2020-10-31T22:28:43.575 INFO:root:teuthology version: 1.0.0-f7de558 2020-10-31T22:28:43.576 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_teuthology@teuthology --lock --verbose --description fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} --archive /home/teuthworker/archive/teuthology-2020-10-28_04:10:03-fs-octopus-distro-basic-smithi/5566789 --block --name teuthology-2020-10-28_04:10:03-fs-octopus-distro-basic-smithi -- /tmp/teuthology-worker.lkvjk7_0.tmp 2020-10-31T22:28:43.612 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-10-31T22:28:43.699 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2020-10-28_04:10:03-fs-octopus-distro-basic-smithi/5566789 branch: octopus description: fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests} email: ceph-qa@ceph.io first_in_suite: false job_id: '5566789' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: teuthology-2020-10-28_04:10:03-fs-octopus-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: octopus ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - evicting unresponsive client - POOL_APP_NOT_ENABLED - has not responded to cap revoke by MDS for over - MDS_CLIENT_LATE_RELEASE - responding to mclientcaps sha1: 5e705cd08d99a37f9ec3c2b451d90f6262257c7c ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 5e705cd08d99a37f9ec3c2b451d90f6262257c7c thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: octopus sha1: 5e705cd08d99a37f9ec3c2b451d90f6262257c7c owner: scheduled_teuthology@teuthology priority: 1000 repo: git://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 sha1: 5e705cd08d99a37f9ec3c2b451d90f6262257c7c sleep_before_teardown: 0 suite: fs suite_branch: octopus suite_path: /home/teuthworker/src/git.ceph.com_ceph_octopus/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph.git suite_sha1: 5e705cd08d99a37f9ec3c2b451d90f6262257c7c tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_misc teuthology_branch: master timestamp: 2020-10-28_04:10:03 tube: smithi user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.11568 2020-10-31T22:28:43.699 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_octopus/qa; will attempt to use it 2020-10-31T22:28:43.700 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_octopus/qa/tasks 2020-10-31T22:28:43.700 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-10-31T22:28:43.706 INFO:teuthology.task.internal:Checking packages... 2020-10-31T22:28:43.727 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '5e705cd08d99a37f9ec3c2b451d90f6262257c7c' 2020-10-31T22:28:43.728 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-10-31T22:28:43.728 INFO:teuthology.packaging:ref: None 2020-10-31T22:28:43.728 INFO:teuthology.packaging:tag: None 2020-10-31T22:28:43.728 INFO:teuthology.packaging:branch: octopus 2020-10-31T22:28:43.729 INFO:teuthology.packaging:sha1: 5e705cd08d99a37f9ec3c2b451d90f6262257c7c 2020-10-31T22:28:43.729 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=octopus 2020-10-31T22:28:44.091 INFO:teuthology.task.internal:Found packages for ceph version 15.2.5-535-g79c1ec4d-1bionic 2020-10-31T22:28:44.092 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-10-31T22:28:44.101 INFO:teuthology.task.internal:no buildpackages task found 2020-10-31T22:28:44.102 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-10-31T22:28:44.127 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-10-31T22:28:44.128 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-10-31T22:28:44.181 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_teuthology@teuthology', 'count': 4, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/teuthology-2020-10-28_04:10:03-fs-octopus-distro-basic-smithi/5566789'} 2020-10-31T22:28:44.204 DEBUG:teuthology.lock.ops:locked ubuntu@smithi060.front.sepia.ceph.com, ubuntu@smithi066.front.sepia.ceph.com, ubuntu@smithi152.front.sepia.ceph.com, ubuntu@smithi085.front.sepia.ceph.com 2020-10-31T22:28:44.324 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f41fd3fd7b8>, signals=[15]) 2020-10-31T22:28:44.538 INFO:teuthology.provision.fog.smithi060:Scheduling deploy of ubuntu 18.04 2020-10-31T22:28:44.568 INFO:teuthology.provision.fog.smithi085:Scheduling deploy of ubuntu 18.04 2020-10-31T22:28:44.598 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of ubuntu 18.04 2020-10-31T22:28:44.607 INFO:teuthology.provision.fog.smithi152:Scheduling deploy of ubuntu 18.04 2020-10-31T22:28:44.895 INFO:teuthology.orchestra.console:Power off smithi060 2020-10-31T22:28:44.896 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-10-31T22:28:44.919 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:44.942 INFO:teuthology.orchestra.console:Power off smithi085 2020-10-31T22:28:44.943 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-10-31T22:28:44.968 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:44.986 INFO:teuthology.orchestra.console:Power off smithi066 2020-10-31T22:28:44.987 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-10-31T22:28:45.002 INFO:teuthology.orchestra.console:Power off smithi152 2020-10-31T22:28:45.003 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-10-31T22:28:45.012 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:45.027 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:48.966 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:49.013 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:49.039 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:49.051 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:53.081 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:53.127 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:53.153 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:53.164 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:53.294 INFO:teuthology.orchestra.console:Power off for smithi060 completed 2020-10-31T22:28:53.395 INFO:teuthology.orchestra.console:Power on smithi060 2020-10-31T22:28:53.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-10-31T22:28:53.416 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:57.239 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:57.265 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:57.276 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:57.439 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:57.452 INFO:teuthology.orchestra.console:Power off for smithi085 completed 2020-10-31T22:28:57.477 INFO:teuthology.orchestra.console:Power off for smithi066 completed 2020-10-31T22:28:57.489 INFO:teuthology.orchestra.console:Power off for smithi152 completed 2020-10-31T22:28:57.553 INFO:teuthology.orchestra.console:Power on smithi085 2020-10-31T22:28:57.554 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-10-31T22:28:57.578 INFO:teuthology.orchestra.console:Power on smithi066 2020-10-31T22:28:57.579 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-10-31T22:28:57.588 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:57.598 INFO:teuthology.orchestra.console:Power on smithi152 2020-10-31T22:28:57.599 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-10-31T22:28:57.608 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:28:57.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:29:01.554 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi060.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:29:01.620 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:29:01.631 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:29:01.642 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:29:01.768 INFO:teuthology.orchestra.console:Power on for smithi060 completed 2020-10-31T22:29:01.870 INFO:teuthology.provision.fog.smithi060:Waiting for deploy to finish 2020-10-31T22:29:05.734 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi085.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:29:05.746 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:29:05.755 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-10-31T22:29:05.948 INFO:teuthology.orchestra.console:Power on for smithi085 completed 2020-10-31T22:29:05.969 INFO:teuthology.orchestra.console:Power on for smithi152 completed 2020-10-31T22:29:06.009 INFO:teuthology.orchestra.console:Power on for smithi066 completed 2020-10-31T22:29:06.050 INFO:teuthology.provision.fog.smithi085:Waiting for deploy to finish 2020-10-31T22:29:06.070 INFO:teuthology.provision.fog.smithi152:Waiting for deploy to finish 2020-10-31T22:29:06.110 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2020-10-31T22:31:33.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:31:42.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:31:51.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:31:52.357 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:00.338 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:01.423 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:07.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:07.525 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:09.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:10.480 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:16.466 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:16.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:18.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:19.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:25.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:25.651 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:28.591 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:34.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:34.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:37.650 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:43.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:43.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:46.736 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:52.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:52.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:55.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:32:55.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:33:01.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:33:01.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:33:01.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:33:02.013 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-10-31T22:33:08.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:33:08.030 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2020-10-31T22:33:10.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:33:14.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:33:20.059 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:33:20.139 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-10-31T22:33:20.142 INFO:teuthology.orchestra.run.smithi060:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-10-31T22:33:20.469 INFO:teuthology.provision.fog.smithi060:Node is ready 2020-10-31T22:33:20.470 INFO:teuthology.orchestra.run.smithi060:> hostname 2020-10-31T22:33:20.523 INFO:teuthology.orchestra.run.smithi060.stdout:smithi060.front.sepia.ceph.com 2020-10-31T22:33:20.523 INFO:teuthology.orchestra.run.smithi060:> grep smithi060.front.sepia.ceph.com /etc/hosts 2020-10-31T22:33:20.574 INFO:teuthology.orchestra.run.smithi060.stdout:172.21.15.60 smithi060.front.sepia.ceph.com smithi060 2020-10-31T22:33:20.576 INFO:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2020-10-31T22:33:20.652 INFO:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hosts 2020-10-31T22:33:20.708 INFO:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/172.21.15.60/172.21.15.60/g' /etc/hosts 2020-10-31T22:33:20.789 INFO:teuthology.orchestra.run.smithi060:> sudo sed -i -e 's/smithi060.front.sepia.ceph.com/smithi060/g' /etc/hostname 2020-10-31T22:33:20.830 INFO:teuthology.orchestra.run.smithi060:> sudo hostname smithi060 2020-10-31T22:33:20.892 INFO:teuthology.provision.fog.smithi060:Deploy complete! 2020-10-31T22:33:20.893 DEBUG:teuthology.parallel:result is None 2020-10-31T22:34:01.802 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:34:01.900 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-10-31T22:34:01.901 INFO:teuthology.orchestra.run.smithi085:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-10-31T22:34:02.307 INFO:teuthology.provision.fog.smithi085:Node is ready 2020-10-31T22:34:02.307 INFO:teuthology.orchestra.run.smithi085:> hostname 2020-10-31T22:34:02.357 INFO:teuthology.orchestra.run.smithi085.stdout:smithi085.front.sepia.ceph.com 2020-10-31T22:34:02.359 INFO:teuthology.orchestra.run.smithi085:> grep smithi085.front.sepia.ceph.com /etc/hosts 2020-10-31T22:34:02.405 INFO:teuthology.orchestra.run.smithi085.stdout:172.21.15.85 smithi085.front.sepia.ceph.com smithi085 2020-10-31T22:34:02.405 INFO:teuthology.orchestra.run.smithi085:> sudo hostname smithi085 2020-10-31T22:34:02.537 INFO:teuthology.orchestra.run.smithi085:> sudo sed -i -e 's/smithi085.front.sepia.ceph.com/smithi085/g' /etc/hosts 2020-10-31T22:34:02.553 INFO:teuthology.orchestra.run.smithi085:> sudo sed -i -e 's/172.21.15.85/172.21.15.85/g' /etc/hosts 2020-10-31T22:34:02.610 INFO:teuthology.orchestra.run.smithi085:> sudo sed -i -e 's/smithi085.front.sepia.ceph.com/smithi085/g' /etc/hostname 2020-10-31T22:34:02.663 INFO:teuthology.orchestra.run.smithi085:> sudo hostname smithi085 2020-10-31T22:34:02.719 INFO:teuthology.provision.fog.smithi085:Deploy complete! 2020-10-31T22:34:02.720 DEBUG:teuthology.parallel:result is None 2020-10-31T22:34:07.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:34:07.996 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-10-31T22:34:07.997 INFO:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-10-31T22:34:08.323 INFO:teuthology.provision.fog.smithi066:Node is ready 2020-10-31T22:34:08.324 INFO:teuthology.orchestra.run.smithi066:> hostname 2020-10-31T22:34:08.372 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2020-10-31T22:34:08.372 INFO:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts 2020-10-31T22:34:08.419 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2020-10-31T22:34:08.420 INFO:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2020-10-31T22:34:08.518 INFO:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts 2020-10-31T22:34:08.535 INFO:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts 2020-10-31T22:34:08.592 INFO:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname 2020-10-31T22:34:08.649 INFO:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2020-10-31T22:34:08.704 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2020-10-31T22:34:08.705 DEBUG:teuthology.parallel:result is None 2020-10-31T22:34:16.807 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:34:16.885 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-10-31T22:34:16.885 INFO:teuthology.orchestra.run.smithi152:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-10-31T22:34:17.287 INFO:teuthology.provision.fog.smithi152:Node is ready 2020-10-31T22:34:17.287 INFO:teuthology.orchestra.run.smithi152:> hostname 2020-10-31T22:34:17.333 INFO:teuthology.orchestra.run.smithi152.stdout:smithi152.front.sepia.ceph.com 2020-10-31T22:34:17.334 INFO:teuthology.orchestra.run.smithi152:> grep smithi152.front.sepia.ceph.com /etc/hosts 2020-10-31T22:34:17.382 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.15.152 smithi152.front.sepia.ceph.com smithi152 2020-10-31T22:34:17.382 INFO:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2020-10-31T22:34:17.455 INFO:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hosts 2020-10-31T22:34:17.511 INFO:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/172.21.15.152/172.21.15.152/g' /etc/hosts 2020-10-31T22:34:17.572 INFO:teuthology.orchestra.run.smithi152:> sudo sed -i -e 's/smithi152.front.sepia.ceph.com/smithi152/g' /etc/hostname 2020-10-31T22:34:17.629 INFO:teuthology.orchestra.run.smithi152:> sudo hostname smithi152 2020-10-31T22:34:17.686 INFO:teuthology.provision.fog.smithi152:Deploy complete! 2020-10-31T22:34:17.686 DEBUG:teuthology.parallel:result is None 2020-10-31T22:34:17.901 INFO:teuthology.lock.ops:Checking smithi060.front.sepia.ceph.com 2020-10-31T22:34:17.902 INFO:teuthology.lock.ops:New key found. Updating... 2020-10-31T22:34:17.920 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2020-10-31T22:34:17.921 INFO:teuthology.lock.ops:New key found. Updating... 2020-10-31T22:34:17.933 INFO:teuthology.lock.ops:Checking smithi152.front.sepia.ceph.com 2020-10-31T22:34:17.933 INFO:teuthology.lock.ops:New key found. Updating... 2020-10-31T22:34:17.945 INFO:teuthology.lock.ops:Checking smithi085.front.sepia.ceph.com 2020-10-31T22:34:17.945 INFO:teuthology.lock.ops:New key found. Updating... 2020-10-31T22:34:17.959 INFO:teuthology.lock.ops:Updating [smithi060.front.sepia.ceph.com]: set os type and version on server 2020-10-31T22:34:17.959 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-10-31T22:34:17.960 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:34:18.034 INFO:teuthology.orchestra.run.smithi060:> true 2020-10-31T22:34:18.235 INFO:teuthology.orchestra.run.smithi060:> uname -m 2020-10-31T22:34:18.283 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2020-10-31T22:34:18.283 INFO:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2020-10-31T22:34:18.328 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Ubuntu" 2020-10-31T22:34:18.329 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-10-31T22:34:18.329 INFO:teuthology.orchestra.run.smithi060.stdout:ID=ubuntu 2020-10-31T22:34:18.329 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE=debian 2020-10-31T22:34:18.329 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-10-31T22:34:18.329 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="18.04" 2020-10-31T22:34:18.329 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.ubuntu.com/" 2020-10-31T22:34:18.330 INFO:teuthology.orchestra.run.smithi060.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-10-31T22:34:18.330 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-10-31T22:34:18.331 INFO:teuthology.orchestra.run.smithi060.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-10-31T22:34:18.331 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_CODENAME=bionic 2020-10-31T22:34:18.331 INFO:teuthology.orchestra.run.smithi060.stdout:UBUNTU_CODENAME=bionic 2020-10-31T22:34:18.332 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2020-10-31T22:34:18.350 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2020-10-31T22:34:18.351 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-10-31T22:34:18.352 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:34:18.427 INFO:teuthology.orchestra.run.smithi066:> true 2020-10-31T22:34:18.679 INFO:teuthology.orchestra.run.smithi066:> uname -m 2020-10-31T22:34:18.726 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2020-10-31T22:34:18.727 INFO:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2020-10-31T22:34:18.775 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Ubuntu" 2020-10-31T22:34:18.775 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-10-31T22:34:18.775 INFO:teuthology.orchestra.run.smithi066.stdout:ID=ubuntu 2020-10-31T22:34:18.775 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE=debian 2020-10-31T22:34:18.775 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-10-31T22:34:18.776 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="18.04" 2020-10-31T22:34:18.776 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.ubuntu.com/" 2020-10-31T22:34:18.776 INFO:teuthology.orchestra.run.smithi066.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-10-31T22:34:18.776 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-10-31T22:34:18.776 INFO:teuthology.orchestra.run.smithi066.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-10-31T22:34:18.776 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_CODENAME=bionic 2020-10-31T22:34:18.776 INFO:teuthology.orchestra.run.smithi066.stdout:UBUNTU_CODENAME=bionic 2020-10-31T22:34:18.777 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2020-10-31T22:34:18.792 INFO:teuthology.lock.ops:Updating [smithi152.front.sepia.ceph.com]: set os type and version on server 2020-10-31T22:34:18.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-10-31T22:34:18.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:34:18.868 INFO:teuthology.orchestra.run.smithi152:> true 2020-10-31T22:34:19.059 INFO:teuthology.orchestra.run.smithi152:> uname -m 2020-10-31T22:34:19.105 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2020-10-31T22:34:19.106 INFO:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2020-10-31T22:34:19.153 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Ubuntu" 2020-10-31T22:34:19.153 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-10-31T22:34:19.154 INFO:teuthology.orchestra.run.smithi152.stdout:ID=ubuntu 2020-10-31T22:34:19.154 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE=debian 2020-10-31T22:34:19.154 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-10-31T22:34:19.154 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="18.04" 2020-10-31T22:34:19.154 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.ubuntu.com/" 2020-10-31T22:34:19.155 INFO:teuthology.orchestra.run.smithi152.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-10-31T22:34:19.155 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-10-31T22:34:19.155 INFO:teuthology.orchestra.run.smithi152.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-10-31T22:34:19.155 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_CODENAME=bionic 2020-10-31T22:34:19.156 INFO:teuthology.orchestra.run.smithi152.stdout:UBUNTU_CODENAME=bionic 2020-10-31T22:34:19.156 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2020-10-31T22:34:19.174 INFO:teuthology.lock.ops:Updating [smithi085.front.sepia.ceph.com]: set os type and version on server 2020-10-31T22:34:19.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-10-31T22:34:19.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:34:19.253 INFO:teuthology.orchestra.run.smithi085:> true 2020-10-31T22:34:19.507 INFO:teuthology.orchestra.run.smithi085:> uname -m 2020-10-31T22:34:19.557 INFO:teuthology.orchestra.run.smithi085.stdout:x86_64 2020-10-31T22:34:19.557 INFO:teuthology.orchestra.run.smithi085:> cat /etc/os-release 2020-10-31T22:34:19.604 INFO:teuthology.orchestra.run.smithi085.stdout:NAME="Ubuntu" 2020-10-31T22:34:19.605 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-10-31T22:34:19.605 INFO:teuthology.orchestra.run.smithi085.stdout:ID=ubuntu 2020-10-31T22:34:19.605 INFO:teuthology.orchestra.run.smithi085.stdout:ID_LIKE=debian 2020-10-31T22:34:19.605 INFO:teuthology.orchestra.run.smithi085.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-10-31T22:34:19.606 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_ID="18.04" 2020-10-31T22:34:19.606 INFO:teuthology.orchestra.run.smithi085.stdout:HOME_URL="https://www.ubuntu.com/" 2020-10-31T22:34:19.606 INFO:teuthology.orchestra.run.smithi085.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-10-31T22:34:19.606 INFO:teuthology.orchestra.run.smithi085.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-10-31T22:34:19.606 INFO:teuthology.orchestra.run.smithi085.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-10-31T22:34:19.607 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_CODENAME=bionic 2020-10-31T22:34:19.607 INFO:teuthology.orchestra.run.smithi085.stdout:UBUNTU_CODENAME=bionic 2020-10-31T22:34:19.607 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2020-10-31T22:34:19.625 INFO:teuthology.task.internal.lock_machines:4 smithi machines locked this try, 4/4 locked so far 2020-10-31T22:34:19.698 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi060.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDWcV67rIubjV46XiMWEL/VfqIVRCXlBSW18ydg2bOr3vA7ge7zLbhtQNi+8ASIS06CCZh5C+oOPaBND1i1nDgxqX8tWaMMl5DW/fgQqwZnM9/E4UOyiXc0CLuJtfeACMbM4+W273M83RdmrPP0DEojAXSoF0XD9SbhEy9bMdLasnN16kUc5Jj9Fr2K6T154pSQfanWh9atxNLc3QPoz8tLUMFfUeRluG2tfo7hY1Mb/yZDa7/zVACVGjFsw1CKM/v2kiBb7/M/TNled7AB2cNCN9QwaqIDJzU80wen9klSj7wbXDZcu/mLNDZqvO6f8fZDZeIMnHCeQ5NKyT2k/d8B smithi066.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUmtf5I+gMDboWsUAqE8fMfLbnvii5X13JFbkiCyjbSuF2I8Be2kbM5OdukucKS0gIz0TWQ+K0VKTYpX18bR1n2uYdUtjpWHV2D2vdUgZ7XeGefiGepmCaTY1JZR652nxrUEFkVUupGBi+pqsz9QX8Z5GNkCQyreDzrLxaP7fMhdckWC9EoivNX0ofdLbv+bqXjEy3SDU1kz4HYTyQtiG0J0ZJ0WT3LTSHmHSEv4M3rF3xG4j49IdCxlNzOhMYnKssBxiu6JL6wfsu3l59/iemFcBu7s21T6xfFWV7EKMxyxTSmvzsg/gt05PvHFpaWRGtYL8E1W/LvMWVggZKPcQ3 smithi085.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwLR4Jg4mPzJUDBu2nL5ZMVGV1xl9sJhCm12V4ITuDfzTGc4XyuG3bZOY6ykylGAQZkBk384EIAei8/o8J9Az7CkeREhd7gWMd+XT5tcR1O+KOvwsbLaHPNKAd4ENDu9D6yXN/ukSVXPK6Z6V9Z/M7BTYmHDC5jOYKMRKlXhDlpfDMt5ceic6B0Y+A/I8VX8MgkfNspvZj7kv4Iw32RRS/NYogX9KQncWFT9stYDPw2FxKceXM9Mp2Ps8MvDP6pTr0l/PZnxFvicuYG0LtImg5QK0/BXbdgyCYnA3JrPrJeLfZ8dSDpJwdU9Z/01/W+nKjuEirIUWdLp7Ukjr7Dxl smithi152.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDI7VH3P/0jj/bpNM37MxDJidqSZ7mUTL9EZVptwMLW/qB8cM+ydaTbyfTVUBoymxVhtGvgSu8+7LC3od06LuDYnxrT9ioHc0547U5o5RoBrEuNlb56K+iMmBOIMru/fWhiPmkrsKdFRViAT05OAEQQLnHEMd4tXPztnyjXEQCBDbRo7lxg6g6m15hPwo/R3F12IROKfr8AiNWweQCZqVl0kPYrgX/+ni3/C5i2I829wm7lAEVquUgUdz2jnu/kgbDxBb9k6GezGmXNtUVvte0q5WX8ga6xwtRb72GstJ87BgSF4LD3wcwJfS8QP1nfQ5KjaJ0Nh7rMb1QKI/dgNO1V 2020-10-31T22:34:19.698 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-10-31T22:34:19.761 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-10-31T22:34:19.768 INFO:teuthology.task.internal:Saving configuration 2020-10-31T22:34:19.785 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-10-31T22:34:19.899 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-10-31T22:34:19.917 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-10-31 22:28:44.189120', 'description': '/home/teuthworker/archive/teuthology-2020-10-28_04:10:03-fs-octopus-distro-basic-smithi/5566789', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHS8bCdwY12sgW/NgHgubmaF7QrRdDIW4tps9kTnakf7', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi060.front.sepia.ceph.com'} 2020-10-31T22:34:19.935 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-10-31 22:28:44.189139', 'description': '/home/teuthworker/archive/teuthology-2020-10-28_04:10:03-fs-octopus-distro-basic-smithi/5566789', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIvg3bXAeBYrn/VgBRVuxoV2QHTMmF6w6ZfBKoSTF1V1', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi066.front.sepia.ceph.com'} 2020-10-31T22:34:19.954 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-10-31 22:28:44.189155', 'description': '/home/teuthworker/archive/teuthology-2020-10-28_04:10:03-fs-octopus-distro-basic-smithi/5566789', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAVjnlvFhSYMybeRxNve6NJQTMbTXghSi3vhpaY/PbF5', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi152.front.sepia.ceph.com'} 2020-10-31T22:34:19.970 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-10-31 22:28:44.189189', 'description': '/home/teuthworker/archive/teuthology-2020-10-28_04:10:03-fs-octopus-distro-basic-smithi/5566789', 'locked_by': 'scheduled_teuthology@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHUFNY476W8+4bU7+PEWah+pGRe9RpOh3Vze1d8RMU4I', 'os_version': '18.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi085.front.sepia.ceph.com'} 2020-10-31T22:34:19.971 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-10-31T22:34:19.979 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2020-10-31T22:34:19.979 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2020-10-31T22:34:19.979 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['client.0'] 2020-10-31T22:34:19.979 INFO:teuthology.task.internal:roles: ubuntu@smithi085.front.sepia.ceph.com - ['client.1'] 2020-10-31T22:34:19.980 INFO:teuthology.run_tasks:Running task console_log... 2020-10-31T22:34:20.110 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f41fd3b5bf8>, signals=[15]) 2020-10-31T22:34:20.111 INFO:teuthology.run_tasks:Running task internal.connect... 2020-10-31T22:34:20.121 INFO:teuthology.task.internal:Opening connections... 2020-10-31T22:34:20.121 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2020-10-31T22:34:20.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:34:20.247 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2020-10-31T22:34:20.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:34:20.323 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2020-10-31T22:34:20.324 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:34:20.402 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi085.front.sepia.ceph.com 2020-10-31T22:34:20.403 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:34:20.480 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-10-31T22:34:20.490 INFO:teuthology.orchestra.run.smithi060:> uname -m 2020-10-31T22:34:20.497 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2020-10-31T22:34:20.498 INFO:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2020-10-31T22:34:20.544 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="Ubuntu" 2020-10-31T22:34:20.544 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-10-31T22:34:20.545 INFO:teuthology.orchestra.run.smithi060.stdout:ID=ubuntu 2020-10-31T22:34:20.545 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE=debian 2020-10-31T22:34:20.545 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-10-31T22:34:20.546 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="18.04" 2020-10-31T22:34:20.546 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://www.ubuntu.com/" 2020-10-31T22:34:20.546 INFO:teuthology.orchestra.run.smithi060.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-10-31T22:34:20.546 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-10-31T22:34:20.547 INFO:teuthology.orchestra.run.smithi060.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-10-31T22:34:20.547 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_CODENAME=bionic 2020-10-31T22:34:20.547 INFO:teuthology.orchestra.run.smithi060.stdout:UBUNTU_CODENAME=bionic 2020-10-31T22:34:20.548 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2020-10-31T22:34:20.566 INFO:teuthology.orchestra.run.smithi066:> uname -m 2020-10-31T22:34:20.574 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2020-10-31T22:34:20.575 INFO:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2020-10-31T22:34:20.622 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Ubuntu" 2020-10-31T22:34:20.623 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-10-31T22:34:20.623 INFO:teuthology.orchestra.run.smithi066.stdout:ID=ubuntu 2020-10-31T22:34:20.623 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE=debian 2020-10-31T22:34:20.623 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-10-31T22:34:20.623 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="18.04" 2020-10-31T22:34:20.623 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.ubuntu.com/" 2020-10-31T22:34:20.624 INFO:teuthology.orchestra.run.smithi066.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-10-31T22:34:20.624 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-10-31T22:34:20.624 INFO:teuthology.orchestra.run.smithi066.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-10-31T22:34:20.624 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_CODENAME=bionic 2020-10-31T22:34:20.624 INFO:teuthology.orchestra.run.smithi066.stdout:UBUNTU_CODENAME=bionic 2020-10-31T22:34:20.625 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2020-10-31T22:34:20.639 INFO:teuthology.orchestra.run.smithi152:> uname -m 2020-10-31T22:34:20.645 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2020-10-31T22:34:20.645 INFO:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2020-10-31T22:34:20.693 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="Ubuntu" 2020-10-31T22:34:20.693 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-10-31T22:34:20.693 INFO:teuthology.orchestra.run.smithi152.stdout:ID=ubuntu 2020-10-31T22:34:20.693 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE=debian 2020-10-31T22:34:20.694 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-10-31T22:34:20.694 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="18.04" 2020-10-31T22:34:20.694 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://www.ubuntu.com/" 2020-10-31T22:34:20.694 INFO:teuthology.orchestra.run.smithi152.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-10-31T22:34:20.694 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-10-31T22:34:20.694 INFO:teuthology.orchestra.run.smithi152.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-10-31T22:34:20.695 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_CODENAME=bionic 2020-10-31T22:34:20.695 INFO:teuthology.orchestra.run.smithi152.stdout:UBUNTU_CODENAME=bionic 2020-10-31T22:34:20.695 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2020-10-31T22:34:20.709 INFO:teuthology.orchestra.run.smithi085:> uname -m 2020-10-31T22:34:20.715 INFO:teuthology.orchestra.run.smithi085.stdout:x86_64 2020-10-31T22:34:20.715 INFO:teuthology.orchestra.run.smithi085:> cat /etc/os-release 2020-10-31T22:34:20.764 INFO:teuthology.orchestra.run.smithi085.stdout:NAME="Ubuntu" 2020-10-31T22:34:20.764 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2020-10-31T22:34:20.764 INFO:teuthology.orchestra.run.smithi085.stdout:ID=ubuntu 2020-10-31T22:34:20.765 INFO:teuthology.orchestra.run.smithi085.stdout:ID_LIKE=debian 2020-10-31T22:34:20.765 INFO:teuthology.orchestra.run.smithi085.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2020-10-31T22:34:20.765 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_ID="18.04" 2020-10-31T22:34:20.765 INFO:teuthology.orchestra.run.smithi085.stdout:HOME_URL="https://www.ubuntu.com/" 2020-10-31T22:34:20.765 INFO:teuthology.orchestra.run.smithi085.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2020-10-31T22:34:20.765 INFO:teuthology.orchestra.run.smithi085.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2020-10-31T22:34:20.765 INFO:teuthology.orchestra.run.smithi085.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2020-10-31T22:34:20.766 INFO:teuthology.orchestra.run.smithi085.stdout:VERSION_CODENAME=bionic 2020-10-31T22:34:20.766 INFO:teuthology.orchestra.run.smithi085.stdout:UBUNTU_CODENAME=bionic 2020-10-31T22:34:20.766 INFO:teuthology.lock.ops:Updating smithi085.front.sepia.ceph.com on lock server 2020-10-31T22:34:20.780 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-10-31T22:34:20.799 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-10-31T22:34:20.809 INFO:teuthology.task.internal:Checking for old test directory... 2020-10-31T22:34:20.810 INFO:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2020-10-31T22:34:20.813 INFO:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2020-10-31T22:34:20.815 INFO:teuthology.orchestra.run.smithi085:> test '!' -e /home/ubuntu/cephtest 2020-10-31T22:34:20.817 INFO:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2020-10-31T22:34:20.823 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-10-31T22:34:20.833 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-10-31T22:34:20.834 INFO:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2020-10-31T22:34:20.860 INFO:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2020-10-31T22:34:20.863 INFO:teuthology.orchestra.run.smithi085:> test -z $(ls -A /var/lib/ceph) 2020-10-31T22:34:20.865 INFO:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2020-10-31T22:34:20.879 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-10-31T22:34:20.956 INFO:teuthology.run_tasks:Running task kernel... 2020-10-31T22:34:20.972 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'mds.a': {'kdb': True, 'sha1': 'distro'}, 'mds.c': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mds.b': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}} 2020-10-31T22:34:20.973 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2020-10-31T22:34:20.973 INFO:teuthology.orchestra.run.smithi060:> uname -r 2020-10-31T22:34:20.979 INFO:teuthology.orchestra.run.smithi060.stdout:4.15.0-122-generic 2020-10-31T22:34:20.980 INFO:teuthology.task.kernel:Running kernel on smithi060: 4.15.0-122-generic 2020-10-31T22:34:20.980 INFO:teuthology.orchestra.run.smithi060:> sudo apt-get clean 2020-10-31T22:34:21.128 INFO:teuthology.orchestra.run.smithi060:> sudo apt-get update 2020-10-31T22:34:21.397 INFO:teuthology.orchestra.run.smithi060.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-10-31T22:34:21.398 INFO:teuthology.orchestra.run.smithi060.stdout:Get:2 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-10-31T22:34:21.458 INFO:teuthology.orchestra.run.smithi060.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-10-31T22:34:21.710 INFO:teuthology.orchestra.run.smithi060.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-10-31T22:34:21.791 INFO:teuthology.orchestra.run.smithi060.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [846 kB] 2020-10-31T22:34:21.921 INFO:teuthology.orchestra.run.smithi060.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,140 kB] 2020-10-31T22:34:22.174 INFO:teuthology.orchestra.run.smithi060.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,399 kB] 2020-10-31T22:34:22.256 INFO:teuthology.orchestra.run.smithi060.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,726 kB] 2020-10-31T22:34:22.285 INFO:teuthology.orchestra.run.smithi060.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [276 kB] 2020-10-31T22:34:22.307 INFO:teuthology.orchestra.run.smithi060.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [166 kB] 2020-10-31T22:34:22.316 INFO:teuthology.orchestra.run.smithi060.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [22.1 kB] 2020-10-31T22:34:22.317 INFO:teuthology.orchestra.run.smithi060.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [965 kB] 2020-10-31T22:34:22.353 INFO:teuthology.orchestra.run.smithi060.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,079 kB] 2020-10-31T22:34:22.354 INFO:teuthology.orchestra.run.smithi060.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [367 kB] 2020-10-31T22:34:22.371 INFO:teuthology.orchestra.run.smithi060.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [184 kB] 2020-10-31T22:34:22.378 INFO:teuthology.orchestra.run.smithi060.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [24.6 kB] 2020-10-31T22:34:22.380 INFO:teuthology.orchestra.run.smithi060.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,683 kB] 2020-10-31T22:34:22.385 INFO:teuthology.orchestra.run.smithi060.stdout:Get:18 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [241 kB] 2020-10-31T22:34:22.425 INFO:teuthology.orchestra.run.smithi060.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,544 kB] 2020-10-31T22:34:22.462 INFO:teuthology.orchestra.run.smithi060.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [354 kB] 2020-10-31T22:34:24.215 INFO:teuthology.orchestra.run.smithi060.stdout:Fetched 12.3 MB in 3s (4,262 kB/s) 2020-10-31T22:34:25.674 INFO:teuthology.orchestra.run.smithi060.stdout:Reading package lists... 2020-10-31T22:34:25.721 INFO:teuthology.orchestra.run.smithi060:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-10-31T22:34:25.818 INFO:teuthology.orchestra.run.smithi060.stdout:Reading package lists... 2020-10-31T22:34:26.082 INFO:teuthology.orchestra.run.smithi060.stdout:Building dependency tree... 2020-10-31T22:34:26.083 INFO:teuthology.orchestra.run.smithi060.stdout:Reading state information... 2020-10-31T22:34:26.178 INFO:teuthology.orchestra.run.smithi060.stderr:E: Unable to locate package linux-image-current-generic 2020-10-31T22:34:26.179 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-10-31T22:34:26.180 INFO:teuthology.orchestra.run.smithi060:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-10-31T22:34:26.263 INFO:teuthology.orchestra.run.smithi060.stdout:Reading package lists... 2020-10-31T22:34:26.532 INFO:teuthology.orchestra.run.smithi060.stdout:Building dependency tree... 2020-10-31T22:34:26.532 INFO:teuthology.orchestra.run.smithi060.stdout:Reading state information... 2020-10-31T22:34:26.760 INFO:teuthology.orchestra.run.smithi060.stdout:linux-image-generic is already the newest version (4.15.0.122.109). 2020-10-31T22:34:26.760 INFO:teuthology.orchestra.run.smithi060.stdout:linux-image-generic set to manually installed. 2020-10-31T22:34:26.760 INFO:teuthology.orchestra.run.smithi060.stdout:0 upgraded, 0 newly installed, 0 to remove and 14 not upgraded. 2020-10-31T22:34:26.761 INFO:teuthology.orchestra.run.smithi060:> dpkg -s linux-image-generic 2020-10-31T22:34:26.777 INFO:teuthology.orchestra.run.smithi060.stdout:Package: linux-image-generic 2020-10-31T22:34:26.778 INFO:teuthology.orchestra.run.smithi060.stdout:Status: install ok installed 2020-10-31T22:34:26.778 INFO:teuthology.orchestra.run.smithi060.stdout:Priority: optional 2020-10-31T22:34:26.778 INFO:teuthology.orchestra.run.smithi060.stdout:Section: kernel 2020-10-31T22:34:26.778 INFO:teuthology.orchestra.run.smithi060.stdout:Installed-Size: 16 2020-10-31T22:34:26.778 INFO:teuthology.orchestra.run.smithi060.stdout:Maintainer: Ubuntu Kernel Team 2020-10-31T22:34:26.778 INFO:teuthology.orchestra.run.smithi060.stdout:Architecture: amd64 2020-10-31T22:34:26.779 INFO:teuthology.orchestra.run.smithi060.stdout:Source: linux-meta 2020-10-31T22:34:26.779 INFO:teuthology.orchestra.run.smithi060.stdout:Version: 4.15.0.122.109 2020-10-31T22:34:26.779 INFO:teuthology.orchestra.run.smithi060.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-10-31T22:34:26.779 INFO:teuthology.orchestra.run.smithi060.stdout:Depends: linux-image-4.15.0-122-generic, linux-modules-extra-4.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2020-10-31T22:34:26.779 INFO:teuthology.orchestra.run.smithi060.stdout:Recommends: thermald 2020-10-31T22:34:26.779 INFO:teuthology.orchestra.run.smithi060.stdout:Description: Generic Linux kernel image 2020-10-31T22:34:26.779 INFO:teuthology.orchestra.run.smithi060.stdout: This package will always depend on the latest generic kernel image 2020-10-31T22:34:26.780 INFO:teuthology.orchestra.run.smithi060.stdout: available. 2020-10-31T22:34:26.780 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-10-31T22:34:26.780 INFO:teuthology.orchestra.run.smithi066:> uname -r 2020-10-31T22:34:26.786 INFO:teuthology.orchestra.run.smithi066.stdout:4.15.0-122-generic 2020-10-31T22:34:26.787 INFO:teuthology.task.kernel:Running kernel on smithi066: 4.15.0-122-generic 2020-10-31T22:34:26.787 INFO:teuthology.orchestra.run.smithi066:> sudo apt-get clean 2020-10-31T22:34:26.915 INFO:teuthology.orchestra.run.smithi066:> sudo apt-get update 2020-10-31T22:34:27.049 INFO:teuthology.orchestra.run.smithi066.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-10-31T22:34:27.174 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-10-31T22:34:27.255 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-10-31T22:34:27.305 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [846 kB] 2020-10-31T22:34:27.398 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,399 kB] 2020-10-31T22:34:27.432 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [276 kB] 2020-10-31T22:34:27.433 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [166 kB] 2020-10-31T22:34:27.435 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [22.1 kB] 2020-10-31T22:34:27.435 INFO:teuthology.orchestra.run.smithi066.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,079 kB] 2020-10-31T22:34:27.446 INFO:teuthology.orchestra.run.smithi066.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [965 kB] 2020-10-31T22:34:27.455 INFO:teuthology.orchestra.run.smithi066.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [241 kB] 2020-10-31T22:34:27.577 INFO:teuthology.orchestra.run.smithi066.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-10-31T22:34:27.720 INFO:teuthology.orchestra.run.smithi066.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,726 kB] 2020-10-31T22:34:28.087 INFO:teuthology.orchestra.run.smithi066.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,140 kB] 2020-10-31T22:34:28.144 INFO:teuthology.orchestra.run.smithi066.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [367 kB] 2020-10-31T22:34:28.160 INFO:teuthology.orchestra.run.smithi066.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [184 kB] 2020-10-31T22:34:28.166 INFO:teuthology.orchestra.run.smithi066.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [24.6 kB] 2020-10-31T22:34:28.167 INFO:teuthology.orchestra.run.smithi066.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,544 kB] 2020-10-31T22:34:28.211 INFO:teuthology.orchestra.run.smithi066.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,683 kB] 2020-10-31T22:34:28.254 INFO:teuthology.orchestra.run.smithi066.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [354 kB] 2020-10-31T22:34:29.132 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 12.3 MB in 2s (6,117 kB/s) 2020-10-31T22:34:30.547 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2020-10-31T22:34:30.594 INFO:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-10-31T22:34:30.671 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2020-10-31T22:34:30.929 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2020-10-31T22:34:30.930 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2020-10-31T22:34:31.021 INFO:teuthology.orchestra.run.smithi066.stderr:E: Unable to locate package linux-image-current-generic 2020-10-31T22:34:31.022 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-10-31T22:34:31.022 INFO:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-10-31T22:34:31.104 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2020-10-31T22:34:31.344 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2020-10-31T22:34:31.345 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2020-10-31T22:34:31.566 INFO:teuthology.orchestra.run.smithi066.stdout:linux-image-generic is already the newest version (4.15.0.122.109). 2020-10-31T22:34:31.566 INFO:teuthology.orchestra.run.smithi066.stdout:linux-image-generic set to manually installed. 2020-10-31T22:34:31.566 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 0 newly installed, 0 to remove and 14 not upgraded. 2020-10-31T22:34:31.568 INFO:teuthology.orchestra.run.smithi066:> dpkg -s linux-image-generic 2020-10-31T22:34:31.590 INFO:teuthology.orchestra.run.smithi066.stdout:Package: linux-image-generic 2020-10-31T22:34:31.591 INFO:teuthology.orchestra.run.smithi066.stdout:Status: install ok installed 2020-10-31T22:34:31.591 INFO:teuthology.orchestra.run.smithi066.stdout:Priority: optional 2020-10-31T22:34:31.591 INFO:teuthology.orchestra.run.smithi066.stdout:Section: kernel 2020-10-31T22:34:31.591 INFO:teuthology.orchestra.run.smithi066.stdout:Installed-Size: 16 2020-10-31T22:34:31.592 INFO:teuthology.orchestra.run.smithi066.stdout:Maintainer: Ubuntu Kernel Team 2020-10-31T22:34:31.592 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: amd64 2020-10-31T22:34:31.592 INFO:teuthology.orchestra.run.smithi066.stdout:Source: linux-meta 2020-10-31T22:34:31.592 INFO:teuthology.orchestra.run.smithi066.stdout:Version: 4.15.0.122.109 2020-10-31T22:34:31.592 INFO:teuthology.orchestra.run.smithi066.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-10-31T22:34:31.592 INFO:teuthology.orchestra.run.smithi066.stdout:Depends: linux-image-4.15.0-122-generic, linux-modules-extra-4.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2020-10-31T22:34:31.593 INFO:teuthology.orchestra.run.smithi066.stdout:Recommends: thermald 2020-10-31T22:34:31.593 INFO:teuthology.orchestra.run.smithi066.stdout:Description: Generic Linux kernel image 2020-10-31T22:34:31.593 INFO:teuthology.orchestra.run.smithi066.stdout: This package will always depend on the latest generic kernel image 2020-10-31T22:34:31.593 INFO:teuthology.orchestra.run.smithi066.stdout: available. 2020-10-31T22:34:31.593 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-10-31T22:34:31.594 INFO:teuthology.orchestra.run.smithi152:> uname -r 2020-10-31T22:34:31.599 INFO:teuthology.orchestra.run.smithi152.stdout:4.15.0-122-generic 2020-10-31T22:34:31.600 INFO:teuthology.task.kernel:Running kernel on smithi152: 4.15.0-122-generic 2020-10-31T22:34:31.600 INFO:teuthology.orchestra.run.smithi152:> sudo apt-get clean 2020-10-31T22:34:31.763 INFO:teuthology.orchestra.run.smithi152:> sudo apt-get update 2020-10-31T22:34:31.883 INFO:teuthology.orchestra.run.smithi152.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-10-31T22:34:32.007 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-10-31T22:34:32.086 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-10-31T22:34:32.135 INFO:teuthology.orchestra.run.smithi152.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,399 kB] 2020-10-31T22:34:32.238 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [846 kB] 2020-10-31T22:34:32.265 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [276 kB] 2020-10-31T22:34:32.265 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [166 kB] 2020-10-31T22:34:32.265 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [22.1 kB] 2020-10-31T22:34:32.266 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [965 kB] 2020-10-31T22:34:32.282 INFO:teuthology.orchestra.run.smithi152.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,079 kB] 2020-10-31T22:34:32.293 INFO:teuthology.orchestra.run.smithi152.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [241 kB] 2020-10-31T22:34:32.386 INFO:teuthology.orchestra.run.smithi152.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-10-31T22:34:32.507 INFO:teuthology.orchestra.run.smithi152.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,726 kB] 2020-10-31T22:34:32.901 INFO:teuthology.orchestra.run.smithi152.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,140 kB] 2020-10-31T22:34:32.936 INFO:teuthology.orchestra.run.smithi152.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [367 kB] 2020-10-31T22:34:32.947 INFO:teuthology.orchestra.run.smithi152.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [184 kB] 2020-10-31T22:34:32.953 INFO:teuthology.orchestra.run.smithi152.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [24.6 kB] 2020-10-31T22:34:32.954 INFO:teuthology.orchestra.run.smithi152.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,544 kB] 2020-10-31T22:34:33.023 INFO:teuthology.orchestra.run.smithi152.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,683 kB] 2020-10-31T22:34:33.075 INFO:teuthology.orchestra.run.smithi152.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [354 kB] 2020-10-31T22:34:33.916 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 12.3 MB in 2s (6,298 kB/s) 2020-10-31T22:34:35.288 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2020-10-31T22:34:35.335 INFO:teuthology.orchestra.run.smithi152:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-10-31T22:34:35.413 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2020-10-31T22:34:35.640 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree... 2020-10-31T22:34:35.641 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information... 2020-10-31T22:34:35.719 INFO:teuthology.orchestra.run.smithi152.stderr:E: Unable to locate package linux-image-current-generic 2020-10-31T22:34:35.720 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-10-31T22:34:35.721 INFO:teuthology.orchestra.run.smithi152:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-10-31T22:34:35.799 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2020-10-31T22:34:36.054 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree... 2020-10-31T22:34:36.054 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information... 2020-10-31T22:34:36.257 INFO:teuthology.orchestra.run.smithi152.stdout:linux-image-generic is already the newest version (4.15.0.122.109). 2020-10-31T22:34:36.257 INFO:teuthology.orchestra.run.smithi152.stdout:linux-image-generic set to manually installed. 2020-10-31T22:34:36.258 INFO:teuthology.orchestra.run.smithi152.stdout:0 upgraded, 0 newly installed, 0 to remove and 14 not upgraded. 2020-10-31T22:34:36.259 INFO:teuthology.orchestra.run.smithi152:> dpkg -s linux-image-generic 2020-10-31T22:34:36.280 INFO:teuthology.orchestra.run.smithi152.stdout:Package: linux-image-generic 2020-10-31T22:34:36.281 INFO:teuthology.orchestra.run.smithi152.stdout:Status: install ok installed 2020-10-31T22:34:36.281 INFO:teuthology.orchestra.run.smithi152.stdout:Priority: optional 2020-10-31T22:34:36.282 INFO:teuthology.orchestra.run.smithi152.stdout:Section: kernel 2020-10-31T22:34:36.282 INFO:teuthology.orchestra.run.smithi152.stdout:Installed-Size: 16 2020-10-31T22:34:36.282 INFO:teuthology.orchestra.run.smithi152.stdout:Maintainer: Ubuntu Kernel Team 2020-10-31T22:34:36.282 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: amd64 2020-10-31T22:34:36.282 INFO:teuthology.orchestra.run.smithi152.stdout:Source: linux-meta 2020-10-31T22:34:36.283 INFO:teuthology.orchestra.run.smithi152.stdout:Version: 4.15.0.122.109 2020-10-31T22:34:36.283 INFO:teuthology.orchestra.run.smithi152.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-10-31T22:34:36.283 INFO:teuthology.orchestra.run.smithi152.stdout:Depends: linux-image-4.15.0-122-generic, linux-modules-extra-4.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2020-10-31T22:34:36.283 INFO:teuthology.orchestra.run.smithi152.stdout:Recommends: thermald 2020-10-31T22:34:36.283 INFO:teuthology.orchestra.run.smithi152.stdout:Description: Generic Linux kernel image 2020-10-31T22:34:36.284 INFO:teuthology.orchestra.run.smithi152.stdout: This package will always depend on the latest generic kernel image 2020-10-31T22:34:36.284 INFO:teuthology.orchestra.run.smithi152.stdout: available. 2020-10-31T22:34:36.284 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-10-31T22:34:36.285 INFO:teuthology.orchestra.run.smithi085:> uname -r 2020-10-31T22:34:36.292 INFO:teuthology.orchestra.run.smithi085.stdout:4.15.0-122-generic 2020-10-31T22:34:36.292 INFO:teuthology.task.kernel:Running kernel on smithi085: 4.15.0-122-generic 2020-10-31T22:34:36.293 INFO:teuthology.orchestra.run.smithi085:> sudo apt-get clean 2020-10-31T22:34:36.444 INFO:teuthology.orchestra.run.smithi085:> sudo apt-get update 2020-10-31T22:34:36.573 INFO:teuthology.orchestra.run.smithi085.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2020-10-31T22:34:36.697 INFO:teuthology.orchestra.run.smithi085.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-10-31T22:34:36.777 INFO:teuthology.orchestra.run.smithi085.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2020-10-31T22:34:36.843 INFO:teuthology.orchestra.run.smithi085.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,399 kB] 2020-10-31T22:34:36.948 INFO:teuthology.orchestra.run.smithi085.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [846 kB] 2020-10-31T22:34:36.964 INFO:teuthology.orchestra.run.smithi085.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [276 kB] 2020-10-31T22:34:36.966 INFO:teuthology.orchestra.run.smithi085.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [166 kB] 2020-10-31T22:34:36.968 INFO:teuthology.orchestra.run.smithi085.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [22.1 kB] 2020-10-31T22:34:36.968 INFO:teuthology.orchestra.run.smithi085.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [965 kB] 2020-10-31T22:34:36.977 INFO:teuthology.orchestra.run.smithi085.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,079 kB] 2020-10-31T22:34:36.989 INFO:teuthology.orchestra.run.smithi085.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [241 kB] 2020-10-31T22:34:37.070 INFO:teuthology.orchestra.run.smithi085.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2020-10-31T22:34:37.188 INFO:teuthology.orchestra.run.smithi085.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,140 kB] 2020-10-31T22:34:37.539 INFO:teuthology.orchestra.run.smithi085.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,726 kB] 2020-10-31T22:34:37.636 INFO:teuthology.orchestra.run.smithi085.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [367 kB] 2020-10-31T22:34:37.648 INFO:teuthology.orchestra.run.smithi085.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [184 kB] 2020-10-31T22:34:37.655 INFO:teuthology.orchestra.run.smithi085.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [24.6 kB] 2020-10-31T22:34:37.656 INFO:teuthology.orchestra.run.smithi085.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,544 kB] 2020-10-31T22:34:37.710 INFO:teuthology.orchestra.run.smithi085.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,683 kB] 2020-10-31T22:34:37.742 INFO:teuthology.orchestra.run.smithi085.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [354 kB] 2020-10-31T22:34:38.610 INFO:teuthology.orchestra.run.smithi085.stdout:Fetched 12.3 MB in 2s (6,176 kB/s) 2020-10-31T22:34:40.074 INFO:teuthology.orchestra.run.smithi085.stdout:Reading package lists... 2020-10-31T22:34:40.120 INFO:teuthology.orchestra.run.smithi085:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2020-10-31T22:34:40.194 INFO:teuthology.orchestra.run.smithi085.stdout:Reading package lists... 2020-10-31T22:34:40.433 INFO:teuthology.orchestra.run.smithi085.stdout:Building dependency tree... 2020-10-31T22:34:40.434 INFO:teuthology.orchestra.run.smithi085.stdout:Reading state information... 2020-10-31T22:34:40.511 INFO:teuthology.orchestra.run.smithi085.stderr:E: Unable to locate package linux-image-current-generic 2020-10-31T22:34:40.513 DEBUG:teuthology.orchestra.run:got remote process result: 100 2020-10-31T22:34:40.513 INFO:teuthology.orchestra.run.smithi085:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2020-10-31T22:34:40.633 INFO:teuthology.orchestra.run.smithi085.stdout:Reading package lists... 2020-10-31T22:34:40.859 INFO:teuthology.orchestra.run.smithi085.stdout:Building dependency tree... 2020-10-31T22:34:40.859 INFO:teuthology.orchestra.run.smithi085.stdout:Reading state information... 2020-10-31T22:34:41.059 INFO:teuthology.orchestra.run.smithi085.stdout:linux-image-generic is already the newest version (4.15.0.122.109). 2020-10-31T22:34:41.060 INFO:teuthology.orchestra.run.smithi085.stdout:linux-image-generic set to manually installed. 2020-10-31T22:34:41.060 INFO:teuthology.orchestra.run.smithi085.stdout:0 upgraded, 0 newly installed, 0 to remove and 14 not upgraded. 2020-10-31T22:34:41.061 INFO:teuthology.orchestra.run.smithi085:> dpkg -s linux-image-generic 2020-10-31T22:34:41.084 INFO:teuthology.orchestra.run.smithi085.stdout:Package: linux-image-generic 2020-10-31T22:34:41.084 INFO:teuthology.orchestra.run.smithi085.stdout:Status: install ok installed 2020-10-31T22:34:41.084 INFO:teuthology.orchestra.run.smithi085.stdout:Priority: optional 2020-10-31T22:34:41.084 INFO:teuthology.orchestra.run.smithi085.stdout:Section: kernel 2020-10-31T22:34:41.085 INFO:teuthology.orchestra.run.smithi085.stdout:Installed-Size: 16 2020-10-31T22:34:41.085 INFO:teuthology.orchestra.run.smithi085.stdout:Maintainer: Ubuntu Kernel Team 2020-10-31T22:34:41.085 INFO:teuthology.orchestra.run.smithi085.stdout:Architecture: amd64 2020-10-31T22:34:41.085 INFO:teuthology.orchestra.run.smithi085.stdout:Source: linux-meta 2020-10-31T22:34:41.085 INFO:teuthology.orchestra.run.smithi085.stdout:Version: 4.15.0.122.109 2020-10-31T22:34:41.085 INFO:teuthology.orchestra.run.smithi085.stdout:Provides: wireguard-modules (= 1.0.20200611-1ubuntu1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2020-10-31T22:34:41.086 INFO:teuthology.orchestra.run.smithi085.stdout:Depends: linux-image-4.15.0-122-generic, linux-modules-extra-4.15.0-122-generic, linux-firmware, intel-microcode, amd64-microcode 2020-10-31T22:34:41.086 INFO:teuthology.orchestra.run.smithi085.stdout:Recommends: thermald 2020-10-31T22:34:41.086 INFO:teuthology.orchestra.run.smithi085.stdout:Description: Generic Linux kernel image 2020-10-31T22:34:41.086 INFO:teuthology.orchestra.run.smithi085.stdout: This package will always depend on the latest generic kernel image 2020-10-31T22:34:41.086 INFO:teuthology.orchestra.run.smithi085.stdout: available. 2020-10-31T22:34:41.086 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-10-31T22:34:41.087 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-10-31T22:34:41.087 INFO:teuthology.orchestra.run.smithi060:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-10-31T22:34:41.111 INFO:teuthology.orchestra.run.smithi060.stdout:ttyS1 2020-10-31T22:34:41.135 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-10-31T22:34:41.135 INFO:teuthology.orchestra.run.smithi066:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-10-31T22:34:41.164 INFO:teuthology.orchestra.run.smithi066.stdout:ttyS1 2020-10-31T22:34:41.183 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2020-10-31T22:34:41.184 INFO:teuthology.orchestra.run.smithi152:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-10-31T22:34:41.208 INFO:teuthology.orchestra.run.smithi152.stdout:ttyS1 2020-10-31T22:34:41.233 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2020-10-31T22:34:41.234 INFO:teuthology.orchestra.run.smithi085:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-10-31T22:34:41.259 INFO:teuthology.orchestra.run.smithi085.stdout:ttyS1 2020-10-31T22:34:41.293 INFO:teuthology.run_tasks:Running task internal.base... 2020-10-31T22:34:41.303 INFO:teuthology.task.internal:Creating test directory... 2020-10-31T22:34:41.303 INFO:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-10-31T22:34:41.305 INFO:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-10-31T22:34:41.308 INFO:teuthology.orchestra.run.smithi085:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-10-31T22:34:41.337 INFO:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-10-31T22:34:41.344 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-10-31T22:34:41.361 INFO:teuthology.run_tasks:Running task internal.archive... 2020-10-31T22:34:41.373 INFO:teuthology.task.internal:Creating archive directory... 2020-10-31T22:34:41.374 INFO:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-10-31T22:34:41.376 INFO:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-10-31T22:34:41.378 INFO:teuthology.orchestra.run.smithi085:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-10-31T22:34:41.384 INFO:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-10-31T22:34:41.413 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-10-31T22:34:41.423 INFO:teuthology.task.internal:Enabling coredump saving... 2020-10-31T22:34:41.423 INFO:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-10-31T22:34:41.430 INFO:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-10-31T22:34:41.432 INFO:teuthology.orchestra.run.smithi085:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-10-31T22:34:41.440 INFO:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-10-31T22:34:41.450 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-10-31T22:34:41.453 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-10-31T22:34:41.457 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-10-31T22:34:41.458 INFO:teuthology.orchestra.run.smithi085.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-10-31T22:34:41.463 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-10-31T22:34:41.466 INFO:teuthology.orchestra.run.smithi085.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-10-31T22:34:41.476 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-10-31T22:34:41.484 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-10-31T22:34:41.485 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-10-31T22:34:41.500 INFO:teuthology.task.internal:Configuring sudo... 2020-10-31T22:34:41.500 INFO:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-10-31T22:34:41.503 INFO:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-10-31T22:34:41.510 INFO:teuthology.orchestra.run.smithi085:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-10-31T22:34:41.512 INFO:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-10-31T22:34:41.542 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-10-31T22:34:41.556 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-10-31T22:34:41.557 INFO:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-10-31T22:34:41.563 INFO:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-10-31T22:34:41.567 INFO:teuthology.orchestra.run.smithi085:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-10-31T22:34:41.571 INFO:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-10-31T22:34:41.589 INFO:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-10-31T22:34:41.619 INFO:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-10-31T22:34:41.667 INFO:teuthology.orchestra.run.smithi060:> set -ex 2020-10-31T22:34:41.668 INFO:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-10-31T22:34:41.713 INFO:teuthology.orchestra.run.smithi060.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-10-31T22:34:41.732 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records in 2020-10-31T22:34:41.732 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records out 2020-10-31T22:34:41.733 INFO:teuthology.orchestra.run.smithi060.stderr:152 bytes copied, 3.3415e-05 s, 4.5 MB/s 2020-10-31T22:34:41.734 INFO:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-10-31T22:34:41.742 INFO:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-10-31T22:34:41.791 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-10-31T22:34:41.792 INFO:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-10-31T22:34:41.837 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-10-31T22:34:41.853 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-10-31T22:34:41.853 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-10-31T22:34:41.853 INFO:teuthology.orchestra.run.smithi066.stderr:152 bytes copied, 3.4259e-05 s, 4.4 MB/s 2020-10-31T22:34:41.854 INFO:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-10-31T22:34:41.861 INFO:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-10-31T22:34:41.909 INFO:teuthology.orchestra.run.smithi152:> set -ex 2020-10-31T22:34:41.910 INFO:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-10-31T22:34:41.955 INFO:teuthology.orchestra.run.smithi152.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-10-31T22:34:41.975 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2020-10-31T22:34:41.976 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2020-10-31T22:34:41.976 INFO:teuthology.orchestra.run.smithi152.stderr:152 bytes copied, 3.1405e-05 s, 4.8 MB/s 2020-10-31T22:34:41.977 INFO:teuthology.orchestra.run.smithi085:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-10-31T22:34:41.984 INFO:teuthology.orchestra.run.smithi085:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-10-31T22:34:42.033 INFO:teuthology.orchestra.run.smithi085:> set -ex 2020-10-31T22:34:42.033 INFO:teuthology.orchestra.run.smithi085:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-10-31T22:34:42.079 INFO:teuthology.orchestra.run.smithi085.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-10-31T22:34:42.094 INFO:teuthology.orchestra.run.smithi085.stderr:0+1 records in 2020-10-31T22:34:42.094 INFO:teuthology.orchestra.run.smithi085.stderr:0+1 records out 2020-10-31T22:34:42.095 INFO:teuthology.orchestra.run.smithi085.stderr:152 bytes copied, 3.3873e-05 s, 4.5 MB/s 2020-10-31T22:34:42.095 INFO:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2020-10-31T22:34:42.098 INFO:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2020-10-31T22:34:42.100 INFO:teuthology.orchestra.run.smithi085:> sudo service rsyslog restart 2020-10-31T22:34:42.140 INFO:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2020-10-31T22:34:42.182 INFO:teuthology.run_tasks:Running task internal.timer... 2020-10-31T22:34:42.195 INFO:teuthology.task.internal:Starting timer... 2020-10-31T22:34:42.195 INFO:teuthology.run_tasks:Running task pcp... 2020-10-31T22:34:42.224 INFO:teuthology.run_tasks:Running task selinux... 2020-10-31T22:34:42.237 DEBUG:teuthology.task.selinux:Excluding smithi060: OS 'ubuntu' does not support SELinux 2020-10-31T22:34:42.237 DEBUG:teuthology.task.selinux:Excluding smithi066: OS 'ubuntu' does not support SELinux 2020-10-31T22:34:42.238 DEBUG:teuthology.task.selinux:Excluding smithi152: OS 'ubuntu' does not support SELinux 2020-10-31T22:34:42.238 DEBUG:teuthology.task.selinux:Excluding smithi085: OS 'ubuntu' does not support SELinux 2020-10-31T22:34:42.238 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-10-31T22:34:42.239 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2020-10-31T22:34:42.239 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-10-31T22:34:42.239 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-10-31T22:34:42.252 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-10-31T22:34:42.253 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-10-31T22:34:42.267 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-10-31T22:34:42.269 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi060.front.sepia.ceph.com,smithi066.front.sepia.ceph.com,smithi152.front.sepia.ceph.com,smithi085.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-10-31T22:34:42.650 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-10-31T22:34:43.520 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-10-31T22:34:45.891 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-10-31T22:34:45.911 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:45 +0000 (0:00:00.068) 0:00:00.068 ****** 2020-10-31T22:34:45.924 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:45 +0000 (0:00:00.013) 0:00:00.081 ****** 2020-10-31T22:34:45.937 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:45 +0000 (0:00:00.013) 0:00:00.094 ****** 2020-10-31T22:34:45.950 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:45 +0000 (0:00:00.013) 0:00:00.108 ****** 2020-10-31T22:34:47.551 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi060.front.sepia.ceph.com] 2020-10-31T22:34:47.719 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] 2020-10-31T22:34:47.729 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] 2020-10-31T22:34:47.741 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] 2020-10-31T22:34:47.783 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:47 +0000 (0:00:01.832) 0:00:01.941 ****** 2020-10-31T22:34:47.902 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:47 +0000 (0:00:00.118) 0:00:02.059 ****** 2020-10-31T22:34:47.933 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:47 +0000 (0:00:00.030) 0:00:02.090 ****** 2020-10-31T22:34:47.968 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:47 +0000 (0:00:00.034) 0:00:02.125 ****** 2020-10-31T22:34:48.091 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-10-31T22:34:48.093 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-10-31T22:34:48.094 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-10-31T22:34:48.128 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:48 +0000 (0:00:00.160) 0:00:02.286 ****** 2020-10-31T22:34:48.163 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:48 +0000 (0:00:00.034) 0:00:02.320 ****** 2020-10-31T22:34:48.195 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:48 +0000 (0:00:00.032) 0:00:02.352 ****** 2020-10-31T22:34:48.201 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-10-31T22:34:48.239 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:48 +0000 (0:00:00.044) 0:00:02.397 ****** 2020-10-31T22:34:48.597 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-10-31T22:34:48.599 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-10-31T22:34:48.601 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-10-31T22:34:48.603 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-10-31T22:34:48.605 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-10-31T22:34:48.641 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:48 +0000 (0:00:00.401) 0:00:02.799 ****** 2020-10-31T22:34:48.685 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:48 +0000 (0:00:00.043) 0:00:02.842 ****** 2020-10-31T22:34:48.720 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:48 +0000 (0:00:00.035) 0:00:02.877 ****** 2020-10-31T22:34:48.754 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:48 +0000 (0:00:00.031) 0:00:02.909 ****** 2020-10-31T22:34:48.982 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-10-31T22:34:48.984 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.057436", "end": "2020-10-31 22:34:48.674391", "rc": 0, "start": "2020-10-31 22:34:48.616955", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} changed: [smithi060.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.074665", "end": "2020-10-31 22:34:49.125735", "rc": 0, "start": "2020-10-31 22:34:49.051070", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-10-31T22:34:49.032 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:49 +0000 (0:00:00.279) 0:00:03.189 ****** 2020-10-31T22:34:49.069 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:49 +0000 (0:00:00.036) 0:00:03.226 ****** 2020-10-31T22:34:49.077 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.068242", "end": "2020-10-31 22:34:48.861553", "rc": 0, "start": "2020-10-31 22:34:48.793311", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-10-31T22:34:49.078 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.075919", "end": "2020-10-31 22:34:48.514088", "rc": 0, "start": "2020-10-31 22:34:48.438169", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2020-10-31T22:34:49.124 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:49 +0000 (0:00:00.054) 0:00:03.281 ****** 2020-10-31T22:34:49.177 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:49 +0000 (0:00:00.053) 0:00:03.335 ****** 2020-10-31T22:34:49.304 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-10-31T22:34:49.307 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi085.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:34:49.307 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:34:49.309 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:34:49.345 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:49 +0000 (0:00:00.167) 0:00:03.503 ****** 2020-10-31T22:34:49.384 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:49 +0000 (0:00:00.039) 0:00:03.542 ****** 2020-10-31T22:34:49.420 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:49 +0000 (0:00:00.035) 0:00:03.577 ****** 2020-10-31T22:34:49.452 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:49 +0000 (0:00:00.032) 0:00:03.610 ****** 2020-10-31T22:34:50.009 INFO:teuthology.task.ansible.out: 2020-10-31T22:34:50.011 INFO:teuthology.task.ansible.out:TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-10-31T22:34:50.011 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1604183689.469116-176368543011892/source", "state": "file", "uid": 0} 2020-10-31T22:34:50.014 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1604183689.399476-250208424660401/source", "state": "file", "uid": 0} 2020-10-31T22:34:50.016 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1604183689.4343884-198393506684284/source", "state": "file", "uid": 0} 2020-10-31T22:34:50.020 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1604183689.3606696-258747709411538/source", "state": "file", "uid": 0} 2020-10-31T22:34:50.053 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:50 +0000 (0:00:00.600) 0:00:04.211 ****** 2020-10-31T22:34:50.085 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:50 +0000 (0:00:00.031) 0:00:04.242 ****** 2020-10-31T22:34:50.118 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:50 +0000 (0:00:00.033) 0:00:04.276 ****** 2020-10-31T22:34:50.150 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:50 +0000 (0:00:00.031) 0:00:04.307 ****** 2020-10-31T22:34:50.360 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-10-31T22:34:50.362 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-10-31T22:34:50.364 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2020-10-31T22:34:50.366 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2020-10-31T22:34:50.368 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-10-31T22:34:50.418 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-10-31T22:34:50.420 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2020-10-31T22:34:50.421 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2020-10-31T22:34:50.423 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-10-31T22:34:50.598 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-10-31T22:34:50.609 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-10-31T22:34:50.760 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:50 +0000 (0:00:00.610) 0:00:04.918 ****** 2020-10-31T22:34:50.792 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:50 +0000 (0:00:00.032) 0:00:04.950 ****** 2020-10-31T22:34:50.824 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:50 +0000 (0:00:00.031) 0:00:04.981 ****** 2020-10-31T22:34:50.856 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:50 +0000 (0:00:00.032) 0:00:05.014 ****** 2020-10-31T22:34:51.434 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi060.front.sepia.ceph.com] 2020-10-31T22:34:51.522 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-10-31T22:34:51.524 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:51 +0000 (0:00:00.666) 0:00:05.680 ****** 2020-10-31T22:34:51.580 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] 2020-10-31T22:34:51.649 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] 2020-10-31T22:34:51.719 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:51 +0000 (0:00:00.196) 0:00:05.877 ****** 2020-10-31T22:34:51.794 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:51 +0000 (0:00:00.074) 0:00:05.952 ****** 2020-10-31T22:34:51.951 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-10-31T22:34:51.953 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.188164", "end": "2020-10-31 22:34:51.925705", "rc": 0, "start": "2020-10-31 22:34:51.737541", "stderr": "", "stderr_lines": [], "stdout": "2fdf53be9d56af7321864400b67aeaef50e8bec5", "stdout_lines": ["2fdf53be9d56af7321864400b67aeaef50e8bec5"]} 2020-10-31T22:34:51.986 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:51 +0000 (0:00:00.192) 0:00:06.144 ****** 2020-10-31T22:34:52.080 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.169660", "end": "2020-10-31 22:34:52.054207", "rc": 0, "start": "2020-10-31 22:34:51.884547", "stderr": "", "stderr_lines": [], "stdout": "2fdf53be9d56af7321864400b67aeaef50e8bec5", "stdout_lines": ["2fdf53be9d56af7321864400b67aeaef50e8bec5"]} 2020-10-31T22:34:52.125 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.138) 0:00:06.282 ****** 2020-10-31T22:34:52.153 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi060.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.015035", "end": "2020-10-31 22:34:52.273738", "failed_when_result": false, "rc": 0, "start": "2020-10-31 22:34:52.258703", "stderr": "", "stderr_lines": [], "stdout": "dc718b4ead91e3defc0b2e249b02a87485264aff", "stdout_lines": ["dc718b4ead91e3defc0b2e249b02a87485264aff"]} TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi152.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.145789", "end": "2020-10-31 22:34:52.112249", "rc": 0, "start": "2020-10-31 22:34:51.966460", "stderr": "", "stderr_lines": [], "stdout": "2fdf53be9d56af7321864400b67aeaef50e8bec5", "stdout_lines": ["2fdf53be9d56af7321864400b67aeaef50e8bec5"]} 2020-10-31T22:34:52.189 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.063) 0:00:06.346 ****** 2020-10-31T22:34:52.221 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.032) 0:00:06.379 ****** 2020-10-31T22:34:52.228 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-10-31T22:34:52.230 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:52.264 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.042) 0:00:06.421 ****** 2020-10-31T22:34:52.283 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi085.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008233", "end": "2020-10-31 22:34:51.964776", "failed_when_result": false, "rc": 0, "start": "2020-10-31 22:34:51.956543", "stderr": "", "stderr_lines": [], "stdout": "dc718b4ead91e3defc0b2e249b02a87485264aff", "stdout_lines": ["dc718b4ead91e3defc0b2e249b02a87485264aff"]} 2020-10-31T22:34:52.325 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.061) 0:00:06.482 ****** 2020-10-31T22:34:52.334 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-10-31T22:34:52.336 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:52.369 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.044) 0:00:06.527 ****** 2020-10-31T22:34:52.378 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:52.413 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.043) 0:00:06.570 ****** 2020-10-31T22:34:52.419 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-10-31T22:34:52.421 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.023722", "end": "2020-10-31 22:34:52.247996", "failed_when_result": false, "rc": 0, "start": "2020-10-31 22:34:52.224274", "stderr": "", "stderr_lines": [], "stdout": "dc718b4ead91e3defc0b2e249b02a87485264aff", "stdout_lines": ["dc718b4ead91e3defc0b2e249b02a87485264aff"]} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:52.462 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.047) 0:00:06.618 ****** 2020-10-31T22:34:52.494 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.032) 0:00:06.650 ****** 2020-10-31T22:34:52.499 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-10-31T22:34:52.501 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:52.539 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.046) 0:00:06.697 ****** 2020-10-31T22:34:52.571 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.031) 0:00:06.729 ****** 2020-10-31T22:34:52.577 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-10-31T22:34:52.579 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:52.613 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.042) 0:00:06.771 ****** 2020-10-31T22:34:52.646 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.032) 0:00:06.803 ****** 2020-10-31T22:34:52.657 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi066.front.sepia.ceph.com] 2020-10-31T22:34:52.664 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-10-31T22:34:52.666 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:52.720 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.074) 0:00:06.878 ****** 2020-10-31T22:34:52.728 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-10-31T22:34:52.730 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:52.771 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.050) 0:00:06.929 ****** 2020-10-31T22:34:52.809 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.037) 0:00:06.966 ****** 2020-10-31T22:34:52.819 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-10-31T22:34:52.820 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [users : Filter the managed_users list] *********************************** 2020-10-31T22:34:52.821 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:52.864 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.055) 0:00:07.022 ****** 2020-10-31T22:34:52.905 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.041) 0:00:07.063 ****** 2020-10-31T22:34:52.913 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-10-31T22:34:52.914 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:52.949 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:52 +0000 (0:00:00.043) 0:00:07.106 ****** 2020-10-31T22:34:52.956 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-10-31T22:34:52.957 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:53.003 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:53 +0000 (0:00:00.054) 0:00:07.161 ****** 2020-10-31T22:34:53.016 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-10-31T22:34:53.017 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:53.063 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:53 +0000 (0:00:00.059) 0:00:07.220 ****** 2020-10-31T22:34:53.070 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-31T22:34:53.072 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-10-31T22:34:53.093 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-10-31T22:34:53.094 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:53.096 INFO:teuthology.task.ansible.out: 2020-10-31T22:34:53.133 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:53 +0000 (0:00:00.069) 0:00:07.290 ****** 2020-10-31T22:34:53.152 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-10-31T22:34:53.154 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:34:53.206 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:53 +0000 (0:00:00.071) 0:00:07.362 ****** 2020-10-31T22:34:53.212 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-10-31T22:34:53.214 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.184673", "end": "2020-10-31 22:34:53.155545", "rc": 0, "start": "2020-10-31 22:34:52.970872", "stderr": "", "stderr_lines": [], "stdout": "2fdf53be9d56af7321864400b67aeaef50e8bec5", "stdout_lines": ["2fdf53be9d56af7321864400b67aeaef50e8bec5"]} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-10-31T22:34:53.251 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:53 +0000 (0:00:00.046) 0:00:07.409 ****** 2020-10-31T22:34:53.280 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-10-31T22:34:53.282 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:34:53.315 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:53 +0000 (0:00:00.064) 0:00:07.473 ****** 2020-10-31T22:34:53.333 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-31T22:34:53.335 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-10-31T22:34:53.390 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-10-31T22:34:53.402 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-10-31T22:34:53.403 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.014215", "end": "2020-10-31 22:34:52.912897", "failed_when_result": false, "rc": 0, "start": "2020-10-31 22:34:52.898682", "stderr": "", "stderr_lines": [], "stdout": "dc718b4ead91e3defc0b2e249b02a87485264aff", "stdout_lines": ["dc718b4ead91e3defc0b2e249b02a87485264aff"]} 2020-10-31T22:34:53.441 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:53 +0000 (0:00:00.125) 0:00:07.598 ****** 2020-10-31T22:34:53.460 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-31T22:34:53.462 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-10-31T22:34:53.472 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:53.512 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:53 +0000 (0:00:00.071) 0:00:07.670 ****** 2020-10-31T22:34:53.520 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-31T22:34:53.522 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-10-31T22:34:53.534 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-10-31T22:34:53.545 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-10-31T22:34:53.547 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:53.582 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:53 +0000 (0:00:00.070) 0:00:07.740 ****** 2020-10-31T22:34:53.603 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-31T22:34:53.606 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-10-31T22:34:53.616 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-10-31T22:34:53.618 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:53.653 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:53 +0000 (0:00:00.070) 0:00:07.810 ****** 2020-10-31T22:34:53.661 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-31T22:34:53.663 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-10-31T22:34:53.688 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:53.726 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:53 +0000 (0:00:00.072) 0:00:07.883 ****** 2020-10-31T22:34:53.745 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-31T22:34:53.747 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-10-31T22:34:53.757 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-10-31T22:34:53.759 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:34:53.793 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:53 +0000 (0:00:00.067) 0:00:07.951 ****** 2020-10-31T22:34:53.801 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-10-31T22:34:53.804 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-10-31T22:34:53.887 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-10-31T22:34:53.908 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-10-31T22:34:53.932 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-10-31T22:34:53.944 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-10-31T22:34:53.945 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:34:53.984 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:34:53 +0000 (0:00:00.190) 0:00:08.142 ****** 2020-10-31T22:34:54.012 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-31T22:34:54.014 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-10-31T22:34:54.036 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-10-31T22:34:54.069 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-10-31T22:34:54.160 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-10-31T22:34:54.171 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2020-10-31T22:34:54.174 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-10-31T22:34:54.198 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-10-31T22:34:54.295 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-10-31T22:34:54.307 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2020-10-31T22:34:54.309 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-10-31T22:34:54.332 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-10-31T22:34:54.334 INFO:teuthology.task.ansible.out: 2020-10-31T22:34:54.431 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-10-31T22:34:54.443 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2020-10-31T22:34:54.444 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-10-31T22:34:54.478 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-10-31T22:34:54.576 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-10-31T22:34:54.589 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2020-10-31T22:34:54.623 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-10-31T22:34:54.718 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "it 2020-10-31T22:34:54.719 INFO:teuthology.task.ansible.out:em", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-10-31T22:34:54.730 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2020-10-31T22:34:54.731 INFO:teuthology.task.ansible.out: 2020-10-31T22:34:54.753 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-10-31T22:34:54.851 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-10-31T22:34:54.863 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2020-10-31T22:34:54.883 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a7 2020-10-31T22:34:54.885 INFO:teuthology.task.ansible.out:3b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-10-31T22:34:54.986 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-10-31T22:34:55.009 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2020-10-31T22:34:55.011 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-10-31T22:34:55.051 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-10-31T22:34:55.119 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-10-31T22:34:55.142 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2020-10-31T22:34:55.180 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-10-31T22:34:55.191 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-10-31T22:34:55.261 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2020-10-31T22:34:55.284 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2020-10-31T22:34:55.332 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-10-31T22:34:55.345 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-10-31T22:34:55.400 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-10-31T22:34:55.413 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2020-10-31T22:34:55.415 INFO:teuthology.task.ansible.out: 2020-10-31T22:34:55.460 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-10-31T22:34:55.493 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-10-31T22:34:55.539 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2020-10-31T22:34:55.562 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2020-10-31T22:34:55.595 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-10-31T22:34:55.639 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-10-31T22:34:55.683 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2020-10-31T22:34:55.685 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-10-31T22:34:55.729 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-10-31T22:34:55.795 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-10-31T22:34:55.820 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2020-10-31T22:34:55.822 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-10-31T22:34:55.867 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-10-31T22:34:55.933 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-10-31T22:34:55.968 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-10-31T22:34:56.013 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-10-31T22:34:56.079 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-10-31T22:34:56.112 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-10-31T22:34:56.114 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2020-10-31T22:34:56.147 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-10-31T22:34:56.212 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-10-31T22:34:56.247 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4 2020-10-31T22:34:56.249 INFO:teuthology.task.ansible.out:277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-10-31T22:34:56.283 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-10-31T22:34:56.350 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-10-31T22:34:56.373 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2020-10-31T22:34:56.409 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-10-31T22:34:56.421 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-10-31T22:34:56.498 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-10-31T22:34:56.510 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2020-10-31T22:34:56.533 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-10-31T22:34:56.556 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-10-31T22:34:56.558 INFO:teuthology.task.ansible.out: 2020-10-31T22:34:56.654 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-10-31T22:34:56.665 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2020-10-31T22:34:56.678 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-10-31T22:34:56.700 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-10-31T22:34:56.797 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-10-31T22:34:56.799 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2020-10-31T22:34:56.810 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-10-31T22:34:56.834 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-10-31T22:34:56.932 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2020-10-31T22:34:56.948 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-10-31T22:34:56.957 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-10-31T22:34:57.066 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2020-10-31T22:34:57.080 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-10-31T22:34:57.093 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-10-31T22:34:57.094 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-10-31T22:34:57.198 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2020-10-31T22:34:57.210 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-10-31T22:34:57.224 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-10-31T22:34:57.225 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-10-31T22:34:57.339 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2020-10-31T22:34:57.351 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-10-31T22:34:57.363 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-10-31T22:34:57.398 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-10-31T22:34:57.476 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2020-10-31T22:34:57.490 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-10-31T22:34:57.502 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-10-31T22:34:57.541 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-10-31T22:34:57.606 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2020-10-31T22:34:57.629 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-10-31T22:34:57.640 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-10-31T22:34:57.674 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-10-31T22:34:57.739 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2020-10-31T22:34:57.763 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-10-31T22:34:57.776 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-10-31T22:34:57.831 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-10-31T22:34:57.876 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2020-10-31T22:34:57.878 INFO:teuthology.task.ansible.out: 2020-10-31T22:34:57.899 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-10-31T22:34:57.902 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-10-31T22:34:57.989 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-10-31T22:34:58.024 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2020-10-31T22:34:58.046 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-10-31T22:34:58.048 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-10-31T22:34:58.136 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-10-31T22:34:58.148 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2020-10-31T22:34:58.185 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-10-31T22:34:58.196 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-10-31T22:34:58.285 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2020-10-31T22:34:58.287 INFO:teuthology.task.ansible.out: 2020-10-31T22:34:58.288 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-10-31T22:34:58.324 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-10-31T22:34:58.343 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-10-31T22:34:58.431 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2020-10-31T22:34:58.432 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-10-31T22:34:58.466 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-10-31T22:34:58.468 INFO:teuthology.task.ansible.out: ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-10-31T22:34:58.565 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-10-31T22:34:58.567 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2020-10-31T22:34:58.611 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-10-31T22:34:58.613 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-10-31T22:34:58.691 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-10-31T22:34:58.702 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2020-10-31T22:34:58.737 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-10-31T22:34:58.739 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-10-31T22:34:58.825 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2020-10-31T22:34:58.848 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-10-31T22:34:58.871 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-10-31T22:34:58.872 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-10-31T22:34:58.959 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2020-10-31T22:34:58.991 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-10-31T22:34:59.003 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-10-31T22:34:59.014 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-10-31T22:34:59.089 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2020-10-31T22:34:59.111 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-10-31T22:34:59.133 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-10-31T22:34:59.146 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-10-31T22:34:59.222 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2020-10-31T22:34:59.258 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-10-31T22:34:59.267 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-10-31T22:34:59.279 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-10-31T22:34:59.355 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2020-10-31T22:34:59.377 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-10-31T22:34:59.400 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-10-31T22:34:59.402 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-10-31T22:34:59.495 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-10-31T22:34:59.511 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-10-31T22:34:59.547 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-10-31T22:34:59.564 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-10-31T22:34:59.638 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2020-10-31T22:34:59.671 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-10-31T22:34:59.683 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-10-31T22:34:59.696 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-10-31T22:34:59.781 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2020-10-31T22:34:59.825 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-10-31T22:34:59.828 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-10-31T22:34:59.915 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2020-10-31T22:34:59.950 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-10-31T22:34:59.962 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-10-31T22:34:59.974 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-10-31T22:35:00.042 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2020-10-31T22:35:00.087 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-10-31T22:35:00.099 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-10-31T22:35:00.110 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-10-31T22:35:00.186 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2020-10-31T22:35:00.220 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-10-31T22:35:00.234 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-10-31T22:35:00.246 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-10-31T22:35:00.313 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2020-10-31T22:35:00.358 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-10-31T22:35:00.381 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-10-31T22:35:00.383 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-10-31T22:35:00.443 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2020-10-31T22:35:00.487 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-10-31T22:35:00.499 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-10-31T22:35:00.511 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-10-31T22:35:00.586 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-10-31T22:35:00.610 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-10-31T22:35:00.645 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-10-31T22:35:00.657 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-10-31T22:35:00.723 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2020-10-31T22:35:00.746 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-10-31T22:35:00.771 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-10-31T22:35:00.805 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-10-31T22:35:00.859 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2020-10-31T22:35:00.881 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-10-31T22:35:00.883 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:00.910 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-10-31T22:35:00.913 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:00.944 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-10-31T22:35:00.988 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2020-10-31T22:35:01.011 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-10-31T22:35:01.045 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-10-31T22:35:01.090 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-10-31T22:35:01.138 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2020-10-31T22:35:01.141 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:01.151 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-10-31T22:35:01.152 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:01.186 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-10-31T22:35:01.221 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-10-31T22:35:01.264 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2020-10-31T22:35:01.286 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-10-31T22:35:01.319 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-10-31T22:35:01.373 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-10-31T22:35:01.396 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2020-10-31T22:35:01.422 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-10-31T22:35:01.454 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-10-31T22:35:01.520 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-10-31T22:35:01.521 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2020-10-31T22:35:01.555 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-10-31T22:35:01.590 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-10-31T22:35:01.648 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-10-31T22:35:01.660 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2020-10-31T22:35:01.663 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:01.690 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-10-31T22:35:01.725 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-10-31T22:35:01.786 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-10-31T22:35:01.799 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2020-10-31T22:35:01.822 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-10-31T22:35:01.823 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:01.857 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-10-31T22:35:01.924 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2020-10-31T22:35:01.936 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-10-31T22:35:01.958 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-10-31T22:35:01.991 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-10-31T22:35:02.058 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2020-10-31T22:35:02.069 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-10-31T22:35:02.096 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-10-31T22:35:02.130 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-10-31T22:35:02.206 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2020-10-31T22:35:02.207 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-10-31T22:35:02.240 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-10-31T22:35:02.264 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-10-31T22:35:02.338 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2020-10-31T22:35:02.350 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-10-31T22:35:02.373 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-10-31T22:35:02.395 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-10-31T22:35:02.472 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2020-10-31T22:35:02.505 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-10-31T22:35:02.506 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-10-31T22:35:02.528 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-10-31T22:35:02.604 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2020-10-31T22:35:02.638 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-10-31T22:35:02.654 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-10-31T22:35:02.663 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-10-31T22:35:02.740 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2020-10-31T22:35:02.784 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-10-31T22:35:02.796 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-10-31T22:35:02.809 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-10-31T22:35:02.875 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2020-10-31T22:35:02.921 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-10-31T22:35:02.923 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-10-31T22:35:02.934 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-10-31T22:35:03.019 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2020-10-31T22:35:03.052 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-10-31T22:35:03.066 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-10-31T22:35:03.079 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-10-31T22:35:03.166 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2020-10-31T22:35:03.189 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-10-31T22:35:03.203 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-10-31T22:35:03.215 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-10-31T22:35:03.302 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2020-10-31T22:35:03.327 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-10-31T22:35:03.370 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-10-31T22:35:03.435 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2020-10-31T22:35:03.457 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-10-31T22:35:03.469 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-10-31T22:35:03.506 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-10-31T22:35:03.571 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2020-10-31T22:35:03.595 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-10-31T22:35:03.607 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-10-31T22:35:03.640 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-10-31T22:35:03.695 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2020-10-31T22:35:03.728 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-10-31T22:35:03.740 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-10-31T22:35:03.783 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-10-31T22:35:03.827 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2020-10-31T22:35:03.861 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-10-31T22:35:03.872 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-10-31T22:35:03.937 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-10-31T22:35:03.960 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2020-10-31T22:35:03.995 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-10-31T22:35:04.007 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-10-31T22:35:04.084 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-10-31T22:35:04.095 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2020-10-31T22:35:04.130 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-10-31T22:35:04.131 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-10-31T22:35:04.218 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-10-31T22:35:04.229 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2020-10-31T22:35:04.262 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-10-31T22:35:04.266 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-10-31T22:35:04.353 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-10-31T22:35:04.366 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2020-10-31T22:35:04.391 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-10-31T22:35:04.489 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-10-31T22:35:04.501 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2020-10-31T22:35:04.523 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-10-31T22:35:04.525 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-10-31T22:35:04.623 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-10-31T22:35:04.637 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2020-10-31T22:35:04.662 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-10-31T22:35:04.675 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-10-31T22:35:04.773 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2020-10-31T22:35:04.785 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-10-31T22:35:04.799 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-10-31T22:35:04.811 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-10-31T22:35:04.896 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2020-10-31T22:35:04.920 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-10-31T22:35:04.944 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-10-31T22:35:04.946 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-10-31T22:35:05.035 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2020-10-31T22:35:05.057 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-10-31T22:35:05.070 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-10-31T22:35:05.081 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-10-31T22:35:05.158 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2020-10-31T22:35:05.202 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-10-31T22:35:05.204 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-10-31T22:35:05.215 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-10-31T22:35:05.291 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2020-10-31T22:35:05.334 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-10-31T22:35:05.336 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-10-31T22:35:05.347 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-10-31T22:35:05.425 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2020-10-31T22:35:05.457 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-10-31T22:35:05.480 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-10-31T22:35:05.491 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-10-31T22:35:05.556 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2020-10-31T22:35:05.605 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-10-31T22:35:05.617 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-10-31T22:35:05.619 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-10-31T22:35:05.695 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2020-10-31T22:35:05.739 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-10-31T22:35:05.751 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-10-31T22:35:05.764 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-10-31T22:35:05.766 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:05.840 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2020-10-31T22:35:05.875 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-10-31T22:35:05.887 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-10-31T22:35:05.911 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-10-31T22:35:05.977 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2020-10-31T22:35:06.011 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-10-31T22:35:06.023 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-10-31T22:35:06.041 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-10-31T22:35:06.095 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2020-10-31T22:35:06.150 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-10-31T22:35:06.150 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:06.153 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-10-31T22:35:06.155 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:06.166 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-10-31T22:35:06.167 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:06.239 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2020-10-31T22:35:06.395 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-10-31T22:35:06.413 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2020-10-31T22:35:06.436 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-10-31T22:35:06.450 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-10-31T22:35:06.463 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-10-31T22:35:06.538 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2020-10-31T22:35:06.572 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-10-31T22:35:06.584 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-10-31T22:35:06.597 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-10-31T22:35:06.674 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2020-10-31T22:35:06.708 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-10-31T22:35:06.732 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-10-31T22:35:06.764 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-10-31T22:35:06.814 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2020-10-31T22:35:06.861 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-10-31T22:35:06.893 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-10-31T22:35:06.897 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-10-31T22:35:06.943 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2020-10-31T22:35:07.020 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-10-31T22:35:07.031 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-10-31T22:35:07.043 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-10-31T22:35:07.077 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2020-10-31T22:35:07.079 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:07.144 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-10-31T22:35:07.180 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-10-31T22:35:07.182 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-10-31T22:35:07.215 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2020-10-31T22:35:07.217 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:07.291 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-10-31T22:35:07.314 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-10-31T22:35:07.315 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-10-31T22:35:07.351 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2020-10-31T22:35:07.417 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-10-31T22:35:07.461 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-10-31T22:35:07.463 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-10-31T22:35:07.485 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2020-10-31T22:35:07.549 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-10-31T22:35:07.594 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-10-31T22:35:07.627 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2020-10-31T22:35:07.691 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-10-31T22:35:07.724 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-10-31T22:35:07.737 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-10-31T22:35:07.770 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2020-10-31T22:35:07.813 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-10-31T22:35:07.856 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-10-31T22:35:07.879 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-10-31T22:35:07.901 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2020-10-31T22:35:07.959 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-10-31T22:35:07.993 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-10-31T22:35:08.004 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-10-31T22:35:08.007 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:08.050 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2020-10-31T22:35:08.086 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-10-31T22:35:08.130 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-10-31T22:35:08.153 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-10-31T22:35:08.177 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2020-10-31T22:35:08.222 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-10-31T22:35:08.257 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-10-31T22:35:08.289 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-10-31T22:35:08.326 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2020-10-31T22:35:08.358 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-10-31T22:35:08.391 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-10-31T22:35:08.426 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-10-31T22:35:08.467 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2020-10-31T22:35:08.491 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-10-31T22:35:08.526 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-10-31T22:35:08.570 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-10-31T22:35:08.595 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2020-10-31T22:35:08.638 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-10-31T22:35:08.666 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-10-31T22:35:08.720 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-10-31T22:35:08.732 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2020-10-31T22:35:08.774 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-10-31T22:35:08.797 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-10-31T22:35:08.863 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2020-10-31T22:35:08.865 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:08.887 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2020-10-31T22:35:08.911 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-10-31T22:35:08.936 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-10-31T22:35:09.002 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-10-31T22:35:09.026 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2020-10-31T22:35:09.060 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-10-31T22:35:09.072 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-10-31T22:35:09.152 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-10-31T22:35:09.161 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2020-10-31T22:35:09.199 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-10-31T22:35:09.223 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2020-10-31T22:35:09.291 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-10-31T22:35:09.329 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2020-10-31T22:35:09.351 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2020-10-31T22:35:09.428 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-10-31T22:35:09.462 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2020-10-31T22:35:09.464 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2020-10-31T22:35:09.485 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2020-10-31T22:35:09.572 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2020-10-31T22:35:09.594 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2020-10-31T22:35:09.596 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2020-10-31T22:35:09.619 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2020-10-31T22:35:09.707 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2020-10-31T22:35:09.750 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2020-10-31T22:35:09.754 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2020-10-31T22:35:09.757 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:09.779 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2020-10-31T22:35:09.868 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2020-10-31T22:35:09.891 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2020-10-31T22:35:09.921 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2020-10-31T22:35:09.934 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2020-10-31T22:35:09.935 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:10.014 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2020-10-31T22:35:10.043 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2020-10-31T22:35:10.050 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2020-10-31T22:35:10.061 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2020-10-31T22:35:10.137 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2020-10-31T22:35:10.159 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2020-10-31T22:35:10.182 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2020-10-31T22:35:10.215 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2020-10-31T22:35:10.280 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2020-10-31T22:35:10.303 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2020-10-31T22:35:10.325 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2020-10-31T22:35:10.337 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2020-10-31T22:35:10.425 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2020-10-31T22:35:10.442 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2020-10-31T22:35:10.472 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2020-10-31T22:35:10.485 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2020-10-31T22:35:10.552 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2020-10-31T22:35:10.576 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2020-10-31T22:35:10.623 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2020-10-31T22:35:10.638 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2020-10-31T22:35:10.705 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2020-10-31T22:35:10.728 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2020-10-31T22:35:10.751 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2020-10-31T22:35:10.767 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2020-10-31T22:35:10.850 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2020-10-31T22:35:10.862 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2020-10-31T22:35:10.885 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2020-10-31T22:35:10.887 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2020-10-31T22:35:10.987 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2020-10-31T22:35:10.999 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2020-10-31T22:35:11.014 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2020-10-31T22:35:11.015 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2020-10-31T22:35:11.124 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2020-10-31T22:35:11.136 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2020-10-31T22:35:11.158 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2020-10-31T22:35:11.170 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2020-10-31T22:35:11.271 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2020-10-31T22:35:11.292 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2020-10-31T22:35:11.308 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2020-10-31T22:35:11.310 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:11.398 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2020-10-31T22:35:11.410 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2020-10-31T22:35:11.421 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2020-10-31T22:35:11.534 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2020-10-31T22:35:11.542 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2020-10-31T22:35:11.664 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2020-10-31T22:35:11.677 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2020-10-31T22:35:11.818 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2020-10-31T22:35:11.939 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-10-31T22:35:12.082 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2020-10-31T22:35:12.122 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:12 +0000 (0:00:18.135) 0:00:26.277 ****** 2020-10-31T22:35:12.130 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2020-10-31T22:35:12.159 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-10-31T22:35:12.209 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:12 +0000 (0:00:00.089) 0:00:26.366 ****** 2020-10-31T22:35:12.217 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-10-31T22:35:12.219 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-10-31T22:35:12.316 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-10-31T22:35:12.401 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-10-31T22:35:12.404 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2020-10-31T22:35:12.406 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2020-10-31T22:35:12.408 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2020-10-31T22:35:12.410 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkK 2020-10-31T22:35:12.411 INFO:teuthology.task.ansible.out:ztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 2020-10-31T22:35:12.413 INFO:teuthology.task.ansible.out:HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg 2020-10-31T22:35:12.414 INFO:teuthology.task.ansible.out:e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 11 2020-10-31T22:35:12.415 INFO:teuthology.task.ansible.out:70ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df 2020-10-31T22:35:12.416 INFO:teuthology.task.ansible.out:79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+ 2020-10-31T22:35:12.418 INFO:teuthology.task.ansible.out:7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b 2020-10-31T22:35:12.420 INFO:teuthology.task.ansible.out:0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/ 2020-10-31T22:35:12.422 INFO:teuthology.task.ansible.out:nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelope 2020-10-31T22:35:12.425 INFO:teuthology.task.ansible.out:z", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0 2020-10-31T22:35:12.427 INFO:teuthology.task.ansible.out:dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}]}, "changed": false} 2020-10-31T22:35:12.456 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:12 +0000 (0:00:00.244) 0:00:26.611 ****** 2020-10-31T22:35:12.510 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:12 +0000 (0:00:00.053) 0:00:26.664 ****** 2020-10-31T22:35:12.553 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:12 +0000 (0:00:00.042) 0:00:26.706 ****** 2020-10-31T22:35:12.558 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-10-31T22:35:12.606 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:12 +0000 (0:00:00.056) 0:00:26.763 ****** 2020-10-31T22:35:12.662 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:12 +0000 (0:00:00.055) 0:00:26.819 ****** 2020-10-31T22:35:12.689 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-10-31T22:35:12.693 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2020-10-31T22:35:12.698 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2020-10-31T22:35:12.706 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2020-10-31T22:35:12.708 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkK 2020-10-31T22:35:12.709 INFO:teuthology.task.ansible.out:ztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 2020-10-31T22:35:12.711 INFO:teuthology.task.ansible.out:HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg 2020-10-31T22:35:12.716 INFO:teuthology.task.ansible.out:e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 11 2020-10-31T22:35:12.717 INFO:teuthology.task.ansible.out:70ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df 2020-10-31T22:35:12.719 INFO:teuthology.task.ansible.out:79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+ 2020-10-31T22:35:12.721 INFO:teuthology.task.ansible.out:7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b 2020-10-31T22:35:12.723 INFO:teuthology.task.ansible.out:0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/ 2020-10-31T22:35:12.724 INFO:teuthology.task.ansible.out:nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelope 2020-10-31T22:35:12.726 INFO:teuthology.task.ansible.out:z", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0 2020-10-31T22:35:12.728 INFO:teuthology.task.ansible.out:dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}]}, "changed": false} ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf 2020-10-31T22:35:12.730 INFO:teuthology.task.ansible.out:13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhn 2020-10-31T22:35:12.732 INFO:teuthology.task.ansible.out:S0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrf 2020-10-31T22:35:12.734 INFO:teuthology.task.ansible.out:B0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalf 2020-10-31T22:35:12.739 INFO:teuthology.task.ansible.out:fzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba 2020-10-31T22:35:12.743 INFO:teuthology.task.ansible.out:6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be1 2020-10-31T22:35:12.749 INFO:teuthology.task.ansible.out:7cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"nam 2020-10-31T22:35:12.752 INFO:teuthology.task.ansible.out:e": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a 2020-10-31T22:35:12.755 INFO:teuthology.task.ansible.out:8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb3 2020-10-31T22:35:12.757 INFO:teuthology.task.ansible.out:0f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b644 2020-10-31T22:35:12.766 INFO:teuthology.task.ansible.out:4e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA 2020-10-31T22:35:12.769 INFO:teuthology.task.ansible.out:+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "b 2020-10-31T22:35:12.772 INFO:teuthology.task.ansible.out:enhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}]}, "changed": false} TASK [users : Create all admin users with sudo access.] ************************ changed: [smithi066.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2020-10-31T22:35:12.882 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:12 +0000 (0:00:00.216) 0:00:27.035 ****** 2020-10-31T22:35:12.916 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:12 +0000 (0:00:00.036) 0:00:27.072 ****** 2020-10-31T22:35:13.002 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:12 +0000 (0:00:00.088) 0:00:27.160 ****** 2020-10-31T22:35:13.012 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-10-31T22:35:13.058 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:13 +0000 (0:00:00.053) 0:00:27.214 ****** 2020-10-31T22:35:13.114 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-10-31T22:35:13.118 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2020-10-31T22:35:13.122 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2020-10-31T22:35:13.126 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancic 2020-10-31T22:35:13.128 INFO:teuthology.task.ansible.out:h", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkK 2020-10-31T22:35:13.130 INFO:teuthology.task.ansible.out:ztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 2020-10-31T22:35:13.134 INFO:teuthology.task.ansible.out:HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg 2020-10-31T22:35:13.135 INFO:teuthology.task.ansible.out:e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df 2020-10-31T22:35:13.137 INFO:teuthology.task.ansible.out:79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+ 2020-10-31T22:35:13.142 INFO:teuthology.task.ansible.out:7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b 2020-10-31T22:35:13.144 INFO:teuthology.task.ansible.out:0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/ 2020-10-31T22:35:13.146 INFO:teuthology.task.ansible.out:nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelope 2020-10-31T22:35:13.148 INFO:teuthology.task.ansible.out:z", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0 2020-10-31T22:35:13.152 INFO:teuthology.task.ansible.out:dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}]}, "changed": false} 2020-10-31T22:35:13.222 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:13 +0000 (0:00:00.164) 0:00:27.378 ****** 2020-10-31T22:35:13.569 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-10-31T22:35:13.571 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com -> localhost] => {"after": "2fdf53be9d56af7321864400b67aeaef50e8bec5", "attempts": 1, "before": "2fdf53be9d56af7321864400b67aeaef50e8bec5", "changed": false, "remote_url_changed": false} 2020-10-31T22:35:13.609 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:13 +0000 (0:00:00.388) 0:00:27.766 ****** 2020-10-31T22:35:13.663 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com -> localhost] => {"after": "2fdf53be9d56af7321864400b67aeaef50e8bec5", "attempts": 1, "before": "2fdf53be9d56af7321864400b67aeaef50e8bec5", "changed": false, "remote_url_changed": false} 2020-10-31T22:35:13.722 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:13 +0000 (0:00:00.110) 0:00:27.877 ****** 2020-10-31T22:35:13.730 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com -> localhost] => {"after": "2fdf53be9d56af7321864400b67aeaef50e8bec5", "attempts": 1, "before": "2fdf53be9d56af7321864400b67aeaef50e8bec5", "changed": false, "remote_url_changed": false} 2020-10-31T22:35:13.784 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:13 +0000 (0:00:00.064) 0:00:27.942 ****** 2020-10-31T22:35:13.870 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-10-31T22:35:13.930 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-10-31T22:35:13.942 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:13.945 INFO:teuthology.task.ansible.out:TASK [users : Clone the keys repo] ********************************************* ok: [smithi066.front.sepia.ceph.com -> localhost] => {"after": "2fdf53be9d56af7321864400b67aeaef50e8bec5", "attempts": 1, "before": "2fdf53be9d56af7321864400b67aeaef50e8bec5", "changed": false, "remote_url_changed": false} 2020-10-31T22:35:13.980 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:13 +0000 (0:00:00.195) 0:00:28.138 ****** 2020-10-31T22:35:14.011 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-10-31T22:35:14.013 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-10-31T22:35:14.054 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf708 2020-10-31T22:35:14.058 INFO:teuthology.task.ansible.out:2b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-10-31T22:35:14.139 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-10-31T22:35:14.173 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2020-10-31T22:35:14.198 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-10-31T22:35:14.200 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-10-31T22:35:14.275 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-10-31T22:35:14.277 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-10-31T22:35:14.308 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2020-10-31T22:35:14.320 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-10-31T22:35:14.331 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-10-31T22:35:14.334 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-10-31T22:35:14.407 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-10-31T22:35:14.453 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2020-10-31T22:35:14.465 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-10-31T22:35:14.467 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbk 2020-10-31T22:35:14.468 INFO:teuthology.task.ansible.out:CDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-10-31T22:35:14.547 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-10-31T22:35:14.548 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-10-31T22:35:14.579 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-10-31T22:35:14.591 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2020-10-31T22:35:14.593 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2020-10-31T22:35:14.602 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-10-31T22:35:14.604 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-10-31T22:35:14.667 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-10-31T22:35:14.715 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-10-31T22:35:14.717 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-10-31T22:35:14.731 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2020-10-31T22:35:14.733 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-10-31T22:35:14.807 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-10-31T22:35:14.861 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-10-31T22:35:14.863 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2020-10-31T22:35:14.865 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2020-10-31T22:35:14.873 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-10-31T22:35:14.929 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-10-31T22:35:14.940 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:14.984 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2020-10-31T22:35:14.995 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2020-10-31T22:35:15.017 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-10-31T22:35:15.029 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:15.065 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-10-31T22:35:15.067 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-10-31T22:35:15.119 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-10-31T22:35:15.134 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhb 2020-10-31T22:35:15.136 INFO:teuthology.task.ansible.out:l1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:15.167 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-10-31T22:35:15.169 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-10-31T22:35:15.191 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2020-10-31T22:35:15.193 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2020-10-31T22:35:15.202 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:15.214 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:15.269 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2020-10-31T22:35:15.271 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2020-10-31T22:35:15.280 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:15.323 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2020-10-31T22:35:15.325 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2020-10-31T22:35:15.338 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:15.340 INFO:teuthology.task.ansible.out: skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:15.341 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:15.352 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-10-31T22:35:15.396 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2020-10-31T22:35:15.398 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2020-10-31T22:35:15.407 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:15.422 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c 2020-10-31T22:35:15.424 INFO:teuthology.task.ansible.out:\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2020-10-31T22:35:15.466 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-10-31T22:35:15.477 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-10-31T22:35:15.479 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-10-31T22:35:15.553 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2020-10-31T22:35:15.555 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2020-10-31T22:35:15.565 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:15.567 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2 2020-10-31T22:35:15.569 INFO:teuthology.task.ansible.out:NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:15.599 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-10-31T22:35:15.601 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-10-31T22:35:15.611 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-10-31T22:35:15.700 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-10-31T22:35:15.702 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2020-10-31T22:35:15.723 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2020-10-31T22:35:15.725 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-10-31T22:35:15.726 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-10-31T22:35:15.835 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-10-31T22:35:15.847 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2020-10-31T22:35:15.849 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/ 2020-10-31T22:35:15.851 INFO:teuthology.task.ansible.out:home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-10-31T22:35:15.869 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-10-31T22:35:15.966 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-10-31T22:35:15.968 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-10-31T22:35:15.988 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2020-10-31T22:35:16.010 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-10-31T22:35:16.088 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-10-31T22:35:16.097 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-10-31T22:35:16.119 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2020-10-31T22:35:16.162 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-10-31T22:35:16.217 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-10-31T22:35:16.227 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-10-31T22:35:16.239 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2020-10-31T22:35:16.315 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-10-31T22:35:16.348 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-10-31T22:35:16.353 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-10-31T22:35:16.359 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-10-31T22:35:16.382 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2020-10-31T22:35:16.438 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-10-31T22:35:16.479 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-10-31T22:35:16.481 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-10-31T22:35:16.491 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-10-31T22:35:16.513 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2020-10-31T22:35:16.612 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-10-31T22:35:16.614 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-10-31T22:35:16.625 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-10-31T22:35:16.628 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:16.642 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-10-31T22:35:16.649 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-10-31T22:35:16.662 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2020-10-31T22:35:16.749 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-10-31T22:35:16.761 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-10-31T22:35:16.763 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-10-31T22:35:16.783 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-10-31T22:35:16.786 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-10-31T22:35:16.796 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2020-10-31T22:35:16.798 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2020-10-31T22:35:16.884 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-10-31T22:35:16.886 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-10-31T22:35:16.907 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-10-31T22:35:16.918 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-10-31T22:35:16.940 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2020-10-31T22:35:16.942 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2020-10-31T22:35:17.006 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-10-31T22:35:17.050 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-10-31T22:35:17.051 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-10-31T22:35:17.062 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2020-10-31T22:35:17.128 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-10-31T22:35:17.192 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-10-31T22:35:17.194 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-10-31T22:35:17.204 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-10-31T22:35:17.206 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2020-10-31T22:35:17.260 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-10-31T22:35:17.318 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-10-31T22:35:17.329 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-10-31T22:35:17.330 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46 2020-10-31T22:35:17.332 INFO:teuthology.task.ansible.out:TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2020-10-31T22:35:17.384 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-10-31T22:35:17.459 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2020-10-31T22:35:17.461 INFO:teuthology.task.ansible.out: ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-10-31T22:35:17.473 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-10-31T22:35:17.506 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-10-31T22:35:17.591 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-10-31T22:35:17.593 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2020-10-31T22:35:17.624 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-10-31T22:35:17.625 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-10-31T22:35:17.627 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-10-31T22:35:17.722 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-10-31T22:35:17.733 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2020-10-31T22:35:17.756 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-10-31T22:35:17.767 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-10-31T22:35:17.843 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-10-31T22:35:17.865 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-10-31T22:35:17.867 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2020-10-31T22:35:17.915 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-10-31T22:35:17.989 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-10-31T22:35:17.991 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-10-31T22:35:18.004 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2020-10-31T22:35:18.080 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-10-31T22:35:18.082 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-10-31T22:35:18.114 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-10-31T22:35:18.126 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-10-31T22:35:18.138 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2020-10-31T22:35:18.140 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2020-10-31T22:35:18.213 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-10-31T22:35:18.246 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-10-31T22:35:18.258 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-10-31T22:35:18.269 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2020-10-31T22:35:18.368 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-10-31T22:35:18.370 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-10-31T22:35:18.390 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-10-31T22:35:18.402 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2020-10-31T22:35:18.501 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-10-31T22:35:18.513 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-10-31T22:35:18.514 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-10-31T22:35:18.526 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2020-10-31T22:35:18.625 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-10-31T22:35:18.646 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-10-31T22:35:18.680 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-10-31T22:35:18.681 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2020-10-31T22:35:18.750 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-10-31T22:35:18.783 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-10-31T22:35:18.805 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-10-31T22:35:18.827 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2020-10-31T22:35:18.885 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-10-31T22:35:18.886 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-10-31T22:35:18.907 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-10-31T22:35:18.942 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-10-31T22:35:18.977 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2020-10-31T22:35:19.020 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-10-31T22:35:19.022 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-10-31T22:35:19.043 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-10-31T22:35:19.066 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-10-31T22:35:19.110 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-10-31T22:35:19.143 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-10-31T22:35:19.165 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-10-31T22:35:19.198 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-10-31T22:35:19.244 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2020-10-31T22:35:19.275 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-10-31T22:35:19.319 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-10-31T22:35:19.321 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-10-31T22:35:19.340 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-10-31T22:35:19.395 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2020-10-31T22:35:19.406 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-10-31T22:35:19.439 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-10-31T22:35:19.441 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-10-31T22:35:19.482 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-10-31T22:35:19.484 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-10-31T22:35:19.526 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2020-10-31T22:35:19.528 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2020-10-31T22:35:19.538 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-10-31T22:35:19.540 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-10-31T22:35:19.571 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-10-31T22:35:19.614 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-10-31T22:35:19.616 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2020-10-31T22:35:19.669 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2020-10-31T22:35:19.671 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZU 2020-10-31T22:35:19.673 INFO:teuthology.task.ansible.out:iD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3Rg 2020-10-31T22:35:19.674 INFO:teuthology.task.ansible.out:Pa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-10-31T22:35:19.691 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-10-31T22:35:19.745 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-10-31T22:35:19.799 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-10-31T22:35:19.810 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2020-10-31T22:35:19.833 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-10-31T22:35:19.877 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-10-31T22:35:19.931 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-10-31T22:35:19.964 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2020-10-31T22:35:19.976 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-10-31T22:35:19.978 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-10-31T22:35:20.009 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-10-31T22:35:20.065 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-10-31T22:35:20.098 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-10-31T22:35:20.100 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-10-31T22:35:20.102 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-10-31T22:35:20.111 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2020-10-31T22:35:20.155 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-10-31T22:35:20.157 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-10-31T22:35:20.188 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-10-31T22:35:20.232 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-10-31T22:35:20.264 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nu 2020-10-31T22:35:20.267 INFO:teuthology.task.ansible.out:ll, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-10-31T22:35:20.287 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-10-31T22:35:20.289 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-10-31T22:35:20.291 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-10-31T22:35:20.310 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-10-31T22:35:20.363 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-10-31T22:35:20.385 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2020-10-31T22:35:20.387 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2020-10-31T22:35:20.389 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2020-10-31T22:35:20.419 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-10-31T22:35:20.442 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-10-31T22:35:20.444 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-10-31T22:35:20.486 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-10-31T22:35:20.529 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2020-10-31T22:35:20.561 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-10-31T22:35:20.573 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-10-31T22:35:20.617 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-10-31T22:35:20.671 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2020-10-31T22:35:20.694 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-10-31T22:35:20.695 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-10-31T22:35:20.750 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-10-31T22:35:20.815 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2020-10-31T22:35:20.816 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-10-31T22:35:20.829 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-10-31T22:35:20.830 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-10-31T22:35:20.893 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-10-31T22:35:20.895 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-10-31T22:35:20.947 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-10-31T22:35:20.949 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2020-10-31T22:35:20.959 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-10-31T22:35:21.024 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-10-31T22:35:21.078 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-10-31T22:35:21.080 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-10-31T22:35:21.089 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-10-31T22:35:21.111 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2020-10-31T22:35:21.155 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-10-31T22:35:21.198 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-10-31T22:35:21.231 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-10-31T22:35:21.233 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-10-31T22:35:21.253 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2020-10-31T22:35:21.256 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2020-10-31T22:35:21.276 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-10-31T22:35:21.278 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-10-31T22:35:21.341 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-10-31T22:35:21.363 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-10-31T22:35:21.395 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2020-10-31T22:35:21.397 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-10-31T22:35:21.480 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-10-31T22:35:21.482 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-10-31T22:35:21.502 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-10-31T22:35:21.524 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-10-31T22:35:21.546 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2020-10-31T22:35:21.632 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-10-31T22:35:21.654 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-10-31T22:35:21.656 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-10-31T22:35:21.697 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2020-10-31T22:35:21.699 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2020-10-31T22:35:21.754 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-10-31T22:35:21.766 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-10-31T22:35:21.778 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-10-31T22:35:21.831 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2020-10-31T22:35:21.884 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-10-31T22:35:21.886 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-10-31T22:35:21.971 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2020-10-31T22:35:22.013 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-10-31T22:35:22.015 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": " 2020-10-31T22:35:22.017 INFO:teuthology.task.ansible.out:/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-10-31T22:35:22.058 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-10-31T22:35:22.111 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2020-10-31T22:35:22.113 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2020-10-31T22:35:22.145 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-10-31T22:35:22.147 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-10-31T22:35:22.198 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-10-31T22:35:22.254 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2020-10-31T22:35:22.276 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-10-31T22:35:22.277 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-10-31T22:35:22.310 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-10-31T22:35:22.419 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-10-31T22:35:22.442 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-10-31T22:35:22.538 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2020-10-31T22:35:22.539 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-10-31T22:35:22.552 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-10-31T22:35:22.573 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-10-31T22:35:22.669 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-10-31T22:35:22.681 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-10-31T22:35:22.693 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2020-10-31T22:35:22.695 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-10-31T22:35:22.802 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-10-31T22:35:22.813 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-10-31T22:35:22.825 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-10-31T22:35:22.837 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2020-10-31T22:35:22.924 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-10-31T22:35:22.946 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-10-31T22:35:22.970 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-10-31T22:35:22.981 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2020-10-31T22:35:23.056 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-10-31T22:35:23.078 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-10-31T22:35:23.090 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-10-31T22:35:23.133 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2020-10-31T22:35:23.188 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-10-31T22:35:23.200 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-10-31T22:35:23.226 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-10-31T22:35:23.270 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2020-10-31T22:35:23.313 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-10-31T22:35:23.336 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-10-31T22:35:23.348 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-10-31T22:35:23.413 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2020-10-31T22:35:23.446 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-10-31T22:35:23.468 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2020-10-31T22:35:23.480 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-10-31T22:35:23.566 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2020-10-31T22:35:23.578 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-10-31T22:35:23.610 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-10-31T22:35:23.612 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-10-31T22:35:23.708 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-10-31T22:35:23.709 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2020-10-31T22:35:23.748 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-10-31T22:35:23.751 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-10-31T22:35:23.838 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tL 2020-10-31T22:35:23.840 INFO:teuthology.task.ansible.out:PCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-10-31T22:35:23.871 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-10-31T22:35:23.882 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-10-31T22:35:23.958 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2020-10-31T22:35:23.960 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-10-31T22:35:23.991 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2020-10-31T22:35:24.004 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-10-31T22:35:24.026 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-10-31T22:35:24.090 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-10-31T22:35:24.122 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2020-10-31T22:35:24.145 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-10-31T22:35:24.156 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-10-31T22:35:24.221 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-10-31T22:35:24.265 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2020-10-31T22:35:24.277 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-10-31T22:35:24.300 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-10-31T22:35:24.344 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-10-31T22:35:24.399 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-10-31T22:35:24.414 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2020-10-31T22:35:24.441 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-10-31T22:35:24.477 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-10-31T22:35:24.530 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2020-10-31T22:35:24.532 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-10-31T22:35:24.553 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2020-10-31T22:35:24.555 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-10-31T22:35:24.607 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-10-31T22:35:24.609 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-10-31T22:35:24.661 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-10-31T22:35:24.683 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2020-10-31T22:35:24.695 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-10-31T22:35:24.749 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-10-31T22:35:24.751 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-10-31T22:35:24.803 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-10-31T22:35:24.825 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2020-10-31T22:35:24.826 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2020-10-31T22:35:24.828 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-10-31T22:35:24.923 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-10-31T22:35:24.967 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-10-31T22:35:24.979 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2020-10-31T22:35:25.033 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-10-31T22:35:25.056 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-10-31T22:35:25.089 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-10-31T22:35:25.111 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2020-10-31T22:35:25.164 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-10-31T22:35:25.186 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-10-31T22:35:25.188 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-10-31T22:35:25.230 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-10-31T22:35:25.253 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2020-10-31T22:35:25.255 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2020-10-31T22:35:25.287 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-10-31T22:35:25.319 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-10-31T22:35:25.321 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-10-31T22:35:25.363 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-10-31T22:35:25.385 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2020-10-31T22:35:25.418 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-10-31T22:35:25.439 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-10-31T22:35:25.493 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-10-31T22:35:25.495 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-10-31T22:35:25.526 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2020-10-31T22:35:25.538 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-10-31T22:35:25.560 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-10-31T22:35:25.624 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-10-31T22:35:25.626 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-10-31T22:35:25.656 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-10-31T22:35:25.668 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2020-10-31T22:35:25.691 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-10-31T22:35:25.755 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-10-31T22:35:25.788 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-10-31T22:35:25.810 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2020-10-31T22:35:25.821 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-10-31T22:35:25.885 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-10-31T22:35:25.917 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2020-10-31T22:35:25.919 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-10-31T22:35:25.950 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-10-31T22:35:25.952 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2020-10-31T22:35:25.953 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2020-10-31T22:35:26.016 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-10-31T22:35:26.037 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-10-31T22:35:26.039 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:26.081 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-10-31T22:35:26.103 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2020-10-31T22:35:26.106 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2020-10-31T22:35:26.146 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-10-31T22:35:26.179 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-10-31T22:35:26.211 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-10-31T22:35:26.243 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2020-10-31T22:35:26.276 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-10-31T22:35:26.308 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-10-31T22:35:26.341 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2020-10-31T22:35:26.343 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-10-31T22:35:26.384 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2020-10-31T22:35:26.406 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-10-31T22:35:26.440 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-10-31T22:35:26.462 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-10-31T22:35:26.496 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2020-10-31T22:35:26.539 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-10-31T22:35:26.573 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-10-31T22:35:26.596 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-10-31T22:35:26.628 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2020-10-31T22:35:26.661 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2020-10-31T22:35:26.666 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-10-31T22:35:26.707 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-10-31T22:35:26.730 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-10-31T22:35:26.774 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2020-10-31T22:35:26.796 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-10-31T22:35:26.828 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-10-31T22:35:26.830 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-10-31T22:35:26.861 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-10-31T22:35:26.915 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2020-10-31T22:35:26.927 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-10-31T22:35:26.971 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-10-31T22:35:26.982 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-10-31T22:35:27.058 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2020-10-31T22:35:27.060 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-10-31T22:35:27.093 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-10-31T22:35:27.115 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-10-31T22:35:27.190 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-10-31T22:35:27.202 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2020-10-31T22:35:27.203 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2020-10-31T22:35:27.235 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-10-31T22:35:27.237 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-10-31T22:35:27.240 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-10-31T22:35:27.321 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-10-31T22:35:27.343 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2020-10-31T22:35:27.355 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-10-31T22:35:27.357 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-10-31T22:35:27.440 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2020-10-31T22:35:27.463 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2020-10-31T22:35:27.490 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-10-31T22:35:27.491 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-10-31T22:35:27.578 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-10-31T22:35:27.580 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-10-31T22:35:27.614 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2020-10-31T22:35:27.628 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvg 2020-10-31T22:35:27.630 INFO:teuthology.task.ansible.out:yPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-10-31T22:35:27.714 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-10-31T22:35:27.747 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2020-10-31T22:35:27.759 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-10-31T22:35:27.760 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-10-31T22:35:27.856 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-10-31T22:35:27.878 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2020-10-31T22:35:27.890 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-10-31T22:35:27.891 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-10-31T22:35:27.976 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-10-31T22:35:28.020 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "valid 2020-10-31T22:35:28.022 INFO:teuthology.task.ansible.out:ate_certs": true} ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-10-31T22:35:28.108 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-10-31T22:35:28.151 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-10-31T22:35:28.152 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-10-31T22:35:28.165 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", 2020-10-31T22:35:28.167 INFO:teuthology.task.ansible.out:"manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2020-10-31T22:35:28.240 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-10-31T22:35:28.284 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-10-31T22:35:28.296 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-10-31T22:35:28.318 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2020-10-31T22:35:28.371 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-10-31T22:35:28.425 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-10-31T22:35:28.437 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-10-31T22:35:28.460 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2020-10-31T22:35:28.461 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:28.494 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-10-31T22:35:28.497 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:28.550 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-10-31T22:35:28.553 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-10-31T22:35:28.607 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2020-10-31T22:35:28.640 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-10-31T22:35:28.682 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-10-31T22:35:28.684 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-10-31T22:35:28.760 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2020-10-31T22:35:28.772 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-10-31T22:35:28.807 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-10-31T22:35:28.818 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-10-31T22:35:28.903 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-10-31T22:35:28.905 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2020-10-31T22:35:28.940 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-10-31T22:35:28.942 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-10-31T22:35:29.026 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-10-31T22:35:29.039 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2020-10-31T22:35:29.061 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-10-31T22:35:29.072 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2020-10-31T22:35:29.158 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-10-31T22:35:29.182 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2020-10-31T22:35:29.193 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-10-31T22:35:29.205 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-10-31T22:35:29.293 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-10-31T22:35:29.325 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-10-31T22:35:29.326 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2020-10-31T22:35:29.327 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9V 2020-10-31T22:35:29.328 INFO:teuthology.task.ansible.out:RB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2020-10-31T22:35:29.435 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-10-31T22:35:29.461 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2020-10-31T22:35:29.463 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2020-10-31T22:35:29.570 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-10-31T22:35:29.593 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-10-31T22:35:29.594 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2020-10-31T22:35:29.607 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2020-10-31T22:35:29.703 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-10-31T22:35:29.715 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2020-10-31T22:35:29.718 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2020-10-31T22:35:29.727 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2020-10-31T22:35:29.750 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2020-10-31T22:35:29.840 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2020-10-31T22:35:29.842 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2020-10-31T22:35:29.852 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2020-10-31T22:35:29.896 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2020-10-31T22:35:29.972 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2020-10-31T22:35:29.973 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-10-31T22:35:29.976 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2020-10-31T22:35:30.019 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2020-10-31T22:35:30.093 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2020-10-31T22:35:30.095 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2020-10-31T22:35:30.097 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2020-10-31T22:35:30.106 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2020-10-31T22:35:30.160 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2020-10-31T22:35:30.226 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2020-10-31T22:35:30.228 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2020-10-31T22:35:30.238 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2020-10-31T22:35:30.302 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2020-10-31T22:35:30.345 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2020-10-31T22:35:30.357 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2020-10-31T22:35:30.358 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2020-10-31T22:35:30.445 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2020-10-31T22:35:30.478 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2020-10-31T22:35:30.480 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCavoAU8IGVih0HbUrIr5K44uQLdAq3r9MhKqnu754H8sigfFkxWPC6CsyKaGe0WnGcXz8wUdONqqew4WVvMN6KqE/8oLBf10yQYiigPw6ITPajrpj1JSsoW8kNIsfvrt+lzTUMWx0b6ThtQdANAu4OFZzERU//6yCy2Az0O0Ys9p4smgkwaXOA26hA48cxi147fBVC0Wl5xHuELKbmZ7pZFF/eAB9RLNlIRhBitWo93cLaWojivaJoxVhmKFgybuy7K+w1Tg7ACEJsSKXesO9AkcbFOXBuEwJQZDwyD4R6FfchloOGLBgb6Vn5bLDShWAgKlHE7eWa1EYG8qAjT9yeJEWIcQLz+8e3izFwriJAAzOqEB9a2GqVN6LQJzXTDcchJkOhhjfXaK3U3fqEfBozRtKVAUoNUgnlhYRbEcTMEuvz5AAUFB+0kvQpiw+RtieZUHl76KsNmFSIu7HSdgukdlkrGwOsl93qmYX96Q5AvanaAFj8ohbWSJSxZhKIB4U= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2020-10-31T22:35:30.490 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2020-10-31T22:35:30.586 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2020-10-31T22:35:30.598 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2020-10-31T22:35:30.599 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2020-10-31T22:35:30.632 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2020-10-31T22:35:30.718 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2020-10-31T22:35:30.729 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2020-10-31T22:35:30.741 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2020-10-31T22:35:30.792 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2020-10-31T22:35:30.825 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:30 +0000 (0:00:16.845) 0:00:44.983 ****** 2020-10-31T22:35:30.846 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2020-10-31T22:35:30.848 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2020-10-31T22:35:30.868 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCavoAU8IGVih0HbUrIr5K44uQLdAq3r9MhKqnu754H8sigfFkxWPC6CsyKaGe0WnGcXz8wUdONqqew4WVvMN6KqE/8oLBf10yQYiigPw6ITPajrpj1JSsoW8kNIsfvrt+lzTUMWx0b6ThtQdANAu4OFZzERU//6yCy2Az0O0Ys9p4smgkwaXOA26hA48cxi147fBVC0Wl5xHuELKbmZ7pZFF/eAB9RLNlIRhBitWo93cLaWojivaJoxVhmKFgybuy7K+w1Tg7ACEJsSKXesO9AkcbFOXBuEwJQZDwyD4R6FfchloOGLBgb6Vn5bLDShWAgKlHE7eWa1EYG8qAjT9yeJEWIcQLz+8e3izFwriJAAzOqEB9a2GqVN6LQJzXTDcchJkOhhjfXaK3U3fqEfBozRtKVAUoNUgnlhYRbEcTMEuvz5AAUFB+0kvQpiw+RtieZUHl76KsNmFSIu7HSdgukdlkrGwOsl93qmYX96Q5AvanaAFj8ohbWSJSxZhKIB4U= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2020-10-31T22:35:30.879 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2020-10-31T22:35:30.881 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:30.892 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:30.903 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:30.915 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:30.927 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:30.938 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:30.983 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-10-31T22:35:30.985 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2020-10-31T22:35:30.995 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2020-10-31T22:35:31.007 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2020-10-31T22:35:31.073 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:31.075 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.127 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-10-31T22:35:31.129 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_ 2020-10-31T22:35:31.131 INFO:teuthology.task.ansible.out:certs": true} 2020-10-31T22:35:31.183 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2020-10-31T22:35:31.218 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:31 +0000 (0:00:00.392) 0:00:45.375 ****** 2020-10-31T22:35:31.225 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-10-31T22:35:31.227 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e 2020-10-31T22:35:31.229 INFO:teuthology.task.ansible.out:1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.273 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-10-31T22:35:31.275 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCavoAU8IGVih0HbUrIr5K44uQLdAq3r9MhKqnu754H8sigfFkxWPC6CsyKaGe0WnGcXz8wUdONqqew4WVvMN6KqE/8oLBf10yQYiigPw6ITPajrpj1JSsoW8kNIsfvrt+lzTUMWx0b6ThtQdANAu4OFZzERU//6yCy2Az0O0Ys9p4smgkwaXOA26hA48cxi147fBVC0Wl5xHuELKbmZ7pZFF/eAB9RLNlIRhBitWo93cLaWojivaJoxVhmKFgybuy7K+w1Tg7ACEJsSKXesO9AkcbFOXBuEwJQZDwyD4R6FfchloOGLBgb6Vn5bLDShWAgKlHE7eWa1EYG8qAjT9yeJEWIcQLz+8e3izFwriJAAzOqEB9a2GqVN6LQJzXTDcchJkOhhjfXaK3U3fqEfBozRtKVAUoNUgnlhYRbEcTMEuvz5AAUFB+0kvQpiw+RtieZUHl76KsNmFSIu7HSdgukdlkrGwOsl93qmYX96Q5AvanaAFj8ohbWSJSxZhKIB4U= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2020-10-31T22:35:31.285 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2020-10-31T22:35:31.362 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-10-31T22:35:31.364 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-10-31T22:35:31.385 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.396 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.408 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2020-10-31T22:35:31.409 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.419 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-10-31T22:35:31.421 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2020-10-31T22:35:31.431 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.433 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841e 2020-10-31T22:35:31.434 INFO:teuthology.task.ansible.out:e62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.444 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.455 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.488 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-10-31T22:35:31.499 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.501 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.512 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.523 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.525 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:31.535 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.536 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi066.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.547 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-10-31T22:35:31.549 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2020-10-31T22:35:31.588 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-10-31T22:35:31.589 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyu 2020-10-31T22:35:31.591 INFO:teuthology.task.ansible.out:riw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.624 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:31 +0000 (0:00:00.406) 0:00:45.782 ****** 2020-10-31T22:35:31.632 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.634 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-10-31T22:35:31.635 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.636 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b9057 2020-10-31T22:35:31.637 INFO:teuthology.task.ansible.out:4d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.638 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 2020-10-31T22:35:31.639 INFO:teuthology.task.ansible.out: 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) 2020-10-31T22:35:31.641 INFO:teuthology.task.ansible.out:=> {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.652 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.664 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.675 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.677 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.687 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-10-31T22:35:31.689 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@re 2020-10-31T22:35:31.691 INFO:teuthology.task.ansible.out:dhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.701 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.703 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.713 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.715 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.725 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.727 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.738 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2020-10-31T22:35:31.740 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.751 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.752 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.762 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.773 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.775 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.785 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.797 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.814 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.825 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.826 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-10-31T22:35:31.827 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2020-10-31T22:35:31.828 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.840 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.851 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.853 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.863 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-10-31T22:35:31.864 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr 2020-10-31T22:35:31.866 INFO:teuthology.task.ansible.out:1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.876 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.877 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@s 2020-10-31T22:35:31.879 INFO:teuthology.task.ansible.out:easalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.888 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.890 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.900 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.902 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.913 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.915 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.924 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.926 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.937 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.939 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.948 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.950 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.961 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-10-31T22:35:31.962 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2020-10-31T22:35:31.963 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "c 2020-10-31T22:35:31.965 INFO:teuthology.task.ansible.out:hanged": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.974 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.975 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.977 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.988 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:31.990 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.001 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.003 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.013 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.014 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.015 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.027 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.028 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.029 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.040 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.041 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.052 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.054 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.064 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.066 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.076 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.077 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZH 2020-10-31T22:35:32.079 INFO:teuthology.task.ansible.out:i8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.088 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.090 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.100 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.101 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.103 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCavoAU8IGVih0HbUrIr5K44uQLdAq3r9MhKqnu754H8sigfFkxWPC6CsyKaGe0WnGcXz8wUdONqqew4WVvMN6KqE/8oLBf10yQYiigPw6ITPajrpj1JSsoW8kNIsfvrt+lzTUMWx0b6ThtQdANAu4OFZzERU//6yCy2Az0O0Ys9p4smgkwaXOA26hA48cxi147fBVC0Wl5xHuELKbmZ7pZFF/eAB9RLNlIRhBitWo93cLaWojivaJoxVhmKFgybuy7K+w1Tg7ACEJsSKXesO9AkcbFOXBuEwJQZDwyD4R6FfchloOGLBgb6Vn5bLDShWAgKlHE7eWa1EYG8qAjT9yeJEWIcQLz+8e3izFwriJAAzOqEB9a2GqVN6LQJzXTDcchJkOhhjfXaK3U3fqEfBozRtKVAUoNUgnlhYRbEcTMEuvz5AAUFB+0kvQpiw+RtieZUHl76KsNmFSIu7HSdgukdlkrGwOsl93qmYX96Q5AvanaAFj8ohbWSJSxZhKIB4U= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2020-10-31T22:35:32.103 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.104 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f 2020-10-31T22:35:32.105 INFO:teuthology.task.ansible.out:459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.116 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.116 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.118 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.129 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.130 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.140 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.142 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJ 2020-10-31T22:35:32.144 INFO:teuthology.task.ansible.out:nd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.154 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.156 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.166 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.168 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.178 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.178 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.179 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.180 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.194 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.196 INFO:teuthology.task.ansible.out: skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.207 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.209 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.211 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.222 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.224 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.234 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.238 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2020-10-31T22:35:32.249 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.252 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.261 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.262 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.263 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.264 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-10-31T22:35:32.265 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c9 2020-10-31T22:35:32.266 INFO:teuthology.task.ansible.out:5b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.277 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.279 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.289 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.290 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.292 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.302 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.304 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.314 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.316 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.317 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.319 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.320 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.321 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.331 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.333 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.333 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.334 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058 2020-10-31T22:35:32.335 INFO:teuthology.task.ansible.out:c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.345 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.346 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.358 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.359 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", 2020-10-31T22:35:32.361 INFO:teuthology.task.ansible.out: "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.371 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.372 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.383 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.390 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.392 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.392 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ans 2020-10-31T22:35:32.394 INFO:teuthology.task.ansible.out:ible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi060.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmom 2020-10-31T22:35:32.397 INFO:teuthology.task.ansible.out:ar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.406 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.425 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-10-31T22:35:32.460 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-10-31T22:35:32.462 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "cha 2020-10-31T22:35:32.464 INFO:teuthology.task.ansible.out:nged": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenha 2020-10-31T22:35:32.465 INFO:teuthology.task.ansible.out:no@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA 2020-10-31T22:35:32.467 INFO:teuthology.task.ansible.out: e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.485 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.488 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+ 2020-10-31T22:35:32.490 INFO:teuthology.task.ansible.out:Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bda 2020-10-31T22:35:32.492 INFO:teuthology.task.ansible.out:f79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff134934 2020-10-31T22:35:32.493 INFO:teuthology.task.ansible.out:9fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.527 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:32 +0000 (0:00:00.902) 0:00:46.685 ****** 2020-10-31T22:35:32.568 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:32 +0000 (0:00:00.041) 0:00:46.726 ****** 2020-10-31T22:35:32.578 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.580 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.581 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.581 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.583 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.584 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.584 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.585 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU 2020-10-31T22:35:32.586 INFO:teuthology.task.ansible.out:8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.587 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPX 2020-10-31T22:35:32.588 INFO:teuthology.task.ansible.out:ipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.589 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679 2020-10-31T22:35:32.590 INFO:teuthology.task.ansible.out:d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.604 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.606 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.607 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item" 2020-10-31T22:35:32.609 INFO:teuthology.task.ansible.out:, "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.744 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:32 +0000 (0:00:00.175) 0:00:46.902 ****** 2020-10-31T22:35:32.753 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.756 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.758 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.758 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": 2020-10-31T22:35:32.760 INFO:teuthology.task.ansible.out:"gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.760 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445 2020-10-31T22:35:32.762 INFO:teuthology.task.ansible.out:d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0i 2020-10-31T22:35:32.764 INFO:teuthology.task.ansible.out:CJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumra 2020-10-31T22:35:32.766 INFO:teuthology.task.ansible.out:o", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.777 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.778 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"n 2020-10-31T22:35:32.780 INFO:teuthology.task.ansible.out:ame": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57 2020-10-31T22:35:32.782 INFO:teuthology.task.ansible.out:ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi152 2020-10-31T22:35:32.783 INFO:teuthology.task.ansible.out:.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "it 2020-10-31T22:35:32.785 INFO:teuthology.task.ansible.out:em": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.786 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.787 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.787 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.788 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "ch 2020-10-31T22:35:32.789 INFO:teuthology.task.ansible.out:anged": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.804 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.806 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.841 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:32 +0000 (0:00:00.096) 0:00:46.999 ****** 2020-10-31T22:35:32.850 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.851 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.853 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.853 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.855 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.867 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.868 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.878 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.879 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.880 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.881 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "excl 2020-10-31T22:35:32.883 INFO:teuthology.task.ansible.out:usive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2020-10-31T22:35:32.931 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:32 +0000 (0:00:00.090) 0:00:47.089 ****** 2020-10-31T22:35:32.939 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.940 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.941 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.942 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi085.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-10-31T22:35:32.944 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.944 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.944 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) 2020-10-31T22:35:32.946 INFO:teuthology.task.ansible.out: => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.956 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.958 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.968 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.969 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.979 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.990 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:32.992 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.001 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.002 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.013 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.024 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.026 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5 2020-10-31T22:35:33.027 INFO:teuthology.task.ansible.out:aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} TASK [users : Remove revoked users] ******************************************** ok: [smithi085.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-10-31T22:35:33.037 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-10-31T22:35:33.039 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.049 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.061 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.063 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.073 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.084 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.086 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi152.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-10-31T22:35:33.096 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-10-31T22:35:33.098 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.108 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.119 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.130 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.142 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.144 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.154 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.154 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-31T22:35:33.155 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-10-31T22:35:33.166 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-10-31T22:35:33.168 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.178 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2020-10-31T22:35:33.180 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.190 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.191 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.192 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.203 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.204 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.215 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.217 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.218 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.219 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi152.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-10-31T22:35:33.219 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db 2020-10-31T22:35:33.221 INFO:teuthology.task.ansible.out:0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.231 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.242 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.243 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.254 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.271 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.272 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.309 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:33 +0000 (0:00:00.377) 0:00:47.467 ****** 2020-10-31T22:35:33.318 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.320 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-31T22:35:33.320 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-10-31T22:35:33.321 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.322 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.323 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.324 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.325 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagi 2020-10-31T22:35:33.326 INFO:teuthology.task.ansible.out:de uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.337 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.338 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.379 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:33 +0000 (0:00:00.069) 0:00:47.537 ****** 2020-10-31T22:35:33.388 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.389 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-31T22:35:33.390 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-10-31T22:35:33.391 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.391 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.393 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.394 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.406 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.408 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi085.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.418 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.429 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.430 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.442 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.444 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.455 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.466 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.468 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.478 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.480 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi152.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-10-31T22:35:33.492 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.494 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.504 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.505 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.515 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.517 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.527 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-31T22:35:33.529 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.540 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.542 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.553 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.554 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-31T22:35:33.554 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-10-31T22:35:33.555 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.566 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.579 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.590 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.601 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.603 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.612 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-31T22:35:33.614 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.625 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.636 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.638 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.648 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.650 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi085.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-10-31T22:35:33.650 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.662 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.663 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.674 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.687 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2020-10-31T22:35:33.689 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.700 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.701 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.712 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.724 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.726 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi152.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-10-31T22:35:33.737 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-10-31T22:35:33.739 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.749 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.760 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.772 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.783 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-31T22:35:33.785 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.786 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.797 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.808 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.819 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-31T22:35:33.821 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.831 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.842 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.844 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.853 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi152.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-10-31T22:35:33.855 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.865 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.866 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.876 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.887 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.889 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.899 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.900 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi085.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.911 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.923 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.924 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.935 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.937 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.946 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-31T22:35:33.948 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.958 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.969 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.970 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.972 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi152.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-10-31T22:35:33.984 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:33.986 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.996 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:33.998 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:34.007 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:34.009 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:34.019 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:34.022 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi085.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-10-31T22:35:34.031 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-10-31T22:35:34.033 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:34.043 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:34.045 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:34.055 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:34.067 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:34.068 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:34.070 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi066.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-10-31T22:35:34.083 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain t8SWYptrljA5HM9+FH06Kg 535cbe1eb043fa4bd6c24ad0a43fa99375ee8c4dea15e10582e51c7a059f5b78"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:34.085 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:34.095 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:34.113 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-31T22:35:34.115 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2020-10-31T22:35:34.150 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:34 +0000 (0:00:00.770) 0:00:48.307 ****** 2020-10-31T22:35:34.159 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-10-31T22:35:34.182 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-10-31T22:35:34.184 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:34.220 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:34 +0000 (0:00:00.070) 0:00:48.378 ****** 2020-10-31T22:35:34.228 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-31T22:35:34.230 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} ok: [smithi152.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-10-31T22:35:34.284 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-10-31T22:35:34.327 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-10-31T22:35:34.349 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-10-31T22:35:34.393 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2020-10-31T22:35:34.416 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-10-31T22:35:34.450 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-10-31T22:35:34.482 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-10-31T22:35:34.526 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2020-10-31T22:35:34.538 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-10-31T22:35:34.581 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2020-10-31T22:35:34.604 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-10-31T22:35:34.658 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2020-10-31T22:35:34.660 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-10-31T22:35:34.702 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-10-31T22:35:34.724 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-10-31T22:35:34.777 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2020-10-31T22:35:34.779 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-10-31T22:35:34.831 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-10-31T22:35:34.853 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-10-31T22:35:34.899 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2020-10-31T22:35:34.901 INFO:teuthology.task.ansible.out: ok: [smithi085.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-10-31T22:35:34.955 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-10-31T22:35:34.956 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:34.978 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-10-31T22:35:34.980 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:35.024 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2020-10-31T22:35:35.025 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-10-31T22:35:35.091 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-10-31T22:35:35.113 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-10-31T22:35:35.145 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-10-31T22:35:35.168 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2020-10-31T22:35:35.212 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-10-31T22:35:35.235 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-10-31T22:35:35.280 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-10-31T22:35:35.302 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2020-10-31T22:35:35.335 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-10-31T22:35:35.357 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-10-31T22:35:35.411 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-10-31T22:35:35.433 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2020-10-31T22:35:35.466 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-10-31T22:35:35.478 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-10-31T22:35:35.541 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-10-31T22:35:35.574 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2020-10-31T22:35:35.596 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-10-31T22:35:35.608 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-10-31T22:35:35.662 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-10-31T22:35:35.685 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2020-10-31T22:35:35.728 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-10-31T22:35:35.729 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-10-31T22:35:35.795 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-10-31T22:35:35.829 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2020-10-31T22:35:35.856 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-10-31T22:35:35.857 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-10-31T22:35:35.922 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-10-31T22:35:35.954 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2020-10-31T22:35:35.989 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-10-31T22:35:35.991 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2020-10-31T22:35:36.055 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-10-31T22:35:36.098 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2020-10-31T22:35:36.110 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2020-10-31T22:35:36.122 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-10-31T22:35:36.177 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-10-31T22:35:36.220 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2020-10-31T22:35:36.242 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-10-31T22:35:36.243 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-10-31T22:35:36.296 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-10-31T22:35:36.349 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2020-10-31T22:35:36.362 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-10-31T22:35:36.373 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-10-31T22:35:36.417 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-10-31T22:35:36.481 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2020-10-31T22:35:36.492 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-10-31T22:35:36.493 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-10-31T22:35:36.548 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-10-31T22:35:36.613 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2020-10-31T22:35:36.615 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} ok: [smithi066.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-10-31T22:35:36.670 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-10-31T22:35:36.738 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-10-31T22:35:36.749 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-10-31T22:35:36.751 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2020-10-31T22:35:36.805 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-10-31T22:35:36.869 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-10-31T22:35:36.871 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} ok: [smithi066.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-10-31T22:35:36.924 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-10-31T22:35:36.994 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-10-31T22:35:37.158 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} ok: [smithi060.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} ok: [smithi085.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} ok: [smithi152.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} ok: [smithi066.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} ok: [smithi060.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2020-10-31T22:35:37.183 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-10-31T22:35:37.242 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-10-31T22:35:37.254 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-10-31T22:35:37.265 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2020-10-31T22:35:37.318 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-10-31T22:35:37.362 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-10-31T22:35:37.385 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-10-31T22:35:37.407 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2020-10-31T22:35:37.440 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2020-10-31T22:35:37.494 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-10-31T22:35:37.505 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-10-31T22:35:37.527 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2020-10-31T22:35:37.560 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-10-31T22:35:37.624 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2020-10-31T22:35:37.635 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-10-31T22:35:37.647 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2020-10-31T22:35:37.690 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-10-31T22:35:37.743 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-10-31T22:35:37.755 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-10-31T22:35:37.787 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2020-10-31T22:35:37.809 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-10-31T22:35:37.884 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-10-31T22:35:37.885 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-10-31T22:35:37.908 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2020-10-31T22:35:37.930 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-10-31T22:35:38.005 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-10-31T22:35:38.007 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-10-31T22:35:38.039 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2020-10-31T22:35:38.051 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-10-31T22:35:38.117 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-10-31T22:35:38.129 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2020-10-31T22:35:38.186 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} ok: [smithi060.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2020-10-31T22:35:38.250 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-10-31T22:35:38.262 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-10-31T22:35:38.306 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2020-10-31T22:35:38.308 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-10-31T22:35:38.371 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-10-31T22:35:38.383 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-10-31T22:35:38.428 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2020-10-31T22:35:38.430 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-10-31T22:35:38.494 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-10-31T22:35:38.506 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-10-31T22:35:38.550 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2020-10-31T22:35:38.552 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2020-10-31T22:35:38.616 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-10-31T22:35:38.638 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-10-31T22:35:38.681 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2020-10-31T22:35:38.683 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2020-10-31T22:35:38.734 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:38 +0000 (0:00:04.513) 0:00:52.892 ****** 2020-10-31T22:35:38.753 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2020-10-31T22:35:38.765 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-10-31T22:35:38.808 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2020-10-31T22:35:38.863 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2020-10-31T22:35:38.917 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:38 +0000 (0:00:00.182) 0:00:53.074 ****** 2020-10-31T22:35:38.925 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-10-31T22:35:38.938 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2020-10-31T22:35:39.013 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-10-31T22:35:39.067 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2020-10-31T22:35:39.099 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-10-31T22:35:39.101 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => {"changed": true, "checksum": "d8552df970c391f399984416ffe118cc22890e59", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "d98ee1485b8d3e37d7723150a7761644", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1604183738.7601047-255183071615631/source", "state": "file", "uid": 0} 2020-10-31T22:35:39.154 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.237) 0:00:53.312 ****** 2020-10-31T22:35:39.165 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-31T22:35:39.166 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2020-10-31T22:35:39.188 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-10-31T22:35:39.189 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => { "msg": "Host smithi085.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } TASK [users : Remove revoked users] ******************************************** ok: [smithi060.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2020-10-31T22:35:39.224 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.070) 0:00:53.382 ****** 2020-10-31T22:35:39.264 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-10-31T22:35:39.266 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} TASK [users : Remove revoked users] ******************************************** ok: [smithi066.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2020-10-31T22:35:39.266 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "checksum": "d8552df970c391f399984416ffe118cc22890e59", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "d98ee1485b8d3e37d7723150a7761644", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1604183738.9407618-9805138883350/source", "state": "file", "uid": 0} 2020-10-31T22:35:39.303 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.078) 0:00:53.461 ****** 2020-10-31T22:35:39.347 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.044) 0:00:53.505 ****** 2020-10-31T22:35:39.355 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-10-31T22:35:39.357 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi060.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2020-10-31T22:35:39.401 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.053) 0:00:53.558 ****** 2020-10-31T22:35:39.409 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-10-31T22:35:39.411 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => { "msg": "Host smithi152.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } TASK [users : Remove revoked users] ******************************************** ok: [smithi066.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2020-10-31T22:35:39.437 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:39.471 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.070) 0:00:53.629 ****** 2020-10-31T22:35:39.513 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.041) 0:00:53.670 ****** 2020-10-31T22:35:39.548 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.035) 0:00:53.706 ****** 2020-10-31T22:35:39.559 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi060.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2020-10-31T22:35:39.561 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:39.598 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.049) 0:00:53.756 ****** 2020-10-31T22:35:39.608 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-10-31T22:35:39.610 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-10-31T22:35:39.610 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi060.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2020-10-31T22:35:39.647 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.048) 0:00:53.804 ****** 2020-10-31T22:35:39.655 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-10-31T22:35:39.657 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:39.696 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.049) 0:00:53.854 ****** 2020-10-31T22:35:39.705 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-10-31T22:35:39.706 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:39.743 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.046) 0:00:53.901 ****** 2020-10-31T22:35:39.751 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-10-31T22:35:39.753 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi060.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2020-10-31T22:35:39.791 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.048) 0:00:53.949 ****** 2020-10-31T22:35:39.800 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-10-31T22:35:39.802 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:39.844 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.052) 0:00:54.001 ****** 2020-10-31T22:35:39.854 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-10-31T22:35:39.857 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "checksum": "d8552df970c391f399984416ffe118cc22890e59", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "d98ee1485b8d3e37d7723150a7761644", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1604183739.4987757-55746967754952/source", "state": "file", "uid": 0} 2020-10-31T22:35:39.859 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi060.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2020-10-31T22:35:39.918 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.073) 0:00:54.075 ****** 2020-10-31T22:35:39.950 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.032) 0:00:54.108 ****** 2020-10-31T22:35:39.958 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-10-31T22:35:39.960 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Log the OS name, version and release] *************************** ok: [smithi066.front.sepia.ceph.com] => { "msg": "Host smithi066.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-10-31T22:35:39.995 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:39 +0000 (0:00:00.044) 0:00:54.152 ****** 2020-10-31T22:35:40.028 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.033) 0:00:54.185 ****** 2020-10-31T22:35:40.034 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-10-31T22:35:40.036 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi060.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2020-10-31T22:35:40.037 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi066.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-10-31T22:35:40.073 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.044) 0:00:54.230 ****** 2020-10-31T22:35:40.107 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.035) 0:00:54.265 ****** 2020-10-31T22:35:40.115 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-10-31T22:35:40.116 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:40.154 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.046) 0:00:54.312 ****** 2020-10-31T22:35:40.187 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.033) 0:00:54.345 ****** 2020-10-31T22:35:40.195 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-10-31T22:35:40.197 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:40.233 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.045) 0:00:54.391 ****** 2020-10-31T22:35:40.268 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.035) 0:00:54.426 ****** 2020-10-31T22:35:40.277 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-10-31T22:35:40.279 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi060.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2020-10-31T22:35:40.319 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.050) 0:00:54.476 ****** 2020-10-31T22:35:40.356 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.037) 0:00:54.514 ****** 2020-10-31T22:35:40.363 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-10-31T22:35:40.365 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi085.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:40.406 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.048) 0:00:54.562 ****** 2020-10-31T22:35:40.439 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.034) 0:00:54.597 ****** 2020-10-31T22:35:40.446 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-10-31T22:35:40.448 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi060.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2020-10-31T22:35:40.468 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:40.470 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:40.504 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.065) 0:00:54.662 ****** 2020-10-31T22:35:40.539 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.034) 0:00:54.697 ****** 2020-10-31T22:35:40.576 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.036) 0:00:54.733 ****** 2020-10-31T22:35:40.612 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.036) 0:00:54.769 ****** 2020-10-31T22:35:40.628 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-10-31T22:35:40.629 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:40.667 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.055) 0:00:54.825 ****** 2020-10-31T22:35:40.718 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.050) 0:00:54.875 ****** 2020-10-31T22:35:40.728 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-10-31T22:35:40.730 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:40.765 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.047) 0:00:54.922 ****** 2020-10-31T22:35:40.801 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.036) 0:00:54.959 ****** 2020-10-31T22:35:40.808 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-10-31T22:35:40.810 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:40.847 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.045) 0:00:55.005 ****** 2020-10-31T22:35:40.880 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.032) 0:00:55.038 ****** 2020-10-31T22:35:40.887 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:40.889 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi060.front.sepia.ceph.com] => {"changed": true, "checksum": "d8552df970c391f399984416ffe118cc22890e59", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "d98ee1485b8d3e37d7723150a7761644", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1604183740.5254333-57482660027558/source", "state": "file", "uid": 0} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi066.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-31T22:35:40.923 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.043) 0:00:55.081 ****** 2020-10-31T22:35:40.957 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.034) 0:00:55.115 ****** 2020-10-31T22:35:40.990 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:40 +0000 (0:00:00.032) 0:00:55.147 ****** 2020-10-31T22:35:40.996 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-10-31T22:35:40.998 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Log the OS name, version and release] *************************** ok: [smithi060.front.sepia.ceph.com] => { "msg": "Host smithi060.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2020-10-31T22:35:40.998 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:41.045 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.055) 0:00:55.203 ****** 2020-10-31T22:35:41.091 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.045) 0:00:55.249 ****** 2020-10-31T22:35:41.123 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.031) 0:00:55.281 ****** 2020-10-31T22:35:41.132 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-10-31T22:35:41.133 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi152.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Including major version specific variables.] ******************** ok: [smithi060.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2020-10-31T22:35:41.135 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:41.167 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.044) 0:00:55.325 ****** 2020-10-31T22:35:41.200 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.032) 0:00:55.358 ****** 2020-10-31T22:35:41.240 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.040) 0:00:55.398 ****** 2020-10-31T22:35:41.247 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-10-31T22:35:41.249 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-31T22:35:41.284 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.043) 0:00:55.442 ****** 2020-10-31T22:35:41.316 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.032) 0:00:55.474 ****** 2020-10-31T22:35:41.349 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.033) 0:00:55.507 ****** 2020-10-31T22:35:41.358 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:41.394 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.044) 0:00:55.552 ****** 2020-10-31T22:35:41.431 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.036) 0:00:55.588 ****** 2020-10-31T22:35:41.466 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.035) 0:00:55.624 ****** 2020-10-31T22:35:41.475 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-10-31T22:35:41.477 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Register with subscription-manager.] **************************** skipping: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-31T22:35:41.534 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.067) 0:00:55.692 ****** 2020-10-31T22:35:41.573 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.039) 0:00:55.731 ****** 2020-10-31T22:35:41.610 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.036) 0:00:55.768 ****** 2020-10-31T22:35:41.619 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-10-31T22:35:41.621 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:41.657 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.047) 0:00:55.815 ****** 2020-10-31T22:35:41.697 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.039) 0:00:55.854 ****** 2020-10-31T22:35:41.733 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.035) 0:00:55.890 ****** 2020-10-31T22:35:41.741 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-10-31T22:35:41.742 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:41.780 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.047) 0:00:55.938 ****** 2020-10-31T22:35:41.818 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.037) 0:00:55.975 ****** 2020-10-31T22:35:41.861 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.043) 0:00:56.018 ****** 2020-10-31T22:35:41.869 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-10-31T22:35:41.871 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:41.906 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.044) 0:00:56.063 ****** 2020-10-31T22:35:41.938 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.032) 0:00:56.096 ****** 2020-10-31T22:35:41.971 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:41 +0000 (0:00:00.032) 0:00:56.128 ****** 2020-10-31T22:35:41.978 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:41.980 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:42.014 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.043) 0:00:56.172 ****** 2020-10-31T22:35:42.051 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.036) 0:00:56.208 ****** 2020-10-31T22:35:42.087 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.035) 0:00:56.244 ****** 2020-10-31T22:35:42.097 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set entitlements_path] ****************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-31T22:35:42.134 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.047) 0:00:56.291 ****** 2020-10-31T22:35:42.169 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.035) 0:00:56.327 ****** 2020-10-31T22:35:42.206 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.036) 0:00:56.364 ****** 2020-10-31T22:35:42.213 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-10-31T22:35:42.215 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi060.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi060.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Clean yum cache] ************************************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:42.265 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.058) 0:00:56.422 ****** 2020-10-31T22:35:42.298 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.033) 0:00:56.456 ****** 2020-10-31T22:35:42.331 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.032) 0:00:56.489 ****** 2020-10-31T22:35:42.338 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-10-31T22:35:42.340 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set have_entitlements] ****************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:42.374 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.042) 0:00:56.532 ****** 2020-10-31T22:35:42.407 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.033) 0:00:56.565 ****** 2020-10-31T22:35:42.447 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.039) 0:00:56.604 ****** 2020-10-31T22:35:42.454 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-10-31T22:35:42.456 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:42.490 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.043) 0:00:56.648 ****** 2020-10-31T22:35:42.523 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.032) 0:00:56.680 ****** 2020-10-31T22:35:42.555 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.032) 0:00:56.713 ****** 2020-10-31T22:35:42.562 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-10-31T22:35:42.564 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Determine if node is registered with subscription-manager.] ***** skipping: [smithi060.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:42.601 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.045) 0:00:56.758 ****** 2020-10-31T22:35:42.636 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.034) 0:00:56.793 ****** 2020-10-31T22:35:42.670 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.034) 0:00:56.828 ****** 2020-10-31T22:35:42.678 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-10-31T22:35:42.680 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:42.714 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.043) 0:00:56.872 ****** 2020-10-31T22:35:42.746 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.032) 0:00:56.904 ****** 2020-10-31T22:35:42.778 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.031) 0:00:56.936 ****** 2020-10-31T22:35:42.786 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-10-31T22:35:42.787 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Register with subscription-manager.] **************************** skipping: [smithi060.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:42.822 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.043) 0:00:56.980 ****** 2020-10-31T22:35:42.856 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.033) 0:00:57.013 ****** 2020-10-31T22:35:42.894 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.038) 0:00:57.052 ****** 2020-10-31T22:35:42.904 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:42.906 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-31T22:35:42.945 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.050) 0:00:57.102 ****** 2020-10-31T22:35:42.978 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:42 +0000 (0:00:00.033) 0:00:57.136 ****** 2020-10-31T22:35:43.020 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.042) 0:00:57.178 ****** 2020-10-31T22:35:43.028 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-10-31T22:35:43.030 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : List CDN releases available to system] ************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:43.074 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.054) 0:00:57.232 ****** 2020-10-31T22:35:43.107 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.032) 0:00:57.265 ****** 2020-10-31T22:35:43.140 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.032) 0:00:57.298 ****** 2020-10-31T22:35:43.146 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-10-31T22:35:43.148 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:43.184 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.044) 0:00:57.342 ****** 2020-10-31T22:35:43.222 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.037) 0:00:57.379 ****** 2020-10-31T22:35:43.258 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.036) 0:00:57.416 ****** 2020-10-31T22:35:43.267 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-10-31T22:35:43.269 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:43.303 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.044) 0:00:57.461 ****** 2020-10-31T22:35:43.338 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.035) 0:00:57.496 ****** 2020-10-31T22:35:43.371 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.032) 0:00:57.529 ****** 2020-10-31T22:35:43.381 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-10-31T22:35:43.383 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi060.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:43.421 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.048) 0:00:57.577 ****** 2020-10-31T22:35:43.452 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.032) 0:00:57.609 ****** 2020-10-31T22:35:43.459 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:43.461 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi152.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-31T22:35:43.461 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:43.497 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.044) 0:00:57.654 ****** 2020-10-31T22:35:43.531 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.034) 0:00:57.689 ****** 2020-10-31T22:35:43.563 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.031) 0:00:57.721 ****** 2020-10-31T22:35:43.581 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-10-31T22:35:43.583 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi066.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-10-31T22:35:43.616 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.053) 0:00:57.774 ****** 2020-10-31T22:35:43.649 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.032) 0:00:57.807 ****** 2020-10-31T22:35:43.657 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-10-31T22:35:43.659 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Store list of enabled repos] ************************************ skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:43.692 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.042) 0:00:57.850 ****** 2020-10-31T22:35:43.725 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.033) 0:00:57.883 ****** 2020-10-31T22:35:43.757 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.032) 0:00:57.915 ****** 2020-10-31T22:35:43.764 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-10-31T22:35:43.766 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:43.800 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.042) 0:00:57.957 ****** 2020-10-31T22:35:43.832 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.032) 0:00:57.990 ****** 2020-10-31T22:35:43.864 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.031) 0:00:58.022 ****** 2020-10-31T22:35:43.872 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-10-31T22:35:43.874 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:43.910 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.046) 0:00:58.068 ****** 2020-10-31T22:35:43.950 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.039) 0:00:58.108 ****** 2020-10-31T22:35:43.957 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-10-31T22:35:43.959 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:43.995 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:43 +0000 (0:00:00.045) 0:00:58.153 ****** 2020-10-31T22:35:44.030 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.034) 0:00:58.188 ****** 2020-10-31T22:35:44.038 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-10-31T22:35:44.040 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013294", "end": "2020-10-31 22:35:43.494488", "rc": 0, "start": "2020-10-31 22:35:43.481194", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi060.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-31T22:35:44.083 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.053) 0:00:58.241 ****** 2020-10-31T22:35:44.116 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.032) 0:00:58.274 ****** 2020-10-31T22:35:44.156 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.039) 0:00:58.313 ****** 2020-10-31T22:35:44.163 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:44.165 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:44.203 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.047) 0:00:58.360 ****** 2020-10-31T22:35:44.247 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.044) 0:00:58.405 ****** 2020-10-31T22:35:44.287 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.040) 0:00:58.445 ****** 2020-10-31T22:35:44.296 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-10-31T22:35:44.297 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:44.342 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.054) 0:00:58.500 ****** 2020-10-31T22:35:44.381 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.038) 0:00:58.538 ****** 2020-10-31T22:35:44.418 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.037) 0:00:58.576 ****** 2020-10-31T22:35:44.426 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:44.428 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:44.463 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.044) 0:00:58.620 ****** 2020-10-31T22:35:44.498 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.034) 0:00:58.655 ****** 2020-10-31T22:35:44.533 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.035) 0:00:58.690 ****** 2020-10-31T22:35:44.540 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-10-31T22:35:44.542 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:44.544 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:44.578 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.045) 0:00:58.736 ****** 2020-10-31T22:35:44.616 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.037) 0:00:58.773 ****** 2020-10-31T22:35:44.650 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.033) 0:00:58.807 ****** 2020-10-31T22:35:44.656 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-10-31T22:35:44.658 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi060.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-10-31T22:35:44.658 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-10-31T22:35:44.659 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:44.693 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.043) 0:00:58.851 ****** 2020-10-31T22:35:44.741 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.047) 0:00:58.899 ****** 2020-10-31T22:35:44.775 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.034) 0:00:58.933 ****** 2020-10-31T22:35:44.782 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-10-31T22:35:44.784 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Clean yum cache] ************************************************ skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:44.825 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.049) 0:00:58.982 ****** 2020-10-31T22:35:44.858 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.033) 0:00:59.016 ****** 2020-10-31T22:35:44.900 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.041) 0:00:59.057 ****** 2020-10-31T22:35:44.907 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-10-31T22:35:44.909 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:44.910 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:44.946 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.046) 0:00:59.104 ****** 2020-10-31T22:35:44.979 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:44 +0000 (0:00:00.033) 0:00:59.137 ****** 2020-10-31T22:35:44.986 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-10-31T22:35:44.988 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Get the current timezone] *************************************** ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.014800", "end": "2020-10-31 22:35:45.072989", "rc": 0, "start": "2020-10-31 22:35:45.058189", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-10-31T22:35:45.024 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.044) 0:00:59.182 ****** 2020-10-31T22:35:45.058 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.034) 0:00:59.216 ****** 2020-10-31T22:35:45.064 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-10-31T22:35:45.066 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.067 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.101 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.042) 0:00:59.259 ****** 2020-10-31T22:35:45.135 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.034) 0:00:59.293 ****** 2020-10-31T22:35:45.143 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-10-31T22:35:45.145 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.181 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.045) 0:00:59.339 ****** 2020-10-31T22:35:45.221 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.039) 0:00:59.378 ****** 2020-10-31T22:35:45.230 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-10-31T22:35:45.232 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.275 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.054) 0:00:59.433 ****** 2020-10-31T22:35:45.308 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.033) 0:00:59.466 ****** 2020-10-31T22:35:45.317 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-10-31T22:35:45.318 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the timezone] *********************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.353 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.044) 0:00:59.510 ****** 2020-10-31T22:35:45.388 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.035) 0:00:59.546 ****** 2020-10-31T22:35:45.395 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-10-31T22:35:45.397 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.438 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.049) 0:00:59.595 ****** 2020-10-31T22:35:45.445 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-10-31T22:35:45.447 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.480 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.042) 0:00:59.638 ****** 2020-10-31T22:35:45.487 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-10-31T22:35:45.489 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.013989", "end": "2020-10-31 22:35:45.153908", "rc": 0, "start": "2020-10-31 22:35:45.139919", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.523 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.043) 0:00:59.681 ****** 2020-10-31T22:35:45.558 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.034) 0:00:59.715 ****** 2020-10-31T22:35:45.565 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-10-31T22:35:45.567 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.568 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.604 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.046) 0:00:59.762 ****** 2020-10-31T22:35:45.637 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.033) 0:00:59.795 ****** 2020-10-31T22:35:45.645 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-10-31T22:35:45.647 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.685 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.047) 0:00:59.843 ****** 2020-10-31T22:35:45.695 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-10-31T22:35:45.696 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.734 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.048) 0:00:59.892 ****** 2020-10-31T22:35:45.742 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-10-31T22:35:45.744 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.779 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.044) 0:00:59.937 ****** 2020-10-31T22:35:45.787 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-10-31T22:35:45.788 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.824 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.044) 0:00:59.981 ****** 2020-10-31T22:35:45.831 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-10-31T22:35:45.833 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.867 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.043) 0:01:00.025 ****** 2020-10-31T22:35:45.897 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-10-31T22:35:45.898 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.938 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:45 +0000 (0:00:00.070) 0:01:00.095 ****** 2020-10-31T22:35:45.967 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:45.968 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.010881", "end": "2020-10-31 22:35:45.836171", "rc": 0, "start": "2020-10-31 22:35:45.825290", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-10-31T22:35:46.016 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.077) 0:01:00.173 ****** 2020-10-31T22:35:46.061 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.045) 0:01:00.218 ****** 2020-10-31T22:35:46.069 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-10-31T22:35:46.071 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.911183", "end": "2020-10-31 22:35:45.500435", "rc": 0, "start": "2020-10-31 22:35:44.589252", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:46.111 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.050) 0:01:00.269 ****** 2020-10-31T22:35:46.154 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.042) 0:01:00.311 ****** 2020-10-31T22:35:46.164 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-10-31T22:35:46.165 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:46.166 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:46.200 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.046) 0:01:00.358 ****** 2020-10-31T22:35:46.236 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.035) 0:01:00.393 ****** 2020-10-31T22:35:46.245 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-10-31T22:35:46.247 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:46.285 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.049) 0:01:00.443 ****** 2020-10-31T22:35:46.294 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-10-31T22:35:46.296 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:46.335 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.050) 0:01:00.493 ****** 2020-10-31T22:35:46.356 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-10-31T22:35:46.358 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.024864", "end": "2020-10-31 22:35:45.869392", "rc": 0, "start": "2020-10-31 22:35:45.844528", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:35:46.402 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.065) 0:01:00.559 ****** 2020-10-31T22:35:46.409 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-10-31T22:35:46.410 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set the hardware clock] ***************************************** changed: [smithi060.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.659928", "end": "2020-10-31 22:35:46.500381", "rc": 0, "start": "2020-10-31 22:35:45.840453", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:35:46.447 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.046) 0:01:00.605 ****** 2020-10-31T22:35:46.482 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.034) 0:01:00.639 ****** 2020-10-31T22:35:46.488 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-10-31T22:35:46.490 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:46.528 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.046) 0:01:00.686 ****** 2020-10-31T22:35:46.537 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-10-31T22:35:46.538 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:46.576 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.047) 0:01:00.734 ****** 2020-10-31T22:35:46.605 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-10-31T22:35:46.607 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:46.640 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.063) 0:01:00.797 ****** 2020-10-31T22:35:46.667 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-10-31T22:35:46.669 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:46.701 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.061) 0:01:00.859 ****** 2020-10-31T22:35:46.708 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-10-31T22:35:46.710 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.024591", "end": "2020-10-31 22:35:46.783456", "rc": 0, "start": "2020-10-31 22:35:46.758865", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:35:46.751 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.049) 0:01:00.908 ****** 2020-10-31T22:35:46.758 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-10-31T22:35:46.760 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:46.795 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.044) 0:01:00.953 ****** 2020-10-31T22:35:46.814 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-10-31T22:35:46.816 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.384802", "end": "2020-10-31 22:35:46.500427", "rc": 0, "start": "2020-10-31 22:35:46.115625", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:35:46.851 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.055) 0:01:01.008 ****** 2020-10-31T22:35:46.880 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:46.915 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:46 +0000 (0:00:00.063) 0:01:01.072 ****** 2020-10-31T22:35:47.070 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-10-31T22:35:47.072 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.024409", "end": "2020-10-31 22:35:46.767712", "rc": 0, "start": "2020-10-31 22:35:46.743303", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:35:47.105 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:47 +0000 (0:00:00.189) 0:01:01.262 ****** 2020-10-31T22:35:47.636 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-10-31T22:35:47.638 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.707442", "end": "2020-10-31 22:35:47.500388", "rc": 0, "start": "2020-10-31 22:35:46.792946", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:35:47.672 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:47 +0000 (0:00:00.567) 0:01:01.830 ****** 2020-10-31T22:35:47.704 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-10-31T22:35:47.705 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:47.757 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:47 +0000 (0:00:00.084) 0:01:01.915 ****** 2020-10-31T22:35:47.912 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-10-31T22:35:47.914 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.023582", "end": "2020-10-31 22:35:47.780784", "rc": 0, "start": "2020-10-31 22:35:47.757202", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:35:47.952 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:47 +0000 (0:00:00.194) 0:01:02.110 ****** 2020-10-31T22:35:49.656 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-10-31T22:35:49.658 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1604183664, "cache_updated": false, "changed": false} 2020-10-31T22:35:49.692 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:49 +0000 (0:00:01.740) 0:01:03.850 ****** 2020-10-31T22:35:49.701 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1604183668, "cache_updated": false, "changed": false} 2020-10-31T22:35:49.740 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:49 +0000 (0:00:00.047) 0:01:03.898 ****** 2020-10-31T22:35:49.986 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1604183678, "cache_updated": false, "changed": false} 2020-10-31T22:35:50.033 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:50 +0000 (0:00:00.293) 0:01:04.191 ****** 2020-10-31T22:35:50.605 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-10-31T22:35:50.607 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"cache_update_time": 1604183664, "cache_updated": false, "changed": false} 2020-10-31T22:35:50.640 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:50 +0000 (0:00:00.607) 0:01:04.798 ****** 2020-10-31T22:35:50.659 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"cache_update_time": 1604183668, "cache_updated": false, "changed": false} 2020-10-31T22:35:50.694 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:50 +0000 (0:00:00.053) 0:01:04.852 ****** 2020-10-31T22:35:50.702 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-10-31T22:35:50.703 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:50.738 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:50 +0000 (0:00:00.043) 0:01:04.896 ****** 2020-10-31T22:35:50.746 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:50.783 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:50 +0000 (0:00:00.045) 0:01:04.941 ****** 2020-10-31T22:35:50.801 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-10-31T22:35:50.803 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1604183673, "cache_updated": false, "changed": false} 2020-10-31T22:35:50.842 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:50 +0000 (0:00:00.058) 0:01:04.999 ****** 2020-10-31T22:35:50.884 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi085.front.sepia.ceph.com] => {"cache_update_time": 1604183678, "cache_updated": false, "changed": false} 2020-10-31T22:35:50.923 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:50 +0000 (0:00:00.081) 0:01:05.081 ****** 2020-10-31T22:35:50.963 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-10-31T22:35:50.965 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:51.005 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:51 +0000 (0:00:00.081) 0:01:05.163 ****** 2020-10-31T22:35:51.363 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-10-31T22:35:51.364 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-10-31T22:35:51.366 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-10-31T22:35:51.368 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-10-31T22:35:51.411 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:51 +0000 (0:00:00.405) 0:01:05.568 ****** 2020-10-31T22:35:51.444 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:51 +0000 (0:00:00.033) 0:01:05.602 ****** 2020-10-31T22:35:51.477 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:51 +0000 (0:00:00.032) 0:01:05.634 ****** 2020-10-31T22:35:51.685 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-10-31T22:35:51.687 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"cache_update_time": 1604183673, "cache_updated": false, "changed": false} 2020-10-31T22:35:51.725 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:51 +0000 (0:00:00.248) 0:01:05.883 ****** 2020-10-31T22:35:51.755 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:51.791 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:51 +0000 (0:00:00.065) 0:01:05.949 ****** 2020-10-31T22:35:52.126 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-10-31T22:35:52.128 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2020-10-31T22:35:52.174 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:52 +0000 (0:00:00.383) 0:01:06.332 ****** 2020-10-31T22:35:52.313 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-10-31T22:35:52.315 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"cache_update_time": 1604183664, "cache_updated": false, "changed": false} 2020-10-31T22:35:52.364 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:52 +0000 (0:00:00.189) 0:01:06.522 ****** 2020-10-31T22:35:52.372 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"cache_update_time": 1604183668, "cache_updated": false, "changed": false} 2020-10-31T22:35:52.373 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"cache_update_time": 1604183678, "cache_updated": false, "changed": false} 2020-10-31T22:35:52.411 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:52 +0000 (0:00:00.046) 0:01:06.569 ****** 2020-10-31T22:35:52.451 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:52 +0000 (0:00:00.039) 0:01:06.608 ****** 2020-10-31T22:35:52.703 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-10-31T22:35:52.706 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-10-31T22:35:52.768 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-10-31T22:35:52.791 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-10-31T22:35:53.023 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-10-31T22:35:53.056 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-10-31T22:35:53.058 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"cache_update_time": 1604183673, "cache_updated": false, "changed": false} 2020-10-31T22:35:53.098 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:53 +0000 (0:00:00.647) 0:01:07.256 ****** 2020-10-31T22:35:53.107 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-10-31T22:35:53.109 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} ok: [smithi085.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-10-31T22:35:53.311 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-10-31T22:35:53.351 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:53 +0000 (0:00:00.253) 0:01:07.509 ****** 2020-10-31T22:35:53.361 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-10-31T22:35:53.375 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-10-31T22:35:53.421 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:53 +0000 (0:00:00.069) 0:01:07.579 ****** 2020-10-31T22:35:53.471 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:53 +0000 (0:00:00.050) 0:01:07.629 ****** 2020-10-31T22:35:53.482 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2020-10-31T22:35:53.484 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-10-31T22:35:53.484 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-10-31T22:35:53.527 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:53 +0000 (0:00:00.055) 0:01:07.685 ****** 2020-10-31T22:35:53.557 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-10-31T22:35:53.596 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:53 +0000 (0:00:00.068) 0:01:07.753 ****** 2020-10-31T22:35:53.603 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-10-31T22:35:53.639 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:53 +0000 (0:00:00.043) 0:01:07.797 ****** 2020-10-31T22:35:53.742 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-10-31T22:35:53.744 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2020-10-31T22:35:53.851 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-10-31T22:35:53.852 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-10-31T22:35:53.916 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-10-31T22:35:53.950 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-10-31T22:35:54.026 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-10-31T22:35:54.028 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2020-10-31T22:35:54.069 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:54 +0000 (0:00:00.430) 0:01:08.227 ****** 2020-10-31T22:35:54.141 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-10-31T22:35:54.143 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-10-31T22:35:54.196 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-10-31T22:35:54.198 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2020-10-31T22:35:54.236 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:54 +0000 (0:00:00.166) 0:01:08.393 ****** 2020-10-31T22:35:54.242 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-10-31T22:35:54.243 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-10-31T22:35:54.437 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-10-31T22:35:54.476 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:54 +0000 (0:00:00.240) 0:01:08.634 ****** 2020-10-31T22:35:54.484 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-10-31T22:35:54.531 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:54 +0000 (0:00:00.054) 0:01:08.688 ****** 2020-10-31T22:35:54.539 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-10-31T22:35:54.543 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi060.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-10-31T22:35:54.545 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi152.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2020-10-31T22:35:54.579 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:54 +0000 (0:00:00.048) 0:01:08.736 ****** 2020-10-31T22:35:54.613 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:54 +0000 (0:00:00.034) 0:01:08.771 ****** 2020-10-31T22:35:54.620 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-10-31T22:35:54.623 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} TASK [common : Include yum_systems vars] *************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:54.657 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:54 +0000 (0:00:00.043) 0:01:08.815 ****** 2020-10-31T22:35:54.692 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:54 +0000 (0:00:00.034) 0:01:08.850 ****** 2020-10-31T22:35:54.701 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi085.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-10-31T22:35:54.703 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi060.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-31T22:35:54.741 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:54 +0000 (0:00:00.048) 0:01:08.898 ****** 2020-10-31T22:35:54.776 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:54 +0000 (0:00:00.035) 0:01:08.933 ****** 2020-10-31T22:35:54.786 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:54.788 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi060.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-31T22:35:54.826 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:54 +0000 (0:00:00.049) 0:01:08.983 ****** 2020-10-31T22:35:54.834 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-31T22:35:54.835 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-10-31T22:35:54.835 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:54.836 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-10-31T22:35:54.837 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2020-10-31T22:35:54.874 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:54 +0000 (0:00:00.048) 0:01:09.032 ****** 2020-10-31T22:35:54.910 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:54 +0000 (0:00:00.036) 0:01:09.068 ****** 2020-10-31T22:35:54.918 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-10-31T22:35:54.920 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:54.960 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:54 +0000 (0:00:00.050) 0:01:09.118 ****** 2020-10-31T22:35:55.002 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:55 +0000 (0:00:00.041) 0:01:09.160 ****** 2020-10-31T22:35:55.011 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-10-31T22:35:55.012 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-31T22:35:55.051 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:55 +0000 (0:00:00.048) 0:01:09.208 ****** 2020-10-31T22:35:55.061 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-10-31T22:35:55.062 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-31T22:35:55.074 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-31T22:35:55.123 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:55 +0000 (0:00:00.072) 0:01:09.281 ****** 2020-10-31T22:35:55.132 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-31T22:35:55.134 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-10-31T22:35:55.134 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2020-10-31T22:35:55.138 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-10-31T22:35:55.140 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-31T22:35:55.187 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:55 +0000 (0:00:00.064) 0:01:09.345 ****** 2020-10-31T22:35:55.220 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:55 +0000 (0:00:00.032) 0:01:09.377 ****** 2020-10-31T22:35:55.226 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-10-31T22:35:55.228 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:55.269 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:55 +0000 (0:00:00.049) 0:01:09.427 ****** 2020-10-31T22:35:55.302 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:55 +0000 (0:00:00.033) 0:01:09.460 ****** 2020-10-31T22:35:55.310 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-10-31T22:35:55.312 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2020-10-31T22:35:55.346 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:55 +0000 (0:00:00.044) 0:01:09.504 ****** 2020-10-31T22:35:55.375 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:55.410 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:55 +0000 (0:00:00.063) 0:01:09.568 ****** 2020-10-31T22:35:55.440 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-10-31T22:35:55.442 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-31T22:35:55.483 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:55 +0000 (0:00:00.073) 0:01:09.641 ****** 2020-10-31T22:35:55.524 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-10-31T22:35:55.526 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-31T22:35:55.537 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-31T22:35:55.539 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-31T22:35:55.548 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-10-31T22:35:55.584 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:55 +0000 (0:00:00.100) 0:01:09.741 ****** 2020-10-31T22:35:55.612 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-10-31T22:35:55.614 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:55.665 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:55 +0000 (0:00:00.081) 0:01:09.823 ****** 2020-10-31T22:35:55.867 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-10-31T22:35:55.869 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"cache_update_time": 1604183664, "cache_updated": false, "changed": false} 2020-10-31T22:35:55.905 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:55 +0000 (0:00:00.239) 0:01:10.062 ****** 2020-10-31T22:35:56.177 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"cache_update_time": 1604183678, "cache_updated": false, "changed": false} 2020-10-31T22:35:56.216 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:56 +0000 (0:00:00.311) 0:01:10.374 ****** 2020-10-31T22:35:56.218 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:56.224 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"cache_update_time": 1604183668, "cache_updated": false, "changed": false} 2020-10-31T22:35:56.261 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:56 +0000 (0:00:00.044) 0:01:10.419 ****** 2020-10-31T22:35:56.270 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-10-31T22:35:56.272 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-10-31T22:35:56.312 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:56 +0000 (0:00:00.050) 0:01:10.470 ****** 2020-10-31T22:35:56.531 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-10-31T22:35:56.566 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:56 +0000 (0:00:00.254) 0:01:10.724 ****** 2020-10-31T22:35:56.574 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-10-31T22:35:56.576 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"cache_update_time": 1604183673, "cache_updated": false, "changed": false} 2020-10-31T22:35:56.620 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:56 +0000 (0:00:00.053) 0:01:10.778 ****** 2020-10-31T22:35:56.628 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-10-31T22:35:56.629 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-10-31T22:35:56.799 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:56 +0000 (0:00:00.178) 0:01:10.956 ****** 2020-10-31T22:35:56.807 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-10-31T22:35:56.809 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-10-31T22:35:56.844 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:56 +0000 (0:00:00.045) 0:01:11.002 ****** 2020-10-31T22:35:56.885 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-10-31T22:35:56.920 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:56 +0000 (0:00:00.075) 0:01:11.077 ****** 2020-10-31T22:35:57.001 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-10-31T22:35:57.003 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-10-31T22:35:57.066 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-10-31T22:35:57.067 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-10-31T22:35:57.067 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2020-10-31T22:35:57.103 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.183) 0:01:11.261 ****** 2020-10-31T22:35:57.122 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-10-31T22:35:57.125 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} TASK [common : Upload nagios check_mem script] ********************************* 2020-10-31T22:35:57.125 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2020-10-31T22:35:57.160 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.056) 0:01:11.318 ****** 2020-10-31T22:35:57.193 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.033) 0:01:11.351 ****** 2020-10-31T22:35:57.200 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-10-31T22:35:57.202 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-10-31T22:35:57.203 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-10-31T22:35:57.203 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:57.249 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.056) 0:01:11.407 ****** 2020-10-31T22:35:57.287 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.037) 0:01:11.444 ****** 2020-10-31T22:35:57.294 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-10-31T22:35:57.297 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-31T22:35:57.331 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.044) 0:01:11.488 ****** 2020-10-31T22:35:57.338 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-10-31T22:35:57.340 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi066.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-10-31T22:35:57.377 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.046) 0:01:11.535 ****** 2020-10-31T22:35:57.384 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-10-31T22:35:57.386 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:57.420 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.042) 0:01:11.578 ****** 2020-10-31T22:35:57.428 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-10-31T22:35:57.430 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-31T22:35:57.464 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.043) 0:01:11.622 ****** 2020-10-31T22:35:57.471 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-10-31T22:35:57.473 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi066.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-10-31T22:35:57.533 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.069) 0:01:11.691 ****** 2020-10-31T22:35:57.591 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.057) 0:01:11.749 ****** 2020-10-31T22:35:57.600 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-10-31T22:35:57.602 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:57.647 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.055) 0:01:11.804 ****** 2020-10-31T22:35:57.680 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.033) 0:01:11.837 ****** 2020-10-31T22:35:57.689 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-10-31T22:35:57.691 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-31T22:35:57.729 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.049) 0:01:11.887 ****** 2020-10-31T22:35:57.731 INFO:teuthology.task.ansible.out: 2020-10-31T22:35:57.756 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi152.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2020-10-31T22:35:57.769 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:57.771 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2020-10-31T22:35:57.814 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.084) 0:01:11.972 ****** 2020-10-31T22:35:57.852 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.038) 0:01:12.010 ****** 2020-10-31T22:35:57.871 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi152.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2020-10-31T22:35:57.914 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.061) 0:01:12.072 ****** 2020-10-31T22:35:57.945 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-10-31T22:35:57.947 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:57.981 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:57 +0000 (0:00:00.067) 0:01:12.139 ****** 2020-10-31T22:35:58.024 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-10-31T22:35:58.026 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-10-31T22:35:58.074 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.092) 0:01:12.232 ****** 2020-10-31T22:35:58.083 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-10-31T22:35:58.085 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2020-10-31T22:35:58.120 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.045) 0:01:12.278 ****** 2020-10-31T22:35:58.129 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-10-31T22:35:58.131 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:58.167 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.047) 0:01:12.325 ****** 2020-10-31T22:35:58.199 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-10-31T22:35:58.201 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2020-10-31T22:35:58.243 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.075) 0:01:12.400 ****** 2020-10-31T22:35:58.470 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-10-31T22:35:58.478 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-10-31 22:32:53 UTC", "ActiveEnterTimestampMonotonic": "17801903", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target sysinit.target var-run.mount time-sync.target systemd-tmpfiles-setup.service systemd-journald.socket system.slice network.target nss-lookup.target -.mount local-fs.target basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-10-31 22:32:53 UTC", "AssertTimestampMonotonic": "17801118", "Before": "xdm.service plymouth-quit.service getty@tty1.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-10-31 22:32:53 UTC", "ConditionTimestampMonotonic": "17801118", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-10-31T22:35:58.480 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1236", "ExecMainStartTimestamp": "Sat 2020-10-31 22:32:53 UTC", "ExecMainStartTimestampMonotonic": "17801863", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-10-31 22:32:53 UTC", "InactiveExitTimestampMonotonic": "17801903", "InvocationID": "58af814b424d4ee999d5b17996fecc50", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "i 2020-10-31T22:35:58.482 INFO:teuthology.task.ansible.out:nfinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128055", "LimitNPROCSoft": "128055", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128055", "LimitSIGPENDINGSoft": "128055", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1236", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no" 2020-10-31T22:35:58.483 INFO:teuthology.task.ansible.out:, "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-10-31 22:32:53 UTC", "StateChangeTimestampMonotonic": "17801903", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-10-31 22:32:53 UTC", "WatchdogTimestampMonotonic": "17801902", "WatchdogUSec": "0"}} ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-10-31 22:33:32 UTC", "ActiveEnterTimestampMonotonic": "17619695", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount local-fs.target sysinit.target network.target -.mount system.slice remote-fs.target nss-lookup.target systemd-tmpfiles-setup.service time-sync.target system 2020-10-31T22:35:58.485 INFO:teuthology.task.ansible.out:d-journald.socket basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-10-31 22:33:32 UTC", "AssertTimestampMonotonic": "17618649", "Before": "xdm.service shutdown.target multi-user.target plymouth-quit.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-10-31 22:33:32 UTC", "ConditionTimestampMonotonic": "17618649", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1099", "ExecMainStartTimestamp": "Sat 2020-10-31 22:33:32 UTC", "ExecMainStartTimestampMonotonic": 2020-10-31T22:35:58.487 INFO:teuthology.task.ansible.out:"17619659", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-10-31 22:33:32 UTC", "InactiveExitTimestampMonotonic": "17619695", "InvocationID": "0b63818d5e34460f9bf9d9e596e3ff97", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "102 2020-10-31T22:35:58.489 INFO:teuthology.task.ansible.out:4", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1099", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "Star 2020-10-31T22:35:58.491 INFO:teuthology.task.ansible.out:tLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-10-31 22:33:32 UTC", "StateChangeTimestampMonotonic": "17619695", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-10-31 22:33:32 UTC", "WatchdogTimestampMonotonic": "17619694", "WatchdogUSec": "0"}} 2020-10-31T22:35:58.518 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.275) 0:01:12.676 ****** 2020-10-31T22:35:58.561 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.042) 0:01:12.719 ****** 2020-10-31T22:35:58.571 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-10-31T22:35:58.573 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2020-10-31T22:35:58.573 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-10-31T22:35:58.575 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-10-31 22:33:24 UTC", "ActiveEnterTimestampMonotonic": "18011111", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket systemd-tmpfiles-setup.service -.mount network.target time-sync.target local-fs.target nss-lookup.target var-run.mount sysinit.target remote-fs.target system.slice basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-10-31 22:33:24 UTC", "AssertTimestampMonotonic": "18010422", "Before": "plymouth-quit.service xdm.service shutdown.target multi-user.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-10-31 22:33:24 UTC", "ConditionTimestampMonotonic": "18010422", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-10-31T22:35:58.577 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1098", "ExecMainStartTimestamp": "Sat 2020-10-31 22:33:24 UTC", "ExecMainStartTimestampMonotonic": "18011084", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-10-31 22:33:24 UTC", "InactiveExitTimestampMonotonic": "18011111", "InvocationID": "bf4e82919f1242778ea18c775e523b70", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "i 2020-10-31T22:35:58.579 INFO:teuthology.task.ansible.out:nfinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128030", "LimitNPROCSoft": "128030", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128030", "LimitSIGPENDINGSoft": "128030", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1098", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no" 2020-10-31T22:35:58.581 INFO:teuthology.task.ansible.out:, "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-10-31 22:33:24 UTC", "StateChangeTimestampMonotonic": "18011111", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-10-31 22:33:24 UTC", "WatchdogTimestampMonotonic": "18011111", "WatchdogUSec": "0"}} TASK [common : Get SELinux status] ********************************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:58.614 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.052) 0:01:12.772 ****** 2020-10-31T22:35:58.648 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.033) 0:01:12.805 ****** 2020-10-31T22:35:58.680 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.032) 0:01:12.838 ****** 2020-10-31T22:35:58.688 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:58.689 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get SELinux status] ********************************************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:58.724 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.043) 0:01:12.882 ****** 2020-10-31T22:35:58.759 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.034) 0:01:12.917 ****** 2020-10-31T22:35:58.791 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.032) 0:01:12.949 ****** 2020-10-31T22:35:58.798 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-10-31T22:35:58.800 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:58.834 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.043) 0:01:12.992 ****** 2020-10-31T22:35:58.867 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.032) 0:01:13.025 ****** 2020-10-31T22:35:58.874 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:58.876 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:58.913 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.046) 0:01:13.071 ****** 2020-10-31T22:35:58.945 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.032) 0:01:13.103 ****** 2020-10-31T22:35:58.953 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-10-31T22:35:58.954 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-10-31 22:33:45 UTC", "ActiveEnterTimestampMonotonic": "18268978", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target systemd-journald.socket nss-lookup.target local-fs.target -.mount time-sync.target basic.target remote-fs.target system.slice network.target var-run.mount systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-10-31 22:33:45 UTC", "AssertTimestampMonotonic": "18268227", "Before": "xdm.service shutdown.target multi-user.target plymouth-quit.service getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-10-31 22:33:45 UTC", "ConditionTimestampMonotonic": "18268226", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nagios-nrpe-ser 2020-10-31T22:35:58.956 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1101", "ExecMainStartTimestamp": "Sat 2020-10-31 22:33:45 UTC", "ExecMainStartTimestampMonotonic": "18268952", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-10-31 22:33:45 UTC", "InactiveExitTimestampMonotonic": "18268978", "InvocationID": "40e6ff5a3a6043f7bf2bcab53c5fe2da", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "i 2020-10-31T22:35:58.958 INFO:teuthology.task.ansible.out:nfinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1101", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no" 2020-10-31T22:35:58.959 INFO:teuthology.task.ansible.out:, "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-10-31 22:33:45 UTC", "StateChangeTimestampMonotonic": "18268978", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-10-31 22:33:45 UTC", "WatchdogTimestampMonotonic": "18268976", "WatchdogUSec": "0"}} TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:58.991 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:58 +0000 (0:00:00.045) 0:01:13.148 ****** 2020-10-31T22:35:59.023 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.032) 0:01:13.181 ****** 2020-10-31T22:35:59.062 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.038) 0:01:13.219 ****** 2020-10-31T22:35:59.069 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-10-31T22:35:59.071 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:59.104 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.042) 0:01:13.262 ****** 2020-10-31T22:35:59.138 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.033) 0:01:13.295 ****** 2020-10-31T22:35:59.170 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.032) 0:01:13.328 ****** 2020-10-31T22:35:59.179 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-10-31T22:35:59.180 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:59.215 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.044) 0:01:13.373 ****** 2020-10-31T22:35:59.248 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.033) 0:01:13.406 ****** 2020-10-31T22:35:59.285 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.036) 0:01:13.443 ****** 2020-10-31T22:35:59.293 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:59.295 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Copy SELinux type enforcement file] ********************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:59.335 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.049) 0:01:13.492 ****** 2020-10-31T22:35:59.368 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.033) 0:01:13.526 ****** 2020-10-31T22:35:59.400 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.031) 0:01:13.558 ****** 2020-10-31T22:35:59.408 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-10-31T22:35:59.410 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:59.450 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.049) 0:01:13.608 ****** 2020-10-31T22:35:59.487 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.036) 0:01:13.644 ****** 2020-10-31T22:35:59.524 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.037) 0:01:13.682 ****** 2020-10-31T22:35:59.531 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-10-31T22:35:59.533 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:59.578 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.054) 0:01:13.736 ****** 2020-10-31T22:35:59.625 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.046) 0:01:13.783 ****** 2020-10-31T22:35:59.673 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.048) 0:01:13.831 ****** 2020-10-31T22:35:59.683 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-10-31T22:35:59.685 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include package type specific vars.] ************************** 2020-10-31T22:35:59.685 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-10-31T22:35:59.686 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:59.722 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.049) 0:01:13.880 ****** 2020-10-31T22:35:59.764 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.041) 0:01:13.921 ****** 2020-10-31T22:35:59.800 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.034) 0:01:13.956 ****** 2020-10-31T22:35:59.805 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-10-31T22:35:59.807 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including distro specific variables.] ************************* ok: [smithi060.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-10-31T22:35:59.808 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:35:59.842 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.043) 0:01:14.000 ****** 2020-10-31T22:35:59.875 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.032) 0:01:14.033 ****** 2020-10-31T22:35:59.910 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.034) 0:01:14.067 ****** 2020-10-31T22:35:59.917 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-10-31T22:35:59.919 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including major version specific variables.] ****************** ok: [smithi060.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-10-31T22:35:59.921 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-10-31T22:35:59.956 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.046) 0:01:14.114 ****** 2020-10-31T22:35:59.991 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:35:59 +0000 (0:00:00.034) 0:01:14.149 ****** 2020-10-31T22:36:00.030 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.038) 0:01:14.187 ****** 2020-10-31T22:36:00.044 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-10-31T22:36:00.046 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including version specific variables.] ************************ ok: [smithi060.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-10-31T22:36:00.046 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-10-31T22:36:00.051 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.co 2020-10-31T22:36:00.053 INFO:teuthology.task.ansible.out:m_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-10-31T22:36:00.083 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.053) 0:01:14.241 ****** 2020-10-31T22:36:00.118 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.034) 0:01:14.275 ****** 2020-10-31T22:36:00.155 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.037) 0:01:14.312 ****** 2020-10-31T22:36:00.162 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-10-31T22:36:00.164 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Including major version specific variables.] ****************** ok: [smithi066.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-10-31T22:36:00.199 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.044) 0:01:14.357 ****** 2020-10-31T22:36:00.231 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.031) 0:01:14.389 ****** 2020-10-31T22:36:00.237 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-10-31T22:36:00.239 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} TASK [testnode : Including version specific variables.] ************************ ok: [smithi066.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-10-31T22:36:00.275 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.044) 0:01:14.433 ****** 2020-10-31T22:36:00.314 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.038) 0:01:14.472 ****** 2020-10-31T22:36:00.347 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.032) 0:01:14.505 ****** 2020-10-31T22:36:00.357 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-10-31T22:36:00.359 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:00.395 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.047) 0:01:14.553 ****** 2020-10-31T22:36:00.401 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-10-31T22:36:00.403 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:00.440 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.045) 0:01:14.598 ****** 2020-10-31T22:36:00.448 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-10-31T22:36:00.449 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "gid": 1231, "name": "ubuntu", "state": "present", "system": false} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-10-31T22:36:00.486 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.045) 0:01:14.643 ****** 2020-10-31T22:36:00.520 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.034) 0:01:14.677 ****** 2020-10-31T22:36:00.556 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.036) 0:01:14.714 ****** 2020-10-31T22:36:00.563 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-10-31T22:36:00.566 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:00.609 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.052) 0:01:14.767 ****** 2020-10-31T22:36:00.651 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.041) 0:01:14.808 ****** 2020-10-31T22:36:00.660 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-10-31T22:36:00.661 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-10-31T22:36:00.662 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 1231, "name": "ubuntu", "state": "present", "system": false} 2020-10-31T22:36:00.701 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.049) 0:01:14.858 ****** 2020-10-31T22:36:00.738 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.037) 0:01:14.896 ****** 2020-10-31T22:36:00.775 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.036) 0:01:14.932 ****** 2020-10-31T22:36:00.785 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-10-31T22:36:00.787 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:00.826 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.051) 0:01:14.984 ****** 2020-10-31T22:36:00.869 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.042) 0:01:15.026 ****** 2020-10-31T22:36:00.877 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-10-31T22:36:00.879 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-10-31T22:36:00.879 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-10-31T22:36:00.914 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.045) 0:01:15.072 ****** 2020-10-31T22:36:00.960 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.045) 0:01:15.117 ****** 2020-10-31T22:36:01.001 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:00 +0000 (0:00:00.040) 0:01:15.158 ****** 2020-10-31T22:36:01.012 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-10-31T22:36:01.014 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-10-31T22:36:01.053 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.052) 0:01:15.211 ****** 2020-10-31T22:36:01.063 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:01.100 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.046) 0:01:15.257 ****** 2020-10-31T22:36:01.107 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-10-31T22:36:01.109 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-10-31T22:36:01.144 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.044) 0:01:15.302 ****** 2020-10-31T22:36:01.153 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-10-31T22:36:01.155 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-10-31T22:36:01.156 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2020-10-31T22:36:01.201 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.056) 0:01:15.358 ****** 2020-10-31T22:36:01.234 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.033) 0:01:15.391 ****** 2020-10-31T22:36:01.241 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-10-31T22:36:01.243 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-10-31T22:36:01.286 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.051) 0:01:15.443 ****** 2020-10-31T22:36:01.295 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-10-31T22:36:01.297 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2020-10-31T22:36:01.334 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.048) 0:01:15.492 ****** 2020-10-31T22:36:01.341 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-10-31T22:36:01.343 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-10-31T22:36:01.380 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.045) 0:01:15.537 ****** 2020-10-31T22:36:01.387 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-10-31T22:36:01.389 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2020-10-31T22:36:01.427 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.047) 0:01:15.585 ****** 2020-10-31T22:36:01.436 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-10-31T22:36:01.437 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi060"}, "changed": false} TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-10-31T22:36:01.477 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.049) 0:01:15.634 ****** 2020-10-31T22:36:01.510 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.033) 0:01:15.668 ****** 2020-10-31T22:36:01.518 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-10-31T22:36:01.520 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-10-31T22:36:01.560 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.049) 0:01:15.717 ****** 2020-10-31T22:36:01.589 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-10-31T22:36:01.591 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-10-31T22:36:01.637 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.077) 0:01:15.795 ****** 2020-10-31T22:36:01.667 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-10-31T22:36:01.669 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "gid": 1231, "name": "ubuntu", "state": "present", "system": false} TASK [testnode : Set hostname var] ********************************************* ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi066"}, "changed": false} 2020-10-31T22:36:01.707 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.070) 0:01:15.865 ****** 2020-10-31T22:36:01.745 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.037) 0:01:15.903 ****** 2020-10-31T22:36:01.753 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-10-31T22:36:01.755 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2020-10-31T22:36:01.792 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.046) 0:01:15.950 ****** 2020-10-31T22:36:01.799 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-10-31T22:36:01.801 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:01.836 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.043) 0:01:15.993 ****** 2020-10-31T22:36:01.865 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-10-31T22:36:01.867 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:01.900 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.064) 0:01:16.058 ****** 2020-10-31T22:36:01.928 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-10-31T22:36:01.930 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 1231, "name": "ubuntu", "state": "present", "system": false} 2020-10-31T22:36:01.964 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:01 +0000 (0:00:00.064) 0:01:16.122 ****** 2020-10-31T22:36:01.992 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-10-31T22:36:01.994 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:02.031 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:02 +0000 (0:00:00.066) 0:01:16.189 ****** 2020-10-31T22:36:02.067 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-10-31T22:36:02.069 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:02.105 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:02 +0000 (0:00:00.073) 0:01:16.262 ****** 2020-10-31T22:36:02.136 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:02 +0000 (0:00:00.031) 0:01:16.293 ****** 2020-10-31T22:36:02.304 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-10-31T22:36:02.306 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2020-10-31T22:36:02.339 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:02 +0000 (0:00:00.202) 0:01:16.496 ****** 2020-10-31T22:36:02.420 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-10-31T22:36:02.422 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi060", "ansible_hostname": "smithi060", "ansible_nodename": "smithi060"}, "changed": false, "name": "smithi060"} 2020-10-31T22:36:02.474 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:02 +0000 (0:00:00.135) 0:01:16.632 ****** 2020-10-31T22:36:02.484 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi066", "ansible_hostname": "smithi066", "ansible_nodename": "smithi066"}, "changed": false, "name": "smithi066"} 2020-10-31T22:36:02.532 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:02 +0000 (0:00:00.058) 0:01:16.690 ****** 2020-10-31T22:36:02.540 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-10-31T22:36:02.542 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-10-31T22:36:02.576 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:02 +0000 (0:00:00.044) 0:01:16.734 ****** 2020-10-31T22:36:02.606 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-10-31T22:36:02.607 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi085"}, "changed": false} 2020-10-31T22:36:02.641 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:02 +0000 (0:00:00.064) 0:01:16.798 ****** 2020-10-31T22:36:02.788 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-10-31T22:36:02.790 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2020-10-31T22:36:02.831 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:02 +0000 (0:00:00.190) 0:01:16.989 ****** 2020-10-31T22:36:02.840 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-10-31T22:36:02.879 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:02 +0000 (0:00:00.047) 0:01:17.037 ****** 2020-10-31T22:36:02.887 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-10-31T22:36:02.890 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi152"}, "changed": false} 2020-10-31T22:36:02.937 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:02 +0000 (0:00:00.058) 0:01:17.095 ****** 2020-10-31T22:36:02.992 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:02 +0000 (0:00:00.054) 0:01:17.149 ****** 2020-10-31T22:36:03.108 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-10-31T22:36:03.109 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi085", "ansible_hostname": "smithi085", "ansible_nodename": "smithi085"}, "changed": false, "name": "smithi085"} 2020-10-31T22:36:03.145 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:03 +0000 (0:00:00.152) 0:01:17.302 ****** 2020-10-31T22:36:03.215 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-10-31T22:36:03.217 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-10-31T22:36:03.251 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:03 +0000 (0:00:00.106) 0:01:17.409 ****** 2020-10-31T22:36:03.269 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-10-31T22:36:03.305 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:03 +0000 (0:00:00.053) 0:01:17.463 ****** 2020-10-31T22:36:03.461 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-10-31T22:36:03.463 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi152", "ansible_hostname": "smithi152", "ansible_nodename": "smithi152"}, "changed": false, "name": "smithi152"} 2020-10-31T22:36:03.500 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:03 +0000 (0:00:00.195) 0:01:17.658 ****** 2020-10-31T22:36:03.507 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-10-31T22:36:03.509 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-10-31T22:36:03.544 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:03 +0000 (0:00:00.043) 0:01:17.701 ****** 2020-10-31T22:36:03.763 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-10-31T22:36:03.765 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-10-31T22:36:03.798 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:03 +0000 (0:00:00.254) 0:01:17.956 ****** 2020-10-31T22:36:03.817 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-10-31T22:36:03.857 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:03 +0000 (0:00:00.059) 0:01:18.015 ****** 2020-10-31T22:36:03.865 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-10-31T22:36:03.866 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2020-10-31T22:36:03.867 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2020-10-31T22:36:03.901 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:03 +0000 (0:00:00.043) 0:01:18.058 ****** 2020-10-31T22:36:03.936 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:03 +0000 (0:00:00.035) 0:01:18.094 ****** 2020-10-31T22:36:03.969 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:03 +0000 (0:00:00.033) 0:01:18.127 ****** 2020-10-31T22:36:03.977 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-10-31T22:36:03.978 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:04.015 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.045) 0:01:18.173 ****** 2020-10-31T22:36:04.048 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.033) 0:01:18.206 ****** 2020-10-31T22:36:04.055 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-10-31T22:36:04.058 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:04.097 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.048) 0:01:18.254 ****** 2020-10-31T22:36:04.106 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-10-31T22:36:04.107 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:04.152 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.055) 0:01:18.309 ****** 2020-10-31T22:36:04.162 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-10-31T22:36:04.164 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:04.199 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.046) 0:01:18.356 ****** 2020-10-31T22:36:04.206 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-10-31T22:36:04.208 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:04.242 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.043) 0:01:18.400 ****** 2020-10-31T22:36:04.250 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-10-31T22:36:04.252 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:04.288 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.045) 0:01:18.445 ****** 2020-10-31T22:36:04.295 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-10-31T22:36:04.297 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:04.330 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.042) 0:01:18.488 ****** 2020-10-31T22:36:04.338 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-10-31T22:36:04.340 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:04.373 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.043) 0:01:18.531 ****** 2020-10-31T22:36:04.408 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.034) 0:01:18.566 ****** 2020-10-31T22:36:04.416 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-10-31T22:36:04.418 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi085.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-10-31T22:36:04.455 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.047) 0:01:18.613 ****** 2020-10-31T22:36:04.492 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.037) 0:01:18.650 ****** 2020-10-31T22:36:04.546 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.053) 0:01:18.704 ****** 2020-10-31T22:36:04.555 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-10-31T22:36:04.557 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:04.593 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.046) 0:01:18.751 ****** 2020-10-31T22:36:04.627 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.033) 0:01:18.785 ****** 2020-10-31T22:36:04.634 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-10-31T22:36:04.636 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-10-31T22:36:04.672 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.045) 0:01:18.830 ****** 2020-10-31T22:36:04.714 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.042) 0:01:18.872 ****** 2020-10-31T22:36:04.723 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-10-31T22:36:04.725 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-10-31T22:36:04.761 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.046) 0:01:18.918 ****** 2020-10-31T22:36:04.794 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.033) 0:01:18.951 ****** 2020-10-31T22:36:04.801 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-10-31T22:36:04.803 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable copr repos] ******************************************** 2020-10-31T22:36:04.838 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.043) 0:01:18.995 ****** 2020-10-31T22:36:04.871 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.033) 0:01:19.029 ****** 2020-10-31T22:36:04.878 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-10-31T22:36:04.880 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:04.917 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.045) 0:01:19.074 ****** 2020-10-31T22:36:04.951 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.033) 0:01:19.108 ****** 2020-10-31T22:36:04.959 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-10-31T22:36:04.960 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi152.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-10-31T22:36:04.961 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi060.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:04.997 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:04 +0000 (0:00:00.045) 0:01:19.154 ****** 2020-10-31T22:36:05.033 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.035) 0:01:19.190 ****** 2020-10-31T22:36:05.073 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.040) 0:01:19.231 ****** 2020-10-31T22:36:05.083 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-10-31T22:36:05.084 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:05.118 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.044) 0:01:19.276 ****** 2020-10-31T22:36:05.167 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.049) 0:01:19.325 ****** 2020-10-31T22:36:05.201 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.033) 0:01:19.358 ****** 2020-10-31T22:36:05.208 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-10-31T22:36:05.210 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-10-31T22:36:05.243 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.043) 0:01:19.401 ****** 2020-10-31T22:36:05.277 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.032) 0:01:19.434 ****** 2020-10-31T22:36:05.308 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.032) 0:01:19.466 ****** 2020-10-31T22:36:05.314 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:05.317 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable copr repos] ******************************************** 2020-10-31T22:36:05.350 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.042) 0:01:19.508 ****** 2020-10-31T22:36:05.383 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.032) 0:01:19.541 ****** 2020-10-31T22:36:05.415 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.032) 0:01:19.573 ****** 2020-10-31T22:36:05.422 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-10-31T22:36:05.424 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install GPG] ************************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:05.458 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.042) 0:01:19.615 ****** 2020-10-31T22:36:05.489 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.031) 0:01:19.647 ****** 2020-10-31T22:36:05.522 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.032) 0:01:19.680 ****** 2020-10-31T22:36:05.530 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-10-31T22:36:05.532 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:05.532 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:05.567 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.044) 0:01:19.725 ****** 2020-10-31T22:36:05.599 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.032) 0:01:19.757 ****** 2020-10-31T22:36:05.633 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.033) 0:01:19.791 ****** 2020-10-31T22:36:05.642 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-10-31T22:36:05.643 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:05.680 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.046) 0:01:19.837 ****** 2020-10-31T22:36:05.724 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.044) 0:01:19.882 ****** 2020-10-31T22:36:05.758 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.033) 0:01:19.916 ****** 2020-10-31T22:36:05.765 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-10-31T22:36:05.767 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:05.801 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.043) 0:01:19.959 ****** 2020-10-31T22:36:05.835 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.033) 0:01:19.992 ****** 2020-10-31T22:36:05.870 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.034) 0:01:20.027 ****** 2020-10-31T22:36:05.877 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-10-31T22:36:05.879 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:05.916 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.046) 0:01:20.074 ****** 2020-10-31T22:36:05.951 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.034) 0:01:20.108 ****** 2020-10-31T22:36:05.983 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:05 +0000 (0:00:00.032) 0:01:20.141 ****** 2020-10-31T22:36:05.989 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-10-31T22:36:05.991 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:06.025 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.042) 0:01:20.183 ****** 2020-10-31T22:36:06.059 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.033) 0:01:20.216 ****** 2020-10-31T22:36:06.099 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.039) 0:01:20.256 ****** 2020-10-31T22:36:06.107 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-10-31T22:36:06.109 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:06.145 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.046) 0:01:20.302 ****** 2020-10-31T22:36:06.177 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.032) 0:01:20.335 ****** 2020-10-31T22:36:06.209 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.031) 0:01:20.367 ****** 2020-10-31T22:36:06.217 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-10-31T22:36:06.219 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:06.254 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.045) 0:01:20.412 ****** 2020-10-31T22:36:06.295 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.041) 0:01:20.453 ****** 2020-10-31T22:36:06.329 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.033) 0:01:20.486 ****** 2020-10-31T22:36:06.336 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-10-31T22:36:06.338 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:06.371 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.042) 0:01:20.529 ****** 2020-10-31T22:36:06.406 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.034) 0:01:20.563 ****** 2020-10-31T22:36:06.440 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.033) 0:01:20.597 ****** 2020-10-31T22:36:06.446 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-10-31T22:36:06.449 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:06.482 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.042) 0:01:20.640 ****** 2020-10-31T22:36:06.518 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.035) 0:01:20.675 ****** 2020-10-31T22:36:06.551 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.033) 0:01:20.709 ****** 2020-10-31T22:36:06.558 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:06.559 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:06.593 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.042) 0:01:20.751 ****** 2020-10-31T22:36:06.628 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.034) 0:01:20.785 ****** 2020-10-31T22:36:06.663 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.035) 0:01:20.821 ****** 2020-10-31T22:36:06.671 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-10-31T22:36:06.673 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install epel packages] **************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:06.709 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.045) 0:01:20.866 ****** 2020-10-31T22:36:06.742 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.033) 0:01:20.900 ****** 2020-10-31T22:36:06.775 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.033) 0:01:20.933 ****** 2020-10-31T22:36:06.783 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-10-31T22:36:06.784 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove packages] ********************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:06.820 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.044) 0:01:20.977 ****** 2020-10-31T22:36:06.863 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.042) 0:01:21.020 ****** 2020-10-31T22:36:06.896 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.033) 0:01:21.054 ****** 2020-10-31T22:36:06.903 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-10-31T22:36:06.905 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:06.942 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.045) 0:01:21.100 ****** 2020-10-31T22:36:06.976 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:06 +0000 (0:00:00.034) 0:01:21.134 ****** 2020-10-31T22:36:07.012 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.035) 0:01:21.169 ****** 2020-10-31T22:36:07.022 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-10-31T22:36:07.024 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable firewalld] *********************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:07.066 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.054) 0:01:21.223 ****** 2020-10-31T22:36:07.103 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.037) 0:01:21.261 ****** 2020-10-31T22:36:07.146 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.043) 0:01:21.304 ****** 2020-10-31T22:36:07.154 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-10-31T22:36:07.156 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:07.158 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:07.194 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.048) 0:01:21.352 ****** 2020-10-31T22:36:07.233 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.033) 0:01:21.386 ****** 2020-10-31T22:36:07.265 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.037) 0:01:21.423 ****** 2020-10-31T22:36:07.273 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-10-31T22:36:07.274 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:07.308 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.042) 0:01:21.466 ****** 2020-10-31T22:36:07.343 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.034) 0:01:21.501 ****** 2020-10-31T22:36:07.378 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.034) 0:01:21.535 ****** 2020-10-31T22:36:07.385 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-10-31T22:36:07.387 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install abrt] ************************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:07.421 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.043) 0:01:21.579 ****** 2020-10-31T22:36:07.462 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.041) 0:01:21.620 ****** 2020-10-31T22:36:07.470 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-10-31T22:36:07.471 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-10-31T22:36:07.472 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005208", "end": "2020-10-31 22:36:07.552162", "rc": 0, "start": "2020-10-31 22:36:07.546954", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:07.472 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:07.508 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.045) 0:01:21.665 ****** 2020-10-31T22:36:07.545 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.037) 0:01:21.703 ****** 2020-10-31T22:36:07.586 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.041) 0:01:21.744 ****** 2020-10-31T22:36:07.595 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-31T22:36:07.596 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:07.639 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.052) 0:01:21.797 ****** 2020-10-31T22:36:07.679 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.039) 0:01:21.836 ****** 2020-10-31T22:36:07.725 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.045) 0:01:21.882 ****** 2020-10-31T22:36:07.734 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:07.846 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Saturday 31 October 2020 22:36:07 +0000 (0:00:00.046) 0:01:21.929 ****** Saturday 31 October 2020 22:36:07 +0000 (0:00:00.037) 0:01:21.966 ****** TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:07.858 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.048) 0:01:22.015 ****** 2020-10-31T22:36:07.911 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.053) 0:01:22.069 ****** 2020-10-31T22:36:07.921 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-10-31T22:36:07.923 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:07.973 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:07 +0000 (0:00:00.062) 0:01:22.131 ****** 2020-10-31T22:36:07.981 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-10-31T22:36:07.983 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:08.034 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.060) 0:01:22.191 ****** 2020-10-31T22:36:08.044 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-10-31T22:36:08.048 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:08.090 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.056) 0:01:22.248 ****** 2020-10-31T22:36:08.104 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-10-31T22:36:08.106 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:08.107 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-10-31T22:36:08.107 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005169", "end": "2020-10-31 22:36:07.591708", "rc": 0, "start": "2020-10-31 22:36:07.586539", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:08.163 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.072) 0:01:22.320 ****** 2020-10-31T22:36:08.208 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.045) 0:01:22.366 ****** 2020-10-31T22:36:08.252 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.042) 0:01:22.409 ****** 2020-10-31T22:36:08.259 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-31T22:36:08.261 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add sources list] ********************************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove custom repos] ****************************************** 2020-10-31T22:36:08.318 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.066) 0:01:22.476 ****** 2020-10-31T22:36:08.353 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.035) 0:01:22.511 ****** 2020-10-31T22:36:08.390 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.035) 0:01:22.547 ****** 2020-10-31T22:36:08.399 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-10-31T22:36:08.401 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:08.442 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.053) 0:01:22.600 ****** 2020-10-31T22:36:08.451 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:08.487 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.045) 0:01:22.645 ****** 2020-10-31T22:36:08.495 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-10-31T22:36:08.496 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:08.538 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.050) 0:01:22.695 ****** 2020-10-31T22:36:08.548 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-10-31T22:36:08.549 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:08.590 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.052) 0:01:22.748 ****** 2020-10-31T22:36:08.592 INFO:teuthology.task.ansible.out: 2020-10-31T22:36:08.599 INFO:teuthology.task.ansible.out: 2020-10-31T22:36:08.601 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:08.644 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.053) 0:01:22.802 ****** 2020-10-31T22:36:08.652 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-10-31T22:36:08.655 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:08.693 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.048) 0:01:22.851 ****** 2020-10-31T22:36:08.700 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-10-31T22:36:08.701 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:08.703 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-10-31T22:36:08.741 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.048) 0:01:22.899 ****** 2020-10-31T22:36:08.777 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.036) 0:01:22.935 ****** 2020-10-31T22:36:08.785 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-10-31T22:36:08.787 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add sources list] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:08.823 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.045) 0:01:22.980 ****** 2020-10-31T22:36:08.856 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.033) 0:01:23.014 ****** 2020-10-31T22:36:08.864 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-10-31T22:36:08.866 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:08.902 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.044) 0:01:23.059 ****** 2020-10-31T22:36:08.920 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-10-31T22:36:08.922 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:08.954 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.053) 0:01:23.112 ****** 2020-10-31T22:36:08.961 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-10-31T22:36:08.962 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:08.997 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:08 +0000 (0:00:00.042) 0:01:23.155 ****** 2020-10-31T22:36:09.004 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-10-31T22:36:09.006 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.044 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.046) 0:01:23.201 ****** 2020-10-31T22:36:09.051 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-10-31T22:36:09.053 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.090 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.046) 0:01:23.247 ****** 2020-10-31T22:36:09.097 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-10-31T22:36:09.102 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.134 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.044) 0:01:23.292 ****** 2020-10-31T22:36:09.141 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-10-31T22:36:09.143 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.180 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.045) 0:01:23.337 ****** 2020-10-31T22:36:09.188 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-10-31T22:36:09.190 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.225 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.044) 0:01:23.381 ****** 2020-10-31T22:36:09.231 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-10-31T22:36:09.233 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.268 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.044) 0:01:23.426 ****** 2020-10-31T22:36:09.277 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-10-31T22:36:09.278 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.317 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.048) 0:01:23.474 ****** 2020-10-31T22:36:09.324 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-10-31T22:36:09.325 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.359 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.042) 0:01:23.517 ****** 2020-10-31T22:36:09.367 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-10-31T22:36:09.369 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.413 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.054) 0:01:23.571 ****** 2020-10-31T22:36:09.424 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.461 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.047) 0:01:23.619 ****** 2020-10-31T22:36:09.475 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-10-31T22:36:09.477 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.511 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.050) 0:01:23.669 ****** 2020-10-31T22:36:09.519 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-10-31T22:36:09.521 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.557 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.045) 0:01:23.715 ****** 2020-10-31T22:36:09.565 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-10-31T22:36:09.566 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.610 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.052) 0:01:23.767 ****** 2020-10-31T22:36:09.618 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-10-31T22:36:09.620 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install apt keys] ********************************************* ok: [smithi060.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-10-31T22:36:09.657 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.047) 0:01:23.815 ****** 2020-10-31T22:36:09.665 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-10-31T22:36:09.667 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.701 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.044) 0:01:23.859 ****** 2020-10-31T22:36:09.708 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-10-31T22:36:09.710 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.757 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.055) 0:01:23.914 ****** 2020-10-31T22:36:09.772 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.810 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.053) 0:01:23.968 ****** 2020-10-31T22:36:09.818 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-10-31T22:36:09.820 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.871 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.060) 0:01:24.028 ****** 2020-10-31T22:36:09.882 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-10-31T22:36:09.883 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install apt keys] ********************************************* ok: [smithi066.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-10-31T22:36:09.928 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.057) 0:01:24.086 ****** 2020-10-31T22:36:09.959 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:09.993 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:09 +0000 (0:00:00.064) 0:01:24.151 ****** 2020-10-31T22:36:10.025 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-10-31T22:36:10.027 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for custom repos] *************************************** ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.003455", "end": "2020-10-31 22:36:09.721664", "rc": 0, "start": "2020-10-31 22:36:09.718209", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:10.060 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:10 +0000 (0:00:00.067) 0:01:24.218 ****** 2020-10-31T22:36:10.093 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:10 +0000 (0:00:00.032) 0:01:24.251 ****** 2020-10-31T22:36:10.101 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-10-31T22:36:10.140 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:10 +0000 (0:00:00.046) 0:01:24.298 ****** 2020-10-31T22:36:10.148 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-10-31T22:36:10.150 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:10.185 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:10 +0000 (0:00:00.044) 0:01:24.343 ****** 2020-10-31T22:36:10.334 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-10-31T22:36:10.336 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.004936", "end": "2020-10-31 22:36:10.205172", "rc": 0, "start": "2020-10-31 22:36:10.200236", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:10.370 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:10 +0000 (0:00:00.185) 0:01:24.528 ****** 2020-10-31T22:36:10.398 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-10-31T22:36:10.434 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:10 +0000 (0:00:00.063) 0:01:24.591 ****** 2020-10-31T22:36:10.474 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-10-31T22:36:10.476 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-10-31T22:36:10.520 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:10 +0000 (0:00:00.086) 0:01:24.677 ****** 2020-10-31T22:36:10.561 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-10-31T22:36:10.563 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:10.606 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:10 +0000 (0:00:00.086) 0:01:24.764 ****** 2020-10-31T22:36:10.614 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-10-31T22:36:10.615 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-10-31T22:36:10.658 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:10 +0000 (0:00:00.051) 0:01:24.816 ****** 2020-10-31T22:36:10.796 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-10-31T22:36:10.798 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2020-10-31T22:36:10.837 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:10 +0000 (0:00:00.179) 0:01:24.995 ****** 2020-10-31T22:36:10.845 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-10-31T22:36:10.847 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-10-31T22:36:10.885 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:10 +0000 (0:00:00.047) 0:01:25.043 ****** 2020-10-31T22:36:10.896 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-10-31T22:36:10.898 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:10.936 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:10 +0000 (0:00:00.050) 0:01:25.094 ****** 2020-10-31T22:36:11.607 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-10-31T22:36:11.608 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} TASK [testnode : Install python-apt] ******************************************* ok: [smithi060.front.sepia.ceph.com] => {"cache_update_time": 1604183664, "cache_updated": false, "changed": false} 2020-10-31T22:36:11.648 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:11 +0000 (0:00:00.712) 0:01:25.806 ****** 2020-10-31T22:36:11.678 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-10-31T22:36:11.713 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:11 +0000 (0:00:00.064) 0:01:25.871 ****** 2020-10-31T22:36:11.827 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-10-31T22:36:11.829 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"cache_update_time": 1604183668, "cache_updated": false, "changed": false} 2020-10-31T22:36:11.866 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:11 +0000 (0:00:00.152) 0:01:26.023 ****** 2020-10-31T22:36:11.896 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-10-31T22:36:11.897 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi060.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.036744", "end": "2020-10-31 22:36:11.986666", "rc": 0, "start": "2020-10-31 22:36:11.949922", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:11.942 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:11 +0000 (0:00:00.076) 0:01:26.100 ****** 2020-10-31T22:36:11.976 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:11 +0000 (0:00:00.033) 0:01:26.133 ****** 2020-10-31T22:36:11.984 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-10-31T22:36:11.986 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2020-10-31T22:36:12.167 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-10-31T22:36:12.169 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.034714", "end": "2020-10-31 22:36:11.682593", "rc": 0, "start": "2020-10-31 22:36:11.647879", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:12.207 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:12 +0000 (0:00:00.231) 0:01:26.365 ****** 2020-10-31T22:36:12.541 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-10-31T22:36:12.543 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-10-31T22:36:12.580 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:12 +0000 (0:00:00.372) 0:01:26.738 ****** 2020-10-31T22:36:12.886 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2020-10-31T22:36:12.930 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:12 +0000 (0:00:00.349) 0:01:27.087 ****** 2020-10-31T22:36:13.494 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-10-31T22:36:13.496 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"cache_update_time": 1604183678, "cache_updated": false, "changed": false} 2020-10-31T22:36:13.548 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:13 +0000 (0:00:00.617) 0:01:27.705 ****** 2020-10-31T22:36:13.588 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-10-31T22:36:13.627 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:13 +0000 (0:00:00.079) 0:01:27.785 ****** 2020-10-31T22:36:13.797 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-10-31T22:36:13.799 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.033931", "end": "2020-10-31 22:36:13.493418", "rc": 0, "start": "2020-10-31 22:36:13.459487", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:13.833 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:13 +0000 (0:00:00.205) 0:01:27.990 ****** 2020-10-31T22:36:13.840 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi152.front.sepia.ceph.com] => {"cache_update_time": 1604183673, "cache_updated": false, "changed": false} 2020-10-31T22:36:13.877 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:13 +0000 (0:00:00.044) 0:01:28.035 ****** 2020-10-31T22:36:13.908 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-10-31T22:36:13.943 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:13 +0000 (0:00:00.065) 0:01:28.101 ****** 2020-10-31T22:36:14.123 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-10-31T22:36:14.126 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.037152", "end": "2020-10-31 22:36:13.987683", "rc": 0, "start": "2020-10-31 22:36:13.950531", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:14.160 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:14 +0000 (0:00:00.216) 0:01:28.318 ****** 2020-10-31T22:36:15.109 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-10-31T22:36:15.111 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"cache_update_time": 1604183664, "cache_updated": false, "changed": false} 2020-10-31T22:36:15.147 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:15 +0000 (0:00:00.987) 0:01:29.305 ****** 2020-10-31T22:36:15.418 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"cache_update_time": 1604183668, "cache_updated": false, "changed": false} 2020-10-31T22:36:15.458 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:15 +0000 (0:00:00.310) 0:01:29.615 ****** 2020-10-31T22:36:16.648 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"cache_update_time": 1604183678, "cache_updated": false, "changed": false} 2020-10-31T22:36:16.687 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:16 +0000 (0:00:01.229) 0:01:30.845 ****** 2020-10-31T22:36:17.101 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"cache_update_time": 1604183673, "cache_updated": false, "changed": false} 2020-10-31T22:36:17.142 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:17 +0000 (0:00:00.454) 0:01:31.299 ****** 2020-10-31T22:36:24.469 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-10-31T22:36:24.471 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 14 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 102060 files and directorie 2020-10-31T22:36:24.473 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 14 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2020-10-31T22:36:24.475 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 102060 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.2) ..."]} 2020-10-31T22:36:24.518 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:24 +0000 (0:00:07.376) 0:01:38.676 ****** 2020-10-31T22:36:24.719 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 14 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 102060 files and directorie 2020-10-31T22:36:24.720 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 14 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2020-10-31T22:36:24.722 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 102060 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.2) ..."]} 2020-10-31T22:36:24.756 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:24 +0000 (0:00:00.237) 0:01:38.913 ****** 2020-10-31T22:36:25.429 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* ok: [smithi066.front.sepia.ceph.com] => {"cache_update_time": 1604183668, "cache_updated": false, "changed": false} 2020-10-31T22:36:25.464 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:25 +0000 (0:00:00.708) 0:01:39.622 ****** 2020-10-31T22:36:25.493 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-10-31T22:36:25.496 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:25.529 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:25 +0000 (0:00:00.064) 0:01:39.686 ****** 2020-10-31T22:36:25.648 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-10-31T22:36:25.651 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"cache_update_time": 1604183664, "cache_updated": false, "changed": false} 2020-10-31T22:36:25.685 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:25 +0000 (0:00:00.156) 0:01:39.842 ****** 2020-10-31T22:36:25.713 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-10-31T22:36:25.715 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:25.747 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:25 +0000 (0:00:00.062) 0:01:39.905 ****** 2020-10-31T22:36:25.755 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-10-31T22:36:25.757 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 14 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 102060 files and directorie 2020-10-31T22:36:25.758 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 14 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2020-10-31T22:36:25.760 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 102060 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.2) ..."]} 2020-10-31T22:36:25.811 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:25 +0000 (0:00:00.061) 0:01:39.967 ****** 2020-10-31T22:36:26.430 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 14 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 102060 files and directorie 2020-10-31T22:36:26.431 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 14 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Read 2020-10-31T22:36:26.434 INFO:teuthology.task.ansible.out:ing database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 102060 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.2) ..."]} 2020-10-31T22:36:26.465 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:26 +0000 (0:00:00.655) 0:01:40.623 ****** 2020-10-31T22:36:26.666 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-10-31T22:36:26.668 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"cache_update_time": 1604183678, "cache_updated": false, "changed": false} 2020-10-31T22:36:26.704 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:26 +0000 (0:00:00.238) 0:01:40.862 ****** 2020-10-31T22:36:26.732 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-10-31T22:36:26.734 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:26.770 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:26 +0000 (0:00:00.066) 0:01:40.928 ****** 2020-10-31T22:36:27.352 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-10-31T22:36:27.354 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"cache_update_time": 1604183673, "cache_updated": false, "changed": false} 2020-10-31T22:36:27.391 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:27 +0000 (0:00:00.620) 0:01:41.548 ****** 2020-10-31T22:36:27.421 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-10-31T22:36:27.423 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:27.457 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:27 +0000 (0:00:00.066) 0:01:41.615 ****** 2020-10-31T22:36:34.237 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-10-31T22:36:34.239 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"cache_update_time": 1604183668, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 14 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.32 [40.3 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.32 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.32 [5184 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.32 [869 kB]\nFetched 10.4 MB in 1s (9595 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2020-10-31T22:36:34.240 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101918 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2020-10-31T22:36:34.242 INFO:teuthology.task.ansible.out:u1.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 14 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.32 [40.3 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.32 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.32 [5184 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.32 [869 kB]", "Fetched 10.4 MB in 1s (9595 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(R 2020-10-31T22:36:34.243 INFO:teuthology.task.ansible.out:eading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101918 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.2) ..."]} 2020-10-31T22:36:34.280 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:34 +0000 (0:00:06.822) 0:01:48.437 ****** 2020-10-31T22:36:34.540 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => {"cache_update_time": 1604183664, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 14 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.32 [40.3 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.32 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.32 [5184 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.32 [869 kB]\nFetched 10.4 MB in 1s (9855 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2020-10-31T22:36:34.542 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101918 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2020-10-31T22:36:34.547 INFO:teuthology.task.ansible.out:u1.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 14 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.32 [40.3 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.32 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.32 [5184 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.32 [869 kB]", "Fetched 10.4 MB in 1s (9855 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(R 2020-10-31T22:36:34.549 INFO:teuthology.task.ansible.out:eading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101918 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.2) ..."]} 2020-10-31T22:36:34.580 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:34 +0000 (0:00:00.298) 0:01:48.736 ****** 2020-10-31T22:36:35.172 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-10-31T22:36:35.174 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"cache_update_time": 1604183668, "cache_updated": false, "changed": false} 2020-10-31T22:36:35.208 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:35 +0000 (0:00:00.629) 0:01:49.366 ****** 2020-10-31T22:36:35.333 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-10-31T22:36:35.335 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-10-31T22:36:35.373 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:35 +0000 (0:00:00.164) 0:01:49.530 ****** 2020-10-31T22:36:35.411 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-10-31T22:36:35.413 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:35.448 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:35 +0000 (0:00:00.075) 0:01:49.606 ****** 2020-10-31T22:36:35.498 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi060.front.sepia.ceph.com] => {"cache_update_time": 1604183664, "cache_updated": false, "changed": false} 2020-10-31T22:36:35.535 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:35 +0000 (0:00:00.086) 0:01:49.693 ****** 2020-10-31T22:36:35.576 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-10-31T22:36:35.578 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-10-31T22:36:35.614 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:35 +0000 (0:00:00.079) 0:01:49.772 ****** 2020-10-31T22:36:35.665 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-10-31T22:36:35.669 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-10-31T22:36:35.709 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:35 +0000 (0:00:00.093) 0:01:49.866 ****** 2020-10-31T22:36:35.719 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-10-31T22:36:35.721 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => {"cache_update_time": 1604183678, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 14 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.32 [40.3 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.32 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.32 [5184 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.32 [869 kB]\nFetched 10.4 MB in 1s (9636 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2020-10-31T22:36:35.723 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101918 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2020-10-31T22:36:35.726 INFO:teuthology.task.ansible.out:u1.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 14 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.32 [40.3 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.32 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.32 [5184 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.32 [869 kB]", "Fetched 10.4 MB in 1s (9636 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(R 2020-10-31T22:36:35.728 INFO:teuthology.task.ansible.out:eading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101918 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.2) ..."]} 2020-10-31T22:36:35.771 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:35 +0000 (0:00:00.062) 0:01:49.929 ****** 2020-10-31T22:36:35.779 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-10-31T22:36:35.782 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:35.815 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:35 +0000 (0:00:00.043) 0:01:49.973 ****** 2020-10-31T22:36:35.947 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-10-31T22:36:35.949 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"cache_update_time": 1604183673, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 14 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.32 [40.3 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.32 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.32 [5184 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.32 [869 kB]\nFetched 10.4 MB in 1s (9783 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2020-10-31T22:36:35.951 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101918 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2020-10-31T22:36:35.952 INFO:teuthology.task.ansible.out:u1.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 14 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.4 [2727 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.4 [924 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.32 [40.3 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.32 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.32 [5184 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.32 [869 kB]", "Fetched 10.4 MB in 1s (9783 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(R 2020-10-31T22:36:35.954 INFO:teuthology.task.ansible.out:eading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101918 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.4_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.32_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.32) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.32) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.2) ..."]} 2020-10-31T22:36:35.988 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:35 +0000 (0:00:00.173) 0:01:50.146 ****** 2020-10-31T22:36:35.999 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-10-31T22:36:36.036 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:36 +0000 (0:00:00.047) 0:01:50.193 ****** 2020-10-31T22:36:36.070 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:36 +0000 (0:00:00.034) 0:01:50.227 ****** 2020-10-31T22:36:36.233 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi066.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1231, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-10-31T22:36:36.266 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:36 +0000 (0:00:00.196) 0:01:50.424 ****** 2020-10-31T22:36:36.404 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-10-31T22:36:36.409 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:36:36.441 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:36 +0000 (0:00:00.174) 0:01:50.598 ****** 2020-10-31T22:36:36.475 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:36 +0000 (0:00:00.034) 0:01:50.633 ****** 2020-10-31T22:36:36.598 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-10-31T22:36:36.600 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1231, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-10-31T22:36:36.635 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:36 +0000 (0:00:00.160) 0:01:50.793 ****** 2020-10-31T22:36:36.664 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-10-31T22:36:36.666 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"cache_update_time": 1604183678, "cache_updated": false, "changed": false} 2020-10-31T22:36:36.719 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:36 +0000 (0:00:00.083) 0:01:50.877 ****** 2020-10-31T22:36:36.778 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-10-31T22:36:36.780 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:36:36.822 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:36 +0000 (0:00:00.103) 0:01:50.980 ****** 2020-10-31T22:36:36.831 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-10-31T22:36:36.833 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sat 2020-10-31 22:33:32 UTC", "ActiveEnterTimestampMonotonic": "18106149", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount systemd-journald.socket network.target sysinit.target systemd-tmpfiles-setup.service system.slice nss-lookup.target remote-fs.target basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-10-31 22:33:32 UTC", "AssertTimestampMonotonic": "17616361", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-10-31 22:33:32 UTC", "ConditionTimestampMonotonic": "17616361", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-10-31T22:36:36.834 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1188", "ExecMainStartTimestamp": "Sat 2020-10-31 22:33:32 UTC", "ExecMainStartTimestampMonotonic": "18106137", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-10-31 22:33:32 UTC", "InactiveExitTimestampMonotonic": "17617050", "InvocationID": "1f8c5efedd7b4b74ae4b403ed667f18e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-10-31T22:36:36.836 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1188", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2020-10-31T22:36:36.838 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-10-31 22:33:32 UTC", "StateChangeTimestampMonotonic": "18106149", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-10-31 22:33:32 UTC", "WatchdogTimestampMonotonic": "18106148", "WatchdogUSec": "0"}} 2020-10-31T22:36:36.875 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:36 +0000 (0:00:00.053) 0:01:51.033 ****** 2020-10-31T22:36:36.883 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-10-31T22:36:36.885 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi152.front.sepia.ceph.com] => {"cache_update_time": 1604183673, "cache_updated": false, "changed": false} 2020-10-31T22:36:36.924 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:36 +0000 (0:00:00.048) 0:01:51.082 ****** 2020-10-31T22:36:36.963 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:36 +0000 (0:00:00.038) 0:01:51.121 ****** 2020-10-31T22:36:36.971 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-10-31T22:36:36.973 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:37.012 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.048) 0:01:51.170 ****** 2020-10-31T22:36:37.047 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.034) 0:01:51.205 ****** 2020-10-31T22:36:37.054 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-10-31T22:36:37.056 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:37.090 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.042) 0:01:51.248 ****** 2020-10-31T22:36:37.108 INFO:teuthology.task.ansible.out: 2020-10-31T22:36:37.109 INFO:teuthology.task.ansible.out:TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-10-31T22:36:37.110 INFO:teuthology.task.ansible.out: ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2020-10-31T22:36:37.112 INFO:teuthology.task.ansible.out:TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:37.147 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.057) 0:01:51.305 ****** 2020-10-31T22:36:37.184 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.036) 0:01:51.342 ****** 2020-10-31T22:36:37.193 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-10-31T22:36:37.193 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sat 2020-10-31 22:32:54 UTC", "ActiveEnterTimestampMonotonic": "18504424", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket nss-lookup.target systemd-tmpfiles-setup.service system.slice -.mount remote-fs.target basic.target network.target sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-10-31 22:32:53 UTC", "AssertTimestampMonotonic": "17802057", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-10-31 22:32:53 UTC", "ConditionTimestampMonotonic": "17802057", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-10-31T22:36:37.195 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1377", "ExecMainStartTimestamp": "Sat 2020-10-31 22:32:54 UTC", "ExecMainStartTimestampMonotonic": "18504412", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-10-31 22:32:53 UTC", "InactiveExitTimestampMonotonic": "17803407", "InvocationID": "ca6f1bf6d169468cacd5c3326806b006", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-10-31T22:36:37.197 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128055", "LimitNPROCSoft": "128055", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128055", "LimitSIGPENDINGSoft": "128055", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1377", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2020-10-31T22:36:37.200 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-10-31 22:32:54 UTC", "StateChangeTimestampMonotonic": "18504424", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-10-31 22:32:54 UTC", "WatchdogTimestampMonotonic": "18504422", "WatchdogUSec": "0"}} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-10-31T22:36:37.232 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.047) 0:01:51.390 ****** 2020-10-31T22:36:37.266 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.033) 0:01:51.423 ****** 2020-10-31T22:36:37.299 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.032) 0:01:51.456 ****** 2020-10-31T22:36:37.314 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:37.316 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:37.350 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.051) 0:01:51.508 ****** 2020-10-31T22:36:37.393 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.042) 0:01:51.550 ****** 2020-10-31T22:36:37.440 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.047) 0:01:51.598 ****** 2020-10-31T22:36:37.450 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-10-31T22:36:37.452 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:37.506 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.064) 0:01:51.663 ****** 2020-10-31T22:36:37.546 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.040) 0:01:51.703 ****** 2020-10-31T22:36:37.554 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-10-31T22:36:37.555 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:37.592 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.043) 0:01:51.747 ****** 2020-10-31T22:36:37.597 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-10-31T22:36:37.600 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2020-10-31T22:36:37.636 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.046) 0:01:51.794 ****** 2020-10-31T22:36:37.673 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.037) 0:01:51.831 ****** 2020-10-31T22:36:37.681 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-10-31T22:36:37.683 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-10-31T22:36:37.683 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2020-10-31T22:36:37.685 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:37.725 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.051) 0:01:51.882 ****** 2020-10-31T22:36:37.760 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.035) 0:01:51.918 ****** 2020-10-31T22:36:37.795 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.034) 0:01:51.952 ****** 2020-10-31T22:36:37.802 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:37.805 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:37.839 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.044) 0:01:51.997 ****** 2020-10-31T22:36:37.873 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.033) 0:01:52.030 ****** 2020-10-31T22:36:37.879 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-10-31T22:36:37.881 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:37.916 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.043) 0:01:52.074 ****** 2020-10-31T22:36:37.923 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-10-31T22:36:37.925 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:37.965 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:37 +0000 (0:00:00.048) 0:01:52.122 ****** 2020-10-31T22:36:37.972 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-10-31T22:36:37.974 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1231, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:38.022 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.057) 0:01:52.179 ****** 2020-10-31T22:36:38.055 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.033) 0:01:52.212 ****** 2020-10-31T22:36:38.063 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:38.066 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:38.102 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.046) 0:01:52.259 ****** 2020-10-31T22:36:38.136 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.034) 0:01:52.294 ****** 2020-10-31T22:36:38.170 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.033) 0:01:52.327 ****** 2020-10-31T22:36:38.177 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-31T22:36:38.179 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:38.215 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.044) 0:01:52.372 ****** 2020-10-31T22:36:38.253 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.038) 0:01:52.411 ****** 2020-10-31T22:36:38.262 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi085.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:36:38.264 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:38.299 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.045) 0:01:52.456 ****** 2020-10-31T22:36:38.333 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.034) 0:01:52.491 ****** 2020-10-31T22:36:38.344 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-10-31T22:36:38.346 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-10-31T22:36:38.347 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1231, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-10-31T22:36:38.385 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.051) 0:01:52.542 ****** 2020-10-31T22:36:38.421 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.036) 0:01:52.579 ****** 2020-10-31T22:36:38.458 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.037) 0:01:52.616 ****** 2020-10-31T22:36:38.466 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-10-31T22:36:38.468 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:38.505 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.046) 0:01:52.662 ****** 2020-10-31T22:36:38.537 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.032) 0:01:52.695 ****** 2020-10-31T22:36:38.554 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-10-31T22:36:38.556 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:38.589 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.051) 0:01:52.746 ****** 2020-10-31T22:36:38.596 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-10-31T22:36:38.671 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Saturday 31 October 2020 22:36:38 +0000 (0:00:00.045) 0:01:52.791 ****** TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi152.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Stop apache2] ************************************************* changed: [smithi085.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sat 2020-10-31 22:33:25 UTC", "ActiveEnterTimestampMonotonic": "18695744", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount systemd-journald.socket network.target systemd-tmpfiles-setup.service nss-lookup.target system.slice remote-fs.target basic.target sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-10-31 22:33:24 UTC", "AssertTimestampMonotonic": "18012407", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin 2020-10-31T22:36:38.673 INFO:teuthology.task.ansible.out: cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-10-31 22:33:24 UTC", "ConditionTimestampMonotonic": "18012406", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1221", "ExecMainStartTimestamp": "Sat 2020-10-31 22:33:25 UTC", "ExecMainStartTimestampMonotonic": "18695715", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-10-31 22:33:24 UTC", "InactiveExitTimestampMonotonic": "18012979", "InvocationID": " 2020-10-31T22:36:38.675 INFO:teuthology.task.ansible.out:076fd3abe5b44c4382e8329929f50913", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128030", "LimitNPROCSoft": "128030", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128030", "LimitSIGPENDINGSoft": "128030", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1221", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterEx 2020-10-31T22:36:38.677 INFO:teuthology.task.ansible.out:it": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-10-31 22:33:25 UTC", "StateChangeTimestampMonotonic": "18695744", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-10-31 22:33:25 UTC", "WatchdogTimestampMonotonic": "18695743", "WatchdogUSec": "0"}} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:38.693 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.058) 0:01:52.850 ****** 2020-10-31T22:36:38.740 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.047) 0:01:52.897 ****** 2020-10-31T22:36:38.795 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.051) 0:01:52.949 ****** 2020-10-31T22:36:38.800 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:38.806 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:38.837 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.044) 0:01:52.993 ****** 2020-10-31T22:36:38.869 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.033) 0:01:53.027 ****** 2020-10-31T22:36:38.903 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.033) 0:01:53.061 ****** 2020-10-31T22:36:38.911 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-10-31T22:36:38.913 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:38.949 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.046) 0:01:53.107 ****** 2020-10-31T22:36:38.986 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:38 +0000 (0:00:00.036) 0:01:53.144 ****** 2020-10-31T22:36:39.000 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-10-31T22:36:39.002 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:39.040 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.054) 0:01:53.198 ****** 2020-10-31T22:36:39.074 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.034) 0:01:53.232 ****** 2020-10-31T22:36:39.083 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:39.085 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:39.121 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.045) 0:01:53.277 ****** 2020-10-31T22:36:39.153 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.032) 0:01:53.310 ****** 2020-10-31T22:36:39.160 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-10-31T22:36:39.162 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop apache2] ************************************************* 2020-10-31T22:36:39.164 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sat 2020-10-31 22:33:46 UTC", "ActiveEnterTimestampMonotonic": "18852950", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount nss-lookup.target systemd-journald.socket remote-fs.target sysinit.target systemd-tmpfiles-setup.service basic.target system.slice network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-10-31 22:33:45 UTC", "AssertTimestampMonotonic": "18271219", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-10-31 22:33:45 UTC", "ConditionTimestampMonotonic": "18271218", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2020-10-31T22:36:39.166 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1195", "ExecMainStartTimestamp": "Sat 2020-10-31 22:33:46 UTC", "ExecMainStartTimestampMonotonic": "18852910", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-10-31 22:33:45 UTC", "InactiveExitTimestampMonotonic": "18272117", "InvocationID": "e7abb92748c145a0bf06f6d36c0abdad", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2020-10-31T22:36:39.169 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1195", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIG 2020-10-31T22:36:39.172 INFO:teuthology.task.ansible.out:HUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-10-31 22:33:46 UTC", "StateChangeTimestampMonotonic": "18852950", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-10-31 22:33:46 UTC", "WatchdogTimestampMonotonic": "18852948", "WatchdogUSec": "0"}} 2020-10-31T22:36:39.209 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.056) 0:01:53.367 ****** 2020-10-31T22:36:39.244 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.034) 0:01:53.402 ****** 2020-10-31T22:36:39.277 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.032) 0:01:53.434 ****** 2020-10-31T22:36:39.283 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-10-31T22:36:39.285 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:39.322 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.045) 0:01:53.479 ****** 2020-10-31T22:36:39.359 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.037) 0:01:53.517 ****** 2020-10-31T22:36:39.392 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.032) 0:01:53.550 ****** 2020-10-31T22:36:39.399 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-10-31T22:36:39.401 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:39.436 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.044) 0:01:53.594 ****** 2020-10-31T22:36:39.470 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.033) 0:01:53.628 ****** 2020-10-31T22:36:39.507 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.034) 0:01:53.663 ****** 2020-10-31T22:36:39.512 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-10-31T22:36:39.513 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:39.548 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.043) 0:01:53.706 ****** 2020-10-31T22:36:39.584 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.036) 0:01:53.742 ****** 2020-10-31T22:36:39.628 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.042) 0:01:53.784 ****** 2020-10-31T22:36:39.638 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:39.640 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:39.679 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.052) 0:01:53.836 ****** 2020-10-31T22:36:39.729 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.050) 0:01:53.887 ****** 2020-10-31T22:36:39.771 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.042) 0:01:53.929 ****** 2020-10-31T22:36:39.779 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:39.781 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:39.821 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.048) 0:01:53.978 ****** 2020-10-31T22:36:39.856 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.034) 0:01:54.014 ****** 2020-10-31T22:36:39.906 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.049) 0:01:54.063 ****** 2020-10-31T22:36:39.914 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-10-31T22:36:39.916 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:39.952 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.046) 0:01:54.110 ****** 2020-10-31T22:36:39.985 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:39 +0000 (0:00:00.033) 0:01:54.143 ****** 2020-10-31T22:36:40.019 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.033) 0:01:54.176 ****** 2020-10-31T22:36:40.027 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-10-31T22:36:40.028 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set grub config.] ********************************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:40.062 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.043) 0:01:54.220 ****** 2020-10-31T22:36:40.096 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.033) 0:01:54.253 ****** 2020-10-31T22:36:40.129 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.033) 0:01:54.287 ****** 2020-10-31T22:36:40.139 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-10-31T22:36:40.141 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set grub config.] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:40.180 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.050) 0:01:54.337 ****** 2020-10-31T22:36:40.218 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.037) 0:01:54.375 ****** 2020-10-31T22:36:40.224 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-10-31T22:36:40.226 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-10-31T22:36:40.261 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.043) 0:01:54.419 ****** 2020-10-31T22:36:40.294 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.032) 0:01:54.452 ****** 2020-10-31T22:36:40.302 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:40.338 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.044) 0:01:54.496 ****** 2020-10-31T22:36:40.350 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-10-31T22:36:40.362 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : set_fact] ***************************************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:40.398 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.058) 0:01:54.554 ****** 2020-10-31T22:36:40.430 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.033) 0:01:54.588 ****** 2020-10-31T22:36:40.438 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:40.475 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.044) 0:01:54.632 ****** 2020-10-31T22:36:40.483 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-10-31T22:36:40.485 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:40.518 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.043) 0:01:54.676 ****** 2020-10-31T22:36:40.526 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-10-31T22:36:40.528 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:40.565 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.046) 0:01:54.723 ****** 2020-10-31T22:36:40.572 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-10-31T22:36:40.573 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:40.609 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.043) 0:01:54.767 ****** 2020-10-31T22:36:40.619 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-10-31T22:36:40.664 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.054) 0:01:54.821 ****** 2020-10-31T22:36:40.704 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.040) 0:01:54.862 ****** 2020-10-31T22:36:40.711 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-10-31T22:36:40.713 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:40.759 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.054) 0:01:54.917 ****** 2020-10-31T22:36:40.795 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.035) 0:01:54.952 ****** 2020-10-31T22:36:40.803 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-10-31T22:36:40.804 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} TASK [testnode : set_fact] ***************************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:40.841 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.046) 0:01:54.998 ****** 2020-10-31T22:36:40.874 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.033) 0:01:55.031 ****** 2020-10-31T22:36:40.881 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-10-31T22:36:40.883 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:40.923 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.049) 0:01:55.081 ****** 2020-10-31T22:36:40.959 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:40 +0000 (0:00:00.035) 0:01:55.116 ****** 2020-10-31T22:36:40.968 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.007 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.048) 0:01:55.165 ****** 2020-10-31T22:36:41.015 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.062 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.052) 0:01:55.218 ****** 2020-10-31T22:36:41.070 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.108 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.048) 0:01:55.266 ****** 2020-10-31T22:36:41.117 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-10-31T22:36:41.120 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.153 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.044) 0:01:55.311 ****** 2020-10-31T22:36:41.160 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-10-31T22:36:41.162 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.199 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.046) 0:01:55.357 ****** 2020-10-31T22:36:41.234 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.034) 0:01:55.391 ****** 2020-10-31T22:36:41.242 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.284 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.050) 0:01:55.441 ****** 2020-10-31T22:36:41.294 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-10-31T22:36:41.296 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-10-31T22:36:41.334 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.050) 0:01:55.492 ****** 2020-10-31T22:36:41.372 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.037) 0:01:55.529 ****** 2020-10-31T22:36:41.381 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-10-31T22:36:41.384 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.431 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.059) 0:01:55.589 ****** 2020-10-31T22:36:41.440 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.477 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.045) 0:01:55.634 ****** 2020-10-31T22:36:41.488 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-10-31T22:36:41.489 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.533 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.054) 0:01:55.689 ****** 2020-10-31T22:36:41.542 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.582 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.050) 0:01:55.739 ****** 2020-10-31T22:36:41.593 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-10-31T22:36:41.596 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.636 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.053) 0:01:55.793 ****** 2020-10-31T22:36:41.673 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.035) 0:01:55.828 ****** 2020-10-31T22:36:41.679 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-10-31T22:36:41.682 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.727 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.055) 0:01:55.884 ****** 2020-10-31T22:36:41.735 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.740 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-10-31T22:36:41.789 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.063) 0:01:55.947 ****** 2020-10-31T22:36:41.841 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.051) 0:01:55.998 ****** 2020-10-31T22:36:41.852 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-10-31T22:36:41.855 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.891 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.050) 0:01:56.049 ****** 2020-10-31T22:36:41.898 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-10-31T22:36:41.899 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.935 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.043) 0:01:56.093 ****** 2020-10-31T22:36:41.943 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-10-31T22:36:41.944 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:41.984 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:41 +0000 (0:00:00.049) 0:01:56.142 ****** 2020-10-31T22:36:41.992 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-10-31T22:36:41.994 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-10-31T22:36:42.032 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.048) 0:01:56.190 ****** 2020-10-31T22:36:42.070 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.036) 0:01:56.226 ****** 2020-10-31T22:36:42.079 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-10-31T22:36:42.081 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:42.126 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.056) 0:01:56.283 ****** 2020-10-31T22:36:42.133 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-10-31T22:36:42.174 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.048) 0:01:56.331 ****** 2020-10-31T22:36:42.208 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.035) 0:01:56.366 ****** 2020-10-31T22:36:42.216 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-10-31T22:36:42.218 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi060.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:36:42.255 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.046) 0:01:56.412 ****** 2020-10-31T22:36:42.301 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.046) 0:01:56.459 ****** 2020-10-31T22:36:42.310 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-10-31T22:36:42.315 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:36:42.349 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.047) 0:01:56.507 ****** 2020-10-31T22:36:42.381 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.032) 0:01:56.539 ****** 2020-10-31T22:36:42.425 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.043) 0:01:56.583 ****** 2020-10-31T22:36:42.434 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-10-31T22:36:42.436 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop collectl] ************************************************ skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:42.482 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.056) 0:01:56.639 ****** 2020-10-31T22:36:42.521 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.039) 0:01:56.679 ****** 2020-10-31T22:36:42.559 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.038) 0:01:56.717 ****** 2020-10-31T22:36:42.567 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:42.569 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Stop collectl] ************************************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:42.607 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.048) 0:01:56.765 ****** 2020-10-31T22:36:42.644 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.036) 0:01:56.802 ****** 2020-10-31T22:36:42.680 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.035) 0:01:56.837 ****** 2020-10-31T22:36:42.687 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-10-31T22:36:42.689 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:42.726 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.045) 0:01:56.883 ****** 2020-10-31T22:36:42.759 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.033) 0:01:56.917 ****** 2020-10-31T22:36:42.793 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.033) 0:01:56.951 ****** 2020-10-31T22:36:42.800 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:42.802 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:42.838 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.044) 0:01:56.996 ****** 2020-10-31T22:36:42.872 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.033) 0:01:57.029 ****** 2020-10-31T22:36:42.906 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.033) 0:01:57.063 ****** 2020-10-31T22:36:42.912 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-10-31T22:36:42.916 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : set_fact] ***************************************************** ok: [smithi060.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:42.954 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.048) 0:01:57.112 ****** 2020-10-31T22:36:42.994 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:42 +0000 (0:00:00.037) 0:01:57.150 ****** 2020-10-31T22:36:43.042 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.049) 0:01:57.199 ****** 2020-10-31T22:36:43.052 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi060.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.068 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.070 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi060.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} TASK [testnode : Check for NVMe drive] ***************************************** 2020-10-31T22:36:43.071 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.072 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.112 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.070) 0:01:57.269 ****** 2020-10-31T22:36:43.152 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.039) 0:01:57.309 ****** 2020-10-31T22:36:43.189 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.037) 0:01:57.346 ****** 2020-10-31T22:36:43.197 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-10-31T22:36:43.199 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi060.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.200 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.200 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.201 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.201 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.204 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.204 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.205 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "it 2020-10-31T22:36:43.206 INFO:teuthology.task.ansible.out:em", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.248 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.059) 0:01:57.406 ****** 2020-10-31T22:36:43.257 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.259 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi066.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi066.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi066.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.259 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.261 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.314 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.065) 0:01:57.472 ****** 2020-10-31T22:36:43.322 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.324 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.370 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.055) 0:01:57.527 ****** 2020-10-31T22:36:43.380 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.430 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.058) 0:01:57.586 ****** 2020-10-31T22:36:43.482 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-10-31T22:36:43.484 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.010406", "end": "2020-10-31 22:36:43.449311", "rc": 0, "start": "2020-10-31 22:36:43.438905", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-10-31T22:36:43.530 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.101) 0:01:57.687 ****** 2020-10-31T22:36:43.537 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-10-31T22:36:43.539 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-10-31T22:36:43.577 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.047) 0:01:57.735 ****** 2020-10-31T22:36:43.586 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove /etc/ceph] ********************************************* 2020-10-31T22:36:43.592 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2020-10-31T22:36:43.634 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.057) 0:01:57.792 ****** 2020-10-31T22:36:43.686 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.051) 0:01:57.844 ****** 2020-10-31T22:36:43.695 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-10-31T22:36:43.697 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi066.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003611", "end": "2020-10-31 22:36:43.577746", "rc": 0, "start": "2020-10-31 22:36:43.574135", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-10-31T22:36:43.697 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.742 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.056) 0:01:57.900 ****** 2020-10-31T22:36:43.798 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.055) 0:01:57.955 ****** 2020-10-31T22:36:43.848 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.050) 0:01:58.006 ****** 2020-10-31T22:36:43.856 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-10-31T22:36:43.858 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:43.915 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.066) 0:01:58.072 ****** 2020-10-31T22:36:43.985 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:43 +0000 (0:00:00.070) 0:01:58.143 ****** 2020-10-31T22:36:44.031 INFO:teuthology.task.ansible.out: 2020-10-31T22:36:44.033 INFO:teuthology.task.ansible.out:TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2020-10-31T22:36:44.086 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:44 +0000 (0:00:00.097) 0:01:58.241 ****** 2020-10-31T22:36:44.131 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:44 +0000 (0:00:00.047) 0:01:58.288 ****** 2020-10-31T22:36:44.138 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-10-31T22:36:44.140 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:44.177 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:44 +0000 (0:00:00.046) 0:01:58.335 ****** 2020-10-31T22:36:44.187 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-10-31T22:36:44.189 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:44.233 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:44 +0000 (0:00:00.055) 0:01:58.391 ****** 2020-10-31T22:36:44.243 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-10-31T22:36:44.246 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-10-31T22:36:44.286 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:44 +0000 (0:00:00.052) 0:01:58.443 ****** 2020-10-31T22:36:44.595 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2020-10-31T22:36:44.636 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:44 +0000 (0:00:00.350) 0:01:58.793 ****** 2020-10-31T22:36:44.648 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-10-31T22:36:44.650 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-10-31T22:36:44.705 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:44 +0000 (0:00:00.065) 0:01:58.859 ****** 2020-10-31T22:36:44.887 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi060.front.sepia.ceph.com] => {"cache_update_time": 1604183664, "cache_updated": false, "changed": false} 2020-10-31T22:36:44.927 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:44 +0000 (0:00:00.226) 0:01:59.085 ****** 2020-10-31T22:36:44.967 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-10-31T22:36:44.969 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:45.014 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.086) 0:01:59.172 ****** 2020-10-31T22:36:45.022 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-10-31T22:36:45.024 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2020-10-31T22:36:45.061 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.046) 0:01:59.218 ****** 2020-10-31T22:36:45.068 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-10-31T22:36:45.069 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item={'block_used': 13640025, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'size_total': 983426940928, 'block_total': 240094468, 'mount': '/', 'block_available': 226454443, 'size_available': 927557398528, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113895, 'block_size': 4096, 'inode_available': 60941081}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226454443, "block_size": 4096, "block_total": 240094468, "block_used": 13640025, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941081, "inode_total": 61054976, "inode_used": 113895, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927557398528, "size_total": 983426940928, "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}} 2020-10-31T22:36:45.070 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-10-31T22:36:45.070 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-10-31T22:36:45.106 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.045) 0:01:59.264 ****** 2020-10-31T22:36:45.140 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.033) 0:01:59.297 ****** 2020-10-31T22:36:45.149 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-10-31T22:36:45.151 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"cache_update_time": 1604183668, "cache_updated": false, "changed": false} 2020-10-31T22:36:45.191 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.051) 0:01:59.349 ****** 2020-10-31T22:36:45.233 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-10-31T22:36:45.235 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:45.272 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.080) 0:01:59.430 ****** 2020-10-31T22:36:45.284 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-10-31T22:36:45.286 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009894", "end": "2020-10-31 22:36:45.224196", "rc": 0, "start": "2020-10-31 22:36:45.214302", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-10-31T22:36:45.286 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:36:45.331 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.059) 0:01:59.489 ****** 2020-10-31T22:36:45.365 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.033) 0:01:59.523 ****** 2020-10-31T22:36:45.375 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-10-31T22:36:45.378 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'block_used': 13640018, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'size_total': 983426940928, 'block_total': 240094468, 'mount': '/', 'block_available': 226454450, 'size_available': 927557427200, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113896, 'block_size': 4096, 'inode_available': 60941080}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226454450, "block_size": 4096, "block_total": 240094468, "block_used": 13640018, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941080, "inode_total": 61054976, "inode_used": 113896, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927557427200, "size_total": 983426940928, "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}} TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi060.front.sepia.ceph.com] => (item={'block_used': 13640025, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'size_total': 983426940928, 'block_total': 240094468, 'mount': '/', 'block_available': 226454443, 'size_available': 927557398528, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113895, 'block_size': 4096, 'inode_available': 60941081}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226454443, "block_size": 4096, "block_total": 240094468, "block_used": 13640025, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941081, "inode_total": 61054976, "inode_used": 113895, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927557398528, "size_total": 983426940928, "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:45.415 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.050) 0:01:59.573 ****** 2020-10-31T22:36:45.424 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:45.426 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2020-10-31T22:36:45.464 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.045) 0:01:59.618 ****** 2020-10-31T22:36:45.496 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.035) 0:01:59.654 ****** 2020-10-31T22:36:45.538 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.041) 0:01:59.696 ****** 2020-10-31T22:36:45.548 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** TASK [testnode : Stop collectl] ************************************************ skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:45.594 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.055) 0:01:59.752 ****** 2020-10-31T22:36:45.642 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.044) 0:01:59.796 ****** 2020-10-31T22:36:45.658 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.007352", "end": "2020-10-31 22:36:45.065145", "rc": 0, "start": "2020-10-31 22:36:45.057793", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:45.700 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.061) 0:01:59.858 ****** 2020-10-31T22:36:45.709 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-10-31T22:36:45.710 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:45.712 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** ok: [smithi152.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:36:45.751 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.050) 0:01:59.908 ****** 2020-10-31T22:36:45.789 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.038) 0:01:59.947 ****** 2020-10-31T22:36:45.797 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-10-31T22:36:45.799 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'block_used': 13640018, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'size_total': 983426940928, 'block_total': 240094468, 'mount': '/', 'block_available': 226454450, 'size_available': 927557427200, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113896, 'block_size': 4096, 'inode_available': 60941080}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226454450, "block_size": 4096, "block_total": 240094468, "block_used": 13640018, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941080, "inode_total": 61054976, "inode_used": 113896, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927557427200, "size_total": 983426940928, "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:45.801 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:45.838 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.049) 0:01:59.996 ****** 2020-10-31T22:36:45.876 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.037) 0:02:00.034 ****** 2020-10-31T22:36:45.887 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-10-31T22:36:45.923 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.047) 0:02:00.081 ****** 2020-10-31T22:36:45.959 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:45 +0000 (0:00:00.032) 0:02:00.114 ****** 2020-10-31T22:36:45.964 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-10-31T22:36:45.966 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.010 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:46 +0000 (0:00:00.053) 0:02:00.168 ****** 2020-10-31T22:36:46.018 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-10-31T22:36:46.019 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.021 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.062 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:46 +0000 (0:00:00.051) 0:02:00.220 ****** 2020-10-31T22:36:46.069 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-31T22:36:46.071 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-10-31T22:36:46.109 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:46 +0000 (0:00:00.046) 0:02:00.267 ****** 2020-10-31T22:36:46.120 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.179 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:46 +0000 (0:00:00.069) 0:02:00.336 ****** 2020-10-31T22:36:46.191 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi085.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.202 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.225 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.267 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:46 +0000 (0:00:00.085) 0:02:00.421 ****** 2020-10-31T22:36:46.286 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi085.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.288 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} ok: [smithi085.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi085.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.289 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.289 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.290 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.290 INFO:teuthology.task.ansible.out: 2020-10-31T22:36:46.293 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.307 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-10-31T22:36:46.308 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.368 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:46 +0000 (0:00:00.104) 0:02:00.526 ****** 2020-10-31T22:36:46.429 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:46 +0000 (0:00:00.059) 0:02:00.585 ****** 2020-10-31T22:36:46.467 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-10-31T22:36:46.526 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:46 +0000 (0:00:00.099) 0:02:00.684 ****** 2020-10-31T22:36:46.581 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi152.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.591 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.615 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.642 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi085.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004471", "end": "2020-10-31 22:36:46.605843", "rc": 0, "start": "2020-10-31 22:36:46.601372", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi152.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.682 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:46 +0000 (0:00:00.155) 0:02:00.840 ****** 2020-10-31T22:36:46.693 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-10-31T22:36:46.694 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.695 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.696 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.697 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.709 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.711 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.722 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.725 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.771 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:46 +0000 (0:00:00.088) 0:02:00.929 ****** 2020-10-31T22:36:46.815 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:46 +0000 (0:00:00.044) 0:02:00.973 ****** 2020-10-31T22:36:46.822 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-10-31T22:36:46.824 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.858 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:46 +0000 (0:00:00.042) 0:02:01.016 ****** 2020-10-31T22:36:46.886 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-10-31T22:36:46.888 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:46.925 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:46 +0000 (0:00:00.066) 0:02:01.082 ****** 2020-10-31T22:36:47.033 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-10-31T22:36:47.035 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003456", "end": "2020-10-31 22:36:47.007374", "rc": 0, "start": "2020-10-31 22:36:47.003918", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-10-31T22:36:47.090 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:47 +0000 (0:00:00.165) 0:02:01.248 ****** 2020-10-31T22:36:47.119 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:47.162 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:47 +0000 (0:00:00.070) 0:02:01.319 ****** 2020-10-31T22:36:47.201 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-10-31T22:36:47.204 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:47.244 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:47 +0000 (0:00:00.083) 0:02:01.402 ****** 2020-10-31T22:36:47.282 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-10-31T22:36:47.284 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:47.325 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:47 +0000 (0:00:00.080) 0:02:01.483 ****** 2020-10-31T22:36:47.807 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* ok: [smithi085.front.sepia.ceph.com] => {"cache_update_time": 1604183678, "cache_updated": false, "changed": false} 2020-10-31T22:36:47.845 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:47 +0000 (0:00:00.516) 0:02:02.000 ****** 2020-10-31T22:36:47.873 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:47.911 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:47 +0000 (0:00:00.068) 0:02:02.068 ****** 2020-10-31T22:36:47.965 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-10-31T22:36:47.967 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item={'block_used': 13640018, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'size_total': 983426940928, 'block_total': 240094468, 'mount': '/', 'block_available': 226454450, 'size_available': 927557427200, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113896, 'block_size': 4096, 'inode_available': 60941080}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226454450, "block_size": 4096, "block_total": 240094468, "block_used": 13640018, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941080, "inode_total": 61054976, "inode_used": 113896, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927557427200, "size_total": 983426940928, "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}} 2020-10-31T22:36:48.017 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:48 +0000 (0:00:00.106) 0:02:02.174 ****** 2020-10-31T22:36:48.028 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-10-31T22:36:48.030 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LpoD3sthzzzp0JfFIFXPFpH70qpibQsgYO4'], 'uuids': ['be930502-ea7d-45e5-acc8-558715cf46ea']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:02.206679", "end": "2020-10-31 22:36:47.971701", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LpoD3sthzzzp0JfFIFXPFpH70qpibQsgYO4"], "labels": [], "masters": [], "uuids": ["be930502-ea7d-45e5-acc8-558715cf46ea"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:45.765022", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:48.032 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:48.043 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:48.067 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCjcAr3F2zeXUV1aDHxplsJrI8Uzo2LWta'], 'uuids': ['81f0b979-e7b4-49c3-b03d-8b1cf56cc00d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.958997", "end": "2020-10-31 22:36:47.565897", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCjcAr3F2zeXUV1aDHxplsJrI8Uzo2LWta"], "labels": [], "masters": [], "uuids": ["81f0b979-e7b4-49c3-b03d-8b1cf56cc00d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:45.606900", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:48.079 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:48.081 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:48.150 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi085.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009835", "end": "2020-10-31 22:36:47.848281", "rc": 0, "start": "2020-10-31 22:36:47.838446", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:48.184 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:48 +0000 (0:00:00.167) 0:02:02.342 ****** 2020-10-31T22:36:48.224 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-10-31T22:36:48.226 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"cache_update_time": 1604183673, "cache_updated": false, "changed": false} 2020-10-31T22:36:48.271 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:48 +0000 (0:00:00.085) 0:02:02.428 ****** 2020-10-31T22:36:48.287 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-10-31T22:36:48.289 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'block_used': 13640018, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'size_total': 983426940928, 'block_total': 240094468, 'mount': '/', 'block_available': 226454450, 'size_available': 927557427200, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113896, 'block_size': 4096, 'inode_available': 60941080}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226454450, "block_size": 4096, "block_total": 240094468, "block_used": 13640018, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941080, "inode_total": 61054976, "inode_used": 113896, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927557427200, "size_total": 983426940928, "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:48.337 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:48 +0000 (0:00:00.066) 0:02:02.494 ****** 2020-10-31T22:36:48.348 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-10-31T22:36:48.350 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:48.399 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:48 +0000 (0:00:00.062) 0:02:02.557 ****** 2020-10-31T22:36:48.410 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-10-31T22:36:48.457 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:48 +0000 (0:00:00.057) 0:02:02.615 ****** 2020-10-31T22:36:48.476 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-10-31T22:36:48.478 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item={'block_used': 13640017, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'size_total': 983426940928, 'block_total': 240094468, 'mount': '/', 'block_available': 226454451, 'size_available': 927557431296, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113896, 'block_size': 4096, 'inode_available': 60941080}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226454451, "block_size": 4096, "block_total": 240094468, "block_used": 13640017, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941080, "inode_total": 61054976, "inode_used": 113896, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927557431296, "size_total": 983426940928, "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}} 2020-10-31T22:36:48.516 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:48 +0000 (0:00:00.059) 0:02:02.674 ****** 2020-10-31T22:36:48.687 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009921", "end": "2020-10-31 22:36:48.555865", "rc": 0, "start": "2020-10-31 22:36:48.545944", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:48.730 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:48 +0000 (0:00:00.213) 0:02:02.888 ****** 2020-10-31T22:36:48.742 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-10-31T22:36:48.744 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:48.942 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-10-31T22:36:48.947 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'block_used': 13640017, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'size_total': 983426940928, 'block_total': 240094468, 'mount': '/', 'block_available': 226454451, 'size_available': 927557431296, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113896, 'block_size': 4096, 'inode_available': 60941080}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226454451, "block_size": 4096, "block_total": 240094468, "block_used": 13640017, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941080, "inode_total": 61054976, "inode_used": 113896, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927557431296, "size_total": 983426940928, "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:48.991 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:48 +0000 (0:00:00.260) 0:02:03.148 ****** 2020-10-31T22:36:49.161 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-10-31T22:36:49.202 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:49 +0000 (0:00:00.206) 0:02:03.355 ****** 2020-10-31T22:36:49.257 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-10-31T22:36:49.260 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:49.308 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LponrosLVd4u91BbdbXKA8yRflMefA9uKR4'], 'uuids': ['5b58fbb5-2d2e-41de-a5b0-b5ef3d8b2df3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.136149", "end": "2020-10-31 22:36:49.262139", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LponrosLVd4u91BbdbXKA8yRflMefA9uKR4"], "labels": [], "masters": [], "uuids": ["5b58fbb5-2d2e-41de-a5b0-b5ef3d8b2df3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:48.125990", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:49.310 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4H4ED', 'wwn-0x5000c500871b1a82'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4H4ED-part1', 'wwn-0x5000c500871b1a82-part1'], 'uuids': ['7bdd21ce-9d44-4fc8-85f8-fb3648839738']}, 'sectors': '1953517568', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871b1a82', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4H4ED', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H4ED", "wwn-0x5000c500871b1a82"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H4ED-part1", "wwn-0x5000c500871b1a82-part1"], "labels": [], "masters": [], "uuids": ["7bdd21ce-9d44-4fc8-85f8-fb3648839738"]}, "sectors": "1953517568", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4H4ED", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b1a82"}}, "skip_reason": 2020-10-31T22:36:49.312 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-10-31T22:36:49.314 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCkinILpzGwAz8X4Mh2Isw1f2jk3QRWhjy'], 'uuids': ['b6ab8c4b-8a7b-44ac-9515-8799b6026c49']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.100094", "end": "2020-10-31 22:36:48.818413", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCkinILpzGwAz8X4Mh2Isw1f2jk3QRWhjy"], "labels": [], "masters": [], "uuids": ["b6ab8c4b-8a7b-44ac-9515-8799b6026c49"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:47.718319", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:49.326 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W2RJ', 'wwn-0x5000c50087b90a26'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W2RJ-part1', 'wwn-0x5000c50087b90a26-part1'], 'uuids': ['7bdd21ce-9d44-4fc8-85f8-fb3648839738']}, 'sectors': '1953517568', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50087b90a26', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4W2RJ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2RJ", "wwn-0x5000c50087b90a26"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2RJ-part1", "wwn-0x5000c50087b90a26-part1"], "labels": [], "masters": [], "uuids": ["7bdd21ce-9d44-4fc8-85f8-fb3648839738"]}, "sectors": "1953517568", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W2RJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b90a26"}}, "skip_reason": 2020-10-31T22:36:49.328 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-10-31T22:36:50.569 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-edsWBB-fPkY-wGoF-i3T9-ayTd-TSdA-qXPXQw', 'nvme-INTEL_SSDPED1D480GA_PHMB7476008A480DGN', 'nvme-nvme.8086-50484d42373437363030384134383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.135891", "end": "2020-10-31 22:36:50.542136", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-edsWBB-fPkY-wGoF-i3T9-ayTd-TSdA-qXPXQw", "nvme-INTEL_SSDPED1D480GA_PHMB7476008A480DGN", "nvme-nvme.8086-50484d42373437363030384134383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:49.406245", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now pa 2020-10-31T22:36:50.572 INFO:teuthology.task.ansible.out:rtition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:50.582 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:50.584 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-HHrTcO-mDWa-eBXv-nQpf-qsu2-5EcP-N9Ybii', 'nvme-INTEL_SSDPEDMD400G4_CVFT53430091400BGN', 'nvme-nvme.8086-43564654353334333030393134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.135264", "end": "2020-10-31 22:36:50.097569", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-HHrTcO-mDWa-eBXv-nQpf-qsu2-5EcP-N9Ybii", "nvme-INTEL_SSDPEDMD400G4_CVFT53430091400BGN", "nvme-nvme.8086-43564654353334333030393134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:48.962305", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-10-31T22:36:50.585 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:50.608 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:50.621 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:50.808 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljknymi17Dhg6AOkWRkGOQZlAMFFdGpg0Bn'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.988300", "end": "2020-10-31 22:36:50.497301", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljknymi17Dhg6AOkWRkGOQZlAMFFdGpg0Bn"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:48.509001", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:50.831 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:50.843 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:50.844 INFO:teuthology.task.ansible.out: 2020-10-31T22:36:51.126 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfzCnAtcYdY2e2aLewHZHYhZNjUqRrIGcm'], 'uuids': ['bb7619b3-c86c-44ca-857e-08465ce2fe67']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.718261", "end": "2020-10-31 22:36:50.981511", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfzCnAtcYdY2e2aLewHZHYhZNjUqRrIGcm"], "labels": [], "masters": [], "uuids": ["bb7619b3-c86c-44ca-857e-08465ce2fe67"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:49.263250", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:51.135 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:51.158 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:51.848 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LpoUya9CwF2DKevS2dIGVPXig4p6boQOlM6'], 'uuids': ['54925ab9-694c-484b-b75a-bc275148f604']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.130961", "end": "2020-10-31 22:36:51.814011", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LpoUya9CwF2DKevS2dIGVPXig4p6boQOlM6"], "labels": [], "masters": [], "uuids": ["54925ab9-694c-484b-b75a-bc275148f604"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:50.683050", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:51.861 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:51.883 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:51.902 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCFiA33ejFr1yDiiZPlyXJTyrzJreH91K0'], 'uuids': ['9e57edc2-805d-4bdb-96ea-ea5ca650b659']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.146091", "end": "2020-10-31 22:36:51.403549", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCFiA33ejFr1yDiiZPlyXJTyrzJreH91K0"], "labels": [], "masters": [], "uuids": ["9e57edc2-805d-4bdb-96ea-ea5ca650b659"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:50.257458", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:51.915 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:52.116 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljkLOKHOK5D2Gg12p4WRC3weFU3tvsGUg3p'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.147042", "end": "2020-10-31 22:36:51.803470", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljkLOKHOK5D2Gg12p4WRC3weFU3tvsGUg3p"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:50.656428", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:52.128 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QA6H', 'wwn-0x5000c50091e09aef'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QA6H-part1', 'wwn-0x5000c50091e09aef-part1'], 'uuids': ['7bdd21ce-9d44-4fc8-85f8-fb3648839738']}, 'sectors': '1953517568', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e09aef', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QA6H', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QA6H", "wwn-0x5000c50091e09aef"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QA6H-part1", "wwn-0x5000c50091e09aef-part1"], "labels": [], "masters": [], "uuids": ["7bdd21ce-9d44-4fc8-85f8-fb3648839738"]}, "sectors": "1953517568", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QA6H", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e09aef"}}, "skip_reason": 2020-10-31T22:36:52.130 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-10-31T22:36:52.394 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfdKNTjwn2IdCf6QU4dQtes3YEfZ63eVew'], 'uuids': ['8b160d0e-5e20-43d5-8090-71f7c4e6a4b8']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.106616", "end": "2020-10-31 22:36:52.255835", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfdKNTjwn2IdCf6QU4dQtes3YEfZ63eVew"], "labels": [], "masters": [], "uuids": ["8b160d0e-5e20-43d5-8090-71f7c4e6a4b8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:51.149219", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:52.408 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XEKT', 'wwn-0x5000c50092928022'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XEKT-part1', 'wwn-0x5000c50092928022-part1'], 'uuids': ['7bdd21ce-9d44-4fc8-85f8-fb3648839738']}, 'sectors': '1953517568', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092928022', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XEKT', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XEKT", "wwn-0x5000c50092928022"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XEKT-part1", "wwn-0x5000c50092928022-part1"], "labels": [], "masters": [], "uuids": ["7bdd21ce-9d44-4fc8-85f8-fb3648839738"]}, "sectors": "1953517568", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XEKT", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092928022"}}, "skip_reason": 2020-10-31T22:36:52.410 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-10-31T22:36:53.141 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5Lpo06EbYksLGlQCu24CZ9XEMJqipvffJrhF'], 'uuids': ['079b2f49-9c5b-471f-a83c-94c2d892b40d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.115861", "end": "2020-10-31 22:36:53.105974", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5Lpo06EbYksLGlQCu24CZ9XEMJqipvffJrhF"], "labels": [], "masters": [], "uuids": ["079b2f49-9c5b-471f-a83c-94c2d892b40d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:51.990113", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:53.143 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:53.155 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuC4un9vMnCZ8i1ksIcfc6kV77XCLVsW3ui'], 'uuids': ['3ba30ae7-f691-4aff-b494-9753e71b4540']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.101681", "end": "2020-10-31 22:36:52.669363", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuC4un9vMnCZ8i1ksIcfc6kV77XCLVsW3ui"], "labels": [], "masters": [], "uuids": ["3ba30ae7-f691-4aff-b494-9753e71b4540"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:51.567682", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:53.169 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:53.411 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-0dExdk-AXSU-dzLm-f7wy-DXwL-gtBS-jXw4Q8', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400X7400BGN', 'nvme-nvme.8086-50484654363230343030583734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.167752", "end": "2020-10-31 22:36:53.104719", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-0dExdk-AXSU-dzLm-f7wy-DXwL-gtBS-jXw4Q8", "nvme-INTEL_SSDPEDMD400G4_PHFT620400X7400BGN", "nvme-nvme.8086-50484654363230343030583734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:51.936967", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-10-31T22:36:53.413 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:53.427 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:53.435 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:53.715 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-Ucci72-OZig-8Zfs-oqfy-8Xhc-h2kJ-pP26mX', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300JT400BGN', 'nvme-nvme.8086-435646543632333330304a5434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.179347", "end": "2020-10-31 22:36:53.573249", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Ucci72-OZig-8Zfs-oqfy-8Xhc-h2kJ-pP26mX", "nvme-INTEL_SSDPEDMD400G4_CVFT623300JT400BGN", "nvme-nvme.8086-435646543632333330304a5434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:52.393902", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-10-31T22:36:53.719 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:53.727 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:53.741 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:54.382 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LpoAAmEM5gJW9GgcMhKZoruFb3wy3jYsXIY'], 'uuids': ['5d7900df-e7a8-4ce3-bd3e-6b5bfb926bf6']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.111582", "end": "2020-10-31 22:36:54.355731", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LpoAAmEM5gJW9GgcMhKZoruFb3wy3jYsXIY"], "labels": [], "masters": [], "uuids": ["5d7900df-e7a8-4ce3-bd3e-6b5bfb926bf6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:53.244149", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:54.440 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:54 +0000 (0:00:05.242) 0:02:08.597 ****** 2020-10-31T22:36:54.453 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCLPKe4YfN0KUWKbtcIGbYQfc3nRENMpAd'], 'uuids': ['9d66e9ca-878c-4f27-8038-4d1a2bebaa1c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.112558", "end": "2020-10-31 22:36:53.928051", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCLPKe4YfN0KUWKbtcIGbYQfc3nRENMpAd"], "labels": [], "masters": [], "uuids": ["9d66e9ca-878c-4f27-8038-4d1a2bebaa1c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:52.815493", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:54.516 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:54 +0000 (0:00:00.076) 0:02:08.674 ****** 2020-10-31T22:36:54.527 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-10-31T22:36:54.529 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:54.567 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:54.678 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljknrbqubJDoAvdiXJx7sgY1XdB46GPw9He'], 'uuids': ['ad997d24-51eb-4de4-b222-c12da8a7ddec']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.120423", "end": "2020-10-31 22:36:54.369266", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljknrbqubJDoAvdiXJx7sgY1XdB46GPw9He"], "labels": [], "masters": [], "uuids": ["ad997d24-51eb-4de4-b222-c12da8a7ddec"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:53.248843", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk usi 2020-10-31T22:36:54.679 INFO:teuthology.task.ansible.out:ng fdisk or", "other utilities."]} 2020-10-31T22:36:54.689 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:54.701 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:54.735 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-10-31T22:36:54.737 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LpoD3sthzzzp0JfFIFXPFpH70qpibQsgYO4'], 'uuids': ['be930502-ea7d-45e5-acc8-558715cf46ea']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.113247", "end": "2020-10-31 22:36:54.707383", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LpoD3sthzzzp0JfFIFXPFpH70qpibQsgYO4"], "labels": [], "masters": [], "uuids": ["be930502-ea7d-45e5-acc8-558715cf46ea"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:54.594136", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.108339 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.108339 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:54.749 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:54.761 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:54.870 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCjcAr3F2zeXUV1aDHxplsJrI8Uzo2LWta'], 'uuids': ['81f0b979-e7b4-49c3-b03d-8b1cf56cc00d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.171687", "end": "2020-10-31 22:36:54.381973", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCjcAr3F2zeXUV1aDHxplsJrI8Uzo2LWta"], "labels": [], "masters": [], "uuids": ["81f0b979-e7b4-49c3-b03d-8b1cf56cc00d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:54.210286", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.168542 s, 684 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.168542 s, 684 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:54.882 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:54.893 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:54.992 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LponrosLVd4u91BbdbXKA8yRflMefA9uKR4'], 'uuids': ['5b58fbb5-2d2e-41de-a5b0-b5ef3d8b2df3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.108374", "end": "2020-10-31 22:36:54.963194", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LponrosLVd4u91BbdbXKA8yRflMefA9uKR4"], "labels": [], "masters": [], "uuids": ["5b58fbb5-2d2e-41de-a5b0-b5ef3d8b2df3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:54.854820", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.103796 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.103796 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:55.005 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4H4ED', 'wwn-0x5000c500871b1a82'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4H4ED-part1', 'wwn-0x5000c500871b1a82-part1'], 'uuids': ['7bdd21ce-9d44-4fc8-85f8-fb3648839738']}, 'sectors': '1953517568', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500871b1a82', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4H4ED', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H4ED", "wwn-0x5000c500871b1a82"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4H4ED-part1", "wwn-0x5000c500871b1a82-part1"], "labels": [], "masters": [], "uuids": ["7bdd21ce-9d44-4fc8-85f8-fb3648839738"]}, "sectors": "1953517568", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4H4ED", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500871b1a82"}}, "skip_reason": 2020-10-31T22:36:55.007 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-10-31T22:36:55.038 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-10-31T22:36:55.041 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfzpWZYY708bxUGtIK9ii0Q7dWknJaUFoR'], 'uuids': ['27ae8dfc-60b3-479a-8113-5db329c4cceb']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.178147", "end": "2020-10-31 22:36:54.897984", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfzpWZYY708bxUGtIK9ii0Q7dWknJaUFoR"], "labels": [], "masters": [], "uuids": ["27ae8dfc-60b3-479a-8113-5db329c4cceb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:53.719837", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:55.053 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:55.075 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:55.173 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCkinILpzGwAz8X4Mh2Isw1f2jk3QRWhjy'], 'uuids': ['b6ab8c4b-8a7b-44ac-9515-8799b6026c49']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.155501", "end": "2020-10-31 22:36:54.677234", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCkinILpzGwAz8X4Mh2Isw1f2jk3QRWhjy"], "labels": [], "masters": [], "uuids": ["b6ab8c4b-8a7b-44ac-9515-8799b6026c49"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:54.521733", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.150972 s, 764 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.150972 s, 764 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:55.186 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W2RJ', 'wwn-0x5000c50087b90a26'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W2RJ-part1', 'wwn-0x5000c50087b90a26-part1'], 'uuids': ['7bdd21ce-9d44-4fc8-85f8-fb3648839738']}, 'sectors': '1953517568', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50087b90a26', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4W2RJ', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2RJ", "wwn-0x5000c50087b90a26"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2RJ-part1", "wwn-0x5000c50087b90a26-part1"], "labels": [], "masters": [], "uuids": ["7bdd21ce-9d44-4fc8-85f8-fb3648839738"]}, "sectors": "1953517568", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W2RJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b90a26"}}, "skip_reason": 2020-10-31T22:36:55.188 INFO:teuthology.task.ansible.out:"Conditional result was False"} changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '937703088', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-edsWBB-fPkY-wGoF-i3T9-ayTd-TSdA-qXPXQw', 'nvme-INTEL_SSDPED1D480GA_PHMB7476008A480DGN', 'nvme-nvme.8086-50484d42373437363030384134383044474e-494e54454c2053534450454431443438304741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPED1D480GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '447.13 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.049797", "end": "2020-10-31 22:36:55.150370", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-edsWBB-fPkY-wGoF-i3T9-ayTd-TSdA-qXPXQw", "nvme-INTEL_SSDPED1D480GA_PHMB7476008A480DGN", "nvme-nvme.8086-50484d42373437363030384134383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:55.100573", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.045059 2020-10-31T22:36:55.190 INFO:teuthology.task.ansible.out:s, 2.6 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.045059 s, 2.6 GB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:55.199 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:55.202 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:55.373 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-HHrTcO-mDWa-eBXv-nQpf-qsu2-5EcP-N9Ybii', 'nvme-INTEL_SSDPEDMD400G4_CVFT53430091400BGN', 'nvme-nvme.8086-43564654353334333030393134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.051409", "end": "2020-10-31 22:36:54.877530", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-HHrTcO-mDWa-eBXv-nQpf-qsu2-5EcP-N9Ybii", "nvme-INTEL_SSDPEDMD400G4_CVFT53430091400BGN", "nvme-nvme.8086-43564654353334333030393134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:54.826121", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0468902 s, 2.5 GB/s", "std 2020-10-31T22:36:55.375 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0468902 s, 2.5 GB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:55.385 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:55.387 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:55.419 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LpoUya9CwF2DKevS2dIGVPXig4p6boQOlM6'], 'uuids': ['54925ab9-694c-484b-b75a-bc275148f604']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.104230", "end": "2020-10-31 22:36:55.396236", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LpoUya9CwF2DKevS2dIGVPXig4p6boQOlM6"], "labels": [], "masters": [], "uuids": ["54925ab9-694c-484b-b75a-bc275148f604"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:55.292006", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0999644 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0999644 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:55.431 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:55.443 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:55.663 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCFiA33ejFr1yDiiZPlyXJTyrzJreH91K0'], 'uuids': ['9e57edc2-805d-4bdb-96ea-ea5ca650b659']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.152381", "end": "2020-10-31 22:36:55.172637", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCFiA33ejFr1yDiiZPlyXJTyrzJreH91K0"], "labels": [], "masters": [], "uuids": ["9e57edc2-805d-4bdb-96ea-ea5ca650b659"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:55.020256", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.149291 s, 773 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.149291 s, 773 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:55.681 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5Lpo06EbYksLGlQCu24CZ9XEMJqipvffJrhF'], 'uuids': ['079b2f49-9c5b-471f-a83c-94c2d892b40d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.109157", "end": "2020-10-31 22:36:55.641387", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5Lpo06EbYksLGlQCu24CZ9XEMJqipvffJrhF"], "labels": [], "masters": [], "uuids": ["079b2f49-9c5b-471f-a83c-94c2d892b40d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address" 2020-10-31T22:36:55.683 INFO:teuthology.task.ansible.out:: null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:55.532230", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.104506 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.104506 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:55.691 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:55.702 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:55.958 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LpoAAmEM5gJW9GgcMhKZoruFb3wy3jYsXIY'], 'uuids': ['5d7900df-e7a8-4ce3-bd3e-6b5bfb926bf6']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.112490", "end": "2020-10-31 22:36:55.917715", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-rI4mJS5m0QvbupUGwwbfF5Vr5mnW5LpoAAmEM5gJW9GgcMhKZoruFb3wy3jYsXIY"], "labels": [], "masters": [], "uuids": ["5d7900df-e7a8-4ce3-bd3e-6b5bfb926bf6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:55.805225", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.107823 s, 1.1 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.107823 s, 1.1 GB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:56.007 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:56 +0000 (0:00:01.490) 0:02:10.165 ****** 2020-10-31T22:36:56.023 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuC4un9vMnCZ8i1ksIcfc6kV77XCLVsW3ui'], 'uuids': ['3ba30ae7-f691-4aff-b494-9753e71b4540']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.156054", "end": "2020-10-31 22:36:55.486420", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuC4un9vMnCZ8i1ksIcfc6kV77XCLVsW3ui"], "labels": [], "masters": [], "uuids": ["3ba30ae7-f691-4aff-b494-9753e71b4540"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:55.330366", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151282 s, 762 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151282 s, 762 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:56.025 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-10-31T22:36:56.025 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljkkLop31FgDTZsT5mrcR0vTQR0ufD7mgYJ'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.145039", "end": "2020-10-31 22:36:55.674016", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljkkLop31FgDTZsT5mrcR0vTQR0ufD7mgYJ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:54.528977", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:56.026 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:56.027 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:56.264 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCLPKe4YfN0KUWKbtcIGbYQfc3nRENMpAd'], 'uuids': ['9d66e9ca-878c-4f27-8038-4d1a2bebaa1c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.152586", "end": "2020-10-31 22:36:55.777266", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-HxFrszsW9DbopB6oVrYyMtIDWWu72SuCLPKe4YfN0KUWKbtcIGbYQfc3nRENMpAd"], "labels": [], "masters": [], "uuids": ["9d66e9ca-878c-4f27-8038-4d1a2bebaa1c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:55.624680", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147876 s, 780 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147876 s, 780 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:56.315 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:56 +0000 (0:00:00.307) 0:02:10.472 ****** 2020-10-31T22:36:56.322 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-10-31T22:36:56.325 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfWchP6cMHMbpe3ZWTGYPHryUrOedjHpHj'], 'uuids': ['7274aebf-1c4b-4bec-b7be-5746e65780c1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.105066", "end": "2020-10-31 22:36:56.165988", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfWchP6cMHMbpe3ZWTGYPHryUrOedjHpHj"], "labels": [], "masters": [], "uuids": ["7274aebf-1c4b-4bec-b7be-5746e65780c1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:55.060922", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi152.front.sepia.ceph.com] => 2020-10-31T22:36:56.326 INFO:teuthology.task.ansible.out:(item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:56.337 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi060.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.166850", "end": "2020-10-31 22:36:56.290233", "rc": 0, "start": "2020-10-31 22:36:56.123383", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:56.386 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:56 +0000 (0:00:00.070) 0:02:10.543 ****** 2020-10-31T22:36:56.587 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-10-31T22:36:56.590 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.053703", "end": "2020-10-31 22:36:56.556129", "rc": 0, "start": "2020-10-31 22:36:56.502426", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:56.640 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:56 +0000 (0:00:00.253) 0:02:10.796 ****** 2020-10-31T22:36:56.647 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-10-31T22:36:56.650 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.175738", "end": "2020-10-31 22:36:56.141295", "rc": 0, "start": "2020-10-31 22:36:55.965557", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:56.699 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:56 +0000 (0:00:00.060) 0:02:10.856 ****** 2020-10-31T22:36:56.709 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-10-31T22:36:56.753 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:56 +0000 (0:00:00.053) 0:02:10.910 ****** 2020-10-31T22:36:56.785 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:56.823 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:56 +0000 (0:00:00.070) 0:02:10.981 ****** 2020-10-31T22:36:56.851 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:56.889 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:56 +0000 (0:00:00.065) 0:02:11.046 ****** 2020-10-31T22:36:56.896 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-10-31T22:36:56.898 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.037578", "end": "2020-10-31 22:36:56.398799", "rc": 0, "start": "2020-10-31 22:36:56.361221", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:56.938 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:56 +0000 (0:00:00.049) 0:02:11.095 ****** 2020-10-31T22:36:56.946 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-10-31T22:36:56.948 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:56.986 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:56 +0000 (0:00:00.047) 0:02:11.143 ****** 2020-10-31T22:36:56.996 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-10-31T22:36:57.030 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.044) 0:02:11.187 ****** 2020-10-31T22:36:57.036 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-10-31T22:36:57.038 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:57.074 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.043) 0:02:11.231 ****** 2020-10-31T22:36:57.081 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-10-31T22:36:57.083 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:57.125 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.051) 0:02:11.283 ****** 2020-10-31T22:36:57.155 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:57.190 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.064) 0:02:11.347 ****** 2020-10-31T22:36:57.220 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi060.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:57.256 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.065) 0:02:11.413 ****** 2020-10-31T22:36:57.315 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.058) 0:02:11.472 ****** 2020-10-31T22:36:57.326 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-10-31T22:36:57.327 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'block_used': 13640025, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'size_total': 983426940928, 'block_total': 240094468, 'mount': '/', 'block_available': 226454443, 'size_available': 927557398528, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113895, 'block_size': 4096, 'inode_available': 60941081}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226454443, "block_size": 4096, "block_total": 240094468, "block_used": 13640025, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941081, "inode_total": 61054976, "inode_used": 113895, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927557398528, "size_total": 983426940928, "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:57.366 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.051) 0:02:11.523 ****** 2020-10-31T22:36:57.375 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljk9ggX39ANrGyoIhLKzwx6Du9zYBztEDRe'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.207325", "end": "2020-10-31 22:36:57.019561", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljk9ggX39ANrGyoIhLKzwx6Du9zYBztEDRe"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:55.812236", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:57.387 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-10-31T22:36:57.388 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:57.424 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.058) 0:02:11.582 ****** 2020-10-31T22:36:57.466 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.041) 0:02:11.623 ****** 2020-10-31T22:36:57.478 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:57.521 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.055) 0:02:11.679 ****** 2020-10-31T22:36:57.541 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:57.558 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-10-31T22:36:57.561 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:36:57.601 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.079) 0:02:11.759 ****** 2020-10-31T22:36:57.609 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-31T22:36:57.610 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfj8SN5WPTnQfRDh1bVgQpDIQe3ffFYuIk'], 'uuids': ['3e023c0a-3278-4118-983a-a5aefc6fd3ad']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.142964", "end": "2020-10-31 22:36:57.448314", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfj8SN5WPTnQfRDh1bVgQpDIQe3ffFYuIk"], "labels": [], "masters": [], "uuids": ["3e023c0a-3278-4118-983a-a5aefc6fd3ad"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:56.305350", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot 2020-10-31T22:36:57.612 INFO:teuthology.task.ansible.out: or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-10-31T22:36:57.677 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.076) 0:02:11.835 ****** 2020-10-31T22:36:57.712 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.034) 0:02:11.869 ****** 2020-10-31T22:36:57.720 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi066.front.sepia.ceph.com] => (item={'block_used': 13640018, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'size_total': 983426940928, 'block_total': 240094468, 'mount': '/', 'block_available': 226454450, 'size_available': 927557427200, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113896, 'block_size': 4096, 'inode_available': 60941080}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226454450, "block_size": 4096, "block_total": 240094468, "block_used": 13640018, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941080, "inode_total": 61054976, "inode_used": 113896, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927557427200, "size_total": 983426940928, "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:57.722 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:57.771 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.059) 0:02:11.929 ****** 2020-10-31T22:36:57.808 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.034) 0:02:11.963 ****** 2020-10-31T22:36:57.814 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-10-31T22:36:57.816 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:57.863 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.057) 0:02:12.020 ****** 2020-10-31T22:36:57.871 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-10-31T22:36:57.873 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljknymi17Dhg6AOkWRkGOQZlAMFFdGpg0Bn'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.160945", "end": "2020-10-31 22:36:57.516874", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljknymi17Dhg6AOkWRkGOQZlAMFFdGpg0Bn"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:57.355929", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156553 s, 737 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156553 s, 737 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:57.874 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": 2020-10-31T22:36:57.875 INFO:teuthology.task.ansible.out:{"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-10-31T22:36:57.876 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:57.915 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.052) 0:02:12.073 ****** 2020-10-31T22:36:57.923 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-10-31T22:36:57.925 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:57.961 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:57 +0000 (0:00:00.044) 0:02:12.118 ****** 2020-10-31T22:36:57.971 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:58.008 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:58 +0000 (0:00:00.047) 0:02:12.166 ****** 2020-10-31T22:36:58.015 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-10-31T22:36:58.017 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:58.056 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:58 +0000 (0:00:00.047) 0:02:12.214 ****** 2020-10-31T22:36:58.065 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-10-31T22:36:58.067 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfzCnAtcYdY2e2aLewHZHYhZNjUqRrIGcm'], 'uuids': ['bb7619b3-c86c-44ca-857e-08465ce2fe67']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.157347", "end": "2020-10-31 22:36:57.910978", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfzCnAtcYdY2e2aLewHZHYhZNjUqRrIGcm"], "labels": [], "masters": [], "uuids": ["bb7619b3-c86c-44ca-857e-08465ce2fe67"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:57.753631", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15292 s, 754 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15292 s, 754 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:58.068 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': ' 2020-10-31T22:36:58.074 INFO:teuthology.task.ansible.out:0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:58.117 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:58 +0000 (0:00:00.060) 0:02:12.275 ****** 2020-10-31T22:36:58.129 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:58.133 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljkLOKHOK5D2Gg12p4WRC3weFU3tvsGUg3p'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.162212", "end": "2020-10-31 22:36:57.823060", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljkLOKHOK5D2Gg12p4WRC3weFU3tvsGUg3p"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:57.660848", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15753 s, 732 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15753 s, 732 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:58.154 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QA6H', 'wwn-0x5000c50091e09aef'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5QA6H-part1', 'wwn-0x5000c50091e09aef-part1'], 'uuids': ['7bdd21ce-9d44-4fc8-85f8-fb3648839738']}, 'sectors': '1953517568', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50091e09aef', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5QA6H', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QA6H", "wwn-0x5000c50091e09aef"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QA6H-part1", "wwn-0x5000c50091e09aef-part1"], "labels": [], "masters": [], "uuids": ["7bdd21ce-9d44-4fc8-85f8-fb3648839738"]}, "sectors": "1953517568", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QA6H", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e09aef"}}, "skip_reason": 2020-10-31T22:36:58.156 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2020-10-31T22:36:58.166 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:58.217 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:58 +0000 (0:00:00.099) 0:02:12.374 ****** 2020-10-31T22:36:58.254 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:58.310 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:58 +0000 (0:00:00.091) 0:02:12.466 ****** 2020-10-31T22:36:58.332 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-10-31T22:36:58.342 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-0dExdk-AXSU-dzLm-f7wy-DXwL-gtBS-jXw4Q8', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400X7400BGN', 'nvme-nvme.8086-50484654363230343030583734303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.049486", "end": "2020-10-31 22:36:58.013662", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-0dExdk-AXSU-dzLm-f7wy-DXwL-gtBS-jXw4Q8", "nvme-INTEL_SSDPEDMD400G4_PHFT620400X7400BGN", "nvme-nvme.8086-50484654363230343030583734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:57.964176", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0458219 s, 2.5 GB/s", "std 2020-10-31T22:36:58.350 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0458219 s, 2.5 GB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:58.410 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:58 +0000 (0:00:00.100) 0:02:12.566 ****** 2020-10-31T22:36:58.426 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfdKNTjwn2IdCf6QU4dQtes3YEfZ63eVew'], 'uuids': ['8b160d0e-5e20-43d5-8090-71f7c4e6a4b8']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.169430", "end": "2020-10-31 22:36:58.237626", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfdKNTjwn2IdCf6QU4dQtes3YEfZ63eVew"], "labels": [], "masters": [], "uuids": ["8b160d0e-5e20-43d5-8090-71f7c4e6a4b8"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address" 2020-10-31T22:36:58.434 INFO:teuthology.task.ansible.out:: null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:58.068196", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.164776 s, 700 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.164776 s, 700 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XEKT', 'wwn-0x5000c50092928022'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XEKT-part1', 'wwn-0x5000c50092928022-part1'], 'uuids': ['7bdd21ce-9d44-4fc8-85f8-fb3648839738']}, 'sectors': '1953517568', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092928022', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XEKT', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XEKT", "wwn-0x5000c50092928022"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XEKT-part1", "wwn-0x5000c50092928022-part1"], "labels": [] 2020-10-31T22:36:58.442 INFO:teuthology.task.ansible.out:, "masters": [], "uuids": ["7bdd21ce-9d44-4fc8-85f8-fb3648839738"]}, "sectors": "1953517568", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XEKT", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092928022"}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:58.607 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-Ucci72-OZig-8Zfs-oqfy-8Xhc-h2kJ-pP26mX', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300JT400BGN', 'nvme-nvme.8086-435646543632333330304a5434303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.053729", "end": "2020-10-31 22:36:58.465003", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Ucci72-OZig-8Zfs-oqfy-8Xhc-h2kJ-pP26mX", "nvme-INTEL_SSDPEDMD400G4_CVFT623300JT400BGN", "nvme-nvme.8086-435646543632333330304a5434303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:58.411274", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.049515 s, 2.3 GB/s", "stde 2020-10-31T22:36:58.609 INFO:teuthology.task.ansible.out:rr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.049515 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Create volume group(s)] *************************************** changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-10-31T22:36:58.654 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:58 +0000 (0:00:00.239) 0:02:12.806 ****** 2020-10-31T22:36:58.660 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-10-31T22:36:58.661 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:58.662 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:58.678 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljknrbqubJDoAvdiXJx7sgY1XdB46GPw9He'], 'uuids': ['ad997d24-51eb-4de4-b222-c12da8a7ddec']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.156266", "end": "2020-10-31 22:36:58.357272", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljknrbqubJDoAvdiXJx7sgY1XdB46GPw9He"], "labels": [], "masters": [], "uuids": ["ad997d24-51eb-4de4-b222-c12da8a7ddec"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:58.201006", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.152772 s, 755 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.152772 s, 755 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:58.689 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:58.701 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:58.779 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-10-31T22:36:58.785 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-10-31T22:36:58.844 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:58 +0000 (0:00:00.195) 0:02:13.001 ****** 2020-10-31T22:36:58.914 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfzpWZYY708bxUGtIK9ii0Q7dWknJaUFoR'], 'uuids': ['27ae8dfc-60b3-479a-8113-5db329c4cceb']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.150470", "end": "2020-10-31 22:36:58.764083", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfzpWZYY708bxUGtIK9ii0Q7dWknJaUFoR"], "labels": [], "masters": [], "uuids": ["27ae8dfc-60b3-479a-8113-5db329c4cceb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:58.613613", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147395 s, 783 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147395 s, 783 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:58.938 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:58.954 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:58.961 INFO:teuthology.task.ansible.out: 2020-10-31T22:36:59.017 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljkkLop31FgDTZsT5mrcR0vTQR0ufD7mgYJ'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.157816", "end": "2020-10-31 22:36:58.696993", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljkkLop31FgDTZsT5mrcR0vTQR0ufD7mgYJ"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:58.539177", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153281 s, 752 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153281 s, 752 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:59.029 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:59.160 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:36:59.206 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:36:59.267 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-10-31T22:36:59.274 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfWchP6cMHMbpe3ZWTGYPHryUrOedjHpHj'], 'uuids': ['7274aebf-1c4b-4bec-b7be-5746e65780c1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.169838", "end": "2020-10-31 22:36:59.126935", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfWchP6cMHMbpe3ZWTGYPHryUrOedjHpHj"], "labels": [], "masters": [], "uuids": ["7274aebf-1c4b-4bec-b7be-5746e65780c1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:58.957097", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.165037 s, 699 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.165037 s, 699 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:59.285 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:36:59.348 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljk9ggX39ANrGyoIhLKzwx6Du9zYBztEDRe'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.158574", "end": "2020-10-31 22:36:59.022178", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-csAGzeTPnvHWFuMBxZsO0z2VGnItEljk9ggX39ANrGyoIhLKzwx6Du9zYBztEDRe"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:58.863604", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15403 s, 749 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15403 s, 749 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:59.406 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:59 +0000 (0:00:00.561) 0:02:13.563 ****** 2020-10-31T22:36:59.429 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:36:59.481 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:36:59.601 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-10-31T22:36:59.603 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfj8SN5WPTnQfRDh1bVgQpDIQe3ffFYuIk'], 'uuids': ['3e023c0a-3278-4118-983a-a5aefc6fd3ad']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.154972", "end": "2020-10-31 22:36:59.455805", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-DX1sBOHzOj811RLTCPoN8JvlRLrTXDDfj8SN5WPTnQfRDh1bVgQpDIQe3ffFYuIk"], "labels": [], "masters": [], "uuids": ["3e023c0a-3278-4118-983a-a5aefc6fd3ad"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-10-31 22:36:59.300833", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.151915 s, 759 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.151915 s, 759 MB/s"], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:59.676 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:59 +0000 (0:00:00.269) 0:02:13.833 ****** 2020-10-31T22:36:59.686 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-10-31T22:36:59.688 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:36:59.730 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:36:59.759 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi085.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.161101", "end": "2020-10-31 22:36:59.408720", "rc": 0, "start": "2020-10-31 22:36:59.247619", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:36:59.817 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:36:59 +0000 (0:00:00.140) 0:02:13.974 ****** 2020-10-31T22:36:59.938 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-10-31T22:36:59.941 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:36:59.985 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:37:00.011 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi085.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.053646", "end": "2020-10-31 22:36:59.701147", "rc": 0, "start": "2020-10-31 22:36:59.647501", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:00.058 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.241) 0:02:14.215 ****** 2020-10-31T22:37:00.070 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi152.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.165132", "end": "2020-10-31 22:36:59.869104", "rc": 0, "start": "2020-10-31 22:36:59.703972", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:00.105 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.047) 0:02:14.262 ****** 2020-10-31T22:37:00.113 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-10-31T22:37:00.155 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.049) 0:02:14.312 ****** 2020-10-31T22:37:00.182 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-10-31T22:37:00.184 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:37:00.188 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:00.223 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.068) 0:02:14.381 ****** 2020-10-31T22:37:00.265 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.041) 0:02:14.422 ****** 2020-10-31T22:37:00.284 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-10-31T22:37:00.285 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:37:00.328 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.063) 0:02:14.485 ****** 2020-10-31T22:37:00.336 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-10-31T22:37:00.338 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for physical volumes] *********************************** changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.077204", "end": "2020-10-31 22:37:00.182000", "rc": 0, "start": "2020-10-31 22:37:00.104796", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:00.378 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.050) 0:02:14.536 ****** 2020-10-31T22:37:00.412 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.033) 0:02:14.570 ****** 2020-10-31T22:37:00.420 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-10-31T22:37:00.421 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:00.473 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.060) 0:02:14.630 ****** 2020-10-31T22:37:00.524 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.051) 0:02:14.682 ****** 2020-10-31T22:37:00.537 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-10-31T22:37:00.539 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-10-31T22:37:00.597 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.073) 0:02:14.755 ****** 2020-10-31T22:37:00.655 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.051) 0:02:14.807 ****** 2020-10-31T22:37:00.657 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:00.713 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.062) 0:02:14.869 ****** 2020-10-31T22:37:00.722 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-10-31T22:37:00.724 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:00.725 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:00.766 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.052) 0:02:14.922 ****** 2020-10-31T22:37:00.771 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-10-31T22:37:00.772 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:00.796 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:00.833 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.068) 0:02:14.990 ****** 2020-10-31T22:37:00.842 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:00.853 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-10-31T22:37:00.855 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-10-31T22:37:00.899 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.066) 0:02:15.057 ****** 2020-10-31T22:37:00.914 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:00.964 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:00 +0000 (0:00:00.064) 0:02:15.122 ****** 2020-10-31T22:37:00.975 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:00.976 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-10-31T22:37:00.977 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'block_used': 13640018, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'size_total': 983426940928, 'block_total': 240094468, 'mount': '/', 'block_available': 226454450, 'size_available': 927557427200, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113896, 'block_size': 4096, 'inode_available': 60941080}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226454450, "block_size": 4096, "block_total": 240094468, "block_used": 13640018, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941080, "inode_total": 61054976, "inode_used": 113896, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927557427200, "size_total": 983426940928, "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:01.038 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.073) 0:02:15.195 ****** 2020-10-31T22:37:01.053 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:01.055 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:01.100 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.062) 0:02:15.258 ****** 2020-10-31T22:37:01.110 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:01.115 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-10-31T22:37:01.117 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:01.167 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.066) 0:02:15.324 ****** 2020-10-31T22:37:01.213 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.046) 0:02:15.370 ****** 2020-10-31T22:37:01.221 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-10-31T22:37:01.223 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:01.279 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.066) 0:02:15.437 ****** 2020-10-31T22:37:01.290 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-10-31T22:37:01.292 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : set_fact] ***************************************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:01.332 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.052) 0:02:15.489 ****** 2020-10-31T22:37:01.366 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.033) 0:02:15.523 ****** 2020-10-31T22:37:01.377 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-10-31T22:37:01.379 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-10-31T22:37:01.380 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:01.427 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.061) 0:02:15.584 ****** 2020-10-31T22:37:01.472 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.043) 0:02:15.628 ****** 2020-10-31T22:37:01.483 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi152.front.sepia.ceph.com] => (item={'block_used': 13640017, 'uuid': '7bdd21ce-9d44-4fc8-85f8-fb3648839738', 'size_total': 983426940928, 'block_total': 240094468, 'mount': '/', 'block_available': 226454451, 'size_available': 927557431296, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 113896, 'block_size': 4096, 'inode_available': 60941080}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226454451, "block_size": 4096, "block_total": 240094468, "block_used": 13640017, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941080, "inode_total": 61054976, "inode_used": 113896, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927557431296, "size_total": 983426940928, "uuid": "7bdd21ce-9d44-4fc8-85f8-fb3648839738"}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:01.486 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-10-31T22:37:01.487 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-10-31T22:37:01.491 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi060.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-10-31T22:37:01.551 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.080) 0:02:15.708 ****** 2020-10-31T22:37:01.614 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.062) 0:02:15.771 ****** 2020-10-31T22:37:01.672 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.057) 0:02:15.828 ****** 2020-10-31T22:37:01.683 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:01.738 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.067) 0:02:15.895 ****** 2020-10-31T22:37:01.766 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:01.803 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.064) 0:02:15.960 ****** 2020-10-31T22:37:01.847 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.043) 0:02:16.004 ****** 2020-10-31T22:37:01.856 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:01.892 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.045) 0:02:16.050 ****** 2020-10-31T22:37:01.900 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:01.942 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.049) 0:02:16.099 ****** 2020-10-31T22:37:01.949 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-10-31T22:37:01.952 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:01.986 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:01 +0000 (0:00:00.044) 0:02:16.143 ****** 2020-10-31T22:37:01.994 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-31T22:37:01.996 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:02.045 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:02 +0000 (0:00:00.059) 0:02:16.203 ****** 2020-10-31T22:37:02.054 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-10-31T22:37:02.055 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true} 2020-10-31T22:37:02.099 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:02 +0000 (0:00:00.054) 0:02:16.257 ****** 2020-10-31T22:37:02.107 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-10-31T22:37:02.109 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:02.146 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:02 +0000 (0:00:00.047) 0:02:16.304 ****** 2020-10-31T22:37:02.176 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:02.211 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:02 +0000 (0:00:00.064) 0:02:16.369 ****** 2020-10-31T22:37:02.242 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-10-31T22:37:02.246 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:02.286 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:02 +0000 (0:00:00.068) 0:02:16.438 ****** 2020-10-31T22:37:02.386 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-10-31T22:37:02.424 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:02 +0000 (0:00:00.143) 0:02:16.582 ****** 2020-10-31T22:37:02.614 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-10-31T22:37:02.616 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-10-31T22:37:02.654 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:02 +0000 (0:00:00.229) 0:02:16.811 ****** 2020-10-31T22:37:02.662 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-10-31T22:37:02.664 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-10-31T22:37:02.706 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:02 +0000 (0:00:00.051) 0:02:16.863 ****** 2020-10-31T22:37:02.745 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-10-31T22:37:02.747 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:37:02.801 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-10-31T22:37:02.803 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 1231, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-10-31T22:37:02.839 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:02 +0000 (0:00:00.133) 0:02:16.997 ****** 2020-10-31T22:37:02.880 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi060.front.sepia.ceph.com] => {"changed": true} 2020-10-31T22:37:02.930 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:02 +0000 (0:00:00.089) 0:02:17.086 ****** 2020-10-31T22:37:02.984 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-10-31T22:37:03.021 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:03 +0000 (0:00:00.092) 0:02:17.178 ****** 2020-10-31T22:37:03.024 INFO:teuthology.task.ansible.out: 2020-10-31T22:37:03.034 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:37:03.122 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-10-31T22:37:03.124 INFO:teuthology.task.ansible.out:changed: [smithi060.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-10-31T22:37:03.172 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:03 +0000 (0:00:00.150) 0:02:17.329 ****** 2020-10-31T22:37:03.246 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-10-31T22:37:03.248 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:37:03.269 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:37:03.324 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-10-31T22:37:03.326 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "gid": 1231, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-10-31T22:37:03.366 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:03 +0000 (0:00:00.193) 0:02:17.523 ****** 2020-10-31T22:37:03.376 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-10-31T22:37:03.377 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1231, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-10-31T22:37:03.421 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:03 +0000 (0:00:00.055) 0:02:17.579 ****** 2020-10-31T22:37:03.487 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:37:03.501 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-10-31T22:37:03.556 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:03 +0000 (0:00:00.134) 0:02:17.713 ****** 2020-10-31T22:37:03.564 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-10-31T22:37:03.567 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:37:03.737 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:37:03.783 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:03 +0000 (0:00:00.226) 0:02:17.940 ****** 2020-10-31T22:37:03.793 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:37:03.814 INFO:teuthology.task.ansible.out: 2020-10-31T22:37:03.815 INFO:teuthology.task.ansible.out:TASK [testnode : Upload CPAN config for root.] ********************************* 2020-10-31T22:37:03.817 INFO:teuthology.task.ansible.out: ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-10-31T22:37:03.876 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:03 +0000 (0:00:00.092) 0:02:18.033 ****** 2020-10-31T22:37:03.913 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-10-31T22:37:03.915 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1231, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-10-31T22:37:03.916 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-10-31T22:37:03.916 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-10-31T22:37:03.969 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:03 +0000 (0:00:00.094) 0:02:18.127 ****** 2020-10-31T22:37:04.033 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:04 +0000 (0:00:00.061) 0:02:18.188 ****** 2020-10-31T22:37:04.050 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-10-31T22:37:04.092 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:04 +0000 (0:00:00.060) 0:02:18.249 ****** 2020-10-31T22:37:04.222 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:04.234 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-10-31T22:37:04.275 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:04 +0000 (0:00:00.183) 0:02:18.433 ****** 2020-10-31T22:37:04.338 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-10-31T22:37:04.340 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:04.350 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-10-31T22:37:04.353 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-10-31T22:37:04.388 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:04 +0000 (0:00:00.113) 0:02:18.546 ****** 2020-10-31T22:37:04.431 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:04.477 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:04.478 INFO:teuthology.task.ansible.out: 2020-10-31T22:37:04.555 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:04.600 INFO:teuthology.task.ansible.out:changed: [smithi085.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:04.612 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:04.655 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:04 +0000 (0:00:00.265) 0:02:18.811 ****** 2020-10-31T22:37:04.673 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:04.782 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-10-31T22:37:04.783 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-10-31T22:37:04.785 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-10-31T22:37:04.829 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:04 +0000 (0:00:00.175) 0:02:18.987 ****** 2020-10-31T22:37:04.837 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:04.842 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-10-31T22:37:04.844 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"cache_update_time": 1604183668, "cache_updated": false, "changed": false} 2020-10-31T22:37:04.881 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:04 +0000 (0:00:00.052) 0:02:19.039 ****** 2020-10-31T22:37:04.916 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:04 +0000 (0:00:00.034) 0:02:19.074 ****** 2020-10-31T22:37:04.922 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-10-31T22:37:04.924 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-10-31T22:37:04.960 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:04 +0000 (0:00:00.043) 0:02:19.117 ****** 2020-10-31T22:37:05.041 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-10-31T22:37:05.043 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2020-10-31T22:37:05.078 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.117) 0:02:19.235 ****** 2020-10-31T22:37:05.085 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-10-31T22:37:05.086 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.037336", "end": "2020-10-31 22:37:04.571078", "rc": 0, "start": "2020-10-31 22:37:04.533742", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-10-31T22:37:05.127 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.049) 0:02:19.285 ****** 2020-10-31T22:37:05.135 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-10-31T22:37:05.137 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-10-31T22:37:05.174 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.045) 0:02:19.331 ****** 2020-10-31T22:37:05.181 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:05.230 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.056) 0:02:19.387 ****** 2020-10-31T22:37:05.238 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi085.front.sepia.ceph.com] => {"changed": true} 2020-10-31T22:37:05.293 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.063) 0:02:19.451 ****** 2020-10-31T22:37:05.301 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-10-31T22:37:05.306 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:05.364 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.070) 0:02:19.521 ****** 2020-10-31T22:37:05.373 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-10-31T22:37:05.380 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"cache_update_time": 1604183664, "cache_updated": false, "changed": false} 2020-10-31T22:37:05.422 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.058) 0:02:19.580 ****** 2020-10-31T22:37:05.445 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi152.front.sepia.ceph.com] => {"changed": true} 2020-10-31T22:37:05.484 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.059) 0:02:19.639 ****** 2020-10-31T22:37:05.501 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi085.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-10-31T22:37:05.544 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.058) 0:02:19.697 ****** 2020-10-31T22:37:05.640 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-10-31T22:37:05.642 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.047644", "end": "2020-10-31 22:37:05.607782", "rc": 0, "start": "2020-10-31 22:37:05.560138", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-10-31T22:37:05.685 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.145) 0:02:19.842 ****** 2020-10-31T22:37:05.695 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-10-31T22:37:05.698 INFO:teuthology.task.ansible.out:changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-10-31T22:37:05.733 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.047) 0:02:19.890 ****** 2020-10-31T22:37:05.739 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-10-31T22:37:05.740 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "gid": 1231, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-10-31T22:37:05.741 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:05.776 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.044) 0:02:19.934 ****** 2020-10-31T22:37:05.809 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.032) 0:02:19.967 ****** 2020-10-31T22:37:05.816 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-10-31T22:37:05.819 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:05.854 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.044) 0:02:20.012 ****** 2020-10-31T22:37:05.882 INFO:teuthology.task.ansible.out: 2020-10-31T22:37:05.884 INFO:teuthology.task.ansible.out:TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 1231, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2020-10-31T22:37:05.923 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:05 +0000 (0:00:00.068) 0:02:20.080 ****** 2020-10-31T22:37:05.965 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-10-31T22:37:06.003 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:06 +0000 (0:00:00.080) 0:02:20.161 ****** 2020-10-31T22:37:06.056 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2020-10-31T22:37:06.099 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:06 +0000 (0:00:00.095) 0:02:20.257 ****** 2020-10-31T22:37:06.291 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-10-31T22:37:06.294 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"cache_update_time": 1604183668, "cache_updated": false, "changed": false} 2020-10-31T22:37:06.345 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:06 +0000 (0:00:00.245) 0:02:20.502 ****** 2020-10-31T22:37:06.355 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-10-31T22:37:06.357 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1231, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-10-31T22:37:06.402 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:06 +0000 (0:00:00.057) 0:02:20.560 ****** 2020-10-31T22:37:06.410 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-10-31T22:37:06.412 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:06.449 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:06 +0000 (0:00:00.047) 0:02:20.607 ****** 2020-10-31T22:37:06.491 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-10-31T22:37:06.493 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1231, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2020-10-31T22:37:06.537 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:06 +0000 (0:00:00.087) 0:02:20.695 ****** 2020-10-31T22:37:06.741 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi060.front.sepia.ceph.com] => {"cache_update_time": 1604183664, "cache_updated": false, "changed": false} 2020-10-31T22:37:06.778 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:06 +0000 (0:00:00.240) 0:02:20.935 ****** 2020-10-31T22:37:06.788 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-10-31T22:37:06.844 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:06 +0000 (0:00:00.065) 0:02:21.001 ****** 2020-10-31T22:37:06.855 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:06.857 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-10-31T22:37:06.857 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-10-31T22:37:06.910 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:06 +0000 (0:00:00.064) 0:02:21.066 ****** 2020-10-31T22:37:06.944 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:06 +0000 (0:00:00.035) 0:02:21.102 ****** 2020-10-31T22:37:06.953 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-10-31T22:37:06.954 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2020-10-31T22:37:06.993 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:06 +0000 (0:00:00.049) 0:02:21.151 ****** 2020-10-31T22:37:07.002 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:07.040 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:07 +0000 (0:00:00.046) 0:02:21.198 ****** 2020-10-31T22:37:07.258 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-10-31 22:33:32 UTC", "ActiveEnterTimestampMonotonic": "17493816", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount system.slice systemd-tmpfiles-setup.service sysinit.target basic.target systemd-journald.socket network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-10-31 22:33:32 UTC", "AssertTimestampMonotonic": "17368147", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_sus 2020-10-31T22:37:07.260 INFO:teuthology.task.ansible.out:pend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-10-31 22:33:32 UTC", "ConditionTimestampMonotonic": "17368147", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1072", "ExecMainStartTimestamp": "Sat 2020-10-31 22:33:32 UTC", "ExecMainStartTimestampMonotonic": "17493794", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-10-31 22:33:32 UTC", "InactiveExitTimestampMonotonic": "17368847", "InvocationID": "aa758ea78a3a4f0cbd3cf544138ce00d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZES 2020-10-31T22:37:07.262 INFO:teuthology.task.ansible.out:oft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1072", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "n 2020-10-31T22:37:07.263 INFO:teuthology.task.ansible.out:o", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-10-31 22:33:32 UTC", "StateChangeTimestampMonotonic": "17493816", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-10-31 22:33:32 UTC", "WatchdogTimestampMonotonic": "17493814", "WatchdogUSec": "0"}} 2020-10-31T22:37:07.310 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:07 +0000 (0:00:00.269) 0:02:21.467 ****** 2020-10-31T22:37:07.351 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:07 +0000 (0:00:00.041) 0:02:21.508 ****** 2020-10-31T22:37:07.360 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-10-31T22:37:07.361 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:07.396 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:07 +0000 (0:00:00.045) 0:02:21.554 ****** 2020-10-31T22:37:07.403 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-31T22:37:07.412 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-10-31T22:37:07.447 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:07 +0000 (0:00:00.050) 0:02:21.605 ****** 2020-10-31T22:37:07.476 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:07.516 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:07 +0000 (0:00:00.068) 0:02:21.673 ****** 2020-10-31T22:37:07.549 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:07.583 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:07 +0000 (0:00:00.067) 0:02:21.740 ****** 2020-10-31T22:37:07.615 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-10-31 22:32:59 UTC", "ActiveEnterTimestampMonotonic": "23830467", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice basic.target network.target systemd-journald.socket -.mount systemd-tmpfiles-setup.service sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-10-31 22:32:53 UTC", "AssertTimestampMonotonic": "17548058", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-10-31 22:32:53 UTC", "ConditionTimestampMonotonic": "17548057", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Dele 2020-10-31T22:37:07.619 INFO:teuthology.task.ansible.out:gate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1974", "ExecMainStartTimestamp": "Sat 2020-10-31 22:32:59 UTC", "ExecMainStartTimestampMonotonic": "23830453", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-10-31 22:32:53 UTC", "InactiveExitTimestampMonotonic": "17548879", "InvocationID": "39e2bb681e90408b9cf133c23f8731e1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128055", "LimitNPROCSoft": "128055", "LimitRSS": "infi 2020-10-31T22:37:07.621 INFO:teuthology.task.ansible.out:nity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128055", "LimitSIGPENDINGSoft": "128055", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1974", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "Star 2020-10-31T22:37:07.623 INFO:teuthology.task.ansible.out:tupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-10-31 22:32:59 UTC", "StateChangeTimestampMonotonic": "23830467", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-10-31 22:32:59 UTC", "WatchdogTimestampMonotonic": "23830465", "WatchdogUSec": "0"}} 2020-10-31T22:37:07.652 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:07 +0000 (0:00:00.069) 0:02:21.810 ****** 2020-10-31T22:37:07.682 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi060.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-10-31T22:37:07.722 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:07 +0000 (0:00:00.068) 0:02:21.879 ****** 2020-10-31T22:37:07.765 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi085.front.sepia.ceph.com] => {"cache_update_time": 1604183678, "cache_updated": false, "changed": false} 2020-10-31T22:37:07.806 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:07 +0000 (0:00:00.082) 0:02:21.961 ****** 2020-10-31T22:37:07.851 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:07 +0000 (0:00:00.047) 0:02:22.009 ****** 2020-10-31T22:37:07.861 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-10-31T22:37:07.864 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:07.898 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:07 +0000 (0:00:00.045) 0:02:22.055 ****** 2020-10-31T22:37:07.920 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi152.front.sepia.ceph.com] => {"cache_update_time": 1604183673, "cache_updated": false, "changed": false} 2020-10-31T22:37:07.960 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:07 +0000 (0:00:00.062) 0:02:22.118 ****** 2020-10-31T22:37:08.042 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-10-31T22:37:08.044 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.046415", "end": "2020-10-31 22:37:08.013806", "rc": 0, "start": "2020-10-31 22:37:07.967391", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-10-31T22:37:08.095 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:08 +0000 (0:00:00.134) 0:02:22.252 ****** 2020-10-31T22:37:08.123 INFO:teuthology.task.ansible.out: 2020-10-31T22:37:08.125 INFO:teuthology.task.ansible.out:TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:08.161 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:08 +0000 (0:00:00.066) 0:02:22.319 ****** 2020-10-31T22:37:08.179 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.042674", "end": "2020-10-31 22:37:08.006471", "rc": 0, "start": "2020-10-31 22:37:07.963797", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2020-10-31T22:37:08.213 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:08 +0000 (0:00:00.049) 0:02:22.369 ****** 2020-10-31T22:37:08.218 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-10-31T22:37:08.220 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:08.254 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:08 +0000 (0:00:00.042) 0:02:22.412 ****** 2020-10-31T22:37:08.261 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-10-31T22:37:08.266 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:08.304 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:08 +0000 (0:00:00.050) 0:02:22.462 ****** 2020-10-31T22:37:08.346 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:08.385 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:08 +0000 (0:00:00.079) 0:02:22.542 ****** 2020-10-31T22:37:08.484 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-10-31T22:37:08.486 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"cache_update_time": 1604183668, "cache_updated": false, "changed": false} 2020-10-31T22:37:08.520 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:08 +0000 (0:00:00.135) 0:02:22.677 ****** 2020-10-31T22:37:08.550 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:08.586 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:08 +0000 (0:00:00.065) 0:02:22.743 ****** 2020-10-31T22:37:08.728 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 1231, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-10-31T22:37:08.763 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:08 +0000 (0:00:00.177) 0:02:22.921 ****** 2020-10-31T22:37:08.770 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-10-31T22:37:08.772 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"cache_update_time": 1604183664, "cache_updated": false, "changed": false} 2020-10-31T22:37:08.807 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:08 +0000 (0:00:00.044) 0:02:22.965 ****** 2020-10-31T22:37:08.838 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-10-31T22:37:08.840 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:08.878 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:08 +0000 (0:00:00.065) 0:02:23.031 ****** 2020-10-31T22:37:09.013 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "gid": 1231, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2020-10-31T22:37:09.053 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:09 +0000 (0:00:00.180) 0:02:23.211 ****** 2020-10-31T22:37:09.108 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1231, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi085.front.sepia.ceph.com] => {"cache_update_time": 1604183678, "cache_updated": false, "changed": false} 2020-10-31T22:37:09.153 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:09 +0000 (0:00:00.093) 0:02:23.304 ****** 2020-10-31T22:37:09.189 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:09 +0000 (0:00:00.039) 0:02:23.344 ****** 2020-10-31T22:37:09.241 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:09.295 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:09 +0000 (0:00:00.109) 0:02:23.453 ****** 2020-10-31T22:37:09.305 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-10-31T22:37:09.306 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"cache_update_time": 1604183673, "cache_updated": false, "changed": false} 2020-10-31T22:37:09.344 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:09 +0000 (0:00:00.048) 0:02:23.501 ****** 2020-10-31T22:37:09.383 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:09.427 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:09 +0000 (0:00:00.082) 0:02:23.584 ****** 2020-10-31T22:37:09.433 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-10-31T22:37:09.436 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1231, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-10-31T22:37:09.475 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:09 +0000 (0:00:00.048) 0:02:23.632 ****** 2020-10-31T22:37:09.476 INFO:teuthology.task.ansible.out: 2020-10-31T22:37:09.680 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-10-31T22:37:09.681 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-10-31T22:37:09.745 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:09 +0000 (0:00:00.267) 0:02:23.900 ****** 2020-10-31T22:37:09.794 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:09.864 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:09 +0000 (0:00:00.119) 0:02:24.020 ****** 2020-10-31T22:37:09.890 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2020-10-31T22:37:09.946 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:09 +0000 (0:00:00.075) 0:02:24.095 ****** 2020-10-31T22:37:09.973 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:10.013 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:10 +0000 (0:00:00.069) 0:02:24.165 ****** 2020-10-31T22:37:10.111 INFO:teuthology.task.ansible.out: 2020-10-31T22:37:10.111 INFO:teuthology.task.ansible.out:TASK [testnode : Make sure ntpd is running.] *********************************** 2020-10-31T22:37:10.113 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-10-31 22:33:24 UTC", "ActiveEnterTimestampMonotonic": "17818631", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target network.target systemd-tmpfiles-setup.service system.slice -.mount sysinit.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-10-31 22:33:24 UTC", "AssertTimestampMonotonic": "17708095", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-10-31 22:33:24 UTC", "ConditionTimestampMonotonic": "17708095", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-10-31T22:37:10.115 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1050", "ExecMainStartTimestamp": "Sat 2020-10-31 22:33:24 UTC", "ExecMainStartTimestampMonotonic": "17818619", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-10-31 22:33:24 UTC", "InactiveExitTimestampMonotonic": "17708747", "InvocationID": "cf2d5d7a82bc4406a75359a13d423395", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128030", "LimitNPROCSoft": "128030", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2020-10-31T22:37:10.117 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128030", "LimitSIGPENDINGSoft": "128030", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1050", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-10-31 22:33:24 UTC", "S 2020-10-31T22:37:10.118 INFO:teuthology.task.ansible.out:tateChangeTimestampMonotonic": "17818631", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-10-31 22:33:24 UTC", "WatchdogTimestampMonotonic": "17818630", "WatchdogUSec": "0"}} 2020-10-31T22:37:10.175 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:10 +0000 (0:00:00.167) 0:02:24.333 ****** 2020-10-31T22:37:10.182 INFO:teuthology.task.ansible.out: 2020-10-31T22:37:10.221 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi085.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-10-31T22:37:10.261 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:10 +0000 (0:00:00.084) 0:02:24.417 ****** 2020-10-31T22:37:10.269 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-10-31T22:37:10.271 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2020-10-31 22:33:45 UTC", "ActiveEnterTimestampMonotonic": "18187318", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target -.mount system.slice systemd-journald.socket network.target systemd-tmpfiles-setup.service sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2020-10-31 22:33:45 UTC", "AssertTimestampMonotonic": "18032046", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2020-10-31 22:33:45 UTC", "ConditionTimestampMonotonic": "18032045", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2020-10-31T22:37:10.274 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "989", "ExecMainStartTimestamp": "Sat 2020-10-31 22:33:45 UTC", "ExecMainStartTimestampMonotonic": "18187308", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2020-10-31 22:33:45 UTC", "InactiveExitTimestampMonotonic": "18033251", "InvocationID": "2a539ee2b44042498fbbb2ecfbde20fc", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limit 2020-10-31T22:37:10.276 INFO:teuthology.task.ansible.out:RTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "989", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2020-10-31 22:33:45 UTC", "Sta 2020-10-31T22:37:10.280 INFO:teuthology.task.ansible.out:teChangeTimestampMonotonic": "18187318", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2020-10-31 22:33:45 UTC", "WatchdogTimestampMonotonic": "18187317", "WatchdogUSec": "0"}} 2020-10-31T22:37:10.319 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:10 +0000 (0:00:00.057) 0:02:24.475 ****** 2020-10-31T22:37:10.325 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-31T22:37:10.328 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages via pip] ************************************* ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null 2020-10-31T22:37:10.332 INFO:teuthology.task.ansible.out:, "virtualenv": null} 2020-10-31T22:37:10.381 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:10 +0000 (0:00:00.061) 0:02:24.536 ****** 2020-10-31T22:37:10.417 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:10 +0000 (0:00:00.038) 0:02:24.574 ****** 2020-10-31T22:37:10.474 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:10 +0000 (0:00:00.056) 0:02:24.631 ****** 2020-10-31T22:37:10.494 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-10-31T22:37:10.532 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:10 +0000 (0:00:00.058) 0:02:24.689 ****** 2020-10-31T22:37:10.551 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-10-31T22:37:10.553 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:10.610 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:10 +0000 (0:00:00.076) 0:02:24.766 ****** 2020-10-31T22:37:10.621 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:10.662 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:10 +0000 (0:00:00.054) 0:02:24.820 ****** 2020-10-31T22:37:10.665 INFO:teuthology.task.ansible.out: 2020-10-31T22:37:10.701 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:10.754 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:10 +0000 (0:00:00.089) 0:02:24.910 ****** 2020-10-31T22:37:10.934 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi060.front.sepia.ceph.com] => {"changed": false} 2020-10-31T22:37:10.971 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:10 +0000 (0:00:00.218) 0:02:25.128 ****** 2020-10-31T22:37:10.989 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false} 2020-10-31T22:37:11.048 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:11 +0000 (0:00:00.076) 0:02:25.205 ****** 2020-10-31T22:37:11.059 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-10-31T22:37:11.062 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2020-10-31T22:37:11.118 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:11 +0000 (0:00:00.067) 0:02:25.273 ****** 2020-10-31T22:37:11.128 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-10-31T22:37:11.170 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:11 +0000 (0:00:00.054) 0:02:25.328 ****** 2020-10-31T22:37:11.269 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1604183588.85838, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1604183588.854382, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 1172, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1604183588.854382, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 67, "uid": 0, "version": "3281182116", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-10-31T22:37:11.310 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:11 +0000 (0:00:00.135) 0:02:25.463 ****** 2020-10-31T22:37:11.329 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1604183633.2525353, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1604183633.2485354, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 1172, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1604183633.2485354, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3281182116", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-10-31T22:37:11.369 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:11 +0000 (0:00:00.062) 0:02:25.526 ****** 2020-10-31T22:37:11.502 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-10-31T22:37:11.509 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"cache_update_time": 1604183678, "cache_updated": false, "changed": false} 2020-10-31T22:37:11.612 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:11 +0000 (0:00:00.230) 0:02:25.757 ****** 2020-10-31T22:37:11.650 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"cache_update_time": 1604183673, "cache_updated": false, "changed": false} 2020-10-31T22:37:11.730 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:11 +0000 (0:00:00.125) 0:02:25.883 ****** 2020-10-31T22:37:11.745 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:11.810 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:11 +0000 (0:00:00.082) 0:02:25.965 ****** 2020-10-31T22:37:11.821 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:11.885 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:11 +0000 (0:00:00.072) 0:02:26.038 ****** 2020-10-31T22:37:12.004 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-10-31T22:37:12.014 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "gid": 1231, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi060.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-10-31T22:37:12.073 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:12 +0000 (0:00:00.191) 0:02:26.230 ****** 2020-10-31T22:37:12.110 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:12 +0000 (0:00:00.035) 0:02:26.266 ****** 2020-10-31T22:37:12.149 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:12 +0000 (0:00:00.038) 0:02:26.305 ****** 2020-10-31T22:37:12.159 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-10-31T22:37:12.161 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "gid": 1231, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi060.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-10-31T22:37:12.162 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-10-31T22:37:12.201 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:12 +0000 (0:00:00.053) 0:02:26.358 ****** 2020-10-31T22:37:12.242 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:12 +0000 (0:00:00.038) 0:02:26.396 ****** 2020-10-31T22:37:12.279 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:12 +0000 (0:00:00.038) 0:02:26.435 ****** 2020-10-31T22:37:12.291 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:12.354 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:12 +0000 (0:00:00.074) 0:02:26.509 ****** 2020-10-31T22:37:12.392 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:12 +0000 (0:00:00.039) 0:02:26.549 ****** 2020-10-31T22:37:12.556 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi060.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-10-31T22:37:12.605 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:12 +0000 (0:00:00.213) 0:02:26.763 ****** 2020-10-31T22:37:12.620 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-10-31T22:37:12.700 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:12 +0000 (0:00:00.094) 0:02:26.857 ****** 2020-10-31T22:37:12.714 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1231, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2020-10-31T22:37:12.788 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:12 +0000 (0:00:00.086) 0:02:26.944 ****** 2020-10-31T22:37:12.802 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1231, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi060.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-10-31T22:37:12.858 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:12 +0000 (0:00:00.069) 0:02:27.013 ****** 2020-10-31T22:37:12.910 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:12 +0000 (0:00:00.053) 0:02:27.067 ****** 2020-10-31T22:37:12.924 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-10-31T22:37:12.982 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:12 +0000 (0:00:00.072) 0:02:27.139 ****** 2020-10-31T22:37:12.995 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-10-31T22:37:12.997 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.052 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.069) 0:02:27.209 ****** 2020-10-31T22:37:13.072 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.119 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.067) 0:02:27.277 ****** 2020-10-31T22:37:13.128 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi060.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.130 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.184 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.061) 0:02:27.338 ****** 2020-10-31T22:37:13.192 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.203 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.208 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.242 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.060) 0:02:27.399 ****** 2020-10-31T22:37:13.250 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-10-31T22:37:13.252 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi060.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.252 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.254 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.265 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'ens1f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.324 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.082) 0:02:27.482 ****** 2020-10-31T22:37:13.339 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.342 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.343 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.394 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.069) 0:02:27.551 ****** 2020-10-31T22:37:13.406 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-31T22:37:13.408 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.445 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.050) 0:02:27.602 ****** 2020-10-31T22:37:13.452 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.491 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.046) 0:02:27.649 ****** 2020-10-31T22:37:13.499 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-10-31T22:37:13.501 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.546 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.055) 0:02:27.704 ****** 2020-10-31T22:37:13.557 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.595 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.048) 0:02:27.753 ****** 2020-10-31T22:37:13.603 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.605 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-10-31T22:37:13.650 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.053) 0:02:27.806 ****** 2020-10-31T22:37:13.684 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.035) 0:02:27.842 ****** 2020-10-31T22:37:13.691 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-10-31T22:37:13.693 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.759 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.073) 0:02:27.916 ****** 2020-10-31T22:37:13.804 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.044) 0:02:27.960 ****** 2020-10-31T22:37:13.814 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.859 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.056) 0:02:28.017 ****** 2020-10-31T22:37:13.902 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.036) 0:02:28.053 ****** 2020-10-31T22:37:13.906 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:13.947 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.051) 0:02:28.104 ****** 2020-10-31T22:37:13.992 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:13 +0000 (0:00:00.045) 0:02:28.150 ****** 2020-10-31T22:37:14.002 INFO:teuthology.task.ansible.out: 2020-10-31T22:37:14.004 INFO:teuthology.task.ansible.out:TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:14.049 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.056) 0:02:28.207 ****** 2020-10-31T22:37:14.058 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:14.097 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.046) 0:02:28.253 ****** 2020-10-31T22:37:14.102 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-10-31T22:37:14.104 INFO:teuthology.task.ansible.out:skipping: [smithi060.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:14.146 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.049) 0:02:28.302 ****** 2020-10-31T22:37:14.152 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-10-31T22:37:14.154 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:14.211 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.066) 0:02:28.369 ****** 2020-10-31T22:37:14.221 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-10-31T22:37:14.223 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false} 2020-10-31T22:37:14.272 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.060) 0:02:28.429 ****** 2020-10-31T22:37:14.282 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-10-31T22:37:14.284 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:14.343 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.070) 0:02:28.499 ****** 2020-10-31T22:37:14.349 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-10-31T22:37:14.357 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi060.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.009995", "end": "2020-10-31 22:37:14.275572", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-10-31 22:37:14.265577", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:14.417 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.073) 0:02:28.573 ****** 2020-10-31T22:37:14.430 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:14.482 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.064) 0:02:28.638 ****** 2020-10-31T22:37:14.493 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi152.front.sepia.ceph.com] => {"changed": false} TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi060.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006122", "end": "2020-10-31 22:37:14.421313", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-10-31 22:37:14.415191", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:14.539 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.058) 0:02:28.696 ****** 2020-10-31T22:37:14.585 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-10-31T22:37:14.640 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.101) 0:02:28.797 ****** 2020-10-31T22:37:14.648 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-10-31T22:37:14.649 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1604183625.5679417, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1604183625.5639417, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 1172, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1604183625.5639417, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3281182116", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-10-31T22:37:14.658 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi060.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005740", "end": "2020-10-31 22:37:14.576136", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-10-31 22:37:14.570396", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:14.700 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.059) 0:02:28.857 ****** 2020-10-31T22:37:14.720 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011024", "end": "2020-10-31 22:37:14.200098", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-10-31 22:37:14.189074", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:14.781 INFO:teuthology.task.ansible.out:ok: [smithi060.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.024236", "end": "2020-10-31 22:37:14.742007", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-10-31 22:37:14.717771", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:14.819 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.119) 0:02:28.977 ****** 2020-10-31T22:37:14.827 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-10-31T22:37:14.829 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1604183646.8562803, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1604183646.8522804, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 1172, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1604183646.8522804, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3281182116", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2020-10-31T22:37:14.830 INFO:teuthology.task.ansible.out: 2020-10-31T22:37:14.831 INFO:teuthology.task.ansible.out: 2020-10-31T22:37:14.832 INFO:teuthology.task.ansible.out:TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-10-31T22:37:14.833 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006180", "end": "2020-10-31 22:37:14.340192", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-10-31 22:37:14.334012", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:14.869 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.049) 0:02:29.027 ****** 2020-10-31T22:37:14.878 INFO:teuthology.task.ansible.out: 2020-10-31T22:37:14.880 INFO:teuthology.task.ansible.out:TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi085.front.sepia.ceph.com] => {"changed": false, "msg": ""} TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-10-31T22:37:14.916 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.046) 0:02:29.074 ****** 2020-10-31T22:37:14.970 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:14 +0000 (0:00:00.033) 0:02:29.107 ****** TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi066.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005590", "end": "2020-10-31 22:37:14.463096", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-10-31 22:37:14.457506", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:14.980 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi085.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-10-31T22:37:15.018 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.068) 0:02:29.175 ****** 2020-10-31T22:37:15.025 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-10-31T22:37:15.027 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2020-10-31T22:37:15.066 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.047) 0:02:29.223 ****** 2020-10-31T22:37:15.072 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-10-31T22:37:15.074 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi060.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-10-31T22:37:15.172 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.106) 0:02:29.329 ****** 2020-10-31T22:37:15.182 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi152.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-10-31T22:37:15.184 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi066.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.025246", "end": "2020-10-31 22:37:14.613843", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-10-31 22:37:14.588597", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:15.275 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.095) 0:02:29.425 ****** 2020-10-31T22:37:15.308 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.039) 0:02:29.464 ****** 2020-10-31T22:37:15.319 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi085.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-10-31T22:37:15.352 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.045) 0:02:29.510 ****** 2020-10-31T22:37:15.389 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.034) 0:02:29.545 ****** 2020-10-31T22:37:15.406 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:15.470 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.080) 0:02:29.625 ****** 2020-10-31T22:37:15.522 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-10-31T22:37:15.581 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi085.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-10-31T22:37:15.649 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.180) 0:02:29.806 ****** 2020-10-31T22:37:15.662 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** changed: [smithi152.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-10-31T22:37:15.700 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.051) 0:02:29.858 ****** 2020-10-31T22:37:15.708 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:15.745 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.045) 0:02:29.903 ****** 2020-10-31T22:37:15.784 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-10-31T22:37:15.786 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-10-31T22:37:15.786 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-10-31T22:37:15.798 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-10-31T22:37:15.800 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-10-31T22:37:15.838 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.092) 0:02:29.996 ****** 2020-10-31T22:37:15.848 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi152.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-10-31T22:37:15.889 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.050) 0:02:30.046 ****** 2020-10-31T22:37:15.898 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-10-31T22:37:15.900 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:15.913 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi085.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:15.914 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:15.916 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:15.961 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.071) 0:02:30.118 ****** 2020-10-31T22:37:15.992 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:15 +0000 (0:00:00.032) 0:02:30.150 ****** 2020-10-31T22:37:16.001 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-10-31T22:37:16.003 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.045 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:16 +0000 (0:00:00.052) 0:02:30.203 ****** 2020-10-31T22:37:16.070 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi152.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.126 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:16 +0000 (0:00:00.075) 0:02:30.279 ****** 2020-10-31T22:37:16.192 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi152.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.194 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.196 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.351 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:16 +0000 (0:00:00.228) 0:02:30.507 ****** 2020-10-31T22:37:16.357 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-10-31T22:37:16.362 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.403 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:16 +0000 (0:00:00.052) 0:02:30.560 ****** 2020-10-31T22:37:16.411 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-10-31T22:37:16.417 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi152.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditiona 2020-10-31T22:37:16.419 INFO:teuthology.task.ansible.out:l result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.456 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:16 +0000 (0:00:00.054) 0:02:30.614 ****** 2020-10-31T22:37:16.465 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.501 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:16 +0000 (0:00:00.044) 0:02:30.658 ****** 2020-10-31T22:37:16.511 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.552 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:16 +0000 (0:00:00.051) 0:02:30.710 ****** 2020-10-31T22:37:16.561 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.603 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:16 +0000 (0:00:00.045) 0:02:30.755 ****** 2020-10-31T22:37:16.607 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.649 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:16 +0000 (0:00:00.050) 0:02:30.806 ****** 2020-10-31T22:37:16.662 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.733 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:16 +0000 (0:00:00.084) 0:02:30.890 ****** 2020-10-31T22:37:16.746 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.789 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:16 +0000 (0:00:00.056) 0:02:30.946 ****** 2020-10-31T22:37:16.798 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.856 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:16 +0000 (0:00:00.067) 0:02:31.014 ****** 2020-10-31T22:37:16.863 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-10-31T22:37:16.866 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.901 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:16 +0000 (0:00:00.044) 0:02:31.058 ****** 2020-10-31T22:37:16.908 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-10-31T22:37:16.911 INFO:teuthology.task.ansible.out:skipping: [smithi085.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:16.950 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:16 +0000 (0:00:00.049) 0:02:31.108 ****** 2020-10-31T22:37:16.960 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-10-31T22:37:16.963 INFO:teuthology.task.ansible.out:skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:17.020 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:17 +0000 (0:00:00.070) 0:02:31.178 ****** 2020-10-31T22:37:17.070 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:17.111 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:17 +0000 (0:00:00.087) 0:02:31.266 ****** 2020-10-31T22:37:17.152 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi085.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010899", "end": "2020-10-31 22:37:17.100135", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-10-31 22:37:17.089236", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:17.178 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:17.217 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:17 +0000 (0:00:00.108) 0:02:31.374 ****** 2020-10-31T22:37:17.258 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi152.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-10-31T22:37:17.298 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:17 +0000 (0:00:00.077) 0:02:31.451 ****** 2020-10-31T22:37:17.319 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-10-31T22:37:17.330 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006033", "end": "2020-10-31 22:37:17.255406", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-10-31 22:37:17.249373", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:17.430 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005539", "end": "2020-10-31 22:37:17.399567", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-10-31 22:37:17.394028", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:17.490 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011091", "end": "2020-10-31 22:37:17.333880", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-10-31 22:37:17.322789", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:17.575 INFO:teuthology.task.ansible.out:ok: [smithi085.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.028374", "end": "2020-10-31 22:37:17.538936", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-10-31 22:37:17.510562", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:17.626 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:17 +0000 (0:00:00.332) 0:02:31.784 ****** 2020-10-31T22:37:17.638 INFO:teuthology.task.ansible.out:ok: [smithi152.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006049", "end": "2020-10-31 22:37:17.470656", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-10-31 22:37:17.464607", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:17.664 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-10-31T22:37:17.703 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:17 +0000 (0:00:00.075) 0:02:31.860 ****** 2020-10-31T22:37:17.775 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi152.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005558", "end": "2020-10-31 22:37:17.621560", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-10-31 22:37:17.616002", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:17.850 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi085.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-10-31T22:37:17.965 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi152.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.031328", "end": "2020-10-31 22:37:17.769606", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-10-31 22:37:17.738278", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-10-31T22:37:18.010 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:18 +0000 (0:00:00.307) 0:02:32.167 ****** 2020-10-31T22:37:18.050 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-10-31T22:37:18.086 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:18 +0000 (0:00:00.071) 0:02:32.239 ****** 2020-10-31T22:37:18.221 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi152.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2020-10-31T22:37:18.322 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-10-31T22:37:18.330 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-10-31T22:37:18.336 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi060.front.sepia.ceph.com : ok=114 changed=30 unreachable=0 failed=0 skipped=175 rescued=0 ignored=0 smithi066.front.sepia.ceph.com : ok=114 changed=30 unreachable=0 failed=0 skipped=175 rescued=0 ignored=0 smithi085.front.sepia.ceph.com : ok=114 changed=30 unreachable=0 failed=0 skipped=175 rescued=0 ignored=0 smithi152.front.sepia.ceph.com : ok=114 changed=30 unreachable=0 failed=0 skipped=175 rescued=0 ignored=0 2020-10-31T22:37:18.339 INFO:teuthology.task.ansible.out:Saturday 31 October 2020 22:37:18 +0000 (0:00:00.254) 0:02:32.494 ****** =============================================================================== users : Create all admin users with sudo access. ----------------------- 18.14s users : Update authorized_keys using the keys repo --------------------- 16.85s testnode : Ensure packages are not present. ----------------------------- 7.38s testnode : Install packages --------------------------------------------- 6.82s testnode : Zap all non-root disks --------------------------------------- 5.24s users : Remove revoked users -------------------------------------------- 4.51s Gathering Facts --------------------------------------------------------- 1.83s common : Update apt cache ----------------------------------------------- 1.74s testnode : Update apt cache. -------------------------------------------- 0.99s testnode : Install apt keys --------------------------------------------- 0.71s Gathering Facts --------------------------------------------------------- 0.67s testnode : Install python-apt ------------------------------------------- 0.62s ansible-managed : Add authorized keys for the ansible user. ------------- 0.61s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.60s testnode : Make sure apt dependencies are installed --------------------- 0.52s ansible-managed : Create the ansible user. ------------------------------ 0.40s users : Clone the keys repo --------------------------------------------- 0.39s common : Add krb5 config file ------------------------------------------- 0.38s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.33s ansible-managed : Delete the ansible users password. -------------------- 0.28s 2020-10-31T22:37:18.825 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi066.front.sepia.ceph.com'), Remote(name='ubuntu@smithi152.front.sepia.ceph.com'), Remote(name='ubuntu@smithi085.front.sepia.ceph.com')] 2020-10-31T22:37:18.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-10-31T22:37:18.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:37:18.965 INFO:teuthology.orchestra.run.smithi060:> true 2020-10-31T22:37:19.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-10-31T22:37:19.160 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:37:19.244 INFO:teuthology.orchestra.run.smithi066:> true 2020-10-31T22:37:19.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-10-31T22:37:19.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:37:19.525 INFO:teuthology.orchestra.run.smithi152:> true 2020-10-31T22:37:19.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-10-31T22:37:19.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi085.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-10-31T22:37:19.793 INFO:teuthology.orchestra.run.smithi085:> true 2020-10-31T22:37:19.988 INFO:teuthology.run_tasks:Running task clock... 2020-10-31T22:37:20.016 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-10-31T22:37:20.016 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-10-31T22:37:20.017 INFO:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-10-31T22:37:20.068 INFO:teuthology.orchestra.run.smithi060.stdout:31 Oct 22:37:20 ntpd[9040]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-10-31T22:37:20.069 INFO:teuthology.orchestra.run.smithi060.stdout:31 Oct 22:37:20 ntpd[9040]: Command line: ntpd -gq 2020-10-31T22:37:20.073 INFO:teuthology.orchestra.run.smithi060.stdout:31 Oct 22:37:20 ntpd[9040]: proto: precision = 0.095 usec (-23) 2020-10-31T22:37:20.073 INFO:teuthology.orchestra.run.smithi060.stdout:31 Oct 22:37:20 ntpd[9040]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-10-31T22:37:20.073 INFO:teuthology.orchestra.run.smithi060.stdout:31 Oct 22:37:20 ntpd[9040]: restrict ::: KOD does nothing without LIMITED. 2020-10-31T22:37:20.073 INFO:teuthology.orchestra.run.smithi060.stdout:31 Oct 22:37:20 ntpd[9040]: Listen and drop on 0 v6wildcard [::]:123 2020-10-31T22:37:20.073 INFO:teuthology.orchestra.run.smithi060.stdout:31 Oct 22:37:20 ntpd[9040]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-10-31T22:37:20.073 INFO:teuthology.orchestra.run.smithi060.stdout:31 Oct 22:37:20 ntpd[9040]: Listen normally on 2 lo 127.0.0.1:123 2020-10-31T22:37:20.073 INFO:teuthology.orchestra.run.smithi060.stdout:31 Oct 22:37:20 ntpd[9040]: Listen normally on 3 ens1f0 172.21.15.60:123 2020-10-31T22:37:20.074 INFO:teuthology.orchestra.run.smithi060.stdout:31 Oct 22:37:20 ntpd[9040]: Listen normally on 4 lo [::1]:123 2020-10-31T22:37:20.074 INFO:teuthology.orchestra.run.smithi060.stdout:31 Oct 22:37:20 ntpd[9040]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:1560%3]:123 2020-10-31T22:37:20.074 INFO:teuthology.orchestra.run.smithi060.stdout:31 Oct 22:37:20 ntpd[9040]: Listening on routing socket on fd #22 for interface updates 2020-10-31T22:37:20.074 INFO:teuthology.orchestra.run.smithi060.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-10-31T22:37:20.074 INFO:teuthology.orchestra.run.smithi060.stderr:restrict ::: KOD does nothing without LIMITED. 2020-10-31T22:37:21.066 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:21 ntpd[9040]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:21.067 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:21 ntpd[9040]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:21.067 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:21 ntpd[9040]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:21.067 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:21 ntpd[9040]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:23.069 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:23 ntpd[9040]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:23.069 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:23 ntpd[9040]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:23.070 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:23 ntpd[9040]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:23.070 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:23 ntpd[9040]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:23.070 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:23 ntpd[9040]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:23.071 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:23 ntpd[9040]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:23.071 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:23 ntpd[9040]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:23.072 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:23 ntpd[9040]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:24.067 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:24 ntpd[9040]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:24.067 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:24 ntpd[9040]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:24.067 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:24 ntpd[9040]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:24.068 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:24 ntpd[9040]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:25.071 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:25 ntpd[9040]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:25.072 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:25 ntpd[9040]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:25.072 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:25 ntpd[9040]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:25.072 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:25 ntpd[9040]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:25.073 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:25 ntpd[9040]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:25.073 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:25 ntpd[9040]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:25.073 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:25 ntpd[9040]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:25.074 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:25 ntpd[9040]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:25.074 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:25 ntpd[9040]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:25.074 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:25 ntpd[9040]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:25.074 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:25 ntpd[9040]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:25.075 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:25 ntpd[9040]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:26.066 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:26 ntpd[9040]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:26.067 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:26 ntpd[9040]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:26.067 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:26 ntpd[9040]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:26.067 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:26 ntpd[9040]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:27.067 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:27 ntpd[9040]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:27.067 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:27 ntpd[9040]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:27.067 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:27 ntpd[9040]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:27.068 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:27 ntpd[9040]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:27.068 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:27 ntpd[9040]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:27.068 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:27 ntpd[9040]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:27.068 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:27 ntpd[9040]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:27.068 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:27 ntpd[9040]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:27.068 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:27 ntpd[9040]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:27.068 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:27 ntpd[9040]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:27.069 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:27 ntpd[9040]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:27.069 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:27 ntpd[9040]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:27.069 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:27 ntpd[9040]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-10-31T22:37:27.069 INFO:teuthology.orchestra.run.smithi060.stderr:31 Oct 22:37:27 ntpd[9040]: can't open /var/log/ntpstats/loopstats.20201031: Permission denied 2020-10-31T22:37:27.069 INFO:teuthology.orchestra.run.smithi060.stdout:31 Oct 22:37:27 ntpd[9040]: ntpd: time slew +0.005334 s 2020-10-31T22:37:27.069 INFO:teuthology.orchestra.run.smithi060.stdout:ntpd: time slew +0.005334s 2020-10-31T22:37:27.115 INFO:teuthology.orchestra.run.smithi060.stdout: remote refid st t when poll reach delay offset jitter 2020-10-31T22:37:27.116 INFO:teuthology.orchestra.run.smithi060.stdout:============================================================================== 2020-10-31T22:37:27.116 INFO:teuthology.orchestra.run.smithi060.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:27.116 INFO:teuthology.orchestra.run.smithi060.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:27.116 INFO:teuthology.orchestra.run.smithi060.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:27.116 INFO:teuthology.orchestra.run.smithi060.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:27.117 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-10-31T22:37:27.117 INFO:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-10-31T22:37:27.179 INFO:teuthology.orchestra.run.smithi066.stdout:31 Oct 22:37:27 ntpd[8598]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-10-31T22:37:27.180 INFO:teuthology.orchestra.run.smithi066.stdout:31 Oct 22:37:27 ntpd[8598]: Command line: ntpd -gq 2020-10-31T22:37:27.180 INFO:teuthology.orchestra.run.smithi066.stdout:31 Oct 22:37:27 ntpd[8598]: proto: precision = 0.130 usec (-23) 2020-10-31T22:37:27.181 INFO:teuthology.orchestra.run.smithi066.stdout:31 Oct 22:37:27 ntpd[8598]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-10-31T22:37:27.181 INFO:teuthology.orchestra.run.smithi066.stdout:31 Oct 22:37:27 ntpd[8598]: restrict ::: KOD does nothing without LIMITED. 2020-10-31T22:37:27.181 INFO:teuthology.orchestra.run.smithi066.stdout:31 Oct 22:37:27 ntpd[8598]: Listen and drop on 0 v6wildcard [::]:123 2020-10-31T22:37:27.181 INFO:teuthology.orchestra.run.smithi066.stdout:31 Oct 22:37:27 ntpd[8598]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-10-31T22:37:27.181 INFO:teuthology.orchestra.run.smithi066.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-10-31T22:37:27.182 INFO:teuthology.orchestra.run.smithi066.stderr:restrict ::: KOD does nothing without LIMITED. 2020-10-31T22:37:27.182 INFO:teuthology.orchestra.run.smithi066.stdout:31 Oct 22:37:27 ntpd[8598]: Listen normally on 2 lo 127.0.0.1:123 2020-10-31T22:37:27.183 INFO:teuthology.orchestra.run.smithi066.stdout:31 Oct 22:37:27 ntpd[8598]: Listen normally on 3 enp3s0f1 172.21.15.66:123 2020-10-31T22:37:27.183 INFO:teuthology.orchestra.run.smithi066.stdout:31 Oct 22:37:27 ntpd[8598]: Listen normally on 4 lo [::1]:123 2020-10-31T22:37:27.183 INFO:teuthology.orchestra.run.smithi066.stdout:31 Oct 22:37:27 ntpd[8598]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:f8bd%5]:123 2020-10-31T22:37:27.183 INFO:teuthology.orchestra.run.smithi066.stdout:31 Oct 22:37:27 ntpd[8598]: Listening on routing socket on fd #22 for interface updates 2020-10-31T22:37:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:29 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:29 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:29 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:29.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:29 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:30 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:30 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:30 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:30.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:30 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:31.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:31 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:31.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:31 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:31.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:31 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:31.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:31 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:31.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:31 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:31.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:31 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:31.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:31 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:31.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:31 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:32.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:32 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:32.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:32 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:32 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:32 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:32 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:32 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:32 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:32.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:32 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:33.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:33 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:33.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:33 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:33.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:33 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:33.182 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:33 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:33.182 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:33 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:33.182 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:33 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:33.183 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:33 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:33.183 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:33 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:34.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:34 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:34.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:34 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:34.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:34 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:34.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:34 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:34.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:34 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:34.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:34 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:34.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:34 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:34.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:34 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:35.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:35 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:35.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:35 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:35.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:35 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:35.180 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:35 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:35.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:35 ntpd[8598]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-10-31T22:37:35.181 INFO:teuthology.orchestra.run.smithi066.stderr:31 Oct 22:37:35 ntpd[8598]: can't open /var/log/ntpstats/loopstats.20201031: Permission denied 2020-10-31T22:37:35.182 INFO:teuthology.orchestra.run.smithi066.stdout:31 Oct 22:37:35 ntpd[8598]: ntpd: time slew -0.000135 s 2020-10-31T22:37:35.182 INFO:teuthology.orchestra.run.smithi066.stdout:ntpd: time slew -0.000135s 2020-10-31T22:37:35.238 INFO:teuthology.orchestra.run.smithi066.stdout: remote refid st t when poll reach delay offset jitter 2020-10-31T22:37:35.239 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================== 2020-10-31T22:37:35.239 INFO:teuthology.orchestra.run.smithi066.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:35.240 INFO:teuthology.orchestra.run.smithi066.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:35.240 INFO:teuthology.orchestra.run.smithi066.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:35.240 INFO:teuthology.orchestra.run.smithi066.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:35.241 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-10-31T22:37:35.241 INFO:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-10-31T22:37:35.312 INFO:teuthology.orchestra.run.smithi152.stdout:31 Oct 22:37:35 ntpd[8620]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-10-31T22:37:35.313 INFO:teuthology.orchestra.run.smithi152.stdout:31 Oct 22:37:35 ntpd[8620]: Command line: ntpd -gq 2020-10-31T22:37:35.315 INFO:teuthology.orchestra.run.smithi152.stdout:31 Oct 22:37:35 ntpd[8620]: proto: precision = 0.126 usec (-23) 2020-10-31T22:37:35.315 INFO:teuthology.orchestra.run.smithi152.stdout:31 Oct 22:37:35 ntpd[8620]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-10-31T22:37:35.315 INFO:teuthology.orchestra.run.smithi152.stdout:31 Oct 22:37:35 ntpd[8620]: restrict ::: KOD does nothing without LIMITED. 2020-10-31T22:37:35.315 INFO:teuthology.orchestra.run.smithi152.stdout:31 Oct 22:37:35 ntpd[8620]: Listen and drop on 0 v6wildcard [::]:123 2020-10-31T22:37:35.316 INFO:teuthology.orchestra.run.smithi152.stdout:31 Oct 22:37:35 ntpd[8620]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-10-31T22:37:35.316 INFO:teuthology.orchestra.run.smithi152.stdout:31 Oct 22:37:35 ntpd[8620]: Listen normally on 2 lo 127.0.0.1:123 2020-10-31T22:37:35.316 INFO:teuthology.orchestra.run.smithi152.stdout:31 Oct 22:37:35 ntpd[8620]: Listen normally on 3 enp3s0f1 172.21.15.152:123 2020-10-31T22:37:35.317 INFO:teuthology.orchestra.run.smithi152.stdout:31 Oct 22:37:35 ntpd[8620]: Listen normally on 4 lo [::1]:123 2020-10-31T22:37:35.317 INFO:teuthology.orchestra.run.smithi152.stdout:31 Oct 22:37:35 ntpd[8620]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de3%5]:123 2020-10-31T22:37:35.317 INFO:teuthology.orchestra.run.smithi152.stdout:31 Oct 22:37:35 ntpd[8620]: Listening on routing socket on fd #22 for interface updates 2020-10-31T22:37:35.317 INFO:teuthology.orchestra.run.smithi152.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-10-31T22:37:35.318 INFO:teuthology.orchestra.run.smithi152.stderr:restrict ::: KOD does nothing without LIMITED. 2020-10-31T22:37:36.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:36 ntpd[8620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:36.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:36 ntpd[8620]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:36.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:36 ntpd[8620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:36.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:36 ntpd[8620]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:37.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:37 ntpd[8620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:37.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:37 ntpd[8620]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:37.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:37 ntpd[8620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:37.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:37 ntpd[8620]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:38.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:38 ntpd[8620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:38.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:38 ntpd[8620]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:38.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:38 ntpd[8620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:38.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:38 ntpd[8620]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:38.314 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:38 ntpd[8620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:38.314 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:38 ntpd[8620]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:38.314 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:38 ntpd[8620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:38.314 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:38 ntpd[8620]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:39.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:39 ntpd[8620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:39.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:39 ntpd[8620]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:39.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:39 ntpd[8620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:39.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:39 ntpd[8620]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:40.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:40 ntpd[8620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:40.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:40 ntpd[8620]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:40.314 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:40 ntpd[8620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:40.314 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:40 ntpd[8620]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:40.314 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:40 ntpd[8620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:40.314 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:40 ntpd[8620]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:40.314 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:40 ntpd[8620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:40.314 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:40 ntpd[8620]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:40.316 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:40 ntpd[8620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:40.316 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:40 ntpd[8620]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:40.316 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:40 ntpd[8620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:40.316 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:40 ntpd[8620]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:41.312 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:41 ntpd[8620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:41.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:41 ntpd[8620]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:41.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:41 ntpd[8620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:41.313 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:41 ntpd[8620]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:42.316 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:42 ntpd[8620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:42.317 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:42 ntpd[8620]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:42.317 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:42 ntpd[8620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:42.317 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:42 ntpd[8620]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:42.317 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:42 ntpd[8620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:42.318 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:42 ntpd[8620]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:42.318 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:42 ntpd[8620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:42.318 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:42 ntpd[8620]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:42.319 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:42 ntpd[8620]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:42.319 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:42 ntpd[8620]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:42.319 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:42 ntpd[8620]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:42.320 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:42 ntpd[8620]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:42.320 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:42 ntpd[8620]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-10-31T22:37:42.320 INFO:teuthology.orchestra.run.smithi152.stderr:31 Oct 22:37:42 ntpd[8620]: can't open /var/log/ntpstats/loopstats.20201031: Permission denied 2020-10-31T22:37:42.321 INFO:teuthology.orchestra.run.smithi152.stdout:31 Oct 22:37:42 ntpd[8620]: ntpd: time slew -0.006151 s 2020-10-31T22:37:42.321 INFO:teuthology.orchestra.run.smithi152.stdout:ntpd: time slew -0.006151s 2020-10-31T22:37:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: remote refid st t when poll reach delay offset jitter 2020-10-31T22:37:42.373 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================== 2020-10-31T22:37:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:42.374 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-10-31T22:37:42.375 INFO:teuthology.orchestra.run.smithi085:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-10-31T22:37:42.438 INFO:teuthology.orchestra.run.smithi085.stdout:31 Oct 22:37:42 ntpd[8598]: ntpd 4.2.8p10@1.3728-o (1): Starting 2020-10-31T22:37:42.438 INFO:teuthology.orchestra.run.smithi085.stdout:31 Oct 22:37:42 ntpd[8598]: Command line: ntpd -gq 2020-10-31T22:37:42.439 INFO:teuthology.orchestra.run.smithi085.stdout:31 Oct 22:37:42 ntpd[8598]: proto: precision = 0.114 usec (-23) 2020-10-31T22:37:42.439 INFO:teuthology.orchestra.run.smithi085.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-10-31T22:37:42.440 INFO:teuthology.orchestra.run.smithi085.stderr:restrict ::: KOD does nothing without LIMITED. 2020-10-31T22:37:42.440 INFO:teuthology.orchestra.run.smithi085.stdout:31 Oct 22:37:42 ntpd[8598]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2020-10-31T22:37:42.440 INFO:teuthology.orchestra.run.smithi085.stdout:31 Oct 22:37:42 ntpd[8598]: restrict ::: KOD does nothing without LIMITED. 2020-10-31T22:37:42.440 INFO:teuthology.orchestra.run.smithi085.stdout:31 Oct 22:37:42 ntpd[8598]: Listen and drop on 0 v6wildcard [::]:123 2020-10-31T22:37:42.440 INFO:teuthology.orchestra.run.smithi085.stdout:31 Oct 22:37:42 ntpd[8598]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2020-10-31T22:37:42.441 INFO:teuthology.orchestra.run.smithi085.stdout:31 Oct 22:37:42 ntpd[8598]: Listen normally on 2 lo 127.0.0.1:123 2020-10-31T22:37:42.441 INFO:teuthology.orchestra.run.smithi085.stdout:31 Oct 22:37:42 ntpd[8598]: Listen normally on 3 enp3s0f1 172.21.15.85:123 2020-10-31T22:37:42.441 INFO:teuthology.orchestra.run.smithi085.stdout:31 Oct 22:37:42 ntpd[8598]: Listen normally on 4 lo [::1]:123 2020-10-31T22:37:42.442 INFO:teuthology.orchestra.run.smithi085.stdout:31 Oct 22:37:42 ntpd[8598]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d7bb%5]:123 2020-10-31T22:37:42.442 INFO:teuthology.orchestra.run.smithi085.stdout:31 Oct 22:37:42 ntpd[8598]: Listening on routing socket on fd #22 for interface updates 2020-10-31T22:37:43.439 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:43 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:43.439 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:43 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:43.439 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:43 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:43.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:43 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:43.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:43 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:43.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:43 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:43.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:43 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:43.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:43 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:43.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:43 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:43.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:43 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:43.441 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:43 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:43.441 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:43 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:45.439 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:45 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:45.439 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:45 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:45.439 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:45 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:45.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:45 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:45.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:45 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:45.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:45 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:45.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:45 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:45.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:45 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:45.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:45 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:45.441 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:45 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:45.441 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:45 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:45.441 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:45 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:47.439 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:47.439 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:47.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:47.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:47.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:47.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:47.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:47.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:47.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:47.441 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:47.441 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:47.441 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:47.441 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:47.441 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:47.441 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:47.441 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:47 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:49.439 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:49 ntpd[8598]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2020-10-31T22:37:49.439 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:49 ntpd[8598]: can't open /var/log/ntpstats/rawstats.20201031: Permission denied 2020-10-31T22:37:49.439 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:49 ntpd[8598]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2020-10-31T22:37:49.439 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:49 ntpd[8598]: can't open /var/log/ntpstats/peerstats.20201031: Permission denied 2020-10-31T22:37:49.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:49 ntpd[8598]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2020-10-31T22:37:49.440 INFO:teuthology.orchestra.run.smithi085.stderr:31 Oct 22:37:49 ntpd[8598]: can't open /var/log/ntpstats/loopstats.20201031: Permission denied 2020-10-31T22:37:49.440 INFO:teuthology.orchestra.run.smithi085.stdout:31 Oct 22:37:49 ntpd[8598]: ntpd: time slew -0.002627 s 2020-10-31T22:37:49.440 INFO:teuthology.orchestra.run.smithi085.stdout:ntpd: time slew -0.002627s 2020-10-31T22:37:49.490 INFO:teuthology.orchestra.run.smithi085.stdout: remote refid st t when poll reach delay offset jitter 2020-10-31T22:37:49.490 INFO:teuthology.orchestra.run.smithi085.stdout:============================================================================== 2020-10-31T22:37:49.490 INFO:teuthology.orchestra.run.smithi085.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:49.490 INFO:teuthology.orchestra.run.smithi085.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:49.490 INFO:teuthology.orchestra.run.smithi085.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:49.491 INFO:teuthology.orchestra.run.smithi085.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2020-10-31T22:37:49.491 INFO:teuthology.run_tasks:Running task install... 2020-10-31T22:37:49.502 DEBUG:teuthology.task.install:project ceph 2020-10-31T22:37:49.503 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '5e705cd08d99a37f9ec3c2b451d90f6262257c7c'}} 2020-10-31T22:37:49.503 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '5e705cd08d99a37f9ec3c2b451d90f6262257c7c'} 2020-10-31T22:37:49.503 INFO:teuthology.task.install:Using flavor: basic 2020-10-31T22:37:49.510 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-10-31T22:37:49.511 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-10-31T22:37:49.511 INFO:teuthology.orchestra.run.smithi060:> sudo lsb_release -is 2020-10-31T22:37:49.564 INFO:teuthology.orchestra.run.smithi060.stdout:Ubuntu 2020-10-31T22:37:49.569 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-31T22:37:49.569 INFO:teuthology.orchestra.run.smithi066:> sudo lsb_release -is 2020-10-31T22:37:49.570 INFO:teuthology.orchestra.run.smithi060:> sudo apt-key list | grep Ceph 2020-10-31T22:37:49.627 INFO:teuthology.orchestra.run.smithi066.stdout:Ubuntu 2020-10-31T22:37:49.632 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-31T22:37:49.632 INFO:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2020-10-31T22:37:49.633 INFO:teuthology.orchestra.run.smithi066:> sudo apt-key list | grep Ceph 2020-10-31T22:37:49.666 INFO:teuthology.orchestra.run.smithi060.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-10-31T22:37:49.680 INFO:teuthology.orchestra.run.smithi152.stdout:Ubuntu 2020-10-31T22:37:49.685 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-31T22:37:49.686 INFO:teuthology.orchestra.run.smithi085:> sudo lsb_release -is 2020-10-31T22:37:49.687 INFO:teuthology.orchestra.run.smithi152:> sudo apt-key list | grep Ceph 2020-10-31T22:37:49.724 INFO:teuthology.orchestra.run.smithi060.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-10-31T22:37:49.724 INFO:teuthology.orchestra.run.smithi060.stdout:uid [ unknown] Ceph.com (release key) 2020-10-31T22:37:49.726 INFO:teuthology.orchestra.run.smithi060:> sudo lsb_release -is 2020-10-31T22:37:49.727 INFO:teuthology.orchestra.run.smithi066.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-10-31T22:37:49.739 INFO:teuthology.orchestra.run.smithi085.stdout:Ubuntu 2020-10-31T22:37:49.744 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-31T22:37:49.745 INFO:teuthology.orchestra.run.smithi085:> sudo apt-key list | grep Ceph 2020-10-31T22:37:49.777 INFO:teuthology.orchestra.run.smithi060.stdout:Ubuntu 2020-10-31T22:37:49.782 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-31T22:37:49.783 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2020-10-31T22:37:49.783 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2020-10-31T22:37:49.784 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=5e705cd08d99a37f9ec3c2b451d90f6262257c7c 2020-10-31T22:37:49.791 INFO:teuthology.orchestra.run.smithi152.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-10-31T22:37:49.792 INFO:teuthology.orchestra.run.smithi066.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-10-31T22:37:49.792 INFO:teuthology.orchestra.run.smithi066.stdout:uid [ unknown] Ceph.com (release key) 2020-10-31T22:37:49.793 INFO:teuthology.orchestra.run.smithi066:> sudo lsb_release -is 2020-10-31T22:37:49.842 INFO:teuthology.orchestra.run.smithi085.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2020-10-31T22:37:49.845 INFO:teuthology.orchestra.run.smithi152.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-10-31T22:37:49.846 INFO:teuthology.orchestra.run.smithi152.stdout:uid [ unknown] Ceph.com (release key) 2020-10-31T22:37:49.846 INFO:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2020-10-31T22:37:49.848 INFO:teuthology.orchestra.run.smithi066.stdout:Ubuntu 2020-10-31T22:37:49.850 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-31T22:37:49.850 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2020-10-31T22:37:49.851 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2020-10-31T22:37:49.851 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=5e705cd08d99a37f9ec3c2b451d90f6262257c7c 2020-10-31T22:37:49.898 INFO:teuthology.orchestra.run.smithi085.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2020-10-31T22:37:49.899 INFO:teuthology.orchestra.run.smithi085.stdout:uid [ unknown] Ceph.com (release key) 2020-10-31T22:37:49.900 INFO:teuthology.orchestra.run.smithi152.stdout:Ubuntu 2020-10-31T22:37:49.900 INFO:teuthology.orchestra.run.smithi085:> sudo lsb_release -is 2020-10-31T22:37:49.904 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-31T22:37:49.904 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2020-10-31T22:37:49.904 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2020-10-31T22:37:49.905 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=5e705cd08d99a37f9ec3c2b451d90f6262257c7c 2020-10-31T22:37:49.951 INFO:teuthology.orchestra.run.smithi085.stdout:Ubuntu 2020-10-31T22:37:49.958 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default/ 2020-10-31T22:37:49.959 INFO:teuthology.task.install.deb:Package version is 15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:37:49.966 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-31T22:37:49.966 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell on remote deb x86_64 2020-10-31T22:37:49.967 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2020-10-31T22:37:49.967 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=5e705cd08d99a37f9ec3c2b451d90f6262257c7c 2020-10-31T22:37:50.020 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default/ 2020-10-31T22:37:50.020 INFO:teuthology.task.install.deb:Package version is 15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:37:50.083 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default/ 2020-10-31T22:37:50.084 INFO:teuthology.task.install.deb:Package version is 15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:37:50.097 INFO:teuthology.orchestra.run.smithi060:> set -ex 2020-10-31T22:37:50.098 INFO:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-10-31T22:37:50.103 INFO:teuthology.orchestra.run.smithi060.stderr:+ sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-10-31T22:37:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records in 2020-10-31T22:37:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records out 2020-10-31T22:37:50.118 INFO:teuthology.orchestra.run.smithi060.stderr:143 bytes copied, 6.6463e-05 s, 2.2 MB/s 2020-10-31T22:37:50.118 INFO:teuthology.orchestra.run.smithi060:> sudo apt-get update 2020-10-31T22:37:50.139 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default/ 2020-10-31T22:37:50.139 INFO:teuthology.task.install.deb:Package version is 15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:37:50.144 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-10-31T22:37:50.145 INFO:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-10-31T22:37:50.149 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-10-31T22:37:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-10-31T22:37:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-10-31T22:37:50.159 INFO:teuthology.orchestra.run.smithi066.stderr:143 bytes copied, 6.8333e-05 s, 2.1 MB/s 2020-10-31T22:37:50.160 INFO:teuthology.orchestra.run.smithi066:> sudo apt-get update 2020-10-31T22:37:50.215 INFO:teuthology.orchestra.run.smithi152:> set -ex 2020-10-31T22:37:50.216 INFO:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-10-31T22:37:50.222 INFO:teuthology.orchestra.run.smithi152.stderr:+ sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-10-31T22:37:50.231 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2020-10-31T22:37:50.231 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2020-10-31T22:37:50.231 INFO:teuthology.orchestra.run.smithi152.stderr:143 bytes copied, 7.27e-05 s, 2.0 MB/s 2020-10-31T22:37:50.232 INFO:teuthology.orchestra.run.smithi152:> sudo apt-get update 2020-10-31T22:37:50.264 INFO:teuthology.orchestra.run.smithi085:> set -ex 2020-10-31T22:37:50.265 INFO:teuthology.orchestra.run.smithi085:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-10-31T22:37:50.270 INFO:teuthology.orchestra.run.smithi085.stderr:+ sudo dd of=/etc/apt/sources.list.d/ceph.list 2020-10-31T22:37:50.279 INFO:teuthology.orchestra.run.smithi085.stderr:0+1 records in 2020-10-31T22:37:50.279 INFO:teuthology.orchestra.run.smithi085.stderr:0+1 records out 2020-10-31T22:37:50.280 INFO:teuthology.orchestra.run.smithi085.stderr:143 bytes copied, 6.8696e-05 s, 2.1 MB/s 2020-10-31T22:37:50.280 INFO:teuthology.orchestra.run.smithi085:> sudo apt-get update 2020-10-31T22:37:50.380 INFO:teuthology.orchestra.run.smithi060.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic InRelease 2020-10-31T22:37:50.403 INFO:teuthology.orchestra.run.smithi060.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2020-10-31T22:37:50.417 INFO:teuthology.orchestra.run.smithi060.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-10-31T22:37:50.418 INFO:teuthology.orchestra.run.smithi060.stdout:Hit:4 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-10-31T22:37:50.429 INFO:teuthology.orchestra.run.smithi060.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic Release.gpg 2020-10-31T22:37:50.431 INFO:teuthology.orchestra.run.smithi066.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic InRelease 2020-10-31T22:37:50.453 INFO:teuthology.orchestra.run.smithi060.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2020-10-31T22:37:50.454 INFO:teuthology.orchestra.run.smithi085.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-10-31T22:37:50.455 INFO:teuthology.orchestra.run.smithi066.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2020-10-31T22:37:50.469 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-10-31T22:37:50.479 INFO:teuthology.orchestra.run.smithi066.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic Release.gpg 2020-10-31T22:37:50.484 INFO:teuthology.orchestra.run.smithi060.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-10-31T22:37:50.488 INFO:teuthology.orchestra.run.smithi060.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,090 B] 2020-10-31T22:37:50.503 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,090 B] 2020-10-31T22:37:50.510 INFO:teuthology.orchestra.run.smithi152.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic InRelease 2020-10-31T22:37:50.533 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-10-31T22:37:50.533 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2020-10-31T22:37:50.535 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:6 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-10-31T22:37:50.537 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2020-10-31T22:37:50.549 INFO:teuthology.orchestra.run.smithi085.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic InRelease 2020-10-31T22:37:50.558 INFO:teuthology.orchestra.run.smithi152.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic Release.gpg 2020-10-31T22:37:50.562 INFO:teuthology.orchestra.run.smithi060.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-10-31T22:37:50.572 INFO:teuthology.orchestra.run.smithi085.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic InRelease 2020-10-31T22:37:50.572 INFO:teuthology.orchestra.run.smithi085.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic Release [7,681 B] 2020-10-31T22:37:50.581 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2020-10-31T22:37:50.597 INFO:teuthology.orchestra.run.smithi085.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic Release.gpg 2020-10-31T22:37:50.602 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:6 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-10-31T22:37:50.614 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-10-31T22:37:50.616 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,090 B] 2020-10-31T22:37:50.621 INFO:teuthology.orchestra.run.smithi085.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.8 kB] 2020-10-31T22:37:50.651 INFO:teuthology.orchestra.run.smithi085.stdout:Hit:7 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2020-10-31T22:37:50.652 INFO:teuthology.orchestra.run.smithi085.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main i386 Packages [3,090 B] 2020-10-31T22:37:50.682 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-10-31T22:37:50.730 INFO:teuthology.orchestra.run.smithi085.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2020-10-31T22:37:50.963 INFO:teuthology.orchestra.run.smithi066.stdout:Hit:9 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-10-31T22:37:51.024 INFO:teuthology.orchestra.run.smithi152.stdout:Hit:9 http://security.ubuntu.com/ubuntu bionic-security InRelease 2020-10-31T22:37:51.046 INFO:teuthology.orchestra.run.smithi060.stdout:Fetched 26.5 kB in 1s (36.4 kB/s) 2020-10-31T22:37:51.049 INFO:teuthology.orchestra.run.smithi085.stdout:Fetched 26.5 kB in 1s (47.2 kB/s) 2020-10-31T22:37:51.174 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 26.5 kB in 1s (33.0 kB/s) 2020-10-31T22:37:51.233 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 26.5 kB in 1s (33.2 kB/s) 2020-10-31T22:37:52.287 INFO:teuthology.orchestra.run.smithi085.stdout:Reading package lists... 2020-10-31T22:37:52.312 INFO:teuthology.orchestra.run.smithi060.stdout:Reading package lists... 2020-10-31T22:37:52.324 INFO:teuthology.orchestra.run.smithi085:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.5-488-g5e705cd0-1bionic cephadm=15.2.5-488-g5e705cd0-1bionic ceph-mds=15.2.5-488-g5e705cd0-1bionic ceph-mgr=15.2.5-488-g5e705cd0-1bionic ceph-common=15.2.5-488-g5e705cd0-1bionic ceph-fuse=15.2.5-488-g5e705cd0-1bionic ceph-test=15.2.5-488-g5e705cd0-1bionic radosgw=15.2.5-488-g5e705cd0-1bionic python3-rados=15.2.5-488-g5e705cd0-1bionic python3-rgw=15.2.5-488-g5e705cd0-1bionic python3-cephfs=15.2.5-488-g5e705cd0-1bionic python3-rbd=15.2.5-488-g5e705cd0-1bionic libcephfs2=15.2.5-488-g5e705cd0-1bionic libcephfs-dev=15.2.5-488-g5e705cd0-1bionic librados2=15.2.5-488-g5e705cd0-1bionic librbd1=15.2.5-488-g5e705cd0-1bionic rbd-fuse=15.2.5-488-g5e705cd0-1bionic python3-cephfs=15.2.5-488-g5e705cd0-1bionic cephfs-shell=15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:37:52.360 INFO:teuthology.orchestra.run.smithi060:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.5-488-g5e705cd0-1bionic cephadm=15.2.5-488-g5e705cd0-1bionic ceph-mds=15.2.5-488-g5e705cd0-1bionic ceph-mgr=15.2.5-488-g5e705cd0-1bionic ceph-common=15.2.5-488-g5e705cd0-1bionic ceph-fuse=15.2.5-488-g5e705cd0-1bionic ceph-test=15.2.5-488-g5e705cd0-1bionic radosgw=15.2.5-488-g5e705cd0-1bionic python3-rados=15.2.5-488-g5e705cd0-1bionic python3-rgw=15.2.5-488-g5e705cd0-1bionic python3-cephfs=15.2.5-488-g5e705cd0-1bionic python3-rbd=15.2.5-488-g5e705cd0-1bionic libcephfs2=15.2.5-488-g5e705cd0-1bionic libcephfs-dev=15.2.5-488-g5e705cd0-1bionic librados2=15.2.5-488-g5e705cd0-1bionic librbd1=15.2.5-488-g5e705cd0-1bionic rbd-fuse=15.2.5-488-g5e705cd0-1bionic python3-cephfs=15.2.5-488-g5e705cd0-1bionic cephfs-shell=15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:37:52.400 INFO:teuthology.orchestra.run.smithi085.stdout:Reading package lists... 2020-10-31T22:37:52.439 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2020-10-31T22:37:52.446 INFO:teuthology.orchestra.run.smithi060.stdout:Reading package lists... 2020-10-31T22:37:52.490 INFO:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.5-488-g5e705cd0-1bionic cephadm=15.2.5-488-g5e705cd0-1bionic ceph-mds=15.2.5-488-g5e705cd0-1bionic ceph-mgr=15.2.5-488-g5e705cd0-1bionic ceph-common=15.2.5-488-g5e705cd0-1bionic ceph-fuse=15.2.5-488-g5e705cd0-1bionic ceph-test=15.2.5-488-g5e705cd0-1bionic radosgw=15.2.5-488-g5e705cd0-1bionic python3-rados=15.2.5-488-g5e705cd0-1bionic python3-rgw=15.2.5-488-g5e705cd0-1bionic python3-cephfs=15.2.5-488-g5e705cd0-1bionic python3-rbd=15.2.5-488-g5e705cd0-1bionic libcephfs2=15.2.5-488-g5e705cd0-1bionic libcephfs-dev=15.2.5-488-g5e705cd0-1bionic librados2=15.2.5-488-g5e705cd0-1bionic librbd1=15.2.5-488-g5e705cd0-1bionic rbd-fuse=15.2.5-488-g5e705cd0-1bionic python3-cephfs=15.2.5-488-g5e705cd0-1bionic cephfs-shell=15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:37:52.571 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2020-10-31T22:37:52.627 INFO:teuthology.orchestra.run.smithi085.stdout:Building dependency tree... 2020-10-31T22:37:52.628 INFO:teuthology.orchestra.run.smithi085.stdout:Reading state information... 2020-10-31T22:37:52.678 INFO:teuthology.orchestra.run.smithi060.stdout:Building dependency tree... 2020-10-31T22:37:52.679 INFO:teuthology.orchestra.run.smithi060.stdout:Reading state information... 2020-10-31T22:37:52.688 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2020-10-31T22:37:52.742 INFO:teuthology.orchestra.run.smithi152:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.5-488-g5e705cd0-1bionic cephadm=15.2.5-488-g5e705cd0-1bionic ceph-mds=15.2.5-488-g5e705cd0-1bionic ceph-mgr=15.2.5-488-g5e705cd0-1bionic ceph-common=15.2.5-488-g5e705cd0-1bionic ceph-fuse=15.2.5-488-g5e705cd0-1bionic ceph-test=15.2.5-488-g5e705cd0-1bionic radosgw=15.2.5-488-g5e705cd0-1bionic python3-rados=15.2.5-488-g5e705cd0-1bionic python3-rgw=15.2.5-488-g5e705cd0-1bionic python3-cephfs=15.2.5-488-g5e705cd0-1bionic python3-rbd=15.2.5-488-g5e705cd0-1bionic libcephfs2=15.2.5-488-g5e705cd0-1bionic libcephfs-dev=15.2.5-488-g5e705cd0-1bionic librados2=15.2.5-488-g5e705cd0-1bionic librbd1=15.2.5-488-g5e705cd0-1bionic rbd-fuse=15.2.5-488-g5e705cd0-1bionic python3-cephfs=15.2.5-488-g5e705cd0-1bionic cephfs-shell=15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:37:52.788 INFO:teuthology.orchestra.run.smithi085.stdout:The following additional packages will be installed: 2020-10-31T22:37:52.788 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-10-31T22:37:52.789 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-10-31T22:37:52.790 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2020-10-31T22:37:52.790 INFO:teuthology.orchestra.run.smithi085.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2020-10-31T22:37:52.791 INFO:teuthology.orchestra.run.smithi085.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2020-10-31T22:37:52.791 INFO:teuthology.orchestra.run.smithi085.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2020-10-31T22:37:52.791 INFO:teuthology.orchestra.run.smithi085.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-10-31T22:37:52.791 INFO:teuthology.orchestra.run.smithi085.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2020-10-31T22:37:52.791 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2020-10-31T22:37:52.791 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2020-10-31T22:37:52.791 INFO:teuthology.orchestra.run.smithi085.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2020-10-31T22:37:52.792 INFO:teuthology.orchestra.run.smithi085.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2020-10-31T22:37:52.792 INFO:teuthology.orchestra.run.smithi085.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-10-31T22:37:52.792 INFO:teuthology.orchestra.run.smithi085.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2020-10-31T22:37:52.792 INFO:teuthology.orchestra.run.smithi085.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2020-10-31T22:37:52.792 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2020-10-31T22:37:52.792 INFO:teuthology.orchestra.run.smithi085.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2020-10-31T22:37:52.792 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2020-10-31T22:37:52.793 INFO:teuthology.orchestra.run.smithi085.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-10-31T22:37:52.793 INFO:teuthology.orchestra.run.smithi085.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-10-31T22:37:52.793 INFO:teuthology.orchestra.run.smithi085.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-10-31T22:37:52.793 INFO:teuthology.orchestra.run.smithi085.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-10-31T22:37:52.793 INFO:teuthology.orchestra.run.smithi085.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-10-31T22:37:52.793 INFO:teuthology.orchestra.run.smithi085.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-10-31T22:37:52.794 INFO:teuthology.orchestra.run.smithi085.stdout:Suggested packages: 2020-10-31T22:37:52.794 INFO:teuthology.orchestra.run.smithi085.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-10-31T22:37:52.794 INFO:teuthology.orchestra.run.smithi085.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-10-31T22:37:52.794 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2020-10-31T22:37:52.794 INFO:teuthology.orchestra.run.smithi085.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2020-10-31T22:37:52.795 INFO:teuthology.orchestra.run.smithi085.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2020-10-31T22:37:52.795 INFO:teuthology.orchestra.run.smithi085.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2020-10-31T22:37:52.795 INFO:teuthology.orchestra.run.smithi085.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2020-10-31T22:37:52.795 INFO:teuthology.orchestra.run.smithi085.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2020-10-31T22:37:52.795 INFO:teuthology.orchestra.run.smithi085.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2020-10-31T22:37:52.795 INFO:teuthology.orchestra.run.smithi085.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2020-10-31T22:37:52.795 INFO:teuthology.orchestra.run.smithi085.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2020-10-31T22:37:52.796 INFO:teuthology.orchestra.run.smithi085.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2020-10-31T22:37:52.796 INFO:teuthology.orchestra.run.smithi085.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2020-10-31T22:37:52.796 INFO:teuthology.orchestra.run.smithi085.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2020-10-31T22:37:52.796 INFO:teuthology.orchestra.run.smithi085.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2020-10-31T22:37:52.815 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2020-10-31T22:37:52.816 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2020-10-31T22:37:52.821 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2020-10-31T22:37:52.856 INFO:teuthology.orchestra.run.smithi060.stdout:The following additional packages will be installed: 2020-10-31T22:37:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-10-31T22:37:52.857 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-10-31T22:37:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2020-10-31T22:37:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2020-10-31T22:37:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2020-10-31T22:37:52.858 INFO:teuthology.orchestra.run.smithi060.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2020-10-31T22:37:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-10-31T22:37:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2020-10-31T22:37:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2020-10-31T22:37:52.859 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2020-10-31T22:37:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2020-10-31T22:37:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2020-10-31T22:37:52.860 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-10-31T22:37:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2020-10-31T22:37:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2020-10-31T22:37:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2020-10-31T22:37:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2020-10-31T22:37:52.861 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2020-10-31T22:37:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-10-31T22:37:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-10-31T22:37:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-10-31T22:37:52.862 INFO:teuthology.orchestra.run.smithi060.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-10-31T22:37:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-10-31T22:37:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-10-31T22:37:52.863 INFO:teuthology.orchestra.run.smithi060.stdout:Suggested packages: 2020-10-31T22:37:52.863 INFO:teuthology.orchestra.run.smithi060.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-10-31T22:37:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-10-31T22:37:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2020-10-31T22:37:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2020-10-31T22:37:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2020-10-31T22:37:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2020-10-31T22:37:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2020-10-31T22:37:52.864 INFO:teuthology.orchestra.run.smithi060.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2020-10-31T22:37:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2020-10-31T22:37:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2020-10-31T22:37:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2020-10-31T22:37:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2020-10-31T22:37:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2020-10-31T22:37:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2020-10-31T22:37:52.865 INFO:teuthology.orchestra.run.smithi060.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2020-10-31T22:37:52.894 INFO:teuthology.orchestra.run.smithi085.stdout:The following NEW packages will be installed: 2020-10-31T22:37:52.895 INFO:teuthology.orchestra.run.smithi085.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-10-31T22:37:52.895 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-10-31T22:37:52.896 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-10-31T22:37:52.896 INFO:teuthology.orchestra.run.smithi085.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2020-10-31T22:37:52.897 INFO:teuthology.orchestra.run.smithi085.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2020-10-31T22:37:52.898 INFO:teuthology.orchestra.run.smithi085.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2020-10-31T22:37:52.898 INFO:teuthology.orchestra.run.smithi085.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2020-10-31T22:37:52.898 INFO:teuthology.orchestra.run.smithi085.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2020-10-31T22:37:52.899 INFO:teuthology.orchestra.run.smithi085.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2020-10-31T22:37:52.899 INFO:teuthology.orchestra.run.smithi085.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cmd2 2020-10-31T22:37:52.899 INFO:teuthology.orchestra.run.smithi085.stdout: python3-colorama python3-cryptography python3-cycler python3-dateutil 2020-10-31T22:37:52.899 INFO:teuthology.orchestra.run.smithi085.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2020-10-31T22:37:52.900 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-10-31T22:37:52.900 INFO:teuthology.orchestra.run.smithi085.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-10-31T22:37:52.900 INFO:teuthology.orchestra.run.smithi085.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-10-31T22:37:52.901 INFO:teuthology.orchestra.run.smithi085.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-10-31T22:37:52.901 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-10-31T22:37:52.901 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-10-31T22:37:52.901 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2020-10-31T22:37:52.902 INFO:teuthology.orchestra.run.smithi085.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2020-10-31T22:37:52.902 INFO:teuthology.orchestra.run.smithi085.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2020-10-31T22:37:52.902 INFO:teuthology.orchestra.run.smithi085.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-10-31T22:37:52.903 INFO:teuthology.orchestra.run.smithi085.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-10-31T22:37:52.903 INFO:teuthology.orchestra.run.smithi085.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2020-10-31T22:37:52.903 INFO:teuthology.orchestra.run.smithi085.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2020-10-31T22:37:52.903 INFO:teuthology.orchestra.run.smithi085.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2020-10-31T22:37:52.903 INFO:teuthology.orchestra.run.smithi085.stdout:The following packages will be upgraded: 2020-10-31T22:37:52.904 INFO:teuthology.orchestra.run.smithi085.stdout: librados2 librbd1 2020-10-31T22:37:52.973 INFO:teuthology.orchestra.run.smithi060.stdout:The following NEW packages will be installed: 2020-10-31T22:37:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-10-31T22:37:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-10-31T22:37:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-10-31T22:37:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2020-10-31T22:37:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2020-10-31T22:37:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2020-10-31T22:37:52.974 INFO:teuthology.orchestra.run.smithi060.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2020-10-31T22:37:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2020-10-31T22:37:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2020-10-31T22:37:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cmd2 2020-10-31T22:37:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama python3-cryptography python3-cycler python3-dateutil 2020-10-31T22:37:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2020-10-31T22:37:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-10-31T22:37:52.975 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-10-31T22:37:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-10-31T22:37:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-10-31T22:37:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-10-31T22:37:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-10-31T22:37:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2020-10-31T22:37:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2020-10-31T22:37:52.976 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2020-10-31T22:37:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-10-31T22:37:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-10-31T22:37:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2020-10-31T22:37:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2020-10-31T22:37:52.977 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2020-10-31T22:37:52.978 INFO:teuthology.orchestra.run.smithi060.stdout:The following packages will be upgraded: 2020-10-31T22:37:52.978 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 librbd1 2020-10-31T22:37:52.995 INFO:teuthology.orchestra.run.smithi066.stdout:The following additional packages will be installed: 2020-10-31T22:37:52.995 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-10-31T22:37:52.996 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-10-31T22:37:52.998 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2020-10-31T22:37:52.998 INFO:teuthology.orchestra.run.smithi066.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2020-10-31T22:37:52.998 INFO:teuthology.orchestra.run.smithi066.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2020-10-31T22:37:52.998 INFO:teuthology.orchestra.run.smithi066.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2020-10-31T22:37:52.998 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-10-31T22:37:52.999 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2020-10-31T22:37:52.999 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2020-10-31T22:37:52.999 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2020-10-31T22:37:52.999 INFO:teuthology.orchestra.run.smithi066.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2020-10-31T22:37:52.999 INFO:teuthology.orchestra.run.smithi066.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2020-10-31T22:37:52.999 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-10-31T22:37:53.000 INFO:teuthology.orchestra.run.smithi066.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2020-10-31T22:37:53.000 INFO:teuthology.orchestra.run.smithi066.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2020-10-31T22:37:53.000 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2020-10-31T22:37:53.000 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2020-10-31T22:37:53.000 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2020-10-31T22:37:53.000 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-10-31T22:37:53.000 INFO:teuthology.orchestra.run.smithi066.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-10-31T22:37:53.001 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-10-31T22:37:53.001 INFO:teuthology.orchestra.run.smithi066.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-10-31T22:37:53.001 INFO:teuthology.orchestra.run.smithi066.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-10-31T22:37:53.001 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-10-31T22:37:53.001 INFO:teuthology.orchestra.run.smithi066.stdout:Suggested packages: 2020-10-31T22:37:53.002 INFO:teuthology.orchestra.run.smithi066.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-10-31T22:37:53.002 INFO:teuthology.orchestra.run.smithi066.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-10-31T22:37:53.002 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2020-10-31T22:37:53.002 INFO:teuthology.orchestra.run.smithi066.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2020-10-31T22:37:53.002 INFO:teuthology.orchestra.run.smithi066.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2020-10-31T22:37:53.002 INFO:teuthology.orchestra.run.smithi066.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2020-10-31T22:37:53.002 INFO:teuthology.orchestra.run.smithi066.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2020-10-31T22:37:53.003 INFO:teuthology.orchestra.run.smithi066.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2020-10-31T22:37:53.003 INFO:teuthology.orchestra.run.smithi066.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2020-10-31T22:37:53.003 INFO:teuthology.orchestra.run.smithi066.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2020-10-31T22:37:53.003 INFO:teuthology.orchestra.run.smithi066.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2020-10-31T22:37:53.003 INFO:teuthology.orchestra.run.smithi066.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2020-10-31T22:37:53.003 INFO:teuthology.orchestra.run.smithi066.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2020-10-31T22:37:53.004 INFO:teuthology.orchestra.run.smithi066.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2020-10-31T22:37:53.004 INFO:teuthology.orchestra.run.smithi066.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2020-10-31T22:37:53.056 INFO:teuthology.orchestra.run.smithi085.stdout:2 upgraded, 115 newly installed, 0 to remove and 14 not upgraded. 2020-10-31T22:37:53.057 INFO:teuthology.orchestra.run.smithi085.stdout:Need to get 156 MB of archives. 2020-10-31T22:37:53.057 INFO:teuthology.orchestra.run.smithi085.stdout:After this operation, 723 MB of additional disk space will be used. 2020-10-31T22:37:53.057 INFO:teuthology.orchestra.run.smithi085.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.5-488-g5e705cd0-1bionic [1,634 kB] 2020-10-31T22:37:53.059 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree... 2020-10-31T22:37:53.059 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information... 2020-10-31T22:37:53.085 INFO:teuthology.orchestra.run.smithi085.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-10-31T22:37:53.111 INFO:teuthology.orchestra.run.smithi066.stdout:The following NEW packages will be installed: 2020-10-31T22:37:53.111 INFO:teuthology.orchestra.run.smithi066.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-10-31T22:37:53.112 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-10-31T22:37:53.112 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-10-31T22:37:53.112 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2020-10-31T22:37:53.112 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2020-10-31T22:37:53.112 INFO:teuthology.orchestra.run.smithi066.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2020-10-31T22:37:53.113 INFO:teuthology.orchestra.run.smithi066.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2020-10-31T22:37:53.113 INFO:teuthology.orchestra.run.smithi066.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2020-10-31T22:37:53.114 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2020-10-31T22:37:53.114 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cmd2 2020-10-31T22:37:53.114 INFO:teuthology.orchestra.run.smithi066.stdout: python3-colorama python3-cryptography python3-cycler python3-dateutil 2020-10-31T22:37:53.115 INFO:teuthology.orchestra.run.smithi066.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2020-10-31T22:37:53.115 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-10-31T22:37:53.115 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-10-31T22:37:53.115 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-10-31T22:37:53.115 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-10-31T22:37:53.115 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-10-31T22:37:53.115 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-10-31T22:37:53.116 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2020-10-31T22:37:53.116 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2020-10-31T22:37:53.117 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2020-10-31T22:37:53.117 INFO:teuthology.orchestra.run.smithi066.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-10-31T22:37:53.117 INFO:teuthology.orchestra.run.smithi066.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-10-31T22:37:53.117 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2020-10-31T22:37:53.117 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2020-10-31T22:37:53.118 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2020-10-31T22:37:53.118 INFO:teuthology.orchestra.run.smithi066.stdout:The following packages will be upgraded: 2020-10-31T22:37:53.118 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 librbd1 2020-10-31T22:37:53.138 INFO:teuthology.orchestra.run.smithi060.stdout:2 upgraded, 115 newly installed, 0 to remove and 14 not upgraded. 2020-10-31T22:37:53.139 INFO:teuthology.orchestra.run.smithi060.stdout:Need to get 156 MB of archives. 2020-10-31T22:37:53.139 INFO:teuthology.orchestra.run.smithi060.stdout:After this operation, 723 MB of additional disk space will be used. 2020-10-31T22:37:53.139 INFO:teuthology.orchestra.run.smithi060.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.5-488-g5e705cd0-1bionic [1,634 kB] 2020-10-31T22:37:53.167 INFO:teuthology.orchestra.run.smithi060.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-10-31T22:37:53.224 INFO:teuthology.orchestra.run.smithi152.stdout:The following additional packages will be installed: 2020-10-31T22:37:53.225 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-10-31T22:37:53.225 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-10-31T22:37:53.226 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook ceph-mon ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 2020-10-31T22:37:53.226 INFO:teuthology.orchestra.run.smithi152.stdout: liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2020-10-31T22:37:53.226 INFO:teuthology.orchestra.run.smithi152.stdout: libsnappy1v5 libxslt1.1 nvme-cli python-attr python-funcsigs 2020-10-31T22:37:53.226 INFO:teuthology.orchestra.run.smithi152.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2020-10-31T22:37:53.227 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2020-10-31T22:37:53.227 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2020-10-31T22:37:53.227 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-cryptography 2020-10-31T22:37:53.228 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cycler python3-dateutil python3-decorator python3-fasteners 2020-10-31T22:37:53.228 INFO:teuthology.orchestra.run.smithi152.stdout: python3-html5lib python3-httplib2 python3-jinja2 python3-joblib 2020-10-31T22:37:53.228 INFO:teuthology.orchestra.run.smithi152.stdout: python3-json-pointer python3-jsonpatch python3-jwt python3-kubernetes 2020-10-31T22:37:53.228 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2020-10-31T22:37:53.229 INFO:teuthology.orchestra.run.smithi152.stdout: python3-matplotlib python3-monotonic python3-numpy python3-oauth2client 2020-10-31T22:37:53.229 INFO:teuthology.orchestra.run.smithi152.stdout: python3-olefile python3-openssl python3-paste python3-pastedeploy 2020-10-31T22:37:53.229 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pastescript python3-pecan python3-pil python3-pluggy 2020-10-31T22:37:53.230 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable python3-py python3-pyasn1 python3-pyasn1-modules 2020-10-31T22:37:53.230 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyinotify python3-pyparsing python3-pyperclip python3-pytest 2020-10-31T22:37:53.230 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze.lru python3-routes python3-rsa python3-scipy 2020-10-31T22:37:53.230 INFO:teuthology.orchestra.run.smithi152.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2020-10-31T22:37:53.231 INFO:teuthology.orchestra.run.smithi152.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2020-10-31T22:37:53.231 INFO:teuthology.orchestra.run.smithi152.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2020-10-31T22:37:53.232 INFO:teuthology.orchestra.run.smithi152.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2020-10-31T22:37:53.232 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2020-10-31T22:37:53.233 INFO:teuthology.orchestra.run.smithi152.stdout:Suggested packages: 2020-10-31T22:37:53.233 INFO:teuthology.orchestra.run.smithi152.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2020-10-31T22:37:53.233 INFO:teuthology.orchestra.run.smithi152.stdout: python-pytest-xdist python-mock python-cryptography-doc 2020-10-31T22:37:53.234 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi 2020-10-31T22:37:53.234 INFO:teuthology.orchestra.run.smithi152.stdout: python-jinja2-doc python3-crypto python3-lxml-dbg python-lxml-doc 2020-10-31T22:37:53.235 INFO:teuthology.orchestra.run.smithi152.stdout: python3-beaker python-mako-doc dvipng ffmpeg gir1.2-gtk-3.0 ghostscript 2020-10-31T22:37:53.236 INFO:teuthology.orchestra.run.smithi152.stdout: inkscape ipython3 python-matplotlib-doc python3-cairocffi python3-gi-cairo 2020-10-31T22:37:53.236 INFO:teuthology.orchestra.run.smithi152.stdout: python3-gobject python3-pyqt4 python3-sip python3-tornado 2020-10-31T22:37:53.236 INFO:teuthology.orchestra.run.smithi152.stdout: texlive-extra-utils texlive-latex-extra ttf-staypuft python-numpy-doc 2020-10-31T22:37:53.237 INFO:teuthology.orchestra.run.smithi152.stdout: python3-dev python3-numpy-dbg python-openssl-doc python3-openssl-dbg 2020-10-31T22:37:53.237 INFO:teuthology.orchestra.run.smithi152.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2020-10-31T22:37:53.237 INFO:teuthology.orchestra.run.smithi152.stdout: python-pecan-doc python-pil-doc python3-pil-dbg python-pyinotify-doc 2020-10-31T22:37:53.237 INFO:teuthology.orchestra.run.smithi152.stdout: python-pyparsing-doc python-scipy-doc python-setuptools-doc python3-dap 2020-10-31T22:37:53.238 INFO:teuthology.orchestra.run.smithi152.stdout: python-sklearn-doc python-sqlalchemy-doc python3-psycopg2 python3-pymysql 2020-10-31T22:37:53.238 INFO:teuthology.orchestra.run.smithi152.stdout: python3-fdb tix python3-tk-dbg python-waitress-doc python-webob-doc 2020-10-31T22:37:53.238 INFO:teuthology.orchestra.run.smithi152.stdout: python-webtest-doc python3-termcolor python3-watchdog python-werkzeug-doc 2020-10-31T22:37:53.277 INFO:teuthology.orchestra.run.smithi066.stdout:2 upgraded, 115 newly installed, 0 to remove and 14 not upgraded. 2020-10-31T22:37:53.278 INFO:teuthology.orchestra.run.smithi066.stdout:Need to get 156 MB of archives. 2020-10-31T22:37:53.278 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 723 MB of additional disk space will be used. 2020-10-31T22:37:53.279 INFO:teuthology.orchestra.run.smithi066.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.5-488-g5e705cd0-1bionic [1,634 kB] 2020-10-31T22:37:53.304 INFO:teuthology.orchestra.run.smithi066.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-10-31T22:37:53.345 INFO:teuthology.orchestra.run.smithi085.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2020-10-31T22:37:53.350 INFO:teuthology.orchestra.run.smithi085.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2020-10-31T22:37:53.352 INFO:teuthology.orchestra.run.smithi085.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.5-488-g5e705cd0-1bionic [3,053 kB] 2020-10-31T22:37:53.355 INFO:teuthology.orchestra.run.smithi152.stdout:The following NEW packages will be installed: 2020-10-31T22:37:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2020-10-31T22:37:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2020-10-31T22:37:53.356 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2020-10-31T22:37:53.359 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm cephfs-shell jq 2020-10-31T22:37:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-dev libcephfs2 libjq1 libleveldb1v5 liblttng-ust0 liboath0 2020-10-31T22:37:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: libonig4 librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 2020-10-31T22:37:53.360 INFO:teuthology.orchestra.run.smithi152.stdout: libxslt1.1 nvme-cli python-attr python-funcsigs python-pastedeploy-tpl 2020-10-31T22:37:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: python-pluggy python-py python-pytest python3-asn1crypto python3-attr 2020-10-31T22:37:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt python3-bs4 python3-ceph-argparse python3-ceph-common 2020-10-31T22:37:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs python3-cffi-backend python3-cherrypy3 python3-cmd2 2020-10-31T22:37:53.361 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama python3-cryptography python3-cycler python3-dateutil 2020-10-31T22:37:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2020-10-31T22:37:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2020-10-31T22:37:53.362 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2020-10-31T22:37:53.363 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe python3-matplotlib python3-monotonic python3-numpy 2020-10-31T22:37:53.363 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2020-10-31T22:37:53.363 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2020-10-31T22:37:53.363 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2020-10-31T22:37:53.364 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pyperclip 2020-10-31T22:37:53.367 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru python3-rgw 2020-10-31T22:37:53.367 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes python3-rsa python3-scipy python3-setuptools 2020-10-31T22:37:53.367 INFO:teuthology.orchestra.run.smithi152.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2020-10-31T22:37:53.367 INFO:teuthology.orchestra.run.smithi152.stdout: python3-sklearn python3-sklearn-lib python3-sqlalchemy python3-tempita 2020-10-31T22:37:53.368 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tk python3-tz python3-uritemplate python3-waitress 2020-10-31T22:37:53.368 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webencodings python3-webob python3-websocket python3-webtest 2020-10-31T22:37:53.368 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2020-10-31T22:37:53.368 INFO:teuthology.orchestra.run.smithi152.stdout:The following packages will be upgraded: 2020-10-31T22:37:53.368 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 librbd1 2020-10-31T22:37:53.370 INFO:teuthology.orchestra.run.smithi085.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-10-31T22:37:53.371 INFO:teuthology.orchestra.run.smithi085.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-10-31T22:37:53.418 INFO:teuthology.orchestra.run.smithi060.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.5-488-g5e705cd0-1bionic [3,053 kB] 2020-10-31T22:37:53.421 INFO:teuthology.orchestra.run.smithi060.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2020-10-31T22:37:53.429 INFO:teuthology.orchestra.run.smithi060.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2020-10-31T22:37:53.451 INFO:teuthology.orchestra.run.smithi060.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-10-31T22:37:53.452 INFO:teuthology.orchestra.run.smithi060.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-10-31T22:37:53.514 INFO:teuthology.orchestra.run.smithi085.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-10-31T22:37:53.517 INFO:teuthology.orchestra.run.smithi152.stdout:2 upgraded, 115 newly installed, 0 to remove and 14 not upgraded. 2020-10-31T22:37:53.518 INFO:teuthology.orchestra.run.smithi152.stdout:Need to get 156 MB of archives. 2020-10-31T22:37:53.518 INFO:teuthology.orchestra.run.smithi152.stdout:After this operation, 723 MB of additional disk space will be used. 2020-10-31T22:37:53.518 INFO:teuthology.orchestra.run.smithi152.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.2.5-488-g5e705cd0-1bionic [1,634 kB] 2020-10-31T22:37:53.524 INFO:teuthology.orchestra.run.smithi085.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-10-31T22:37:53.539 INFO:teuthology.orchestra.run.smithi085.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-10-31T22:37:53.543 INFO:teuthology.orchestra.run.smithi152.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2020-10-31T22:37:53.551 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2020-10-31T22:37:53.557 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2020-10-31T22:37:53.558 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.5-488-g5e705cd0-1bionic [3,053 kB] 2020-10-31T22:37:53.583 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-10-31T22:37:53.584 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-10-31T22:37:53.591 INFO:teuthology.orchestra.run.smithi060.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-10-31T22:37:53.602 INFO:teuthology.orchestra.run.smithi060.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-10-31T22:37:53.616 INFO:teuthology.orchestra.run.smithi060.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-10-31T22:37:53.617 INFO:teuthology.orchestra.run.smithi085.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-10-31T22:37:53.621 INFO:teuthology.orchestra.run.smithi085.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-10-31T22:37:53.629 INFO:teuthology.orchestra.run.smithi085.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.5-488-g5e705cd0-1bionic [435 kB] 2020-10-31T22:37:53.644 INFO:teuthology.orchestra.run.smithi085.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-10-31T22:37:53.650 INFO:teuthology.orchestra.run.smithi085.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-10-31T22:37:53.655 INFO:teuthology.orchestra.run.smithi085.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-10-31T22:37:53.663 INFO:teuthology.orchestra.run.smithi085.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-10-31T22:37:53.667 INFO:teuthology.orchestra.run.smithi085.stdout:Get:18 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.5-488-g5e705cd0-1bionic [331 kB] 2020-10-31T22:37:53.674 INFO:teuthology.orchestra.run.smithi085.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2020-10-31T22:37:53.698 INFO:teuthology.orchestra.run.smithi060.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-10-31T22:37:53.699 INFO:teuthology.orchestra.run.smithi085.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-10-31T22:37:53.701 INFO:teuthology.orchestra.run.smithi060.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-10-31T22:37:53.702 INFO:teuthology.orchestra.run.smithi085.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.5-488-g5e705cd0-1bionic [20.7 kB] 2020-10-31T22:37:53.704 INFO:teuthology.orchestra.run.smithi085.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-10-31T22:37:53.704 INFO:teuthology.orchestra.run.smithi085.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.5-488-g5e705cd0-1bionic [132 kB] 2020-10-31T22:37:53.713 INFO:teuthology.orchestra.run.smithi085.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.5-488-g5e705cd0-1bionic [27.8 kB] 2020-10-31T22:37:53.715 INFO:teuthology.orchestra.run.smithi085.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.5-488-g5e705cd0-1bionic [312 kB] 2020-10-31T22:37:53.719 INFO:teuthology.orchestra.run.smithi060.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.5-488-g5e705cd0-1bionic [435 kB] 2020-10-31T22:37:53.725 INFO:teuthology.orchestra.run.smithi060.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-10-31T22:37:53.732 INFO:teuthology.orchestra.run.smithi060.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-10-31T22:37:53.740 INFO:teuthology.orchestra.run.smithi060.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-10-31T22:37:53.745 INFO:teuthology.orchestra.run.smithi085.stdout:Get:26 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.5-488-g5e705cd0-1bionic [2,891 kB] 2020-10-31T22:37:53.749 INFO:teuthology.orchestra.run.smithi060.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-10-31T22:37:53.750 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-10-31T22:37:53.756 INFO:teuthology.orchestra.run.smithi060.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2020-10-31T22:37:53.756 INFO:teuthology.orchestra.run.smithi066.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-10-31T22:37:53.758 INFO:teuthology.orchestra.run.smithi085.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-10-31T22:37:53.764 INFO:teuthology.orchestra.run.smithi060.stdout:Get:19 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.5-488-g5e705cd0-1bionic [331 kB] 2020-10-31T22:37:53.766 INFO:teuthology.orchestra.run.smithi085.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-10-31T22:37:53.767 INFO:teuthology.orchestra.run.smithi085.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-10-31T22:37:53.767 INFO:teuthology.orchestra.run.smithi085.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-10-31T22:37:53.768 INFO:teuthology.orchestra.run.smithi066.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-10-31T22:37:53.768 INFO:teuthology.orchestra.run.smithi085.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-10-31T22:37:53.771 INFO:teuthology.orchestra.run.smithi085.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-10-31T22:37:53.771 INFO:teuthology.orchestra.run.smithi085.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-10-31T22:37:53.780 INFO:teuthology.orchestra.run.smithi060.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-10-31T22:37:53.784 INFO:teuthology.orchestra.run.smithi060.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-10-31T22:37:53.796 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyperclip all 1.6.0-1 [9,376 B] 2020-10-31T22:37:53.802 INFO:teuthology.orchestra.run.smithi060.stdout:Get:22 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.5-488-g5e705cd0-1bionic [20.7 kB] 2020-10-31T22:37:53.803 INFO:teuthology.orchestra.run.smithi060.stdout:Get:23 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.5-488-g5e705cd0-1bionic [132 kB] 2020-10-31T22:37:53.803 INFO:teuthology.orchestra.run.smithi152.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cmd2 all 0.7.9-0ubuntu1 [34.2 kB] 2020-10-31T22:37:53.813 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2020-10-31T22:37:53.813 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2020-10-31T22:37:53.819 INFO:teuthology.orchestra.run.smithi060.stdout:Get:24 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.5-488-g5e705cd0-1bionic [27.8 kB] 2020-10-31T22:37:53.822 INFO:teuthology.orchestra.run.smithi060.stdout:Get:25 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.5-488-g5e705cd0-1bionic [312 kB] 2020-10-31T22:37:53.836 INFO:teuthology.orchestra.run.smithi060.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-10-31T22:37:53.838 INFO:teuthology.orchestra.run.smithi085.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-10-31T22:37:53.842 INFO:teuthology.orchestra.run.smithi085.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-10-31T22:37:53.844 INFO:teuthology.orchestra.run.smithi060.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-10-31T22:37:53.844 INFO:teuthology.orchestra.run.smithi060.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-10-31T22:37:53.845 INFO:teuthology.orchestra.run.smithi085.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-10-31T22:37:53.848 INFO:teuthology.orchestra.run.smithi060.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-10-31T22:37:53.848 INFO:teuthology.orchestra.run.smithi060.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-10-31T22:37:53.848 INFO:teuthology.orchestra.run.smithi066.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-10-31T22:37:53.849 INFO:teuthology.orchestra.run.smithi060.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-10-31T22:37:53.851 INFO:teuthology.orchestra.run.smithi066.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-10-31T22:37:53.858 INFO:teuthology.orchestra.run.smithi060.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.5-488-g5e705cd0-1bionic [2,891 kB] 2020-10-31T22:37:53.892 INFO:teuthology.orchestra.run.smithi066.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-10-31T22:37:53.898 INFO:teuthology.orchestra.run.smithi066.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-10-31T22:37:53.903 INFO:teuthology.orchestra.run.smithi066.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-10-31T22:37:53.911 INFO:teuthology.orchestra.run.smithi066.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-10-31T22:37:53.915 INFO:teuthology.orchestra.run.smithi060.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-10-31T22:37:53.916 INFO:teuthology.orchestra.run.smithi060.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-10-31T22:37:53.918 INFO:teuthology.orchestra.run.smithi066.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2020-10-31T22:37:53.918 INFO:teuthology.orchestra.run.smithi060.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-10-31T22:37:53.919 INFO:teuthology.orchestra.run.smithi085.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-10-31T22:37:53.920 INFO:teuthology.orchestra.run.smithi085.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-10-31T22:37:53.921 INFO:teuthology.orchestra.run.smithi060.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-10-31T22:37:53.937 INFO:teuthology.orchestra.run.smithi066.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-10-31T22:37:53.938 INFO:teuthology.orchestra.run.smithi085.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-10-31T22:37:53.939 INFO:teuthology.orchestra.run.smithi066.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-10-31T22:37:53.939 INFO:teuthology.orchestra.run.smithi085.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-10-31T22:37:53.940 INFO:teuthology.orchestra.run.smithi085.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-10-31T22:37:53.941 INFO:teuthology.orchestra.run.smithi085.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-10-31T22:37:53.944 INFO:teuthology.orchestra.run.smithi085.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-10-31T22:37:53.967 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.2.5-488-g5e705cd0-1bionic [3,053 kB] 2020-10-31T22:37:53.972 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2020-10-31T22:37:53.980 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2020-10-31T22:37:53.987 INFO:teuthology.orchestra.run.smithi152.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2020-10-31T22:37:53.992 INFO:teuthology.orchestra.run.smithi066.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-10-31T22:37:53.993 INFO:teuthology.orchestra.run.smithi066.stdout:Get:21 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.5-488-g5e705cd0-1bionic [435 kB] 2020-10-31T22:37:53.996 INFO:teuthology.orchestra.run.smithi060.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-10-31T22:37:53.996 INFO:teuthology.orchestra.run.smithi060.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-10-31T22:37:53.999 INFO:teuthology.orchestra.run.smithi085.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2020-10-31T22:37:54.001 INFO:teuthology.orchestra.run.smithi066.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-10-31T22:37:54.002 INFO:teuthology.orchestra.run.smithi066.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-10-31T22:37:54.002 INFO:teuthology.orchestra.run.smithi066.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-10-31T22:37:54.003 INFO:teuthology.orchestra.run.smithi085.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-10-31T22:37:54.003 INFO:teuthology.orchestra.run.smithi085.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-10-31T22:37:54.003 INFO:teuthology.orchestra.run.smithi066.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-10-31T22:37:54.006 INFO:teuthology.orchestra.run.smithi066.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-10-31T22:37:54.017 INFO:teuthology.orchestra.run.smithi060.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-10-31T22:37:54.018 INFO:teuthology.orchestra.run.smithi060.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-10-31T22:37:54.018 INFO:teuthology.orchestra.run.smithi085.stdout:Get:47 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.5-488-g5e705cd0-1bionic [99.3 kB] 2020-10-31T22:37:54.019 INFO:teuthology.orchestra.run.smithi060.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-10-31T22:37:54.019 INFO:teuthology.orchestra.run.smithi060.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-10-31T22:37:54.030 INFO:teuthology.orchestra.run.smithi085.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.5-488-g5e705cd0-1bionic [334 kB] 2020-10-31T22:37:54.047 INFO:teuthology.orchestra.run.smithi066.stdout:Get:27 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.5-488-g5e705cd0-1bionic [331 kB] 2020-10-31T22:37:54.067 INFO:teuthology.orchestra.run.smithi085.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.5-488-g5e705cd0-1bionic [18.8 MB] 2020-10-31T22:37:54.072 INFO:teuthology.orchestra.run.smithi066.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-10-31T22:37:54.073 INFO:teuthology.orchestra.run.smithi152.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2020-10-31T22:37:54.074 INFO:teuthology.orchestra.run.smithi066.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-10-31T22:37:54.075 INFO:teuthology.orchestra.run.smithi066.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-10-31T22:37:54.077 INFO:teuthology.orchestra.run.smithi152.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2020-10-31T22:37:54.077 INFO:teuthology.orchestra.run.smithi060.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-10-31T22:37:54.078 INFO:teuthology.orchestra.run.smithi066.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-10-31T22:37:54.080 INFO:teuthology.orchestra.run.smithi085.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-10-31T22:37:54.084 INFO:teuthology.orchestra.run.smithi060.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2020-10-31T22:37:54.088 INFO:teuthology.orchestra.run.smithi060.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-10-31T22:37:54.088 INFO:teuthology.orchestra.run.smithi060.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-10-31T22:37:54.101 INFO:teuthology.orchestra.run.smithi152.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2020-10-31T22:37:54.102 INFO:teuthology.orchestra.run.smithi066.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.5-488-g5e705cd0-1bionic [20.7 kB] 2020-10-31T22:37:54.102 INFO:teuthology.orchestra.run.smithi066.stdout:Get:33 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.5-488-g5e705cd0-1bionic [132 kB] 2020-10-31T22:37:54.108 INFO:teuthology.orchestra.run.smithi066.stdout:Get:34 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.5-488-g5e705cd0-1bionic [27.8 kB] 2020-10-31T22:37:54.109 INFO:teuthology.orchestra.run.smithi066.stdout:Get:35 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.5-488-g5e705cd0-1bionic [312 kB] 2020-10-31T22:37:54.109 INFO:teuthology.orchestra.run.smithi152.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2020-10-31T22:37:54.118 INFO:teuthology.orchestra.run.smithi085.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-10-31T22:37:54.118 INFO:teuthology.orchestra.run.smithi085.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-10-31T22:37:54.118 INFO:teuthology.orchestra.run.smithi152.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2020-10-31T22:37:54.125 INFO:teuthology.orchestra.run.smithi152.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2020-10-31T22:37:54.131 INFO:teuthology.orchestra.run.smithi152.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2020-10-31T22:37:54.152 INFO:teuthology.orchestra.run.smithi066.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-10-31T22:37:54.153 INFO:teuthology.orchestra.run.smithi066.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-10-31T22:37:54.154 INFO:teuthology.orchestra.run.smithi152.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2020-10-31T22:37:54.157 INFO:teuthology.orchestra.run.smithi060.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-10-31T22:37:54.158 INFO:teuthology.orchestra.run.smithi152.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2020-10-31T22:37:54.164 INFO:teuthology.orchestra.run.smithi066.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.5-488-g5e705cd0-1bionic [2,891 kB] 2020-10-31T22:37:54.170 INFO:teuthology.orchestra.run.smithi060.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.5-488-g5e705cd0-1bionic [99.3 kB] 2020-10-31T22:37:54.173 INFO:teuthology.orchestra.run.smithi066.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-10-31T22:37:54.174 INFO:teuthology.orchestra.run.smithi066.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-10-31T22:37:54.174 INFO:teuthology.orchestra.run.smithi066.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-10-31T22:37:54.175 INFO:teuthology.orchestra.run.smithi066.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-10-31T22:37:54.180 INFO:teuthology.orchestra.run.smithi060.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.5-488-g5e705cd0-1bionic [334 kB] 2020-10-31T22:37:54.214 INFO:teuthology.orchestra.run.smithi060.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.5-488-g5e705cd0-1bionic [18.8 MB] 2020-10-31T22:37:54.215 INFO:teuthology.orchestra.run.smithi152.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2020-10-31T22:37:54.221 INFO:teuthology.orchestra.run.smithi152.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2020-10-31T22:37:54.222 INFO:teuthology.orchestra.run.smithi152.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2020-10-31T22:37:54.222 INFO:teuthology.orchestra.run.smithi152.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2020-10-31T22:37:54.223 INFO:teuthology.orchestra.run.smithi152.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2020-10-31T22:37:54.225 INFO:teuthology.orchestra.run.smithi152.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2020-10-31T22:37:54.225 INFO:teuthology.orchestra.run.smithi152.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2020-10-31T22:37:54.231 INFO:teuthology.orchestra.run.smithi066.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-10-31T22:37:54.239 INFO:teuthology.orchestra.run.smithi066.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2020-10-31T22:37:54.241 INFO:teuthology.orchestra.run.smithi060.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-10-31T22:37:54.241 INFO:teuthology.orchestra.run.smithi060.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-10-31T22:37:54.243 INFO:teuthology.orchestra.run.smithi066.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-10-31T22:37:54.244 INFO:teuthology.orchestra.run.smithi066.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-10-31T22:37:54.294 INFO:teuthology.orchestra.run.smithi152.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2020-10-31T22:37:54.294 INFO:teuthology.orchestra.run.smithi152.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2020-10-31T22:37:54.298 INFO:teuthology.orchestra.run.smithi152.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2020-10-31T22:37:54.310 INFO:teuthology.orchestra.run.smithi066.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-10-31T22:37:54.372 INFO:teuthology.orchestra.run.smithi152.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2020-10-31T22:37:54.372 INFO:teuthology.orchestra.run.smithi152.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2020-10-31T22:37:54.393 INFO:teuthology.orchestra.run.smithi152.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2020-10-31T22:37:54.393 INFO:teuthology.orchestra.run.smithi152.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2020-10-31T22:37:54.394 INFO:teuthology.orchestra.run.smithi066.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-10-31T22:37:54.395 INFO:teuthology.orchestra.run.smithi066.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-10-31T22:37:54.395 INFO:teuthology.orchestra.run.smithi152.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2020-10-31T22:37:54.396 INFO:teuthology.orchestra.run.smithi152.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2020-10-31T22:37:54.398 INFO:teuthology.orchestra.run.smithi152.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2020-10-31T22:37:54.425 INFO:teuthology.orchestra.run.smithi085.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-10-31T22:37:54.438 INFO:teuthology.orchestra.run.smithi085.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-10-31T22:37:54.439 INFO:teuthology.orchestra.run.smithi085.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-10-31T22:37:54.451 INFO:teuthology.orchestra.run.smithi152.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-jinja2 all 2.10-1ubuntu0.18.04.1 [95.4 kB] 2020-10-31T22:37:54.455 INFO:teuthology.orchestra.run.smithi152.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2020-10-31T22:37:54.456 INFO:teuthology.orchestra.run.smithi152.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2020-10-31T22:37:54.503 INFO:teuthology.orchestra.run.smithi085.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-10-31T22:37:54.503 INFO:teuthology.orchestra.run.smithi085.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-10-31T22:37:54.503 INFO:teuthology.orchestra.run.smithi085.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2020-10-31T22:37:54.504 INFO:teuthology.orchestra.run.smithi085.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-10-31T22:37:54.504 INFO:teuthology.orchestra.run.smithi085.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-10-31T22:37:54.507 INFO:teuthology.orchestra.run.smithi085.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-10-31T22:37:54.508 INFO:teuthology.orchestra.run.smithi085.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-10-31T22:37:54.523 INFO:teuthology.orchestra.run.smithi060.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-10-31T22:37:54.533 INFO:teuthology.orchestra.run.smithi152.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2020-10-31T22:37:54.567 INFO:teuthology.orchestra.run.smithi152.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2020-10-31T22:37:54.568 INFO:teuthology.orchestra.run.smithi152.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2020-10-31T22:37:54.577 INFO:teuthology.orchestra.run.smithi060.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-10-31T22:37:54.578 INFO:teuthology.orchestra.run.smithi060.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-10-31T22:37:54.579 INFO:teuthology.orchestra.run.smithi066.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.5-488-g5e705cd0-1bionic [99.3 kB] 2020-10-31T22:37:54.583 INFO:teuthology.orchestra.run.smithi066.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.5-488-g5e705cd0-1bionic [334 kB] 2020-10-31T22:37:54.589 INFO:teuthology.orchestra.run.smithi085.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-10-31T22:37:54.590 INFO:teuthology.orchestra.run.smithi085.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-10-31T22:37:54.592 INFO:teuthology.orchestra.run.smithi085.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-10-31T22:37:54.592 INFO:teuthology.orchestra.run.smithi085.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-10-31T22:37:54.595 INFO:teuthology.orchestra.run.smithi085.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2020-10-31T22:37:54.595 INFO:teuthology.orchestra.run.smithi085.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2020-10-31T22:37:54.596 INFO:teuthology.orchestra.run.smithi085.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-10-31T22:37:54.605 INFO:teuthology.orchestra.run.smithi060.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-10-31T22:37:54.606 INFO:teuthology.orchestra.run.smithi060.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-10-31T22:37:54.606 INFO:teuthology.orchestra.run.smithi060.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2020-10-31T22:37:54.607 INFO:teuthology.orchestra.run.smithi060.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-10-31T22:37:54.607 INFO:teuthology.orchestra.run.smithi060.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-10-31T22:37:54.608 INFO:teuthology.orchestra.run.smithi060.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-10-31T22:37:54.609 INFO:teuthology.orchestra.run.smithi060.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-10-31T22:37:54.657 INFO:teuthology.orchestra.run.smithi066.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.5-488-g5e705cd0-1bionic [18.8 MB] 2020-10-31T22:37:54.670 INFO:teuthology.orchestra.run.smithi085.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-10-31T22:37:54.672 INFO:teuthology.orchestra.run.smithi085.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-10-31T22:37:54.672 INFO:teuthology.orchestra.run.smithi085.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-10-31T22:37:54.674 INFO:teuthology.orchestra.run.smithi066.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-10-31T22:37:54.686 INFO:teuthology.orchestra.run.smithi060.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-10-31T22:37:54.688 INFO:teuthology.orchestra.run.smithi060.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-10-31T22:37:54.702 INFO:teuthology.orchestra.run.smithi152.stdout:Get:43 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.2.5-488-g5e705cd0-1bionic [435 kB] 2020-10-31T22:37:54.712 INFO:teuthology.orchestra.run.smithi066.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-10-31T22:37:54.713 INFO:teuthology.orchestra.run.smithi066.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-10-31T22:37:54.750 INFO:teuthology.orchestra.run.smithi085.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-10-31T22:37:54.754 INFO:teuthology.orchestra.run.smithi066.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-10-31T22:37:54.755 INFO:teuthology.orchestra.run.smithi066.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-10-31T22:37:54.756 INFO:teuthology.orchestra.run.smithi066.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2020-10-31T22:37:54.757 INFO:teuthology.orchestra.run.smithi085.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-10-31T22:37:54.758 INFO:teuthology.orchestra.run.smithi066.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-10-31T22:37:54.758 INFO:teuthology.orchestra.run.smithi066.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-10-31T22:37:54.758 INFO:teuthology.orchestra.run.smithi066.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-10-31T22:37:54.758 INFO:teuthology.orchestra.run.smithi066.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-10-31T22:37:54.764 INFO:teuthology.orchestra.run.smithi085.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2020-10-31T22:37:54.764 INFO:teuthology.orchestra.run.smithi085.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 nvme-cli amd64 1.5-1ubuntu1 [183 kB] 2020-10-31T22:37:54.766 INFO:teuthology.orchestra.run.smithi085.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-10-31T22:37:54.767 INFO:teuthology.orchestra.run.smithi085.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-10-31T22:37:54.767 INFO:teuthology.orchestra.run.smithi060.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-10-31T22:37:54.767 INFO:teuthology.orchestra.run.smithi085.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-10-31T22:37:54.768 INFO:teuthology.orchestra.run.smithi060.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-10-31T22:37:54.772 INFO:teuthology.orchestra.run.smithi060.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2020-10-31T22:37:54.773 INFO:teuthology.orchestra.run.smithi060.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2020-10-31T22:37:54.773 INFO:teuthology.orchestra.run.smithi060.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-10-31T22:37:54.777 INFO:teuthology.orchestra.run.smithi060.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-10-31T22:37:54.779 INFO:teuthology.orchestra.run.smithi060.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-10-31T22:37:54.780 INFO:teuthology.orchestra.run.smithi060.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-10-31T22:37:54.831 INFO:teuthology.orchestra.run.smithi085.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-10-31T22:37:54.832 INFO:teuthology.orchestra.run.smithi085.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-10-31T22:37:54.835 INFO:teuthology.orchestra.run.smithi085.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-10-31T22:37:54.836 INFO:teuthology.orchestra.run.smithi066.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-10-31T22:37:54.838 INFO:teuthology.orchestra.run.smithi066.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-10-31T22:37:54.845 INFO:teuthology.orchestra.run.smithi066.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-10-31T22:37:54.846 INFO:teuthology.orchestra.run.smithi066.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-10-31T22:37:54.847 INFO:teuthology.orchestra.run.smithi060.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-10-31T22:37:54.853 INFO:teuthology.orchestra.run.smithi060.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-10-31T22:37:54.862 INFO:teuthology.orchestra.run.smithi152.stdout:Get:44 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.2.5-488-g5e705cd0-1bionic [331 kB] 2020-10-31T22:37:54.874 INFO:teuthology.orchestra.run.smithi152.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2020-10-31T22:37:54.892 INFO:teuthology.orchestra.run.smithi152.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2020-10-31T22:37:54.893 INFO:teuthology.orchestra.run.smithi152.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2020-10-31T22:37:54.906 INFO:teuthology.orchestra.run.smithi152.stdout:Get:48 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.2.5-488-g5e705cd0-1bionic [20.7 kB] 2020-10-31T22:37:54.907 INFO:teuthology.orchestra.run.smithi152.stdout:Get:49 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.2.5-488-g5e705cd0-1bionic [132 kB] 2020-10-31T22:37:54.912 INFO:teuthology.orchestra.run.smithi085.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-10-31T22:37:54.912 INFO:teuthology.orchestra.run.smithi152.stdout:Get:50 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.2.5-488-g5e705cd0-1bionic [27.8 kB] 2020-10-31T22:37:54.913 INFO:teuthology.orchestra.run.smithi085.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-10-31T22:37:54.913 INFO:teuthology.orchestra.run.smithi085.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-10-31T22:37:54.915 INFO:teuthology.orchestra.run.smithi085.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-10-31T22:37:54.916 INFO:teuthology.orchestra.run.smithi066.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2020-10-31T22:37:54.916 INFO:teuthology.orchestra.run.smithi066.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2020-10-31T22:37:54.917 INFO:teuthology.orchestra.run.smithi066.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-10-31T22:37:54.922 INFO:teuthology.orchestra.run.smithi066.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-10-31T22:37:54.922 INFO:teuthology.orchestra.run.smithi152.stdout:Get:51 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.2.5-488-g5e705cd0-1bionic [312 kB] 2020-10-31T22:37:54.923 INFO:teuthology.orchestra.run.smithi066.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-10-31T22:37:54.926 INFO:teuthology.orchestra.run.smithi066.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-10-31T22:37:54.929 INFO:teuthology.orchestra.run.smithi060.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2020-10-31T22:37:54.929 INFO:teuthology.orchestra.run.smithi060.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 nvme-cli amd64 1.5-1ubuntu1 [183 kB] 2020-10-31T22:37:54.940 INFO:teuthology.orchestra.run.smithi060.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-10-31T22:37:54.940 INFO:teuthology.orchestra.run.smithi060.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-10-31T22:37:54.940 INFO:teuthology.orchestra.run.smithi060.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-10-31T22:37:54.941 INFO:teuthology.orchestra.run.smithi060.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-10-31T22:37:54.941 INFO:teuthology.orchestra.run.smithi060.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-10-31T22:37:54.941 INFO:teuthology.orchestra.run.smithi085.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-10-31T22:37:54.942 INFO:teuthology.orchestra.run.smithi085.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-10-31T22:37:54.942 INFO:teuthology.orchestra.run.smithi060.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-10-31T22:37:54.952 INFO:teuthology.orchestra.run.smithi152.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2020-10-31T22:37:54.953 INFO:teuthology.orchestra.run.smithi152.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2020-10-31T22:37:54.953 INFO:teuthology.orchestra.run.smithi152.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [28.6 kB] 2020-10-31T22:37:54.953 INFO:teuthology.orchestra.run.smithi152.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2020-10-31T22:37:54.954 INFO:teuthology.orchestra.run.smithi152.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2020-10-31T22:37:54.954 INFO:teuthology.orchestra.run.smithi152.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2020-10-31T22:37:54.954 INFO:teuthology.orchestra.run.smithi152.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2020-10-31T22:37:54.995 INFO:teuthology.orchestra.run.smithi066.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-10-31T22:37:55.000 INFO:teuthology.orchestra.run.smithi066.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-10-31T22:37:55.008 INFO:teuthology.orchestra.run.smithi060.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-10-31T22:37:55.009 INFO:teuthology.orchestra.run.smithi066.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2020-10-31T22:37:55.009 INFO:teuthology.orchestra.run.smithi066.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 nvme-cli amd64 1.5-1ubuntu1 [183 kB] 2020-10-31T22:37:55.010 INFO:teuthology.orchestra.run.smithi060.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-10-31T22:37:55.023 INFO:teuthology.orchestra.run.smithi085.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-10-31T22:37:55.030 INFO:teuthology.orchestra.run.smithi152.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.2.5-488-g5e705cd0-1bionic [2,891 kB] 2020-10-31T22:37:55.034 INFO:teuthology.orchestra.run.smithi152.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2020-10-31T22:37:55.035 INFO:teuthology.orchestra.run.smithi152.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2020-10-31T22:37:55.039 INFO:teuthology.orchestra.run.smithi152.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2020-10-31T22:37:55.041 INFO:teuthology.orchestra.run.smithi152.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2020-10-31T22:37:55.043 INFO:teuthology.orchestra.run.smithi152.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-json-pointer all 1.10-1 [7,478 B] 2020-10-31T22:37:55.044 INFO:teuthology.orchestra.run.smithi152.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jsonpatch all 1.19+really1.16-1fakesync1 [13.4 kB] 2020-10-31T22:37:55.045 INFO:teuthology.orchestra.run.smithi152.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2020-10-31T22:37:55.073 INFO:teuthology.orchestra.run.smithi085.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-10-31T22:37:55.074 INFO:teuthology.orchestra.run.smithi066.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-10-31T22:37:55.074 INFO:teuthology.orchestra.run.smithi085.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.3 [330 kB] 2020-10-31T22:37:55.075 INFO:teuthology.orchestra.run.smithi066.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-10-31T22:37:55.076 INFO:teuthology.orchestra.run.smithi066.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-10-31T22:37:55.077 INFO:teuthology.orchestra.run.smithi066.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-10-31T22:37:55.080 INFO:teuthology.orchestra.run.smithi066.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-10-31T22:37:55.082 INFO:teuthology.orchestra.run.smithi066.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-10-31T22:37:55.085 INFO:teuthology.orchestra.run.smithi085.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-10-31T22:37:55.085 INFO:teuthology.orchestra.run.smithi085.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-10-31T22:37:55.086 INFO:teuthology.orchestra.run.smithi085.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-10-31T22:37:55.086 INFO:teuthology.orchestra.run.smithi085.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-10-31T22:37:55.088 INFO:teuthology.orchestra.run.smithi085.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-10-31T22:37:55.089 INFO:teuthology.orchestra.run.smithi060.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-10-31T22:37:55.089 INFO:teuthology.orchestra.run.smithi085.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-10-31T22:37:55.092 INFO:teuthology.orchestra.run.smithi060.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-10-31T22:37:55.111 INFO:teuthology.orchestra.run.smithi060.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-10-31T22:37:55.112 INFO:teuthology.orchestra.run.smithi060.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-10-31T22:37:55.113 INFO:teuthology.orchestra.run.smithi152.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2020-10-31T22:37:55.117 INFO:teuthology.orchestra.run.smithi152.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2020-10-31T22:37:55.119 INFO:teuthology.orchestra.run.smithi152.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2020-10-31T22:37:55.154 INFO:teuthology.orchestra.run.smithi066.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-10-31T22:37:55.155 INFO:teuthology.orchestra.run.smithi066.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-10-31T22:37:55.155 INFO:teuthology.orchestra.run.smithi066.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-10-31T22:37:55.158 INFO:teuthology.orchestra.run.smithi066.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-10-31T22:37:55.193 INFO:teuthology.orchestra.run.smithi152.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2020-10-31T22:37:55.198 INFO:teuthology.orchestra.run.smithi060.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-10-31T22:37:55.199 INFO:teuthology.orchestra.run.smithi152.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2020-10-31T22:37:55.205 INFO:teuthology.orchestra.run.smithi152.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-colorama all 0.3.7-1 [14.9 kB] 2020-10-31T22:37:55.205 INFO:teuthology.orchestra.run.smithi152.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 nvme-cli amd64 1.5-1ubuntu1 [183 kB] 2020-10-31T22:37:55.207 INFO:teuthology.orchestra.run.smithi152.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2020-10-31T22:37:55.208 INFO:teuthology.orchestra.run.smithi152.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2020-10-31T22:37:55.208 INFO:teuthology.orchestra.run.smithi152.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2020-10-31T22:37:55.232 INFO:teuthology.orchestra.run.smithi066.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-10-31T22:37:55.233 INFO:teuthology.orchestra.run.smithi066.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-10-31T22:37:55.250 INFO:teuthology.orchestra.run.smithi060.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-10-31T22:37:55.252 INFO:teuthology.orchestra.run.smithi060.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.3 [330 kB] 2020-10-31T22:37:55.263 INFO:teuthology.orchestra.run.smithi060.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-10-31T22:37:55.263 INFO:teuthology.orchestra.run.smithi060.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-10-31T22:37:55.264 INFO:teuthology.orchestra.run.smithi060.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-10-31T22:37:55.264 INFO:teuthology.orchestra.run.smithi060.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-10-31T22:37:55.266 INFO:teuthology.orchestra.run.smithi060.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-10-31T22:37:55.266 INFO:teuthology.orchestra.run.smithi060.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-10-31T22:37:55.273 INFO:teuthology.orchestra.run.smithi152.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2020-10-31T22:37:55.275 INFO:teuthology.orchestra.run.smithi152.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2020-10-31T22:37:55.279 INFO:teuthology.orchestra.run.smithi152.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2020-10-31T22:37:55.332 INFO:teuthology.orchestra.run.smithi066.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-10-31T22:37:55.333 INFO:teuthology.orchestra.run.smithi066.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-10-31T22:37:55.333 INFO:teuthology.orchestra.run.smithi066.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.3 [330 kB] 2020-10-31T22:37:55.337 INFO:teuthology.orchestra.run.smithi066.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-10-31T22:37:55.338 INFO:teuthology.orchestra.run.smithi066.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-10-31T22:37:55.338 INFO:teuthology.orchestra.run.smithi066.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-10-31T22:37:55.338 INFO:teuthology.orchestra.run.smithi066.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-10-31T22:37:55.340 INFO:teuthology.orchestra.run.smithi066.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-10-31T22:37:55.352 INFO:teuthology.orchestra.run.smithi152.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2020-10-31T22:37:55.353 INFO:teuthology.orchestra.run.smithi152.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2020-10-31T22:37:55.354 INFO:teuthology.orchestra.run.smithi152.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2020-10-31T22:37:55.357 INFO:teuthology.orchestra.run.smithi152.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2020-10-31T22:37:55.376 INFO:teuthology.orchestra.run.smithi152.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2020-10-31T22:37:55.376 INFO:teuthology.orchestra.run.smithi152.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2020-10-31T22:37:55.391 INFO:teuthology.orchestra.run.smithi066.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-10-31T22:37:55.514 INFO:teuthology.orchestra.run.smithi152.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2020-10-31T22:37:55.515 INFO:teuthology.orchestra.run.smithi152.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2020-10-31T22:37:55.515 INFO:teuthology.orchestra.run.smithi152.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-pil amd64 5.1.0-1ubuntu0.3 [330 kB] 2020-10-31T22:37:55.523 INFO:teuthology.orchestra.run.smithi152.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2020-10-31T22:37:55.523 INFO:teuthology.orchestra.run.smithi152.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2020-10-31T22:37:55.524 INFO:teuthology.orchestra.run.smithi152.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2020-10-31T22:37:55.524 INFO:teuthology.orchestra.run.smithi152.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2020-10-31T22:37:55.525 INFO:teuthology.orchestra.run.smithi152.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2020-10-31T22:37:55.526 INFO:teuthology.orchestra.run.smithi152.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2020-10-31T22:37:55.751 INFO:teuthology.orchestra.run.smithi152.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.2.5-488-g5e705cd0-1bionic [99.3 kB] 2020-10-31T22:37:55.755 INFO:teuthology.orchestra.run.smithi152.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.2.5-488-g5e705cd0-1bionic [334 kB] 2020-10-31T22:37:55.825 INFO:teuthology.orchestra.run.smithi152.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.2.5-488-g5e705cd0-1bionic [18.8 MB] 2020-10-31T22:37:55.884 INFO:teuthology.orchestra.run.smithi085.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.5-488-g5e705cd0-1bionic [5,169 kB] 2020-10-31T22:37:56.272 INFO:teuthology.orchestra.run.smithi060.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.5-488-g5e705cd0-1bionic [5,169 kB] 2020-10-31T22:37:56.390 INFO:teuthology.orchestra.run.smithi085.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.5-488-g5e705cd0-1bionic [147 kB] 2020-10-31T22:37:56.397 INFO:teuthology.orchestra.run.smithi085.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.5-488-g5e705cd0-1bionic [1,282 kB] 2020-10-31T22:37:56.535 INFO:teuthology.orchestra.run.smithi085.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.5-488-g5e705cd0-1bionic [5,943 kB] 2020-10-31T22:37:56.837 INFO:teuthology.orchestra.run.smithi060.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.5-488-g5e705cd0-1bionic [147 kB] 2020-10-31T22:37:56.866 INFO:teuthology.orchestra.run.smithi060.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.5-488-g5e705cd0-1bionic [1,282 kB] 2020-10-31T22:37:57.002 INFO:teuthology.orchestra.run.smithi060.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.5-488-g5e705cd0-1bionic [5,943 kB] 2020-10-31T22:37:57.138 INFO:teuthology.orchestra.run.smithi085.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.5-488-g5e705cd0-1bionic [22.7 MB] 2020-10-31T22:37:57.361 INFO:teuthology.orchestra.run.smithi066.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.5-488-g5e705cd0-1bionic [5,169 kB] 2020-10-31T22:37:57.661 INFO:teuthology.orchestra.run.smithi060.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.5-488-g5e705cd0-1bionic [22.7 MB] 2020-10-31T22:37:58.126 INFO:teuthology.orchestra.run.smithi066.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.5-488-g5e705cd0-1bionic [147 kB] 2020-10-31T22:37:58.131 INFO:teuthology.orchestra.run.smithi066.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.5-488-g5e705cd0-1bionic [1,282 kB] 2020-10-31T22:37:58.339 INFO:teuthology.orchestra.run.smithi066.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.5-488-g5e705cd0-1bionic [5,943 kB] 2020-10-31T22:37:59.410 INFO:teuthology.orchestra.run.smithi066.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.5-488-g5e705cd0-1bionic [22.7 MB] 2020-10-31T22:37:59.836 INFO:teuthology.orchestra.run.smithi085.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.5-488-g5e705cd0-1bionic [3,872 B] 2020-10-31T22:37:59.836 INFO:teuthology.orchestra.run.smithi085.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.5-488-g5e705cd0-1bionic [515 kB] 2020-10-31T22:37:59.906 INFO:teuthology.orchestra.run.smithi085.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.5-488-g5e705cd0-1bionic [1,850 kB] 2020-10-31T22:37:59.928 INFO:teuthology.orchestra.run.smithi152.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.2.5-488-g5e705cd0-1bionic [5,169 kB] 2020-10-31T22:38:00.193 INFO:teuthology.orchestra.run.smithi085.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.5-488-g5e705cd0-1bionic [51.3 kB] 2020-10-31T22:38:00.194 INFO:teuthology.orchestra.run.smithi085.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.5-488-g5e705cd0-1bionic [55.5 kB] 2020-10-31T22:38:00.199 INFO:teuthology.orchestra.run.smithi085.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.5-488-g5e705cd0-1bionic [3,173 kB] 2020-10-31T22:38:00.656 INFO:teuthology.orchestra.run.smithi085.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.5-488-g5e705cd0-1bionic [34.2 kB] 2020-10-31T22:38:00.690 INFO:teuthology.orchestra.run.smithi085.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.5-488-g5e705cd0-1bionic [7,871 kB] 2020-10-31T22:38:00.953 INFO:teuthology.orchestra.run.smithi060.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.5-488-g5e705cd0-1bionic [3,872 B] 2020-10-31T22:38:00.958 INFO:teuthology.orchestra.run.smithi060.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.5-488-g5e705cd0-1bionic [515 kB] 2020-10-31T22:38:00.968 INFO:teuthology.orchestra.run.smithi152.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-modules-core all 15.2.5-488-g5e705cd0-1bionic [147 kB] 2020-10-31T22:38:00.974 INFO:teuthology.orchestra.run.smithi152.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.2.5-488-g5e705cd0-1bionic [1,282 kB] 2020-10-31T22:38:01.051 INFO:teuthology.orchestra.run.smithi060.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.5-488-g5e705cd0-1bionic [1,850 kB] 2020-10-31T22:38:01.282 INFO:teuthology.orchestra.run.smithi152.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.2.5-488-g5e705cd0-1bionic [5,943 kB] 2020-10-31T22:38:01.355 INFO:teuthology.orchestra.run.smithi060.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.5-488-g5e705cd0-1bionic [51.3 kB] 2020-10-31T22:38:01.356 INFO:teuthology.orchestra.run.smithi060.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.5-488-g5e705cd0-1bionic [55.5 kB] 2020-10-31T22:38:01.359 INFO:teuthology.orchestra.run.smithi060.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.5-488-g5e705cd0-1bionic [3,173 kB] 2020-10-31T22:38:01.859 INFO:teuthology.orchestra.run.smithi085.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.5-488-g5e705cd0-1bionic [3,996 B] 2020-10-31T22:38:01.859 INFO:teuthology.orchestra.run.smithi085.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.5-488-g5e705cd0-1bionic [22.4 kB] 2020-10-31T22:38:01.860 INFO:teuthology.orchestra.run.smithi085.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.5-488-g5e705cd0-1bionic [43.9 MB] 2020-10-31T22:38:01.890 INFO:teuthology.orchestra.run.smithi060.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.5-488-g5e705cd0-1bionic [34.2 kB] 2020-10-31T22:38:01.890 INFO:teuthology.orchestra.run.smithi060.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.5-488-g5e705cd0-1bionic [7,871 kB] 2020-10-31T22:38:02.905 INFO:teuthology.orchestra.run.smithi152.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.2.5-488-g5e705cd0-1bionic [22.7 MB] 2020-10-31T22:38:03.169 INFO:teuthology.orchestra.run.smithi060.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.5-488-g5e705cd0-1bionic [3,996 B] 2020-10-31T22:38:03.172 INFO:teuthology.orchestra.run.smithi060.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.5-488-g5e705cd0-1bionic [22.4 kB] 2020-10-31T22:38:03.175 INFO:teuthology.orchestra.run.smithi060.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.5-488-g5e705cd0-1bionic [43.9 MB] 2020-10-31T22:38:04.305 INFO:teuthology.orchestra.run.smithi066.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.5-488-g5e705cd0-1bionic [3,872 B] 2020-10-31T22:38:04.306 INFO:teuthology.orchestra.run.smithi066.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.5-488-g5e705cd0-1bionic [515 kB] 2020-10-31T22:38:04.386 INFO:teuthology.orchestra.run.smithi066.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.5-488-g5e705cd0-1bionic [1,850 kB] 2020-10-31T22:38:04.774 INFO:teuthology.orchestra.run.smithi066.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.5-488-g5e705cd0-1bionic [51.3 kB] 2020-10-31T22:38:04.813 INFO:teuthology.orchestra.run.smithi066.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.5-488-g5e705cd0-1bionic [55.5 kB] 2020-10-31T22:38:04.820 INFO:teuthology.orchestra.run.smithi066.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.5-488-g5e705cd0-1bionic [3,173 kB] 2020-10-31T22:38:05.487 INFO:teuthology.orchestra.run.smithi066.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.5-488-g5e705cd0-1bionic [34.2 kB] 2020-10-31T22:38:05.489 INFO:teuthology.orchestra.run.smithi066.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.5-488-g5e705cd0-1bionic [7,871 kB] 2020-10-31T22:38:07.156 INFO:teuthology.orchestra.run.smithi066.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.5-488-g5e705cd0-1bionic [3,996 B] 2020-10-31T22:38:07.156 INFO:teuthology.orchestra.run.smithi066.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.5-488-g5e705cd0-1bionic [22.4 kB] 2020-10-31T22:38:07.157 INFO:teuthology.orchestra.run.smithi066.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.5-488-g5e705cd0-1bionic [43.9 MB] 2020-10-31T22:38:08.009 INFO:teuthology.orchestra.run.smithi152.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.2.5-488-g5e705cd0-1bionic [3,872 B] 2020-10-31T22:38:08.010 INFO:teuthology.orchestra.run.smithi152.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.2.5-488-g5e705cd0-1bionic [515 kB] 2020-10-31T22:38:08.155 INFO:teuthology.orchestra.run.smithi152.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.2.5-488-g5e705cd0-1bionic [1,850 kB] 2020-10-31T22:38:08.317 INFO:teuthology.orchestra.run.smithi085.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.2.5-488-g5e705cd0-1bionic [15.7 kB] 2020-10-31T22:38:08.317 INFO:teuthology.orchestra.run.smithi085.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.5-488-g5e705cd0-1bionic [17.9 kB] 2020-10-31T22:38:08.317 INFO:teuthology.orchestra.run.smithi085.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.5-488-g5e705cd0-1bionic [8,750 kB] 2020-10-31T22:38:08.561 INFO:teuthology.orchestra.run.smithi152.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.2.5-488-g5e705cd0-1bionic [51.3 kB] 2020-10-31T22:38:08.563 INFO:teuthology.orchestra.run.smithi152.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.2.5-488-g5e705cd0-1bionic [55.5 kB] 2020-10-31T22:38:08.565 INFO:teuthology.orchestra.run.smithi152.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.2.5-488-g5e705cd0-1bionic [3,173 kB] 2020-10-31T22:38:09.275 INFO:teuthology.orchestra.run.smithi152.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.2.5-488-g5e705cd0-1bionic [34.2 kB] 2020-10-31T22:38:09.277 INFO:teuthology.orchestra.run.smithi152.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.2.5-488-g5e705cd0-1bionic [7,871 kB] 2020-10-31T22:38:09.865 INFO:teuthology.orchestra.run.smithi085.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.5-488-g5e705cd0-1bionic [62.6 kB] 2020-10-31T22:38:10.578 INFO:teuthology.orchestra.run.smithi085.stdout:Fetched 156 MB in 17s (9,189 kB/s) 2020-10-31T22:38:10.697 INFO:teuthology.orchestra.run.smithi152.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.2.5-488-g5e705cd0-1bionic [3,996 B] 2020-10-31T22:38:10.698 INFO:teuthology.orchestra.run.smithi152.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.2.5-488-g5e705cd0-1bionic [22.4 kB] 2020-10-31T22:38:10.699 INFO:teuthology.orchestra.run.smithi152.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.2.5-488-g5e705cd0-1bionic [43.9 MB] 2020-10-31T22:38:10.747 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-pyparsing. 2020-10-31T22:38:10.785 INFO:teuthology.orchestra.run.smithi085.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102061 files and directories currently installed.) 2020-10-31T22:38:10.787 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-10-31T22:38:10.829 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-10-31T22:38:11.121 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-pyperclip. 2020-10-31T22:38:11.127 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2020-10-31T22:38:11.165 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2020-10-31T22:38:11.434 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-cmd2. 2020-10-31T22:38:11.446 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2020-10-31T22:38:11.476 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2020-10-31T22:38:11.805 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-uritemplate. 2020-10-31T22:38:11.815 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-10-31T22:38:11.854 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-10-31T22:38:12.192 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-10-31T22:38:12.202 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-10-31T22:38:12.282 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-10-31T22:38:12.647 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../005-librbd1_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:12.786 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking librbd1 (15.2.5-488-g5e705cd0-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-10-31T22:38:13.502 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../006-librados2_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:13.624 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking librados2 (15.2.5-488-g5e705cd0-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-10-31T22:38:13.625 INFO:teuthology.orchestra.run.smithi060.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.2.5-488-g5e705cd0-1bionic [15.7 kB] 2020-10-31T22:38:13.626 INFO:teuthology.orchestra.run.smithi060.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.5-488-g5e705cd0-1bionic [17.9 kB] 2020-10-31T22:38:13.626 INFO:teuthology.orchestra.run.smithi060.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.5-488-g5e705cd0-1bionic [8,750 kB] 2020-10-31T22:38:14.302 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package libcephfs2. 2020-10-31T22:38:14.315 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../007-libcephfs2_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:14.352 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking libcephfs2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:14.676 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-rados. 2020-10-31T22:38:14.683 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../008-python3-rados_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:14.721 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-rados (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:15.075 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-10-31T22:38:15.085 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:15.124 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-ceph-argparse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:15.436 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-cephfs. 2020-10-31T22:38:15.448 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../010-python3-cephfs_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:15.485 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-cephfs (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:15.804 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-ceph-common. 2020-10-31T22:38:15.817 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../011-python3-ceph-common_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:15.846 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:16.084 INFO:teuthology.orchestra.run.smithi060.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.5-488-g5e705cd0-1bionic [62.6 kB] 2020-10-31T22:38:16.157 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-prettytable. 2020-10-31T22:38:16.170 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2020-10-31T22:38:16.207 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-10-31T22:38:16.484 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-rbd. 2020-10-31T22:38:16.495 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../013-python3-rbd_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:16.534 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-rbd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:16.832 INFO:teuthology.orchestra.run.smithi060.stdout:Fetched 156 MB in 23s (6,744 kB/s) 2020-10-31T22:38:16.929 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-10-31T22:38:16.940 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-10-31T22:38:16.989 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pyparsing. 2020-10-31T22:38:17.004 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-10-31T22:38:17.028 INFO:teuthology.orchestra.run.smithi060.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102061 files and directories currently installed.) 2020-10-31T22:38:17.031 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-10-31T22:38:17.071 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-10-31T22:38:17.290 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-10-31T22:38:17.302 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-10-31T22:38:17.367 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-10-31T22:38:17.368 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pyperclip. 2020-10-31T22:38:17.376 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2020-10-31T22:38:17.415 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2020-10-31T22:38:17.636 INFO:teuthology.orchestra.run.smithi152.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.2.5-488-g5e705cd0-1bionic [15.7 kB] 2020-10-31T22:38:17.637 INFO:teuthology.orchestra.run.smithi152.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.5-488-g5e705cd0-1bionic [17.9 kB] 2020-10-31T22:38:17.637 INFO:teuthology.orchestra.run.smithi152.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.5-488-g5e705cd0-1bionic [8,750 kB] 2020-10-31T22:38:17.643 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-cmd2. 2020-10-31T22:38:17.656 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2020-10-31T22:38:17.685 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2020-10-31T22:38:17.718 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package librgw2. 2020-10-31T22:38:17.729 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../016-librgw2_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:17.768 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking librgw2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:17.987 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-uritemplate. 2020-10-31T22:38:18.000 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-10-31T22:38:18.038 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-10-31T22:38:18.321 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-rgw. 2020-10-31T22:38:18.331 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../017-python3-rgw_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:18.357 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-10-31T22:38:18.369 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-10-31T22:38:18.370 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-rgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:18.441 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-10-31T22:38:18.698 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-10-31T22:38:18.711 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-10-31T22:38:18.740 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-10-31T22:38:18.741 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../005-librbd1_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:18.853 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking librbd1 (15.2.5-488-g5e705cd0-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-10-31T22:38:18.870 INFO:teuthology.orchestra.run.smithi152.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.5-488-g5e705cd0-1bionic [62.6 kB] 2020-10-31T22:38:19.051 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-10-31T22:38:19.063 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2020-10-31T22:38:19.101 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-10-31T22:38:19.377 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../006-librados2_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:19.499 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking librados2 (15.2.5-488-g5e705cd0-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-10-31T22:38:19.512 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package liboath0. 2020-10-31T22:38:19.525 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2020-10-31T22:38:19.558 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 156 MB in 25s (6,113 kB/s) 2020-10-31T22:38:19.567 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-10-31T22:38:19.678 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyparsing. 2020-10-31T22:38:19.714 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102061 files and directories currently installed.) 2020-10-31T22:38:19.717 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-10-31T22:38:19.786 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-10-31T22:38:19.875 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package libradosstriper1. 2020-10-31T22:38:19.886 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../021-libradosstriper1_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:19.923 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking libradosstriper1 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:20.095 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libcephfs2. 2020-10-31T22:38:20.095 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyperclip. 2020-10-31T22:38:20.107 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../007-libcephfs2_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:20.108 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2020-10-31T22:38:20.145 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libcephfs2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:20.146 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2020-10-31T22:38:20.351 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-common. 2020-10-31T22:38:20.363 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../022-ceph-common_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:20.399 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cmd2. 2020-10-31T22:38:20.401 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:20.410 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2020-10-31T22:38:20.431 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-rados. 2020-10-31T22:38:20.444 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../008-python3-rados_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:20.450 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2020-10-31T22:38:20.481 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-rados (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:20.768 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-uritemplate. 2020-10-31T22:38:20.781 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-10-31T22:38:20.826 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-10-31T22:38:20.827 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-10-31T22:38:20.839 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:20.875 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-ceph-argparse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:21.149 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-10-31T22:38:21.161 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-10-31T22:38:21.162 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-cephfs. 2020-10-31T22:38:21.173 INFO:teuthology.orchestra.run.smithi066.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 cephfs-shell all 15.2.5-488-g5e705cd0-1bionic [15.7 kB] 2020-10-31T22:38:21.173 INFO:teuthology.orchestra.run.smithi066.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.2.5-488-g5e705cd0-1bionic [17.9 kB] 2020-10-31T22:38:21.174 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../010-python3-cephfs_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:21.174 INFO:teuthology.orchestra.run.smithi066.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.2.5-488-g5e705cd0-1bionic [8,750 kB] 2020-10-31T22:38:21.206 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-cephfs (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:21.248 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-10-31T22:38:21.548 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-ceph-common. 2020-10-31T22:38:21.560 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../011-python3-ceph-common_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:21.561 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../005-librbd1_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:21.601 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:21.660 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librbd1 (15.2.5-488-g5e705cd0-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-10-31T22:38:21.901 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-prettytable. 2020-10-31T22:38:21.914 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2020-10-31T22:38:21.951 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-10-31T22:38:22.192 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../006-librados2_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:22.216 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-base. 2020-10-31T22:38:22.220 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-rbd. 2020-10-31T22:38:22.228 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../023-ceph-base_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:22.232 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../013-python3-rbd_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:22.270 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-rbd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:22.275 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-base (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:22.322 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librados2 (15.2.5-488-g5e705cd0-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-10-31T22:38:22.564 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-10-31T22:38:22.577 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-10-31T22:38:22.606 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-10-31T22:38:22.926 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-10-31T22:38:22.934 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libcephfs2. 2020-10-31T22:38:22.939 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-10-31T22:38:22.946 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../007-libcephfs2_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:22.976 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libcephfs2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:22.976 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-10-31T22:38:23.170 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-dateutil. 2020-10-31T22:38:23.183 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2020-10-31T22:38:23.221 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-10-31T22:38:23.270 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rados. 2020-10-31T22:38:23.282 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../008-python3-rados_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:23.312 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package librgw2. 2020-10-31T22:38:23.320 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rados (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:23.324 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../016-librgw2_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:23.362 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking librgw2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:23.681 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-10-31T22:38:23.693 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:23.716 INFO:teuthology.orchestra.run.smithi066.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/octopus/5e705cd08d99a37f9ec3c2b451d90f6262257c7c/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.2.5-488-g5e705cd0-1bionic [62.6 kB] 2020-10-31T22:38:23.856 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-rgw. 2020-10-31T22:38:23.868 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../017-python3-rgw_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:23.898 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-rgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:24.226 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-10-31T22:38:24.238 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-10-31T22:38:24.276 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-10-31T22:38:24.340 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-asn1crypto. 2020-10-31T22:38:24.353 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2020-10-31T22:38:24.393 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-10-31T22:38:24.458 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 156 MB in 31s (5,096 kB/s) 2020-10-31T22:38:24.490 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-ceph-argparse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:24.579 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-10-31T22:38:24.591 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2020-10-31T22:38:24.596 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pyparsing. 2020-10-31T22:38:24.628 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-10-31T22:38:24.632 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102061 files and directories currently installed.) 2020-10-31T22:38:24.635 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../000-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2020-10-31T22:38:24.678 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2020-10-31T22:38:24.684 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-cffi-backend. 2020-10-31T22:38:24.697 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-10-31T22:38:24.734 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-10-31T22:38:24.776 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cephfs. 2020-10-31T22:38:24.787 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../010-python3-cephfs_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:24.818 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cephfs (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:24.948 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package liboath0. 2020-10-31T22:38:24.960 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2020-10-31T22:38:24.990 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-10-31T22:38:25.037 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-cryptography. 2020-10-31T22:38:25.048 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2020-10-31T22:38:25.079 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-10-31T22:38:25.090 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pyperclip. 2020-10-31T22:38:25.104 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../001-python3-pyperclip_1.6.0-1_all.deb ... 2020-10-31T22:38:25.139 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-ceph-common. 2020-10-31T22:38:25.139 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pyperclip (1.6.0-1) ... 2020-10-31T22:38:25.149 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../011-python3-ceph-common_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:25.187 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:25.284 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libradosstriper1. 2020-10-31T22:38:25.297 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../021-libradosstriper1_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:25.334 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libradosstriper1 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:25.441 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-openssl. 2020-10-31T22:38:25.450 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cmd2. 2020-10-31T22:38:25.453 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-10-31T22:38:25.462 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../002-python3-cmd2_0.7.9-0ubuntu1_all.deb ... 2020-10-31T22:38:25.491 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-10-31T22:38:25.491 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-prettytable. 2020-10-31T22:38:25.502 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cmd2 (0.7.9-0ubuntu1) ... 2020-10-31T22:38:25.503 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2020-10-31T22:38:25.558 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-10-31T22:38:25.768 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-10-31T22:38:25.778 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:25.779 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-common. 2020-10-31T22:38:25.797 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../022-ceph-common_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:25.809 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rbd. 2020-10-31T22:38:25.818 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-mgr-modules-core (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:25.821 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../013-python3-rbd_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:25.829 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:25.859 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rbd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:26.154 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-10-31T22:38:26.155 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-bcrypt. 2020-10-31T22:38:26.166 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-10-31T22:38:26.167 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-10-31T22:38:26.195 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-10-31T22:38:26.207 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-10-31T22:38:26.453 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-uritemplate. 2020-10-31T22:38:26.464 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../003-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2020-10-31T22:38:26.494 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2020-10-31T22:38:26.499 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-cherrypy3. 2020-10-31T22:38:26.510 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2020-10-31T22:38:26.532 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-10-31T22:38:26.544 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-10-31T22:38:26.549 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-10-31T22:38:26.583 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-10-31T22:38:26.814 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2020-10-31T22:38:26.826 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../004-liblttng-ust0_2.10.1-1_amd64.deb ... 2020-10-31T22:38:26.869 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-jwt. 2020-10-31T22:38:26.882 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-10-31T22:38:26.918 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package librgw2. 2020-10-31T22:38:26.920 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-10-31T22:38:26.931 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../016-librgw2_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:26.931 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2020-10-31T22:38:26.968 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking librgw2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:27.239 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-logutils. 2020-10-31T22:38:27.247 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../005-librbd1_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:27.252 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2020-10-31T22:38:27.289 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-10-31T22:38:27.368 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librbd1 (15.2.5-488-g5e705cd0-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-10-31T22:38:27.471 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rgw. 2020-10-31T22:38:27.482 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../017-python3-rgw_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:27.512 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:27.600 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-markupsafe. 2020-10-31T22:38:27.611 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-10-31T22:38:27.636 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-base. 2020-10-31T22:38:27.648 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../023-ceph-base_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:27.650 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-10-31T22:38:27.695 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-base (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:27.851 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../006-librados2_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:27.857 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-10-31T22:38:27.869 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-10-31T22:38:27.907 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-10-31T22:38:27.947 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librados2 (15.2.5-488-g5e705cd0-1bionic) over (12.2.13-0ubuntu0.18.04.4) ... 2020-10-31T22:38:27.953 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-mako. 2020-10-31T22:38:27.966 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2020-10-31T22:38:27.994 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-10-31T22:38:28.209 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-10-31T22:38:28.221 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2020-10-31T22:38:28.260 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-10-31T22:38:28.306 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-simplegeneric. 2020-10-31T22:38:28.319 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2020-10-31T22:38:28.347 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-10-31T22:38:28.524 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-dateutil. 2020-10-31T22:38:28.536 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2020-10-31T22:38:28.565 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-10-31T22:38:28.596 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package liboath0. 2020-10-31T22:38:28.600 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libcephfs2. 2020-10-31T22:38:28.608 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2020-10-31T22:38:28.612 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../007-libcephfs2_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:28.638 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-10-31T22:38:28.641 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-singledispatch. 2020-10-31T22:38:28.650 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libcephfs2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:28.652 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-10-31T22:38:28.691 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-10-31T22:38:28.852 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-asn1crypto. 2020-10-31T22:38:28.866 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2020-10-31T22:38:28.902 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-10-31T22:38:28.949 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libradosstriper1. 2020-10-31T22:38:28.961 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../021-libradosstriper1_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:28.970 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rados. 2020-10-31T22:38:28.982 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../008-python3-rados_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:29.002 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libradosstriper1 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:29.021 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rados (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:29.028 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-webob. 2020-10-31T22:38:29.039 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-10-31T22:38:29.078 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-10-31T22:38:29.190 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-cffi-backend. 2020-10-31T22:38:29.200 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-10-31T22:38:29.238 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-10-31T22:38:29.322 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-ceph-argparse. 2020-10-31T22:38:29.335 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../009-python3-ceph-argparse_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:29.364 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-ceph-argparse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:29.414 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-bs4. 2020-10-31T22:38:29.425 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2020-10-31T22:38:29.453 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-common. 2020-10-31T22:38:29.469 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-10-31T22:38:29.469 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../022-ceph-common_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:29.502 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:29.540 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-cryptography. 2020-10-31T22:38:29.554 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2020-10-31T22:38:29.590 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-10-31T22:38:29.651 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cephfs. 2020-10-31T22:38:29.662 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../010-python3-cephfs_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:29.700 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cephfs (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:29.800 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-waitress. 2020-10-31T22:38:29.813 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2020-10-31T22:38:29.850 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-10-31T22:38:29.944 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-openssl. 2020-10-31T22:38:29.958 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-10-31T22:38:29.994 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-10-31T22:38:30.044 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-ceph-common. 2020-10-31T22:38:30.057 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../011-python3-ceph-common_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:30.094 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:30.188 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-tempita. 2020-10-31T22:38:30.199 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2020-10-31T22:38:30.230 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-10-31T22:38:30.238 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-10-31T22:38:30.242 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:30.281 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mgr-modules-core (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:30.430 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-prettytable. 2020-10-31T22:38:30.442 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../012-python3-prettytable_0.7.2-3_all.deb ... 2020-10-31T22:38:30.481 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2020-10-31T22:38:30.574 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-paste. 2020-10-31T22:38:30.587 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-10-31T22:38:30.624 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-10-31T22:38:30.699 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rbd. 2020-10-31T22:38:30.712 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../013-python3-rbd_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:30.741 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rbd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:30.751 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-bcrypt. 2020-10-31T22:38:30.762 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-10-31T22:38:30.801 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-10-31T22:38:30.943 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-10-31T22:38:30.962 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-10-31T22:38:31.006 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-10-31T22:38:31.066 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-cherrypy3. 2020-10-31T22:38:31.074 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2020-10-31T22:38:31.104 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-10-31T22:38:31.202 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package librabbitmq4:amd64. 2020-10-31T22:38:31.215 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../014-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2020-10-31T22:38:31.252 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-10-31T22:38:31.295 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-base. 2020-10-31T22:38:31.296 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-pastedeploy. 2020-10-31T22:38:31.306 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../023-ceph-base_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:31.310 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2020-10-31T22:38:31.350 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-base (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:31.379 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-10-31T22:38:31.416 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-jwt. 2020-10-31T22:38:31.430 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-10-31T22:38:31.466 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-10-31T22:38:31.597 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package librdkafka1:amd64. 2020-10-31T22:38:31.609 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../015-librdkafka1_0.11.3-1build1_amd64.deb ... 2020-10-31T22:38:31.647 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2020-10-31T22:38:31.732 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-webtest. 2020-10-31T22:38:31.745 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-10-31T22:38:31.777 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-logutils. 2020-10-31T22:38:31.782 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-10-31T22:38:31.791 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2020-10-31T22:38:31.827 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-10-31T22:38:31.949 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package librgw2. 2020-10-31T22:38:31.960 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../016-librgw2_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:32.016 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking librgw2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:32.143 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-pecan. 2020-10-31T22:38:32.155 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-markupsafe. 2020-10-31T22:38:32.156 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2020-10-31T22:38:32.166 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-10-31T22:38:32.193 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-10-31T22:38:32.205 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-10-31T22:38:32.222 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-dateutil. 2020-10-31T22:38:32.234 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2020-10-31T22:38:32.264 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-10-31T22:38:32.508 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-mako. 2020-10-31T22:38:32.510 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rgw. 2020-10-31T22:38:32.520 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2020-10-31T22:38:32.523 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../017-python3-rgw_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:32.556 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-werkzeug. 2020-10-31T22:38:32.558 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-10-31T22:38:32.558 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-asn1crypto. 2020-10-31T22:38:32.559 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:32.567 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-10-31T22:38:32.571 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2020-10-31T22:38:32.606 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-10-31T22:38:32.799 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-10-31T22:38:32.878 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-simplegeneric. 2020-10-31T22:38:32.879 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2020-10-31T22:38:32.886 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cffi-backend. 2020-10-31T22:38:32.889 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2020-10-31T22:38:32.892 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../018-libsnappy1v5_1.1.7-1_amd64.deb ... 2020-10-31T22:38:32.899 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-10-31T22:38:32.920 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-10-31T22:38:32.929 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2020-10-31T22:38:32.936 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-10-31T22:38:33.001 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-mgr. 2020-10-31T22:38:33.014 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../048-ceph-mgr_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:33.050 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-mgr (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:33.189 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-singledispatch. 2020-10-31T22:38:33.202 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-10-31T22:38:33.223 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2020-10-31T22:38:33.235 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../019-libleveldb1v5_1.20-2_amd64.deb ... 2020-10-31T22:38:33.239 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-10-31T22:38:33.273 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cryptography. 2020-10-31T22:38:33.274 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2020-10-31T22:38:33.302 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2020-10-31T22:38:33.320 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-10-31T22:38:33.495 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-mon. 2020-10-31T22:38:33.507 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../049-ceph-mon_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:33.526 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-webob. 2020-10-31T22:38:33.538 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-10-31T22:38:33.545 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-mon (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:33.575 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-10-31T22:38:33.584 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package liboath0. 2020-10-31T22:38:33.597 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../020-liboath0_2.6.1-1_amd64.deb ... 2020-10-31T22:38:33.627 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking liboath0 (2.6.1-1) ... 2020-10-31T22:38:33.684 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-openssl. 2020-10-31T22:38:33.700 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-10-31T22:38:33.738 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-10-31T22:38:33.878 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-bs4. 2020-10-31T22:38:33.889 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2020-10-31T22:38:33.928 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-10-31T22:38:33.962 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libradosstriper1. 2020-10-31T22:38:33.976 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../021-libradosstriper1_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:34.012 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libradosstriper1 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:34.170 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-10-31T22:38:34.183 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:34.214 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-waitress. 2020-10-31T22:38:34.220 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-modules-core (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:34.225 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2020-10-31T22:38:34.272 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-10-31T22:38:34.449 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-common. 2020-10-31T22:38:34.464 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../022-ceph-common_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:34.465 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-osd. 2020-10-31T22:38:34.477 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../050-ceph-osd_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:34.499 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:34.527 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-osd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:34.551 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-tempita. 2020-10-31T22:38:34.558 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-bcrypt. 2020-10-31T22:38:34.562 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2020-10-31T22:38:34.570 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-10-31T22:38:34.601 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-10-31T22:38:34.608 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-10-31T22:38:34.853 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cherrypy3. 2020-10-31T22:38:34.864 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2020-10-31T22:38:34.894 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-10-31T22:38:34.895 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-paste. 2020-10-31T22:38:34.908 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-10-31T22:38:34.949 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-10-31T22:38:35.206 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jwt. 2020-10-31T22:38:35.218 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-10-31T22:38:35.241 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-10-31T22:38:35.248 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-10-31T22:38:35.252 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-10-31T22:38:35.282 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-10-31T22:38:35.551 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-logutils. 2020-10-31T22:38:35.562 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2020-10-31T22:38:35.586 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pastedeploy. 2020-10-31T22:38:35.597 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2020-10-31T22:38:35.616 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-10-31T22:38:35.634 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-10-31T22:38:35.904 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-markupsafe. 2020-10-31T22:38:35.917 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-10-31T22:38:35.938 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-webtest. 2020-10-31T22:38:35.949 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-10-31T22:38:35.954 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-10-31T22:38:35.988 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-10-31T22:38:36.263 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-base. 2020-10-31T22:38:36.265 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-mako. 2020-10-31T22:38:36.266 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pecan. 2020-10-31T22:38:36.279 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../023-ceph-base_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:36.280 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2020-10-31T22:38:36.281 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2020-10-31T22:38:36.315 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-10-31T22:38:36.316 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-10-31T22:38:36.322 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-base (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:36.419 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph. 2020-10-31T22:38:36.434 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../051-ceph_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:36.470 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:36.580 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-simplegeneric. 2020-10-31T22:38:36.589 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2020-10-31T22:38:36.619 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-10-31T22:38:36.620 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-werkzeug. 2020-10-31T22:38:36.634 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-10-31T22:38:36.662 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-10-31T22:38:36.772 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-fuse. 2020-10-31T22:38:36.786 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../052-ceph-fuse_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:36.814 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:36.905 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-singledispatch. 2020-10-31T22:38:36.915 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-10-31T22:38:36.955 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-10-31T22:38:37.008 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mgr. 2020-10-31T22:38:37.019 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../048-ceph-mgr_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:37.049 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mgr (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:37.167 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-dateutil. 2020-10-31T22:38:37.179 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../024-python3-dateutil_2.6.1-1_all.deb ... 2020-10-31T22:38:37.219 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2020-10-31T22:38:37.225 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-mds. 2020-10-31T22:38:37.240 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../053-ceph-mds_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:37.275 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-mds (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:37.368 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-webob. 2020-10-31T22:38:37.379 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-10-31T22:38:37.417 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-10-31T22:38:37.481 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mon. 2020-10-31T22:38:37.493 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../049-ceph-mon_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:37.530 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mon (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:37.538 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-asn1crypto. 2020-10-31T22:38:37.556 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2020-10-31T22:38:37.587 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2020-10-31T22:38:37.720 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-bs4. 2020-10-31T22:38:37.732 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2020-10-31T22:38:37.769 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package cephadm. 2020-10-31T22:38:37.770 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-10-31T22:38:37.782 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../054-cephadm_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:37.819 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:37.839 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cffi-backend. 2020-10-31T22:38:37.851 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../026-python3-cffi-backend_1.11.5-1_amd64.deb ... 2020-10-31T22:38:37.890 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2020-10-31T22:38:38.090 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-waitress. 2020-10-31T22:38:38.105 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2020-10-31T22:38:38.114 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-jinja2. 2020-10-31T22:38:38.130 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-10-31T22:38:38.131 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-10-31T22:38:38.144 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cryptography. 2020-10-31T22:38:38.153 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../027-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2020-10-31T22:38:38.169 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-10-31T22:38:38.183 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-10-31T22:38:38.392 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-tempita. 2020-10-31T22:38:38.409 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2020-10-31T22:38:38.431 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-osd. 2020-10-31T22:38:38.434 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-10-31T22:38:38.442 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../050-ceph-osd_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:38.474 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-10-31T22:38:38.479 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:38.480 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-osd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:38.508 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-mgr-cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:38.573 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-openssl. 2020-10-31T22:38:38.584 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../028-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2020-10-31T22:38:38.621 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2020-10-31T22:38:38.736 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-paste. 2020-10-31T22:38:38.747 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-10-31T22:38:38.786 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-10-31T22:38:38.803 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-repoze.lru. 2020-10-31T22:38:38.815 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2020-10-31T22:38:38.852 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-10-31T22:38:38.921 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2020-10-31T22:38:38.921 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../029-ceph-mgr-modules-core_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:38.959 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-modules-core (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:39.114 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-10-31T22:38:39.130 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-10-31T22:38:39.157 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-10-31T22:38:39.185 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-routes. 2020-10-31T22:38:39.193 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2020-10-31T22:38:39.232 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-10-31T22:38:39.293 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-bcrypt. 2020-10-31T22:38:39.306 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../030-python3-bcrypt_3.1.4-2_amd64.deb ... 2020-10-31T22:38:39.335 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2020-10-31T22:38:39.443 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pastedeploy. 2020-10-31T22:38:39.455 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2020-10-31T22:38:39.493 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-10-31T22:38:39.566 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-10-31T22:38:39.579 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:39.616 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-mgr-dashboard (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:39.638 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cherrypy3. 2020-10-31T22:38:39.651 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../031-python3-cherrypy3_8.9.1-2_all.deb ... 2020-10-31T22:38:39.689 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2020-10-31T22:38:39.778 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-webtest. 2020-10-31T22:38:39.789 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-10-31T22:38:39.830 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-10-31T22:38:40.024 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-jwt. 2020-10-31T22:38:40.037 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../032-python3-jwt_1.5.3+ds1-1_all.deb ... 2020-10-31T22:38:40.074 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2020-10-31T22:38:40.189 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pecan. 2020-10-31T22:38:40.201 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2020-10-31T22:38:40.238 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-10-31T22:38:40.352 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-logutils. 2020-10-31T22:38:40.365 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../033-python3-logutils_0.3.3-5_all.deb ... 2020-10-31T22:38:40.369 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph. 2020-10-31T22:38:40.381 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../051-ceph_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:40.394 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-logutils (0.3.3-5) ... 2020-10-31T22:38:40.419 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:40.565 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-10-31T22:38:40.579 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:40.580 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-werkzeug. 2020-10-31T22:38:40.591 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-10-31T22:38:40.627 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-10-31T22:38:40.627 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:40.710 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-markupsafe. 2020-10-31T22:38:40.718 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../034-python3-markupsafe_1.0-1build1_amd64.deb ... 2020-10-31T22:38:40.739 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-fuse. 2020-10-31T22:38:40.751 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../052-ceph-fuse_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:40.755 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2020-10-31T22:38:40.788 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:40.935 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-numpy. 2020-10-31T22:38:40.947 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../061-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-10-31T22:38:40.975 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-10-31T22:38:41.013 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr. 2020-10-31T22:38:41.025 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../048-ceph-mgr_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:41.050 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-mako. 2020-10-31T22:38:41.062 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../035-python3-mako_1.0.7+ds1-1_all.deb ... 2020-10-31T22:38:41.062 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:41.099 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2020-10-31T22:38:41.134 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mds. 2020-10-31T22:38:41.145 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../053-ceph-mds_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:41.177 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mds (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:41.410 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-simplegeneric. 2020-10-31T22:38:41.422 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../036-python3-simplegeneric_0.8.1-1_all.deb ... 2020-10-31T22:38:41.460 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2020-10-31T22:38:41.503 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mon. 2020-10-31T22:38:41.511 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../049-ceph-mon_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:41.550 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mon (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:41.656 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-decorator. 2020-10-31T22:38:41.669 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../062-python3-decorator_4.1.2-1_all.deb ... 2020-10-31T22:38:41.706 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-10-31T22:38:41.720 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package cephadm. 2020-10-31T22:38:41.732 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../054-cephadm_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:41.746 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-singledispatch. 2020-10-31T22:38:41.757 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../037-python3-singledispatch_3.4.0.3-2_all.deb ... 2020-10-31T22:38:41.770 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:41.797 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2020-10-31T22:38:42.025 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-scipy. 2020-10-31T22:38:42.032 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-webob. 2020-10-31T22:38:42.037 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../063-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-10-31T22:38:42.043 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../038-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2020-10-31T22:38:42.073 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-jinja2. 2020-10-31T22:38:42.074 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2020-10-31T22:38:42.074 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-10-31T22:38:42.087 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-10-31T22:38:42.123 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-10-31T22:38:42.395 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-bs4. 2020-10-31T22:38:42.405 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../039-python3-bs4_4.6.0-1_all.deb ... 2020-10-31T22:38:42.442 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-10-31T22:38:42.443 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2020-10-31T22:38:42.444 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-osd. 2020-10-31T22:38:42.454 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:42.456 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../050-ceph-osd_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:42.492 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mgr-cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:42.493 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-osd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:42.759 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-waitress. 2020-10-31T22:38:42.766 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../040-python3-waitress_1.0.1-1_all.deb ... 2020-10-31T22:38:42.783 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-repoze.lru. 2020-10-31T22:38:42.792 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2020-10-31T22:38:42.804 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-waitress (1.0.1-1) ... 2020-10-31T22:38:42.821 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-10-31T22:38:43.098 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-routes. 2020-10-31T22:38:43.108 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-tempita. 2020-10-31T22:38:43.110 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2020-10-31T22:38:43.120 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-2_all.deb ... 2020-10-31T22:38:43.148 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-10-31T22:38:43.158 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-tempita (0.5.2-2) ... 2020-10-31T22:38:43.299 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-10-31T22:38:43.311 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-10-31T22:38:43.349 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-10-31T22:38:43.443 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-paste. 2020-10-31T22:38:43.456 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../042-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2020-10-31T22:38:43.460 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-10-31T22:38:43.472 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:43.496 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-10-31T22:38:43.509 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mgr-dashboard (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:43.804 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2020-10-31T22:38:43.817 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2020-10-31T22:38:43.835 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-joblib. 2020-10-31T22:38:43.848 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../065-python3-joblib_0.11-1_all.deb ... 2020-10-31T22:38:43.855 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2020-10-31T22:38:43.911 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-joblib (0.11-1) ... 2020-10-31T22:38:44.165 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pastedeploy. 2020-10-31T22:38:44.178 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../044-python3-pastedeploy_1.5.2-4_all.deb ... 2020-10-31T22:38:44.215 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2020-10-31T22:38:44.272 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-sklearn. 2020-10-31T22:38:44.283 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../066-python3-sklearn_0.19.1-3_all.deb ... 2020-10-31T22:38:44.321 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-10-31T22:38:44.340 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph. 2020-10-31T22:38:44.354 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../051-ceph_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:44.367 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-10-31T22:38:44.382 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:44.390 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:44.417 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:44.526 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-webtest. 2020-10-31T22:38:44.537 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../045-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2020-10-31T22:38:44.568 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2020-10-31T22:38:44.668 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-fuse. 2020-10-31T22:38:44.680 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../052-ceph-fuse_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:44.721 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-numpy. 2020-10-31T22:38:44.731 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../061-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-10-31T22:38:44.733 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:44.762 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-10-31T22:38:44.856 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pecan. 2020-10-31T22:38:44.861 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-10-31T22:38:44.867 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../046-python3-pecan_1.2.1-2_all.deb ... 2020-10-31T22:38:44.874 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:44.904 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pecan (1.2.1-2) ... 2020-10-31T22:38:44.927 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:45.112 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mds. 2020-10-31T22:38:45.128 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../053-ceph-mds_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:45.162 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mds (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:45.233 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-werkzeug. 2020-10-31T22:38:45.246 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../047-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2020-10-31T22:38:45.284 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2020-10-31T22:38:45.385 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-decorator. 2020-10-31T22:38:45.396 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../062-python3-decorator_4.1.2-1_all.deb ... 2020-10-31T22:38:45.434 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-10-31T22:38:45.631 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package cephadm. 2020-10-31T22:38:45.642 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../054-cephadm_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:45.644 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr. 2020-10-31T22:38:45.657 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../048-ceph-mgr_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:45.695 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:45.706 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:45.721 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-scipy. 2020-10-31T22:38:45.736 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../063-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-10-31T22:38:45.762 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-10-31T22:38:45.984 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jinja2. 2020-10-31T22:38:45.995 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-10-31T22:38:46.026 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-10-31T22:38:46.086 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-monotonic. 2020-10-31T22:38:46.099 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../068-python3-monotonic_1.1-2_all.deb ... 2020-10-31T22:38:46.148 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-10-31T22:38:46.149 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mon. 2020-10-31T22:38:46.160 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../049-ceph-mon_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:46.198 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mon (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:46.303 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-10-31T22:38:46.316 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:46.346 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:46.383 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-fasteners. 2020-10-31T22:38:46.395 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../069-python3-fasteners_0.12.0-3_all.deb ... 2020-10-31T22:38:46.466 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-10-31T22:38:46.615 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-repoze.lru. 2020-10-31T22:38:46.626 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2020-10-31T22:38:46.673 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-10-31T22:38:46.802 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-httplib2. 2020-10-31T22:38:46.817 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../070-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2020-10-31T22:38:46.860 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-10-31T22:38:46.921 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-10-31T22:38:46.935 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-10-31T22:38:46.980 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-10-31T22:38:46.985 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-routes. 2020-10-31T22:38:46.996 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2020-10-31T22:38:47.009 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-osd. 2020-10-31T22:38:47.021 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../050-ceph-osd_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:47.034 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-10-31T22:38:47.059 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-osd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:47.188 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-pyasn1. 2020-10-31T22:38:47.200 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3_all.deb ... 2020-10-31T22:38:47.240 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-10-31T22:38:47.328 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-10-31T22:38:47.339 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:47.378 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-dashboard (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:47.400 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-joblib. 2020-10-31T22:38:47.413 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../065-python3-joblib_0.11-1_all.deb ... 2020-10-31T22:38:47.458 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-joblib (0.11-1) ... 2020-10-31T22:38:47.600 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-10-31T22:38:47.618 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-10-31T22:38:47.649 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-10-31T22:38:47.778 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-sklearn. 2020-10-31T22:38:47.789 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../066-python3-sklearn_0.19.1-3_all.deb ... 2020-10-31T22:38:47.828 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-10-31T22:38:47.994 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-rsa. 2020-10-31T22:38:48.006 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../073-python3-rsa_3.4.2-1_all.deb ... 2020-10-31T22:38:48.044 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-10-31T22:38:48.276 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-10-31T22:38:48.290 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:48.334 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:48.338 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-10-31T22:38:48.350 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../074-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-10-31T22:38:48.351 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-10-31T22:38:48.365 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:48.379 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-10-31T22:38:48.401 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:48.662 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-numpy. 2020-10-31T22:38:48.674 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../061-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-10-31T22:38:48.712 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-10-31T22:38:48.859 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-oauth2client. 2020-10-31T22:38:48.872 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../075-python3-oauth2client_4.1.2-3_all.deb ... 2020-10-31T22:38:48.923 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph. 2020-10-31T22:38:48.940 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../051-ceph_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:48.947 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-10-31T22:38:48.973 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:49.308 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-fuse. 2020-10-31T22:38:49.321 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../052-ceph-fuse_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:49.351 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-decorator. 2020-10-31T22:38:49.358 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../062-python3-decorator_4.1.2-1_all.deb ... 2020-10-31T22:38:49.405 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-10-31T22:38:49.413 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-setuptools. 2020-10-31T22:38:49.425 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../076-python3-setuptools_39.0.1-2_all.deb ... 2020-10-31T22:38:49.470 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-10-31T22:38:49.509 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-monotonic. 2020-10-31T22:38:49.519 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../068-python3-monotonic_1.1-2_all.deb ... 2020-10-31T22:38:49.557 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-10-31T22:38:49.678 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mds. 2020-10-31T22:38:49.692 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../053-ceph-mds_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:49.721 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-scipy. 2020-10-31T22:38:49.728 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mds (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:49.733 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../063-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-10-31T22:38:49.774 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-10-31T22:38:49.859 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-fasteners. 2020-10-31T22:38:49.871 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../069-python3-fasteners_0.12.0-3_all.deb ... 2020-10-31T22:38:49.882 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-websocket. 2020-10-31T22:38:49.893 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../077-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-10-31T22:38:49.909 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-10-31T22:38:49.950 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-10-31T22:38:50.187 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-httplib2. 2020-10-31T22:38:50.200 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package cephadm. 2020-10-31T22:38:50.201 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../070-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2020-10-31T22:38:50.211 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../054-cephadm_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:50.236 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-10-31T22:38:50.250 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:50.268 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-kubernetes. 2020-10-31T22:38:50.278 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../078-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-10-31T22:38:50.359 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-10-31T22:38:50.539 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pyasn1. 2020-10-31T22:38:50.552 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3_all.deb ... 2020-10-31T22:38:50.585 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-jinja2. 2020-10-31T22:38:50.589 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-10-31T22:38:50.598 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../055-python3-jinja2_2.10-1ubuntu0.18.04.1_all.deb ... 2020-10-31T22:38:50.635 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-10-31T22:38:50.797 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-10-31T22:38:50.808 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../079-ceph-mgr-k8sevents_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:50.846 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-mgr-k8sevents (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:50.918 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-10-31T22:38:50.919 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-10-31T22:38:50.931 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-10-31T22:38:50.931 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-10-31T22:38:50.968 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-10-31T22:38:50.968 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-10-31T22:38:50.981 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2020-10-31T22:38:50.991 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:51.030 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:51.149 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-json-pointer. 2020-10-31T22:38:51.161 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../080-python3-json-pointer_1.10-1_all.deb ... 2020-10-31T22:38:51.271 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-rsa. 2020-10-31T22:38:51.276 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-json-pointer (1.10-1) ... 2020-10-31T22:38:51.282 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../073-python3-rsa_3.4.2-1_all.deb ... 2020-10-31T22:38:51.316 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-repoze.lru. 2020-10-31T22:38:51.320 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-10-31T22:38:51.329 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../057-python3-repoze.lru_0.7-1_all.deb ... 2020-10-31T22:38:51.358 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2020-10-31T22:38:51.405 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-joblib. 2020-10-31T22:38:51.418 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../065-python3-joblib_0.11-1_all.deb ... 2020-10-31T22:38:51.455 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-joblib (0.11-1) ... 2020-10-31T22:38:51.595 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-jsonpatch. 2020-10-31T22:38:51.609 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../081-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2020-10-31T22:38:51.632 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-10-31T22:38:51.636 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-routes. 2020-10-31T22:38:51.640 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-10-31T22:38:51.647 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../058-python3-routes_2.4.1-1_all.deb ... 2020-10-31T22:38:51.666 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../074-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-10-31T22:38:51.686 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-routes (2.4.1-1) ... 2020-10-31T22:38:51.816 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-sklearn. 2020-10-31T22:38:51.830 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../066-python3-sklearn_0.19.1-3_all.deb ... 2020-10-31T22:38:51.892 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-10-31T22:38:51.916 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-10-31T22:38:51.974 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-10-31T22:38:51.987 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:51.990 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2020-10-31T22:38:52.000 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../059-ceph-mgr-dashboard_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:52.023 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-mgr-rook (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:52.038 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-dashboard (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:52.378 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package libonig4:amd64. 2020-10-31T22:38:52.388 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../083-libonig4_6.7.0-1_amd64.deb ... 2020-10-31T22:38:52.390 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-10-31T22:38:52.395 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-oauth2client. 2020-10-31T22:38:52.403 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:52.409 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../075-python3-oauth2client_4.1.2-3_all.deb ... 2020-10-31T22:38:52.442 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-10-31T22:38:52.464 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:52.470 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-10-31T22:38:52.807 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-setuptools. 2020-10-31T22:38:52.812 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package libjq1:amd64. 2020-10-31T22:38:52.818 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../076-python3-setuptools_39.0.1-2_all.deb ... 2020-10-31T22:38:52.824 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../084-libjq1_1.5+dfsg-2_amd64.deb ... 2020-10-31T22:38:52.856 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-10-31T22:38:52.861 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-10-31T22:38:52.920 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2020-10-31T22:38:52.934 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../060-ceph-mgr-diskprediction-cloud_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:52.978 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:53.125 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package jq. 2020-10-31T22:38:53.139 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../085-jq_1.5+dfsg-2_amd64.deb ... 2020-10-31T22:38:53.184 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-10-31T22:38:53.243 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-websocket. 2020-10-31T22:38:53.248 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../077-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-10-31T22:38:53.273 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-numpy. 2020-10-31T22:38:53.285 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-10-31T22:38:53.286 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../061-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2020-10-31T22:38:53.323 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2020-10-31T22:38:53.434 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package socat. 2020-10-31T22:38:53.447 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../086-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-10-31T22:38:53.516 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-10-31T22:38:53.550 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-monotonic. 2020-10-31T22:38:53.563 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../068-python3-monotonic_1.1-2_all.deb ... 2020-10-31T22:38:53.596 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-kubernetes. 2020-10-31T22:38:53.600 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-10-31T22:38:53.610 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../078-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-10-31T22:38:53.655 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-10-31T22:38:53.894 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-fasteners. 2020-10-31T22:38:53.908 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../069-python3-fasteners_0.12.0-3_all.deb ... 2020-10-31T22:38:53.920 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-decorator. 2020-10-31T22:38:53.932 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../062-python3-decorator_4.1.2-1_all.deb ... 2020-10-31T22:38:53.944 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-10-31T22:38:53.945 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-10-31T22:38:53.957 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../087-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-10-31T22:38:53.970 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-decorator (4.1.2-1) ... 2020-10-31T22:38:53.995 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-10-31T22:38:54.026 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-10-31T22:38:54.038 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../079-ceph-mgr-k8sevents_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:54.067 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mgr-k8sevents (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:54.230 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-httplib2. 2020-10-31T22:38:54.241 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../070-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2020-10-31T22:38:54.256 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-scipy. 2020-10-31T22:38:54.267 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../063-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2020-10-31T22:38:54.280 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-10-31T22:38:54.297 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package xmlstarlet. 2020-10-31T22:38:54.306 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2020-10-31T22:38:54.309 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2_amd64.deb ... 2020-10-31T22:38:54.347 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-10-31T22:38:54.369 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-json-pointer. 2020-10-31T22:38:54.382 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../080-python3-json-pointer_1.10-1_all.deb ... 2020-10-31T22:38:54.497 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-json-pointer (1.10-1) ... 2020-10-31T22:38:54.625 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyasn1. 2020-10-31T22:38:54.637 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3_all.deb ... 2020-10-31T22:38:54.674 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-10-31T22:38:54.718 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package ceph-test. 2020-10-31T22:38:54.731 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../089-ceph-test_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:54.770 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking ceph-test (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:54.842 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-jsonpatch. 2020-10-31T22:38:54.854 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../081-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2020-10-31T22:38:54.895 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-10-31T22:38:55.028 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-10-31T22:38:55.040 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-10-31T22:38:55.069 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-10-31T22:38:55.178 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-10-31T22:38:55.190 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:55.228 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-mgr-rook (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:55.389 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-rsa. 2020-10-31T22:38:55.401 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../073-python3-rsa_3.4.2-1_all.deb ... 2020-10-31T22:38:55.430 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-10-31T22:38:55.449 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-sklearn-lib. 2020-10-31T22:38:55.461 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../064-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2020-10-31T22:38:55.488 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2020-10-31T22:38:55.556 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libonig4:amd64. 2020-10-31T22:38:55.569 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../083-libonig4_6.7.0-1_amd64.deb ... 2020-10-31T22:38:55.608 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-10-31T22:38:55.716 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-10-31T22:38:55.731 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../074-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-10-31T22:38:55.775 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-10-31T22:38:55.942 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libjq1:amd64. 2020-10-31T22:38:55.957 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../084-libjq1_1.5+dfsg-2_amd64.deb ... 2020-10-31T22:38:55.984 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-joblib. 2020-10-31T22:38:55.995 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../065-python3-joblib_0.11-1_all.deb ... 2020-10-31T22:38:56.001 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-10-31T22:38:56.033 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-joblib (0.11-1) ... 2020-10-31T22:38:56.220 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package jq. 2020-10-31T22:38:56.220 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-oauth2client. 2020-10-31T22:38:56.234 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../075-python3-oauth2client_4.1.2-3_all.deb ... 2020-10-31T22:38:56.234 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../085-jq_1.5+dfsg-2_amd64.deb ... 2020-10-31T22:38:56.270 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-10-31T22:38:56.288 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-10-31T22:38:56.354 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-sklearn. 2020-10-31T22:38:56.367 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../066-python3-sklearn_0.19.1-3_all.deb ... 2020-10-31T22:38:56.412 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2020-10-31T22:38:56.506 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package socat. 2020-10-31T22:38:56.519 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../086-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-10-31T22:38:56.556 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-10-31T22:38:56.615 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-setuptools. 2020-10-31T22:38:56.629 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../076-python3-setuptools_39.0.1-2_all.deb ... 2020-10-31T22:38:56.673 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-10-31T22:38:56.944 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-10-31T22:38:56.952 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2020-10-31T22:38:56.956 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../087-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-10-31T22:38:56.963 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../067-ceph-mgr-diskprediction-local_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:56.993 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-10-31T22:38:56.993 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:57.035 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-websocket. 2020-10-31T22:38:57.050 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../077-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-10-31T22:38:57.093 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-10-31T22:38:57.247 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package xmlstarlet. 2020-10-31T22:38:57.257 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2_amd64.deb ... 2020-10-31T22:38:57.312 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-10-31T22:38:57.421 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-kubernetes. 2020-10-31T22:38:57.433 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../078-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-10-31T22:38:57.471 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-10-31T22:38:57.630 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package ceph-test. 2020-10-31T22:38:57.640 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../089-ceph-test_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:57.675 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking ceph-test (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:57.877 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-10-31T22:38:57.887 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../079-ceph-mgr-k8sevents_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:57.929 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-k8sevents (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:58.013 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-colorama. 2020-10-31T22:38:58.025 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../090-python3-colorama_0.3.7-1_all.deb ... 2020-10-31T22:38:58.078 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-colorama (0.3.7-1) ... 2020-10-31T22:38:58.087 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-monotonic. 2020-10-31T22:38:58.103 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../068-python3-monotonic_1.1-2_all.deb ... 2020-10-31T22:38:58.138 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-monotonic (1.1-2) ... 2020-10-31T22:38:58.235 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-json-pointer. 2020-10-31T22:38:58.250 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../080-python3-json-pointer_1.10-1_all.deb ... 2020-10-31T22:38:58.330 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package cephfs-shell. 2020-10-31T22:38:58.338 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../091-cephfs-shell_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:58.356 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-json-pointer (1.10-1) ... 2020-10-31T22:38:58.380 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking cephfs-shell (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:58.449 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-fasteners. 2020-10-31T22:38:58.460 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../069-python3-fasteners_0.12.0-3_all.deb ... 2020-10-31T22:38:58.499 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2020-10-31T22:38:58.668 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package libcephfs-dev. 2020-10-31T22:38:58.682 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../092-libcephfs-dev_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:38:58.708 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-jsonpatch. 2020-10-31T22:38:58.718 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking libcephfs-dev (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:58.718 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../081-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2020-10-31T22:38:58.762 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-10-31T22:38:58.786 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-httplib2. 2020-10-31T22:38:58.798 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../070-python3-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2020-10-31T22:38:58.834 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-10-31T22:38:58.970 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package nvme-cli. 2020-10-31T22:38:58.983 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../093-nvme-cli_1.5-1ubuntu1_amd64.deb ... 2020-10-31T22:38:59.020 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking nvme-cli (1.5-1ubuntu1) ... 2020-10-31T22:38:59.035 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-10-31T22:38:59.047 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:38:59.103 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-mgr-rook (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:38:59.123 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pyasn1. 2020-10-31T22:38:59.134 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3_all.deb ... 2020-10-31T22:38:59.173 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2020-10-31T22:38:59.378 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python-attr. 2020-10-31T22:38:59.379 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libonig4:amd64. 2020-10-31T22:38:59.390 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../094-python-attr_17.4.0-2_all.deb ... 2020-10-31T22:38:59.392 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../083-libonig4_6.7.0-1_amd64.deb ... 2020-10-31T22:38:59.424 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python-attr (17.4.0-2) ... 2020-10-31T22:38:59.429 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-10-31T22:38:59.507 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pyasn1-modules. 2020-10-31T22:38:59.521 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2020-10-31T22:38:59.562 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2020-10-31T22:38:59.727 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python-funcsigs. 2020-10-31T22:38:59.742 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../095-python-funcsigs_1.0.2-4_all.deb ... 2020-10-31T22:38:59.782 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libjq1:amd64. 2020-10-31T22:38:59.786 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-10-31T22:38:59.794 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../084-libjq1_1.5+dfsg-2_amd64.deb ... 2020-10-31T22:38:59.834 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-10-31T22:38:59.876 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-rsa. 2020-10-31T22:38:59.890 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../073-python3-rsa_3.4.2-1_all.deb ... 2020-10-31T22:38:59.928 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-rsa (3.4.2-1) ... 2020-10-31T22:39:00.114 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python-pluggy. 2020-10-31T22:39:00.130 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package jq. 2020-10-31T22:39:00.130 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../096-python-pluggy_0.6.0-1_all.deb ... 2020-10-31T22:39:00.147 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../085-jq_1.5+dfsg-2_amd64.deb ... 2020-10-31T22:39:00.166 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-10-31T22:39:00.176 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-10-31T22:39:00.238 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-sqlalchemy. 2020-10-31T22:39:00.251 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../074-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2020-10-31T22:39:00.292 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-10-31T22:39:00.406 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package socat. 2020-10-31T22:39:00.418 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../086-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-10-31T22:39:00.458 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-10-31T22:39:00.492 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python-py. 2020-10-31T22:39:00.506 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../097-python-py_1.5.2-1_all.deb ... 2020-10-31T22:39:00.566 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python-py (1.5.2-1) ... 2020-10-31T22:39:00.742 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-oauth2client. 2020-10-31T22:39:00.761 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../075-python3-oauth2client_4.1.2-3_all.deb ... 2020-10-31T22:39:00.802 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2020-10-31T22:39:00.842 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-10-31T22:39:00.857 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../087-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-10-31T22:39:00.892 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-10-31T22:39:00.920 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python-pytest. 2020-10-31T22:39:00.932 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2020-10-31T22:39:00.980 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-10-31T22:39:01.007 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-colorama. 2020-10-31T22:39:01.018 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../090-python3-colorama_0.3.7-1_all.deb ... 2020-10-31T22:39:01.054 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-colorama (0.3.7-1) ... 2020-10-31T22:39:01.145 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-setuptools. 2020-10-31T22:39:01.158 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../076-python3-setuptools_39.0.1-2_all.deb ... 2020-10-31T22:39:01.193 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package xmlstarlet. 2020-10-31T22:39:01.201 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2020-10-31T22:39:01.207 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2_amd64.deb ... 2020-10-31T22:39:01.251 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-10-31T22:39:01.299 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package cephfs-shell. 2020-10-31T22:39:01.312 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../091-cephfs-shell_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:39:01.313 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-attr. 2020-10-31T22:39:01.328 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../099-python3-attr_17.4.0-2_all.deb ... 2020-10-31T22:39:01.348 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking cephfs-shell (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:01.364 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-10-31T22:39:01.523 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-websocket. 2020-10-31T22:39:01.535 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../077-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2020-10-31T22:39:01.573 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2020-10-31T22:39:01.597 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package ceph-test. 2020-10-31T22:39:01.601 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libcephfs-dev. 2020-10-31T22:39:01.609 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../089-ceph-test_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:39:01.612 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../092-libcephfs-dev_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:39:01.646 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking ceph-test (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:01.650 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libcephfs-dev (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:01.684 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-cycler. 2020-10-31T22:39:01.696 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../100-python3-cycler_0.10.0-1_all.deb ... 2020-10-31T22:39:01.732 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-10-31T22:39:01.895 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package nvme-cli. 2020-10-31T22:39:01.906 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../093-nvme-cli_1.5-1ubuntu1_amd64.deb ... 2020-10-31T22:39:01.937 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking nvme-cli (1.5-1ubuntu1) ... 2020-10-31T22:39:02.052 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-webencodings. 2020-10-31T22:39:02.071 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../101-python3-webencodings_0.5-2_all.deb ... 2020-10-31T22:39:02.102 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-10-31T22:39:02.126 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-kubernetes. 2020-10-31T22:39:02.139 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../078-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2020-10-31T22:39:02.176 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2020-10-31T22:39:02.276 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python-attr. 2020-10-31T22:39:02.288 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../094-python-attr_17.4.0-2_all.deb ... 2020-10-31T22:39:02.325 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python-attr (17.4.0-2) ... 2020-10-31T22:39:02.429 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-html5lib. 2020-10-31T22:39:02.442 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../102-python3-html5lib_0.999999999-1_all.deb ... 2020-10-31T22:39:02.479 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-10-31T22:39:02.564 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2020-10-31T22:39:02.575 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../079-ceph-mgr-k8sevents_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:39:02.628 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python-funcsigs. 2020-10-31T22:39:02.629 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-k8sevents (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:02.641 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../095-python-funcsigs_1.0.2-4_all.deb ... 2020-10-31T22:39:02.686 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-10-31T22:39:02.824 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-10-31T22:39:02.838 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../103-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-10-31T22:39:02.883 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-10-31T22:39:02.916 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-json-pointer. 2020-10-31T22:39:02.929 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../080-python3-json-pointer_1.10-1_all.deb ... 2020-10-31T22:39:02.972 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python-pluggy. 2020-10-31T22:39:02.986 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../096-python-pluggy_0.6.0-1_all.deb ... 2020-10-31T22:39:03.043 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-json-pointer (1.10-1) ... 2020-10-31T22:39:03.046 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-10-31T22:39:03.333 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python-py. 2020-10-31T22:39:03.345 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../097-python-py_1.5.2-1_all.deb ... 2020-10-31T22:39:03.377 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-tz. 2020-10-31T22:39:03.383 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python-py (1.5.2-1) ... 2020-10-31T22:39:03.390 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../104-python3-tz_2018.3-2_all.deb ... 2020-10-31T22:39:03.396 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-jsonpatch. 2020-10-31T22:39:03.407 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../081-python3-jsonpatch_1.19+really1.16-1fakesync1_all.deb ... 2020-10-31T22:39:03.435 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-tz (2018.3-2) ... 2020-10-31T22:39:03.448 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-10-31T22:39:03.669 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python-pytest. 2020-10-31T22:39:03.682 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2020-10-31T22:39:03.712 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-10-31T22:39:03.746 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-matplotlib. 2020-10-31T22:39:03.757 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-mgr-rook. 2020-10-31T22:39:03.758 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../105-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-10-31T22:39:03.770 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../082-ceph-mgr-rook_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:39:03.796 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-10-31T22:39:03.807 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-mgr-rook (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:04.031 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-attr. 2020-10-31T22:39:04.206 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libonig4:amd64. 2020-10-31T22:39:04.206 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../083-libonig4_6.7.0-1_amd64.deb ... 2020-10-31T22:39:04.206 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2020-10-31T22:39:04.206 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../099-python3-attr_17.4.0-2_all.deb ... 2020-10-31T22:39:04.207 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-10-31T22:39:04.377 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-cycler. 2020-10-31T22:39:04.389 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../100-python3-cycler_0.10.0-1_all.deb ... 2020-10-31T22:39:04.426 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-10-31T22:39:04.513 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libjq1:amd64. 2020-10-31T22:39:04.524 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../084-libjq1_1.5+dfsg-2_amd64.deb ... 2020-10-31T22:39:04.562 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2020-10-31T22:39:04.702 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-olefile. 2020-10-31T22:39:04.712 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-webencodings. 2020-10-31T22:39:04.714 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../106-python3-olefile_0.45.1-1_all.deb ... 2020-10-31T22:39:04.726 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../101-python3-webencodings_0.5-2_all.deb ... 2020-10-31T22:39:04.769 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-10-31T22:39:04.770 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-10-31T22:39:04.823 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package jq. 2020-10-31T22:39:04.837 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../085-jq_1.5+dfsg-2_amd64.deb ... 2020-10-31T22:39:04.873 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking jq (1.5+dfsg-2) ... 2020-10-31T22:39:05.054 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-pastescript. 2020-10-31T22:39:05.059 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-2_all.deb ... 2020-10-31T22:39:05.098 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-html5lib. 2020-10-31T22:39:05.110 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../102-python3-html5lib_0.999999999-1_all.deb ... 2020-10-31T22:39:05.112 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-10-31T22:39:05.134 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package socat. 2020-10-31T22:39:05.147 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../086-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2020-10-31T22:39:05.148 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-10-31T22:39:05.185 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2020-10-31T22:39:05.217 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-colorama. 2020-10-31T22:39:05.227 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../090-python3-colorama_0.3.7-1_all.deb ... 2020-10-31T22:39:05.268 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-colorama (0.3.7-1) ... 2020-10-31T22:39:05.424 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-pil:amd64. 2020-10-31T22:39:05.435 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../108-python3-pil_5.1.0-1ubuntu0.3_amd64.deb ... 2020-10-31T22:39:05.459 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-10-31T22:39:05.471 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../103-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-10-31T22:39:05.486 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package cephfs-shell. 2020-10-31T22:39:05.497 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../091-cephfs-shell_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:39:05.501 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-10-31T22:39:05.504 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libxslt1.1:amd64. 2020-10-31T22:39:05.507 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-10-31T22:39:05.517 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../087-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2020-10-31T22:39:05.527 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking cephfs-shell (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:05.547 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-10-31T22:39:05.805 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libcephfs-dev. 2020-10-31T22:39:05.807 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package xmlstarlet. 2020-10-31T22:39:05.818 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../092-libcephfs-dev_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:39:05.819 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../088-xmlstarlet_1.6.1-2_amd64.deb ... 2020-10-31T22:39:05.857 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2020-10-31T22:39:05.863 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libcephfs-dev (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:05.877 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-pluggy. 2020-10-31T22:39:05.888 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-tz. 2020-10-31T22:39:05.889 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../109-python3-pluggy_0.6.0-1_all.deb ... 2020-10-31T22:39:05.902 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../104-python3-tz_2018.3-2_all.deb ... 2020-10-31T22:39:05.927 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-10-31T22:39:05.946 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-tz (2018.3-2) ... 2020-10-31T22:39:06.116 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package nvme-cli. 2020-10-31T22:39:06.128 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../093-nvme-cli_1.5-1ubuntu1_amd64.deb ... 2020-10-31T22:39:06.166 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking nvme-cli (1.5-1ubuntu1) ... 2020-10-31T22:39:06.179 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package ceph-test. 2020-10-31T22:39:06.192 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../089-ceph-test_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:39:06.204 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-py. 2020-10-31T22:39:06.216 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../110-python3-py_1.5.2-1_all.deb ... 2020-10-31T22:39:06.227 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking ceph-test (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:06.245 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-py (1.5.2-1) ... 2020-10-31T22:39:06.257 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-matplotlib. 2020-10-31T22:39:06.270 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../105-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-10-31T22:39:06.307 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-10-31T22:39:06.520 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-attr. 2020-10-31T22:39:06.533 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../094-python-attr_17.4.0-2_all.deb ... 2020-10-31T22:39:06.570 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-attr (17.4.0-2) ... 2020-10-31T22:39:06.582 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-pyinotify. 2020-10-31T22:39:06.596 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1_all.deb ... 2020-10-31T22:39:06.640 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-10-31T22:39:06.872 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-funcsigs. 2020-10-31T22:39:06.885 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../095-python-funcsigs_1.0.2-4_all.deb ... 2020-10-31T22:39:06.922 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-10-31T22:39:06.971 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-olefile. 2020-10-31T22:39:06.984 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-pytest. 2020-10-31T22:39:06.985 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../106-python3-olefile_0.45.1-1_all.deb ... 2020-10-31T22:39:06.997 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../112-python3-pytest_3.3.2-2_all.deb ... 2020-10-31T22:39:07.035 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-10-31T22:39:07.041 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-10-31T22:39:07.176 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-pluggy. 2020-10-31T22:39:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../096-python-pluggy_0.6.0-1_all.deb ... 2020-10-31T22:39:07.216 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-10-31T22:39:07.341 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pastescript. 2020-10-31T22:39:07.354 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-2_all.deb ... 2020-10-31T22:39:07.388 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-simplejson. 2020-10-31T22:39:07.391 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-10-31T22:39:07.399 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../113-python3-simplejson_3.13.2-1_amd64.deb ... 2020-10-31T22:39:07.437 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-10-31T22:39:07.527 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-py. 2020-10-31T22:39:07.540 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../097-python-py_1.5.2-1_all.deb ... 2020-10-31T22:39:07.577 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-py (1.5.2-1) ... 2020-10-31T22:39:07.753 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pil:amd64. 2020-10-31T22:39:07.767 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../108-python3-pil_5.1.0-1ubuntu0.3_amd64.deb ... 2020-10-31T22:39:07.792 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package python3-tk:amd64. 2020-10-31T22:39:07.805 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../114-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-10-31T22:39:07.810 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-10-31T22:39:07.849 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-10-31T22:39:07.914 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python-pytest. 2020-10-31T22:39:07.927 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2020-10-31T22:39:07.975 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-10-31T22:39:08.122 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pluggy. 2020-10-31T22:39:08.135 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../109-python3-pluggy_0.6.0-1_all.deb ... 2020-10-31T22:39:08.172 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-10-31T22:39:08.308 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-attr. 2020-10-31T22:39:08.321 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../099-python3-attr_17.4.0-2_all.deb ... 2020-10-31T22:39:08.335 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package radosgw. 2020-10-31T22:39:08.348 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../115-radosgw_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:39:08.358 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-10-31T22:39:08.385 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking radosgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:08.475 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-py. 2020-10-31T22:39:08.488 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../110-python3-py_1.5.2-1_all.deb ... 2020-10-31T22:39:08.525 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-py (1.5.2-1) ... 2020-10-31T22:39:08.669 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-cycler. 2020-10-31T22:39:08.684 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../100-python3-cycler_0.10.0-1_all.deb ... 2020-10-31T22:39:08.727 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-10-31T22:39:08.845 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pyinotify. 2020-10-31T22:39:08.859 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1_all.deb ... 2020-10-31T22:39:08.904 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-10-31T22:39:09.030 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-webencodings. 2020-10-31T22:39:09.044 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../101-python3-webencodings_0.5-2_all.deb ... 2020-10-31T22:39:09.088 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-10-31T22:39:09.214 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-pytest. 2020-10-31T22:39:09.226 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../112-python3-pytest_3.3.2-2_all.deb ... 2020-10-31T22:39:09.264 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-10-31T22:39:09.313 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package rbd-fuse. 2020-10-31T22:39:09.325 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../116-rbd-fuse_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:39:09.357 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-html5lib. 2020-10-31T22:39:09.370 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../102-python3-html5lib_0.999999999-1_all.deb ... 2020-10-31T22:39:09.388 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking rbd-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:09.399 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-10-31T22:39:09.584 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-simplejson. 2020-10-31T22:39:09.590 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-colorama. 2020-10-31T22:39:09.604 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../113-python3-simplejson_3.13.2-1_amd64.deb ... 2020-10-31T22:39:09.605 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../090-python3-colorama_0.3.7-1_all.deb ... 2020-10-31T22:39:09.640 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-colorama (0.3.7-1) ... 2020-10-31T22:39:09.642 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-10-31T22:39:09.683 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-10-31T22:39:09.786 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-10-31T22:39:09.798 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../103-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-10-31T22:39:09.836 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-10-31T22:39:09.875 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package cephfs-shell. 2020-10-31T22:39:09.887 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../091-cephfs-shell_15.2.5-488-g5e705cd0-1bionic_all.deb ... 2020-10-31T22:39:09.925 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking cephfs-shell (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:09.962 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package python3-tk:amd64. 2020-10-31T22:39:09.974 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../114-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-10-31T22:39:10.012 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-10-31T22:39:10.021 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-10-31T22:39:10.157 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libcephfs-dev. 2020-10-31T22:39:10.167 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../092-libcephfs-dev_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:39:10.203 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libcephfs-dev (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:10.280 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-tz. 2020-10-31T22:39:10.292 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../104-python3-tz_2018.3-2_all.deb ... 2020-10-31T22:39:10.330 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-tz (2018.3-2) ... 2020-10-31T22:39:10.430 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-10-31T22:39:10.447 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package nvme-cli. 2020-10-31T22:39:10.461 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../093-nvme-cli_1.5-1ubuntu1_amd64.deb ... 2020-10-31T22:39:10.500 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package radosgw. 2020-10-31T22:39:10.505 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking nvme-cli (1.5-1ubuntu1) ... 2020-10-31T22:39:10.513 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../115-radosgw_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:39:10.550 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking radosgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:10.556 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-10-31T22:39:10.649 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-matplotlib. 2020-10-31T22:39:10.662 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../105-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-10-31T22:39:10.699 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-10-31T22:39:10.852 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-attr. 2020-10-31T22:39:10.863 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../094-python-attr_17.4.0-2_all.deb ... 2020-10-31T22:39:10.901 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-attr (17.4.0-2) ... 2020-10-31T22:39:11.185 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-10-31T22:39:11.205 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-funcsigs. 2020-10-31T22:39:11.218 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../095-python-funcsigs_1.0.2-4_all.deb ... 2020-10-31T22:39:11.246 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2020-10-31T22:39:11.338 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-olefile. 2020-10-31T22:39:11.352 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../106-python3-olefile_0.45.1-1_all.deb ... 2020-10-31T22:39:11.421 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-10-31T22:39:11.523 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-pluggy. 2020-10-31T22:39:11.535 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../096-python-pluggy_0.6.0-1_all.deb ... 2020-10-31T22:39:11.536 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package rbd-fuse. 2020-10-31T22:39:11.548 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../116-rbd-fuse_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:39:11.569 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-10-31T22:39:11.573 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-pluggy (0.6.0-1) ... 2020-10-31T22:39:11.586 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking rbd-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:11.741 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pastescript. 2020-10-31T22:39:11.753 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-2_all.deb ... 2020-10-31T22:39:11.790 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-10-31T22:39:11.863 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-10-31T22:39:11.870 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-webencodings (0.5-2) ... 2020-10-31T22:39:11.876 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-py. 2020-10-31T22:39:11.888 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../097-python-py_1.5.2-1_all.deb ... 2020-10-31T22:39:11.926 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-py (1.5.2-1) ... 2020-10-31T22:39:12.120 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pil:amd64. 2020-10-31T22:39:12.132 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../108-python3-pil_5.1.0-1ubuntu0.3_amd64.deb ... 2020-10-31T22:39:12.155 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python-attr (17.4.0-2) ... 2020-10-31T22:39:12.185 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-10-31T22:39:12.225 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-10-31T22:39:12.254 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python-pytest. 2020-10-31T22:39:12.268 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2020-10-31T22:39:12.304 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python-pytest (3.3.2-2) ... 2020-10-31T22:39:12.390 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-10-31T22:39:12.517 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-py (1.5.2-1) ... 2020-10-31T22:39:12.588 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pluggy. 2020-10-31T22:39:12.599 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-attr. 2020-10-31T22:39:12.601 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../109-python3-pluggy_0.6.0-1_all.deb ... 2020-10-31T22:39:12.609 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-10-31T22:39:12.611 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../099-python3-attr_17.4.0-2_all.deb ... 2020-10-31T22:39:12.630 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-10-31T22:39:12.640 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-attr (17.4.0-2) ... 2020-10-31T22:39:12.762 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-10-31T22:39:12.909 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-10-31T22:39:12.933 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-py. 2020-10-31T22:39:12.943 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-cycler. 2020-10-31T22:39:12.944 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../110-python3-py_1.5.2-1_all.deb ... 2020-10-31T22:39:12.956 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../100-python3-cycler_0.10.0-1_all.deb ... 2020-10-31T22:39:12.982 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-py (1.5.2-1) ... 2020-10-31T22:39:12.993 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-cycler (0.10.0-1) ... 2020-10-31T22:39:13.245 INFO:teuthology.orchestra.run.smithi085.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-10-31T22:39:13.296 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-webencodings. 2020-10-31T22:39:13.308 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../101-python3-webencodings_0.5-2_all.deb ... 2020-10-31T22:39:13.319 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pyinotify. 2020-10-31T22:39:13.333 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1_all.deb ... 2020-10-31T22:39:13.346 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-webencodings (0.5-2) ... 2020-10-31T22:39:13.374 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-10-31T22:39:13.377 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-10-31T22:39:13.554 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-10-31T22:39:13.649 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-html5lib. 2020-10-31T22:39:13.662 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../102-python3-html5lib_0.999999999-1_all.deb ... 2020-10-31T22:39:13.671 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-pytest. 2020-10-31T22:39:13.685 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../112-python3-pytest_3.3.2-2_all.deb ... 2020-10-31T22:39:13.698 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2020-10-31T22:39:13.721 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-10-31T22:39:13.781 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-10-31T22:39:13.872 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-ceph-argparse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:14.025 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-simplejson. 2020-10-31T22:39:14.035 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-lxml:amd64. 2020-10-31T22:39:14.039 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../113-python3-simplejson_3.13.2-1_amd64.deb ... 2020-10-31T22:39:14.047 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../103-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2020-10-31T22:39:14.074 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-webencodings (0.5-2) ... 2020-10-31T22:39:14.074 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-10-31T22:39:14.076 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-10-31T22:39:14.210 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-10-31T22:39:14.375 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python-attr (17.4.0-2) ... 2020-10-31T22:39:14.421 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package python3-tk:amd64. 2020-10-31T22:39:14.448 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../114-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-10-31T22:39:14.479 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-10-31T22:39:14.531 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-tz. 2020-10-31T22:39:14.542 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../104-python3-tz_2018.3-2_all.deb ... 2020-10-31T22:39:14.543 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-10-31T22:39:14.577 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-10-31T22:39:14.580 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-tz (2018.3-2) ... 2020-10-31T22:39:14.703 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-py (1.5.2-1) ... 2020-10-31T22:39:14.711 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-10-31T22:39:14.882 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-matplotlib. 2020-10-31T22:39:14.896 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../105-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2020-10-31T22:39:14.934 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package radosgw. 2020-10-31T22:39:14.934 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2020-10-31T22:39:14.946 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../115-radosgw_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:39:14.982 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking radosgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:15.029 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-10-31T22:39:15.359 INFO:teuthology.orchestra.run.smithi060.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-10-31T22:39:15.546 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-olefile. 2020-10-31T22:39:15.559 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../106-python3-olefile_0.45.1-1_all.deb ... 2020-10-31T22:39:15.596 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-olefile (0.45.1-1) ... 2020-10-31T22:39:15.638 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-10-31T22:39:15.665 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-10-31T22:39:15.882 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pastescript. 2020-10-31T22:39:15.896 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-2_all.deb ... 2020-10-31T22:39:15.927 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package rbd-fuse. 2020-10-31T22:39:15.939 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../116-rbd-fuse_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:39:15.940 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2020-10-31T22:39:15.958 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-ceph-argparse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:15.972 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-10-31T22:39:15.977 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking rbd-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:16.251 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-10-31T22:39:16.282 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python-py (1.5.2-1) ... 2020-10-31T22:39:16.296 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-10-31T22:39:16.312 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pil:amd64. 2020-10-31T22:39:16.322 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../108-python3-pil_5.1.0-1ubuntu0.3_amd64.deb ... 2020-10-31T22:39:16.360 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-10-31T22:39:16.517 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-10-31T22:39:16.560 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-10-31T22:39:16.607 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-10-31T22:39:16.670 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-10-31T22:39:16.735 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pluggy. 2020-10-31T22:39:16.743 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../109-python3-pluggy_0.6.0-1_all.deb ... 2020-10-31T22:39:16.780 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2020-10-31T22:39:16.860 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-json-pointer (1.10-1) ... 2020-10-31T22:39:16.950 INFO:teuthology.orchestra.run.smithi085.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2020-10-31T22:39:16.966 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-10-31T22:39:17.083 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-py. 2020-10-31T22:39:17.096 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../110-python3-py_1.5.2-1_all.deb ... 2020-10-31T22:39:17.110 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-10-31T22:39:17.141 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-py (1.5.2-1) ... 2020-10-31T22:39:17.203 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-10-31T22:39:17.313 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-10-31T22:39:17.461 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pyinotify. 2020-10-31T22:39:17.474 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1_all.deb ... 2020-10-31T22:39:17.511 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2020-10-31T22:39:17.513 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-colorama (0.3.7-1) ... 2020-10-31T22:39:17.598 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-10-31T22:39:17.711 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-10-31T22:39:17.806 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-pytest. 2020-10-31T22:39:17.818 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../112-python3-pytest_3.3.2-2_all.deb ... 2020-10-31T22:39:17.840 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-10-31T22:39:17.855 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-pytest (3.3.2-2) ... 2020-10-31T22:39:17.925 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-10-31T22:39:18.079 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-10-31T22:39:18.133 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-10-31T22:39:18.192 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-simplejson. 2020-10-31T22:39:18.206 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../113-python3-simplejson_3.13.2-1_amd64.deb ... 2020-10-31T22:39:18.217 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python-py (1.5.2-1) ... 2020-10-31T22:39:18.250 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2020-10-31T22:39:18.372 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-webencodings (0.5-2) ... 2020-10-31T22:39:18.452 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-10-31T22:39:18.484 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-10-31T22:39:18.561 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package python3-tk:amd64. 2020-10-31T22:39:18.576 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../114-python3-tk_3.6.9-1~18.04_amd64.deb ... 2020-10-31T22:39:18.619 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2020-10-31T22:39:18.656 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-attr (17.4.0-2) ... 2020-10-31T22:39:18.770 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-json-pointer (1.10-1) ... 2020-10-31T22:39:18.802 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-10-31T22:39:18.842 INFO:teuthology.orchestra.run.smithi060.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2020-10-31T22:39:18.858 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-10-31T22:39:19.000 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-py (1.5.2-1) ... 2020-10-31T22:39:19.073 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package radosgw. 2020-10-31T22:39:19.079 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-10-31T22:39:19.085 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../115-radosgw_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:39:19.123 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking radosgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:19.195 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-10-31T22:39:19.206 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-10-31T22:39:19.335 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-10-31T22:39:19.399 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-colorama (0.3.7-1) ... 2020-10-31T22:39:19.538 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-10-31T22:39:19.686 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-10-31T22:39:19.709 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-10-31T22:39:19.865 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:19.980 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-10-31T22:39:20.009 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-10-31T22:39:20.085 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package rbd-fuse. 2020-10-31T22:39:20.098 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../116-rbd-fuse_15.2.5-488-g5e705cd0-1bionic_amd64.deb ... 2020-10-31T22:39:20.134 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking rbd-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:20.289 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-ceph-argparse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:20.330 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-10-31T22:39:20.420 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-logutils (0.3.3-5) ... 2020-10-31T22:39:20.516 INFO:teuthology.orchestra.run.smithi085.stdout:Adding system user cephadm....done 2020-10-31T22:39:20.599 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-10-31T22:39:20.620 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-10-31T22:39:20.672 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-10-31T22:39:20.748 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2020-10-31T22:39:20.900 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-10-31T22:39:20.955 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-10-31T22:39:20.992 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-10-31T22:39:21.026 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-10-31T22:39:21.124 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2020-10-31T22:39:21.132 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up nvme-cli (1.5-1ubuntu1) ... 2020-10-31T22:39:21.250 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2020-10-31T22:39:21.267 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-10-31T22:39:21.281 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-10-31T22:39:21.566 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:21.619 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-10-31T22:39:21.886 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pil:amd64 (5.1.0-1ubuntu0.3) ... 2020-10-31T22:39:21.936 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-10-31T22:39:21.962 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-10-31T22:39:22.071 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-10-31T22:39:22.166 INFO:teuthology.orchestra.run.smithi060.stdout:Adding system user cephadm....done 2020-10-31T22:39:22.271 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-10-31T22:39:22.287 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2020-10-31T22:39:22.305 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-10-31T22:39:22.422 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:22.556 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-py (1.5.2-1) ... 2020-10-31T22:39:22.588 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-webencodings (0.5-2) ... 2020-10-31T22:39:22.716 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-monotonic (1.1-2) ... 2020-10-31T22:39:22.782 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-10-31T22:39:22.841 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-10-31T22:39:22.889 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-attr (17.4.0-2) ... 2020-10-31T22:39:22.991 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up nvme-cli (1.5-1ubuntu1) ... 2020-10-31T22:39:23.042 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-10-31T22:39:23.086 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2020-10-31T22:39:23.116 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-json-pointer (1.10-1) ... 2020-10-31T22:39:23.117 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-10-31T22:39:23.200 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-10-31T22:39:23.206 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2020-10-31T22:39:23.217 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-py (1.5.2-1) ... 2020-10-31T22:39:23.435 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-10-31T22:39:23.452 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-10-31T22:39:23.536 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-10-31T22:39:23.544 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-waitress (1.0.1-1) ... 2020-10-31T22:39:23.552 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-10-31T22:39:23.737 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-colorama (0.3.7-1) ... 2020-10-31T22:39:23.753 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-10-31T22:39:23.828 INFO:teuthology.orchestra.run.smithi066.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2020-10-31T22:39:23.863 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-10-31T22:39:23.896 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-10-31T22:39:23.973 INFO:teuthology.orchestra.run.smithi085.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-10-31T22:39:24.001 INFO:teuthology.orchestra.run.smithi085.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2020-10-31T22:39:24.030 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-10-31T22:39:24.171 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-olefile (0.45.1-1) ... 2020-10-31T22:39:24.172 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:24.240 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-10-31T22:39:24.330 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-10-31T22:39:24.472 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-ceph-argparse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:24.482 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-monotonic (1.1-2) ... 2020-10-31T22:39:24.549 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-10-31T22:39:24.673 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-10-31T22:39:24.775 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-10-31T22:39:24.781 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-tempita (0.5.2-2) ... 2020-10-31T22:39:24.892 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-10-31T22:39:24.901 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-10-31T22:39:24.966 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-10-31T22:39:25.083 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2020-10-31T22:39:25.217 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2020-10-31T22:39:25.244 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-10-31T22:39:25.252 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-attr (17.4.0-2) ... 2020-10-31T22:39:25.326 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-10-31T22:39:25.536 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-10-31T22:39:25.587 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-10-31T22:39:25.668 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-10-31T22:39:25.669 INFO:teuthology.orchestra.run.smithi060.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-10-31T22:39:25.701 INFO:teuthology.orchestra.run.smithi060.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2020-10-31T22:39:25.738 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-10-31T22:39:25.939 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-10-31T22:39:25.971 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:26.128 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2020-10-31T22:39:26.131 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-10-31T22:39:26.221 INFO:teuthology.orchestra.run.smithi085.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-10-31T22:39:26.242 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-10-31T22:39:26.454 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2020-10-31T22:39:26.484 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up liboath0 (2.6.1-1) ... 2020-10-31T22:39:26.550 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-10-31T22:39:26.562 INFO:teuthology.orchestra.run.smithi152.stdout:Adding system user cephadm....done 2020-10-31T22:39:26.685 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-10-31T22:39:26.726 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-10-31T22:39:26.747 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-py (1.5.2-1) ... 2020-10-31T22:39:26.811 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-10-31T22:39:26.893 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-attr (17.4.0-2) ... 2020-10-31T22:39:26.974 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-simplejson (3.13.2-1) ... 2020-10-31T22:39:27.019 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-10-31T22:39:27.062 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-10-31T22:39:27.145 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up nvme-cli (1.5-1ubuntu1) ... 2020-10-31T22:39:27.172 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-10-31T22:39:27.206 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-10-31T22:39:27.254 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-10-31T22:39:27.325 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-json-pointer (1.10-1) ... 2020-10-31T22:39:27.395 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-10-31T22:39:27.424 INFO:teuthology.orchestra.run.smithi066.stdout:update-alternatives: using /usr/bin/python3-jsonpointer to provide /usr/bin/jsonpointer (jsonpointer) in auto mode 2020-10-31T22:39:27.540 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-10-31T22:39:27.598 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-10-31T22:39:27.660 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2020-10-31T22:39:27.691 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-10-31T22:39:27.761 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-pluggy (0.6.0-1) ... 2020-10-31T22:39:27.780 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-10-31T22:39:27.862 INFO:teuthology.orchestra.run.smithi060.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-10-31T22:39:27.890 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-10-31T22:39:27.962 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-colorama (0.3.7-1) ... 2020-10-31T22:39:27.993 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-tz (2018.3-2) ... 2020-10-31T22:39:28.019 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-10-31T22:39:28.099 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up liboath0 (2.6.1-1) ... 2020-10-31T22:39:28.264 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2020-10-31T22:39:28.275 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-10-31T22:39:28.319 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-10-31T22:39:28.353 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:28.401 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-10-31T22:39:28.564 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2020-10-31T22:39:28.644 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-10-31T22:39:28.645 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-10-31T22:39:28.685 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-monotonic (1.1-2) ... 2020-10-31T22:39:28.745 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-10-31T22:39:28.882 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cycler (0.10.0-1) ... 2020-10-31T22:39:28.963 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-joblib (0.11-1) ... 2020-10-31T22:39:28.978 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-10-31T22:39:29.095 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-10-31T22:39:29.121 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-10-31T22:39:29.191 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2020-10-31T22:39:29.247 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-10-31T22:39:29.331 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-routes (2.4.1-1) ... 2020-10-31T22:39:29.438 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-10-31T22:39:29.557 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-tz (2018.3-2) ... 2020-10-31T22:39:29.559 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-bs4 (4.6.0-1) ... 2020-10-31T22:39:29.674 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-10-31T22:39:29.789 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-10-31T22:39:29.869 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pluggy (0.6.0-1) ... 2020-10-31T22:39:29.875 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-10-31T22:39:29.879 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-10-31T22:39:29.920 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2020-10-31T22:39:30.059 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-10-31T22:39:30.133 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-10-31T22:39:30.162 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:30.184 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-10-31T22:39:30.402 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2020-10-31T22:39:30.409 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-10-31T22:39:30.519 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-joblib (0.11-1) ... 2020-10-31T22:39:30.685 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-10-31T22:39:30.728 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-10-31T22:39:30.779 INFO:teuthology.orchestra.run.smithi066.stdout:Adding system user cephadm....done 2020-10-31T22:39:30.887 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-routes (2.4.1-1) ... 2020-10-31T22:39:30.943 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2020-10-31T22:39:31.020 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-attr (17.4.0-2) ... 2020-10-31T22:39:31.097 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-10-31T22:39:31.163 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-10-31T22:39:31.236 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2020-10-31T22:39:31.337 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-10-31T22:39:31.354 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up nvme-cli (1.5-1ubuntu1) ... 2020-10-31T22:39:31.373 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up jq (1.5+dfsg-2) ... 2020-10-31T22:39:31.481 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-10-31T22:39:31.496 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2020-10-31T22:39:31.499 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-10-31T22:39:31.530 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-10-31T22:39:31.824 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2020-10-31T22:39:31.848 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-prettytable (0.7.2-3) ... 2020-10-31T22:39:31.940 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-10-31T22:39:32.029 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-10-31T22:39:32.125 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-10-31T22:39:32.140 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2020-10-31T22:39:32.269 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2020-10-31T22:39:32.283 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liboath0 (2.6.1-1) ... 2020-10-31T22:39:32.434 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-10-31T22:39:32.502 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-10-31T22:39:32.535 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-10-31T22:39:32.688 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-10-31T22:39:32.745 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:32.786 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-10-31T22:39:32.803 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up jq (1.5+dfsg-2) ... 2020-10-31T22:39:32.913 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-10-31T22:39:32.946 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-10-31T22:39:32.990 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-10-31T22:39:33.071 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-monotonic (1.1-2) ... 2020-10-31T22:39:33.314 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-10-31T22:39:33.349 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-10-31T22:39:33.364 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2020-10-31T22:39:33.440 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-10-31T22:39:33.476 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-10-31T22:39:33.491 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-jinja2 (2.10-1ubuntu0.18.04.1) ... 2020-10-31T22:39:33.740 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-tz (2018.3-2) ... 2020-10-31T22:39:33.833 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-html5lib (0.999999999-1) ... 2020-10-31T22:39:33.852 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2020-10-31T22:39:34.071 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-10-31T22:39:34.136 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-10-31T22:39:34.153 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python-pytest (3.3.2-2) ... 2020-10-31T22:39:34.185 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-jsonpatch (1.19+really1.16-1fakesync1) ... 2020-10-31T22:39:34.275 INFO:teuthology.orchestra.run.smithi066.stdout:update-alternatives: using /usr/bin/python3-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2020-10-31T22:39:34.307 INFO:teuthology.orchestra.run.smithi066.stdout:update-alternatives: using /usr/bin/python3-jsonpatch to provide /usr/bin/jsonpatch (jsonpatch) in auto mode 2020-10-31T22:39:34.334 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-10-31T22:39:34.412 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-10-31T22:39:34.445 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-10-31T22:39:34.514 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-10-31T22:39:34.537 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-repoze.lru (0.7-1) ... 2020-10-31T22:39:34.619 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-joblib (0.11-1) ... 2020-10-31T22:39:34.640 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up librados2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:34.764 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-10-31T22:39:34.800 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-10-31T22:39:34.830 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2020-10-31T22:39:34.889 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-10-31T22:39:34.987 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-routes (2.4.1-1) ... 2020-10-31T22:39:35.148 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2020-10-31T22:39:35.266 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2020-10-31T22:39:35.313 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-10-31T22:39:35.385 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up libcephfs2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:35.473 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-attr (17.4.0-2) ... 2020-10-31T22:39:35.527 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up libcephfs-dev (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:35.583 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python-pytest (3.3.2-2) ... 2020-10-31T22:39:35.653 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-rados (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:35.775 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-funcsigs (1.0.2-4) ... 2020-10-31T22:39:35.780 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-10-31T22:39:35.787 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-10-31T22:39:35.869 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-10-31T22:39:35.976 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2020-10-31T22:39:35.994 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-10-31T22:39:36.095 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up librados2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:36.107 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2020-10-31T22:39:36.190 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-10-31T22:39:36.196 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-10-31T22:39:36.378 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2020-10-31T22:39:36.416 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-10-31T22:39:36.451 INFO:teuthology.orchestra.run.smithi066.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2020-10-31T22:39:36.489 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libcephfs2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:36.508 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-10-31T22:39:36.615 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libcephfs-dev (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:36.713 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up liboath0 (2.6.1-1) ... 2020-10-31T22:39:36.741 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-rados (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:36.784 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-10-31T22:39:36.851 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-10-31T22:39:36.866 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-10-31T22:39:36.889 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2020-10-31T22:39:37.015 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2020-10-31T22:39:37.078 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up jq (1.5+dfsg-2) ... 2020-10-31T22:39:37.203 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-10-31T22:39:37.266 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2020-10-31T22:39:37.269 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-10-31T22:39:37.392 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-setuptools (39.0.1-2) ... 2020-10-31T22:39:37.537 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-10-31T22:39:37.696 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-10-31T22:39:37.777 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2020-10-31T22:39:37.847 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-10-31T22:39:37.887 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-decorator (4.1.2-1) ... 2020-10-31T22:39:38.180 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-tz (2018.3-2) ... 2020-10-31T22:39:38.366 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-10-31T22:39:38.493 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-10-31T22:39:38.497 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2020-10-31T22:39:38.692 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-10-31T22:39:38.700 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-10-31T22:39:38.790 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2020-10-31T22:39:38.802 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up libradosstriper1 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:38.962 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-cephfs (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:39.001 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-10-31T22:39:39.100 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-joblib (0.11-1) ... 2020-10-31T22:39:39.111 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-10-31T22:39:39.239 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up librgw2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:39.373 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:39.476 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-routes (2.4.1-1) ... 2020-10-31T22:39:39.479 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2020-10-31T22:39:39.554 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-10-31T22:39:39.594 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-10-31T22:39:39.594 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-10-31T22:39:39.772 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python-pytest (3.3.2-2) ... 2020-10-31T22:39:39.777 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2020-10-31T22:39:39.830 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libradosstriper1 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:39.866 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up librbd1 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:39.956 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-cephfs (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:40.026 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up cephfs-shell (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:40.062 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-dateutil (2.6.1-1) ... 2020-10-31T22:39:40.064 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-10-31T22:39:40.152 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-10-31T22:39:40.190 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-10-31T22:39:40.258 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up librgw2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:40.258 INFO:teuthology.orchestra.run.smithi085.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-10-31T22:39:40.291 INFO:teuthology.orchestra.run.smithi085.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-10-31T22:39:40.316 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librados2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:40.371 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pyperclip (1.6.0-1) ... 2020-10-31T22:39:40.384 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:40.442 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-10-31T22:39:40.588 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-10-31T22:39:40.605 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-10-31T22:39:40.605 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-10-31T22:39:40.664 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2020-10-31T22:39:40.727 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libcephfs2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:40.828 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libcephfs-dev (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:40.910 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up librbd1 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:40.945 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rados (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:41.036 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up cephfs-shell (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:41.041 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-fasteners (0.12.0-3) ... 2020-10-31T22:39:41.071 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-10-31T22:39:41.137 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-10-31T22:39:41.209 INFO:teuthology.orchestra.run.smithi060.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-10-31T22:39:41.234 INFO:teuthology.orchestra.run.smithi060.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-10-31T22:39:41.250 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-mgr-modules-core (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:41.342 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up jq (1.5+dfsg-2) ... 2020-10-31T22:39:41.376 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-10-31T22:39:41.465 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-10-31T22:39:41.468 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2020-10-31T22:39:41.548 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-10-31T22:39:41.727 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-rgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:41.758 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-10-31T22:39:41.870 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up rbd-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:41.988 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up python3-rbd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:42.092 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-10-31T22:39:42.121 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:42.218 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mgr-modules-core (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:42.344 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-10-31T22:39:42.657 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2020-10-31T22:39:42.678 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-rgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:42.682 INFO:teuthology.orchestra.run.smithi085.stdout:Adding group ceph....done 2020-10-31T22:39:42.780 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up rbd-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:42.922 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up python3-rbd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:42.928 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-10-31T22:39:42.967 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2020-10-31T22:39:43.048 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:43.077 INFO:teuthology.orchestra.run.smithi085.stdout:Adding system user ceph....done 2020-10-31T22:39:43.294 INFO:teuthology.orchestra.run.smithi085.stdout:Setting system user ceph properties....done 2020-10-31T22:39:43.305 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2020-10-31T22:39:43.444 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pytest (3.3.2-2) ... 2020-10-31T22:39:43.450 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-10-31T22:39:43.608 INFO:teuthology.orchestra.run.smithi060.stdout:Adding group ceph....done 2020-10-31T22:39:43.661 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-10-31T22:39:43.774 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-10-31T22:39:43.795 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cmd2 (0.7.9-0ubuntu1) ... 2020-10-31T22:39:43.942 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up radosgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:43.943 INFO:teuthology.orchestra.run.smithi060.stdout:Adding system user ceph....done 2020-10-31T22:39:44.067 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libradosstriper1 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:44.071 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python-pytest (3.3.2-2) ... 2020-10-31T22:39:44.136 INFO:teuthology.orchestra.run.smithi060.stdout:Setting system user ceph properties....done 2020-10-31T22:39:44.168 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-cephfs (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:44.207 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-10-31T22:39:44.207 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-10-31T22:39:44.296 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-10-31T22:39:44.332 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2020-10-31T22:39:44.453 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librgw2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:44.457 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up xmlstarlet (1.6.1-2) ... 2020-10-31T22:39:44.529 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-10-31T22:39:44.570 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:44.573 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-test (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:44.625 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librados2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:44.704 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-base (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:44.752 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rsa (3.4.2-1) ... 2020-10-31T22:39:44.790 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-10-31T22:39:44.791 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-10-31T22:39:44.841 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up radosgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:45.040 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-10-31T22:39:45.055 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up librbd1 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:45.094 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libcephfs2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:45.121 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-10-31T22:39:45.121 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-10-31T22:39:45.181 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up cephfs-shell (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:45.203 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libcephfs-dev (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:45.304 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rados (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:45.332 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-10-31T22:39:45.421 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-10-31T22:39:45.422 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2020-10-31T22:39:45.453 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-10-31T22:39:45.498 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-mgr (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:45.526 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-test (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:45.652 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-base (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:45.719 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-10-31T22:39:45.720 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-10-31T22:39:45.751 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-10-31T22:39:45.817 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2020-10-31T22:39:45.990 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-10-31T22:39:46.000 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-mgr-diskprediction-local (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:46.117 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2020-10-31T22:39:46.143 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-osd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:46.287 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mgr (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:46.395 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-modules-core (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:46.452 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2020-10-31T22:39:46.501 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-10-31T22:39:46.501 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-10-31T22:39:46.521 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-10-31T22:39:46.589 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-10-31T22:39:46.589 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-10-31T22:39:46.781 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mgr-diskprediction-local (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:46.837 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-mgr-cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:46.847 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:46.906 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-osd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:46.971 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:46.973 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up rbd-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:47.100 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up python3-rbd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:47.114 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-mgr-rook (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:47.232 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-mds (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:47.250 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:47.297 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-sklearn (0.19.1-3) ... 2020-10-31T22:39:47.363 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-10-31T22:39:47.364 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-10-31T22:39:47.455 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-10-31T22:39:47.455 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-10-31T22:39:47.659 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mgr-cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:47.708 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-mon (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:47.726 INFO:teuthology.orchestra.run.smithi152.stdout:Adding group ceph....done 2020-10-31T22:39:47.802 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:47.944 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mgr-rook (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:47.955 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-10-31T22:39:47.955 INFO:teuthology.orchestra.run.smithi085.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-10-31T22:39:48.095 INFO:teuthology.orchestra.run.smithi152.stdout:Adding system user ceph....done 2020-10-31T22:39:48.151 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2020-10-31T22:39:48.201 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-mgr-k8sevents (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:48.280 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mds (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:48.304 INFO:teuthology.orchestra.run.smithi152.stdout:Setting system user ceph properties....done 2020-10-31T22:39:48.328 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph-mgr-dashboard (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:48.449 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-10-31T22:39:48.478 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libradosstriper1 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:48.487 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up ceph (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:48.490 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-10-31T22:39:48.490 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-10-31T22:39:48.596 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-cephfs (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:48.605 INFO:teuthology.orchestra.run.smithi085.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-10-31T22:39:48.650 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-10-31T22:39:48.797 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mon (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:48.800 INFO:teuthology.orchestra.run.smithi085.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-10-31T22:39:48.880 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librgw2 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:48.935 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up radosgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:49.007 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:49.018 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-10-31T22:39:49.018 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-10-31T22:39:49.184 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-10-31T22:39:49.184 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-10-31T22:39:49.227 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-10-31T22:39:49.228 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2020-10-31T22:39:49.307 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mgr-k8sevents (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:49.433 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph-mgr-dashboard (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:49.491 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up librbd1 (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:49.553 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-test (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:49.585 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up ceph (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:49.617 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up cephfs-shell (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:49.671 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-base (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:49.711 INFO:teuthology.orchestra.run.smithi060.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-10-31T22:39:49.743 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pecan (1.2.1-2) ... 2020-10-31T22:39:49.833 INFO:teuthology.orchestra.run.smithi066.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2020-10-31T22:39:49.865 INFO:teuthology.orchestra.run.smithi066.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2020-10-31T22:39:49.924 INFO:teuthology.orchestra.run.smithi060.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-10-31T22:39:50.003 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-10-31T22:39:50.188 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2020-10-31T22:39:50.281 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:50.500 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-10-31T22:39:50.501 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-10-31T22:39:50.843 INFO:teuthology.orchestra.run.smithi085.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-10-31T22:39:50.874 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-modules-core (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:50.886 INFO:teuthology.orchestra.run.smithi085.stdout:ureadahead will be reprofiled on next reboot 2020-10-31T22:39:50.952 INFO:teuthology.orchestra.run.smithi085.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.2) ... 2020-10-31T22:39:50.995 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-diskprediction-local (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:50.999 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-pastescript (2.0.2-2) ... 2020-10-31T22:39:51.142 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-osd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:51.309 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:51.403 INFO:teuthology.orchestra.run.smithi085.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-10-31T22:39:51.405 INFO:teuthology.orchestra.run.smithi085:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2020-10-31T22:39:51.435 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up rbd-fuse (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:51.486 INFO:teuthology.orchestra.run.smithi085.stdout:Reading package lists... 2020-10-31T22:39:51.553 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up python3-rbd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:51.582 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-10-31T22:39:51.583 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-10-31T22:39:51.663 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-common (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:51.744 INFO:teuthology.orchestra.run.smithi085.stdout:Building dependency tree... 2020-10-31T22:39:51.745 INFO:teuthology.orchestra.run.smithi085.stdout:Reading state information... 2020-10-31T22:39:51.853 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:51.920 INFO:teuthology.orchestra.run.smithi085.stdout:libtool-bin is already the newest version (2.4.6-2). 2020-10-31T22:39:51.920 INFO:teuthology.orchestra.run.smithi085.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2020-10-31T22:39:51.920 INFO:teuthology.orchestra.run.smithi085.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2020-10-31T22:39:51.921 INFO:teuthology.orchestra.run.smithi085.stdout:The following additional packages will be installed: 2020-10-31T22:39:51.921 INFO:teuthology.orchestra.run.smithi085.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2020-10-31T22:39:51.923 INFO:teuthology.orchestra.run.smithi085.stdout:Suggested packages: 2020-10-31T22:39:51.923 INFO:teuthology.orchestra.run.smithi085.stdout: bison-doc flex-doc indent-doc libssl-doc 2020-10-31T22:39:51.947 INFO:teuthology.orchestra.run.smithi085.stdout:The following NEW packages will be installed: 2020-10-31T22:39:51.948 INFO:teuthology.orchestra.run.smithi085.stdout: bison dump flex indent libaio-dev libbison-dev libelf-dev libfl-dev libfl2 2020-10-31T22:39:51.948 INFO:teuthology.orchestra.run.smithi085.stdout: libssl-dev zlib1g-dev 2020-10-31T22:39:52.004 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:52.031 INFO:teuthology.orchestra.run.smithi060.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-10-31T22:39:52.065 INFO:teuthology.orchestra.run.smithi060.stdout:ureadahead will be reprofiled on next reboot 2020-10-31T22:39:52.115 INFO:teuthology.orchestra.run.smithi060.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.2) ... 2020-10-31T22:39:52.128 INFO:teuthology.orchestra.run.smithi085.stdout:0 upgraded, 11 newly installed, 0 to remove and 14 not upgraded. 2020-10-31T22:39:52.128 INFO:teuthology.orchestra.run.smithi085.stdout:Need to get 2,960 kB of archives. 2020-10-31T22:39:52.129 INFO:teuthology.orchestra.run.smithi085.stdout:After this operation, 12.2 MB of additional disk space will be used. 2020-10-31T22:39:52.129 INFO:teuthology.orchestra.run.smithi085.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2020-10-31T22:39:52.138 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-rook (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:52.231 INFO:teuthology.orchestra.run.smithi066.stdout:Adding group ceph....done 2020-10-31T22:39:52.281 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mds (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:52.494 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-10-31T22:39:52.494 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-10-31T22:39:52.563 INFO:teuthology.orchestra.run.smithi085.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2020-10-31T22:39:52.571 INFO:teuthology.orchestra.run.smithi060.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-10-31T22:39:52.573 INFO:teuthology.orchestra.run.smithi060:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2020-10-31T22:39:52.625 INFO:teuthology.orchestra.run.smithi066.stdout:Adding system user ceph....done 2020-10-31T22:39:52.643 INFO:teuthology.orchestra.run.smithi085.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2020-10-31T22:39:52.659 INFO:teuthology.orchestra.run.smithi060.stdout:Reading package lists... 2020-10-31T22:39:52.696 INFO:teuthology.orchestra.run.smithi085.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2020-10-31T22:39:52.716 INFO:teuthology.orchestra.run.smithi085.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2020-10-31T22:39:52.728 INFO:teuthology.orchestra.run.smithi085.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2020-10-31T22:39:52.730 INFO:teuthology.orchestra.run.smithi085.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2020-10-31T22:39:52.745 INFO:teuthology.orchestra.run.smithi085.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2020-10-31T22:39:52.749 INFO:teuthology.orchestra.run.smithi085.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2020-10-31T22:39:52.750 INFO:teuthology.orchestra.run.smithi085.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2020-10-31T22:39:52.751 INFO:teuthology.orchestra.run.smithi085.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.6 [1,566 kB] 2020-10-31T22:39:52.782 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mon (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:52.801 INFO:teuthology.orchestra.run.smithi066.stdout:Setting system user ceph properties....done 2020-10-31T22:39:52.937 INFO:teuthology.orchestra.run.smithi060.stdout:Building dependency tree... 2020-10-31T22:39:52.937 INFO:teuthology.orchestra.run.smithi060.stdout:Reading state information... 2020-10-31T22:39:52.955 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2020-10-31T22:39:53.021 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-10-31T22:39:53.021 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-10-31T22:39:53.141 INFO:teuthology.orchestra.run.smithi060.stdout:libtool-bin is already the newest version (2.4.6-2). 2020-10-31T22:39:53.141 INFO:teuthology.orchestra.run.smithi060.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2020-10-31T22:39:53.141 INFO:teuthology.orchestra.run.smithi060.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2020-10-31T22:39:53.141 INFO:teuthology.orchestra.run.smithi060.stdout:The following additional packages will be installed: 2020-10-31T22:39:53.142 INFO:teuthology.orchestra.run.smithi060.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2020-10-31T22:39:53.144 INFO:teuthology.orchestra.run.smithi060.stdout:Suggested packages: 2020-10-31T22:39:53.144 INFO:teuthology.orchestra.run.smithi060.stdout: bison-doc flex-doc indent-doc libssl-doc 2020-10-31T22:39:53.172 INFO:teuthology.orchestra.run.smithi060.stdout:The following NEW packages will be installed: 2020-10-31T22:39:53.173 INFO:teuthology.orchestra.run.smithi060.stdout: bison dump flex indent libaio-dev libbison-dev libelf-dev libfl-dev libfl2 2020-10-31T22:39:53.173 INFO:teuthology.orchestra.run.smithi060.stdout: libssl-dev zlib1g-dev 2020-10-31T22:39:53.202 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2020-10-31T22:39:53.224 INFO:teuthology.orchestra.run.smithi085.stdout:Fetched 2,960 kB in 1s (3,372 kB/s) 2020-10-31T22:39:53.300 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-k8sevents (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:53.355 INFO:teuthology.orchestra.run.smithi060.stdout:0 upgraded, 11 newly installed, 0 to remove and 14 not upgraded. 2020-10-31T22:39:53.356 INFO:teuthology.orchestra.run.smithi060.stdout:Need to get 2,960 kB of archives. 2020-10-31T22:39:53.356 INFO:teuthology.orchestra.run.smithi060.stdout:After this operation, 12.2 MB of additional disk space will be used. 2020-10-31T22:39:53.357 INFO:teuthology.orchestra.run.smithi060.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2020-10-31T22:39:53.400 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package flex. 2020-10-31T22:39:53.426 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph-mgr-dashboard (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:53.445 INFO:teuthology.orchestra.run.smithi085.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109901 files and directories currently installed.) 2020-10-31T22:39:53.448 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2020-10-31T22:39:53.482 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking flex (2.6.4-6) ... 2020-10-31T22:39:53.526 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up radosgw (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:53.577 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up ceph (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:53.678 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-10-31T22:39:53.790 INFO:teuthology.orchestra.run.smithi060.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2020-10-31T22:39:53.808 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-10-31T22:39:53.809 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2020-10-31T22:39:53.869 INFO:teuthology.orchestra.run.smithi060.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2020-10-31T22:39:53.878 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package libbison-dev:amd64. 2020-10-31T22:39:53.887 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-10-31T22:39:53.891 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-10-31T22:39:53.918 INFO:teuthology.orchestra.run.smithi060.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2020-10-31T22:39:53.928 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:39:53.935 INFO:teuthology.orchestra.run.smithi060.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2020-10-31T22:39:53.948 INFO:teuthology.orchestra.run.smithi060.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2020-10-31T22:39:53.949 INFO:teuthology.orchestra.run.smithi060.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2020-10-31T22:39:53.960 INFO:teuthology.orchestra.run.smithi060.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2020-10-31T22:39:53.965 INFO:teuthology.orchestra.run.smithi060.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2020-10-31T22:39:53.966 INFO:teuthology.orchestra.run.smithi060.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2020-10-31T22:39:53.967 INFO:teuthology.orchestra.run.smithi060.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.6 [1,566 kB] 2020-10-31T22:39:54.234 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-test (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:54.281 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package bison. 2020-10-31T22:39:54.292 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-10-31T22:39:54.335 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:39:54.361 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-base (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:54.451 INFO:teuthology.orchestra.run.smithi060.stdout:Fetched 2,960 kB in 1s (3,401 kB/s) 2020-10-31T22:39:54.605 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package flex. 2020-10-31T22:39:54.646 INFO:teuthology.orchestra.run.smithi060.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109901 files and directories currently installed.) 2020-10-31T22:39:54.649 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2020-10-31T22:39:54.686 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking flex (2.6.4-6) ... 2020-10-31T22:39:54.699 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2020-10-31T22:39:54.726 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package dump. 2020-10-31T22:39:54.738 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2020-10-31T22:39:54.768 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking dump (0.4b46-3) ... 2020-10-31T22:39:54.979 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:55.049 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libbison-dev:amd64. 2020-10-31T22:39:55.062 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-10-31T22:39:55.071 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package indent. 2020-10-31T22:39:55.083 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2020-10-31T22:39:55.090 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:39:55.122 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking indent (2.2.11-5) ... 2020-10-31T22:39:55.185 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-10-31T22:39:55.187 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2020-10-31T22:39:55.425 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package libaio-dev:amd64. 2020-10-31T22:39:55.439 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../05-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2020-10-31T22:39:55.443 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package bison. 2020-10-31T22:39:55.456 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-10-31T22:39:55.483 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2020-10-31T22:39:55.488 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-diskprediction-local (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:55.497 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:39:55.623 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-osd (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:55.745 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2020-10-31T22:39:55.756 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../06-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2020-10-31T22:39:55.795 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-10-31T22:39:55.880 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package dump. 2020-10-31T22:39:55.892 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2020-10-31T22:39:55.930 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking dump (0.4b46-3) ... 2020-10-31T22:39:56.072 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-10-31T22:39:56.072 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2020-10-31T22:39:56.074 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-10-31T22:39:56.115 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package libelf-dev:amd64. 2020-10-31T22:39:56.116 INFO:teuthology.orchestra.run.smithi152.stdout:ureadahead will be reprofiled on next reboot 2020-10-31T22:39:56.128 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../07-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2020-10-31T22:39:56.165 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-10-31T22:39:56.174 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.2) ... 2020-10-31T22:39:56.242 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package indent. 2020-10-31T22:39:56.255 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2020-10-31T22:39:56.284 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking indent (2.2.11-5) ... 2020-10-31T22:39:56.367 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-cephadm (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:56.510 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:56.544 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package libfl2:amd64. 2020-10-31T22:39:56.545 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libaio-dev:amd64. 2020-10-31T22:39:56.557 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../08-libfl2_2.6.4-6_amd64.deb ... 2020-10-31T22:39:56.558 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../05-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2020-10-31T22:39:56.594 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2020-10-31T22:39:56.617 INFO:teuthology.orchestra.run.smithi152.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-10-31T22:39:56.619 INFO:teuthology.orchestra.run.smithi152:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2020-10-31T22:39:56.643 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2020-10-31T22:39:56.661 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-rook (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:56.701 INFO:teuthology.orchestra.run.smithi152.stdout:Reading package lists... 2020-10-31T22:39:56.804 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mds (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:56.848 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2020-10-31T22:39:56.861 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../06-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2020-10-31T22:39:56.871 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package libfl-dev:amd64. 2020-10-31T22:39:56.884 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6_amd64.deb ... 2020-10-31T22:39:56.898 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-10-31T22:39:56.946 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2020-10-31T22:39:56.956 INFO:teuthology.orchestra.run.smithi152.stdout:Building dependency tree... 2020-10-31T22:39:56.957 INFO:teuthology.orchestra.run.smithi152.stdout:Reading state information... 2020-10-31T22:39:57.022 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-10-31T22:39:57.022 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2020-10-31T22:39:57.118 INFO:teuthology.orchestra.run.smithi152.stdout:libtool-bin is already the newest version (2.4.6-2). 2020-10-31T22:39:57.119 INFO:teuthology.orchestra.run.smithi152.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2020-10-31T22:39:57.119 INFO:teuthology.orchestra.run.smithi152.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2020-10-31T22:39:57.119 INFO:teuthology.orchestra.run.smithi152.stdout:The following additional packages will be installed: 2020-10-31T22:39:57.119 INFO:teuthology.orchestra.run.smithi152.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2020-10-31T22:39:57.121 INFO:teuthology.orchestra.run.smithi152.stdout:Suggested packages: 2020-10-31T22:39:57.121 INFO:teuthology.orchestra.run.smithi152.stdout: bison-doc flex-doc indent-doc libssl-doc 2020-10-31T22:39:57.147 INFO:teuthology.orchestra.run.smithi152.stdout:The following NEW packages will be installed: 2020-10-31T22:39:57.148 INFO:teuthology.orchestra.run.smithi152.stdout: bison dump flex indent libaio-dev libbison-dev libelf-dev libfl-dev libfl2 2020-10-31T22:39:57.148 INFO:teuthology.orchestra.run.smithi152.stdout: libssl-dev zlib1g-dev 2020-10-31T22:39:57.182 INFO:teuthology.orchestra.run.smithi085.stdout:Selecting previously unselected package libssl-dev:amd64. 2020-10-31T22:39:57.183 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libelf-dev:amd64. 2020-10-31T22:39:57.195 INFO:teuthology.orchestra.run.smithi085.stdout:Preparing to unpack .../10-libssl-dev_1.1.1-1ubuntu2.1~18.04.6_amd64.deb ... 2020-10-31T22:39:57.196 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../07-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2020-10-31T22:39:57.232 INFO:teuthology.orchestra.run.smithi085.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.6) ... 2020-10-31T22:39:57.242 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-10-31T22:39:57.313 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mon (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:57.328 INFO:teuthology.orchestra.run.smithi152.stdout:0 upgraded, 11 newly installed, 0 to remove and 14 not upgraded. 2020-10-31T22:39:57.329 INFO:teuthology.orchestra.run.smithi152.stdout:Need to get 2,960 kB of archives. 2020-10-31T22:39:57.329 INFO:teuthology.orchestra.run.smithi152.stdout:After this operation, 12.2 MB of additional disk space will be used. 2020-10-31T22:39:57.329 INFO:teuthology.orchestra.run.smithi152.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2020-10-31T22:39:57.515 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-10-31T22:39:57.516 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2020-10-31T22:39:57.570 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libfl2:amd64. 2020-10-31T22:39:57.584 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../08-libfl2_2.6.4-6_amd64.deb ... 2020-10-31T22:39:57.662 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2020-10-31T22:39:57.742 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up flex (2.6.4-6) ... 2020-10-31T22:39:57.755 INFO:teuthology.orchestra.run.smithi152.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2020-10-31T22:39:57.806 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-k8sevents (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:57.834 INFO:teuthology.orchestra.run.smithi152.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2020-10-31T22:39:57.862 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up dump (0.4b46-3) ... 2020-10-31T22:39:57.882 INFO:teuthology.orchestra.run.smithi152.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2020-10-31T22:39:57.889 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libfl-dev:amd64. 2020-10-31T22:39:57.901 INFO:teuthology.orchestra.run.smithi152.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2020-10-31T22:39:57.903 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6_amd64.deb ... 2020-10-31T22:39:57.912 INFO:teuthology.orchestra.run.smithi152.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2020-10-31T22:39:57.913 INFO:teuthology.orchestra.run.smithi152.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2020-10-31T22:39:57.928 INFO:teuthology.orchestra.run.smithi152.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2020-10-31T22:39:57.933 INFO:teuthology.orchestra.run.smithi152.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2020-10-31T22:39:57.933 INFO:teuthology.orchestra.run.smithi152.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2020-10-31T22:39:57.934 INFO:teuthology.orchestra.run.smithi152.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.6 [1,566 kB] 2020-10-31T22:39:57.944 INFO:teuthology.orchestra.run.smithi085.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2020-10-31T22:39:57.948 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2020-10-31T22:39:57.949 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph-mgr-dashboard (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:58.039 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.6) ... 2020-10-31T22:39:58.165 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up indent (2.2.11-5) ... 2020-10-31T22:39:58.200 INFO:teuthology.orchestra.run.smithi060.stdout:Selecting previously unselected package libssl-dev:amd64. 2020-10-31T22:39:58.209 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up ceph (15.2.5-488-g5e705cd0-1bionic) ... 2020-10-31T22:39:58.214 INFO:teuthology.orchestra.run.smithi060.stdout:Preparing to unpack .../10-libssl-dev_1.1.1-1ubuntu2.1~18.04.6_amd64.deb ... 2020-10-31T22:39:58.259 INFO:teuthology.orchestra.run.smithi060.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.6) ... 2020-10-31T22:39:58.291 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:39:58.336 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2020-10-31T22:39:58.402 INFO:teuthology.orchestra.run.smithi152.stdout:Fetched 2,960 kB in 1s (3,443 kB/s) 2020-10-31T22:39:58.451 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2020-10-31T22:39:58.513 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package flex. 2020-10-31T22:39:58.537 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-10-31T22:39:58.553 INFO:teuthology.orchestra.run.smithi152.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109901 files and directories currently installed.) 2020-10-31T22:39:58.558 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2020-10-31T22:39:58.577 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:39:58.595 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking flex (2.6.4-6) ... 2020-10-31T22:39:58.667 INFO:teuthology.orchestra.run.smithi085.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2020-10-31T22:39:58.754 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2020-10-31T22:39:58.811 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up flex (2.6.4-6) ... 2020-10-31T22:39:58.864 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-10-31T22:39:58.939 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up dump (0.4b46-3) ... 2020-10-31T22:39:58.965 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libbison-dev:amd64. 2020-10-31T22:39:58.973 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-10-31T22:39:58.978 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-10-31T22:39:59.015 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:39:59.043 INFO:teuthology.orchestra.run.smithi060.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2020-10-31T22:39:59.099 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.6) ... 2020-10-31T22:39:59.124 INFO:teuthology.orchestra.run.smithi085.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2020-10-31T22:39:59.225 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up indent (2.2.11-5) ... 2020-10-31T22:39:59.250 INFO:teuthology.orchestra.run.smithi085.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-10-31T22:39:59.343 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:39:59.377 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package bison. 2020-10-31T22:39:59.390 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-10-31T22:39:59.439 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:39:59.444 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2020-10-31T22:39:59.561 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:39:59.651 INFO:teuthology.orchestra.run.smithi060.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2020-10-31T22:39:59.721 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2020-10-31T22:39:59.813 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package dump. 2020-10-31T22:39:59.827 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2020-10-31T22:39:59.847 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-10-31T22:39:59.871 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking dump (0.4b46-3) ... 2020-10-31T22:39:59.973 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-10-31T22:40:00.099 INFO:teuthology.orchestra.run.smithi060.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2020-10-31T22:40:00.125 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package indent. 2020-10-31T22:40:00.137 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2020-10-31T22:40:00.175 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking indent (2.2.11-5) ... 2020-10-31T22:40:00.226 INFO:teuthology.orchestra.run.smithi060.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-10-31T22:40:00.461 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libaio-dev:amd64. 2020-10-31T22:40:00.473 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../05-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2020-10-31T22:40:00.511 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2020-10-31T22:40:00.648 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2020-10-31T22:40:00.691 INFO:teuthology.orchestra.run.smithi066.stdout:ureadahead will be reprofiled on next reboot 2020-10-31T22:40:00.749 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.2) ... 2020-10-31T22:40:00.755 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2020-10-31T22:40:00.768 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../06-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2020-10-31T22:40:00.805 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-10-31T22:40:00.995 INFO:teuthology.orchestra.run.smithi085.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2020-10-31T22:40:01.199 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-10-31T22:40:01.202 INFO:teuthology.orchestra.run.smithi066:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev 2020-10-31T22:40:01.225 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libelf-dev:amd64. 2020-10-31T22:40:01.238 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../07-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2020-10-31T22:40:01.247 INFO:teuthology.orchestra.run.smithi085.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.2) ... 2020-10-31T22:40:01.266 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-10-31T22:40:01.283 INFO:teuthology.orchestra.run.smithi066.stdout:Reading package lists... 2020-10-31T22:40:01.548 INFO:teuthology.orchestra.run.smithi066.stdout:Building dependency tree... 2020-10-31T22:40:01.548 INFO:teuthology.orchestra.run.smithi066.stdout:Reading state information... 2020-10-31T22:40:01.636 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libfl2:amd64. 2020-10-31T22:40:01.647 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../08-libfl2_2.6.4-6_amd64.deb ... 2020-10-31T22:40:01.680 INFO:teuthology.orchestra.run.smithi085.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-10-31T22:40:01.683 DEBUG:teuthology.parallel:result is None 2020-10-31T22:40:01.711 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2020-10-31T22:40:01.747 INFO:teuthology.orchestra.run.smithi066.stdout:libtool-bin is already the newest version (2.4.6-2). 2020-10-31T22:40:01.747 INFO:teuthology.orchestra.run.smithi066.stdout:xfslibs-dev is already the newest version (4.9.0+nmu1ubuntu2). 2020-10-31T22:40:01.748 INFO:teuthology.orchestra.run.smithi066.stdout:uuid-dev is already the newest version (2.31.1-0.4ubuntu3.7). 2020-10-31T22:40:01.748 INFO:teuthology.orchestra.run.smithi066.stdout:The following additional packages will be installed: 2020-10-31T22:40:01.748 INFO:teuthology.orchestra.run.smithi066.stdout: libbison-dev libfl-dev libfl2 zlib1g-dev 2020-10-31T22:40:01.750 INFO:teuthology.orchestra.run.smithi066.stdout:Suggested packages: 2020-10-31T22:40:01.750 INFO:teuthology.orchestra.run.smithi066.stdout: bison-doc flex-doc indent-doc libssl-doc 2020-10-31T22:40:01.778 INFO:teuthology.orchestra.run.smithi066.stdout:The following NEW packages will be installed: 2020-10-31T22:40:01.779 INFO:teuthology.orchestra.run.smithi066.stdout: bison dump flex indent libaio-dev libbison-dev libelf-dev libfl-dev libfl2 2020-10-31T22:40:01.779 INFO:teuthology.orchestra.run.smithi066.stdout: libssl-dev zlib1g-dev 2020-10-31T22:40:01.955 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libfl-dev:amd64. 2020-10-31T22:40:01.965 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6_amd64.deb ... 2020-10-31T22:40:01.997 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2020-10-31T22:40:02.003 INFO:teuthology.orchestra.run.smithi066.stdout:0 upgraded, 11 newly installed, 0 to remove and 14 not upgraded. 2020-10-31T22:40:02.004 INFO:teuthology.orchestra.run.smithi066.stdout:Need to get 2,960 kB of archives. 2020-10-31T22:40:02.004 INFO:teuthology.orchestra.run.smithi066.stdout:After this operation, 12.2 MB of additional disk space will be used. 2020-10-31T22:40:02.005 INFO:teuthology.orchestra.run.smithi066.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/main amd64 flex amd64 2.6.4-6 [316 kB] 2020-10-31T22:40:02.195 INFO:teuthology.orchestra.run.smithi060.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2020-10-31T22:40:02.250 INFO:teuthology.orchestra.run.smithi152.stdout:Selecting previously unselected package libssl-dev:amd64. 2020-10-31T22:40:02.263 INFO:teuthology.orchestra.run.smithi152.stdout:Preparing to unpack .../10-libssl-dev_1.1.1-1ubuntu2.1~18.04.6_amd64.deb ... 2020-10-31T22:40:02.300 INFO:teuthology.orchestra.run.smithi152.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.6) ... 2020-10-31T22:40:02.455 INFO:teuthology.orchestra.run.smithi060.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.2) ... 2020-10-31T22:40:02.456 INFO:teuthology.orchestra.run.smithi066.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/main amd64 libbison-dev amd64 2:3.0.4.dfsg-1build1 [339 kB] 2020-10-31T22:40:02.537 INFO:teuthology.orchestra.run.smithi066.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/main amd64 bison amd64 2:3.0.4.dfsg-1build1 [266 kB] 2020-10-31T22:40:02.588 INFO:teuthology.orchestra.run.smithi066.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/universe amd64 dump amd64 0.4b46-3 [129 kB] 2020-10-31T22:40:02.606 INFO:teuthology.orchestra.run.smithi066.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 indent amd64 2.2.11-5 [80.7 kB] 2020-10-31T22:40:02.618 INFO:teuthology.orchestra.run.smithi066.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libaio-dev amd64 0.3.110-5ubuntu0.1 [12.8 kB] 2020-10-31T22:40:02.619 INFO:teuthology.orchestra.run.smithi066.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 zlib1g-dev amd64 1:1.2.11.dfsg-0ubuntu2 [176 kB] 2020-10-31T22:40:02.634 INFO:teuthology.orchestra.run.smithi066.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libelf-dev amd64 0.170-0.4ubuntu0.1 [57.3 kB] 2020-10-31T22:40:02.638 INFO:teuthology.orchestra.run.smithi066.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl2 amd64 2.6.4-6 [11.4 kB] 2020-10-31T22:40:02.639 INFO:teuthology.orchestra.run.smithi066.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 libfl-dev amd64 2.6.4-6 [6,320 B] 2020-10-31T22:40:02.639 INFO:teuthology.orchestra.run.smithi066.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libssl-dev amd64 1.1.1-1ubuntu2.1~18.04.6 [1,566 kB] 2020-10-31T22:40:02.764 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up flex (2.6.4-6) ... 2020-10-31T22:40:02.887 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up dump (0.4b46-3) ... 2020-10-31T22:40:02.904 INFO:teuthology.orchestra.run.smithi060.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-10-31T22:40:02.907 DEBUG:teuthology.parallel:result is None 2020-10-31T22:40:02.988 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2020-10-31T22:40:03.056 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.6) ... 2020-10-31T22:40:03.129 INFO:teuthology.orchestra.run.smithi066.stdout:Fetched 2,960 kB in 1s (3,153 kB/s) 2020-10-31T22:40:03.181 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up indent (2.2.11-5) ... 2020-10-31T22:40:03.332 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:40:03.458 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2020-10-31T22:40:03.576 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:40:03.655 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package flex. 2020-10-31T22:40:03.666 INFO:teuthology.orchestra.run.smithi152.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2020-10-31T22:40:03.696 INFO:teuthology.orchestra.run.smithi066.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109901 files and directories currently installed.) 2020-10-31T22:40:03.699 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../00-flex_2.6.4-6_amd64.deb ... 2020-10-31T22:40:03.720 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2020-10-31T22:40:03.737 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking flex (2.6.4-6) ... 2020-10-31T22:40:03.847 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-10-31T22:40:03.971 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-10-31T22:40:04.091 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libbison-dev:amd64. 2020-10-31T22:40:04.097 INFO:teuthology.orchestra.run.smithi152.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2020-10-31T22:40:04.103 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../01-libbison-dev_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-10-31T22:40:04.141 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:40:04.240 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-10-31T22:40:04.485 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package bison. 2020-10-31T22:40:04.498 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../02-bison_2%3a3.0.4.dfsg-1build1_amd64.deb ... 2020-10-31T22:40:04.548 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking bison (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:40:04.964 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package dump. 2020-10-31T22:40:04.976 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../03-dump_0.4b46-3_amd64.deb ... 2020-10-31T22:40:05.014 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking dump (0.4b46-3) ... 2020-10-31T22:40:05.276 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package indent. 2020-10-31T22:40:05.289 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../04-indent_2.2.11-5_amd64.deb ... 2020-10-31T22:40:05.326 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking indent (2.2.11-5) ... 2020-10-31T22:40:05.620 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libaio-dev:amd64. 2020-10-31T22:40:05.634 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../05-libaio-dev_0.3.110-5ubuntu0.1_amd64.deb ... 2020-10-31T22:40:05.670 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2020-10-31T22:40:05.907 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package zlib1g-dev:amd64. 2020-10-31T22:40:05.919 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../06-zlib1g-dev_1%3a1.2.11.dfsg-0ubuntu2_amd64.deb ... 2020-10-31T22:40:05.957 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-10-31T22:40:06.051 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2020-10-31T22:40:06.226 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libelf-dev:amd64. 2020-10-31T22:40:06.237 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../07-libelf-dev_0.170-0.4ubuntu0.1_amd64.deb ... 2020-10-31T22:40:06.268 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-10-31T22:40:06.578 INFO:teuthology.orchestra.run.smithi152.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.2) ... 2020-10-31T22:40:06.613 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libfl2:amd64. 2020-10-31T22:40:06.624 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../08-libfl2_2.6.4-6_amd64.deb ... 2020-10-31T22:40:06.705 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libfl2:amd64 (2.6.4-6) ... 2020-10-31T22:40:06.957 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libfl-dev:amd64. 2020-10-31T22:40:06.970 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../09-libfl-dev_2.6.4-6_amd64.deb ... 2020-10-31T22:40:07.007 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libfl-dev:amd64 (2.6.4-6) ... 2020-10-31T22:40:07.022 INFO:teuthology.orchestra.run.smithi152.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-10-31T22:40:07.025 DEBUG:teuthology.parallel:result is None 2020-10-31T22:40:07.260 INFO:teuthology.orchestra.run.smithi066.stdout:Selecting previously unselected package libssl-dev:amd64. 2020-10-31T22:40:07.274 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing to unpack .../10-libssl-dev_1.1.1-1ubuntu2.1~18.04.6_amd64.deb ... 2020-10-31T22:40:07.318 INFO:teuthology.orchestra.run.smithi066.stdout:Unpacking libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.6) ... 2020-10-31T22:40:07.784 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up flex (2.6.4-6) ... 2020-10-31T22:40:07.906 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up dump (0.4b46-3) ... 2020-10-31T22:40:08.005 INFO:teuthology.orchestra.run.smithi066.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2020-10-31T22:40:08.071 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libssl-dev:amd64 (1.1.1-1ubuntu2.1~18.04.6) ... 2020-10-31T22:40:08.192 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up indent (2.2.11-5) ... 2020-10-31T22:40:08.318 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libbison-dev:amd64 (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:40:08.453 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libfl2:amd64 (2.6.4-6) ... 2020-10-31T22:40:08.630 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up bison (2:3.0.4.dfsg-1build1) ... 2020-10-31T22:40:08.711 INFO:teuthology.orchestra.run.smithi066.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2020-10-31T22:40:08.781 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libaio-dev:amd64 (0.3.110-5ubuntu0.1) ... 2020-10-31T22:40:08.932 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up zlib1g-dev:amd64 (1:1.2.11.dfsg-0ubuntu2) ... 2020-10-31T22:40:09.058 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libelf-dev:amd64 (0.170-0.4ubuntu0.1) ... 2020-10-31T22:40:09.184 INFO:teuthology.orchestra.run.smithi066.stdout:Setting up libfl-dev:amd64 (2.6.4-6) ... 2020-10-31T22:40:09.311 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2020-10-31T22:40:11.097 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for install-info (6.5.0.dfsg.1-2) ... 2020-10-31T22:40:11.373 INFO:teuthology.orchestra.run.smithi066.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.2) ... 2020-10-31T22:40:11.814 INFO:teuthology.orchestra.run.smithi066.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2020-10-31T22:40:11.816 DEBUG:teuthology.parallel:result is None 2020-10-31T22:40:11.817 INFO:teuthology.orchestra.run.smithi060:> sudo lsb_release -is 2020-10-31T22:40:11.875 INFO:teuthology.orchestra.run.smithi060.stdout:Ubuntu 2020-10-31T22:40:11.880 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-31T22:40:11.882 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=5e705cd08d99a37f9ec3c2b451d90f6262257c7c 2020-10-31T22:40:12.056 INFO:teuthology.orchestra.run.smithi060:> dpkg-query -W -f '${Version}' ceph 2020-10-31T22:40:12.082 INFO:teuthology.orchestra.run.smithi060.stdout:15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:40:12.083 INFO:teuthology.packaging:The installed version of ceph is 15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:40:12.084 INFO:teuthology.task.install:The correct ceph version 15.2.5-488-g5e705cd0-1bionic is installed. 2020-10-31T22:40:12.084 INFO:teuthology.orchestra.run.smithi066:> sudo lsb_release -is 2020-10-31T22:40:12.143 INFO:teuthology.orchestra.run.smithi066.stdout:Ubuntu 2020-10-31T22:40:12.151 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-31T22:40:12.152 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=5e705cd08d99a37f9ec3c2b451d90f6262257c7c 2020-10-31T22:40:12.328 INFO:teuthology.orchestra.run.smithi066:> dpkg-query -W -f '${Version}' ceph 2020-10-31T22:40:12.354 INFO:teuthology.orchestra.run.smithi066.stdout:15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:40:12.354 INFO:teuthology.packaging:The installed version of ceph is 15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:40:12.355 INFO:teuthology.task.install:The correct ceph version 15.2.5-488-g5e705cd0-1bionic is installed. 2020-10-31T22:40:12.355 INFO:teuthology.orchestra.run.smithi152:> sudo lsb_release -is 2020-10-31T22:40:12.414 INFO:teuthology.orchestra.run.smithi152.stdout:Ubuntu 2020-10-31T22:40:12.419 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-31T22:40:12.420 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=5e705cd08d99a37f9ec3c2b451d90f6262257c7c 2020-10-31T22:40:12.589 INFO:teuthology.orchestra.run.smithi152:> dpkg-query -W -f '${Version}' ceph 2020-10-31T22:40:12.615 INFO:teuthology.orchestra.run.smithi152.stdout:15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:40:12.615 INFO:teuthology.packaging:The installed version of ceph is 15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:40:12.616 INFO:teuthology.task.install:The correct ceph version 15.2.5-488-g5e705cd0-1bionic is installed. 2020-10-31T22:40:12.616 INFO:teuthology.orchestra.run.smithi085:> sudo lsb_release -is 2020-10-31T22:40:12.665 INFO:teuthology.orchestra.run.smithi085.stdout:Ubuntu 2020-10-31T22:40:12.670 DEBUG:teuthology.misc:System to be installed: Ubuntu 2020-10-31T22:40:12.671 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=5e705cd08d99a37f9ec3c2b451d90f6262257c7c 2020-10-31T22:40:12.850 INFO:teuthology.orchestra.run.smithi085:> dpkg-query -W -f '${Version}' ceph 2020-10-31T22:40:12.875 INFO:teuthology.orchestra.run.smithi085.stdout:15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:40:12.876 INFO:teuthology.packaging:The installed version of ceph is 15.2.5-488-g5e705cd0-1bionic 2020-10-31T22:40:12.876 INFO:teuthology.task.install:The correct ceph version 15.2.5-488-g5e705cd0-1bionic is installed. 2020-10-31T22:40:12.876 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-10-31T22:40:12.877 INFO:teuthology.orchestra.run.smithi060:> set -ex 2020-10-31T22:40:12.877 INFO:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-10-31T22:40:12.882 INFO:teuthology.orchestra.run.smithi060.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-10-31T22:40:12.892 INFO:teuthology.orchestra.run.smithi060.stderr:24+1 records in 2020-10-31T22:40:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:24+1 records out 2020-10-31T22:40:12.893 INFO:teuthology.orchestra.run.smithi060.stderr:12667 bytes (13 kB, 12 KiB) copied, 0.000222798 s, 56.9 MB/s 2020-10-31T22:40:12.894 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-10-31T22:40:12.894 INFO:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-10-31T22:40:12.902 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-10-31T22:40:12.913 INFO:teuthology.orchestra.run.smithi066.stderr:24+1 records in 2020-10-31T22:40:12.914 INFO:teuthology.orchestra.run.smithi066.stderr:24+1 records out 2020-10-31T22:40:12.914 INFO:teuthology.orchestra.run.smithi066.stderr:12667 bytes (13 kB, 12 KiB) copied, 0.00021794 s, 58.1 MB/s 2020-10-31T22:40:12.915 INFO:teuthology.orchestra.run.smithi152:> set -ex 2020-10-31T22:40:12.915 INFO:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-10-31T22:40:12.920 INFO:teuthology.orchestra.run.smithi152.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-10-31T22:40:12.930 INFO:teuthology.orchestra.run.smithi152.stderr:24+1 records in 2020-10-31T22:40:12.930 INFO:teuthology.orchestra.run.smithi152.stderr:24+1 records out 2020-10-31T22:40:12.930 INFO:teuthology.orchestra.run.smithi152.stderr:12667 bytes (13 kB, 12 KiB) copied, 0.000195232 s, 64.9 MB/s 2020-10-31T22:40:12.931 INFO:teuthology.orchestra.run.smithi085:> set -ex 2020-10-31T22:40:12.931 INFO:teuthology.orchestra.run.smithi085:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-10-31T22:40:12.936 INFO:teuthology.orchestra.run.smithi085.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-10-31T22:40:12.945 INFO:teuthology.orchestra.run.smithi085.stderr:24+1 records in 2020-10-31T22:40:12.945 INFO:teuthology.orchestra.run.smithi085.stderr:24+1 records out 2020-10-31T22:40:12.945 INFO:teuthology.orchestra.run.smithi085.stderr:12667 bytes (13 kB, 12 KiB) copied, 9.0913e-05 s, 139 MB/s 2020-10-31T22:40:12.947 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-10-31T22:40:12.947 INFO:teuthology.orchestra.run.smithi060:> set -ex 2020-10-31T22:40:12.948 INFO:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2020-10-31T22:40:12.953 INFO:teuthology.orchestra.run.smithi060.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-10-31T22:40:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:5+1 records in 2020-10-31T22:40:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:5+1 records out 2020-10-31T22:40:12.962 INFO:teuthology.orchestra.run.smithi060.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 0.000100641 s, 30.4 MB/s 2020-10-31T22:40:12.963 INFO:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-10-31T22:40:13.019 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-10-31T22:40:13.019 INFO:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2020-10-31T22:40:13.024 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-10-31T22:40:13.033 INFO:teuthology.orchestra.run.smithi066.stderr:5+1 records in 2020-10-31T22:40:13.034 INFO:teuthology.orchestra.run.smithi066.stderr:5+1 records out 2020-10-31T22:40:13.034 INFO:teuthology.orchestra.run.smithi066.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 9.919e-05 s, 30.8 MB/s 2020-10-31T22:40:13.035 INFO:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-10-31T22:40:13.093 INFO:teuthology.orchestra.run.smithi152:> set -ex 2020-10-31T22:40:13.094 INFO:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2020-10-31T22:40:13.099 INFO:teuthology.orchestra.run.smithi152.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-10-31T22:40:13.107 INFO:teuthology.orchestra.run.smithi152.stderr:5+1 records in 2020-10-31T22:40:13.107 INFO:teuthology.orchestra.run.smithi152.stderr:5+1 records out 2020-10-31T22:40:13.107 INFO:teuthology.orchestra.run.smithi152.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.3924e-05 s, 69.6 MB/s 2020-10-31T22:40:13.108 INFO:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-10-31T22:40:13.164 INFO:teuthology.orchestra.run.smithi085:> set -ex 2020-10-31T22:40:13.164 INFO:teuthology.orchestra.run.smithi085:> sudo dd of=/usr/bin/daemon-helper 2020-10-31T22:40:13.169 INFO:teuthology.orchestra.run.smithi085.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-10-31T22:40:13.178 INFO:teuthology.orchestra.run.smithi085.stderr:5+1 records in 2020-10-31T22:40:13.178 INFO:teuthology.orchestra.run.smithi085.stderr:5+1 records out 2020-10-31T22:40:13.179 INFO:teuthology.orchestra.run.smithi085.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 9.3512e-05 s, 32.7 MB/s 2020-10-31T22:40:13.180 INFO:teuthology.orchestra.run.smithi085:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-10-31T22:40:13.234 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-10-31T22:40:13.235 INFO:teuthology.orchestra.run.smithi060:> set -ex 2020-10-31T22:40:13.235 INFO:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2020-10-31T22:40:13.241 INFO:teuthology.orchestra.run.smithi060.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-10-31T22:40:13.250 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records in 2020-10-31T22:40:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records out 2020-10-31T22:40:13.251 INFO:teuthology.orchestra.run.smithi060.stderr:299 bytes copied, 6.86e-05 s, 4.4 MB/s 2020-10-31T22:40:13.252 INFO:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-10-31T22:40:13.307 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-10-31T22:40:13.308 INFO:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2020-10-31T22:40:13.312 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-10-31T22:40:13.322 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-10-31T22:40:13.323 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-10-31T22:40:13.323 INFO:teuthology.orchestra.run.smithi066.stderr:299 bytes copied, 6.822e-05 s, 4.4 MB/s 2020-10-31T22:40:13.323 INFO:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-10-31T22:40:13.378 INFO:teuthology.orchestra.run.smithi152:> set -ex 2020-10-31T22:40:13.378 INFO:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2020-10-31T22:40:13.383 INFO:teuthology.orchestra.run.smithi152.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-10-31T22:40:13.392 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2020-10-31T22:40:13.392 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2020-10-31T22:40:13.392 INFO:teuthology.orchestra.run.smithi152.stderr:299 bytes copied, 6.9777e-05 s, 4.3 MB/s 2020-10-31T22:40:13.393 INFO:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-10-31T22:40:13.451 INFO:teuthology.orchestra.run.smithi085:> set -ex 2020-10-31T22:40:13.452 INFO:teuthology.orchestra.run.smithi085:> sudo dd of=/usr/bin/adjust-ulimits 2020-10-31T22:40:13.457 INFO:teuthology.orchestra.run.smithi085.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-10-31T22:40:13.465 INFO:teuthology.orchestra.run.smithi085.stderr:0+1 records in 2020-10-31T22:40:13.466 INFO:teuthology.orchestra.run.smithi085.stderr:0+1 records out 2020-10-31T22:40:13.466 INFO:teuthology.orchestra.run.smithi085.stderr:299 bytes copied, 6.7356e-05 s, 4.4 MB/s 2020-10-31T22:40:13.467 INFO:teuthology.orchestra.run.smithi085:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-10-31T22:40:13.523 INFO:teuthology.run_tasks:Running task ceph... 2020-10-31T22:40:13.596 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-10-31T22:40:13.598 INFO:teuthology.orchestra.run.smithi060:> sudo chmod 777 /var/log/ceph 2020-10-31T22:40:13.603 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 777 /var/log/ceph 2020-10-31T22:40:13.605 INFO:teuthology.orchestra.run.smithi085:> sudo chmod 777 /var/log/ceph 2020-10-31T22:40:13.608 INFO:teuthology.orchestra.run.smithi152:> sudo chmod 777 /var/log/ceph 2020-10-31T22:40:13.623 INFO:tasks.ceph:Disabling ceph logrotate... 2020-10-31T22:40:13.623 INFO:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/logrotate.d/ceph 2020-10-31T22:40:13.659 INFO:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/logrotate.d/ceph 2020-10-31T22:40:13.661 INFO:teuthology.orchestra.run.smithi085:> sudo rm -f -- /etc/logrotate.d/ceph 2020-10-31T22:40:13.666 INFO:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/logrotate.d/ceph 2020-10-31T22:40:13.681 INFO:tasks.ceph:Creating extra log directories... 2020-10-31T22:40:13.681 INFO:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-10-31T22:40:13.716 INFO:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-10-31T22:40:13.720 INFO:teuthology.orchestra.run.smithi085:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-10-31T22:40:13.722 INFO:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-10-31T22:40:13.737 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-10-31T22:40:13.738 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-10-31T22:40:13.738 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-10-31T22:40:13.739 INFO:teuthology.orchestra.run.smithi060:> set -ex 2020-10-31T22:40:13.739 INFO:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-10-31T22:40:13.775 INFO:teuthology.orchestra.run.smithi060.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-10-31T22:40:13.777 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records in 2020-10-31T22:40:13.778 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records out 2020-10-31T22:40:13.778 INFO:teuthology.orchestra.run.smithi060.stderr:408 bytes copied, 7.4574e-05 s, 5.5 MB/s 2020-10-31T22:40:13.778 INFO:teuthology.orchestra.run.smithi060:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-10-31T22:40:13.858 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-10-31T22:40:13.859 INFO:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-10-31T22:40:13.864 INFO:teuthology.orchestra.run.smithi066.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-10-31T22:40:13.865 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-10-31T22:40:13.866 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-10-31T22:40:13.866 INFO:teuthology.orchestra.run.smithi066.stderr:408 bytes copied, 7.3468e-05 s, 5.6 MB/s 2020-10-31T22:40:13.866 INFO:teuthology.orchestra.run.smithi066:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-10-31T22:40:13.944 INFO:teuthology.orchestra.run.smithi152:> set -ex 2020-10-31T22:40:13.946 INFO:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-10-31T22:40:13.951 INFO:teuthology.orchestra.run.smithi152.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-10-31T22:40:13.953 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2020-10-31T22:40:13.954 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2020-10-31T22:40:13.954 INFO:teuthology.orchestra.run.smithi152.stderr:408 bytes copied, 7.595e-05 s, 5.4 MB/s 2020-10-31T22:40:13.954 INFO:teuthology.orchestra.run.smithi152:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-10-31T22:40:14.032 INFO:teuthology.orchestra.run.smithi085:> set -ex 2020-10-31T22:40:14.033 INFO:teuthology.orchestra.run.smithi085:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-10-31T22:40:14.038 INFO:teuthology.orchestra.run.smithi085.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-10-31T22:40:14.040 INFO:teuthology.orchestra.run.smithi085.stderr:0+1 records in 2020-10-31T22:40:14.040 INFO:teuthology.orchestra.run.smithi085.stderr:0+1 records out 2020-10-31T22:40:14.041 INFO:teuthology.orchestra.run.smithi085.stderr:408 bytes copied, 6.6049e-05 s, 6.2 MB/s 2020-10-31T22:40:14.041 INFO:teuthology.orchestra.run.smithi085:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-10-31T22:40:14.121 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-10-31T22:40:14.122 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-10-31T22:40:14.122 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2020-10-28_04:10:03-fs-octopus-distro-basic-smithi/5566789', 'branch': 'octopus', 'description': 'fs/multiclient/{begin clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp overrides/{frag_enable whitelist_health whitelist_wrongly_marked_down} tasks/cephfs_misc_tests}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '5566789', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'teuthology-2020-10-28_04:10:03-fs-octopus-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '18.04', 'overrides': {'admin_socket': {'branch': 'octopus'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'evicting unresponsive client', 'POOL_APP_NOT_ENABLED', 'has not responded to cap revoke by MDS for over', 'MDS_CLIENT_LATE_RELEASE', 'responding to mclientcaps'], 'sha1': '5e705cd08d99a37f9ec3c2b451d90f6262257c7c'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '5e705cd08d99a37f9ec3c2b451d90f6262257c7c'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'octopus', 'sha1': '5e705cd08d99a37f9ec3c2b451d90f6262257c7c'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 1000, 'repo': 'git://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1']], 'sha1': '5e705cd08d99a37f9ec3c2b451d90f6262257c7c', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'octopus', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_octopus/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph.git', 'suite_sha1': '5e705cd08d99a37f9ec3c2b451d90f6262257c7c', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (4, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': '5e705cd08d99a37f9ec3c2b451d90f6262257c7c'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_misc']}}], 'teuthology_branch': 'master', 'timestamp': '2020-10-28_04:10:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.11568', 'targets': {'smithi060.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDWcV67rIubjV46XiMWEL/VfqIVRCXlBSW18ydg2bOr3vA7ge7zLbhtQNi+8ASIS06CCZh5C+oOPaBND1i1nDgxqX8tWaMMl5DW/fgQqwZnM9/E4UOyiXc0CLuJtfeACMbM4+W273M83RdmrPP0DEojAXSoF0XD9SbhEy9bMdLasnN16kUc5Jj9Fr2K6T154pSQfanWh9atxNLc3QPoz8tLUMFfUeRluG2tfo7hY1Mb/yZDa7/zVACVGjFsw1CKM/v2kiBb7/M/TNled7AB2cNCN9QwaqIDJzU80wen9klSj7wbXDZcu/mLNDZqvO6f8fZDZeIMnHCeQ5NKyT2k/d8B', 'smithi066.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUmtf5I+gMDboWsUAqE8fMfLbnvii5X13JFbkiCyjbSuF2I8Be2kbM5OdukucKS0gIz0TWQ+K0VKTYpX18bR1n2uYdUtjpWHV2D2vdUgZ7XeGefiGepmCaTY1JZR652nxrUEFkVUupGBi+pqsz9QX8Z5GNkCQyreDzrLxaP7fMhdckWC9EoivNX0ofdLbv+bqXjEy3SDU1kz4HYTyQtiG0J0ZJ0WT3LTSHmHSEv4M3rF3xG4j49IdCxlNzOhMYnKssBxiu6JL6wfsu3l59/iemFcBu7s21T6xfFWV7EKMxyxTSmvzsg/gt05PvHFpaWRGtYL8E1W/LvMWVggZKPcQ3', 'smithi152.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDI7VH3P/0jj/bpNM37MxDJidqSZ7mUTL9EZVptwMLW/qB8cM+ydaTbyfTVUBoymxVhtGvgSu8+7LC3od06LuDYnxrT9ioHc0547U5o5RoBrEuNlb56K+iMmBOIMru/fWhiPmkrsKdFRViAT05OAEQQLnHEMd4tXPztnyjXEQCBDbRo7lxg6g6m15hPwo/R3F12IROKfr8AiNWweQCZqVl0kPYrgX/+ni3/C5i2I829wm7lAEVquUgUdz2jnu/kgbDxBb9k6GezGmXNtUVvte0q5WX8ga6xwtRb72GstJ87BgSF4LD3wcwJfS8QP1nfQ5KjaJ0Nh7rMb1QKI/dgNO1V', 'smithi085.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwLR4Jg4mPzJUDBu2nL5ZMVGV1xl9sJhCm12V4ITuDfzTGc4XyuG3bZOY6ykylGAQZkBk384EIAei8/o8J9Az7CkeREhd7gWMd+XT5tcR1O+KOvwsbLaHPNKAd4ENDu9D6yXN/ukSVXPK6Z6V9Z/M7BTYmHDC5jOYKMRKlXhDlpfDMt5ceic6B0Y+A/I8VX8MgkfNspvZj7kv4Iw32RRS/NYogX9KQncWFT9stYDPw2FxKceXM9Mp2Ps8MvDP6pTr0l/PZnxFvicuYG0LtImg5QK0/BXbdgyCYnA3JrPrJeLfZ8dSDpJwdU9Z/01/W+nKjuEirIUWdLp7Ukjr7Dxl'}} 2020-10-31T22:40:14.123 INFO:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-10-31T22:40:14.126 INFO:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-10-31T22:40:14.131 INFO:teuthology.orchestra.run.smithi085:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-10-31T22:40:14.170 INFO:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-10-31T22:40:14.670 INFO:teuthology.orchestra.run.smithi060:> sudo install -d -m0777 -- /var/run/ceph 2020-10-31T22:40:14.675 INFO:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/run/ceph 2020-10-31T22:40:14.691 INFO:teuthology.orchestra.run.smithi085:> sudo install -d -m0777 -- /var/run/ceph 2020-10-31T22:40:14.702 INFO:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/run/ceph 2020-10-31T22:40:14.734 INFO:teuthology.orchestra.run.smithi060:> set -ex 2020-10-31T22:40:14.735 INFO:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2020-10-31T22:40:14.746 INFO:teuthology.orchestra.run.smithi060.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-10-31T22:40:14.748 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/vg_nvme/lv_1 2020-10-31T22:40:14.748 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/vg_nvme/lv_2 2020-10-31T22:40:14.748 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/vg_nvme/lv_3 2020-10-31T22:40:14.749 INFO:teuthology.orchestra.run.smithi060.stdout:/dev/vg_nvme/lv_4 2020-10-31T22:40:14.749 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records in 2020-10-31T22:40:14.749 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records out 2020-10-31T22:40:14.750 INFO:teuthology.orchestra.run.smithi060.stderr:72 bytes copied, 0.000177064 s, 407 kB/s 2020-10-31T22:40:14.750 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-10-31T22:40:14.751 INFO:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-10-31T22:40:14.805 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-10-31T22:40:14.808 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-31T22:40:14.809 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 341 Links: 1 2020-10-31T22:40:14.810 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-31T22:40:14.810 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2020-10-31 22:36:59.269557114 +0000 2020-10-31T22:40:14.811 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2020-10-31 22:36:59.161557117 +0000 2020-10-31T22:40:14.811 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2020-10-31 22:36:59.161557117 +0000 2020-10-31T22:40:14.812 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2020-10-31T22:40:14.815 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2020-10-31T22:40:14.816 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2020-10-31T22:40:14.816 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000310054 s, 1.7 MB/s 2020-10-31T22:40:14.819 INFO:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-10-31T22:40:14.874 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-10-31T22:40:14.874 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-31T22:40:14.874 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 348 Links: 1 2020-10-31T22:40:14.875 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-31T22:40:14.875 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2020-10-31 22:36:59.533557108 +0000 2020-10-31T22:40:14.875 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2020-10-31 22:36:59.401557111 +0000 2020-10-31T22:40:14.875 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2020-10-31 22:36:59.401557111 +0000 2020-10-31T22:40:14.875 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2020-10-31T22:40:14.883 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2020-10-31T22:40:14.884 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2020-10-31T22:40:14.884 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000203937 s, 2.5 MB/s 2020-10-31T22:40:14.888 INFO:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-10-31T22:40:14.940 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-10-31T22:40:14.940 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-31T22:40:14.941 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 354 Links: 1 2020-10-31T22:40:14.941 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-31T22:40:14.941 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2020-10-31 22:36:59.793557103 +0000 2020-10-31T22:40:14.941 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2020-10-31 22:36:59.665557105 +0000 2020-10-31T22:40:14.941 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2020-10-31 22:36:59.665557105 +0000 2020-10-31T22:40:14.942 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2020-10-31T22:40:14.950 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2020-10-31T22:40:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2020-10-31T22:40:14.951 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000279648 s, 1.8 MB/s 2020-10-31T22:40:14.954 INFO:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-10-31T22:40:15.006 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-10-31T22:40:15.006 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-31T22:40:15.006 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 6h/6d Inode: 360 Links: 1 2020-10-31T22:40:15.007 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-31T22:40:15.007 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2020-10-31 22:37:00.057557097 +0000 2020-10-31T22:40:15.007 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2020-10-31 22:36:59.917557100 +0000 2020-10-31T22:40:15.008 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2020-10-31 22:36:59.917557100 +0000 2020-10-31T22:40:15.008 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: - 2020-10-31T22:40:15.015 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2020-10-31T22:40:15.015 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2020-10-31T22:40:15.015 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000281902 s, 1.8 MB/s 2020-10-31T22:40:15.020 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-10-31T22:40:15.020 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-10-31T22:40:15.020 INFO:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2020-10-31T22:40:15.036 INFO:teuthology.orchestra.run.smithi066.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-10-31T22:40:15.038 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/vg_nvme/lv_1 2020-10-31T22:40:15.039 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/vg_nvme/lv_2 2020-10-31T22:40:15.039 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/vg_nvme/lv_3 2020-10-31T22:40:15.039 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/vg_nvme/lv_4 2020-10-31T22:40:15.039 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-10-31T22:40:15.040 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-10-31T22:40:15.040 INFO:teuthology.orchestra.run.smithi066.stderr:72 bytes copied, 0.000164294 s, 438 kB/s 2020-10-31T22:40:15.040 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-10-31T22:40:15.040 INFO:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-10-31T22:40:15.100 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-10-31T22:40:15.100 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-31T22:40:15.100 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 342 Links: 1 2020-10-31T22:40:15.101 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-31T22:40:15.101 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2020-10-31 22:36:58.868533324 +0000 2020-10-31T22:40:15.101 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2020-10-31 22:36:58.720533325 +0000 2020-10-31T22:40:15.101 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2020-10-31 22:36:58.720533325 +0000 2020-10-31T22:40:15.101 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2020-10-31T22:40:15.109 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2020-10-31T22:40:15.110 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2020-10-31T22:40:15.110 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000406076 s, 1.3 MB/s 2020-10-31T22:40:15.114 INFO:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-10-31T22:40:15.185 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-10-31T22:40:15.186 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-31T22:40:15.186 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 349 Links: 1 2020-10-31T22:40:15.186 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-31T22:40:15.187 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2020-10-31 22:36:59.120533321 +0000 2020-10-31T22:40:15.187 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2020-10-31 22:36:59.016533322 +0000 2020-10-31T22:40:15.187 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2020-10-31 22:36:59.016533322 +0000 2020-10-31T22:40:15.187 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2020-10-31T22:40:15.191 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2020-10-31T22:40:15.192 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2020-10-31T22:40:15.192 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000372246 s, 1.4 MB/s 2020-10-31T22:40:15.198 INFO:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-10-31T22:40:15.262 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-10-31T22:40:15.262 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-31T22:40:15.262 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 355 Links: 1 2020-10-31T22:40:15.262 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-31T22:40:15.262 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2020-10-31 22:36:59.384533318 +0000 2020-10-31T22:40:15.263 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2020-10-31 22:36:59.252533319 +0000 2020-10-31T22:40:15.263 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2020-10-31 22:36:59.252533319 +0000 2020-10-31T22:40:15.263 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2020-10-31T22:40:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2020-10-31T22:40:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2020-10-31T22:40:15.270 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.00037852 s, 1.4 MB/s 2020-10-31T22:40:15.273 INFO:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-10-31T22:40:15.334 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-10-31T22:40:15.335 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-10-31T22:40:15.335 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 361 Links: 1 2020-10-31T22:40:15.335 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-10-31T22:40:15.336 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2020-10-31 22:36:59.528533316 +0000 2020-10-31T22:40:15.336 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2020-10-31 22:36:59.524533316 +0000 2020-10-31T22:40:15.336 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2020-10-31 22:36:59.524533316 +0000 2020-10-31T22:40:15.337 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2020-10-31T22:40:15.343 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2020-10-31T22:40:15.344 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2020-10-31T22:40:15.344 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000417415 s, 1.2 MB/s 2020-10-31T22:40:15.348 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-10-31T22:40:15.349 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-10-31T22:40:15.349 INFO:tasks.ceph:Generating config... 2020-10-31T22:40:15.351 INFO:tasks.ceph:[client] client mount timeout = 600 2020-10-31T22:40:15.351 INFO:tasks.ceph:[client] debug client = 20 2020-10-31T22:40:15.352 INFO:tasks.ceph:[client] debug ms = 1 2020-10-31T22:40:15.352 INFO:tasks.ceph:[mds] debug mds = 20 2020-10-31T22:40:15.353 INFO:tasks.ceph:[mds] debug ms = 1 2020-10-31T22:40:15.354 INFO:tasks.ceph:[mds] mds bal frag = True 2020-10-31T22:40:15.354 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-10-31T22:40:15.354 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-10-31T22:40:15.354 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-10-31T22:40:15.355 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-10-31T22:40:15.355 INFO:tasks.ceph:[mds] mds debug frag = True 2020-10-31T22:40:15.355 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-10-31T22:40:15.356 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-10-31T22:40:15.356 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-10-31T22:40:15.357 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-10-31T22:40:15.357 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-10-31T22:40:15.357 INFO:tasks.ceph:[mgr] debug ms = 1 2020-10-31T22:40:15.357 INFO:tasks.ceph:[mon] debug mon = 20 2020-10-31T22:40:15.358 INFO:tasks.ceph:[mon] debug ms = 1 2020-10-31T22:40:15.358 INFO:tasks.ceph:[mon] debug paxos = 20 2020-10-31T22:40:15.358 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-10-31T22:40:15.358 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-10-31T22:40:15.359 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2020-10-31T22:40:15.359 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-10-31T22:40:15.359 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-10-31T22:40:15.359 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-10-31T22:40:15.360 INFO:tasks.ceph:[osd] debug filestore = 20 2020-10-31T22:40:15.360 INFO:tasks.ceph:[osd] debug journal = 20 2020-10-31T22:40:15.360 INFO:tasks.ceph:[osd] debug ms = 20 2020-10-31T22:40:15.360 INFO:tasks.ceph:[osd] debug osd = 25 2020-10-31T22:40:15.360 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-10-31T22:40:15.361 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-10-31T22:40:15.361 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-10-31T22:40:15.361 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-10-31T22:40:15.361 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-10-31T22:40:15.362 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-10-31T22:40:15.362 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-10-31T22:40:15.363 INFO:tasks.ceph:Setting up mon.a... 2020-10-31T22:40:15.363 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-10-31T22:40:15.398 INFO:teuthology.orchestra.run.smithi060.stdout:creating /etc/ceph/ceph.keyring 2020-10-31T22:40:15.400 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-10-31T22:40:15.480 INFO:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-10-31T22:40:15.551 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.60'), ('mon.b', '172.21.15.66'), ('mon.c', '[v2:172.21.15.66:3301,v1:172.21.15.66:6790]')] 2020-10-31T22:40:15.552 INFO:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.60 --add b 172.21.15.66 --addv c '[v2:172.21.15.66:3301,v1:172.21.15.66:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:15.639 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:15.639 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: generated fsid 226f905a-1517-4a8c-8009-08779515965c 2020-10-31T22:40:15.639 INFO:teuthology.orchestra.run.smithi060.stdout:epoch 0 2020-10-31T22:40:15.640 INFO:teuthology.orchestra.run.smithi060.stdout:fsid 226f905a-1517-4a8c-8009-08779515965c 2020-10-31T22:40:15.640 INFO:teuthology.orchestra.run.smithi060.stdout:last_changed 2020-10-31T22:40:15.642887+0000 2020-10-31T22:40:15.640 INFO:teuthology.orchestra.run.smithi060.stdout:created 2020-10-31T22:40:15.642887+0000 2020-10-31T22:40:15.640 INFO:teuthology.orchestra.run.smithi060.stdout:min_mon_release 0 (unknown) 2020-10-31T22:40:15.640 INFO:teuthology.orchestra.run.smithi060.stdout:0: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.a 2020-10-31T22:40:15.640 INFO:teuthology.orchestra.run.smithi060.stdout:1: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2020-10-31T22:40:15.640 INFO:teuthology.orchestra.run.smithi060.stdout:2: [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] mon.c 2020-10-31T22:40:15.641 INFO:teuthology.orchestra.run.smithi060.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-10-31T22:40:15.642 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 226f905a-1517-4a8c-8009-08779515965c... 2020-10-31T22:40:15.643 INFO:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-10-31T22:40:15.693 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-10-31T22:40:15.705 INFO:teuthology.orchestra.run.smithi085:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-10-31T22:40:15.708 INFO:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-10-31T22:40:15.725 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2020-10-31T22:40:15.725 INFO:teuthology.orchestra.run.smithi060.stdout: chdir = "" 2020-10-31T22:40:15.725 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-31T22:40:15.726 INFO:teuthology.orchestra.run.smithi060.stdout: auth supported = cephx 2020-10-31T22:40:15.726 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.726 INFO:teuthology.orchestra.run.smithi060.stdout: filestore xattr use omap = true 2020-10-31T22:40:15.726 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.726 INFO:teuthology.orchestra.run.smithi060.stdout: mon clock drift allowed = 1.000 2020-10-31T22:40:15.726 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.726 INFO:teuthology.orchestra.run.smithi060.stdout: osd crush chooseleaf type = 0 2020-10-31T22:40:15.727 INFO:teuthology.orchestra.run.smithi060.stdout: auth debug = true 2020-10-31T22:40:15.727 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.727 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on old message = true 2020-10-31T22:40:15.727 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on bug = true 2020-10-31T22:40:15.727 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.727 INFO:teuthology.orchestra.run.smithi060.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-31T22:40:15.727 INFO:teuthology.orchestra.run.smithi060.stdout: mon pg warn max object skew = 0 2020-10-31T22:40:15.728 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.728 INFO:teuthology.orchestra.run.smithi060.stdout: # disable pg_autoscaler by default for new pools 2020-10-31T22:40:15.728 INFO:teuthology.orchestra.run.smithi060.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-31T22:40:15.728 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.728 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default size = 2 2020-10-31T22:40:15.728 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.728 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow primary affinity = true 2020-10-31T22:40:15.729 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow pg remap = true 2020-10-31T22:40:15.729 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on legacy crush tunables = false 2020-10-31T22:40:15.729 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on crush straw calc version zero = false 2020-10-31T22:40:15.729 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on no sortbitwise = false 2020-10-31T22:40:15.729 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on osd down out interval zero = false 2020-10-31T22:40:15.729 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on too few osds = false 2020-10-31T22:40:15.729 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-31T22:40:15.730 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-31T22:40:15.730 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.730 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-31T22:40:15.730 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.730 INFO:teuthology.orchestra.run.smithi060.stdout: osd default data pool replay window = 5 2020-10-31T22:40:15.730 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.730 INFO:teuthology.orchestra.run.smithi060.stdout: mon allow pool delete = true 2020-10-31T22:40:15.730 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.731 INFO:teuthology.orchestra.run.smithi060.stdout: mon cluster log file level = debug 2020-10-31T22:40:15.731 INFO:teuthology.orchestra.run.smithi060.stdout: debug asserts on shutdown = true 2020-10-31T22:40:15.731 INFO:teuthology.orchestra.run.smithi060.stdout: mon host = "172.21.15.60,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2020-10-31T22:40:15.731 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = 226f905a-1517-4a8c-8009-08779515965c 2020-10-31T22:40:15.731 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.731 INFO:teuthology.orchestra.run.smithi060.stdout:[osd] 2020-10-31T22:40:15.731 INFO:teuthology.orchestra.run.smithi060.stdout: osd journal size = 100 2020-10-31T22:40:15.732 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.732 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub load threshold = 5.0 2020-10-31T22:40:15.732 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub max interval = 600 2020-10-31T22:40:15.732 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.732 INFO:teuthology.orchestra.run.smithi060.stdout: osd recover clone overlap = true 2020-10-31T22:40:15.732 INFO:teuthology.orchestra.run.smithi060.stdout: osd recovery max chunk = 1048576 2020-10-31T22:40:15.732 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.733 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug shutdown = true 2020-10-31T22:40:15.733 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug op order = true 2020-10-31T22:40:15.733 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug verify stray on activate = true 2020-10-31T22:40:15.733 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.733 INFO:teuthology.orchestra.run.smithi060.stdout: osd open classes on start = true 2020-10-31T22:40:15.733 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug pg log writeout = true 2020-10-31T22:40:15.733 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.733 INFO:teuthology.orchestra.run.smithi060.stdout: osd deep scrub update digest min age = 30 2020-10-31T22:40:15.734 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.734 INFO:teuthology.orchestra.run.smithi060.stdout: osd map max advance = 10 2020-10-31T22:40:15.734 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.734 INFO:teuthology.orchestra.run.smithi060.stdout: journal zero on create = true 2020-10-31T22:40:15.734 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.734 INFO:teuthology.orchestra.run.smithi060.stdout: filestore ondisk finisher threads = 3 2020-10-31T22:40:15.734 INFO:teuthology.orchestra.run.smithi060.stdout: filestore apply finisher threads = 3 2020-10-31T22:40:15.735 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.735 INFO:teuthology.orchestra.run.smithi060.stdout: bdev debug aio = true 2020-10-31T22:40:15.735 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug misdirected ops = true 2020-10-31T22:40:15.735 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore block size = 96636764160 2020-10-31T22:40:15.735 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore compression mode = aggressive 2020-10-31T22:40:15.735 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore fsck on mount = True 2020-10-31T22:40:15.735 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluefs = 20 2020-10-31T22:40:15.736 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluestore = 20 2020-10-31T22:40:15.736 INFO:teuthology.orchestra.run.smithi060.stdout: debug filestore = 20 2020-10-31T22:40:15.736 INFO:teuthology.orchestra.run.smithi060.stdout: debug journal = 20 2020-10-31T22:40:15.736 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 20 2020-10-31T22:40:15.736 INFO:teuthology.orchestra.run.smithi060.stdout: debug osd = 25 2020-10-31T22:40:15.736 INFO:teuthology.orchestra.run.smithi060.stdout: debug rocksdb = 10 2020-10-31T22:40:15.736 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd backfillfull_ratio = 0.85 2020-10-31T22:40:15.736 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd full ratio = 0.9 2020-10-31T22:40:15.737 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd nearfull ratio = 0.8 2020-10-31T22:40:15.737 INFO:teuthology.orchestra.run.smithi060.stdout: osd failsafe full ratio = 0.95 2020-10-31T22:40:15.737 INFO:teuthology.orchestra.run.smithi060.stdout: osd objectstore = bluestore 2020-10-31T22:40:15.737 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2020-10-31T22:40:15.737 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.737 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr] 2020-10-31T22:40:15.737 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2020-10-31T22:40:15.738 INFO:teuthology.orchestra.run.smithi060.stdout: debug mgr = 20 2020-10-31T22:40:15.738 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2020-10-31T22:40:15.738 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2020-10-31T22:40:15.738 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:40:15.738 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:40:15.738 INFO:teuthology.orchestra.run.smithi060.stdout: mgr/telemetry/nag = false 2020-10-31T22:40:15.738 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.738 INFO:teuthology.orchestra.run.smithi060.stdout:[mon] 2020-10-31T22:40:15.739 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2020-10-31T22:40:15.739 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2020-10-31T22:40:15.739 INFO:teuthology.orchestra.run.smithi060.stdout: debug paxos = 20 2020-10-31T22:40:15.739 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2020-10-31T22:40:15.739 INFO:teuthology.orchestra.run.smithi060.stdout: mon data avail warn = 5 2020-10-31T22:40:15.739 INFO:teuthology.orchestra.run.smithi060.stdout: mon mgr mkfs grace = 240 2020-10-31T22:40:15.739 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:40:15.740 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd reporter subtree level = osd 2020-10-31T22:40:15.740 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd prime pg temp = true 2020-10-31T22:40:15.740 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:40:15.740 INFO:teuthology.orchestra.run.smithi060.stdout: mon op complaint time = 120 2020-10-31T22:40:15.740 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:40:15.740 INFO:teuthology.orchestra.run.smithi060.stdout:[client] 2020-10-31T22:40:15.740 INFO:teuthology.orchestra.run.smithi060.stdout: rgw cache enabled = true 2020-10-31T22:40:15.740 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable ops log = true 2020-10-31T22:40:15.741 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable usage log = true 2020-10-31T22:40:15.741 INFO:teuthology.orchestra.run.smithi060.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-31T22:40:15.741 INFO:teuthology.orchestra.run.smithi060.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-31T22:40:15.741 INFO:teuthology.orchestra.run.smithi060.stdout: client mount timeout = 600 2020-10-31T22:40:15.741 INFO:teuthology.orchestra.run.smithi060.stdout: debug client = 20 2020-10-31T22:40:15.741 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2020-10-31T22:40:15.741 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.a] 2020-10-31T22:40:15.742 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.b] 2020-10-31T22:40:15.742 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.c] 2020-10-31T22:40:15.742 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2020-10-31T22:40:15.742 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2020-10-31T22:40:15.742 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2020-10-31T22:40:15.742 INFO:teuthology.orchestra.run.smithi060.stdout:[mds] 2020-10-31T22:40:15.742 INFO:teuthology.orchestra.run.smithi060.stdout: debug mds = 20 2020-10-31T22:40:15.743 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2020-10-31T22:40:15.743 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal frag = True 2020-10-31T22:40:15.743 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal fragment size max = 10000 2020-10-31T22:40:15.743 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal merge size = 5 2020-10-31T22:40:15.743 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal split bits = 3 2020-10-31T22:40:15.743 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal split size = 100 2020-10-31T22:40:15.743 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug frag = True 2020-10-31T22:40:15.744 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug scatterstat = True 2020-10-31T22:40:15.744 INFO:teuthology.orchestra.run.smithi060.stdout: mds op complaint time = 180 2020-10-31T22:40:15.744 INFO:teuthology.orchestra.run.smithi060.stdout: mds verify scatter = True 2020-10-31T22:40:15.744 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2020-10-31T22:40:15.745 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2020-10-31T22:40:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2020-10-31T22:40:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-31T22:40:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2020-10-31T22:40:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.746 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2020-10-31T22:40:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2020-10-31T22:40:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2020-10-31T22:40:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2020-10-31T22:40:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.747 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2020-10-31T22:40:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2020-10-31T22:40:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-31T22:40:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2020-10-31T22:40:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2020-10-31T22:40:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-31T22:40:15.748 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2020-10-31T22:40:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2020-10-31T22:40:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2020-10-31T22:40:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2020-10-31T22:40:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2020-10-31T22:40:15.749 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2020-10-31T22:40:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2020-10-31T22:40:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2020-10-31T22:40:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-31T22:40:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-31T22:40:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-31T22:40:15.750 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2020-10-31T22:40:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2020-10-31T22:40:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2020-10-31T22:40:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2020-10-31T22:40:15.751 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "172.21.15.60,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2020-10-31T22:40:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = 226f905a-1517-4a8c-8009-08779515965c 2020-10-31T22:40:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.752 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2020-10-31T22:40:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2020-10-31T22:40:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2020-10-31T22:40:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2020-10-31T22:40:15.752 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2020-10-31T22:40:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2020-10-31T22:40:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2020-10-31T22:40:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2020-10-31T22:40:15.753 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2020-10-31T22:40:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2020-10-31T22:40:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2020-10-31T22:40:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2020-10-31T22:40:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.754 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2020-10-31T22:40:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2020-10-31T22:40:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2020-10-31T22:40:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2020-10-31T22:40:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2020-10-31T22:40:15.755 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2020-10-31T22:40:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2020-10-31T22:40:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore compression mode = aggressive 2020-10-31T22:40:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2020-10-31T22:40:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 20 2020-10-31T22:40:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 20 2020-10-31T22:40:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: debug filestore = 20 2020-10-31T22:40:15.756 INFO:teuthology.orchestra.run.smithi152.stdout: debug journal = 20 2020-10-31T22:40:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 20 2020-10-31T22:40:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 25 2020-10-31T22:40:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 10 2020-10-31T22:40:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2020-10-31T22:40:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2020-10-31T22:40:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2020-10-31T22:40:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2020-10-31T22:40:15.757 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2020-10-31T22:40:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2020-10-31T22:40:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.758 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2020-10-31T22:40:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2020-10-31T22:40:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2020-10-31T22:40:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2020-10-31T22:40:15.758 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2020-10-31T22:40:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:40:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:40:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2020-10-31T22:40:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.759 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2020-10-31T22:40:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2020-10-31T22:40:15.759 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2020-10-31T22:40:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2020-10-31T22:40:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2020-10-31T22:40:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2020-10-31T22:40:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2020-10-31T22:40:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:40:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2020-10-31T22:40:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2020-10-31T22:40:15.760 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:40:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: mon op complaint time = 120 2020-10-31T22:40:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:40:15.761 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2020-10-31T22:40:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2020-10-31T22:40:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2020-10-31T22:40:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2020-10-31T22:40:15.761 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-31T22:40:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-31T22:40:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: client mount timeout = 600 2020-10-31T22:40:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: debug client = 20 2020-10-31T22:40:15.762 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2020-10-31T22:40:15.762 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2020-10-31T22:40:15.762 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2020-10-31T22:40:15.762 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2020-10-31T22:40:15.762 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2020-10-31T22:40:15.763 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2020-10-31T22:40:15.763 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2020-10-31T22:40:15.763 INFO:teuthology.orchestra.run.smithi152.stdout:[mds] 2020-10-31T22:40:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds = 20 2020-10-31T22:40:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2020-10-31T22:40:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal frag = True 2020-10-31T22:40:15.763 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal fragment size max = 10000 2020-10-31T22:40:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal merge size = 5 2020-10-31T22:40:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal split bits = 3 2020-10-31T22:40:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal split size = 100 2020-10-31T22:40:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug frag = True 2020-10-31T22:40:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug scatterstat = True 2020-10-31T22:40:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: mds op complaint time = 180 2020-10-31T22:40:15.764 INFO:teuthology.orchestra.run.smithi152.stdout: mds verify scatter = True 2020-10-31T22:40:15.765 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2020-10-31T22:40:15.765 INFO:teuthology.orchestra.run.smithi085.stdout:[global] 2020-10-31T22:40:15.765 INFO:teuthology.orchestra.run.smithi085.stdout: chdir = "" 2020-10-31T22:40:15.765 INFO:teuthology.orchestra.run.smithi085.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-31T22:40:15.765 INFO:teuthology.orchestra.run.smithi085.stdout: auth supported = cephx 2020-10-31T22:40:15.765 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.765 INFO:teuthology.orchestra.run.smithi085.stdout: filestore xattr use omap = true 2020-10-31T22:40:15.766 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.766 INFO:teuthology.orchestra.run.smithi085.stdout: mon clock drift allowed = 1.000 2020-10-31T22:40:15.766 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.766 INFO:teuthology.orchestra.run.smithi085.stdout: osd crush chooseleaf type = 0 2020-10-31T22:40:15.766 INFO:teuthology.orchestra.run.smithi085.stdout: auth debug = true 2020-10-31T22:40:15.766 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.766 INFO:teuthology.orchestra.run.smithi085.stdout: ms die on old message = true 2020-10-31T22:40:15.767 INFO:teuthology.orchestra.run.smithi085.stdout: ms die on bug = true 2020-10-31T22:40:15.767 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.767 INFO:teuthology.orchestra.run.smithi085.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-31T22:40:15.767 INFO:teuthology.orchestra.run.smithi085.stdout: mon pg warn max object skew = 0 2020-10-31T22:40:15.767 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.767 INFO:teuthology.orchestra.run.smithi085.stdout: # disable pg_autoscaler by default for new pools 2020-10-31T22:40:15.767 INFO:teuthology.orchestra.run.smithi085.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-31T22:40:15.767 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.768 INFO:teuthology.orchestra.run.smithi085.stdout: osd pool default size = 2 2020-10-31T22:40:15.768 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.768 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd allow primary affinity = true 2020-10-31T22:40:15.768 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd allow pg remap = true 2020-10-31T22:40:15.768 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on legacy crush tunables = false 2020-10-31T22:40:15.768 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on crush straw calc version zero = false 2020-10-31T22:40:15.768 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on no sortbitwise = false 2020-10-31T22:40:15.769 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on osd down out interval zero = false 2020-10-31T22:40:15.769 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on too few osds = false 2020-10-31T22:40:15.769 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-31T22:40:15.769 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-31T22:40:15.769 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.769 INFO:teuthology.orchestra.run.smithi085.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-31T22:40:15.769 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.769 INFO:teuthology.orchestra.run.smithi085.stdout: osd default data pool replay window = 5 2020-10-31T22:40:15.770 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.770 INFO:teuthology.orchestra.run.smithi085.stdout: mon allow pool delete = true 2020-10-31T22:40:15.770 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.770 INFO:teuthology.orchestra.run.smithi085.stdout: mon cluster log file level = debug 2020-10-31T22:40:15.770 INFO:teuthology.orchestra.run.smithi085.stdout: debug asserts on shutdown = true 2020-10-31T22:40:15.770 INFO:teuthology.orchestra.run.smithi085.stdout: mon host = "172.21.15.60,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2020-10-31T22:40:15.770 INFO:teuthology.orchestra.run.smithi085.stdout: fsid = 226f905a-1517-4a8c-8009-08779515965c 2020-10-31T22:40:15.771 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.771 INFO:teuthology.orchestra.run.smithi085.stdout:[osd] 2020-10-31T22:40:15.771 INFO:teuthology.orchestra.run.smithi085.stdout: osd journal size = 100 2020-10-31T22:40:15.771 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.771 INFO:teuthology.orchestra.run.smithi085.stdout: osd scrub load threshold = 5.0 2020-10-31T22:40:15.771 INFO:teuthology.orchestra.run.smithi085.stdout: osd scrub max interval = 600 2020-10-31T22:40:15.771 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.772 INFO:teuthology.orchestra.run.smithi085.stdout: osd recover clone overlap = true 2020-10-31T22:40:15.772 INFO:teuthology.orchestra.run.smithi085.stdout: osd recovery max chunk = 1048576 2020-10-31T22:40:15.772 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.772 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug shutdown = true 2020-10-31T22:40:15.772 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug op order = true 2020-10-31T22:40:15.772 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug verify stray on activate = true 2020-10-31T22:40:15.772 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.772 INFO:teuthology.orchestra.run.smithi085.stdout: osd open classes on start = true 2020-10-31T22:40:15.773 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug pg log writeout = true 2020-10-31T22:40:15.773 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.773 INFO:teuthology.orchestra.run.smithi085.stdout: osd deep scrub update digest min age = 30 2020-10-31T22:40:15.773 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.773 INFO:teuthology.orchestra.run.smithi085.stdout: osd map max advance = 10 2020-10-31T22:40:15.773 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.773 INFO:teuthology.orchestra.run.smithi085.stdout: journal zero on create = true 2020-10-31T22:40:15.774 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.774 INFO:teuthology.orchestra.run.smithi085.stdout: filestore ondisk finisher threads = 3 2020-10-31T22:40:15.774 INFO:teuthology.orchestra.run.smithi085.stdout: filestore apply finisher threads = 3 2020-10-31T22:40:15.774 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.774 INFO:teuthology.orchestra.run.smithi085.stdout: bdev debug aio = true 2020-10-31T22:40:15.774 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug misdirected ops = true 2020-10-31T22:40:15.774 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore block size = 96636764160 2020-10-31T22:40:15.774 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore compression mode = aggressive 2020-10-31T22:40:15.775 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore fsck on mount = True 2020-10-31T22:40:15.775 INFO:teuthology.orchestra.run.smithi085.stdout: debug bluefs = 20 2020-10-31T22:40:15.775 INFO:teuthology.orchestra.run.smithi085.stdout: debug bluestore = 20 2020-10-31T22:40:15.775 INFO:teuthology.orchestra.run.smithi085.stdout: debug filestore = 20 2020-10-31T22:40:15.775 INFO:teuthology.orchestra.run.smithi085.stdout: debug journal = 20 2020-10-31T22:40:15.775 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 20 2020-10-31T22:40:15.775 INFO:teuthology.orchestra.run.smithi085.stdout: debug osd = 25 2020-10-31T22:40:15.776 INFO:teuthology.orchestra.run.smithi085.stdout: debug rocksdb = 10 2020-10-31T22:40:15.776 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd backfillfull_ratio = 0.85 2020-10-31T22:40:15.776 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd full ratio = 0.9 2020-10-31T22:40:15.776 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd nearfull ratio = 0.8 2020-10-31T22:40:15.776 INFO:teuthology.orchestra.run.smithi085.stdout: osd failsafe full ratio = 0.95 2020-10-31T22:40:15.776 INFO:teuthology.orchestra.run.smithi085.stdout: osd objectstore = bluestore 2020-10-31T22:40:15.776 INFO:teuthology.orchestra.run.smithi085.stdout: osd op complaint time = 180 2020-10-31T22:40:15.776 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.777 INFO:teuthology.orchestra.run.smithi085.stdout:[mgr] 2020-10-31T22:40:15.777 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2020-10-31T22:40:15.777 INFO:teuthology.orchestra.run.smithi085.stdout: debug mgr = 20 2020-10-31T22:40:15.777 INFO:teuthology.orchestra.run.smithi085.stdout: debug mon = 20 2020-10-31T22:40:15.777 INFO:teuthology.orchestra.run.smithi085.stdout: debug auth = 20 2020-10-31T22:40:15.777 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:40:15.777 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:40:15.778 INFO:teuthology.orchestra.run.smithi085.stdout: mgr/telemetry/nag = false 2020-10-31T22:40:15.778 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.778 INFO:teuthology.orchestra.run.smithi085.stdout:[mon] 2020-10-31T22:40:15.778 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2020-10-31T22:40:15.778 INFO:teuthology.orchestra.run.smithi085.stdout: debug mon = 20 2020-10-31T22:40:15.778 INFO:teuthology.orchestra.run.smithi085.stdout: debug paxos = 20 2020-10-31T22:40:15.778 INFO:teuthology.orchestra.run.smithi085.stdout: debug auth = 20 2020-10-31T22:40:15.778 INFO:teuthology.orchestra.run.smithi085.stdout: mon data avail warn = 5 2020-10-31T22:40:15.779 INFO:teuthology.orchestra.run.smithi085.stdout: mon mgr mkfs grace = 240 2020-10-31T22:40:15.779 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:40:15.779 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd reporter subtree level = osd 2020-10-31T22:40:15.780 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd prime pg temp = true 2020-10-31T22:40:15.780 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:40:15.780 INFO:teuthology.orchestra.run.smithi085.stdout: mon op complaint time = 120 2020-10-31T22:40:15.780 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:40:15.780 INFO:teuthology.orchestra.run.smithi085.stdout:[client] 2020-10-31T22:40:15.780 INFO:teuthology.orchestra.run.smithi085.stdout: rgw cache enabled = true 2020-10-31T22:40:15.781 INFO:teuthology.orchestra.run.smithi085.stdout: rgw enable ops log = true 2020-10-31T22:40:15.781 INFO:teuthology.orchestra.run.smithi085.stdout: rgw enable usage log = true 2020-10-31T22:40:15.781 INFO:teuthology.orchestra.run.smithi085.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-31T22:40:15.781 INFO:teuthology.orchestra.run.smithi085.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-31T22:40:15.781 INFO:teuthology.orchestra.run.smithi085.stdout: client mount timeout = 600 2020-10-31T22:40:15.781 INFO:teuthology.orchestra.run.smithi085.stdout: debug client = 20 2020-10-31T22:40:15.781 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2020-10-31T22:40:15.781 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.a] 2020-10-31T22:40:15.782 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.b] 2020-10-31T22:40:15.782 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.c] 2020-10-31T22:40:15.782 INFO:teuthology.orchestra.run.smithi085.stdout:[mds.a] 2020-10-31T22:40:15.782 INFO:teuthology.orchestra.run.smithi085.stdout:[mds.c] 2020-10-31T22:40:15.782 INFO:teuthology.orchestra.run.smithi085.stdout:[mds.b] 2020-10-31T22:40:15.782 INFO:teuthology.orchestra.run.smithi085.stdout:[mds] 2020-10-31T22:40:15.782 INFO:teuthology.orchestra.run.smithi085.stdout: debug mds = 20 2020-10-31T22:40:15.783 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2020-10-31T22:40:15.783 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal frag = True 2020-10-31T22:40:15.783 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal fragment size max = 10000 2020-10-31T22:40:15.783 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal merge size = 5 2020-10-31T22:40:15.783 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal split bits = 3 2020-10-31T22:40:15.783 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal split size = 100 2020-10-31T22:40:15.783 INFO:teuthology.orchestra.run.smithi085.stdout: mds debug frag = True 2020-10-31T22:40:15.783 INFO:teuthology.orchestra.run.smithi085.stdout: mds debug scatterstat = True 2020-10-31T22:40:15.784 INFO:teuthology.orchestra.run.smithi085.stdout: mds op complaint time = 180 2020-10-31T22:40:15.784 INFO:teuthology.orchestra.run.smithi085.stdout: mds verify scatter = True 2020-10-31T22:40:15.784 INFO:teuthology.orchestra.run.smithi085.stdout: osd op complaint time = 180 2020-10-31T22:40:15.784 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2020-10-31T22:40:15.784 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2020-10-31T22:40:15.784 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-31T22:40:15.785 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2020-10-31T22:40:15.785 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.785 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2020-10-31T22:40:15.785 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.785 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2020-10-31T22:40:15.785 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.785 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2020-10-31T22:40:15.786 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2020-10-31T22:40:15.786 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.786 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2020-10-31T22:40:15.786 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2020-10-31T22:40:15.786 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.786 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-31T22:40:15.786 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2020-10-31T22:40:15.787 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.787 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2020-10-31T22:40:15.787 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-31T22:40:15.787 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.787 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2020-10-31T22:40:15.787 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.787 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2020-10-31T22:40:15.787 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2020-10-31T22:40:15.788 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2020-10-31T22:40:15.788 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2020-10-31T22:40:15.788 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2020-10-31T22:40:15.788 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2020-10-31T22:40:15.788 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2020-10-31T22:40:15.788 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-31T22:40:15.788 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-31T22:40:15.789 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.789 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-31T22:40:15.789 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.789 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2020-10-31T22:40:15.789 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.789 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2020-10-31T22:40:15.789 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.789 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2020-10-31T22:40:15.790 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2020-10-31T22:40:15.790 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.60,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2020-10-31T22:40:15.790 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 226f905a-1517-4a8c-8009-08779515965c 2020-10-31T22:40:15.790 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.790 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2020-10-31T22:40:15.790 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2020-10-31T22:40:15.790 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.791 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2020-10-31T22:40:15.791 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2020-10-31T22:40:15.791 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.791 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2020-10-31T22:40:15.791 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2020-10-31T22:40:15.791 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.791 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2020-10-31T22:40:15.792 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2020-10-31T22:40:15.792 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2020-10-31T22:40:15.792 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.792 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2020-10-31T22:40:15.792 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2020-10-31T22:40:15.792 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.792 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2020-10-31T22:40:15.792 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.793 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2020-10-31T22:40:15.793 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.793 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2020-10-31T22:40:15.793 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.793 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2020-10-31T22:40:15.793 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2020-10-31T22:40:15.793 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.794 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2020-10-31T22:40:15.794 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2020-10-31T22:40:15.794 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2020-10-31T22:40:15.794 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore compression mode = aggressive 2020-10-31T22:40:15.794 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2020-10-31T22:40:15.794 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 20 2020-10-31T22:40:15.794 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 20 2020-10-31T22:40:15.794 INFO:teuthology.orchestra.run.smithi066.stdout: debug filestore = 20 2020-10-31T22:40:15.795 INFO:teuthology.orchestra.run.smithi066.stdout: debug journal = 20 2020-10-31T22:40:15.795 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 20 2020-10-31T22:40:15.795 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 25 2020-10-31T22:40:15.795 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 10 2020-10-31T22:40:15.795 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2020-10-31T22:40:15.795 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2020-10-31T22:40:15.795 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2020-10-31T22:40:15.796 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2020-10-31T22:40:15.796 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2020-10-31T22:40:15.796 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2020-10-31T22:40:15.796 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.796 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2020-10-31T22:40:15.796 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-10-31T22:40:15.796 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2020-10-31T22:40:15.796 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2020-10-31T22:40:15.797 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2020-10-31T22:40:15.797 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:40:15.797 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:40:15.797 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2020-10-31T22:40:15.797 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.797 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2020-10-31T22:40:15.797 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-10-31T22:40:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2020-10-31T22:40:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2020-10-31T22:40:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2020-10-31T22:40:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2020-10-31T22:40:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2020-10-31T22:40:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:40:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2020-10-31T22:40:15.798 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2020-10-31T22:40:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:40:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: mon op complaint time = 120 2020-10-31T22:40:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:40:15.799 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2020-10-31T22:40:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2020-10-31T22:40:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2020-10-31T22:40:15.799 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2020-10-31T22:40:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-31T22:40:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-31T22:40:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: client mount timeout = 600 2020-10-31T22:40:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2020-10-31T22:40:15.800 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-10-31T22:40:15.800 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2020-10-31T22:40:15.800 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2020-10-31T22:40:15.801 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2020-10-31T22:40:15.801 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2020-10-31T22:40:15.801 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2020-10-31T22:40:15.801 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2020-10-31T22:40:15.801 INFO:teuthology.orchestra.run.smithi066.stdout:[mds] 2020-10-31T22:40:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds = 20 2020-10-31T22:40:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-10-31T22:40:15.801 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal frag = True 2020-10-31T22:40:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal fragment size max = 10000 2020-10-31T22:40:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal merge size = 5 2020-10-31T22:40:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal split bits = 3 2020-10-31T22:40:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal split size = 100 2020-10-31T22:40:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug frag = True 2020-10-31T22:40:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug scatterstat = True 2020-10-31T22:40:15.802 INFO:teuthology.orchestra.run.smithi066.stdout: mds op complaint time = 180 2020-10-31T22:40:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: mds verify scatter = True 2020-10-31T22:40:15.803 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2020-10-31T22:40:15.804 INFO:tasks.ceph:Creating admin key on mon.a... 2020-10-31T22:40:15.805 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-10-31T22:40:15.854 INFO:tasks.ceph:Copying monmap to all nodes... 2020-10-31T22:40:15.866 DEBUG:teuthology.orchestra.remote:smithi060:/etc/ceph/ceph.keyring is 206B 2020-10-31T22:40:15.892 DEBUG:teuthology.orchestra.remote:smithi060:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-10-31T22:40:15.907 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi060.front.sepia.ceph.com 2020-10-31T22:40:15.907 INFO:teuthology.orchestra.run.smithi060:> set -ex 2020-10-31T22:40:15.908 INFO:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.keyring 2020-10-31T22:40:15.908 INFO:teuthology.orchestra.run.smithi060:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-10-31T22:40:15.915 INFO:teuthology.orchestra.run.smithi060.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-10-31T22:40:15.924 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records in 2020-10-31T22:40:15.924 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records out 2020-10-31T22:40:15.924 INFO:teuthology.orchestra.run.smithi060.stderr:206 bytes copied, 0.000127837 s, 1.6 MB/s 2020-10-31T22:40:15.925 INFO:teuthology.orchestra.run.smithi060.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-10-31T22:40:15.935 INFO:teuthology.orchestra.run.smithi060:> set -ex 2020-10-31T22:40:15.936 INFO:teuthology.orchestra.run.smithi060:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:15.981 INFO:teuthology.orchestra.run.smithi060.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:15.983 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records in 2020-10-31T22:40:15.983 INFO:teuthology.orchestra.run.smithi060.stderr:0+1 records out 2020-10-31T22:40:15.983 INFO:teuthology.orchestra.run.smithi060.stderr:379 bytes copied, 0.000128603 s, 2.9 MB/s 2020-10-31T22:40:15.984 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi066.front.sepia.ceph.com 2020-10-31T22:40:15.984 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-10-31T22:40:15.984 INFO:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.keyring 2020-10-31T22:40:15.985 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-10-31T22:40:15.991 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-10-31T22:40:16.001 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-10-31T22:40:16.001 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-10-31T22:40:16.002 INFO:teuthology.orchestra.run.smithi066.stderr:206 bytes copied, 7.2753e-05 s, 2.8 MB/s 2020-10-31T22:40:16.002 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-10-31T22:40:16.011 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-10-31T22:40:16.011 INFO:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:16.064 INFO:teuthology.orchestra.run.smithi066.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:16.065 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-10-31T22:40:16.065 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-10-31T22:40:16.065 INFO:teuthology.orchestra.run.smithi066.stderr:379 bytes copied, 7.8303e-05 s, 4.8 MB/s 2020-10-31T22:40:16.065 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi152.front.sepia.ceph.com 2020-10-31T22:40:16.066 INFO:teuthology.orchestra.run.smithi152:> set -ex 2020-10-31T22:40:16.066 INFO:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.keyring 2020-10-31T22:40:16.066 INFO:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-10-31T22:40:16.072 INFO:teuthology.orchestra.run.smithi152.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-10-31T22:40:16.080 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2020-10-31T22:40:16.081 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2020-10-31T22:40:16.081 INFO:teuthology.orchestra.run.smithi152.stderr:206 bytes copied, 7.761e-05 s, 2.7 MB/s 2020-10-31T22:40:16.082 INFO:teuthology.orchestra.run.smithi152.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-10-31T22:40:16.092 INFO:teuthology.orchestra.run.smithi152:> set -ex 2020-10-31T22:40:16.092 INFO:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:16.144 INFO:teuthology.orchestra.run.smithi152.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:16.145 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2020-10-31T22:40:16.146 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2020-10-31T22:40:16.146 INFO:teuthology.orchestra.run.smithi152.stderr:379 bytes copied, 6.696e-05 s, 5.7 MB/s 2020-10-31T22:40:16.146 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi085.front.sepia.ceph.com 2020-10-31T22:40:16.147 INFO:teuthology.orchestra.run.smithi085:> set -ex 2020-10-31T22:40:16.147 INFO:teuthology.orchestra.run.smithi085:> sudo dd of=/etc/ceph/ceph.keyring 2020-10-31T22:40:16.147 INFO:teuthology.orchestra.run.smithi085:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-10-31T22:40:16.152 INFO:teuthology.orchestra.run.smithi085.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-10-31T22:40:16.161 INFO:teuthology.orchestra.run.smithi085.stderr:0+1 records in 2020-10-31T22:40:16.162 INFO:teuthology.orchestra.run.smithi085.stderr:0+1 records out 2020-10-31T22:40:16.162 INFO:teuthology.orchestra.run.smithi085.stderr:206 bytes copied, 6.9006e-05 s, 3.0 MB/s 2020-10-31T22:40:16.163 INFO:teuthology.orchestra.run.smithi085.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-10-31T22:40:16.173 INFO:teuthology.orchestra.run.smithi085:> set -ex 2020-10-31T22:40:16.173 INFO:teuthology.orchestra.run.smithi085:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:16.221 INFO:teuthology.orchestra.run.smithi085.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:16.224 INFO:teuthology.orchestra.run.smithi085.stderr:0+1 records in 2020-10-31T22:40:16.225 INFO:teuthology.orchestra.run.smithi085.stderr:0+1 records out 2020-10-31T22:40:16.225 INFO:teuthology.orchestra.run.smithi085.stderr:379 bytes copied, 6.5629e-05 s, 5.8 MB/s 2020-10-31T22:40:16.225 INFO:tasks.ceph:Setting up mon nodes... 2020-10-31T22:40:16.225 INFO:tasks.ceph:Setting up mgr nodes... 2020-10-31T22:40:16.226 INFO:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-10-31T22:40:16.273 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-10-31T22:40:16.275 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-10-31T22:40:16.317 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-10-31T22:40:16.320 INFO:tasks.ceph:Setting up mds nodes... 2020-10-31T22:40:16.320 INFO:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-10-31T22:40:16.363 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-10-31T22:40:16.367 INFO:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-10-31T22:40:16.424 INFO:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2020-10-31T22:40:16.506 INFO:teuthology.orchestra.run.smithi060.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2020-10-31T22:40:16.508 INFO:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2020-10-31T22:40:16.569 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-10-31T22:40:16.615 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-10-31T22:40:16.618 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-10-31T22:40:16.633 INFO:tasks.ceph_client:Setting up client nodes... 2020-10-31T22:40:16.634 INFO:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-10-31T22:40:16.669 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-10-31T22:40:16.681 INFO:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2020-10-31T22:40:16.713 INFO:teuthology.orchestra.run.smithi085.stdout:creating /etc/ceph/ceph.client.1.keyring 2020-10-31T22:40:16.725 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-10-31T22:40:16.725 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi060.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2020-10-31T22:40:16.726 INFO:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-10-31T22:40:16.742 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-10-31T22:40:16.742 INFO:tasks.ceph:role: osd.0 2020-10-31T22:40:16.742 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com 2020-10-31T22:40:16.743 INFO:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-10-31T22:40:16.824 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-10-31T22:40:16.825 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2020-10-31T22:40:16.825 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-10-31T22:40:16.825 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-10-31T22:40:16.826 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2020-10-31T22:40:16.826 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-10-31T22:40:16.826 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-10-31T22:40:16.826 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-10-31T22:40:16.826 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-10-31T22:40:16.827 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2020-10-31T22:40:16.828 INFO:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-10-31T22:40:16.889 INFO:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-10-31T22:40:16.944 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: /sbin/restorecon: command not found 2020-10-31T22:40:16.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:40:16.946 INFO:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-10-31T22:40:17.003 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-10-31T22:40:17.004 INFO:tasks.ceph:role: osd.1 2020-10-31T22:40:17.004 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com 2020-10-31T22:40:17.005 INFO:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-10-31T22:40:17.086 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-10-31T22:40:17.086 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2020-10-31T22:40:17.087 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-10-31T22:40:17.087 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-10-31T22:40:17.087 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2020-10-31T22:40:17.087 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-10-31T22:40:17.087 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-10-31T22:40:17.087 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-10-31T22:40:17.087 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-10-31T22:40:17.089 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2020-10-31T22:40:17.089 INFO:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2020-10-31T22:40:17.154 INFO:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-10-31T22:40:17.208 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: /sbin/restorecon: command not found 2020-10-31T22:40:17.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:40:17.209 INFO:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-10-31T22:40:17.268 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-10-31T22:40:17.268 INFO:tasks.ceph:role: osd.2 2020-10-31T22:40:17.268 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com 2020-10-31T22:40:17.269 INFO:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-10-31T22:40:17.350 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-10-31T22:40:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2020-10-31T22:40:17.350 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-10-31T22:40:17.351 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-10-31T22:40:17.351 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2020-10-31T22:40:17.351 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-10-31T22:40:17.351 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-10-31T22:40:17.351 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-10-31T22:40:17.351 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-10-31T22:40:17.352 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2020-10-31T22:40:17.353 INFO:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2020-10-31T22:40:17.411 INFO:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-10-31T22:40:17.466 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: /sbin/restorecon: command not found 2020-10-31T22:40:17.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:40:17.468 INFO:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-10-31T22:40:17.524 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2020-10-31T22:40:17.524 INFO:tasks.ceph:role: osd.3 2020-10-31T22:40:17.524 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com 2020-10-31T22:40:17.525 INFO:teuthology.orchestra.run.smithi060:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-10-31T22:40:17.605 INFO:teuthology.orchestra.run.smithi060.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-10-31T22:40:17.606 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 attr=2, projid32bit=1 2020-10-31T22:40:17.606 INFO:teuthology.orchestra.run.smithi060.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-10-31T22:40:17.607 INFO:teuthology.orchestra.run.smithi060.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-10-31T22:40:17.607 INFO:teuthology.orchestra.run.smithi060.stdout: = sunit=0 swidth=0 blks 2020-10-31T22:40:17.607 INFO:teuthology.orchestra.run.smithi060.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-10-31T22:40:17.607 INFO:teuthology.orchestra.run.smithi060.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-10-31T22:40:17.608 INFO:teuthology.orchestra.run.smithi060.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-10-31T22:40:17.608 INFO:teuthology.orchestra.run.smithi060.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-10-31T22:40:17.609 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi060.front.sepia.ceph.com -o noatime 2020-10-31T22:40:17.610 INFO:teuthology.orchestra.run.smithi060:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2020-10-31T22:40:17.678 INFO:teuthology.orchestra.run.smithi060:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-10-31T22:40:17.732 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: /sbin/restorecon: command not found 2020-10-31T22:40:17.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:40:17.733 INFO:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:17.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:17.818+0000 7f273718cd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-10-31T22:40:17.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:17.818+0000 7f273718cd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-10-31T22:40:17.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:17.822+0000 7f273718cd80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-10-31T22:40:17.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:17.822+0000 7f273718cd80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-10-31T22:40:17.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:17.822+0000 7f273718cd80 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-10-31T22:40:17.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:17.822+0000 7f273718cd80 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-10-31T22:40:17.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:17.834+0000 7f273718cd80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-10-31T22:40:20.256 INFO:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-10-31T22:40:20.313 INFO:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:20.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:20.394+0000 7f5b8fbe8d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-10-31T22:40:20.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:20.394+0000 7f5b8fbe8d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-10-31T22:40:20.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:20.394+0000 7f5b8fbe8d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-10-31T22:40:20.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:20.394+0000 7f5b8fbe8d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-10-31T22:40:20.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:20.394+0000 7f5b8fbe8d80 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-10-31T22:40:20.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:20.394+0000 7f5b8fbe8d80 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-10-31T22:40:20.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:20.406+0000 7f5b8fbe8d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-10-31T22:40:22.838 INFO:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-10-31T22:40:22.896 INFO:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:22.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:22.978+0000 7fe945fb5d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-10-31T22:40:22.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:22.978+0000 7fe945fb5d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-10-31T22:40:22.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:22.978+0000 7fe945fb5d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-10-31T22:40:22.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:22.978+0000 7fe945fb5d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-10-31T22:40:22.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:22.978+0000 7fe945fb5d80 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-10-31T22:40:22.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:22.978+0000 7fe945fb5d80 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-10-31T22:40:22.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:22.994+0000 7fe945fb5d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-10-31T22:40:25.435 INFO:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-10-31T22:40:25.493 INFO:teuthology.orchestra.run.smithi060:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:25.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:25.574+0000 7f2b50858d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-10-31T22:40:25.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:25.574+0000 7f2b50858d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-10-31T22:40:25.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:25.574+0000 7f2b50858d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-10-31T22:40:25.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:25.574+0000 7f2b50858d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-10-31T22:40:25.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:25.574+0000 7f2b50858d80 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-10-31T22:40:25.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:25.574+0000 7f2b50858d80 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-10-31T22:40:25.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:25.586+0000 7f2b50858d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-10-31T22:40:28.011 INFO:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-10-31T22:40:28.069 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-10-31T22:40:28.087 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-10-31T22:40:28.088 INFO:tasks.ceph:role: osd.4 2020-10-31T22:40:28.088 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com 2020-10-31T22:40:28.089 INFO:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-10-31T22:40:28.625 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-10-31T22:40:28.625 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2020-10-31T22:40:28.625 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-10-31T22:40:28.625 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-10-31T22:40:28.626 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2020-10-31T22:40:28.626 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-10-31T22:40:28.626 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-10-31T22:40:28.626 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-10-31T22:40:28.626 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-10-31T22:40:28.628 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2020-10-31T22:40:28.628 INFO:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2020-10-31T22:40:28.711 INFO:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-10-31T22:40:28.722 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: /sbin/restorecon: command not found 2020-10-31T22:40:28.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:40:28.723 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-10-31T22:40:28.781 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-10-31T22:40:28.782 INFO:tasks.ceph:role: osd.5 2020-10-31T22:40:28.782 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com 2020-10-31T22:40:28.782 INFO:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-10-31T22:40:29.312 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-10-31T22:40:29.312 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2020-10-31T22:40:29.312 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-10-31T22:40:29.313 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-10-31T22:40:29.313 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2020-10-31T22:40:29.313 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-10-31T22:40:29.313 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-10-31T22:40:29.313 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-10-31T22:40:29.313 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-10-31T22:40:29.314 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2020-10-31T22:40:29.315 INFO:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-10-31T22:40:29.350 INFO:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-10-31T22:40:29.402 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: /sbin/restorecon: command not found 2020-10-31T22:40:29.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:40:29.403 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-10-31T22:40:29.460 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-10-31T22:40:29.460 INFO:tasks.ceph:role: osd.6 2020-10-31T22:40:29.461 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi066.front.sepia.ceph.com 2020-10-31T22:40:29.461 INFO:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-10-31T22:40:30.014 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-10-31T22:40:30.015 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2020-10-31T22:40:30.015 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-10-31T22:40:30.015 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-10-31T22:40:30.016 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2020-10-31T22:40:30.016 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-10-31T22:40:30.016 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-10-31T22:40:30.016 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-10-31T22:40:30.016 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-10-31T22:40:30.018 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2020-10-31T22:40:30.018 INFO:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-10-31T22:40:30.065 INFO:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-10-31T22:40:30.075 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: /sbin/restorecon: command not found 2020-10-31T22:40:30.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:40:30.076 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-10-31T22:40:30.135 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2020-10-31T22:40:30.136 INFO:tasks.ceph:role: osd.7 2020-10-31T22:40:30.136 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi066.front.sepia.ceph.com 2020-10-31T22:40:30.137 INFO:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-10-31T22:40:30.699 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-10-31T22:40:30.700 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2020-10-31T22:40:30.700 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2020-10-31T22:40:30.701 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-10-31T22:40:30.701 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2020-10-31T22:40:30.701 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2020-10-31T22:40:30.701 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-10-31T22:40:30.702 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-10-31T22:40:30.702 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-10-31T22:40:30.703 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2020-10-31T22:40:30.704 INFO:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2020-10-31T22:40:30.762 INFO:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-10-31T22:40:30.773 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: /sbin/restorecon: command not found 2020-10-31T22:40:30.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:40:30.774 INFO:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:30.866 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:30.864+0000 7f484546fd80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-10-31T22:40:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:30.868+0000 7f484546fd80 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-10-31T22:40:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:30.868+0000 7f484546fd80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-10-31T22:40:30.867 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:30.868+0000 7f484546fd80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-10-31T22:40:30.868 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:30.868+0000 7f484546fd80 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-10-31T22:40:30.874 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:30.872+0000 7f484546fd80 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-10-31T22:40:30.918 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:30.916+0000 7f484546fd80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-10-31T22:40:33.342 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-10-31T22:40:33.359 INFO:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:33.441 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:33.440+0000 7fde8407ad80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-10-31T22:40:33.441 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:33.440+0000 7fde8407ad80 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-10-31T22:40:33.441 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:33.440+0000 7fde8407ad80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-10-31T22:40:33.441 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:33.440+0000 7fde8407ad80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-10-31T22:40:33.442 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:33.440+0000 7fde8407ad80 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-10-31T22:40:33.442 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:33.440+0000 7fde8407ad80 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-10-31T22:40:33.457 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:33.456+0000 7fde8407ad80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-10-31T22:40:35.889 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-10-31T22:40:35.947 INFO:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:36.029 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:36.028+0000 7f536802ad80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-10-31T22:40:36.030 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:36.028+0000 7f536802ad80 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-10-31T22:40:36.030 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:36.028+0000 7f536802ad80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-10-31T22:40:36.030 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:36.028+0000 7f536802ad80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-10-31T22:40:36.030 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:36.028+0000 7f536802ad80 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-10-31T22:40:36.031 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:36.028+0000 7f536802ad80 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-10-31T22:40:36.055 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:36.048+0000 7f536802ad80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-10-31T22:40:38.477 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-10-31T22:40:38.534 INFO:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:38.619 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:38.616+0000 7f9fe0a16d80 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-10-31T22:40:38.620 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:38.620+0000 7f9fe0a16d80 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-10-31T22:40:38.620 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:38.620+0000 7f9fe0a16d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-10-31T22:40:38.620 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:38.620+0000 7f9fe0a16d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-10-31T22:40:38.620 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:38.620+0000 7f9fe0a16d80 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-10-31T22:40:38.621 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:38.620+0000 7f9fe0a16d80 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-10-31T22:40:38.644 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:38.644+0000 7f9fe0a16d80 -1 freelist read_size_meta_from_db missing size meta in DB 2020-10-31T22:40:41.075 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-10-31T22:40:41.134 INFO:tasks.ceph:Reading keys from all nodes... 2020-10-31T22:40:41.134 INFO:teuthology.orchestra.run.smithi060:> mktemp 2020-10-31T22:40:41.140 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.pghKqV7d6T 2020-10-31T22:40:41.141 INFO:teuthology.orchestra.run.smithi060:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.pghKqV7d6T 2020-10-31T22:40:41.201 INFO:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.pghKqV7d6T 2020-10-31T22:40:41.320 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.pghKqV7d6T is 56B 2020-10-31T22:40:41.335 INFO:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.pghKqV7d6T 2020-10-31T22:40:41.343 INFO:teuthology.orchestra.run.smithi060:> mktemp 2020-10-31T22:40:41.391 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.LSw6EhAmug 2020-10-31T22:40:41.392 INFO:teuthology.orchestra.run.smithi060:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.LSw6EhAmug 2020-10-31T22:40:41.449 INFO:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.LSw6EhAmug 2020-10-31T22:40:41.558 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.LSw6EhAmug is 56B 2020-10-31T22:40:41.576 INFO:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.LSw6EhAmug 2020-10-31T22:40:41.583 INFO:teuthology.orchestra.run.smithi060:> mktemp 2020-10-31T22:40:41.631 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.39wVPzbqEt 2020-10-31T22:40:41.631 INFO:teuthology.orchestra.run.smithi060:> sudo cp /var/lib/ceph/mds/ceph-c/keyring /tmp/tmp.39wVPzbqEt 2020-10-31T22:40:41.688 INFO:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.39wVPzbqEt 2020-10-31T22:40:41.797 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.39wVPzbqEt is 56B 2020-10-31T22:40:41.851 INFO:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.39wVPzbqEt 2020-10-31T22:40:41.859 INFO:teuthology.orchestra.run.smithi060:> mktemp 2020-10-31T22:40:41.906 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.0Vk8ajXeWi 2020-10-31T22:40:41.907 INFO:teuthology.orchestra.run.smithi060:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.0Vk8ajXeWi 2020-10-31T22:40:41.965 INFO:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.0Vk8ajXeWi 2020-10-31T22:40:42.071 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.0Vk8ajXeWi is 56B 2020-10-31T22:40:42.081 INFO:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.0Vk8ajXeWi 2020-10-31T22:40:42.088 INFO:teuthology.orchestra.run.smithi060:> mktemp 2020-10-31T22:40:42.136 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.kG4I8P3c57 2020-10-31T22:40:42.136 INFO:teuthology.orchestra.run.smithi060:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.kG4I8P3c57 2020-10-31T22:40:42.195 INFO:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.kG4I8P3c57 2020-10-31T22:40:42.296 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.kG4I8P3c57 is 56B 2020-10-31T22:40:42.307 INFO:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.kG4I8P3c57 2020-10-31T22:40:42.314 INFO:teuthology.orchestra.run.smithi060:> mktemp 2020-10-31T22:40:42.363 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.CujsTsf3mm 2020-10-31T22:40:42.363 INFO:teuthology.orchestra.run.smithi060:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.CujsTsf3mm 2020-10-31T22:40:42.419 INFO:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.CujsTsf3mm 2020-10-31T22:40:42.528 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.CujsTsf3mm is 56B 2020-10-31T22:40:42.549 INFO:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.CujsTsf3mm 2020-10-31T22:40:42.556 INFO:teuthology.orchestra.run.smithi060:> mktemp 2020-10-31T22:40:42.603 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.qOU6PukBBg 2020-10-31T22:40:42.603 INFO:teuthology.orchestra.run.smithi060:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.qOU6PukBBg 2020-10-31T22:40:42.661 INFO:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.qOU6PukBBg 2020-10-31T22:40:42.768 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.qOU6PukBBg is 56B 2020-10-31T22:40:42.779 INFO:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.qOU6PukBBg 2020-10-31T22:40:42.786 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-10-31T22:40:42.793 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.Yccyfsv6Qh 2020-10-31T22:40:42.794 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.Yccyfsv6Qh 2020-10-31T22:40:42.850 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.Yccyfsv6Qh 2020-10-31T22:40:42.954 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.Yccyfsv6Qh is 56B 2020-10-31T22:40:42.964 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.Yccyfsv6Qh 2020-10-31T22:40:42.971 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-10-31T22:40:43.020 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.7xb9p1ZQXW 2020-10-31T22:40:43.021 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.7xb9p1ZQXW 2020-10-31T22:40:43.079 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.7xb9p1ZQXW 2020-10-31T22:40:43.187 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.7xb9p1ZQXW is 56B 2020-10-31T22:40:43.199 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.7xb9p1ZQXW 2020-10-31T22:40:43.205 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-10-31T22:40:43.252 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.btEGevPVjV 2020-10-31T22:40:43.253 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.btEGevPVjV 2020-10-31T22:40:43.309 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.btEGevPVjV 2020-10-31T22:40:43.414 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.btEGevPVjV is 56B 2020-10-31T22:40:43.425 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.btEGevPVjV 2020-10-31T22:40:43.431 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-10-31T22:40:43.480 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.v9lgWmKdY6 2020-10-31T22:40:43.482 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.v9lgWmKdY6 2020-10-31T22:40:43.540 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.v9lgWmKdY6 2020-10-31T22:40:43.647 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.v9lgWmKdY6 is 56B 2020-10-31T22:40:43.660 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.v9lgWmKdY6 2020-10-31T22:40:43.668 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-10-31T22:40:43.716 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.Ed57HavPHY 2020-10-31T22:40:43.717 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.Ed57HavPHY 2020-10-31T22:40:43.773 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.Ed57HavPHY 2020-10-31T22:40:43.878 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.Ed57HavPHY is 56B 2020-10-31T22:40:43.890 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.Ed57HavPHY 2020-10-31T22:40:43.897 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-10-31T22:40:43.944 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.FELy4NgpwR 2020-10-31T22:40:43.944 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.FELy4NgpwR 2020-10-31T22:40:44.002 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.FELy4NgpwR 2020-10-31T22:40:44.112 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.FELy4NgpwR is 56B 2020-10-31T22:40:44.125 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:40:44.129 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:40:44.161 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:40:44.164 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:40:44.257 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.FELy4NgpwR 2020-10-31T22:40:44.274 DEBUG:teuthology.orchestra.remote:smithi152:/etc/ceph/ceph.client.0.keyring is 59B 2020-10-31T22:40:44.298 DEBUG:teuthology.orchestra.remote:smithi085:/etc/ceph/ceph.client.1.keyring is 59B 2020-10-31T22:40:44.349 INFO:tasks.ceph:Adding keys to all mons... 2020-10-31T22:40:44.350 INFO:teuthology.orchestra.run.smithi060:> sudo tee -a /etc/ceph/ceph.keyring 2020-10-31T22:40:44.359 INFO:teuthology.orchestra.run.smithi066:> sudo tee -a /etc/ceph/ceph.keyring 2020-10-31T22:40:44.371 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.y] 2020-10-31T22:40:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDQ551fKiN5EBAAhHtXXE4+yydXWOK7agZ14g== 2020-10-31T22:40:44.371 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2020-10-31T22:40:44.371 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDQ551f7D/cFRAAHQ9NU7VSs14mi5sC/GwHng== 2020-10-31T22:40:44.371 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2020-10-31T22:40:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDQ551fKpdoHhAAhhlaYqOQoI6tTKexjRpbGA== 2020-10-31T22:40:44.372 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.0] 2020-10-31T22:40:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDR551f7MwsMRAACZIQlAKm3BdVbDs2gQAfxg== 2020-10-31T22:40:44.372 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.1] 2020-10-31T22:40:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDU551f07HQFxAAokMFXwsbgKGtJNpnKerdGg== 2020-10-31T22:40:44.372 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.2] 2020-10-31T22:40:44.372 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDW551fODyjOhAAJ+j8KITJidSpltSiJaQZGw== 2020-10-31T22:40:44.373 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.3] 2020-10-31T22:40:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDZ551fs+aCIhAAwpbmgGQjU05W3hZofTtHdg== 2020-10-31T22:40:44.373 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr.x] 2020-10-31T22:40:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDQ551feZUgExAAvGt2fUb5GhkkFQ0dbgP5nw== 2020-10-31T22:40:44.373 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2020-10-31T22:40:44.373 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDQ551f5SPjJBAAVjFv2PdBZ7j94etJrAT0tA== 2020-10-31T22:40:44.373 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.4] 2020-10-31T22:40:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDe551fI5nIMxAAwwNSHQYDPS6G2achKIpwqg== 2020-10-31T22:40:44.374 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.5] 2020-10-31T22:40:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDh551f68p2GhAAhlGpZLPg8RqouzStqN4tFw== 2020-10-31T22:40:44.374 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.6] 2020-10-31T22:40:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDk551fUi3kARAAsXPU7HEhqax8Go00CqgdNw== 2020-10-31T22:40:44.374 INFO:teuthology.orchestra.run.smithi060.stdout:[osd.7] 2020-10-31T22:40:44.374 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDm551fKh4aJRAAj+whV4kueCu2Og7wZ05tNw== 2020-10-31T22:40:44.375 INFO:teuthology.orchestra.run.smithi060.stdout:[client.0] 2020-10-31T22:40:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDQ551flXvBJxAAtD4URDL2NV0zyAympufvVA== 2020-10-31T22:40:44.375 INFO:teuthology.orchestra.run.smithi060.stdout:[client.1] 2020-10-31T22:40:44.375 INFO:teuthology.orchestra.run.smithi060.stdout: key = AQDQ551fQ/OGKhAA/xGrRlUW52pP6E6SWXYAGA== 2020-10-31T22:40:44.376 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.y] 2020-10-31T22:40:44.376 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDQ551fKiN5EBAAhHtXXE4+yydXWOK7agZ14g== 2020-10-31T22:40:44.376 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2020-10-31T22:40:44.377 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDQ551f7D/cFRAAHQ9NU7VSs14mi5sC/GwHng== 2020-10-31T22:40:44.377 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2020-10-31T22:40:44.377 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDQ551fKpdoHhAAhhlaYqOQoI6tTKexjRpbGA== 2020-10-31T22:40:44.377 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.0] 2020-10-31T22:40:44.377 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDR551f7MwsMRAACZIQlAKm3BdVbDs2gQAfxg== 2020-10-31T22:40:44.377 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.1] 2020-10-31T22:40:44.377 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDU551f07HQFxAAokMFXwsbgKGtJNpnKerdGg== 2020-10-31T22:40:44.378 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.2] 2020-10-31T22:40:44.378 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDW551fODyjOhAAJ+j8KITJidSpltSiJaQZGw== 2020-10-31T22:40:44.378 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.3] 2020-10-31T22:40:44.378 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDZ551fs+aCIhAAwpbmgGQjU05W3hZofTtHdg== 2020-10-31T22:40:44.378 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.x] 2020-10-31T22:40:44.378 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDQ551feZUgExAAvGt2fUb5GhkkFQ0dbgP5nw== 2020-10-31T22:40:44.379 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2020-10-31T22:40:44.379 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDQ551f5SPjJBAAVjFv2PdBZ7j94etJrAT0tA== 2020-10-31T22:40:44.379 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.4] 2020-10-31T22:40:44.379 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDe551fI5nIMxAAwwNSHQYDPS6G2achKIpwqg== 2020-10-31T22:40:44.379 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.5] 2020-10-31T22:40:44.379 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDh551f68p2GhAAhlGpZLPg8RqouzStqN4tFw== 2020-10-31T22:40:44.380 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.6] 2020-10-31T22:40:44.380 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDk551fUi3kARAAsXPU7HEhqax8Go00CqgdNw== 2020-10-31T22:40:44.380 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.7] 2020-10-31T22:40:44.380 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDm551fKh4aJRAAj+whV4kueCu2Og7wZ05tNw== 2020-10-31T22:40:44.380 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2020-10-31T22:40:44.380 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDQ551flXvBJxAAtD4URDL2NV0zyAympufvVA== 2020-10-31T22:40:44.381 INFO:teuthology.orchestra.run.smithi066.stdout:[client.1] 2020-10-31T22:40:44.381 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDQ551fQ/OGKhAA/xGrRlUW52pP6E6SWXYAGA== 2020-10-31T22:40:44.381 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-10-31T22:40:44.418 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-10-31T22:40:44.467 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-10-31T22:40:44.502 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-10-31T22:40:44.555 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-10-31T22:40:44.559 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-10-31T22:40:44.606 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:44.609 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:44.687 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:44.695 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:44.770 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:44.779 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:44.851 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:44.864 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:44.937 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-10-31T22:40:44.950 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-10-31T22:40:45.020 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-10-31T22:40:45.036 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-10-31T22:40:45.107 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:45.123 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:45.171 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:45.210 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:45.260 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:45.295 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:45.352 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:45.383 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-10-31T22:40:45.675 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-10-31T22:40:45.702 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-10-31T22:40:45.773 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-10-31T22:40:45.799 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-10-31T22:40:45.868 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-10-31T22:40:45.868 INFO:teuthology.orchestra.run.smithi060:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-10-31T22:40:45.919 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-10-31T22:40:46.040 INFO:teuthology.orchestra.run.smithi060:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-10-31T22:40:46.062 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-10-31T22:40:46.088 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-10-31T22:40:46.221 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-10-31T22:40:46.257 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-10-31T22:40:46.339 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-10-31T22:40:46.474 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-10-31T22:40:46.502 INFO:teuthology.orchestra.run.smithi060:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:46.507 INFO:teuthology.orchestra.run.smithi066:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-10-31T22:40:46.557 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-10-31T22:40:46.558 INFO:tasks.ceph.mon.a:Restarting daemon 2020-10-31T22:40:46.559 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-10-31T22:40:46.563 INFO:tasks.ceph.mon.a:Started 2020-10-31T22:40:46.564 INFO:tasks.ceph.mon.b:Restarting daemon 2020-10-31T22:40:46.564 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-10-31T22:40:46.612 INFO:tasks.ceph.mon.b:Started 2020-10-31T22:40:46.613 INFO:tasks.ceph.mon.c:Restarting daemon 2020-10-31T22:40:46.614 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-10-31T22:40:46.623 INFO:tasks.ceph.mon.c:Started 2020-10-31T22:40:46.624 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-10-31T22:40:46.625 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-10-31T22:40:46.626 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-10-31T22:40:46.638 INFO:tasks.ceph.mgr.y:Started 2020-10-31T22:40:46.639 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-10-31T22:40:46.639 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-10-31T22:40:46.646 INFO:tasks.ceph.mgr.x:Started 2020-10-31T22:40:46.646 INFO:tasks.ceph:Setting crush tunables to default 2020-10-31T22:40:46.647 INFO:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd crush tunables default 2020-10-31T22:40:52.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:46.869+0000 7fc0cc5e7700 1 Processor -- start 2020-10-31T22:40:52.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:46.869+0000 7fc0cc5e7700 1 -- start start 2020-10-31T22:40:52.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:46.869+0000 7fc0cc5e7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 0x7fc0c40a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:52.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:46.869+0000 7fc0cc5e7700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c405b700 con 0x7fc0c405b320 2020-10-31T22:40:52.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:46.869+0000 7fc0cc5e7700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c40807c0 con 0x7fc0c40ac110 2020-10-31T22:40:52.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:46.869+0000 7fc0cc5e7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c40ab730 con 0x7fc0c40ae200 2020-10-31T22:40:52.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:46.869+0000 7fc0cab84700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc0c405b320 0x7fc0c407ff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44756/0 (socket says 172.21.15.60:44756) 2020-10-31T22:40:52.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:46.869+0000 7fc0cab84700 1 -- 172.21.15.60:0/722055081 learned_addr learned my addr 172.21.15.60:0/722055081 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:40:52.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:46.869+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 0x7fc0c40a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:46.869+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 msgr2=0x7fc0c40a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-10-31T22:40:52.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:46.869+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 msgr2=0x7fc0c40a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-10-31T22:40:52.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:46.869+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 0x7fc0c40a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-10-31T22:40:52.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:46.869+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 0x7fc0c40a74b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-10-31T22:40:52.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:47.073+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 0x7fc0c40a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:47.073+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 msgr2=0x7fc0c40a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-10-31T22:40:52.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:47.073+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 msgr2=0x7fc0c40a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-10-31T22:40:52.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:47.073+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 0x7fc0c40a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-10-31T22:40:52.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:47.073+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 0x7fc0c40a74b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-10-31T22:40:52.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:47.477+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 0x7fc0c40a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:47.477+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 msgr2=0x7fc0c40a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-10-31T22:40:52.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:47.477+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 msgr2=0x7fc0c40a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-10-31T22:40:52.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:47.477+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 0x7fc0c40a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-10-31T22:40:52.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:47.477+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 0x7fc0c40a74b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-10-31T22:40:52.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:48.281+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 0x7fc0c40a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:48.281+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 msgr2=0x7fc0c40a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-10-31T22:40:52.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:48.281+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 msgr2=0x7fc0c40a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-10-31T22:40:52.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:48.281+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 0x7fc0c40a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-10-31T22:40:52.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:48.281+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 0x7fc0c40a74b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-10-31T22:40:52.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0c8b80700 1 -- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 msgr2=0x7fc0c40a74b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-10-31T22:40:52.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0c8b80700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0c40ae200 0x7fc0c40a74b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:52.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0c8b80700 1 -- 172.21.15.60:0/722055081 >> v1:172.21.15.66:6789/0 conn(0x7fc0c40ac110 legacy=0x7fc0c40af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:52.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0c8b80700 1 -- 172.21.15.60:0/722055081 >> v1:172.21.15.60:6789/0 conn(0x7fc0c405b320 legacy=0x7fc0c407ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:52.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0c8b80700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 0x7fc0a8049860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:52.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0c8b80700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 0x7fc0a804c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:52.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0c8b80700 1 -- 172.21.15.60:0/722055081 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c40ab730 con 0x7fc0a8049e60 2020-10-31T22:40:52.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0c8b80700 1 -- 172.21.15.60:0/722055081 --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a804ca10 con 0x7fc0a8047400 2020-10-31T22:40:52.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 0x7fc0a804c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 0x7fc0a8049860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 msgr2=0x7fc0a804c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-10-31T22:40:52.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 msgr2=0x7fc0a804c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-10-31T22:40:52.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 0x7fc0a804c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-10-31T22:40:52.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 0x7fc0a804c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-10-31T22:40:52.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0cab84700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 msgr2=0x7fc0a8049860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-10-31T22:40:52.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0cab84700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 msgr2=0x7fc0a8049860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-10-31T22:40:52.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 0x7fc0a8049860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-10-31T22:40:52.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:49.872+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 0x7fc0a8049860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-10-31T22:40:52.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.076+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 0x7fc0a804c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.076+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 0x7fc0a8049860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.076+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 msgr2=0x7fc0a804c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-10-31T22:40:52.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.076+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 msgr2=0x7fc0a804c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-10-31T22:40:52.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.076+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 0x7fc0a804c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-10-31T22:40:52.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.076+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 0x7fc0a804c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-10-31T22:40:52.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.076+0000 7fc0cab84700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 msgr2=0x7fc0a8049860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-10-31T22:40:52.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.076+0000 7fc0cab84700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 msgr2=0x7fc0a8049860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-10-31T22:40:52.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.076+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 0x7fc0a8049860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-10-31T22:40:52.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.076+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 0x7fc0a8049860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-10-31T22:40:52.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.480+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 0x7fc0a804c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.480+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 0x7fc0a8049860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.480+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 msgr2=0x7fc0a804c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-10-31T22:40:52.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.480+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 msgr2=0x7fc0a804c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-10-31T22:40:52.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.480+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 0x7fc0a804c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-10-31T22:40:52.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.480+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 0x7fc0a804c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-10-31T22:40:52.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.480+0000 7fc0cab84700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 msgr2=0x7fc0a8049860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-10-31T22:40:52.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.480+0000 7fc0cab84700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 msgr2=0x7fc0a8049860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-10-31T22:40:52.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.480+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 0x7fc0a8049860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-10-31T22:40:52.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:50.480+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 0x7fc0a8049860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-10-31T22:40:52.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:51.283+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 0x7fc0a804c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:51.283+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 0x7fc0a8049860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:51.283+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 msgr2=0x7fc0a804c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-10-31T22:40:52.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:51.283+0000 7fc0ca383700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 msgr2=0x7fc0a804c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-10-31T22:40:52.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:51.283+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 0x7fc0a804c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-10-31T22:40:52.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:51.283+0000 7fc0ca383700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 0x7fc0a804c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-10-31T22:40:52.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:51.283+0000 7fc0cab84700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 msgr2=0x7fc0a8049860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2020-10-31T22:40:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:51.283+0000 7fc0cab84700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 msgr2=0x7fc0a8049860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-10-31T22:40:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:51.283+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 0x7fc0a8049860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-10-31T22:40:52.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:51.283+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 0x7fc0a8049860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-10-31T22:40:52.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.871+0000 7fc0c8b80700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 msgr2=0x7fc0a8049860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-10-31T22:40:52.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.871+0000 7fc0c8b80700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a8047400 0x7fc0a8049860 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:52.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.871+0000 7fc0c8b80700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 msgr2=0x7fc0a804c320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-10-31T22:40:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.871+0000 7fc0c8b80700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a8049e60 0x7fc0a804c320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.871+0000 7fc0cb385700 1 -- 172.21.15.60:0/722055081 reap_dead start 2020-10-31T22:40:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.871+0000 7fc0c8b80700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a804ce20 0x7fc0a804f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:52.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.871+0000 7fc0c8b80700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a804ba70 0x7fc0a804bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:52.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.871+0000 7fc0c8b80700 1 -- 172.21.15.60:0/722055081 --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0c40ab9d0 con 0x7fc0a8047830 2020-10-31T22:40:52.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.871+0000 7fc0c8b80700 1 -- 172.21.15.60:0/722055081 --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0c40ab730 con 0x7fc0a804ce20 2020-10-31T22:40:52.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.871+0000 7fc0c8b80700 1 -- 172.21.15.60:0/722055081 --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a804ca10 con 0x7fc0a804ba70 2020-10-31T22:40:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.871+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.60:3300/0 conn(0x7fc0a804ce20 0x7fc0a804f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.871+0000 7fc0cb385700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a804ba70 0x7fc0a804bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0cab84700 1 -- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a804ba70 msgr2=0x7fc0a804bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:40:52.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a804ba70 0x7fc0a804bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:52.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0cab84700 1 -- 172.21.15.60:0/722055081 >> v1:172.21.15.66:6789/0 conn(0x7fc0a8047830 legacy=0x7fc0a804a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:52.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0cab84700 1 -- 172.21.15.60:0/722055081 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a8052720 con 0x7fc0a804ce20 2020-10-31T22:40:52.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0cab84700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a804ce20 0x7fc0a804f210 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fc0c000b000 tx=0x7fc0c0009040).ready entity=mon.0 client_cookie=51aa26cd2d0b789f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:52.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0c9b82700 1 -- 172.21.15.60:0/722055081 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0c00165d0 con 0x7fc0a804ce20 2020-10-31T22:40:52.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0c9b82700 1 -- 172.21.15.60:0/722055081 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c0016730 con 0x7fc0a804ce20 2020-10-31T22:40:52.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0c9b82700 1 -- 172.21.15.60:0/722055081 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0c0016a90 con 0x7fc0a804ce20 2020-10-31T22:40:52.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0cc5e7700 1 -- 172.21.15.60:0/722055081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a804ce20 msgr2=0x7fc0a804f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:52.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0cc5e7700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a804ce20 0x7fc0a804f210 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fc0c000b000 tx=0x7fc0c0009040).stop 2020-10-31T22:40:52.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0cc5e7700 1 -- 172.21.15.60:0/722055081 shutdown_connections 2020-10-31T22:40:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0cc5e7700 1 --2- 172.21.15.60:0/722055081 >> v2:172.21.15.66:3300/0 conn(0x7fc0a804ba70 0x7fc0a804bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0cc5e7700 1 --2- 172.21.15.60:0/722055081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a804ce20 0x7fc0a804f210 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:52.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0cc5e7700 1 -- 172.21.15.60:0/722055081 >> 172.21.15.60:0/722055081 conn(0x7fc0c40b3fd0 msgr2=0x7fc0c40b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:52.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0cc5e7700 1 -- 172.21.15.60:0/722055081 shutdown_connections 2020-10-31T22:40:52.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.875+0000 7fc0cc5e7700 1 -- 172.21.15.60:0/722055081 wait complete. 2020-10-31T22:40:52.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.879+0000 7fc0cc5e7700 1 Processor -- start 2020-10-31T22:40:52.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.879+0000 7fc0cc5e7700 1 -- start start 2020-10-31T22:40:52.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.879+0000 7fc0cc5e7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0a8047830 0x7fc0c4143a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:52.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.879+0000 7fc0cc5e7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0a804ba70 0x7fc0c4065f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:52.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cc5e7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a804ce20 0x7fc0c40a9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:52.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cc5e7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c4140930 con 0x7fc0a804ce20 2020-10-31T22:40:52.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cc5e7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c41430b0 con 0x7fc0a8047830 2020-10-31T22:40:52.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cc5e7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0c4143310 con 0x7fc0a804ba70 2020-10-31T22:40:52.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cb385700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a804ce20 0x7fc0c40a9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cb385700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a804ce20 0x7fc0c40a9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40688/0 (socket says 172.21.15.60:40688) 2020-10-31T22:40:52.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cab84700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0a8047830 0x7fc0c4143a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cb385700 1 -- 172.21.15.60:0/2643601423 learned_addr learned my addr 172.21.15.60:0/2643601423 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:40:52.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0ca383700 1 --2- 172.21.15.60:0/2643601423 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0a804ba70 0x7fc0c4065f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:52.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cab84700 1 -- 172.21.15.60:0/2643601423 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0a804ba70 msgr2=0x7fc0c4065f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:52.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cab84700 1 --2- 172.21.15.60:0/2643601423 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0a804ba70 0x7fc0c4065f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:52.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cab84700 1 -- 172.21.15.60:0/2643601423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a804ce20 msgr2=0x7fc0c40a9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:52.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cab84700 1 --2- 172.21.15.60:0/2643601423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a804ce20 0x7fc0c40a9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:52.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cab84700 1 -- 172.21.15.60:0/2643601423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c41435b0 con 0x7fc0a8047830 2020-10-31T22:40:52.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cab84700 1 --2- 172.21.15.60:0/2643601423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0a8047830 0x7fc0c4143a50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fc0c000b000 tx=0x7fc0c0009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:52.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0bb7fe700 1 -- 172.21.15.60:0/2643601423 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0c0000e50 con 0x7fc0a8047830 2020-10-31T22:40:52.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0bb7fe700 1 -- 172.21.15.60:0/2643601423 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c0017bc0 con 0x7fc0a8047830 2020-10-31T22:40:52.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0bb7fe700 1 -- 172.21.15.60:0/2643601423 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0c0023430 con 0x7fc0a8047830 2020-10-31T22:40:52.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cc5e7700 1 -- 172.21.15.60:0/2643601423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0c40b2d10 con 0x7fc0a8047830 2020-10-31T22:40:52.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0cc5e7700 1 -- 172.21.15.60:0/2643601423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0c40a9b20 con 0x7fc0a8047830 2020-10-31T22:40:52.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0bb7fe700 1 -- 172.21.15.60:0/2643601423 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fc0c0029070 con 0x7fc0a8047830 2020-10-31T22:40:52.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.883+0000 7fc0bb7fe700 1 -- 172.21.15.60:0/2643601423 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fc0c00237b0 con 0x7fc0a8047830 2020-10-31T22:40:52.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.887+0000 7fc0cc5e7700 1 -- 172.21.15.60:0/2643601423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0c4140760 con 0x7fc0a8047830 2020-10-31T22:40:52.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.891+0000 7fc0bb7fe700 1 -- 172.21.15.60:0/2643601423 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fc0c0027070 con 0x7fc0a8047830 2020-10-31T22:40:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.963+0000 7fc0cc5e7700 1 -- 172.21.15.60:0/2643601423 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc0c4140760 con 0x7fc0a8047830 2020-10-31T22:40:52.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.971+0000 7fc0bb7fe700 1 -- 172.21.15.60:0/2643601423 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc0c0023970 con 0x7fc0a8047830 2020-10-31T22:40:52.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.971+0000 7fc0cc5e7700 1 -- 172.21.15.60:0/2643601423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0a8047830 msgr2=0x7fc0c4143a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:52.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.971+0000 7fc0cc5e7700 1 --2- 172.21.15.60:0/2643601423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0a8047830 0x7fc0c4143a50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fc0c000b000 tx=0x7fc0c0009040).stop 2020-10-31T22:40:52.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.971+0000 7fc0cc5e7700 1 -- 172.21.15.60:0/2643601423 shutdown_connections 2020-10-31T22:40:52.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.971+0000 7fc0cc5e7700 1 --2- 172.21.15.60:0/2643601423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0a804ce20 0x7fc0c40a9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:52.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.971+0000 7fc0cc5e7700 1 --2- 172.21.15.60:0/2643601423 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0a8047830 0x7fc0c4143a50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:52.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.971+0000 7fc0cc5e7700 1 --2- 172.21.15.60:0/2643601423 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0a804ba70 0x7fc0c4065f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:52.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.971+0000 7fc0cc5e7700 1 -- 172.21.15.60:0/2643601423 >> 172.21.15.60:0/2643601423 conn(0x7fc0c40b3fd0 msgr2=0x7fc0c40a7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:52.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.971+0000 7fc0cc5e7700 1 -- 172.21.15.60:0/2643601423 shutdown_connections 2020-10-31T22:40:52.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:40:52.971+0000 7fc0cc5e7700 1 -- 172.21.15.60:0/2643601423 wait complete. 2020-10-31T22:40:52.985 INFO:teuthology.orchestra.run.smithi060.stderr:adjusted tunables profile to default 2020-10-31T22:40:52.987 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-10-31T22:40:52.988 INFO:teuthology.orchestra.run.smithi060:> mktemp 2020-10-31T22:40:52.993 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.MVxTdvA6Zx 2020-10-31T22:40:52.993 INFO:teuthology.orchestra.run.smithi060:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.MVxTdvA6Zx 2020-10-31T22:40:53.049 INFO:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.MVxTdvA6Zx 2020-10-31T22:40:53.169 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.MVxTdvA6Zx is 37B 2020-10-31T22:40:53.180 INFO:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.MVxTdvA6Zx 2020-10-31T22:40:53.187 INFO:teuthology.orchestra.run.smithi060:> mktemp 2020-10-31T22:40:53.233 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.W71PNoEj0Y 2020-10-31T22:40:53.234 INFO:teuthology.orchestra.run.smithi060:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.W71PNoEj0Y 2020-10-31T22:40:53.293 INFO:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.W71PNoEj0Y 2020-10-31T22:40:53.409 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.W71PNoEj0Y is 37B 2020-10-31T22:40:53.463 INFO:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.W71PNoEj0Y 2020-10-31T22:40:53.474 INFO:teuthology.orchestra.run.smithi060:> mktemp 2020-10-31T22:40:53.518 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.JlI2cvXA2O 2020-10-31T22:40:53.519 INFO:teuthology.orchestra.run.smithi060:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.JlI2cvXA2O 2020-10-31T22:40:53.576 INFO:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.JlI2cvXA2O 2020-10-31T22:40:53.680 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.JlI2cvXA2O is 37B 2020-10-31T22:40:53.691 INFO:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.JlI2cvXA2O 2020-10-31T22:40:53.697 INFO:teuthology.orchestra.run.smithi060:> mktemp 2020-10-31T22:40:53.748 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.LuVcLtg6Jr 2020-10-31T22:40:53.748 INFO:teuthology.orchestra.run.smithi060:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.LuVcLtg6Jr 2020-10-31T22:40:53.808 INFO:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.LuVcLtg6Jr 2020-10-31T22:40:53.920 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.LuVcLtg6Jr is 37B 2020-10-31T22:40:53.936 INFO:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.LuVcLtg6Jr 2020-10-31T22:40:53.943 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-10-31T22:40:53.950 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.jzgUG7HUB4 2020-10-31T22:40:53.951 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.jzgUG7HUB4 2020-10-31T22:40:54.011 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.jzgUG7HUB4 2020-10-31T22:40:54.113 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.jzgUG7HUB4 is 37B 2020-10-31T22:40:54.122 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.jzgUG7HUB4 2020-10-31T22:40:54.128 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-10-31T22:40:54.176 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.lQaPJGni24 2020-10-31T22:40:54.176 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.lQaPJGni24 2020-10-31T22:40:54.231 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.lQaPJGni24 2020-10-31T22:40:54.338 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.lQaPJGni24 is 37B 2020-10-31T22:40:54.348 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.lQaPJGni24 2020-10-31T22:40:54.356 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-10-31T22:40:54.404 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.bXWajhLSVV 2020-10-31T22:40:54.404 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.bXWajhLSVV 2020-10-31T22:40:54.463 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.bXWajhLSVV 2020-10-31T22:40:54.574 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.bXWajhLSVV is 37B 2020-10-31T22:40:54.624 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.bXWajhLSVV 2020-10-31T22:40:54.631 INFO:teuthology.orchestra.run.smithi066:> mktemp 2020-10-31T22:40:54.681 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.Vh9dE0boLz 2020-10-31T22:40:54.681 INFO:teuthology.orchestra.run.smithi066:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.Vh9dE0boLz 2020-10-31T22:40:54.740 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.Vh9dE0boLz 2020-10-31T22:40:54.847 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.Vh9dE0boLz is 37B 2020-10-31T22:40:54.859 INFO:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.Vh9dE0boLz 2020-10-31T22:40:54.866 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new f8f5851d-7561-4db8-b0bf-d0ed3e815d67 0 2020-10-31T22:40:55.029 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.024+0000 7f5ff759e700 1 Processor -- start 2020-10-31T22:40:55.032 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.024+0000 7f5ff759e700 1 -- start start 2020-10-31T22:40:55.032 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.024+0000 7f5ff759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff80b1570 0x7f5ff8024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.032 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.024+0000 7f5ff759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5ff8025480 0x7f5ff807fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.033 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.024+0000 7f5ff759e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ff80b1950 con 0x7f5ff80801c0 2020-10-31T22:40:55.033 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.024+0000 7f5ff759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ff8062720 con 0x7f5ff8025480 2020-10-31T22:40:55.033 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.024+0000 7f5ff759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff8066cb0 con 0x7f5ff80b1570 2020-10-31T22:40:55.033 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff659c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5ff8025480 0x7f5ff807fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.033 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ffcce8700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f5ff80801c0 0x7f5ff80afcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:45476/0 (socket says 172.21.15.66:45476) 2020-10-31T22:40:55.033 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ffcce8700 1 -- 172.21.15.66:0/331186099 learned_addr learned my addr 172.21.15.66:0/331186099 (peer_addr_for_me v1:172.21.15.66:0/0) 2020-10-31T22:40:55.033 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff6d9d700 1 --2- 172.21.15.66:0/331186099 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff80b1570 0x7f5ff8024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.034 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff6d9d700 1 -- 172.21.15.66:0/331186099 >> v2:172.21.15.66:3300/0 conn(0x7f5ff8025480 msgr2=0x7f5ff807fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:40:55.034 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff6d9d700 1 --2- 172.21.15.66:0/331186099 >> v2:172.21.15.66:3300/0 conn(0x7f5ff8025480 0x7f5ff807fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.034 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff6d9d700 1 -- 172.21.15.66:0/331186099 >> v1:172.21.15.66:6789/0 conn(0x7f5ff80801c0 legacy=0x7f5ff80afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.034 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff6d9d700 1 -- 172.21.15.66:0/331186099 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80aca00 con 0x7f5ff80b1570 2020-10-31T22:40:55.035 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff659c700 1 --2- 172.21.15.66:0/331186099 >> v2:172.21.15.66:3300/0 conn(0x7f5ff8025480 0x7f5ff807fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:40:55.035 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff6d9d700 1 --2- 172.21.15.66:0/331186099 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff80b1570 0x7f5ff8024f90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f5fe8002f30 tx=0x7f5fe8006dc0).ready entity=mon.2 client_cookie=970f1494e1e69890 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:55.035 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff5d9b700 1 -- 172.21.15.66:0/331186099 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe8009760 con 0x7f5ff80b1570 2020-10-31T22:40:55.036 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff5d9b700 1 -- 172.21.15.66:0/331186099 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fe80098c0 con 0x7f5ff80b1570 2020-10-31T22:40:55.036 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff5d9b700 1 -- 172.21.15.66:0/331186099 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5fe8009c20 con 0x7f5ff80b1570 2020-10-31T22:40:55.036 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff759e700 1 -- 172.21.15.66:0/331186099 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff80b1570 msgr2=0x7f5ff8024f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.036 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff759e700 1 --2- 172.21.15.66:0/331186099 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff80b1570 0x7f5ff8024f90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f5fe8002f30 tx=0x7f5fe8006dc0).stop 2020-10-31T22:40:55.036 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff759e700 1 -- 172.21.15.66:0/331186099 shutdown_connections 2020-10-31T22:40:55.036 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff759e700 1 --2- 172.21.15.66:0/331186099 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff80b1570 0x7f5ff8024f90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.036 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff759e700 1 --2- 172.21.15.66:0/331186099 >> v2:172.21.15.66:3300/0 conn(0x7f5ff8025480 0x7f5ff807fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.037 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff759e700 1 -- 172.21.15.66:0/331186099 >> 172.21.15.66:0/331186099 conn(0x7f5ff80b5440 msgr2=0x7f5ff80b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:55.037 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff759e700 1 -- 172.21.15.66:0/331186099 shutdown_connections 2020-10-31T22:40:55.037 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff759e700 1 -- 172.21.15.66:0/331186099 wait complete. 2020-10-31T22:40:55.039 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff759e700 1 Processor -- start 2020-10-31T22:40:55.040 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.028+0000 7f5ff759e700 1 -- start start 2020-10-31T22:40:55.040 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ff759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff8025480 0x7f5ff80a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.040 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ff759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ff80801c0 0x7f5ff80a24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.040 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ff759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ff80b1570 0x7f5ff80afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.040 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ff759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80a29a0 con 0x7f5ff80801c0 2020-10-31T22:40:55.040 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ff759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80a3380 con 0x7f5ff80b1570 2020-10-31T22:40:55.041 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ff759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ff80a2db0 con 0x7f5ff8025480 2020-10-31T22:40:55.041 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ffcce8700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ff80b1570 0x7f5ff80afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.041 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ff6d9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff8025480 0x7f5ff80a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.041 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ffcce8700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ff80b1570 0x7f5ff80afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55842/0 (socket says 172.21.15.66:55842) 2020-10-31T22:40:55.042 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ffcce8700 1 -- 172.21.15.66:0/3141632571 learned_addr learned my addr 172.21.15.66:0/3141632571 (peer_addr_for_me v2:172.21.15.66:0/0) 2020-10-31T22:40:55.042 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ff6d9d700 1 --2- 172.21.15.66:0/3141632571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff8025480 0x7f5ff80a3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:33920/0 (socket says 172.21.15.66:33920) 2020-10-31T22:40:55.042 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ff659c700 1 --2- 172.21.15.66:0/3141632571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ff80801c0 0x7f5ff80a24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.042 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ffcce8700 1 -- 172.21.15.66:0/3141632571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff8025480 msgr2=0x7f5ff80a3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.042 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ffcce8700 1 --2- 172.21.15.66:0/3141632571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff8025480 0x7f5ff80a3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.043 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ffcce8700 1 -- 172.21.15.66:0/3141632571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ff80801c0 msgr2=0x7f5ff80a24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.043 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ffcce8700 1 --2- 172.21.15.66:0/3141632571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ff80801c0 0x7f5ff80a24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.043 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ffcce8700 1 -- 172.21.15.66:0/3141632571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff80a3050 con 0x7f5ff80b1570 2020-10-31T22:40:55.043 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ffcce8700 1 --2- 172.21.15.66:0/3141632571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ff80b1570 0x7f5ff80afcf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f5ff80a2ae0 tx=0x7f5ff0007ed0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:55.043 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5fef7fe700 1 -- 172.21.15.66:0/3141632571 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff0005b70 con 0x7f5ff80b1570 2020-10-31T22:40:55.043 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5fef7fe700 1 -- 172.21.15.66:0/3141632571 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff0005cd0 con 0x7f5ff80b1570 2020-10-31T22:40:55.043 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ff759e700 1 -- 172.21.15.66:0/3141632571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ff80a3600 con 0x7f5ff80b1570 2020-10-31T22:40:55.044 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5fef7fe700 1 -- 172.21.15.66:0/3141632571 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ff0007300 con 0x7f5ff80b1570 2020-10-31T22:40:55.044 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ff759e700 1 -- 172.21.15.66:0/3141632571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff80b0400 con 0x7f5ff80b1570 2020-10-31T22:40:55.044 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5fef7fe700 1 -- 172.21.15.66:0/3141632571 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f5ff0010030 con 0x7f5ff80b1570 2020-10-31T22:40:55.044 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5fef7fe700 1 -- 172.21.15.66:0/3141632571 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f5ff0005e40 con 0x7f5ff80b1570 2020-10-31T22:40:55.044 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.032+0000 7f5ff759e700 1 -- 172.21.15.66:0/3141632571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ff807fff0 con 0x7f5ff80b1570 2020-10-31T22:40:55.044 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.040+0000 7f5fef7fe700 1 -- 172.21.15.66:0/3141632571 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f5ff807fff0 con 0x7f5ff80b1570 2020-10-31T22:40:55.143 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.144+0000 7f5ff759e700 1 -- 172.21.15.66:0/3141632571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", "id": 0} v 0) v1 -- 0x7f5ff80a3800 con 0x7f5ff80b1570 2020-10-31T22:40:55.150 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.148+0000 7f5fef7fe700 1 -- 172.21.15.66:0/3141632571 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5ff80a3800 con 0x7f5ff80b1570 2020-10-31T22:40:55.151 INFO:teuthology.orchestra.run.smithi066.stdout:0 2020-10-31T22:40:55.151 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.152+0000 7f5ff759e700 1 -- 172.21.15.66:0/3141632571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ff80b1570 msgr2=0x7f5ff80afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.152 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.152+0000 7f5ff759e700 1 --2- 172.21.15.66:0/3141632571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ff80b1570 0x7f5ff80afcf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f5ff80a2ae0 tx=0x7f5ff0007ed0).stop 2020-10-31T22:40:55.152 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.152+0000 7f5ff759e700 1 -- 172.21.15.66:0/3141632571 shutdown_connections 2020-10-31T22:40:55.152 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.152+0000 7f5ff759e700 1 --2- 172.21.15.66:0/3141632571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5ff80b1570 0x7f5ff80afcf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.152 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.152+0000 7f5ff759e700 1 --2- 172.21.15.66:0/3141632571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5ff8025480 0x7f5ff80a3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.152 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.152+0000 7f5ff759e700 1 --2- 172.21.15.66:0/3141632571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ff80801c0 0x7f5ff80a24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.152 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.152+0000 7f5ff759e700 1 -- 172.21.15.66:0/3141632571 >> 172.21.15.66:0/3141632571 conn(0x7f5ff80b5440 msgr2=0x7f5ff80ae530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:55.153 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.152+0000 7f5ff759e700 1 -- 172.21.15.66:0/3141632571 shutdown_connections 2020-10-31T22:40:55.153 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.152+0000 7f5ff759e700 1 -- 172.21.15.66:0/3141632571 wait complete. 2020-10-31T22:40:55.163 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 2f4036a9-518b-4d0b-ae4f-489e2ae476d2 1 2020-10-31T22:40:55.290 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f214359e700 1 Processor -- start 2020-10-31T22:40:55.290 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f214359e700 1 -- start start 2020-10-31T22:40:55.290 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f214359e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f21440b1570 0x7f2144024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.291 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f214359e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21440803e0 0x7f2144159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.291 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f214359e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21440b1950 con 0x7f2144025480 2020-10-31T22:40:55.291 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f214359e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2144080850 con 0x7f21440803e0 2020-10-31T22:40:55.291 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f214359e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2144025910 con 0x7f21440b1570 2020-10-31T22:40:55.292 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f2142d9d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f21440b1570 0x7f2144024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.292 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f2142d9d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f21440b1570 0x7f2144024f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55844/0 (socket says 172.21.15.66:55844) 2020-10-31T22:40:55.292 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f2142d9d700 1 -- 172.21.15.66:0/3030390444 learned_addr learned my addr 172.21.15.66:0/3030390444 (peer_addr_for_me v2:172.21.15.66:0/0) 2020-10-31T22:40:55.292 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f2148ca3700 1 --2- 172.21.15.66:0/3030390444 >> v2:172.21.15.60:3300/0 conn(0x7f21440803e0 0x7f2144159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.293 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f2142d9d700 1 -- 172.21.15.66:0/3030390444 >> v2:172.21.15.60:3300/0 conn(0x7f21440803e0 msgr2=0x7f2144159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:40:55.294 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f2142d9d700 1 --2- 172.21.15.66:0/3030390444 >> v2:172.21.15.60:3300/0 conn(0x7f21440803e0 0x7f2144159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.294 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f2142d9d700 1 -- 172.21.15.66:0/3030390444 >> v1:172.21.15.60:6789/0 conn(0x7f2144025480 legacy=0x7f214407fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.294 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f2142d9d700 1 -- 172.21.15.66:0/3030390444 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2144062720 con 0x7f21440b1570 2020-10-31T22:40:55.295 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f2142d9d700 1 --2- 172.21.15.66:0/3030390444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21440b1570 0x7f2144024f90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f2134002f30 tx=0x7f2134006e80).ready entity=mon.1 client_cookie=8ec214d694c93b5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:55.295 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f214259c700 1 -- 172.21.15.66:0/3030390444 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21340097f0 con 0x7f21440b1570 2020-10-31T22:40:55.295 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f214259c700 1 -- 172.21.15.66:0/3030390444 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2134009950 con 0x7f21440b1570 2020-10-31T22:40:55.296 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f214259c700 1 -- 172.21.15.66:0/3030390444 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2134009cb0 con 0x7f21440b1570 2020-10-31T22:40:55.296 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f214359e700 1 -- 172.21.15.66:0/3030390444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21440b1570 msgr2=0x7f2144024f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.296 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.284+0000 7f214359e700 1 --2- 172.21.15.66:0/3030390444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21440b1570 0x7f2144024f90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f2134002f30 tx=0x7f2134006e80).stop 2020-10-31T22:40:55.296 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f214359e700 1 -- 172.21.15.66:0/3030390444 shutdown_connections 2020-10-31T22:40:55.297 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f214359e700 1 --2- 172.21.15.66:0/3030390444 >> v2:172.21.15.60:3300/0 conn(0x7f21440803e0 0x7f2144159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.297 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f214359e700 1 --2- 172.21.15.66:0/3030390444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21440b1570 0x7f2144024f90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.297 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f214359e700 1 -- 172.21.15.66:0/3030390444 >> 172.21.15.66:0/3030390444 conn(0x7f21440b5440 msgr2=0x7f21440b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:55.297 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f214359e700 1 -- 172.21.15.66:0/3030390444 shutdown_connections 2020-10-31T22:40:55.298 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f214359e700 1 -- 172.21.15.66:0/3030390444 wait complete. 2020-10-31T22:40:55.298 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f214359e700 1 Processor -- start 2020-10-31T22:40:55.298 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f214359e700 1 -- start start 2020-10-31T22:40:55.301 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f214359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2144025480 0x7f21440acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.302 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f214359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440803e0 0x7f214407faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.302 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f214359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21440b1570 0x7f2144140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.302 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f214359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2144143b50 con 0x7f21440803e0 2020-10-31T22:40:55.302 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f214359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2144143df0 con 0x7f21440b1570 2020-10-31T22:40:55.302 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f214359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214413fad0 con 0x7f2144025480 2020-10-31T22:40:55.302 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.288+0000 7f2148ca3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21440b1570 0x7f2144140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.303 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f2142d9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2144025480 0x7f21440acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.303 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f2148ca3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21440b1570 0x7f2144140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55854/0 (socket says 172.21.15.66:55854) 2020-10-31T22:40:55.303 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f2148ca3700 1 -- 172.21.15.66:0/2004704915 learned_addr learned my addr 172.21.15.66:0/2004704915 (peer_addr_for_me v2:172.21.15.66:0/0) 2020-10-31T22:40:55.303 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f213a59c700 1 --2- 172.21.15.66:0/2004704915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440803e0 0x7f214407faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.303 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f2148ca3700 1 -- 172.21.15.66:0/2004704915 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2144025480 msgr2=0x7f21440acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.303 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f2148ca3700 1 --2- 172.21.15.66:0/2004704915 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2144025480 0x7f21440acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f2148ca3700 1 -- 172.21.15.66:0/2004704915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440803e0 msgr2=0x7f214407faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f2148ca3700 1 --2- 172.21.15.66:0/2004704915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440803e0 0x7f214407faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f2148ca3700 1 -- 172.21.15.66:0/2004704915 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214413fd70 con 0x7f21440b1570 2020-10-31T22:40:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f2148ca3700 1 --2- 172.21.15.66:0/2004704915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21440b1570 0x7f2144140210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f213c00c000 tx=0x7f213c0091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f213bfff700 1 -- 172.21.15.66:0/2004704915 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f213c00cb00 con 0x7f21440b1570 2020-10-31T22:40:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f213bfff700 1 -- 172.21.15.66:0/2004704915 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c00cc60 con 0x7f21440b1570 2020-10-31T22:40:55.304 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f213bfff700 1 -- 172.21.15.66:0/2004704915 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f213c0123f0 con 0x7f21440b1570 2020-10-31T22:40:55.305 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f214359e700 1 -- 172.21.15.66:0/2004704915 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21440b4340 con 0x7f21440b1570 2020-10-31T22:40:55.305 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f214359e700 1 -- 172.21.15.66:0/2004704915 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21440ad5d0 con 0x7f21440b1570 2020-10-31T22:40:55.305 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f213bfff700 1 -- 172.21.15.66:0/2004704915 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f213c022070 con 0x7f21440b1570 2020-10-31T22:40:55.305 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f213bfff700 1 -- 172.21.15.66:0/2004704915 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f213c012bd0 con 0x7f21440b1570 2020-10-31T22:40:55.305 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.292+0000 7f214359e700 1 -- 172.21.15.66:0/2004704915 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2144057100 con 0x7f21440b1570 2020-10-31T22:40:55.305 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.296+0000 7f213bfff700 1 -- 172.21.15.66:0/2004704915 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f213c039870 con 0x7f21440b1570 2020-10-31T22:40:55.381 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.380+0000 7f214359e700 1 -- 172.21.15.66:0/2004704915 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", "id": 1} v 0) v1 -- 0x7f2144062920 con 0x7f21440b1570 2020-10-31T22:40:55.387 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.388+0000 7f213bfff700 1 -- 172.21.15.66:0/2004704915 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f213c029070 con 0x7f21440b1570 2020-10-31T22:40:55.387 INFO:teuthology.orchestra.run.smithi066.stdout:1 2020-10-31T22:40:55.389 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.388+0000 7f214359e700 1 -- 172.21.15.66:0/2004704915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21440b1570 msgr2=0x7f2144140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.390 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.388+0000 7f214359e700 1 --2- 172.21.15.66:0/2004704915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21440b1570 0x7f2144140210 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f213c00c000 tx=0x7f213c0091a0).stop 2020-10-31T22:40:55.390 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.388+0000 7f214359e700 1 -- 172.21.15.66:0/2004704915 shutdown_connections 2020-10-31T22:40:55.390 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.388+0000 7f214359e700 1 --2- 172.21.15.66:0/2004704915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21440b1570 0x7f2144140210 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.390 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.388+0000 7f214359e700 1 --2- 172.21.15.66:0/2004704915 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2144025480 0x7f21440acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.390 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.388+0000 7f214359e700 1 --2- 172.21.15.66:0/2004704915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21440803e0 0x7f214407faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.391 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.388+0000 7f214359e700 1 -- 172.21.15.66:0/2004704915 >> 172.21.15.66:0/2004704915 conn(0x7f21440b5440 msgr2=0x7f21440aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:55.391 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.388+0000 7f214359e700 1 -- 172.21.15.66:0/2004704915 shutdown_connections 2020-10-31T22:40:55.391 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.388+0000 7f214359e700 1 -- 172.21.15.66:0/2004704915 wait complete. 2020-10-31T22:40:55.401 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new eb771e2b-981d-4ef8-b2bb-143431fea891 2 2020-10-31T22:40:55.522 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.516+0000 7f7c0a429700 1 Processor -- start 2020-10-31T22:40:55.523 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.516+0000 7f7c0a429700 1 -- start start 2020-10-31T22:40:55.524 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.516+0000 7f7c0a429700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c040b1570 0x7f7c04024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.524 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.516+0000 7f7c0a429700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7c04025480 0x7f7c0407fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.525 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c040b1950 con 0x7f7c040801c0 2020-10-31T22:40:55.525 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c04062720 con 0x7f7c04025480 2020-10-31T22:40:55.525 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c04066cb0 con 0x7f7c040b1570 2020-10-31T22:40:55.525 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c09427700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7c04025480 0x7f7c0407fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.525 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c09427700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7c04025480 0x7f7c0407fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55858/0 (socket says 172.21.15.66:55858) 2020-10-31T22:40:55.525 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c09427700 1 -- 172.21.15.66:0/2888468246 learned_addr learned my addr 172.21.15.66:0/2888468246 (peer_addr_for_me v2:172.21.15.66:0/0) 2020-10-31T22:40:55.526 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c09c28700 1 --2- 172.21.15.66:0/2888468246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c040b1570 0x7f7c04024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.526 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c09427700 1 -- 172.21.15.66:0/2888468246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c040b1570 msgr2=0x7f7c04024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:40:55.526 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c09427700 1 --2- 172.21.15.66:0/2888468246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c040b1570 0x7f7c04024f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.526 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c09427700 1 -- 172.21.15.66:0/2888468246 >> v1:172.21.15.66:6789/0 conn(0x7f7c040801c0 legacy=0x7f7c040afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.527 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c09427700 1 -- 172.21.15.66:0/2888468246 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040aca00 con 0x7f7c04025480 2020-10-31T22:40:55.527 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c09c28700 1 --2- 172.21.15.66:0/2888468246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c040b1570 0x7f7c04024f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:40:55.527 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c09427700 1 --2- 172.21.15.66:0/2888468246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c04025480 0x7f7c0407fcd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f7bf8002f30 tx=0x7f7bf8006e80).ready entity=mon.1 client_cookie=2d2434a21366ce6e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:55.527 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c08c26700 1 -- 172.21.15.66:0/2888468246 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf80097f0 con 0x7f7c04025480 2020-10-31T22:40:55.527 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c08c26700 1 -- 172.21.15.66:0/2888468246 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf8009950 con 0x7f7c04025480 2020-10-31T22:40:55.527 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c08c26700 1 -- 172.21.15.66:0/2888468246 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf8009b00 con 0x7f7c04025480 2020-10-31T22:40:55.528 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 -- 172.21.15.66:0/2888468246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c04025480 msgr2=0x7f7c0407fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.528 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 --2- 172.21.15.66:0/2888468246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c04025480 0x7f7c0407fcd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f7bf8002f30 tx=0x7f7bf8006e80).stop 2020-10-31T22:40:55.528 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 -- 172.21.15.66:0/2888468246 shutdown_connections 2020-10-31T22:40:55.529 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 --2- 172.21.15.66:0/2888468246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c040b1570 0x7f7c04024f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.529 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 --2- 172.21.15.66:0/2888468246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c04025480 0x7f7c0407fcd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.529 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 -- 172.21.15.66:0/2888468246 >> 172.21.15.66:0/2888468246 conn(0x7f7c040b5440 msgr2=0x7f7c040b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:55.530 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 -- 172.21.15.66:0/2888468246 shutdown_connections 2020-10-31T22:40:55.530 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 -- 172.21.15.66:0/2888468246 wait complete. 2020-10-31T22:40:55.530 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 Processor -- start 2020-10-31T22:40:55.531 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 -- start start 2020-10-31T22:40:55.531 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c04025480 0x7f7c0412eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.531 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c040801c0 0x7f7c040a32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.531 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c040b1570 0x7f7c040a3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.532 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0412fee0 con 0x7f7c040801c0 2020-10-31T22:40:55.532 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c041316a0 con 0x7f7c04025480 2020-10-31T22:40:55.532 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.520+0000 7f7c0a429700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c040a3c80 con 0x7f7c040b1570 2020-10-31T22:40:55.536 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c09c28700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c04025480 0x7f7c0412eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.536 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c0b68b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c040b1570 0x7f7c040a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.537 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c09c28700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c04025480 0x7f7c0412eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55864/0 (socket says 172.21.15.66:55864) 2020-10-31T22:40:55.537 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c0b68b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c040b1570 0x7f7c040a3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:33948/0 (socket says 172.21.15.66:33948) 2020-10-31T22:40:55.537 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c09c28700 1 -- 172.21.15.66:0/2965647344 learned_addr learned my addr 172.21.15.66:0/2965647344 (peer_addr_for_me v2:172.21.15.66:0/0) 2020-10-31T22:40:55.538 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c09427700 1 --2- 172.21.15.66:0/2965647344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c040801c0 0x7f7c040a32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.538 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c09c28700 1 -- 172.21.15.66:0/2965647344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c040b1570 msgr2=0x7f7c040a3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.538 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c09c28700 1 --2- 172.21.15.66:0/2965647344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c040b1570 0x7f7c040a3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.539 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c09c28700 1 -- 172.21.15.66:0/2965647344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c040801c0 msgr2=0x7f7c040a32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.540 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c09c28700 1 --2- 172.21.15.66:0/2965647344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c040801c0 0x7f7c040a32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.540 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c09c28700 1 -- 172.21.15.66:0/2965647344 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c04131400 con 0x7f7c04025480 2020-10-31T22:40:55.540 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c09c28700 1 --2- 172.21.15.66:0/2965647344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c04025480 0x7f7c0412eb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f7bf4006c90 tx=0x7f7bf4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:55.540 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c027fc700 1 -- 172.21.15.66:0/2965647344 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf400ca80 con 0x7f7c04025480 2020-10-31T22:40:55.541 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c027fc700 1 -- 172.21.15.66:0/2965647344 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf400cbe0 con 0x7f7c04025480 2020-10-31T22:40:55.541 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c0a429700 1 -- 172.21.15.66:0/2965647344 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c04130140 con 0x7f7c04025480 2020-10-31T22:40:55.541 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c027fc700 1 -- 172.21.15.66:0/2965647344 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bf4009e20 con 0x7f7c04025480 2020-10-31T22:40:55.542 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c0a429700 1 -- 172.21.15.66:0/2965647344 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c040a48d0 con 0x7f7c04025480 2020-10-31T22:40:55.542 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c027fc700 1 -- 172.21.15.66:0/2965647344 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f7bf401d630 con 0x7f7c04025480 2020-10-31T22:40:55.542 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c027fc700 1 -- 172.21.15.66:0/2965647344 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f7bf401d8c0 con 0x7f7c04025480 2020-10-31T22:40:55.542 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.524+0000 7f7c0a429700 1 -- 172.21.15.66:0/2965647344 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0412f1a0 con 0x7f7c04025480 2020-10-31T22:40:55.543 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.528+0000 7f7c027fc700 1 -- 172.21.15.66:0/2965647344 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f7bf400f040 con 0x7f7c04025480 2020-10-31T22:40:55.636 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.636+0000 7f7c0a429700 1 -- 172.21.15.66:0/2965647344 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", "id": 2} v 0) v1 -- 0x7f7c041302d0 con 0x7f7c04025480 2020-10-31T22:40:55.643 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.644+0000 7f7c027fc700 1 -- 172.21.15.66:0/2965647344 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7bf401dd20 con 0x7f7c04025480 2020-10-31T22:40:55.643 INFO:teuthology.orchestra.run.smithi066.stdout:2 2020-10-31T22:40:55.644 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.644+0000 7f7c0a429700 1 -- 172.21.15.66:0/2965647344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c04025480 msgr2=0x7f7c0412eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.644 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.644+0000 7f7c0a429700 1 --2- 172.21.15.66:0/2965647344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c04025480 0x7f7c0412eb10 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f7bf4006c90 tx=0x7f7bf4008040).stop 2020-10-31T22:40:55.645 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.644+0000 7f7c0a429700 1 -- 172.21.15.66:0/2965647344 shutdown_connections 2020-10-31T22:40:55.645 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.644+0000 7f7c0a429700 1 --2- 172.21.15.66:0/2965647344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c040b1570 0x7f7c040a3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.645 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.644+0000 7f7c0a429700 1 --2- 172.21.15.66:0/2965647344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c04025480 0x7f7c0412eb10 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.645 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.644+0000 7f7c0a429700 1 --2- 172.21.15.66:0/2965647344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c040801c0 0x7f7c040a32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.645 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.644+0000 7f7c0a429700 1 -- 172.21.15.66:0/2965647344 >> 172.21.15.66:0/2965647344 conn(0x7f7c040b5440 msgr2=0x7f7c040ae470 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:55.646 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.644+0000 7f7c0a429700 1 -- 172.21.15.66:0/2965647344 shutdown_connections 2020-10-31T22:40:55.646 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.644+0000 7f7c0a429700 1 -- 172.21.15.66:0/2965647344 wait complete. 2020-10-31T22:40:55.656 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 48292ed1-84ef-42a1-818f-f3541c45b2db 3 2020-10-31T22:40:55.783 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff92759e700 1 Processor -- start 2020-10-31T22:40:55.783 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff92759e700 1 -- start start 2020-10-31T22:40:55.784 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff92759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff9280b1570 0x7ff928024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.784 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff92759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff928025480 0x7ff92807fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.784 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff92759e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9280b1950 con 0x7ff9280801c0 2020-10-31T22:40:55.784 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff92759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff928062720 con 0x7ff9280b1570 2020-10-31T22:40:55.784 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff92759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff928066cb0 con 0x7ff928025480 2020-10-31T22:40:55.785 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff92cda7700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff9280801c0 0x7ff9280afcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:45512/0 (socket says 172.21.15.66:45512) 2020-10-31T22:40:55.785 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff92cda7700 1 -- 172.21.15.66:0/1032047036 learned_addr learned my addr 172.21.15.66:0/1032047036 (peer_addr_for_me v1:172.21.15.66:0/0) 2020-10-31T22:40:55.786 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff91ffff700 1 --2- 172.21.15.66:0/1032047036 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff928025480 0x7ff92807fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.786 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff926d9d700 1 --2- 172.21.15.66:0/1032047036 >> v2:172.21.15.60:3300/0 conn(0x7ff9280b1570 0x7ff928024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.786 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff91ffff700 1 -- 172.21.15.66:0/1032047036 >> v2:172.21.15.60:3300/0 conn(0x7ff9280b1570 msgr2=0x7ff928024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:40:55.786 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff91ffff700 1 --2- 172.21.15.66:0/1032047036 >> v2:172.21.15.60:3300/0 conn(0x7ff9280b1570 0x7ff928024f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.786 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff91ffff700 1 -- 172.21.15.66:0/1032047036 >> v1:172.21.15.66:6789/0 conn(0x7ff9280801c0 legacy=0x7ff9280afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.786 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.772+0000 7ff91ffff700 1 -- 172.21.15.66:0/1032047036 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9280aca00 con 0x7ff928025480 2020-10-31T22:40:55.787 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.776+0000 7ff91ffff700 1 --2- 172.21.15.66:0/1032047036 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff928025480 0x7ff92807fcd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff910002f30 tx=0x7ff910006dc0).ready entity=mon.2 client_cookie=da57e32616a7cd16 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:55.787 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.776+0000 7ff92659c700 1 -- 172.21.15.66:0/1032047036 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9100097f0 con 0x7ff928025480 2020-10-31T22:40:55.787 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.776+0000 7ff92659c700 1 -- 172.21.15.66:0/1032047036 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff910009950 con 0x7ff928025480 2020-10-31T22:40:55.787 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.776+0000 7ff92659c700 1 -- 172.21.15.66:0/1032047036 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff910009cb0 con 0x7ff928025480 2020-10-31T22:40:55.787 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.776+0000 7ff92759e700 1 -- 172.21.15.66:0/1032047036 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff928025480 msgr2=0x7ff92807fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.787 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.776+0000 7ff92759e700 1 --2- 172.21.15.66:0/1032047036 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff928025480 0x7ff92807fcd0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7ff910002f30 tx=0x7ff910006dc0).stop 2020-10-31T22:40:55.787 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.776+0000 7ff92759e700 1 -- 172.21.15.66:0/1032047036 shutdown_connections 2020-10-31T22:40:55.788 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.776+0000 7ff92759e700 1 --2- 172.21.15.66:0/1032047036 >> v2:172.21.15.60:3300/0 conn(0x7ff9280b1570 0x7ff928024f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.788 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.776+0000 7ff92759e700 1 --2- 172.21.15.66:0/1032047036 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff928025480 0x7ff92807fcd0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.788 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.776+0000 7ff92759e700 1 -- 172.21.15.66:0/1032047036 >> 172.21.15.66:0/1032047036 conn(0x7ff9280b5440 msgr2=0x7ff9280b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:55.788 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.776+0000 7ff92759e700 1 -- 172.21.15.66:0/1032047036 shutdown_connections 2020-10-31T22:40:55.788 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.776+0000 7ff92759e700 1 -- 172.21.15.66:0/1032047036 wait complete. 2020-10-31T22:40:55.788 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff92759e700 1 Processor -- start 2020-10-31T22:40:55.789 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff92759e700 1 -- start start 2020-10-31T22:40:55.789 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff92759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff928025480 0x7ff9280a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.789 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff92759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff9280801c0 0x7ff92813e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.789 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff92759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9280b1570 0x7ff92813e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:55.789 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff92759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9280a6da0 con 0x7ff9280b1570 2020-10-31T22:40:55.789 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff92759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9280a6140 con 0x7ff928025480 2020-10-31T22:40:55.789 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff92759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff92813dc40 con 0x7ff9280801c0 2020-10-31T22:40:55.790 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff926d9d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff928025480 0x7ff9280a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.790 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff91ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff9280801c0 0x7ff92813e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.790 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff926d9d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff928025480 0x7ff9280a83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55874/0 (socket says 172.21.15.66:55874) 2020-10-31T22:40:55.790 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff926d9d700 1 -- 172.21.15.66:0/1767656556 learned_addr learned my addr 172.21.15.66:0/1767656556 (peer_addr_for_me v2:172.21.15.66:0/0) 2020-10-31T22:40:55.790 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff92cda7700 1 --2- 172.21.15.66:0/1767656556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9280b1570 0x7ff92813e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:55.790 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff91ffff700 1 -- 172.21.15.66:0/1767656556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff928025480 msgr2=0x7ff9280a83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.790 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff91ffff700 1 --2- 172.21.15.66:0/1767656556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff928025480 0x7ff9280a83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.791 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff91ffff700 1 -- 172.21.15.66:0/1767656556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9280b1570 msgr2=0x7ff92813e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.791 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff91ffff700 1 --2- 172.21.15.66:0/1767656556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9280b1570 0x7ff92813e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.791 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff91ffff700 1 -- 172.21.15.66:0/1767656556 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9280a51c0 con 0x7ff9280801c0 2020-10-31T22:40:55.791 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff92cda7700 1 --2- 172.21.15.66:0/1767656556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9280b1570 0x7ff92813e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:40:55.791 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff91ffff700 1 --2- 172.21.15.66:0/1767656556 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff9280801c0 0x7ff92813e290 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff910002f30 tx=0x7ff910015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:55.791 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff91f7fe700 1 -- 172.21.15.66:0/1767656556 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff910011b90 con 0x7ff9280801c0 2020-10-31T22:40:55.791 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff91f7fe700 1 -- 172.21.15.66:0/1767656556 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff910011cf0 con 0x7ff9280801c0 2020-10-31T22:40:55.792 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff91f7fe700 1 -- 172.21.15.66:0/1767656556 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff91001d640 con 0x7ff9280801c0 2020-10-31T22:40:55.792 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff92759e700 1 -- 172.21.15.66:0/1767656556 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff92813de30 con 0x7ff9280801c0 2020-10-31T22:40:55.792 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff92759e700 1 -- 172.21.15.66:0/1767656556 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9280ab510 con 0x7ff9280801c0 2020-10-31T22:40:55.792 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff91f7fe700 1 -- 172.21.15.66:0/1767656556 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 2) v1 ==== 33184+0+0 (secure 0 0 0) 0x7ff91000f070 con 0x7ff9280801c0 2020-10-31T22:40:55.792 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff91f7fe700 1 -- 172.21.15.66:0/1767656556 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7ff91003c1a0 con 0x7ff9280801c0 2020-10-31T22:40:55.792 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.780+0000 7ff9077fe700 1 -- 172.21.15.66:0/1767656556 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8fc003340 con 0x7ff9280801c0 2020-10-31T22:40:55.793 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.784+0000 7ff91f7fe700 1 -- 172.21.15.66:0/1767656556 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7ff910022070 con 0x7ff9280801c0 2020-10-31T22:40:55.870 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.868+0000 7ff9077fe700 1 -- 172.21.15.66:0/1767656556 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd new", "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", "id": 3} v 0) v1 -- 0x7ff8fc002200 con 0x7ff9280801c0 2020-10-31T22:40:55.875 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.876+0000 7ff91f7fe700 1 -- 172.21.15.66:0/1767656556 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff910022030 con 0x7ff9280801c0 2020-10-31T22:40:55.876 INFO:teuthology.orchestra.run.smithi066.stdout:3 2020-10-31T22:40:55.876 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.876+0000 7ff9077fe700 1 -- 172.21.15.66:0/1767656556 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff9280801c0 msgr2=0x7ff92813e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:55.877 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.876+0000 7ff9077fe700 1 --2- 172.21.15.66:0/1767656556 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff9280801c0 0x7ff92813e290 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff910002f30 tx=0x7ff910015000).stop 2020-10-31T22:40:55.877 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.876+0000 7ff9077fe700 1 -- 172.21.15.66:0/1767656556 shutdown_connections 2020-10-31T22:40:55.877 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.876+0000 7ff9077fe700 1 --2- 172.21.15.66:0/1767656556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff9280b1570 0x7ff92813e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.877 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.876+0000 7ff9077fe700 1 --2- 172.21.15.66:0/1767656556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff928025480 0x7ff9280a83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.877 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.876+0000 7ff9077fe700 1 --2- 172.21.15.66:0/1767656556 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff9280801c0 0x7ff92813e290 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:55.877 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.876+0000 7ff9077fe700 1 -- 172.21.15.66:0/1767656556 >> 172.21.15.66:0/1767656556 conn(0x7ff9280b5440 msgr2=0x7ff9280afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:55.878 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.876+0000 7ff9077fe700 1 -- 172.21.15.66:0/1767656556 shutdown_connections 2020-10-31T22:40:55.878 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.876+0000 7ff9077fe700 1 -- 172.21.15.66:0/1767656556 wait complete. 2020-10-31T22:40:55.889 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 019bc4f3-4ff6-4aaa-b822-2613e251a63e 4 2020-10-31T22:40:55.999 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.992+0000 7f59fece8700 1 Processor -- start 2020-10-31T22:40:56.000 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.992+0000 7f59fece8700 1 -- start start 2020-10-31T22:40:56.000 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59f80b1570 0x7f59f8024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.001 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f59f8025480 0x7f59f807fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.001 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f59f80801c0 0x7f59f80afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.001 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f80b1950 con 0x7f59f80801c0 2020-10-31T22:40:56.001 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f8062720 con 0x7f59f8025480 2020-10-31T22:40:56.002 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f8066cb0 con 0x7f59f80b1570 2020-10-31T22:40:56.002 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fdce6700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f59f8025480 0x7f59f807fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.002 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fe4e7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59f80b1570 0x7f59f8024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.002 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fdce6700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f59f8025480 0x7f59f807fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55882/0 (socket says 172.21.15.66:55882) 2020-10-31T22:40:56.003 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fdce6700 1 -- 172.21.15.66:0/1873306865 learned_addr learned my addr 172.21.15.66:0/1873306865 (peer_addr_for_me v2:172.21.15.66:0/0) 2020-10-31T22:40:56.003 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fff4a700 1 --2- 172.21.15.66:0/1873306865 >> v2:172.21.15.60:3300/0 conn(0x7f59f80801c0 0x7f59f80afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.003 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fe4e7700 1 -- 172.21.15.66:0/1873306865 >> v2:172.21.15.66:3300/0 conn(0x7f59f8025480 msgr2=0x7f59f807fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:40:56.004 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fe4e7700 1 --2- 172.21.15.66:0/1873306865 >> v2:172.21.15.66:3300/0 conn(0x7f59f8025480 0x7f59f807fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.004 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fe4e7700 1 -- 172.21.15.66:0/1873306865 >> v2:172.21.15.60:3300/0 conn(0x7f59f80801c0 msgr2=0x7f59f80afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:40:56.004 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fe4e7700 1 --2- 172.21.15.66:0/1873306865 >> v2:172.21.15.60:3300/0 conn(0x7f59f80801c0 0x7f59f80afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.005 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fe4e7700 1 -- 172.21.15.66:0/1873306865 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f80aca00 con 0x7f59f80b1570 2020-10-31T22:40:56.005 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fdce6700 1 --2- 172.21.15.66:0/1873306865 >> v2:172.21.15.66:3300/0 conn(0x7f59f8025480 0x7f59f807fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:40:56.005 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fe4e7700 1 --2- 172.21.15.66:0/1873306865 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59f80b1570 0x7f59f8024f90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f59f4002f30 tx=0x7f59f4006dc0).ready entity=mon.2 client_cookie=d39b579ca8bfd248 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:56.005 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fd4e5700 1 -- 172.21.15.66:0/1873306865 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59f4009710 con 0x7f59f80b1570 2020-10-31T22:40:56.006 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fd4e5700 1 -- 172.21.15.66:0/1873306865 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f4009870 con 0x7f59f80b1570 2020-10-31T22:40:56.006 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fd4e5700 1 -- 172.21.15.66:0/1873306865 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59f4009bd0 con 0x7f59f80b1570 2020-10-31T22:40:56.006 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 -- 172.21.15.66:0/1873306865 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59f80b1570 msgr2=0x7f59f8024f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.006 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 --2- 172.21.15.66:0/1873306865 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59f80b1570 0x7f59f8024f90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7f59f4002f30 tx=0x7f59f4006dc0).stop 2020-10-31T22:40:56.007 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 -- 172.21.15.66:0/1873306865 shutdown_connections 2020-10-31T22:40:56.007 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 --2- 172.21.15.66:0/1873306865 >> v2:172.21.15.60:3300/0 conn(0x7f59f80801c0 0x7f59f80afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.007 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 --2- 172.21.15.66:0/1873306865 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59f80b1570 0x7f59f8024f90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.007 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 --2- 172.21.15.66:0/1873306865 >> v2:172.21.15.66:3300/0 conn(0x7f59f8025480 0x7f59f807fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.008 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 -- 172.21.15.66:0/1873306865 >> 172.21.15.66:0/1873306865 conn(0x7f59f80b5440 msgr2=0x7f59f80b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:56.008 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 -- 172.21.15.66:0/1873306865 shutdown_connections 2020-10-31T22:40:56.008 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 -- 172.21.15.66:0/1873306865 wait complete. 2020-10-31T22:40:56.008 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 Processor -- start 2020-10-31T22:40:56.009 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:55.996+0000 7f59fece8700 1 -- start start 2020-10-31T22:40:56.012 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fece8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f8025480 0x7f59f812eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.012 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fece8700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f80801c0 0x7f59f812c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.013 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fece8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59f80b1570 0x7f59f812cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.013 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fece8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f812d2e0 con 0x7f59f8025480 2020-10-31T22:40:56.013 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fece8700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f8131c20 con 0x7f59f80801c0 2020-10-31T22:40:56.013 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fece8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f8132620 con 0x7f59f80b1570 2020-10-31T22:40:56.014 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fdce6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f80801c0 0x7f59f812c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.014 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fff4a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59f80b1570 0x7f59f812cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.014 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fdce6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f80801c0 0x7f59f812c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55888/0 (socket says 172.21.15.66:55888) 2020-10-31T22:40:56.014 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fdce6700 1 -- 172.21.15.66:0/3741860109 learned_addr learned my addr 172.21.15.66:0/3741860109 (peer_addr_for_me v2:172.21.15.66:0/0) 2020-10-31T22:40:56.015 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fe4e7700 1 --2- 172.21.15.66:0/3741860109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f8025480 0x7f59f812eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.015 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fff4a700 1 -- 172.21.15.66:0/3741860109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f80801c0 msgr2=0x7f59f812c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.015 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fff4a700 1 --2- 172.21.15.66:0/3741860109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f80801c0 0x7f59f812c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.015 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fff4a700 1 -- 172.21.15.66:0/3741860109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f8025480 msgr2=0x7f59f812eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.016 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fff4a700 1 --2- 172.21.15.66:0/3741860109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f8025480 0x7f59f812eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.016 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fff4a700 1 -- 172.21.15.66:0/3741860109 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f807b090 con 0x7f59f80b1570 2020-10-31T22:40:56.016 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fff4a700 1 --2- 172.21.15.66:0/3741860109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59f80b1570 0x7f59f812cdf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f59f000a000 tx=0x7f59f0008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:56.016 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59eeffd700 1 -- 172.21.15.66:0/3741860109 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59f000b980 con 0x7f59f80b1570 2020-10-31T22:40:56.017 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59eeffd700 1 -- 172.21.15.66:0/3741860109 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59f000bae0 con 0x7f59f80b1570 2020-10-31T22:40:56.017 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fece8700 1 -- 172.21.15.66:0/3741860109 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f807b330 con 0x7f59f80b1570 2020-10-31T22:40:56.017 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59eeffd700 1 -- 172.21.15.66:0/3741860109 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59f000be40 con 0x7f59f80b1570 2020-10-31T22:40:56.017 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fece8700 1 -- 172.21.15.66:0/3741860109 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f807dcc0 con 0x7f59f80b1570 2020-10-31T22:40:56.017 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59fece8700 1 -- 172.21.15.66:0/3741860109 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f812f3a0 con 0x7f59f80b1570 2020-10-31T22:40:56.018 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59eeffd700 1 -- 172.21.15.66:0/3741860109 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 2) v1 ==== 33184+0+0 (secure 0 0 0) 0x7f59f001c460 con 0x7f59f80b1570 2020-10-31T22:40:56.018 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.000+0000 7f59eeffd700 1 -- 172.21.15.66:0/3741860109 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1590+0+0 (secure 0 0 0) 0x7f59f003b9f0 con 0x7f59f80b1570 2020-10-31T22:40:56.018 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.004+0000 7f59eeffd700 1 -- 172.21.15.66:0/3741860109 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f59f00108d0 con 0x7f59f80b1570 2020-10-31T22:40:56.109 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.108+0000 7f59fece8700 1 -- 172.21.15.66:0/3741860109 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd new", "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", "id": 4} v 0) v1 -- 0x7f59f8132480 con 0x7f59f80b1570 2020-10-31T22:40:56.117 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.116+0000 7f59eeffd700 1 -- 172.21.15.66:0/3741860109 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f59f8132480 con 0x7f59f80b1570 2020-10-31T22:40:56.118 INFO:teuthology.orchestra.run.smithi066.stdout:4 2020-10-31T22:40:56.119 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.116+0000 7f59fece8700 1 -- 172.21.15.66:0/3741860109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59f80b1570 msgr2=0x7f59f812cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.119 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.116+0000 7f59fece8700 1 --2- 172.21.15.66:0/3741860109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59f80b1570 0x7f59f812cdf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f59f000a000 tx=0x7f59f0008040).stop 2020-10-31T22:40:56.119 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.116+0000 7f59fece8700 1 -- 172.21.15.66:0/3741860109 shutdown_connections 2020-10-31T22:40:56.120 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.116+0000 7f59fece8700 1 --2- 172.21.15.66:0/3741860109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59f80b1570 0x7f59f812cdf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.120 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.116+0000 7f59fece8700 1 --2- 172.21.15.66:0/3741860109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59f8025480 0x7f59f812eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.120 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.116+0000 7f59fece8700 1 --2- 172.21.15.66:0/3741860109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59f80801c0 0x7f59f812c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.121 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.116+0000 7f59fece8700 1 -- 172.21.15.66:0/3741860109 >> 172.21.15.66:0/3741860109 conn(0x7f59f80b5440 msgr2=0x7f59f807f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:56.121 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.116+0000 7f59fece8700 1 -- 172.21.15.66:0/3741860109 shutdown_connections 2020-10-31T22:40:56.121 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.116+0000 7f59fece8700 1 -- 172.21.15.66:0/3741860109 wait complete. 2020-10-31T22:40:56.136 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 79a0f0a3-769d-454a-8d26-04d8bc544575 5 2020-10-31T22:40:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c2878e700 1 Processor -- start 2020-10-31T22:40:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c2878e700 1 -- start start 2020-10-31T22:40:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c2878e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0c2005b320 0x7f0c2007ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.262 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c2878e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c200ac110 0x7f0c200af980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c2878e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c2005b700 con 0x7f0c200ae200 2020-10-31T22:40:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c2878e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c200807c0 con 0x7f0c2005b320 2020-10-31T22:40:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c2878e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c200ab730 con 0x7f0c200ac110 2020-10-31T22:40:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c26d2b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0c2005b320 0x7f0c2007ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c2752c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c200ac110 0x7f0c200af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.263 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c26d2b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0c2005b320 0x7f0c2007ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55892/0 (socket says 172.21.15.66:55892) 2020-10-31T22:40:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c26d2b700 1 -- 172.21.15.66:0/2714408538 learned_addr learned my addr 172.21.15.66:0/2714408538 (peer_addr_for_me v2:172.21.15.66:0/0) 2020-10-31T22:40:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c26d2b700 1 -- 172.21.15.66:0/2714408538 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c200ac110 msgr2=0x7f0c200af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:40:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c26d2b700 1 --2- 172.21.15.66:0/2714408538 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c200ac110 0x7f0c200af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c26d2b700 1 -- 172.21.15.66:0/2714408538 >> v1:172.21.15.60:6789/0 conn(0x7f0c200ae200 legacy=0x7f0c200a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c26d2b700 1 -- 172.21.15.66:0/2714408538 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c200ab9d0 con 0x7f0c2005b320 2020-10-31T22:40:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c26d2b700 1 --2- 172.21.15.66:0/2714408538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c2005b320 0x7f0c2007ff20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0c1c002f30 tx=0x7f0c1c006e80).ready entity=mon.1 client_cookie=eadd74a4b6b7a819 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:56.264 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c25d29700 1 -- 172.21.15.66:0/2714408538 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1c0097f0 con 0x7f0c2005b320 2020-10-31T22:40:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c25d29700 1 -- 172.21.15.66:0/2714408538 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1c009950 con 0x7f0c2005b320 2020-10-31T22:40:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.255+0000 7f0c25d29700 1 -- 172.21.15.66:0/2714408538 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1c009cf0 con 0x7f0c2005b320 2020-10-31T22:40:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.259+0000 7f0c2878e700 1 -- 172.21.15.66:0/2714408538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c2005b320 msgr2=0x7f0c2007ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.259+0000 7f0c2878e700 1 --2- 172.21.15.66:0/2714408538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c2005b320 0x7f0c2007ff20 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0c1c002f30 tx=0x7f0c1c006e80).stop 2020-10-31T22:40:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.259+0000 7f0c2878e700 1 -- 172.21.15.66:0/2714408538 shutdown_connections 2020-10-31T22:40:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.259+0000 7f0c2878e700 1 --2- 172.21.15.66:0/2714408538 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c200ac110 0x7f0c200af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.265 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.259+0000 7f0c2878e700 1 --2- 172.21.15.66:0/2714408538 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c2005b320 0x7f0c2007ff20 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.259+0000 7f0c2878e700 1 -- 172.21.15.66:0/2714408538 >> 172.21.15.66:0/2714408538 conn(0x7f0c200b3fd0 msgr2=0x7f0c200b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.259+0000 7f0c2878e700 1 -- 172.21.15.66:0/2714408538 shutdown_connections 2020-10-31T22:40:56.266 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.259+0000 7f0c2878e700 1 -- 172.21.15.66:0/2714408538 wait complete. 2020-10-31T22:40:56.268 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.259+0000 7f0c2878e700 1 Processor -- start 2020-10-31T22:40:56.268 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.259+0000 7f0c2878e700 1 -- start start 2020-10-31T22:40:56.268 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2878e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c2005b320 0x7f0c200644c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.268 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2878e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c200ac110 0x7f0c2013c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.268 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2878e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c200ae200 0x7f0c2013c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.268 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2878e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c20063c30 con 0x7f0c2005b320 2020-10-31T22:40:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2878e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2013c020 con 0x7f0c200ae200 2020-10-31T22:40:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2878e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2013ce30 con 0x7f0c200ac110 2020-10-31T22:40:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2652a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c200ac110 0x7f0c2013c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2652a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c200ac110 0x7f0c2013c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:33982/0 (socket says 172.21.15.66:33982) 2020-10-31T22:40:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2752c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c200ae200 0x7f0c2013c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.269 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2652a700 1 -- 172.21.15.66:0/3463419862 learned_addr learned my addr 172.21.15.66:0/3463419862 (peer_addr_for_me v2:172.21.15.66:0/0) 2020-10-31T22:40:56.270 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c26d2b700 1 --2- 172.21.15.66:0/3463419862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c2005b320 0x7f0c200644c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.270 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2752c700 1 -- 172.21.15.66:0/3463419862 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c200ac110 msgr2=0x7f0c2013c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.270 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2752c700 1 --2- 172.21.15.66:0/3463419862 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c200ac110 0x7f0c2013c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.270 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2752c700 1 -- 172.21.15.66:0/3463419862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c2005b320 msgr2=0x7f0c200644c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.270 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2752c700 1 --2- 172.21.15.66:0/3463419862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c2005b320 0x7f0c200644c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.270 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2752c700 1 -- 172.21.15.66:0/3463419862 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c201313e0 con 0x7f0c200ae200 2020-10-31T22:40:56.271 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2652a700 1 --2- 172.21.15.66:0/3463419862 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c200ac110 0x7f0c2013c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:40:56.271 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c26d2b700 1 --2- 172.21.15.66:0/3463419862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c2005b320 0x7f0c200644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:40:56.271 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2752c700 1 --2- 172.21.15.66:0/3463419862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c200ae200 0x7f0c2013c940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f0c2009e940 tx=0x7f0c180091a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:56.271 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c177fe700 1 -- 172.21.15.66:0/3463419862 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c1800cc10 con 0x7f0c200ae200 2020-10-31T22:40:56.271 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c177fe700 1 -- 172.21.15.66:0/3463419862 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c1800cd70 con 0x7f0c200ae200 2020-10-31T22:40:56.271 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2878e700 1 -- 172.21.15.66:0/3463419862 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c20131680 con 0x7f0c200ae200 2020-10-31T22:40:56.271 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c177fe700 1 -- 172.21.15.66:0/3463419862 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0c180125e0 con 0x7f0c200ae200 2020-10-31T22:40:56.272 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2878e700 1 -- 172.21.15.66:0/3463419862 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c20139ac0 con 0x7f0c200ae200 2020-10-31T22:40:56.272 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c177fe700 1 -- 172.21.15.66:0/3463419862 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 2) v1 ==== 33184+0+0 (secure 0 0 0) 0x7f0c18012740 con 0x7f0c200ae200 2020-10-31T22:40:56.272 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c2878e700 1 -- 172.21.15.66:0/3463419862 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2013c160 con 0x7f0c200ae200 2020-10-31T22:40:56.272 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.263+0000 7f0c177fe700 1 -- 172.21.15.66:0/3463419862 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1729+0+0 (secure 0 0 0) 0x7f0c1803bd30 con 0x7f0c200ae200 2020-10-31T22:40:56.272 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.267+0000 7f0c177fe700 1 -- 172.21.15.66:0/3463419862 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f0c18012cb0 con 0x7f0c200ae200 2020-10-31T22:40:56.352 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.347+0000 7f0c2878e700 1 -- 172.21.15.66:0/3463419862 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", "id": 5} v 0) v1 -- 0x7f0c20057100 con 0x7f0c200ae200 2020-10-31T22:40:56.359 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.355+0000 7f0c177fe700 1 -- 172.21.15.66:0/3463419862 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0c180212a0 con 0x7f0c200ae200 2020-10-31T22:40:56.360 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.355+0000 7f0c2878e700 1 -- 172.21.15.66:0/3463419862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c200ae200 msgr2=0x7f0c2013c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.360 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.355+0000 7f0c2878e700 1 --2- 172.21.15.66:0/3463419862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c200ae200 0x7f0c2013c940 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f0c2009e940 tx=0x7f0c180091a0).stop 2020-10-31T22:40:56.360 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.359+0000 7f0c2878e700 1 -- 172.21.15.66:0/3463419862 shutdown_connections 2020-10-31T22:40:56.360 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.359+0000 7f0c2878e700 1 --2- 172.21.15.66:0/3463419862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0c200ae200 0x7f0c2013c940 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.360 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.359+0000 7f0c2878e700 1 --2- 172.21.15.66:0/3463419862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0c2005b320 0x7f0c200644c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.361 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.359+0000 7f0c2878e700 1 --2- 172.21.15.66:0/3463419862 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0c200ac110 0x7f0c2013c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.361 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.359+0000 7f0c2878e700 1 -- 172.21.15.66:0/3463419862 >> 172.21.15.66:0/3463419862 conn(0x7f0c200b3fd0 msgr2=0x7f0c200aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:56.361 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.359+0000 7f0c2878e700 1 -- 172.21.15.66:0/3463419862 shutdown_connections 2020-10-31T22:40:56.361 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.359+0000 7f0c2878e700 1 -- 172.21.15.66:0/3463419862 wait complete. 2020-10-31T22:40:56.361 INFO:teuthology.orchestra.run.smithi066.stdout:5 2020-10-31T22:40:56.371 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 0fb1e61f-a193-4798-bfaa-8f4e4ad01a12 6 2020-10-31T22:40:56.471 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abe2d4700 1 Processor -- start 2020-10-31T22:40:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abe2d4700 1 -- start start 2020-10-31T22:40:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abe2d4700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3ab80b1570 0x7f3ab8024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abe2d4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab80b1950 con 0x7f3ab80803e0 2020-10-31T22:40:56.472 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abe2d4700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab8025910 con 0x7f3ab8025480 2020-10-31T22:40:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abe2d4700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab8080850 con 0x7f3ab80b1570 2020-10-31T22:40:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abdad3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3ab80b1570 0x7f3ab8024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abd2d2700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f3ab8025480 0x7f3ab807fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:45548/0 (socket says 172.21.15.66:45548) 2020-10-31T22:40:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abd2d2700 1 -- 172.21.15.66:0/3590561276 learned_addr learned my addr 172.21.15.66:0/3590561276 (peer_addr_for_me v1:172.21.15.66:0/0) 2020-10-31T22:40:56.473 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abdad3700 1 -- 172.21.15.66:0/3590561276 >> v1:172.21.15.66:6789/0 conn(0x7f3ab8025480 legacy=0x7f3ab807fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abdad3700 1 -- 172.21.15.66:0/3590561276 >> v1:172.21.15.60:6789/0 conn(0x7f3ab80803e0 legacy=0x7f3ab8159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abdad3700 1 -- 172.21.15.66:0/3590561276 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab8062720 con 0x7f3ab80b1570 2020-10-31T22:40:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abdad3700 1 --2- 172.21.15.66:0/3590561276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab80b1570 0x7f3ab8024f90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3ab4002f30 tx=0x7f3ab4006dc0).ready entity=mon.1 client_cookie=905a6fed816d42c4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abcad1700 1 -- 172.21.15.66:0/3590561276 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ab40097f0 con 0x7f3ab80b1570 2020-10-31T22:40:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abcad1700 1 -- 172.21.15.66:0/3590561276 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab4009950 con 0x7f3ab80b1570 2020-10-31T22:40:56.474 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abcad1700 1 -- 172.21.15.66:0/3590561276 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ab4009cb0 con 0x7f3ab80b1570 2020-10-31T22:40:56.475 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abe2d4700 1 -- 172.21.15.66:0/3590561276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab80b1570 msgr2=0x7f3ab8024f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.475 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abe2d4700 1 --2- 172.21.15.66:0/3590561276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab80b1570 0x7f3ab8024f90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f3ab4002f30 tx=0x7f3ab4006dc0).stop 2020-10-31T22:40:56.475 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abe2d4700 1 -- 172.21.15.66:0/3590561276 shutdown_connections 2020-10-31T22:40:56.475 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abe2d4700 1 --2- 172.21.15.66:0/3590561276 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab80b1570 0x7f3ab8024f90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.475 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abe2d4700 1 -- 172.21.15.66:0/3590561276 >> 172.21.15.66:0/3590561276 conn(0x7f3ab80b5440 msgr2=0x7f3ab80b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:56.475 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abe2d4700 1 -- 172.21.15.66:0/3590561276 shutdown_connections 2020-10-31T22:40:56.476 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.467+0000 7f3abe2d4700 1 -- 172.21.15.66:0/3590561276 wait complete. 2020-10-31T22:40:56.479 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abe2d4700 1 Processor -- start 2020-10-31T22:40:56.479 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abe2d4700 1 -- start start 2020-10-31T22:40:56.479 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abe2d4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ab8025480 0x7f3ab80aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.480 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abe2d4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab80803e0 0x7f3ab8162b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.480 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abe2d4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab80b1570 0x7f3ab815ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.480 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abe2d4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab80ac140 con 0x7f3ab80b1570 2020-10-31T22:40:56.480 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abe2d4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab8162140 con 0x7f3ab80803e0 2020-10-31T22:40:56.481 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abe2d4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab81623e0 con 0x7f3ab8025480 2020-10-31T22:40:56.481 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abd2d2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab80803e0 0x7f3ab8162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.481 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abd2d2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab80803e0 0x7f3ab8162b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55912/0 (socket says 172.21.15.66:55912) 2020-10-31T22:40:56.481 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abdad3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ab8025480 0x7f3ab80aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.481 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abd2d2700 1 -- 172.21.15.66:0/3272233300 learned_addr learned my addr 172.21.15.66:0/3272233300 (peer_addr_for_me v2:172.21.15.66:0/0) 2020-10-31T22:40:56.482 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abf536700 1 --2- 172.21.15.66:0/3272233300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab80b1570 0x7f3ab815ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.482 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abd2d2700 1 -- 172.21.15.66:0/3272233300 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ab8025480 msgr2=0x7f3ab80aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.482 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abd2d2700 1 --2- 172.21.15.66:0/3272233300 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ab8025480 0x7f3ab80aaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.482 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abd2d2700 1 -- 172.21.15.66:0/3272233300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab80b1570 msgr2=0x7f3ab815ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.482 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abd2d2700 1 --2- 172.21.15.66:0/3272233300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab80b1570 0x7f3ab815ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.483 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abd2d2700 1 -- 172.21.15.66:0/3272233300 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab8162680 con 0x7f3ab80803e0 2020-10-31T22:40:56.483 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abf536700 1 --2- 172.21.15.66:0/3272233300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab80b1570 0x7f3ab815ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:40:56.483 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abd2d2700 1 --2- 172.21.15.66:0/3272233300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab80803e0 0x7f3ab8162b20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3ab8062110 tx=0x7f3aa8007bd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:56.483 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3aae7fc700 1 -- 172.21.15.66:0/3272233300 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aa80072e0 con 0x7f3ab80803e0 2020-10-31T22:40:56.483 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3aae7fc700 1 -- 172.21.15.66:0/3272233300 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa8007440 con 0x7f3ab80803e0 2020-10-31T22:40:56.483 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abe2d4700 1 -- 172.21.15.66:0/3272233300 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab80abe30 con 0x7f3ab80803e0 2020-10-31T22:40:56.484 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3aae7fc700 1 -- 172.21.15.66:0/3272233300 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aa80057d0 con 0x7f3ab80803e0 2020-10-31T22:40:56.484 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abe2d4700 1 -- 172.21.15.66:0/3272233300 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab80b41a0 con 0x7f3ab80803e0 2020-10-31T22:40:56.484 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3aae7fc700 1 -- 172.21.15.66:0/3272233300 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 2) v1 ==== 33184+0+0 (secure 0 0 0) 0x7f3aa801a060 con 0x7f3ab80803e0 2020-10-31T22:40:56.484 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3abe2d4700 1 -- 172.21.15.66:0/3272233300 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab8057100 con 0x7f3ab80803e0 2020-10-31T22:40:56.485 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.471+0000 7f3aae7fc700 1 -- 172.21.15.66:0/3272233300 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1844+0+0 (secure 0 0 0) 0x7f3aa803ad50 con 0x7f3ab80803e0 2020-10-31T22:40:56.485 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.475+0000 7f3aae7fc700 1 -- 172.21.15.66:0/3272233300 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f3aa8005b20 con 0x7f3ab80803e0 2020-10-31T22:40:56.558 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.555+0000 7f3abe2d4700 1 -- 172.21.15.66:0/3272233300 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", "id": 6} v 0) v1 -- 0x7f3ab8062920 con 0x7f3ab80803e0 2020-10-31T22:40:56.568 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.563+0000 7f3aae7fc700 1 -- 172.21.15.66:0/3272233300 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3aa8018030 con 0x7f3ab80803e0 2020-10-31T22:40:56.569 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.567+0000 7f3abe2d4700 1 -- 172.21.15.66:0/3272233300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab80803e0 msgr2=0x7f3ab8162b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.569 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.567+0000 7f3abe2d4700 1 --2- 172.21.15.66:0/3272233300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab80803e0 0x7f3ab8162b20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3ab8062110 tx=0x7f3aa8007bd0).stop 2020-10-31T22:40:56.569 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.567+0000 7f3abe2d4700 1 -- 172.21.15.66:0/3272233300 shutdown_connections 2020-10-31T22:40:56.569 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.567+0000 7f3abe2d4700 1 --2- 172.21.15.66:0/3272233300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ab80b1570 0x7f3ab815ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.570 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.567+0000 7f3abe2d4700 1 --2- 172.21.15.66:0/3272233300 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ab8025480 0x7f3ab80aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.570 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.567+0000 7f3abe2d4700 1 --2- 172.21.15.66:0/3272233300 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ab80803e0 0x7f3ab8162b20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.570 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.567+0000 7f3abe2d4700 1 -- 172.21.15.66:0/3272233300 >> 172.21.15.66:0/3272233300 conn(0x7f3ab80b5440 msgr2=0x7f3ab80acec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:56.570 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.567+0000 7f3abe2d4700 1 -- 172.21.15.66:0/3272233300 shutdown_connections 2020-10-31T22:40:56.571 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.567+0000 7f3abe2d4700 1 -- 172.21.15.66:0/3272233300 wait complete. 2020-10-31T22:40:56.571 INFO:teuthology.orchestra.run.smithi066.stdout:6 2020-10-31T22:40:56.583 INFO:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 1bf0b828-c2b3-4c7a-9b24-914620a369b5 7 2020-10-31T22:40:56.700 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61ac12700 1 Processor -- start 2020-10-31T22:40:56.701 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61ac12700 1 -- start start 2020-10-31T22:40:56.701 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61ac12700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6140256a0 0x7ff61407fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.701 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61ac12700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6140b1950 con 0x7ff6140801c0 2020-10-31T22:40:56.702 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61ac12700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff614062720 con 0x7ff6140b1570 2020-10-31T22:40:56.702 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61ac12700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff614066cb0 con 0x7ff6140256a0 2020-10-31T22:40:56.702 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff619c10700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6140256a0 0x7ff61407fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.703 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff619c10700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6140256a0 0x7ff61407fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:33998/0 (socket says 172.21.15.66:33998) 2020-10-31T22:40:56.703 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff619c10700 1 -- 172.21.15.66:0/1829393944 learned_addr learned my addr 172.21.15.66:0/1829393944 (peer_addr_for_me v2:172.21.15.66:0/0) 2020-10-31T22:40:56.703 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61a411700 1 --1- 172.21.15.66:0/1829393944 >> v1:172.21.15.66:6789/0 conn(0x7ff6140b1570 0x7ff614024f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:45560/0 (socket says 172.21.15.66:45560) 2020-10-31T22:40:56.704 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff619c10700 1 -- 172.21.15.66:0/1829393944 >> v1:172.21.15.66:6789/0 conn(0x7ff6140b1570 legacy=0x7ff614024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.704 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff619c10700 1 -- 172.21.15.66:0/1829393944 >> v1:172.21.15.60:6789/0 conn(0x7ff6140801c0 legacy=0x7ff614159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.705 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff619c10700 1 -- 172.21.15.66:0/1829393944 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6140aca00 con 0x7ff6140256a0 2020-10-31T22:40:56.705 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff619c10700 1 --2- 172.21.15.66:0/1829393944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6140256a0 0x7ff61407fcd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7ff608002f30 tx=0x7ff608006e80).ready entity=mon.2 client_cookie=75d1f19d7d553120 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:56.705 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61940f700 1 -- 172.21.15.66:0/1829393944 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6080097f0 con 0x7ff6140256a0 2020-10-31T22:40:56.705 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61940f700 1 -- 172.21.15.66:0/1829393944 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff608009950 con 0x7ff6140256a0 2020-10-31T22:40:56.705 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61940f700 1 -- 172.21.15.66:0/1829393944 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff608009cb0 con 0x7ff6140256a0 2020-10-31T22:40:56.705 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61ac12700 1 -- 172.21.15.66:0/1829393944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6140256a0 msgr2=0x7ff61407fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.706 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61ac12700 1 --2- 172.21.15.66:0/1829393944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6140256a0 0x7ff61407fcd0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7ff608002f30 tx=0x7ff608006e80).stop 2020-10-31T22:40:56.706 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61ac12700 1 -- 172.21.15.66:0/1829393944 shutdown_connections 2020-10-31T22:40:56.706 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61ac12700 1 --2- 172.21.15.66:0/1829393944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6140256a0 0x7ff61407fcd0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.706 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.695+0000 7ff61ac12700 1 -- 172.21.15.66:0/1829393944 >> 172.21.15.66:0/1829393944 conn(0x7ff6140b5440 msgr2=0x7ff6140b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:56.706 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61ac12700 1 -- 172.21.15.66:0/1829393944 shutdown_connections 2020-10-31T22:40:56.707 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61ac12700 1 -- 172.21.15.66:0/1829393944 wait complete. 2020-10-31T22:40:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61ac12700 1 Processor -- start 2020-10-31T22:40:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61ac12700 1 -- start start 2020-10-31T22:40:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61ac12700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6140256a0 0x7ff61413ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61ac12700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6140801c0 0x7ff614141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61ac12700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6140b1570 0x7ff614065910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.709 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61ac12700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6140ac110 con 0x7ff6140801c0 2020-10-31T22:40:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61ac12700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff614141530 con 0x7ff6140256a0 2020-10-31T22:40:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61ac12700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6141417d0 con 0x7ff6140b1570 2020-10-31T22:40:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61a411700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6140256a0 0x7ff61413ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61be74700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6140b1570 0x7ff614065910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.710 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61a411700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6140256a0 0x7ff61413ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:55922/0 (socket says 172.21.15.66:55922) 2020-10-31T22:40:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61be74700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6140b1570 0x7ff614065910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:34006/0 (socket says 172.21.15.66:34006) 2020-10-31T22:40:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61a411700 1 -- 172.21.15.66:0/4078690070 learned_addr learned my addr 172.21.15.66:0/4078690070 (peer_addr_for_me v2:172.21.15.66:0/0) 2020-10-31T22:40:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff619c10700 1 --2- 172.21.15.66:0/4078690070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6140801c0 0x7ff614141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61a411700 1 -- 172.21.15.66:0/4078690070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6140b1570 msgr2=0x7ff614065910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61a411700 1 --2- 172.21.15.66:0/4078690070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6140b1570 0x7ff614065910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61a411700 1 -- 172.21.15.66:0/4078690070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6140801c0 msgr2=0x7ff614141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.711 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61a411700 1 --2- 172.21.15.66:0/4078690070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6140801c0 0x7ff614141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61a411700 1 -- 172.21.15.66:0/4078690070 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61413e2b0 con 0x7ff6140256a0 2020-10-31T22:40:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61a411700 1 --2- 172.21.15.66:0/4078690070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6140256a0 0x7ff61413ddc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7ff6140625a0 tx=0x7ff60c007ee0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff612ffd700 1 -- 172.21.15.66:0/4078690070 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff60c00ce40 con 0x7ff6140256a0 2020-10-31T22:40:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff612ffd700 1 -- 172.21.15.66:0/4078690070 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60c005ab0 con 0x7ff6140256a0 2020-10-31T22:40:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff61ac12700 1 -- 172.21.15.66:0/4078690070 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6140abd90 con 0x7ff6140256a0 2020-10-31T22:40:56.712 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.699+0000 7ff612ffd700 1 -- 172.21.15.66:0/4078690070 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff60c005e10 con 0x7ff6140256a0 2020-10-31T22:40:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.703+0000 7ff61ac12700 1 -- 172.21.15.66:0/4078690070 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff614152ea0 con 0x7ff6140256a0 2020-10-31T22:40:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.703+0000 7ff612ffd700 1 -- 172.21.15.66:0/4078690070 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 2) v1 ==== 33184+0+0 (secure 0 0 0) 0x7ff60c010030 con 0x7ff6140256a0 2020-10-31T22:40:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.703+0000 7ff61ac12700 1 -- 172.21.15.66:0/4078690070 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6140abf80 con 0x7ff6140256a0 2020-10-31T22:40:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.703+0000 7ff612ffd700 1 -- 172.21.15.66:0/4078690070 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1959+0+0 (secure 0 0 0) 0x7ff60c03b400 con 0x7ff6140256a0 2020-10-31T22:40:56.713 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.707+0000 7ff612ffd700 1 -- 172.21.15.66:0/4078690070 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7ff60c01bc10 con 0x7ff6140256a0 2020-10-31T22:40:56.786 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.783+0000 7ff612ffd700 1 -- 172.21.15.66:0/4078690070 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mgrmap(e 3) v1 ==== 66496+0+0 (secure 0 0 0) 0x7ff60c00a5a0 con 0x7ff6140256a0 2020-10-31T22:40:56.787 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.783+0000 7ff612ffd700 1 --2- 172.21.15.66:0/4078690070 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5f4055670 0x7ff5f4057a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:56.787 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.783+0000 7ff619c10700 1 --2- 172.21.15.66:0/4078690070 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5f4055670 0x7ff5f4057a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:56.788 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.787+0000 7ff619c10700 1 --2- 172.21.15.66:0/4078690070 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5f4055670 0x7ff5f4057a80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7ff60801c000 tx=0x7ff608015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:56.791 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.787+0000 7ff61ac12700 1 -- 172.21.15.66:0/4078690070 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", "id": 7} v 0) v1 -- 0x7ff6140ac310 con 0x7ff6140256a0 2020-10-31T22:40:56.797 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.795+0000 7ff612ffd700 1 -- 172.21.15.66:0/4078690070 <== mon.1 v2:172.21.15.66:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff60c046600 con 0x7ff6140256a0 2020-10-31T22:40:56.798 INFO:teuthology.orchestra.run.smithi066.stdout:7 2020-10-31T22:40:56.799 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.795+0000 7ff61ac12700 1 -- 172.21.15.66:0/4078690070 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5f4055670 msgr2=0x7ff5f4057a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.799 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.795+0000 7ff61ac12700 1 --2- 172.21.15.66:0/4078690070 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5f4055670 0x7ff5f4057a80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7ff60801c000 tx=0x7ff608015000).stop 2020-10-31T22:40:56.799 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.795+0000 7ff61ac12700 1 -- 172.21.15.66:0/4078690070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6140256a0 msgr2=0x7ff61413ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:56.800 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.795+0000 7ff61ac12700 1 --2- 172.21.15.66:0/4078690070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6140256a0 0x7ff61413ddc0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7ff6140625a0 tx=0x7ff60c007ee0).stop 2020-10-31T22:40:56.800 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.795+0000 7ff61ac12700 1 -- 172.21.15.66:0/4078690070 shutdown_connections 2020-10-31T22:40:56.800 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.795+0000 7ff61ac12700 1 --2- 172.21.15.66:0/4078690070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6140b1570 0x7ff614065910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.800 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.795+0000 7ff61ac12700 1 --2- 172.21.15.66:0/4078690070 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5f4055670 0x7ff5f4057a80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.801 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.795+0000 7ff61ac12700 1 --2- 172.21.15.66:0/4078690070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6140256a0 0x7ff61413ddc0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.801 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.795+0000 7ff61ac12700 1 --2- 172.21.15.66:0/4078690070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6140801c0 0x7ff614141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:56.801 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.795+0000 7ff61ac12700 1 -- 172.21.15.66:0/4078690070 >> 172.21.15.66:0/4078690070 conn(0x7ff6140b5440 msgr2=0x7ff6140ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:56.801 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.795+0000 7ff61ac12700 1 -- 172.21.15.66:0/4078690070 shutdown_connections 2020-10-31T22:40:56.802 INFO:teuthology.orchestra.run.smithi066.stderr:2020-10-31T22:40:56.795+0000 7ff61ac12700 1 -- 172.21.15.66:0/4078690070 wait complete. 2020-10-31T22:40:56.812 INFO:tasks.ceph.osd.0:Restarting daemon 2020-10-31T22:40:56.813 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-10-31T22:40:56.816 INFO:tasks.ceph.osd.0:Started 2020-10-31T22:40:56.817 INFO:tasks.ceph.osd.1:Restarting daemon 2020-10-31T22:40:56.818 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-10-31T22:40:56.820 INFO:tasks.ceph.osd.1:Started 2020-10-31T22:40:56.821 INFO:tasks.ceph.osd.2:Restarting daemon 2020-10-31T22:40:56.821 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-10-31T22:40:56.824 INFO:tasks.ceph.osd.2:Started 2020-10-31T22:40:56.825 INFO:tasks.ceph.osd.3:Restarting daemon 2020-10-31T22:40:56.825 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-10-31T22:40:56.828 INFO:tasks.ceph.osd.3:Started 2020-10-31T22:40:56.829 INFO:tasks.ceph.osd.4:Restarting daemon 2020-10-31T22:40:56.829 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-10-31T22:40:56.833 INFO:tasks.ceph.osd.4:Started 2020-10-31T22:40:56.835 INFO:tasks.ceph.osd.5:Restarting daemon 2020-10-31T22:40:56.836 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-10-31T22:40:56.838 INFO:tasks.ceph.osd.5:Started 2020-10-31T22:40:56.839 INFO:tasks.ceph.osd.6:Restarting daemon 2020-10-31T22:40:56.840 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-10-31T22:40:56.842 INFO:tasks.ceph.osd.6:Started 2020-10-31T22:40:56.842 INFO:tasks.ceph.osd.7:Restarting daemon 2020-10-31T22:40:56.843 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-10-31T22:40:56.844 INFO:tasks.ceph.osd.7:Started 2020-10-31T22:40:56.845 INFO:tasks.ceph:Waiting for OSDs to come up 2020-10-31T22:40:57.186 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-10-31T22:40:57.183+0000 7f3b8ac56d80 -1 Falling back to public interface 2020-10-31T22:40:57.211 INFO:tasks.ceph.osd.0.smithi060.stderr:2020-10-31T22:40:57.203+0000 7fd265c8bd80 -1 Falling back to public interface 2020-10-31T22:40:57.434 INFO:tasks.ceph.osd.1.smithi060.stderr:2020-10-31T22:40:57.431+0000 7fb71f728d80 -1 Falling back to public interface 2020-10-31T22:40:57.437 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-10-31T22:40:57.435+0000 7f8a05b02d80 -1 Falling back to public interface 2020-10-31T22:40:57.446 INFO:tasks.ceph.osd.4.smithi066.stderr:2020-10-31T22:40:57.443+0000 7efca2f33d80 -1 Falling back to public interface 2020-10-31T22:40:57.446 INFO:tasks.ceph.osd.3.smithi060.stderr:2020-10-31T22:40:57.443+0000 7f41e36e2d80 -1 Falling back to public interface 2020-10-31T22:40:57.465 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-10-31T22:40:57.463+0000 7f97a66d3d80 -1 Falling back to public interface 2020-10-31T22:40:57.469 INFO:tasks.ceph.osd.2.smithi060.stderr:2020-10-31T22:40:57.467+0000 7feab16a4d80 -1 Falling back to public interface 2020-10-31T22:40:57.652 INFO:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-10-31T22:40:57.755 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f325d043700 1 Processor -- start 2020-10-31T22:40:57.755 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f325d043700 1 -- start start 2020-10-31T22:40:57.756 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f325d043700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f32580ae200 0x7f32580a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:57.756 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f325d043700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f325805b700 con 0x7f325805b320 2020-10-31T22:40:57.756 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f325d043700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32580807c0 con 0x7f32580ac110 2020-10-31T22:40:57.756 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f325d043700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32580ab730 con 0x7f32580ae200 2020-10-31T22:40:57.756 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f325759e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f325805b320 0x7f325807ff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:44908/0 (socket says 172.21.15.60:44908) 2020-10-31T22:40:57.757 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f325759e700 1 -- 172.21.15.60:0/509437830 learned_addr learned my addr 172.21.15.60:0/509437830 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:40:57.757 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f3256d9d700 1 --2- 172.21.15.60:0/509437830 >> v2:172.21.15.66:3300/0 conn(0x7f32580ae200 0x7f32580a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:57.757 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f325659c700 1 -- 172.21.15.60:0/509437830 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125075860 0 0) 0x7f325805b700 con 0x7f325805b320 2020-10-31T22:40:57.757 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f325659c700 1 -- 172.21.15.60:0/509437830 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3244003230 con 0x7f325805b320 2020-10-31T22:40:57.757 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f3256d9d700 1 -- 172.21.15.60:0/509437830 >> v1:172.21.15.66:6789/0 conn(0x7f32580ac110 legacy=0x7f32580af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:57.758 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f3256d9d700 1 -- 172.21.15.60:0/509437830 >> v1:172.21.15.60:6789/0 conn(0x7f325805b320 legacy=0x7f325807ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:57.758 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f3256d9d700 1 -- 172.21.15.60:0/509437830 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32580ab9d0 con 0x7f32580ae200 2020-10-31T22:40:57.758 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.747+0000 7f3256d9d700 1 --2- 172.21.15.60:0/509437830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32580ae200 0x7f32580a74b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3248002f30 tx=0x7f3248006dc0).ready entity=mon.1 client_cookie=a04fa702197efe35 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:57.758 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325659c700 1 -- 172.21.15.60:0/509437830 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3248009800 con 0x7f32580ae200 2020-10-31T22:40:57.758 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325659c700 1 -- 172.21.15.60:0/509437830 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3248009960 con 0x7f32580ae200 2020-10-31T22:40:57.758 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 -- 172.21.15.60:0/509437830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32580ae200 msgr2=0x7f32580a74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:57.758 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325659c700 1 -- 172.21.15.60:0/509437830 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3248009cc0 con 0x7f32580ae200 2020-10-31T22:40:57.759 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 --2- 172.21.15.60:0/509437830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32580ae200 0x7f32580a74b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f3248002f30 tx=0x7f3248006dc0).stop 2020-10-31T22:40:57.759 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 -- 172.21.15.60:0/509437830 shutdown_connections 2020-10-31T22:40:57.759 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 --2- 172.21.15.60:0/509437830 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32580ae200 0x7f32580a74b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:57.759 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 -- 172.21.15.60:0/509437830 >> 172.21.15.60:0/509437830 conn(0x7f32580b3fd0 msgr2=0x7f32580b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:57.759 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 -- 172.21.15.60:0/509437830 shutdown_connections 2020-10-31T22:40:57.759 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 -- 172.21.15.60:0/509437830 wait complete. 2020-10-31T22:40:57.759 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 Processor -- start 2020-10-31T22:40:57.760 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 -- start start 2020-10-31T22:40:57.764 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f325805b320 0x7f325809ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:57.765 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32580ac110 0x7f32580637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:57.765 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32580ae200 0x7f3258140070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:57.765 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325809ef20 con 0x7f32580ae200 2020-10-31T22:40:57.765 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3258140b20 con 0x7f325805b320 2020-10-31T22:40:57.765 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325d043700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3258065c00 con 0x7f32580ac110 2020-10-31T22:40:57.766 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325c842700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32580ae200 0x7f3258140070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:57.766 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325c842700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32580ae200 0x7f3258140070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:40778/0 (socket says 172.21.15.60:40778) 2020-10-31T22:40:57.766 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325c842700 1 -- 172.21.15.60:0/1879135524 learned_addr learned my addr 172.21.15.60:0/1879135524 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:40:57.766 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325759e700 1 --2- 172.21.15.60:0/1879135524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f325805b320 0x7f325809ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:57.766 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f3256d9d700 1 --2- 172.21.15.60:0/1879135524 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32580ac110 0x7f32580637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:57.766 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325c842700 1 -- 172.21.15.60:0/1879135524 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32580ac110 msgr2=0x7f32580637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:57.767 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325c842700 1 --2- 172.21.15.60:0/1879135524 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32580ac110 0x7f32580637f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:57.767 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325c842700 1 -- 172.21.15.60:0/1879135524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f325805b320 msgr2=0x7f325809ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:57.767 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325c842700 1 --2- 172.21.15.60:0/1879135524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f325805b320 0x7f325809ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:57.767 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325c842700 1 -- 172.21.15.60:0/1879135524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3258065ea0 con 0x7f32580ae200 2020-10-31T22:40:57.768 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f325c842700 1 --2- 172.21.15.60:0/1879135524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32580ae200 0x7f3258140070 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f32580b3ee0 tx=0x7f3250007e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:57.768 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.751+0000 7f324ffff700 1 -- 172.21.15.60:0/1879135524 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3250006860 con 0x7f32580ae200 2020-10-31T22:40:57.768 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.755+0000 7f324ffff700 1 -- 172.21.15.60:0/1879135524 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32500069c0 con 0x7f32580ae200 2020-10-31T22:40:57.768 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.755+0000 7f324ffff700 1 -- 172.21.15.60:0/1879135524 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3250006d20 con 0x7f32580ae200 2020-10-31T22:40:57.768 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.755+0000 7f325d043700 1 -- 172.21.15.60:0/1879135524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32580804e0 con 0x7f32580ae200 2020-10-31T22:40:57.768 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.755+0000 7f325d043700 1 -- 172.21.15.60:0/1879135524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3258066670 con 0x7f32580ae200 2020-10-31T22:40:57.768 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.755+0000 7f325d043700 1 -- 172.21.15.60:0/1879135524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3258057100 con 0x7f32580ae200 2020-10-31T22:40:57.769 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.755+0000 7f324ffff700 1 -- 172.21.15.60:0/1879135524 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 3) v1 ==== 66496+0+0 (secure 0 0 0) 0x7f3250010070 con 0x7f32580ae200 2020-10-31T22:40:57.769 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.755+0000 7f324ffff700 1 --2- 172.21.15.60:0/1879135524 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f323c054ef0 0x7f323c0573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:40:57.769 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.755+0000 7f324ffff700 1 -- 172.21.15.60:0/1879135524 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 2074+0+0 (secure 0 0 0) 0x7f325006bef0 con 0x7f32580ae200 2020-10-31T22:40:57.769 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.755+0000 7f325759e700 1 --2- 172.21.15.60:0/1879135524 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f323c054ef0 0x7f323c0573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:40:57.769 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.755+0000 7f325759e700 1 --2- 172.21.15.60:0/1879135524 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f323c054ef0 0x7f323c0573b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f324000d000 tx=0x7f3240009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:40:57.769 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.759+0000 7f324ffff700 1 -- 172.21.15.60:0/1879135524 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3250040df0 con 0x7f32580ae200 2020-10-31T22:40:57.901 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.899+0000 7f325d043700 1 -- 172.21.15.60:0/1879135524 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f325805a8e0 con 0x7f32580ae200 2020-10-31T22:40:57.902 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.899+0000 7f324ffff700 1 -- 172.21.15.60:0/1879135524 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+8274 (secure 0 0 0) 0x7f3250022070 con 0x7f32580ae200 2020-10-31T22:40:57.902 INFO:teuthology.misc.health.smithi060.stdout: 2020-10-31T22:40:57.902 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":10,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:40:56.793397+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"7","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:40:57.904 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.899+0000 7f325d043700 1 -- 172.21.15.60:0/1879135524 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f323c054ef0 msgr2=0x7f323c0573b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:57.904 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.899+0000 7f325d043700 1 --2- 172.21.15.60:0/1879135524 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f323c054ef0 0x7f323c0573b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f324000d000 tx=0x7f3240009040).stop 2020-10-31T22:40:57.905 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.899+0000 7f325d043700 1 -- 172.21.15.60:0/1879135524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32580ae200 msgr2=0x7f3258140070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:40:57.905 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.899+0000 7f325d043700 1 --2- 172.21.15.60:0/1879135524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32580ae200 0x7f3258140070 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f32580b3ee0 tx=0x7f3250007e80).stop 2020-10-31T22:40:57.905 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.899+0000 7f325d043700 1 -- 172.21.15.60:0/1879135524 shutdown_connections 2020-10-31T22:40:57.905 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.899+0000 7f325d043700 1 --2- 172.21.15.60:0/1879135524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32580ae200 0x7f3258140070 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:57.905 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.899+0000 7f325d043700 1 --2- 172.21.15.60:0/1879135524 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f323c054ef0 0x7f323c0573b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:57.905 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.899+0000 7f325d043700 1 --2- 172.21.15.60:0/1879135524 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f325805b320 0x7f325809ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:57.906 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.899+0000 7f325d043700 1 --2- 172.21.15.60:0/1879135524 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32580ac110 0x7f32580637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:40:57.906 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.899+0000 7f325d043700 1 -- 172.21.15.60:0/1879135524 >> 172.21.15.60:0/1879135524 conn(0x7f32580b3fd0 msgr2=0x7f32580a7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:40:57.906 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.899+0000 7f325d043700 1 -- 172.21.15.60:0/1879135524 shutdown_connections 2020-10-31T22:40:57.906 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:40:57.899+0000 7f325d043700 1 -- 172.21.15.60:0/1879135524 wait complete. 2020-10-31T22:40:57.915 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-10-31T22:40:58.359 INFO:tasks.ceph.osd.0.smithi060.stderr:2020-10-31T22:40:58.355+0000 7fd265c8bd80 -1 osd.0 0 log_to_monitors {default=true} 2020-10-31T22:40:58.364 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-10-31T22:40:58.358+0000 7f3b8ac56d80 -1 osd.5 0 log_to_monitors {default=true} 2020-10-31T22:40:58.596 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-10-31T22:40:58.590+0000 7f8a05b02d80 -1 osd.6 0 log_to_monitors {default=true} 2020-10-31T22:40:58.596 INFO:tasks.ceph.osd.4.smithi066.stderr:2020-10-31T22:40:58.590+0000 7efca2f33d80 -1 osd.4 0 log_to_monitors {default=true} 2020-10-31T22:40:58.604 INFO:tasks.ceph.osd.1.smithi060.stderr:2020-10-31T22:40:58.603+0000 7fb71f728d80 -1 osd.1 0 log_to_monitors {default=true} 2020-10-31T22:40:58.630 INFO:tasks.ceph.osd.3.smithi060.stderr:2020-10-31T22:40:58.627+0000 7f41e36e2d80 -1 osd.3 0 log_to_monitors {default=true} 2020-10-31T22:40:58.643 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-10-31T22:40:58.638+0000 7f97a66d3d80 -1 osd.7 0 log_to_monitors {default=true} 2020-10-31T22:40:58.655 INFO:tasks.ceph.osd.2.smithi060.stderr:2020-10-31T22:40:58.651+0000 7feab16a4d80 -1 osd.2 0 log_to_monitors {default=true} 2020-10-31T22:41:00.291 INFO:tasks.ceph.osd.0.smithi060.stderr:2020-10-31T22:41:00.283+0000 7fd24eed7700 -1 osd.0 0 waiting for initial osdmap 2020-10-31T22:41:00.291 INFO:tasks.ceph.osd.3.smithi060.stderr:2020-10-31T22:41:00.287+0000 7f41cc92e700 -1 osd.3 0 waiting for initial osdmap 2020-10-31T22:41:00.292 INFO:tasks.ceph.osd.4.smithi066.stderr:2020-10-31T22:41:00.285+0000 7efc8c17f700 -1 osd.4 0 waiting for initial osdmap 2020-10-31T22:41:00.294 INFO:tasks.ceph.osd.1.smithi060.stderr:2020-10-31T22:41:00.287+0000 7fb708974700 -1 osd.1 0 waiting for initial osdmap 2020-10-31T22:41:00.295 INFO:tasks.ceph.osd.2.smithi060.stderr:2020-10-31T22:41:00.287+0000 7fea9a8f0700 -1 osd.2 0 waiting for initial osdmap 2020-10-31T22:41:00.295 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-10-31T22:41:00.289+0000 7f89eed4e700 -1 osd.6 0 waiting for initial osdmap 2020-10-31T22:41:00.296 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-10-31T22:41:00.293+0000 7f978f91f700 -1 osd.7 0 waiting for initial osdmap 2020-10-31T22:41:00.296 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-10-31T22:41:00.293+0000 7f3b73ea2700 -1 osd.5 0 waiting for initial osdmap 2020-10-31T22:41:04.727 INFO:teuthology.orchestra.run.smithi060:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-10-31T22:41:04.842 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d2674700 1 Processor -- start 2020-10-31T22:41:04.843 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d2674700 1 -- start start 2020-10-31T22:41:04.843 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d2674700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f30cc05b320 0x7f30cc07ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:04.843 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d2674700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30cc0ac110 0x7f30cc0af980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:04.843 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d2674700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30cc05b700 con 0x7f30cc0ae200 2020-10-31T22:41:04.843 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d2674700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30cc0807c0 con 0x7f30cc05b320 2020-10-31T22:41:04.843 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d2674700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0ab730 con 0x7f30cc0ac110 2020-10-31T22:41:04.844 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d0c11700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f30cc05b320 0x7f30cc07ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:04.844 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d1412700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30cc0ac110 0x7f30cc0af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:04.844 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d0c11700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f30cc05b320 0x7f30cc07ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:51934/0 (socket says 172.21.15.60:51934) 2020-10-31T22:41:04.844 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30cbfff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f30cc0ae200 0x7f30cc0a74b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:43000/0 (socket says 172.21.15.60:43000) 2020-10-31T22:41:04.844 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d0c11700 1 -- 172.21.15.60:0/3527821885 learned_addr learned my addr 172.21.15.60:0/3527821885 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:04.844 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d0c11700 1 -- 172.21.15.60:0/3527821885 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30cc0ac110 msgr2=0x7f30cc0af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:04.845 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d0c11700 1 --2- 172.21.15.60:0/3527821885 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30cc0ac110 0x7f30cc0af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:04.845 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d0c11700 1 -- 172.21.15.60:0/3527821885 >> v1:172.21.15.66:6789/0 conn(0x7f30cc0ae200 legacy=0x7f30cc0a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:04.845 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d0c11700 1 -- 172.21.15.60:0/3527821885 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc0ab9d0 con 0x7f30cc05b320 2020-10-31T22:41:04.845 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d0c11700 1 --2- 172.21.15.60:0/3527821885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30cc05b320 0x7f30cc07ff20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f30c0002f30 tx=0x7f30c0006e80).ready entity=mon.1 client_cookie=cf94523de6f8e556 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:04.845 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30cb7fe700 1 -- 172.21.15.60:0/3527821885 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30c00097f0 con 0x7f30cc05b320 2020-10-31T22:41:04.845 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30cb7fe700 1 -- 172.21.15.60:0/3527821885 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c0009950 con 0x7f30cc05b320 2020-10-31T22:41:04.845 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30cb7fe700 1 -- 172.21.15.60:0/3527821885 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30c0009cf0 con 0x7f30cc05b320 2020-10-31T22:41:04.846 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d2674700 1 -- 172.21.15.60:0/3527821885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30cc05b320 msgr2=0x7f30cc07ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:04.846 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d2674700 1 --2- 172.21.15.60:0/3527821885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30cc05b320 0x7f30cc07ff20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f30c0002f30 tx=0x7f30c0006e80).stop 2020-10-31T22:41:04.846 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d2674700 1 -- 172.21.15.60:0/3527821885 shutdown_connections 2020-10-31T22:41:04.846 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d2674700 1 --2- 172.21.15.60:0/3527821885 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30cc0ac110 0x7f30cc0af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:04.846 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d2674700 1 --2- 172.21.15.60:0/3527821885 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30cc05b320 0x7f30cc07ff20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:04.846 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.835+0000 7f30d2674700 1 -- 172.21.15.60:0/3527821885 >> 172.21.15.60:0/3527821885 conn(0x7f30cc0b3fd0 msgr2=0x7f30cc0b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:04.846 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30d2674700 1 -- 172.21.15.60:0/3527821885 shutdown_connections 2020-10-31T22:41:04.847 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30d2674700 1 -- 172.21.15.60:0/3527821885 wait complete. 2020-10-31T22:41:04.847 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30d2674700 1 Processor -- start 2020-10-31T22:41:04.847 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30d2674700 1 -- start start 2020-10-31T22:41:04.849 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30d2674700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30cc05b320 0x7f30cc0b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:04.849 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30d2674700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0ac110 0x7f30cc13d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:04.849 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30d2674700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30cc0ae200 0x7f30cc13ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:04.850 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30d2674700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc09e3d0 con 0x7f30cc0ac110 2020-10-31T22:41:04.850 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30d2674700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc0a69d0 con 0x7f30cc05b320 2020-10-31T22:41:04.851 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30d2674700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30cc09e130 con 0x7f30cc0ae200 2020-10-31T22:41:04.851 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30cbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0ac110 0x7f30cc13d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:04.851 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30cbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0ac110 0x7f30cc13d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41004/0 (socket says 172.21.15.60:41004) 2020-10-31T22:41:04.851 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30cbfff700 1 -- 172.21.15.60:0/3234241890 learned_addr learned my addr 172.21.15.60:0/3234241890 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:04.851 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30d0c11700 1 --2- 172.21.15.60:0/3234241890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30cc05b320 0x7f30cc0b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:04.851 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.839+0000 7f30d1412700 1 --2- 172.21.15.60:0/3234241890 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30cc0ae200 0x7f30cc13ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:04.852 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.843+0000 7f30cbfff700 1 -- 172.21.15.60:0/3234241890 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30cc0ae200 msgr2=0x7f30cc13ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:04.852 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.843+0000 7f30cbfff700 1 --2- 172.21.15.60:0/3234241890 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30cc0ae200 0x7f30cc13ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:04.852 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.843+0000 7f30cbfff700 1 -- 172.21.15.60:0/3234241890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30cc05b320 msgr2=0x7f30cc0b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:04.852 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.843+0000 7f30cbfff700 1 --2- 172.21.15.60:0/3234241890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30cc05b320 0x7f30cc0b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:04.852 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.843+0000 7f30cbfff700 1 -- 172.21.15.60:0/3234241890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc0a6c30 con 0x7f30cc0ac110 2020-10-31T22:41:04.852 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.843+0000 7f30cbfff700 1 --2- 172.21.15.60:0/3234241890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0ac110 0x7f30cc13d8e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f30cc0b3ee0 tx=0x7f30b8007ba0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:04.852 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.843+0000 7f30c97fa700 1 -- 172.21.15.60:0/3234241890 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30b80072e0 con 0x7f30cc0ac110 2020-10-31T22:41:04.853 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.843+0000 7f30c97fa700 1 -- 172.21.15.60:0/3234241890 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b8005520 con 0x7f30cc0ac110 2020-10-31T22:41:04.853 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.843+0000 7f30d2674700 1 -- 172.21.15.60:0/3234241890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30cc0a2200 con 0x7f30cc0ac110 2020-10-31T22:41:04.853 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.843+0000 7f30c97fa700 1 -- 172.21.15.60:0/3234241890 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30b8005880 con 0x7f30cc0ac110 2020-10-31T22:41:04.853 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.843+0000 7f30d2674700 1 -- 172.21.15.60:0/3234241890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30cc13e4e0 con 0x7f30cc0ac110 2020-10-31T22:41:04.853 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.843+0000 7f30d2674700 1 -- 172.21.15.60:0/3234241890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30cc0a6ff0 con 0x7f30cc0ac110 2020-10-31T22:41:04.853 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.843+0000 7f30c97fa700 1 -- 172.21.15.60:0/3234241890 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f30b8010070 con 0x7f30cc0ac110 2020-10-31T22:41:04.853 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.843+0000 7f30c97fa700 1 --2- 172.21.15.60:0/3234241890 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30ac054f90 0x7f30ac057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:04.853 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.847+0000 7f30d0c11700 1 --2- 172.21.15.60:0/3234241890 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30ac054f90 0x7f30ac057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:04.854 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.847+0000 7f30c97fa700 1 -- 172.21.15.60:0/3234241890 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7f30b806cd60 con 0x7f30cc0ac110 2020-10-31T22:41:04.854 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.847+0000 7f30d0c11700 1 --2- 172.21.15.60:0/3234241890 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30ac054f90 0x7f30ac057450 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f30c001c000 tx=0x7f30c0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:04.863 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.855+0000 7f30c97fa700 1 -- 172.21.15.60:0/3234241890 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f30b8043640 con 0x7f30cc0ac110 2020-10-31T22:41:05.002 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.999+0000 7f30d2674700 1 -- 172.21.15.60:0/3234241890 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30cc0a6dc0 con 0x7f30cc0ac110 2020-10-31T22:41:05.003 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:04.999+0000 7f30c97fa700 1 -- 172.21.15.60:0/3234241890 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+11805 (secure 0 0 0) 0x7f30b8046c60 con 0x7f30cc0ac110 2020-10-31T22:41:05.003 INFO:teuthology.misc.health.smithi060.stdout: 2020-10-31T22:41:05.004 INFO:teuthology.misc.health.smithi060.stdout:{"epoch":15,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:03.313422+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:05.005 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:05.003+0000 7f30d2674700 1 -- 172.21.15.60:0/3234241890 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30ac054f90 msgr2=0x7f30ac057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:05.006 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:05.003+0000 7f30d2674700 1 --2- 172.21.15.60:0/3234241890 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30ac054f90 0x7f30ac057450 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f30c001c000 tx=0x7f30c0015000).stop 2020-10-31T22:41:05.006 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:05.003+0000 7f30d2674700 1 -- 172.21.15.60:0/3234241890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0ac110 msgr2=0x7f30cc13d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:05.007 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:05.003+0000 7f30d2674700 1 --2- 172.21.15.60:0/3234241890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0ac110 0x7f30cc13d8e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f30cc0b3ee0 tx=0x7f30b8007ba0).stop 2020-10-31T22:41:05.007 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:05.003+0000 7f30d2674700 1 -- 172.21.15.60:0/3234241890 shutdown_connections 2020-10-31T22:41:05.007 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:05.003+0000 7f30d2674700 1 --2- 172.21.15.60:0/3234241890 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30cc0ae200 0x7f30cc13ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.007 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:05.003+0000 7f30d2674700 1 --2- 172.21.15.60:0/3234241890 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30ac054f90 0x7f30ac057450 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.007 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:05.003+0000 7f30d2674700 1 --2- 172.21.15.60:0/3234241890 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30cc05b320 0x7f30cc0b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.007 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:05.003+0000 7f30d2674700 1 --2- 172.21.15.60:0/3234241890 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30cc0ac110 0x7f30cc13d8e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.007 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:05.003+0000 7f30d2674700 1 -- 172.21.15.60:0/3234241890 >> 172.21.15.60:0/3234241890 conn(0x7f30cc0b3fd0 msgr2=0x7f30cc1332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:05.008 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:05.003+0000 7f30d2674700 1 -- 172.21.15.60:0/3234241890 shutdown_connections 2020-10-31T22:41:05.008 INFO:teuthology.misc.health.smithi060.stderr:2020-10-31T22:41:05.003+0000 7f30d2674700 1 -- 172.21.15.60:0/3234241890 wait complete. 2020-10-31T22:41:05.017 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-10-31T22:41:05.021 INFO:tasks.ceph:Creating RBD pool 2020-10-31T22:41:05.023 INFO:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd pool create rbd 8 2020-10-31T22:41:05.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.139+0000 7fb9abfff700 1 Processor -- start 2020-10-31T22:41:05.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.139+0000 7fb9abfff700 1 -- start start 2020-10-31T22:41:05.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9abfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb9ac0803e0 0x7fb9ac15a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:05.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9abfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac080820 con 0x7fb9ac0256a0 2020-10-31T22:41:05.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9abfff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9ac0b1950 con 0x7fb9ac0b1570 2020-10-31T22:41:05.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9abfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9ac062720 con 0x7fb9ac0803e0 2020-10-31T22:41:05.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9aaffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb9ac0256a0 0x7fb9ac07fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45148/0 (socket says 172.21.15.60:45148) 2020-10-31T22:41:05.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9aaffd700 1 -- 172.21.15.60:0/2533567186 learned_addr learned my addr 172.21.15.60:0/2533567186 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:05.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9b1273700 1 --2- 172.21.15.60:0/2533567186 >> v2:172.21.15.66:3300/0 conn(0x7fb9ac0803e0 0x7fb9ac15a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:05.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9aa7fc700 1 -- 172.21.15.60:0/2533567186 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2830604130 0 0) 0x7fb9ac080820 con 0x7fb9ac0256a0 2020-10-31T22:41:05.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9aa7fc700 1 -- 172.21.15.60:0/2533567186 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb998003230 con 0x7fb9ac0256a0 2020-10-31T22:41:05.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9b1273700 1 -- 172.21.15.60:0/2533567186 >> v1:172.21.15.66:6789/0 conn(0x7fb9ac0b1570 legacy=0x7fb9ac024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:05.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9b1273700 1 -- 172.21.15.60:0/2533567186 >> v1:172.21.15.60:6789/0 conn(0x7fb9ac0256a0 legacy=0x7fb9ac07fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:05.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9b1273700 1 -- 172.21.15.60:0/2533567186 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac066cb0 con 0x7fb9ac0803e0 2020-10-31T22:41:05.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9b1273700 1 --2- 172.21.15.60:0/2533567186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9ac0803e0 0x7fb9ac15a220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb9a4002f30 tx=0x7fb9a4006dc0).ready entity=mon.1 client_cookie=29147eff5cea21cb server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:05.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9aa7fc700 1 -- 172.21.15.60:0/2533567186 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9a4009800 con 0x7fb9ac0803e0 2020-10-31T22:41:05.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9aa7fc700 1 -- 172.21.15.60:0/2533567186 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9a4009960 con 0x7fb9ac0803e0 2020-10-31T22:41:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9aa7fc700 1 -- 172.21.15.60:0/2533567186 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9a4009cc0 con 0x7fb9ac0803e0 2020-10-31T22:41:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9abfff700 1 -- 172.21.15.60:0/2533567186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9ac0803e0 msgr2=0x7fb9ac15a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9abfff700 1 --2- 172.21.15.60:0/2533567186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9ac0803e0 0x7fb9ac15a220 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb9a4002f30 tx=0x7fb9a4006dc0).stop 2020-10-31T22:41:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9abfff700 1 -- 172.21.15.60:0/2533567186 shutdown_connections 2020-10-31T22:41:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9abfff700 1 --2- 172.21.15.60:0/2533567186 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9ac0803e0 0x7fb9ac15a220 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9abfff700 1 -- 172.21.15.60:0/2533567186 >> 172.21.15.60:0/2533567186 conn(0x7fb9ac0b5440 msgr2=0x7fb9ac0b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9abfff700 1 -- 172.21.15.60:0/2533567186 shutdown_connections 2020-10-31T22:41:05.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.143+0000 7fb9abfff700 1 -- 172.21.15.60:0/2533567186 wait complete. 2020-10-31T22:41:05.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.147+0000 7fb9abfff700 1 Processor -- start 2020-10-31T22:41:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.147+0000 7fb9abfff700 1 -- start start 2020-10-31T22:41:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.147+0000 7fb9abfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9ac0256a0 0x7fb9ac134b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.147+0000 7fb9abfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9ac0803e0 0x7fb9ac07be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.147+0000 7fb9abfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9ac0b1570 0x7fb9ac12e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.147+0000 7fb9abfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac07f170 con 0x7fb9ac0803e0 2020-10-31T22:41:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.147+0000 7fb9abfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac07c350 con 0x7fb9ac0256a0 2020-10-31T22:41:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.147+0000 7fb9abfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9ac07f6f0 con 0x7fb9ac0b1570 2020-10-31T22:41:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.147+0000 7fb9aaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9ac0803e0 0x7fb9ac07be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.147+0000 7fb9aaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9ac0803e0 0x7fb9ac07be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41018/0 (socket says 172.21.15.60:41018) 2020-10-31T22:41:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.147+0000 7fb9aaffd700 1 -- 172.21.15.60:0/2843784729 learned_addr learned my addr 172.21.15.60:0/2843784729 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.147+0000 7fb9ab7fe700 1 --2- 172.21.15.60:0/2843784729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9ac0256a0 0x7fb9ac134b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:05.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.147+0000 7fb9b1273700 1 --2- 172.21.15.60:0/2843784729 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9ac0b1570 0x7fb9ac12e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:05.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9aaffd700 1 -- 172.21.15.60:0/2843784729 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9ac0b1570 msgr2=0x7fb9ac12e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:05.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9aaffd700 1 --2- 172.21.15.60:0/2843784729 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9ac0b1570 0x7fb9ac12e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9aaffd700 1 -- 172.21.15.60:0/2843784729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9ac0256a0 msgr2=0x7fb9ac134b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:05.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9aaffd700 1 --2- 172.21.15.60:0/2843784729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9ac0256a0 0x7fb9ac134b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9aaffd700 1 -- 172.21.15.60:0/2843784729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9ac07b9c0 con 0x7fb9ac0803e0 2020-10-31T22:41:05.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9aaffd700 1 --2- 172.21.15.60:0/2843784729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9ac0803e0 0x7fb9ac07be60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb9940010d0 tx=0x7fb994007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:05.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9a3fff700 1 -- 172.21.15.60:0/2843784729 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9940072e0 con 0x7fb9ac0803e0 2020-10-31T22:41:05.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9a3fff700 1 -- 172.21.15.60:0/2843784729 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb994007440 con 0x7fb9ac0803e0 2020-10-31T22:41:05.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9abfff700 1 -- 172.21.15.60:0/2843784729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9ac07caf0 con 0x7fb9ac0803e0 2020-10-31T22:41:05.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9a3fff700 1 -- 172.21.15.60:0/2843784729 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9940057d0 con 0x7fb9ac0803e0 2020-10-31T22:41:05.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9abfff700 1 -- 172.21.15.60:0/2843784729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ac07fc90 con 0x7fb9ac0803e0 2020-10-31T22:41:05.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9abfff700 1 -- 172.21.15.60:0/2843784729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9ac07f300 con 0x7fb9ac0803e0 2020-10-31T22:41:05.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9a3fff700 1 -- 172.21.15.60:0/2843784729 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb99401a060 con 0x7fb9ac0803e0 2020-10-31T22:41:05.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9a3fff700 1 --2- 172.21.15.60:0/2843784729 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb990054f90 0x7fb990057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:05.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9a3fff700 1 -- 172.21.15.60:0/2843784729 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4900+0+0 (secure 0 0 0) 0x7fb99406ca60 con 0x7fb9ac0803e0 2020-10-31T22:41:05.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9ab7fe700 1 --2- 172.21.15.60:0/2843784729 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb990054f90 0x7fb990057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:05.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.151+0000 7fb9ab7fe700 1 --2- 172.21.15.60:0/2843784729 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb990054f90 0x7fb990057450 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb99c00d000 tx=0x7fb99c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:05.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.163+0000 7fb9a3fff700 1 -- 172.21.15.60:0/2843784729 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb9940432a0 con 0x7fb9ac0803e0 2020-10-31T22:41:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.303+0000 7fb9abfff700 1 -- 172.21.15.60:0/2843784729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fb9ac07f8b0 con 0x7fb9ac0803e0 2020-10-31T22:41:05.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.411+0000 7fb9a3fff700 1 -- 172.21.15.60:0/2843784729 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb994018070 con 0x7fb9ac0803e0 2020-10-31T22:41:05.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.415+0000 7fb9abfff700 1 -- 172.21.15.60:0/2843784729 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb990054f90 msgr2=0x7fb990057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:05.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.415+0000 7fb9abfff700 1 --2- 172.21.15.60:0/2843784729 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb990054f90 0x7fb990057450 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fb99c00d000 tx=0x7fb99c009040).stop 2020-10-31T22:41:05.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.415+0000 7fb9abfff700 1 -- 172.21.15.60:0/2843784729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9ac0803e0 msgr2=0x7fb9ac07be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:05.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.415+0000 7fb9abfff700 1 --2- 172.21.15.60:0/2843784729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9ac0803e0 0x7fb9ac07be60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fb9940010d0 tx=0x7fb994007aa0).stop 2020-10-31T22:41:05.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.419+0000 7fb9abfff700 1 -- 172.21.15.60:0/2843784729 shutdown_connections 2020-10-31T22:41:05.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.419+0000 7fb9abfff700 1 --2- 172.21.15.60:0/2843784729 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9ac0b1570 0x7fb9ac12e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.419+0000 7fb9abfff700 1 --2- 172.21.15.60:0/2843784729 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb990054f90 0x7fb990057450 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.419+0000 7fb9abfff700 1 --2- 172.21.15.60:0/2843784729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9ac0256a0 0x7fb9ac134b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.419+0000 7fb9abfff700 1 --2- 172.21.15.60:0/2843784729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9ac0803e0 0x7fb9ac07be60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.419+0000 7fb9abfff700 1 -- 172.21.15.60:0/2843784729 >> 172.21.15.60:0/2843784729 conn(0x7fb9ac0b5440 msgr2=0x7fb9ac0ad280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:05.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.419+0000 7fb9abfff700 1 -- 172.21.15.60:0/2843784729 shutdown_connections 2020-10-31T22:41:05.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.419+0000 7fb9abfff700 1 -- 172.21.15.60:0/2843784729 wait complete. 2020-10-31T22:41:05.423 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'rbd' created 2020-10-31T22:41:05.436 INFO:teuthology.orchestra.run.smithi060:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-10-31T22:41:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf1dd9700 1 Processor -- start 2020-10-31T22:41:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf1dd9700 1 -- start start 2020-10-31T22:41:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf1dd9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9bec025460 0x7f9bec0b0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf1dd9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bec025c40 0x7f9bec0aa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:05.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf1dd9700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9bec0aa720 0x7f9bec0aab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:05.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf1dd9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec025840 con 0x7f9bec025460 2020-10-31T22:41:05.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf1dd9700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bec0a9dd0 con 0x7f9bec0aa720 2020-10-31T22:41:05.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf1dd9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec063630 con 0x7f9bec025c40 2020-10-31T22:41:05.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf15d8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9bec025460 0x7f9bec0b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:05.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf15d8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9bec025460 0x7f9bec0b0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41026/0 (socket says 172.21.15.60:41026) 2020-10-31T22:41:05.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf15d8700 1 -- 172.21.15.60:0/2551994764 learned_addr learned my addr 172.21.15.60:0/2551994764 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:05.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf0dd7700 1 --2- 172.21.15.60:0/2551994764 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bec025c40 0x7f9bec0aa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:05.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf303b700 1 --2- 172.21.15.60:0/2551994764 >> v2:172.21.15.66:3300/0 conn(0x7f9bec0aa720 0x7f9bec0aab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:05.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf15d8700 1 -- 172.21.15.60:0/2551994764 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bec025c40 msgr2=0x7f9bec0aa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:05.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf15d8700 1 --2- 172.21.15.60:0/2551994764 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bec025c40 0x7f9bec0aa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf15d8700 1 -- 172.21.15.60:0/2551994764 >> v2:172.21.15.66:3300/0 conn(0x7f9bec0aa720 msgr2=0x7f9bec0aab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf15d8700 1 --2- 172.21.15.60:0/2551994764 >> v2:172.21.15.66:3300/0 conn(0x7f9bec0aa720 0x7f9bec0aab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf15d8700 1 -- 172.21.15.60:0/2551994764 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec062e50 con 0x7f9bec025460 2020-10-31T22:41:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf303b700 1 --2- 172.21.15.60:0/2551994764 >> v2:172.21.15.66:3300/0 conn(0x7f9bec0aa720 0x7f9bec0aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf15d8700 1 --2- 172.21.15.60:0/2551994764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bec025460 0x7f9bec0b0ea0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9bdc002f30 tx=0x7f9bdc006e80).ready entity=mon.0 client_cookie=22410629acf3aaee server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bebfff700 1 -- 172.21.15.60:0/2551994764 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bdc0097f0 con 0x7f9bec025460 2020-10-31T22:41:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bebfff700 1 -- 172.21.15.60:0/2551994764 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc009950 con 0x7f9bec025460 2020-10-31T22:41:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bebfff700 1 -- 172.21.15.60:0/2551994764 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bdc009ac0 con 0x7f9bec025460 2020-10-31T22:41:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/2551994764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bec025460 msgr2=0x7f9bec0b0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.555+0000 7f9bf1dd9700 1 --2- 172.21.15.60:0/2551994764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bec025460 0x7f9bec0b0ea0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9bdc002f30 tx=0x7f9bdc006e80).stop 2020-10-31T22:41:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/2551994764 shutdown_connections 2020-10-31T22:41:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 --2- 172.21.15.60:0/2551994764 >> v2:172.21.15.66:3300/0 conn(0x7f9bec0aa720 0x7f9bec0aab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 --2- 172.21.15.60:0/2551994764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bec025460 0x7f9bec0b0ea0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 --2- 172.21.15.60:0/2551994764 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bec025c40 0x7f9bec0aa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/2551994764 >> 172.21.15.60:0/2551994764 conn(0x7f9bec05cdc0 msgr2=0x7f9bec06a260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:05.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/2551994764 shutdown_connections 2020-10-31T22:41:05.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/2551994764 wait complete. 2020-10-31T22:41:05.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 Processor -- start 2020-10-31T22:41:05.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 -- start start 2020-10-31T22:41:05.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bec025460 0x7f9bec0669c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:05.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bec025c40 0x7f9bec13fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:05.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bec0aa720 0x7f9bec1401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:05.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec12feb0 con 0x7f9bec025460 2020-10-31T22:41:05.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec0af070 con 0x7f9bec025c40 2020-10-31T22:41:05.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf1dd9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bec130820 con 0x7f9bec0aa720 2020-10-31T22:41:05.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf15d8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bec025460 0x7f9bec0669c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:05.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf15d8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bec025460 0x7f9bec0669c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41030/0 (socket says 172.21.15.60:41030) 2020-10-31T22:41:05.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf15d8700 1 -- 172.21.15.60:0/3394311028 learned_addr learned my addr 172.21.15.60:0/3394311028 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:05.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf0dd7700 1 --2- 172.21.15.60:0/3394311028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bec025c40 0x7f9bec13fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:05.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.559+0000 7f9bf303b700 1 --2- 172.21.15.60:0/3394311028 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bec0aa720 0x7f9bec1401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:05.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9bf15d8700 1 -- 172.21.15.60:0/3394311028 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bec0aa720 msgr2=0x7f9bec1401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:05.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9bf15d8700 1 --2- 172.21.15.60:0/3394311028 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bec0aa720 0x7f9bec1401d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9bf15d8700 1 -- 172.21.15.60:0/3394311028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bec025c40 msgr2=0x7f9bec13fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:05.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9bf15d8700 1 --2- 172.21.15.60:0/3394311028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bec025c40 0x7f9bec13fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:05.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9bf15d8700 1 -- 172.21.15.60:0/3394311028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec1300e0 con 0x7f9bec025460 2020-10-31T22:41:05.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9bf15d8700 1 --2- 172.21.15.60:0/3394311028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bec025460 0x7f9bec0669c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9bdc002f30 tx=0x7f9bdc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:05.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9be9ffb700 1 -- 172.21.15.60:0/3394311028 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bdc011e20 con 0x7f9bec025460 2020-10-31T22:41:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9be9ffb700 1 -- 172.21.15.60:0/3394311028 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc021440 con 0x7f9bec025460 2020-10-31T22:41:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/3394311028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bec130380 con 0x7f9bec025460 2020-10-31T22:41:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9be9ffb700 1 -- 172.21.15.60:0/3394311028 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bdc0217a0 con 0x7f9bec025460 2020-10-31T22:41:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/3394311028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bec0aec00 con 0x7f9bec025460 2020-10-31T22:41:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/3394311028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bec057100 con 0x7f9bec025460 2020-10-31T22:41:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9be9ffb700 1 -- 172.21.15.60:0/3394311028 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9bdc00f070 con 0x7f9bec025460 2020-10-31T22:41:05.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9be9ffb700 1 --2- 172.21.15.60:0/3394311028 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bcc054f00 0x7f9bcc0573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9be9ffb700 1 -- 172.21.15.60:0/3394311028 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5242+0+0 (secure 0 0 0) 0x7f9bdc06dfe0 con 0x7f9bec025460 2020-10-31T22:41:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.563+0000 7f9bf0dd7700 1 --2- 172.21.15.60:0/3394311028 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bcc054f00 0x7f9bcc0573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.567+0000 7f9bf0dd7700 1 --2- 172.21.15.60:0/3394311028 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bcc054f00 0x7f9bcc0573c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9be000b000 tx=0x7f9be0006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.575+0000 7f9be9ffb700 1 -- 172.21.15.60:0/3394311028 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9bdc0447a0 con 0x7f9bec025460 2020-10-31T22:41:05.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:05.719+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/3394311028 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9bec05d1d0 con 0x7f9bec025460 2020-10-31T22:41:06.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.423+0000 7f9be9ffb700 1 -- 172.21.15.60:0/3394311028 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v17) v1 ==== 173+0+0 (secure 0 0 0) 0x7f9bdc015070 con 0x7f9bec025460 2020-10-31T22:41:06.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.427+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/3394311028 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bcc054f00 msgr2=0x7f9bcc0573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:06.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.427+0000 7f9bf1dd9700 1 --2- 172.21.15.60:0/3394311028 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bcc054f00 0x7f9bcc0573c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9be000b000 tx=0x7f9be0006dc0).stop 2020-10-31T22:41:06.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.427+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/3394311028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bec025460 msgr2=0x7f9bec0669c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:06.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.427+0000 7f9bf1dd9700 1 --2- 172.21.15.60:0/3394311028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bec025460 0x7f9bec0669c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f9bdc002f30 tx=0x7f9bdc016000).stop 2020-10-31T22:41:06.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.427+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/3394311028 shutdown_connections 2020-10-31T22:41:06.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.427+0000 7f9bf1dd9700 1 --2- 172.21.15.60:0/3394311028 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bec0aa720 0x7f9bec1401d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.427+0000 7f9bf1dd9700 1 --2- 172.21.15.60:0/3394311028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bec025460 0x7f9bec0669c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.427+0000 7f9bf1dd9700 1 --2- 172.21.15.60:0/3394311028 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bcc054f00 0x7f9bcc0573c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.427+0000 7f9bf1dd9700 1 --2- 172.21.15.60:0/3394311028 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bec025c40 0x7f9bec13fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.427+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/3394311028 >> 172.21.15.60:0/3394311028 conn(0x7f9bec05cdc0 msgr2=0x7f9bec06a260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:06.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.427+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/3394311028 shutdown_connections 2020-10-31T22:41:06.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.427+0000 7f9bf1dd9700 1 -- 172.21.15.60:0/3394311028 wait complete. 2020-10-31T22:41:06.435 INFO:teuthology.orchestra.run.smithi060.stderr:enabled application 'rbd' on pool 'rbd' 2020-10-31T22:41:06.449 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-10-31T22:41:06.449 INFO:tasks.ceph.mds.a:Restarting daemon 2020-10-31T22:41:06.450 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-10-31T22:41:06.452 INFO:tasks.ceph.mds.a:Started 2020-10-31T22:41:06.452 INFO:tasks.ceph.mds.c:Restarting daemon 2020-10-31T22:41:06.453 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-10-31T22:41:06.455 INFO:tasks.ceph.mds.c:Started 2020-10-31T22:41:06.455 INFO:tasks.ceph.mds.b:Restarting daemon 2020-10-31T22:41:06.456 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-10-31T22:41:06.458 INFO:tasks.ceph.mds.b:Started 2020-10-31T22:41:06.459 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-10-31T22:41:06.459 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:06.534 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:41:06.535 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:41:06.538 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:41:06.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f917a045700 1 Processor -- start 2020-10-31T22:41:06.582 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f917a045700 1 -- start start 2020-10-31T22:41:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f917a045700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f91740b1d50 0x7f91740b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f917a045700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9174141d80 0x7f91740b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:06.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f917a045700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91740b2130 con 0x7f917405afe0 2020-10-31T22:41:06.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f917a045700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f917413fab0 con 0x7f91740b1d50 2020-10-31T22:41:06.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f917a045700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91740af380 con 0x7f9174141d80 2020-10-31T22:41:06.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f9179043700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f91740b1d50 0x7f91740b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:06.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f9179844700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f917405afe0 0x7f917405bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45210/0 (socket says 172.21.15.60:45210) 2020-10-31T22:41:06.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f9179844700 1 -- 172.21.15.60:0/1475824748 learned_addr learned my addr 172.21.15.60:0/1475824748 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:06.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f9178842700 1 --2- 172.21.15.60:0/1475824748 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9174141d80 0x7f91740b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:06.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f9179043700 1 -- 172.21.15.60:0/1475824748 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9174141d80 msgr2=0x7f91740b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:06.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f9179043700 1 --2- 172.21.15.60:0/1475824748 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9174141d80 0x7f91740b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f9179043700 1 -- 172.21.15.60:0/1475824748 >> v1:172.21.15.60:6789/0 conn(0x7f917405afe0 legacy=0x7f917405bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:06.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f9163fff700 1 -- 172.21.15.60:0/1475824748 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289968782 0 0) 0x7f91740b2130 con 0x7f917405afe0 2020-10-31T22:41:06.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f9179043700 1 -- 172.21.15.60:0/1475824748 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91740af620 con 0x7f91740b1d50 2020-10-31T22:41:06.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f9179043700 1 --2- 172.21.15.60:0/1475824748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91740b1d50 0x7f91740b0000 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9164002f30 tx=0x7f9164006dc0).ready entity=mon.0 client_cookie=22d9f6cf9c4e2d87 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:06.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f9163fff700 1 -- 172.21.15.60:0/1475824748 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9164009760 con 0x7f91740b1d50 2020-10-31T22:41:06.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f9163fff700 1 -- 172.21.15.60:0/1475824748 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91640098c0 con 0x7f91740b1d50 2020-10-31T22:41:06.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f9163fff700 1 -- 172.21.15.60:0/1475824748 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9164009c20 con 0x7f91740b1d50 2020-10-31T22:41:06.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f917a045700 1 -- 172.21.15.60:0/1475824748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91740b1d50 msgr2=0x7f91740b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:06.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.579+0000 7f917a045700 1 --2- 172.21.15.60:0/1475824748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91740b1d50 0x7f91740b0000 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9164002f30 tx=0x7f9164006dc0).stop 2020-10-31T22:41:06.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 -- 172.21.15.60:0/1475824748 shutdown_connections 2020-10-31T22:41:06.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 --2- 172.21.15.60:0/1475824748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91740b1d50 0x7f91740b0000 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 --2- 172.21.15.60:0/1475824748 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9174141d80 0x7f91740b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 -- 172.21.15.60:0/1475824748 >> 172.21.15.60:0/1475824748 conn(0x7f91740b5300 msgr2=0x7f91740b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 -- 172.21.15.60:0/1475824748 shutdown_connections 2020-10-31T22:41:06.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 -- 172.21.15.60:0/1475824748 wait complete. 2020-10-31T22:41:06.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 Processor -- start 2020-10-31T22:41:06.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 -- start start 2020-10-31T22:41:06.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f917405afe0 0x7f91740ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:06.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91740b1d50 0x7f9174143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:06.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9174141d80 0x7f91740ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:06.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91740a9eb0 con 0x7f91740b1d50 2020-10-31T22:41:06.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9174143e60 con 0x7f917405afe0 2020-10-31T22:41:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91740aa4b0 con 0x7f9174141d80 2020-10-31T22:41:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f9178842700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91740b1d50 0x7f9174143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:06.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f9178842700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91740b1d50 0x7f9174143460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41076/0 (socket says 172.21.15.60:41076) 2020-10-31T22:41:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f9178842700 1 -- 172.21.15.60:0/1893788290 learned_addr learned my addr 172.21.15.60:0/1893788290 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f9179844700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9174141d80 0x7f91740ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f9179043700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f917405afe0 0x7f91740ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:06.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f9178842700 1 -- 172.21.15.60:0/1893788290 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9174141d80 msgr2=0x7f91740ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f9178842700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9174141d80 0x7f91740ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f9178842700 1 -- 172.21.15.60:0/1893788290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f917405afe0 msgr2=0x7f91740ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:06.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f9178842700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f917405afe0 0x7f91740ab460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f9178842700 1 -- 172.21.15.60:0/1893788290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91740aa0e0 con 0x7f91740b1d50 2020-10-31T22:41:06.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f9179844700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9174141d80 0x7f91740ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:06.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f9178842700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91740b1d50 0x7f9174143460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9174143ff0 tx=0x7f91700091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f91627fc700 1 -- 172.21.15.60:0/1893788290 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f917000cc00 con 0x7f91740b1d50 2020-10-31T22:41:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f91627fc700 1 -- 172.21.15.60:0/1893788290 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917000cd60 con 0x7f91740b1d50 2020-10-31T22:41:06.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 -- 172.21.15.60:0/1893788290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91740aa750 con 0x7f91740b1d50 2020-10-31T22:41:06.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f91627fc700 1 -- 172.21.15.60:0/1893788290 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91700125e0 con 0x7f91740b1d50 2020-10-31T22:41:06.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.583+0000 7f917a045700 1 -- 172.21.15.60:0/1893788290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f917413bc10 con 0x7f91740b1d50 2020-10-31T22:41:06.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.587+0000 7f91627fc700 1 -- 172.21.15.60:0/1893788290 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9170022070 con 0x7f91740b1d50 2020-10-31T22:41:06.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.587+0000 7f917a045700 1 -- 172.21.15.60:0/1893788290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91741431a0 con 0x7f91740b1d50 2020-10-31T22:41:06.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.587+0000 7f91627fc700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9154054f10 0x7f91540573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:06.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.587+0000 7f91627fc700 1 -- 172.21.15.60:0/1893788290 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f917006dfe0 con 0x7f91740b1d50 2020-10-31T22:41:06.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.587+0000 7f9179043700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9154054f10 0x7f91540573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:06.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.587+0000 7f9179043700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9154054f10 0x7f91540573d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9164018000 tx=0x7f9164015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:06.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.591+0000 7f91627fc700 1 -- 172.21.15.60:0/1893788290 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f91741431a0 con 0x7f91740b1d50 2020-10-31T22:41:06.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.735+0000 7f917a045700 1 -- 172.21.15.60:0/1893788290 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91741431a0 con 0x7f91740b1d50 2020-10-31T22:41:06.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.739+0000 7f91627fc700 1 -- 172.21.15.60:0/1893788290 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+13191 (secure 0 0 0) 0x7f91741431a0 con 0x7f91740b1d50 2020-10-31T22:41:06.742 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:06.742 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":17,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:06.411922+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:06.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.739+0000 7f917a045700 1 -- 172.21.15.60:0/1893788290 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9154054f10 msgr2=0x7f91540573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:06.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.739+0000 7f917a045700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9154054f10 0x7f91540573d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f9164018000 tx=0x7f9164015000).stop 2020-10-31T22:41:06.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.739+0000 7f917a045700 1 -- 172.21.15.60:0/1893788290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91740b1d50 msgr2=0x7f9174143460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:06.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.739+0000 7f917a045700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91740b1d50 0x7f9174143460 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f9174143ff0 tx=0x7f91700091a0).stop 2020-10-31T22:41:06.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.739+0000 7f917a045700 1 -- 172.21.15.60:0/1893788290 shutdown_connections 2020-10-31T22:41:06.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.739+0000 7f917a045700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9174141d80 0x7f91740ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.739+0000 7f917a045700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9154054f10 0x7f91540573d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.739+0000 7f917a045700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f917405afe0 0x7f91740ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.739+0000 7f917a045700 1 --2- 172.21.15.60:0/1893788290 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91740b1d50 0x7f9174143460 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.739+0000 7f917a045700 1 -- 172.21.15.60:0/1893788290 >> 172.21.15.60:0/1893788290 conn(0x7f91740b5300 msgr2=0x7f91740b12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:06.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.739+0000 7f917a045700 1 -- 172.21.15.60:0/1893788290 shutdown_connections 2020-10-31T22:41:06.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.739+0000 7f917a045700 1 -- 172.21.15.60:0/1893788290 wait complete. 2020-10-31T22:41:06.755 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-31T22:41:06.756 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:41:06.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0ffff700 1 Processor -- start 2020-10-31T22:41:06.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0ffff700 1 -- start start 2020-10-31T22:41:06.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3e100b5570 0x7f3e100b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:06.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e10141f00 0x7f3e10142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:06.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0ffff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e100b4440 con 0x7f3e100b24a0 2020-10-31T22:41:06.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0ffff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1013f930 con 0x7f3e100b5570 2020-10-31T22:41:06.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e10146060 con 0x7f3e10141f00 2020-10-31T22:41:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3e100b5570 0x7f3e100b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3e100b5570 0x7f3e100b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41088/0 (socket says 172.21.15.60:41088) 2020-10-31T22:41:06.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0effd700 1 -- 172.21.15.60:0/2449318834 learned_addr learned my addr 172.21.15.60:0/2449318834 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:06.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0f7fe700 1 --2- 172.21.15.60:0/2449318834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e10141f00 0x7f3e10142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:06.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0effd700 1 -- 172.21.15.60:0/2449318834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e10141f00 msgr2=0x7f3e10142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:06.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0effd700 1 --2- 172.21.15.60:0/2449318834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e10141f00 0x7f3e10142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0effd700 1 -- 172.21.15.60:0/2449318834 >> v1:172.21.15.66:6789/0 conn(0x7f3e100b24a0 legacy=0x7f3e10145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0effd700 1 -- 172.21.15.60:0/2449318834 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e100b02f0 con 0x7f3e100b5570 2020-10-31T22:41:06.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.875+0000 7f3e0dffb700 1 -- 172.21.15.60:0/2449318834 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953016752 0 0) 0x7f3e100b4440 con 0x7f3e100b24a0 2020-10-31T22:41:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0effd700 1 --2- 172.21.15.60:0/2449318834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e100b5570 0x7f3e100b5950 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3e000032b0 tx=0x7f3e00009270).ready entity=mon.0 client_cookie=3bfe0f86d96352dc server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0dffb700 1 -- 172.21.15.60:0/2449318834 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e00009e60 con 0x7f3e100b5570 2020-10-31T22:41:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0dffb700 1 -- 172.21.15.60:0/2449318834 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0000bc00 con 0x7f3e100b5570 2020-10-31T22:41:06.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0dffb700 1 -- 172.21.15.60:0/2449318834 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0000bd70 con 0x7f3e100b5570 2020-10-31T22:41:06.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0ffff700 1 -- 172.21.15.60:0/2449318834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e100b5570 msgr2=0x7f3e100b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:06.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0ffff700 1 --2- 172.21.15.60:0/2449318834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e100b5570 0x7f3e100b5950 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f3e000032b0 tx=0x7f3e00009270).stop 2020-10-31T22:41:06.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0ffff700 1 -- 172.21.15.60:0/2449318834 shutdown_connections 2020-10-31T22:41:06.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0ffff700 1 --2- 172.21.15.60:0/2449318834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e10141f00 0x7f3e10142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0ffff700 1 --2- 172.21.15.60:0/2449318834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e100b5570 0x7f3e100b5950 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0ffff700 1 -- 172.21.15.60:0/2449318834 >> 172.21.15.60:0/2449318834 conn(0x7f3e100b8e90 msgr2=0x7f3e100b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:06.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0ffff700 1 -- 172.21.15.60:0/2449318834 shutdown_connections 2020-10-31T22:41:06.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0ffff700 1 -- 172.21.15.60:0/2449318834 wait complete. 2020-10-31T22:41:06.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0ffff700 1 Processor -- start 2020-10-31T22:41:06.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0ffff700 1 -- start start 2020-10-31T22:41:06.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0ffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e100b24a0 0x7f3e10148220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:06.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.879+0000 7f3e0ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e100b5570 0x7f3e10151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:06.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e10141f00 0x7f3e101515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:06.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e10144e40 con 0x7f3e10141f00 2020-10-31T22:41:06.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0ffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e10144660 con 0x7f3e100b24a0 2020-10-31T22:41:06.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e10144900 con 0x7f3e100b5570 2020-10-31T22:41:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e10141f00 0x7f3e101515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e10141f00 0x7f3e101515f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41094/0 (socket says 172.21.15.60:41094) 2020-10-31T22:41:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0f7fe700 1 -- 172.21.15.60:0/3078838406 learned_addr learned my addr 172.21.15.60:0/3078838406 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:06.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0effd700 1 --2- 172.21.15.60:0/3078838406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e100b24a0 0x7f3e10148220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0e7fc700 1 --2- 172.21.15.60:0/3078838406 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e100b5570 0x7f3e10151100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0f7fe700 1 -- 172.21.15.60:0/3078838406 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e100b5570 msgr2=0x7f3e10151100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:06.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0f7fe700 1 --2- 172.21.15.60:0/3078838406 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e100b5570 0x7f3e10151100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0f7fe700 1 -- 172.21.15.60:0/3078838406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e100b24a0 msgr2=0x7f3e10148220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0f7fe700 1 --2- 172.21.15.60:0/3078838406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e100b24a0 0x7f3e10148220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0f7fe700 1 -- 172.21.15.60:0/3078838406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e10144ba0 con 0x7f3e10141f00 2020-10-31T22:41:06.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0f7fe700 1 --2- 172.21.15.60:0/3078838406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e10141f00 0x7f3e101515f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3e08006a50 tx=0x7f3e08006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e07fff700 1 -- 172.21.15.60:0/3078838406 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0800ca10 con 0x7f3e10141f00 2020-10-31T22:41:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e07fff700 1 -- 172.21.15.60:0/3078838406 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0800cb70 con 0x7f3e10141f00 2020-10-31T22:41:06.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0ffff700 1 -- 172.21.15.60:0/3078838406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e10150c60 con 0x7f3e10141f00 2020-10-31T22:41:06.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e07fff700 1 -- 172.21.15.60:0/3078838406 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e0800eeb0 con 0x7f3e10141f00 2020-10-31T22:41:06.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0ffff700 1 -- 172.21.15.60:0/3078838406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e100ad280 con 0x7f3e10141f00 2020-10-31T22:41:06.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e0ffff700 1 -- 172.21.15.60:0/3078838406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e10148d40 con 0x7f3e10141f00 2020-10-31T22:41:06.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e07fff700 1 -- 172.21.15.60:0/3078838406 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3e0801c460 con 0x7f3e10141f00 2020-10-31T22:41:06.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.883+0000 7f3e07fff700 1 --2- 172.21.15.60:0/3078838406 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3df4054f90 0x7f3df4057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:06.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.887+0000 7f3e07fff700 1 -- 172.21.15.60:0/3078838406 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3e0806dab0 con 0x7f3e10141f00 2020-10-31T22:41:06.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.887+0000 7f3e0effd700 1 --2- 172.21.15.60:0/3078838406 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3df4054f90 0x7f3df4057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:06.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.887+0000 7f3e0effd700 1 --2- 172.21.15.60:0/3078838406 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3df4054f90 0x7f3df4057450 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3e0001a000 tx=0x7f3e00016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:06.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:06.891+0000 7f3e07fff700 1 -- 172.21.15.60:0/3078838406 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3e10148d40 con 0x7f3e10141f00 2020-10-31T22:41:07.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.031+0000 7f3e0ffff700 1 -- 172.21.15.60:0/3078838406 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3e10148d40 con 0x7f3e10141f00 2020-10-31T22:41:07.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.035+0000 7f3e07fff700 1 -- 172.21.15.60:0/3078838406 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v17) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3e10148d40 con 0x7f3e10141f00 2020-10-31T22:41:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.035+0000 7f3e0ffff700 1 -- 172.21.15.60:0/3078838406 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3df4054f90 msgr2=0x7f3df4057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.035+0000 7f3e0ffff700 1 --2- 172.21.15.60:0/3078838406 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3df4054f90 0x7f3df4057450 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3e0001a000 tx=0x7f3e00016000).stop 2020-10-31T22:41:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.035+0000 7f3e0ffff700 1 -- 172.21.15.60:0/3078838406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e10141f00 msgr2=0x7f3e101515f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.035+0000 7f3e0ffff700 1 --2- 172.21.15.60:0/3078838406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e10141f00 0x7f3e101515f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f3e08006a50 tx=0x7f3e08006dc0).stop 2020-10-31T22:41:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.035+0000 7f3e0ffff700 1 -- 172.21.15.60:0/3078838406 shutdown_connections 2020-10-31T22:41:07.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.035+0000 7f3e0ffff700 1 --2- 172.21.15.60:0/3078838406 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e10141f00 0x7f3e101515f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.035+0000 7f3e0ffff700 1 --2- 172.21.15.60:0/3078838406 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3df4054f90 0x7f3df4057450 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.035+0000 7f3e0ffff700 1 --2- 172.21.15.60:0/3078838406 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e100b24a0 0x7f3e10148220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.035+0000 7f3e0ffff700 1 --2- 172.21.15.60:0/3078838406 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e100b5570 0x7f3e10151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.035+0000 7f3e0ffff700 1 -- 172.21.15.60:0/3078838406 >> 172.21.15.60:0/3078838406 conn(0x7f3e100b8e90 msgr2=0x7f3e100b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:07.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.035+0000 7f3e0ffff700 1 -- 172.21.15.60:0/3078838406 shutdown_connections 2020-10-31T22:41:07.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.035+0000 7f3e0ffff700 1 -- 172.21.15.60:0/3078838406 wait complete. 2020-10-31T22:41:07.042 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:41:07.052 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:41:07.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.167+0000 7f3fb759e700 1 Processor -- start 2020-10-31T22:41:07.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 -- start start 2020-10-31T22:41:07.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3fb80afdc0 0x7f3fb813be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3fb80a7530 0x7f3fb813edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3fb813c310 0x7f3fb813f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb813f7d0 con 0x7f3fb80afdc0 2020-10-31T22:41:07.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb81429d0 con 0x7f3fb80a7530 2020-10-31T22:41:07.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb8142c70 con 0x7f3fb813c310 2020-10-31T22:41:07.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3fb80afdc0 0x7f3fb813be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3fb80afdc0 0x7f3fb813be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41098/0 (socket says 172.21.15.60:41098) 2020-10-31T22:41:07.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb659c700 1 -- 172.21.15.60:0/476292433 learned_addr learned my addr 172.21.15.60:0/476292433 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:07.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb5d9b700 1 --2- 172.21.15.60:0/476292433 >> v2:172.21.15.66:3300/0 conn(0x7f3fb80a7530 0x7f3fb813edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb6d9d700 1 --2- 172.21.15.60:0/476292433 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3fb813c310 0x7f3fb813f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb659c700 1 -- 172.21.15.60:0/476292433 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3fb813c310 msgr2=0x7f3fb813f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:07.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb659c700 1 --2- 172.21.15.60:0/476292433 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3fb813c310 0x7f3fb813f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb659c700 1 -- 172.21.15.60:0/476292433 >> v2:172.21.15.66:3300/0 conn(0x7f3fb80a7530 msgr2=0x7f3fb813edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:07.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb659c700 1 --2- 172.21.15.60:0/476292433 >> v2:172.21.15.66:3300/0 conn(0x7f3fb80a7530 0x7f3fb813edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb659c700 1 -- 172.21.15.60:0/476292433 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb813e8e0 con 0x7f3fb80afdc0 2020-10-31T22:41:07.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb5d9b700 1 --2- 172.21.15.60:0/476292433 >> v2:172.21.15.66:3300/0 conn(0x7f3fb80a7530 0x7f3fb813edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:07.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb659c700 1 --2- 172.21.15.60:0/476292433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb80afdc0 0x7f3fb813be20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3fa8002f30 tx=0x7f3fa8006e20).ready entity=mon.0 client_cookie=2df7004aae8ce77b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:07.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb559a700 1 -- 172.21.15.60:0/476292433 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa80098c0 con 0x7f3fb80afdc0 2020-10-31T22:41:07.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb559a700 1 -- 172.21.15.60:0/476292433 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa8009a20 con 0x7f3fb80afdc0 2020-10-31T22:41:07.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb559a700 1 -- 172.21.15.60:0/476292433 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fa8009d80 con 0x7f3fb80afdc0 2020-10-31T22:41:07.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 -- 172.21.15.60:0/476292433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb80afdc0 msgr2=0x7f3fb813be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 --2- 172.21.15.60:0/476292433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb80afdc0 0x7f3fb813be20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3fa8002f30 tx=0x7f3fa8006e20).stop 2020-10-31T22:41:07.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 -- 172.21.15.60:0/476292433 shutdown_connections 2020-10-31T22:41:07.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 --2- 172.21.15.60:0/476292433 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3fb813c310 0x7f3fb813f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 --2- 172.21.15.60:0/476292433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb80afdc0 0x7f3fb813be20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 --2- 172.21.15.60:0/476292433 >> v2:172.21.15.66:3300/0 conn(0x7f3fb80a7530 0x7f3fb813edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 -- 172.21.15.60:0/476292433 >> 172.21.15.60:0/476292433 conn(0x7f3fb80b3fd0 msgr2=0x7f3fb80b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:07.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 -- 172.21.15.60:0/476292433 shutdown_connections 2020-10-31T22:41:07.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 -- 172.21.15.60:0/476292433 wait complete. 2020-10-31T22:41:07.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 Processor -- start 2020-10-31T22:41:07.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.171+0000 7f3fb759e700 1 -- start start 2020-10-31T22:41:07.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3fb80afdc0 0x7f3fb8141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb813c310 0x7f3fb8137760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fb8137c50 0x7f3fb80a8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb80aa5e0 con 0x7f3fb813c310 2020-10-31T22:41:07.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb80aa880 con 0x7f3fb8137c50 2020-10-31T22:41:07.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb80aab20 con 0x7f3fb80afdc0 2020-10-31T22:41:07.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb813c310 0x7f3fb8137760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb813c310 0x7f3fb8137760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41104/0 (socket says 172.21.15.60:41104) 2020-10-31T22:41:07.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb5d9b700 1 -- 172.21.15.60:0/2162052236 learned_addr learned my addr 172.21.15.60:0/2162052236 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:07.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb6d9d700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fb8137c50 0x7f3fb80a8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb5d9b700 1 -- 172.21.15.60:0/2162052236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3fb80afdc0 msgr2=0x7f3fb8141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb659c700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3fb80afdc0 0x7f3fb8141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb5d9b700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3fb80afdc0 0x7f3fb8141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb5d9b700 1 -- 172.21.15.60:0/2162052236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fb8137c50 msgr2=0x7f3fb80a8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb5d9b700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fb8137c50 0x7f3fb80a8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb5d9b700 1 -- 172.21.15.60:0/2162052236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb81385f0 con 0x7f3fb813c310 2020-10-31T22:41:07.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb6d9d700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fb8137c50 0x7f3fb80a8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:07.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb659c700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3fb80afdc0 0x7f3fb8141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:41:07.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb5d9b700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb813c310 0x7f3fb8137760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3fac00a000 tx=0x7f3fac008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:07.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fa77fe700 1 -- 172.21.15.60:0/2162052236 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fac0099c0 con 0x7f3fb813c310 2020-10-31T22:41:07.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb759e700 1 -- 172.21.15.60:0/2162052236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb8066900 con 0x7f3fb813c310 2020-10-31T22:41:07.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb759e700 1 -- 172.21.15.60:0/2162052236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb813a5a0 con 0x7f3fb813c310 2020-10-31T22:41:07.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fa77fe700 1 -- 172.21.15.60:0/2162052236 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac009b20 con 0x7f3fb813c310 2020-10-31T22:41:07.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fa77fe700 1 -- 172.21.15.60:0/2162052236 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3fac00de80 con 0x7f3fb813c310 2020-10-31T22:41:07.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.175+0000 7f3fb759e700 1 -- 172.21.15.60:0/2162052236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb8066a90 con 0x7f3fb813c310 2020-10-31T22:41:07.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.179+0000 7f3fa77fe700 1 -- 172.21.15.60:0/2162052236 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3fac013480 con 0x7f3fb813c310 2020-10-31T22:41:07.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.179+0000 7f3fa77fe700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3f94055020 0x7f3f940574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.179+0000 7f3fa77fe700 1 -- 172.21.15.60:0/2162052236 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3fac06df10 con 0x7f3fb813c310 2020-10-31T22:41:07.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.179+0000 7f3fb659c700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3f94055020 0x7f3f940574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.179+0000 7f3fb659c700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3f94055020 0x7f3f940574e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3fa8016000 tx=0x7f3fa8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:07.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.183+0000 7f3fa77fe700 1 -- 172.21.15.60:0/2162052236 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3fac044660 con 0x7f3fb813c310 2020-10-31T22:41:07.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.331+0000 7f3fb759e700 1 -- 172.21.15.60:0/2162052236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3fb80aace0 con 0x7f3fb813c310 2020-10-31T22:41:07.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.331+0000 7f3fa77fe700 1 -- 172.21.15.60:0/2162052236 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v17) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3fac047c80 con 0x7f3fb813c310 2020-10-31T22:41:07.335 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:07.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.331+0000 7f3fb759e700 1 -- 172.21.15.60:0/2162052236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3f94055020 msgr2=0x7f3f940574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.331+0000 7f3fb759e700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3f94055020 0x7f3f940574e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f3fa8016000 tx=0x7f3fa8015000).stop 2020-10-31T22:41:07.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.331+0000 7f3fb759e700 1 -- 172.21.15.60:0/2162052236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb813c310 msgr2=0x7f3fb8137760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.331+0000 7f3fb759e700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb813c310 0x7f3fb8137760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f3fac00a000 tx=0x7f3fac008040).stop 2020-10-31T22:41:07.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.335+0000 7f3fb759e700 1 -- 172.21.15.60:0/2162052236 shutdown_connections 2020-10-31T22:41:07.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.335+0000 7f3fb759e700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3f94055020 0x7f3f940574e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.335+0000 7f3fb759e700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fb8137c50 0x7f3fb80a8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.335+0000 7f3fb759e700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3fb80afdc0 0x7f3fb8141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.335+0000 7f3fb759e700 1 --2- 172.21.15.60:0/2162052236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3fb813c310 0x7f3fb8137760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.335+0000 7f3fb759e700 1 -- 172.21.15.60:0/2162052236 >> 172.21.15.60:0/2162052236 conn(0x7f3fb80b3fd0 msgr2=0x7f3fb80acb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:07.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.335+0000 7f3fb759e700 1 -- 172.21.15.60:0/2162052236 shutdown_connections 2020-10-31T22:41:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.335+0000 7f3fb759e700 1 -- 172.21.15.60:0/2162052236 wait complete. 2020-10-31T22:41:07.350 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-10-31T22:41:07.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.455+0000 7fceaf59e700 1 Processor -- start 2020-10-31T22:41:07.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.455+0000 7fceaf59e700 1 -- start start 2020-10-31T22:41:07.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaf59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fceb00ac870 0x7fceb00b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaf59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fceb00ae8b0 0x7fceb01412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaf59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb00acc50 con 0x7fceb00b0e20 2020-10-31T22:41:07.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaf59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fceb00b14c0 con 0x7fceb00ac870 2020-10-31T22:41:07.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaf59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00b5690 con 0x7fceb00ae8b0 2020-10-31T22:41:07.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fcea5d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fceb00b0e20 0x7fceb00ae1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45250/0 (socket says 172.21.15.60:45250) 2020-10-31T22:41:07.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fcea5d9b700 1 -- 172.21.15.60:0/343910658 learned_addr learned my addr 172.21.15.60:0/343910658 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:07.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceae59c700 1 --2- 172.21.15.60:0/343910658 >> v2:172.21.15.66:3300/0 conn(0x7fceb00ac870 0x7fceb00b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaed9d700 1 --2- 172.21.15.60:0/343910658 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fceb00ae8b0 0x7fceb01412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceadd9b700 1 -- 172.21.15.60:0/343910658 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041459559 0 0) 0x7fceb00acc50 con 0x7fceb00b0e20 2020-10-31T22:41:07.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceadd9b700 1 -- 172.21.15.60:0/343910658 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce90003230 con 0x7fceb00b0e20 2020-10-31T22:41:07.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaed9d700 1 -- 172.21.15.60:0/343910658 >> v2:172.21.15.66:3300/0 conn(0x7fceb00ac870 msgr2=0x7fceb00b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:07.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaed9d700 1 --2- 172.21.15.60:0/343910658 >> v2:172.21.15.66:3300/0 conn(0x7fceb00ac870 0x7fceb00b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaed9d700 1 -- 172.21.15.60:0/343910658 >> v1:172.21.15.60:6789/0 conn(0x7fceb00b0e20 legacy=0x7fceb00ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaed9d700 1 -- 172.21.15.60:0/343910658 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb00afc10 con 0x7fceb00ae8b0 2020-10-31T22:41:07.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaed9d700 1 --2- 172.21.15.60:0/343910658 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fceb00ae8b0 0x7fceb01412e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fcea80032b0 tx=0x7fcea80091a0).ready entity=mon.2 client_cookie=4cc155e09ed609b9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:07.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceadd9b700 1 -- 172.21.15.60:0/343910658 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcea800b9d0 con 0x7fceb00ae8b0 2020-10-31T22:41:07.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceadd9b700 1 -- 172.21.15.60:0/343910658 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea800bb30 con 0x7fceb00ae8b0 2020-10-31T22:41:07.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceadd9b700 1 -- 172.21.15.60:0/343910658 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcea800bca0 con 0x7fceb00ae8b0 2020-10-31T22:41:07.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaf59e700 1 -- 172.21.15.60:0/343910658 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fceb00ae8b0 msgr2=0x7fceb01412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaf59e700 1 --2- 172.21.15.60:0/343910658 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fceb00ae8b0 0x7fceb01412e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fcea80032b0 tx=0x7fcea80091a0).stop 2020-10-31T22:41:07.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaf59e700 1 -- 172.21.15.60:0/343910658 shutdown_connections 2020-10-31T22:41:07.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaf59e700 1 --2- 172.21.15.60:0/343910658 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fceb00ae8b0 0x7fceb01412e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaf59e700 1 --2- 172.21.15.60:0/343910658 >> v2:172.21.15.66:3300/0 conn(0x7fceb00ac870 0x7fceb00b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaf59e700 1 -- 172.21.15.60:0/343910658 >> 172.21.15.60:0/343910658 conn(0x7fceb006a600 msgr2=0x7fceb0060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:07.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaf59e700 1 -- 172.21.15.60:0/343910658 shutdown_connections 2020-10-31T22:41:07.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.459+0000 7fceaf59e700 1 -- 172.21.15.60:0/343910658 wait complete. 2020-10-31T22:41:07.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.463+0000 7fceaf59e700 1 Processor -- start 2020-10-31T22:41:07.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.463+0000 7fceaf59e700 1 -- start start 2020-10-31T22:41:07.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.463+0000 7fceaf59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fceb00ac870 0x7fceb01466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.463+0000 7fceaf59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb00ae8b0 0x7fceb00a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.463+0000 7fceaf59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fceb00b0e20 0x7fceb009e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.463+0000 7fceaf59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb009f780 con 0x7fceb00ae8b0 2020-10-31T22:41:07.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.463+0000 7fceaf59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb0146e80 con 0x7fceb00b0e20 2020-10-31T22:41:07.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.463+0000 7fceaf59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb00a9320 con 0x7fceb00ac870 2020-10-31T22:41:07.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.463+0000 7fcea5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb00ae8b0 0x7fceb00a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.463+0000 7fcea5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb00ae8b0 0x7fceb00a9b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41120/0 (socket says 172.21.15.60:41120) 2020-10-31T22:41:07.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.463+0000 7fcea5d9b700 1 -- 172.21.15.60:0/1645765486 learned_addr learned my addr 172.21.15.60:0/1645765486 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:07.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.463+0000 7fceae59c700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fceb00ac870 0x7fceb01466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.463+0000 7fceaed9d700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fceb00b0e20 0x7fceb009e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.467+0000 7fcea5d9b700 1 -- 172.21.15.60:0/1645765486 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fceb00ac870 msgr2=0x7fceb01466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.467+0000 7fcea5d9b700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fceb00ac870 0x7fceb01466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.467+0000 7fcea5d9b700 1 -- 172.21.15.60:0/1645765486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fceb00b0e20 msgr2=0x7fceb009e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.467+0000 7fcea5d9b700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fceb00b0e20 0x7fceb009e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.467+0000 7fcea5d9b700 1 -- 172.21.15.60:0/1645765486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb0154bc0 con 0x7fceb00ae8b0 2020-10-31T22:41:07.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.467+0000 7fceaed9d700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fceb00b0e20 0x7fceb009e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:07.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.467+0000 7fcea5d9b700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb00ae8b0 0x7fceb00a9b80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fceb0146fc0 tx=0x7fce98007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:07.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.467+0000 7fcea7fff700 1 -- 172.21.15.60:0/1645765486 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce980072e0 con 0x7fceb00ae8b0 2020-10-31T22:41:07.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.467+0000 7fcea7fff700 1 -- 172.21.15.60:0/1645765486 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce98007440 con 0x7fceb00ae8b0 2020-10-31T22:41:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.467+0000 7fceaf59e700 1 -- 172.21.15.60:0/1645765486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb00aa4e0 con 0x7fceb00ae8b0 2020-10-31T22:41:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.467+0000 7fcea7fff700 1 -- 172.21.15.60:0/1645765486 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce980057d0 con 0x7fceb00ae8b0 2020-10-31T22:41:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.467+0000 7fceaf59e700 1 -- 172.21.15.60:0/1645765486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb00aaa20 con 0x7fceb00ae8b0 2020-10-31T22:41:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.467+0000 7fceaf59e700 1 -- 172.21.15.60:0/1645765486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceb0057100 con 0x7fceb00ae8b0 2020-10-31T22:41:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.467+0000 7fcea7fff700 1 -- 172.21.15.60:0/1645765486 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fce98010070 con 0x7fceb00ae8b0 2020-10-31T22:41:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.471+0000 7fcea7fff700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce94054f30 0x7fce940573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.471+0000 7fcea7fff700 1 -- 172.21.15.60:0/1645765486 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fce9806ccc0 con 0x7fceb00ae8b0 2020-10-31T22:41:07.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.471+0000 7fceae59c700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce94054f30 0x7fce940573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.471+0000 7fceae59c700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce94054f30 0x7fce940573f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fcea000b000 tx=0x7fcea0006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:07.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.475+0000 7fcea7fff700 1 -- 172.21.15.60:0/1645765486 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fce98043470 con 0x7fceb00ae8b0 2020-10-31T22:41:07.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.623+0000 7fceaf59e700 1 -- 172.21.15.60:0/1645765486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fceb00a9920 con 0x7fceb00ae8b0 2020-10-31T22:41:07.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.623+0000 7fcea7fff700 1 -- 172.21.15.60:0/1645765486 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+143 (secure 0 0 0) 0x7fce98046a90 con 0x7fceb00ae8b0 2020-10-31T22:41:07.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.627+0000 7fceaf59e700 1 -- 172.21.15.60:0/1645765486 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce94054f30 msgr2=0x7fce940573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.627+0000 7fceaf59e700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce94054f30 0x7fce940573f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fcea000b000 tx=0x7fcea0006dc0).stop 2020-10-31T22:41:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.627+0000 7fceaf59e700 1 -- 172.21.15.60:0/1645765486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb00ae8b0 msgr2=0x7fceb00a9b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.627+0000 7fceaf59e700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb00ae8b0 0x7fceb00a9b80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fceb0146fc0 tx=0x7fce98007a70).stop 2020-10-31T22:41:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.627+0000 7fceaf59e700 1 -- 172.21.15.60:0/1645765486 shutdown_connections 2020-10-31T22:41:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.627+0000 7fceaf59e700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce94054f30 0x7fce940573f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.627+0000 7fceaf59e700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fceb00b0e20 0x7fceb009e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.627+0000 7fceaf59e700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fceb00ac870 0x7fceb01466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.627+0000 7fceaf59e700 1 --2- 172.21.15.60:0/1645765486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fceb00ae8b0 0x7fceb00a9b80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.627+0000 7fceaf59e700 1 -- 172.21.15.60:0/1645765486 >> 172.21.15.60:0/1645765486 conn(0x7fceb006a600 msgr2=0x7fceb00a8140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.627+0000 7fceaf59e700 1 -- 172.21.15.60:0/1645765486 shutdown_connections 2020-10-31T22:41:07.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.627+0000 7fceaf59e700 1 -- 172.21.15.60:0/1645765486 wait complete. 2020-10-31T22:41:07.644 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:07.645 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2020-10-31T22:41:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2020-10-31T22:41:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "device_health_metrics" 2020-10-31T22:41:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:07.645 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2020-10-31T22:41:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2020-10-31T22:41:07.646 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:07.646 INFO:teuthology.orchestra.run.smithi060.stdout:] 2020-10-31T22:41:07.647 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-10-31T22:41:07.648 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:41:07.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.763+0000 7f9ca6a29700 1 Processor -- start 2020-10-31T22:41:07.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.763+0000 7f9ca6a29700 1 -- start start 2020-10-31T22:41:07.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.763+0000 7f9ca6a29700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ca00b5570 0x7f9ca00b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.763+0000 7f9ca6a29700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ca00b24a0 0x7f9ca0145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.763+0000 7f9ca6a29700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca00b4440 con 0x7f9ca0145e40 2020-10-31T22:41:07.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.763+0000 7f9ca6a29700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca013f930 con 0x7f9ca00b5570 2020-10-31T22:41:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.763+0000 7f9ca6a29700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00b02f0 con 0x7f9ca00b24a0 2020-10-31T22:41:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.763+0000 7f9ca6228700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9ca0145e40 0x7f9ca0141f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45268/0 (socket says 172.21.15.60:45268) 2020-10-31T22:41:07.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.763+0000 7f9ca6228700 1 -- 172.21.15.60:0/1630192568 learned_addr learned my addr 172.21.15.60:0/1630192568 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:07.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.763+0000 7f9ca5a27700 1 --2- 172.21.15.60:0/1630192568 >> v2:172.21.15.60:3300/0 conn(0x7f9ca00b5570 0x7f9ca00b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca5226700 1 --2- 172.21.15.60:0/1630192568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ca00b24a0 0x7f9ca0145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca5a27700 1 -- 172.21.15.60:0/1630192568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ca00b24a0 msgr2=0x7f9ca0145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:07.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca4a25700 1 -- 172.21.15.60:0/1630192568 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533115369 0 0) 0x7f9ca00b4440 con 0x7f9ca0145e40 2020-10-31T22:41:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca5a27700 1 --2- 172.21.15.60:0/1630192568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ca00b24a0 0x7f9ca0145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca5a27700 1 -- 172.21.15.60:0/1630192568 >> v1:172.21.15.60:6789/0 conn(0x7f9ca0145e40 legacy=0x7f9ca0141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca5a27700 1 -- 172.21.15.60:0/1630192568 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca00b0590 con 0x7f9ca00b5570 2020-10-31T22:41:07.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca5a27700 1 --2- 172.21.15.60:0/1630192568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ca00b5570 0x7f9ca00b5950 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9ca0141c20 tx=0x7f9c9c006dc0).ready entity=mon.0 client_cookie=ed603ca4dce08e8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:07.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca4a25700 1 -- 172.21.15.60:0/1630192568 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c9c009720 con 0x7f9ca00b5570 2020-10-31T22:41:07.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca4a25700 1 -- 172.21.15.60:0/1630192568 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9c009880 con 0x7f9ca00b5570 2020-10-31T22:41:07.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca4a25700 1 -- 172.21.15.60:0/1630192568 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c9c009be0 con 0x7f9ca00b5570 2020-10-31T22:41:07.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca6a29700 1 -- 172.21.15.60:0/1630192568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ca00b5570 msgr2=0x7f9ca00b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca6a29700 1 --2- 172.21.15.60:0/1630192568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ca00b5570 0x7f9ca00b5950 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9ca0141c20 tx=0x7f9c9c006dc0).stop 2020-10-31T22:41:07.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca6a29700 1 -- 172.21.15.60:0/1630192568 shutdown_connections 2020-10-31T22:41:07.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca6a29700 1 --2- 172.21.15.60:0/1630192568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ca00b5570 0x7f9ca00b5950 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca6a29700 1 --2- 172.21.15.60:0/1630192568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ca00b24a0 0x7f9ca0145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca6a29700 1 -- 172.21.15.60:0/1630192568 >> 172.21.15.60:0/1630192568 conn(0x7f9ca00b8e90 msgr2=0x7f9ca00b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:07.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca6a29700 1 -- 172.21.15.60:0/1630192568 shutdown_connections 2020-10-31T22:41:07.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.767+0000 7f9ca6a29700 1 -- 172.21.15.60:0/1630192568 wait complete. 2020-10-31T22:41:07.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca6a29700 1 Processor -- start 2020-10-31T22:41:07.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca6a29700 1 -- start start 2020-10-31T22:41:07.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca6a29700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ca00b24a0 0x7f9ca0144c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca6a29700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ca00b5570 0x7f9ca0150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca6a29700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ca0145e40 0x7f9ca0151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca6a29700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca01477a0 con 0x7f9ca00b5570 2020-10-31T22:41:07.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca6a29700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca01507f0 con 0x7f9ca0145e40 2020-10-31T22:41:07.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca6a29700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca0148470 con 0x7f9ca00b24a0 2020-10-31T22:41:07.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca5226700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ca00b5570 0x7f9ca0150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca5226700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ca00b5570 0x7f9ca0150e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41136/0 (socket says 172.21.15.60:41136) 2020-10-31T22:41:07.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca5226700 1 -- 172.21.15.60:0/107281167 learned_addr learned my addr 172.21.15.60:0/107281167 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:07.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca5a27700 1 --2- 172.21.15.60:0/107281167 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ca00b24a0 0x7f9ca0144c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca6228700 1 --2- 172.21.15.60:0/107281167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ca0145e40 0x7f9ca0151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca5226700 1 -- 172.21.15.60:0/107281167 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ca00b24a0 msgr2=0x7f9ca0144c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca5226700 1 --2- 172.21.15.60:0/107281167 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ca00b24a0 0x7f9ca0144c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca5226700 1 -- 172.21.15.60:0/107281167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ca0145e40 msgr2=0x7f9ca0151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:07.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca5226700 1 --2- 172.21.15.60:0/107281167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ca0145e40 0x7f9ca0151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:07.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca5226700 1 -- 172.21.15.60:0/107281167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca01509e0 con 0x7f9ca00b5570 2020-10-31T22:41:07.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.771+0000 7f9ca5226700 1 --2- 172.21.15.60:0/107281167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ca00b5570 0x7f9ca0150e40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9c9000c000 tx=0x7f9c90006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:07.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.775+0000 7f9c8effd700 1 -- 172.21.15.60:0/107281167 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c9000ca10 con 0x7f9ca00b5570 2020-10-31T22:41:07.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.775+0000 7f9c8effd700 1 -- 172.21.15.60:0/107281167 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9000cb70 con 0x7f9ca00b5570 2020-10-31T22:41:07.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.775+0000 7f9ca6a29700 1 -- 172.21.15.60:0/107281167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca0145640 con 0x7f9ca00b5570 2020-10-31T22:41:07.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.775+0000 7f9c8effd700 1 -- 172.21.15.60:0/107281167 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c900123f0 con 0x7f9ca00b5570 2020-10-31T22:41:07.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.775+0000 7f9ca6a29700 1 -- 172.21.15.60:0/107281167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca00abf00 con 0x7f9ca00b5570 2020-10-31T22:41:07.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.775+0000 7f9ca6a29700 1 -- 172.21.15.60:0/107281167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca01463e0 con 0x7f9ca00b5570 2020-10-31T22:41:07.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.775+0000 7f9c8effd700 1 -- 172.21.15.60:0/107281167 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9c90012550 con 0x7f9ca00b5570 2020-10-31T22:41:07.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.775+0000 7f9c8effd700 1 --2- 172.21.15.60:0/107281167 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9c80054f10 0x7f9c800573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:07.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.775+0000 7f9c8effd700 1 -- 172.21.15.60:0/107281167 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9c9006d9d0 con 0x7f9ca00b5570 2020-10-31T22:41:07.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.775+0000 7f9ca5a27700 1 --2- 172.21.15.60:0/107281167 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9c80054f10 0x7f9c800573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:07.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.775+0000 7f9ca5a27700 1 --2- 172.21.15.60:0/107281167 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9c80054f10 0x7f9c800573d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9c9c01b000 tx=0x7f9c9c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:07.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.783+0000 7f9c8effd700 1 -- 172.21.15.60:0/107281167 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9c900441c0 con 0x7f9ca00b5570 2020-10-31T22:41:07.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:07.923+0000 7f9ca6a29700 1 -- 172.21.15.60:0/107281167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f9ca0150b70 con 0x7f9ca00b5570 2020-10-31T22:41:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.559+0000 7f9c8effd700 1 -- 172.21.15.60:0/107281167 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v19) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9c900477e0 con 0x7f9ca00b5570 2020-10-31T22:41:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.563+0000 7f9ca6a29700 1 -- 172.21.15.60:0/107281167 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9c80054f10 msgr2=0x7f9c800573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.563+0000 7f9ca6a29700 1 --2- 172.21.15.60:0/107281167 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9c80054f10 0x7f9c800573d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f9c9c01b000 tx=0x7f9c9c015000).stop 2020-10-31T22:41:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.563+0000 7f9ca6a29700 1 -- 172.21.15.60:0/107281167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ca00b5570 msgr2=0x7f9ca0150e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.563+0000 7f9ca6a29700 1 --2- 172.21.15.60:0/107281167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ca00b5570 0x7f9ca0150e40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f9c9000c000 tx=0x7f9c90006dc0).stop 2020-10-31T22:41:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.563+0000 7f9ca6a29700 1 -- 172.21.15.60:0/107281167 shutdown_connections 2020-10-31T22:41:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.563+0000 7f9ca6a29700 1 --2- 172.21.15.60:0/107281167 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9c80054f10 0x7f9c800573d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.563+0000 7f9ca6a29700 1 --2- 172.21.15.60:0/107281167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ca0145e40 0x7f9ca0151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.563+0000 7f9ca6a29700 1 --2- 172.21.15.60:0/107281167 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ca00b24a0 0x7f9ca0144c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.563+0000 7f9ca6a29700 1 --2- 172.21.15.60:0/107281167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ca00b5570 0x7f9ca0150e40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.563+0000 7f9ca6a29700 1 -- 172.21.15.60:0/107281167 >> 172.21.15.60:0/107281167 conn(0x7f9ca00b8e90 msgr2=0x7f9ca00b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.567+0000 7f9ca6a29700 1 -- 172.21.15.60:0/107281167 shutdown_connections 2020-10-31T22:41:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.567+0000 7f9ca6a29700 1 -- 172.21.15.60:0/107281167 wait complete. 2020-10-31T22:41:08.571 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:41:08.592 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-10-31T22:41:08.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.711+0000 7fc6588e7700 1 Processor -- start 2020-10-31T22:41:08.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.711+0000 7fc6588e7700 1 -- start start 2020-10-31T22:41:08.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.711+0000 7fc6588e7700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc6540b5570 0x7fc6540b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:08.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.711+0000 7fc6588e7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6540b24a0 0x7fc654145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:08.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.711+0000 7fc6588e7700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6540b4440 con 0x7fc654145e40 2020-10-31T22:41:08.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.711+0000 7fc6588e7700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65413f930 con 0x7fc6540b5570 2020-10-31T22:41:08.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.711+0000 7fc6588e7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6540b02f0 con 0x7fc6540b24a0 2020-10-31T22:41:08.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.711+0000 7fc65359e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc654145e40 0x7fc654141f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45282/0 (socket says 172.21.15.60:45282) 2020-10-31T22:41:08.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.711+0000 7fc65359e700 1 -- 172.21.15.60:0/3740395005 learned_addr learned my addr 172.21.15.60:0/3740395005 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:08.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.711+0000 7fc652d9d700 1 --2- 172.21.15.60:0/3740395005 >> v2:172.21.15.66:3300/0 conn(0x7fc6540b5570 0x7fc6540b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:08.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.711+0000 7fc65259c700 1 --2- 172.21.15.60:0/3740395005 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6540b24a0 0x7fc654145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:08.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.711+0000 7fc651d9b700 1 -- 172.21.15.60:0/3740395005 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 585524455 0 0) 0x7fc6540b4440 con 0x7fc654145e40 2020-10-31T22:41:08.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.711+0000 7fc651d9b700 1 -- 172.21.15.60:0/3740395005 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc638003230 con 0x7fc654145e40 2020-10-31T22:41:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc65259c700 1 -- 172.21.15.60:0/3740395005 >> v2:172.21.15.66:3300/0 conn(0x7fc6540b5570 msgr2=0x7fc6540b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc65259c700 1 --2- 172.21.15.60:0/3740395005 >> v2:172.21.15.66:3300/0 conn(0x7fc6540b5570 0x7fc6540b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc65259c700 1 -- 172.21.15.60:0/3740395005 >> v1:172.21.15.60:6789/0 conn(0x7fc654145e40 legacy=0x7fc654141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:08.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc65259c700 1 -- 172.21.15.60:0/3740395005 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6540b0590 con 0x7fc6540b24a0 2020-10-31T22:41:08.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc652d9d700 1 --2- 172.21.15.60:0/3740395005 >> v2:172.21.15.66:3300/0 conn(0x7fc6540b5570 0x7fc6540b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:08.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc65259c700 1 --2- 172.21.15.60:0/3740395005 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6540b24a0 0x7fc654145950 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fc654141c20 tx=0x7fc644006dc0).ready entity=mon.2 client_cookie=13c3485e247b5b18 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:08.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc651d9b700 1 -- 172.21.15.60:0/3740395005 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6440096a0 con 0x7fc6540b24a0 2020-10-31T22:41:08.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc651d9b700 1 -- 172.21.15.60:0/3740395005 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc644009800 con 0x7fc6540b24a0 2020-10-31T22:41:08.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc651d9b700 1 -- 172.21.15.60:0/3740395005 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc644009b60 con 0x7fc6540b24a0 2020-10-31T22:41:08.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc6588e7700 1 -- 172.21.15.60:0/3740395005 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6540b24a0 msgr2=0x7fc654145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:08.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc6588e7700 1 --2- 172.21.15.60:0/3740395005 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6540b24a0 0x7fc654145950 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fc654141c20 tx=0x7fc644006dc0).stop 2020-10-31T22:41:08.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc6588e7700 1 -- 172.21.15.60:0/3740395005 shutdown_connections 2020-10-31T22:41:08.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc6588e7700 1 --2- 172.21.15.60:0/3740395005 >> v2:172.21.15.66:3300/0 conn(0x7fc6540b5570 0x7fc6540b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:08.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc6588e7700 1 --2- 172.21.15.60:0/3740395005 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6540b24a0 0x7fc654145950 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:08.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc6588e7700 1 -- 172.21.15.60:0/3740395005 >> 172.21.15.60:0/3740395005 conn(0x7fc6540b8e90 msgr2=0x7fc6540b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:08.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc6588e7700 1 -- 172.21.15.60:0/3740395005 shutdown_connections 2020-10-31T22:41:08.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.715+0000 7fc6588e7700 1 -- 172.21.15.60:0/3740395005 wait complete. 2020-10-31T22:41:08.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc6588e7700 1 Processor -- start 2020-10-31T22:41:08.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc6588e7700 1 -- start start 2020-10-31T22:41:08.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc6588e7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6540b24a0 0x7fc65413ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:08.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc6588e7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6540b5570 0x7fc654150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:08.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc6588e7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc654145e40 0x7fc654151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:08.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc6588e7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6541508c0 con 0x7fc654145e40 2020-10-31T22:41:08.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc6588e7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6541541c0 con 0x7fc6540b5570 2020-10-31T22:41:08.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc6588e7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc654067860 con 0x7fc6540b24a0 2020-10-31T22:41:08.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc65359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc654145e40 0x7fc654151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:08.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc65359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc654145e40 0x7fc654151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41152/0 (socket says 172.21.15.60:41152) 2020-10-31T22:41:08.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc65359e700 1 -- 172.21.15.60:0/3437006056 learned_addr learned my addr 172.21.15.60:0/3437006056 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:08.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc652d9d700 1 --2- 172.21.15.60:0/3437006056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6540b24a0 0x7fc65413ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:08.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc65259c700 1 --2- 172.21.15.60:0/3437006056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6540b5570 0x7fc654150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:08.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc65359e700 1 -- 172.21.15.60:0/3437006056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6540b24a0 msgr2=0x7fc65413ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:08.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc65359e700 1 --2- 172.21.15.60:0/3437006056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6540b24a0 0x7fc65413ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:08.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc65359e700 1 -- 172.21.15.60:0/3437006056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6540b5570 msgr2=0x7fc654150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:08.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc65359e700 1 --2- 172.21.15.60:0/3437006056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6540b5570 0x7fc654150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:08.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc65359e700 1 -- 172.21.15.60:0/3437006056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6540b8160 con 0x7fc654145e40 2020-10-31T22:41:08.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc65359e700 1 --2- 172.21.15.60:0/3437006056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc654145e40 0x7fc654151400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc654146870 tx=0x7fc64c007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc643fff700 1 -- 172.21.15.60:0/3437006056 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc64c00ce40 con 0x7fc654145e40 2020-10-31T22:41:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc643fff700 1 -- 172.21.15.60:0/3437006056 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c005b70 con 0x7fc654145e40 2020-10-31T22:41:08.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc6588e7700 1 -- 172.21.15.60:0/3437006056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc654150ab0 con 0x7fc654145e40 2020-10-31T22:41:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc643fff700 1 -- 172.21.15.60:0/3437006056 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc64c007110 con 0x7fc654145e40 2020-10-31T22:41:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.719+0000 7fc6588e7700 1 -- 172.21.15.60:0/3437006056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65413aa20 con 0x7fc654145e40 2020-10-31T22:41:08.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.723+0000 7fc6588e7700 1 -- 172.21.15.60:0/3437006056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc654057100 con 0x7fc654145e40 2020-10-31T22:41:08.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.723+0000 7fc643fff700 1 -- 172.21.15.60:0/3437006056 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc64c010030 con 0x7fc654145e40 2020-10-31T22:41:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.723+0000 7fc643fff700 1 --2- 172.21.15.60:0/3437006056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc630054f10 0x7fc6300573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.723+0000 7fc643fff700 1 -- 172.21.15.60:0/3437006056 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fc64c06d880 con 0x7fc654145e40 2020-10-31T22:41:08.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.723+0000 7fc652d9d700 1 --2- 172.21.15.60:0/3437006056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc630054f10 0x7fc6300573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:08.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.723+0000 7fc652d9d700 1 --2- 172.21.15.60:0/3437006056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc630054f10 0x7fc6300573d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc64800b000 tx=0x7fc648006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:08.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.731+0000 7fc643fff700 1 -- 172.21.15.60:0/3437006056 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc64c043e60 con 0x7fc654145e40 2020-10-31T22:41:08.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:08.867+0000 7fc6588e7700 1 -- 172.21.15.60:0/3437006056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fc65405a8e0 con 0x7fc654145e40 2020-10-31T22:41:09.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.575+0000 7fc643fff700 1 -- 172.21.15.60:0/3437006056 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v20) v1 ==== 125+0+0 (secure 0 0 0) 0x7fc64c047480 con 0x7fc654145e40 2020-10-31T22:41:09.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.587+0000 7fc6588e7700 1 -- 172.21.15.60:0/3437006056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc630054f10 msgr2=0x7fc6300573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:09.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.587+0000 7fc6588e7700 1 --2- 172.21.15.60:0/3437006056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc630054f10 0x7fc6300573d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fc64800b000 tx=0x7fc648006dc0).stop 2020-10-31T22:41:09.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.587+0000 7fc6588e7700 1 -- 172.21.15.60:0/3437006056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc654145e40 msgr2=0x7fc654151400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:09.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.587+0000 7fc6588e7700 1 --2- 172.21.15.60:0/3437006056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc654145e40 0x7fc654151400 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fc654146870 tx=0x7fc64c007d30).stop 2020-10-31T22:41:09.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.587+0000 7fc6588e7700 1 -- 172.21.15.60:0/3437006056 shutdown_connections 2020-10-31T22:41:09.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.587+0000 7fc6588e7700 1 --2- 172.21.15.60:0/3437006056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc654145e40 0x7fc654151400 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:09.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.587+0000 7fc6588e7700 1 --2- 172.21.15.60:0/3437006056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6540b24a0 0x7fc65413ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:09.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.587+0000 7fc6588e7700 1 --2- 172.21.15.60:0/3437006056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc630054f10 0x7fc6300573d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:09.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.587+0000 7fc6588e7700 1 --2- 172.21.15.60:0/3437006056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6540b5570 0x7fc654150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:09.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.587+0000 7fc6588e7700 1 -- 172.21.15.60:0/3437006056 >> 172.21.15.60:0/3437006056 conn(0x7fc6540b8e90 msgr2=0x7fc6540b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:09.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.587+0000 7fc6588e7700 1 -- 172.21.15.60:0/3437006056 shutdown_connections 2020-10-31T22:41:09.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.587+0000 7fc6588e7700 1 -- 172.21.15.60:0/3437006056 wait complete. 2020-10-31T22:41:09.714 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2020-10-31T22:41:09.716 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-10-31T22:41:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.843+0000 7fd1bf59e700 1 Processor -- start 2020-10-31T22:41:09.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.843+0000 7fd1bf59e700 1 -- start start 2020-10-31T22:41:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bf59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd1c0063140 0x7fd1c00b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:09.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bf59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1c00b5040 0x7fd1c00b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bf59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c0063520 con 0x7fd1c00b25e0 2020-10-31T22:41:09.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bf59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c00b5550 con 0x7fd1c0063140 2020-10-31T22:41:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bf59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c00b57f0 con 0x7fd1c00b5040 2020-10-31T22:41:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1be59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd1c0063140 0x7fd1c00b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:09.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bed9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd1c00b25e0 0x7fd1c0143080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45296/0 (socket says 172.21.15.60:45296) 2020-10-31T22:41:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bed9d700 1 -- 172.21.15.60:0/1428146073 learned_addr learned my addr 172.21.15.60:0/1428146073 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:09.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bdd9b700 1 --2- 172.21.15.60:0/1428146073 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1c00b5040 0x7fd1c00b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:09.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bd59a700 1 -- 172.21.15.60:0/1428146073 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 39433378 0 0) 0x7fd1c0063520 con 0x7fd1c00b25e0 2020-10-31T22:41:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bd59a700 1 -- 172.21.15.60:0/1428146073 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1a4003230 con 0x7fd1c00b25e0 2020-10-31T22:41:09.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1be59c700 1 -- 172.21.15.60:0/1428146073 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1c00b5040 msgr2=0x7fd1c00b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1be59c700 1 --2- 172.21.15.60:0/1428146073 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1c00b5040 0x7fd1c00b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:09.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1be59c700 1 -- 172.21.15.60:0/1428146073 >> v1:172.21.15.60:6789/0 conn(0x7fd1c00b25e0 legacy=0x7fd1c0143080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1be59c700 1 -- 172.21.15.60:0/1428146073 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c00b5a90 con 0x7fd1c0063140 2020-10-31T22:41:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1be59c700 1 --2- 172.21.15.60:0/1428146073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1c0063140 0x7fd1c00b1c00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fd1b4002f30 tx=0x7fd1b4006dc0).ready entity=mon.0 client_cookie=41a13456f662ae6b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:09.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bd59a700 1 -- 172.21.15.60:0/1428146073 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1b40096a0 con 0x7fd1c0063140 2020-10-31T22:41:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bd59a700 1 -- 172.21.15.60:0/1428146073 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b4009800 con 0x7fd1c0063140 2020-10-31T22:41:09.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bd59a700 1 -- 172.21.15.60:0/1428146073 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1b4009ba0 con 0x7fd1c0063140 2020-10-31T22:41:09.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bf59e700 1 -- 172.21.15.60:0/1428146073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1c0063140 msgr2=0x7fd1c00b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:09.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bf59e700 1 --2- 172.21.15.60:0/1428146073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1c0063140 0x7fd1c00b1c00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fd1b4002f30 tx=0x7fd1b4006dc0).stop 2020-10-31T22:41:09.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bf59e700 1 -- 172.21.15.60:0/1428146073 shutdown_connections 2020-10-31T22:41:09.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bf59e700 1 --2- 172.21.15.60:0/1428146073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1c0063140 0x7fd1c00b1c00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:09.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bf59e700 1 --2- 172.21.15.60:0/1428146073 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1c00b5040 0x7fd1c00b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:09.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bf59e700 1 -- 172.21.15.60:0/1428146073 >> 172.21.15.60:0/1428146073 conn(0x7fd1c006a600 msgr2=0x7fd1c0060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:09.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bf59e700 1 -- 172.21.15.60:0/1428146073 shutdown_connections 2020-10-31T22:41:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.847+0000 7fd1bf59e700 1 -- 172.21.15.60:0/1428146073 wait complete. 2020-10-31T22:41:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bf59e700 1 Processor -- start 2020-10-31T22:41:09.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bf59e700 1 -- start start 2020-10-31T22:41:09.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bf59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1c0063140 0x7fd1c00b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:09.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bf59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c00b25e0 0x7fd1c013f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:09.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bf59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1c00b5040 0x7fd1c013fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:09.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bf59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c0150670 con 0x7fd1c00b5040 2020-10-31T22:41:09.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bf59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c00657a0 con 0x7fd1c00b25e0 2020-10-31T22:41:09.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bf59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c0064a20 con 0x7fd1c0063140 2020-10-31T22:41:09.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1c00b5040 0x7fd1c013fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:09.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1c00b5040 0x7fd1c013fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41164/0 (socket says 172.21.15.60:41164) 2020-10-31T22:41:09.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bed9d700 1 -- 172.21.15.60:0/160380998 learned_addr learned my addr 172.21.15.60:0/160380998 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:09.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1be59c700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1c0063140 0x7fd1c00b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:09.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bdd9b700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c00b25e0 0x7fd1c013f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:09.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bed9d700 1 -- 172.21.15.60:0/160380998 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1c0063140 msgr2=0x7fd1c00b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:09.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bed9d700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1c0063140 0x7fd1c00b4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:09.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bed9d700 1 -- 172.21.15.60:0/160380998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c00b25e0 msgr2=0x7fd1c013f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:09.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bed9d700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c00b25e0 0x7fd1c013f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:09.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bed9d700 1 -- 172.21.15.60:0/160380998 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c0064cc0 con 0x7fd1c00b5040 2020-10-31T22:41:09.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1be59c700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1c0063140 0x7fd1c00b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:09.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bdd9b700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c00b25e0 0x7fd1c013f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:09.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bed9d700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1c00b5040 0x7fd1c013fde0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd1b80010d0 tx=0x7fd1b80079b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:09.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1af7fe700 1 -- 172.21.15.60:0/160380998 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1b80072e0 con 0x7fd1c00b5040 2020-10-31T22:41:09.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1af7fe700 1 -- 172.21.15.60:0/160380998 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b8007440 con 0x7fd1c00b5040 2020-10-31T22:41:09.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1af7fe700 1 -- 172.21.15.60:0/160380998 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd1b80057d0 con 0x7fd1c00b5040 2020-10-31T22:41:09.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bf59e700 1 -- 172.21.15.60:0/160380998 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c0066960 con 0x7fd1c00b5040 2020-10-31T22:41:09.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.851+0000 7fd1bf59e700 1 -- 172.21.15.60:0/160380998 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c0065290 con 0x7fd1c00b5040 2020-10-31T22:41:09.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.855+0000 7fd1bf59e700 1 -- 172.21.15.60:0/160380998 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c0065060 con 0x7fd1c00b5040 2020-10-31T22:41:09.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.855+0000 7fd1af7fe700 1 -- 172.21.15.60:0/160380998 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd1b8010070 con 0x7fd1c00b5040 2020-10-31T22:41:09.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.855+0000 7fd1af7fe700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd19c055020 0x7fd19c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:09.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.855+0000 7fd1af7fe700 1 -- 172.21.15.60:0/160380998 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fd1b806d140 con 0x7fd1c00b5040 2020-10-31T22:41:09.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.855+0000 7fd1be59c700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd19c055020 0x7fd19c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:09.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.855+0000 7fd1be59c700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd19c055020 0x7fd19c0574e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd1b4019000 tx=0x7fd1b4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:09.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:09.859+0000 7fd1af7fe700 1 -- 172.21.15.60:0/160380998 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd1b80436d0 con 0x7fd1c00b5040 2020-10-31T22:41:10.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.051+0000 7fd1bf59e700 1 -- 172.21.15.60:0/160380998 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fd1c00659a0 con 0x7fd1c00b5040 2020-10-31T22:41:10.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.059+0000 7fd1af7fe700 1 -- 172.21.15.60:0/160380998 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 187+0+0 (secure 0 0 0) 0x7fd1b8046cf0 con 0x7fd1c00b5040 2020-10-31T22:41:10.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.063+0000 7fd1bf59e700 1 -- 172.21.15.60:0/160380998 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd19c055020 msgr2=0x7fd19c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.063+0000 7fd1bf59e700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd19c055020 0x7fd19c0574e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fd1b4019000 tx=0x7fd1b4015000).stop 2020-10-31T22:41:10.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.063+0000 7fd1bf59e700 1 -- 172.21.15.60:0/160380998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1c00b5040 msgr2=0x7fd1c013fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.063+0000 7fd1bf59e700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1c00b5040 0x7fd1c013fde0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fd1b80010d0 tx=0x7fd1b80079b0).stop 2020-10-31T22:41:10.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.063+0000 7fd1bf59e700 1 -- 172.21.15.60:0/160380998 shutdown_connections 2020-10-31T22:41:10.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.063+0000 7fd1bf59e700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd1c00b5040 0x7fd1c013fde0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.063+0000 7fd1bf59e700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1c0063140 0x7fd1c00b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.063+0000 7fd1bf59e700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd19c055020 0x7fd19c0574e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.063+0000 7fd1bf59e700 1 --2- 172.21.15.60:0/160380998 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1c00b25e0 0x7fd1c013f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.063+0000 7fd1bf59e700 1 -- 172.21.15.60:0/160380998 >> 172.21.15.60:0/160380998 conn(0x7fd1c006a600 msgr2=0x7fd1c00b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:10.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.063+0000 7fd1bf59e700 1 -- 172.21.15.60:0/160380998 shutdown_connections 2020-10-31T22:41:10.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.063+0000 7fd1bf59e700 1 -- 172.21.15.60:0/160380998 wait complete. 2020-10-31T22:41:10.072 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 3 and data pool 4 2020-10-31T22:41:10.087 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:10.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5c759e700 1 Processor -- start 2020-10-31T22:41:10.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5c759e700 1 -- start start 2020-10-31T22:41:10.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5c759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc5c80af130 0x7fc5c8140a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5c759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5c80b13c0 0x7fc5c80b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5c759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c8063520 con 0x7fc5c8063140 2020-10-31T22:41:10.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5c759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c81430e0 con 0x7fc5c80af130 2020-10-31T22:41:10.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5c759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c8143380 con 0x7fc5c80b13c0 2020-10-31T22:41:10.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5bdd9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc5c80af130 0x7fc5c8140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5c659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc5c8063140 0x7fc5c8140360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45306/0 (socket says 172.21.15.60:45306) 2020-10-31T22:41:10.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5c659c700 1 -- 172.21.15.60:0/99205824 learned_addr learned my addr 172.21.15.60:0/99205824 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:10.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5c6d9d700 1 --2- 172.21.15.60:0/99205824 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5c80b13c0 0x7fc5c80b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5c5d9b700 1 -- 172.21.15.60:0/99205824 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784902913 0 0) 0x7fc5c8063520 con 0x7fc5c8063140 2020-10-31T22:41:10.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5c5d9b700 1 -- 172.21.15.60:0/99205824 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5a8003230 con 0x7fc5c8063140 2020-10-31T22:41:10.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5bdd9b700 1 -- 172.21.15.60:0/99205824 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5c80b13c0 msgr2=0x7fc5c80b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:10.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5bdd9b700 1 --2- 172.21.15.60:0/99205824 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5c80b13c0 0x7fc5c80b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5bdd9b700 1 -- 172.21.15.60:0/99205824 >> v1:172.21.15.60:6789/0 conn(0x7fc5c8063140 legacy=0x7fc5c8140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5bdd9b700 1 -- 172.21.15.60:0/99205824 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c8143620 con 0x7fc5c80af130 2020-10-31T22:41:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5bdd9b700 1 --2- 172.21.15.60:0/99205824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80af130 0x7fc5c8140a70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc5b0002f30 tx=0x7fc5b0006dc0).ready entity=mon.0 client_cookie=e77fbe93c97650bb server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.187+0000 7fc5c5d9b700 1 -- 172.21.15.60:0/99205824 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5b00096a0 con 0x7fc5c80af130 2020-10-31T22:41:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c5d9b700 1 -- 172.21.15.60:0/99205824 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b0009800 con 0x7fc5c80af130 2020-10-31T22:41:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c5d9b700 1 -- 172.21.15.60:0/99205824 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5b0009b60 con 0x7fc5c80af130 2020-10-31T22:41:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 -- 172.21.15.60:0/99205824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80af130 msgr2=0x7fc5c8140a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 --2- 172.21.15.60:0/99205824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80af130 0x7fc5c8140a70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc5b0002f30 tx=0x7fc5b0006dc0).stop 2020-10-31T22:41:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 -- 172.21.15.60:0/99205824 shutdown_connections 2020-10-31T22:41:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 --2- 172.21.15.60:0/99205824 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5c80b13c0 0x7fc5c80b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 --2- 172.21.15.60:0/99205824 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c80af130 0x7fc5c8140a70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 -- 172.21.15.60:0/99205824 >> 172.21.15.60:0/99205824 conn(0x7fc5c806a600 msgr2=0x7fc5c8060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 -- 172.21.15.60:0/99205824 shutdown_connections 2020-10-31T22:41:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 -- 172.21.15.60:0/99205824 wait complete. 2020-10-31T22:41:10.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 Processor -- start 2020-10-31T22:41:10.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 -- start start 2020-10-31T22:41:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c8063140 0x7fc5c80b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5c80af130 0x7fc5c80b36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5c80b13c0 0x7fc5c814e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80b3bc0 con 0x7fc5c8063140 2020-10-31T22:41:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80a93a0 con 0x7fc5c80af130 2020-10-31T22:41:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c80b2cf0 con 0x7fc5c80b13c0 2020-10-31T22:41:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c8063140 0x7fc5c80b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c8063140 0x7fc5c80b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41176/0 (socket says 172.21.15.60:41176) 2020-10-31T22:41:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c659c700 1 -- 172.21.15.60:0/1828664877 learned_addr learned my addr 172.21.15.60:0/1828664877 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5bdd9b700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5c80af130 0x7fc5c80b36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c6d9d700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5c80b13c0 0x7fc5c814e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c659c700 1 -- 172.21.15.60:0/1828664877 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5c80b13c0 msgr2=0x7fc5c814e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c659c700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5c80b13c0 0x7fc5c814e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.191+0000 7fc5c659c700 1 -- 172.21.15.60:0/1828664877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5c80af130 msgr2=0x7fc5c80b36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5c659c700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5c80af130 0x7fc5c80b36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5c659c700 1 -- 172.21.15.60:0/1828664877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c80b2f90 con 0x7fc5c8063140 2020-10-31T22:41:10.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5bdd9b700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5c80af130 0x7fc5c80b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:10.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5c659c700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c8063140 0x7fc5c80b1e60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc5b80010d0 tx=0x7fc5b8007a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:10.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5bffff700 1 -- 172.21.15.60:0/1828664877 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5b80072e0 con 0x7fc5c8063140 2020-10-31T22:41:10.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5c759e700 1 -- 172.21.15.60:0/1828664877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c80b3230 con 0x7fc5c8063140 2020-10-31T22:41:10.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5bffff700 1 -- 172.21.15.60:0/1828664877 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b8007440 con 0x7fc5c8063140 2020-10-31T22:41:10.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5c759e700 1 -- 172.21.15.60:0/1828664877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c814ed30 con 0x7fc5c8063140 2020-10-31T22:41:10.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5bffff700 1 -- 172.21.15.60:0/1828664877 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc5b80057d0 con 0x7fc5c8063140 2020-10-31T22:41:10.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5c759e700 1 -- 172.21.15.60:0/1828664877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5c80b33c0 con 0x7fc5c8063140 2020-10-31T22:41:10.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5bffff700 1 -- 172.21.15.60:0/1828664877 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc5b8010070 con 0x7fc5c8063140 2020-10-31T22:41:10.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5bffff700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc5ac054f10 0x7fc5ac0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5bffff700 1 -- 172.21.15.60:0/1828664877 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc5b806d230 con 0x7fc5c8063140 2020-10-31T22:41:10.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5bdd9b700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc5ac054f10 0x7fc5ac0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.195+0000 7fc5bdd9b700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc5ac054f10 0x7fc5ac0573d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc5b0019000 tx=0x7fc5b0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:10.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.207+0000 7fc5bffff700 1 -- 172.21.15.60:0/1828664877 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc5b80436b0 con 0x7fc5c8063140 2020-10-31T22:41:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.347+0000 7fc5c759e700 1 -- 172.21.15.60:0/1828664877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5c8057100 con 0x7fc5c8063140 2020-10-31T22:41:10.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.351+0000 7fc5bffff700 1 -- 172.21.15.60:0/1828664877 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fc5b8046cd0 con 0x7fc5c8063140 2020-10-31T22:41:10.353 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:10.354 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:10.055530+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:07.982891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:08.927092+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:10.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.351+0000 7fc5c759e700 1 -- 172.21.15.60:0/1828664877 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc5ac054f10 msgr2=0x7fc5ac0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.351+0000 7fc5c759e700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc5ac054f10 0x7fc5ac0573d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fc5b0019000 tx=0x7fc5b0015000).stop 2020-10-31T22:41:10.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.351+0000 7fc5c759e700 1 -- 172.21.15.60:0/1828664877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c8063140 msgr2=0x7fc5c80b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.351+0000 7fc5c759e700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c8063140 0x7fc5c80b1e60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fc5b80010d0 tx=0x7fc5b8007a10).stop 2020-10-31T22:41:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.351+0000 7fc5c759e700 1 -- 172.21.15.60:0/1828664877 shutdown_connections 2020-10-31T22:41:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.351+0000 7fc5c759e700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5c80b13c0 0x7fc5c814e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.351+0000 7fc5c759e700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc5c8063140 0x7fc5c80b1e60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.351+0000 7fc5c759e700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc5ac054f10 0x7fc5ac0573d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.351+0000 7fc5c759e700 1 --2- 172.21.15.60:0/1828664877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5c80af130 0x7fc5c80b36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.351+0000 7fc5c759e700 1 -- 172.21.15.60:0/1828664877 >> 172.21.15.60:0/1828664877 conn(0x7fc5c806a600 msgr2=0x7fc5c80a8060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:10.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.351+0000 7fc5c759e700 1 -- 172.21.15.60:0/1828664877 shutdown_connections 2020-10-31T22:41:10.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.351+0000 7fc5c759e700 1 -- 172.21.15.60:0/1828664877 wait complete. 2020-10-31T22:41:10.367 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e3a633700 1 Processor -- start 2020-10-31T22:41:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e3a633700 1 -- start start 2020-10-31T22:41:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e3a633700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e340b2e20 0x7f4e3405c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e3a633700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4e340b4410 0x7f4e34146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e3a633700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e34065e90 con 0x7f4e3405c4c0 2020-10-31T22:41:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e3a633700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e34141ef0 con 0x7f4e340b4410 2020-10-31T22:41:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e3a633700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e34066130 con 0x7f4e340b2e20 2020-10-31T22:41:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e33fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4e3405c4c0 0x7f4e3413f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45320/0 (socket says 172.21.15.60:45320) 2020-10-31T22:41:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e33fff700 1 -- 172.21.15.60:0/1328061879 learned_addr learned my addr 172.21.15.60:0/1328061879 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e337fe700 1 --2- 172.21.15.60:0/1328061879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e340b2e20 0x7f4e3405c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e38bd0700 1 --2- 172.21.15.60:0/1328061879 >> v2:172.21.15.66:3300/0 conn(0x7f4e340b4410 0x7f4e34146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 -- 172.21.15.60:0/1328061879 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598824133 0 0) 0x7f4e34065e90 con 0x7f4e3405c4c0 2020-10-31T22:41:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 -- 172.21.15.60:0/1328061879 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e18003230 con 0x7f4e3405c4c0 2020-10-31T22:41:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 -- 172.21.15.60:0/1328061879 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1090498646 0 0) 0x7f4e18003230 con 0x7f4e3405c4c0 2020-10-31T22:41:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 -- 172.21.15.60:0/1328061879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e340b2e20 msgr2=0x7f4e3405c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 --2- 172.21.15.60:0/1328061879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e340b2e20 0x7f4e3405c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 -- 172.21.15.60:0/1328061879 >> v2:172.21.15.66:3300/0 conn(0x7f4e340b4410 msgr2=0x7f4e34146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 --2- 172.21.15.60:0/1328061879 >> v2:172.21.15.66:3300/0 conn(0x7f4e340b4410 0x7f4e34146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 -- 172.21.15.60:0/1328061879 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e340663d0 con 0x7f4e3405c4c0 2020-10-31T22:41:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 -- 172.21.15.60:0/1328061879 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f4e2c001a50 con 0x7f4e3405c4c0 2020-10-31T22:41:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e337fe700 1 --2- 172.21.15.60:0/1328061879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e340b2e20 0x7f4e3405c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 -- 172.21.15.60:0/1328061879 >> v1:172.21.15.60:6789/0 conn(0x7f4e3405c4c0 legacy=0x7f4e3413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 --2- 172.21.15.60:0/1328061879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e180037a0 0x7f4e18003b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 --2- 172.21.15.60:0/1328061879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e18004070 0x7f4e18004530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 --2- 172.21.15.60:0/1328061879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e18004b30 0x7f4e18004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 -- 172.21.15.60:0/1328061879 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e34066130 con 0x7f4e18004070 2020-10-31T22:41:10.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 -- 172.21.15.60:0/1328061879 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1800b850 con 0x7f4e18004b30 2020-10-31T22:41:10.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e32ffd700 1 -- 172.21.15.60:0/1328061879 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1800ba10 con 0x7f4e180037a0 2020-10-31T22:41:10.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e337fe700 1 --2- 172.21.15.60:0/1328061879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e18004070 0x7f4e18004530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e33fff700 1 --2- 172.21.15.60:0/1328061879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e180037a0 0x7f4e18003b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e38bd0700 1 --2- 172.21.15.60:0/1328061879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e18004b30 0x7f4e18004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e337fe700 1 -- 172.21.15.60:0/1328061879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e180037a0 msgr2=0x7f4e18003b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:10.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e337fe700 1 --2- 172.21.15.60:0/1328061879 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e180037a0 0x7f4e18003b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e337fe700 1 -- 172.21.15.60:0/1328061879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e18004b30 msgr2=0x7f4e18004fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:10.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e337fe700 1 --2- 172.21.15.60:0/1328061879 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e18004b30 0x7f4e18004fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.479+0000 7f4e337fe700 1 -- 172.21.15.60:0/1328061879 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e18003230 con 0x7f4e18004070 2020-10-31T22:41:10.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e337fe700 1 --2- 172.21.15.60:0/1328061879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e18004070 0x7f4e18004530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4e1c00c000 tx=0x7f4e1c008040).ready entity=mon.0 client_cookie=3b322081432069f4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:10.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e32ffd700 1 -- 172.21.15.60:0/1328061879 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1c00b4c0 con 0x7f4e18004070 2020-10-31T22:41:10.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e32ffd700 1 -- 172.21.15.60:0/1328061879 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e1c00ec30 con 0x7f4e18004070 2020-10-31T22:41:10.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e32ffd700 1 -- 172.21.15.60:0/1328061879 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e1c0123f0 con 0x7f4e18004070 2020-10-31T22:41:10.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e3a633700 1 -- 172.21.15.60:0/1328061879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e18004070 msgr2=0x7f4e18004530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e3a633700 1 --2- 172.21.15.60:0/1328061879 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e18004070 0x7f4e18004530 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f4e1c00c000 tx=0x7f4e1c008040).stop 2020-10-31T22:41:10.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e38bd0700 1 -- 172.21.15.60:0/1328061879 reap_dead start 2020-10-31T22:41:10.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e3a633700 1 -- 172.21.15.60:0/1328061879 shutdown_connections 2020-10-31T22:41:10.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e3a633700 1 -- 172.21.15.60:0/1328061879 >> 172.21.15.60:0/1328061879 conn(0x7f4e340601e0 msgr2=0x7f4e3405b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:10.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e3a633700 1 -- 172.21.15.60:0/1328061879 shutdown_connections 2020-10-31T22:41:10.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e3a633700 1 -- 172.21.15.60:0/1328061879 wait complete. 2020-10-31T22:41:10.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e3a633700 1 Processor -- start 2020-10-31T22:41:10.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e3a633700 1 -- start start 2020-10-31T22:41:10.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e3a633700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e340b1f30 0x7f4e34145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.483+0000 7f4e3a633700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e340a8f30 0x7f4e340b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e3a633700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e34139560 0x7f4e341399f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e3a633700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e340a93b0 con 0x7f4e340b1f30 2020-10-31T22:41:10.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e3a633700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e340b8280 con 0x7f4e34139560 2020-10-31T22:41:10.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e3a633700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e341454e0 con 0x7f4e340a8f30 2020-10-31T22:41:10.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e33fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e340b1f30 0x7f4e34145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e33fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e340b1f30 0x7f4e34145710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41198/0 (socket says 172.21.15.60:41198) 2020-10-31T22:41:10.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e33fff700 1 -- 172.21.15.60:0/4141429162 learned_addr learned my addr 172.21.15.60:0/4141429162 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:10.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e337fe700 1 --2- 172.21.15.60:0/4141429162 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e340a8f30 0x7f4e340b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e38bd0700 1 --2- 172.21.15.60:0/4141429162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e34139560 0x7f4e341399f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e33fff700 1 -- 172.21.15.60:0/4141429162 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e340a8f30 msgr2=0x7f4e340b8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e33fff700 1 --2- 172.21.15.60:0/4141429162 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e340a8f30 0x7f4e340b8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e33fff700 1 -- 172.21.15.60:0/4141429162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e34139560 msgr2=0x7f4e341399f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e33fff700 1 --2- 172.21.15.60:0/4141429162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e34139560 0x7f4e341399f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e33fff700 1 -- 172.21.15.60:0/4141429162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e340b2310 con 0x7f4e340b1f30 2020-10-31T22:41:10.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e33fff700 1 --2- 172.21.15.60:0/4141429162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e340b1f30 0x7f4e34145710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4e2c009000 tx=0x7f4e2c008ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:10.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e317fa700 1 -- 172.21.15.60:0/4141429162 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e2c00fdb0 con 0x7f4e340b1f30 2020-10-31T22:41:10.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e317fa700 1 -- 172.21.15.60:0/4141429162 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e2c016440 con 0x7f4e340b1f30 2020-10-31T22:41:10.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e3a633700 1 -- 172.21.15.60:0/4141429162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e34144da0 con 0x7f4e340b1f30 2020-10-31T22:41:10.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e317fa700 1 -- 172.21.15.60:0/4141429162 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e2c0167a0 con 0x7f4e340b1f30 2020-10-31T22:41:10.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e3a633700 1 -- 172.21.15.60:0/4141429162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e340b2560 con 0x7f4e340b1f30 2020-10-31T22:41:10.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e317fa700 1 -- 172.21.15.60:0/4141429162 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4e2c016900 con 0x7f4e340b1f30 2020-10-31T22:41:10.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.487+0000 7f4e3a633700 1 -- 172.21.15.60:0/4141429162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3413a080 con 0x7f4e340b1f30 2020-10-31T22:41:10.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.491+0000 7f4e317fa700 1 --2- 172.21.15.60:0/4141429162 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4e0c055020 0x7f4e0c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.491+0000 7f4e337fe700 1 --2- 172.21.15.60:0/4141429162 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4e0c055020 0x7f4e0c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.491+0000 7f4e317fa700 1 -- 172.21.15.60:0/4141429162 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4e2c06dc80 con 0x7f4e340b1f30 2020-10-31T22:41:10.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.491+0000 7f4e337fe700 1 --2- 172.21.15.60:0/4141429162 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4e0c055020 0x7f4e0c0574e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4e1c008000 tx=0x7f4e1c01a000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:10.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.495+0000 7f4e317fa700 1 -- 172.21.15.60:0/4141429162 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4e2c044090 con 0x7f4e340b1f30 2020-10-31T22:41:10.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.635+0000 7f4e3a633700 1 -- 172.21.15.60:0/4141429162 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e340b8fa0 con 0x7f4e340b1f30 2020-10-31T22:41:10.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.639+0000 7f4e317fa700 1 -- 172.21.15.60:0/4141429162 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f4e2c01b030 con 0x7f4e340b1f30 2020-10-31T22:41:10.643 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:10.643 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":21,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:10.055530+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:07.982891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:08.927092+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:10.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.639+0000 7f4e3a633700 1 -- 172.21.15.60:0/4141429162 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4e0c055020 msgr2=0x7f4e0c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.639+0000 7f4e3a633700 1 --2- 172.21.15.60:0/4141429162 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4e0c055020 0x7f4e0c0574e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f4e1c008000 tx=0x7f4e1c01a000).stop 2020-10-31T22:41:10.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.639+0000 7f4e3a633700 1 -- 172.21.15.60:0/4141429162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e340b1f30 msgr2=0x7f4e34145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.639+0000 7f4e3a633700 1 --2- 172.21.15.60:0/4141429162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e340b1f30 0x7f4e34145710 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4e2c009000 tx=0x7f4e2c008ed0).stop 2020-10-31T22:41:10.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.639+0000 7f4e3a633700 1 -- 172.21.15.60:0/4141429162 shutdown_connections 2020-10-31T22:41:10.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.639+0000 7f4e3a633700 1 --2- 172.21.15.60:0/4141429162 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4e0c055020 0x7f4e0c0574e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.639+0000 7f4e3a633700 1 --2- 172.21.15.60:0/4141429162 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e34139560 0x7f4e341399f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.639+0000 7f4e3a633700 1 --2- 172.21.15.60:0/4141429162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e340b1f30 0x7f4e34145710 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.639+0000 7f4e3a633700 1 --2- 172.21.15.60:0/4141429162 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e340a8f30 0x7f4e340b8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.639+0000 7f4e3a633700 1 -- 172.21.15.60:0/4141429162 >> 172.21.15.60:0/4141429162 conn(0x7f4e340601e0 msgr2=0x7f4e3413d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:10.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.643+0000 7f4e3a633700 1 -- 172.21.15.60:0/4141429162 shutdown_connections 2020-10-31T22:41:10.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.643+0000 7f4e3a633700 1 -- 172.21.15.60:0/4141429162 wait complete. 2020-10-31T22:41:10.664 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-10-31T22:41:10.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.779+0000 7f3a95dd6700 1 Processor -- start 2020-10-31T22:41:10.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.779+0000 7f3a95dd6700 1 -- start start 2020-10-31T22:41:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.779+0000 7f3a95dd6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3a900b5950 0x7f3a90142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.779+0000 7f3a95dd6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a90142b00 con 0x7f3a900b5570 2020-10-31T22:41:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.779+0000 7f3a95dd6700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a900b4440 con 0x7f3a900b24a0 2020-10-31T22:41:10.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.779+0000 7f3a95dd6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9013f930 con 0x7f3a900b5950 2020-10-31T22:41:10.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.779+0000 7f3a94dd4700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3a900b5570 0x7f3a90145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45340/0 (socket says 172.21.15.60:45340) 2020-10-31T22:41:10.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.779+0000 7f3a94dd4700 1 -- 172.21.15.60:0/3873122782 learned_addr learned my addr 172.21.15.60:0/3873122782 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:10.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.779+0000 7f3a955d5700 1 --2- 172.21.15.60:0/3873122782 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3a900b5950 0x7f3a90142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.779+0000 7f3a8f7fe700 1 -- 172.21.15.60:0/3873122782 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1295715918 0 0) 0x7f3a90142b00 con 0x7f3a900b5570 2020-10-31T22:41:10.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.779+0000 7f3a8f7fe700 1 -- 172.21.15.60:0/3873122782 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a7c003230 con 0x7f3a900b5570 2020-10-31T22:41:10.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.779+0000 7f3a8f7fe700 1 -- 172.21.15.60:0/3873122782 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3233622018 0 0) 0x7f3a7c003230 con 0x7f3a900b5570 2020-10-31T22:41:10.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 -- 172.21.15.60:0/3873122782 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3a900b5950 msgr2=0x7f3a90142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:10.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 --2- 172.21.15.60:0/3873122782 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3a900b5950 0x7f3a90142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 -- 172.21.15.60:0/3873122782 >> v1:172.21.15.66:6789/0 conn(0x7f3a900b24a0 legacy=0x7f3a90141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 -- 172.21.15.60:0/3873122782 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a90146060 con 0x7f3a900b5570 2020-10-31T22:41:10.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 -- 172.21.15.60:0/3873122782 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f3a800016d0 con 0x7f3a900b5570 2020-10-31T22:41:10.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 -- 172.21.15.60:0/3873122782 >> v1:172.21.15.60:6789/0 conn(0x7f3a900b5570 legacy=0x7f3a90145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 --2- 172.21.15.60:0/3873122782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a7c003750 0x7f3a7c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 --2- 172.21.15.60:0/3873122782 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3a900b5950 0x7f3a7c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 --2- 172.21.15.60:0/3873122782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a7c0049c0 0x7f3a7c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 -- 172.21.15.60:0/3873122782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9013f930 con 0x7f3a7c003750 2020-10-31T22:41:10.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 -- 172.21.15.60:0/3873122782 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c0041f0 con 0x7f3a7c0049c0 2020-10-31T22:41:10.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 -- 172.21.15.60:0/3873122782 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7c00b720 con 0x7f3a900b5950 2020-10-31T22:41:10.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a94dd4700 1 --2- 172.21.15.60:0/3873122782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a7c003750 0x7f3a7c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8ffff700 1 --2- 172.21.15.60:0/3873122782 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3a900b5950 0x7f3a7c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a955d5700 1 --2- 172.21.15.60:0/3873122782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a7c0049c0 0x7f3a7c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a94dd4700 1 -- 172.21.15.60:0/3873122782 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3a900b5950 msgr2=0x7f3a7c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:10.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a94dd4700 1 --2- 172.21.15.60:0/3873122782 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3a900b5950 0x7f3a7c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a94dd4700 1 -- 172.21.15.60:0/3873122782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a7c0049c0 msgr2=0x7f3a7c004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:10.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a94dd4700 1 --2- 172.21.15.60:0/3873122782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a7c0049c0 0x7f3a7c004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a94dd4700 1 -- 172.21.15.60:0/3873122782 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a7c003230 con 0x7f3a7c003750 2020-10-31T22:41:10.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a955d5700 1 --2- 172.21.15.60:0/3873122782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a7c0049c0 0x7f3a7c004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:10.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a94dd4700 1 --2- 172.21.15.60:0/3873122782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a7c003750 0x7f3a7c003b70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f3a7c0054a0 tx=0x7f3a90141bf0).ready entity=mon.0 client_cookie=b5f87f874319fb84 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:10.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 -- 172.21.15.60:0/3873122782 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a800070d0 con 0x7f3a7c003750 2020-10-31T22:41:10.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 -- 172.21.15.60:0/3873122782 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a80007230 con 0x7f3a7c003750 2020-10-31T22:41:10.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a8f7fe700 1 -- 172.21.15.60:0/3873122782 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a800055e0 con 0x7f3a7c003750 2020-10-31T22:41:10.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a95dd6700 1 -- 172.21.15.60:0/3873122782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a7c003750 msgr2=0x7f3a7c003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a95dd6700 1 --2- 172.21.15.60:0/3873122782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a7c003750 0x7f3a7c003b70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f3a7c0054a0 tx=0x7f3a90141bf0).stop 2020-10-31T22:41:10.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a955d5700 1 -- 172.21.15.60:0/3873122782 reap_dead start 2020-10-31T22:41:10.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a95dd6700 1 -- 172.21.15.60:0/3873122782 shutdown_connections 2020-10-31T22:41:10.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a95dd6700 1 -- 172.21.15.60:0/3873122782 >> 172.21.15.60:0/3873122782 conn(0x7f3a900b8e90 msgr2=0x7f3a900b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:10.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a95dd6700 1 -- 172.21.15.60:0/3873122782 shutdown_connections 2020-10-31T22:41:10.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a95dd6700 1 -- 172.21.15.60:0/3873122782 wait complete. 2020-10-31T22:41:10.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a95dd6700 1 Processor -- start 2020-10-31T22:41:10.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.783+0000 7f3a95dd6700 1 -- start start 2020-10-31T22:41:10.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a95dd6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3a90147510 0x7f3a90142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a95dd6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a90144aa0 0x7f3a901434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a95dd6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a90154140 0x7f3a901545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a95dd6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90150bf0 con 0x7f3a90144aa0 2020-10-31T22:41:10.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a95dd6700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a901478f0 con 0x7f3a90154140 2020-10-31T22:41:10.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a95dd6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a90150de0 con 0x7f3a90147510 2020-10-31T22:41:10.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a8ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a90144aa0 0x7f3a901434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a94dd4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3a90147510 0x7f3a90142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a8ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a90144aa0 0x7f3a901434a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41220/0 (socket says 172.21.15.60:41220) 2020-10-31T22:41:10.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a8ffff700 1 -- 172.21.15.60:0/429495741 learned_addr learned my addr 172.21.15.60:0/429495741 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:10.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a955d5700 1 --2- 172.21.15.60:0/429495741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a90154140 0x7f3a901545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a8ffff700 1 -- 172.21.15.60:0/429495741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3a90147510 msgr2=0x7f3a90142fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a8ffff700 1 --2- 172.21.15.60:0/429495741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3a90147510 0x7f3a90142fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a8ffff700 1 -- 172.21.15.60:0/429495741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a90154140 msgr2=0x7f3a901545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:10.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a8ffff700 1 --2- 172.21.15.60:0/429495741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a90154140 0x7f3a901545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:10.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a8ffff700 1 -- 172.21.15.60:0/429495741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a90151080 con 0x7f3a90144aa0 2020-10-31T22:41:10.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a8ffff700 1 --2- 172.21.15.60:0/429495741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a90144aa0 0x7f3a901434a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f3a8400d000 tx=0x7f3a84007b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:10.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a8dffb700 1 -- 172.21.15.60:0/429495741 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a8400f8b0 con 0x7f3a90144aa0 2020-10-31T22:41:10.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a8dffb700 1 -- 172.21.15.60:0/429495741 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8400fa10 con 0x7f3a90144aa0 2020-10-31T22:41:10.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a95dd6700 1 -- 172.21.15.60:0/429495741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a90151320 con 0x7f3a90144aa0 2020-10-31T22:41:10.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a8dffb700 1 -- 172.21.15.60:0/429495741 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a8400fd70 con 0x7f3a90144aa0 2020-10-31T22:41:10.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a95dd6700 1 -- 172.21.15.60:0/429495741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a90143990 con 0x7f3a90144aa0 2020-10-31T22:41:10.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.787+0000 7f3a95dd6700 1 -- 172.21.15.60:0/429495741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a90057100 con 0x7f3a90144aa0 2020-10-31T22:41:10.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.791+0000 7f3a8dffb700 1 -- 172.21.15.60:0/429495741 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3a8401b030 con 0x7f3a90144aa0 2020-10-31T22:41:10.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.791+0000 7f3a8dffb700 1 --2- 172.21.15.60:0/429495741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3a70054f90 0x7f3a70057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:10.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.791+0000 7f3a8dffb700 1 -- 172.21.15.60:0/429495741 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3a8406d870 con 0x7f3a90144aa0 2020-10-31T22:41:10.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.791+0000 7f3a94dd4700 1 --2- 172.21.15.60:0/429495741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3a70054f90 0x7f3a70057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:10.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.791+0000 7f3a94dd4700 1 --2- 172.21.15.60:0/429495741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3a70054f90 0x7f3a70057450 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3a80017000 tx=0x7f3a80015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:10.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.799+0000 7f3a8dffb700 1 -- 172.21.15.60:0/429495741 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3a84043cd0 con 0x7f3a90144aa0 2020-10-31T22:41:10.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:10.987+0000 7f3a95dd6700 1 -- 172.21.15.60:0/429495741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3a9005a8e0 con 0x7f3a90144aa0 2020-10-31T22:41:11.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.063+0000 7f3a8dffb700 1 -- 172.21.15.60:0/429495741 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3a840472f0 con 0x7f3a90144aa0 2020-10-31T22:41:11.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.063+0000 7f3a95dd6700 1 -- 172.21.15.60:0/429495741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3a70054f90 msgr2=0x7f3a70057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.063+0000 7f3a95dd6700 1 --2- 172.21.15.60:0/429495741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3a70054f90 0x7f3a70057450 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f3a80017000 tx=0x7f3a80015000).stop 2020-10-31T22:41:11.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.063+0000 7f3a95dd6700 1 -- 172.21.15.60:0/429495741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a90144aa0 msgr2=0x7f3a901434a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.063+0000 7f3a95dd6700 1 --2- 172.21.15.60:0/429495741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a90144aa0 0x7f3a901434a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f3a8400d000 tx=0x7f3a84007b60).stop 2020-10-31T22:41:11.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.063+0000 7f3a95dd6700 1 -- 172.21.15.60:0/429495741 shutdown_connections 2020-10-31T22:41:11.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.063+0000 7f3a95dd6700 1 --2- 172.21.15.60:0/429495741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3a70054f90 0x7f3a70057450 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.063+0000 7f3a95dd6700 1 --2- 172.21.15.60:0/429495741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3a90154140 0x7f3a901545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.063+0000 7f3a95dd6700 1 --2- 172.21.15.60:0/429495741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3a90147510 0x7f3a90142fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.063+0000 7f3a95dd6700 1 --2- 172.21.15.60:0/429495741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3a90144aa0 0x7f3a901434a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.063+0000 7f3a95dd6700 1 -- 172.21.15.60:0/429495741 >> 172.21.15.60:0/429495741 conn(0x7f3a900b8e90 msgr2=0x7f3a900b61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:11.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.067+0000 7f3a95dd6700 1 -- 172.21.15.60:0/429495741 shutdown_connections 2020-10-31T22:41:11.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.067+0000 7f3a95dd6700 1 -- 172.21.15.60:0/429495741 wait complete. 2020-10-31T22:41:11.085 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:41:11.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29e0d04700 1 Processor -- start 2020-10-31T22:41:11.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29e0d04700 1 -- start start 2020-10-31T22:41:11.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29e0d04700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f29dc13ebe0 0x7f29dc142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29e0d04700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc0abea0 con 0x7f29dc0b1a10 2020-10-31T22:41:11.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29e0d04700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29dc141870 con 0x7f29dc0af200 2020-10-31T22:41:11.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29e0d04700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29dc141b10 con 0x7f29dc13ebe0 2020-10-31T22:41:11.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29db7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f29dc0b1a10 0x7f29dc0afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45364/0 (socket says 172.21.15.60:45364) 2020-10-31T22:41:11.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29db7fe700 1 -- 172.21.15.60:0/435695515 learned_addr learned my addr 172.21.15.60:0/435695515 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:11.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29d2ffd700 1 --2- 172.21.15.60:0/435695515 >> v2:172.21.15.66:3300/0 conn(0x7f29dc13ebe0 0x7f29dc142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29daffd700 1 -- 172.21.15.60:0/435695515 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185505552 0 0) 0x7f29dc0abea0 con 0x7f29dc0b1a10 2020-10-31T22:41:11.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29daffd700 1 -- 172.21.15.60:0/435695515 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29bc003230 con 0x7f29dc0b1a10 2020-10-31T22:41:11.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29daffd700 1 -- 172.21.15.60:0/435695515 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1914786357 0 0) 0x7f29bc003230 con 0x7f29dc0b1a10 2020-10-31T22:41:11.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29d2ffd700 1 -- 172.21.15.60:0/435695515 >> v1:172.21.15.66:6789/0 conn(0x7f29dc0af200 legacy=0x7f29dc0b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29d2ffd700 1 -- 172.21.15.60:0/435695515 >> v1:172.21.15.60:6789/0 conn(0x7f29dc0b1a10 legacy=0x7f29dc0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29d2ffd700 1 -- 172.21.15.60:0/435695515 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc141db0 con 0x7f29dc13ebe0 2020-10-31T22:41:11.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29d2ffd700 1 --2- 172.21.15.60:0/435695515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29dc13ebe0 0x7f29dc142250 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f29cc001870 tx=0x7f29c4006dc0).ready entity=mon.1 client_cookie=879ac90a67a0d32d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:11.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29daffd700 1 -- 172.21.15.60:0/435695515 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29cc0016d0 con 0x7f29dc13ebe0 2020-10-31T22:41:11.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29daffd700 1 -- 172.21.15.60:0/435695515 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c4009620 con 0x7f29dc13ebe0 2020-10-31T22:41:11.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29e0d04700 1 -- 172.21.15.60:0/435695515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29dc13ebe0 msgr2=0x7f29dc142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29e0d04700 1 --2- 172.21.15.60:0/435695515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29dc13ebe0 0x7f29dc142250 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f29cc001870 tx=0x7f29c4006dc0).stop 2020-10-31T22:41:11.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.199+0000 7f29daffd700 1 -- 172.21.15.60:0/435695515 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29c4009790 con 0x7f29dc13ebe0 2020-10-31T22:41:11.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29e0d04700 1 -- 172.21.15.60:0/435695515 shutdown_connections 2020-10-31T22:41:11.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29e0d04700 1 --2- 172.21.15.60:0/435695515 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29dc13ebe0 0x7f29dc142250 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29e0d04700 1 -- 172.21.15.60:0/435695515 >> 172.21.15.60:0/435695515 conn(0x7f29dc0b5300 msgr2=0x7f29dc0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:11.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29e0d04700 1 -- 172.21.15.60:0/435695515 shutdown_connections 2020-10-31T22:41:11.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29e0d04700 1 -- 172.21.15.60:0/435695515 wait complete. 2020-10-31T22:41:11.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29e0d04700 1 Processor -- start 2020-10-31T22:41:11.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29e0d04700 1 -- start start 2020-10-31T22:41:11.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29e0d04700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc0af200 0x7f29dc0631a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29e0d04700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29dc0b1a10 0x7f29dc14eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29e0d04700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29dc13ebe0 0x7f29dc066320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29e0d04700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc066d40 con 0x7f29dc0af200 2020-10-31T22:41:11.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29e0d04700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc14f080 con 0x7f29dc0b1a10 2020-10-31T22:41:11.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29e0d04700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc066810 con 0x7f29dc13ebe0 2020-10-31T22:41:11.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29db7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc0af200 0x7f29dc0631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29db7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc0af200 0x7f29dc0631a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41232/0 (socket says 172.21.15.60:41232) 2020-10-31T22:41:11.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29db7fe700 1 -- 172.21.15.60:0/1409664316 learned_addr learned my addr 172.21.15.60:0/1409664316 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:11.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29d2ffd700 1 --2- 172.21.15.60:0/1409664316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29dc0b1a10 0x7f29dc14eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29dbfff700 1 --2- 172.21.15.60:0/1409664316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29dc13ebe0 0x7f29dc066320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29db7fe700 1 -- 172.21.15.60:0/1409664316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29dc13ebe0 msgr2=0x7f29dc066320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29db7fe700 1 --2- 172.21.15.60:0/1409664316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29dc13ebe0 0x7f29dc066320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29db7fe700 1 -- 172.21.15.60:0/1409664316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29dc0b1a10 msgr2=0x7f29dc14eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29db7fe700 1 --2- 172.21.15.60:0/1409664316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29dc0b1a10 0x7f29dc14eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29db7fe700 1 -- 172.21.15.60:0/1409664316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc066aa0 con 0x7f29dc0af200 2020-10-31T22:41:11.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29db7fe700 1 --2- 172.21.15.60:0/1409664316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc0af200 0x7f29dc0631a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f29cc001930 tx=0x7f29cc0011f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:11.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29d97fa700 1 -- 172.21.15.60:0/1409664316 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29cc007170 con 0x7f29dc0af200 2020-10-31T22:41:11.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29d97fa700 1 -- 172.21.15.60:0/1409664316 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29cc0072d0 con 0x7f29dc0af200 2020-10-31T22:41:11.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.203+0000 7f29e0d04700 1 -- 172.21.15.60:0/1409664316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29dc1521f0 con 0x7f29dc0af200 2020-10-31T22:41:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.207+0000 7f29d97fa700 1 -- 172.21.15.60:0/1409664316 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29cc0048f0 con 0x7f29dc0af200 2020-10-31T22:41:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.207+0000 7f29e0d04700 1 -- 172.21.15.60:0/1409664316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29dc13e2d0 con 0x7f29dc0af200 2020-10-31T22:41:11.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.207+0000 7f29e0d04700 1 -- 172.21.15.60:0/1409664316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29dc057100 con 0x7f29dc0af200 2020-10-31T22:41:11.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.207+0000 7f29d97fa700 1 -- 172.21.15.60:0/1409664316 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f29cc010070 con 0x7f29dc0af200 2020-10-31T22:41:11.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.207+0000 7f29d97fa700 1 --2- 172.21.15.60:0/1409664316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f29c0054f10 0x7f29c00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.207+0000 7f29d97fa700 1 -- 172.21.15.60:0/1409664316 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f29cc06d6f0 con 0x7f29dc0af200 2020-10-31T22:41:11.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.207+0000 7f29d2ffd700 1 --2- 172.21.15.60:0/1409664316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f29c0054f10 0x7f29c00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.207+0000 7f29d2ffd700 1 --2- 172.21.15.60:0/1409664316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f29c0054f10 0x7f29c00573d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f29c4018000 tx=0x7f29dc13f160).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:11.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.215+0000 7f29d97fa700 1 -- 172.21.15.60:0/1409664316 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f29cc043b00 con 0x7f29dc0af200 2020-10-31T22:41:11.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.403+0000 7f29e0d04700 1 -- 172.21.15.60:0/1409664316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f29dc05ee00 con 0x7f29dc0af200 2020-10-31T22:41:11.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.403+0000 7f29d97fa700 1 -- 172.21.15.60:0/1409664316 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2483 (secure 0 0 0) 0x7f29cc047120 con 0x7f29dc0af200 2020-10-31T22:41:11.407 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:11.407 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/909749940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":909749940},{"type":"v1","addr":"172.21.15.60:6837","nonce":909749940}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3142095774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3142095774},{"type":"v1","addr":"172.21.15.60:6835","nonce":3142095774}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:41:10.055893+0000","modified":"2020-10-31T22:41:11.058634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.66:6833/4161698670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4161698670},{"type":"v1","addr":"172.21.15.66:6833","nonce":4161698670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-10-31T22:41:11.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.407+0000 7f29e0d04700 1 -- 172.21.15.60:0/1409664316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f29c0054f10 msgr2=0x7f29c00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.407+0000 7f29e0d04700 1 --2- 172.21.15.60:0/1409664316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f29c0054f10 0x7f29c00573d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f29c4018000 tx=0x7f29dc13f160).stop 2020-10-31T22:41:11.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.407+0000 7f29e0d04700 1 -- 172.21.15.60:0/1409664316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc0af200 msgr2=0x7f29dc0631a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.407+0000 7f29e0d04700 1 --2- 172.21.15.60:0/1409664316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc0af200 0x7f29dc0631a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f29cc001930 tx=0x7f29cc0011f0).stop 2020-10-31T22:41:11.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.407+0000 7f29e0d04700 1 -- 172.21.15.60:0/1409664316 shutdown_connections 2020-10-31T22:41:11.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.407+0000 7f29e0d04700 1 --2- 172.21.15.60:0/1409664316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29dc13ebe0 0x7f29dc066320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.407+0000 7f29e0d04700 1 --2- 172.21.15.60:0/1409664316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29dc0af200 0x7f29dc0631a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.407+0000 7f29e0d04700 1 --2- 172.21.15.60:0/1409664316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f29c0054f10 0x7f29c00573d0 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0x7f29c4018000 tx=0x7f29dc13f160).stop 2020-10-31T22:41:11.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.407+0000 7f29e0d04700 1 --2- 172.21.15.60:0/1409664316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29dc0b1a10 0x7f29dc14eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.407+0000 7f29e0d04700 1 -- 172.21.15.60:0/1409664316 >> 172.21.15.60:0/1409664316 conn(0x7f29dc0b5300 msgr2=0x7f29dc0ad260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:11.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.407+0000 7f29e0d04700 1 -- 172.21.15.60:0/1409664316 shutdown_connections 2020-10-31T22:41:11.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.407+0000 7f29e0d04700 1 -- 172.21.15.60:0/1409664316 wait complete. 2020-10-31T22:41:11.414 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 5 2020-10-31T22:41:11.429 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:11.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.535+0000 7fe7c298e700 1 Processor -- start 2020-10-31T22:41:11.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c298e700 1 -- start start 2020-10-31T22:41:11.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c298e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7bc0b1d50 0x7fe7bc05c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c298e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe7bc0b0d60 0x7fe7bc13fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c298e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7bc0b2130 con 0x7fe7bc140010 2020-10-31T22:41:11.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c298e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7bc06a9b0 con 0x7fe7bc0b0d60 2020-10-31T22:41:11.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c298e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0af380 con 0x7fe7bc0b1d50 2020-10-31T22:41:11.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c118b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe7bc0b0d60 0x7fe7bc13fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c218d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe7bc140010 0x7fe7bc0adeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45380/0 (socket says 172.21.15.60:45380) 2020-10-31T22:41:11.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c218d700 1 -- 172.21.15.60:0/1360403142 learned_addr learned my addr 172.21.15.60:0/1360403142 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:11.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c198c700 1 --2- 172.21.15.60:0/1360403142 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7bc0b1d50 0x7fe7bc05c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c118b700 1 -- 172.21.15.60:0/1360403142 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7bc0b1d50 msgr2=0x7fe7bc05c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:11.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c118b700 1 --2- 172.21.15.60:0/1360403142 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7bc0b1d50 0x7fe7bc05c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c118b700 1 -- 172.21.15.60:0/1360403142 >> v1:172.21.15.60:6789/0 conn(0x7fe7bc140010 legacy=0x7fe7bc0adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c118b700 1 -- 172.21.15.60:0/1360403142 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc05b160 con 0x7fe7bc0b0d60 2020-10-31T22:41:11.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c118b700 1 --2- 172.21.15.60:0/1360403142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7bc0b0d60 0x7fe7bc13fb20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe7ac002f30 tx=0x7fe7ac006dc0).ready entity=mon.0 client_cookie=49b4116e72f9e7a4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:11.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c098a700 1 -- 172.21.15.60:0/1360403142 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7ac0097f0 con 0x7fe7bc0b0d60 2020-10-31T22:41:11.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c098a700 1 -- 172.21.15.60:0/1360403142 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac009950 con 0x7fe7bc0b0d60 2020-10-31T22:41:11.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c098a700 1 -- 172.21.15.60:0/1360403142 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7ac009cb0 con 0x7fe7bc0b0d60 2020-10-31T22:41:11.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c298e700 1 -- 172.21.15.60:0/1360403142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7bc0b0d60 msgr2=0x7fe7bc13fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.539+0000 7fe7c298e700 1 --2- 172.21.15.60:0/1360403142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7bc0b0d60 0x7fe7bc13fb20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7fe7ac002f30 tx=0x7fe7ac006dc0).stop 2020-10-31T22:41:11.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.543+0000 7fe7c298e700 1 -- 172.21.15.60:0/1360403142 shutdown_connections 2020-10-31T22:41:11.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.543+0000 7fe7c298e700 1 --2- 172.21.15.60:0/1360403142 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7bc0b1d50 0x7fe7bc05c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.543+0000 7fe7c298e700 1 --2- 172.21.15.60:0/1360403142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7bc0b0d60 0x7fe7bc13fb20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.543+0000 7fe7c298e700 1 -- 172.21.15.60:0/1360403142 >> 172.21.15.60:0/1360403142 conn(0x7fe7bc0b5300 msgr2=0x7fe7bc0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:11.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.543+0000 7fe7c298e700 1 -- 172.21.15.60:0/1360403142 shutdown_connections 2020-10-31T22:41:11.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.543+0000 7fe7c298e700 1 -- 172.21.15.60:0/1360403142 wait complete. 2020-10-31T22:41:11.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.543+0000 7fe7c298e700 1 Processor -- start 2020-10-31T22:41:11.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.543+0000 7fe7c298e700 1 -- start start 2020-10-31T22:41:11.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c298e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7bc0b0d60 0x7fe7bc0b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c298e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7bc0b1d50 0x7fe7bc0a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c298e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7bc140010 0x7fe7bc0a9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c298e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc0aadf0 con 0x7fe7bc0b1d50 2020-10-31T22:41:11.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c298e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc066f80 con 0x7fe7bc140010 2020-10-31T22:41:11.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c298e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7bc064670 con 0x7fe7bc0b0d60 2020-10-31T22:41:11.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c118b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7bc0b1d50 0x7fe7bc0a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c118b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7bc0b1d50 0x7fe7bc0a98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41248/0 (socket says 172.21.15.60:41248) 2020-10-31T22:41:11.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c118b700 1 -- 172.21.15.60:0/2730382950 learned_addr learned my addr 172.21.15.60:0/2730382950 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:11.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c198c700 1 --2- 172.21.15.60:0/2730382950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7bc0b0d60 0x7fe7bc0b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c218d700 1 --2- 172.21.15.60:0/2730382950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7bc140010 0x7fe7bc0a9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c118b700 1 -- 172.21.15.60:0/2730382950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7bc0b0d60 msgr2=0x7fe7bc0b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c118b700 1 --2- 172.21.15.60:0/2730382950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7bc0b0d60 0x7fe7bc0b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c118b700 1 -- 172.21.15.60:0/2730382950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7bc140010 msgr2=0x7fe7bc0a9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c118b700 1 --2- 172.21.15.60:0/2730382950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7bc140010 0x7fe7bc0a9da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c118b700 1 -- 172.21.15.60:0/2730382950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7bc0aa290 con 0x7fe7bc0b1d50 2020-10-31T22:41:11.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c118b700 1 --2- 172.21.15.60:0/2730382950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7bc0b1d50 0x7fe7bc0a98b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe7bc0ab650 tx=0x7fe7ac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:11.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7aaffd700 1 -- 172.21.15.60:0/2730382950 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7ac009c50 con 0x7fe7bc0b1d50 2020-10-31T22:41:11.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7aaffd700 1 -- 172.21.15.60:0/2730382950 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac011dc0 con 0x7fe7bc0b1d50 2020-10-31T22:41:11.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c298e700 1 -- 172.21.15.60:0/2730382950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7bc0aafe0 con 0x7fe7bc0b1d50 2020-10-31T22:41:11.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7aaffd700 1 -- 172.21.15.60:0/2730382950 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7ac01d640 con 0x7fe7bc0b1d50 2020-10-31T22:41:11.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.547+0000 7fe7c298e700 1 -- 172.21.15.60:0/2730382950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7bc064b40 con 0x7fe7bc0b1d50 2020-10-31T22:41:11.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.551+0000 7fe7c298e700 1 -- 172.21.15.60:0/2730382950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7bc064d00 con 0x7fe7bc0b1d50 2020-10-31T22:41:11.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.551+0000 7fe7aaffd700 1 -- 172.21.15.60:0/2730382950 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe7ac024030 con 0x7fe7bc0b1d50 2020-10-31T22:41:11.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.551+0000 7fe7aaffd700 1 --2- 172.21.15.60:0/2730382950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe79c054f10 0x7fe79c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.551+0000 7fe7aaffd700 1 -- 172.21.15.60:0/2730382950 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe7ac06ec00 con 0x7fe7bc0b1d50 2020-10-31T22:41:11.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.551+0000 7fe7c198c700 1 --2- 172.21.15.60:0/2730382950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe79c054f10 0x7fe79c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.551+0000 7fe7c198c700 1 --2- 172.21.15.60:0/2730382950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe79c054f10 0x7fe79c0573d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe7b800c000 tx=0x7fe7b8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:11.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.559+0000 7fe7aaffd700 1 -- 172.21.15.60:0/2730382950 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe7ac074020 con 0x7fe7bc0b1d50 2020-10-31T22:41:11.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.699+0000 7fe7c298e700 1 -- 172.21.15.60:0/2730382950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7bc057100 con 0x7fe7bc0b1d50 2020-10-31T22:41:11.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.703+0000 7fe7aaffd700 1 -- 172.21.15.60:0/2730382950 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fe7ac022020 con 0x7fe7bc0b1d50 2020-10-31T22:41:11.705 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:11.705 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:11.059362+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:07.982891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:08.927092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:11.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.703+0000 7fe7c298e700 1 -- 172.21.15.60:0/2730382950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe79c054f10 msgr2=0x7fe79c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.703+0000 7fe7c298e700 1 --2- 172.21.15.60:0/2730382950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe79c054f10 0x7fe79c0573d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fe7b800c000 tx=0x7fe7b8008040).stop 2020-10-31T22:41:11.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.703+0000 7fe7c298e700 1 -- 172.21.15.60:0/2730382950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7bc0b1d50 msgr2=0x7fe7bc0a98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.703+0000 7fe7c298e700 1 --2- 172.21.15.60:0/2730382950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7bc0b1d50 0x7fe7bc0a98b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fe7bc0ab650 tx=0x7fe7ac015000).stop 2020-10-31T22:41:11.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.703+0000 7fe7c298e700 1 -- 172.21.15.60:0/2730382950 shutdown_connections 2020-10-31T22:41:11.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.703+0000 7fe7c298e700 1 --2- 172.21.15.60:0/2730382950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe79c054f10 0x7fe79c0573d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.703+0000 7fe7c298e700 1 --2- 172.21.15.60:0/2730382950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7bc140010 0x7fe7bc0a9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.703+0000 7fe7c298e700 1 --2- 172.21.15.60:0/2730382950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7bc0b0d60 0x7fe7bc0b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.703+0000 7fe7c298e700 1 --2- 172.21.15.60:0/2730382950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7bc0b1d50 0x7fe7bc0a98b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.703+0000 7fe7c298e700 1 -- 172.21.15.60:0/2730382950 >> 172.21.15.60:0/2730382950 conn(0x7fe7bc0b5300 msgr2=0x7fe7bc0600a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:11.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.703+0000 7fe7c298e700 1 -- 172.21.15.60:0/2730382950 shutdown_connections 2020-10-31T22:41:11.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.703+0000 7fe7c298e700 1 -- 172.21.15.60:0/2730382950 wait complete. 2020-10-31T22:41:11.724 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:11.725 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-10-31T22:41:11.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.831+0000 7f069b59e700 1 Processor -- start 2020-10-31T22:41:11.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069b59e700 1 -- start start 2020-10-31T22:41:11.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069b59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f069c140230 0x7f069c05c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069b59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c0b2130 con 0x7f069c0b1d50 2020-10-31T22:41:11.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069b59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c0af380 con 0x7f069c0b0d60 2020-10-31T22:41:11.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069b59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c06a9b0 con 0x7f069c140230 2020-10-31T22:41:11.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069a59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f069c0b1d50 0x7f069c13fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45390/0 (socket says 172.21.15.60:45390) 2020-10-31T22:41:11.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069a59c700 1 -- 172.21.15.60:0/4087130601 learned_addr learned my addr 172.21.15.60:0/4087130601 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:11.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069ad9d700 1 --2- 172.21.15.60:0/4087130601 >> v2:172.21.15.66:3300/0 conn(0x7f069c140230 0x7f069c05c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069959a700 1 -- 172.21.15.60:0/4087130601 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546655420 0 0) 0x7f069c0b2130 con 0x7f069c0b1d50 2020-10-31T22:41:11.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069959a700 1 -- 172.21.15.60:0/4087130601 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f067c003230 con 0x7f069c0b1d50 2020-10-31T22:41:11.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069ad9d700 1 -- 172.21.15.60:0/4087130601 >> v1:172.21.15.66:6789/0 conn(0x7f069c0b0d60 legacy=0x7f069c13c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069ad9d700 1 -- 172.21.15.60:0/4087130601 >> v1:172.21.15.60:6789/0 conn(0x7f069c0b1d50 legacy=0x7f069c13fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069ad9d700 1 -- 172.21.15.60:0/4087130601 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c05b160 con 0x7f069c140230 2020-10-31T22:41:11.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069ad9d700 1 --2- 172.21.15.60:0/4087130601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f069c140230 0x7f069c05c6a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f06940032b0 tx=0x7f06940091a0).ready entity=mon.1 client_cookie=a76a477c474fd6c2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069959a700 1 -- 172.21.15.60:0/4087130601 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f069400b9a0 con 0x7f069c140230 2020-10-31T22:41:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069959a700 1 -- 172.21.15.60:0/4087130601 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069400bb00 con 0x7f069c140230 2020-10-31T22:41:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069b59e700 1 -- 172.21.15.60:0/4087130601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f069c140230 msgr2=0x7f069c05c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069959a700 1 -- 172.21.15.60:0/4087130601 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f069400bc70 con 0x7f069c140230 2020-10-31T22:41:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069b59e700 1 --2- 172.21.15.60:0/4087130601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f069c140230 0x7f069c05c6a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f06940032b0 tx=0x7f06940091a0).stop 2020-10-31T22:41:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069b59e700 1 -- 172.21.15.60:0/4087130601 shutdown_connections 2020-10-31T22:41:11.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069b59e700 1 --2- 172.21.15.60:0/4087130601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f069c140230 0x7f069c05c6a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069b59e700 1 -- 172.21.15.60:0/4087130601 >> 172.21.15.60:0/4087130601 conn(0x7f069c0b5300 msgr2=0x7f069c0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069b59e700 1 -- 172.21.15.60:0/4087130601 shutdown_connections 2020-10-31T22:41:11.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.835+0000 7f069b59e700 1 -- 172.21.15.60:0/4087130601 wait complete. 2020-10-31T22:41:11.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f069b59e700 1 Processor -- start 2020-10-31T22:41:11.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f069b59e700 1 -- start start 2020-10-31T22:41:11.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f069b59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f069c0b0d60 0x7f069c0aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f069b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f069c0b1d50 0x7f069c14f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f069b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f069c140230 0x7f069c14f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f069b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c14ea40 con 0x7f069c0b1d50 2020-10-31T22:41:11.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f069b59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0642e0 con 0x7f069c0b0d60 2020-10-31T22:41:11.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f069b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c064580 con 0x7f069c140230 2020-10-31T22:41:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f0699d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f069c0b1d50 0x7f069c14f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f0699d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f069c0b1d50 0x7f069c14f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41262/0 (socket says 172.21.15.60:41262) 2020-10-31T22:41:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f0699d9b700 1 -- 172.21.15.60:0/2675765298 learned_addr learned my addr 172.21.15.60:0/2675765298 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f069a59c700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f069c0b0d60 0x7f069c0aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f069ad9d700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f069c140230 0x7f069c14f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f0699d9b700 1 -- 172.21.15.60:0/2675765298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f069c140230 msgr2=0x7f069c14f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f0699d9b700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f069c140230 0x7f069c14f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f0699d9b700 1 -- 172.21.15.60:0/2675765298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f069c0b0d60 msgr2=0x7f069c0aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f0699d9b700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f069c0b0d60 0x7f069c0aa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:11.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f0699d9b700 1 -- 172.21.15.60:0/2675765298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c064820 con 0x7f069c0b1d50 2020-10-31T22:41:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f069a59c700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f069c0b0d60 0x7f069c0aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f0699d9b700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f069c0b1d50 0x7f069c14f0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f069c0af0f0 tx=0x7f068c007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f06937fe700 1 -- 172.21.15.60:0/2675765298 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f068c00e4a0 con 0x7f069c0b1d50 2020-10-31T22:41:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f06937fe700 1 -- 172.21.15.60:0/2675765298 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c00e600 con 0x7f069c0b1d50 2020-10-31T22:41:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f069b59e700 1 -- 172.21.15.60:0/2675765298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c14ec30 con 0x7f069c0b1d50 2020-10-31T22:41:11.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f06937fe700 1 -- 172.21.15.60:0/2675765298 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f068c00e960 con 0x7f069c0b1d50 2020-10-31T22:41:11.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.839+0000 7f069b59e700 1 -- 172.21.15.60:0/2675765298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c063ee0 con 0x7f069c0b1d50 2020-10-31T22:41:11.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.843+0000 7f069b59e700 1 -- 172.21.15.60:0/2675765298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c14edc0 con 0x7f069c0b1d50 2020-10-31T22:41:11.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.843+0000 7f06937fe700 1 -- 172.21.15.60:0/2675765298 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f068c019030 con 0x7f069c0b1d50 2020-10-31T22:41:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.843+0000 7f06937fe700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0680054f90 0x7f0680057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.843+0000 7f069a59c700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0680054f90 0x7f0680057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.843+0000 7f06937fe700 1 -- 172.21.15.60:0/2675765298 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f068c001e40 con 0x7f069c0b1d50 2020-10-31T22:41:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.843+0000 7f069a59c700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0680054f90 0x7f0680057450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f068400b000 tx=0x7f0684009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.847+0000 7f06937fe700 1 -- 172.21.15.60:0/2675765298 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f068c0437e0 con 0x7f069c0b1d50 2020-10-31T22:41:11.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.995+0000 7f069b59e700 1 -- 172.21.15.60:0/2675765298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f069c057100 con 0x7f069c0b1d50 2020-10-31T22:41:11.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.995+0000 7f06937fe700 1 -- 172.21.15.60:0/2675765298 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f068c046e00 con 0x7f069c0b1d50 2020-10-31T22:41:11.998 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:11.999 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:11.059362+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:07.982891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:08.927092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:12.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.995+0000 7f069b59e700 1 -- 172.21.15.60:0/2675765298 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0680054f90 msgr2=0x7f0680057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.995+0000 7f069b59e700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0680054f90 0x7f0680057450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f068400b000 tx=0x7f0684009040).stop 2020-10-31T22:41:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.995+0000 7f069b59e700 1 -- 172.21.15.60:0/2675765298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f069c0b1d50 msgr2=0x7f069c14f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.995+0000 7f069b59e700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f069c0b1d50 0x7f069c14f0d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f069c0af0f0 tx=0x7f068c007c20).stop 2020-10-31T22:41:12.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.995+0000 7f069b59e700 1 -- 172.21.15.60:0/2675765298 shutdown_connections 2020-10-31T22:41:12.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.995+0000 7f069b59e700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f069c140230 0x7f069c14f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.995+0000 7f069b59e700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0680054f90 0x7f0680057450 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.995+0000 7f069b59e700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f069c0b0d60 0x7f069c0aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.995+0000 7f069b59e700 1 --2- 172.21.15.60:0/2675765298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f069c0b1d50 0x7f069c14f0d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.995+0000 7f069b59e700 1 -- 172.21.15.60:0/2675765298 >> 172.21.15.60:0/2675765298 conn(0x7f069c0b5300 msgr2=0x7f069c13f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:12.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.999+0000 7f069b59e700 1 -- 172.21.15.60:0/2675765298 shutdown_connections 2020-10-31T22:41:12.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:11.999+0000 7f069b59e700 1 -- 172.21.15.60:0/2675765298 wait complete. 2020-10-31T22:41:12.013 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:41:07.982891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:41:08.927092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:41:12.015 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:41:12.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef700c700 1 Processor -- start 2020-10-31T22:41:12.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef700c700 1 -- start start 2020-10-31T22:41:12.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef700c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7ef00b0b70 0x7f7ef013f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef700c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef005f3c0 con 0x7f7ef00b0040 2020-10-31T22:41:12.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef700c700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef0145f70 con 0x7f7ef005b180 2020-10-31T22:41:12.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef700c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef005f5f0 con 0x7f7ef00b0b70 2020-10-31T22:41:12.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef680b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7ef00b0040 0x7f7ef00aef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45410/0 (socket says 172.21.15.60:45410) 2020-10-31T22:41:12.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef5809700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7ef00b0b70 0x7f7ef013f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef680b700 1 -- 172.21.15.60:0/2412011306 learned_addr learned my addr 172.21.15.60:0/2412011306 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:12.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef5809700 1 -- 172.21.15.60:0/2412011306 >> v1:172.21.15.66:6789/0 conn(0x7f7ef005b180 legacy=0x7f7ef005fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef5809700 1 -- 172.21.15.60:0/2412011306 >> v1:172.21.15.60:6789/0 conn(0x7f7ef00b0040 legacy=0x7f7ef00aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef5809700 1 -- 172.21.15.60:0/2412011306 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef005f890 con 0x7f7ef00b0b70 2020-10-31T22:41:12.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef5809700 1 --2- 172.21.15.60:0/2412011306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef00b0b70 0x7f7ef013f030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f7ee0002f30 tx=0x7f7ee0006dc0).ready entity=mon.0 client_cookie=803b6ca1f9c65a42 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:12.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef5008700 1 -- 172.21.15.60:0/2412011306 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee00097f0 con 0x7f7ef00b0b70 2020-10-31T22:41:12.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef5008700 1 -- 172.21.15.60:0/2412011306 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee0009950 con 0x7f7ef00b0b70 2020-10-31T22:41:12.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef5008700 1 -- 172.21.15.60:0/2412011306 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee0009cb0 con 0x7f7ef00b0b70 2020-10-31T22:41:12.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef700c700 1 -- 172.21.15.60:0/2412011306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef00b0b70 msgr2=0x7f7ef013f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.135+0000 7f7ef700c700 1 --2- 172.21.15.60:0/2412011306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef00b0b70 0x7f7ef013f030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f7ee0002f30 tx=0x7f7ee0006dc0).stop 2020-10-31T22:41:12.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.139+0000 7f7ef700c700 1 -- 172.21.15.60:0/2412011306 shutdown_connections 2020-10-31T22:41:12.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.139+0000 7f7ef700c700 1 --2- 172.21.15.60:0/2412011306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef00b0b70 0x7f7ef013f030 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.139+0000 7f7ef700c700 1 -- 172.21.15.60:0/2412011306 >> 172.21.15.60:0/2412011306 conn(0x7f7ef00b61d0 msgr2=0x7f7ef00b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:12.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.139+0000 7f7ef700c700 1 -- 172.21.15.60:0/2412011306 shutdown_connections 2020-10-31T22:41:12.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.139+0000 7f7ef700c700 1 -- 172.21.15.60:0/2412011306 wait complete. 2020-10-31T22:41:12.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.139+0000 7f7ef700c700 1 Processor -- start 2020-10-31T22:41:12.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.139+0000 7f7ef700c700 1 -- start start 2020-10-31T22:41:12.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef700c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ef005b180 0x7f7ef01414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef700c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ef00b0040 0x7f7ef00ac2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef700c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef00b0b70 0x7f7ef00ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef700c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00ab1b0 con 0x7f7ef00b0b70 2020-10-31T22:41:12.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef700c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef013fd70 con 0x7f7ef005b180 2020-10-31T22:41:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef700c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef00ab760 con 0x7f7ef00b0040 2020-10-31T22:41:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef680b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef00b0b70 0x7f7ef00ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef680b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef00b0b70 0x7f7ef00ac7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41280/0 (socket says 172.21.15.60:41280) 2020-10-31T22:41:12.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef680b700 1 -- 172.21.15.60:0/1543945454 learned_addr learned my addr 172.21.15.60:0/1543945454 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:12.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef5809700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ef00b0040 0x7f7ef00ac2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef600a700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ef005b180 0x7f7ef01414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef680b700 1 -- 172.21.15.60:0/1543945454 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ef00b0040 msgr2=0x7f7ef00ac2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef680b700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ef00b0040 0x7f7ef00ac2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef680b700 1 -- 172.21.15.60:0/1543945454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ef005b180 msgr2=0x7f7ef01414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef680b700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ef005b180 0x7f7ef01414d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef680b700 1 -- 172.21.15.60:0/1543945454 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef00accd0 con 0x7f7ef00b0b70 2020-10-31T22:41:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef5809700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ef00b0040 0x7f7ef00ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef600a700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ef005b180 0x7f7ef01414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:12.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef680b700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef00b0b70 0x7f7ef00ac7e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7ef00b6d90 tx=0x7f7ee8007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7edf7fe700 1 -- 172.21.15.60:0/1543945454 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee8005b70 con 0x7f7ef00b0b70 2020-10-31T22:41:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7edf7fe700 1 -- 172.21.15.60:0/1543945454 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee8005cd0 con 0x7f7ef00b0b70 2020-10-31T22:41:12.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef700c700 1 -- 172.21.15.60:0/1543945454 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef013fad0 con 0x7f7ef00b0b70 2020-10-31T22:41:12.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7edf7fe700 1 -- 172.21.15.60:0/1543945454 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ee8007300 con 0x7f7ef00b0b70 2020-10-31T22:41:12.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef700c700 1 -- 172.21.15.60:0/1543945454 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef00abbc0 con 0x7f7ef00b0b70 2020-10-31T22:41:12.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.143+0000 7f7ef700c700 1 -- 172.21.15.60:0/1543945454 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef0142a00 con 0x7f7ef00b0b70 2020-10-31T22:41:12.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.147+0000 7f7edf7fe700 1 -- 172.21.15.60:0/1543945454 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7ee8010030 con 0x7f7ef00b0b70 2020-10-31T22:41:12.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.147+0000 7f7edf7fe700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ed0054f10 0x7f7ed00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.147+0000 7f7edf7fe700 1 -- 172.21.15.60:0/1543945454 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7ee806da40 con 0x7f7ef00b0b70 2020-10-31T22:41:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.147+0000 7f7ef600a700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ed0054f10 0x7f7ed00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.147+0000 7f7ef600a700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ed0054f10 0x7f7ed00573d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7eec00b000 tx=0x7f7eec009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:12.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.155+0000 7f7edf7fe700 1 -- 172.21.15.60:0/1543945454 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7ee8043f70 con 0x7f7ef00b0b70 2020-10-31T22:41:12.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.299+0000 7f7ef700c700 1 -- 172.21.15.60:0/1543945454 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7ef0057100 con 0x7f7ef00b0b70 2020-10-31T22:41:12.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.303+0000 7f7edf7fe700 1 -- 172.21.15.60:0/1543945454 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7ee8047590 con 0x7f7ef00b0b70 2020-10-31T22:41:12.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.303+0000 7f7ef700c700 1 -- 172.21.15.60:0/1543945454 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ed0054f10 msgr2=0x7f7ed00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.303+0000 7f7ef700c700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ed0054f10 0x7f7ed00573d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f7eec00b000 tx=0x7f7eec009040).stop 2020-10-31T22:41:12.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.303+0000 7f7ef700c700 1 -- 172.21.15.60:0/1543945454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef00b0b70 msgr2=0x7f7ef00ac7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.303+0000 7f7ef700c700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef00b0b70 0x7f7ef00ac7e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7ef00b6d90 tx=0x7f7ee8007e50).stop 2020-10-31T22:41:12.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.303+0000 7f7ef700c700 1 -- 172.21.15.60:0/1543945454 shutdown_connections 2020-10-31T22:41:12.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.303+0000 7f7ef700c700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef00b0b70 0x7f7ef00ac7e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.303+0000 7f7ef700c700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ed0054f10 0x7f7ed00573d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.303+0000 7f7ef700c700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ef005b180 0x7f7ef01414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.303+0000 7f7ef700c700 1 --2- 172.21.15.60:0/1543945454 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ef00b0040 0x7f7ef00ac2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.303+0000 7f7ef700c700 1 -- 172.21.15.60:0/1543945454 >> 172.21.15.60:0/1543945454 conn(0x7f7ef00b61d0 msgr2=0x7f7ef00b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:12.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.303+0000 7f7ef700c700 1 -- 172.21.15.60:0/1543945454 shutdown_connections 2020-10-31T22:41:12.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.303+0000 7f7ef700c700 1 -- 172.21.15.60:0/1543945454 wait complete. 2020-10-31T22:41:12.311 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:41:12.319 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:41:12.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 Processor -- start 2020-10-31T22:41:12.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 -- start start 2020-10-31T22:41:12.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa57c065f70 0x7fa57c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa57c0b2e20 0x7fa57c142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa57c066410 con 0x7fa57c05c660 2020-10-31T22:41:12.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57c066d60 con 0x7fa57c065f70 2020-10-31T22:41:12.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57c0b5e80 con 0x7fa57c0b2e20 2020-10-31T22:41:12.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa581b11700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa57c065f70 0x7fa57c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa581b11700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa57c065f70 0x7fa57c0b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41286/0 (socket says 172.21.15.60:41286) 2020-10-31T22:41:12.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa581b11700 1 -- 172.21.15.60:0/1620311306 learned_addr learned my addr 172.21.15.60:0/1620311306 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:12.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa582b13700 1 --2- 172.21.15.60:0/1620311306 >> v2:172.21.15.66:3300/0 conn(0x7fa57c0b2e20 0x7fa57c142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa581b11700 1 -- 172.21.15.60:0/1620311306 >> v2:172.21.15.66:3300/0 conn(0x7fa57c0b2e20 msgr2=0x7fa57c142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:12.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa581b11700 1 --2- 172.21.15.60:0/1620311306 >> v2:172.21.15.66:3300/0 conn(0x7fa57c0b2e20 0x7fa57c142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa581b11700 1 -- 172.21.15.60:0/1620311306 >> v1:172.21.15.66:6789/0 conn(0x7fa57c05c660 legacy=0x7fa57c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa581b11700 1 -- 172.21.15.60:0/1620311306 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c0666b0 con 0x7fa57c065f70 2020-10-31T22:41:12.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa581b11700 1 --2- 172.21.15.60:0/1620311306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa57c065f70 0x7fa57c0b5990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa56c002f30 tx=0x7fa56c006e80).ready entity=mon.0 client_cookie=8f91715b6d0ef5c2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:12.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa581310700 1 -- 172.21.15.60:0/1620311306 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa56c0097f0 con 0x7fa57c065f70 2020-10-31T22:41:12.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa581310700 1 -- 172.21.15.60:0/1620311306 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c009950 con 0x7fa57c065f70 2020-10-31T22:41:12.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa581310700 1 -- 172.21.15.60:0/1620311306 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa56c009cb0 con 0x7fa57c065f70 2020-10-31T22:41:12.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 -- 172.21.15.60:0/1620311306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa57c065f70 msgr2=0x7fa57c0b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 --2- 172.21.15.60:0/1620311306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa57c065f70 0x7fa57c0b5990 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa56c002f30 tx=0x7fa56c006e80).stop 2020-10-31T22:41:12.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 -- 172.21.15.60:0/1620311306 shutdown_connections 2020-10-31T22:41:12.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 --2- 172.21.15.60:0/1620311306 >> v2:172.21.15.66:3300/0 conn(0x7fa57c0b2e20 0x7fa57c142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 --2- 172.21.15.60:0/1620311306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa57c065f70 0x7fa57c0b5990 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 -- 172.21.15.60:0/1620311306 >> 172.21.15.60:0/1620311306 conn(0x7fa57c0601e0 msgr2=0x7fa57c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:12.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 -- 172.21.15.60:0/1620311306 shutdown_connections 2020-10-31T22:41:12.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.435+0000 7fa584576700 1 -- 172.21.15.60:0/1620311306 wait complete. 2020-10-31T22:41:12.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa584576700 1 Processor -- start 2020-10-31T22:41:12.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa584576700 1 -- start start 2020-10-31T22:41:12.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa584576700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa57c05c660 0x7fa57c0ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa584576700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa57c065f70 0x7fa57c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa584576700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa57c0b2e20 0x7fa57c0ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa584576700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c0ada00 con 0x7fa57c05c660 2020-10-31T22:41:12.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa584576700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c1517f0 con 0x7fa57c0b2e20 2020-10-31T22:41:12.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa584576700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c151a50 con 0x7fa57c065f70 2020-10-31T22:41:12.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa582312700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa57c05c660 0x7fa57c0ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa582312700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa57c05c660 0x7fa57c0ac6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41290/0 (socket says 172.21.15.60:41290) 2020-10-31T22:41:12.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa582312700 1 -- 172.21.15.60:0/2490155700 learned_addr learned my addr 172.21.15.60:0/2490155700 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:12.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa582b13700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa57c0b2e20 0x7fa57c0ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa581b11700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa57c065f70 0x7fa57c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa582312700 1 -- 172.21.15.60:0/2490155700 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa57c065f70 msgr2=0x7fa57c0b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa582312700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa57c065f70 0x7fa57c0b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa582312700 1 -- 172.21.15.60:0/2490155700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa57c0b2e20 msgr2=0x7fa57c0ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa582312700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa57c0b2e20 0x7fa57c0ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa582312700 1 -- 172.21.15.60:0/2490155700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c0ae330 con 0x7fa57c05c660 2020-10-31T22:41:12.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa581b11700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa57c065f70 0x7fa57c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa582312700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa57c05c660 0x7fa57c0ac6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fa57c0b0560 tx=0x7fa578007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa56b7fe700 1 -- 172.21.15.60:0/2490155700 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa57800e4a0 con 0x7fa57c05c660 2020-10-31T22:41:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa56b7fe700 1 -- 172.21.15.60:0/2490155700 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57800e600 con 0x7fa57c05c660 2020-10-31T22:41:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa584576700 1 -- 172.21.15.60:0/2490155700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57c0acd40 con 0x7fa57c05c660 2020-10-31T22:41:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa56b7fe700 1 -- 172.21.15.60:0/2490155700 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa57800e960 con 0x7fa57c05c660 2020-10-31T22:41:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.439+0000 7fa584576700 1 -- 172.21.15.60:0/2490155700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57c0a8270 con 0x7fa57c05c660 2020-10-31T22:41:12.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.443+0000 7fa584576700 1 -- 172.21.15.60:0/2490155700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57c0ae4c0 con 0x7fa57c05c660 2020-10-31T22:41:12.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.443+0000 7fa56b7fe700 1 -- 172.21.15.60:0/2490155700 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa578019030 con 0x7fa57c05c660 2020-10-31T22:41:12.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.443+0000 7fa56b7fe700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa55c054f10 0x7fa55c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.443+0000 7fa56b7fe700 1 -- 172.21.15.60:0/2490155700 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa57806cdd0 con 0x7fa57c05c660 2020-10-31T22:41:12.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.443+0000 7fa581b11700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa55c054f10 0x7fa55c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.443+0000 7fa581b11700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa55c054f10 0x7fa55c0573d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa56c01a000 tx=0x7fa56c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.451+0000 7fa56b7fe700 1 -- 172.21.15.60:0/2490155700 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa5780432f0 con 0x7fa57c05c660 2020-10-31T22:41:12.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.587+0000 7fa584576700 1 -- 172.21.15.60:0/2490155700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa57c057100 con 0x7fa57c05c660 2020-10-31T22:41:12.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.587+0000 7fa56b7fe700 1 -- 172.21.15.60:0/2490155700 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa578017070 con 0x7fa57c05c660 2020-10-31T22:41:12.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.591+0000 7fa584576700 1 -- 172.21.15.60:0/2490155700 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa55c054f10 msgr2=0x7fa55c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.591+0000 7fa584576700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa55c054f10 0x7fa55c0573d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fa56c01a000 tx=0x7fa56c015000).stop 2020-10-31T22:41:12.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.591+0000 7fa584576700 1 -- 172.21.15.60:0/2490155700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa57c05c660 msgr2=0x7fa57c0ac6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.591+0000 7fa584576700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa57c05c660 0x7fa57c0ac6c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fa57c0b0560 tx=0x7fa578007b90).stop 2020-10-31T22:41:12.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.591+0000 7fa584576700 1 -- 172.21.15.60:0/2490155700 shutdown_connections 2020-10-31T22:41:12.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.591+0000 7fa584576700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa55c054f10 0x7fa55c0573d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.591+0000 7fa584576700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa57c0b2e20 0x7fa57c0ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.591+0000 7fa584576700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa57c05c660 0x7fa57c0ac6c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.591+0000 7fa584576700 1 --2- 172.21.15.60:0/2490155700 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa57c065f70 0x7fa57c0b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.591+0000 7fa584576700 1 -- 172.21.15.60:0/2490155700 >> 172.21.15.60:0/2490155700 conn(0x7fa57c0601e0 msgr2=0x7fa57c13dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:12.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.591+0000 7fa584576700 1 -- 172.21.15.60:0/2490155700 shutdown_connections 2020-10-31T22:41:12.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.591+0000 7fa584576700 1 -- 172.21.15.60:0/2490155700 wait complete. 2020-10-31T22:41:12.620 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:12.620 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:41:12.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.739+0000 7fa08ec06700 1 Processor -- start 2020-10-31T22:41:12.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.739+0000 7fa08ec06700 1 -- start start 2020-10-31T22:41:12.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08ec06700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa08814f980 0x7fa088151d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08ec06700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0880af900 con 0x7fa0880af520 2020-10-31T22:41:12.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08ec06700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0880afc10 con 0x7fa0880ac870 2020-10-31T22:41:12.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08ec06700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08805bb70 con 0x7fa08814f980 2020-10-31T22:41:12.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08e405700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa08814f980 0x7fa088151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08dc04700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa0880af520 0x7fa088066c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45434/0 (socket says 172.21.15.60:45434) 2020-10-31T22:41:12.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08dc04700 1 -- 172.21.15.60:0/2862507047 learned_addr learned my addr 172.21.15.60:0/2862507047 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:12.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08e405700 1 -- 172.21.15.60:0/2862507047 >> v1:172.21.15.66:6789/0 conn(0x7fa0880ac870 legacy=0x7fa088146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08e405700 1 -- 172.21.15.60:0/2862507047 >> v1:172.21.15.60:6789/0 conn(0x7fa0880af520 legacy=0x7fa088066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08e405700 1 -- 172.21.15.60:0/2862507047 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0880ac130 con 0x7fa08814f980 2020-10-31T22:41:12.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08e405700 1 --2- 172.21.15.60:0/2862507047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa08814f980 0x7fa088151d70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa07c001250 tx=0x7fa0800091a0).ready entity=mon.0 client_cookie=2f7ead390d42f17e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:12.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08cc02700 1 -- 172.21.15.60:0/2862507047 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08000b910 con 0x7fa08814f980 2020-10-31T22:41:12.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08cc02700 1 -- 172.21.15.60:0/2862507047 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08000ba70 con 0x7fa08814f980 2020-10-31T22:41:12.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08cc02700 1 -- 172.21.15.60:0/2862507047 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08000bbe0 con 0x7fa08814f980 2020-10-31T22:41:12.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08ec06700 1 -- 172.21.15.60:0/2862507047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa08814f980 msgr2=0x7fa088151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08ec06700 1 --2- 172.21.15.60:0/2862507047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa08814f980 0x7fa088151d70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fa07c001250 tx=0x7fa0800091a0).stop 2020-10-31T22:41:12.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08ec06700 1 -- 172.21.15.60:0/2862507047 shutdown_connections 2020-10-31T22:41:12.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08ec06700 1 --2- 172.21.15.60:0/2862507047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa08814f980 0x7fa088151d70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08ec06700 1 -- 172.21.15.60:0/2862507047 >> 172.21.15.60:0/2862507047 conn(0x7fa0880b3fd0 msgr2=0x7fa0880b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:12.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08ec06700 1 -- 172.21.15.60:0/2862507047 shutdown_connections 2020-10-31T22:41:12.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08ec06700 1 -- 172.21.15.60:0/2862507047 wait complete. 2020-10-31T22:41:12.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08ec06700 1 Processor -- start 2020-10-31T22:41:12.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.743+0000 7fa08ec06700 1 -- start start 2020-10-31T22:41:12.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08ec06700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0880ac870 0x7fa08813e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08ec06700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0880af520 0x7fa088140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08ec06700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa08814f980 0x7fa08813c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08ec06700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08813db10 con 0x7fa08814f980 2020-10-31T22:41:12.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08ec06700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08813ddb0 con 0x7fa0880ac870 2020-10-31T22:41:12.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08ec06700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0881474f0 con 0x7fa0880af520 2020-10-31T22:41:12.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08e405700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa08814f980 0x7fa08813c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08e405700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa08814f980 0x7fa08813c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41308/0 (socket says 172.21.15.60:41308) 2020-10-31T22:41:12.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08e405700 1 -- 172.21.15.60:0/3149766366 learned_addr learned my addr 172.21.15.60:0/3149766366 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:12.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08dc04700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0880ac870 0x7fa08813e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08d403700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0880af520 0x7fa088140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08e405700 1 -- 172.21.15.60:0/3149766366 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0880af520 msgr2=0x7fa088140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08e405700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0880af520 0x7fa088140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08e405700 1 -- 172.21.15.60:0/3149766366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0880ac870 msgr2=0x7fa08813e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08e405700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0880ac870 0x7fa08813e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08e405700 1 -- 172.21.15.60:0/3149766366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa088147790 con 0x7fa08814f980 2020-10-31T22:41:12.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08dc04700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0880ac870 0x7fa08813e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:12.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08e405700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa08814f980 0x7fa08813c6a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fa07c001250 tx=0x7fa080016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:12.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa07affd700 1 -- 172.21.15.60:0/3149766366 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08001f5e0 con 0x7fa08814f980 2020-10-31T22:41:12.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa07affd700 1 -- 172.21.15.60:0/3149766366 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08001f740 con 0x7fa08814f980 2020-10-31T22:41:12.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08ec06700 1 -- 172.21.15.60:0/3149766366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa088147c30 con 0x7fa08814f980 2020-10-31T22:41:12.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa07affd700 1 -- 172.21.15.60:0/3149766366 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08001faa0 con 0x7fa08814f980 2020-10-31T22:41:12.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08ec06700 1 -- 172.21.15.60:0/3149766366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa088149f50 con 0x7fa08814f980 2020-10-31T22:41:12.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.747+0000 7fa08ec06700 1 -- 172.21.15.60:0/3149766366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa088057100 con 0x7fa08814f980 2020-10-31T22:41:12.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.751+0000 7fa07affd700 1 -- 172.21.15.60:0/3149766366 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa080026030 con 0x7fa08814f980 2020-10-31T22:41:12.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.751+0000 7fa07affd700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa068054f10 0x7fa0680573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:12.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.751+0000 7fa07affd700 1 -- 172.21.15.60:0/3149766366 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa08006f380 con 0x7fa08814f980 2020-10-31T22:41:12.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.751+0000 7fa08dc04700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa068054f10 0x7fa0680573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:12.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.751+0000 7fa08dc04700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa068054f10 0x7fa0680573d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa07c00b000 tx=0x7fa07c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:12.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.759+0000 7fa07affd700 1 -- 172.21.15.60:0/3149766366 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa0800458e0 con 0x7fa08814f980 2020-10-31T22:41:12.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.899+0000 7fa08ec06700 1 -- 172.21.15.60:0/3149766366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa088147920 con 0x7fa08814f980 2020-10-31T22:41:12.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.903+0000 7fa07affd700 1 -- 172.21.15.60:0/3149766366 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa0800240a0 con 0x7fa08814f980 2020-10-31T22:41:12.905 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:12.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.903+0000 7fa08ec06700 1 -- 172.21.15.60:0/3149766366 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa068054f10 msgr2=0x7fa0680573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.903+0000 7fa08ec06700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa068054f10 0x7fa0680573d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fa07c00b000 tx=0x7fa07c009040).stop 2020-10-31T22:41:12.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.903+0000 7fa08ec06700 1 -- 172.21.15.60:0/3149766366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa08814f980 msgr2=0x7fa08813c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:12.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.903+0000 7fa08ec06700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa08814f980 0x7fa08813c6a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fa07c001250 tx=0x7fa080016000).stop 2020-10-31T22:41:12.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.903+0000 7fa08ec06700 1 -- 172.21.15.60:0/3149766366 shutdown_connections 2020-10-31T22:41:12.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.903+0000 7fa08ec06700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa08814f980 0x7fa08813c6a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.903+0000 7fa08ec06700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa068054f10 0x7fa0680573d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.903+0000 7fa08ec06700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0880ac870 0x7fa08813e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.903+0000 7fa08ec06700 1 --2- 172.21.15.60:0/3149766366 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0880af520 0x7fa088140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.903+0000 7fa08ec06700 1 -- 172.21.15.60:0/3149766366 >> 172.21.15.60:0/3149766366 conn(0x7fa0880b3fd0 msgr2=0x7fa0880b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.903+0000 7fa08ec06700 1 -- 172.21.15.60:0/3149766366 shutdown_connections 2020-10-31T22:41:12.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:12.903+0000 7fa08ec06700 1 -- 172.21.15.60:0/3149766366 wait complete. 2020-10-31T22:41:12.921 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:41:13.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31ef59e700 1 Processor -- start 2020-10-31T22:41:13.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31ef59e700 1 -- start start 2020-10-31T22:41:13.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31ef59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31f00b0bc0 0x7f31f00ade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31ef59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f31f00b0500 0x7f31f01413c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31ef59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f00b02d0 con 0x7f31f00afef0 2020-10-31T22:41:13.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31ef59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f00a8060 con 0x7f31f00b0500 2020-10-31T22:41:13.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31ef59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f00a8300 con 0x7f31f00b0bc0 2020-10-31T22:41:13.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31ee59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f31f00afef0 0x7f31f00ad730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45448/0 (socket says 172.21.15.60:45448) 2020-10-31T22:41:13.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31ee59c700 1 -- 172.21.15.60:0/2931399624 learned_addr learned my addr 172.21.15.60:0/2931399624 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:13.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31eed9d700 1 --2- 172.21.15.60:0/2931399624 >> v2:172.21.15.60:3300/0 conn(0x7f31f00b0500 0x7f31f01413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31edd9b700 1 --2- 172.21.15.60:0/2931399624 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31f00b0bc0 0x7f31f00ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31eed9d700 1 -- 172.21.15.60:0/2931399624 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31f00b0bc0 msgr2=0x7f31f00ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:13.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31eed9d700 1 --2- 172.21.15.60:0/2931399624 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31f00b0bc0 0x7f31f00ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31eed9d700 1 -- 172.21.15.60:0/2931399624 >> v1:172.21.15.60:6789/0 conn(0x7f31f00afef0 legacy=0x7f31f00ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31eed9d700 1 -- 172.21.15.60:0/2931399624 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f00af290 con 0x7f31f00b0500 2020-10-31T22:41:13.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31ed59a700 1 -- 172.21.15.60:0/2931399624 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258879339 0 0) 0x7f31f00b02d0 con 0x7f31f00afef0 2020-10-31T22:41:13.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31edd9b700 1 --2- 172.21.15.60:0/2931399624 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31f00b0bc0 0x7f31f00ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:41:13.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31eed9d700 1 --2- 172.21.15.60:0/2931399624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31f00b0500 0x7f31f01413c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f31e80032b0 tx=0x7f31e80091a0).ready entity=mon.0 client_cookie=705fc2597c25c32 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:13.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31ed59a700 1 -- 172.21.15.60:0/2931399624 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31e800ba50 con 0x7f31f00b0500 2020-10-31T22:41:13.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31ed59a700 1 -- 172.21.15.60:0/2931399624 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e800bbb0 con 0x7f31f00b0500 2020-10-31T22:41:13.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.035+0000 7f31ed59a700 1 -- 172.21.15.60:0/2931399624 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31e800bd20 con 0x7f31f00b0500 2020-10-31T22:41:13.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.039+0000 7f31ef59e700 1 -- 172.21.15.60:0/2931399624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31f00b0500 msgr2=0x7f31f01413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.039+0000 7f31ef59e700 1 --2- 172.21.15.60:0/2931399624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31f00b0500 0x7f31f01413c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f31e80032b0 tx=0x7f31e80091a0).stop 2020-10-31T22:41:13.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.039+0000 7f31ef59e700 1 -- 172.21.15.60:0/2931399624 shutdown_connections 2020-10-31T22:41:13.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.039+0000 7f31ef59e700 1 --2- 172.21.15.60:0/2931399624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31f00b0500 0x7f31f01413c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.039+0000 7f31ef59e700 1 --2- 172.21.15.60:0/2931399624 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31f00b0bc0 0x7f31f00ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.039+0000 7f31ef59e700 1 -- 172.21.15.60:0/2931399624 >> 172.21.15.60:0/2931399624 conn(0x7f31f00b4840 msgr2=0x7f31f00b4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:13.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.039+0000 7f31ef59e700 1 -- 172.21.15.60:0/2931399624 shutdown_connections 2020-10-31T22:41:13.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.039+0000 7f31ef59e700 1 -- 172.21.15.60:0/2931399624 wait complete. 2020-10-31T22:41:13.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.039+0000 7f31ef59e700 1 Processor -- start 2020-10-31T22:41:13.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.039+0000 7f31ef59e700 1 -- start start 2020-10-31T22:41:13.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31ef59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31f00afef0 0x7f31f00ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31ef59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31f00b0500 0x7f31f0063c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31ef59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31f00b0bc0 0x7f31f0091a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31ef59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f00665b0 con 0x7f31f00b0500 2020-10-31T22:41:13.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31ef59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f0092510 con 0x7f31f00afef0 2020-10-31T22:41:13.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31ef59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f0092270 con 0x7f31f00b0bc0 2020-10-31T22:41:13.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31edd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31f00b0500 0x7f31f0063c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31ee59c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31f00afef0 0x7f31f00ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31edd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31f00b0500 0x7f31f0063c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41320/0 (socket says 172.21.15.60:41320) 2020-10-31T22:41:13.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31edd9b700 1 -- 172.21.15.60:0/2904467284 learned_addr learned my addr 172.21.15.60:0/2904467284 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:13.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31eed9d700 1 --2- 172.21.15.60:0/2904467284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31f00b0bc0 0x7f31f0091a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31edd9b700 1 -- 172.21.15.60:0/2904467284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31f00b0bc0 msgr2=0x7f31f0091a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31edd9b700 1 --2- 172.21.15.60:0/2904467284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31f00b0bc0 0x7f31f0091a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31edd9b700 1 -- 172.21.15.60:0/2904467284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31f00afef0 msgr2=0x7f31f00ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31edd9b700 1 --2- 172.21.15.60:0/2904467284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31f00afef0 0x7f31f00ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31edd9b700 1 -- 172.21.15.60:0/2904467284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f014f980 con 0x7f31f00b0500 2020-10-31T22:41:13.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31edd9b700 1 --2- 172.21.15.60:0/2904467284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31f00b0500 0x7f31f0063c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f31e4007000 tx=0x7f31e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:13.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31df7fe700 1 -- 172.21.15.60:0/2904467284 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31e4010580 con 0x7f31f00b0500 2020-10-31T22:41:13.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31df7fe700 1 -- 172.21.15.60:0/2904467284 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e40106e0 con 0x7f31f00b0500 2020-10-31T22:41:13.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31ef59e700 1 -- 172.21.15.60:0/2904467284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f014fc20 con 0x7f31f00b0500 2020-10-31T22:41:13.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31df7fe700 1 -- 172.21.15.60:0/2904467284 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31e4010a40 con 0x7f31f00b0500 2020-10-31T22:41:13.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.043+0000 7f31ef59e700 1 -- 172.21.15.60:0/2904467284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f0065680 con 0x7f31f00b0500 2020-10-31T22:41:13.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.047+0000 7f31ef59e700 1 -- 172.21.15.60:0/2904467284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f00920d0 con 0x7f31f00b0500 2020-10-31T22:41:13.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.047+0000 7f31df7fe700 1 -- 172.21.15.60:0/2904467284 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f31e4010ba0 con 0x7f31f00b0500 2020-10-31T22:41:13.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.047+0000 7f31df7fe700 1 --2- 172.21.15.60:0/2904467284 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f31cc054f10 0x7f31cc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.047+0000 7f31df7fe700 1 -- 172.21.15.60:0/2904467284 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f31e406da90 con 0x7f31f00b0500 2020-10-31T22:41:13.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.047+0000 7f31ee59c700 1 --2- 172.21.15.60:0/2904467284 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f31cc054f10 0x7f31cc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.047+0000 7f31ee59c700 1 --2- 172.21.15.60:0/2904467284 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f31cc054f10 0x7f31cc0573d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f31e000d000 tx=0x7f31e00078d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:13.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.055+0000 7f31df7fe700 1 -- 172.21.15.60:0/2904467284 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f31f00920d0 con 0x7f31f00b0500 2020-10-31T22:41:13.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.195+0000 7f31ef59e700 1 -- 172.21.15.60:0/2904467284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31f00920d0 con 0x7f31f00b0500 2020-10-31T22:41:13.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.195+0000 7f31df7fe700 1 -- 172.21.15.60:0/2904467284 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f31f00920d0 con 0x7f31f00b0500 2020-10-31T22:41:13.201 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.199+0000 7f31ef59e700 1 -- 172.21.15.60:0/2904467284 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f31cc054f10 msgr2=0x7f31cc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.199+0000 7f31ef59e700 1 --2- 172.21.15.60:0/2904467284 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f31cc054f10 0x7f31cc0573d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f31e000d000 tx=0x7f31e00078d0).stop 2020-10-31T22:41:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.199+0000 7f31ef59e700 1 -- 172.21.15.60:0/2904467284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31f00b0500 msgr2=0x7f31f0063c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.199+0000 7f31ef59e700 1 --2- 172.21.15.60:0/2904467284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31f00b0500 0x7f31f0063c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f31e4007000 tx=0x7f31e4008040).stop 2020-10-31T22:41:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.199+0000 7f31ef59e700 1 -- 172.21.15.60:0/2904467284 shutdown_connections 2020-10-31T22:41:13.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.199+0000 7f31ef59e700 1 --2- 172.21.15.60:0/2904467284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31f00b0bc0 0x7f31f0091a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.199+0000 7f31ef59e700 1 --2- 172.21.15.60:0/2904467284 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f31cc054f10 0x7f31cc0573d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.199+0000 7f31ef59e700 1 --2- 172.21.15.60:0/2904467284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31f00afef0 0x7f31f00ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.199+0000 7f31ef59e700 1 --2- 172.21.15.60:0/2904467284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31f00b0500 0x7f31f0063c00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.199+0000 7f31ef59e700 1 -- 172.21.15.60:0/2904467284 >> 172.21.15.60:0/2904467284 conn(0x7f31f00b4840 msgr2=0x7f31f005c000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:13.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.199+0000 7f31ef59e700 1 -- 172.21.15.60:0/2904467284 shutdown_connections 2020-10-31T22:41:13.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.199+0000 7f31ef59e700 1 -- 172.21.15.60:0/2904467284 wait complete. 2020-10-31T22:41:13.215 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-10-31T22:41:13.216 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-10-31T22:41:13.216 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-10-31T22:41:13.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.331+0000 7f06d1034700 1 Processor -- start 2020-10-31T22:41:13.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.331+0000 7f06d1034700 1 -- start start 2020-10-31T22:41:13.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.331+0000 7f06d1034700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f06cc0b1bb0 0x7f06cc05c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.331+0000 7f06d1034700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06cc0ae630 0x7f06cc13ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.331+0000 7f06d1034700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06cc05c800 con 0x7f06cc13f1b0 2020-10-31T22:41:13.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.331+0000 7f06d1034700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06cc05c5e0 con 0x7f06cc0b1bb0 2020-10-31T22:41:13.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.331+0000 7f06d1034700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc13f630 con 0x7f06cc0ae630 2020-10-31T22:41:13.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.331+0000 7f06d0833700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f06cc13f1b0 0x7f06cc0b0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45464/0 (socket says 172.21.15.60:45464) 2020-10-31T22:41:13.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.331+0000 7f06d0833700 1 -- 172.21.15.60:0/2403506607 learned_addr learned my addr 172.21.15.60:0/2403506607 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:13.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.331+0000 7f06cb7fe700 1 --2- 172.21.15.60:0/2403506607 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06cc0ae630 0x7f06cc13ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.331+0000 7f06cbfff700 1 --2- 172.21.15.60:0/2403506607 >> v2:172.21.15.66:3300/0 conn(0x7f06cc0b1bb0 0x7f06cc05c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.331+0000 7f06caffd700 1 -- 172.21.15.60:0/2403506607 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882614303 0 0) 0x7f06cc05c800 con 0x7f06cc13f1b0 2020-10-31T22:41:13.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06cb7fe700 1 -- 172.21.15.60:0/2403506607 >> v2:172.21.15.66:3300/0 conn(0x7f06cc0b1bb0 msgr2=0x7f06cc05c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:13.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06cb7fe700 1 --2- 172.21.15.60:0/2403506607 >> v2:172.21.15.66:3300/0 conn(0x7f06cc0b1bb0 0x7f06cc05c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06cb7fe700 1 -- 172.21.15.60:0/2403506607 >> v1:172.21.15.60:6789/0 conn(0x7f06cc13f1b0 legacy=0x7f06cc0b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06cb7fe700 1 -- 172.21.15.60:0/2403506607 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc0adc50 con 0x7f06cc0ae630 2020-10-31T22:41:13.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06cb7fe700 1 --2- 172.21.15.60:0/2403506607 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06cc0ae630 0x7f06cc13ecc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f06b4002f30 tx=0x7f06b4006dc0).ready entity=mon.2 client_cookie=740b75f468adf574 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:13.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06caffd700 1 -- 172.21.15.60:0/2403506607 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06b4009760 con 0x7f06cc0ae630 2020-10-31T22:41:13.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06caffd700 1 -- 172.21.15.60:0/2403506607 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b40098c0 con 0x7f06cc0ae630 2020-10-31T22:41:13.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06caffd700 1 -- 172.21.15.60:0/2403506607 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06b4009c20 con 0x7f06cc0ae630 2020-10-31T22:41:13.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06d1034700 1 -- 172.21.15.60:0/2403506607 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06cc0ae630 msgr2=0x7f06cc13ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06d1034700 1 --2- 172.21.15.60:0/2403506607 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06cc0ae630 0x7f06cc13ecc0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f06b4002f30 tx=0x7f06b4006dc0).stop 2020-10-31T22:41:13.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06d1034700 1 -- 172.21.15.60:0/2403506607 shutdown_connections 2020-10-31T22:41:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06d1034700 1 --2- 172.21.15.60:0/2403506607 >> v2:172.21.15.66:3300/0 conn(0x7f06cc0b1bb0 0x7f06cc05c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06d1034700 1 --2- 172.21.15.60:0/2403506607 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06cc0ae630 0x7f06cc13ecc0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06d1034700 1 -- 172.21.15.60:0/2403506607 >> 172.21.15.60:0/2403506607 conn(0x7f06cc0b5300 msgr2=0x7f06cc0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06d1034700 1 -- 172.21.15.60:0/2403506607 shutdown_connections 2020-10-31T22:41:13.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.335+0000 7f06d1034700 1 -- 172.21.15.60:0/2403506607 wait complete. 2020-10-31T22:41:13.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06d1034700 1 Processor -- start 2020-10-31T22:41:13.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06d1034700 1 -- start start 2020-10-31T22:41:13.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06d1034700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06cc0b1bb0 0x7f06cc066a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06d1034700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06cc13f1b0 0x7f06cc13ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06d1034700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06cc13bef0 0x7f06cc132bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06d1034700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc14e150 con 0x7f06cc13f1b0 2020-10-31T22:41:13.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06d1034700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc062dd0 con 0x7f06cc13bef0 2020-10-31T22:41:13.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06d1034700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06cc14e380 con 0x7f06cc0b1bb0 2020-10-31T22:41:13.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06cb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06cc13f1b0 0x7f06cc13ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06cb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06cc13f1b0 0x7f06cc13ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41330/0 (socket says 172.21.15.60:41330) 2020-10-31T22:41:13.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06cb7fe700 1 -- 172.21.15.60:0/2438002822 learned_addr learned my addr 172.21.15.60:0/2438002822 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:13.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06cbfff700 1 --2- 172.21.15.60:0/2438002822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06cc0b1bb0 0x7f06cc066a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06d0833700 1 --2- 172.21.15.60:0/2438002822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06cc13bef0 0x7f06cc132bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06cb7fe700 1 -- 172.21.15.60:0/2438002822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06cc0b1bb0 msgr2=0x7f06cc066a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06cb7fe700 1 --2- 172.21.15.60:0/2438002822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06cc0b1bb0 0x7f06cc066a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06cb7fe700 1 -- 172.21.15.60:0/2438002822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06cc13bef0 msgr2=0x7f06cc132bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06cb7fe700 1 --2- 172.21.15.60:0/2438002822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06cc13bef0 0x7f06cc132bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06cb7fe700 1 -- 172.21.15.60:0/2438002822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc063070 con 0x7f06cc13f1b0 2020-10-31T22:41:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06cb7fe700 1 --2- 172.21.15.60:0/2438002822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06cc13f1b0 0x7f06cc13ba00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f06b4002f30 tx=0x7f06b4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06c97fa700 1 -- 172.21.15.60:0/2438002822 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06b4011a50 con 0x7f06cc13f1b0 2020-10-31T22:41:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06c97fa700 1 -- 172.21.15.60:0/2438002822 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06b4011bb0 con 0x7f06cc13f1b0 2020-10-31T22:41:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06d1034700 1 -- 172.21.15.60:0/2438002822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06cc13c3a0 con 0x7f06cc13f1b0 2020-10-31T22:41:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06c97fa700 1 -- 172.21.15.60:0/2438002822 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06b401d440 con 0x7f06cc13f1b0 2020-10-31T22:41:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.339+0000 7f06d1034700 1 -- 172.21.15.60:0/2438002822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06cc0b3210 con 0x7f06cc13f1b0 2020-10-31T22:41:13.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.343+0000 7f06d1034700 1 -- 172.21.15.60:0/2438002822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06cc14e540 con 0x7f06cc13f1b0 2020-10-31T22:41:13.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.343+0000 7f06c97fa700 1 -- 172.21.15.60:0/2438002822 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f06b4024030 con 0x7f06cc13f1b0 2020-10-31T22:41:13.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.343+0000 7f06c97fa700 1 --2- 172.21.15.60:0/2438002822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f06b0054f10 0x7f06b00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.343+0000 7f06c97fa700 1 -- 172.21.15.60:0/2438002822 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f06b406e9b0 con 0x7f06cc13f1b0 2020-10-31T22:41:13.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.343+0000 7f06cbfff700 1 --2- 172.21.15.60:0/2438002822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f06b0054f10 0x7f06b00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.343+0000 7f06cbfff700 1 --2- 172.21.15.60:0/2438002822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f06b0054f10 0x7f06b00573d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f06bc00b000 tx=0x7f06bc0091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:13.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.347+0000 7f06c97fa700 1 -- 172.21.15.60:0/2438002822 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f06b4044ed0 con 0x7f06cc13f1b0 2020-10-31T22:41:13.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.523+0000 7f06d1034700 1 -- 172.21.15.60:0/2438002822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f06cc057100 con 0x7f06cc13f1b0 2020-10-31T22:41:13.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.527+0000 7f06c97fa700 1 -- 172.21.15.60:0/2438002822 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+133136 (secure 0 0 0) 0x7f06b4022020 con 0x7f06cc13f1b0 2020-10-31T22:41:13.531 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:13.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.527+0000 7f06d1034700 1 -- 172.21.15.60:0/2438002822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f06b0054f10 msgr2=0x7f06b00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.527+0000 7f06d1034700 1 --2- 172.21.15.60:0/2438002822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f06b0054f10 0x7f06b00573d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f06bc00b000 tx=0x7f06bc0091a0).stop 2020-10-31T22:41:13.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.527+0000 7f06d1034700 1 -- 172.21.15.60:0/2438002822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06cc13f1b0 msgr2=0x7f06cc13ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.527+0000 7f06d1034700 1 --2- 172.21.15.60:0/2438002822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06cc13f1b0 0x7f06cc13ba00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f06b4002f30 tx=0x7f06b4015000).stop 2020-10-31T22:41:13.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.527+0000 7f06d1034700 1 -- 172.21.15.60:0/2438002822 shutdown_connections 2020-10-31T22:41:13.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.527+0000 7f06d1034700 1 --2- 172.21.15.60:0/2438002822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f06b0054f10 0x7f06b00573d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.527+0000 7f06d1034700 1 --2- 172.21.15.60:0/2438002822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06cc13bef0 0x7f06cc132bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.527+0000 7f06d1034700 1 --2- 172.21.15.60:0/2438002822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06cc0b1bb0 0x7f06cc066a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.527+0000 7f06d1034700 1 --2- 172.21.15.60:0/2438002822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06cc13f1b0 0x7f06cc13ba00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.527+0000 7f06d1034700 1 -- 172.21.15.60:0/2438002822 >> 172.21.15.60:0/2438002822 conn(0x7f06cc0b5300 msgr2=0x7f06cc0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:13.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.527+0000 7f06d1034700 1 -- 172.21.15.60:0/2438002822 shutdown_connections 2020-10-31T22:41:13.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.527+0000 7f06d1034700 1 -- 172.21.15.60:0/2438002822 wait complete. 2020-10-31T22:41:13.545 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":4,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":14112},{"type":"v1","addr":"172.21.15.60:6801","nonce":14112}]},"active_addr":"172.21.15.60:6801/14112","active_change":"2020-10-31T22:40:55.771223+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2117147676}]},{"addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":2806507642}]},{"addrvec":[{"type":"v2","addr":"172.21.15.60:0","nonce":3011056338}]}]}} 2020-10-31T22:41:13.552 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-10-31T22:41:13.553 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-10-31T22:41:13.553 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:13.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 Processor -- start 2020-10-31T22:41:13.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 -- start start 2020-10-31T22:41:13.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f50c00b5570 0x7f50c00b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50c0141fe0 0x7f50c0142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c0145180 con 0x7f50c00b24a0 2020-10-31T22:41:13.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c00afae0 con 0x7f50c00b5570 2020-10-31T22:41:13.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c0141bf0 con 0x7f50c0141fe0 2020-10-31T22:41:13.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c4fe2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f50c00b5570 0x7f50c00b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50bffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f50c00b24a0 0x7f50c0145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45476/0 (socket says 172.21.15.60:45476) 2020-10-31T22:41:13.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50bffff700 1 -- 172.21.15.60:0/1527687006 learned_addr learned my addr 172.21.15.60:0/1527687006 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:13.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c57e3700 1 --2- 172.21.15.60:0/1527687006 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50c0141fe0 0x7f50c0142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c4fe2700 1 -- 172.21.15.60:0/1527687006 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50c0141fe0 msgr2=0x7f50c0142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:13.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c4fe2700 1 --2- 172.21.15.60:0/1527687006 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50c0141fe0 0x7f50c0142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c4fe2700 1 -- 172.21.15.60:0/1527687006 >> v1:172.21.15.60:6789/0 conn(0x7f50c00b24a0 legacy=0x7f50c0145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50bf7fe700 1 -- 172.21.15.60:0/1527687006 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321488344 0 0) 0x7f50c0145180 con 0x7f50c00b24a0 2020-10-31T22:41:13.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c4fe2700 1 -- 172.21.15.60:0/1527687006 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c00b0670 con 0x7f50c00b5570 2020-10-31T22:41:13.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c4fe2700 1 --2- 172.21.15.60:0/1527687006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50c00b5570 0x7f50c00b5950 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f50c005f580 tx=0x7f50b4006dc0).ready entity=mon.0 client_cookie=5ebedc680df6977e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:13.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50bf7fe700 1 -- 172.21.15.60:0/1527687006 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50b4009720 con 0x7f50c00b5570 2020-10-31T22:41:13.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50bf7fe700 1 -- 172.21.15.60:0/1527687006 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b4009880 con 0x7f50c00b5570 2020-10-31T22:41:13.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50bf7fe700 1 -- 172.21.15.60:0/1527687006 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50b4009be0 con 0x7f50c00b5570 2020-10-31T22:41:13.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1527687006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50c00b5570 msgr2=0x7f50c00b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 --2- 172.21.15.60:0/1527687006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50c00b5570 0x7f50c00b5950 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f50c005f580 tx=0x7f50b4006dc0).stop 2020-10-31T22:41:13.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1527687006 shutdown_connections 2020-10-31T22:41:13.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 --2- 172.21.15.60:0/1527687006 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50c0141fe0 0x7f50c0142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 --2- 172.21.15.60:0/1527687006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50c00b5570 0x7f50c00b5950 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1527687006 >> 172.21.15.60:0/1527687006 conn(0x7f50c00b8e90 msgr2=0x7f50c00b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:13.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1527687006 shutdown_connections 2020-10-31T22:41:13.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.667+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1527687006 wait complete. 2020-10-31T22:41:13.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50c5fe4700 1 Processor -- start 2020-10-31T22:41:13.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50c5fe4700 1 -- start start 2020-10-31T22:41:13.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50c5fe4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50c00b24a0 0x7f50c00b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50c5fe4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50c00b5570 0x7f50c013fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50c5fe4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50c0141fe0 0x7f50c0150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50c5fe4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00b7fa0 con 0x7f50c00b5570 2020-10-31T22:41:13.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50c5fe4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00b6540 con 0x7f50c0141fe0 2020-10-31T22:41:13.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50c5fe4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c00b67e0 con 0x7f50c00b24a0 2020-10-31T22:41:13.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50bffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50c00b5570 0x7f50c013fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50bffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50c00b5570 0x7f50c013fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41344/0 (socket says 172.21.15.60:41344) 2020-10-31T22:41:13.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50bffff700 1 -- 172.21.15.60:0/1821417742 learned_addr learned my addr 172.21.15.60:0/1821417742 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:13.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50c57e3700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50c0141fe0 0x7f50c0150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50c4fe2700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50c00b24a0 0x7f50c00b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50bffff700 1 -- 172.21.15.60:0/1821417742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50c00b24a0 msgr2=0x7f50c00b6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50bffff700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50c00b24a0 0x7f50c00b6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50bffff700 1 -- 172.21.15.60:0/1821417742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50c0141fe0 msgr2=0x7f50c0150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50bffff700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50c0141fe0 0x7f50c0150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50bffff700 1 -- 172.21.15.60:0/1821417742 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c00b6a80 con 0x7f50c00b5570 2020-10-31T22:41:13.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50c4fe2700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50c00b24a0 0x7f50c00b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:41:13.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50bffff700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50c00b5570 0x7f50c013fe30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f50ac000b80 tx=0x7f50ac007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:13.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50bdffb700 1 -- 172.21.15.60:0/1821417742 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50ac0072e0 con 0x7f50c00b5570 2020-10-31T22:41:13.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1821417742 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c01431e0 con 0x7f50c00b5570 2020-10-31T22:41:13.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1821417742 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c01404c0 con 0x7f50c00b5570 2020-10-31T22:41:13.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50bdffb700 1 -- 172.21.15.60:0/1821417742 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac007440 con 0x7f50c00b5570 2020-10-31T22:41:13.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.671+0000 7f50bdffb700 1 -- 172.21.15.60:0/1821417742 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50ac0057d0 con 0x7f50c00b5570 2020-10-31T22:41:13.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.675+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1821417742 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c00b6350 con 0x7f50c00b5570 2020-10-31T22:41:13.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.675+0000 7f50bdffb700 1 -- 172.21.15.60:0/1821417742 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f50ac010070 con 0x7f50c00b5570 2020-10-31T22:41:13.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.675+0000 7f50bdffb700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f50a8054f10 0x7f50a80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.675+0000 7f50c4fe2700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f50a8054f10 0x7f50a80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.675+0000 7f50bdffb700 1 -- 172.21.15.60:0/1821417742 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f50ac06d220 con 0x7f50c00b5570 2020-10-31T22:41:13.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.675+0000 7f50c4fe2700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f50a8054f10 0x7f50a80573d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f50b4016000 tx=0x7f50b4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:13.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.683+0000 7f50bdffb700 1 -- 172.21.15.60:0/1821417742 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f50ac0436a0 con 0x7f50c00b5570 2020-10-31T22:41:13.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.831+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1821417742 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50c0057100 con 0x7f50c00b5570 2020-10-31T22:41:13.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.831+0000 7f50bdffb700 1 -- 172.21.15.60:0/1821417742 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f50ac046cc0 con 0x7f50c00b5570 2020-10-31T22:41:13.836 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:13.836 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:11.059362+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:07.982891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:08.927092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:13.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.835+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1821417742 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f50a8054f10 msgr2=0x7f50a80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.835+0000 7f50c5fe4700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f50a8054f10 0x7f50a80573d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f50b4016000 tx=0x7f50b4015000).stop 2020-10-31T22:41:13.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.835+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1821417742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50c00b5570 msgr2=0x7f50c013fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.835+0000 7f50c5fe4700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50c00b5570 0x7f50c013fe30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f50ac000b80 tx=0x7f50ac007a30).stop 2020-10-31T22:41:13.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.835+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1821417742 shutdown_connections 2020-10-31T22:41:13.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.835+0000 7f50c5fe4700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f50a8054f10 0x7f50a80573d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.835+0000 7f50c5fe4700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50c0141fe0 0x7f50c0150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.835+0000 7f50c5fe4700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50c00b24a0 0x7f50c00b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.835+0000 7f50c5fe4700 1 --2- 172.21.15.60:0/1821417742 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50c00b5570 0x7f50c013fe30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.835+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1821417742 >> 172.21.15.60:0/1821417742 conn(0x7f50c00b8e90 msgr2=0x7f50c00b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:13.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.835+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1821417742 shutdown_connections 2020-10-31T22:41:13.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.835+0000 7f50c5fe4700 1 -- 172.21.15.60:0/1821417742 wait complete. 2020-10-31T22:41:13.856 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-10-31T22:41:13.856 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f2482131700 1 Processor -- start 2020-10-31T22:41:13.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f2482131700 1 -- start start 2020-10-31T22:41:13.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f2482131700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f247c0af520 0x7f247c0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f2482131700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247c0af900 con 0x7f247c066c90 2020-10-31T22:41:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f2482131700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f247c0afc10 con 0x7f247c0670f0 2020-10-31T22:41:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f2482131700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c05bb70 con 0x7f247c0af520 2020-10-31T22:41:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f248092e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f247c066c90 0x7f247c146060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45490/0 (socket says 172.21.15.60:45490) 2020-10-31T22:41:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f248092e700 1 -- 172.21.15.60:0/130958176 learned_addr learned my addr 172.21.15.60:0/130958176 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f248112f700 1 --2- 172.21.15.60:0/130958176 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f247c0af520 0x7f247c0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f247bfff700 1 -- 172.21.15.60:0/130958176 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591418878 0 0) 0x7f247c0af900 con 0x7f247c066c90 2020-10-31T22:41:13.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f247bfff700 1 -- 172.21.15.60:0/130958176 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f245c003230 con 0x7f247c066c90 2020-10-31T22:41:13.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f248112f700 1 -- 172.21.15.60:0/130958176 >> v1:172.21.15.66:6789/0 conn(0x7f247c0670f0 legacy=0x7f247c150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f247bfff700 1 -- 172.21.15.60:0/130958176 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914876760 0 0) 0x7f247c0afc10 con 0x7f247c0670f0 2020-10-31T22:41:13.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f248112f700 1 -- 172.21.15.60:0/130958176 >> v1:172.21.15.60:6789/0 conn(0x7f247c066c90 legacy=0x7f247c146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f248112f700 1 -- 172.21.15.60:0/130958176 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c0ac130 con 0x7f247c0af520 2020-10-31T22:41:13.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f248112f700 1 --2- 172.21.15.60:0/130958176 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f247c0af520 0x7f247c0ac870 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f24740032b0 tx=0x7f24740091a0).ready entity=mon.2 client_cookie=9a94f652691dd574 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:13.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f247bfff700 1 -- 172.21.15.60:0/130958176 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f247400b9f0 con 0x7f247c0af520 2020-10-31T22:41:13.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f247bfff700 1 -- 172.21.15.60:0/130958176 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247400bb50 con 0x7f247c0af520 2020-10-31T22:41:13.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f247bfff700 1 -- 172.21.15.60:0/130958176 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f247400bcc0 con 0x7f247c0af520 2020-10-31T22:41:13.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f2482131700 1 -- 172.21.15.60:0/130958176 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f247c0af520 msgr2=0x7f247c0ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.967+0000 7f2482131700 1 --2- 172.21.15.60:0/130958176 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f247c0af520 0x7f247c0ac870 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f24740032b0 tx=0x7f24740091a0).stop 2020-10-31T22:41:13.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2482131700 1 -- 172.21.15.60:0/130958176 shutdown_connections 2020-10-31T22:41:13.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2482131700 1 --2- 172.21.15.60:0/130958176 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f247c0af520 0x7f247c0ac870 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2482131700 1 -- 172.21.15.60:0/130958176 >> 172.21.15.60:0/130958176 conn(0x7f247c0b3fd0 msgr2=0x7f247c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:13.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2482131700 1 -- 172.21.15.60:0/130958176 shutdown_connections 2020-10-31T22:41:13.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2482131700 1 -- 172.21.15.60:0/130958176 wait complete. 2020-10-31T22:41:13.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2482131700 1 Processor -- start 2020-10-31T22:41:13.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2482131700 1 -- start start 2020-10-31T22:41:13.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2482131700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f247c066c90 0x7f247c155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2482131700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f247c0670f0 0x7f247c14b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2482131700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f247c0af520 0x7f247c0aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2482131700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c155570 con 0x7f247c0af520 2020-10-31T22:41:13.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2482131700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c14bba0 con 0x7f247c0670f0 2020-10-31T22:41:13.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2482131700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f247c1557a0 con 0x7f247c066c90 2020-10-31T22:41:13.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2481930700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f247c0af520 0x7f247c0aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2481930700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f247c0af520 0x7f247c0aa930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41362/0 (socket says 172.21.15.60:41362) 2020-10-31T22:41:13.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f248112f700 1 --2- 172.21.15.60:0/2826913689 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f247c066c90 0x7f247c155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f2481930700 1 -- 172.21.15.60:0/2826913689 learned_addr learned my addr 172.21.15.60:0/2826913689 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:13.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.971+0000 7f248092e700 1 --2- 172.21.15.60:0/2826913689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f247c0670f0 0x7f247c14b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f2481930700 1 -- 172.21.15.60:0/2826913689 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f247c066c90 msgr2=0x7f247c155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f2481930700 1 --2- 172.21.15.60:0/2826913689 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f247c066c90 0x7f247c155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f2481930700 1 -- 172.21.15.60:0/2826913689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f247c0670f0 msgr2=0x7f247c14b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:13.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f2481930700 1 --2- 172.21.15.60:0/2826913689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f247c0670f0 0x7f247c14b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:13.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f2481930700 1 -- 172.21.15.60:0/2826913689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f247c0a9280 con 0x7f247c0af520 2020-10-31T22:41:13.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f2481930700 1 --2- 172.21.15.60:0/2826913689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f247c0af520 0x7f247c0aa930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f246c000b80 tx=0x7f246c007940).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:13.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f247a7fc700 1 -- 172.21.15.60:0/2826913689 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f246c00f470 con 0x7f247c0af520 2020-10-31T22:41:13.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f2482131700 1 -- 172.21.15.60:0/2826913689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247c0a9520 con 0x7f247c0af520 2020-10-31T22:41:13.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f247a7fc700 1 -- 172.21.15.60:0/2826913689 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f246c00f5d0 con 0x7f247c0af520 2020-10-31T22:41:13.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f247a7fc700 1 -- 172.21.15.60:0/2826913689 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f246c00f930 con 0x7f247c0af520 2020-10-31T22:41:13.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f2482131700 1 -- 172.21.15.60:0/2826913689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247c14d340 con 0x7f247c0af520 2020-10-31T22:41:13.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f2482131700 1 -- 172.21.15.60:0/2826913689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247c0a96b0 con 0x7f247c0af520 2020-10-31T22:41:13.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f247a7fc700 1 -- 172.21.15.60:0/2826913689 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f246c019030 con 0x7f247c0af520 2020-10-31T22:41:13.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f247a7fc700 1 --2- 172.21.15.60:0/2826913689 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f24600550c0 0x7f2460057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:13.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f247a7fc700 1 -- 172.21.15.60:0/2826913689 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f246c06ce00 con 0x7f247c0af520 2020-10-31T22:41:13.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.975+0000 7f248112f700 1 --2- 172.21.15.60:0/2826913689 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f24600550c0 0x7f2460057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:13.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.979+0000 7f248112f700 1 --2- 172.21.15.60:0/2826913689 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f24600550c0 0x7f2460057580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f247401a000 tx=0x7f2474016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:13.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:13.983+0000 7f247a7fc700 1 -- 172.21.15.60:0/2826913689 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f246c041df0 con 0x7f247c0af520 2020-10-31T22:41:14.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.127+0000 7f2482131700 1 -- 172.21.15.60:0/2826913689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f247c057100 con 0x7f247c0af520 2020-10-31T22:41:14.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.131+0000 7f247a7fc700 1 -- 172.21.15.60:0/2826913689 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f246c024ec0 con 0x7f247c0af520 2020-10-31T22:41:14.135 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:14.135 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:11.059362+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:07.982891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:08.927092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:14.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.131+0000 7f2482131700 1 -- 172.21.15.60:0/2826913689 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f24600550c0 msgr2=0x7f2460057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.131+0000 7f2482131700 1 --2- 172.21.15.60:0/2826913689 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f24600550c0 0x7f2460057580 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f247401a000 tx=0x7f2474016000).stop 2020-10-31T22:41:14.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.131+0000 7f2482131700 1 -- 172.21.15.60:0/2826913689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f247c0af520 msgr2=0x7f247c0aa930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.131+0000 7f2482131700 1 --2- 172.21.15.60:0/2826913689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f247c0af520 0x7f247c0aa930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f246c000b80 tx=0x7f246c007940).stop 2020-10-31T22:41:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.131+0000 7f2482131700 1 -- 172.21.15.60:0/2826913689 shutdown_connections 2020-10-31T22:41:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.131+0000 7f2482131700 1 --2- 172.21.15.60:0/2826913689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f247c0af520 0x7f247c0aa930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.131+0000 7f2482131700 1 --2- 172.21.15.60:0/2826913689 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f247c066c90 0x7f247c155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.131+0000 7f2482131700 1 --2- 172.21.15.60:0/2826913689 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f24600550c0 0x7f2460057580 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.131+0000 7f2482131700 1 --2- 172.21.15.60:0/2826913689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f247c0670f0 0x7f247c14b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.131+0000 7f2482131700 1 -- 172.21.15.60:0/2826913689 >> 172.21.15.60:0/2826913689 conn(0x7f247c0b3fd0 msgr2=0x7f247c149440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:14.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.131+0000 7f2482131700 1 -- 172.21.15.60:0/2826913689 shutdown_connections 2020-10-31T22:41:14.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.135+0000 7f2482131700 1 -- 172.21.15.60:0/2826913689 wait complete. 2020-10-31T22:41:14.149 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-10-31T22:41:14.230 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:41:14.234 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:41:14.237 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:41:14.240 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:41:14.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 Processor -- start 2020-10-31T22:41:14.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 -- start start 2020-10-31T22:41:14.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efea80b1b10 0x7efea80b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efea813f430 0x7efea8142a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efea81420d0 con 0x7efea80ac520 2020-10-31T22:41:14.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efea813f970 con 0x7efea80b1b10 2020-10-31T22:41:14.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea8142330 con 0x7efea813f430 2020-10-31T22:41:14.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efea80b1b10 0x7efea80b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efea80b1b10 0x7efea80b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41366/0 (socket says 172.21.15.60:41366) 2020-10-31T22:41:14.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea659c700 1 -- 172.21.15.60:0/3898507826 learned_addr learned my addr 172.21.15.60:0/3898507826 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:14.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea5d9b700 1 --2- 172.21.15.60:0/3898507826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efea813f430 0x7efea8142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea659c700 1 -- 172.21.15.60:0/3898507826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efea813f430 msgr2=0x7efea8142a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:14.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea659c700 1 --2- 172.21.15.60:0/3898507826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efea813f430 0x7efea8142a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea659c700 1 -- 172.21.15.60:0/3898507826 >> v1:172.21.15.60:6789/0 conn(0x7efea80ac520 legacy=0x7efea80a4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea659c700 1 -- 172.21.15.60:0/3898507826 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea81425d0 con 0x7efea80b1b10 2020-10-31T22:41:14.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea659c700 1 --2- 172.21.15.60:0/3898507826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea80b1b10 0x7efea80b1ef0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7efea813ea10 tx=0x7efe98006e80).ready entity=mon.0 client_cookie=96c057c98087e2ec server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea559a700 1 -- 172.21.15.60:0/3898507826 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe980097b0 con 0x7efea80b1b10 2020-10-31T22:41:14.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea559a700 1 -- 172.21.15.60:0/3898507826 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe98009910 con 0x7efea80b1b10 2020-10-31T22:41:14.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea559a700 1 -- 172.21.15.60:0/3898507826 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe98009c70 con 0x7efea80b1b10 2020-10-31T22:41:14.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 -- 172.21.15.60:0/3898507826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea80b1b10 msgr2=0x7efea80b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 --2- 172.21.15.60:0/3898507826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea80b1b10 0x7efea80b1ef0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7efea813ea10 tx=0x7efe98006e80).stop 2020-10-31T22:41:14.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 -- 172.21.15.60:0/3898507826 shutdown_connections 2020-10-31T22:41:14.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 --2- 172.21.15.60:0/3898507826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea80b1b10 0x7efea80b1ef0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 --2- 172.21.15.60:0/3898507826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efea813f430 0x7efea8142a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 -- 172.21.15.60:0/3898507826 >> 172.21.15.60:0/3898507826 conn(0x7efea8060de0 msgr2=0x7efea8062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:14.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 -- 172.21.15.60:0/3898507826 shutdown_connections 2020-10-31T22:41:14.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.263+0000 7efea759e700 1 -- 172.21.15.60:0/3898507826 wait complete. 2020-10-31T22:41:14.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea759e700 1 Processor -- start 2020-10-31T22:41:14.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea759e700 1 -- start start 2020-10-31T22:41:14.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea80ac520 0x7efea8141030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efea80b1b10 0x7efea8153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efea813f430 0x7efea8154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea8154910 con 0x7efea80ac520 2020-10-31T22:41:14.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efea80b5de0 con 0x7efea80b1b10 2020-10-31T22:41:14.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efea80b4b30 con 0x7efea813f430 2020-10-31T22:41:14.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea80ac520 0x7efea8141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea80ac520 0x7efea8141030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41372/0 (socket says 172.21.15.60:41372) 2020-10-31T22:41:14.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea659c700 1 -- 172.21.15.60:0/3494604623 learned_addr learned my addr 172.21.15.60:0/3494604623 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:14.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea6d9d700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efea813f430 0x7efea8154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea5d9b700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efea80b1b10 0x7efea8153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea659c700 1 -- 172.21.15.60:0/3494604623 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efea813f430 msgr2=0x7efea8154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea659c700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efea813f430 0x7efea8154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea659c700 1 -- 172.21.15.60:0/3494604623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efea80b1b10 msgr2=0x7efea8153f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea659c700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efea80b1b10 0x7efea8153f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea659c700 1 -- 172.21.15.60:0/3494604623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efea80b4dd0 con 0x7efea80ac520 2020-10-31T22:41:14.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea5d9b700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efea80b1b10 0x7efea8153f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:41:14.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea659c700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea80ac520 0x7efea8141030 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7efea8154a50 tx=0x7efe98015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efe9f7fe700 1 -- 172.21.15.60:0/3494604623 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe98011ca0 con 0x7efea80ac520 2020-10-31T22:41:14.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efe9f7fe700 1 -- 172.21.15.60:0/3494604623 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe98011e00 con 0x7efea80ac520 2020-10-31T22:41:14.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea759e700 1 -- 172.21.15.60:0/3494604623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efea80b5070 con 0x7efea80ac520 2020-10-31T22:41:14.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efe9f7fe700 1 -- 172.21.15.60:0/3494604623 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe9801e650 con 0x7efea80ac520 2020-10-31T22:41:14.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea759e700 1 -- 172.21.15.60:0/3494604623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efea81419c0 con 0x7efea80ac520 2020-10-31T22:41:14.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.267+0000 7efea759e700 1 -- 172.21.15.60:0/3494604623 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efea80b56b0 con 0x7efea80ac520 2020-10-31T22:41:14.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.271+0000 7efe9f7fe700 1 -- 172.21.15.60:0/3494604623 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7efe98025030 con 0x7efea80ac520 2020-10-31T22:41:14.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.271+0000 7efe9f7fe700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe8c054f90 0x7efe8c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.271+0000 7efe9f7fe700 1 -- 172.21.15.60:0/3494604623 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efe9806f6a0 con 0x7efea80ac520 2020-10-31T22:41:14.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.271+0000 7efea5d9b700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe8c054f90 0x7efe8c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.271+0000 7efe9f7fe700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.60:6802/14302,v1:172.21.15.60:6803/14302] conn(0x7efe8c05c410 0x7efe8c05e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.271+0000 7efe9f7fe700 1 -- 172.21.15.60:0/3494604623 --> [v2:172.21.15.60:6802/14302,v1:172.21.15.60:6803/14302] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe8c05ee80 con 0x7efe8c05c410 2020-10-31T22:41:14.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.271+0000 7efe9f7fe700 1 -- 172.21.15.60:0/3494604623 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe9806f970 con 0x7efea80ac520 2020-10-31T22:41:14.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.271+0000 7efea6d9d700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.60:6802/14302,v1:172.21.15.60:6803/14302] conn(0x7efe8c05c410 0x7efe8c05e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.271+0000 7efea5d9b700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe8c054f90 0x7efe8c057450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7efe90008000 tx=0x7efe90008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.271+0000 7efea6d9d700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.60:6802/14302,v1:172.21.15.60:6803/14302] conn(0x7efe8c05c410 0x7efe8c05e830 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.271+0000 7efe9f7fe700 1 -- 172.21.15.60:0/3494604623 <== osd.0 v2:172.21.15.60:6802/14302 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7efe8c05ee80 con 0x7efe8c05c410 2020-10-31T22:41:14.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.291+0000 7efea759e700 1 -- 172.21.15.60:0/3494604623 --> [v2:172.21.15.60:6802/14302,v1:172.21.15.60:6803/14302] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efea80b5c00 con 0x7efe8c05c410 2020-10-31T22:41:14.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.291+0000 7efe9f7fe700 1 -- 172.21.15.60:0/3494604623 <== osd.0 v2:172.21.15.60:6802/14302 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efea80b5c00 con 0x7efe8c05c410 2020-10-31T22:41:14.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.291+0000 7efea759e700 1 -- 172.21.15.60:0/3494604623 >> [v2:172.21.15.60:6802/14302,v1:172.21.15.60:6803/14302] conn(0x7efe8c05c410 msgr2=0x7efe8c05e830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.291+0000 7efea759e700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.60:6802/14302,v1:172.21.15.60:6803/14302] conn(0x7efe8c05c410 0x7efe8c05e830 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.291+0000 7efea759e700 1 -- 172.21.15.60:0/3494604623 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe8c054f90 msgr2=0x7efe8c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.291+0000 7efea759e700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe8c054f90 0x7efe8c057450 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7efe90008000 tx=0x7efe90008040).stop 2020-10-31T22:41:14.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.291+0000 7efea759e700 1 -- 172.21.15.60:0/3494604623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea80ac520 msgr2=0x7efea8141030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.291+0000 7efea759e700 1 --2- 172.21.15.60:0/3494604623 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efea80ac520 0x7efea8141030 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7efea8154a50 tx=0x7efe98015000).stop 2020-10-31T22:41:14.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.295+0000 7efea6d9d700 1 -- 172.21.15.60:0/3494604623 reap_dead start 2020-10-31T22:41:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.295+0000 7efea759e700 1 -- 172.21.15.60:0/3494604623 shutdown_connections 2020-10-31T22:41:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.295+0000 7efea759e700 1 -- 172.21.15.60:0/3494604623 >> 172.21.15.60:0/3494604623 conn(0x7efea8060de0 msgr2=0x7efea80b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.295+0000 7efea759e700 1 -- 172.21.15.60:0/3494604623 shutdown_connections 2020-10-31T22:41:14.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.295+0000 7efea759e700 1 -- 172.21.15.60:0/3494604623 wait complete. 2020-10-31T22:41:14.313 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2020-10-31T22:41:14.314 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-10-31T22:41:14.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 Processor -- start 2020-10-31T22:41:14.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 -- start start 2020-10-31T22:41:14.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f68980b1a10 0x7f6898142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f689813ebe0 0x7f68980b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68980abea0 con 0x7f68980af200 2020-10-31T22:41:14.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6898141870 con 0x7f68980b1a10 2020-10-31T22:41:14.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6898141b10 con 0x7f689813ebe0 2020-10-31T22:41:14.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689d5ee700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f68980b1a10 0x7f6898142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689d5ee700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f68980b1a10 0x7f6898142250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41382/0 (socket says 172.21.15.60:41382) 2020-10-31T22:41:14.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689d5ee700 1 -- 172.21.15.60:0/3432089908 learned_addr learned my addr 172.21.15.60:0/3432089908 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:14.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689cded700 1 --2- 172.21.15.60:0/3432089908 >> v2:172.21.15.66:3300/0 conn(0x7f689813ebe0 0x7f68980b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689d5ee700 1 -- 172.21.15.60:0/3432089908 >> v2:172.21.15.66:3300/0 conn(0x7f689813ebe0 msgr2=0x7f68980b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:14.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689d5ee700 1 --2- 172.21.15.60:0/3432089908 >> v2:172.21.15.66:3300/0 conn(0x7f689813ebe0 0x7f68980b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689d5ee700 1 -- 172.21.15.60:0/3432089908 >> v1:172.21.15.66:6789/0 conn(0x7f68980af200 legacy=0x7f68980afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689d5ee700 1 -- 172.21.15.60:0/3432089908 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6898141db0 con 0x7f68980b1a10 2020-10-31T22:41:14.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689cded700 1 --2- 172.21.15.60:0/3432089908 >> v2:172.21.15.66:3300/0 conn(0x7f689813ebe0 0x7f68980b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:14.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689d5ee700 1 --2- 172.21.15.60:0/3432089908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68980b1a10 0x7f6898142250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f68880032b0 tx=0x7f6888009270).ready entity=mon.0 client_cookie=8ca6eb8492c73d9e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f6897fff700 1 -- 172.21.15.60:0/3432089908 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688800bc00 con 0x7f68980b1a10 2020-10-31T22:41:14.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f6897fff700 1 -- 172.21.15.60:0/3432089908 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688800bd60 con 0x7f68980b1a10 2020-10-31T22:41:14.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f6897fff700 1 -- 172.21.15.60:0/3432089908 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6888011400 con 0x7f68980b1a10 2020-10-31T22:41:14.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 -- 172.21.15.60:0/3432089908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68980b1a10 msgr2=0x7f6898142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 --2- 172.21.15.60:0/3432089908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68980b1a10 0x7f6898142250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f68880032b0 tx=0x7f6888009270).stop 2020-10-31T22:41:14.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 -- 172.21.15.60:0/3432089908 shutdown_connections 2020-10-31T22:41:14.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 --2- 172.21.15.60:0/3432089908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68980b1a10 0x7f6898142250 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 --2- 172.21.15.60:0/3432089908 >> v2:172.21.15.66:3300/0 conn(0x7f689813ebe0 0x7f68980b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 -- 172.21.15.60:0/3432089908 >> 172.21.15.60:0/3432089908 conn(0x7f68980b5300 msgr2=0x7f68980b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:14.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 -- 172.21.15.60:0/3432089908 shutdown_connections 2020-10-31T22:41:14.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.479+0000 7f689e5f0700 1 -- 172.21.15.60:0/3432089908 wait complete. 2020-10-31T22:41:14.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689e5f0700 1 Processor -- start 2020-10-31T22:41:14.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689e5f0700 1 -- start start 2020-10-31T22:41:14.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689e5f0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68980af200 0x7f68980adf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689e5f0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68980b1a10 0x7f6898063190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689e5f0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f689813ebe0 0x7f6898063680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689e5f0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6898065e80 con 0x7f68980af200 2020-10-31T22:41:14.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689e5f0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6898066910 con 0x7f689813ebe0 2020-10-31T22:41:14.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689e5f0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68980660d0 con 0x7f68980b1a10 2020-10-31T22:41:14.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689d5ee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68980af200 0x7f68980adf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689d5ee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68980af200 0x7f68980adf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41390/0 (socket says 172.21.15.60:41390) 2020-10-31T22:41:14.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689d5ee700 1 -- 172.21.15.60:0/3681303787 learned_addr learned my addr 172.21.15.60:0/3681303787 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:14.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689cded700 1 --2- 172.21.15.60:0/3681303787 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68980b1a10 0x7f6898063190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689ddef700 1 --2- 172.21.15.60:0/3681303787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f689813ebe0 0x7f6898063680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689d5ee700 1 -- 172.21.15.60:0/3681303787 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68980b1a10 msgr2=0x7f6898063190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689d5ee700 1 --2- 172.21.15.60:0/3681303787 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f68980b1a10 0x7f6898063190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689d5ee700 1 -- 172.21.15.60:0/3681303787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f689813ebe0 msgr2=0x7f6898063680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689d5ee700 1 --2- 172.21.15.60:0/3681303787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f689813ebe0 0x7f6898063680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689d5ee700 1 -- 172.21.15.60:0/3681303787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6898066390 con 0x7f68980af200 2020-10-31T22:41:14.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689d5ee700 1 --2- 172.21.15.60:0/3681303787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68980af200 0x7f68980adf80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f68880032b0 tx=0x7f6888016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f68967fc700 1 -- 172.21.15.60:0/3681303787 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688801f670 con 0x7f68980af200 2020-10-31T22:41:14.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f68967fc700 1 -- 172.21.15.60:0/3681303787 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688801f7d0 con 0x7f68980af200 2020-10-31T22:41:14.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f68967fc700 1 -- 172.21.15.60:0/3681303787 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688801fb30 con 0x7f68980af200 2020-10-31T22:41:14.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689e5f0700 1 -- 172.21.15.60:0/3681303787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6898066630 con 0x7f68980af200 2020-10-31T22:41:14.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.483+0000 7f689e5f0700 1 -- 172.21.15.60:0/3681303787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68980ae5f0 con 0x7f68980af200 2020-10-31T22:41:14.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.487+0000 7f689e5f0700 1 -- 172.21.15.60:0/3681303787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6898057100 con 0x7f68980af200 2020-10-31T22:41:14.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.487+0000 7f68967fc700 1 -- 172.21.15.60:0/3681303787 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f688800f070 con 0x7f68980af200 2020-10-31T22:41:14.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.487+0000 7f68967fc700 1 --2- 172.21.15.60:0/3681303787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f687c054f10 0x7f687c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.487+0000 7f68967fc700 1 -- 172.21.15.60:0/3681303787 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f688806ec80 con 0x7f68980af200 2020-10-31T22:41:14.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.487+0000 7f689cded700 1 --2- 172.21.15.60:0/3681303787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f687c054f10 0x7f687c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.487+0000 7f68967fc700 1 --2- 172.21.15.60:0/3681303787 >> [v2:172.21.15.60:6810/14300,v1:172.21.15.60:6811/14300] conn(0x7f687c05c390 0x7f687c05e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.487+0000 7f68967fc700 1 -- 172.21.15.60:0/3681303787 --> [v2:172.21.15.60:6810/14300,v1:172.21.15.60:6811/14300] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f687c05ee00 con 0x7f687c05c390 2020-10-31T22:41:14.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.487+0000 7f68967fc700 1 -- 172.21.15.60:0/3681303787 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6888073220 con 0x7f68980af200 2020-10-31T22:41:14.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.487+0000 7f689ddef700 1 --2- 172.21.15.60:0/3681303787 >> [v2:172.21.15.60:6810/14300,v1:172.21.15.60:6811/14300] conn(0x7f687c05c390 0x7f687c05e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.487+0000 7f689cded700 1 --2- 172.21.15.60:0/3681303787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f687c054f10 0x7f687c0573d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f688000c000 tx=0x7f6880008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.487+0000 7f689ddef700 1 --2- 172.21.15.60:0/3681303787 >> [v2:172.21.15.60:6810/14300,v1:172.21.15.60:6811/14300] conn(0x7f687c05c390 0x7f687c05e7b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.491+0000 7f68967fc700 1 -- 172.21.15.60:0/3681303787 <== osd.1 v2:172.21.15.60:6810/14300 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7f687c05ee00 con 0x7f687c05c390 2020-10-31T22:41:14.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.511+0000 7f689e5f0700 1 -- 172.21.15.60:0/3681303787 --> [v2:172.21.15.60:6810/14300,v1:172.21.15.60:6811/14300] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f68980ab5c0 con 0x7f687c05c390 2020-10-31T22:41:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.511+0000 7f68967fc700 1 -- 172.21.15.60:0/3681303787 <== osd.1 v2:172.21.15.60:6810/14300 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f68980ab5c0 con 0x7f687c05c390 2020-10-31T22:41:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.511+0000 7f689e5f0700 1 -- 172.21.15.60:0/3681303787 >> [v2:172.21.15.60:6810/14300,v1:172.21.15.60:6811/14300] conn(0x7f687c05c390 msgr2=0x7f687c05e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.511+0000 7f689e5f0700 1 --2- 172.21.15.60:0/3681303787 >> [v2:172.21.15.60:6810/14300,v1:172.21.15.60:6811/14300] conn(0x7f687c05c390 0x7f687c05e7b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.511+0000 7f689e5f0700 1 -- 172.21.15.60:0/3681303787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f687c054f10 msgr2=0x7f687c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.511+0000 7f689e5f0700 1 --2- 172.21.15.60:0/3681303787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f687c054f10 0x7f687c0573d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f688000c000 tx=0x7f6880008040).stop 2020-10-31T22:41:14.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.511+0000 7f689e5f0700 1 -- 172.21.15.60:0/3681303787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68980af200 msgr2=0x7f68980adf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.511+0000 7f689e5f0700 1 --2- 172.21.15.60:0/3681303787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f68980af200 0x7f68980adf80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f68880032b0 tx=0x7f6888016000).stop 2020-10-31T22:41:14.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.511+0000 7f689ddef700 1 -- 172.21.15.60:0/3681303787 reap_dead start 2020-10-31T22:41:14.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.511+0000 7f689e5f0700 1 -- 172.21.15.60:0/3681303787 shutdown_connections 2020-10-31T22:41:14.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.511+0000 7f689e5f0700 1 -- 172.21.15.60:0/3681303787 >> 172.21.15.60:0/3681303787 conn(0x7f68980b5300 msgr2=0x7f68980b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:14.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.511+0000 7f689e5f0700 1 -- 172.21.15.60:0/3681303787 shutdown_connections 2020-10-31T22:41:14.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.511+0000 7f689e5f0700 1 -- 172.21.15.60:0/3681303787 wait complete. 2020-10-31T22:41:14.526 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2020-10-31T22:41:14.527 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-10-31T22:41:14.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.643+0000 7f330b1f1700 1 Processor -- start 2020-10-31T22:41:14.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.643+0000 7f330b1f1700 1 -- start start 2020-10-31T22:41:14.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330b1f1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33040b0e20 0x7f33040ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330b1f1700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33040acc50 con 0x7f33040ac870 2020-10-31T22:41:14.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330b1f1700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33040b5690 con 0x7f33040b5060 2020-10-31T22:41:14.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330b1f1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33040b54b0 con 0x7f33040b0e20 2020-10-31T22:41:14.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330a1ef700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f33040ac870 0x7f33040ae1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45534/0 (socket says 172.21.15.60:45534) 2020-10-31T22:41:14.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330a1ef700 1 -- 172.21.15.60:0/877673738 learned_addr learned my addr 172.21.15.60:0/877673738 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33099ee700 1 --2- 172.21.15.60:0/877673738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33040b0e20 0x7f33040ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572576814 0 0) 0x7f33040acc50 con 0x7f33040ac870 2020-10-31T22:41:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e8003230 con 0x7f33040ac870 2020-10-31T22:41:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3317228056 0 0) 0x7f33040b5690 con 0x7f33040b5060 2020-10-31T22:41:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33040acc50 con 0x7f33040b5060 2020-10-31T22:41:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3497077580 0 0) 0x7f32e8003230 con 0x7f33040ac870 2020-10-31T22:41:14.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33040b0e20 msgr2=0x7f33040ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:14.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 --2- 172.21.15.60:0/877673738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33040b0e20 0x7f33040ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 >> v1:172.21.15.66:6789/0 conn(0x7f33040b5060 legacy=0x7f33041412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33040afc10 con 0x7f33040ac870 2020-10-31T22:41:14.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f32f8001a50 con 0x7f33040ac870 2020-10-31T22:41:14.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 >> v1:172.21.15.60:6789/0 conn(0x7f33040ac870 legacy=0x7f33040ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 --2- 172.21.15.60:0/877673738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32e80038e0 0x7f32e8003cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 --2- 172.21.15.60:0/877673738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33040b0e20 0x7f32e80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 --2- 172.21.15.60:0/877673738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e80049c0 0x7f32e8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33040b54b0 con 0x7f32e80049c0 2020-10-31T22:41:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32e8005330 con 0x7f32e80038e0 2020-10-31T22:41:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32e800b750 con 0x7f33040b0e20 2020-10-31T22:41:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330a9f0700 1 --2- 172.21.15.60:0/877673738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e80049c0 0x7f32e8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33099ee700 1 --2- 172.21.15.60:0/877673738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33040b0e20 0x7f32e80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330a1ef700 1 --2- 172.21.15.60:0/877673738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32e80038e0 0x7f32e8003cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330a9f0700 1 -- 172.21.15.60:0/877673738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33040b0e20 msgr2=0x7f32e80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:14.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330a9f0700 1 --2- 172.21.15.60:0/877673738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33040b0e20 0x7f32e80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330a9f0700 1 -- 172.21.15.60:0/877673738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32e80038e0 msgr2=0x7f32e8003cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:14.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330a9f0700 1 --2- 172.21.15.60:0/877673738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32e80038e0 0x7f32e8003cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330a9f0700 1 -- 172.21.15.60:0/877673738 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e8003230 con 0x7f32e80049c0 2020-10-31T22:41:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330a9f0700 1 --2- 172.21.15.60:0/877673738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e80049c0 0x7f32e8004e40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f32fc001110 tx=0x7f32fc007b60).ready entity=mon.0 client_cookie=f3519c7018a85418 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32fc00c810 con 0x7f32e80049c0 2020-10-31T22:41:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc00c970 con 0x7f32e80049c0 2020-10-31T22:41:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f33091ed700 1 -- 172.21.15.60:0/877673738 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32fc00ccd0 con 0x7f32e80049c0 2020-10-31T22:41:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330b1f1700 1 -- 172.21.15.60:0/877673738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e80049c0 msgr2=0x7f32e8004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330b1f1700 1 --2- 172.21.15.60:0/877673738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32e80049c0 0x7f32e8004e40 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f32fc001110 tx=0x7f32fc007b60).stop 2020-10-31T22:41:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.647+0000 7f330a9f0700 1 -- 172.21.15.60:0/877673738 reap_dead start 2020-10-31T22:41:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330b1f1700 1 -- 172.21.15.60:0/877673738 shutdown_connections 2020-10-31T22:41:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330b1f1700 1 -- 172.21.15.60:0/877673738 >> 172.21.15.60:0/877673738 conn(0x7f330406a600 msgr2=0x7f3304060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330b1f1700 1 -- 172.21.15.60:0/877673738 shutdown_connections 2020-10-31T22:41:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330b1f1700 1 -- 172.21.15.60:0/877673738 wait complete. 2020-10-31T22:41:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330b1f1700 1 Processor -- start 2020-10-31T22:41:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330b1f1700 1 -- start start 2020-10-31T22:41:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330b1f1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f330405b320 0x7f330414eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330b1f1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3304065110 0x7f330414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330b1f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f330413f2c0 0x7f330413f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330b1f1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330414f8d0 con 0x7f330413f2c0 2020-10-31T22:41:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330b1f1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330405b700 con 0x7f330405b320 2020-10-31T22:41:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330b1f1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330414ea90 con 0x7f3304065110 2020-10-31T22:41:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330a9f0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f330413f2c0 0x7f330413f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330a9f0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f330413f2c0 0x7f330413f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41414/0 (socket says 172.21.15.60:41414) 2020-10-31T22:41:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330a9f0700 1 -- 172.21.15.60:0/2254808969 learned_addr learned my addr 172.21.15.60:0/2254808969 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f33099ee700 1 --2- 172.21.15.60:0/2254808969 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3304065110 0x7f330414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330a1ef700 1 --2- 172.21.15.60:0/2254808969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f330405b320 0x7f330414eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330a9f0700 1 -- 172.21.15.60:0/2254808969 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3304065110 msgr2=0x7f330414f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330a9f0700 1 --2- 172.21.15.60:0/2254808969 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3304065110 0x7f330414f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330a9f0700 1 -- 172.21.15.60:0/2254808969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f330405b320 msgr2=0x7f330414eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330a9f0700 1 --2- 172.21.15.60:0/2254808969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f330405b320 0x7f330414eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330a9f0700 1 -- 172.21.15.60:0/2254808969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3304065ef0 con 0x7f330413f2c0 2020-10-31T22:41:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330a9f0700 1 --2- 172.21.15.60:0/2254808969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f330413f2c0 0x7f330413f770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f33040b0230 tx=0x7f32fc017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f33037fe700 1 -- 172.21.15.60:0/2254808969 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32fc001ea0 con 0x7f330413f2c0 2020-10-31T22:41:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f33037fe700 1 -- 172.21.15.60:0/2254808969 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32fc007430 con 0x7f330413f2c0 2020-10-31T22:41:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330b1f1700 1 -- 172.21.15.60:0/2254808969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33040659b0 con 0x7f330413f2c0 2020-10-31T22:41:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f33037fe700 1 -- 172.21.15.60:0/2254808969 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32fc012b50 con 0x7f330413f2c0 2020-10-31T22:41:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.651+0000 7f330b1f1700 1 -- 172.21.15.60:0/2254808969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330409f900 con 0x7f330413f2c0 2020-10-31T22:41:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.655+0000 7f330b1f1700 1 -- 172.21.15.60:0/2254808969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f330414e910 con 0x7f330413f2c0 2020-10-31T22:41:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.655+0000 7f33037fe700 1 -- 172.21.15.60:0/2254808969 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f32fc010070 con 0x7f330413f2c0 2020-10-31T22:41:14.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.655+0000 7f33037fe700 1 --2- 172.21.15.60:0/2254808969 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f32ec055020 0x7f32ec0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.655+0000 7f33037fe700 1 -- 172.21.15.60:0/2254808969 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f32fc06df50 con 0x7f330413f2c0 2020-10-31T22:41:14.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.655+0000 7f330a1ef700 1 --2- 172.21.15.60:0/2254808969 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f32ec055020 0x7f32ec0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.655+0000 7f33037fe700 1 --2- 172.21.15.60:0/2254808969 >> [v2:172.21.15.60:6826/14318,v1:172.21.15.60:6827/14318] conn(0x7f32ec05c4a0 0x7f32ec05e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.655+0000 7f33037fe700 1 -- 172.21.15.60:0/2254808969 --> [v2:172.21.15.60:6826/14318,v1:172.21.15.60:6827/14318] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f32ec05ef10 con 0x7f32ec05c4a0 2020-10-31T22:41:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.655+0000 7f33037fe700 1 -- 172.21.15.60:0/2254808969 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32fc070580 con 0x7f330413f2c0 2020-10-31T22:41:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.655+0000 7f330a1ef700 1 --2- 172.21.15.60:0/2254808969 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f32ec055020 0x7f32ec0574e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f32f800c000 tx=0x7f32f8008e30).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.659+0000 7f33099ee700 1 --2- 172.21.15.60:0/2254808969 >> [v2:172.21.15.60:6826/14318,v1:172.21.15.60:6827/14318] conn(0x7f32ec05c4a0 0x7f32ec05e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.659+0000 7f33099ee700 1 --2- 172.21.15.60:0/2254808969 >> [v2:172.21.15.60:6826/14318,v1:172.21.15.60:6827/14318] conn(0x7f32ec05c4a0 0x7f32ec05e8c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.659+0000 7f33037fe700 1 -- 172.21.15.60:0/2254808969 <== osd.2 v2:172.21.15.60:6826/14318 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7f32ec05ef10 con 0x7f32ec05c4a0 2020-10-31T22:41:14.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.683+0000 7f330b1f1700 1 -- 172.21.15.60:0/2254808969 --> [v2:172.21.15.60:6826/14318,v1:172.21.15.60:6827/14318] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f330414ec00 con 0x7f32ec05c4a0 2020-10-31T22:41:14.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.683+0000 7f33037fe700 1 -- 172.21.15.60:0/2254808969 <== osd.2 v2:172.21.15.60:6826/14318 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f330414ec00 con 0x7f32ec05c4a0 2020-10-31T22:41:14.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.683+0000 7f330b1f1700 1 -- 172.21.15.60:0/2254808969 >> [v2:172.21.15.60:6826/14318,v1:172.21.15.60:6827/14318] conn(0x7f32ec05c4a0 msgr2=0x7f32ec05e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.683+0000 7f330b1f1700 1 --2- 172.21.15.60:0/2254808969 >> [v2:172.21.15.60:6826/14318,v1:172.21.15.60:6827/14318] conn(0x7f32ec05c4a0 0x7f32ec05e8c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.683+0000 7f330b1f1700 1 -- 172.21.15.60:0/2254808969 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f32ec055020 msgr2=0x7f32ec0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.683+0000 7f330b1f1700 1 --2- 172.21.15.60:0/2254808969 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f32ec055020 0x7f32ec0574e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f32f800c000 tx=0x7f32f8008e30).stop 2020-10-31T22:41:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.687+0000 7f330b1f1700 1 -- 172.21.15.60:0/2254808969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f330413f2c0 msgr2=0x7f330413f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.687+0000 7f330b1f1700 1 --2- 172.21.15.60:0/2254808969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f330413f2c0 0x7f330413f770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f33040b0230 tx=0x7f32fc017000).stop 2020-10-31T22:41:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.687+0000 7f330a9f0700 1 -- 172.21.15.60:0/2254808969 reap_dead start 2020-10-31T22:41:14.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.687+0000 7f330b1f1700 1 -- 172.21.15.60:0/2254808969 shutdown_connections 2020-10-31T22:41:14.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.687+0000 7f330b1f1700 1 -- 172.21.15.60:0/2254808969 >> 172.21.15.60:0/2254808969 conn(0x7f330406a600 msgr2=0x7f33040b4850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:14.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.687+0000 7f330b1f1700 1 -- 172.21.15.60:0/2254808969 shutdown_connections 2020-10-31T22:41:14.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.687+0000 7f330b1f1700 1 -- 172.21.15.60:0/2254808969 wait complete. 2020-10-31T22:41:14.713 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2020-10-31T22:41:14.714 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-10-31T22:41:14.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa665673700 1 Processor -- start 2020-10-31T22:41:14.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa665673700 1 -- start start 2020-10-31T22:41:14.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa665673700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6600ae750 0x7fa66013b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa665673700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa6600b0880 0x7fa66013beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa665673700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6600afbe0 con 0x7fa660062e10 2020-10-31T22:41:14.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa665673700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6600631f0 con 0x7fa6600b0880 2020-10-31T22:41:14.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa665673700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600afe10 con 0x7fa6600ae750 2020-10-31T22:41:14.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa65e7fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6600ae750 0x7fa66013b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa65f7fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa6600b0880 0x7fa66013beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa65effd700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa660062e10 0x7fa6600b0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:43424/0 (socket says 172.21.15.60:43424) 2020-10-31T22:41:14.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa65effd700 1 -- 172.21.15.60:0/1460434344 learned_addr learned my addr 172.21.15.60:0/1460434344 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:14.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa65f7fe700 1 -- 172.21.15.60:0/1460434344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6600ae750 msgr2=0x7fa66013b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:14.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa65f7fe700 1 --2- 172.21.15.60:0/1460434344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6600ae750 0x7fa66013b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa65f7fe700 1 -- 172.21.15.60:0/1460434344 >> v1:172.21.15.66:6789/0 conn(0x7fa660062e10 legacy=0x7fa6600b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa65f7fe700 1 -- 172.21.15.60:0/1460434344 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600ae010 con 0x7fa6600b0880 2020-10-31T22:41:14.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa65e7fc700 1 --2- 172.21.15.60:0/1460434344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6600ae750 0x7fa66013b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:14.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa65f7fe700 1 --2- 172.21.15.60:0/1460434344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6600b0880 0x7fa66013beb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa6580032b0 tx=0x7fa6580091a0).ready entity=mon.1 client_cookie=52a7a053ab81b65 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa65dffb700 1 -- 172.21.15.60:0/1460434344 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa65800b9a0 con 0x7fa6600b0880 2020-10-31T22:41:14.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa65dffb700 1 -- 172.21.15.60:0/1460434344 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65800bb00 con 0x7fa6600b0880 2020-10-31T22:41:14.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa65dffb700 1 -- 172.21.15.60:0/1460434344 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa65800bc70 con 0x7fa6600b0880 2020-10-31T22:41:14.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa665673700 1 -- 172.21.15.60:0/1460434344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6600b0880 msgr2=0x7fa66013beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.839+0000 7fa665673700 1 --2- 172.21.15.60:0/1460434344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6600b0880 0x7fa66013beb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fa6580032b0 tx=0x7fa6580091a0).stop 2020-10-31T22:41:14.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.843+0000 7fa665673700 1 -- 172.21.15.60:0/1460434344 shutdown_connections 2020-10-31T22:41:14.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.843+0000 7fa665673700 1 --2- 172.21.15.60:0/1460434344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6600b0880 0x7fa66013beb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.843+0000 7fa665673700 1 --2- 172.21.15.60:0/1460434344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6600ae750 0x7fa66013b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.843+0000 7fa665673700 1 -- 172.21.15.60:0/1460434344 >> 172.21.15.60:0/1460434344 conn(0x7fa66005fae0 msgr2=0x7fa66005fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:14.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.843+0000 7fa665673700 1 -- 172.21.15.60:0/1460434344 shutdown_connections 2020-10-31T22:41:14.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.843+0000 7fa665673700 1 -- 172.21.15.60:0/1460434344 wait complete. 2020-10-31T22:41:14.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.843+0000 7fa665673700 1 Processor -- start 2020-10-31T22:41:14.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.843+0000 7fa665673700 1 -- start start 2020-10-31T22:41:14.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa665673700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa660062e10 0x7fa66013af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa665673700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6600ae750 0x7fa66013df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa665673700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6600b0880 0x7fa66013e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa665673700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66013e950 con 0x7fa660062e10 2020-10-31T22:41:14.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa665673700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6600b2e40 con 0x7fa6600b0880 2020-10-31T22:41:14.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa665673700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66013ce00 con 0x7fa6600ae750 2020-10-31T22:41:14.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa65effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa660062e10 0x7fa66013af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa65effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa660062e10 0x7fa66013af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41426/0 (socket says 172.21.15.60:41426) 2020-10-31T22:41:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa65effd700 1 -- 172.21.15.60:0/2459648218 learned_addr learned my addr 172.21.15.60:0/2459648218 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa65e7fc700 1 --2- 172.21.15.60:0/2459648218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6600ae750 0x7fa66013df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa65f7fe700 1 --2- 172.21.15.60:0/2459648218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6600b0880 0x7fa66013e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa65e7fc700 1 -- 172.21.15.60:0/2459648218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6600b0880 msgr2=0x7fa66013e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa65e7fc700 1 --2- 172.21.15.60:0/2459648218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6600b0880 0x7fa66013e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa65e7fc700 1 -- 172.21.15.60:0/2459648218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa660062e10 msgr2=0x7fa66013af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa65e7fc700 1 --2- 172.21.15.60:0/2459648218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa660062e10 0x7fa66013af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa65e7fc700 1 -- 172.21.15.60:0/2459648218 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6600b3310 con 0x7fa6600ae750 2020-10-31T22:41:14.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa65e7fc700 1 --2- 172.21.15.60:0/2459648218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6600ae750 0x7fa66013df70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fa66013ea90 tx=0x7fa654006dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa64ffff700 1 -- 172.21.15.60:0/2459648218 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa65400cae0 con 0x7fa6600ae750 2020-10-31T22:41:14.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa64ffff700 1 -- 172.21.15.60:0/2459648218 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa65400cc40 con 0x7fa6600ae750 2020-10-31T22:41:14.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa665673700 1 -- 172.21.15.60:0/2459648218 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa660135f40 con 0x7fa6600ae750 2020-10-31T22:41:14.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa64ffff700 1 -- 172.21.15.60:0/2459648218 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6540123f0 con 0x7fa6600ae750 2020-10-31T22:41:14.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa665673700 1 -- 172.21.15.60:0/2459648218 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66013cb60 con 0x7fa6600ae750 2020-10-31T22:41:14.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa665673700 1 -- 172.21.15.60:0/2459648218 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa66013ffc0 con 0x7fa6600ae750 2020-10-31T22:41:14.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.847+0000 7fa64ffff700 1 -- 172.21.15.60:0/2459648218 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa654033730 con 0x7fa6600ae750 2020-10-31T22:41:14.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.851+0000 7fa64ffff700 1 --2- 172.21.15.60:0/2459648218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa63c054fd0 0x7fa63c057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.851+0000 7fa64ffff700 1 -- 172.21.15.60:0/2459648218 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa65406e100 con 0x7fa6600ae750 2020-10-31T22:41:14.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.851+0000 7fa65effd700 1 --2- 172.21.15.60:0/2459648218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa63c054fd0 0x7fa63c057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.851+0000 7fa64ffff700 1 --2- 172.21.15.60:0/2459648218 >> [v2:172.21.15.60:6818/14301,v1:172.21.15.60:6819/14301] conn(0x7fa63c05c3d0 0x7fa63c05e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:14.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.851+0000 7fa64ffff700 1 -- 172.21.15.60:0/2459648218 --> [v2:172.21.15.60:6818/14301,v1:172.21.15.60:6819/14301] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa63c05ee40 con 0x7fa63c05c3d0 2020-10-31T22:41:14.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.851+0000 7fa64ffff700 1 -- 172.21.15.60:0/2459648218 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa65406e4c0 con 0x7fa6600ae750 2020-10-31T22:41:14.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.851+0000 7fa65f7fe700 1 --2- 172.21.15.60:0/2459648218 >> [v2:172.21.15.60:6818/14301,v1:172.21.15.60:6819/14301] conn(0x7fa63c05c3d0 0x7fa63c05e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:14.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.851+0000 7fa65effd700 1 --2- 172.21.15.60:0/2459648218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa63c054fd0 0x7fa63c057490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa65000d000 tx=0x7fa650009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.851+0000 7fa65f7fe700 1 --2- 172.21.15.60:0/2459648218 >> [v2:172.21.15.60:6818/14301,v1:172.21.15.60:6819/14301] conn(0x7fa63c05c3d0 0x7fa63c05e7f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:14.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.851+0000 7fa64ffff700 1 -- 172.21.15.60:0/2459648218 <== osd.3 v2:172.21.15.60:6818/14301 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7fa63c05ee40 con 0x7fa63c05c3d0 2020-10-31T22:41:14.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.875+0000 7fa665673700 1 -- 172.21.15.60:0/2459648218 --> [v2:172.21.15.60:6818/14301,v1:172.21.15.60:6819/14301] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa66013d7c0 con 0x7fa63c05c3d0 2020-10-31T22:41:14.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.875+0000 7fa64ffff700 1 -- 172.21.15.60:0/2459648218 <== osd.3 v2:172.21.15.60:6818/14301 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa66013d7c0 con 0x7fa63c05c3d0 2020-10-31T22:41:14.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.875+0000 7fa665673700 1 -- 172.21.15.60:0/2459648218 >> [v2:172.21.15.60:6818/14301,v1:172.21.15.60:6819/14301] conn(0x7fa63c05c3d0 msgr2=0x7fa63c05e7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.875+0000 7fa665673700 1 --2- 172.21.15.60:0/2459648218 >> [v2:172.21.15.60:6818/14301,v1:172.21.15.60:6819/14301] conn(0x7fa63c05c3d0 0x7fa63c05e7f0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:14.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.875+0000 7fa665673700 1 -- 172.21.15.60:0/2459648218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa63c054fd0 msgr2=0x7fa63c057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.875+0000 7fa665673700 1 --2- 172.21.15.60:0/2459648218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa63c054fd0 0x7fa63c057490 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa65000d000 tx=0x7fa650009040).stop 2020-10-31T22:41:14.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.875+0000 7fa665673700 1 -- 172.21.15.60:0/2459648218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6600ae750 msgr2=0x7fa66013df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:14.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.875+0000 7fa665673700 1 --2- 172.21.15.60:0/2459648218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6600ae750 0x7fa66013df70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fa66013ea90 tx=0x7fa654006dc0).stop 2020-10-31T22:41:14.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.875+0000 7fa65f7fe700 1 -- 172.21.15.60:0/2459648218 reap_dead start 2020-10-31T22:41:14.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.875+0000 7fa665673700 1 -- 172.21.15.60:0/2459648218 shutdown_connections 2020-10-31T22:41:14.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.875+0000 7fa665673700 1 -- 172.21.15.60:0/2459648218 >> 172.21.15.60:0/2459648218 conn(0x7fa66005fae0 msgr2=0x7fa660136b50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:14.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.875+0000 7fa665673700 1 -- 172.21.15.60:0/2459648218 shutdown_connections 2020-10-31T22:41:14.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:14.875+0000 7fa665673700 1 -- 172.21.15.60:0/2459648218 wait complete. 2020-10-31T22:41:14.898 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2020-10-31T22:41:14.899 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-10-31T22:41:15.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.039+0000 7f075bfff700 1 Processor -- start 2020-10-31T22:41:15.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.039+0000 7f075bfff700 1 -- start start 2020-10-31T22:41:15.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.039+0000 7f075bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f075c0b1a10 0x7f075c142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.039+0000 7f075bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f075c0af200 0x7f075c0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.039+0000 7f075bfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075c0abea0 con 0x7f075c13ebe0 2020-10-31T22:41:15.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.039+0000 7f075bfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075c141870 con 0x7f075c0af200 2020-10-31T22:41:15.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c141b10 con 0x7f075c0b1a10 2020-10-31T22:41:15.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f0753fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f075c13ebe0 0x7f075c0afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45572/0 (socket says 172.21.15.60:45572) 2020-10-31T22:41:15.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f0753fff700 1 -- 172.21.15.60:0/2252823198 learned_addr learned my addr 172.21.15.60:0/2252823198 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:15.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075b7fe700 1 --2- 172.21.15.60:0/2252823198 >> v2:172.21.15.60:3300/0 conn(0x7f075c0af200 0x7f075c0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075affd700 1 --2- 172.21.15.60:0/2252823198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f075c0b1a10 0x7f075c142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075b7fe700 1 -- 172.21.15.60:0/2252823198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f075c0b1a10 msgr2=0x7f075c142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:15.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075b7fe700 1 --2- 172.21.15.60:0/2252823198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f075c0b1a10 0x7f075c142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075b7fe700 1 -- 172.21.15.60:0/2252823198 >> v1:172.21.15.60:6789/0 conn(0x7f075c13ebe0 legacy=0x7f075c0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075b7fe700 1 -- 172.21.15.60:0/2252823198 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c141db0 con 0x7f075c0af200 2020-10-31T22:41:15.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075a7fc700 1 -- 172.21.15.60:0/2252823198 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973165836 0 0) 0x7f075c0abea0 con 0x7f075c13ebe0 2020-10-31T22:41:15.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075b7fe700 1 --2- 172.21.15.60:0/2252823198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f075c0af200 0x7f075c0b1df0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f07540032b0 tx=0x7f07540091a0).ready entity=mon.0 client_cookie=c88da7dd75dc3cbc server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075a7fc700 1 -- 172.21.15.60:0/2252823198 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f075400b9a0 con 0x7f075c0af200 2020-10-31T22:41:15.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075a7fc700 1 -- 172.21.15.60:0/2252823198 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075400bb00 con 0x7f075c0af200 2020-10-31T22:41:15.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075a7fc700 1 -- 172.21.15.60:0/2252823198 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f075400bc70 con 0x7f075c0af200 2020-10-31T22:41:15.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075bfff700 1 -- 172.21.15.60:0/2252823198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f075c0af200 msgr2=0x7f075c0b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075bfff700 1 --2- 172.21.15.60:0/2252823198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f075c0af200 0x7f075c0b1df0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f07540032b0 tx=0x7f07540091a0).stop 2020-10-31T22:41:15.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075bfff700 1 -- 172.21.15.60:0/2252823198 shutdown_connections 2020-10-31T22:41:15.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075bfff700 1 --2- 172.21.15.60:0/2252823198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f075c0af200 0x7f075c0b1df0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075bfff700 1 --2- 172.21.15.60:0/2252823198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f075c0b1a10 0x7f075c142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075bfff700 1 -- 172.21.15.60:0/2252823198 >> 172.21.15.60:0/2252823198 conn(0x7f075c0b5300 msgr2=0x7f075c0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:15.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075bfff700 1 -- 172.21.15.60:0/2252823198 shutdown_connections 2020-10-31T22:41:15.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075bfff700 1 -- 172.21.15.60:0/2252823198 wait complete. 2020-10-31T22:41:15.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075bfff700 1 Processor -- start 2020-10-31T22:41:15.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.043+0000 7f075bfff700 1 -- start start 2020-10-31T22:41:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f075c0af200 0x7f075c0aa770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f075c0b1a10 0x7f075c13aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f075c13ebe0 0x7f075c0aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c13af50 con 0x7f075c13ebe0 2020-10-31T22:41:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075bfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c063410 con 0x7f075c0af200 2020-10-31T22:41:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0636b0 con 0x7f075c0b1a10 2020-10-31T22:41:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f075c13ebe0 0x7f075c0aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f075c13ebe0 0x7f075c0aaf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41446/0 (socket says 172.21.15.60:41446) 2020-10-31T22:41:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075b7fe700 1 -- 172.21.15.60:0/3902368444 learned_addr learned my addr 172.21.15.60:0/3902368444 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075affd700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f075c0af200 0x7f075c0aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f0753fff700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f075c0b1a10 0x7f075c13aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075b7fe700 1 -- 172.21.15.60:0/3902368444 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f075c0b1a10 msgr2=0x7f075c13aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075b7fe700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f075c0b1a10 0x7f075c13aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075b7fe700 1 -- 172.21.15.60:0/3902368444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f075c0af200 msgr2=0x7f075c0aa770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075b7fe700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f075c0af200 0x7f075c0aa770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075b7fe700 1 -- 172.21.15.60:0/3902368444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c063950 con 0x7f075c13ebe0 2020-10-31T22:41:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075affd700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f075c0af200 0x7f075c0aa770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075b7fe700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f075c13ebe0 0x7f075c0aaf50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f07540032b0 tx=0x7f0754016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f0758ff9700 1 -- 172.21.15.60:0/3902368444 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f075401f3f0 con 0x7f075c13ebe0 2020-10-31T22:41:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f0758ff9700 1 -- 172.21.15.60:0/3902368444 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075401f550 con 0x7f075c13ebe0 2020-10-31T22:41:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075bfff700 1 -- 172.21.15.60:0/3902368444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075c0b2d10 con 0x7f075c13ebe0 2020-10-31T22:41:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f0758ff9700 1 -- 172.21.15.60:0/3902368444 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f075401f8b0 con 0x7f075c13ebe0 2020-10-31T22:41:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075bfff700 1 -- 172.21.15.60:0/3902368444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075c0b33d0 con 0x7f075c13ebe0 2020-10-31T22:41:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.047+0000 7f075bfff700 1 -- 172.21.15.60:0/3902368444 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f075c057100 con 0x7f075c13ebe0 2020-10-31T22:41:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.051+0000 7f0758ff9700 1 -- 172.21.15.60:0/3902368444 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0754026030 con 0x7f075c13ebe0 2020-10-31T22:41:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.051+0000 7f0758ff9700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0734054f30 0x7f07340573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.051+0000 7f0758ff9700 1 -- 172.21.15.60:0/3902368444 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f075406e640 con 0x7f075c13ebe0 2020-10-31T22:41:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.051+0000 7f075affd700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0734054f30 0x7f07340573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.051+0000 7f0758ff9700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.66:6816/14002,v1:172.21.15.66:6817/14002] conn(0x7f073405c3b0 0x7f073405e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.051+0000 7f0758ff9700 1 -- 172.21.15.60:0/3902368444 --> [v2:172.21.15.66:6816/14002,v1:172.21.15.66:6817/14002] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f073405ee20 con 0x7f073405c3b0 2020-10-31T22:41:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.051+0000 7f0758ff9700 1 -- 172.21.15.60:0/3902368444 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0754070cd0 con 0x7f075c13ebe0 2020-10-31T22:41:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.051+0000 7f075affd700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0734054f30 0x7f07340573f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f074400b000 tx=0x7f0744008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.051+0000 7f0753fff700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.66:6816/14002,v1:172.21.15.66:6817/14002] conn(0x7f073405c3b0 0x7f073405e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.051+0000 7f0753fff700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.66:6816/14002,v1:172.21.15.66:6817/14002] conn(0x7f073405c3b0 0x7f073405e7d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.055+0000 7f0758ff9700 1 -- 172.21.15.60:0/3902368444 <== osd.4 v2:172.21.15.66:6816/14002 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7f073405ee20 con 0x7f073405c3b0 2020-10-31T22:41:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.075+0000 7f075bfff700 1 -- 172.21.15.60:0/3902368444 --> [v2:172.21.15.66:6816/14002,v1:172.21.15.66:6817/14002] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f075c0ab680 con 0x7f073405c3b0 2020-10-31T22:41:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.079+0000 7f0758ff9700 1 -- 172.21.15.60:0/3902368444 <== osd.4 v2:172.21.15.66:6816/14002 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f075c0ab680 con 0x7f073405c3b0 2020-10-31T22:41:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.079+0000 7f075bfff700 1 -- 172.21.15.60:0/3902368444 >> [v2:172.21.15.66:6816/14002,v1:172.21.15.66:6817/14002] conn(0x7f073405c3b0 msgr2=0x7f073405e7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.079+0000 7f075bfff700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.66:6816/14002,v1:172.21.15.66:6817/14002] conn(0x7f073405c3b0 0x7f073405e7d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.079+0000 7f075bfff700 1 -- 172.21.15.60:0/3902368444 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0734054f30 msgr2=0x7f07340573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.079+0000 7f075bfff700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0734054f30 0x7f07340573f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f074400b000 tx=0x7f0744008040).stop 2020-10-31T22:41:15.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.079+0000 7f075bfff700 1 -- 172.21.15.60:0/3902368444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f075c13ebe0 msgr2=0x7f075c0aaf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.079+0000 7f075bfff700 1 --2- 172.21.15.60:0/3902368444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f075c13ebe0 0x7f075c0aaf50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f07540032b0 tx=0x7f0754016000).stop 2020-10-31T22:41:15.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.079+0000 7f075b7fe700 1 -- 172.21.15.60:0/3902368444 reap_dead start 2020-10-31T22:41:15.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.079+0000 7f075bfff700 1 -- 172.21.15.60:0/3902368444 shutdown_connections 2020-10-31T22:41:15.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.079+0000 7f075bfff700 1 -- 172.21.15.60:0/3902368444 >> 172.21.15.60:0/3902368444 conn(0x7f075c0b5300 msgr2=0x7f075c0b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:15.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.079+0000 7f075bfff700 1 -- 172.21.15.60:0/3902368444 shutdown_connections 2020-10-31T22:41:15.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.079+0000 7f075bfff700 1 -- 172.21.15.60:0/3902368444 wait complete. 2020-10-31T22:41:15.101 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2020-10-31T22:41:15.102 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-10-31T22:41:15.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5808700 1 Processor -- start 2020-10-31T22:41:15.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5808700 1 -- start start 2020-10-31T22:41:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5808700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49d00ac870 0x7f49d0146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5808700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f49d0146550 0x7f49d0150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5808700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d00af900 con 0x7f49d00af520 2020-10-31T22:41:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5808700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d00afc10 con 0x7f49d0146550 2020-10-31T22:41:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5808700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d005bb70 con 0x7f49d00ac870 2020-10-31T22:41:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d4806700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f49d00af520 0x7f49d0066c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45588/0 (socket says 172.21.15.60:45588) 2020-10-31T22:41:15.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d4806700 1 -- 172.21.15.60:0/2822009054 learned_addr learned my addr 172.21.15.60:0/2822009054 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:15.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5007700 1 --2- 172.21.15.60:0/2822009054 >> v2:172.21.15.60:3300/0 conn(0x7f49d0146550 0x7f49d0150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49cffff700 1 --2- 172.21.15.60:0/2822009054 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49d00ac870 0x7f49d0146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49cf7fe700 1 -- 172.21.15.60:0/2822009054 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762443740 0 0) 0x7f49d00af900 con 0x7f49d00af520 2020-10-31T22:41:15.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49cf7fe700 1 -- 172.21.15.60:0/2822009054 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49b0003230 con 0x7f49d00af520 2020-10-31T22:41:15.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5007700 1 -- 172.21.15.60:0/2822009054 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49d00ac870 msgr2=0x7f49d0146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:15.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5007700 1 --2- 172.21.15.60:0/2822009054 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49d00ac870 0x7f49d0146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5007700 1 -- 172.21.15.60:0/2822009054 >> v1:172.21.15.60:6789/0 conn(0x7f49d00af520 legacy=0x7f49d0066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5007700 1 -- 172.21.15.60:0/2822009054 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d00ac130 con 0x7f49d0146550 2020-10-31T22:41:15.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5007700 1 --2- 172.21.15.60:0/2822009054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d0146550 0x7f49d0150980 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f49c8002f30 tx=0x7f49c8006dc0).ready entity=mon.0 client_cookie=8bae1713f624429a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49cf7fe700 1 -- 172.21.15.60:0/2822009054 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49c80096a0 con 0x7f49d0146550 2020-10-31T22:41:15.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49cf7fe700 1 -- 172.21.15.60:0/2822009054 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c8009800 con 0x7f49d0146550 2020-10-31T22:41:15.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49cf7fe700 1 -- 172.21.15.60:0/2822009054 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49c8009b60 con 0x7f49d0146550 2020-10-31T22:41:15.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5808700 1 -- 172.21.15.60:0/2822009054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d0146550 msgr2=0x7f49d0150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5808700 1 --2- 172.21.15.60:0/2822009054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d0146550 0x7f49d0150980 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f49c8002f30 tx=0x7f49c8006dc0).stop 2020-10-31T22:41:15.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.223+0000 7f49d5808700 1 -- 172.21.15.60:0/2822009054 shutdown_connections 2020-10-31T22:41:15.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5808700 1 --2- 172.21.15.60:0/2822009054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d0146550 0x7f49d0150980 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5808700 1 --2- 172.21.15.60:0/2822009054 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49d00ac870 0x7f49d0146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5808700 1 -- 172.21.15.60:0/2822009054 >> 172.21.15.60:0/2822009054 conn(0x7f49d00b3fd0 msgr2=0x7f49d00b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:15.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5808700 1 -- 172.21.15.60:0/2822009054 shutdown_connections 2020-10-31T22:41:15.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5808700 1 -- 172.21.15.60:0/2822009054 wait complete. 2020-10-31T22:41:15.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5808700 1 Processor -- start 2020-10-31T22:41:15.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5808700 1 -- start start 2020-10-31T22:41:15.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5808700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49d00ac870 0x7f49d01452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5808700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49d00af520 0x7f49d0158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5808700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d0146550 0x7f49d0141ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5808700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d00a96d0 con 0x7f49d0146550 2020-10-31T22:41:15.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5808700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d01591d0 con 0x7f49d00ac870 2020-10-31T22:41:15.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5808700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d00a8ef0 con 0x7f49d00af520 2020-10-31T22:41:15.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5007700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d0146550 0x7f49d0141ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5007700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d0146550 0x7f49d0141ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41462/0 (socket says 172.21.15.60:41462) 2020-10-31T22:41:15.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5007700 1 -- 172.21.15.60:0/2519669153 learned_addr learned my addr 172.21.15.60:0/2519669153 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:15.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49cffff700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49d00af520 0x7f49d0158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d4806700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49d00ac870 0x7f49d01452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5007700 1 -- 172.21.15.60:0/2519669153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49d00af520 msgr2=0x7f49d0158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5007700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49d00af520 0x7f49d0158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5007700 1 -- 172.21.15.60:0/2519669153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49d00ac870 msgr2=0x7f49d01452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5007700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49d00ac870 0x7f49d01452b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5007700 1 -- 172.21.15.60:0/2519669153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d00a9190 con 0x7f49d0146550 2020-10-31T22:41:15.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49cffff700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49d00af520 0x7f49d0158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:15.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d4806700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49d00ac870 0x7f49d01452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:15.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5007700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d0146550 0x7f49d0141ae0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f49c8002f30 tx=0x7f49c8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49cdffb700 1 -- 172.21.15.60:0/2519669153 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49c8011b40 con 0x7f49d0146550 2020-10-31T22:41:15.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49cdffb700 1 -- 172.21.15.60:0/2519669153 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c8011ca0 con 0x7f49d0146550 2020-10-31T22:41:15.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.227+0000 7f49d5808700 1 -- 172.21.15.60:0/2519669153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d00a9430 con 0x7f49d0146550 2020-10-31T22:41:15.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.231+0000 7f49cdffb700 1 -- 172.21.15.60:0/2519669153 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49c801d450 con 0x7f49d0146550 2020-10-31T22:41:15.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.231+0000 7f49d5808700 1 -- 172.21.15.60:0/2519669153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d0149e90 con 0x7f49d0146550 2020-10-31T22:41:15.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.231+0000 7f49d5808700 1 -- 172.21.15.60:0/2519669153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49d00a8900 con 0x7f49d0146550 2020-10-31T22:41:15.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.231+0000 7f49cdffb700 1 -- 172.21.15.60:0/2519669153 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f49c8024030 con 0x7f49d0146550 2020-10-31T22:41:15.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.231+0000 7f49cdffb700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f49b4054f90 0x7f49b4057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.231+0000 7f49cdffb700 1 -- 172.21.15.60:0/2519669153 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f49c806f480 con 0x7f49d0146550 2020-10-31T22:41:15.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.231+0000 7f49d4806700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f49b4054f90 0x7f49b4057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.231+0000 7f49cdffb700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.66:6800/14001,v1:172.21.15.66:6801/14001] conn(0x7f49b405c410 0x7f49b405e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.231+0000 7f49cdffb700 1 -- 172.21.15.60:0/2519669153 --> [v2:172.21.15.66:6800/14001,v1:172.21.15.66:6801/14001] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f49b405ee80 con 0x7f49b405c410 2020-10-31T22:41:15.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.231+0000 7f49cdffb700 1 -- 172.21.15.60:0/2519669153 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49c806f750 con 0x7f49d0146550 2020-10-31T22:41:15.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.231+0000 7f49d4806700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f49b4054f90 0x7f49b4057450 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f49c000b000 tx=0x7f49c0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.231+0000 7f49cffff700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.66:6800/14001,v1:172.21.15.66:6801/14001] conn(0x7f49b405c410 0x7f49b405e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.235+0000 7f49cffff700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.66:6800/14001,v1:172.21.15.66:6801/14001] conn(0x7f49b405c410 0x7f49b405e830 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.235+0000 7f49cdffb700 1 -- 172.21.15.60:0/2519669153 <== osd.5 v2:172.21.15.66:6800/14001 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7f49b405ee80 con 0x7f49b405c410 2020-10-31T22:41:15.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.255+0000 7f49d5808700 1 -- 172.21.15.60:0/2519669153 --> [v2:172.21.15.66:6800/14001,v1:172.21.15.66:6801/14001] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f49d00a8d10 con 0x7f49b405c410 2020-10-31T22:41:15.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.259+0000 7f49cdffb700 1 -- 172.21.15.60:0/2519669153 <== osd.5 v2:172.21.15.66:6800/14001 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f49d00a8d10 con 0x7f49b405c410 2020-10-31T22:41:15.261 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.259+0000 7f49d5808700 1 -- 172.21.15.60:0/2519669153 >> [v2:172.21.15.66:6800/14001,v1:172.21.15.66:6801/14001] conn(0x7f49b405c410 msgr2=0x7f49b405e830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.261 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.259+0000 7f49d5808700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.66:6800/14001,v1:172.21.15.66:6801/14001] conn(0x7f49b405c410 0x7f49b405e830 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.259+0000 7f49d5808700 1 -- 172.21.15.60:0/2519669153 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f49b4054f90 msgr2=0x7f49b4057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.259+0000 7f49d5808700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f49b4054f90 0x7f49b4057450 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f49c000b000 tx=0x7f49c0009040).stop 2020-10-31T22:41:15.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.259+0000 7f49d5808700 1 -- 172.21.15.60:0/2519669153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d0146550 msgr2=0x7f49d0141ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.259+0000 7f49d5808700 1 --2- 172.21.15.60:0/2519669153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49d0146550 0x7f49d0141ae0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f49c8002f30 tx=0x7f49c8015000).stop 2020-10-31T22:41:15.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.259+0000 7f49d5007700 1 -- 172.21.15.60:0/2519669153 reap_dead start 2020-10-31T22:41:15.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.259+0000 7f49d5808700 1 -- 172.21.15.60:0/2519669153 shutdown_connections 2020-10-31T22:41:15.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.259+0000 7f49d5808700 1 -- 172.21.15.60:0/2519669153 >> 172.21.15.60:0/2519669153 conn(0x7f49d00b3fd0 msgr2=0x7f49d00ad340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:15.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.259+0000 7f49d5808700 1 -- 172.21.15.60:0/2519669153 shutdown_connections 2020-10-31T22:41:15.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.259+0000 7f49d5808700 1 -- 172.21.15.60:0/2519669153 wait complete. 2020-10-31T22:41:15.275 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2020-10-31T22:41:15.276 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-10-31T22:41:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.407+0000 7f8d9b391700 1 Processor -- start 2020-10-31T22:41:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.407+0000 7f8d9b391700 1 -- start start 2020-10-31T22:41:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9b391700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8d9405b320 0x7f8d940b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9b391700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8d94140420 0x7f8d940b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9b391700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9405b700 con 0x7f8d940acc80 2020-10-31T22:41:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9b391700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d940b2830 con 0x7f8d94140420 2020-10-31T22:41:15.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9b391700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d941408a0 con 0x7f8d9405b320 2020-10-31T22:41:15.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d99b8e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8d94140420 0x7f8d940b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9ab90700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8d940acc80 0x7f8d940ad7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45606/0 (socket says 172.21.15.60:45606) 2020-10-31T22:41:15.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9ab90700 1 -- 172.21.15.60:0/3723453098 learned_addr learned my addr 172.21.15.60:0/3723453098 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:15.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9a38f700 1 --2- 172.21.15.60:0/3723453098 >> v2:172.21.15.66:3300/0 conn(0x7f8d9405b320 0x7f8d940b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d99b8e700 1 -- 172.21.15.60:0/3723453098 >> v2:172.21.15.66:3300/0 conn(0x7f8d9405b320 msgr2=0x7f8d940b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d99b8e700 1 --2- 172.21.15.60:0/3723453098 >> v2:172.21.15.66:3300/0 conn(0x7f8d9405b320 0x7f8d940b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d99b8e700 1 -- 172.21.15.60:0/3723453098 >> v1:172.21.15.60:6789/0 conn(0x7f8d940acc80 legacy=0x7f8d940ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d99b8e700 1 -- 172.21.15.60:0/3723453098 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d940b0220 con 0x7f8d94140420 2020-10-31T22:41:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d99b8e700 1 --2- 172.21.15.60:0/3723453098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d94140420 0x7f8d940b2340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8d90002f30 tx=0x7f8d90006dc0).ready entity=mon.0 client_cookie=827de9d627106b41 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9938d700 1 -- 172.21.15.60:0/3723453098 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d900097b0 con 0x7f8d94140420 2020-10-31T22:41:15.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9938d700 1 -- 172.21.15.60:0/3723453098 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d90009910 con 0x7f8d94140420 2020-10-31T22:41:15.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9938d700 1 -- 172.21.15.60:0/3723453098 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d90009c70 con 0x7f8d94140420 2020-10-31T22:41:15.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9b391700 1 -- 172.21.15.60:0/3723453098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d94140420 msgr2=0x7f8d940b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9b391700 1 --2- 172.21.15.60:0/3723453098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d94140420 0x7f8d940b2340 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f8d90002f30 tx=0x7f8d90006dc0).stop 2020-10-31T22:41:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9b391700 1 -- 172.21.15.60:0/3723453098 shutdown_connections 2020-10-31T22:41:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9b391700 1 --2- 172.21.15.60:0/3723453098 >> v2:172.21.15.66:3300/0 conn(0x7f8d9405b320 0x7f8d940b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9b391700 1 --2- 172.21.15.60:0/3723453098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d94140420 0x7f8d940b2340 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9b391700 1 -- 172.21.15.60:0/3723453098 >> 172.21.15.60:0/3723453098 conn(0x7f8d940b61d0 msgr2=0x7f8d940b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9b391700 1 -- 172.21.15.60:0/3723453098 shutdown_connections 2020-10-31T22:41:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.411+0000 7f8d9b391700 1 -- 172.21.15.60:0/3723453098 wait complete. 2020-10-31T22:41:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d9b391700 1 Processor -- start 2020-10-31T22:41:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d9b391700 1 -- start start 2020-10-31T22:41:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d9b391700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d9405b320 0x7f8d9413e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d9b391700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940acc80 0x7f8d9413a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d9b391700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d94140420 0x7f8d9413a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d9b391700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d94141be0 con 0x7f8d940acc80 2020-10-31T22:41:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d9b391700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9414f840 con 0x7f8d9405b320 2020-10-31T22:41:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d9b391700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9414f340 con 0x7f8d94140420 2020-10-31T22:41:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d99b8e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940acc80 0x7f8d9413a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d99b8e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940acc80 0x7f8d9413a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41476/0 (socket says 172.21.15.60:41476) 2020-10-31T22:41:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d99b8e700 1 -- 172.21.15.60:0/3752817992 learned_addr learned my addr 172.21.15.60:0/3752817992 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d9a38f700 1 --2- 172.21.15.60:0/3752817992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d9405b320 0x7f8d9413e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d9ab90700 1 --2- 172.21.15.60:0/3752817992 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d94140420 0x7f8d9413a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d99b8e700 1 -- 172.21.15.60:0/3752817992 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d94140420 msgr2=0x7f8d9413a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d99b8e700 1 --2- 172.21.15.60:0/3752817992 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d94140420 0x7f8d9413a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d99b8e700 1 -- 172.21.15.60:0/3752817992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d9405b320 msgr2=0x7f8d9413e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d99b8e700 1 --2- 172.21.15.60:0/3752817992 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d9405b320 0x7f8d9413e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d99b8e700 1 -- 172.21.15.60:0/3752817992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9414f5a0 con 0x7f8d940acc80 2020-10-31T22:41:15.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d99b8e700 1 --2- 172.21.15.60:0/3752817992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940acc80 0x7f8d9413a010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8d9414e8f0 tx=0x7f8d90015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d8b7fe700 1 -- 172.21.15.60:0/3752817992 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d90011990 con 0x7f8d940acc80 2020-10-31T22:41:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d9b391700 1 -- 172.21.15.60:0/3752817992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9413c440 con 0x7f8d940acc80 2020-10-31T22:41:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d8b7fe700 1 -- 172.21.15.60:0/3752817992 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d90011af0 con 0x7f8d940acc80 2020-10-31T22:41:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d9b391700 1 -- 172.21.15.60:0/3752817992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9413ed60 con 0x7f8d940acc80 2020-10-31T22:41:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d8b7fe700 1 -- 172.21.15.60:0/3752817992 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8d90011e50 con 0x7f8d940acc80 2020-10-31T22:41:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.415+0000 7f8d9b391700 1 -- 172.21.15.60:0/3752817992 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d9413c8e0 con 0x7f8d940acc80 2020-10-31T22:41:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.419+0000 7f8d8b7fe700 1 -- 172.21.15.60:0/3752817992 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8d90024030 con 0x7f8d940acc80 2020-10-31T22:41:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.419+0000 7f8d8b7fe700 1 --2- 172.21.15.60:0/3752817992 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8d74054f10 0x7f8d740573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.419+0000 7f8d8b7fe700 1 -- 172.21.15.60:0/3752817992 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8d9006ea10 con 0x7f8d940acc80 2020-10-31T22:41:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.419+0000 7f8d9a38f700 1 --2- 172.21.15.60:0/3752817992 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8d74054f10 0x7f8d740573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.419+0000 7f8d8b7fe700 1 --2- 172.21.15.60:0/3752817992 >> [v2:172.21.15.66:6808/14003,v1:172.21.15.66:6809/14003] conn(0x7f8d7405c310 0x7f8d7405e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.419+0000 7f8d8b7fe700 1 -- 172.21.15.60:0/3752817992 --> [v2:172.21.15.66:6808/14003,v1:172.21.15.66:6809/14003] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d7405ed80 con 0x7f8d7405c310 2020-10-31T22:41:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.419+0000 7f8d8b7fe700 1 -- 172.21.15.60:0/3752817992 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d90073240 con 0x7f8d940acc80 2020-10-31T22:41:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.419+0000 7f8d9a38f700 1 --2- 172.21.15.60:0/3752817992 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8d74054f10 0x7f8d740573d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f8d8400b000 tx=0x7f8d840091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.419+0000 7f8d9ab90700 1 --2- 172.21.15.60:0/3752817992 >> [v2:172.21.15.66:6808/14003,v1:172.21.15.66:6809/14003] conn(0x7f8d7405c310 0x7f8d7405e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.419+0000 7f8d9ab90700 1 --2- 172.21.15.60:0/3752817992 >> [v2:172.21.15.66:6808/14003,v1:172.21.15.66:6809/14003] conn(0x7f8d7405c310 0x7f8d7405e730 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.423+0000 7f8d8b7fe700 1 -- 172.21.15.60:0/3752817992 <== osd.6 v2:172.21.15.66:6808/14003 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7f8d7405ed80 con 0x7f8d7405c310 2020-10-31T22:41:15.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.443+0000 7f8d9b391700 1 -- 172.21.15.60:0/3752817992 --> [v2:172.21.15.66:6808/14003,v1:172.21.15.66:6809/14003] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d9413bfc0 con 0x7f8d7405c310 2020-10-31T22:41:15.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.443+0000 7f8d8b7fe700 1 -- 172.21.15.60:0/3752817992 <== osd.6 v2:172.21.15.66:6808/14003 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8d9413bfc0 con 0x7f8d7405c310 2020-10-31T22:41:15.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.447+0000 7f8d9b391700 1 -- 172.21.15.60:0/3752817992 >> [v2:172.21.15.66:6808/14003,v1:172.21.15.66:6809/14003] conn(0x7f8d7405c310 msgr2=0x7f8d7405e730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.447+0000 7f8d9b391700 1 --2- 172.21.15.60:0/3752817992 >> [v2:172.21.15.66:6808/14003,v1:172.21.15.66:6809/14003] conn(0x7f8d7405c310 0x7f8d7405e730 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.447+0000 7f8d9b391700 1 -- 172.21.15.60:0/3752817992 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8d74054f10 msgr2=0x7f8d740573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.447+0000 7f8d9b391700 1 --2- 172.21.15.60:0/3752817992 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8d74054f10 0x7f8d740573d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f8d8400b000 tx=0x7f8d840091a0).stop 2020-10-31T22:41:15.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.447+0000 7f8d9b391700 1 -- 172.21.15.60:0/3752817992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940acc80 msgr2=0x7f8d9413a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.447+0000 7f8d9b391700 1 --2- 172.21.15.60:0/3752817992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d940acc80 0x7f8d9413a010 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8d9414e8f0 tx=0x7f8d90015000).stop 2020-10-31T22:41:15.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.447+0000 7f8d9ab90700 1 -- 172.21.15.60:0/3752817992 reap_dead start 2020-10-31T22:41:15.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.447+0000 7f8d9b391700 1 -- 172.21.15.60:0/3752817992 shutdown_connections 2020-10-31T22:41:15.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.447+0000 7f8d9b391700 1 -- 172.21.15.60:0/3752817992 >> 172.21.15.60:0/3752817992 conn(0x7f8d940b61d0 msgr2=0x7f8d940b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:15.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.447+0000 7f8d9b391700 1 -- 172.21.15.60:0/3752817992 shutdown_connections 2020-10-31T22:41:15.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.447+0000 7f8d9b391700 1 -- 172.21.15.60:0/3752817992 wait complete. 2020-10-31T22:41:15.464 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2020-10-31T22:41:15.465 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-10-31T22:41:15.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.599+0000 7feba6ced700 1 Processor -- start 2020-10-31T22:41:15.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.599+0000 7feba6ced700 1 -- start start 2020-10-31T22:41:15.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.599+0000 7feba6ced700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7feba005c4c0 0x7feba005c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.599+0000 7feba6ced700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba0065e90 con 0x7feba00b2e20 2020-10-31T22:41:15.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.599+0000 7feba6ced700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba0066130 con 0x7feba00b4410 2020-10-31T22:41:15.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.599+0000 7feba6ced700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba0141ef0 con 0x7feba005c4c0 2020-10-31T22:41:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.599+0000 7feb9ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7feba00b2e20 0x7feba013f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45620/0 (socket says 172.21.15.60:45620) 2020-10-31T22:41:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.599+0000 7feb9ffff700 1 -- 172.21.15.60:0/797722511 learned_addr learned my addr 172.21.15.60:0/797722511 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:15.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.599+0000 7feba4a89700 1 --2- 172.21.15.60:0/797722511 >> v2:172.21.15.66:3300/0 conn(0x7feba005c4c0 0x7feba005c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feb9f7fe700 1 -- 172.21.15.60:0/797722511 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101228683 0 0) 0x7feba0065e90 con 0x7feba00b2e20 2020-10-31T22:41:15.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feb9f7fe700 1 -- 172.21.15.60:0/797722511 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb8c003230 con 0x7feba00b2e20 2020-10-31T22:41:15.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feba4a89700 1 -- 172.21.15.60:0/797722511 >> v1:172.21.15.66:6789/0 conn(0x7feba00b4410 legacy=0x7feba0142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feb9f7fe700 1 -- 172.21.15.60:0/797722511 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2999929985 0 0) 0x7feb8c003230 con 0x7feba00b2e20 2020-10-31T22:41:15.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feba4a89700 1 -- 172.21.15.60:0/797722511 >> v1:172.21.15.60:6789/0 conn(0x7feba00b2e20 legacy=0x7feba013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feba4a89700 1 -- 172.21.15.60:0/797722511 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba00663d0 con 0x7feba005c4c0 2020-10-31T22:41:15.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feba4a89700 1 --2- 172.21.15.60:0/797722511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feba005c4c0 0x7feba005c8a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7feb94001870 tx=0x7feb90006dc0).ready entity=mon.1 client_cookie=fe923e5f6c34bd5e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feb9f7fe700 1 -- 172.21.15.60:0/797722511 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb940016d0 con 0x7feba005c4c0 2020-10-31T22:41:15.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feb9f7fe700 1 -- 172.21.15.60:0/797722511 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb90009670 con 0x7feba005c4c0 2020-10-31T22:41:15.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feb9f7fe700 1 -- 172.21.15.60:0/797722511 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb900097e0 con 0x7feba005c4c0 2020-10-31T22:41:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feba6ced700 1 -- 172.21.15.60:0/797722511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feba005c4c0 msgr2=0x7feba005c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feba6ced700 1 --2- 172.21.15.60:0/797722511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feba005c4c0 0x7feba005c8a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7feb94001870 tx=0x7feb90006dc0).stop 2020-10-31T22:41:15.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feba6ced700 1 -- 172.21.15.60:0/797722511 shutdown_connections 2020-10-31T22:41:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feba6ced700 1 --2- 172.21.15.60:0/797722511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feba005c4c0 0x7feba005c8a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feba6ced700 1 -- 172.21.15.60:0/797722511 >> 172.21.15.60:0/797722511 conn(0x7feba00601e0 msgr2=0x7feba005b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:15.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feba6ced700 1 -- 172.21.15.60:0/797722511 shutdown_connections 2020-10-31T22:41:15.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feba6ced700 1 -- 172.21.15.60:0/797722511 wait complete. 2020-10-31T22:41:15.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feba6ced700 1 Processor -- start 2020-10-31T22:41:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.603+0000 7feba6ced700 1 -- start start 2020-10-31T22:41:15.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba6ced700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feba005c4c0 0x7feba00a9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba6ced700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feba00b4410 0x7feba0150d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba6ced700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feba0151250 0x7feba013e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba6ced700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba0143930 con 0x7feba0151250 2020-10-31T22:41:15.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba6ced700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba0143b60 con 0x7feba005c4c0 2020-10-31T22:41:15.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba6ced700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba0145770 con 0x7feba00b4410 2020-10-31T22:41:15.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba528a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feba0151250 0x7feba013e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba528a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feba0151250 0x7feba013e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41494/0 (socket says 172.21.15.60:41494) 2020-10-31T22:41:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba528a700 1 -- 172.21.15.60:0/3033866129 learned_addr learned my addr 172.21.15.60:0/3033866129 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba4a89700 1 --2- 172.21.15.60:0/3033866129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feba005c4c0 0x7feba00a9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feb9ffff700 1 --2- 172.21.15.60:0/3033866129 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feba00b4410 0x7feba0150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba528a700 1 -- 172.21.15.60:0/3033866129 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feba00b4410 msgr2=0x7feba0150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba528a700 1 --2- 172.21.15.60:0/3033866129 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feba00b4410 0x7feba0150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba528a700 1 -- 172.21.15.60:0/3033866129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feba005c4c0 msgr2=0x7feba00a9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba528a700 1 --2- 172.21.15.60:0/3033866129 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feba005c4c0 0x7feba00a9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba528a700 1 -- 172.21.15.60:0/3033866129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba0145270 con 0x7feba0151250 2020-10-31T22:41:15.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba528a700 1 --2- 172.21.15.60:0/3033866129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feba0151250 0x7feba013e5b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7feba00aa850 tx=0x7feb98007e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feb9dffb700 1 -- 172.21.15.60:0/3033866129 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb9800a560 con 0x7feba0151250 2020-10-31T22:41:15.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feb9dffb700 1 -- 172.21.15.60:0/3033866129 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800a6c0 con 0x7feba0151250 2020-10-31T22:41:15.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feb9dffb700 1 -- 172.21.15.60:0/3033866129 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb9800aa20 con 0x7feba0151250 2020-10-31T22:41:15.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba6ced700 1 -- 172.21.15.60:0/3033866129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba0144560 con 0x7feba0151250 2020-10-31T22:41:15.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba6ced700 1 -- 172.21.15.60:0/3033866129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba0143fd0 con 0x7feba0151250 2020-10-31T22:41:15.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feba6ced700 1 -- 172.21.15.60:0/3033866129 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feba0143d30 con 0x7feba0151250 2020-10-31T22:41:15.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.607+0000 7feb9dffb700 1 -- 172.21.15.60:0/3033866129 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7feb98019030 con 0x7feba0151250 2020-10-31T22:41:15.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.611+0000 7feb9dffb700 1 --2- 172.21.15.60:0/3033866129 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7feb80054f90 0x7feb80057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.611+0000 7feb9dffb700 1 -- 172.21.15.60:0/3033866129 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feb9806d2b0 con 0x7feba0151250 2020-10-31T22:41:15.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.611+0000 7feba4a89700 1 --2- 172.21.15.60:0/3033866129 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7feb80054f90 0x7feb80057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.611+0000 7feb9dffb700 1 --2- 172.21.15.60:0/3033866129 >> [v2:172.21.15.66:6824/14046,v1:172.21.15.66:6825/14046] conn(0x7feb8005c410 0x7feb8005e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.611+0000 7feb9dffb700 1 -- 172.21.15.60:0/3033866129 --> [v2:172.21.15.66:6824/14046,v1:172.21.15.66:6825/14046] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feb8005ee80 con 0x7feb8005c410 2020-10-31T22:41:15.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.611+0000 7feb9dffb700 1 -- 172.21.15.60:0/3033866129 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb9806f940 con 0x7feba0151250 2020-10-31T22:41:15.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.611+0000 7feba4a89700 1 --2- 172.21.15.60:0/3033866129 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7feb80054f90 0x7feb80057450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7feb90019000 tx=0x7feb90015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.611+0000 7feb9ffff700 1 --2- 172.21.15.60:0/3033866129 >> [v2:172.21.15.66:6824/14046,v1:172.21.15.66:6825/14046] conn(0x7feb8005c410 0x7feb8005e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.611+0000 7feb9ffff700 1 --2- 172.21.15.60:0/3033866129 >> [v2:172.21.15.66:6824/14046,v1:172.21.15.66:6825/14046] conn(0x7feb8005c410 0x7feb8005e830 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.611+0000 7feb9dffb700 1 -- 172.21.15.60:0/3033866129 <== osd.7 v2:172.21.15.66:6824/14046 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23260 (crc 0 0 0) 0x7feb8005ee80 con 0x7feb8005c410 2020-10-31T22:41:15.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.635+0000 7feba6ced700 1 -- 172.21.15.60:0/3033866129 --> [v2:172.21.15.66:6824/14046,v1:172.21.15.66:6825/14046] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feba0057100 con 0x7feb8005c410 2020-10-31T22:41:15.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.635+0000 7feb9dffb700 1 -- 172.21.15.60:0/3033866129 <== osd.7 v2:172.21.15.66:6824/14046 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7feba0057100 con 0x7feb8005c410 2020-10-31T22:41:15.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.635+0000 7feba6ced700 1 -- 172.21.15.60:0/3033866129 >> [v2:172.21.15.66:6824/14046,v1:172.21.15.66:6825/14046] conn(0x7feb8005c410 msgr2=0x7feb8005e830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.635+0000 7feba6ced700 1 --2- 172.21.15.60:0/3033866129 >> [v2:172.21.15.66:6824/14046,v1:172.21.15.66:6825/14046] conn(0x7feb8005c410 0x7feb8005e830 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.635+0000 7feba6ced700 1 -- 172.21.15.60:0/3033866129 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7feb80054f90 msgr2=0x7feb80057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.635+0000 7feba6ced700 1 --2- 172.21.15.60:0/3033866129 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7feb80054f90 0x7feb80057450 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7feb90019000 tx=0x7feb90015000).stop 2020-10-31T22:41:15.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.635+0000 7feba6ced700 1 -- 172.21.15.60:0/3033866129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feba0151250 msgr2=0x7feba013e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.635+0000 7feba6ced700 1 --2- 172.21.15.60:0/3033866129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feba0151250 0x7feba013e5b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7feba00aa850 tx=0x7feb98007e80).stop 2020-10-31T22:41:15.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.635+0000 7feba528a700 1 -- 172.21.15.60:0/3033866129 reap_dead start 2020-10-31T22:41:15.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.635+0000 7feba6ced700 1 -- 172.21.15.60:0/3033866129 shutdown_connections 2020-10-31T22:41:15.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.635+0000 7feba6ced700 1 -- 172.21.15.60:0/3033866129 >> 172.21.15.60:0/3033866129 conn(0x7feba00601e0 msgr2=0x7feba013fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:15.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.635+0000 7feba6ced700 1 -- 172.21.15.60:0/3033866129 shutdown_connections 2020-10-31T22:41:15.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.635+0000 7feba6ced700 1 -- 172.21.15.60:0/3033866129 wait complete. 2020-10-31T22:41:15.663 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2020-10-31T22:41:15.663 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-10-31T22:41:15.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.783+0000 7f01a2c69700 1 Processor -- start 2020-10-31T22:41:15.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.783+0000 7f01a2c69700 1 -- start start 2020-10-31T22:41:15.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2c69700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f019c13ebe0 0x7f019c142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2c69700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f019c0af200 0x7f019c0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2c69700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f019c0abea0 con 0x7f019c0b1a10 2020-10-31T22:41:15.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2c69700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f019c141870 con 0x7f019c13ebe0 2020-10-31T22:41:15.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2c69700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019c141b10 con 0x7f019c0af200 2020-10-31T22:41:15.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a1466700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f019c13ebe0 0x7f019c142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2468700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f019c0af200 0x7f019c0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a1466700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f019c13ebe0 0x7f019c142250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:52438/0 (socket says 172.21.15.60:52438) 2020-10-31T22:41:15.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a1466700 1 -- 172.21.15.60:0/2166931379 learned_addr learned my addr 172.21.15.60:0/2166931379 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:15.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2468700 1 -- 172.21.15.60:0/2166931379 >> v2:172.21.15.66:3300/0 conn(0x7f019c13ebe0 msgr2=0x7f019c142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:15.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2468700 1 --2- 172.21.15.60:0/2166931379 >> v2:172.21.15.66:3300/0 conn(0x7f019c13ebe0 0x7f019c142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2468700 1 -- 172.21.15.60:0/2166931379 >> v1:172.21.15.66:6789/0 conn(0x7f019c0b1a10 legacy=0x7f019c0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2468700 1 -- 172.21.15.60:0/2166931379 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c141db0 con 0x7f019c0af200 2020-10-31T22:41:15.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2468700 1 --2- 172.21.15.60:0/2166931379 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f019c0af200 0x7f019c0b1df0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f01940032b0 tx=0x7f01940091a0).ready entity=mon.2 client_cookie=d6a8de9676bac7ae server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a0c65700 1 -- 172.21.15.60:0/2166931379 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f019400b9a0 con 0x7f019c0af200 2020-10-31T22:41:15.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a0c65700 1 -- 172.21.15.60:0/2166931379 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019400bb00 con 0x7f019c0af200 2020-10-31T22:41:15.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a0c65700 1 -- 172.21.15.60:0/2166931379 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f019400bc70 con 0x7f019c0af200 2020-10-31T22:41:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2c69700 1 -- 172.21.15.60:0/2166931379 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f019c0af200 msgr2=0x7f019c0b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2c69700 1 --2- 172.21.15.60:0/2166931379 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f019c0af200 0x7f019c0b1df0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f01940032b0 tx=0x7f01940091a0).stop 2020-10-31T22:41:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2c69700 1 -- 172.21.15.60:0/2166931379 shutdown_connections 2020-10-31T22:41:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2c69700 1 --2- 172.21.15.60:0/2166931379 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f019c0af200 0x7f019c0b1df0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2c69700 1 --2- 172.21.15.60:0/2166931379 >> v2:172.21.15.66:3300/0 conn(0x7f019c13ebe0 0x7f019c142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2c69700 1 -- 172.21.15.60:0/2166931379 >> 172.21.15.60:0/2166931379 conn(0x7f019c0b5300 msgr2=0x7f019c0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:15.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2c69700 1 -- 172.21.15.60:0/2166931379 shutdown_connections 2020-10-31T22:41:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.787+0000 7f01a2c69700 1 -- 172.21.15.60:0/2166931379 wait complete. 2020-10-31T22:41:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a2c69700 1 Processor -- start 2020-10-31T22:41:15.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a2c69700 1 -- start start 2020-10-31T22:41:15.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a2c69700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f019c0af200 0x7f019c063bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a2c69700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f019c0b1a10 0x7f019c0ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a2c69700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f019c13ebe0 0x7f019c066840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a2c69700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c0631f0 con 0x7f019c0af200 2020-10-31T22:41:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a2c69700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c062f50 con 0x7f019c0b1a10 2020-10-31T22:41:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a2c69700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019c14e7c0 con 0x7f019c13ebe0 2020-10-31T22:41:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a1c67700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f019c0af200 0x7f019c063bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a1c67700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f019c0af200 0x7f019c063bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41506/0 (socket says 172.21.15.60:41506) 2020-10-31T22:41:15.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a1466700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f019c0b1a10 0x7f019c0ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a1c67700 1 -- 172.21.15.60:0/3252547396 learned_addr learned my addr 172.21.15.60:0/3252547396 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:15.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a2468700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f019c13ebe0 0x7f019c066840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a1c67700 1 -- 172.21.15.60:0/3252547396 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f019c13ebe0 msgr2=0x7f019c066840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a1c67700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f019c13ebe0 0x7f019c066840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a1c67700 1 -- 172.21.15.60:0/3252547396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f019c0b1a10 msgr2=0x7f019c0ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a1c67700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f019c0b1a10 0x7f019c0ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a1c67700 1 -- 172.21.15.60:0/3252547396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c14ea60 con 0x7f019c0af200 2020-10-31T22:41:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a1466700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f019c0b1a10 0x7f019c0ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a1c67700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f019c0af200 0x7f019c063bd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f019c062ba0 tx=0x7f018c007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f018affd700 1 -- 172.21.15.60:0/3252547396 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f018c00e4a0 con 0x7f019c0af200 2020-10-31T22:41:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f018affd700 1 -- 172.21.15.60:0/3252547396 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c00e600 con 0x7f019c0af200 2020-10-31T22:41:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a2c69700 1 -- 172.21.15.60:0/3252547396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019c064310 con 0x7f019c0af200 2020-10-31T22:41:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f018affd700 1 -- 172.21.15.60:0/3252547396 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f018c00e960 con 0x7f019c0af200 2020-10-31T22:41:15.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.791+0000 7f01a2c69700 1 -- 172.21.15.60:0/3252547396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019c064890 con 0x7f019c0af200 2020-10-31T22:41:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.795+0000 7f018affd700 1 -- 172.21.15.60:0/3252547396 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f018c019030 con 0x7f019c0af200 2020-10-31T22:41:15.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.795+0000 7f01a2c69700 1 -- 172.21.15.60:0/3252547396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f019c057100 con 0x7f019c0af200 2020-10-31T22:41:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.795+0000 7f018affd700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f017c054f10 0x7f017c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.795+0000 7f018affd700 1 -- 172.21.15.60:0/3252547396 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f018c06cdf0 con 0x7f019c0af200 2020-10-31T22:41:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.795+0000 7f01a1466700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f017c054f10 0x7f017c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:15.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.795+0000 7f01a1466700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f017c054f10 0x7f017c0573d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f0198008000 tx=0x7f0198008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:15.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.803+0000 7f018affd700 1 -- 172.21.15.60:0/3252547396 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f018c043310 con 0x7f019c0af200 2020-10-31T22:41:15.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.947+0000 7f01a2c69700 1 -- 172.21.15.60:0/3252547396 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f019c0644a0 con 0x7f019c0af200 2020-10-31T22:41:15.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.947+0000 7f018affd700 1 -- 172.21.15.60:0/3252547396 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f019c0644a0 con 0x7f019c0af200 2020-10-31T22:41:15.953 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2020-10-31T22:41:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.951+0000 7f01a2c69700 1 -- 172.21.15.60:0/3252547396 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f017c054f10 msgr2=0x7f017c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.951+0000 7f01a2c69700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f017c054f10 0x7f017c0573d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f0198008000 tx=0x7f0198008040).stop 2020-10-31T22:41:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.951+0000 7f01a2c69700 1 -- 172.21.15.60:0/3252547396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f019c0af200 msgr2=0x7f019c063bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.951+0000 7f01a2c69700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f019c0af200 0x7f019c063bd0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f019c062ba0 tx=0x7f018c007b90).stop 2020-10-31T22:41:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.951+0000 7f01a2c69700 1 -- 172.21.15.60:0/3252547396 shutdown_connections 2020-10-31T22:41:15.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.951+0000 7f01a2c69700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f019c13ebe0 0x7f019c066840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.951+0000 7f01a2c69700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f019c0af200 0x7f019c063bd0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.951+0000 7f01a2c69700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f017c054f10 0x7f017c0573d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.951+0000 7f01a2c69700 1 --2- 172.21.15.60:0/3252547396 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f019c0b1a10 0x7f019c0ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:15.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.951+0000 7f01a2c69700 1 -- 172.21.15.60:0/3252547396 >> 172.21.15.60:0/3252547396 conn(0x7f019c0b5300 msgr2=0x7f019c0b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:15.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.951+0000 7f01a2c69700 1 -- 172.21.15.60:0/3252547396 shutdown_connections 2020-10-31T22:41:15.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:15.951+0000 7f01a2c69700 1 -- 172.21.15.60:0/3252547396 wait complete. 2020-10-31T22:41:15.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2020-10-31T22:41:15.970 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-10-31T22:41:16.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9359e700 1 Processor -- start 2020-10-31T22:41:16.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9359e700 1 -- start start 2020-10-31T22:41:16.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9359e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5c940b1d50 0x7f5c940b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c940b0950 0x7f5c9405bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9359e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c940b2130 con 0x7f5c94141d80 2020-10-31T22:41:16.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9359e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c9413fab0 con 0x7f5c940b1d50 2020-10-31T22:41:16.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940af380 con 0x7f5c940b0950 2020-10-31T22:41:16.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c91d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5c94141d80 0x7f5c9405afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45654/0 (socket says 172.21.15.60:45654) 2020-10-31T22:41:16.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c91d9b700 1 -- 172.21.15.60:0/3610388521 learned_addr learned my addr 172.21.15.60:0/3610388521 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:16.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9259c700 1 --2- 172.21.15.60:0/3610388521 >> v2:172.21.15.66:3300/0 conn(0x7f5c940b1d50 0x7f5c940b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c92d9d700 1 --2- 172.21.15.60:0/3610388521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c940b0950 0x7f5c9405bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9159a700 1 -- 172.21.15.60:0/3610388521 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267814383 0 0) 0x7f5c940b2130 con 0x7f5c94141d80 2020-10-31T22:41:16.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9159a700 1 -- 172.21.15.60:0/3610388521 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c78003230 con 0x7f5c94141d80 2020-10-31T22:41:16.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c92d9d700 1 -- 172.21.15.60:0/3610388521 >> v2:172.21.15.66:3300/0 conn(0x7f5c940b1d50 msgr2=0x7f5c940b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:16.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c92d9d700 1 --2- 172.21.15.60:0/3610388521 >> v2:172.21.15.66:3300/0 conn(0x7f5c940b1d50 0x7f5c940b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c92d9d700 1 -- 172.21.15.60:0/3610388521 >> v1:172.21.15.60:6789/0 conn(0x7f5c94141d80 legacy=0x7f5c9405afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c92d9d700 1 -- 172.21.15.60:0/3610388521 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c940af620 con 0x7f5c940b0950 2020-10-31T22:41:16.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c92d9d700 1 --2- 172.21.15.60:0/3610388521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c940b0950 0x7f5c9405bc10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5c8c0032b0 tx=0x7f5c8c0091a0).ready entity=mon.2 client_cookie=645d2c22b08618aa server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:16.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9159a700 1 -- 172.21.15.60:0/3610388521 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c8c00b940 con 0x7f5c940b0950 2020-10-31T22:41:16.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9159a700 1 -- 172.21.15.60:0/3610388521 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c00baa0 con 0x7f5c940b0950 2020-10-31T22:41:16.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9159a700 1 -- 172.21.15.60:0/3610388521 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c8c00bc10 con 0x7f5c940b0950 2020-10-31T22:41:16.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9359e700 1 -- 172.21.15.60:0/3610388521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c940b0950 msgr2=0x7f5c9405bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.087+0000 7f5c9359e700 1 --2- 172.21.15.60:0/3610388521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c940b0950 0x7f5c9405bc10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f5c8c0032b0 tx=0x7f5c8c0091a0).stop 2020-10-31T22:41:16.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9359e700 1 -- 172.21.15.60:0/3610388521 shutdown_connections 2020-10-31T22:41:16.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9359e700 1 --2- 172.21.15.60:0/3610388521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c940b0950 0x7f5c9405bc10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9359e700 1 --2- 172.21.15.60:0/3610388521 >> v2:172.21.15.66:3300/0 conn(0x7f5c940b1d50 0x7f5c940b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9359e700 1 -- 172.21.15.60:0/3610388521 >> 172.21.15.60:0/3610388521 conn(0x7f5c940b5300 msgr2=0x7f5c940b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:16.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9359e700 1 -- 172.21.15.60:0/3610388521 shutdown_connections 2020-10-31T22:41:16.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9359e700 1 -- 172.21.15.60:0/3610388521 wait complete. 2020-10-31T22:41:16.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9359e700 1 Processor -- start 2020-10-31T22:41:16.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9359e700 1 -- start start 2020-10-31T22:41:16.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c940b0950 0x7f5c94151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c940b1d50 0x7f5c940aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c94141d80 0x7f5c941483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c94148a40 con 0x7f5c94141d80 2020-10-31T22:41:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c94150a30 con 0x7f5c940b0950 2020-10-31T22:41:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c94150cd0 con 0x7f5c940b1d50 2020-10-31T22:41:16.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c92d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c94141d80 0x7f5c941483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c92d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c94141d80 0x7f5c941483a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41524/0 (socket says 172.21.15.60:41524) 2020-10-31T22:41:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c92d9d700 1 -- 172.21.15.60:0/1717162107 learned_addr learned my addr 172.21.15.60:0/1717162107 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c9259c700 1 --2- 172.21.15.60:0/1717162107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c940b0950 0x7f5c94151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.091+0000 7f5c91d9b700 1 --2- 172.21.15.60:0/1717162107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c940b1d50 0x7f5c940aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c92d9d700 1 -- 172.21.15.60:0/1717162107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c940b1d50 msgr2=0x7f5c940aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c92d9d700 1 --2- 172.21.15.60:0/1717162107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c940b1d50 0x7f5c940aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c92d9d700 1 -- 172.21.15.60:0/1717162107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c940b0950 msgr2=0x7f5c94151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c92d9d700 1 --2- 172.21.15.60:0/1717162107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c940b0950 0x7f5c94151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c92d9d700 1 -- 172.21.15.60:0/1717162107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c94150f70 con 0x7f5c94141d80 2020-10-31T22:41:16.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c92d9d700 1 --2- 172.21.15.60:0/1717162107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c94141d80 0x7f5c941483a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f5c8c0032b0 tx=0x7f5c8c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:16.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c837fe700 1 -- 172.21.15.60:0/1717162107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c8c011d90 con 0x7f5c94141d80 2020-10-31T22:41:16.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c9359e700 1 -- 172.21.15.60:0/1717162107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c940aabd0 con 0x7f5c94141d80 2020-10-31T22:41:16.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c837fe700 1 -- 172.21.15.60:0/1717162107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c8c01f3f0 con 0x7f5c94141d80 2020-10-31T22:41:16.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c837fe700 1 -- 172.21.15.60:0/1717162107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c8c01f750 con 0x7f5c94141d80 2020-10-31T22:41:16.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c9359e700 1 -- 172.21.15.60:0/1717162107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c94142fd0 con 0x7f5c94141d80 2020-10-31T22:41:16.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c9359e700 1 -- 172.21.15.60:0/1717162107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c94148890 con 0x7f5c94141d80 2020-10-31T22:41:16.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c837fe700 1 -- 172.21.15.60:0/1717162107 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5c8c026030 con 0x7f5c94141d80 2020-10-31T22:41:16.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c837fe700 1 --2- 172.21.15.60:0/1717162107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c70055020 0x7f5c700574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c837fe700 1 -- 172.21.15.60:0/1717162107 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5c8c06e760 con 0x7f5c94141d80 2020-10-31T22:41:16.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.095+0000 7f5c9259c700 1 --2- 172.21.15.60:0/1717162107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c70055020 0x7f5c700574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.099+0000 7f5c9259c700 1 --2- 172.21.15.60:0/1717162107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c70055020 0x7f5c700574e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f5c8400b000 tx=0x7f5c84006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:16.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.099+0000 7f5c837fe700 1 -- 172.21.15.60:0/1717162107 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5c8c044cc0 con 0x7f5c94141d80 2020-10-31T22:41:16.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.243+0000 7f5c9359e700 1 -- 172.21.15.60:0/1717162107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5c94057100 con 0x7f5c94141d80 2020-10-31T22:41:16.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.243+0000 7f5c837fe700 1 -- 172.21.15.60:0/1717162107 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5c8c024020 con 0x7f5c94141d80 2020-10-31T22:41:16.247 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2020-10-31T22:41:16.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.243+0000 7f5c9359e700 1 -- 172.21.15.60:0/1717162107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c70055020 msgr2=0x7f5c700574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.243+0000 7f5c9359e700 1 --2- 172.21.15.60:0/1717162107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c70055020 0x7f5c700574e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f5c8400b000 tx=0x7f5c84006dc0).stop 2020-10-31T22:41:16.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.243+0000 7f5c9359e700 1 -- 172.21.15.60:0/1717162107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c94141d80 msgr2=0x7f5c941483a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.243+0000 7f5c9359e700 1 --2- 172.21.15.60:0/1717162107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c94141d80 0x7f5c941483a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f5c8c0032b0 tx=0x7f5c8c016000).stop 2020-10-31T22:41:16.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.247+0000 7f5c9359e700 1 -- 172.21.15.60:0/1717162107 shutdown_connections 2020-10-31T22:41:16.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.247+0000 7f5c9359e700 1 --2- 172.21.15.60:0/1717162107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c94141d80 0x7f5c941483a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.247+0000 7f5c9359e700 1 --2- 172.21.15.60:0/1717162107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c70055020 0x7f5c700574e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.247+0000 7f5c9359e700 1 --2- 172.21.15.60:0/1717162107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c940b0950 0x7f5c94151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.247+0000 7f5c9359e700 1 --2- 172.21.15.60:0/1717162107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c940b1d50 0x7f5c940aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.247+0000 7f5c9359e700 1 -- 172.21.15.60:0/1717162107 >> 172.21.15.60:0/1717162107 conn(0x7f5c940b5300 msgr2=0x7f5c940b2770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:16.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.247+0000 7f5c9359e700 1 -- 172.21.15.60:0/1717162107 shutdown_connections 2020-10-31T22:41:16.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.247+0000 7f5c9359e700 1 -- 172.21.15.60:0/1717162107 wait complete. 2020-10-31T22:41:16.263 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2020-10-31T22:41:16.264 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-10-31T22:41:16.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.383+0000 7f4089437700 1 Processor -- start 2020-10-31T22:41:16.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.383+0000 7f4089437700 1 -- start start 2020-10-31T22:41:16.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4089437700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40840b24a0 0x7f40840b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4089437700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4084141fe0 0x7f4084142450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4089437700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4084145180 con 0x7f40840b5570 2020-10-31T22:41:16.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4089437700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40840afae0 con 0x7f4084141fe0 2020-10-31T22:41:16.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4089437700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4084141bf0 con 0x7f40840b24a0 2020-10-31T22:41:16.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4088c36700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4084141fe0 0x7f4084142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4083fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f40840b5570 0x7f4084145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45664/0 (socket says 172.21.15.60:45664) 2020-10-31T22:41:16.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f40837fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40840b24a0 0x7f40840b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4083fff700 1 -- 172.21.15.60:0/4056053247 learned_addr learned my addr 172.21.15.60:0/4056053247 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4088c36700 1 -- 172.21.15.60:0/4056053247 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40840b24a0 msgr2=0x7f40840b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4088c36700 1 --2- 172.21.15.60:0/4056053247 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40840b24a0 0x7f40840b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4088c36700 1 -- 172.21.15.60:0/4056053247 >> v1:172.21.15.60:6789/0 conn(0x7f40840b5570 legacy=0x7f4084145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4088c36700 1 -- 172.21.15.60:0/4056053247 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40840b0670 con 0x7f4084141fe0 2020-10-31T22:41:16.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4088c36700 1 --2- 172.21.15.60:0/4056053247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4084141fe0 0x7f4084142450 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4084061290 tx=0x7f407c0091a0).ready entity=mon.0 client_cookie=15102fa3df0f08aa server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:16.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4082ffd700 1 -- 172.21.15.60:0/4056053247 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f407c00b9b0 con 0x7f4084141fe0 2020-10-31T22:41:16.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4082ffd700 1 -- 172.21.15.60:0/4056053247 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c00bb10 con 0x7f4084141fe0 2020-10-31T22:41:16.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4082ffd700 1 -- 172.21.15.60:0/4056053247 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f407c00bc80 con 0x7f4084141fe0 2020-10-31T22:41:16.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4089437700 1 -- 172.21.15.60:0/4056053247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4084141fe0 msgr2=0x7f4084142450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4089437700 1 --2- 172.21.15.60:0/4056053247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4084141fe0 0x7f4084142450 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f4084061290 tx=0x7f407c0091a0).stop 2020-10-31T22:41:16.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4089437700 1 -- 172.21.15.60:0/4056053247 shutdown_connections 2020-10-31T22:41:16.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4089437700 1 --2- 172.21.15.60:0/4056053247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4084141fe0 0x7f4084142450 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4089437700 1 --2- 172.21.15.60:0/4056053247 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40840b24a0 0x7f40840b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4089437700 1 -- 172.21.15.60:0/4056053247 >> 172.21.15.60:0/4056053247 conn(0x7f40840b8e90 msgr2=0x7f40840b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:16.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4089437700 1 -- 172.21.15.60:0/4056053247 shutdown_connections 2020-10-31T22:41:16.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.387+0000 7f4089437700 1 -- 172.21.15.60:0/4056053247 wait complete. 2020-10-31T22:41:16.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f4089437700 1 Processor -- start 2020-10-31T22:41:16.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f4089437700 1 -- start start 2020-10-31T22:41:16.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f4089437700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40840b24a0 0x7f408413fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f4089437700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40840b5570 0x7f40841512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f4089437700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4084141fe0 0x7f40841517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f4089437700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4084150c40 con 0x7f40840b5570 2020-10-31T22:41:16.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f4089437700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4084139730 con 0x7f4084141fe0 2020-10-31T22:41:16.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f4089437700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408413ebb0 con 0x7f40840b24a0 2020-10-31T22:41:16.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f40837fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40840b5570 0x7f40841512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f40837fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40840b5570 0x7f40841512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41536/0 (socket says 172.21.15.60:41536) 2020-10-31T22:41:16.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f40837fe700 1 -- 172.21.15.60:0/585897375 learned_addr learned my addr 172.21.15.60:0/585897375 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:16.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f4083fff700 1 --2- 172.21.15.60:0/585897375 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40840b24a0 0x7f408413fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f4088c36700 1 --2- 172.21.15.60:0/585897375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4084141fe0 0x7f40841517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f40837fe700 1 -- 172.21.15.60:0/585897375 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40840b24a0 msgr2=0x7f408413fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f40837fe700 1 --2- 172.21.15.60:0/585897375 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40840b24a0 0x7f408413fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f40837fe700 1 -- 172.21.15.60:0/585897375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4084141fe0 msgr2=0x7f40841517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f40837fe700 1 --2- 172.21.15.60:0/585897375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4084141fe0 0x7f40841517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f40837fe700 1 -- 172.21.15.60:0/585897375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408413ee50 con 0x7f40840b5570 2020-10-31T22:41:16.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f40837fe700 1 --2- 172.21.15.60:0/585897375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40840b5570 0x7f40841512d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f407400c000 tx=0x7f4074006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:16.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f40817fa700 1 -- 172.21.15.60:0/585897375 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f407400ca10 con 0x7f40840b5570 2020-10-31T22:41:16.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f40817fa700 1 -- 172.21.15.60:0/585897375 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407400cb70 con 0x7f40840b5570 2020-10-31T22:41:16.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f4089437700 1 -- 172.21.15.60:0/585897375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4084150e30 con 0x7f40840b5570 2020-10-31T22:41:16.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.391+0000 7f40817fa700 1 -- 172.21.15.60:0/585897375 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40740123f0 con 0x7f40840b5570 2020-10-31T22:41:16.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.395+0000 7f4089437700 1 -- 172.21.15.60:0/585897375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408413e8a0 con 0x7f40840b5570 2020-10-31T22:41:16.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.395+0000 7f4089437700 1 -- 172.21.15.60:0/585897375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4084150fc0 con 0x7f40840b5570 2020-10-31T22:41:16.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.395+0000 7f40817fa700 1 -- 172.21.15.60:0/585897375 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4074012550 con 0x7f40840b5570 2020-10-31T22:41:16.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.395+0000 7f40817fa700 1 --2- 172.21.15.60:0/585897375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f40640550c0 0x7f4064057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.395+0000 7f40817fa700 1 -- 172.21.15.60:0/585897375 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f407406ddc0 con 0x7f40840b5570 2020-10-31T22:41:16.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.395+0000 7f4083fff700 1 --2- 172.21.15.60:0/585897375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f40640550c0 0x7f4064057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.395+0000 7f4083fff700 1 --2- 172.21.15.60:0/585897375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f40640550c0 0x7f4064057580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f407800d000 tx=0x7f4078009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:16.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.403+0000 7f40817fa700 1 -- 172.21.15.60:0/585897375 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4074044280 con 0x7f40840b5570 2020-10-31T22:41:16.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.543+0000 7f4089437700 1 -- 172.21.15.60:0/585897375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4084057100 con 0x7f40840b5570 2020-10-31T22:41:16.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.543+0000 7f40817fa700 1 -- 172.21.15.60:0/585897375 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f40740478a0 con 0x7f40840b5570 2020-10-31T22:41:16.547 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2020-10-31T22:41:16.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.547+0000 7f4089437700 1 -- 172.21.15.60:0/585897375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f40640550c0 msgr2=0x7f4064057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.547+0000 7f4089437700 1 --2- 172.21.15.60:0/585897375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f40640550c0 0x7f4064057580 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f407800d000 tx=0x7f4078009040).stop 2020-10-31T22:41:16.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.547+0000 7f4089437700 1 -- 172.21.15.60:0/585897375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40840b5570 msgr2=0x7f40841512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.547+0000 7f4089437700 1 --2- 172.21.15.60:0/585897375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40840b5570 0x7f40841512d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f407400c000 tx=0x7f4074006dc0).stop 2020-10-31T22:41:16.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.547+0000 7f4089437700 1 -- 172.21.15.60:0/585897375 shutdown_connections 2020-10-31T22:41:16.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.547+0000 7f4089437700 1 --2- 172.21.15.60:0/585897375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f40640550c0 0x7f4064057580 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.547+0000 7f4089437700 1 --2- 172.21.15.60:0/585897375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4084141fe0 0x7f40841517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.547+0000 7f4089437700 1 --2- 172.21.15.60:0/585897375 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40840b24a0 0x7f408413fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.547+0000 7f4089437700 1 --2- 172.21.15.60:0/585897375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40840b5570 0x7f40841512d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.547+0000 7f4089437700 1 -- 172.21.15.60:0/585897375 >> 172.21.15.60:0/585897375 conn(0x7f40840b8e90 msgr2=0x7f408405fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.547+0000 7f4089437700 1 -- 172.21.15.60:0/585897375 shutdown_connections 2020-10-31T22:41:16.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.547+0000 7f4089437700 1 -- 172.21.15.60:0/585897375 wait complete. 2020-10-31T22:41:16.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2020-10-31T22:41:16.561 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-10-31T22:41:16.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c71cc0700 1 Processor -- start 2020-10-31T22:41:16.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c71cc0700 1 -- start start 2020-10-31T22:41:16.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c71cc0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1c6c05b320 0x7f1c6c0b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c71cc0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1c6c0acc80 0x7f1c6c0b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c71cc0700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6c05b700 con 0x7f1c6c140420 2020-10-31T22:41:16.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c71cc0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c6c0b2830 con 0x7f1c6c05b320 2020-10-31T22:41:16.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c71cc0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c1408a0 con 0x7f1c6c0acc80 2020-10-31T22:41:16.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c70cbe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1c6c05b320 0x7f1c6c0b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c70cbe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1c6c05b320 0x7f1c6c0b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41542/0 (socket says 172.21.15.60:41542) 2020-10-31T22:41:16.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c70cbe700 1 -- 172.21.15.60:0/2045205300 learned_addr learned my addr 172.21.15.60:0/2045205300 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:16.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c714bf700 1 --2- 172.21.15.60:0/2045205300 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1c6c0acc80 0x7f1c6c0b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c70cbe700 1 -- 172.21.15.60:0/2045205300 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1c6c0acc80 msgr2=0x7f1c6c0b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:16.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c70cbe700 1 --2- 172.21.15.60:0/2045205300 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1c6c0acc80 0x7f1c6c0b2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c70cbe700 1 -- 172.21.15.60:0/2045205300 >> v1:172.21.15.66:6789/0 conn(0x7f1c6c140420 legacy=0x7f1c6c0ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c70cbe700 1 -- 172.21.15.60:0/2045205300 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c0b0220 con 0x7f1c6c05b320 2020-10-31T22:41:16.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c70cbe700 1 --2- 172.21.15.60:0/2045205300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c6c05b320 0x7f1c6c0b1e50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f1c5c0032b0 tx=0x7f1c5c009270).ready entity=mon.0 client_cookie=efda5fef143ad040 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:16.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c6b7fe700 1 -- 172.21.15.60:0/2045205300 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c5c009e60 con 0x7f1c6c05b320 2020-10-31T22:41:16.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c6b7fe700 1 -- 172.21.15.60:0/2045205300 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c00bc00 con 0x7f1c6c05b320 2020-10-31T22:41:16.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c6b7fe700 1 -- 172.21.15.60:0/2045205300 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c5c00bd70 con 0x7f1c6c05b320 2020-10-31T22:41:16.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2045205300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c6c05b320 msgr2=0x7f1c6c0b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.675+0000 7f1c71cc0700 1 --2- 172.21.15.60:0/2045205300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c6c05b320 0x7f1c6c0b1e50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f1c5c0032b0 tx=0x7f1c5c009270).stop 2020-10-31T22:41:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2045205300 shutdown_connections 2020-10-31T22:41:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c71cc0700 1 --2- 172.21.15.60:0/2045205300 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1c6c0acc80 0x7f1c6c0b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c71cc0700 1 --2- 172.21.15.60:0/2045205300 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c6c05b320 0x7f1c6c0b1e50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2045205300 >> 172.21.15.60:0/2045205300 conn(0x7f1c6c0b61d0 msgr2=0x7f1c6c0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:16.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2045205300 shutdown_connections 2020-10-31T22:41:16.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2045205300 wait complete. 2020-10-31T22:41:16.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c71cc0700 1 Processor -- start 2020-10-31T22:41:16.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c71cc0700 1 -- start start 2020-10-31T22:41:16.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c71cc0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1c6c05b320 0x7f1c6c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c71cc0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c6c0acc80 0x7f1c6c151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c71cc0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c6c140420 0x7f1c6c05f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c71cc0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c150cf0 con 0x7f1c6c0acc80 2020-10-31T22:41:16.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c71cc0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c151b50 con 0x7f1c6c140420 2020-10-31T22:41:16.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c71cc0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c060680 con 0x7f1c6c05b320 2020-10-31T22:41:16.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c70cbe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1c6c05b320 0x7f1c6c13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c70cbe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1c6c05b320 0x7f1c6c13eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:54736/0 (socket says 172.21.15.60:54736) 2020-10-31T22:41:16.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c6bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c6c0acc80 0x7f1c6c151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c70cbe700 1 -- 172.21.15.60:0/2425362335 learned_addr learned my addr 172.21.15.60:0/2425362335 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:16.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c714bf700 1 --2- 172.21.15.60:0/2425362335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c6c140420 0x7f1c6c05f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c6bfff700 1 -- 172.21.15.60:0/2425362335 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1c6c05b320 msgr2=0x7f1c6c13eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c6bfff700 1 --2- 172.21.15.60:0/2425362335 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1c6c05b320 0x7f1c6c13eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c6bfff700 1 -- 172.21.15.60:0/2425362335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c6c140420 msgr2=0x7f1c6c05f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c6bfff700 1 --2- 172.21.15.60:0/2425362335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c6c140420 0x7f1c6c05f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c6bfff700 1 -- 172.21.15.60:0/2425362335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6c150f20 con 0x7f1c6c0acc80 2020-10-31T22:41:16.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.679+0000 7f1c70cbe700 1 --2- 172.21.15.60:0/2425362335 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1c6c05b320 0x7f1c6c13eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:16.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.683+0000 7f1c6bfff700 1 --2- 172.21.15.60:0/2425362335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c6c0acc80 0x7f1c6c151660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1c6c151ce0 tx=0x7f1c54007b60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:16.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.683+0000 7f1c69ffb700 1 -- 172.21.15.60:0/2425362335 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c54013410 con 0x7f1c6c0acc80 2020-10-31T22:41:16.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.683+0000 7f1c69ffb700 1 -- 172.21.15.60:0/2425362335 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c54013570 con 0x7f1c6c0acc80 2020-10-31T22:41:16.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.683+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2425362335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c1511c0 con 0x7f1c6c0acc80 2020-10-31T22:41:16.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.683+0000 7f1c69ffb700 1 -- 172.21.15.60:0/2425362335 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c540138d0 con 0x7f1c6c0acc80 2020-10-31T22:41:16.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.683+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2425362335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c05f8b0 con 0x7f1c6c0acc80 2020-10-31T22:41:16.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.683+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2425362335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c151350 con 0x7f1c6c0acc80 2020-10-31T22:41:16.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.683+0000 7f1c69ffb700 1 -- 172.21.15.60:0/2425362335 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1c54010030 con 0x7f1c6c0acc80 2020-10-31T22:41:16.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.683+0000 7f1c69ffb700 1 --2- 172.21.15.60:0/2425362335 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1c50054f90 0x7f1c50057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.683+0000 7f1c70cbe700 1 --2- 172.21.15.60:0/2425362335 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1c50054f90 0x7f1c50057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.683+0000 7f1c69ffb700 1 -- 172.21.15.60:0/2425362335 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1c5406d7d0 con 0x7f1c6c0acc80 2020-10-31T22:41:16.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.687+0000 7f1c70cbe700 1 --2- 172.21.15.60:0/2425362335 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1c50054f90 0x7f1c50057450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f1c5c01a000 tx=0x7f1c5c016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:16.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.691+0000 7f1c69ffb700 1 -- 172.21.15.60:0/2425362335 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1c54043cf0 con 0x7f1c6c0acc80 2020-10-31T22:41:16.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.831+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2425362335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1c6c057100 con 0x7f1c6c0acc80 2020-10-31T22:41:16.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.831+0000 7f1c69ffb700 1 -- 172.21.15.60:0/2425362335 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1c5406be60 con 0x7f1c6c0acc80 2020-10-31T22:41:16.835 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2020-10-31T22:41:16.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.835+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2425362335 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1c50054f90 msgr2=0x7f1c50057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.835+0000 7f1c71cc0700 1 --2- 172.21.15.60:0/2425362335 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1c50054f90 0x7f1c50057450 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f1c5c01a000 tx=0x7f1c5c016000).stop 2020-10-31T22:41:16.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.835+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2425362335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c6c0acc80 msgr2=0x7f1c6c151660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.835+0000 7f1c71cc0700 1 --2- 172.21.15.60:0/2425362335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c6c0acc80 0x7f1c6c151660 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f1c6c151ce0 tx=0x7f1c54007b60).stop 2020-10-31T22:41:16.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.835+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2425362335 shutdown_connections 2020-10-31T22:41:16.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.835+0000 7f1c71cc0700 1 --2- 172.21.15.60:0/2425362335 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1c50054f90 0x7f1c50057450 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.835+0000 7f1c71cc0700 1 --2- 172.21.15.60:0/2425362335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1c6c140420 0x7f1c6c05f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.835+0000 7f1c71cc0700 1 --2- 172.21.15.60:0/2425362335 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1c6c05b320 0x7f1c6c13eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.835+0000 7f1c71cc0700 1 --2- 172.21.15.60:0/2425362335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c6c0acc80 0x7f1c6c151660 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.835+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2425362335 >> 172.21.15.60:0/2425362335 conn(0x7f1c6c0b61d0 msgr2=0x7f1c6c0ad6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:16.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.835+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2425362335 shutdown_connections 2020-10-31T22:41:16.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.835+0000 7f1c71cc0700 1 -- 172.21.15.60:0/2425362335 wait complete. 2020-10-31T22:41:16.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2020-10-31T22:41:16.850 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-10-31T22:41:16.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.959+0000 7f36832bb700 1 Processor -- start 2020-10-31T22:41:16.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.959+0000 7f36832bb700 1 -- start start 2020-10-31T22:41:16.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f36832bb700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f367c062c70 0x7f367c1431a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f36832bb700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367c0b1c40 con 0x7f367c0afbe0 2020-10-31T22:41:16.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f36832bb700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f367c0b27d0 con 0x7f367c0a9120 2020-10-31T22:41:16.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f36832bb700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f367c13d620 con 0x7f367c062c70 2020-10-31T22:41:16.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f3681057700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f367c062c70 0x7f367c1431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f3681858700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f367c0afbe0 0x7f367c05b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45696/0 (socket says 172.21.15.60:45696) 2020-10-31T22:41:16.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f3681858700 1 -- 172.21.15.60:0/3570911234 learned_addr learned my addr 172.21.15.60:0/3570911234 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:16.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f3681057700 1 -- 172.21.15.60:0/3570911234 >> v1:172.21.15.66:6789/0 conn(0x7f367c0a9120 legacy=0x7f367c0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f3681057700 1 -- 172.21.15.60:0/3570911234 >> v1:172.21.15.60:6789/0 conn(0x7f367c0afbe0 legacy=0x7f367c05b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f3681057700 1 -- 172.21.15.60:0/3570911234 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c0b2a70 con 0x7f367c062c70 2020-10-31T22:41:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f3681057700 1 --2- 172.21.15.60:0/3570911234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f367c062c70 0x7f367c1431a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3678002f30 tx=0x7f3678006dc0).ready entity=mon.0 client_cookie=57e7192caab1322 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f366bfff700 1 -- 172.21.15.60:0/3570911234 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36780097f0 con 0x7f367c062c70 2020-10-31T22:41:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f366bfff700 1 -- 172.21.15.60:0/3570911234 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3678009950 con 0x7f367c062c70 2020-10-31T22:41:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f366bfff700 1 -- 172.21.15.60:0/3570911234 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3678009cb0 con 0x7f367c062c70 2020-10-31T22:41:16.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f36832bb700 1 -- 172.21.15.60:0/3570911234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f367c062c70 msgr2=0x7f367c1431a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f36832bb700 1 --2- 172.21.15.60:0/3570911234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f367c062c70 0x7f367c1431a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f3678002f30 tx=0x7f3678006dc0).stop 2020-10-31T22:41:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f36832bb700 1 -- 172.21.15.60:0/3570911234 shutdown_connections 2020-10-31T22:41:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f36832bb700 1 --2- 172.21.15.60:0/3570911234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f367c062c70 0x7f367c1431a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f36832bb700 1 -- 172.21.15.60:0/3570911234 >> 172.21.15.60:0/3570911234 conn(0x7f367c05fae0 msgr2=0x7f367c05fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:16.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f36832bb700 1 -- 172.21.15.60:0/3570911234 shutdown_connections 2020-10-31T22:41:16.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.963+0000 7f36832bb700 1 -- 172.21.15.60:0/3570911234 wait complete. 2020-10-31T22:41:16.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f36832bb700 1 Processor -- start 2020-10-31T22:41:16.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f36832bb700 1 -- start start 2020-10-31T22:41:16.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f36832bb700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f367c062c70 0x7f367c152930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f36832bb700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f367c0a9120 0x7f367c0a95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f36832bb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f367c0afbe0 0x7f367c142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f36832bb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c141350 con 0x7f367c0afbe0 2020-10-31T22:41:16.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f36832bb700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f367c153520 con 0x7f367c062c70 2020-10-31T22:41:16.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f36832bb700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f367c141550 con 0x7f367c0a9120 2020-10-31T22:41:16.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f3681858700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f367c0afbe0 0x7f367c142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f3681858700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f367c0afbe0 0x7f367c142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41566/0 (socket says 172.21.15.60:41566) 2020-10-31T22:41:16.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f3681858700 1 -- 172.21.15.60:0/250666499 learned_addr learned my addr 172.21.15.60:0/250666499 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:16.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f3680856700 1 --2- 172.21.15.60:0/250666499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f367c0a9120 0x7f367c0a95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f3681057700 1 --2- 172.21.15.60:0/250666499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f367c062c70 0x7f367c152930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f3681858700 1 -- 172.21.15.60:0/250666499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f367c0a9120 msgr2=0x7f367c0a95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f3681858700 1 --2- 172.21.15.60:0/250666499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f367c0a9120 0x7f367c0a95d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f3681858700 1 -- 172.21.15.60:0/250666499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f367c062c70 msgr2=0x7f367c152930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:16.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f3681858700 1 --2- 172.21.15.60:0/250666499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f367c062c70 0x7f367c152930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:16.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f3681858700 1 -- 172.21.15.60:0/250666499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f367c152fe0 con 0x7f367c0afbe0 2020-10-31T22:41:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f3681858700 1 --2- 172.21.15.60:0/250666499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f367c0afbe0 0x7f367c142ab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f367c13fc00 tx=0x7f3674007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f366a7fc700 1 -- 172.21.15.60:0/250666499 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3674005960 con 0x7f367c0afbe0 2020-10-31T22:41:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f366a7fc700 1 -- 172.21.15.60:0/250666499 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3674005ac0 con 0x7f367c0afbe0 2020-10-31T22:41:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f36832bb700 1 -- 172.21.15.60:0/250666499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f367c153280 con 0x7f367c0afbe0 2020-10-31T22:41:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f366a7fc700 1 -- 172.21.15.60:0/250666499 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3674005e20 con 0x7f367c0afbe0 2020-10-31T22:41:16.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.967+0000 7f36832bb700 1 -- 172.21.15.60:0/250666499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f367c140fd0 con 0x7f367c0afbe0 2020-10-31T22:41:16.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.971+0000 7f36832bb700 1 -- 172.21.15.60:0/250666499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f367c057100 con 0x7f367c0afbe0 2020-10-31T22:41:16.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.971+0000 7f366a7fc700 1 -- 172.21.15.60:0/250666499 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3674010030 con 0x7f367c0afbe0 2020-10-31T22:41:16.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.971+0000 7f366a7fc700 1 --2- 172.21.15.60:0/250666499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f365c055020 0x7f365c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:16.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.971+0000 7f366a7fc700 1 -- 172.21.15.60:0/250666499 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f367406d850 con 0x7f367c0afbe0 2020-10-31T22:41:16.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.971+0000 7f3681057700 1 --2- 172.21.15.60:0/250666499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f365c055020 0x7f365c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:16.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.971+0000 7f3681057700 1 --2- 172.21.15.60:0/250666499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f365c055020 0x7f365c0574e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f367801b000 tx=0x7f3678015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:16.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:16.979+0000 7f366a7fc700 1 -- 172.21.15.60:0/250666499 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3674043d70 con 0x7f367c0afbe0 2020-10-31T22:41:17.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.119+0000 7f36832bb700 1 -- 172.21.15.60:0/250666499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f367c0af0f0 con 0x7f367c0afbe0 2020-10-31T22:41:17.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.119+0000 7f366a7fc700 1 -- 172.21.15.60:0/250666499 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3674047390 con 0x7f367c0afbe0 2020-10-31T22:41:17.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.123+0000 7f36832bb700 1 -- 172.21.15.60:0/250666499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f365c055020 msgr2=0x7f365c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.123+0000 7f36832bb700 1 --2- 172.21.15.60:0/250666499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f365c055020 0x7f365c0574e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f367801b000 tx=0x7f3678015000).stop 2020-10-31T22:41:17.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.123+0000 7f36832bb700 1 -- 172.21.15.60:0/250666499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f367c0afbe0 msgr2=0x7f367c142ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.123+0000 7f36832bb700 1 --2- 172.21.15.60:0/250666499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f367c0afbe0 0x7f367c142ab0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f367c13fc00 tx=0x7f3674007e50).stop 2020-10-31T22:41:17.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.123+0000 7f36832bb700 1 -- 172.21.15.60:0/250666499 shutdown_connections 2020-10-31T22:41:17.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.123+0000 7f36832bb700 1 --2- 172.21.15.60:0/250666499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f367c0afbe0 0x7f367c142ab0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.123+0000 7f36832bb700 1 --2- 172.21.15.60:0/250666499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f365c055020 0x7f365c0574e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.123+0000 7f36832bb700 1 --2- 172.21.15.60:0/250666499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f367c062c70 0x7f367c152930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.123+0000 7f36832bb700 1 --2- 172.21.15.60:0/250666499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f367c0a9120 0x7f367c0a95d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.123+0000 7f36832bb700 1 -- 172.21.15.60:0/250666499 >> 172.21.15.60:0/250666499 conn(0x7f367c05fae0 msgr2=0x7f367c0b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:17.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.123+0000 7f36832bb700 1 -- 172.21.15.60:0/250666499 shutdown_connections 2020-10-31T22:41:17.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.123+0000 7f36832bb700 1 -- 172.21.15.60:0/250666499 wait complete. 2020-10-31T22:41:17.139 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2020-10-31T22:41:17.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2020-10-31T22:41:17.143 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-10-31T22:41:17.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567c840700 1 Processor -- start 2020-10-31T22:41:17.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567c840700 1 -- start start 2020-10-31T22:41:17.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567c840700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56780ac870 0x7f56780b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567c840700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f56780ae8b0 0x7f56781412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567c840700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56780acc50 con 0x7f56780b0e20 2020-10-31T22:41:17.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567c840700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56780b14c0 con 0x7f56780ae8b0 2020-10-31T22:41:17.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567c840700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56780b5690 con 0x7f56780ac870 2020-10-31T22:41:17.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f56780b0e20 0x7f56780ae1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45708/0 (socket says 172.21.15.60:45708) 2020-10-31T22:41:17.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567659c700 1 -- 172.21.15.60:0/3148756981 learned_addr learned my addr 172.21.15.60:0/3148756981 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:17.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5676d9d700 1 --2- 172.21.15.60:0/3148756981 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56780ac870 0x7f56780b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567759e700 1 --2- 172.21.15.60:0/3148756981 >> v2:172.21.15.66:3300/0 conn(0x7f56780ae8b0 0x7f56781412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 -- 172.21.15.60:0/3148756981 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1981911249 0 0) 0x7f56780acc50 con 0x7f56780b0e20 2020-10-31T22:41:17.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 -- 172.21.15.60:0/3148756981 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5658003230 con 0x7f56780b0e20 2020-10-31T22:41:17.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 -- 172.21.15.60:0/3148756981 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3650045608 0 0) 0x7f5658003230 con 0x7f56780b0e20 2020-10-31T22:41:17.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 -- 172.21.15.60:0/3148756981 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56780ac870 msgr2=0x7f56780b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:17.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 --2- 172.21.15.60:0/3148756981 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56780ac870 0x7f56780b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 -- 172.21.15.60:0/3148756981 >> v2:172.21.15.66:3300/0 conn(0x7f56780ae8b0 msgr2=0x7f56781412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:17.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 --2- 172.21.15.60:0/3148756981 >> v2:172.21.15.66:3300/0 conn(0x7f56780ae8b0 0x7f56781412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 -- 172.21.15.60:0/3148756981 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56780afc10 con 0x7f56780b0e20 2020-10-31T22:41:17.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 -- 172.21.15.60:0/3148756981 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f56600016d0 con 0x7f56780b0e20 2020-10-31T22:41:17.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 -- 172.21.15.60:0/3148756981 >> v1:172.21.15.60:6789/0 conn(0x7f56780b0e20 legacy=0x7f56780ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 --2- 172.21.15.60:0/3148756981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5658003720 0x7f5658003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 --2- 172.21.15.60:0/3148756981 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56780ac870 0x7f56580044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 --2- 172.21.15.60:0/3148756981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56580049c0 0x7f5658004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 -- 172.21.15.60:0/3148756981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780b14c0 con 0x7f5658003720 2020-10-31T22:41:17.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 -- 172.21.15.60:0/3148756981 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780b5690 con 0x7f56580049c0 2020-10-31T22:41:17.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 -- 172.21.15.60:0/3148756981 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56580041c0 con 0x7f56780ac870 2020-10-31T22:41:17.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5676d9d700 1 --2- 172.21.15.60:0/3148756981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5658003720 0x7f5658003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567659c700 1 --2- 172.21.15.60:0/3148756981 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56780ac870 0x7f56580044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567759e700 1 --2- 172.21.15.60:0/3148756981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56580049c0 0x7f5658004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5676d9d700 1 -- 172.21.15.60:0/3148756981 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56780ac870 msgr2=0x7f56580044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:17.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5676d9d700 1 --2- 172.21.15.60:0/3148756981 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56780ac870 0x7f56580044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5676d9d700 1 -- 172.21.15.60:0/3148756981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56580049c0 msgr2=0x7f5658004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:17.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5676d9d700 1 --2- 172.21.15.60:0/3148756981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56580049c0 0x7f5658004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5676d9d700 1 -- 172.21.15.60:0/3148756981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5658003230 con 0x7f5658003720 2020-10-31T22:41:17.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5676d9d700 1 --2- 172.21.15.60:0/3148756981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5658003720 0x7f5658003b40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f566800c000 tx=0x7f56680091a0).ready entity=mon.0 client_cookie=d9995b21dffa2d85 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:17.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 -- 172.21.15.60:0/3148756981 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f566800ed00 con 0x7f5658003720 2020-10-31T22:41:17.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 -- 172.21.15.60:0/3148756981 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566800ee60 con 0x7f5658003720 2020-10-31T22:41:17.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f5675d9b700 1 -- 172.21.15.60:0/3148756981 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56680125e0 con 0x7f5658003720 2020-10-31T22:41:17.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567c840700 1 -- 172.21.15.60:0/3148756981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5658003720 msgr2=0x7f5658003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567c840700 1 --2- 172.21.15.60:0/3148756981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5658003720 0x7f5658003b40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f566800c000 tx=0x7f56680091a0).stop 2020-10-31T22:41:17.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.255+0000 7f567759e700 1 -- 172.21.15.60:0/3148756981 reap_dead start 2020-10-31T22:41:17.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567c840700 1 -- 172.21.15.60:0/3148756981 shutdown_connections 2020-10-31T22:41:17.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567c840700 1 -- 172.21.15.60:0/3148756981 >> 172.21.15.60:0/3148756981 conn(0x7f567806a600 msgr2=0x7f5678060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:17.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567c840700 1 -- 172.21.15.60:0/3148756981 shutdown_connections 2020-10-31T22:41:17.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567c840700 1 -- 172.21.15.60:0/3148756981 wait complete. 2020-10-31T22:41:17.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567c840700 1 Processor -- start 2020-10-31T22:41:17.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567c840700 1 -- start start 2020-10-31T22:41:17.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567c840700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f567805b530 0x7f5678154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567c840700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56781509e0 0x7f5678150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567c840700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5678064eb0 0x7f5678065360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567c840700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567805b910 con 0x7f56781509e0 2020-10-31T22:41:17.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567c840700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5678154130 con 0x7f5678064eb0 2020-10-31T22:41:17.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567c840700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56781543d0 con 0x7f567805b530 2020-10-31T22:41:17.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56781509e0 0x7f5678150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56781509e0 0x7f5678150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41586/0 (socket says 172.21.15.60:41586) 2020-10-31T22:41:17.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f5676d9d700 1 --2- 172.21.15.60:0/3116751458 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f567805b530 0x7f5678154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567659c700 1 -- 172.21.15.60:0/3116751458 learned_addr learned my addr 172.21.15.60:0/3116751458 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:17.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567759e700 1 --2- 172.21.15.60:0/3116751458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5678064eb0 0x7f5678065360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567659c700 1 -- 172.21.15.60:0/3116751458 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f567805b530 msgr2=0x7f5678154b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567659c700 1 --2- 172.21.15.60:0/3116751458 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f567805b530 0x7f5678154b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567659c700 1 -- 172.21.15.60:0/3116751458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5678064eb0 msgr2=0x7f5678065360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567659c700 1 --2- 172.21.15.60:0/3116751458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5678064eb0 0x7f5678065360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.259+0000 7f567659c700 1 -- 172.21.15.60:0/3116751458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5678154670 con 0x7f56781509e0 2020-10-31T22:41:17.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.263+0000 7f567659c700 1 --2- 172.21.15.60:0/3116751458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56781509e0 0x7f5678150e60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f566000b000 tx=0x7f56600014e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:17.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.263+0000 7f566ffff700 1 -- 172.21.15.60:0/3116751458 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f566000c9a0 con 0x7f56781509e0 2020-10-31T22:41:17.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.263+0000 7f566ffff700 1 -- 172.21.15.60:0/3116751458 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566000ee90 con 0x7f56781509e0 2020-10-31T22:41:17.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.263+0000 7f567c840700 1 -- 172.21.15.60:0/3116751458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f567814e620 con 0x7f56781509e0 2020-10-31T22:41:17.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.263+0000 7f566ffff700 1 -- 172.21.15.60:0/3116751458 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f566000ccf0 con 0x7f56781509e0 2020-10-31T22:41:17.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.263+0000 7f567c840700 1 -- 172.21.15.60:0/3116751458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5678064b10 con 0x7f56781509e0 2020-10-31T22:41:17.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.263+0000 7f567c840700 1 -- 172.21.15.60:0/3116751458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56780a8680 con 0x7f56781509e0 2020-10-31T22:41:17.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.263+0000 7f566ffff700 1 -- 172.21.15.60:0/3116751458 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5660014430 con 0x7f56781509e0 2020-10-31T22:41:17.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.263+0000 7f566ffff700 1 --2- 172.21.15.60:0/3116751458 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f565c054f90 0x7f565c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.263+0000 7f566ffff700 1 -- 172.21.15.60:0/3116751458 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f566006d7a0 con 0x7f56781509e0 2020-10-31T22:41:17.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.263+0000 7f5676d9d700 1 --2- 172.21.15.60:0/3116751458 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f565c054f90 0x7f565c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.263+0000 7f5676d9d700 1 --2- 172.21.15.60:0/3116751458 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f565c054f90 0x7f565c057450 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f566801d000 tx=0x7f566801a000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:17.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.271+0000 7f566ffff700 1 -- 172.21.15.60:0/3116751458 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5660043bc0 con 0x7f56781509e0 2020-10-31T22:41:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.415+0000 7f567c840700 1 -- 172.21.15.60:0/3116751458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5678154800 con 0x7f56781509e0 2020-10-31T22:41:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.419+0000 7f566ffff700 1 -- 172.21.15.60:0/3116751458 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f56600471e0 con 0x7f56781509e0 2020-10-31T22:41:17.421 INFO:teuthology.orchestra.run.smithi060.stdout:55834574852 2020-10-31T22:41:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.419+0000 7f567c840700 1 -- 172.21.15.60:0/3116751458 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f565c054f90 msgr2=0x7f565c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.419+0000 7f567c840700 1 --2- 172.21.15.60:0/3116751458 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f565c054f90 0x7f565c057450 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f566801d000 tx=0x7f566801a000).stop 2020-10-31T22:41:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.419+0000 7f567c840700 1 -- 172.21.15.60:0/3116751458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56781509e0 msgr2=0x7f5678150e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.419+0000 7f567c840700 1 --2- 172.21.15.60:0/3116751458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56781509e0 0x7f5678150e60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f566000b000 tx=0x7f56600014e0).stop 2020-10-31T22:41:17.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.419+0000 7f567c840700 1 -- 172.21.15.60:0/3116751458 shutdown_connections 2020-10-31T22:41:17.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.419+0000 7f567c840700 1 --2- 172.21.15.60:0/3116751458 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f565c054f90 0x7f565c057450 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.419+0000 7f567c840700 1 --2- 172.21.15.60:0/3116751458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5678064eb0 0x7f5678065360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.419+0000 7f567c840700 1 --2- 172.21.15.60:0/3116751458 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f567805b530 0x7f5678154b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.419+0000 7f567c840700 1 --2- 172.21.15.60:0/3116751458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56781509e0 0x7f5678150e60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.419+0000 7f567c840700 1 -- 172.21.15.60:0/3116751458 >> 172.21.15.60:0/3116751458 conn(0x7f567806a600 msgr2=0x7f56780b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:17.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.419+0000 7f567c840700 1 -- 172.21.15.60:0/3116751458 shutdown_connections 2020-10-31T22:41:17.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.419+0000 7f567c840700 1 -- 172.21.15.60:0/3116751458 wait complete. 2020-10-31T22:41:17.435 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2020-10-31T22:41:17.436 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-10-31T22:41:17.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff407fff700 1 Processor -- start 2020-10-31T22:41:17.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff407fff700 1 -- start start 2020-10-31T22:41:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff407fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4080b24a0 0x7ff4080b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff407fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff408145180 con 0x7ff4080b5570 2020-10-31T22:41:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff407fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4080b0670 con 0x7ff408141fe0 2020-10-31T22:41:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff407fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080afae0 con 0x7ff4080b24a0 2020-10-31T22:41:17.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff406ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff4080b5570 0x7ff408145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45726/0 (socket says 172.21.15.60:45726) 2020-10-31T22:41:17.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff406ffd700 1 -- 172.21.15.60:0/3804508107 learned_addr learned my addr 172.21.15.60:0/3804508107 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:17.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff3fe7fc700 1 --2- 172.21.15.60:0/3804508107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4080b24a0 0x7ff4080b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699906137 0 0) 0x7ff408145180 con 0x7ff4080b5570 2020-10-31T22:41:17.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3e8003230 con 0x7ff4080b5570 2020-10-31T22:41:17.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665123520 0 0) 0x7ff4080b0670 con 0x7ff408141fe0 2020-10-31T22:41:17.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff408145180 con 0x7ff408141fe0 2020-10-31T22:41:17.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1909728940 0 0) 0x7ff3e8003230 con 0x7ff4080b5570 2020-10-31T22:41:17.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4080b24a0 msgr2=0x7ff4080b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:17.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 --2- 172.21.15.60:0/3804508107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4080b24a0 0x7ff4080b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 >> v1:172.21.15.66:6789/0 conn(0x7ff408141fe0 legacy=0x7ff408142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080b0910 con 0x7ff4080b5570 2020-10-31T22:41:17.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7ff3f80016d0 con 0x7ff4080b5570 2020-10-31T22:41:17.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 >> v1:172.21.15.60:6789/0 conn(0x7ff4080b5570 legacy=0x7ff408145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 --2- 172.21.15.60:0/3804508107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3e80038e0 0x7ff3e8003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 --2- 172.21.15.60:0/3804508107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e80044d0 0x7ff3e8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 --2- 172.21.15.60:0/3804508107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4080b24a0 0x7ff3e8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080afae0 con 0x7ff3e80044d0 2020-10-31T22:41:17.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e8005330 con 0x7ff3e80038e0 2020-10-31T22:41:17.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3e800b750 con 0x7ff4080b24a0 2020-10-31T22:41:17.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff3fe7fc700 1 --2- 172.21.15.60:0/3804508107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e80044d0 0x7ff3e8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff406ffd700 1 --2- 172.21.15.60:0/3804508107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3e80038e0 0x7ff3e8003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff4077fe700 1 --2- 172.21.15.60:0/3804508107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4080b24a0 0x7ff3e8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff3fe7fc700 1 -- 172.21.15.60:0/3804508107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4080b24a0 msgr2=0x7ff3e8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:17.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff3fe7fc700 1 --2- 172.21.15.60:0/3804508107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4080b24a0 0x7ff3e8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff3fe7fc700 1 -- 172.21.15.60:0/3804508107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3e80038e0 msgr2=0x7ff3e8003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:17.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff3fe7fc700 1 --2- 172.21.15.60:0/3804508107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3e80038e0 0x7ff3e8003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.551+0000 7ff3fe7fc700 1 -- 172.21.15.60:0/3804508107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3e8003230 con 0x7ff3e80044d0 2020-10-31T22:41:17.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff3fe7fc700 1 --2- 172.21.15.60:0/3804508107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e80044d0 0x7ff3e8004950 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7ff3f000c000 tx=0x7ff3f0008040).ready entity=mon.0 client_cookie=10492b2b263dcdc9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:17.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3f000e8a0 con 0x7ff3e80044d0 2020-10-31T22:41:17.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f000ea00 con 0x7ff3e80044d0 2020-10-31T22:41:17.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff4067fc700 1 -- 172.21.15.60:0/3804508107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3f000ed60 con 0x7ff3e80044d0 2020-10-31T22:41:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff407fff700 1 -- 172.21.15.60:0/3804508107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e80044d0 msgr2=0x7ff3e8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff407fff700 1 --2- 172.21.15.60:0/3804508107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3e80044d0 0x7ff3e8004950 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7ff3f000c000 tx=0x7ff3f0008040).stop 2020-10-31T22:41:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff4077fe700 1 -- 172.21.15.60:0/3804508107 reap_dead start 2020-10-31T22:41:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff407fff700 1 -- 172.21.15.60:0/3804508107 shutdown_connections 2020-10-31T22:41:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff407fff700 1 -- 172.21.15.60:0/3804508107 >> 172.21.15.60:0/3804508107 conn(0x7ff4080b8e90 msgr2=0x7ff4080b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff407fff700 1 -- 172.21.15.60:0/3804508107 shutdown_connections 2020-10-31T22:41:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff407fff700 1 -- 172.21.15.60:0/3804508107 wait complete. 2020-10-31T22:41:17.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff407fff700 1 Processor -- start 2020-10-31T22:41:17.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff407fff700 1 -- start start 2020-10-31T22:41:17.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff407fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40813b9f0 0x7ff408154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff407fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff408143b60 0x7ff408154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff407fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff408150b70 0x7ff408150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff407fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff408144050 con 0x7ff408143b60 2020-10-31T22:41:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff407fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4081403b0 con 0x7ff408150b70 2020-10-31T22:41:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff407fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4081507a0 con 0x7ff40813b9f0 2020-10-31T22:41:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff3fe7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff408143b60 0x7ff408154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff3fe7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff408143b60 0x7ff408154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41606/0 (socket says 172.21.15.60:41606) 2020-10-31T22:41:17.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff3fe7fc700 1 -- 172.21.15.60:0/3161397236 learned_addr learned my addr 172.21.15.60:0/3161397236 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff406ffd700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40813b9f0 0x7ff408154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff4077fe700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff408150b70 0x7ff408150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff3fe7fc700 1 -- 172.21.15.60:0/3161397236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40813b9f0 msgr2=0x7ff408154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff3fe7fc700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40813b9f0 0x7ff408154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff3fe7fc700 1 -- 172.21.15.60:0/3161397236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff408150b70 msgr2=0x7ff408150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff3fe7fc700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff408150b70 0x7ff408150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff3fe7fc700 1 -- 172.21.15.60:0/3161397236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40813bdd0 con 0x7ff408143b60 2020-10-31T22:41:17.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.555+0000 7ff4077fe700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff408150b70 0x7ff408150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:17.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.559+0000 7ff3fe7fc700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff408143b60 0x7ff408154540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7ff408140170 tx=0x7ff3f001a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:17.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.559+0000 7ff404ff9700 1 -- 172.21.15.60:0/3161397236 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3f0012e60 con 0x7ff408143b60 2020-10-31T22:41:17.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.559+0000 7ff404ff9700 1 -- 172.21.15.60:0/3161397236 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f001c430 con 0x7ff408143b60 2020-10-31T22:41:17.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.559+0000 7ff407fff700 1 -- 172.21.15.60:0/3161397236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4081405a0 con 0x7ff408143b60 2020-10-31T22:41:17.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.559+0000 7ff404ff9700 1 -- 172.21.15.60:0/3161397236 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3f001c790 con 0x7ff408143b60 2020-10-31T22:41:17.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.559+0000 7ff407fff700 1 -- 172.21.15.60:0/3161397236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40813c310 con 0x7ff408143b60 2020-10-31T22:41:17.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.559+0000 7ff407fff700 1 -- 172.21.15.60:0/3161397236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff408153d40 con 0x7ff408143b60 2020-10-31T22:41:17.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.559+0000 7ff404ff9700 1 -- 172.21.15.60:0/3161397236 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff3f001c8f0 con 0x7ff408143b60 2020-10-31T22:41:17.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.559+0000 7ff404ff9700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff3ec0550c0 0x7ff3ec057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.559+0000 7ff404ff9700 1 -- 172.21.15.60:0/3161397236 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff3f006f4f0 con 0x7ff408143b60 2020-10-31T22:41:17.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.559+0000 7ff406ffd700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff3ec0550c0 0x7ff3ec057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.559+0000 7ff406ffd700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff3ec0550c0 0x7ff3ec057580 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff3f8005000 tx=0x7ff3f8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:17.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.563+0000 7ff404ff9700 1 -- 172.21.15.60:0/3161397236 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff3f0045900 con 0x7ff408143b60 2020-10-31T22:41:17.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.707+0000 7ff407fff700 1 -- 172.21.15.60:0/3161397236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff408057100 con 0x7ff408143b60 2020-10-31T22:41:17.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.707+0000 7ff404ff9700 1 -- 172.21.15.60:0/3161397236 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff3f0016020 con 0x7ff408143b60 2020-10-31T22:41:17.712 INFO:teuthology.orchestra.run.smithi060.stdout:55834574853 2020-10-31T22:41:17.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.711+0000 7ff407fff700 1 -- 172.21.15.60:0/3161397236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff3ec0550c0 msgr2=0x7ff3ec057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.711+0000 7ff407fff700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff3ec0550c0 0x7ff3ec057580 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff3f8005000 tx=0x7ff3f8009040).stop 2020-10-31T22:41:17.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.711+0000 7ff407fff700 1 -- 172.21.15.60:0/3161397236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff408143b60 msgr2=0x7ff408154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.711+0000 7ff407fff700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff408143b60 0x7ff408154540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7ff408140170 tx=0x7ff3f001a000).stop 2020-10-31T22:41:17.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.711+0000 7ff407fff700 1 -- 172.21.15.60:0/3161397236 shutdown_connections 2020-10-31T22:41:17.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.711+0000 7ff407fff700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff3ec0550c0 0x7ff3ec057580 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.711+0000 7ff407fff700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff408150b70 0x7ff408150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.711+0000 7ff407fff700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40813b9f0 0x7ff408154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.711+0000 7ff407fff700 1 --2- 172.21.15.60:0/3161397236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff408143b60 0x7ff408154540 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.711+0000 7ff407fff700 1 -- 172.21.15.60:0/3161397236 >> 172.21.15.60:0/3161397236 conn(0x7ff4080b8e90 msgr2=0x7ff4080b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:17.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.711+0000 7ff407fff700 1 -- 172.21.15.60:0/3161397236 shutdown_connections 2020-10-31T22:41:17.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.711+0000 7ff407fff700 1 -- 172.21.15.60:0/3161397236 wait complete. 2020-10-31T22:41:17.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2020-10-31T22:41:17.725 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-10-31T22:41:17.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.843+0000 7f907ca13700 1 Processor -- start 2020-10-31T22:41:17.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.843+0000 7f907ca13700 1 -- start start 2020-10-31T22:41:17.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f907805afe0 0x7f907806a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90780aa7b0 0x7f90780aac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90780b0bb0 con 0x7f90780ae1d0 2020-10-31T22:41:17.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90780ae5b0 con 0x7f907805afe0 2020-10-31T22:41:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90780b0de0 con 0x7f90780aa7b0 2020-10-31T22:41:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f9076ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f907805afe0 0x7f907806a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f9076ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f907805afe0 0x7f907806a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41612/0 (socket says 172.21.15.60:41612) 2020-10-31T22:41:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f9076ffd700 1 -- 172.21.15.60:0/2292845673 learned_addr learned my addr 172.21.15.60:0/2292845673 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f9077fff700 1 --2- 172.21.15.60:0/2292845673 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90780aa7b0 0x7f90780aac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f9077fff700 1 -- 172.21.15.60:0/2292845673 >> v2:172.21.15.60:3300/0 conn(0x7f907805afe0 msgr2=0x7f907806a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f9077fff700 1 --2- 172.21.15.60:0/2292845673 >> v2:172.21.15.60:3300/0 conn(0x7f907805afe0 0x7f907806a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f9077fff700 1 -- 172.21.15.60:0/2292845673 >> v1:172.21.15.66:6789/0 conn(0x7f90780ae1d0 legacy=0x7f90781430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f9077fff700 1 -- 172.21.15.60:0/2292845673 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90780b1080 con 0x7f90780aa7b0 2020-10-31T22:41:17.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f9077fff700 1 --2- 172.21.15.60:0/2292845673 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90780aa7b0 0x7f90780aac60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f90700032b0 tx=0x7f90700091a0).ready entity=mon.2 client_cookie=f90445652ac561f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f90767fc700 1 -- 172.21.15.60:0/2292845673 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f907000b9a0 con 0x7f90780aa7b0 2020-10-31T22:41:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f90767fc700 1 -- 172.21.15.60:0/2292845673 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907000bb00 con 0x7f90780aa7b0 2020-10-31T22:41:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f90767fc700 1 -- 172.21.15.60:0/2292845673 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f907000bc70 con 0x7f90780aa7b0 2020-10-31T22:41:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 -- 172.21.15.60:0/2292845673 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90780aa7b0 msgr2=0x7f90780aac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 --2- 172.21.15.60:0/2292845673 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90780aa7b0 0x7f90780aac60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f90700032b0 tx=0x7f90700091a0).stop 2020-10-31T22:41:17.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 -- 172.21.15.60:0/2292845673 shutdown_connections 2020-10-31T22:41:17.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 --2- 172.21.15.60:0/2292845673 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90780aa7b0 0x7f90780aac60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 --2- 172.21.15.60:0/2292845673 >> v2:172.21.15.60:3300/0 conn(0x7f907805afe0 0x7f907806a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 -- 172.21.15.60:0/2292845673 >> 172.21.15.60:0/2292845673 conn(0x7f90780b4840 msgr2=0x7f90780b4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:17.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 -- 172.21.15.60:0/2292845673 shutdown_connections 2020-10-31T22:41:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 -- 172.21.15.60:0/2292845673 wait complete. 2020-10-31T22:41:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 Processor -- start 2020-10-31T22:41:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.847+0000 7f907ca13700 1 -- start start 2020-10-31T22:41:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f907ca13700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f907805afe0 0x7f907814f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f907ca13700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90780aa7b0 0x7f907808f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f907ca13700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90780ae1d0 0x7f9078092470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f907ca13700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f907809a950 con 0x7f907805afe0 2020-10-31T22:41:17.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f907ca13700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90780a84a0 con 0x7f90780ae1d0 2020-10-31T22:41:17.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f907ca13700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f907808f650 con 0x7f90780aa7b0 2020-10-31T22:41:17.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f90777fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f907805afe0 0x7f907814f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f90777fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f907805afe0 0x7f907814f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41616/0 (socket says 172.21.15.60:41616) 2020-10-31T22:41:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f90777fe700 1 -- 172.21.15.60:0/2042517749 learned_addr learned my addr 172.21.15.60:0/2042517749 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f9077fff700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90780ae1d0 0x7f9078092470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f9076ffd700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90780aa7b0 0x7f907808f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f90777fe700 1 -- 172.21.15.60:0/2042517749 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90780aa7b0 msgr2=0x7f907808f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f90777fe700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90780aa7b0 0x7f907808f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f90777fe700 1 -- 172.21.15.60:0/2042517749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90780ae1d0 msgr2=0x7f9078092470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f90777fe700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90780ae1d0 0x7f9078092470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f90777fe700 1 -- 172.21.15.60:0/2042517749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90780662d0 con 0x7f907805afe0 2020-10-31T22:41:17.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f9077fff700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90780ae1d0 0x7f9078092470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:17.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f9076ffd700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90780aa7b0 0x7f907808f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:17.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f90777fe700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f907805afe0 0x7f907814f3d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f90780b4790 tx=0x7f9068007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:17.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f9074ff9700 1 -- 172.21.15.60:0/2042517749 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9068007020 con 0x7f907805afe0 2020-10-31T22:41:17.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f9074ff9700 1 -- 172.21.15.60:0/2042517749 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9068007180 con 0x7f907805afe0 2020-10-31T22:41:17.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f907ca13700 1 -- 172.21.15.60:0/2042517749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9078066570 con 0x7f907805afe0 2020-10-31T22:41:17.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f9074ff9700 1 -- 172.21.15.60:0/2042517749 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9068006530 con 0x7f907805afe0 2020-10-31T22:41:17.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f907ca13700 1 -- 172.21.15.60:0/2042517749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9078065ef0 con 0x7f907805afe0 2020-10-31T22:41:17.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f907ca13700 1 -- 172.21.15.60:0/2042517749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9078066700 con 0x7f907805afe0 2020-10-31T22:41:17.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f9074ff9700 1 -- 172.21.15.60:0/2042517749 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9068010070 con 0x7f907805afe0 2020-10-31T22:41:17.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f9074ff9700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9058054f10 0x7f90580573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:17.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f9074ff9700 1 -- 172.21.15.60:0/2042517749 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f906806cd30 con 0x7f907805afe0 2020-10-31T22:41:17.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f9076ffd700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9058054f10 0x7f90580573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:17.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.851+0000 7f9076ffd700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9058054f10 0x7f90580573d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f906c008000 tx=0x7f906c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:17.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.855+0000 7f9074ff9700 1 -- 172.21.15.60:0/2042517749 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9068040df0 con 0x7f907805afe0 2020-10-31T22:41:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.999+0000 7f907ca13700 1 -- 172.21.15.60:0/2042517749 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9078057100 con 0x7f907805afe0 2020-10-31T22:41:18.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:17.999+0000 7f9074ff9700 1 -- 172.21.15.60:0/2042517749 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9068020020 con 0x7f907805afe0 2020-10-31T22:41:18.005 INFO:teuthology.orchestra.run.smithi060.stdout:55834574854 2020-10-31T22:41:18.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.003+0000 7f907ca13700 1 -- 172.21.15.60:0/2042517749 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9058054f10 msgr2=0x7f90580573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.003+0000 7f907ca13700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9058054f10 0x7f90580573d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f906c008000 tx=0x7f906c008040).stop 2020-10-31T22:41:18.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.003+0000 7f907ca13700 1 -- 172.21.15.60:0/2042517749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f907805afe0 msgr2=0x7f907814f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.003+0000 7f907ca13700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f907805afe0 0x7f907814f3d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f90780b4790 tx=0x7f9068007b80).stop 2020-10-31T22:41:18.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.003+0000 7f907ca13700 1 -- 172.21.15.60:0/2042517749 shutdown_connections 2020-10-31T22:41:18.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.003+0000 7f907ca13700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9058054f10 0x7f90580573d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.003+0000 7f907ca13700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90780ae1d0 0x7f9078092470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.003+0000 7f907ca13700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f907805afe0 0x7f907814f3d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.003+0000 7f907ca13700 1 --2- 172.21.15.60:0/2042517749 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90780aa7b0 0x7f907808f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.003+0000 7f907ca13700 1 -- 172.21.15.60:0/2042517749 >> 172.21.15.60:0/2042517749 conn(0x7f90780b4840 msgr2=0x7f90780aab90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:18.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.003+0000 7f907ca13700 1 -- 172.21.15.60:0/2042517749 shutdown_connections 2020-10-31T22:41:18.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.003+0000 7f907ca13700 1 -- 172.21.15.60:0/2042517749 wait complete. 2020-10-31T22:41:18.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2020-10-31T22:41:18.018 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-10-31T22:41:18.018 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-10-31T22:41:18.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dff017700 1 Processor -- start 2020-10-31T22:41:18.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dff017700 1 -- start start 2020-10-31T22:41:18.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dff017700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9df805f700 0x7f9df805c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dff017700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9df80b0d30 0x7f9df813d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dff017700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9df813da40 0x7f9df8141870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dff017700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df80af3f0 con 0x7f9df813da40 2020-10-31T22:41:18.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dff017700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df805fae0 con 0x7f9df80b0d30 2020-10-31T22:41:18.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dff017700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80af620 con 0x7f9df805f700 2020-10-31T22:41:18.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dfe816700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9df813da40 0x7f9df8141870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dfe816700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9df813da40 0x7f9df8141870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41628/0 (socket says 172.21.15.60:41628) 2020-10-31T22:41:18.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dfe816700 1 -- 172.21.15.60:0/1838747880 learned_addr learned my addr 172.21.15.60:0/1838747880 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:18.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dfe015700 1 --2- 172.21.15.60:0/1838747880 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9df805f700 0x7f9df805c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dfd814700 1 --2- 172.21.15.60:0/1838747880 >> v2:172.21.15.66:3300/0 conn(0x7f9df80b0d30 0x7f9df813d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dfe816700 1 -- 172.21.15.60:0/1838747880 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9df805f700 msgr2=0x7f9df805c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:18.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dfe816700 1 --2- 172.21.15.60:0/1838747880 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9df805f700 0x7f9df805c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dfe816700 1 -- 172.21.15.60:0/1838747880 >> v2:172.21.15.66:3300/0 conn(0x7f9df80b0d30 msgr2=0x7f9df813d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:18.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dfe816700 1 --2- 172.21.15.60:0/1838747880 >> v2:172.21.15.66:3300/0 conn(0x7f9df80b0d30 0x7f9df813d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dfe816700 1 -- 172.21.15.60:0/1838747880 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df80af8c0 con 0x7f9df813da40 2020-10-31T22:41:18.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.135+0000 7f9dfe816700 1 --2- 172.21.15.60:0/1838747880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9df813da40 0x7f9df8141870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f9df00032b0 tx=0x7f9df000a410).ready entity=mon.0 client_cookie=a893e38c68336639 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:18.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.139+0000 7f9dfd013700 1 -- 172.21.15.60:0/1838747880 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df000ce50 con 0x7f9df813da40 2020-10-31T22:41:18.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.139+0000 7f9dfd013700 1 -- 172.21.15.60:0/1838747880 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df0010410 con 0x7f9df813da40 2020-10-31T22:41:18.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.139+0000 7f9dfd013700 1 -- 172.21.15.60:0/1838747880 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9df0010770 con 0x7f9df813da40 2020-10-31T22:41:18.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.139+0000 7f9dff017700 1 -- 172.21.15.60:0/1838747880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9df813da40 msgr2=0x7f9df8141870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.139+0000 7f9dff017700 1 --2- 172.21.15.60:0/1838747880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9df813da40 0x7f9df8141870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f9df00032b0 tx=0x7f9df000a410).stop 2020-10-31T22:41:18.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.139+0000 7f9dff017700 1 -- 172.21.15.60:0/1838747880 shutdown_connections 2020-10-31T22:41:18.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.139+0000 7f9dff017700 1 --2- 172.21.15.60:0/1838747880 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9df813da40 0x7f9df8141870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.139+0000 7f9dff017700 1 --2- 172.21.15.60:0/1838747880 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9df805f700 0x7f9df805c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.139+0000 7f9dff017700 1 --2- 172.21.15.60:0/1838747880 >> v2:172.21.15.66:3300/0 conn(0x7f9df80b0d30 0x7f9df813d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.139+0000 7f9dff017700 1 -- 172.21.15.60:0/1838747880 >> 172.21.15.60:0/1838747880 conn(0x7f9df80b4840 msgr2=0x7f9df80b4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:18.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.139+0000 7f9dff017700 1 -- 172.21.15.60:0/1838747880 shutdown_connections 2020-10-31T22:41:18.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.139+0000 7f9dff017700 1 -- 172.21.15.60:0/1838747880 wait complete. 2020-10-31T22:41:18.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.139+0000 7f9dff017700 1 Processor -- start 2020-10-31T22:41:18.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.139+0000 7f9dff017700 1 -- start start 2020-10-31T22:41:18.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dff017700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9df805f700 0x7f9df80653d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dff017700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9df80b0d30 0x7f9df8140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dff017700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df813da40 0x7f9df81411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dff017700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80b36e0 con 0x7f9df80b0d30 2020-10-31T22:41:18.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dff017700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df813fbf0 con 0x7f9df813da40 2020-10-31T22:41:18.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dff017700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df80b4070 con 0x7f9df805f700 2020-10-31T22:41:18.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dfd814700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9df80b0d30 0x7f9df8140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dfd814700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9df80b0d30 0x7f9df8140cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41632/0 (socket says 172.21.15.60:41632) 2020-10-31T22:41:18.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dfd814700 1 -- 172.21.15.60:0/3847482494 learned_addr learned my addr 172.21.15.60:0/3847482494 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:18.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dfe015700 1 --2- 172.21.15.60:0/3847482494 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9df805f700 0x7f9df80653d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dfe816700 1 --2- 172.21.15.60:0/3847482494 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df813da40 0x7f9df81411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dfd814700 1 -- 172.21.15.60:0/3847482494 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9df805f700 msgr2=0x7f9df80653d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dfd814700 1 --2- 172.21.15.60:0/3847482494 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9df805f700 0x7f9df80653d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dfd814700 1 -- 172.21.15.60:0/3847482494 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df813da40 msgr2=0x7f9df81411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dfd814700 1 --2- 172.21.15.60:0/3847482494 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df813da40 0x7f9df81411a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dfd814700 1 -- 172.21.15.60:0/3847482494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df80b4510 con 0x7f9df80b0d30 2020-10-31T22:41:18.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dfd814700 1 --2- 172.21.15.60:0/3847482494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9df80b0d30 0x7f9df8140cb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f9de800c000 tx=0x7f9de8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:18.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9de77fe700 1 -- 172.21.15.60:0/3847482494 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9de800ca10 con 0x7f9df80b0d30 2020-10-31T22:41:18.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9de77fe700 1 -- 172.21.15.60:0/3847482494 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de800cb70 con 0x7f9df80b0d30 2020-10-31T22:41:18.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dff017700 1 -- 172.21.15.60:0/3847482494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df8067080 con 0x7f9df80b0d30 2020-10-31T22:41:18.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9de77fe700 1 -- 172.21.15.60:0/3847482494 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9de80123f0 con 0x7f9df80b0d30 2020-10-31T22:41:18.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dff017700 1 -- 172.21.15.60:0/3847482494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df81521f0 con 0x7f9df80b0d30 2020-10-31T22:41:18.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.143+0000 7f9dff017700 1 -- 172.21.15.60:0/3847482494 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df808f5c0 con 0x7f9df80b0d30 2020-10-31T22:41:18.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.147+0000 7f9de77fe700 1 -- 172.21.15.60:0/3847482494 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9de8012550 con 0x7f9df80b0d30 2020-10-31T22:41:18.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.147+0000 7f9de77fe700 1 --2- 172.21.15.60:0/3847482494 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9dd8054f90 0x7f9dd8057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.147+0000 7f9de77fe700 1 -- 172.21.15.60:0/3847482494 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9de806dd00 con 0x7f9df80b0d30 2020-10-31T22:41:18.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.147+0000 7f9dfe015700 1 --2- 172.21.15.60:0/3847482494 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9dd8054f90 0x7f9dd8057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.147+0000 7f9dfe015700 1 --2- 172.21.15.60:0/3847482494 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9dd8054f90 0x7f9dd8057450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f9df4006000 tx=0x7f9df4006d60).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:18.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.151+0000 7f9de77fe700 1 -- 172.21.15.60:0/3847482494 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9de8071030 con 0x7f9df80b0d30 2020-10-31T22:41:18.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.291+0000 7f9dff017700 1 -- 172.21.15.60:0/3847482494 --> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9df80b3ef0 con 0x7f9dd8054f90 2020-10-31T22:41:18.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.299+0000 7f9de77fe700 1 -- 172.21.15.60:0/3847482494 <== mgr.4101 v2:172.21.15.60:6800/14112 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82311 (secure 0 0 0) 0x7f9df4005e50 con 0x7f9dd8054f90 2020-10-31T22:41:18.303 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.299+0000 7f9dff017700 1 -- 172.21.15.60:0/3847482494 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9dd8054f90 msgr2=0x7f9dd8057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.299+0000 7f9dff017700 1 --2- 172.21.15.60:0/3847482494 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9dd8054f90 0x7f9dd8057450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f9df4006000 tx=0x7f9df4006d60).stop 2020-10-31T22:41:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.299+0000 7f9dff017700 1 -- 172.21.15.60:0/3847482494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9df80b0d30 msgr2=0x7f9df8140cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.299+0000 7f9dff017700 1 --2- 172.21.15.60:0/3847482494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9df80b0d30 0x7f9df8140cb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f9de800c000 tx=0x7f9de8006dc0).stop 2020-10-31T22:41:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.299+0000 7f9dff017700 1 -- 172.21.15.60:0/3847482494 shutdown_connections 2020-10-31T22:41:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.299+0000 7f9dff017700 1 --2- 172.21.15.60:0/3847482494 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9dd8054f90 0x7f9dd8057450 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.299+0000 7f9dff017700 1 --2- 172.21.15.60:0/3847482494 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9df813da40 0x7f9df81411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.299+0000 7f9dff017700 1 --2- 172.21.15.60:0/3847482494 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9df805f700 0x7f9df80653d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.299+0000 7f9dff017700 1 --2- 172.21.15.60:0/3847482494 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9df80b0d30 0x7f9df8140cb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.299+0000 7f9dff017700 1 -- 172.21.15.60:0/3847482494 >> 172.21.15.60:0/3847482494 conn(0x7f9df80b4840 msgr2=0x7f9df813de50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:18.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.299+0000 7f9dff017700 1 -- 172.21.15.60:0/3847482494 shutdown_connections 2020-10-31T22:41:18.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.299+0000 7f9dff017700 1 -- 172.21.15.60:0/3847482494 wait complete. 2020-10-31T22:41:18.306 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2020-10-31T22:41:18.317 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2020-10-31T22:41:17.785449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390528,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584192,"statfs":{"total":773094113280,"available":764502212608,"internally_reserved":8589934592,"allocated":1900544,"data_stored":708552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002130"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.086693+0000","last_change":"2020-10-31T22:41:10.083654+0000","last_active":"2020-10-31T22:41:10.086693+0000","last_peered":"2020-10-31T22:41:10.086693+0000","last_clean":"2020-10-31T22:41:10.086693+0000","last_became_active":"2020-10-31T22:41:10.083250+0000","last_became_peered":"2020-10-31T22:41:10.083250+0000","last_unstale":"2020-10-31T22:41:10.086693+0000","last_undegraded":"2020-10-31T22:41:10.086693+0000","last_fullsized":"2020-10-31T22:41:10.086693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.072397+0000","last_change":"2020-10-31T22:41:07.314659+0000","last_active":"2020-10-31T22:41:10.072397+0000","last_peered":"2020-10-31T22:41:10.072397+0000","last_clean":"2020-10-31T22:41:10.072397+0000","last_became_active":"2020-10-31T22:41:07.314009+0000","last_became_peered":"2020-10-31T22:41:07.314009+0000","last_unstale":"2020-10-31T22:41:10.072397+0000","last_undegraded":"2020-10-31T22:41:10.072397+0000","last_fullsized":"2020-10-31T22:41:10.072397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'6","reported_seq":"16","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.086173+0000","last_change":"2020-10-31T22:41:09.587199+0000","last_active":"2020-10-31T22:41:10.086173+0000","last_peered":"2020-10-31T22:41:10.086173+0000","last_clean":"2020-10-31T22:41:10.086173+0000","last_became_active":"2020-10-31T22:41:09.586564+0000","last_became_peered":"2020-10-31T22:41:09.586564+0000","last_unstale":"2020-10-31T22:41:10.086173+0000","last_undegraded":"2020-10-31T22:41:10.086173+0000","last_fullsized":"2020-10-31T22:41:10.086173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.090720+0000","last_change":"2020-10-31T22:41:10.089714+0000","last_active":"2020-10-31T22:41:10.090720+0000","last_peered":"2020-10-31T22:41:10.090720+0000","last_clean":"2020-10-31T22:41:10.090720+0000","last_became_active":"2020-10-31T22:41:10.089225+0000","last_became_peered":"2020-10-31T22:41:10.089225+0000","last_unstale":"2020-10-31T22:41:10.090720+0000","last_undegraded":"2020-10-31T22:41:10.090720+0000","last_fullsized":"2020-10-31T22:41:10.090720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.069887+0000","last_change":"2020-10-31T22:41:06.438766+0000","last_active":"2020-10-31T22:41:10.069887+0000","last_peered":"2020-10-31T22:41:10.069887+0000","last_clean":"2020-10-31T22:41:10.069887+0000","last_became_active":"2020-10-31T22:41:06.438183+0000","last_became_peered":"2020-10-31T22:41:06.438183+0000","last_unstale":"2020-10-31T22:41:10.069887+0000","last_undegraded":"2020-10-31T22:41:10.069887+0000","last_fullsized":"2020-10-31T22:41:10.069887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"21'5","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.081992+0000","last_change":"2020-10-31T22:41:09.585439+0000","last_active":"2020-10-31T22:41:10.081992+0000","last_peered":"2020-10-31T22:41:10.081992+0000","last_clean":"2020-10-31T22:41:10.081992+0000","last_became_active":"2020-10-31T22:41:09.584884+0000","last_became_peered":"2020-10-31T22:41:09.584884+0000","last_unstale":"2020-10-31T22:41:10.081992+0000","last_undegraded":"2020-10-31T22:41:10.081992+0000","last_fullsized":"2020-10-31T22:41:10.081992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.086750+0000","last_change":"2020-10-31T22:41:10.084351+0000","last_active":"2020-10-31T22:41:10.086750+0000","last_peered":"2020-10-31T22:41:10.086750+0000","last_clean":"2020-10-31T22:41:10.086750+0000","last_became_active":"2020-10-31T22:41:10.083909+0000","last_became_peered":"2020-10-31T22:41:10.083909+0000","last_unstale":"2020-10-31T22:41:10.086750+0000","last_undegraded":"2020-10-31T22:41:10.086750+0000","last_fullsized":"2020-10-31T22:41:10.086750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.082374+0000","last_change":"2020-10-31T22:41:06.439885+0000","last_active":"2020-10-31T22:41:10.082374+0000","last_peered":"2020-10-31T22:41:10.082374+0000","last_clean":"2020-10-31T22:41:10.082374+0000","last_became_active":"2020-10-31T22:41:06.439237+0000","last_became_peered":"2020-10-31T22:41:06.439237+0000","last_unstale":"2020-10-31T22:41:10.082374+0000","last_undegraded":"2020-10-31T22:41:10.082374+0000","last_fullsized":"2020-10-31T22:41:10.082374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'8","reported_seq":"18","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.088871+0000","last_change":"2020-10-31T22:41:09.591298+0000","last_active":"2020-10-31T22:41:10.088871+0000","last_peered":"2020-10-31T22:41:10.088871+0000","last_clean":"2020-10-31T22:41:10.088871+0000","last_became_active":"2020-10-31T22:41:09.590852+0000","last_became_peered":"2020-10-31T22:41:09.590852+0000","last_unstale":"2020-10-31T22:41:10.088871+0000","last_undegraded":"2020-10-31T22:41:10.088871+0000","last_fullsized":"2020-10-31T22:41:10.088871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.077249+0000","last_change":"2020-10-31T22:41:10.076334+0000","last_active":"2020-10-31T22:41:10.077249+0000","last_peered":"2020-10-31T22:41:10.077249+0000","last_clean":"2020-10-31T22:41:10.077249+0000","last_became_active":"2020-10-31T22:41:10.075800+0000","last_became_peered":"2020-10-31T22:41:10.075800+0000","last_unstale":"2020-10-31T22:41:10.077249+0000","last_undegraded":"2020-10-31T22:41:10.077249+0000","last_fullsized":"2020-10-31T22:41:10.077249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.069498+0000","last_change":"2020-10-31T22:41:06.437549+0000","last_active":"2020-10-31T22:41:10.069498+0000","last_peered":"2020-10-31T22:41:10.069498+0000","last_clean":"2020-10-31T22:41:10.069498+0000","last_became_active":"2020-10-31T22:41:06.436949+0000","last_became_peered":"2020-10-31T22:41:06.436949+0000","last_unstale":"2020-10-31T22:41:10.069498+0000","last_undegraded":"2020-10-31T22:41:10.069498+0000","last_fullsized":"2020-10-31T22:41:10.069498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"18","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.075461+0000","last_change":"2020-10-31T22:41:02.350188+0000","last_active":"2020-10-31T22:41:10.075461+0000","last_peered":"2020-10-31T22:41:10.075461+0000","last_clean":"2020-10-31T22:41:10.075461+0000","last_became_active":"2020-10-31T22:41:02.349649+0000","last_became_peered":"2020-10-31T22:41:02.349649+0000","last_unstale":"2020-10-31T22:41:10.075461+0000","last_undegraded":"2020-10-31T22:41:10.075461+0000","last_fullsized":"2020-10-31T22:41:10.075461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:40:55.872174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:40:55.872174+0000","last_clean_scrub_stamp":"2020-10-31T22:40:55.872174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.084694+0000","last_change":"2020-10-31T22:41:09.587471+0000","last_active":"2020-10-31T22:41:10.084694+0000","last_peered":"2020-10-31T22:41:10.084694+0000","last_clean":"2020-10-31T22:41:10.084694+0000","last_became_active":"2020-10-31T22:41:09.586985+0000","last_became_peered":"2020-10-31T22:41:09.586985+0000","last_unstale":"2020-10-31T22:41:10.084694+0000","last_undegraded":"2020-10-31T22:41:10.084694+0000","last_fullsized":"2020-10-31T22:41:10.084694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.082538+0000","last_change":"2020-10-31T22:41:10.078645+0000","last_active":"2020-10-31T22:41:10.082538+0000","last_peered":"2020-10-31T22:41:10.082538+0000","last_clean":"2020-10-31T22:41:10.082538+0000","last_became_active":"2020-10-31T22:41:10.078251+0000","last_became_peered":"2020-10-31T22:41:10.078251+0000","last_unstale":"2020-10-31T22:41:10.082538+0000","last_undegraded":"2020-10-31T22:41:10.082538+0000","last_fullsized":"2020-10-31T22:41:10.082538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.075572+0000","last_change":"2020-10-31T22:41:06.438419+0000","last_active":"2020-10-31T22:41:10.075572+0000","last_peered":"2020-10-31T22:41:10.075572+0000","last_clean":"2020-10-31T22:41:10.075572+0000","last_became_active":"2020-10-31T22:41:06.437836+0000","last_became_peered":"2020-10-31T22:41:06.437836+0000","last_unstale":"2020-10-31T22:41:10.075572+0000","last_undegraded":"2020-10-31T22:41:10.075572+0000","last_fullsized":"2020-10-31T22:41:10.075572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.065715+0000","last_change":"2020-10-31T22:41:09.590898+0000","last_active":"2020-10-31T22:41:10.065715+0000","last_peered":"2020-10-31T22:41:10.065715+0000","last_clean":"2020-10-31T22:41:10.065715+0000","last_became_active":"2020-10-31T22:41:09.589883+0000","last_became_peered":"2020-10-31T22:41:09.589883+0000","last_unstale":"2020-10-31T22:41:10.065715+0000","last_undegraded":"2020-10-31T22:41:10.065715+0000","last_fullsized":"2020-10-31T22:41:10.065715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.077083+0000","last_change":"2020-10-31T22:41:10.075457+0000","last_active":"2020-10-31T22:41:10.077083+0000","last_peered":"2020-10-31T22:41:10.077083+0000","last_clean":"2020-10-31T22:41:10.077083+0000","last_became_active":"2020-10-31T22:41:10.073048+0000","last_became_peered":"2020-10-31T22:41:10.073048+0000","last_unstale":"2020-10-31T22:41:10.077083+0000","last_undegraded":"2020-10-31T22:41:10.077083+0000","last_fullsized":"2020-10-31T22:41:10.077083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.076455+0000","last_change":"2020-10-31T22:41:07.312782+0000","last_active":"2020-10-31T22:41:10.076455+0000","last_peered":"2020-10-31T22:41:10.076455+0000","last_clean":"2020-10-31T22:41:10.076455+0000","last_became_active":"2020-10-31T22:41:07.311635+0000","last_became_peered":"2020-10-31T22:41:07.311635+0000","last_unstale":"2020-10-31T22:41:10.076455+0000","last_undegraded":"2020-10-31T22:41:10.076455+0000","last_fullsized":"2020-10-31T22:41:10.076455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"21'8","reported_seq":"18","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.091856+0000","last_change":"2020-10-31T22:41:09.591342+0000","last_active":"2020-10-31T22:41:10.091856+0000","last_peered":"2020-10-31T22:41:10.091856+0000","last_clean":"2020-10-31T22:41:10.091856+0000","last_became_active":"2020-10-31T22:41:09.590881+0000","last_became_peered":"2020-10-31T22:41:09.590881+0000","last_unstale":"2020-10-31T22:41:10.091856+0000","last_undegraded":"2020-10-31T22:41:10.091856+0000","last_fullsized":"2020-10-31T22:41:10.091856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.085307+0000","last_change":"2020-10-31T22:41:10.081435+0000","last_active":"2020-10-31T22:41:10.085307+0000","last_peered":"2020-10-31T22:41:10.085307+0000","last_clean":"2020-10-31T22:41:10.085307+0000","last_became_active":"2020-10-31T22:41:10.080981+0000","last_became_peered":"2020-10-31T22:41:10.080981+0000","last_unstale":"2020-10-31T22:41:10.085307+0000","last_undegraded":"2020-10-31T22:41:10.085307+0000","last_fullsized":"2020-10-31T22:41:10.085307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"21'7","reported_seq":"17","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.088032+0000","last_change":"2020-10-31T22:41:09.588368+0000","last_active":"2020-10-31T22:41:10.088032+0000","last_peered":"2020-10-31T22:41:10.088032+0000","last_clean":"2020-10-31T22:41:10.088032+0000","last_became_active":"2020-10-31T22:41:09.587802+0000","last_became_peered":"2020-10-31T22:41:09.587802+0000","last_unstale":"2020-10-31T22:41:10.088032+0000","last_undegraded":"2020-10-31T22:41:10.088032+0000","last_fullsized":"2020-10-31T22:41:10.088032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.072233+0000","last_change":"2020-10-31T22:41:06.442333+0000","last_active":"2020-10-31T22:41:10.072233+0000","last_peered":"2020-10-31T22:41:10.072233+0000","last_clean":"2020-10-31T22:41:10.072233+0000","last_became_active":"2020-10-31T22:41:06.441830+0000","last_became_peered":"2020-10-31T22:41:06.441830+0000","last_unstale":"2020-10-31T22:41:10.072233+0000","last_undegraded":"2020-10-31T22:41:10.072233+0000","last_fullsized":"2020-10-31T22:41:10.072233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.082329+0000","last_change":"2020-10-31T22:41:10.080020+0000","last_active":"2020-10-31T22:41:10.082329+0000","last_peered":"2020-10-31T22:41:10.082329+0000","last_clean":"2020-10-31T22:41:10.082329+0000","last_became_active":"2020-10-31T22:41:10.079558+0000","last_became_peered":"2020-10-31T22:41:10.079558+0000","last_unstale":"2020-10-31T22:41:10.082329+0000","last_undegraded":"2020-10-31T22:41:10.082329+0000","last_fullsized":"2020-10-31T22:41:10.082329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"12","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.070971+0000","last_change":"2020-10-31T22:41:06.435324+0000","last_active":"2020-10-31T22:41:10.070971+0000","last_peered":"2020-10-31T22:41:10.070971+0000","last_clean":"2020-10-31T22:41:10.070971+0000","last_became_active":"2020-10-31T22:41:06.434820+0000","last_became_peered":"2020-10-31T22:41:06.434820+0000","last_unstale":"2020-10-31T22:41:10.070971+0000","last_undegraded":"2020-10-31T22:41:10.070971+0000","last_fullsized":"2020-10-31T22:41:10.070971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'4","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-10-31T22:41:11.412830+0000","last_change":"2020-10-31T22:41:09.590577+0000","last_active":"2020-10-31T22:41:11.412830+0000","last_peered":"2020-10-31T22:41:11.412830+0000","last_clean":"2020-10-31T22:41:11.412830+0000","last_became_active":"2020-10-31T22:41:09.589907+0000","last_became_peered":"2020-10-31T22:41:09.589907+0000","last_unstale":"2020-10-31T22:41:11.412830+0000","last_undegraded":"2020-10-31T22:41:11.412830+0000","last_fullsized":"2020-10-31T22:41:11.412830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":88568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2770000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.633}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4460000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1440000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":87993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7829999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0169999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9089999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9860000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4220000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6359999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.756}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0630000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5539999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6930000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":88027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.524}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4769999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3580000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1709999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.411}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.081}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.966}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3780000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7989999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9239999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1179999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4670000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":88728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.577}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7190000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2010000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6589999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":88027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.258}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3439999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9339999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5110000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2810000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5859999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":88153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6760000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9219999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.609}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8479999999999999}]}]}]}} 2020-10-31T22:41:18.324 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-10-31T22:41:18.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.435+0000 7f9fb087d700 1 Processor -- start 2020-10-31T22:41:18.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.435+0000 7f9fb087d700 1 -- start start 2020-10-31T22:41:18.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.435+0000 7f9fb087d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9fac063140 0x7f9fac0b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.435+0000 7f9fb087d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9fac0b2820 0x7f9fac0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.435+0000 7f9fb087d700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fac1459c0 con 0x7f9fac0b1000 2020-10-31T22:41:18.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.435+0000 7f9fb087d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fac0b2060 con 0x7f9fac0b2820 2020-10-31T22:41:18.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.435+0000 7f9fb087d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac063520 con 0x7f9fac063140 2020-10-31T22:41:18.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fabfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9fac0b2820 0x7f9fac0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fab7fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9fac063140 0x7f9fac0b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fabfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9fac0b2820 0x7f9fac0aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:52578/0 (socket says 172.21.15.60:52578) 2020-10-31T22:41:18.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fab7fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9fac063140 0x7f9fac0b09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:54826/0 (socket says 172.21.15.60:54826) 2020-10-31T22:41:18.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fa2ffd700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f9fac0b1000 0x7f9fac1452b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:43644/0 (socket says 172.21.15.60:43644) 2020-10-31T22:41:18.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fabfff700 1 -- 172.21.15.60:0/179727263 learned_addr learned my addr 172.21.15.60:0/179727263 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:18.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fabfff700 1 -- 172.21.15.60:0/179727263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9fac063140 msgr2=0x7f9fac0b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:18.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fabfff700 1 --2- 172.21.15.60:0/179727263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9fac063140 0x7f9fac0b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fabfff700 1 -- 172.21.15.60:0/179727263 >> v1:172.21.15.66:6789/0 conn(0x7f9fac0b1000 legacy=0x7f9fac1452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fabfff700 1 -- 172.21.15.60:0/179727263 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac0b02e0 con 0x7f9fac0b2820 2020-10-31T22:41:18.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fabfff700 1 --2- 172.21.15.60:0/179727263 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fac0b2820 0x7f9fac0aeda0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9fa40032b0 tx=0x7f9fa4009270).ready entity=mon.1 client_cookie=a223e26abb3ea5ca server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:18.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9faaffd700 1 -- 172.21.15.60:0/179727263 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fa4009e60 con 0x7f9fac0b2820 2020-10-31T22:41:18.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9faaffd700 1 -- 172.21.15.60:0/179727263 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa400bc00 con 0x7f9fac0b2820 2020-10-31T22:41:18.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9faaffd700 1 -- 172.21.15.60:0/179727263 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9fa400bd70 con 0x7f9fac0b2820 2020-10-31T22:41:18.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fb087d700 1 -- 172.21.15.60:0/179727263 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fac0b2820 msgr2=0x7f9fac0aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fb087d700 1 --2- 172.21.15.60:0/179727263 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fac0b2820 0x7f9fac0aeda0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f9fa40032b0 tx=0x7f9fa4009270).stop 2020-10-31T22:41:18.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fb087d700 1 -- 172.21.15.60:0/179727263 shutdown_connections 2020-10-31T22:41:18.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fb087d700 1 --2- 172.21.15.60:0/179727263 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fac0b2820 0x7f9fac0aeda0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fb087d700 1 --2- 172.21.15.60:0/179727263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9fac063140 0x7f9fac0b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fb087d700 1 -- 172.21.15.60:0/179727263 >> 172.21.15.60:0/179727263 conn(0x7f9fac06a600 msgr2=0x7f9fac060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:18.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fb087d700 1 -- 172.21.15.60:0/179727263 shutdown_connections 2020-10-31T22:41:18.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.439+0000 7f9fb087d700 1 -- 172.21.15.60:0/179727263 wait complete. 2020-10-31T22:41:18.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fb087d700 1 Processor -- start 2020-10-31T22:41:18.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fb087d700 1 -- start start 2020-10-31T22:41:18.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fb087d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fac063140 0x7f9fac064bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fb087d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fac0b1000 0x7f9fac1423f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fb087d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9fac0b2820 0x7f9fac1428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fb087d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac066670 con 0x7f9fac063140 2020-10-31T22:41:18.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fb087d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac066910 con 0x7f9fac0b1000 2020-10-31T22:41:18.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fb087d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fac066bb0 con 0x7f9fac0b2820 2020-10-31T22:41:18.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fab7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fac063140 0x7f9fac064bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fab7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fac063140 0x7f9fac064bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41644/0 (socket says 172.21.15.60:41644) 2020-10-31T22:41:18.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fab7fe700 1 -- 172.21.15.60:0/1478155652 learned_addr learned my addr 172.21.15.60:0/1478155652 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:18.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fa2ffd700 1 --2- 172.21.15.60:0/1478155652 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fac0b1000 0x7f9fac1423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fabfff700 1 --2- 172.21.15.60:0/1478155652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9fac0b2820 0x7f9fac1428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fab7fe700 1 -- 172.21.15.60:0/1478155652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9fac0b2820 msgr2=0x7f9fac1428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fab7fe700 1 --2- 172.21.15.60:0/1478155652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9fac0b2820 0x7f9fac1428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fab7fe700 1 -- 172.21.15.60:0/1478155652 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fac0b1000 msgr2=0x7f9fac1423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fab7fe700 1 --2- 172.21.15.60:0/1478155652 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fac0b1000 0x7f9fac1423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fab7fe700 1 -- 172.21.15.60:0/1478155652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fac066e50 con 0x7f9fac063140 2020-10-31T22:41:18.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fab7fe700 1 --2- 172.21.15.60:0/1478155652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fac063140 0x7f9fac064bc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f9f9c00c000 tx=0x7f9f9c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:18.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fa97fa700 1 -- 172.21.15.60:0/1478155652 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f9c00ca10 con 0x7f9fac063140 2020-10-31T22:41:18.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fa97fa700 1 -- 172.21.15.60:0/1478155652 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9c00cb70 con 0x7f9fac063140 2020-10-31T22:41:18.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fb087d700 1 -- 172.21.15.60:0/1478155652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fac142dd0 con 0x7f9fac063140 2020-10-31T22:41:18.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fa97fa700 1 -- 172.21.15.60:0/1478155652 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f9c0123f0 con 0x7f9fac063140 2020-10-31T22:41:18.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fb087d700 1 -- 172.21.15.60:0/1478155652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fac067700 con 0x7f9fac063140 2020-10-31T22:41:18.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.443+0000 7f9fb087d700 1 -- 172.21.15.60:0/1478155652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fac066fe0 con 0x7f9fac063140 2020-10-31T22:41:18.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.447+0000 7f9fa97fa700 1 -- 172.21.15.60:0/1478155652 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9f9c012550 con 0x7f9fac063140 2020-10-31T22:41:18.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.447+0000 7f9fa97fa700 1 --2- 172.21.15.60:0/1478155652 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9f90054f90 0x7f9f90057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.447+0000 7f9fa97fa700 1 -- 172.21.15.60:0/1478155652 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9f9c06dd20 con 0x7f9fac063140 2020-10-31T22:41:18.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.447+0000 7f9fa2ffd700 1 --2- 172.21.15.60:0/1478155652 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9f90054f90 0x7f9f90057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.447+0000 7f9fa2ffd700 1 --2- 172.21.15.60:0/1478155652 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9f90054f90 0x7f9f90057450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f9f9400d000 tx=0x7f9f94007b50).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:18.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.455+0000 7f9fa97fa700 1 -- 172.21.15.60:0/1478155652 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9f9c0441e0 con 0x7f9fac063140 2020-10-31T22:41:18.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.591+0000 7f9fb087d700 1 -- 172.21.15.60:0/1478155652 --> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9fac0a89c0 con 0x7f9f90054f90 2020-10-31T22:41:18.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.599+0000 7f9fa97fa700 1 -- 172.21.15.60:0/1478155652 <== mgr.4101 v2:172.21.15.60:6800/14112 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+82311 (secure 0 0 0) 0x7f9fac0a89c0 con 0x7f9f90054f90 2020-10-31T22:41:18.605 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.603+0000 7f9fb087d700 1 -- 172.21.15.60:0/1478155652 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9f90054f90 msgr2=0x7f9f90057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.603+0000 7f9fb087d700 1 --2- 172.21.15.60:0/1478155652 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9f90054f90 0x7f9f90057450 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f9f9400d000 tx=0x7f9f94007b50).stop 2020-10-31T22:41:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.603+0000 7f9fb087d700 1 -- 172.21.15.60:0/1478155652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fac063140 msgr2=0x7f9fac064bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.603+0000 7f9fb087d700 1 --2- 172.21.15.60:0/1478155652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fac063140 0x7f9fac064bc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f9f9c00c000 tx=0x7f9f9c006dc0).stop 2020-10-31T22:41:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.603+0000 7f9fb087d700 1 -- 172.21.15.60:0/1478155652 shutdown_connections 2020-10-31T22:41:18.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.603+0000 7f9fb087d700 1 --2- 172.21.15.60:0/1478155652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9fac0b2820 0x7f9fac1428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.603+0000 7f9fb087d700 1 --2- 172.21.15.60:0/1478155652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9fac063140 0x7f9fac064bc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.603+0000 7f9fb087d700 1 --2- 172.21.15.60:0/1478155652 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9f90054f90 0x7f9f90057450 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.603+0000 7f9fb087d700 1 --2- 172.21.15.60:0/1478155652 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9fac0b1000 0x7f9fac1423f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.603+0000 7f9fb087d700 1 -- 172.21.15.60:0/1478155652 >> 172.21.15.60:0/1478155652 conn(0x7f9fac06a600 msgr2=0x7f9fac060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.603+0000 7f9fb087d700 1 -- 172.21.15.60:0/1478155652 shutdown_connections 2020-10-31T22:41:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.603+0000 7f9fb087d700 1 -- 172.21.15.60:0/1478155652 wait complete. 2020-10-31T22:41:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:dumped all 2020-10-31T22:41:18.620 INFO:teuthology.orchestra.run.smithi060.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2020-10-31T22:41:17.785449+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":50,"acting":50,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390528,"kb_used_data":1856,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584192,"statfs":{"total":773094113280,"available":764502212608,"internally_reserved":8589934592,"allocated":1900544,"data_stored":708552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002130"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.086693+0000","last_change":"2020-10-31T22:41:10.083654+0000","last_active":"2020-10-31T22:41:10.086693+0000","last_peered":"2020-10-31T22:41:10.086693+0000","last_clean":"2020-10-31T22:41:10.086693+0000","last_became_active":"2020-10-31T22:41:10.083250+0000","last_became_peered":"2020-10-31T22:41:10.083250+0000","last_unstale":"2020-10-31T22:41:10.086693+0000","last_undegraded":"2020-10-31T22:41:10.086693+0000","last_fullsized":"2020-10-31T22:41:10.086693+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.072397+0000","last_change":"2020-10-31T22:41:07.314659+0000","last_active":"2020-10-31T22:41:10.072397+0000","last_peered":"2020-10-31T22:41:10.072397+0000","last_clean":"2020-10-31T22:41:10.072397+0000","last_became_active":"2020-10-31T22:41:07.314009+0000","last_became_peered":"2020-10-31T22:41:07.314009+0000","last_unstale":"2020-10-31T22:41:10.072397+0000","last_undegraded":"2020-10-31T22:41:10.072397+0000","last_fullsized":"2020-10-31T22:41:10.072397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"21'6","reported_seq":"16","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.086173+0000","last_change":"2020-10-31T22:41:09.587199+0000","last_active":"2020-10-31T22:41:10.086173+0000","last_peered":"2020-10-31T22:41:10.086173+0000","last_clean":"2020-10-31T22:41:10.086173+0000","last_became_active":"2020-10-31T22:41:09.586564+0000","last_became_peered":"2020-10-31T22:41:09.586564+0000","last_unstale":"2020-10-31T22:41:10.086173+0000","last_undegraded":"2020-10-31T22:41:10.086173+0000","last_fullsized":"2020-10-31T22:41:10.086173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.090720+0000","last_change":"2020-10-31T22:41:10.089714+0000","last_active":"2020-10-31T22:41:10.090720+0000","last_peered":"2020-10-31T22:41:10.090720+0000","last_clean":"2020-10-31T22:41:10.090720+0000","last_became_active":"2020-10-31T22:41:10.089225+0000","last_became_peered":"2020-10-31T22:41:10.089225+0000","last_unstale":"2020-10-31T22:41:10.090720+0000","last_undegraded":"2020-10-31T22:41:10.090720+0000","last_fullsized":"2020-10-31T22:41:10.090720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.069887+0000","last_change":"2020-10-31T22:41:06.438766+0000","last_active":"2020-10-31T22:41:10.069887+0000","last_peered":"2020-10-31T22:41:10.069887+0000","last_clean":"2020-10-31T22:41:10.069887+0000","last_became_active":"2020-10-31T22:41:06.438183+0000","last_became_peered":"2020-10-31T22:41:06.438183+0000","last_unstale":"2020-10-31T22:41:10.069887+0000","last_undegraded":"2020-10-31T22:41:10.069887+0000","last_fullsized":"2020-10-31T22:41:10.069887+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"21'5","reported_seq":"15","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.081992+0000","last_change":"2020-10-31T22:41:09.585439+0000","last_active":"2020-10-31T22:41:10.081992+0000","last_peered":"2020-10-31T22:41:10.081992+0000","last_clean":"2020-10-31T22:41:10.081992+0000","last_became_active":"2020-10-31T22:41:09.584884+0000","last_became_peered":"2020-10-31T22:41:09.584884+0000","last_unstale":"2020-10-31T22:41:10.081992+0000","last_undegraded":"2020-10-31T22:41:10.081992+0000","last_fullsized":"2020-10-31T22:41:10.081992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.086750+0000","last_change":"2020-10-31T22:41:10.084351+0000","last_active":"2020-10-31T22:41:10.086750+0000","last_peered":"2020-10-31T22:41:10.086750+0000","last_clean":"2020-10-31T22:41:10.086750+0000","last_became_active":"2020-10-31T22:41:10.083909+0000","last_became_peered":"2020-10-31T22:41:10.083909+0000","last_unstale":"2020-10-31T22:41:10.086750+0000","last_undegraded":"2020-10-31T22:41:10.086750+0000","last_fullsized":"2020-10-31T22:41:10.086750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.082374+0000","last_change":"2020-10-31T22:41:06.439885+0000","last_active":"2020-10-31T22:41:10.082374+0000","last_peered":"2020-10-31T22:41:10.082374+0000","last_clean":"2020-10-31T22:41:10.082374+0000","last_became_active":"2020-10-31T22:41:06.439237+0000","last_became_peered":"2020-10-31T22:41:06.439237+0000","last_unstale":"2020-10-31T22:41:10.082374+0000","last_undegraded":"2020-10-31T22:41:10.082374+0000","last_fullsized":"2020-10-31T22:41:10.082374+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"21'8","reported_seq":"18","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.088871+0000","last_change":"2020-10-31T22:41:09.591298+0000","last_active":"2020-10-31T22:41:10.088871+0000","last_peered":"2020-10-31T22:41:10.088871+0000","last_clean":"2020-10-31T22:41:10.088871+0000","last_became_active":"2020-10-31T22:41:09.590852+0000","last_became_peered":"2020-10-31T22:41:09.590852+0000","last_unstale":"2020-10-31T22:41:10.088871+0000","last_undegraded":"2020-10-31T22:41:10.088871+0000","last_fullsized":"2020-10-31T22:41:10.088871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.077249+0000","last_change":"2020-10-31T22:41:10.076334+0000","last_active":"2020-10-31T22:41:10.077249+0000","last_peered":"2020-10-31T22:41:10.077249+0000","last_clean":"2020-10-31T22:41:10.077249+0000","last_became_active":"2020-10-31T22:41:10.075800+0000","last_became_peered":"2020-10-31T22:41:10.075800+0000","last_unstale":"2020-10-31T22:41:10.077249+0000","last_undegraded":"2020-10-31T22:41:10.077249+0000","last_fullsized":"2020-10-31T22:41:10.077249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.069498+0000","last_change":"2020-10-31T22:41:06.437549+0000","last_active":"2020-10-31T22:41:10.069498+0000","last_peered":"2020-10-31T22:41:10.069498+0000","last_clean":"2020-10-31T22:41:10.069498+0000","last_became_active":"2020-10-31T22:41:06.436949+0000","last_became_peered":"2020-10-31T22:41:06.436949+0000","last_unstale":"2020-10-31T22:41:10.069498+0000","last_undegraded":"2020-10-31T22:41:10.069498+0000","last_fullsized":"2020-10-31T22:41:10.069498+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'2","reported_seq":"18","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.075461+0000","last_change":"2020-10-31T22:41:02.350188+0000","last_active":"2020-10-31T22:41:10.075461+0000","last_peered":"2020-10-31T22:41:10.075461+0000","last_clean":"2020-10-31T22:41:10.075461+0000","last_became_active":"2020-10-31T22:41:02.349649+0000","last_became_peered":"2020-10-31T22:41:02.349649+0000","last_unstale":"2020-10-31T22:41:10.075461+0000","last_undegraded":"2020-10-31T22:41:10.075461+0000","last_fullsized":"2020-10-31T22:41:10.075461+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":6,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:40:55.872174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:40:55.872174+0000","last_clean_scrub_stamp":"2020-10-31T22:40:55.872174+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"21'1","reported_seq":"11","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.084694+0000","last_change":"2020-10-31T22:41:09.587471+0000","last_active":"2020-10-31T22:41:10.084694+0000","last_peered":"2020-10-31T22:41:10.084694+0000","last_clean":"2020-10-31T22:41:10.084694+0000","last_became_active":"2020-10-31T22:41:09.586985+0000","last_became_peered":"2020-10-31T22:41:09.586985+0000","last_unstale":"2020-10-31T22:41:10.084694+0000","last_undegraded":"2020-10-31T22:41:10.084694+0000","last_fullsized":"2020-10-31T22:41:10.084694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.082538+0000","last_change":"2020-10-31T22:41:10.078645+0000","last_active":"2020-10-31T22:41:10.082538+0000","last_peered":"2020-10-31T22:41:10.082538+0000","last_clean":"2020-10-31T22:41:10.082538+0000","last_became_active":"2020-10-31T22:41:10.078251+0000","last_became_peered":"2020-10-31T22:41:10.078251+0000","last_unstale":"2020-10-31T22:41:10.082538+0000","last_undegraded":"2020-10-31T22:41:10.082538+0000","last_fullsized":"2020-10-31T22:41:10.082538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.075572+0000","last_change":"2020-10-31T22:41:06.438419+0000","last_active":"2020-10-31T22:41:10.075572+0000","last_peered":"2020-10-31T22:41:10.075572+0000","last_clean":"2020-10-31T22:41:10.075572+0000","last_became_active":"2020-10-31T22:41:06.437836+0000","last_became_peered":"2020-10-31T22:41:06.437836+0000","last_unstale":"2020-10-31T22:41:10.075572+0000","last_undegraded":"2020-10-31T22:41:10.075572+0000","last_fullsized":"2020-10-31T22:41:10.075572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"10","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.065715+0000","last_change":"2020-10-31T22:41:09.590898+0000","last_active":"2020-10-31T22:41:10.065715+0000","last_peered":"2020-10-31T22:41:10.065715+0000","last_clean":"2020-10-31T22:41:10.065715+0000","last_became_active":"2020-10-31T22:41:09.589883+0000","last_became_peered":"2020-10-31T22:41:09.589883+0000","last_unstale":"2020-10-31T22:41:10.065715+0000","last_undegraded":"2020-10-31T22:41:10.065715+0000","last_fullsized":"2020-10-31T22:41:10.065715+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.077083+0000","last_change":"2020-10-31T22:41:10.075457+0000","last_active":"2020-10-31T22:41:10.077083+0000","last_peered":"2020-10-31T22:41:10.077083+0000","last_clean":"2020-10-31T22:41:10.077083+0000","last_became_active":"2020-10-31T22:41:10.073048+0000","last_became_peered":"2020-10-31T22:41:10.073048+0000","last_unstale":"2020-10-31T22:41:10.077083+0000","last_undegraded":"2020-10-31T22:41:10.077083+0000","last_fullsized":"2020-10-31T22:41:10.077083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.076455+0000","last_change":"2020-10-31T22:41:07.312782+0000","last_active":"2020-10-31T22:41:10.076455+0000","last_peered":"2020-10-31T22:41:10.076455+0000","last_clean":"2020-10-31T22:41:10.076455+0000","last_became_active":"2020-10-31T22:41:07.311635+0000","last_became_peered":"2020-10-31T22:41:07.311635+0000","last_unstale":"2020-10-31T22:41:10.076455+0000","last_undegraded":"2020-10-31T22:41:10.076455+0000","last_fullsized":"2020-10-31T22:41:10.076455+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"21'8","reported_seq":"18","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.091856+0000","last_change":"2020-10-31T22:41:09.591342+0000","last_active":"2020-10-31T22:41:10.091856+0000","last_peered":"2020-10-31T22:41:10.091856+0000","last_clean":"2020-10-31T22:41:10.091856+0000","last_became_active":"2020-10-31T22:41:09.590881+0000","last_became_peered":"2020-10-31T22:41:09.590881+0000","last_unstale":"2020-10-31T22:41:10.091856+0000","last_undegraded":"2020-10-31T22:41:10.091856+0000","last_fullsized":"2020-10-31T22:41:10.091856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.085307+0000","last_change":"2020-10-31T22:41:10.081435+0000","last_active":"2020-10-31T22:41:10.085307+0000","last_peered":"2020-10-31T22:41:10.085307+0000","last_clean":"2020-10-31T22:41:10.085307+0000","last_became_active":"2020-10-31T22:41:10.080981+0000","last_became_peered":"2020-10-31T22:41:10.080981+0000","last_unstale":"2020-10-31T22:41:10.085307+0000","last_undegraded":"2020-10-31T22:41:10.085307+0000","last_fullsized":"2020-10-31T22:41:10.085307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"21'7","reported_seq":"17","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.088032+0000","last_change":"2020-10-31T22:41:09.588368+0000","last_active":"2020-10-31T22:41:10.088032+0000","last_peered":"2020-10-31T22:41:10.088032+0000","last_clean":"2020-10-31T22:41:10.088032+0000","last_became_active":"2020-10-31T22:41:09.587802+0000","last_became_peered":"2020-10-31T22:41:09.587802+0000","last_unstale":"2020-10-31T22:41:10.088032+0000","last_undegraded":"2020-10-31T22:41:10.088032+0000","last_fullsized":"2020-10-31T22:41:10.088032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"13","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.072233+0000","last_change":"2020-10-31T22:41:06.442333+0000","last_active":"2020-10-31T22:41:10.072233+0000","last_peered":"2020-10-31T22:41:10.072233+0000","last_clean":"2020-10-31T22:41:10.072233+0000","last_became_active":"2020-10-31T22:41:06.441830+0000","last_became_peered":"2020-10-31T22:41:06.441830+0000","last_unstale":"2020-10-31T22:41:10.072233+0000","last_undegraded":"2020-10-31T22:41:10.072233+0000","last_fullsized":"2020-10-31T22:41:10.072233+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"9","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.082329+0000","last_change":"2020-10-31T22:41:10.080020+0000","last_active":"2020-10-31T22:41:10.082329+0000","last_peered":"2020-10-31T22:41:10.082329+0000","last_clean":"2020-10-31T22:41:10.082329+0000","last_became_active":"2020-10-31T22:41:10.079558+0000","last_became_peered":"2020-10-31T22:41:10.079558+0000","last_unstale":"2020-10-31T22:41:10.082329+0000","last_undegraded":"2020-10-31T22:41:10.082329+0000","last_fullsized":"2020-10-31T22:41:10.082329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:09.562334+0000","last_clean_scrub_stamp":"2020-10-31T22:41:09.562334+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"12","reported_epoch":"21","state":"active+clean","last_fresh":"2020-10-31T22:41:10.070971+0000","last_change":"2020-10-31T22:41:06.435324+0000","last_active":"2020-10-31T22:41:10.070971+0000","last_peered":"2020-10-31T22:41:10.070971+0000","last_clean":"2020-10-31T22:41:10.070971+0000","last_became_active":"2020-10-31T22:41:06.434820+0000","last_became_peered":"2020-10-31T22:41:06.434820+0000","last_unstale":"2020-10-31T22:41:10.070971+0000","last_undegraded":"2020-10-31T22:41:10.070971+0000","last_fullsized":"2020-10-31T22:41:10.070971+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:05.408670+0000","last_clean_scrub_stamp":"2020-10-31T22:41:05.408670+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"22'4","reported_seq":"14","reported_epoch":"22","state":"active+clean","last_fresh":"2020-10-31T22:41:11.412830+0000","last_change":"2020-10-31T22:41:09.590577+0000","last_active":"2020-10-31T22:41:11.412830+0000","last_peered":"2020-10-31T22:41:11.412830+0000","last_clean":"2020-10-31T22:41:11.412830+0000","last_became_active":"2020-10-31T22:41:09.589907+0000","last_became_peered":"2020-10-31T22:41:09.589907+0000","last_unstale":"2020-10-31T22:41:11.412830+0000","last_undegraded":"2020-10-31T22:41:11.412830+0000","last_fullsized":"2020-10-31T22:41:11.412830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-10-31T22:41:08.550632+0000","last_clean_scrub_stamp":"2020-10-31T22:41:08.550632+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":88568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.258}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2770000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.633}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4460000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1440000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9199999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048808,"kb_used_data":224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323032,"statfs":{"total":96636764160,"available":95562784768,"internally_reserved":1073741824,"allocated":229376,"data_stored":87993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7829999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0169999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9089999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9860000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4220000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6359999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.756}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0630000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5539999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6930000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":88027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.524}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4769999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3580000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1709999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.411}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.081}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048820,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323020,"statfs":{"total":96636764160,"available":95562772480,"internally_reserved":1073741824,"allocated":241664,"data_stored":89528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.966}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3780000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7989999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9239999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1179999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4670000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048824,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323016,"statfs":{"total":96636764160,"available":95562768384,"internally_reserved":1073741824,"allocated":245760,"data_stored":88728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5049999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.577}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7190000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2010000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4569999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.6589999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048812,"kb_used_data":228,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323028,"statfs":{"total":96636764160,"available":95562780672,"internally_reserved":1073741824,"allocated":233472,"data_stored":88027,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.258}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3439999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9339999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5110000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.2810000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5859999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048816,"kb_used_data":232,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323024,"statfs":{"total":96636764160,"available":95562776576,"internally_reserved":1073741824,"allocated":237568,"data_stored":88153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6760000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9219999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.609}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.8479999999999999}]}]}]}} 2020-10-31T22:41:18.625 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-10-31T22:41:18.625 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-10-31T22:41:18.626 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-10-31T22:41:18.626 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-10-31T22:41:18.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f7548700 1 Processor -- start 2020-10-31T22:41:18.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f7548700 1 -- start start 2020-10-31T22:41:18.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f7548700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5f00ac870 0x7ff5f0146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f7548700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5f0146550 0x7ff5f0150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f7548700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5f00af900 con 0x7ff5f00af520 2020-10-31T22:41:18.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f7548700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5f00afc10 con 0x7ff5f0146550 2020-10-31T22:41:18.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f7548700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f005bb70 con 0x7ff5f00ac870 2020-10-31T22:41:18.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f6d47700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5f0146550 0x7ff5f0150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f6d47700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5f0146550 0x7ff5f0150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41656/0 (socket says 172.21.15.60:41656) 2020-10-31T22:41:18.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f6d47700 1 -- 172.21.15.60:0/2434191881 learned_addr learned my addr 172.21.15.60:0/2434191881 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:18.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f5d45700 1 --2- 172.21.15.60:0/2434191881 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5f00ac870 0x7ff5f0146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f6d47700 1 -- 172.21.15.60:0/2434191881 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5f00ac870 msgr2=0x7ff5f0146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:18.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f6d47700 1 --2- 172.21.15.60:0/2434191881 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5f00ac870 0x7ff5f0146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f6d47700 1 -- 172.21.15.60:0/2434191881 >> v1:172.21.15.60:6789/0 conn(0x7ff5f00af520 legacy=0x7ff5f0066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f6d47700 1 -- 172.21.15.60:0/2434191881 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f00ac130 con 0x7ff5f0146550 2020-10-31T22:41:18.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f5d45700 1 --2- 172.21.15.60:0/2434191881 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5f00ac870 0x7ff5f0146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:41:18.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f6d47700 1 --2- 172.21.15.60:0/2434191881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5f0146550 0x7ff5f0150980 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff5e80032b0 tx=0x7ff5e8009270).ready entity=mon.0 client_cookie=76206a3d3bbdefb1 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:18.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.739+0000 7ff5f5544700 1 -- 172.21.15.60:0/2434191881 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5e800bc00 con 0x7ff5f0146550 2020-10-31T22:41:18.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f5544700 1 -- 172.21.15.60:0/2434191881 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e800bd60 con 0x7ff5f0146550 2020-10-31T22:41:18.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f5544700 1 -- 172.21.15.60:0/2434191881 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5e8011400 con 0x7ff5f0146550 2020-10-31T22:41:18.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 -- 172.21.15.60:0/2434191881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5f0146550 msgr2=0x7ff5f0150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 --2- 172.21.15.60:0/2434191881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5f0146550 0x7ff5f0150980 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7ff5e80032b0 tx=0x7ff5e8009270).stop 2020-10-31T22:41:18.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 -- 172.21.15.60:0/2434191881 shutdown_connections 2020-10-31T22:41:18.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 --2- 172.21.15.60:0/2434191881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5f0146550 0x7ff5f0150980 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 --2- 172.21.15.60:0/2434191881 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5f00ac870 0x7ff5f0146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 -- 172.21.15.60:0/2434191881 >> 172.21.15.60:0/2434191881 conn(0x7ff5f00b3fd0 msgr2=0x7ff5f00b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:18.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 -- 172.21.15.60:0/2434191881 shutdown_connections 2020-10-31T22:41:18.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 -- 172.21.15.60:0/2434191881 wait complete. 2020-10-31T22:41:18.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 Processor -- start 2020-10-31T22:41:18.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 -- start start 2020-10-31T22:41:18.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5f00ac870 0x7ff5f00aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5f00af520 0x7ff5f0154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5f0146550 0x7ff5f01490d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f01475d0 con 0x7ff5f00ac870 2020-10-31T22:41:18.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0147870 con 0x7ff5f00af520 2020-10-31T22:41:18.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f7548700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5f0147b10 con 0x7ff5f0146550 2020-10-31T22:41:18.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f6546700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5f00ac870 0x7ff5f00aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f6546700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5f00ac870 0x7ff5f00aa130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41658/0 (socket says 172.21.15.60:41658) 2020-10-31T22:41:18.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f6546700 1 -- 172.21.15.60:0/2182548492 learned_addr learned my addr 172.21.15.60:0/2182548492 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:18.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f5d45700 1 --2- 172.21.15.60:0/2182548492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5f00af520 0x7ff5f0154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f6d47700 1 --2- 172.21.15.60:0/2182548492 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5f0146550 0x7ff5f01490d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f6546700 1 -- 172.21.15.60:0/2182548492 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5f0146550 msgr2=0x7ff5f01490d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f6546700 1 --2- 172.21.15.60:0/2182548492 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5f0146550 0x7ff5f01490d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f6546700 1 -- 172.21.15.60:0/2182548492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5f00af520 msgr2=0x7ff5f0154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f6546700 1 --2- 172.21.15.60:0/2182548492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5f00af520 0x7ff5f0154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f6546700 1 -- 172.21.15.60:0/2182548492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f0148c30 con 0x7ff5f00ac870 2020-10-31T22:41:18.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.743+0000 7ff5f6546700 1 --2- 172.21.15.60:0/2182548492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5f00ac870 0x7ff5f00aa130 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7ff5f00ac750 tx=0x7ff5e4007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:18.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.747+0000 7ff5e37fe700 1 -- 172.21.15.60:0/2182548492 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5e4007030 con 0x7ff5f00ac870 2020-10-31T22:41:18.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.747+0000 7ff5e37fe700 1 -- 172.21.15.60:0/2182548492 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4007190 con 0x7ff5f00ac870 2020-10-31T22:41:18.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.747+0000 7ff5e37fe700 1 -- 172.21.15.60:0/2182548492 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5e40064e0 con 0x7ff5f00ac870 2020-10-31T22:41:18.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.747+0000 7ff5f7548700 1 -- 172.21.15.60:0/2182548492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5f0062a70 con 0x7ff5f00ac870 2020-10-31T22:41:18.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.747+0000 7ff5f7548700 1 -- 172.21.15.60:0/2182548492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5f0149ca0 con 0x7ff5f00ac870 2020-10-31T22:41:18.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.747+0000 7ff5f7548700 1 -- 172.21.15.60:0/2182548492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5f0057100 con 0x7ff5f00ac870 2020-10-31T22:41:18.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.747+0000 7ff5e37fe700 1 -- 172.21.15.60:0/2182548492 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff5e4010070 con 0x7ff5f00ac870 2020-10-31T22:41:18.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.747+0000 7ff5e37fe700 1 --2- 172.21.15.60:0/2182548492 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5d0055020 0x7ff5d00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:18.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.747+0000 7ff5e37fe700 1 -- 172.21.15.60:0/2182548492 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff5e406cf50 con 0x7ff5f00ac870 2020-10-31T22:41:18.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.747+0000 7ff5f5d45700 1 --2- 172.21.15.60:0/2182548492 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5d0055020 0x7ff5d00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:18.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.747+0000 7ff5f5d45700 1 --2- 172.21.15.60:0/2182548492 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5d0055020 0x7ff5d00574e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff5ec00d000 tx=0x7ff5ec008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:18.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.759+0000 7ff5e37fe700 1 -- 172.21.15.60:0/2182548492 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff5e4043470 con 0x7ff5f00ac870 2020-10-31T22:41:18.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.951+0000 7ff5f7548700 1 -- 172.21.15.60:0/2182548492 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff5f00b18b0 con 0x7ff5f00ac870 2020-10-31T22:41:18.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.951+0000 7ff5e37fe700 1 -- 172.21.15.60:0/2182548492 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7ff5e4018030 con 0x7ff5f00ac870 2020-10-31T22:41:18.956 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:18.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.955+0000 7ff5f7548700 1 -- 172.21.15.60:0/2182548492 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5d0055020 msgr2=0x7ff5d00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.955+0000 7ff5f7548700 1 --2- 172.21.15.60:0/2182548492 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5d0055020 0x7ff5d00574e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ff5ec00d000 tx=0x7ff5ec008040).stop 2020-10-31T22:41:18.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.955+0000 7ff5f7548700 1 -- 172.21.15.60:0/2182548492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5f00ac870 msgr2=0x7ff5f00aa130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:18.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.955+0000 7ff5f7548700 1 --2- 172.21.15.60:0/2182548492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5f00ac870 0x7ff5f00aa130 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7ff5f00ac750 tx=0x7ff5e4007b50).stop 2020-10-31T22:41:18.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.955+0000 7ff5f7548700 1 -- 172.21.15.60:0/2182548492 shutdown_connections 2020-10-31T22:41:18.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.955+0000 7ff5f7548700 1 --2- 172.21.15.60:0/2182548492 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5f0146550 0x7ff5f01490d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.955+0000 7ff5f7548700 1 --2- 172.21.15.60:0/2182548492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5f00ac870 0x7ff5f00aa130 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.955+0000 7ff5f7548700 1 --2- 172.21.15.60:0/2182548492 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5d0055020 0x7ff5d00574e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.955+0000 7ff5f7548700 1 --2- 172.21.15.60:0/2182548492 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5f00af520 0x7ff5f0154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:18.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.955+0000 7ff5f7548700 1 -- 172.21.15.60:0/2182548492 >> 172.21.15.60:0/2182548492 conn(0x7ff5f00b3fd0 msgr2=0x7ff5f00b1170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:18.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.955+0000 7ff5f7548700 1 -- 172.21.15.60:0/2182548492 shutdown_connections 2020-10-31T22:41:18.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:18.955+0000 7ff5f7548700 1 -- 172.21.15.60:0/2182548492 wait complete. 2020-10-31T22:41:18.970 INFO:teuthology.orchestra.run.smithi060.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-10-31T22:41:18.970 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-10-31T22:41:18.971 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:19.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.083+0000 7f0fc9002700 1 Processor -- start 2020-10-31T22:41:19.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.083+0000 7f0fc9002700 1 -- start start 2020-10-31T22:41:19.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc9002700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0fc40b24a0 0x7f0fc40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc9002700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc4145180 con 0x7f0fc4141fe0 2020-10-31T22:41:19.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc9002700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fc40b0670 con 0x7f0fc40b5570 2020-10-31T22:41:19.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc9002700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fc40afae0 con 0x7f0fc40b24a0 2020-10-31T22:41:19.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc8801700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0fc4141fe0 0x7f0fc4142490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45806/0 (socket says 172.21.15.60:45806) 2020-10-31T22:41:19.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc8801700 1 -- 172.21.15.60:0/2827908541 learned_addr learned my addr 172.21.15.60:0/2827908541 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:19.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fbbfff700 1 --2- 172.21.15.60:0/2827908541 >> v2:172.21.15.66:3300/0 conn(0x7f0fc40b24a0 0x7f0fc40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc37fe700 1 -- 172.21.15.60:0/2827908541 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2733792951 0 0) 0x7f0fc4145180 con 0x7f0fc4141fe0 2020-10-31T22:41:19.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc37fe700 1 -- 172.21.15.60:0/2827908541 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa8003230 con 0x7f0fc4141fe0 2020-10-31T22:41:19.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fbbfff700 1 -- 172.21.15.60:0/2827908541 >> v1:172.21.15.66:6789/0 conn(0x7f0fc40b5570 legacy=0x7f0fc4145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fbbfff700 1 -- 172.21.15.60:0/2827908541 >> v1:172.21.15.60:6789/0 conn(0x7f0fc4141fe0 legacy=0x7f0fc4142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fbbfff700 1 -- 172.21.15.60:0/2827908541 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40b0910 con 0x7f0fc40b24a0 2020-10-31T22:41:19.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fbbfff700 1 --2- 172.21.15.60:0/2827908541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc40b24a0 0x7f0fc40b5950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0fc405f580 tx=0x7f0fac006dc0).ready entity=mon.1 client_cookie=90aea5a1313fa37d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:19.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc37fe700 1 -- 172.21.15.60:0/2827908541 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fac0097c0 con 0x7f0fc40b24a0 2020-10-31T22:41:19.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc37fe700 1 -- 172.21.15.60:0/2827908541 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac009920 con 0x7f0fc40b24a0 2020-10-31T22:41:19.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc37fe700 1 -- 172.21.15.60:0/2827908541 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fac009c80 con 0x7f0fc40b24a0 2020-10-31T22:41:19.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc9002700 1 -- 172.21.15.60:0/2827908541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc40b24a0 msgr2=0x7f0fc40b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc9002700 1 --2- 172.21.15.60:0/2827908541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc40b24a0 0x7f0fc40b5950 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f0fc405f580 tx=0x7f0fac006dc0).stop 2020-10-31T22:41:19.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc9002700 1 -- 172.21.15.60:0/2827908541 shutdown_connections 2020-10-31T22:41:19.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc9002700 1 --2- 172.21.15.60:0/2827908541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc40b24a0 0x7f0fc40b5950 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc9002700 1 -- 172.21.15.60:0/2827908541 >> 172.21.15.60:0/2827908541 conn(0x7f0fc40b8e90 msgr2=0x7f0fc40b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:19.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc9002700 1 -- 172.21.15.60:0/2827908541 shutdown_connections 2020-10-31T22:41:19.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.087+0000 7f0fc9002700 1 -- 172.21.15.60:0/2827908541 wait complete. 2020-10-31T22:41:19.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc9002700 1 Processor -- start 2020-10-31T22:41:19.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc9002700 1 -- start start 2020-10-31T22:41:19.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc9002700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fc40b24a0 0x7f0fc40b78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc9002700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fc40b5570 0x7f0fc4146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc9002700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc4141fe0 0x7f0fc413e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc9002700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc4151bb0 con 0x7f0fc40b5570 2020-10-31T22:41:19.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc9002700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc41481c0 con 0x7f0fc4141fe0 2020-10-31T22:41:19.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc9002700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fc4151910 con 0x7f0fc40b24a0 2020-10-31T22:41:19.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fbbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fc40b5570 0x7f0fc4146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fbbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fc40b5570 0x7f0fc4146190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41674/0 (socket says 172.21.15.60:41674) 2020-10-31T22:41:19.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fbbfff700 1 -- 172.21.15.60:0/3102139709 learned_addr learned my addr 172.21.15.60:0/3102139709 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:19.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc8801700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc4141fe0 0x7f0fc413e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc3fff700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fc40b24a0 0x7f0fc40b78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fbbfff700 1 -- 172.21.15.60:0/3102139709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fc40b24a0 msgr2=0x7f0fc40b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fbbfff700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fc40b24a0 0x7f0fc40b78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fbbfff700 1 -- 172.21.15.60:0/3102139709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc4141fe0 msgr2=0x7f0fc413e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fbbfff700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc4141fe0 0x7f0fc413e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fbbfff700 1 -- 172.21.15.60:0/3102139709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40b7410 con 0x7f0fc40b5570 2020-10-31T22:41:19.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc3fff700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fc40b24a0 0x7f0fc40b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:19.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fbbfff700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fc40b5570 0x7f0fc4146190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f0fc405f580 tx=0x7f0fac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:19.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc1ffb700 1 -- 172.21.15.60:0/3102139709 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fac011d00 con 0x7f0fc40b5570 2020-10-31T22:41:19.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc1ffb700 1 -- 172.21.15.60:0/3102139709 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac011e60 con 0x7f0fc40b5570 2020-10-31T22:41:19.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc9002700 1 -- 172.21.15.60:0/3102139709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fc4151640 con 0x7f0fc40b5570 2020-10-31T22:41:19.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc1ffb700 1 -- 172.21.15.60:0/3102139709 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fac01d640 con 0x7f0fc40b5570 2020-10-31T22:41:19.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.091+0000 7f0fc9002700 1 -- 172.21.15.60:0/3102139709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fc4146680 con 0x7f0fc40b5570 2020-10-31T22:41:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.095+0000 7f0fc9002700 1 -- 172.21.15.60:0/3102139709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fc4140140 con 0x7f0fc40b5570 2020-10-31T22:41:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.095+0000 7f0fc1ffb700 1 -- 172.21.15.60:0/3102139709 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0fac024030 con 0x7f0fc40b5570 2020-10-31T22:41:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.095+0000 7f0fc1ffb700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f9c054f90 0x7f0f9c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.095+0000 7f0fc1ffb700 1 -- 172.21.15.60:0/3102139709 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0fac06ebd0 con 0x7f0fc40b5570 2020-10-31T22:41:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.095+0000 7f0fc3fff700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f9c054f90 0x7f0f9c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.095+0000 7f0fc3fff700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f9c054f90 0x7f0f9c057450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f0fb400b000 tx=0x7f0fb4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:19.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.103+0000 7f0fc1ffb700 1 -- 172.21.15.60:0/3102139709 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0fac0450f0 con 0x7f0fc40b5570 2020-10-31T22:41:19.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.251+0000 7f0fc9002700 1 -- 172.21.15.60:0/3102139709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0fc40b75a0 con 0x7f0fc40b5570 2020-10-31T22:41:19.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.251+0000 7f0fc1ffb700 1 -- 172.21.15.60:0/3102139709 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f0fac022070 con 0x7f0fc40b5570 2020-10-31T22:41:19.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.255+0000 7f0fc9002700 1 -- 172.21.15.60:0/3102139709 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f9c054f90 msgr2=0x7f0f9c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.255+0000 7f0fc9002700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f9c054f90 0x7f0f9c057450 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f0fb400b000 tx=0x7f0fb4009040).stop 2020-10-31T22:41:19.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.255+0000 7f0fc9002700 1 -- 172.21.15.60:0/3102139709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fc40b5570 msgr2=0x7f0fc4146190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.255+0000 7f0fc9002700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fc40b5570 0x7f0fc4146190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f0fc405f580 tx=0x7f0fac015000).stop 2020-10-31T22:41:19.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.255+0000 7f0fc9002700 1 -- 172.21.15.60:0/3102139709 shutdown_connections 2020-10-31T22:41:19.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.255+0000 7f0fc9002700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f9c054f90 0x7f0f9c057450 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.255+0000 7f0fc9002700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fc4141fe0 0x7f0fc413e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.255+0000 7f0fc9002700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fc40b24a0 0x7f0fc40b78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.255+0000 7f0fc9002700 1 --2- 172.21.15.60:0/3102139709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fc40b5570 0x7f0fc4146190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.255+0000 7f0fc9002700 1 -- 172.21.15.60:0/3102139709 >> 172.21.15.60:0/3102139709 conn(0x7f0fc40b8e90 msgr2=0x7f0fc405f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:19.261 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.255+0000 7f0fc9002700 1 -- 172.21.15.60:0/3102139709 shutdown_connections 2020-10-31T22:41:19.261 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.255+0000 7f0fc9002700 1 -- 172.21.15.60:0/3102139709 wait complete. 2020-10-31T22:41:19.261 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:19.262 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:11.059362+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:07.982891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:08.927092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:19.268 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:41:07.982891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:41:08.927092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:41:19.270 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:41:19.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.383+0000 7f9465357700 1 Processor -- start 2020-10-31T22:41:19.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9465357700 1 -- start start 2020-10-31T22:41:19.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9465357700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94600b06a0 0x7f9460145c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9465357700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946005b5a0 con 0x7f9460142890 2020-10-31T22:41:19.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9465357700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946005b840 con 0x7f9460067070 2020-10-31T22:41:19.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9465357700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946005bae0 con 0x7f94600b06a0 2020-10-31T22:41:19.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f945f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9460142890 0x7f94600aff90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45818/0 (socket says 172.21.15.60:45818) 2020-10-31T22:41:19.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f945f7fe700 1 -- 172.21.15.60:0/2514612786 learned_addr learned my addr 172.21.15.60:0/2514612786 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:19.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9464b56700 1 --2- 172.21.15.60:0/2514612786 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94600b06a0 0x7f9460145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f945effd700 1 -- 172.21.15.60:0/2514612786 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3751389331 0 0) 0x7f946005b5a0 con 0x7f9460142890 2020-10-31T22:41:19.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f945effd700 1 -- 172.21.15.60:0/2514612786 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9440003230 con 0x7f9460142890 2020-10-31T22:41:19.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f945effd700 1 -- 172.21.15.60:0/2514612786 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834926045 0 0) 0x7f946005b840 con 0x7f9460067070 2020-10-31T22:41:19.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f945effd700 1 -- 172.21.15.60:0/2514612786 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f946005b5a0 con 0x7f9460067070 2020-10-31T22:41:19.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9464b56700 1 -- 172.21.15.60:0/2514612786 >> v1:172.21.15.66:6789/0 conn(0x7f9460067070 legacy=0x7f9460142180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9464b56700 1 -- 172.21.15.60:0/2514612786 >> v1:172.21.15.60:6789/0 conn(0x7f9460142890 legacy=0x7f94600aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f945effd700 1 -- 172.21.15.60:0/2514612786 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3765354974 0 0) 0x7f9440003230 con 0x7f9460142890 2020-10-31T22:41:19.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9464b56700 1 -- 172.21.15.60:0/2514612786 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460141ce0 con 0x7f94600b06a0 2020-10-31T22:41:19.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9464b56700 1 --2- 172.21.15.60:0/2514612786 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94600b06a0 0x7f9460145c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f9448001870 tx=0x7f94580091a0).ready entity=mon.2 client_cookie=a6f436663a70a3ed server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:19.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f945effd700 1 -- 172.21.15.60:0/2514612786 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94480016d0 con 0x7f94600b06a0 2020-10-31T22:41:19.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f945effd700 1 -- 172.21.15.60:0/2514612786 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945800b800 con 0x7f94600b06a0 2020-10-31T22:41:19.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f945effd700 1 -- 172.21.15.60:0/2514612786 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f945800b970 con 0x7f94600b06a0 2020-10-31T22:41:19.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9465357700 1 -- 172.21.15.60:0/2514612786 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94600b06a0 msgr2=0x7f9460145c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9465357700 1 --2- 172.21.15.60:0/2514612786 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94600b06a0 0x7f9460145c90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f9448001870 tx=0x7f94580091a0).stop 2020-10-31T22:41:19.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9465357700 1 -- 172.21.15.60:0/2514612786 shutdown_connections 2020-10-31T22:41:19.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9465357700 1 --2- 172.21.15.60:0/2514612786 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94600b06a0 0x7f9460145c90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9465357700 1 -- 172.21.15.60:0/2514612786 >> 172.21.15.60:0/2514612786 conn(0x7f9460061dc0 msgr2=0x7f94600621a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:19.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9465357700 1 -- 172.21.15.60:0/2514612786 shutdown_connections 2020-10-31T22:41:19.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.387+0000 7f9465357700 1 -- 172.21.15.60:0/2514612786 wait complete. 2020-10-31T22:41:19.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9465357700 1 Processor -- start 2020-10-31T22:41:19.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9465357700 1 -- start start 2020-10-31T22:41:19.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9465357700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9460067070 0x7f94600aaf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9465357700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94600b06a0 0x7f94600ab440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9465357700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9460142890 0x7f94600a8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9465357700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94601452c0 con 0x7f9460142890 2020-10-31T22:41:19.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9465357700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9460151940 con 0x7f9460067070 2020-10-31T22:41:19.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9465357700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9460151be0 con 0x7f94600b06a0 2020-10-31T22:41:19.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9464b56700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9460142890 0x7f94600a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9464b56700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9460142890 0x7f94600a8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41688/0 (socket says 172.21.15.60:41688) 2020-10-31T22:41:19.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9464b56700 1 -- 172.21.15.60:0/106561573 learned_addr learned my addr 172.21.15.60:0/106561573 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:19.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f945f7fe700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94600b06a0 0x7f94600ab440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f945ffff700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9460067070 0x7f94600aaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9464b56700 1 -- 172.21.15.60:0/106561573 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94600b06a0 msgr2=0x7f94600ab440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9464b56700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94600b06a0 0x7f94600ab440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9464b56700 1 -- 172.21.15.60:0/106561573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9460067070 msgr2=0x7f94600aaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9464b56700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9460067070 0x7f94600aaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9464b56700 1 -- 172.21.15.60:0/106561573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9460145e10 con 0x7f9460142890 2020-10-31T22:41:19.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f945f7fe700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94600b06a0 0x7f94600ab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:19.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9464b56700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9460142890 0x7f94600a8650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f9448001870 tx=0x7f9458016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:19.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f945d7fa700 1 -- 172.21.15.60:0/106561573 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9458011e60 con 0x7f9460142890 2020-10-31T22:41:19.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f945d7fa700 1 -- 172.21.15.60:0/106561573 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9458021430 con 0x7f9460142890 2020-10-31T22:41:19.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9465357700 1 -- 172.21.15.60:0/106561573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94600b35f0 con 0x7f9460142890 2020-10-31T22:41:19.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f945d7fa700 1 -- 172.21.15.60:0/106561573 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9458021790 con 0x7f9460142890 2020-10-31T22:41:19.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.391+0000 7f9465357700 1 -- 172.21.15.60:0/106561573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94600a8d60 con 0x7f9460142890 2020-10-31T22:41:19.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.395+0000 7f945d7fa700 1 -- 172.21.15.60:0/106561573 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9458028070 con 0x7f9460142890 2020-10-31T22:41:19.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.395+0000 7f9465357700 1 -- 172.21.15.60:0/106561573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94601517a0 con 0x7f9460142890 2020-10-31T22:41:19.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.395+0000 7f945d7fa700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f94440550c0 0x7f9444057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.395+0000 7f945d7fa700 1 -- 172.21.15.60:0/106561573 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f945806e690 con 0x7f9460142890 2020-10-31T22:41:19.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.395+0000 7f945ffff700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f94440550c0 0x7f9444057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.395+0000 7f945ffff700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f94440550c0 0x7f9444057580 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f945000b000 tx=0x7f9450009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:19.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.399+0000 7f945d7fa700 1 -- 172.21.15.60:0/106561573 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f94601517a0 con 0x7f9460142890 2020-10-31T22:41:19.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.543+0000 7f9465357700 1 -- 172.21.15.60:0/106561573 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f94601517a0 con 0x7f9460142890 2020-10-31T22:41:19.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.543+0000 7f945d7fa700 1 -- 172.21.15.60:0/106561573 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f94601517a0 con 0x7f9460142890 2020-10-31T22:41:19.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.547+0000 7f9465357700 1 -- 172.21.15.60:0/106561573 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f94440550c0 msgr2=0x7f9444057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.547+0000 7f9465357700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f94440550c0 0x7f9444057580 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f945000b000 tx=0x7f9450009040).stop 2020-10-31T22:41:19.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.547+0000 7f9465357700 1 -- 172.21.15.60:0/106561573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9460142890 msgr2=0x7f94600a8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.547+0000 7f9465357700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9460142890 0x7f94600a8650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f9448001870 tx=0x7f9458016000).stop 2020-10-31T22:41:19.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.547+0000 7f9465357700 1 -- 172.21.15.60:0/106561573 shutdown_connections 2020-10-31T22:41:19.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.547+0000 7f9465357700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9460142890 0x7f94600a8650 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.547+0000 7f9465357700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f94440550c0 0x7f9444057580 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.547+0000 7f9465357700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9460067070 0x7f94600aaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.547+0000 7f9465357700 1 --2- 172.21.15.60:0/106561573 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94600b06a0 0x7f94600ab440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.547+0000 7f9465357700 1 -- 172.21.15.60:0/106561573 >> 172.21.15.60:0/106561573 conn(0x7f9460061dc0 msgr2=0x7f94600b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:19.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.547+0000 7f9465357700 1 -- 172.21.15.60:0/106561573 shutdown_connections 2020-10-31T22:41:19.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.547+0000 7f9465357700 1 -- 172.21.15.60:0/106561573 wait complete. 2020-10-31T22:41:19.555 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:41:19.563 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:41:19.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b5c5d700 1 Processor -- start 2020-10-31T22:41:19.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b5c5d700 1 -- start start 2020-10-31T22:41:19.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b5c5d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f49b005c540 0x7f49b013dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b5c5d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f49b00b0d30 0x7f49b01419f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b5c5d700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49b005fae0 con 0x7f49b005f700 2020-10-31T22:41:19.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b5c5d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b013e150 con 0x7f49b00b0d30 2020-10-31T22:41:19.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b5c5d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49b00af770 con 0x7f49b005c540 2020-10-31T22:41:19.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b545c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f49b00b0d30 0x7f49b01419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b4c5b700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f49b005f700 0x7f49b013d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:43698/0 (socket says 172.21.15.60:43698) 2020-10-31T22:41:19.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49a7fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f49b005c540 0x7f49b013dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b4c5b700 1 -- 172.21.15.60:0/1973377669 learned_addr learned my addr 172.21.15.60:0/1973377669 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:19.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b545c700 1 -- 172.21.15.60:0/1973377669 >> v2:172.21.15.66:3300/0 conn(0x7f49b005c540 msgr2=0x7f49b013dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:19.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b545c700 1 --2- 172.21.15.60:0/1973377669 >> v2:172.21.15.66:3300/0 conn(0x7f49b005c540 0x7f49b013dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b545c700 1 -- 172.21.15.60:0/1973377669 >> v1:172.21.15.66:6789/0 conn(0x7f49b005f700 legacy=0x7f49b013d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b545c700 1 -- 172.21.15.60:0/1973377669 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b00afa10 con 0x7f49b00b0d30 2020-10-31T22:41:19.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49b545c700 1 --2- 172.21.15.60:0/1973377669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b00b0d30 0x7f49b01419f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f49a80032b0 tx=0x7f49a80091a0).ready entity=mon.0 client_cookie=499399004bf68c11 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:19.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49a77fe700 1 -- 172.21.15.60:0/1973377669 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49a800bb90 con 0x7f49b00b0d30 2020-10-31T22:41:19.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49a77fe700 1 -- 172.21.15.60:0/1973377669 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49a800bcf0 con 0x7f49b00b0d30 2020-10-31T22:41:19.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.691+0000 7f49a77fe700 1 -- 172.21.15.60:0/1973377669 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49a8010660 con 0x7f49b00b0d30 2020-10-31T22:41:19.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.695+0000 7f49b5c5d700 1 -- 172.21.15.60:0/1973377669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b00b0d30 msgr2=0x7f49b01419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.695+0000 7f49b5c5d700 1 --2- 172.21.15.60:0/1973377669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b00b0d30 0x7f49b01419f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f49a80032b0 tx=0x7f49a80091a0).stop 2020-10-31T22:41:19.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.695+0000 7f49b5c5d700 1 -- 172.21.15.60:0/1973377669 shutdown_connections 2020-10-31T22:41:19.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.695+0000 7f49b5c5d700 1 --2- 172.21.15.60:0/1973377669 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b00b0d30 0x7f49b01419f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.695+0000 7f49b5c5d700 1 --2- 172.21.15.60:0/1973377669 >> v2:172.21.15.66:3300/0 conn(0x7f49b005c540 0x7f49b013dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.695+0000 7f49b5c5d700 1 -- 172.21.15.60:0/1973377669 >> 172.21.15.60:0/1973377669 conn(0x7f49b00b4840 msgr2=0x7f49b00b4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:19.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.695+0000 7f49b5c5d700 1 -- 172.21.15.60:0/1973377669 shutdown_connections 2020-10-31T22:41:19.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.695+0000 7f49b5c5d700 1 -- 172.21.15.60:0/1973377669 wait complete. 2020-10-31T22:41:19.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.695+0000 7f49b5c5d700 1 Processor -- start 2020-10-31T22:41:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.695+0000 7f49b5c5d700 1 -- start start 2020-10-31T22:41:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b5c5d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b005c540 0x7f49b00ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b5c5d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49b005f700 0x7f49b0149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b5c5d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49b00b0d30 0x7f49b014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b5c5d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b013a1b0 con 0x7f49b005c540 2020-10-31T22:41:19.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b5c5d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b0065380 con 0x7f49b005f700 2020-10-31T22:41:19.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b5c5d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b0065620 con 0x7f49b00b0d30 2020-10-31T22:41:19.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b4c5b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b005c540 0x7f49b00ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b4c5b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b005c540 0x7f49b00ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41700/0 (socket says 172.21.15.60:41700) 2020-10-31T22:41:19.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b4c5b700 1 -- 172.21.15.60:0/2283094666 learned_addr learned my addr 172.21.15.60:0/2283094666 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:19.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49a7fff700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49b005f700 0x7f49b0149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b545c700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49b00b0d30 0x7f49b014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b4c5b700 1 -- 172.21.15.60:0/2283094666 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49b00b0d30 msgr2=0x7f49b014c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b4c5b700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49b00b0d30 0x7f49b014c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b4c5b700 1 -- 172.21.15.60:0/2283094666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49b005f700 msgr2=0x7f49b0149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b4c5b700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49b005f700 0x7f49b0149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b4c5b700 1 -- 172.21.15.60:0/2283094666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b00658c0 con 0x7f49b005c540 2020-10-31T22:41:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49a7fff700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49b005f700 0x7f49b0149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:41:19.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b4c5b700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b005c540 0x7f49b00ae630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f49b00b5550 tx=0x7f49ac0079c0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:19.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49a5ffb700 1 -- 172.21.15.60:0/2283094666 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49ac0072e0 con 0x7f49b005c540 2020-10-31T22:41:19.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49a5ffb700 1 -- 172.21.15.60:0/2283094666 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49ac0054b0 con 0x7f49b005c540 2020-10-31T22:41:19.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b5c5d700 1 -- 172.21.15.60:0/2283094666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b0065b60 con 0x7f49b005c540 2020-10-31T22:41:19.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49a5ffb700 1 -- 172.21.15.60:0/2283094666 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49ac005810 con 0x7f49b005c540 2020-10-31T22:41:19.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b5c5d700 1 -- 172.21.15.60:0/2283094666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b0063d30 con 0x7f49b005c540 2020-10-31T22:41:19.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49b5c5d700 1 -- 172.21.15.60:0/2283094666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b01411e0 con 0x7f49b005c540 2020-10-31T22:41:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49a5ffb700 1 -- 172.21.15.60:0/2283094666 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f49ac010070 con 0x7f49b005c540 2020-10-31T22:41:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49a5ffb700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4990054fd0 0x7f4990057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49a5ffb700 1 -- 172.21.15.60:0/2283094666 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f49ac06cfb0 con 0x7f49b005c540 2020-10-31T22:41:19.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.699+0000 7f49a7fff700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4990054fd0 0x7f4990057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.703+0000 7f49a7fff700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4990054fd0 0x7f4990057490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f49a000b000 tx=0x7f49a0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:19.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.707+0000 7f49a5ffb700 1 -- 172.21.15.60:0/2283094666 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f49ac0434d0 con 0x7f49b005c540 2020-10-31T22:41:19.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.847+0000 7f49b5c5d700 1 -- 172.21.15.60:0/2283094666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f49b0057100 con 0x7f49b005c540 2020-10-31T22:41:19.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.847+0000 7f49a5ffb700 1 -- 172.21.15.60:0/2283094666 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f49ac018030 con 0x7f49b005c540 2020-10-31T22:41:19.852 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:19.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.847+0000 7f49b5c5d700 1 -- 172.21.15.60:0/2283094666 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4990054fd0 msgr2=0x7f4990057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.847+0000 7f49b5c5d700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4990054fd0 0x7f4990057490 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f49a000b000 tx=0x7f49a0008040).stop 2020-10-31T22:41:19.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.847+0000 7f49b5c5d700 1 -- 172.21.15.60:0/2283094666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b005c540 msgr2=0x7f49b00ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.847+0000 7f49b5c5d700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b005c540 0x7f49b00ae630 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f49b00b5550 tx=0x7f49ac0079c0).stop 2020-10-31T22:41:19.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.851+0000 7f49b5c5d700 1 -- 172.21.15.60:0/2283094666 shutdown_connections 2020-10-31T22:41:19.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.851+0000 7f49b5c5d700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49b00b0d30 0x7f49b014c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.851+0000 7f49b5c5d700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49b005c540 0x7f49b00ae630 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.851+0000 7f49b5c5d700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4990054fd0 0x7f4990057490 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.851+0000 7f49b5c5d700 1 --2- 172.21.15.60:0/2283094666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49b005f700 0x7f49b0149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:19.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.851+0000 7f49b5c5d700 1 -- 172.21.15.60:0/2283094666 >> 172.21.15.60:0/2283094666 conn(0x7f49b00b4840 msgr2=0x7f49b013e290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:19.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.851+0000 7f49b5c5d700 1 -- 172.21.15.60:0/2283094666 shutdown_connections 2020-10-31T22:41:19.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.851+0000 7f49b5c5d700 1 -- 172.21.15.60:0/2283094666 wait complete. 2020-10-31T22:41:19.872 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:41:19.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.991+0000 7fc6ebcaa700 1 Processor -- start 2020-10-31T22:41:19.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.991+0000 7fc6ebcaa700 1 -- start start 2020-10-31T22:41:19.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.991+0000 7fc6ebcaa700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6e40b0dc0 0x7fc6e40b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:19.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.991+0000 7fc6ebcaa700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e40653c0 con 0x7fc6e40664e0 2020-10-31T22:41:19.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.991+0000 7fc6ebcaa700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6e4066b10 con 0x7fc6e413fd20 2020-10-31T22:41:19.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.991+0000 7fc6ebcaa700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40668f0 con 0x7fc6e40b0dc0 2020-10-31T22:41:19.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.991+0000 7fc6ea247700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc6e40664e0 0x7fc6e4143890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45848/0 (socket says 172.21.15.60:45848) 2020-10-31T22:41:19.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.991+0000 7fc6ea247700 1 -- 172.21.15.60:0/1153468172 learned_addr learned my addr 172.21.15.60:0/1153468172 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:19.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.991+0000 7fc6e9a46700 1 --2- 172.21.15.60:0/1153468172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6e40b0dc0 0x7fc6e40b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:19.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6e8a44700 1 -- 172.21.15.60:0/1153468172 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240182885 0 0) 0x7fc6e40653c0 con 0x7fc6e40664e0 2020-10-31T22:41:19.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6e8a44700 1 -- 172.21.15.60:0/1153468172 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6cc003230 con 0x7fc6e40664e0 2020-10-31T22:41:19.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6e8a44700 1 -- 172.21.15.60:0/1153468172 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3701184275 0 0) 0x7fc6e4066b10 con 0x7fc6e413fd20 2020-10-31T22:41:19.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6e8a44700 1 -- 172.21.15.60:0/1153468172 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6e40653c0 con 0x7fc6e413fd20 2020-10-31T22:41:19.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6e9a46700 1 -- 172.21.15.60:0/1153468172 >> v1:172.21.15.66:6789/0 conn(0x7fc6e413fd20 legacy=0x7fc6e413d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6e9a46700 1 -- 172.21.15.60:0/1153468172 >> v1:172.21.15.60:6789/0 conn(0x7fc6e40664e0 legacy=0x7fc6e4143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:19.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6e9a46700 1 -- 172.21.15.60:0/1153468172 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e4066db0 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6e9a46700 1 --2- 172.21.15.60:0/1153468172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6e40b0dc0 0x7fc6e40b2d50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc6d8002f30 tx=0x7fc6d8006dc0).ready entity=mon.2 client_cookie=165917198c931272 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:20.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6e8a44700 1 -- 172.21.15.60:0/1153468172 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6d8009730 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6e8a44700 1 -- 172.21.15.60:0/1153468172 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6d8009890 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6e8a44700 1 -- 172.21.15.60:0/1153468172 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6d8009bf0 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/1153468172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6e40b0dc0 msgr2=0x7fc6e40b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6ebcaa700 1 --2- 172.21.15.60:0/1153468172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6e40b0dc0 0x7fc6e40b2d50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fc6d8002f30 tx=0x7fc6d8006dc0).stop 2020-10-31T22:41:20.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/1153468172 shutdown_connections 2020-10-31T22:41:20.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6ebcaa700 1 --2- 172.21.15.60:0/1153468172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6e40b0dc0 0x7fc6e40b2d50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/1153468172 >> 172.21.15.60:0/1153468172 conn(0x7fc6e406a260 msgr2=0x7fc6e4063c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:20.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/1153468172 shutdown_connections 2020-10-31T22:41:20.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/1153468172 wait complete. 2020-10-31T22:41:20.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6ebcaa700 1 Processor -- start 2020-10-31T22:41:20.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.995+0000 7fc6ebcaa700 1 -- start start 2020-10-31T22:41:20.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6ebcaa700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6e40664e0 0x7fc6e40b4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6ebcaa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e40b0dc0 0x7fc6e413f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6ebcaa700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6e413fd20 0x7fc6e4137490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6ebcaa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e41388d0 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6ebcaa700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40aa200 con 0x7fc6e413fd20 2020-10-31T22:41:20.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6ebcaa700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6e40aa430 con 0x7fc6e40664e0 2020-10-31T22:41:20.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6e9245700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e40b0dc0 0x7fc6e413f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6e9245700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e40b0dc0 0x7fc6e413f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41716/0 (socket says 172.21.15.60:41716) 2020-10-31T22:41:20.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6e9245700 1 -- 172.21.15.60:0/359277223 learned_addr learned my addr 172.21.15.60:0/359277223 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:20.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6ea247700 1 --2- 172.21.15.60:0/359277223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6e413fd20 0x7fc6e4137490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6e9a46700 1 --2- 172.21.15.60:0/359277223 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6e40664e0 0x7fc6e40b4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6e9245700 1 -- 172.21.15.60:0/359277223 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6e40664e0 msgr2=0x7fc6e40b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6e9245700 1 --2- 172.21.15.60:0/359277223 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6e40664e0 0x7fc6e40b4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6e9245700 1 -- 172.21.15.60:0/359277223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6e413fd20 msgr2=0x7fc6e4137490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6e9245700 1 --2- 172.21.15.60:0/359277223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6e413fd20 0x7fc6e4137490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6e9245700 1 -- 172.21.15.60:0/359277223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e40aa750 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6e9245700 1 --2- 172.21.15.60:0/359277223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e40b0dc0 0x7fc6e413f000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fc6e0001490 tx=0x7fc6e0007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:20.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6d6ffd700 1 -- 172.21.15.60:0/359277223 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6e0002240 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6d6ffd700 1 -- 172.21.15.60:0/359277223 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e00023a0 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/359277223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6e40b4270 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6d6ffd700 1 -- 172.21.15.60:0/359277223 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6e0001640 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/359277223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6e40b6100 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:19.999+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/359277223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6e4057100 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.003+0000 7fc6d6ffd700 1 -- 172.21.15.60:0/359277223 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc6e0019030 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.003+0000 7fc6d6ffd700 1 --2- 172.21.15.60:0/359277223 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc6c4055020 0x7fc6c40574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.003+0000 7fc6d6ffd700 1 -- 172.21.15.60:0/359277223 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc6e006d1a0 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.003+0000 7fc6e9a46700 1 --2- 172.21.15.60:0/359277223 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc6c4055020 0x7fc6c40574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.003+0000 7fc6e9a46700 1 --2- 172.21.15.60:0/359277223 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc6c4055020 0x7fc6c40574e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fc6d8019000 tx=0x7fc6d8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:20.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.007+0000 7fc6d6ffd700 1 -- 172.21.15.60:0/359277223 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc6e00435b0 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.151+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/359277223 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6e40b3560 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.151+0000 7fc6d6ffd700 1 -- 172.21.15.60:0/359277223 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc6e0046bd0 con 0x7fc6e40b0dc0 2020-10-31T22:41:20.154 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:20.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.151+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/359277223 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc6c4055020 msgr2=0x7fc6c40574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.151+0000 7fc6ebcaa700 1 --2- 172.21.15.60:0/359277223 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc6c4055020 0x7fc6c40574e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7fc6d8019000 tx=0x7fc6d8015000).stop 2020-10-31T22:41:20.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.151+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/359277223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e40b0dc0 msgr2=0x7fc6e413f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.151+0000 7fc6ebcaa700 1 --2- 172.21.15.60:0/359277223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e40b0dc0 0x7fc6e413f000 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fc6e0001490 tx=0x7fc6e0007df0).stop 2020-10-31T22:41:20.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.151+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/359277223 shutdown_connections 2020-10-31T22:41:20.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.151+0000 7fc6ebcaa700 1 --2- 172.21.15.60:0/359277223 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc6c4055020 0x7fc6c40574e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.151+0000 7fc6ebcaa700 1 --2- 172.21.15.60:0/359277223 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc6e413fd20 0x7fc6e4137490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.151+0000 7fc6ebcaa700 1 --2- 172.21.15.60:0/359277223 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc6e40664e0 0x7fc6e40b4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.151+0000 7fc6ebcaa700 1 --2- 172.21.15.60:0/359277223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6e40b0dc0 0x7fc6e413f000 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.151+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/359277223 >> 172.21.15.60:0/359277223 conn(0x7fc6e406a260 msgr2=0x7fc6e413c610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:20.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.151+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/359277223 shutdown_connections 2020-10-31T22:41:20.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.151+0000 7fc6ebcaa700 1 -- 172.21.15.60:0/359277223 wait complete. 2020-10-31T22:41:20.168 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:41:20.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.283+0000 7fe7021c3700 1 Processor -- start 2020-10-31T22:41:20.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.283+0000 7fe7021c3700 1 -- start start 2020-10-31T22:41:20.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.283+0000 7fe7021c3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6fc0b52a0 0x7fe6fc141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.283+0000 7fe7021c3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe6fc05c8a0 0x7fe6fc0af400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.283+0000 7fe7021c3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6fc06a8f0 con 0x7fe6fc05bde0 2020-10-31T22:41:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.283+0000 7fe7021c3700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6fc0af8f0 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.283+0000 7fe7021c3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc05b160 con 0x7fe6fc0b52a0 2020-10-31T22:41:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe6fbfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe6fc05bde0 0x7fe6fc0adf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45862/0 (socket says 172.21.15.60:45862) 2020-10-31T22:41:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe6fbfff700 1 -- 172.21.15.60:0/4054873982 learned_addr learned my addr 172.21.15.60:0/4054873982 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe6fb7fe700 1 --2- 172.21.15.60:0/4054873982 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6fc0b52a0 0x7fe6fc141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe6faffd700 1 --2- 172.21.15.60:0/4054873982 >> v2:172.21.15.66:3300/0 conn(0x7fe6fc05c8a0 0x7fe6fc0af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe6fa7fc700 1 -- 172.21.15.60:0/4054873982 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857405244 0 0) 0x7fe6f4001450 con 0x7fe6fc05bde0 2020-10-31T22:41:20.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe6fa7fc700 1 -- 172.21.15.60:0/4054873982 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6dc003230 con 0x7fe6fc05bde0 2020-10-31T22:41:20.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe6faffd700 1 -- 172.21.15.60:0/4054873982 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6fc0b52a0 msgr2=0x7fe6fc141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:20.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe6faffd700 1 --2- 172.21.15.60:0/4054873982 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6fc0b52a0 0x7fe6fc141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe6faffd700 1 -- 172.21.15.60:0/4054873982 >> v1:172.21.15.60:6789/0 conn(0x7fe6fc05bde0 legacy=0x7fe6fc0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe6faffd700 1 -- 172.21.15.60:0/4054873982 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc05b400 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe6faffd700 1 --2- 172.21.15.60:0/4054873982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc05c8a0 0x7fe6fc0af400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fe6e4002f30 tx=0x7fe6e4006dc0).ready entity=mon.1 client_cookie=87e82e1b98b7bd66 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:20.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe6fa7fc700 1 -- 172.21.15.60:0/4054873982 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e40096a0 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe6fa7fc700 1 -- 172.21.15.60:0/4054873982 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e4009800 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe6fa7fc700 1 -- 172.21.15.60:0/4054873982 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e4009b60 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe7021c3700 1 -- 172.21.15.60:0/4054873982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc05c8a0 msgr2=0x7fe6fc0af400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe7021c3700 1 --2- 172.21.15.60:0/4054873982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc05c8a0 0x7fe6fc0af400 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fe6e4002f30 tx=0x7fe6e4006dc0).stop 2020-10-31T22:41:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe7021c3700 1 -- 172.21.15.60:0/4054873982 shutdown_connections 2020-10-31T22:41:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe7021c3700 1 --2- 172.21.15.60:0/4054873982 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6fc0b52a0 0x7fe6fc141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe7021c3700 1 --2- 172.21.15.60:0/4054873982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc05c8a0 0x7fe6fc0af400 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe7021c3700 1 -- 172.21.15.60:0/4054873982 >> 172.21.15.60:0/4054873982 conn(0x7fe6fc060c50 msgr2=0x7fe6fc0b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe7021c3700 1 -- 172.21.15.60:0/4054873982 shutdown_connections 2020-10-31T22:41:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.287+0000 7fe7021c3700 1 -- 172.21.15.60:0/4054873982 wait complete. 2020-10-31T22:41:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe7021c3700 1 Processor -- start 2020-10-31T22:41:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe7021c3700 1 -- start start 2020-10-31T22:41:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe7021c3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc05bde0 0x7fe6fc13ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe7021c3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6fc05c8a0 0x7fe6fc1463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe7021c3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6fc0b52a0 0x7fe6fc1468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe7021c3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc146da0 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe7021c3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc145b70 con 0x7fe6fc05bde0 2020-10-31T22:41:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe7021c3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6fc145e10 con 0x7fe6fc0b52a0 2020-10-31T22:41:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe6faffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6fc05c8a0 0x7fe6fc1463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe6faffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6fc05c8a0 0x7fe6fc1463c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41730/0 (socket says 172.21.15.60:41730) 2020-10-31T22:41:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe6faffd700 1 -- 172.21.15.60:0/157440932 learned_addr learned my addr 172.21.15.60:0/157440932 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe6fb7fe700 1 --2- 172.21.15.60:0/157440932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc05bde0 0x7fe6fc13ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe6fbfff700 1 --2- 172.21.15.60:0/157440932 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6fc0b52a0 0x7fe6fc1468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe6faffd700 1 -- 172.21.15.60:0/157440932 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6fc0b52a0 msgr2=0x7fe6fc1468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe6faffd700 1 --2- 172.21.15.60:0/157440932 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6fc0b52a0 0x7fe6fc1468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe6faffd700 1 -- 172.21.15.60:0/157440932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc05bde0 msgr2=0x7fe6fc13ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe6faffd700 1 --2- 172.21.15.60:0/157440932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc05bde0 0x7fe6fc13ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe6faffd700 1 -- 172.21.15.60:0/157440932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6fc1460b0 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.291+0000 7fe6faffd700 1 --2- 172.21.15.60:0/157440932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6fc05c8a0 0x7fe6fc1463c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fe6e4002f30 tx=0x7fe6e4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.295+0000 7fe6f8ff9700 1 -- 172.21.15.60:0/157440932 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e4011bf0 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.295+0000 7fe6f8ff9700 1 -- 172.21.15.60:0/157440932 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e4011d50 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.295+0000 7fe7021c3700 1 -- 172.21.15.60:0/157440932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6fc1414f0 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.295+0000 7fe6f8ff9700 1 -- 172.21.15.60:0/157440932 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e401d640 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.295+0000 7fe7021c3700 1 -- 172.21.15.60:0/157440932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6fc141990 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.295+0000 7fe7021c3700 1 -- 172.21.15.60:0/157440932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6fc141680 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.295+0000 7fe6f8ff9700 1 -- 172.21.15.60:0/157440932 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe6e4024030 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.295+0000 7fe6f8ff9700 1 --2- 172.21.15.60:0/157440932 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6e0054f30 0x7fe6e00573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.295+0000 7fe6fb7fe700 1 --2- 172.21.15.60:0/157440932 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6e0054f30 0x7fe6e00573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.295+0000 7fe6f8ff9700 1 -- 172.21.15.60:0/157440932 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe6e406eb50 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.295+0000 7fe6fb7fe700 1 --2- 172.21.15.60:0/157440932 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6e0054f30 0x7fe6e00573f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fe6ec008000 tx=0x7fe6ec008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.303+0000 7fe6f8ff9700 1 -- 172.21.15.60:0/157440932 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe6e4045070 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.451+0000 7fe7021c3700 1 -- 172.21.15.60:0/157440932 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe6fc057100 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.451+0000 7fe6f8ff9700 1 -- 172.21.15.60:0/157440932 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe6e4022070 con 0x7fe6fc05c8a0 2020-10-31T22:41:20.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.451+0000 7fe7021c3700 1 -- 172.21.15.60:0/157440932 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6e0054f30 msgr2=0x7fe6e00573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.451+0000 7fe7021c3700 1 --2- 172.21.15.60:0/157440932 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6e0054f30 0x7fe6e00573f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fe6ec008000 tx=0x7fe6ec008040).stop 2020-10-31T22:41:20.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.451+0000 7fe7021c3700 1 -- 172.21.15.60:0/157440932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6fc05c8a0 msgr2=0x7fe6fc1463c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.451+0000 7fe7021c3700 1 --2- 172.21.15.60:0/157440932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6fc05c8a0 0x7fe6fc1463c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fe6e4002f30 tx=0x7fe6e4015000).stop 2020-10-31T22:41:20.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.451+0000 7fe7021c3700 1 -- 172.21.15.60:0/157440932 shutdown_connections 2020-10-31T22:41:20.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.451+0000 7fe7021c3700 1 --2- 172.21.15.60:0/157440932 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6fc0b52a0 0x7fe6fc1468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.451+0000 7fe7021c3700 1 --2- 172.21.15.60:0/157440932 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6e0054f30 0x7fe6e00573f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.451+0000 7fe7021c3700 1 --2- 172.21.15.60:0/157440932 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6fc05bde0 0x7fe6fc13ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.451+0000 7fe7021c3700 1 --2- 172.21.15.60:0/157440932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6fc05c8a0 0x7fe6fc1463c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.451+0000 7fe7021c3700 1 -- 172.21.15.60:0/157440932 >> 172.21.15.60:0/157440932 conn(0x7fe6fc060c50 msgr2=0x7fe6fc0b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:20.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.451+0000 7fe7021c3700 1 -- 172.21.15.60:0/157440932 shutdown_connections 2020-10-31T22:41:20.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.451+0000 7fe7021c3700 1 -- 172.21.15.60:0/157440932 wait complete. 2020-10-31T22:41:20.459 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:20.473 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:41:20.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.583+0000 7fea9359e700 1 Processor -- start 2020-10-31T22:41:20.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.583+0000 7fea9359e700 1 -- start start 2020-10-31T22:41:20.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea9359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fea8c05c4c0 0x7fea8c05c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea9359e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fea8c0b2e20 0x7fea8c146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea9359e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea8c065e90 con 0x7fea8c0b4410 2020-10-31T22:41:20.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea9359e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8c141ef0 con 0x7fea8c0b2e20 2020-10-31T22:41:20.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea9359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c066130 con 0x7fea8c05c4c0 2020-10-31T22:41:20.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea91b3b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fea8c0b4410 0x7fea8c13f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45874/0 (socket says 172.21.15.60:45874) 2020-10-31T22:41:20.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea91b3b700 1 -- 172.21.15.60:0/1294980348 learned_addr learned my addr 172.21.15.60:0/1294980348 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:20.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea9133a700 1 --2- 172.21.15.60:0/1294980348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fea8c05c4c0 0x7fea8c05c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea90b39700 1 --2- 172.21.15.60:0/1294980348 >> v2:172.21.15.66:3300/0 conn(0x7fea8c0b2e20 0x7fea8c146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 -- 172.21.15.60:0/1294980348 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187900124 0 0) 0x7fea8c065e90 con 0x7fea8c0b4410 2020-10-31T22:41:20.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 -- 172.21.15.60:0/1294980348 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea78003230 con 0x7fea8c0b4410 2020-10-31T22:41:20.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 -- 172.21.15.60:0/1294980348 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3802660882 0 0) 0x7fea78003230 con 0x7fea8c0b4410 2020-10-31T22:41:20.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 -- 172.21.15.60:0/1294980348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fea8c05c4c0 msgr2=0x7fea8c05c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:20.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 --2- 172.21.15.60:0/1294980348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fea8c05c4c0 0x7fea8c05c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 -- 172.21.15.60:0/1294980348 >> v2:172.21.15.66:3300/0 conn(0x7fea8c0b2e20 msgr2=0x7fea8c146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:20.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 --2- 172.21.15.60:0/1294980348 >> v2:172.21.15.66:3300/0 conn(0x7fea8c0b2e20 0x7fea8c146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 -- 172.21.15.60:0/1294980348 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c0663d0 con 0x7fea8c0b4410 2020-10-31T22:41:20.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 -- 172.21.15.60:0/1294980348 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fea7c0016d0 con 0x7fea8c0b4410 2020-10-31T22:41:20.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 -- 172.21.15.60:0/1294980348 >> v1:172.21.15.60:6789/0 conn(0x7fea8c0b4410 legacy=0x7fea8c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 --2- 172.21.15.60:0/1294980348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fea78003720 0x7fea78003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 --2- 172.21.15.60:0/1294980348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea780040a0 0x7fea78004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 --2- 172.21.15.60:0/1294980348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea78004b70 0x7fea78004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 -- 172.21.15.60:0/1294980348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c066130 con 0x7fea78004b70 2020-10-31T22:41:20.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 -- 172.21.15.60:0/1294980348 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7800b990 con 0x7fea780040a0 2020-10-31T22:41:20.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 -- 172.21.15.60:0/1294980348 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7800bb50 con 0x7fea78003720 2020-10-31T22:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea9133a700 1 --2- 172.21.15.60:0/1294980348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fea8c05c4c0 0x7fea8c05c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea91b3b700 1 --2- 172.21.15.60:0/1294980348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea78004b70 0x7fea78004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea90b39700 1 --2- 172.21.15.60:0/1294980348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea780040a0 0x7fea78004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea9133a700 1 --2- 172.21.15.60:0/1294980348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fea78003720 0x7fea78003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea91b3b700 1 -- 172.21.15.60:0/1294980348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fea78003720 msgr2=0x7fea78003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea91b3b700 1 --2- 172.21.15.60:0/1294980348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fea78003720 0x7fea78003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea91b3b700 1 -- 172.21.15.60:0/1294980348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea780040a0 msgr2=0x7fea78004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:20.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea91b3b700 1 --2- 172.21.15.60:0/1294980348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea780040a0 0x7fea78004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea91b3b700 1 -- 172.21.15.60:0/1294980348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78003230 con 0x7fea78004b70 2020-10-31T22:41:20.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea91b3b700 1 --2- 172.21.15.60:0/1294980348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea78004b70 0x7fea78004ff0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fea7c0013e0 tx=0x7fea8c0b04c0).ready entity=mon.0 client_cookie=7bca8ac5ed913675 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:20.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 -- 172.21.15.60:0/1294980348 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea7c0070d0 con 0x7fea78004b70 2020-10-31T22:41:20.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 -- 172.21.15.60:0/1294980348 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7c007230 con 0x7fea78004b70 2020-10-31T22:41:20.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea8bfff700 1 -- 172.21.15.60:0/1294980348 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea7c0055e0 con 0x7fea78004b70 2020-10-31T22:41:20.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea9359e700 1 -- 172.21.15.60:0/1294980348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea78004b70 msgr2=0x7fea78004ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea9359e700 1 --2- 172.21.15.60:0/1294980348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea78004b70 0x7fea78004ff0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fea7c0013e0 tx=0x7fea8c0b04c0).stop 2020-10-31T22:41:20.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea91b3b700 1 -- 172.21.15.60:0/1294980348 reap_dead start 2020-10-31T22:41:20.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea9359e700 1 -- 172.21.15.60:0/1294980348 shutdown_connections 2020-10-31T22:41:20.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea9359e700 1 -- 172.21.15.60:0/1294980348 >> 172.21.15.60:0/1294980348 conn(0x7fea8c0601e0 msgr2=0x7fea8c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:20.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea9359e700 1 -- 172.21.15.60:0/1294980348 shutdown_connections 2020-10-31T22:41:20.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.587+0000 7fea9359e700 1 -- 172.21.15.60:0/1294980348 wait complete. 2020-10-31T22:41:20.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea9359e700 1 Processor -- start 2020-10-31T22:41:20.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea9359e700 1 -- start start 2020-10-31T22:41:20.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea9359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fea8c0aa380 0x7fea8c0aa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea9359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea8c0b7150 0x7fea8c0b6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea9359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea8c1546b0 0x7fea8c154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea9359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c1520a0 con 0x7fea8c0b7150 2020-10-31T22:41:20.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea9359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c151e00 con 0x7fea8c1546b0 2020-10-31T22:41:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea9359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c0af0e0 con 0x7fea8c0aa380 2020-10-31T22:41:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea90b39700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea8c0b7150 0x7fea8c0b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea90b39700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea8c0b7150 0x7fea8c0b6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41748/0 (socket says 172.21.15.60:41748) 2020-10-31T22:41:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea90b39700 1 -- 172.21.15.60:0/3239053332 learned_addr learned my addr 172.21.15.60:0/3239053332 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea9133a700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fea8c0aa380 0x7fea8c0aa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea91b3b700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea8c1546b0 0x7fea8c154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea90b39700 1 -- 172.21.15.60:0/3239053332 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fea8c0aa380 msgr2=0x7fea8c0aa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea90b39700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fea8c0aa380 0x7fea8c0aa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea90b39700 1 -- 172.21.15.60:0/3239053332 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea8c1546b0 msgr2=0x7fea8c154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea90b39700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea8c1546b0 0x7fea8c154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea90b39700 1 -- 172.21.15.60:0/3239053332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c151b20 con 0x7fea8c0b7150 2020-10-31T22:41:20.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea91b3b700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea8c1546b0 0x7fea8c154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:20.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea90b39700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea8c0b7150 0x7fea8c0b6630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fea80000b20 tx=0x7fea80008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:20.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea8a7fc700 1 -- 172.21.15.60:0/3239053332 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea8000e8f0 con 0x7fea8c0b7150 2020-10-31T22:41:20.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea8a7fc700 1 -- 172.21.15.60:0/3239053332 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8000ea50 con 0x7fea8c0b7150 2020-10-31T22:41:20.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea9359e700 1 -- 172.21.15.60:0/3239053332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8c0af580 con 0x7fea8c0b7150 2020-10-31T22:41:20.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea8a7fc700 1 -- 172.21.15.60:0/3239053332 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea8000edb0 con 0x7fea8c0b7150 2020-10-31T22:41:20.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea9359e700 1 -- 172.21.15.60:0/3239053332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8c0b7750 con 0x7fea8c0b7150 2020-10-31T22:41:20.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea9359e700 1 -- 172.21.15.60:0/3239053332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8c057100 con 0x7fea8c0b7150 2020-10-31T22:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.591+0000 7fea8a7fc700 1 -- 172.21.15.60:0/3239053332 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fea80014470 con 0x7fea8c0b7150 2020-10-31T22:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.595+0000 7fea8a7fc700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fea6c054f90 0x7fea6c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.595+0000 7fea9133a700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fea6c054f90 0x7fea6c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:20.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.595+0000 7fea8a7fc700 1 -- 172.21.15.60:0/3239053332 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fea8006e330 con 0x7fea8c0b7150 2020-10-31T22:41:20.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.595+0000 7fea9133a700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fea6c054f90 0x7fea6c057450 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fea8400b000 tx=0x7fea84008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:20.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.603+0000 7fea8a7fc700 1 -- 172.21.15.60:0/3239053332 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fea800446e0 con 0x7fea8c0b7150 2020-10-31T22:41:20.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.783+0000 7fea9359e700 1 -- 172.21.15.60:0/3239053332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea8c142c90 con 0x7fea8c0b7150 2020-10-31T22:41:20.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.783+0000 7fea8a7fc700 1 -- 172.21.15.60:0/3239053332 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2483 (secure 0 0 0) 0x7fea80047d00 con 0x7fea8c0b7150 2020-10-31T22:41:20.788 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:20.788 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/909749940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":909749940},{"type":"v1","addr":"172.21.15.60:6837","nonce":909749940}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3142095774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3142095774},{"type":"v1","addr":"172.21.15.60:6835","nonce":3142095774}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:41:10.055893+0000","modified":"2020-10-31T22:41:11.058634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.66:6833/4161698670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4161698670},{"type":"v1","addr":"172.21.15.66:6833","nonce":4161698670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-10-31T22:41:20.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.783+0000 7fea9359e700 1 -- 172.21.15.60:0/3239053332 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fea6c054f90 msgr2=0x7fea6c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.783+0000 7fea9359e700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fea6c054f90 0x7fea6c057450 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fea8400b000 tx=0x7fea84008040).stop 2020-10-31T22:41:20.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.783+0000 7fea9359e700 1 -- 172.21.15.60:0/3239053332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea8c0b7150 msgr2=0x7fea8c0b6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:20.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.783+0000 7fea9359e700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea8c0b7150 0x7fea8c0b6630 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fea80000b20 tx=0x7fea80008040).stop 2020-10-31T22:41:20.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.787+0000 7fea9359e700 1 -- 172.21.15.60:0/3239053332 shutdown_connections 2020-10-31T22:41:20.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.787+0000 7fea9359e700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fea6c054f90 0x7fea6c057450 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.787+0000 7fea9359e700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea8c1546b0 0x7fea8c154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.787+0000 7fea9359e700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fea8c0aa380 0x7fea8c0aa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.787+0000 7fea9359e700 1 --2- 172.21.15.60:0/3239053332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fea8c0b7150 0x7fea8c0b6630 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:20.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.787+0000 7fea9359e700 1 -- 172.21.15.60:0/3239053332 >> 172.21.15.60:0/3239053332 conn(0x7fea8c0601e0 msgr2=0x7fea8c0b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:20.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.787+0000 7fea9359e700 1 -- 172.21.15.60:0/3239053332 shutdown_connections 2020-10-31T22:41:20.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:20.787+0000 7fea9359e700 1 -- 172.21.15.60:0/3239053332 wait complete. 2020-10-31T22:41:20.792 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 5 2020-10-31T22:41:21.102 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:41:10.055893+0000', 'modified': '2020-10-31T22:41:11.058634+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.66:6833/4161698670', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 4161698670}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 4161698670}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:41:21.103 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:41:21.104 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-10-31T22:41:21.238 INFO:teuthology.orchestra.run.smithi066.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":4306,"want_state":"up:active","state":"up:active","rank_uptime":11.167323607,"mdsmap_epoch":5,"osdmap_epoch":22,"osdmap_epoch_barrier":21,"uptime":14.692555114999999} 2020-10-31T22:41:21.239 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 4306, "mdsmap_epoch": 5, "osdmap_epoch": 22, "osdmap_epoch_barrier": 21, "rank_uptime": 11.167323607, "state": "up:active", "uptime": 14.692555115, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:41:21.239 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-10-31T22:41:21.268 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-10-31T22:41:21.268 INFO:tasks.ceph_fuse:config is None 2020-10-31T22:41:21.269 INFO:tasks.ceph_fuse:new config is {'client.0': None, 'client.1': None} 2020-10-31T22:41:21.269 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-10-31T22:41:21.270 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:21.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.395+0000 7f8b9e626700 1 Processor -- start 2020-10-31T22:41:21.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.395+0000 7f8b9e626700 1 -- start start 2020-10-31T22:41:21.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b980b52a0 0x7f8b980abe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:21.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b980acab0 0x7f8b980ac320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:21.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8b9805c440 0x7f8b9813ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:21.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b980ae1e0 con 0x7f8b980b52a0 2020-10-31T22:41:21.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b980ae480 con 0x7f8b9805c440 2020-10-31T22:41:21.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980ae720 con 0x7f8b980acab0 2020-10-31T22:41:21.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b97fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b980b52a0 0x7f8b980abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:21.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b97fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b980b52a0 0x7f8b980abe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41756/0 (socket says 172.21.15.60:41756) 2020-10-31T22:41:21.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b97fff700 1 -- 172.21.15.60:0/1127358924 learned_addr learned my addr 172.21.15.60:0/1127358924 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:21.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9cbc3700 1 --2- 172.21.15.60:0/1127358924 >> v2:172.21.15.66:3300/0 conn(0x7f8b9805c440 0x7f8b9813ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:21.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b8f7fe700 1 --2- 172.21.15.60:0/1127358924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b980acab0 0x7f8b980ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:21.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b97fff700 1 -- 172.21.15.60:0/1127358924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b980acab0 msgr2=0x7f8b980ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:21.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b97fff700 1 --2- 172.21.15.60:0/1127358924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b980acab0 0x7f8b980ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b97fff700 1 -- 172.21.15.60:0/1127358924 >> v2:172.21.15.66:3300/0 conn(0x7f8b9805c440 msgr2=0x7f8b9813ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:21.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b97fff700 1 --2- 172.21.15.60:0/1127358924 >> v2:172.21.15.66:3300/0 conn(0x7f8b9805c440 0x7f8b9813ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b97fff700 1 -- 172.21.15.60:0/1127358924 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b980ae9c0 con 0x7f8b980b52a0 2020-10-31T22:41:21.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9cbc3700 1 --2- 172.21.15.60:0/1127358924 >> v2:172.21.15.66:3300/0 conn(0x7f8b9805c440 0x7f8b9813ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:21.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b97fff700 1 --2- 172.21.15.60:0/1127358924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980b52a0 0x7f8b980abe30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f8b88002f30 tx=0x7f8b88006f10).ready entity=mon.0 client_cookie=bf6cc91d805f0c92 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:21.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b977fe700 1 -- 172.21.15.60:0/1127358924 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b8800de50 con 0x7f8b980b52a0 2020-10-31T22:41:21.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b977fe700 1 -- 172.21.15.60:0/1127358924 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b88010470 con 0x7f8b980b52a0 2020-10-31T22:41:21.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b977fe700 1 -- 172.21.15.60:0/1127358924 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b880107d0 con 0x7f8b980b52a0 2020-10-31T22:41:21.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 -- 172.21.15.60:0/1127358924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980b52a0 msgr2=0x7f8b980abe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:21.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 --2- 172.21.15.60:0/1127358924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980b52a0 0x7f8b980abe30 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f8b88002f30 tx=0x7f8b88006f10).stop 2020-10-31T22:41:21.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 -- 172.21.15.60:0/1127358924 shutdown_connections 2020-10-31T22:41:21.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 --2- 172.21.15.60:0/1127358924 >> v2:172.21.15.66:3300/0 conn(0x7f8b9805c440 0x7f8b9813ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 --2- 172.21.15.60:0/1127358924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980b52a0 0x7f8b980abe30 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 --2- 172.21.15.60:0/1127358924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b980acab0 0x7f8b980ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 -- 172.21.15.60:0/1127358924 >> 172.21.15.60:0/1127358924 conn(0x7f8b98060c10 msgr2=0x7f8b980b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:21.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 -- 172.21.15.60:0/1127358924 shutdown_connections 2020-10-31T22:41:21.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.399+0000 7f8b9e626700 1 -- 172.21.15.60:0/1127358924 wait complete. 2020-10-31T22:41:21.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.403+0000 7f8b9e626700 1 Processor -- start 2020-10-31T22:41:21.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.403+0000 7f8b9e626700 1 -- start start 2020-10-31T22:41:21.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9e626700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b9805c440 0x7f8b980aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:21.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9e626700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b980acab0 0x7f8b98141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:21.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9e626700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980b52a0 0x7f8b98063530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:21.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9e626700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980666d0 con 0x7f8b980b52a0 2020-10-31T22:41:21.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9e626700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980668f0 con 0x7f8b980acab0 2020-10-31T22:41:21.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9e626700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b98066430 con 0x7f8b9805c440 2020-10-31T22:41:21.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b97fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b9805c440 0x7f8b980aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b97fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b9805c440 0x7f8b980aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:54950/0 (socket says 172.21.15.60:54950) 2020-10-31T22:41:21.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b97fff700 1 -- 172.21.15.60:0/1398003321 learned_addr learned my addr 172.21.15.60:0/1398003321 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:21.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9cbc3700 1 --2- 172.21.15.60:0/1398003321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980b52a0 0x7f8b98063530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:21.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9cbc3700 1 -- 172.21.15.60:0/1398003321 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b9805c440 msgr2=0x7f8b980aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:21.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9cbc3700 1 --2- 172.21.15.60:0/1398003321 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b9805c440 0x7f8b980aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9cbc3700 1 -- 172.21.15.60:0/1398003321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b980acab0 msgr2=0x7f8b98141d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:21.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9cbc3700 1 --2- 172.21.15.60:0/1398003321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b980acab0 0x7f8b98141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-10-31T22:41:21.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9cbc3700 1 -- 172.21.15.60:0/1398003321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b980ab360 con 0x7f8b980b52a0 2020-10-31T22:41:21.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9cbc3700 1 --2- 172.21.15.60:0/1398003321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980b52a0 0x7f8b98063530 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f8b9000a000 tx=0x7f8b90008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:21.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b95ffb700 1 -- 172.21.15.60:0/1398003321 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b9000c7e0 con 0x7f8b980b52a0 2020-10-31T22:41:21.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b95ffb700 1 -- 172.21.15.60:0/1398003321 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b9000c940 con 0x7f8b980b52a0 2020-10-31T22:41:21.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9e626700 1 -- 172.21.15.60:0/1398003321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b98066030 con 0x7f8b980b52a0 2020-10-31T22:41:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b95ffb700 1 -- 172.21.15.60:0/1398003321 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b9000cca0 con 0x7f8b980b52a0 2020-10-31T22:41:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9e626700 1 -- 172.21.15.60:0/1398003321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b98063a20 con 0x7f8b980b52a0 2020-10-31T22:41:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.407+0000 7f8b9e626700 1 -- 172.21.15.60:0/1398003321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b98057100 con 0x7f8b980b52a0 2020-10-31T22:41:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.411+0000 7f8b95ffb700 1 -- 172.21.15.60:0/1398003321 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8b9001d460 con 0x7f8b980b52a0 2020-10-31T22:41:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.411+0000 7f8b95ffb700 1 --2- 172.21.15.60:0/1398003321 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b7c0550e0 0x7f8b7c0575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.411+0000 7f8b95ffb700 1 -- 172.21.15.60:0/1398003321 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8b9006e890 con 0x7f8b980b52a0 2020-10-31T22:41:21.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.411+0000 7f8b97fff700 1 --2- 172.21.15.60:0/1398003321 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b7c0550e0 0x7f8b7c0575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.411+0000 7f8b97fff700 1 --2- 172.21.15.60:0/1398003321 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b7c0550e0 0x7f8b7c0575a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f8b8801b000 tx=0x7f8b980ae060).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:21.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.419+0000 7f8b95ffb700 1 -- 172.21.15.60:0/1398003321 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8b90044d50 con 0x7f8b980b52a0 2020-10-31T22:41:21.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.559+0000 7f8b9e626700 1 -- 172.21.15.60:0/1398003321 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b9805aa30 con 0x7f8b980b52a0 2020-10-31T22:41:21.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.563+0000 7f8b95ffb700 1 -- 172.21.15.60:0/1398003321 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f8b9000ce00 con 0x7f8b980b52a0 2020-10-31T22:41:21.567 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:21.567 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:11.059362+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:07.982891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:08.927092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:21.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.567+0000 7f8b9e626700 1 -- 172.21.15.60:0/1398003321 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b7c0550e0 msgr2=0x7f8b7c0575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:21.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.567+0000 7f8b9e626700 1 --2- 172.21.15.60:0/1398003321 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b7c0550e0 0x7f8b7c0575a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f8b8801b000 tx=0x7f8b980ae060).stop 2020-10-31T22:41:21.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.567+0000 7f8b9e626700 1 -- 172.21.15.60:0/1398003321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980b52a0 msgr2=0x7f8b98063530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:21.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.567+0000 7f8b9e626700 1 --2- 172.21.15.60:0/1398003321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980b52a0 0x7f8b98063530 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f8b9000a000 tx=0x7f8b90008040).stop 2020-10-31T22:41:21.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.567+0000 7f8b9e626700 1 -- 172.21.15.60:0/1398003321 shutdown_connections 2020-10-31T22:41:21.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.567+0000 7f8b9e626700 1 --2- 172.21.15.60:0/1398003321 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b980b52a0 0x7f8b98063530 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.567+0000 7f8b9e626700 1 --2- 172.21.15.60:0/1398003321 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b9805c440 0x7f8b980aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.567+0000 7f8b9e626700 1 --2- 172.21.15.60:0/1398003321 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b7c0550e0 0x7f8b7c0575a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.567+0000 7f8b9e626700 1 --2- 172.21.15.60:0/1398003321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b980acab0 0x7f8b98141d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-10-31T22:41:21.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.567+0000 7f8b9e626700 1 -- 172.21.15.60:0/1398003321 >> 172.21.15.60:0/1398003321 conn(0x7f8b98060c10 msgr2=0x7f8b980b4870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:21.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.567+0000 7f8b9e626700 1 -- 172.21.15.60:0/1398003321 shutdown_connections 2020-10-31T22:41:21.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.567+0000 7f8b9e626700 1 -- 172.21.15.60:0/1398003321 wait complete. 2020-10-31T22:41:21.637 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:41:07.982891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:41:08.927092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:41:21.638 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:41:21.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54eeb49700 1 Processor -- start 2020-10-31T22:41:21.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54eeb49700 1 -- start start 2020-10-31T22:41:21.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54eeb49700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54e8063140 0x7f54e80afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:21.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54eeb49700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f54e80ae740 0x7f54e80b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54eeb49700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e80b0390 con 0x7f54e80aee10 2020-10-31T22:41:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54eeb49700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54e8063520 con 0x7f54e80ae740 2020-10-31T22:41:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54eeb49700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e80b19c0 con 0x7f54e8063140 2020-10-31T22:41:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54ee348700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f54e80aee10 0x7f54e80ab860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45908/0 (socket says 172.21.15.60:45908) 2020-10-31T22:41:21.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54ee348700 1 -- 172.21.15.60:0/456771103 learned_addr learned my addr 172.21.15.60:0/456771103 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:21.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54edb47700 1 --2- 172.21.15.60:0/456771103 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54e8063140 0x7f54e80afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:21.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54ed346700 1 --2- 172.21.15.60:0/456771103 >> v2:172.21.15.66:3300/0 conn(0x7f54e80ae740 0x7f54e80b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:21.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54ecb45700 1 -- 172.21.15.60:0/456771103 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968174666 0 0) 0x7f54e80b0390 con 0x7f54e80aee10 2020-10-31T22:41:21.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54ecb45700 1 -- 172.21.15.60:0/456771103 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54d0003230 con 0x7f54e80aee10 2020-10-31T22:41:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54edb47700 1 -- 172.21.15.60:0/456771103 >> v2:172.21.15.66:3300/0 conn(0x7f54e80ae740 msgr2=0x7f54e80b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54edb47700 1 --2- 172.21.15.60:0/456771103 >> v2:172.21.15.66:3300/0 conn(0x7f54e80ae740 0x7f54e80b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54ecb45700 1 -- 172.21.15.60:0/456771103 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3072460980 0 0) 0x7f54d0003230 con 0x7f54e80aee10 2020-10-31T22:41:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54edb47700 1 -- 172.21.15.60:0/456771103 >> v1:172.21.15.60:6789/0 conn(0x7f54e80aee10 legacy=0x7f54e80ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54edb47700 1 -- 172.21.15.60:0/456771103 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e80a9070 con 0x7f54e8063140 2020-10-31T22:41:21.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.763+0000 7f54edb47700 1 --2- 172.21.15.60:0/456771103 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54e8063140 0x7f54e80afea0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f54e0001bf0 tx=0x7f54e4006dc0).ready entity=mon.2 client_cookie=c05e469b59650f9d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.767+0000 7f54ecb45700 1 -- 172.21.15.60:0/456771103 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54e0001a50 con 0x7f54e8063140 2020-10-31T22:41:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.767+0000 7f54ecb45700 1 -- 172.21.15.60:0/456771103 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e400d570 con 0x7f54e8063140 2020-10-31T22:41:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.767+0000 7f54ecb45700 1 -- 172.21.15.60:0/456771103 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54e400d6e0 con 0x7f54e8063140 2020-10-31T22:41:21.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.767+0000 7f54eeb49700 1 -- 172.21.15.60:0/456771103 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54e8063140 msgr2=0x7f54e80afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:21.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.767+0000 7f54eeb49700 1 --2- 172.21.15.60:0/456771103 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54e8063140 0x7f54e80afea0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f54e0001bf0 tx=0x7f54e4006dc0).stop 2020-10-31T22:41:21.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.767+0000 7f54eeb49700 1 -- 172.21.15.60:0/456771103 shutdown_connections 2020-10-31T22:41:21.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.767+0000 7f54eeb49700 1 --2- 172.21.15.60:0/456771103 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54e8063140 0x7f54e80afea0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.767+0000 7f54eeb49700 1 --2- 172.21.15.60:0/456771103 >> v2:172.21.15.66:3300/0 conn(0x7f54e80ae740 0x7f54e80b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.767+0000 7f54eeb49700 1 -- 172.21.15.60:0/456771103 >> 172.21.15.60:0/456771103 conn(0x7f54e806a600 msgr2=0x7f54e8060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:21.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.767+0000 7f54eeb49700 1 -- 172.21.15.60:0/456771103 shutdown_connections 2020-10-31T22:41:21.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.767+0000 7f54eeb49700 1 -- 172.21.15.60:0/456771103 wait complete. 2020-10-31T22:41:21.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.767+0000 7f54eeb49700 1 Processor -- start 2020-10-31T22:41:21.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.767+0000 7f54eeb49700 1 -- start start 2020-10-31T22:41:21.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54eeb49700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54e8063140 0x7f54e80b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:21.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54eeb49700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54e80ae740 0x7f54e8152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:21.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54eeb49700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54e80aee10 0x7f54e8152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:21.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54eeb49700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e81472a0 con 0x7f54e80aee10 2020-10-31T22:41:21.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54eeb49700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e8146540 con 0x7f54e8063140 2020-10-31T22:41:21.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54eeb49700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e81520c0 con 0x7f54e80ae740 2020-10-31T22:41:21.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54ee348700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54e80aee10 0x7f54e8152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:21.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54ee348700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54e80aee10 0x7f54e8152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41780/0 (socket says 172.21.15.60:41780) 2020-10-31T22:41:21.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54ee348700 1 -- 172.21.15.60:0/4022711904 learned_addr learned my addr 172.21.15.60:0/4022711904 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:21.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54ed346700 1 --2- 172.21.15.60:0/4022711904 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54e80ae740 0x7f54e8152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:21.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54edb47700 1 --2- 172.21.15.60:0/4022711904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54e8063140 0x7f54e80b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:21.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54ee348700 1 -- 172.21.15.60:0/4022711904 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54e80ae740 msgr2=0x7f54e8152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:21.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54ee348700 1 --2- 172.21.15.60:0/4022711904 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54e80ae740 0x7f54e8152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54ee348700 1 -- 172.21.15.60:0/4022711904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54e8063140 msgr2=0x7f54e80b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:21.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54ee348700 1 --2- 172.21.15.60:0/4022711904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54e8063140 0x7f54e80b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54ee348700 1 -- 172.21.15.60:0/4022711904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e8146f20 con 0x7f54e80aee10 2020-10-31T22:41:21.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54ee348700 1 --2- 172.21.15.60:0/4022711904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54e80aee10 0x7f54e8152a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f54e0001cb0 tx=0x7f54e0002180).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:21.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54d6ffd700 1 -- 172.21.15.60:0/4022711904 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54e0004a80 con 0x7f54e80aee10 2020-10-31T22:41:21.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54d6ffd700 1 -- 172.21.15.60:0/4022711904 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e0004be0 con 0x7f54e80aee10 2020-10-31T22:41:21.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54eeb49700 1 -- 172.21.15.60:0/4022711904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e8145fe0 con 0x7f54e80aee10 2020-10-31T22:41:21.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54d6ffd700 1 -- 172.21.15.60:0/4022711904 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54e0007170 con 0x7f54e80aee10 2020-10-31T22:41:21.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.771+0000 7f54eeb49700 1 -- 172.21.15.60:0/4022711904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e8146d20 con 0x7f54e80aee10 2020-10-31T22:41:21.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.775+0000 7f54eeb49700 1 -- 172.21.15.60:0/4022711904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e8146700 con 0x7f54e80aee10 2020-10-31T22:41:21.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.775+0000 7f54d6ffd700 1 -- 172.21.15.60:0/4022711904 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f54e0010070 con 0x7f54e80aee10 2020-10-31T22:41:21.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.775+0000 7f54d6ffd700 1 --2- 172.21.15.60:0/4022711904 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54c8054f90 0x7f54c8057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:21.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.775+0000 7f54d6ffd700 1 -- 172.21.15.60:0/4022711904 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f54e006d930 con 0x7f54e80aee10 2020-10-31T22:41:21.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.775+0000 7f54edb47700 1 --2- 172.21.15.60:0/4022711904 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54c8054f90 0x7f54c8057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:21.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.775+0000 7f54edb47700 1 --2- 172.21.15.60:0/4022711904 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54c8054f90 0x7f54c8057450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f54e401a000 tx=0x7f54e4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:21.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.783+0000 7f54d6ffd700 1 -- 172.21.15.60:0/4022711904 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f54e0043ce0 con 0x7f54e80aee10 2020-10-31T22:41:21.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.927+0000 7f54eeb49700 1 -- 172.21.15.60:0/4022711904 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f54e8152280 con 0x7f54e80aee10 2020-10-31T22:41:21.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.927+0000 7f54d6ffd700 1 -- 172.21.15.60:0/4022711904 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f54e0047300 con 0x7f54e80aee10 2020-10-31T22:41:21.932 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:41:21.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.931+0000 7f54eeb49700 1 -- 172.21.15.60:0/4022711904 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54c8054f90 msgr2=0x7f54c8057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:21.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.931+0000 7f54eeb49700 1 --2- 172.21.15.60:0/4022711904 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54c8054f90 0x7f54c8057450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f54e401a000 tx=0x7f54e4015000).stop 2020-10-31T22:41:21.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.931+0000 7f54eeb49700 1 -- 172.21.15.60:0/4022711904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54e80aee10 msgr2=0x7f54e8152a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:21.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.931+0000 7f54eeb49700 1 --2- 172.21.15.60:0/4022711904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54e80aee10 0x7f54e8152a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f54e0001cb0 tx=0x7f54e0002180).stop 2020-10-31T22:41:21.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.931+0000 7f54eeb49700 1 -- 172.21.15.60:0/4022711904 shutdown_connections 2020-10-31T22:41:21.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.931+0000 7f54eeb49700 1 --2- 172.21.15.60:0/4022711904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54e80aee10 0x7f54e8152a50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.931+0000 7f54eeb49700 1 --2- 172.21.15.60:0/4022711904 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54c8054f90 0x7f54c8057450 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.931+0000 7f54eeb49700 1 --2- 172.21.15.60:0/4022711904 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54e8063140 0x7f54e80b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.931+0000 7f54eeb49700 1 --2- 172.21.15.60:0/4022711904 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54e80ae740 0x7f54e8152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:21.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.931+0000 7f54eeb49700 1 -- 172.21.15.60:0/4022711904 >> 172.21.15.60:0/4022711904 conn(0x7f54e806a600 msgr2=0x7f54e80a98c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:21.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.931+0000 7f54eeb49700 1 -- 172.21.15.60:0/4022711904 shutdown_connections 2020-10-31T22:41:21.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:21.931+0000 7f54eeb49700 1 -- 172.21.15.60:0/4022711904 wait complete. 2020-10-31T22:41:21.952 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:41:22.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.067+0000 7fee96aff700 1 Processor -- start 2020-10-31T22:41:22.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.067+0000 7fee96aff700 1 -- start start 2020-10-31T22:41:22.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee96aff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fee900b1bd0 0x7fee9014a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee96aff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee90063520 con 0x7fee900b2820 2020-10-31T22:41:22.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee96aff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee900b2150 con 0x7fee90063140 2020-10-31T22:41:22.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee96aff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee900b23f0 con 0x7fee900b1bd0 2020-10-31T22:41:22.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee952fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fee900b2820 0x7fee90149af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45922/0 (socket says 172.21.15.60:45922) 2020-10-31T22:41:22.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee952fc700 1 -- 172.21.15.60:0/926135793 learned_addr learned my addr 172.21.15.60:0/926135793 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:22.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee962fe700 1 --2- 172.21.15.60:0/926135793 >> v2:172.21.15.66:3300/0 conn(0x7fee900b1bd0 0x7fee9014a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee94afb700 1 -- 172.21.15.60:0/926135793 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3840272251 0 0) 0x7fee90063520 con 0x7fee900b2820 2020-10-31T22:41:22.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee94afb700 1 -- 172.21.15.60:0/926135793 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee7c003230 con 0x7fee900b2820 2020-10-31T22:41:22.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee962fe700 1 -- 172.21.15.60:0/926135793 >> v1:172.21.15.66:6789/0 conn(0x7fee90063140 legacy=0x7fee900b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee962fe700 1 -- 172.21.15.60:0/926135793 >> v1:172.21.15.60:6789/0 conn(0x7fee900b2820 legacy=0x7fee90149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee962fe700 1 -- 172.21.15.60:0/926135793 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee900b04c0 con 0x7fee900b1bd0 2020-10-31T22:41:22.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee962fe700 1 --2- 172.21.15.60:0/926135793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee900b1bd0 0x7fee9014a200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fee880032b0 tx=0x7fee880091a0).ready entity=mon.1 client_cookie=1140c627a21fd144 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:22.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee94afb700 1 -- 172.21.15.60:0/926135793 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee8800b9a0 con 0x7fee900b1bd0 2020-10-31T22:41:22.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee94afb700 1 -- 172.21.15.60:0/926135793 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8800bb00 con 0x7fee900b1bd0 2020-10-31T22:41:22.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee94afb700 1 -- 172.21.15.60:0/926135793 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee8800bc70 con 0x7fee900b1bd0 2020-10-31T22:41:22.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee96aff700 1 -- 172.21.15.60:0/926135793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee900b1bd0 msgr2=0x7fee9014a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee96aff700 1 --2- 172.21.15.60:0/926135793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee900b1bd0 0x7fee9014a200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fee880032b0 tx=0x7fee880091a0).stop 2020-10-31T22:41:22.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee96aff700 1 -- 172.21.15.60:0/926135793 shutdown_connections 2020-10-31T22:41:22.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee96aff700 1 --2- 172.21.15.60:0/926135793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee900b1bd0 0x7fee9014a200 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee96aff700 1 -- 172.21.15.60:0/926135793 >> 172.21.15.60:0/926135793 conn(0x7fee9006a600 msgr2=0x7fee90060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:22.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee96aff700 1 -- 172.21.15.60:0/926135793 shutdown_connections 2020-10-31T22:41:22.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.071+0000 7fee96aff700 1 -- 172.21.15.60:0/926135793 wait complete. 2020-10-31T22:41:22.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee96aff700 1 Processor -- start 2020-10-31T22:41:22.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee96aff700 1 -- start start 2020-10-31T22:41:22.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee96aff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee90063140 0x7fee900af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee96aff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bd0 0x7fee900aba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee96aff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900b2820 0x7fee901587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee96aff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee900675e0 con 0x7fee900b2820 2020-10-31T22:41:22.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee96aff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee90063780 con 0x7fee90063140 2020-10-31T22:41:22.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee96aff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9014d2a0 con 0x7fee900b1bd0 2020-10-31T22:41:22.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee962fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900b2820 0x7fee901587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee962fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900b2820 0x7fee901587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41794/0 (socket says 172.21.15.60:41794) 2020-10-31T22:41:22.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee962fe700 1 -- 172.21.15.60:0/377458801 learned_addr learned my addr 172.21.15.60:0/377458801 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:22.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee952fc700 1 --2- 172.21.15.60:0/377458801 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bd0 0x7fee900aba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee95afd700 1 --2- 172.21.15.60:0/377458801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee90063140 0x7fee900af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee962fe700 1 -- 172.21.15.60:0/377458801 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bd0 msgr2=0x7fee900aba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee962fe700 1 --2- 172.21.15.60:0/377458801 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bd0 0x7fee900aba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee962fe700 1 -- 172.21.15.60:0/377458801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee90063140 msgr2=0x7fee900af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee962fe700 1 --2- 172.21.15.60:0/377458801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee90063140 0x7fee900af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee962fe700 1 -- 172.21.15.60:0/377458801 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee900639b0 con 0x7fee900b2820 2020-10-31T22:41:22.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee962fe700 1 --2- 172.21.15.60:0/377458801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900b2820 0x7fee901587e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fee880032b0 tx=0x7fee88016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee86ffd700 1 -- 172.21.15.60:0/377458801 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee8800bc70 con 0x7fee900b2820 2020-10-31T22:41:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee86ffd700 1 -- 172.21.15.60:0/377458801 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8801f3f0 con 0x7fee900b2820 2020-10-31T22:41:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee86ffd700 1 -- 172.21.15.60:0/377458801 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee8801f750 con 0x7fee900b2820 2020-10-31T22:41:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee96aff700 1 -- 172.21.15.60:0/377458801 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee900aff50 con 0x7fee900b2820 2020-10-31T22:41:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.075+0000 7fee96aff700 1 -- 172.21.15.60:0/377458801 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee900b4200 con 0x7fee900b2820 2020-10-31T22:41:22.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.079+0000 7fee96aff700 1 -- 172.21.15.60:0/377458801 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee90057100 con 0x7fee900b2820 2020-10-31T22:41:22.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.079+0000 7fee86ffd700 1 -- 172.21.15.60:0/377458801 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fee88026030 con 0x7fee900b2820 2020-10-31T22:41:22.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.079+0000 7fee86ffd700 1 --2- 172.21.15.60:0/377458801 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee70054f90 0x7fee70057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.079+0000 7fee86ffd700 1 -- 172.21.15.60:0/377458801 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fee8806e5c0 con 0x7fee900b2820 2020-10-31T22:41:22.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.079+0000 7fee95afd700 1 --2- 172.21.15.60:0/377458801 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee70054f90 0x7fee70057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.079+0000 7fee95afd700 1 --2- 172.21.15.60:0/377458801 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee70054f90 0x7fee70057450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fee8000d000 tx=0x7fee80007ad0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:22.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.083+0000 7fee86ffd700 1 -- 172.21.15.60:0/377458801 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fee88044ae0 con 0x7fee900b2820 2020-10-31T22:41:22.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.231+0000 7fee96aff700 1 -- 172.21.15.60:0/377458801 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fee9005ed50 con 0x7fee900b2820 2020-10-31T22:41:22.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.231+0000 7fee86ffd700 1 -- 172.21.15.60:0/377458801 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fee880150a0 con 0x7fee900b2820 2020-10-31T22:41:22.234 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:22.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.231+0000 7fee96aff700 1 -- 172.21.15.60:0/377458801 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee70054f90 msgr2=0x7fee70057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.231+0000 7fee96aff700 1 --2- 172.21.15.60:0/377458801 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee70054f90 0x7fee70057450 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fee8000d000 tx=0x7fee80007ad0).stop 2020-10-31T22:41:22.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.231+0000 7fee96aff700 1 -- 172.21.15.60:0/377458801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900b2820 msgr2=0x7fee901587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.231+0000 7fee96aff700 1 --2- 172.21.15.60:0/377458801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900b2820 0x7fee901587e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7fee880032b0 tx=0x7fee88016000).stop 2020-10-31T22:41:22.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.231+0000 7fee96aff700 1 -- 172.21.15.60:0/377458801 shutdown_connections 2020-10-31T22:41:22.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.231+0000 7fee96aff700 1 --2- 172.21.15.60:0/377458801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900b2820 0x7fee901587e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.231+0000 7fee96aff700 1 --2- 172.21.15.60:0/377458801 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee70054f90 0x7fee70057450 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.231+0000 7fee96aff700 1 --2- 172.21.15.60:0/377458801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee90063140 0x7fee900af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.231+0000 7fee96aff700 1 --2- 172.21.15.60:0/377458801 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bd0 0x7fee900aba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.231+0000 7fee96aff700 1 -- 172.21.15.60:0/377458801 >> 172.21.15.60:0/377458801 conn(0x7fee9006a600 msgr2=0x7fee900b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:22.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.231+0000 7fee96aff700 1 -- 172.21.15.60:0/377458801 shutdown_connections 2020-10-31T22:41:22.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.231+0000 7fee96aff700 1 -- 172.21.15.60:0/377458801 wait complete. 2020-10-31T22:41:22.247 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:41:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.363+0000 7fb9961e7700 1 Processor -- start 2020-10-31T22:41:22.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.363+0000 7fb9961e7700 1 -- start start 2020-10-31T22:41:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb9961e7700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb9900b0dc0 0x7fb9900b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb9961e7700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9900653c0 con 0x7fb99013fd20 2020-10-31T22:41:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb9961e7700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb990066b10 con 0x7fb9900664e0 2020-10-31T22:41:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb9961e7700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb990066930 con 0x7fb9900b0dc0 2020-10-31T22:41:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb986ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb99013fd20 0x7fb99013d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45938/0 (socket says 172.21.15.60:45938) 2020-10-31T22:41:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb986ffd700 1 -- 172.21.15.60:0/826632681 learned_addr learned my addr 172.21.15.60:0/826632681 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb98f7fe700 1 --2- 172.21.15.60:0/826632681 >> v2:172.21.15.66:3300/0 conn(0x7fb9900b0dc0 0x7fb9900b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb98effd700 1 -- 172.21.15.60:0/826632681 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3981207416 0 0) 0x7fb9900653c0 con 0x7fb99013fd20 2020-10-31T22:41:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb98effd700 1 -- 172.21.15.60:0/826632681 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb970003230 con 0x7fb99013fd20 2020-10-31T22:41:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb98effd700 1 -- 172.21.15.60:0/826632681 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522892634 0 0) 0x7fb990066b10 con 0x7fb9900664e0 2020-10-31T22:41:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb98effd700 1 -- 172.21.15.60:0/826632681 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9900653c0 con 0x7fb9900664e0 2020-10-31T22:41:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb98f7fe700 1 -- 172.21.15.60:0/826632681 >> v1:172.21.15.66:6789/0 conn(0x7fb9900664e0 legacy=0x7fb990143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb98f7fe700 1 -- 172.21.15.60:0/826632681 >> v1:172.21.15.60:6789/0 conn(0x7fb99013fd20 legacy=0x7fb99013d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb98f7fe700 1 -- 172.21.15.60:0/826632681 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990066db0 con 0x7fb9900b0dc0 2020-10-31T22:41:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb98f7fe700 1 --2- 172.21.15.60:0/826632681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9900b0dc0 0x7fb9900b2d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb980002f30 tx=0x7fb980006dc0).ready entity=mon.1 client_cookie=a8bce565f0003bc2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb98effd700 1 -- 172.21.15.60:0/826632681 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb980009740 con 0x7fb9900b0dc0 2020-10-31T22:41:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb98effd700 1 -- 172.21.15.60:0/826632681 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9800098a0 con 0x7fb9900b0dc0 2020-10-31T22:41:22.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb98effd700 1 -- 172.21.15.60:0/826632681 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb980009c00 con 0x7fb9900b0dc0 2020-10-31T22:41:22.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb9961e7700 1 -- 172.21.15.60:0/826632681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9900b0dc0 msgr2=0x7fb9900b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.367+0000 7fb9961e7700 1 --2- 172.21.15.60:0/826632681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9900b0dc0 0x7fb9900b2d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb980002f30 tx=0x7fb980006dc0).stop 2020-10-31T22:41:22.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.371+0000 7fb9961e7700 1 -- 172.21.15.60:0/826632681 shutdown_connections 2020-10-31T22:41:22.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.371+0000 7fb9961e7700 1 --2- 172.21.15.60:0/826632681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9900b0dc0 0x7fb9900b2d50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.371+0000 7fb9961e7700 1 -- 172.21.15.60:0/826632681 >> 172.21.15.60:0/826632681 conn(0x7fb99006a260 msgr2=0x7fb990063c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:22.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.371+0000 7fb9961e7700 1 -- 172.21.15.60:0/826632681 shutdown_connections 2020-10-31T22:41:22.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.371+0000 7fb9961e7700 1 -- 172.21.15.60:0/826632681 wait complete. 2020-10-31T22:41:22.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.371+0000 7fb9961e7700 1 Processor -- start 2020-10-31T22:41:22.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.371+0000 7fb9961e7700 1 -- start start 2020-10-31T22:41:22.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb9961e7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9900664e0 0x7fb9900aa400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb9961e7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9900b0dc0 0x7fb9901467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb9961e7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99013fd20 0x7fb9901422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb9961e7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9901520f0 con 0x7fb99013fd20 2020-10-31T22:41:22.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb9961e7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb990140fe0 con 0x7fb9900b0dc0 2020-10-31T22:41:22.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb9961e7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb990141210 con 0x7fb9900664e0 2020-10-31T22:41:22.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb98ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99013fd20 0x7fb9901422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb98ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99013fd20 0x7fb9901422b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41808/0 (socket says 172.21.15.60:41808) 2020-10-31T22:41:22.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb98ffff700 1 -- 172.21.15.60:0/3619529167 learned_addr learned my addr 172.21.15.60:0/3619529167 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:22.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb986ffd700 1 --2- 172.21.15.60:0/3619529167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9900b0dc0 0x7fb9901467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb98f7fe700 1 --2- 172.21.15.60:0/3619529167 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9900664e0 0x7fb9900aa400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb98ffff700 1 -- 172.21.15.60:0/3619529167 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9900664e0 msgr2=0x7fb9900aa400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb98ffff700 1 --2- 172.21.15.60:0/3619529167 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9900664e0 0x7fb9900aa400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb98ffff700 1 -- 172.21.15.60:0/3619529167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9900b0dc0 msgr2=0x7fb9901467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb98ffff700 1 --2- 172.21.15.60:0/3619529167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9900b0dc0 0x7fb9901467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb98ffff700 1 -- 172.21.15.60:0/3619529167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9901414b0 con 0x7fb99013fd20 2020-10-31T22:41:22.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb98ffff700 1 --2- 172.21.15.60:0/3619529167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99013fd20 0x7fb9901422b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fb99014ebd0 tx=0x7fb988007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:22.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb98d7fa700 1 -- 172.21.15.60:0/3619529167 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb98800ce40 con 0x7fb99013fd20 2020-10-31T22:41:22.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb98d7fa700 1 -- 172.21.15.60:0/3619529167 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98800a770 con 0x7fb99013fd20 2020-10-31T22:41:22.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb98d7fa700 1 -- 172.21.15.60:0/3619529167 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb98800a8e0 con 0x7fb99013fd20 2020-10-31T22:41:22.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb9961e7700 1 -- 172.21.15.60:0/3619529167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb990141750 con 0x7fb99013fd20 2020-10-31T22:41:22.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb9961e7700 1 -- 172.21.15.60:0/3619529167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb990147200 con 0x7fb99013fd20 2020-10-31T22:41:22.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.375+0000 7fb9961e7700 1 -- 172.21.15.60:0/3619529167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9901420d0 con 0x7fb99013fd20 2020-10-31T22:41:22.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.379+0000 7fb98d7fa700 1 -- 172.21.15.60:0/3619529167 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb988010070 con 0x7fb99013fd20 2020-10-31T22:41:22.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.379+0000 7fb98d7fa700 1 --2- 172.21.15.60:0/3619529167 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb974054f10 0x7fb9740573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.379+0000 7fb98d7fa700 1 -- 172.21.15.60:0/3619529167 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb98806d580 con 0x7fb99013fd20 2020-10-31T22:41:22.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.379+0000 7fb98f7fe700 1 --2- 172.21.15.60:0/3619529167 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb974054f10 0x7fb9740573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.379+0000 7fb98f7fe700 1 --2- 172.21.15.60:0/3619529167 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb974054f10 0x7fb9740573d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb980019000 tx=0x7fb980015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:22.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.383+0000 7fb98d7fa700 1 -- 172.21.15.60:0/3619529167 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb988043aa0 con 0x7fb99013fd20 2020-10-31T22:41:22.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.527+0000 7fb9961e7700 1 -- 172.21.15.60:0/3619529167 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb990057100 con 0x7fb99013fd20 2020-10-31T22:41:22.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.527+0000 7fb98d7fa700 1 -- 172.21.15.60:0/3619529167 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb9880470c0 con 0x7fb99013fd20 2020-10-31T22:41:22.532 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:22.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.531+0000 7fb9961e7700 1 -- 172.21.15.60:0/3619529167 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb974054f10 msgr2=0x7fb9740573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.531+0000 7fb9961e7700 1 --2- 172.21.15.60:0/3619529167 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb974054f10 0x7fb9740573d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb980019000 tx=0x7fb980015000).stop 2020-10-31T22:41:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.531+0000 7fb9961e7700 1 -- 172.21.15.60:0/3619529167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99013fd20 msgr2=0x7fb9901422b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.531+0000 7fb9961e7700 1 --2- 172.21.15.60:0/3619529167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99013fd20 0x7fb9901422b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fb99014ebd0 tx=0x7fb988007d30).stop 2020-10-31T22:41:22.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.531+0000 7fb9961e7700 1 -- 172.21.15.60:0/3619529167 shutdown_connections 2020-10-31T22:41:22.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.531+0000 7fb9961e7700 1 --2- 172.21.15.60:0/3619529167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb99013fd20 0x7fb9901422b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.531+0000 7fb9961e7700 1 --2- 172.21.15.60:0/3619529167 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9900664e0 0x7fb9900aa400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.531+0000 7fb9961e7700 1 --2- 172.21.15.60:0/3619529167 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb974054f10 0x7fb9740573d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.531+0000 7fb9961e7700 1 --2- 172.21.15.60:0/3619529167 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9900b0dc0 0x7fb9901467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.531+0000 7fb9961e7700 1 -- 172.21.15.60:0/3619529167 >> 172.21.15.60:0/3619529167 conn(0x7fb99006a260 msgr2=0x7fb9900b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:22.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.531+0000 7fb9961e7700 1 -- 172.21.15.60:0/3619529167 shutdown_connections 2020-10-31T22:41:22.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.531+0000 7fb9961e7700 1 -- 172.21.15.60:0/3619529167 wait complete. 2020-10-31T22:41:22.551 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:41:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.671+0000 7f76f17e3700 1 Processor -- start 2020-10-31T22:41:22.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.671+0000 7f76f17e3700 1 -- start start 2020-10-31T22:41:22.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.671+0000 7f76f17e3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f76ec0b0b50 0x7f76ec0b1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.671+0000 7f76f17e3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ec0acd60 con 0x7f76ec0b5380 2020-10-31T22:41:22.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.671+0000 7f76f17e3700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ec0b5760 con 0x7f76ec140f80 2020-10-31T22:41:22.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.671+0000 7f76f17e3700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ec0ad650 con 0x7f76ec0b0b50 2020-10-31T22:41:22.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.671+0000 7f76ebfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f76ec0b5380 0x7f76ec0ac530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45948/0 (socket says 172.21.15.60:45948) 2020-10-31T22:41:22.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.671+0000 7f76ebfff700 1 -- 172.21.15.60:0/4072040862 learned_addr learned my addr 172.21.15.60:0/4072040862 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:22.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eb7fe700 1 --2- 172.21.15.60:0/4072040862 >> v2:172.21.15.66:3300/0 conn(0x7f76ec0b0b50 0x7f76ec0b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 -- 172.21.15.60:0/4072040862 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584927177 0 0) 0x7f76ec0acd60 con 0x7f76ec0b5380 2020-10-31T22:41:22.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 -- 172.21.15.60:0/4072040862 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76d4003230 con 0x7f76ec0b5380 2020-10-31T22:41:22.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 -- 172.21.15.60:0/4072040862 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4086779619 0 0) 0x7f76d4003230 con 0x7f76ec0b5380 2020-10-31T22:41:22.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 -- 172.21.15.60:0/4072040862 >> v2:172.21.15.66:3300/0 conn(0x7f76ec0b0b50 msgr2=0x7f76ec0b1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:22.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 --2- 172.21.15.60:0/4072040862 >> v2:172.21.15.66:3300/0 conn(0x7f76ec0b0b50 0x7f76ec0b1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 -- 172.21.15.60:0/4072040862 >> v1:172.21.15.66:6789/0 conn(0x7f76ec140f80 legacy=0x7f76ec141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 -- 172.21.15.60:0/4072040862 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec0b14f0 con 0x7f76ec0b5380 2020-10-31T22:41:22.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 -- 172.21.15.60:0/4072040862 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f76e4001a50 con 0x7f76ec0b5380 2020-10-31T22:41:22.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eb7fe700 1 --2- 172.21.15.60:0/4072040862 >> v2:172.21.15.66:3300/0 conn(0x7f76ec0b0b50 0x7f76ec0b1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:22.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 -- 172.21.15.60:0/4072040862 >> v1:172.21.15.60:6789/0 conn(0x7f76ec0b5380 legacy=0x7f76ec0ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 --2- 172.21.15.60:0/4072040862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d4003720 0x7f76d4003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 --2- 172.21.15.60:0/4072040862 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76d40044d0 0x7f76d4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 --2- 172.21.15.60:0/4072040862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d4004e40 0x7f76d400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 -- 172.21.15.60:0/4072040862 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0ad650 con 0x7f76d4004e40 2020-10-31T22:41:22.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 -- 172.21.15.60:0/4072040862 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d400bc10 con 0x7f76d4003720 2020-10-31T22:41:22.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 -- 172.21.15.60:0/4072040862 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d400bd50 con 0x7f76d40044d0 2020-10-31T22:41:22.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76ebfff700 1 --2- 172.21.15.60:0/4072040862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d4003720 0x7f76d4003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eb7fe700 1 --2- 172.21.15.60:0/4072040862 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76d40044d0 0x7f76d4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76f0fe2700 1 --2- 172.21.15.60:0/4072040862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d4004e40 0x7f76d400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76ebfff700 1 -- 172.21.15.60:0/4072040862 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76d40044d0 msgr2=0x7f76d4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:22.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76ebfff700 1 --2- 172.21.15.60:0/4072040862 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76d40044d0 0x7f76d4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76ebfff700 1 -- 172.21.15.60:0/4072040862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d4004e40 msgr2=0x7f76d400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:22.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76ebfff700 1 --2- 172.21.15.60:0/4072040862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d4004e40 0x7f76d400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76ebfff700 1 -- 172.21.15.60:0/4072040862 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d4003230 con 0x7f76d4003720 2020-10-31T22:41:22.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76f0fe2700 1 --2- 172.21.15.60:0/4072040862 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76d4004e40 0x7f76d400b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:22.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76f0fe2700 1 -- 172.21.15.60:0/4072040862 reap_dead start 2020-10-31T22:41:22.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76ebfff700 1 --2- 172.21.15.60:0/4072040862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d4003720 0x7f76d4003b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f76e4001760 tx=0x7f76ec062fb0).ready entity=mon.1 client_cookie=7a1ae2478d91c4a9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:22.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 -- 172.21.15.60:0/4072040862 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76e4005b70 con 0x7f76d4003720 2020-10-31T22:41:22.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 -- 172.21.15.60:0/4072040862 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e4005cd0 con 0x7f76d4003720 2020-10-31T22:41:22.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76eaffd700 1 -- 172.21.15.60:0/4072040862 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76e40072c0 con 0x7f76d4003720 2020-10-31T22:41:22.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76f17e3700 1 -- 172.21.15.60:0/4072040862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d4003720 msgr2=0x7f76d4003b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76f17e3700 1 --2- 172.21.15.60:0/4072040862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d4003720 0x7f76d4003b60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f76e4001760 tx=0x7f76ec062fb0).stop 2020-10-31T22:41:22.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76f17e3700 1 -- 172.21.15.60:0/4072040862 shutdown_connections 2020-10-31T22:41:22.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76f17e3700 1 --2- 172.21.15.60:0/4072040862 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d4003720 0x7f76d4003b60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76f17e3700 1 -- 172.21.15.60:0/4072040862 >> 172.21.15.60:0/4072040862 conn(0x7f76ec06a600 msgr2=0x7f76ec060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:22.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76f17e3700 1 -- 172.21.15.60:0/4072040862 shutdown_connections 2020-10-31T22:41:22.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.675+0000 7f76f17e3700 1 -- 172.21.15.60:0/4072040862 wait complete. 2020-10-31T22:41:22.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f17e3700 1 Processor -- start 2020-10-31T22:41:22.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f17e3700 1 -- start start 2020-10-31T22:41:22.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f17e3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d4003720 0x7f76ec05b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f17e3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76ec05bd50 0x7f76ec146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f17e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76ec1447f0 0x7f76ec146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f17e3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec14bfc0 con 0x7f76ec1447f0 2020-10-31T22:41:22.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f17e3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec14c490 con 0x7f76d4003720 2020-10-31T22:41:22.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f17e3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ec0662f0 con 0x7f76ec05bd50 2020-10-31T22:41:22.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f0fe2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76ec1447f0 0x7f76ec146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f0fe2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76ec1447f0 0x7f76ec146680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41828/0 (socket says 172.21.15.60:41828) 2020-10-31T22:41:22.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f0fe2700 1 -- 172.21.15.60:0/453532000 learned_addr learned my addr 172.21.15.60:0/453532000 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:22.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76eb7fe700 1 --2- 172.21.15.60:0/453532000 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76ec05bd50 0x7f76ec146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76ebfff700 1 --2- 172.21.15.60:0/453532000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d4003720 0x7f76ec05b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f0fe2700 1 -- 172.21.15.60:0/453532000 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76ec05bd50 msgr2=0x7f76ec146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f0fe2700 1 --2- 172.21.15.60:0/453532000 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76ec05bd50 0x7f76ec146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f0fe2700 1 -- 172.21.15.60:0/453532000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d4003720 msgr2=0x7f76ec05b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f0fe2700 1 --2- 172.21.15.60:0/453532000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d4003720 0x7f76ec05b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f0fe2700 1 -- 172.21.15.60:0/453532000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ec1408e0 con 0x7f76ec1447f0 2020-10-31T22:41:22.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.679+0000 7f76f0fe2700 1 --2- 172.21.15.60:0/453532000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76ec1447f0 0x7f76ec146680 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f76e4001450 tx=0x7f76dc009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:22.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.683+0000 7f76e97fa700 1 -- 172.21.15.60:0/453532000 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76dc0064e0 con 0x7f76ec1447f0 2020-10-31T22:41:22.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.683+0000 7f76e97fa700 1 -- 172.21.15.60:0/453532000 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76dc006640 con 0x7f76ec1447f0 2020-10-31T22:41:22.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.683+0000 7f76f17e3700 1 -- 172.21.15.60:0/453532000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ec14c1f0 con 0x7f76ec1447f0 2020-10-31T22:41:22.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.683+0000 7f76e97fa700 1 -- 172.21.15.60:0/453532000 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f76dc0069a0 con 0x7f76ec1447f0 2020-10-31T22:41:22.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.683+0000 7f76f17e3700 1 -- 172.21.15.60:0/453532000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ec065d30 con 0x7f76ec1447f0 2020-10-31T22:41:22.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.683+0000 7f76e17fa700 1 -- 172.21.15.60:0/453532000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c0003340 con 0x7f76ec1447f0 2020-10-31T22:41:22.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.683+0000 7f76e97fa700 1 -- 172.21.15.60:0/453532000 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f76dc006b00 con 0x7f76ec1447f0 2020-10-31T22:41:22.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.683+0000 7f76e97fa700 1 --2- 172.21.15.60:0/453532000 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f76c8054f10 0x7f76c80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.683+0000 7f76e97fa700 1 -- 172.21.15.60:0/453532000 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f76dc06dd50 con 0x7f76ec1447f0 2020-10-31T22:41:22.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.683+0000 7f76ebfff700 1 --2- 172.21.15.60:0/453532000 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f76c8054f10 0x7f76c80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.683+0000 7f76ebfff700 1 --2- 172.21.15.60:0/453532000 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f76c8054f10 0x7f76c80573d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f76e401a000 tx=0x7f76e4013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:22.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.691+0000 7f76e97fa700 1 -- 172.21.15.60:0/453532000 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f76dc044270 con 0x7f76ec1447f0 2020-10-31T22:41:22.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.835+0000 7f76e17fa700 1 -- 172.21.15.60:0/453532000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f76c0002200 con 0x7f76ec1447f0 2020-10-31T22:41:22.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.835+0000 7f76e97fa700 1 -- 172.21.15.60:0/453532000 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f76dc047890 con 0x7f76ec1447f0 2020-10-31T22:41:22.840 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:22.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.839+0000 7f76e17fa700 1 -- 172.21.15.60:0/453532000 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f76c8054f10 msgr2=0x7f76c80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.839+0000 7f76e17fa700 1 --2- 172.21.15.60:0/453532000 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f76c8054f10 0x7f76c80573d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f76e401a000 tx=0x7f76e4013000).stop 2020-10-31T22:41:22.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.839+0000 7f76e17fa700 1 -- 172.21.15.60:0/453532000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76ec1447f0 msgr2=0x7f76ec146680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.839+0000 7f76e17fa700 1 --2- 172.21.15.60:0/453532000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76ec1447f0 0x7f76ec146680 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f76e4001450 tx=0x7f76dc009040).stop 2020-10-31T22:41:22.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.839+0000 7f76e17fa700 1 -- 172.21.15.60:0/453532000 shutdown_connections 2020-10-31T22:41:22.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.839+0000 7f76e17fa700 1 --2- 172.21.15.60:0/453532000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76ec1447f0 0x7f76ec146680 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.839+0000 7f76e17fa700 1 --2- 172.21.15.60:0/453532000 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f76c8054f10 0x7f76c80573d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.839+0000 7f76e17fa700 1 --2- 172.21.15.60:0/453532000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76d4003720 0x7f76ec05b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.839+0000 7f76e17fa700 1 --2- 172.21.15.60:0/453532000 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76ec05bd50 0x7f76ec146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.839+0000 7f76e17fa700 1 -- 172.21.15.60:0/453532000 >> 172.21.15.60:0/453532000 conn(0x7f76ec06a600 msgr2=0x7f76ec05afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.839+0000 7f76e17fa700 1 -- 172.21.15.60:0/453532000 shutdown_connections 2020-10-31T22:41:22.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.839+0000 7f76e17fa700 1 -- 172.21.15.60:0/453532000 wait complete. 2020-10-31T22:41:22.861 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:41:22.861 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:41:22.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.967+0000 7fbf0f59e700 1 Processor -- start 2020-10-31T22:41:22.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.967+0000 7fbf0f59e700 1 -- start start 2020-10-31T22:41:22.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbf10140420 0x7fbf100ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf100b2560 0x7fbf100adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1005b700 con 0x7fbf1005b320 2020-10-31T22:41:22.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf101408a0 con 0x7fbf100b2560 2020-10-31T22:41:22.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf100b0220 con 0x7fbf10140420 2020-10-31T22:41:22.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0ed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf100b2560 0x7fbf100adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0e59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbf1005b320 0x7fbf100b1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:45970/0 (socket says 172.21.15.60:45970) 2020-10-31T22:41:22.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0ed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf100b2560 0x7fbf100adc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41836/0 (socket says 172.21.15.60:41836) 2020-10-31T22:41:22.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0e59c700 1 -- 172.21.15.60:0/3512467594 learned_addr learned my addr 172.21.15.60:0/3512467594 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:22.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf05d9b700 1 --2- 172.21.15.60:0/3512467594 >> v2:172.21.15.66:3300/0 conn(0x7fbf10140420 0x7fbf100ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0ed9d700 1 -- 172.21.15.60:0/3512467594 >> v2:172.21.15.66:3300/0 conn(0x7fbf10140420 msgr2=0x7fbf100ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:22.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0ed9d700 1 --2- 172.21.15.60:0/3512467594 >> v2:172.21.15.66:3300/0 conn(0x7fbf10140420 0x7fbf100ad7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0ed9d700 1 -- 172.21.15.60:0/3512467594 >> v1:172.21.15.60:6789/0 conn(0x7fbf1005b320 legacy=0x7fbf100b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0dd9b700 1 -- 172.21.15.60:0/3512467594 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1309242658 0 0) 0x7fbf1005b700 con 0x7fbf1005b320 2020-10-31T22:41:22.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0ed9d700 1 -- 172.21.15.60:0/3512467594 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf100b04c0 con 0x7fbf100b2560 2020-10-31T22:41:22.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0ed9d700 1 --2- 172.21.15.60:0/3512467594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf100b2560 0x7fbf100adc90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fbf080032b0 tx=0x7fbf080091a0).ready entity=mon.0 client_cookie=6bbb9d5325bea9be server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:22.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0dd9b700 1 -- 172.21.15.60:0/3512467594 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf0800ba50 con 0x7fbf100b2560 2020-10-31T22:41:22.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0dd9b700 1 -- 172.21.15.60:0/3512467594 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0800bbb0 con 0x7fbf100b2560 2020-10-31T22:41:22.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0dd9b700 1 -- 172.21.15.60:0/3512467594 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf0800bd20 con 0x7fbf100b2560 2020-10-31T22:41:22.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 -- 172.21.15.60:0/3512467594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf100b2560 msgr2=0x7fbf100adc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 --2- 172.21.15.60:0/3512467594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf100b2560 0x7fbf100adc90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fbf080032b0 tx=0x7fbf080091a0).stop 2020-10-31T22:41:22.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 -- 172.21.15.60:0/3512467594 shutdown_connections 2020-10-31T22:41:22.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 --2- 172.21.15.60:0/3512467594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf100b2560 0x7fbf100adc90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 --2- 172.21.15.60:0/3512467594 >> v2:172.21.15.66:3300/0 conn(0x7fbf10140420 0x7fbf100ad7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 -- 172.21.15.60:0/3512467594 >> 172.21.15.60:0/3512467594 conn(0x7fbf100b61d0 msgr2=0x7fbf100b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:22.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 -- 172.21.15.60:0/3512467594 shutdown_connections 2020-10-31T22:41:22.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 -- 172.21.15.60:0/3512467594 wait complete. 2020-10-31T22:41:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 Processor -- start 2020-10-31T22:41:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.971+0000 7fbf0f59e700 1 -- start start 2020-10-31T22:41:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0f59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf1005b320 0x7fbf10145230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0f59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf100b2560 0x7fbf1013b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf10140420 0x7fbf10135d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf101445b0 con 0x7fbf10140420 2020-10-31T22:41:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0f59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf100ab450 con 0x7fbf1005b320 2020-10-31T22:41:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0f59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf100ab6f0 con 0x7fbf100b2560 2020-10-31T22:41:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf10140420 0x7fbf10135d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf10140420 0x7fbf10135d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41842/0 (socket says 172.21.15.60:41842) 2020-10-31T22:41:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0ed9d700 1 -- 172.21.15.60:0/1187069943 learned_addr learned my addr 172.21.15.60:0/1187069943 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf05d9b700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf100b2560 0x7fbf1013b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0e59c700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf1005b320 0x7fbf10145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0ed9d700 1 -- 172.21.15.60:0/1187069943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf100b2560 msgr2=0x7fbf1013b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0ed9d700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf100b2560 0x7fbf1013b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0ed9d700 1 -- 172.21.15.60:0/1187069943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf1005b320 msgr2=0x7fbf10145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0ed9d700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf1005b320 0x7fbf10145230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0ed9d700 1 -- 172.21.15.60:0/1187069943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf100ab990 con 0x7fbf10140420 2020-10-31T22:41:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0e59c700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf1005b320 0x7fbf10145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0ed9d700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf10140420 0x7fbf10135d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fbf080032b0 tx=0x7fbf08016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf07fff700 1 -- 172.21.15.60:0/1187069943 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf0801f5e0 con 0x7fbf10140420 2020-10-31T22:41:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0f59e700 1 -- 172.21.15.60:0/1187069943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf101358e0 con 0x7fbf10140420 2020-10-31T22:41:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf07fff700 1 -- 172.21.15.60:0/1187069943 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0801f740 con 0x7fbf10140420 2020-10-31T22:41:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf07fff700 1 -- 172.21.15.60:0/1187069943 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf0801faa0 con 0x7fbf10140420 2020-10-31T22:41:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0f59e700 1 -- 172.21.15.60:0/1187069943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf10136270 con 0x7fbf10140420 2020-10-31T22:41:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.975+0000 7fbf0f59e700 1 -- 172.21.15.60:0/1187069943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf10135a70 con 0x7fbf10140420 2020-10-31T22:41:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.979+0000 7fbf07fff700 1 -- 172.21.15.60:0/1187069943 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbf08026030 con 0x7fbf10140420 2020-10-31T22:41:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.979+0000 7fbf07fff700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbee8054f90 0x7fbee8057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.979+0000 7fbf07fff700 1 -- 172.21.15.60:0/1187069943 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbf0806f2d0 con 0x7fbf10140420 2020-10-31T22:41:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.979+0000 7fbf0e59c700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbee8054f90 0x7fbee8057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.979+0000 7fbf0e59c700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbee8054f90 0x7fbee8057450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbf0000b000 tx=0x7fbf00009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:22.983+0000 7fbf07fff700 1 -- 172.21.15.60:0/1187069943 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbf080457f0 con 0x7fbf10140420 2020-10-31T22:41:23.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:23.171+0000 7fbf0f59e700 1 -- 172.21.15.60:0/1187069943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf10057100 con 0x7fbf10140420 2020-10-31T22:41:23.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:23.171+0000 7fbf07fff700 1 -- 172.21.15.60:0/1187069943 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2483 (secure 0 0 0) 0x7fbf08024090 con 0x7fbf10140420 2020-10-31T22:41:23.174 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:23.174 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/909749940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":909749940},{"type":"v1","addr":"172.21.15.60:6837","nonce":909749940}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3142095774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3142095774},{"type":"v1","addr":"172.21.15.60:6835","nonce":3142095774}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:41:10.055893+0000","modified":"2020-10-31T22:41:11.058634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.66:6833/4161698670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4161698670},{"type":"v1","addr":"172.21.15.66:6833","nonce":4161698670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-10-31T22:41:23.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:23.171+0000 7fbf0f59e700 1 -- 172.21.15.60:0/1187069943 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbee8054f90 msgr2=0x7fbee8057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:23.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:23.171+0000 7fbf0f59e700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbee8054f90 0x7fbee8057450 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fbf0000b000 tx=0x7fbf00009040).stop 2020-10-31T22:41:23.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:23.171+0000 7fbf0f59e700 1 -- 172.21.15.60:0/1187069943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf10140420 msgr2=0x7fbf10135d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:23.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:23.171+0000 7fbf0f59e700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf10140420 0x7fbf10135d80 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fbf080032b0 tx=0x7fbf08016000).stop 2020-10-31T22:41:23.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:23.171+0000 7fbf0f59e700 1 -- 172.21.15.60:0/1187069943 shutdown_connections 2020-10-31T22:41:23.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:23.171+0000 7fbf0f59e700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf10140420 0x7fbf10135d80 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:23.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:23.171+0000 7fbf0f59e700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbee8054f90 0x7fbee8057450 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:23.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:23.171+0000 7fbf0f59e700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf1005b320 0x7fbf10145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:23.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:23.171+0000 7fbf0f59e700 1 --2- 172.21.15.60:0/1187069943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf100b2560 0x7fbf1013b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:23.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:23.171+0000 7fbf0f59e700 1 -- 172.21.15.60:0/1187069943 >> 172.21.15.60:0/1187069943 conn(0x7fbf100b61d0 msgr2=0x7fbf1013c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:23.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:23.171+0000 7fbf0f59e700 1 -- 172.21.15.60:0/1187069943 shutdown_connections 2020-10-31T22:41:23.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:23.171+0000 7fbf0f59e700 1 -- 172.21.15.60:0/1187069943 wait complete. 2020-10-31T22:41:23.178 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 5 2020-10-31T22:41:23.490 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:41:10.055893+0000', 'modified': '2020-10-31T22:41:11.058634+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.66:6833/4161698670', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 4161698670}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 4161698670}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:41:23.491 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:41:23.491 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-10-31T22:41:23.622 INFO:teuthology.orchestra.run.smithi066.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":4306,"want_state":"up:active","state":"up:active","rank_uptime":13.552104077999999,"mdsmap_epoch":5,"osdmap_epoch":22,"osdmap_epoch_barrier":21,"uptime":17.077336316} 2020-10-31T22:41:23.623 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 4306, "mdsmap_epoch": 5, "osdmap_epoch": 22, "osdmap_epoch_barrier": 21, "rank_uptime": 13.552104078, "state": "up:active", "uptime": 17.077336316, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:41:23.624 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:41:23.624 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:41:23.625 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:41:23.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:23.625 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:23.635 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:41:23.691 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:41:23.692 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:41:23.745 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:41:23.747 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:41:23.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:23.748 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:41:23.794 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:41:23.795 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:23.840 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:41:23.859 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:41:23.860 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:41:23.919 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:41:23.927 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:41:23.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:23.929 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:41:23.930 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:41:23.912+0000 7f76818f20c0 -1 init, newargv = 0x557637351c90 newargc=9 2020-10-31T22:41:23.931 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[12930]: starting ceph client 2020-10-31T22:41:23.931 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[12930]: starting fuse 2020-10-31T22:41:23.936 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:41:23.937 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:41:23.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:23.938 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:41:23.938 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:41:23.938 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:41:23.938 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:41:23.939 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:41:23.939 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:41:23.939 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:41:23.939 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:41:23.940 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:41:23.940 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:41:23.940 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:41:23.940 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:41:23.941 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:41:23.941 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:41:23.941 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:41:23.942 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:41:23.942 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:41:23.942 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:41:23.942 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:41:23.943 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:41:23.943 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:41:23.943 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:41:23.944 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:41:24.028 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.12930.asok 2020-10-31T22:41:24.033 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.12930.asok 2020-10-31T22:41:24.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:24.034 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.12930.asok status 2020-10-31T22:41:24.225 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:41:24.225 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:41:24.225 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:41:24.226 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:41:24.226 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:41:24.226 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:41:24.226 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:41:24.226 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "12930", 2020-10-31T22:41:24.227 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:41:24.227 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:41:24.227 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:41:24.227 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:41:24.227 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 4606, 2020-10-31T22:41:24.227 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:41:24.228 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:41:24.228 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:41:24.228 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 4606 2020-10-31T22:41:24.228 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:41:24.228 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:41:24.228 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:41:24.230 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:41:24.230 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 4024751325 2020-10-31T22:41:24.230 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:41:24.230 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:41:24.230 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:41:24.231 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:41:24.231 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:41:24.231 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 4024751325 2020-10-31T22:41:24.231 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:41:24.231 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.4606 172.21.15.152:0/4024751325", 2020-10-31T22:41:24.232 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/4024751325", 2020-10-31T22:41:24.232 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:41:24.232 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 5, 2020-10-31T22:41:24.233 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 22, 2020-10-31T22:41:24.233 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:41:24.233 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:41:24.233 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:41:24.236 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:24.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1d0bbe700 1 Processor -- start 2020-10-31T22:41:24.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1d0bbe700 1 -- start start 2020-10-31T22:41:24.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1d0bbe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe1cc0b1000 0x7fe1cc0b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1d0bbe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe1cc0b2820 0x7fe1cc0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1d0bbe700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1cc1459c0 con 0x7fe1cc063140 2020-10-31T22:41:24.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1d0bbe700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc0b2060 con 0x7fe1cc0b2820 2020-10-31T22:41:24.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1d0bbe700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc063520 con 0x7fe1cc0b1000 2020-10-31T22:41:24.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1cbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe1cc0b2820 0x7fe1cc0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1cb7fe700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fe1cc063140 0x7fe1cc1452b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:43850/0 (socket says 172.21.15.60:43850) 2020-10-31T22:41:24.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1cbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe1cc0b2820 0x7fe1cc0aeda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41848/0 (socket says 172.21.15.60:41848) 2020-10-31T22:41:24.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1cb7fe700 1 -- 172.21.15.60:0/2553191419 learned_addr learned my addr 172.21.15.60:0/2553191419 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:24.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1caffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe1cc0b1000 0x7fe1cc0b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1cbfff700 1 -- 172.21.15.60:0/2553191419 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe1cc0b1000 msgr2=0x7fe1cc0b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:24.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1cbfff700 1 --2- 172.21.15.60:0/2553191419 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe1cc0b1000 0x7fe1cc0b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1cbfff700 1 -- 172.21.15.60:0/2553191419 >> v1:172.21.15.66:6789/0 conn(0x7fe1cc063140 legacy=0x7fe1cc1452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1ca7fc700 1 -- 172.21.15.60:0/2553191419 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544692567 0 0) 0x7fe1cc1459c0 con 0x7fe1cc063140 2020-10-31T22:41:24.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1cbfff700 1 -- 172.21.15.60:0/2553191419 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc0b02e0 con 0x7fe1cc0b2820 2020-10-31T22:41:24.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1cbfff700 1 --2- 172.21.15.60:0/2553191419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1cc0b2820 0x7fe1cc0aeda0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fe1c4002f30 tx=0x7fe1c4006dc0).ready entity=mon.0 client_cookie=fd5ef9fc57644e85 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:24.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1ca7fc700 1 -- 172.21.15.60:0/2553191419 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1c4009760 con 0x7fe1cc0b2820 2020-10-31T22:41:24.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1ca7fc700 1 -- 172.21.15.60:0/2553191419 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c40098c0 con 0x7fe1cc0b2820 2020-10-31T22:41:24.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1ca7fc700 1 -- 172.21.15.60:0/2553191419 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1c4009c20 con 0x7fe1cc0b2820 2020-10-31T22:41:24.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/2553191419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1cc0b2820 msgr2=0x7fe1cc0aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.367+0000 7fe1d0bbe700 1 --2- 172.21.15.60:0/2553191419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1cc0b2820 0x7fe1cc0aeda0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fe1c4002f30 tx=0x7fe1c4006dc0).stop 2020-10-31T22:41:24.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/2553191419 shutdown_connections 2020-10-31T22:41:24.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 --2- 172.21.15.60:0/2553191419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1cc0b2820 0x7fe1cc0aeda0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 --2- 172.21.15.60:0/2553191419 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe1cc0b1000 0x7fe1cc0b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/2553191419 >> 172.21.15.60:0/2553191419 conn(0x7fe1cc06a600 msgr2=0x7fe1cc060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:24.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/2553191419 shutdown_connections 2020-10-31T22:41:24.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/2553191419 wait complete. 2020-10-31T22:41:24.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 Processor -- start 2020-10-31T22:41:24.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 -- start start 2020-10-31T22:41:24.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1cc063140 0x7fe1cc063a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1cc0b1000 0x7fe1cc0659d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe1cc0b2820 0x7fe1cc1461e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc1492f0 con 0x7fe1cc0b1000 2020-10-31T22:41:24.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc065570 con 0x7fe1cc063140 2020-10-31T22:41:24.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc067740 con 0x7fe1cc0b2820 2020-10-31T22:41:24.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1caffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1cc0b1000 0x7fe1cc0659d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1caffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1cc0b1000 0x7fe1cc0659d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41852/0 (socket says 172.21.15.60:41852) 2020-10-31T22:41:24.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1caffd700 1 -- 172.21.15.60:0/3103133740 learned_addr learned my addr 172.21.15.60:0/3103133740 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:24.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1cb7fe700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1cc063140 0x7fe1cc063a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1cbfff700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe1cc0b2820 0x7fe1cc1461e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1caffd700 1 -- 172.21.15.60:0/3103133740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe1cc0b2820 msgr2=0x7fe1cc1461e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1caffd700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe1cc0b2820 0x7fe1cc1461e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1caffd700 1 -- 172.21.15.60:0/3103133740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1cc063140 msgr2=0x7fe1cc063a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1caffd700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1cc063140 0x7fe1cc063a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1caffd700 1 -- 172.21.15.60:0/3103133740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc148db0 con 0x7fe1cc0b1000 2020-10-31T22:41:24.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1cb7fe700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1cc063140 0x7fe1cc063a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:24.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1caffd700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1cc0b1000 0x7fe1cc0659d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fe1bc00c000 tx=0x7fe1bc0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:24.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1c8ff9700 1 -- 172.21.15.60:0/3103133740 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1bc00cbb0 con 0x7fe1cc0b1000 2020-10-31T22:41:24.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1c8ff9700 1 -- 172.21.15.60:0/3103133740 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc00cd10 con 0x7fe1cc0b1000 2020-10-31T22:41:24.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/3103133740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc149050 con 0x7fe1cc0b1000 2020-10-31T22:41:24.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1c8ff9700 1 -- 172.21.15.60:0/3103133740 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1bc0125e0 con 0x7fe1cc0b1000 2020-10-31T22:41:24.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.371+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/3103133740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc1466d0 con 0x7fe1cc0b1000 2020-10-31T22:41:24.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.375+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/3103133740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc057100 con 0x7fe1cc0b1000 2020-10-31T22:41:24.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.375+0000 7fe1c8ff9700 1 -- 172.21.15.60:0/3103133740 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe1bc022070 con 0x7fe1cc0b1000 2020-10-31T22:41:24.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.375+0000 7fe1c8ff9700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe1b0054f10 0x7fe1b00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.375+0000 7fe1c8ff9700 1 -- 172.21.15.60:0/3103133740 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe1bc06e220 con 0x7fe1cc0b1000 2020-10-31T22:41:24.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.375+0000 7fe1cb7fe700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe1b0054f10 0x7fe1b00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.375+0000 7fe1cb7fe700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe1b0054f10 0x7fe1b00573d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fe1b400b000 tx=0x7fe1b4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:24.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.379+0000 7fe1c8ff9700 1 -- 172.21.15.60:0/3103133740 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe1bc044740 con 0x7fe1cc0b1000 2020-10-31T22:41:24.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.523+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/3103133740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1cc05ed50 con 0x7fe1cc0b1000 2020-10-31T22:41:24.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.527+0000 7fe1c8ff9700 1 -- 172.21.15.60:0/3103133740 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fe1bc047d60 con 0x7fe1cc0b1000 2020-10-31T22:41:24.530 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:24.530 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:11.059362+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:07.982891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:08.927092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:24.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.527+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/3103133740 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe1b0054f10 msgr2=0x7fe1b00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.527+0000 7fe1d0bbe700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe1b0054f10 0x7fe1b00573d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fe1b400b000 tx=0x7fe1b4009040).stop 2020-10-31T22:41:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.527+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/3103133740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1cc0b1000 msgr2=0x7fe1cc0659d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.527+0000 7fe1d0bbe700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1cc0b1000 0x7fe1cc0659d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7fe1bc00c000 tx=0x7fe1bc0091a0).stop 2020-10-31T22:41:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.527+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/3103133740 shutdown_connections 2020-10-31T22:41:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.527+0000 7fe1d0bbe700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe1cc0b2820 0x7fe1cc1461e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.527+0000 7fe1d0bbe700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe1b0054f10 0x7fe1b00573d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.527+0000 7fe1d0bbe700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1cc063140 0x7fe1cc063a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.527+0000 7fe1d0bbe700 1 --2- 172.21.15.60:0/3103133740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1cc0b1000 0x7fe1cc0659d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.527+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/3103133740 >> 172.21.15.60:0/3103133740 conn(0x7fe1cc06a600 msgr2=0x7fe1cc060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:24.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.527+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/3103133740 shutdown_connections 2020-10-31T22:41:24.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.527+0000 7fe1d0bbe700 1 -- 172.21.15.60:0/3103133740 wait complete. 2020-10-31T22:41:24.544 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:41:07.982891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:41:08.927092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:41:24.545 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:41:24.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.659+0000 7f2f7f59e700 1 Processor -- start 2020-10-31T22:41:24.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.659+0000 7f2f7f59e700 1 -- start start 2020-10-31T22:41:24.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.659+0000 7f2f7f59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2f800b5570 0x7f2f800b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f800b24a0 0x7f2f80145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f80145e40 0x7f2f80141f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8013f930 con 0x7f2f800b24a0 2020-10-31T22:41:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f800b4440 con 0x7f2f800b5570 2020-10-31T22:41:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f800b02f0 con 0x7f2f80145e40 2020-10-31T22:41:24.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7dd9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f800b24a0 0x7f2f80145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7dd9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f800b24a0 0x7f2f80145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41858/0 (socket says 172.21.15.60:41858) 2020-10-31T22:41:24.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7dd9b700 1 -- 172.21.15.60:0/3886564992 learned_addr learned my addr 172.21.15.60:0/3886564992 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:24.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7ed9d700 1 --2- 172.21.15.60:0/3886564992 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f80145e40 0x7f2f80141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7e59c700 1 --2- 172.21.15.60:0/3886564992 >> v2:172.21.15.66:3300/0 conn(0x7f2f800b5570 0x7f2f800b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7dd9b700 1 -- 172.21.15.60:0/3886564992 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f80145e40 msgr2=0x7f2f80141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7dd9b700 1 --2- 172.21.15.60:0/3886564992 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f80145e40 0x7f2f80141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7dd9b700 1 -- 172.21.15.60:0/3886564992 >> v2:172.21.15.66:3300/0 conn(0x7f2f800b5570 msgr2=0x7f2f800b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7dd9b700 1 --2- 172.21.15.60:0/3886564992 >> v2:172.21.15.66:3300/0 conn(0x7f2f800b5570 0x7f2f800b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7dd9b700 1 -- 172.21.15.60:0/3886564992 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800b0590 con 0x7f2f800b24a0 2020-10-31T22:41:24.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7e59c700 1 --2- 172.21.15.60:0/3886564992 >> v2:172.21.15.66:3300/0 conn(0x7f2f800b5570 0x7f2f800b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:24.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7dd9b700 1 --2- 172.21.15.60:0/3886564992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f800b24a0 0x7f2f80145950 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f2f68002f30 tx=0x7f2f68006e80).ready entity=mon.0 client_cookie=977de494365e775d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:24.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7d59a700 1 -- 172.21.15.60:0/3886564992 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f680097f0 con 0x7f2f800b24a0 2020-10-31T22:41:24.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7d59a700 1 -- 172.21.15.60:0/3886564992 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f68009950 con 0x7f2f800b24a0 2020-10-31T22:41:24.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7d59a700 1 -- 172.21.15.60:0/3886564992 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f68009cb0 con 0x7f2f800b24a0 2020-10-31T22:41:24.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 -- 172.21.15.60:0/3886564992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f800b24a0 msgr2=0x7f2f80145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 --2- 172.21.15.60:0/3886564992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f800b24a0 0x7f2f80145950 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f2f68002f30 tx=0x7f2f68006e80).stop 2020-10-31T22:41:24.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 -- 172.21.15.60:0/3886564992 shutdown_connections 2020-10-31T22:41:24.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 --2- 172.21.15.60:0/3886564992 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f80145e40 0x7f2f80141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 --2- 172.21.15.60:0/3886564992 >> v2:172.21.15.66:3300/0 conn(0x7f2f800b5570 0x7f2f800b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 --2- 172.21.15.60:0/3886564992 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f800b24a0 0x7f2f80145950 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 -- 172.21.15.60:0/3886564992 >> 172.21.15.60:0/3886564992 conn(0x7f2f800b8e90 msgr2=0x7f2f800b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:24.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 -- 172.21.15.60:0/3886564992 shutdown_connections 2020-10-31T22:41:24.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 -- 172.21.15.60:0/3886564992 wait complete. 2020-10-31T22:41:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 Processor -- start 2020-10-31T22:41:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.663+0000 7f2f7f59e700 1 -- start start 2020-10-31T22:41:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7f59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f800b24a0 0x7f2f80144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7f59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f800b5570 0x7f2f80146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f80145e40 0x7f2f80146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f801486b0 con 0x7f2f80145e40 2020-10-31T22:41:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7f59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80148950 con 0x7f2f800b5570 2020-10-31T22:41:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7f59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f80148bf0 con 0x7f2f800b24a0 2020-10-31T22:41:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f80145e40 0x7f2f80146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f80145e40 0x7f2f80146a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41868/0 (socket says 172.21.15.60:41868) 2020-10-31T22:41:24.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7ed9d700 1 -- 172.21.15.60:0/4188129891 learned_addr learned my addr 172.21.15.60:0/4188129891 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:24.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7e59c700 1 --2- 172.21.15.60:0/4188129891 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f800b24a0 0x7f2f80144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7dd9b700 1 --2- 172.21.15.60:0/4188129891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f800b5570 0x7f2f80146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7ed9d700 1 -- 172.21.15.60:0/4188129891 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f800b24a0 msgr2=0x7f2f80144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7ed9d700 1 --2- 172.21.15.60:0/4188129891 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f800b24a0 0x7f2f80144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7ed9d700 1 -- 172.21.15.60:0/4188129891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f800b5570 msgr2=0x7f2f80146540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7ed9d700 1 --2- 172.21.15.60:0/4188129891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f800b5570 0x7f2f80146540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7ed9d700 1 -- 172.21.15.60:0/4188129891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f80148e90 con 0x7f2f80145e40 2020-10-31T22:41:24.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7ed9d700 1 --2- 172.21.15.60:0/4188129891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f80145e40 0x7f2f80146a30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f2f78006dd0 tx=0x7f2f780091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:24.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f777fe700 1 -- 172.21.15.60:0/4188129891 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f7800c950 con 0x7f2f80145e40 2020-10-31T22:41:24.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f777fe700 1 -- 172.21.15.60:0/4188129891 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7800cab0 con 0x7f2f80145e40 2020-10-31T22:41:24.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7f59e700 1 -- 172.21.15.60:0/4188129891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f80144990 con 0x7f2f80145e40 2020-10-31T22:41:24.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f777fe700 1 -- 172.21.15.60:0/4188129891 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f7800ce10 con 0x7f2f80145e40 2020-10-31T22:41:24.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.667+0000 7f2f7f59e700 1 -- 172.21.15.60:0/4188129891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f800ad930 con 0x7f2f80145e40 2020-10-31T22:41:24.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.671+0000 7f2f7f59e700 1 -- 172.21.15.60:0/4188129891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8005b320 con 0x7f2f80145e40 2020-10-31T22:41:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.671+0000 7f2f777fe700 1 -- 172.21.15.60:0/4188129891 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2f78022070 con 0x7f2f80145e40 2020-10-31T22:41:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.671+0000 7f2f777fe700 1 --2- 172.21.15.60:0/4188129891 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2f64054f10 0x7f2f640573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.671+0000 7f2f777fe700 1 -- 172.21.15.60:0/4188129891 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2f7806df60 con 0x7f2f80145e40 2020-10-31T22:41:24.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.671+0000 7f2f7e59c700 1 --2- 172.21.15.60:0/4188129891 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2f64054f10 0x7f2f640573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.671+0000 7f2f7e59c700 1 --2- 172.21.15.60:0/4188129891 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2f64054f10 0x7f2f640573d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f2f7000c000 tx=0x7f2f70008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:24.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.675+0000 7f2f777fe700 1 -- 172.21.15.60:0/4188129891 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2f78044480 con 0x7f2f80145e40 2020-10-31T22:41:24.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.823+0000 7f2f7f59e700 1 -- 172.21.15.60:0/4188129891 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2f800ad930 con 0x7f2f80145e40 2020-10-31T22:41:24.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.823+0000 7f2f777fe700 1 -- 172.21.15.60:0/4188129891 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2f800ad930 con 0x7f2f80145e40 2020-10-31T22:41:24.825 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:41:24.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.823+0000 7f2f7f59e700 1 -- 172.21.15.60:0/4188129891 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2f64054f10 msgr2=0x7f2f640573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.823+0000 7f2f7f59e700 1 --2- 172.21.15.60:0/4188129891 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2f64054f10 0x7f2f640573d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f2f7000c000 tx=0x7f2f70008040).stop 2020-10-31T22:41:24.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.823+0000 7f2f7f59e700 1 -- 172.21.15.60:0/4188129891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f80145e40 msgr2=0x7f2f80146a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.823+0000 7f2f7f59e700 1 --2- 172.21.15.60:0/4188129891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f80145e40 0x7f2f80146a30 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f2f78006dd0 tx=0x7f2f780091a0).stop 2020-10-31T22:41:24.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.823+0000 7f2f7f59e700 1 -- 172.21.15.60:0/4188129891 shutdown_connections 2020-10-31T22:41:24.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.823+0000 7f2f7f59e700 1 --2- 172.21.15.60:0/4188129891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f80145e40 0x7f2f80146a30 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.823+0000 7f2f7f59e700 1 --2- 172.21.15.60:0/4188129891 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f800b24a0 0x7f2f80144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.823+0000 7f2f7f59e700 1 --2- 172.21.15.60:0/4188129891 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2f64054f10 0x7f2f640573d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.823+0000 7f2f7f59e700 1 --2- 172.21.15.60:0/4188129891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f800b5570 0x7f2f80146540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.823+0000 7f2f7f59e700 1 -- 172.21.15.60:0/4188129891 >> 172.21.15.60:0/4188129891 conn(0x7f2f800b8e90 msgr2=0x7f2f800b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:24.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.823+0000 7f2f7f59e700 1 -- 172.21.15.60:0/4188129891 shutdown_connections 2020-10-31T22:41:24.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.823+0000 7f2f7f59e700 1 -- 172.21.15.60:0/4188129891 wait complete. 2020-10-31T22:41:24.839 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:41:24.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f49a08c0700 1 Processor -- start 2020-10-31T22:41:24.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f49a08c0700 1 -- start start 2020-10-31T22:41:24.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f49a08c0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f499c0b1e50 0x7f499c145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f49a08c0700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f499c0b09a0 0x7f499c145d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f49a08c0700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f499c0b0e50 con 0x7f499c0a54e0 2020-10-31T22:41:24.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f49a08c0700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f499c0b2230 con 0x7f499c0b09a0 2020-10-31T22:41:24.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f49a08c0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c146200 con 0x7f499c0b1e50 2020-10-31T22:41:24.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f499b59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f499c0b09a0 0x7f499c145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f499ad9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f499c0b1e50 0x7f499c145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f499a59c700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f499c0a54e0 0x7f499c0b0290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:43878/0 (socket says 172.21.15.60:43878) 2020-10-31T22:41:24.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f499a59c700 1 -- 172.21.15.60:0/1985888264 learned_addr learned my addr 172.21.15.60:0/1985888264 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:24.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f499ad9d700 1 -- 172.21.15.60:0/1985888264 >> v2:172.21.15.66:3300/0 conn(0x7f499c0b09a0 msgr2=0x7f499c145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:24.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f499ad9d700 1 --2- 172.21.15.60:0/1985888264 >> v2:172.21.15.66:3300/0 conn(0x7f499c0b09a0 0x7f499c145d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f499ad9d700 1 -- 172.21.15.60:0/1985888264 >> v1:172.21.15.66:6789/0 conn(0x7f499c0a54e0 legacy=0x7f499c0b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f499ad9d700 1 -- 172.21.15.60:0/1985888264 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c05fba0 con 0x7f499c0b1e50 2020-10-31T22:41:24.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f499b59e700 1 --2- 172.21.15.60:0/1985888264 >> v2:172.21.15.66:3300/0 conn(0x7f499c0b09a0 0x7f499c145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:24.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.959+0000 7f499ad9d700 1 --2- 172.21.15.60:0/1985888264 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f499c0b1e50 0x7f499c145820 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f498c0032b0 tx=0x7f498c0091a0).ready entity=mon.2 client_cookie=eb238cb4294a8b5c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:24.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f4999d9b700 1 -- 172.21.15.60:0/1985888264 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f498c00b9a0 con 0x7f499c0b1e50 2020-10-31T22:41:24.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f4999d9b700 1 -- 172.21.15.60:0/1985888264 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c00bb00 con 0x7f499c0b1e50 2020-10-31T22:41:24.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f4999d9b700 1 -- 172.21.15.60:0/1985888264 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f498c00bc70 con 0x7f499c0b1e50 2020-10-31T22:41:24.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 -- 172.21.15.60:0/1985888264 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f499c0b1e50 msgr2=0x7f499c145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 --2- 172.21.15.60:0/1985888264 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f499c0b1e50 0x7f499c145820 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f498c0032b0 tx=0x7f498c0091a0).stop 2020-10-31T22:41:24.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 -- 172.21.15.60:0/1985888264 shutdown_connections 2020-10-31T22:41:24.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 --2- 172.21.15.60:0/1985888264 >> v2:172.21.15.66:3300/0 conn(0x7f499c0b09a0 0x7f499c145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 --2- 172.21.15.60:0/1985888264 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f499c0b1e50 0x7f499c145820 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 -- 172.21.15.60:0/1985888264 >> 172.21.15.60:0/1985888264 conn(0x7f499c060de0 msgr2=0x7f499c062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:24.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 -- 172.21.15.60:0/1985888264 shutdown_connections 2020-10-31T22:41:24.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 -- 172.21.15.60:0/1985888264 wait complete. 2020-10-31T22:41:24.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 Processor -- start 2020-10-31T22:41:24.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 -- start start 2020-10-31T22:41:24.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c0a54e0 0x7f499c141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f499c0b09a0 0x7f499c13ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f499c0b1e50 0x7f499c13f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c13f650 con 0x7f499c0a54e0 2020-10-31T22:41:24.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0a4f00 con 0x7f499c0b09a0 2020-10-31T22:41:24.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f49a08c0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f499c0a42f0 con 0x7f499c0b1e50 2020-10-31T22:41:24.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f499ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c0a54e0 0x7f499c141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f499ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c0a54e0 0x7f499c141cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41878/0 (socket says 172.21.15.60:41878) 2020-10-31T22:41:24.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.963+0000 7f499ad9d700 1 -- 172.21.15.60:0/2687353875 learned_addr learned my addr 172.21.15.60:0/2687353875 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:24.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.967+0000 7f499a59c700 1 --2- 172.21.15.60:0/2687353875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f499c0b09a0 0x7f499c13ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.967+0000 7f499b59e700 1 --2- 172.21.15.60:0/2687353875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f499c0b1e50 0x7f499c13f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.967+0000 7f499ad9d700 1 -- 172.21.15.60:0/2687353875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f499c0b1e50 msgr2=0x7f499c13f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.967+0000 7f499ad9d700 1 --2- 172.21.15.60:0/2687353875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f499c0b1e50 0x7f499c13f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.967+0000 7f499ad9d700 1 -- 172.21.15.60:0/2687353875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f499c0b09a0 msgr2=0x7f499c13ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:24.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.967+0000 7f499ad9d700 1 --2- 172.21.15.60:0/2687353875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f499c0b09a0 0x7f499c13ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:24.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.967+0000 7f499ad9d700 1 -- 172.21.15.60:0/2687353875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f499c0a4590 con 0x7f499c0a54e0 2020-10-31T22:41:24.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.967+0000 7f499ad9d700 1 --2- 172.21.15.60:0/2687353875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c0a54e0 0x7f499c141cb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f498c0032b0 tx=0x7f498c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:24.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.967+0000 7f4993fff700 1 -- 172.21.15.60:0/2687353875 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f498c0205f0 con 0x7f499c0a54e0 2020-10-31T22:41:24.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.967+0000 7f4993fff700 1 -- 172.21.15.60:0/2687353875 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498c020750 con 0x7f499c0a54e0 2020-10-31T22:41:24.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.967+0000 7f4993fff700 1 -- 172.21.15.60:0/2687353875 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f498c020ab0 con 0x7f499c0a54e0 2020-10-31T22:41:24.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.967+0000 7f49a08c0700 1 -- 172.21.15.60:0/2687353875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c0a4b80 con 0x7f499c0a54e0 2020-10-31T22:41:24.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.967+0000 7f49a08c0700 1 -- 172.21.15.60:0/2687353875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c0a6620 con 0x7f499c0a54e0 2020-10-31T22:41:24.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.967+0000 7f49a08c0700 1 -- 172.21.15.60:0/2687353875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499c0a3ef0 con 0x7f499c0a54e0 2020-10-31T22:41:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.971+0000 7f4993fff700 1 -- 172.21.15.60:0/2687353875 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f498c027030 con 0x7f499c0a54e0 2020-10-31T22:41:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.971+0000 7f4993fff700 1 --2- 172.21.15.60:0/2687353875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4980054fe0 0x7f49800574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:24.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.971+0000 7f499a59c700 1 --2- 172.21.15.60:0/2687353875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4980054fe0 0x7f49800574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.971+0000 7f4993fff700 1 -- 172.21.15.60:0/2687353875 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f498c06efc0 con 0x7f499c0a54e0 2020-10-31T22:41:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.971+0000 7f499a59c700 1 --2- 172.21.15.60:0/2687353875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4980054fe0 0x7f49800574a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f498400d000 tx=0x7f4984009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:24.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:24.975+0000 7f4993fff700 1 -- 172.21.15.60:0/2687353875 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f498c0454e0 con 0x7f499c0a54e0 2020-10-31T22:41:25.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.119+0000 7f49a08c0700 1 -- 172.21.15.60:0/2687353875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f499c0a4150 con 0x7f499c0a54e0 2020-10-31T22:41:25.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.119+0000 7f4993fff700 1 -- 172.21.15.60:0/2687353875 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f499c0a4150 con 0x7f499c0a54e0 2020-10-31T22:41:25.123 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:25.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.119+0000 7f49a08c0700 1 -- 172.21.15.60:0/2687353875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4980054fe0 msgr2=0x7f49800574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.119+0000 7f49a08c0700 1 --2- 172.21.15.60:0/2687353875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4980054fe0 0x7f49800574a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f498400d000 tx=0x7f4984009040).stop 2020-10-31T22:41:25.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.119+0000 7f49a08c0700 1 -- 172.21.15.60:0/2687353875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c0a54e0 msgr2=0x7f499c141cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.119+0000 7f49a08c0700 1 --2- 172.21.15.60:0/2687353875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c0a54e0 0x7f499c141cb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f498c0032b0 tx=0x7f498c016000).stop 2020-10-31T22:41:25.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.119+0000 7f49a08c0700 1 -- 172.21.15.60:0/2687353875 shutdown_connections 2020-10-31T22:41:25.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.119+0000 7f49a08c0700 1 --2- 172.21.15.60:0/2687353875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f499c0b1e50 0x7f499c13f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.119+0000 7f49a08c0700 1 --2- 172.21.15.60:0/2687353875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f499c0a54e0 0x7f499c141cb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.119+0000 7f49a08c0700 1 --2- 172.21.15.60:0/2687353875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4980054fe0 0x7f49800574a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.119+0000 7f49a08c0700 1 --2- 172.21.15.60:0/2687353875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f499c0b09a0 0x7f499c13ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.119+0000 7f49a08c0700 1 -- 172.21.15.60:0/2687353875 >> 172.21.15.60:0/2687353875 conn(0x7f499c060de0 msgr2=0x7f499c0ad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:25.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.119+0000 7f49a08c0700 1 -- 172.21.15.60:0/2687353875 shutdown_connections 2020-10-31T22:41:25.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.119+0000 7f49a08c0700 1 -- 172.21.15.60:0/2687353875 wait complete. 2020-10-31T22:41:25.135 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:41:25.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078ffff700 1 Processor -- start 2020-10-31T22:41:25.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078ffff700 1 -- start start 2020-10-31T22:41:25.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078ffff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f07900b5380 0x7f07900ac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07900b0b50 0x7f07900b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078ffff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07900acd60 con 0x7f07900b1b20 2020-10-31T22:41:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078ffff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07900ad650 con 0x7f07900b5380 2020-10-31T22:41:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07900b5760 con 0x7f07900b0b50 2020-10-31T22:41:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f07900b1b20 0x7f07900b1f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46026/0 (socket says 172.21.15.60:46026) 2020-10-31T22:41:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078f7fe700 1 -- 172.21.15.60:0/2224852997 learned_addr learned my addr 172.21.15.60:0/2224852997 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:25.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078e7fc700 1 --2- 172.21.15.60:0/2224852997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07900b0b50 0x7f07900b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078effd700 1 --2- 172.21.15.60:0/2224852997 >> v2:172.21.15.66:3300/0 conn(0x7f07900b5380 0x7f07900ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078dffb700 1 -- 172.21.15.60:0/2224852997 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610656364 0 0) 0x7f07900acd60 con 0x7f07900b1b20 2020-10-31T22:41:25.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078dffb700 1 -- 172.21.15.60:0/2224852997 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0774003230 con 0x7f07900b1b20 2020-10-31T22:41:25.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078effd700 1 -- 172.21.15.60:0/2224852997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07900b0b50 msgr2=0x7f07900b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078effd700 1 --2- 172.21.15.60:0/2224852997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07900b0b50 0x7f07900b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078dffb700 1 -- 172.21.15.60:0/2224852997 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2328460292 0 0) 0x7f0774003230 con 0x7f07900b1b20 2020-10-31T22:41:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078effd700 1 -- 172.21.15.60:0/2224852997 >> v1:172.21.15.60:6789/0 conn(0x7f07900b1b20 legacy=0x7f07900b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078effd700 1 -- 172.21.15.60:0/2224852997 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07900b14c0 con 0x7f07900b5380 2020-10-31T22:41:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078e7fc700 1 --2- 172.21.15.60:0/2224852997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07900b0b50 0x7f07900b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078effd700 1 --2- 172.21.15.60:0/2224852997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07900b5380 0x7f07900ac530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f0788001bf0 tx=0x7f0780006dc0).ready entity=mon.1 client_cookie=53fb2abd4d7ab005 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:25.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078dffb700 1 -- 172.21.15.60:0/2224852997 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0788001a50 con 0x7f07900b5380 2020-10-31T22:41:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078dffb700 1 -- 172.21.15.60:0/2224852997 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078000d570 con 0x7f07900b5380 2020-10-31T22:41:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.255+0000 7f078dffb700 1 -- 172.21.15.60:0/2224852997 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f078000d6e0 con 0x7f07900b5380 2020-10-31T22:41:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.259+0000 7f078ffff700 1 -- 172.21.15.60:0/2224852997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07900b5380 msgr2=0x7f07900ac530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.259+0000 7f078ffff700 1 --2- 172.21.15.60:0/2224852997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07900b5380 0x7f07900ac530 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f0788001bf0 tx=0x7f0780006dc0).stop 2020-10-31T22:41:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.259+0000 7f078ffff700 1 -- 172.21.15.60:0/2224852997 shutdown_connections 2020-10-31T22:41:25.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.259+0000 7f078ffff700 1 --2- 172.21.15.60:0/2224852997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07900b5380 0x7f07900ac530 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.259+0000 7f078ffff700 1 --2- 172.21.15.60:0/2224852997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07900b0b50 0x7f07900b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.259+0000 7f078ffff700 1 -- 172.21.15.60:0/2224852997 >> 172.21.15.60:0/2224852997 conn(0x7f079006a600 msgr2=0x7f0790060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:25.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.259+0000 7f078ffff700 1 -- 172.21.15.60:0/2224852997 shutdown_connections 2020-10-31T22:41:25.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.259+0000 7f078ffff700 1 -- 172.21.15.60:0/2224852997 wait complete. 2020-10-31T22:41:25.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.259+0000 7f078ffff700 1 Processor -- start 2020-10-31T22:41:25.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.259+0000 7f078ffff700 1 -- start start 2020-10-31T22:41:25.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078ffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07900b0b50 0x7f0790066e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07900b1b20 0x7f07900a3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07900b5380 0x7f07900a40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07900a2120 con 0x7f07900b5380 2020-10-31T22:41:25.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078ffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079009ff10 con 0x7f07900b0b50 2020-10-31T22:41:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07900a01b0 con 0x7f07900b1b20 2020-10-31T22:41:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07900b5380 0x7f07900a40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07900b5380 0x7f07900a40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41896/0 (socket says 172.21.15.60:41896) 2020-10-31T22:41:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078f7fe700 1 -- 172.21.15.60:0/120894275 learned_addr learned my addr 172.21.15.60:0/120894275 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078e7fc700 1 --2- 172.21.15.60:0/120894275 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07900b1b20 0x7f07900a3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078effd700 1 --2- 172.21.15.60:0/120894275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07900b0b50 0x7f0790066e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078f7fe700 1 -- 172.21.15.60:0/120894275 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07900b1b20 msgr2=0x7f07900a3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078f7fe700 1 --2- 172.21.15.60:0/120894275 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07900b1b20 0x7f07900a3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078f7fe700 1 -- 172.21.15.60:0/120894275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07900b0b50 msgr2=0x7f0790066e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078f7fe700 1 --2- 172.21.15.60:0/120894275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07900b0b50 0x7f0790066e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078f7fe700 1 -- 172.21.15.60:0/120894275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07900a0450 con 0x7f07900b5380 2020-10-31T22:41:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078f7fe700 1 --2- 172.21.15.60:0/120894275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07900b5380 0x7f07900a40f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f0788001cb0 tx=0x7f078800cd10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f077ffff700 1 -- 172.21.15.60:0/120894275 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0788004a80 con 0x7f07900b5380 2020-10-31T22:41:25.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f077ffff700 1 -- 172.21.15.60:0/120894275 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0788004be0 con 0x7f07900b5380 2020-10-31T22:41:25.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f077ffff700 1 -- 172.21.15.60:0/120894275 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0788007170 con 0x7f07900b5380 2020-10-31T22:41:25.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078ffff700 1 -- 172.21.15.60:0/120894275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07900a06f0 con 0x7f07900b5380 2020-10-31T22:41:25.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078ffff700 1 -- 172.21.15.60:0/120894275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07900a2370 con 0x7f07900b5380 2020-10-31T22:41:25.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.263+0000 7f078ffff700 1 -- 172.21.15.60:0/120894275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07900a1520 con 0x7f07900b5380 2020-10-31T22:41:25.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.267+0000 7f077ffff700 1 -- 172.21.15.60:0/120894275 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0788010070 con 0x7f07900b5380 2020-10-31T22:41:25.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.267+0000 7f077ffff700 1 --2- 172.21.15.60:0/120894275 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f076c054fd0 0x7f076c057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.267+0000 7f078effd700 1 --2- 172.21.15.60:0/120894275 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f076c054fd0 0x7f076c057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.267+0000 7f077ffff700 1 -- 172.21.15.60:0/120894275 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f078806d630 con 0x7f07900b5380 2020-10-31T22:41:25.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.267+0000 7f078effd700 1 --2- 172.21.15.60:0/120894275 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f076c054fd0 0x7f076c057490 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f078001a000 tx=0x7f0780015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:25.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.271+0000 7f077ffff700 1 -- 172.21.15.60:0/120894275 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f07900a1520 con 0x7f07900b5380 2020-10-31T22:41:25.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.419+0000 7f078ffff700 1 -- 172.21.15.60:0/120894275 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f07900a1520 con 0x7f07900b5380 2020-10-31T22:41:25.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.419+0000 7f077ffff700 1 -- 172.21.15.60:0/120894275 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f07900a1520 con 0x7f07900b5380 2020-10-31T22:41:25.422 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:25.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.419+0000 7f078ffff700 1 -- 172.21.15.60:0/120894275 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f076c054fd0 msgr2=0x7f076c057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.419+0000 7f078ffff700 1 --2- 172.21.15.60:0/120894275 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f076c054fd0 0x7f076c057490 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f078001a000 tx=0x7f0780015000).stop 2020-10-31T22:41:25.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.419+0000 7f078ffff700 1 -- 172.21.15.60:0/120894275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07900b5380 msgr2=0x7f07900a40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.419+0000 7f078ffff700 1 --2- 172.21.15.60:0/120894275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07900b5380 0x7f07900a40f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f0788001cb0 tx=0x7f078800cd10).stop 2020-10-31T22:41:25.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.419+0000 7f078ffff700 1 -- 172.21.15.60:0/120894275 shutdown_connections 2020-10-31T22:41:25.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.419+0000 7f078ffff700 1 --2- 172.21.15.60:0/120894275 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07900b5380 0x7f07900a40f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.419+0000 7f078ffff700 1 --2- 172.21.15.60:0/120894275 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f076c054fd0 0x7f076c057490 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.419+0000 7f078ffff700 1 --2- 172.21.15.60:0/120894275 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07900b0b50 0x7f0790066e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.419+0000 7f078ffff700 1 --2- 172.21.15.60:0/120894275 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07900b1b20 0x7f07900a3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.419+0000 7f078ffff700 1 -- 172.21.15.60:0/120894275 >> 172.21.15.60:0/120894275 conn(0x7f079006a600 msgr2=0x7f07900aa000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:25.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.419+0000 7f078ffff700 1 -- 172.21.15.60:0/120894275 shutdown_connections 2020-10-31T22:41:25.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.419+0000 7f078ffff700 1 -- 172.21.15.60:0/120894275 wait complete. 2020-10-31T22:41:25.436 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:41:25.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56df59e700 1 Processor -- start 2020-10-31T22:41:25.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56df59e700 1 -- start start 2020-10-31T22:41:25.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56df59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f56e005f900 0x7f56e005fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56df59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f56e0060260 0x7f56e013f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56df59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e00b0890 con 0x7f56e005b180 2020-10-31T22:41:25.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56df59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e00b0350 con 0x7f56e005f900 2020-10-31T22:41:25.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56df59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e00b05f0 con 0x7f56e0060260 2020-10-31T22:41:25.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56ddd9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f56e005f900 0x7f56e005fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56ddd9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f56e005f900 0x7f56e005fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41902/0 (socket says 172.21.15.60:41902) 2020-10-31T22:41:25.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56ddd9b700 1 -- 172.21.15.60:0/3035386262 learned_addr learned my addr 172.21.15.60:0/3035386262 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:25.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56ded9d700 1 --2- 172.21.15.60:0/3035386262 >> v2:172.21.15.66:3300/0 conn(0x7f56e0060260 0x7f56e013f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56ddd9b700 1 -- 172.21.15.60:0/3035386262 >> v2:172.21.15.66:3300/0 conn(0x7f56e0060260 msgr2=0x7f56e013f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:25.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56ddd9b700 1 --2- 172.21.15.60:0/3035386262 >> v2:172.21.15.66:3300/0 conn(0x7f56e0060260 0x7f56e013f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56ddd9b700 1 -- 172.21.15.60:0/3035386262 >> v1:172.21.15.66:6789/0 conn(0x7f56e005b180 legacy=0x7f56e01469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56ddd9b700 1 -- 172.21.15.60:0/3035386262 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e005f460 con 0x7f56e005f900 2020-10-31T22:41:25.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56ddd9b700 1 --2- 172.21.15.60:0/3035386262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56e005f900 0x7f56e005fd70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f56e00adf00 tx=0x7f56d4006e80).ready entity=mon.0 client_cookie=c1710218bec07b7e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:25.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56dd59a700 1 -- 172.21.15.60:0/3035386262 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56d40097b0 con 0x7f56e005f900 2020-10-31T22:41:25.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56dd59a700 1 -- 172.21.15.60:0/3035386262 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d4009910 con 0x7f56e005f900 2020-10-31T22:41:25.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56df59e700 1 -- 172.21.15.60:0/3035386262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56e005f900 msgr2=0x7f56e005fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56dd59a700 1 -- 172.21.15.60:0/3035386262 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56d4009c70 con 0x7f56e005f900 2020-10-31T22:41:25.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.551+0000 7f56df59e700 1 --2- 172.21.15.60:0/3035386262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56e005f900 0x7f56e005fd70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f56e00adf00 tx=0x7f56d4006e80).stop 2020-10-31T22:41:25.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 -- 172.21.15.60:0/3035386262 shutdown_connections 2020-10-31T22:41:25.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 --2- 172.21.15.60:0/3035386262 >> v2:172.21.15.66:3300/0 conn(0x7f56e0060260 0x7f56e013f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 --2- 172.21.15.60:0/3035386262 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56e005f900 0x7f56e005fd70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 -- 172.21.15.60:0/3035386262 >> 172.21.15.60:0/3035386262 conn(0x7f56e00b61d0 msgr2=0x7f56e00b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:25.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 -- 172.21.15.60:0/3035386262 shutdown_connections 2020-10-31T22:41:25.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 -- 172.21.15.60:0/3035386262 wait complete. 2020-10-31T22:41:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 Processor -- start 2020-10-31T22:41:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 -- start start 2020-10-31T22:41:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56e005b180 0x7f56e0155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56e005f900 0x7f56e00b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e0060260 0x7f56e00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e013b1b0 con 0x7f56e005f900 2020-10-31T22:41:25.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00b5f30 con 0x7f56e0060260 2020-10-31T22:41:25.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0155120 con 0x7f56e005b180 2020-10-31T22:41:25.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56ddd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56e005f900 0x7f56e00b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56ddd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56e005f900 0x7f56e00b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41910/0 (socket says 172.21.15.60:41910) 2020-10-31T22:41:25.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56ddd9b700 1 -- 172.21.15.60:0/372006443 learned_addr learned my addr 172.21.15.60:0/372006443 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:25.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56ded9d700 1 --2- 172.21.15.60:0/372006443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e0060260 0x7f56e00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56de59c700 1 --2- 172.21.15.60:0/372006443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56e005b180 0x7f56e0155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56ddd9b700 1 -- 172.21.15.60:0/372006443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56e005b180 msgr2=0x7f56e0155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56ddd9b700 1 --2- 172.21.15.60:0/372006443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56e005b180 0x7f56e0155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56ddd9b700 1 -- 172.21.15.60:0/372006443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e0060260 msgr2=0x7f56e00b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56ddd9b700 1 --2- 172.21.15.60:0/372006443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e0060260 0x7f56e00b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56ddd9b700 1 -- 172.21.15.60:0/372006443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e01553c0 con 0x7f56e005f900 2020-10-31T22:41:25.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56ddd9b700 1 --2- 172.21.15.60:0/372006443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56e005f900 0x7f56e00b5890 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f56e00adf00 tx=0x7f56d4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:25.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56cf7fe700 1 -- 172.21.15.60:0/372006443 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56d4011ce0 con 0x7f56e005f900 2020-10-31T22:41:25.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.555+0000 7f56df59e700 1 -- 172.21.15.60:0/372006443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e0155660 con 0x7f56e005f900 2020-10-31T22:41:25.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.559+0000 7f56df59e700 1 -- 172.21.15.60:0/372006443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e013eba0 con 0x7f56e005f900 2020-10-31T22:41:25.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.559+0000 7f56cf7fe700 1 -- 172.21.15.60:0/372006443 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d4011e40 con 0x7f56e005f900 2020-10-31T22:41:25.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.559+0000 7f56cf7fe700 1 -- 172.21.15.60:0/372006443 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56d401e650 con 0x7f56e005f900 2020-10-31T22:41:25.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.559+0000 7f56df59e700 1 -- 172.21.15.60:0/372006443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e00b5d80 con 0x7f56e005f900 2020-10-31T22:41:25.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.559+0000 7f56cf7fe700 1 -- 172.21.15.60:0/372006443 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f56d4025030 con 0x7f56e005f900 2020-10-31T22:41:25.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.559+0000 7f56cf7fe700 1 --2- 172.21.15.60:0/372006443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f56bc054f10 0x7f56bc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.559+0000 7f56cf7fe700 1 -- 172.21.15.60:0/372006443 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f56d406ef90 con 0x7f56e005f900 2020-10-31T22:41:25.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.559+0000 7f56de59c700 1 --2- 172.21.15.60:0/372006443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f56bc054f10 0x7f56bc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.559+0000 7f56de59c700 1 --2- 172.21.15.60:0/372006443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f56bc054f10 0x7f56bc0573d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f56d000b000 tx=0x7f56d0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:25.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.567+0000 7f56cf7fe700 1 -- 172.21.15.60:0/372006443 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f56d4045410 con 0x7f56e005f900 2020-10-31T22:41:25.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.711+0000 7f56df59e700 1 -- 172.21.15.60:0/372006443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56e01557f0 con 0x7f56e005f900 2020-10-31T22:41:25.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.711+0000 7f56cf7fe700 1 -- 172.21.15.60:0/372006443 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f56d4023020 con 0x7f56e005f900 2020-10-31T22:41:25.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.715+0000 7f56df59e700 1 -- 172.21.15.60:0/372006443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f56bc054f10 msgr2=0x7f56bc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.715+0000 7f56df59e700 1 --2- 172.21.15.60:0/372006443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f56bc054f10 0x7f56bc0573d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f56d000b000 tx=0x7f56d0009040).stop 2020-10-31T22:41:25.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.715+0000 7f56df59e700 1 -- 172.21.15.60:0/372006443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56e005f900 msgr2=0x7f56e00b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.715+0000 7f56df59e700 1 --2- 172.21.15.60:0/372006443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56e005f900 0x7f56e00b5890 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f56e00adf00 tx=0x7f56d4015000).stop 2020-10-31T22:41:25.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.715+0000 7f56df59e700 1 -- 172.21.15.60:0/372006443 shutdown_connections 2020-10-31T22:41:25.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.715+0000 7f56df59e700 1 --2- 172.21.15.60:0/372006443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f56bc054f10 0x7f56bc0573d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.715+0000 7f56df59e700 1 --2- 172.21.15.60:0/372006443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56e0060260 0x7f56e00b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.715+0000 7f56df59e700 1 --2- 172.21.15.60:0/372006443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56e005b180 0x7f56e0155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.715+0000 7f56df59e700 1 --2- 172.21.15.60:0/372006443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56e005f900 0x7f56e00b5890 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.715+0000 7f56df59e700 1 -- 172.21.15.60:0/372006443 >> 172.21.15.60:0/372006443 conn(0x7f56e00b61d0 msgr2=0x7f56e0142f40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:25.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.715+0000 7f56df59e700 1 -- 172.21.15.60:0/372006443 shutdown_connections 2020-10-31T22:41:25.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.715+0000 7f56df59e700 1 -- 172.21.15.60:0/372006443 wait complete. 2020-10-31T22:41:25.724 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:25.731 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:41:25.732 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:41:25.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f20013c3700 1 Processor -- start 2020-10-31T22:41:25.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f20013c3700 1 -- start start 2020-10-31T22:41:25.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f20013c3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1ffc0a7850 0x7f1ffc05bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f20013c3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1ffc146790 0x7f1ffc146b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f20013c3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ffc0af200 con 0x7f1ffc05b960 2020-10-31T22:41:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f20013c3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc0b0f00 con 0x7f1ffc146790 2020-10-31T22:41:25.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f20013c3700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ffc0b11a0 con 0x7f1ffc0a7850 2020-10-31T22:41:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffaffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1ffc05b960 0x7f1ffc0aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46050/0 (socket says 172.21.15.60:46050) 2020-10-31T22:41:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffaffd700 1 -- 172.21.15.60:0/3801074011 learned_addr learned my addr 172.21.15.60:0/3801074011 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffb7fe700 1 --2- 172.21.15.60:0/3801074011 >> v2:172.21.15.60:3300/0 conn(0x7f1ffc146790 0x7f1ffc146b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 -- 172.21.15.60:0/3801074011 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107035787 0 0) 0x7f1ffc0af200 con 0x7f1ffc05b960 2020-10-31T22:41:25.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffa7fc700 1 --2- 172.21.15.60:0/3801074011 >> v2:172.21.15.66:3300/0 conn(0x7f1ffc0a7850 0x7f1ffc05bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 -- 172.21.15.60:0/3801074011 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fe0003230 con 0x7f1ffc05b960 2020-10-31T22:41:25.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 -- 172.21.15.60:0/3801074011 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 109421208 0 0) 0x7f1fe0003230 con 0x7f1ffc05b960 2020-10-31T22:41:25.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 -- 172.21.15.60:0/3801074011 >> v2:172.21.15.66:3300/0 conn(0x7f1ffc0a7850 msgr2=0x7f1ffc05bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:25.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 --2- 172.21.15.60:0/3801074011 >> v2:172.21.15.66:3300/0 conn(0x7f1ffc0a7850 0x7f1ffc05bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 -- 172.21.15.60:0/3801074011 >> v2:172.21.15.60:3300/0 conn(0x7f1ffc146790 msgr2=0x7f1ffc146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:25.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 --2- 172.21.15.60:0/3801074011 >> v2:172.21.15.60:3300/0 conn(0x7f1ffc146790 0x7f1ffc146b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 -- 172.21.15.60:0/3801074011 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc0b1440 con 0x7f1ffc05b960 2020-10-31T22:41:25.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 -- 172.21.15.60:0/3801074011 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f1fec0016d0 con 0x7f1ffc05b960 2020-10-31T22:41:25.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 -- 172.21.15.60:0/3801074011 >> v1:172.21.15.60:6789/0 conn(0x7f1ffc05b960 legacy=0x7f1ffc0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 --2- 172.21.15.60:0/3801074011 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fe0003720 0x7f1fe0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 --2- 172.21.15.60:0/3801074011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe00044d0 0x7f1fe0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 --2- 172.21.15.60:0/3801074011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fe0004e40 0x7f1fe000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 -- 172.21.15.60:0/3801074011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0b0f00 con 0x7f1fe0004e40 2020-10-31T22:41:25.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 -- 172.21.15.60:0/3801074011 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0b11a0 con 0x7f1fe00044d0 2020-10-31T22:41:25.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 -- 172.21.15.60:0/3801074011 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe000bc10 con 0x7f1fe0003720 2020-10-31T22:41:25.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffa7fc700 1 --2- 172.21.15.60:0/3801074011 >> v2:172.21.15.66:3300/0 conn(0x7f1ffc0a7850 0x7f1ffc05bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:25.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffaffd700 1 --2- 172.21.15.60:0/3801074011 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fe0003720 0x7f1fe0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffb7fe700 1 --2- 172.21.15.60:0/3801074011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fe0004e40 0x7f1fe000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffa7fc700 1 --2- 172.21.15.60:0/3801074011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe00044d0 0x7f1fe0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffb7fe700 1 -- 172.21.15.60:0/3801074011 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fe0003720 msgr2=0x7f1fe0003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:25.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffb7fe700 1 --2- 172.21.15.60:0/3801074011 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fe0003720 0x7f1fe0003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffb7fe700 1 -- 172.21.15.60:0/3801074011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe00044d0 msgr2=0x7f1fe0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:25.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffb7fe700 1 --2- 172.21.15.60:0/3801074011 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe00044d0 0x7f1fe0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffb7fe700 1 -- 172.21.15.60:0/3801074011 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe0003230 con 0x7f1fe0004e40 2020-10-31T22:41:25.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffb7fe700 1 -- 172.21.15.60:0/3801074011 reap_dead start 2020-10-31T22:41:25.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ffb7fe700 1 --2- 172.21.15.60:0/3801074011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fe0004e40 0x7f1fe000b720 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f1ff400c000 tx=0x7f1ff40091a0).ready entity=mon.0 client_cookie=21311cac39def310 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:25.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 -- 172.21.15.60:0/3801074011 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ff400eb80 con 0x7f1fe0004e40 2020-10-31T22:41:25.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 -- 172.21.15.60:0/3801074011 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff400ece0 con 0x7f1fe0004e40 2020-10-31T22:41:25.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f1ff9ffb700 1 -- 172.21.15.60:0/3801074011 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ff40125e0 con 0x7f1fe0004e40 2020-10-31T22:41:25.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f20013c3700 1 -- 172.21.15.60:0/3801074011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fe0004e40 msgr2=0x7f1fe000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.847+0000 7f20013c3700 1 --2- 172.21.15.60:0/3801074011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fe0004e40 0x7f1fe000b720 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f1ff400c000 tx=0x7f1ff40091a0).stop 2020-10-31T22:41:25.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.851+0000 7f20013c3700 1 -- 172.21.15.60:0/3801074011 shutdown_connections 2020-10-31T22:41:25.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.851+0000 7f20013c3700 1 --2- 172.21.15.60:0/3801074011 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fe0004e40 0x7f1fe000b720 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.851+0000 7f20013c3700 1 -- 172.21.15.60:0/3801074011 >> 172.21.15.60:0/3801074011 conn(0x7f1ffc06a260 msgr2=0x7f1ffc061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:25.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.851+0000 7f20013c3700 1 -- 172.21.15.60:0/3801074011 shutdown_connections 2020-10-31T22:41:25.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.851+0000 7f20013c3700 1 -- 172.21.15.60:0/3801074011 wait complete. 2020-10-31T22:41:25.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.851+0000 7f20013c3700 1 Processor -- start 2020-10-31T22:41:25.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.851+0000 7f20013c3700 1 -- start start 2020-10-31T22:41:25.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f20013c3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe0004e40 0x7f1ffc0acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f20013c3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ffc0b3140 0x7f1ffc0aa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f20013c3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ffc154f00 0x7f1ffc1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f20013c3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0a9a10 con 0x7f1ffc0b3140 2020-10-31T22:41:25.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f20013c3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0aac70 con 0x7f1fe0004e40 2020-10-31T22:41:25.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f20013c3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ffc0aaf00 con 0x7f1ffc154f00 2020-10-31T22:41:25.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1ffa7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ffc0b3140 0x7f1ffc0aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1ffa7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ffc0b3140 0x7f1ffc0aa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41928/0 (socket says 172.21.15.60:41928) 2020-10-31T22:41:25.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1ffa7fc700 1 -- 172.21.15.60:0/3750367559 learned_addr learned my addr 172.21.15.60:0/3750367559 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:25.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1ffaffd700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe0004e40 0x7f1ffc0acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1ffb7fe700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ffc154f00 0x7f1ffc1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1ffa7fc700 1 -- 172.21.15.60:0/3750367559 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ffc154f00 msgr2=0x7f1ffc1553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1ffa7fc700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ffc154f00 0x7f1ffc1553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1ffa7fc700 1 -- 172.21.15.60:0/3750367559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe0004e40 msgr2=0x7f1ffc0acfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:25.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1ffa7fc700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe0004e40 0x7f1ffc0acfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:25.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1ffa7fc700 1 -- 172.21.15.60:0/3750367559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc0a9c40 con 0x7f1ffc0b3140 2020-10-31T22:41:25.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1ffb7fe700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ffc154f00 0x7f1ffc1553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:25.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1ffa7fc700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ffc0b3140 0x7f1ffc0aa780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f1ff000c000 tx=0x7f1ff000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:25.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1febfff700 1 -- 172.21.15.60:0/3750367559 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ff000e690 con 0x7f1ffc0b3140 2020-10-31T22:41:25.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1febfff700 1 -- 172.21.15.60:0/3750367559 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff000e7f0 con 0x7f1ffc0b3140 2020-10-31T22:41:25.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f20013c3700 1 -- 172.21.15.60:0/3750367559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ffc0a9ee0 con 0x7f1ffc0b3140 2020-10-31T22:41:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1febfff700 1 -- 172.21.15.60:0/3750367559 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ff000eb50 con 0x7f1ffc0b3140 2020-10-31T22:41:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f20013c3700 1 -- 172.21.15.60:0/3750367559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ffc0aa380 con 0x7f1ffc0b3140 2020-10-31T22:41:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f20013c3700 1 -- 172.21.15.60:0/3750367559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ffc0aa070 con 0x7f1ffc0b3140 2020-10-31T22:41:25.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.855+0000 7f1febfff700 1 -- 172.21.15.60:0/3750367559 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1ff000ecb0 con 0x7f1ffc0b3140 2020-10-31T22:41:25.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.859+0000 7f1febfff700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fd8055020 0x7f1fd80574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:25.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.859+0000 7f1ffaffd700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fd8055020 0x7f1fd80574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:25.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.859+0000 7f1febfff700 1 -- 172.21.15.60:0/3750367559 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1ff006df30 con 0x7f1ffc0b3140 2020-10-31T22:41:25.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.859+0000 7f1ffaffd700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fd8055020 0x7f1fd80574e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1fec005000 tx=0x7f1fec007740).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:25.867+0000 7f1febfff700 1 -- 172.21.15.60:0/3750367559 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1ff0044450 con 0x7f1ffc0b3140 2020-10-31T22:41:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:26.055+0000 7f20013c3700 1 -- 172.21.15.60:0/3750367559 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1ffc057100 con 0x7f1ffc0b3140 2020-10-31T22:41:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:26.055+0000 7f1febfff700 1 -- 172.21.15.60:0/3750367559 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2483 (secure 0 0 0) 0x7f1ff0047a70 con 0x7f1ffc0b3140 2020-10-31T22:41:26.059 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:26.060 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/909749940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":909749940},{"type":"v1","addr":"172.21.15.60:6837","nonce":909749940}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3142095774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3142095774},{"type":"v1","addr":"172.21.15.60:6835","nonce":3142095774}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:41:10.055893+0000","modified":"2020-10-31T22:41:11.058634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.66:6833/4161698670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4161698670},{"type":"v1","addr":"172.21.15.66:6833","nonce":4161698670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-10-31T22:41:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:26.059+0000 7f20013c3700 1 -- 172.21.15.60:0/3750367559 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fd8055020 msgr2=0x7f1fd80574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:26.059+0000 7f20013c3700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fd8055020 0x7f1fd80574e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f1fec005000 tx=0x7f1fec007740).stop 2020-10-31T22:41:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:26.059+0000 7f20013c3700 1 -- 172.21.15.60:0/3750367559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ffc0b3140 msgr2=0x7f1ffc0aa780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:26.059+0000 7f20013c3700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ffc0b3140 0x7f1ffc0aa780 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f1ff000c000 tx=0x7f1ff000b040).stop 2020-10-31T22:41:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:26.059+0000 7f20013c3700 1 -- 172.21.15.60:0/3750367559 shutdown_connections 2020-10-31T22:41:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:26.059+0000 7f20013c3700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ffc154f00 0x7f1ffc1553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:26.059+0000 7f20013c3700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fd8055020 0x7f1fd80574e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:26.059+0000 7f20013c3700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fe0004e40 0x7f1ffc0acfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:26.059+0000 7f20013c3700 1 --2- 172.21.15.60:0/3750367559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ffc0b3140 0x7f1ffc0aa780 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:26.059+0000 7f20013c3700 1 -- 172.21.15.60:0/3750367559 >> 172.21.15.60:0/3750367559 conn(0x7f1ffc06a260 msgr2=0x7f1ffc1480c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:26.059+0000 7f20013c3700 1 -- 172.21.15.60:0/3750367559 shutdown_connections 2020-10-31T22:41:26.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:26.059+0000 7f20013c3700 1 -- 172.21.15.60:0/3750367559 wait complete. 2020-10-31T22:41:26.063 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 5 2020-10-31T22:41:26.376 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:41:10.055893+0000', 'modified': '2020-10-31T22:41:11.058634+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4306}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4306': {'gid': 4306, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.66:6833/4161698670', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 4161698670}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 4161698670}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:41:26.377 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:41:26.377 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-10-31T22:41:26.509 INFO:teuthology.orchestra.run.smithi066.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":4306,"want_state":"up:active","state":"up:active","rank_uptime":16.439279625000001,"mdsmap_epoch":5,"osdmap_epoch":22,"osdmap_epoch_barrier":21,"uptime":19.964511912999999} 2020-10-31T22:41:26.510 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 4306, "mdsmap_epoch": 5, "osdmap_epoch": 22, "osdmap_epoch_barrier": 21, "rank_uptime": 16.439279625, "state": "up:active", "uptime": 19.964511913, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:41:26.510 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:41:26.510 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-10-31T22:41:26.511 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi085.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-10-31T22:41:26.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:26.511 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:41:26.519 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:41:26.577 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:41:26.578 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:41:26.634 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:41:26.635 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:41:26.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:26.636 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:41:26.684 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:41:26.685 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:41:26.729 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:41:26.745 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:41:26.745 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:41:26.800 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:41:26.801 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:41:26.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:26.802 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:41:26.807 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:2020-10-31T22:41:26.808+0000 7f5248eec0c0 -1 init, newargv = 0x55e23b68f520 newargc=9 2020-10-31T22:41:26.808 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[12927]: starting ceph client 2020-10-31T22:41:26.819 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[12927]: starting fuse 2020-10-31T22:41:27.914 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:41:27.932 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:41:27.932 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:41:27.990 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:41:27.992 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:41:27.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:27.993 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:41:28.041 INFO:teuthology.orchestra.run.smithi085.stdout:50 2020-10-31T22:41:28.041 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-10-31T22:41:28.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:28.042 INFO:teuthology.orchestra.run.smithi085:> sudo python3 -c ' 2020-10-31T22:41:28.043 INFO:teuthology.orchestra.run.smithi085:> import glob 2020-10-31T22:41:28.043 INFO:teuthology.orchestra.run.smithi085:> import re 2020-10-31T22:41:28.044 INFO:teuthology.orchestra.run.smithi085:> import os 2020-10-31T22:41:28.044 INFO:teuthology.orchestra.run.smithi085:> import subprocess 2020-10-31T22:41:28.045 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:41:28.045 INFO:teuthology.orchestra.run.smithi085:> def find_socket(client_name): 2020-10-31T22:41:28.045 INFO:teuthology.orchestra.run.smithi085:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-10-31T22:41:28.046 INFO:teuthology.orchestra.run.smithi085:> files = glob.glob(asok_path) 2020-10-31T22:41:28.046 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:41:28.047 INFO:teuthology.orchestra.run.smithi085:> # Given a non-glob path, it better be there 2020-10-31T22:41:28.047 INFO:teuthology.orchestra.run.smithi085:> if "*" not in asok_path: 2020-10-31T22:41:28.048 INFO:teuthology.orchestra.run.smithi085:> assert(len(files) == 1) 2020-10-31T22:41:28.048 INFO:teuthology.orchestra.run.smithi085:> return files[0] 2020-10-31T22:41:28.049 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:41:28.049 INFO:teuthology.orchestra.run.smithi085:> for f in files: 2020-10-31T22:41:28.049 INFO:teuthology.orchestra.run.smithi085:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:41:28.050 INFO:teuthology.orchestra.run.smithi085:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:41:28.050 INFO:teuthology.orchestra.run.smithi085:> return f 2020-10-31T22:41:28.051 INFO:teuthology.orchestra.run.smithi085:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:41:28.054 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:41:28.054 INFO:teuthology.orchestra.run.smithi085:> print(find_socket("client.1")) 2020-10-31T22:41:28.055 INFO:teuthology.orchestra.run.smithi085:> ' 2020-10-31T22:41:28.128 INFO:teuthology.orchestra.run.smithi085.stdout:/var/run/ceph/ceph-client.1.12927.asok 2020-10-31T22:41:28.133 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.12927.asok 2020-10-31T22:41:28.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:28.134 INFO:teuthology.orchestra.run.smithi085:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.12927.asok status 2020-10-31T22:41:28.319 INFO:teuthology.orchestra.run.smithi085.stdout:{ 2020-10-31T22:41:28.320 INFO:teuthology.orchestra.run.smithi085.stdout: "metadata": { 2020-10-31T22:41:28.320 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:41:28.320 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:41:28.320 INFO:teuthology.orchestra.run.smithi085.stdout: "entity_id": "1", 2020-10-31T22:41:28.320 INFO:teuthology.orchestra.run.smithi085.stdout: "hostname": "smithi085", 2020-10-31T22:41:28.321 INFO:teuthology.orchestra.run.smithi085.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-10-31T22:41:28.321 INFO:teuthology.orchestra.run.smithi085.stdout: "pid": "12927", 2020-10-31T22:41:28.321 INFO:teuthology.orchestra.run.smithi085.stdout: "root": "/" 2020-10-31T22:41:28.321 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:41:28.321 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_count": 0, 2020-10-31T22:41:28.321 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_pinned_count": 0, 2020-10-31T22:41:28.321 INFO:teuthology.orchestra.run.smithi085.stdout: "id": 4657, 2020-10-31T22:41:28.322 INFO:teuthology.orchestra.run.smithi085.stdout: "inst": { 2020-10-31T22:41:28.322 INFO:teuthology.orchestra.run.smithi085.stdout: "name": { 2020-10-31T22:41:28.322 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "client", 2020-10-31T22:41:28.322 INFO:teuthology.orchestra.run.smithi085.stdout: "num": 4657 2020-10-31T22:41:28.322 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:41:28.322 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:41:28.322 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:41:28.323 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:41:28.323 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 2473731409 2020-10-31T22:41:28.323 INFO:teuthology.orchestra.run.smithi085.stdout: } 2020-10-31T22:41:28.323 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:41:28.323 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:41:28.323 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:41:28.323 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:41:28.324 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 2473731409 2020-10-31T22:41:28.324 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:41:28.324 INFO:teuthology.orchestra.run.smithi085.stdout: "inst_str": "client.4657 172.21.15.85:0/2473731409", 2020-10-31T22:41:28.324 INFO:teuthology.orchestra.run.smithi085.stdout: "addr_str": "172.21.15.85:0/2473731409", 2020-10-31T22:41:28.324 INFO:teuthology.orchestra.run.smithi085.stdout: "inode_count": 1, 2020-10-31T22:41:28.324 INFO:teuthology.orchestra.run.smithi085.stdout: "mds_epoch": 5, 2020-10-31T22:41:28.324 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch": 22, 2020-10-31T22:41:28.325 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:41:28.325 INFO:teuthology.orchestra.run.smithi085.stdout: "blacklisted": false 2020-10-31T22:41:28.325 INFO:teuthology.orchestra.run.smithi085.stdout:} 2020-10-31T22:41:28.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:28.331 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:41:28.331 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:28.339 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:41:28.340 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:41:28.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:28.341 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:28.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:28.403 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:41:28.403 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:41:28.411 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:41:28.412 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:41:28.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:28.413 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:41:28.479 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2020-10-31T22:41:28.500 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:28.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91bef01700 1 Processor -- start 2020-10-31T22:41:28.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91bef01700 1 -- start start 2020-10-31T22:41:28.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91bef01700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f91b805c4c0 0x7f91b805c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:28.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91bef01700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f91b80b4410 0x7f91b8146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:28.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91bef01700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91b8065e90 con 0x7f91b80b2e20 2020-10-31T22:41:28.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91bef01700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b8141ef0 con 0x7f91b80b4410 2020-10-31T22:41:28.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91bef01700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91b8066130 con 0x7f91b805c4c0 2020-10-31T22:41:28.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91bd49e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f91b80b4410 0x7f91b8146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:28.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91b7fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f91b80b2e20 0x7f91b813f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46072/0 (socket says 172.21.15.60:46072) 2020-10-31T22:41:28.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91b7fff700 1 -- 172.21.15.60:0/1299546744 learned_addr learned my addr 172.21.15.60:0/1299546744 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:28.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91bcc9d700 1 --2- 172.21.15.60:0/1299546744 >> v2:172.21.15.66:3300/0 conn(0x7f91b805c4c0 0x7f91b805c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:28.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91bd49e700 1 -- 172.21.15.60:0/1299546744 >> v2:172.21.15.66:3300/0 conn(0x7f91b805c4c0 msgr2=0x7f91b805c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:28.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91bd49e700 1 --2- 172.21.15.60:0/1299546744 >> v2:172.21.15.66:3300/0 conn(0x7f91b805c4c0 0x7f91b805c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:28.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91bd49e700 1 -- 172.21.15.60:0/1299546744 >> v1:172.21.15.60:6789/0 conn(0x7f91b80b2e20 legacy=0x7f91b813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:28.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91bd49e700 1 -- 172.21.15.60:0/1299546744 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80663d0 con 0x7f91b80b4410 2020-10-31T22:41:28.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.619+0000 7f91b77fe700 1 -- 172.21.15.60:0/1299546744 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758053574 0 0) 0x7f91b8065e90 con 0x7f91b80b2e20 2020-10-31T22:41:28.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.623+0000 7f91bd49e700 1 --2- 172.21.15.60:0/1299546744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80b4410 0x7f91b8146020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f91b0002f30 tx=0x7f91b0006dc0).ready entity=mon.0 client_cookie=ee9eaf99adbe15c5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:28.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.623+0000 7f91b77fe700 1 -- 172.21.15.60:0/1299546744 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91b00097b0 con 0x7f91b80b4410 2020-10-31T22:41:28.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.623+0000 7f91b77fe700 1 -- 172.21.15.60:0/1299546744 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b0009910 con 0x7f91b80b4410 2020-10-31T22:41:28.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.623+0000 7f91b77fe700 1 -- 172.21.15.60:0/1299546744 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91b0009c70 con 0x7f91b80b4410 2020-10-31T22:41:28.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.623+0000 7f91bef01700 1 -- 172.21.15.60:0/1299546744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80b4410 msgr2=0x7f91b8146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:28.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.623+0000 7f91bef01700 1 --2- 172.21.15.60:0/1299546744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80b4410 0x7f91b8146020 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f91b0002f30 tx=0x7f91b0006dc0).stop 2020-10-31T22:41:28.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.623+0000 7f91bef01700 1 -- 172.21.15.60:0/1299546744 shutdown_connections 2020-10-31T22:41:28.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.623+0000 7f91bef01700 1 --2- 172.21.15.60:0/1299546744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80b4410 0x7f91b8146020 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:28.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.623+0000 7f91bef01700 1 --2- 172.21.15.60:0/1299546744 >> v2:172.21.15.66:3300/0 conn(0x7f91b805c4c0 0x7f91b805c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:28.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.623+0000 7f91bef01700 1 -- 172.21.15.60:0/1299546744 >> 172.21.15.60:0/1299546744 conn(0x7f91b80601e0 msgr2=0x7f91b805b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:28.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.623+0000 7f91bef01700 1 -- 172.21.15.60:0/1299546744 shutdown_connections 2020-10-31T22:41:28.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.623+0000 7f91bef01700 1 -- 172.21.15.60:0/1299546744 wait complete. 2020-10-31T22:41:28.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bef01700 1 Processor -- start 2020-10-31T22:41:28.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bef01700 1 -- start start 2020-10-31T22:41:28.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bef01700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91b805c4c0 0x7f91b8145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:28.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bef01700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91b80b4410 0x7f91b80add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:28.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bef01700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80ae270 0x7f91b8150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:28.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bef01700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80aea60 con 0x7f91b80ae270 2020-10-31T22:41:28.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bef01700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80ae700 con 0x7f91b805c4c0 2020-10-31T22:41:28.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bef01700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b80aecb0 con 0x7f91b80b4410 2020-10-31T22:41:28.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bd49e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80ae270 0x7f91b8150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:28.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bd49e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80ae270 0x7f91b8150ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41944/0 (socket says 172.21.15.60:41944) 2020-10-31T22:41:28.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bd49e700 1 -- 172.21.15.60:0/3021892747 learned_addr learned my addr 172.21.15.60:0/3021892747 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:28.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91b7fff700 1 --2- 172.21.15.60:0/3021892747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91b80b4410 0x7f91b80add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:28.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bcc9d700 1 --2- 172.21.15.60:0/3021892747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91b805c4c0 0x7f91b8145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:28.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bd49e700 1 -- 172.21.15.60:0/3021892747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91b80b4410 msgr2=0x7f91b80add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:28.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bd49e700 1 --2- 172.21.15.60:0/3021892747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91b80b4410 0x7f91b80add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:28.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bd49e700 1 -- 172.21.15.60:0/3021892747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91b805c4c0 msgr2=0x7f91b8145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:28.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bd49e700 1 --2- 172.21.15.60:0/3021892747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91b805c4c0 0x7f91b8145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:28.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bd49e700 1 -- 172.21.15.60:0/3021892747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b80aef50 con 0x7f91b80ae270 2020-10-31T22:41:28.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bd49e700 1 --2- 172.21.15.60:0/3021892747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80ae270 0x7f91b8150ce0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f91b0002f30 tx=0x7f91b0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:28.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91b5ffb700 1 -- 172.21.15.60:0/3021892747 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91b0011ad0 con 0x7f91b80ae270 2020-10-31T22:41:28.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91b5ffb700 1 -- 172.21.15.60:0/3021892747 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91b0011c30 con 0x7f91b80ae270 2020-10-31T22:41:28.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91b5ffb700 1 -- 172.21.15.60:0/3021892747 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91b001d440 con 0x7f91b80ae270 2020-10-31T22:41:28.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.627+0000 7f91bef01700 1 -- 172.21.15.60:0/3021892747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b80aaae0 con 0x7f91b80ae270 2020-10-31T22:41:28.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.631+0000 7f91bef01700 1 -- 172.21.15.60:0/3021892747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b80af610 con 0x7f91b80ae270 2020-10-31T22:41:28.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.631+0000 7f91bef01700 1 -- 172.21.15.60:0/3021892747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b80af0e0 con 0x7f91b80ae270 2020-10-31T22:41:28.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.631+0000 7f91b5ffb700 1 -- 172.21.15.60:0/3021892747 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f91b0017070 con 0x7f91b80ae270 2020-10-31T22:41:28.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.631+0000 7f91b5ffb700 1 --2- 172.21.15.60:0/3021892747 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f919c054f10 0x7f919c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:28.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.631+0000 7f91b5ffb700 1 -- 172.21.15.60:0/3021892747 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f91b006e590 con 0x7f91b80ae270 2020-10-31T22:41:28.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.631+0000 7f91bcc9d700 1 --2- 172.21.15.60:0/3021892747 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f919c054f10 0x7f919c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:28.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.635+0000 7f91bcc9d700 1 --2- 172.21.15.60:0/3021892747 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f919c054f10 0x7f919c0573d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f91a800b000 tx=0x7f91a8006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:28.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.639+0000 7f91b5ffb700 1 -- 172.21.15.60:0/3021892747 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f91b0044ab0 con 0x7f91b80ae270 2020-10-31T22:41:28.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.787+0000 7f91bef01700 1 -- 172.21.15.60:0/3021892747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91b8057100 con 0x7f91b80ae270 2020-10-31T22:41:28.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.791+0000 7f91b5ffb700 1 -- 172.21.15.60:0/3021892747 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f91b0022090 con 0x7f91b80ae270 2020-10-31T22:41:28.793 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:28.793 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:11.059362+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:07.982891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:08.927092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:28.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.791+0000 7f91bef01700 1 -- 172.21.15.60:0/3021892747 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f919c054f10 msgr2=0x7f919c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:28.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.791+0000 7f91bef01700 1 --2- 172.21.15.60:0/3021892747 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f919c054f10 0x7f919c0573d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f91a800b000 tx=0x7f91a8006dc0).stop 2020-10-31T22:41:28.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.791+0000 7f91bef01700 1 -- 172.21.15.60:0/3021892747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80ae270 msgr2=0x7f91b8150ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:28.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.791+0000 7f91bef01700 1 --2- 172.21.15.60:0/3021892747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80ae270 0x7f91b8150ce0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f91b0002f30 tx=0x7f91b0015000).stop 2020-10-31T22:41:28.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.791+0000 7f91bef01700 1 -- 172.21.15.60:0/3021892747 shutdown_connections 2020-10-31T22:41:28.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.791+0000 7f91bef01700 1 --2- 172.21.15.60:0/3021892747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f91b80ae270 0x7f91b8150ce0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:28.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.791+0000 7f91bef01700 1 --2- 172.21.15.60:0/3021892747 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f919c054f10 0x7f919c0573d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:28.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.791+0000 7f91bef01700 1 --2- 172.21.15.60:0/3021892747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91b805c4c0 0x7f91b8145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:28.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.791+0000 7f91bef01700 1 --2- 172.21.15.60:0/3021892747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91b80b4410 0x7f91b80add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:28.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.791+0000 7f91bef01700 1 -- 172.21.15.60:0/3021892747 >> 172.21.15.60:0/3021892747 conn(0x7f91b80601e0 msgr2=0x7f91b8140950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:28.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.791+0000 7f91bef01700 1 -- 172.21.15.60:0/3021892747 shutdown_connections 2020-10-31T22:41:28.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.791+0000 7f91bef01700 1 -- 172.21.15.60:0/3021892747 wait complete. 2020-10-31T22:41:28.810 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:41:07.982891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:41:08.927092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:41:28.811 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:41:28.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f0691b8c700 1 Processor -- start 2020-10-31T22:41:28.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f0691b8c700 1 -- start start 2020-10-31T22:41:28.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f0691b8c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f068c0b38b0 0x7f068c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:28.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f0691b8c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f068c0b2580 0x7f068c150c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:28.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f0691b8c700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068c0b47d0 con 0x7f068c05c660 2020-10-31T22:41:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f0691b8c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f068c0a8bd0 con 0x7f068c0b2580 2020-10-31T22:41:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f0691b8c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f068c147120 con 0x7f068c0b38b0 2020-10-31T22:41:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f068bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f068c0b2580 0x7f068c150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f068bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f068c0b2580 0x7f068c150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41952/0 (socket says 172.21.15.60:41952) 2020-10-31T22:41:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f068bfff700 1 -- 172.21.15.60:0/857348020 learned_addr learned my addr 172.21.15.60:0/857348020 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:28.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f068affd700 1 --2- 172.21.15.60:0/857348020 >> v2:172.21.15.66:3300/0 conn(0x7f068c0b38b0 0x7f068c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:28.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f068bfff700 1 -- 172.21.15.60:0/857348020 >> v2:172.21.15.66:3300/0 conn(0x7f068c0b38b0 msgr2=0x7f068c0b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:28.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f068bfff700 1 --2- 172.21.15.60:0/857348020 >> v2:172.21.15.66:3300/0 conn(0x7f068c0b38b0 0x7f068c0b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f068bfff700 1 -- 172.21.15.60:0/857348020 >> v1:172.21.15.66:6789/0 conn(0x7f068c05c660 legacy=0x7f068c0a66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.927+0000 7f068bfff700 1 -- 172.21.15.60:0/857348020 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c0a6db0 con 0x7f068c0b2580 2020-10-31T22:41:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.931+0000 7f068bfff700 1 --2- 172.21.15.60:0/857348020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c0b2580 0x7f068c150c90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f06840032b0 tx=0x7f0684009270).ready entity=mon.0 client_cookie=881bc0fb0bc890b6 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:28.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.931+0000 7f068a7fc700 1 -- 172.21.15.60:0/857348020 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f068400bc90 con 0x7f068c0b2580 2020-10-31T22:41:28.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.931+0000 7f068a7fc700 1 -- 172.21.15.60:0/857348020 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068400bdf0 con 0x7f068c0b2580 2020-10-31T22:41:28.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.931+0000 7f068a7fc700 1 -- 172.21.15.60:0/857348020 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0684011400 con 0x7f068c0b2580 2020-10-31T22:41:28.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.931+0000 7f0691b8c700 1 -- 172.21.15.60:0/857348020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c0b2580 msgr2=0x7f068c150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:28.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.931+0000 7f0691b8c700 1 --2- 172.21.15.60:0/857348020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c0b2580 0x7f068c150c90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f06840032b0 tx=0x7f0684009270).stop 2020-10-31T22:41:28.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.931+0000 7f0691b8c700 1 -- 172.21.15.60:0/857348020 shutdown_connections 2020-10-31T22:41:28.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.931+0000 7f0691b8c700 1 --2- 172.21.15.60:0/857348020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c0b2580 0x7f068c150c90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:28.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.931+0000 7f0691b8c700 1 --2- 172.21.15.60:0/857348020 >> v2:172.21.15.66:3300/0 conn(0x7f068c0b38b0 0x7f068c0b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:28.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.931+0000 7f0691b8c700 1 -- 172.21.15.60:0/857348020 >> 172.21.15.60:0/857348020 conn(0x7f068c0601e0 msgr2=0x7f068c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:28.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.931+0000 7f0691b8c700 1 -- 172.21.15.60:0/857348020 shutdown_connections 2020-10-31T22:41:28.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.931+0000 7f0691b8c700 1 -- 172.21.15.60:0/857348020 wait complete. 2020-10-31T22:41:28.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.931+0000 7f0691b8c700 1 Processor -- start 2020-10-31T22:41:28.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.931+0000 7f0691b8c700 1 -- start start 2020-10-31T22:41:28.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f0691b8c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c05c660 0x7f068c14bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:28.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f0691b8c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c0b2580 0x7f068c0aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:28.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f0691b8c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c0b38b0 0x7f068c1554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:28.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f0691b8c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c0aba90 con 0x7f068c0b38b0 2020-10-31T22:41:28.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f0691b8c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c14d6c0 con 0x7f068c0b2580 2020-10-31T22:41:28.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f0691b8c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068c154fb0 con 0x7f068c05c660 2020-10-31T22:41:28.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f068bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c0b38b0 0x7f068c1554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:28.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f068bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c0b38b0 0x7f068c1554d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41956/0 (socket says 172.21.15.60:41956) 2020-10-31T22:41:28.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f068bfff700 1 -- 172.21.15.60:0/278675666 learned_addr learned my addr 172.21.15.60:0/278675666 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:28.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f068affd700 1 --2- 172.21.15.60:0/278675666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c0b2580 0x7f068c0aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:28.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f068b7fe700 1 --2- 172.21.15.60:0/278675666 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c05c660 0x7f068c14bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:28.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f068bfff700 1 -- 172.21.15.60:0/278675666 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c05c660 msgr2=0x7f068c14bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:28.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f068bfff700 1 --2- 172.21.15.60:0/278675666 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c05c660 0x7f068c14bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f068bfff700 1 -- 172.21.15.60:0/278675666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c0b2580 msgr2=0x7f068c0aa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f068bfff700 1 --2- 172.21.15.60:0/278675666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c0b2580 0x7f068c0aa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f068bfff700 1 -- 172.21.15.60:0/278675666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c0adef0 con 0x7f068c0b38b0 2020-10-31T22:41:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f068bfff700 1 --2- 172.21.15.60:0/278675666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c0b38b0 0x7f068c1554d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f06840032b0 tx=0x7f0684016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f0688ff9700 1 -- 172.21.15.60:0/278675666 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06840107a0 con 0x7f068c0b38b0 2020-10-31T22:41:28.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f0688ff9700 1 -- 172.21.15.60:0/278675666 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0684010900 con 0x7f068c0b38b0 2020-10-31T22:41:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f0691b8c700 1 -- 172.21.15.60:0/278675666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068c0abf30 con 0x7f068c0b38b0 2020-10-31T22:41:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f0688ff9700 1 -- 172.21.15.60:0/278675666 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0684010c60 con 0x7f068c0b38b0 2020-10-31T22:41:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f0691b8c700 1 -- 172.21.15.60:0/278675666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068c0aafc0 con 0x7f068c0b38b0 2020-10-31T22:41:28.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f0691b8c700 1 -- 172.21.15.60:0/278675666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068c0ab8f0 con 0x7f068c0b38b0 2020-10-31T22:41:28.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.935+0000 7f0688ff9700 1 -- 172.21.15.60:0/278675666 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f068400f070 con 0x7f068c0b38b0 2020-10-31T22:41:28.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.939+0000 7f0688ff9700 1 --2- 172.21.15.60:0/278675666 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f066c055020 0x7f066c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:28.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.939+0000 7f0688ff9700 1 -- 172.21.15.60:0/278675666 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f068406f150 con 0x7f068c0b38b0 2020-10-31T22:41:28.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.939+0000 7f068b7fe700 1 --2- 172.21.15.60:0/278675666 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f066c055020 0x7f066c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:28.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.939+0000 7f068b7fe700 1 --2- 172.21.15.60:0/278675666 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f066c055020 0x7f066c0574e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f067c00b000 tx=0x7f067c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:28.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:28.943+0000 7f0688ff9700 1 -- 172.21.15.60:0/278675666 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f068c0ab8f0 con 0x7f068c0b38b0 2020-10-31T22:41:29.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.087+0000 7f0691b8c700 1 -- 172.21.15.60:0/278675666 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f068c0ae0e0 con 0x7f068c0b38b0 2020-10-31T22:41:29.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.087+0000 7f0688ff9700 1 -- 172.21.15.60:0/278675666 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f068c0ae0e0 con 0x7f068c0b38b0 2020-10-31T22:41:29.092 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:41:29.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.091+0000 7f0691b8c700 1 -- 172.21.15.60:0/278675666 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f066c055020 msgr2=0x7f066c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.091+0000 7f0691b8c700 1 --2- 172.21.15.60:0/278675666 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f066c055020 0x7f066c0574e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f067c00b000 tx=0x7f067c009040).stop 2020-10-31T22:41:29.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.091+0000 7f0691b8c700 1 -- 172.21.15.60:0/278675666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c0b38b0 msgr2=0x7f068c1554d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.091+0000 7f0691b8c700 1 --2- 172.21.15.60:0/278675666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c0b38b0 0x7f068c1554d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f06840032b0 tx=0x7f0684016000).stop 2020-10-31T22:41:29.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.091+0000 7f0691b8c700 1 -- 172.21.15.60:0/278675666 shutdown_connections 2020-10-31T22:41:29.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.091+0000 7f0691b8c700 1 --2- 172.21.15.60:0/278675666 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c0b38b0 0x7f068c1554d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.091+0000 7f0691b8c700 1 --2- 172.21.15.60:0/278675666 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c05c660 0x7f068c14bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.091+0000 7f0691b8c700 1 --2- 172.21.15.60:0/278675666 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f066c055020 0x7f066c0574e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.091+0000 7f0691b8c700 1 --2- 172.21.15.60:0/278675666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c0b2580 0x7f068c0aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.091+0000 7f0691b8c700 1 -- 172.21.15.60:0/278675666 >> 172.21.15.60:0/278675666 conn(0x7f068c0601e0 msgr2=0x7f068c0a66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:29.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.091+0000 7f0691b8c700 1 -- 172.21.15.60:0/278675666 shutdown_connections 2020-10-31T22:41:29.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.091+0000 7f0691b8c700 1 -- 172.21.15.60:0/278675666 wait complete. 2020-10-31T22:41:29.106 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:41:29.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5052246700 1 Processor -- start 2020-10-31T22:41:29.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5052246700 1 -- start start 2020-10-31T22:41:29.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5052246700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f504c0af520 0x7f504c0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5052246700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f504c066c90 0x7f504c0670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5052246700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504c0af900 con 0x7f504c146060 2020-10-31T22:41:29.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5052246700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504c0afc10 con 0x7f504c0af520 2020-10-31T22:41:29.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5052246700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c05bb70 con 0x7f504c066c90 2020-10-31T22:41:29.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5051244700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f504c0af520 0x7f504c0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5050a43700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f504c066c90 0x7f504c0670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5051244700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f504c0af520 0x7f504c0ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41962/0 (socket says 172.21.15.60:41962) 2020-10-31T22:41:29.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5051244700 1 -- 172.21.15.60:0/2463107070 learned_addr learned my addr 172.21.15.60:0/2463107070 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:29.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5051244700 1 -- 172.21.15.60:0/2463107070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f504c066c90 msgr2=0x7f504c0670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:29.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5051244700 1 --2- 172.21.15.60:0/2463107070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f504c066c90 0x7f504c0670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5043fff700 1 -- 172.21.15.60:0/2463107070 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158045147 0 0) 0x7f504c0af900 con 0x7f504c146060 2020-10-31T22:41:29.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5051244700 1 -- 172.21.15.60:0/2463107070 >> v1:172.21.15.66:6789/0 conn(0x7f504c146060 legacy=0x7f504c149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5051244700 1 -- 172.21.15.60:0/2463107070 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c0ac130 con 0x7f504c0af520 2020-10-31T22:41:29.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5051244700 1 --2- 172.21.15.60:0/2463107070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c0af520 0x7f504c0ac870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f503c002f30 tx=0x7f503c006e20).ready entity=mon.0 client_cookie=594b2701c4b0aec5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:29.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5043fff700 1 -- 172.21.15.60:0/2463107070 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f503c0097f0 con 0x7f504c0af520 2020-10-31T22:41:29.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5043fff700 1 -- 172.21.15.60:0/2463107070 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c009950 con 0x7f504c0af520 2020-10-31T22:41:29.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5052246700 1 -- 172.21.15.60:0/2463107070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c0af520 msgr2=0x7f504c0ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5043fff700 1 -- 172.21.15.60:0/2463107070 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f503c009cb0 con 0x7f504c0af520 2020-10-31T22:41:29.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.219+0000 7f5052246700 1 --2- 172.21.15.60:0/2463107070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c0af520 0x7f504c0ac870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f503c002f30 tx=0x7f503c006e20).stop 2020-10-31T22:41:29.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5052246700 1 -- 172.21.15.60:0/2463107070 shutdown_connections 2020-10-31T22:41:29.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5052246700 1 --2- 172.21.15.60:0/2463107070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c0af520 0x7f504c0ac870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5052246700 1 --2- 172.21.15.60:0/2463107070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f504c066c90 0x7f504c0670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5052246700 1 -- 172.21.15.60:0/2463107070 >> 172.21.15.60:0/2463107070 conn(0x7f504c0b3fd0 msgr2=0x7f504c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:29.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5052246700 1 -- 172.21.15.60:0/2463107070 shutdown_connections 2020-10-31T22:41:29.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5052246700 1 -- 172.21.15.60:0/2463107070 wait complete. 2020-10-31T22:41:29.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5052246700 1 Processor -- start 2020-10-31T22:41:29.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5052246700 1 -- start start 2020-10-31T22:41:29.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5052246700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c066c90 0x7f504c14a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5052246700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f504c0af520 0x7f504c147a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5052246700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f504c146060 0x7f504c14d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5052246700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c149e90 con 0x7f504c066c90 2020-10-31T22:41:29.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5052246700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504c1425b0 con 0x7f504c0af520 2020-10-31T22:41:29.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5052246700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504c149240 con 0x7f504c146060 2020-10-31T22:41:29.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5051244700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c066c90 0x7f504c14a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5051244700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c066c90 0x7f504c14a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41968/0 (socket says 172.21.15.60:41968) 2020-10-31T22:41:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5051244700 1 -- 172.21.15.60:0/4163921426 learned_addr learned my addr 172.21.15.60:0/4163921426 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5050a43700 1 --2- 172.21.15.60:0/4163921426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f504c0af520 0x7f504c147a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5051a45700 1 --2- 172.21.15.60:0/4163921426 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f504c146060 0x7f504c14d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5051244700 1 -- 172.21.15.60:0/4163921426 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f504c146060 msgr2=0x7f504c14d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5051244700 1 --2- 172.21.15.60:0/4163921426 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f504c146060 0x7f504c14d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5051244700 1 -- 172.21.15.60:0/4163921426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f504c0af520 msgr2=0x7f504c147a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5051244700 1 --2- 172.21.15.60:0/4163921426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f504c0af520 0x7f504c147a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5051244700 1 -- 172.21.15.60:0/4163921426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504c155ca0 con 0x7f504c066c90 2020-10-31T22:41:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.223+0000 7f5051244700 1 --2- 172.21.15.60:0/4163921426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c066c90 0x7f504c14a030 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f503c002f30 tx=0x7f503c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.227+0000 7f50427fc700 1 -- 172.21.15.60:0/4163921426 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f503c011b60 con 0x7f504c066c90 2020-10-31T22:41:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.227+0000 7f50427fc700 1 -- 172.21.15.60:0/4163921426 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c011cc0 con 0x7f504c066c90 2020-10-31T22:41:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.227+0000 7f5052246700 1 -- 172.21.15.60:0/4163921426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504c155fa0 con 0x7f504c066c90 2020-10-31T22:41:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.227+0000 7f50427fc700 1 -- 172.21.15.60:0/4163921426 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f503c006220 con 0x7f504c066c90 2020-10-31T22:41:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.227+0000 7f5052246700 1 -- 172.21.15.60:0/4163921426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504c0aa860 con 0x7f504c066c90 2020-10-31T22:41:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.227+0000 7f5052246700 1 -- 172.21.15.60:0/4163921426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504c057100 con 0x7f504c066c90 2020-10-31T22:41:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.227+0000 7f50427fc700 1 -- 172.21.15.60:0/4163921426 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f503c024030 con 0x7f504c066c90 2020-10-31T22:41:29.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.227+0000 7f50427fc700 1 --2- 172.21.15.60:0/4163921426 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5034055020 0x7f50340574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.227+0000 7f50427fc700 1 -- 172.21.15.60:0/4163921426 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f503c06e890 con 0x7f504c066c90 2020-10-31T22:41:29.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.227+0000 7f5050a43700 1 --2- 172.21.15.60:0/4163921426 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5034055020 0x7f50340574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.231+0000 7f5050a43700 1 --2- 172.21.15.60:0/4163921426 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5034055020 0x7f50340574e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f504800b000 tx=0x7f50480091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:29.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.239+0000 7f50427fc700 1 -- 172.21.15.60:0/4163921426 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f503c044df0 con 0x7f504c066c90 2020-10-31T22:41:29.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.383+0000 7f5052246700 1 -- 172.21.15.60:0/4163921426 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f504c0ab730 con 0x7f504c066c90 2020-10-31T22:41:29.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.383+0000 7f50427fc700 1 -- 172.21.15.60:0/4163921426 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f503c022020 con 0x7f504c066c90 2020-10-31T22:41:29.387 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.387+0000 7f5052246700 1 -- 172.21.15.60:0/4163921426 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5034055020 msgr2=0x7f50340574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.387+0000 7f5052246700 1 --2- 172.21.15.60:0/4163921426 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5034055020 0x7f50340574e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f504800b000 tx=0x7f50480091a0).stop 2020-10-31T22:41:29.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.387+0000 7f5052246700 1 -- 172.21.15.60:0/4163921426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c066c90 msgr2=0x7f504c14a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.387+0000 7f5052246700 1 --2- 172.21.15.60:0/4163921426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c066c90 0x7f504c14a030 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f503c002f30 tx=0x7f503c015000).stop 2020-10-31T22:41:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.387+0000 7f5052246700 1 -- 172.21.15.60:0/4163921426 shutdown_connections 2020-10-31T22:41:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.387+0000 7f5052246700 1 --2- 172.21.15.60:0/4163921426 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f504c146060 0x7f504c14d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.387+0000 7f5052246700 1 --2- 172.21.15.60:0/4163921426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f504c066c90 0x7f504c14a030 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.387+0000 7f5052246700 1 --2- 172.21.15.60:0/4163921426 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5034055020 0x7f50340574e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.387+0000 7f5052246700 1 --2- 172.21.15.60:0/4163921426 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f504c0af520 0x7f504c147a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.387+0000 7f5052246700 1 -- 172.21.15.60:0/4163921426 >> 172.21.15.60:0/4163921426 conn(0x7f504c0b3fd0 msgr2=0x7f504c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.387+0000 7f5052246700 1 -- 172.21.15.60:0/4163921426 shutdown_connections 2020-10-31T22:41:29.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.387+0000 7f5052246700 1 -- 172.21.15.60:0/4163921426 wait complete. 2020-10-31T22:41:29.400 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:41:29.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.515+0000 7f7616048700 1 Processor -- start 2020-10-31T22:41:29.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.515+0000 7f7616048700 1 -- start start 2020-10-31T22:41:29.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.515+0000 7f7616048700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f761005c660 0x7f76100b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.515+0000 7f7616048700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76100b2e20 0x7f7610142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.515+0000 7f7616048700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7610066410 con 0x7f7610065f70 2020-10-31T22:41:29.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.515+0000 7f7616048700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7610066d60 con 0x7f761005c660 2020-10-31T22:41:29.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.515+0000 7f7616048700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76100b5e80 con 0x7f76100b2e20 2020-10-31T22:41:29.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f760f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f761005c660 0x7f76100b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f760f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f761005c660 0x7f76100b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41974/0 (socket says 172.21.15.60:41974) 2020-10-31T22:41:29.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f760f7fe700 1 -- 172.21.15.60:0/3178969544 learned_addr learned my addr 172.21.15.60:0/3178969544 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:29.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f760ffff700 1 --2- 172.21.15.60:0/3178969544 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76100b2e20 0x7f7610142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f760e7fc700 1 -- 172.21.15.60:0/3178969544 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 92929017 0 0) 0x7f7610066410 con 0x7f7610065f70 2020-10-31T22:41:29.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f760f7fe700 1 -- 172.21.15.60:0/3178969544 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76100b2e20 msgr2=0x7f7610142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:29.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f760f7fe700 1 --2- 172.21.15.60:0/3178969544 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76100b2e20 0x7f7610142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f760f7fe700 1 -- 172.21.15.60:0/3178969544 >> v1:172.21.15.66:6789/0 conn(0x7f7610065f70 legacy=0x7f761013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f760f7fe700 1 -- 172.21.15.60:0/3178969544 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76100666b0 con 0x7f761005c660 2020-10-31T22:41:29.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f760f7fe700 1 --2- 172.21.15.60:0/3178969544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f761005c660 0x7f76100b5990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f75f8002f30 tx=0x7f75f8006e80).ready entity=mon.0 client_cookie=d82f486bafbda176 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:29.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f760e7fc700 1 -- 172.21.15.60:0/3178969544 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75f80097f0 con 0x7f761005c660 2020-10-31T22:41:29.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f760e7fc700 1 -- 172.21.15.60:0/3178969544 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f8009950 con 0x7f761005c660 2020-10-31T22:41:29.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f760e7fc700 1 -- 172.21.15.60:0/3178969544 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75f8009cb0 con 0x7f761005c660 2020-10-31T22:41:29.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f7616048700 1 -- 172.21.15.60:0/3178969544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f761005c660 msgr2=0x7f76100b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f7616048700 1 --2- 172.21.15.60:0/3178969544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f761005c660 0x7f76100b5990 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f75f8002f30 tx=0x7f75f8006e80).stop 2020-10-31T22:41:29.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f7616048700 1 -- 172.21.15.60:0/3178969544 shutdown_connections 2020-10-31T22:41:29.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f7616048700 1 --2- 172.21.15.60:0/3178969544 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76100b2e20 0x7f7610142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f7616048700 1 --2- 172.21.15.60:0/3178969544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f761005c660 0x7f76100b5990 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f7616048700 1 -- 172.21.15.60:0/3178969544 >> 172.21.15.60:0/3178969544 conn(0x7f76100601e0 msgr2=0x7f761005b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:29.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f7616048700 1 -- 172.21.15.60:0/3178969544 shutdown_connections 2020-10-31T22:41:29.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.519+0000 7f7616048700 1 -- 172.21.15.60:0/3178969544 wait complete. 2020-10-31T22:41:29.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f7616048700 1 Processor -- start 2020-10-31T22:41:29.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f7616048700 1 -- start start 2020-10-31T22:41:29.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f7616048700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f761005c660 0x7f76100aac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f7616048700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7610065f70 0x7f76100ae040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f7616048700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76100b2e20 0x7f76100ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f7616048700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76100ab100 con 0x7f76100b2e20 2020-10-31T22:41:29.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f7616048700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76101516a0 con 0x7f7610065f70 2020-10-31T22:41:29.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f7616048700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76100ab330 con 0x7f761005c660 2020-10-31T22:41:29.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f760ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76100b2e20 0x7f76100ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f760ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76100b2e20 0x7f76100ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41984/0 (socket says 172.21.15.60:41984) 2020-10-31T22:41:29.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f760ffff700 1 -- 172.21.15.60:0/2166136533 learned_addr learned my addr 172.21.15.60:0/2166136533 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:29.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f760f7fe700 1 --2- 172.21.15.60:0/2166136533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f761005c660 0x7f76100aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f760effd700 1 --2- 172.21.15.60:0/2166136533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7610065f70 0x7f76100ae040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f760ffff700 1 -- 172.21.15.60:0/2166136533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f761005c660 msgr2=0x7f76100aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f760ffff700 1 --2- 172.21.15.60:0/2166136533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f761005c660 0x7f76100aac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f760ffff700 1 -- 172.21.15.60:0/2166136533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7610065f70 msgr2=0x7f76100ae040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f760ffff700 1 --2- 172.21.15.60:0/2166136533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7610065f70 0x7f76100ae040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f760ffff700 1 -- 172.21.15.60:0/2166136533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7610151930 con 0x7f76100b2e20 2020-10-31T22:41:29.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f760ffff700 1 --2- 172.21.15.60:0/2166136533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76100b2e20 0x7f76100ae530 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f760800c000 tx=0x7f76080091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:29.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f760cff9700 1 -- 172.21.15.60:0/2166136533 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f760800c980 con 0x7f76100b2e20 2020-10-31T22:41:29.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f760cff9700 1 -- 172.21.15.60:0/2166136533 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760800cae0 con 0x7f76100b2e20 2020-10-31T22:41:29.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f760cff9700 1 -- 172.21.15.60:0/2166136533 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f760800ce40 con 0x7f76100b2e20 2020-10-31T22:41:29.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f7616048700 1 -- 172.21.15.60:0/2166136533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7610151bd0 con 0x7f76100b2e20 2020-10-31T22:41:29.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.523+0000 7f7616048700 1 -- 172.21.15.60:0/2166136533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76100aa5d0 con 0x7f76100b2e20 2020-10-31T22:41:29.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.527+0000 7f7616048700 1 -- 172.21.15.60:0/2166136533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7610057100 con 0x7f76100b2e20 2020-10-31T22:41:29.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.527+0000 7f760cff9700 1 -- 172.21.15.60:0/2166136533 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7608022070 con 0x7f76100b2e20 2020-10-31T22:41:29.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.527+0000 7f760cff9700 1 --2- 172.21.15.60:0/2166136533 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f75f4054f10 0x7f75f40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.527+0000 7f760cff9700 1 -- 172.21.15.60:0/2166136533 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f760806e130 con 0x7f76100b2e20 2020-10-31T22:41:29.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.527+0000 7f760f7fe700 1 --2- 172.21.15.60:0/2166136533 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f75f4054f10 0x7f75f40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.527+0000 7f760f7fe700 1 --2- 172.21.15.60:0/2166136533 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f75f4054f10 0x7f75f40573d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f75f801c000 tx=0x7f75f8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:29.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.535+0000 7f760cff9700 1 -- 172.21.15.60:0/2166136533 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7608044650 con 0x7f76100b2e20 2020-10-31T22:41:29.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.679+0000 7f7616048700 1 -- 172.21.15.60:0/2166136533 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f76100ab470 con 0x7f76100b2e20 2020-10-31T22:41:29.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.679+0000 7f760cff9700 1 -- 172.21.15.60:0/2166136533 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7f76080160a0 con 0x7f76100b2e20 2020-10-31T22:41:29.681 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:29.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.679+0000 7f7616048700 1 -- 172.21.15.60:0/2166136533 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f75f4054f10 msgr2=0x7f75f40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.679+0000 7f7616048700 1 --2- 172.21.15.60:0/2166136533 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f75f4054f10 0x7f75f40573d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f75f801c000 tx=0x7f75f8015000).stop 2020-10-31T22:41:29.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.679+0000 7f7616048700 1 -- 172.21.15.60:0/2166136533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76100b2e20 msgr2=0x7f76100ae530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.679+0000 7f7616048700 1 --2- 172.21.15.60:0/2166136533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76100b2e20 0x7f76100ae530 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f760800c000 tx=0x7f76080091a0).stop 2020-10-31T22:41:29.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.679+0000 7f7616048700 1 -- 172.21.15.60:0/2166136533 shutdown_connections 2020-10-31T22:41:29.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.679+0000 7f7616048700 1 --2- 172.21.15.60:0/2166136533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76100b2e20 0x7f76100ae530 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.679+0000 7f7616048700 1 --2- 172.21.15.60:0/2166136533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f761005c660 0x7f76100aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.679+0000 7f7616048700 1 --2- 172.21.15.60:0/2166136533 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f75f4054f10 0x7f75f40573d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.679+0000 7f7616048700 1 --2- 172.21.15.60:0/2166136533 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7610065f70 0x7f76100ae040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.679+0000 7f7616048700 1 -- 172.21.15.60:0/2166136533 >> 172.21.15.60:0/2166136533 conn(0x7f76100601e0 msgr2=0x7f76100b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:29.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.679+0000 7f7616048700 1 -- 172.21.15.60:0/2166136533 shutdown_connections 2020-10-31T22:41:29.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.679+0000 7f7616048700 1 -- 172.21.15.60:0/2166136533 wait complete. 2020-10-31T22:41:29.695 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:41:29.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5df0a7700 1 Processor -- start 2020-10-31T22:41:29.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5df0a7700 1 -- start start 2020-10-31T22:41:29.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5df0a7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd5d80b52a0 0x7fd5d8141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5df0a7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d805c8a0 0x7fd5d80af400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5df0a7700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d806a8f0 con 0x7fd5d805bde0 2020-10-31T22:41:29.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5df0a7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d80af8f0 con 0x7fd5d80b52a0 2020-10-31T22:41:29.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5df0a7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d805b160 con 0x7fd5d805c8a0 2020-10-31T22:41:29.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5dce43700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd5d80b52a0 0x7fd5d8141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5dd644700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd5d805bde0 0x7fd5d80adf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46128/0 (socket says 172.21.15.60:46128) 2020-10-31T22:41:29.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5dce43700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd5d80b52a0 0x7fd5d8141d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41988/0 (socket says 172.21.15.60:41988) 2020-10-31T22:41:29.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5dd644700 1 -- 172.21.15.60:0/3150603649 learned_addr learned my addr 172.21.15.60:0/3150603649 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:29.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5d7fff700 1 --2- 172.21.15.60:0/3150603649 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d805c8a0 0x7fd5d80af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5dce43700 1 -- 172.21.15.60:0/3150603649 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d805c8a0 msgr2=0x7fd5d80af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:29.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5dce43700 1 --2- 172.21.15.60:0/3150603649 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d805c8a0 0x7fd5d80af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5dce43700 1 -- 172.21.15.60:0/3150603649 >> v1:172.21.15.60:6789/0 conn(0x7fd5d805bde0 legacy=0x7fd5d80adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5d77fe700 1 -- 172.21.15.60:0/3150603649 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943486544 0 0) 0x7fd5d0001450 con 0x7fd5d805bde0 2020-10-31T22:41:29.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5dce43700 1 -- 172.21.15.60:0/3150603649 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d805b400 con 0x7fd5d80b52a0 2020-10-31T22:41:29.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5dce43700 1 --2- 172.21.15.60:0/3150603649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d80b52a0 0x7fd5d8141d50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fd5c8002f30 tx=0x7fd5c8006dc0).ready entity=mon.0 client_cookie=21c3789fc93b2289 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:29.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5d77fe700 1 -- 172.21.15.60:0/3150603649 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5c8009760 con 0x7fd5d80b52a0 2020-10-31T22:41:29.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5d77fe700 1 -- 172.21.15.60:0/3150603649 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c80098c0 con 0x7fd5d80b52a0 2020-10-31T22:41:29.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5df0a7700 1 -- 172.21.15.60:0/3150603649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d80b52a0 msgr2=0x7fd5d8141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5df0a7700 1 --2- 172.21.15.60:0/3150603649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d80b52a0 0x7fd5d8141d50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fd5c8002f30 tx=0x7fd5c8006dc0).stop 2020-10-31T22:41:29.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.811+0000 7fd5d77fe700 1 -- 172.21.15.60:0/3150603649 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5c8009c20 con 0x7fd5d80b52a0 2020-10-31T22:41:29.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5df0a7700 1 -- 172.21.15.60:0/3150603649 shutdown_connections 2020-10-31T22:41:29.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5df0a7700 1 --2- 172.21.15.60:0/3150603649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d80b52a0 0x7fd5d8141d50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5df0a7700 1 --2- 172.21.15.60:0/3150603649 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d805c8a0 0x7fd5d80af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5df0a7700 1 -- 172.21.15.60:0/3150603649 >> 172.21.15.60:0/3150603649 conn(0x7fd5d8060c50 msgr2=0x7fd5d80b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:29.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5df0a7700 1 -- 172.21.15.60:0/3150603649 shutdown_connections 2020-10-31T22:41:29.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5df0a7700 1 -- 172.21.15.60:0/3150603649 wait complete. 2020-10-31T22:41:29.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5df0a7700 1 Processor -- start 2020-10-31T22:41:29.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5df0a7700 1 -- start start 2020-10-31T22:41:29.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5df0a7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d805bde0 0x7fd5d8143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5df0a7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d805c8a0 0x7fd5d8145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5df0a7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5d80b52a0 0x7fd5d813dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5df0a7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d8144750 con 0x7fd5d805bde0 2020-10-31T22:41:29.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5df0a7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d8141610 con 0x7fd5d80b52a0 2020-10-31T22:41:29.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5df0a7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d80ab980 con 0x7fd5d805c8a0 2020-10-31T22:41:29.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5dce43700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d805bde0 0x7fd5d8143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5dce43700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d805bde0 0x7fd5d8143700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41994/0 (socket says 172.21.15.60:41994) 2020-10-31T22:41:29.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5dce43700 1 -- 172.21.15.60:0/524476734 learned_addr learned my addr 172.21.15.60:0/524476734 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:29.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5d7fff700 1 --2- 172.21.15.60:0/524476734 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d805c8a0 0x7fd5d8145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5dd644700 1 --2- 172.21.15.60:0/524476734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5d80b52a0 0x7fd5d813dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5dce43700 1 -- 172.21.15.60:0/524476734 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d805c8a0 msgr2=0x7fd5d8145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5dce43700 1 --2- 172.21.15.60:0/524476734 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d805c8a0 0x7fd5d8145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5dce43700 1 -- 172.21.15.60:0/524476734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5d80b52a0 msgr2=0x7fd5d813dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5dce43700 1 --2- 172.21.15.60:0/524476734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5d80b52a0 0x7fd5d813dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.815+0000 7fd5dce43700 1 -- 172.21.15.60:0/524476734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d80ab6e0 con 0x7fd5d805bde0 2020-10-31T22:41:29.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.819+0000 7fd5dce43700 1 --2- 172.21.15.60:0/524476734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d805bde0 0x7fd5d8143700 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fd5d80abb10 tx=0x7fd5c8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:29.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.819+0000 7fd5d5ffb700 1 -- 172.21.15.60:0/524476734 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5c8011c40 con 0x7fd5d805bde0 2020-10-31T22:41:29.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.819+0000 7fd5d5ffb700 1 -- 172.21.15.60:0/524476734 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c8011da0 con 0x7fd5d805bde0 2020-10-31T22:41:29.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.819+0000 7fd5df0a7700 1 -- 172.21.15.60:0/524476734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d8141870 con 0x7fd5d805bde0 2020-10-31T22:41:29.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.819+0000 7fd5d5ffb700 1 -- 172.21.15.60:0/524476734 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd5c801d630 con 0x7fd5d805bde0 2020-10-31T22:41:29.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.819+0000 7fd5df0a7700 1 -- 172.21.15.60:0/524476734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d8143250 con 0x7fd5d805bde0 2020-10-31T22:41:29.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.819+0000 7fd5df0a7700 1 -- 172.21.15.60:0/524476734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d8141a70 con 0x7fd5d805bde0 2020-10-31T22:41:29.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.819+0000 7fd5d5ffb700 1 -- 172.21.15.60:0/524476734 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd5c8024030 con 0x7fd5d805bde0 2020-10-31T22:41:29.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.819+0000 7fd5d5ffb700 1 --2- 172.21.15.60:0/524476734 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd5b8054f10 0x7fd5b80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:29.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.819+0000 7fd5d7fff700 1 --2- 172.21.15.60:0/524476734 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd5b8054f10 0x7fd5b80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:29.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.819+0000 7fd5d5ffb700 1 -- 172.21.15.60:0/524476734 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd5c806ebc0 con 0x7fd5d805bde0 2020-10-31T22:41:29.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.819+0000 7fd5d7fff700 1 --2- 172.21.15.60:0/524476734 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd5b8054f10 0x7fd5b80573d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd5cc002000 tx=0x7fd5cc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:29.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.827+0000 7fd5d5ffb700 1 -- 172.21.15.60:0/524476734 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd5d8141a70 con 0x7fd5d805bde0 2020-10-31T22:41:29.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.967+0000 7fd5df0a7700 1 -- 172.21.15.60:0/524476734 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5d8141a70 con 0x7fd5d805bde0 2020-10-31T22:41:29.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.967+0000 7fd5d5ffb700 1 -- 172.21.15.60:0/524476734 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd5d8141a70 con 0x7fd5d805bde0 2020-10-31T22:41:29.969 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:29.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.967+0000 7fd5df0a7700 1 -- 172.21.15.60:0/524476734 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd5b8054f10 msgr2=0x7fd5b80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.967+0000 7fd5df0a7700 1 --2- 172.21.15.60:0/524476734 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd5b8054f10 0x7fd5b80573d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fd5cc002000 tx=0x7fd5cc008040).stop 2020-10-31T22:41:29.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.967+0000 7fd5df0a7700 1 -- 172.21.15.60:0/524476734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d805bde0 msgr2=0x7fd5d8143700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:29.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.967+0000 7fd5df0a7700 1 --2- 172.21.15.60:0/524476734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d805bde0 0x7fd5d8143700 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fd5d80abb10 tx=0x7fd5c8015000).stop 2020-10-31T22:41:29.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.967+0000 7fd5df0a7700 1 -- 172.21.15.60:0/524476734 shutdown_connections 2020-10-31T22:41:29.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.967+0000 7fd5df0a7700 1 --2- 172.21.15.60:0/524476734 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd5b8054f10 0x7fd5b80573d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.967+0000 7fd5df0a7700 1 --2- 172.21.15.60:0/524476734 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5d80b52a0 0x7fd5d813dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.967+0000 7fd5df0a7700 1 --2- 172.21.15.60:0/524476734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5d805bde0 0x7fd5d8143700 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.967+0000 7fd5df0a7700 1 --2- 172.21.15.60:0/524476734 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d805c8a0 0x7fd5d8145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:29.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.967+0000 7fd5df0a7700 1 -- 172.21.15.60:0/524476734 >> 172.21.15.60:0/524476734 conn(0x7fd5d8060c50 msgr2=0x7fd5d80ae1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:29.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.967+0000 7fd5df0a7700 1 -- 172.21.15.60:0/524476734 shutdown_connections 2020-10-31T22:41:29.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:29.967+0000 7fd5df0a7700 1 -- 172.21.15.60:0/524476734 wait complete. 2020-10-31T22:41:29.983 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:30.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.091+0000 7fe0d759e700 1 Processor -- start 2020-10-31T22:41:30.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.091+0000 7fe0d759e700 1 -- start start 2020-10-31T22:41:30.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe0d80a95e0 0x7fe0d80a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0d805b440 0x7fe0d805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d80a75d0 con 0x7fe0d8066830 2020-10-31T22:41:30.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d805afe0 con 0x7fe0d80a95e0 2020-10-31T22:41:30.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d80a8e00 con 0x7fe0d805b440 2020-10-31T22:41:30.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe0d80a95e0 0x7fe0d80a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe0d80a95e0 0x7fe0d80a99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42002/0 (socket says 172.21.15.60:42002) 2020-10-31T22:41:30.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d659c700 1 -- 172.21.15.60:0/1108106187 learned_addr learned my addr 172.21.15.60:0/1108106187 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:30.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d5d9b700 1 --2- 172.21.15.60:0/1108106187 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0d805b440 0x7fe0d805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d659c700 1 -- 172.21.15.60:0/1108106187 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0d805b440 msgr2=0x7fe0d805b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:30.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d659c700 1 --2- 172.21.15.60:0/1108106187 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0d805b440 0x7fe0d805b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d659c700 1 -- 172.21.15.60:0/1108106187 >> v1:172.21.15.66:6789/0 conn(0x7fe0d8066830 legacy=0x7fe0d8066c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:30.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d659c700 1 -- 172.21.15.60:0/1108106187 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d80aeaf0 con 0x7fe0d80a95e0 2020-10-31T22:41:30.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d659c700 1 --2- 172.21.15.60:0/1108106187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d80a95e0 0x7fe0d80a99c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fe0d80ae670 tx=0x7fe0c8006e80).ready entity=mon.0 client_cookie=10d76c079a8d6398 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:30.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d559a700 1 -- 172.21.15.60:0/1108106187 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0c80097b0 con 0x7fe0d80a95e0 2020-10-31T22:41:30.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d559a700 1 -- 172.21.15.60:0/1108106187 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c8009910 con 0x7fe0d80a95e0 2020-10-31T22:41:30.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d559a700 1 -- 172.21.15.60:0/1108106187 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0c8009ac0 con 0x7fe0d80a95e0 2020-10-31T22:41:30.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 -- 172.21.15.60:0/1108106187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d80a95e0 msgr2=0x7fe0d80a99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 --2- 172.21.15.60:0/1108106187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d80a95e0 0x7fe0d80a99c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7fe0d80ae670 tx=0x7fe0c8006e80).stop 2020-10-31T22:41:30.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 -- 172.21.15.60:0/1108106187 shutdown_connections 2020-10-31T22:41:30.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 --2- 172.21.15.60:0/1108106187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d80a95e0 0x7fe0d80a99c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 --2- 172.21.15.60:0/1108106187 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0d805b440 0x7fe0d805b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 -- 172.21.15.60:0/1108106187 >> 172.21.15.60:0/1108106187 conn(0x7fe0d80b3fd0 msgr2=0x7fe0d80b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:30.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 -- 172.21.15.60:0/1108106187 shutdown_connections 2020-10-31T22:41:30.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 -- 172.21.15.60:0/1108106187 wait complete. 2020-10-31T22:41:30.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 Processor -- start 2020-10-31T22:41:30.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.095+0000 7fe0d759e700 1 -- start start 2020-10-31T22:41:30.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0d805b440 0x7fe0d8135410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0d8066830 0x7fe0d812e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d80a95e0 0x7fe0d812e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d80adc00 con 0x7fe0d80a95e0 2020-10-31T22:41:30.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d8150b80 con 0x7fe0d805b440 2020-10-31T22:41:30.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d80615e0 con 0x7fe0d8066830 2020-10-31T22:41:30.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d80a95e0 0x7fe0d812e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d5d9b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0d8066830 0x7fe0d812e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d659c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0d805b440 0x7fe0d8135410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d5d9b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0d8066830 0x7fe0d812e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:55198/0 (socket says 172.21.15.60:55198) 2020-10-31T22:41:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d5d9b700 1 -- 172.21.15.60:0/596897210 learned_addr learned my addr 172.21.15.60:0/596897210 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d6d9d700 1 --2- 172.21.15.60:0/596897210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d80a95e0 0x7fe0d812e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42012/0 (socket says 172.21.15.60:42012) 2020-10-31T22:41:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d6d9d700 1 -- 172.21.15.60:0/596897210 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0d8066830 msgr2=0x7fe0d812e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d6d9d700 1 --2- 172.21.15.60:0/596897210 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0d8066830 0x7fe0d812e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d6d9d700 1 -- 172.21.15.60:0/596897210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0d805b440 msgr2=0x7fe0d8135410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d6d9d700 1 --2- 172.21.15.60:0/596897210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0d805b440 0x7fe0d8135410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d6d9d700 1 -- 172.21.15.60:0/596897210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d8061880 con 0x7fe0d80a95e0 2020-10-31T22:41:30.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d6d9d700 1 --2- 172.21.15.60:0/596897210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d80a95e0 0x7fe0d812e590 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fe0d00022d0 tx=0x7fe0d0007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:30.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0c77fe700 1 -- 172.21.15.60:0/596897210 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0d000e4a0 con 0x7fe0d80a95e0 2020-10-31T22:41:30.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0c77fe700 1 -- 172.21.15.60:0/596897210 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d000e600 con 0x7fe0d80a95e0 2020-10-31T22:41:30.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0c77fe700 1 -- 172.21.15.60:0/596897210 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0d000e960 con 0x7fe0d80a95e0 2020-10-31T22:41:30.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d759e700 1 -- 172.21.15.60:0/596897210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d8061b80 con 0x7fe0d80a95e0 2020-10-31T22:41:30.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d759e700 1 -- 172.21.15.60:0/596897210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d8063f00 con 0x7fe0d80a95e0 2020-10-31T22:41:30.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0d759e700 1 -- 172.21.15.60:0/596897210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d8057100 con 0x7fe0d80a95e0 2020-10-31T22:41:30.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.099+0000 7fe0c77fe700 1 -- 172.21.15.60:0/596897210 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe0d0019030 con 0x7fe0d80a95e0 2020-10-31T22:41:30.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.103+0000 7fe0c77fe700 1 --2- 172.21.15.60:0/596897210 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0b4055020 0x7fe0b40574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.103+0000 7fe0d659c700 1 --2- 172.21.15.60:0/596897210 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0b4055020 0x7fe0b40574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.103+0000 7fe0c77fe700 1 -- 172.21.15.60:0/596897210 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe0d006d0a0 con 0x7fe0d80a95e0 2020-10-31T22:41:30.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.103+0000 7fe0d659c700 1 --2- 172.21.15.60:0/596897210 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0b4055020 0x7fe0b40574e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fe0c801c000 tx=0x7fe0c8016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:30.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.107+0000 7fe0c77fe700 1 -- 172.21.15.60:0/596897210 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe0d00435c0 con 0x7fe0d80a95e0 2020-10-31T22:41:30.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.247+0000 7fe0d759e700 1 -- 172.21.15.60:0/596897210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0d80b0850 con 0x7fe0d80a95e0 2020-10-31T22:41:30.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.247+0000 7fe0c77fe700 1 -- 172.21.15.60:0/596897210 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fe0d0046be0 con 0x7fe0d80a95e0 2020-10-31T22:41:30.251 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:30.251 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:11.059362+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:07.982891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:08.927092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:30.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.251+0000 7fe0d759e700 1 -- 172.21.15.60:0/596897210 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0b4055020 msgr2=0x7fe0b40574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.251+0000 7fe0d759e700 1 --2- 172.21.15.60:0/596897210 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0b4055020 0x7fe0b40574e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fe0c801c000 tx=0x7fe0c8016000).stop 2020-10-31T22:41:30.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.251+0000 7fe0d759e700 1 -- 172.21.15.60:0/596897210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d80a95e0 msgr2=0x7fe0d812e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.251+0000 7fe0d759e700 1 --2- 172.21.15.60:0/596897210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d80a95e0 0x7fe0d812e590 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fe0d00022d0 tx=0x7fe0d0007e30).stop 2020-10-31T22:41:30.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.251+0000 7fe0d759e700 1 -- 172.21.15.60:0/596897210 shutdown_connections 2020-10-31T22:41:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.251+0000 7fe0d759e700 1 --2- 172.21.15.60:0/596897210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0d80a95e0 0x7fe0d812e590 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.251+0000 7fe0d759e700 1 --2- 172.21.15.60:0/596897210 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0b4055020 0x7fe0b40574e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.256 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.251+0000 7fe0d759e700 1 --2- 172.21.15.60:0/596897210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0d805b440 0x7fe0d8135410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.251+0000 7fe0d759e700 1 --2- 172.21.15.60:0/596897210 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0d8066830 0x7fe0d812e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.251+0000 7fe0d759e700 1 -- 172.21.15.60:0/596897210 >> 172.21.15.60:0/596897210 conn(0x7fe0d80b3fd0 msgr2=0x7fe0d80b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:30.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.251+0000 7fe0d759e700 1 -- 172.21.15.60:0/596897210 shutdown_connections 2020-10-31T22:41:30.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.251+0000 7fe0d759e700 1 -- 172.21.15.60:0/596897210 wait complete. 2020-10-31T22:41:30.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:41:07.982891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:41:08.927092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:41:30.268 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:41:30.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.383+0000 7f4c5ed81700 1 Processor -- start 2020-10-31T22:41:30.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.383+0000 7f4c5ed81700 1 -- start start 2020-10-31T22:41:30.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5ed81700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c580b5570 0x7f4c580b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5ed81700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4c58141f00 0x7f4c58142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5ed81700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c580b4440 con 0x7f4c580b24a0 2020-10-31T22:41:30.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5ed81700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c5813f930 con 0x7f4c58141f00 2020-10-31T22:41:30.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5ed81700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58146060 con 0x7f4c580b5570 2020-10-31T22:41:30.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5e580700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4c58141f00 0x7f4c58142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5e580700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4c58141f00 0x7f4c58142390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:52954/0 (socket says 172.21.15.60:52954) 2020-10-31T22:41:30.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5e580700 1 -- 172.21.15.60:0/2486139947 learned_addr learned my addr 172.21.15.60:0/2486139947 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:30.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5dd7f700 1 --2- 172.21.15.60:0/2486139947 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c580b5570 0x7f4c580b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5e580700 1 -- 172.21.15.60:0/2486139947 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c580b5570 msgr2=0x7f4c580b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:30.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5e580700 1 --2- 172.21.15.60:0/2486139947 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c580b5570 0x7f4c580b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5e580700 1 -- 172.21.15.60:0/2486139947 >> v1:172.21.15.66:6789/0 conn(0x7f4c580b24a0 legacy=0x7f4c58145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5e580700 1 -- 172.21.15.60:0/2486139947 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580b02f0 con 0x7f4c58141f00 2020-10-31T22:41:30.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5e580700 1 --2- 172.21.15.60:0/2486139947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c58141f00 0x7f4c58142390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f4c50002f30 tx=0x7f4c50006e80).ready entity=mon.1 client_cookie=a84c5a90b86cd917 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:30.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5cd7d700 1 -- 172.21.15.60:0/2486139947 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c500097f0 con 0x7f4c58141f00 2020-10-31T22:41:30.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5cd7d700 1 -- 172.21.15.60:0/2486139947 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c50009950 con 0x7f4c58141f00 2020-10-31T22:41:30.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5cd7d700 1 -- 172.21.15.60:0/2486139947 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c50009cb0 con 0x7f4c58141f00 2020-10-31T22:41:30.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2486139947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c58141f00 msgr2=0x7f4c58142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5ed81700 1 --2- 172.21.15.60:0/2486139947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c58141f00 0x7f4c58142390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f4c50002f30 tx=0x7f4c50006e80).stop 2020-10-31T22:41:30.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2486139947 shutdown_connections 2020-10-31T22:41:30.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5ed81700 1 --2- 172.21.15.60:0/2486139947 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c58141f00 0x7f4c58142390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5ed81700 1 --2- 172.21.15.60:0/2486139947 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c580b5570 0x7f4c580b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2486139947 >> 172.21.15.60:0/2486139947 conn(0x7f4c580b8e90 msgr2=0x7f4c580b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:30.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2486139947 shutdown_connections 2020-10-31T22:41:30.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.387+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2486139947 wait complete. 2020-10-31T22:41:30.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5ed81700 1 Processor -- start 2020-10-31T22:41:30.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5ed81700 1 -- start start 2020-10-31T22:41:30.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5ed81700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c580b24a0 0x7f4c58144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5ed81700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c580b5570 0x7f4c5813c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5ed81700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c58141f00 0x7f4c5813cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5ed81700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c581437b0 con 0x7f4c580b24a0 2020-10-31T22:41:30.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5ed81700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5813d010 con 0x7f4c580b5570 2020-10-31T22:41:30.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5ed81700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c58140d90 con 0x7f4c58141f00 2020-10-31T22:41:30.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5dd7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c580b24a0 0x7f4c58144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5dd7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c580b24a0 0x7f4c58144e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42022/0 (socket says 172.21.15.60:42022) 2020-10-31T22:41:30.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5d57e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c580b5570 0x7f4c5813c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5dd7f700 1 -- 172.21.15.60:0/2879341777 learned_addr learned my addr 172.21.15.60:0/2879341777 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:30.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5e580700 1 --2- 172.21.15.60:0/2879341777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c58141f00 0x7f4c5813cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5dd7f700 1 -- 172.21.15.60:0/2879341777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c58141f00 msgr2=0x7f4c5813cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5dd7f700 1 --2- 172.21.15.60:0/2879341777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c58141f00 0x7f4c5813cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5dd7f700 1 -- 172.21.15.60:0/2879341777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c580b5570 msgr2=0x7f4c5813c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5dd7f700 1 --2- 172.21.15.60:0/2879341777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c580b5570 0x7f4c5813c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5dd7f700 1 -- 172.21.15.60:0/2879341777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c58141030 con 0x7f4c580b24a0 2020-10-31T22:41:30.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5dd7f700 1 --2- 172.21.15.60:0/2879341777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c580b24a0 0x7f4c58144e60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f4c580adda0 tx=0x7f4c540091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:30.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c46ffd700 1 -- 172.21.15.60:0/2879341777 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c5400ca80 con 0x7f4c580b24a0 2020-10-31T22:41:30.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2879341777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c581412d0 con 0x7f4c580b24a0 2020-10-31T22:41:30.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c46ffd700 1 -- 172.21.15.60:0/2879341777 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5400cbe0 con 0x7f4c580b24a0 2020-10-31T22:41:30.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c46ffd700 1 -- 172.21.15.60:0/2879341777 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c540123f0 con 0x7f4c580b24a0 2020-10-31T22:41:30.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.391+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2879341777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c58144060 con 0x7f4c580b24a0 2020-10-31T22:41:30.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.395+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2879341777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c58143c80 con 0x7f4c580b24a0 2020-10-31T22:41:30.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.395+0000 7f4c46ffd700 1 -- 172.21.15.60:0/2879341777 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4c54022070 con 0x7f4c580b24a0 2020-10-31T22:41:30.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.395+0000 7f4c46ffd700 1 --2- 172.21.15.60:0/2879341777 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4c38054f10 0x7f4c380573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.395+0000 7f4c46ffd700 1 -- 172.21.15.60:0/2879341777 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4c5406e070 con 0x7f4c580b24a0 2020-10-31T22:41:30.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.395+0000 7f4c5d57e700 1 --2- 172.21.15.60:0/2879341777 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4c38054f10 0x7f4c380573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.395+0000 7f4c5d57e700 1 --2- 172.21.15.60:0/2879341777 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4c38054f10 0x7f4c380573d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f4c4800d000 tx=0x7f4c48000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:30.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.399+0000 7f4c46ffd700 1 -- 172.21.15.60:0/2879341777 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4c58143c80 con 0x7f4c580b24a0 2020-10-31T22:41:30.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.547+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2879341777 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4c58143c80 con 0x7f4c580b24a0 2020-10-31T22:41:30.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.547+0000 7f4c46ffd700 1 -- 172.21.15.60:0/2879341777 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4c58143c80 con 0x7f4c580b24a0 2020-10-31T22:41:30.550 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:41:30.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.547+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2879341777 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4c38054f10 msgr2=0x7f4c380573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.547+0000 7f4c5ed81700 1 --2- 172.21.15.60:0/2879341777 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4c38054f10 0x7f4c380573d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f4c4800d000 tx=0x7f4c48000b80).stop 2020-10-31T22:41:30.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.547+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2879341777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c580b24a0 msgr2=0x7f4c58144e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.547+0000 7f4c5ed81700 1 --2- 172.21.15.60:0/2879341777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c580b24a0 0x7f4c58144e60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f4c580adda0 tx=0x7f4c540091a0).stop 2020-10-31T22:41:30.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.547+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2879341777 shutdown_connections 2020-10-31T22:41:30.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.547+0000 7f4c5ed81700 1 --2- 172.21.15.60:0/2879341777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c58141f00 0x7f4c5813cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.547+0000 7f4c5ed81700 1 --2- 172.21.15.60:0/2879341777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c580b24a0 0x7f4c58144e60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.547+0000 7f4c5ed81700 1 --2- 172.21.15.60:0/2879341777 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4c38054f10 0x7f4c380573d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.547+0000 7f4c5ed81700 1 --2- 172.21.15.60:0/2879341777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c580b5570 0x7f4c5813c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.547+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2879341777 >> 172.21.15.60:0/2879341777 conn(0x7f4c580b8e90 msgr2=0x7f4c580600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:30.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.547+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2879341777 shutdown_connections 2020-10-31T22:41:30.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.547+0000 7f4c5ed81700 1 -- 172.21.15.60:0/2879341777 wait complete. 2020-10-31T22:41:30.563 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:41:30.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.679+0000 7faf3b59e700 1 Processor -- start 2020-10-31T22:41:30.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.679+0000 7faf3b59e700 1 -- start start 2020-10-31T22:41:30.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.679+0000 7faf3b59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7faf3c0b5570 0x7faf3c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.679+0000 7faf3b59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf3c141f00 0x7faf3c142360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.679+0000 7faf3b59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf3c0b4440 con 0x7faf3c0b24a0 2020-10-31T22:41:30.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.679+0000 7faf3b59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c13f930 con 0x7faf3c141f00 2020-10-31T22:41:30.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.679+0000 7faf3b59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c146060 con 0x7faf3c0b5570 2020-10-31T22:41:30.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.679+0000 7faf3ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf3c141f00 0x7faf3c142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.679+0000 7faf3ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf3c141f00 0x7faf3c142360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42034/0 (socket says 172.21.15.60:42034) 2020-10-31T22:41:30.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.679+0000 7faf3ad9d700 1 -- 172.21.15.60:0/3409689252 learned_addr learned my addr 172.21.15.60:0/3409689252 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:30.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.679+0000 7faf3a59c700 1 --2- 172.21.15.60:0/3409689252 >> v2:172.21.15.66:3300/0 conn(0x7faf3c0b5570 0x7faf3c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3ad9d700 1 -- 172.21.15.60:0/3409689252 >> v2:172.21.15.66:3300/0 conn(0x7faf3c0b5570 msgr2=0x7faf3c0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:30.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3ad9d700 1 --2- 172.21.15.60:0/3409689252 >> v2:172.21.15.66:3300/0 conn(0x7faf3c0b5570 0x7faf3c0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3ad9d700 1 -- 172.21.15.60:0/3409689252 >> v1:172.21.15.66:6789/0 conn(0x7faf3c0b24a0 legacy=0x7faf3c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3ad9d700 1 -- 172.21.15.60:0/3409689252 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0b02f0 con 0x7faf3c141f00 2020-10-31T22:41:30.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3a59c700 1 --2- 172.21.15.60:0/3409689252 >> v2:172.21.15.66:3300/0 conn(0x7faf3c0b5570 0x7faf3c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3ad9d700 1 --2- 172.21.15.60:0/3409689252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3c141f00 0x7faf3c142360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7faf340032b0 tx=0x7faf34009270).ready entity=mon.0 client_cookie=2d29944dd4e97a2c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3959a700 1 -- 172.21.15.60:0/3409689252 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf3400bc00 con 0x7faf3c141f00 2020-10-31T22:41:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3959a700 1 -- 172.21.15.60:0/3409689252 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3400bd60 con 0x7faf3c141f00 2020-10-31T22:41:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3959a700 1 -- 172.21.15.60:0/3409689252 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf34011400 con 0x7faf3c141f00 2020-10-31T22:41:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3b59e700 1 -- 172.21.15.60:0/3409689252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3c141f00 msgr2=0x7faf3c142360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3b59e700 1 --2- 172.21.15.60:0/3409689252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3c141f00 0x7faf3c142360 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7faf340032b0 tx=0x7faf34009270).stop 2020-10-31T22:41:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3b59e700 1 -- 172.21.15.60:0/3409689252 shutdown_connections 2020-10-31T22:41:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3b59e700 1 --2- 172.21.15.60:0/3409689252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3c141f00 0x7faf3c142360 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3b59e700 1 --2- 172.21.15.60:0/3409689252 >> v2:172.21.15.66:3300/0 conn(0x7faf3c0b5570 0x7faf3c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3b59e700 1 -- 172.21.15.60:0/3409689252 >> 172.21.15.60:0/3409689252 conn(0x7faf3c0b8e90 msgr2=0x7faf3c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:30.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3b59e700 1 -- 172.21.15.60:0/3409689252 shutdown_connections 2020-10-31T22:41:30.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3b59e700 1 -- 172.21.15.60:0/3409689252 wait complete. 2020-10-31T22:41:30.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3b59e700 1 Processor -- start 2020-10-31T22:41:30.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.683+0000 7faf3b59e700 1 -- start start 2020-10-31T22:41:30.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3c0b24a0 0x7faf3c140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf3c0b5570 0x7faf3c0aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3b59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf3c141f00 0x7faf3c150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0adcb0 con 0x7faf3c0b24a0 2020-10-31T22:41:30.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3b59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0b7b70 con 0x7faf3c141f00 2020-10-31T22:41:30.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c0ae920 con 0x7faf3c0b5570 2020-10-31T22:41:30.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3c0b24a0 0x7faf3c140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3c0b24a0 0x7faf3c140d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42036/0 (socket says 172.21.15.60:42036) 2020-10-31T22:41:30.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3a59c700 1 -- 172.21.15.60:0/776457240 learned_addr learned my addr 172.21.15.60:0/776457240 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:30.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3ad9d700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf3c141f00 0x7faf3c150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf39d9b700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf3c0b5570 0x7faf3c0aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3a59c700 1 -- 172.21.15.60:0/776457240 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf3c0b5570 msgr2=0x7faf3c0aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3a59c700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf3c0b5570 0x7faf3c0aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3a59c700 1 -- 172.21.15.60:0/776457240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf3c141f00 msgr2=0x7faf3c150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3a59c700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf3c141f00 0x7faf3c150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3a59c700 1 -- 172.21.15.60:0/776457240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c147830 con 0x7faf3c0b24a0 2020-10-31T22:41:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3ad9d700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf3c141f00 0x7faf3c150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf39d9b700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf3c0b5570 0x7faf3c0aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:30.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3a59c700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3c0b24a0 0x7faf3c140d60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7faf24006910 tx=0x7faf24008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:30.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf337fe700 1 -- 172.21.15.60:0/776457240 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf24009920 con 0x7faf3c0b24a0 2020-10-31T22:41:30.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf337fe700 1 -- 172.21.15.60:0/776457240 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf24009a80 con 0x7faf3c0b24a0 2020-10-31T22:41:30.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3b59e700 1 -- 172.21.15.60:0/776457240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c0ad0d0 con 0x7faf3c0b24a0 2020-10-31T22:41:30.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf337fe700 1 -- 172.21.15.60:0/776457240 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf24009de0 con 0x7faf3c0b24a0 2020-10-31T22:41:30.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3b59e700 1 -- 172.21.15.60:0/776457240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c0ac3f0 con 0x7faf3c0b24a0 2020-10-31T22:41:30.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf3b59e700 1 -- 172.21.15.60:0/776457240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf3c057100 con 0x7faf3c0b24a0 2020-10-31T22:41:30.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf337fe700 1 -- 172.21.15.60:0/776457240 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7faf24013480 con 0x7faf3c0b24a0 2020-10-31T22:41:30.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf337fe700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf20055020 0x7faf200574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.687+0000 7faf337fe700 1 -- 172.21.15.60:0/776457240 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf2406e270 con 0x7faf3c0b24a0 2020-10-31T22:41:30.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.691+0000 7faf39d9b700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf20055020 0x7faf200574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.691+0000 7faf39d9b700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf20055020 0x7faf200574e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7faf2c00b000 tx=0x7faf2c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:30.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.695+0000 7faf337fe700 1 -- 172.21.15.60:0/776457240 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7faf24044730 con 0x7faf3c0b24a0 2020-10-31T22:41:30.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.839+0000 7faf3b59e700 1 -- 172.21.15.60:0/776457240 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faf3c05a8e0 con 0x7faf3c0b24a0 2020-10-31T22:41:30.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.839+0000 7faf337fe700 1 -- 172.21.15.60:0/776457240 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7faf24047d50 con 0x7faf3c0b24a0 2020-10-31T22:41:30.843 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:30.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.843+0000 7faf3b59e700 1 -- 172.21.15.60:0/776457240 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf20055020 msgr2=0x7faf200574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.843+0000 7faf3b59e700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf20055020 0x7faf200574e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7faf2c00b000 tx=0x7faf2c009040).stop 2020-10-31T22:41:30.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.843+0000 7faf3b59e700 1 -- 172.21.15.60:0/776457240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3c0b24a0 msgr2=0x7faf3c140d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.843+0000 7faf3b59e700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3c0b24a0 0x7faf3c140d60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7faf24006910 tx=0x7faf24008040).stop 2020-10-31T22:41:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.843+0000 7faf3b59e700 1 -- 172.21.15.60:0/776457240 shutdown_connections 2020-10-31T22:41:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.843+0000 7faf3b59e700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf20055020 0x7faf200574e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.843+0000 7faf3b59e700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf3c141f00 0x7faf3c150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.843+0000 7faf3b59e700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf3c0b24a0 0x7faf3c140d60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.843+0000 7faf3b59e700 1 --2- 172.21.15.60:0/776457240 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf3c0b5570 0x7faf3c0aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.843+0000 7faf3b59e700 1 -- 172.21.15.60:0/776457240 >> 172.21.15.60:0/776457240 conn(0x7faf3c0b8e90 msgr2=0x7faf3c05f780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:30.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.843+0000 7faf3b59e700 1 -- 172.21.15.60:0/776457240 shutdown_connections 2020-10-31T22:41:30.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.843+0000 7faf3b59e700 1 -- 172.21.15.60:0/776457240 wait complete. 2020-10-31T22:41:30.857 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:41:30.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.967+0000 7fe518b03700 1 Processor -- start 2020-10-31T22:41:30.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.967+0000 7fe518b03700 1 -- start start 2020-10-31T22:41:30.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.967+0000 7fe518b03700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe5140b0dc0 0x7fe5140b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.967+0000 7fe518b03700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5140653c0 con 0x7fe5140664e0 2020-10-31T22:41:30.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.967+0000 7fe518b03700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe514066b10 con 0x7fe51413fd20 2020-10-31T22:41:30.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.967+0000 7fe518b03700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe514066930 con 0x7fe5140b0dc0 2020-10-31T22:41:30.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.967+0000 7fe51259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe5140b0dc0 0x7fe5140b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.967+0000 7fe512d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe5140664e0 0x7fe514143890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46184/0 (socket says 172.21.15.60:46184) 2020-10-31T22:41:30.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe512d9d700 1 -- 172.21.15.60:0/2669788355 learned_addr learned my addr 172.21.15.60:0/2669788355 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:30.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe51159a700 1 -- 172.21.15.60:0/2669788355 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 159739053 0 0) 0x7fe5140653c0 con 0x7fe5140664e0 2020-10-31T22:41:30.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe51159a700 1 -- 172.21.15.60:0/2669788355 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4f4003230 con 0x7fe5140664e0 2020-10-31T22:41:30.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe51159a700 1 -- 172.21.15.60:0/2669788355 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599315653 0 0) 0x7fe514066b10 con 0x7fe51413fd20 2020-10-31T22:41:30.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe51259c700 1 -- 172.21.15.60:0/2669788355 >> v1:172.21.15.66:6789/0 conn(0x7fe51413fd20 legacy=0x7fe51413d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe51259c700 1 -- 172.21.15.60:0/2669788355 >> v1:172.21.15.60:6789/0 conn(0x7fe5140664e0 legacy=0x7fe514143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe51259c700 1 -- 172.21.15.60:0/2669788355 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe514066db0 con 0x7fe5140b0dc0 2020-10-31T22:41:30.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe51259c700 1 --2- 172.21.15.60:0/2669788355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5140b0dc0 0x7fe5140b2d50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fe5040032b0 tx=0x7fe5040091a0).ready entity=mon.0 client_cookie=54d92f53aa020e9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:30.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe51159a700 1 -- 172.21.15.60:0/2669788355 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe50400b9a0 con 0x7fe5140b0dc0 2020-10-31T22:41:30.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe51159a700 1 -- 172.21.15.60:0/2669788355 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50400bb00 con 0x7fe5140b0dc0 2020-10-31T22:41:30.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe51159a700 1 -- 172.21.15.60:0/2669788355 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe50400bc70 con 0x7fe5140b0dc0 2020-10-31T22:41:30.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe518b03700 1 -- 172.21.15.60:0/2669788355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5140b0dc0 msgr2=0x7fe5140b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe518b03700 1 --2- 172.21.15.60:0/2669788355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5140b0dc0 0x7fe5140b2d50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fe5040032b0 tx=0x7fe5040091a0).stop 2020-10-31T22:41:30.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe518b03700 1 -- 172.21.15.60:0/2669788355 shutdown_connections 2020-10-31T22:41:30.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe518b03700 1 --2- 172.21.15.60:0/2669788355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5140b0dc0 0x7fe5140b2d50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe518b03700 1 -- 172.21.15.60:0/2669788355 >> 172.21.15.60:0/2669788355 conn(0x7fe51406a260 msgr2=0x7fe514063c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:30.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe518b03700 1 -- 172.21.15.60:0/2669788355 shutdown_connections 2020-10-31T22:41:30.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.971+0000 7fe518b03700 1 -- 172.21.15.60:0/2669788355 wait complete. 2020-10-31T22:41:30.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe518b03700 1 Processor -- start 2020-10-31T22:41:30.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe518b03700 1 -- start start 2020-10-31T22:41:30.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe518b03700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe5140664e0 0x7fe51413cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe518b03700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5140b0dc0 0x7fe5140aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe518b03700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe51413fd20 0x7fe51414e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe518b03700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5140aa800 con 0x7fe51413fd20 2020-10-31T22:41:30.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe518b03700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe514146480 con 0x7fe5140b0dc0 2020-10-31T22:41:30.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe518b03700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5141461e0 con 0x7fe5140664e0 2020-10-31T22:41:30.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe512d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe51413fd20 0x7fe51414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe512d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe51413fd20 0x7fe51414e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42054/0 (socket says 172.21.15.60:42054) 2020-10-31T22:41:30.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe512d9d700 1 -- 172.21.15.60:0/3519061732 learned_addr learned my addr 172.21.15.60:0/3519061732 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe51259c700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe5140664e0 0x7fe51413cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe511d9b700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5140b0dc0 0x7fe5140aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe512d9d700 1 -- 172.21.15.60:0/3519061732 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe5140664e0 msgr2=0x7fe51413cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe512d9d700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe5140664e0 0x7fe51413cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe512d9d700 1 -- 172.21.15.60:0/3519061732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5140b0dc0 msgr2=0x7fe5140aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe512d9d700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5140b0dc0 0x7fe5140aaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe512d9d700 1 -- 172.21.15.60:0/3519061732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5140aaa60 con 0x7fe51413fd20 2020-10-31T22:41:30.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe51259c700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe5140664e0 0x7fe51413cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe511d9b700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5140b0dc0 0x7fe5140aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:41:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe512d9d700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe51413fd20 0x7fe51414e850 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fe50c0010d0 tx=0x7fe50c0079b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe50b7fe700 1 -- 172.21.15.60:0/3519061732 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe50c0072e0 con 0x7fe51413fd20 2020-10-31T22:41:30.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe50b7fe700 1 -- 172.21.15.60:0/3519061732 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe50c007440 con 0x7fe51413fd20 2020-10-31T22:41:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe518b03700 1 -- 172.21.15.60:0/3519061732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5140ab3f0 con 0x7fe51413fd20 2020-10-31T22:41:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe50b7fe700 1 -- 172.21.15.60:0/3519061732 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe50c0057d0 con 0x7fe51413fd20 2020-10-31T22:41:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.975+0000 7fe518b03700 1 -- 172.21.15.60:0/3519061732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51414ed40 con 0x7fe51413fd20 2020-10-31T22:41:30.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.979+0000 7fe518b03700 1 -- 172.21.15.60:0/3519061732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5140aabf0 con 0x7fe51413fd20 2020-10-31T22:41:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.979+0000 7fe50b7fe700 1 -- 172.21.15.60:0/3519061732 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe50c01a060 con 0x7fe51413fd20 2020-10-31T22:41:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.979+0000 7fe50b7fe700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe4f8054f10 0x7fe4f80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.979+0000 7fe51259c700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe4f8054f10 0x7fe4f80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:30.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.979+0000 7fe50b7fe700 1 -- 172.21.15.60:0/3519061732 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe50c06ce70 con 0x7fe51413fd20 2020-10-31T22:41:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.979+0000 7fe51259c700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe4f8054f10 0x7fe4f80573d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe504019000 tx=0x7fe504016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:30.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:30.987+0000 7fe50b7fe700 1 -- 172.21.15.60:0/3519061732 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe50c043390 con 0x7fe51413fd20 2020-10-31T22:41:31.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.127+0000 7fe518b03700 1 -- 172.21.15.60:0/3519061732 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe514057100 con 0x7fe51413fd20 2020-10-31T22:41:31.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.131+0000 7fe50b7fe700 1 -- 172.21.15.60:0/3519061732 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe50c018020 con 0x7fe51413fd20 2020-10-31T22:41:31.132 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:31.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.131+0000 7fe518b03700 1 -- 172.21.15.60:0/3519061732 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe4f8054f10 msgr2=0x7fe4f80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.131+0000 7fe518b03700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe4f8054f10 0x7fe4f80573d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fe504019000 tx=0x7fe504016000).stop 2020-10-31T22:41:31.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.131+0000 7fe518b03700 1 -- 172.21.15.60:0/3519061732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe51413fd20 msgr2=0x7fe51414e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.131+0000 7fe518b03700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe51413fd20 0x7fe51414e850 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fe50c0010d0 tx=0x7fe50c0079b0).stop 2020-10-31T22:41:31.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.131+0000 7fe518b03700 1 -- 172.21.15.60:0/3519061732 shutdown_connections 2020-10-31T22:41:31.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.131+0000 7fe518b03700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe51413fd20 0x7fe51414e850 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.131+0000 7fe518b03700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe5140664e0 0x7fe51413cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.131+0000 7fe518b03700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe4f8054f10 0x7fe4f80573d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.131+0000 7fe518b03700 1 --2- 172.21.15.60:0/3519061732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe5140b0dc0 0x7fe5140aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.131+0000 7fe518b03700 1 -- 172.21.15.60:0/3519061732 >> 172.21.15.60:0/3519061732 conn(0x7fe51406a260 msgr2=0x7fe5140b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:31.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.131+0000 7fe518b03700 1 -- 172.21.15.60:0/3519061732 shutdown_connections 2020-10-31T22:41:31.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.131+0000 7fe518b03700 1 -- 172.21.15.60:0/3519061732 wait complete. 2020-10-31T22:41:31.146 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:41:31.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75ad78e700 1 Processor -- start 2020-10-31T22:41:31.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75ad78e700 1 -- start start 2020-10-31T22:41:31.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75ad78e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f75a80b5570 0x7f75a80b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75ad78e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f75a80b24a0 0x7f75a8145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75ad78e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75a8145e40 0x7f75a8141f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75ad78e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a813f930 con 0x7f75a80b5570 2020-10-31T22:41:31.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75ad78e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75a80b4440 con 0x7f75a80b24a0 2020-10-31T22:41:31.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75ad78e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80b02f0 con 0x7f75a8145e40 2020-10-31T22:41:31.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75a7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f75a80b5570 0x7f75a80b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75a7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f75a80b5570 0x7f75a80b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42058/0 (socket says 172.21.15.60:42058) 2020-10-31T22:41:31.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75a7fff700 1 -- 172.21.15.60:0/1773439560 learned_addr learned my addr 172.21.15.60:0/1773439560 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:31.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75a77fe700 1 --2- 172.21.15.60:0/1773439560 >> v2:172.21.15.66:3300/0 conn(0x7f75a80b24a0 0x7f75a8145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75acf8d700 1 --2- 172.21.15.60:0/1773439560 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75a8145e40 0x7f75a8141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75a7fff700 1 -- 172.21.15.60:0/1773439560 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75a8145e40 msgr2=0x7f75a8141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:31.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75a7fff700 1 --2- 172.21.15.60:0/1773439560 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75a8145e40 0x7f75a8141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75a7fff700 1 -- 172.21.15.60:0/1773439560 >> v2:172.21.15.66:3300/0 conn(0x7f75a80b24a0 msgr2=0x7f75a8145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:31.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75a7fff700 1 --2- 172.21.15.60:0/1773439560 >> v2:172.21.15.66:3300/0 conn(0x7f75a80b24a0 0x7f75a8145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75a7fff700 1 -- 172.21.15.60:0/1773439560 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a80b0590 con 0x7f75a80b5570 2020-10-31T22:41:31.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75a7fff700 1 --2- 172.21.15.60:0/1773439560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a80b5570 0x7f75a80b5950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f7598002f30 tx=0x7f7598006e80).ready entity=mon.0 client_cookie=c7b0171ad4bc9a7a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:31.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75a6ffd700 1 -- 172.21.15.60:0/1773439560 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75980097f0 con 0x7f75a80b5570 2020-10-31T22:41:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75a6ffd700 1 -- 172.21.15.60:0/1773439560 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7598009950 con 0x7f75a80b5570 2020-10-31T22:41:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75a6ffd700 1 -- 172.21.15.60:0/1773439560 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7598009cb0 con 0x7f75a80b5570 2020-10-31T22:41:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75ad78e700 1 -- 172.21.15.60:0/1773439560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a80b5570 msgr2=0x7f75a80b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75ad78e700 1 --2- 172.21.15.60:0/1773439560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a80b5570 0x7f75a80b5950 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f7598002f30 tx=0x7f7598006e80).stop 2020-10-31T22:41:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75ad78e700 1 -- 172.21.15.60:0/1773439560 shutdown_connections 2020-10-31T22:41:31.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75ad78e700 1 --2- 172.21.15.60:0/1773439560 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75a8145e40 0x7f75a8141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75ad78e700 1 --2- 172.21.15.60:0/1773439560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a80b5570 0x7f75a80b5950 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.259+0000 7f75ad78e700 1 --2- 172.21.15.60:0/1773439560 >> v2:172.21.15.66:3300/0 conn(0x7f75a80b24a0 0x7f75a8145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75ad78e700 1 -- 172.21.15.60:0/1773439560 >> 172.21.15.60:0/1773439560 conn(0x7f75a80b8e90 msgr2=0x7f75a80b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:31.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75ad78e700 1 -- 172.21.15.60:0/1773439560 shutdown_connections 2020-10-31T22:41:31.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75ad78e700 1 -- 172.21.15.60:0/1773439560 wait complete. 2020-10-31T22:41:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75ad78e700 1 Processor -- start 2020-10-31T22:41:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75ad78e700 1 -- start start 2020-10-31T22:41:31.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75ad78e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a80b24a0 0x7f75a8140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75ad78e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75a80b5570 0x7f75a80ac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75ad78e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75a8145e40 0x7f75a80acac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75ad78e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a80acfb0 con 0x7f75a80b24a0 2020-10-31T22:41:31.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75ad78e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75a81444f0 con 0x7f75a8145e40 2020-10-31T22:41:31.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75ad78e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75a8144d70 con 0x7f75a80b5570 2020-10-31T22:41:31.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a80b24a0 0x7f75a8140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75a7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a80b24a0 0x7f75a8140880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42064/0 (socket says 172.21.15.60:42064) 2020-10-31T22:41:31.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75a7fff700 1 -- 172.21.15.60:0/3470349299 learned_addr learned my addr 172.21.15.60:0/3470349299 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:31.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75a77fe700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75a80b5570 0x7f75a80ac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.263+0000 7f75acf8d700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75a8145e40 0x7f75a80acac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75a7fff700 1 -- 172.21.15.60:0/3470349299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75a80b5570 msgr2=0x7f75a80ac5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75a7fff700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75a80b5570 0x7f75a80ac5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75a7fff700 1 -- 172.21.15.60:0/3470349299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75a8145e40 msgr2=0x7f75a80acac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75a7fff700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75a8145e40 0x7f75a80acac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75a7fff700 1 -- 172.21.15.60:0/3470349299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a8145010 con 0x7f75a80b24a0 2020-10-31T22:41:31.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75a77fe700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75a80b5570 0x7f75a80ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75acf8d700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75a8145e40 0x7f75a80acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75a7fff700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a80b24a0 0x7f75a8140880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f7598002f30 tx=0x7f7598015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75a57fa700 1 -- 172.21.15.60:0/3470349299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7598011ce0 con 0x7f75a80b24a0 2020-10-31T22:41:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75a57fa700 1 -- 172.21.15.60:0/3470349299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7598011e40 con 0x7f75a80b24a0 2020-10-31T22:41:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75ad78e700 1 -- 172.21.15.60:0/3470349299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75a80af2c0 con 0x7f75a80b24a0 2020-10-31T22:41:31.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75a57fa700 1 -- 172.21.15.60:0/3470349299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f759801e650 con 0x7f75a80b24a0 2020-10-31T22:41:31.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75ad78e700 1 -- 172.21.15.60:0/3470349299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75a8153f50 con 0x7f75a80b24a0 2020-10-31T22:41:31.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75ad78e700 1 -- 172.21.15.60:0/3470349299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75a8057100 con 0x7f75a80b24a0 2020-10-31T22:41:31.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75a57fa700 1 -- 172.21.15.60:0/3470349299 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7598025030 con 0x7f75a80b24a0 2020-10-31T22:41:31.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75a57fa700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7588054f90 0x7f7588057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75a77fe700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7588054f90 0x7f7588057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.267+0000 7f75a57fa700 1 -- 172.21.15.60:0/3470349299 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f759806ee00 con 0x7f75a80b24a0 2020-10-31T22:41:31.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.271+0000 7f75a77fe700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7588054f90 0x7f7588057450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f759c00c000 tx=0x7f759c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:31.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.275+0000 7f75a57fa700 1 -- 172.21.15.60:0/3470349299 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7598045320 con 0x7f75a80b24a0 2020-10-31T22:41:31.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.415+0000 7f75ad78e700 1 -- 172.21.15.60:0/3470349299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75a805a8e0 con 0x7f75a80b24a0 2020-10-31T22:41:31.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.419+0000 7f75a57fa700 1 -- 172.21.15.60:0/3470349299 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f7598048940 con 0x7f75a80b24a0 2020-10-31T22:41:31.422 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:31.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.419+0000 7f75ad78e700 1 -- 172.21.15.60:0/3470349299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7588054f90 msgr2=0x7f7588057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.419+0000 7f75ad78e700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7588054f90 0x7f7588057450 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f759c00c000 tx=0x7f759c008040).stop 2020-10-31T22:41:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.419+0000 7f75ad78e700 1 -- 172.21.15.60:0/3470349299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a80b24a0 msgr2=0x7f75a8140880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.419+0000 7f75ad78e700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a80b24a0 0x7f75a8140880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f7598002f30 tx=0x7f7598015000).stop 2020-10-31T22:41:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.419+0000 7f75ad78e700 1 -- 172.21.15.60:0/3470349299 shutdown_connections 2020-10-31T22:41:31.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.419+0000 7f75ad78e700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7588054f90 0x7f7588057450 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.419+0000 7f75ad78e700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75a8145e40 0x7f75a80acac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.419+0000 7f75ad78e700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f75a80b24a0 0x7f75a8140880 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.419+0000 7f75ad78e700 1 --2- 172.21.15.60:0/3470349299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75a80b5570 0x7f75a80ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.419+0000 7f75ad78e700 1 -- 172.21.15.60:0/3470349299 >> 172.21.15.60:0/3470349299 conn(0x7f75a80b8e90 msgr2=0x7f75a8141e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:31.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.419+0000 7f75ad78e700 1 -- 172.21.15.60:0/3470349299 shutdown_connections 2020-10-31T22:41:31.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.419+0000 7f75ad78e700 1 -- 172.21.15.60:0/3470349299 wait complete. 2020-10-31T22:41:31.435 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:31.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.543+0000 7f248bfff700 1 Processor -- start 2020-10-31T22:41:31.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.543+0000 7f248bfff700 1 -- start start 2020-10-31T22:41:31.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.543+0000 7f248bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f248c0b5570 0x7f248c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.543+0000 7f248bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f248c0b24a0 0x7f248c145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.543+0000 7f248bfff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f248c145180 con 0x7f248c145d10 2020-10-31T22:41:31.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.543+0000 7f248bfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f248c0afae0 con 0x7f248c0b5570 2020-10-31T22:41:31.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.543+0000 7f248bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248c141bf0 con 0x7f248c0b24a0 2020-10-31T22:41:31.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.543+0000 7f248affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f248c0b5570 0x7f248c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.543+0000 7f248a7fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f248c0b24a0 0x7f248c145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.543+0000 7f248affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f248c0b5570 0x7f248c0b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42072/0 (socket says 172.21.15.60:42072) 2020-10-31T22:41:31.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.543+0000 7f248a7fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f248c0b24a0 0x7f248c145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:55260/0 (socket says 172.21.15.60:55260) 2020-10-31T22:41:31.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.543+0000 7f248affd700 1 -- 172.21.15.60:0/5316263 learned_addr learned my addr 172.21.15.60:0/5316263 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:31.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f2489ffb700 1 -- 172.21.15.60:0/5316263 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104937648 0 0) 0x7f248c145180 con 0x7f248c145d10 2020-10-31T22:41:31.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f2489ffb700 1 -- 172.21.15.60:0/5316263 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2470003230 con 0x7f248c145d10 2020-10-31T22:41:31.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248affd700 1 -- 172.21.15.60:0/5316263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f248c0b24a0 msgr2=0x7f248c145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:31.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248affd700 1 --2- 172.21.15.60:0/5316263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f248c0b24a0 0x7f248c145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248affd700 1 -- 172.21.15.60:0/5316263 >> v1:172.21.15.66:6789/0 conn(0x7f248c145d10 legacy=0x7f248c141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248affd700 1 -- 172.21.15.60:0/5316263 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c0b0670 con 0x7f248c0b5570 2020-10-31T22:41:31.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248affd700 1 --2- 172.21.15.60:0/5316263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f248c0b5570 0x7f248c0b5950 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f2480002f30 tx=0x7f2480006e80).ready entity=mon.0 client_cookie=4634c3314b23cdc6 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:31.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f2489ffb700 1 -- 172.21.15.60:0/5316263 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2480009640 con 0x7f248c0b5570 2020-10-31T22:41:31.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f2489ffb700 1 -- 172.21.15.60:0/5316263 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24800097a0 con 0x7f248c0b5570 2020-10-31T22:41:31.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f2489ffb700 1 -- 172.21.15.60:0/5316263 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2480009b00 con 0x7f248c0b5570 2020-10-31T22:41:31.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248bfff700 1 -- 172.21.15.60:0/5316263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f248c0b5570 msgr2=0x7f248c0b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248bfff700 1 --2- 172.21.15.60:0/5316263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f248c0b5570 0x7f248c0b5950 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f2480002f30 tx=0x7f2480006e80).stop 2020-10-31T22:41:31.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248bfff700 1 -- 172.21.15.60:0/5316263 shutdown_connections 2020-10-31T22:41:31.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248bfff700 1 --2- 172.21.15.60:0/5316263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f248c0b5570 0x7f248c0b5950 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248bfff700 1 --2- 172.21.15.60:0/5316263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f248c0b24a0 0x7f248c145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248bfff700 1 -- 172.21.15.60:0/5316263 >> 172.21.15.60:0/5316263 conn(0x7f248c0b8e90 msgr2=0x7f248c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:31.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248bfff700 1 -- 172.21.15.60:0/5316263 shutdown_connections 2020-10-31T22:41:31.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248bfff700 1 -- 172.21.15.60:0/5316263 wait complete. 2020-10-31T22:41:31.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248bfff700 1 Processor -- start 2020-10-31T22:41:31.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.547+0000 7f248bfff700 1 -- start start 2020-10-31T22:41:31.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f248c0b24a0 0x7f248c154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f248c0b5570 0x7f248c13d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f248c145d10 0x7f248c1507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c1444e0 con 0x7f248c145d10 2020-10-31T22:41:31.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248bfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248c144780 con 0x7f248c0b24a0 2020-10-31T22:41:31.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f248c144a20 con 0x7f248c0b5570 2020-10-31T22:41:31.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f248c145d10 0x7f248c1507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f248c145d10 0x7f248c1507a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42082/0 (socket says 172.21.15.60:42082) 2020-10-31T22:41:31.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248b7fe700 1 -- 172.21.15.60:0/179006950 learned_addr learned my addr 172.21.15.60:0/179006950 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:31.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248affd700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f248c0b24a0 0x7f248c154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248a7fc700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f248c0b5570 0x7f248c13d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248b7fe700 1 -- 172.21.15.60:0/179006950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f248c0b5570 msgr2=0x7f248c13d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248b7fe700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f248c0b5570 0x7f248c13d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248b7fe700 1 -- 172.21.15.60:0/179006950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f248c0b24a0 msgr2=0x7f248c154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248b7fe700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f248c0b24a0 0x7f248c154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248b7fe700 1 -- 172.21.15.60:0/179006950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f248c144ec0 con 0x7f248c145d10 2020-10-31T22:41:31.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248a7fc700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f248c0b5570 0x7f248c13d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:31.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248b7fe700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f248c145d10 0x7f248c1507a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f2484001450 tx=0x7f2484007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:31.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f247bfff700 1 -- 172.21.15.60:0/179006950 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f248400a7b0 con 0x7f248c145d10 2020-10-31T22:41:31.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f247bfff700 1 -- 172.21.15.60:0/179006950 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f248400a910 con 0x7f248c145d10 2020-10-31T22:41:31.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248bfff700 1 -- 172.21.15.60:0/179006950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f248c144020 con 0x7f248c145d10 2020-10-31T22:41:31.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f247bfff700 1 -- 172.21.15.60:0/179006950 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f248400aa80 con 0x7f248c145d10 2020-10-31T22:41:31.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248bfff700 1 -- 172.21.15.60:0/179006950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f248c0b7650 con 0x7f248c145d10 2020-10-31T22:41:31.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.551+0000 7f248bfff700 1 -- 172.21.15.60:0/179006950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248c057100 con 0x7f248c145d10 2020-10-31T22:41:31.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.555+0000 7f247bfff700 1 -- 172.21.15.60:0/179006950 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2484010070 con 0x7f248c145d10 2020-10-31T22:41:31.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.555+0000 7f247bfff700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2468054f90 0x7f2468057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.555+0000 7f248affd700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2468054f90 0x7f2468057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.555+0000 7f247bfff700 1 -- 172.21.15.60:0/179006950 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f248406d670 con 0x7f248c145d10 2020-10-31T22:41:31.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.555+0000 7f248affd700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2468054f90 0x7f2468057450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f248001b000 tx=0x7f2480015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:31.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.559+0000 7f247bfff700 1 -- 172.21.15.60:0/179006950 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2484043b10 con 0x7f248c145d10 2020-10-31T22:41:31.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.703+0000 7f248bfff700 1 -- 172.21.15.60:0/179006950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f248c05a8e0 con 0x7f248c145d10 2020-10-31T22:41:31.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.703+0000 7f247bfff700 1 -- 172.21.15.60:0/179006950 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f2484047130 con 0x7f248c145d10 2020-10-31T22:41:31.708 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:31.708 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:11.059362+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:07.982891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:08.927092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:31.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.707+0000 7f248bfff700 1 -- 172.21.15.60:0/179006950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2468054f90 msgr2=0x7f2468057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.707+0000 7f248bfff700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2468054f90 0x7f2468057450 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f248001b000 tx=0x7f2480015000).stop 2020-10-31T22:41:31.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.707+0000 7f248bfff700 1 -- 172.21.15.60:0/179006950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f248c145d10 msgr2=0x7f248c1507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.707+0000 7f248bfff700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f248c145d10 0x7f248c1507a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f2484001450 tx=0x7f2484007d30).stop 2020-10-31T22:41:31.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.707+0000 7f248bfff700 1 -- 172.21.15.60:0/179006950 shutdown_connections 2020-10-31T22:41:31.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.707+0000 7f248bfff700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f248c145d10 0x7f248c1507a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.707+0000 7f248bfff700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2468054f90 0x7f2468057450 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.707+0000 7f248bfff700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f248c0b24a0 0x7f248c154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.707+0000 7f248bfff700 1 --2- 172.21.15.60:0/179006950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f248c0b5570 0x7f248c13d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.707+0000 7f248bfff700 1 -- 172.21.15.60:0/179006950 >> 172.21.15.60:0/179006950 conn(0x7f248c0b8e90 msgr2=0x7f248c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:31.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.707+0000 7f248bfff700 1 -- 172.21.15.60:0/179006950 shutdown_connections 2020-10-31T22:41:31.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.707+0000 7f248bfff700 1 -- 172.21.15.60:0/179006950 wait complete. 2020-10-31T22:41:31.724 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:41:07.982891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:41:08.927092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:41:31.727 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:41:31.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b4b180700 1 Processor -- start 2020-10-31T22:41:31.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b4b180700 1 -- start start 2020-10-31T22:41:31.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b4b180700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6b44062ad0 0x7f6b44062eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b4b180700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b44149780 con 0x7f6b4405afe0 2020-10-31T22:41:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b4b180700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4414a630 con 0x7f6b4405ba80 2020-10-31T22:41:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b4b180700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b441499b0 con 0x7f6b44062ad0 2020-10-31T22:41:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b4971d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6b4405afe0 0x7f6b441461b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46224/0 (socket says 172.21.15.60:46224) 2020-10-31T22:41:31.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b4971d700 1 -- 172.21.15.60:0/3293472781 learned_addr learned my addr 172.21.15.60:0/3293472781 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b48f1c700 1 --2- 172.21.15.60:0/3293472781 >> v2:172.21.15.66:3300/0 conn(0x7f6b44062ad0 0x7f6b44062eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b437fe700 1 -- 172.21.15.60:0/3293472781 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1597659724 0 0) 0x7f6b44149780 con 0x7f6b4405afe0 2020-10-31T22:41:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b437fe700 1 -- 172.21.15.60:0/3293472781 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b30003230 con 0x7f6b4405afe0 2020-10-31T22:41:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b48f1c700 1 -- 172.21.15.60:0/3293472781 >> v1:172.21.15.66:6789/0 conn(0x7f6b4405ba80 legacy=0x7f6b440aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b48f1c700 1 -- 172.21.15.60:0/3293472781 >> v1:172.21.15.60:6789/0 conn(0x7f6b4405afe0 legacy=0x7f6b441461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b48f1c700 1 -- 172.21.15.60:0/3293472781 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b44149c50 con 0x7f6b44062ad0 2020-10-31T22:41:31.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.843+0000 7f6b48f1c700 1 --2- 172.21.15.60:0/3293472781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b44062ad0 0x7f6b44062eb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f6b340032b0 tx=0x7f6b340091a0).ready entity=mon.1 client_cookie=1051d95019dd1384 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:31.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.847+0000 7f6b437fe700 1 -- 172.21.15.60:0/3293472781 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b3400b9a0 con 0x7f6b44062ad0 2020-10-31T22:41:31.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.847+0000 7f6b437fe700 1 -- 172.21.15.60:0/3293472781 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3400bb00 con 0x7f6b44062ad0 2020-10-31T22:41:31.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.847+0000 7f6b437fe700 1 -- 172.21.15.60:0/3293472781 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b3400bc70 con 0x7f6b44062ad0 2020-10-31T22:41:31.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.847+0000 7f6b4b180700 1 -- 172.21.15.60:0/3293472781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b44062ad0 msgr2=0x7f6b44062eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.847+0000 7f6b4b180700 1 --2- 172.21.15.60:0/3293472781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b44062ad0 0x7f6b44062eb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f6b340032b0 tx=0x7f6b340091a0).stop 2020-10-31T22:41:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.847+0000 7f6b4b180700 1 -- 172.21.15.60:0/3293472781 shutdown_connections 2020-10-31T22:41:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.847+0000 7f6b4b180700 1 --2- 172.21.15.60:0/3293472781 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b44062ad0 0x7f6b44062eb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.847+0000 7f6b4b180700 1 -- 172.21.15.60:0/3293472781 >> 172.21.15.60:0/3293472781 conn(0x7f6b4405fae0 msgr2=0x7f6b4405fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:31.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.847+0000 7f6b4b180700 1 -- 172.21.15.60:0/3293472781 shutdown_connections 2020-10-31T22:41:31.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.847+0000 7f6b4b180700 1 -- 172.21.15.60:0/3293472781 wait complete. 2020-10-31T22:41:31.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.847+0000 7f6b4b180700 1 Processor -- start 2020-10-31T22:41:31.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.847+0000 7f6b4b180700 1 -- start start 2020-10-31T22:41:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b4b180700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4405afe0 0x7f6b44141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b4b180700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b4405ba80 0x7f6b4413f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b4b180700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b44062ad0 0x7f6b4413fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b4b180700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b44146190 con 0x7f6b4405afe0 2020-10-31T22:41:31.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b4b180700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b44146430 con 0x7f6b4405ba80 2020-10-31T22:41:31.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b4b180700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b441466d0 con 0x7f6b44062ad0 2020-10-31T22:41:31.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b48f1c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4405afe0 0x7f6b44141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b48f1c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4405afe0 0x7f6b44141920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42092/0 (socket says 172.21.15.60:42092) 2020-10-31T22:41:31.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b48f1c700 1 -- 172.21.15.60:0/1205299123 learned_addr learned my addr 172.21.15.60:0/1205299123 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:31.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b4971d700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b44062ad0 0x7f6b4413fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b43fff700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b4405ba80 0x7f6b4413f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b48f1c700 1 -- 172.21.15.60:0/1205299123 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b44062ad0 msgr2=0x7f6b4413fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b48f1c700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b44062ad0 0x7f6b4413fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b48f1c700 1 -- 172.21.15.60:0/1205299123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b4405ba80 msgr2=0x7f6b4413f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:31.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b48f1c700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b4405ba80 0x7f6b4413f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:31.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b48f1c700 1 -- 172.21.15.60:0/1205299123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b44146970 con 0x7f6b4405afe0 2020-10-31T22:41:31.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b43fff700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b4405ba80 0x7f6b4413f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:31.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b48f1c700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4405afe0 0x7f6b44141920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f6b340032b0 tx=0x7f6b34016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:31.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b41ffb700 1 -- 172.21.15.60:0/1205299123 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b340107a0 con 0x7f6b4405afe0 2020-10-31T22:41:31.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b41ffb700 1 -- 172.21.15.60:0/1205299123 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b34010900 con 0x7f6b4405afe0 2020-10-31T22:41:31.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b4b180700 1 -- 172.21.15.60:0/1205299123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4413ffd0 con 0x7f6b4405afe0 2020-10-31T22:41:31.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b41ffb700 1 -- 172.21.15.60:0/1205299123 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b34010c60 con 0x7f6b4405afe0 2020-10-31T22:41:31.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b4b180700 1 -- 172.21.15.60:0/1205299123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b44147f80 con 0x7f6b4405afe0 2020-10-31T22:41:31.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.851+0000 7f6b4b180700 1 -- 172.21.15.60:0/1205299123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b44057100 con 0x7f6b4405afe0 2020-10-31T22:41:31.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.855+0000 7f6b41ffb700 1 -- 172.21.15.60:0/1205299123 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6b3401e070 con 0x7f6b4405afe0 2020-10-31T22:41:31.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.855+0000 7f6b41ffb700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6b24054f90 0x7f6b24057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:31.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.855+0000 7f6b43fff700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6b24054f90 0x7f6b24057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:31.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.855+0000 7f6b41ffb700 1 -- 172.21.15.60:0/1205299123 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6b3406eb00 con 0x7f6b4405afe0 2020-10-31T22:41:31.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.855+0000 7f6b43fff700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6b24054f90 0x7f6b24057450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f6b3800b000 tx=0x7f6b38009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:31.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:31.859+0000 7f6b41ffb700 1 -- 172.21.15.60:0/1205299123 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6b34070e60 con 0x7f6b4405afe0 2020-10-31T22:41:32.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.003+0000 7f6b4b180700 1 -- 172.21.15.60:0/1205299123 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f6b44146b00 con 0x7f6b4405afe0 2020-10-31T22:41:32.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.003+0000 7f6b41ffb700 1 -- 172.21.15.60:0/1205299123 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f6b34015030 con 0x7f6b4405afe0 2020-10-31T22:41:32.008 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:41:32.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.007+0000 7f6b4b180700 1 -- 172.21.15.60:0/1205299123 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6b24054f90 msgr2=0x7f6b24057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.007+0000 7f6b4b180700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6b24054f90 0x7f6b24057450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f6b3800b000 tx=0x7f6b38009040).stop 2020-10-31T22:41:32.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.007+0000 7f6b4b180700 1 -- 172.21.15.60:0/1205299123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4405afe0 msgr2=0x7f6b44141920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.007+0000 7f6b4b180700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4405afe0 0x7f6b44141920 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f6b340032b0 tx=0x7f6b34016000).stop 2020-10-31T22:41:32.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.007+0000 7f6b4b180700 1 -- 172.21.15.60:0/1205299123 shutdown_connections 2020-10-31T22:41:32.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.007+0000 7f6b4b180700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b44062ad0 0x7f6b4413fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.007+0000 7f6b4b180700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b4405afe0 0x7f6b44141920 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.007+0000 7f6b4b180700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6b24054f90 0x7f6b24057450 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.007+0000 7f6b4b180700 1 --2- 172.21.15.60:0/1205299123 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b4405ba80 0x7f6b4413f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.007+0000 7f6b4b180700 1 -- 172.21.15.60:0/1205299123 >> 172.21.15.60:0/1205299123 conn(0x7f6b4405fae0 msgr2=0x7f6b440adfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:32.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.007+0000 7f6b4b180700 1 -- 172.21.15.60:0/1205299123 shutdown_connections 2020-10-31T22:41:32.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.007+0000 7f6b4b180700 1 -- 172.21.15.60:0/1205299123 wait complete. 2020-10-31T22:41:32.029 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:41:32.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.139+0000 7fcaea53f700 1 Processor -- start 2020-10-31T22:41:32.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.139+0000 7fcaea53f700 1 -- start start 2020-10-31T22:41:32.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcae40b5570 0x7fcae40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcae4141f00 0x7fcae4142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae40b4440 con 0x7fcae40b24a0 2020-10-31T22:41:32.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae413f930 con 0x7fcae4141f00 2020-10-31T22:41:32.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae4146060 con 0x7fcae40b5570 2020-10-31T22:41:32.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcae9d3e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcae4141f00 0x7fcae4142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcae9d3e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcae4141f00 0x7fcae4142390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42104/0 (socket says 172.21.15.60:42104) 2020-10-31T22:41:32.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcae9d3e700 1 -- 172.21.15.60:0/3342925453 learned_addr learned my addr 172.21.15.60:0/3342925453 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:32.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcae953d700 1 --2- 172.21.15.60:0/3342925453 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcae40b5570 0x7fcae40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcae9d3e700 1 -- 172.21.15.60:0/3342925453 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcae40b5570 msgr2=0x7fcae40b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:32.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcae9d3e700 1 --2- 172.21.15.60:0/3342925453 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcae40b5570 0x7fcae40b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcae9d3e700 1 -- 172.21.15.60:0/3342925453 >> v1:172.21.15.66:6789/0 conn(0x7fcae40b24a0 legacy=0x7fcae4145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcae9d3e700 1 -- 172.21.15.60:0/3342925453 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae40b02f0 con 0x7fcae4141f00 2020-10-31T22:41:32.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcae953d700 1 --2- 172.21.15.60:0/3342925453 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcae40b5570 0x7fcae40b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:41:32.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcae9d3e700 1 --2- 172.21.15.60:0/3342925453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae4141f00 0x7fcae4142390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fcadc0032b0 tx=0x7fcadc009270).ready entity=mon.0 client_cookie=a1af86268e652dab server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:32.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcacffff700 1 -- 172.21.15.60:0/3342925453 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcadc00bc00 con 0x7fcae4141f00 2020-10-31T22:41:32.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcacffff700 1 -- 172.21.15.60:0/3342925453 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcadc00bd60 con 0x7fcae4141f00 2020-10-31T22:41:32.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcacffff700 1 -- 172.21.15.60:0/3342925453 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcadc011400 con 0x7fcae4141f00 2020-10-31T22:41:32.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 -- 172.21.15.60:0/3342925453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae4141f00 msgr2=0x7fcae4142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 --2- 172.21.15.60:0/3342925453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae4141f00 0x7fcae4142390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fcadc0032b0 tx=0x7fcadc009270).stop 2020-10-31T22:41:32.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 -- 172.21.15.60:0/3342925453 shutdown_connections 2020-10-31T22:41:32.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 --2- 172.21.15.60:0/3342925453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae4141f00 0x7fcae4142390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 --2- 172.21.15.60:0/3342925453 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcae40b5570 0x7fcae40b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 -- 172.21.15.60:0/3342925453 >> 172.21.15.60:0/3342925453 conn(0x7fcae40b8e90 msgr2=0x7fcae40b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:32.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 -- 172.21.15.60:0/3342925453 shutdown_connections 2020-10-31T22:41:32.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 -- 172.21.15.60:0/3342925453 wait complete. 2020-10-31T22:41:32.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 Processor -- start 2020-10-31T22:41:32.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.143+0000 7fcaea53f700 1 -- start start 2020-10-31T22:41:32.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcaea53f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcae40b24a0 0x7fcae4151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcaea53f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcae40b5570 0x7fcae4146450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcaea53f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae4141f00 0x7fcae41477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcaea53f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae4153e50 con 0x7fcae4141f00 2020-10-31T22:41:32.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcaea53f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae4141910 con 0x7fcae40b24a0 2020-10-31T22:41:32.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcaea53f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcae41517f0 con 0x7fcae40b5570 2020-10-31T22:41:32.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcae9d3e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae4141f00 0x7fcae41477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcae953d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcae40b24a0 0x7fcae4151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcae8d3c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcae40b5570 0x7fcae4146450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcae9d3e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae4141f00 0x7fcae41477d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42110/0 (socket says 172.21.15.60:42110) 2020-10-31T22:41:32.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcae9d3e700 1 -- 172.21.15.60:0/3551857592 learned_addr learned my addr 172.21.15.60:0/3551857592 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:32.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcae9d3e700 1 -- 172.21.15.60:0/3551857592 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcae40b5570 msgr2=0x7fcae4146450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcae9d3e700 1 --2- 172.21.15.60:0/3551857592 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcae40b5570 0x7fcae4146450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcae9d3e700 1 -- 172.21.15.60:0/3551857592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcae40b24a0 msgr2=0x7fcae4151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcae9d3e700 1 --2- 172.21.15.60:0/3551857592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcae40b24a0 0x7fcae4151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcae9d3e700 1 -- 172.21.15.60:0/3551857592 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae4140e80 con 0x7fcae4141f00 2020-10-31T22:41:32.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcae8d3c700 1 --2- 172.21.15.60:0/3551857592 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcae40b5570 0x7fcae4146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:32.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcae9d3e700 1 --2- 172.21.15.60:0/3551857592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae4141f00 0x7fcae41477d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fcadc0032b0 tx=0x7fcadc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:32.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcad6ffd700 1 -- 172.21.15.60:0/3551857592 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcadc01f3f0 con 0x7fcae4141f00 2020-10-31T22:41:32.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcad6ffd700 1 -- 172.21.15.60:0/3551857592 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcadc01f550 con 0x7fcae4141f00 2020-10-31T22:41:32.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcaea53f700 1 -- 172.21.15.60:0/3551857592 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae4141120 con 0x7fcae4141f00 2020-10-31T22:41:32.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcad6ffd700 1 -- 172.21.15.60:0/3551857592 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcadc01f8b0 con 0x7fcae4141f00 2020-10-31T22:41:32.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.147+0000 7fcaea53f700 1 -- 172.21.15.60:0/3551857592 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae4146fc0 con 0x7fcae4141f00 2020-10-31T22:41:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.151+0000 7fcaea53f700 1 -- 172.21.15.60:0/3551857592 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae4153f90 con 0x7fcae4141f00 2020-10-31T22:41:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.151+0000 7fcad6ffd700 1 -- 172.21.15.60:0/3551857592 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fcadc026030 con 0x7fcae4141f00 2020-10-31T22:41:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.151+0000 7fcad6ffd700 1 --2- 172.21.15.60:0/3551857592 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcac0054f90 0x7fcac0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.151+0000 7fcad6ffd700 1 -- 172.21.15.60:0/3551857592 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcadc06e530 con 0x7fcae4141f00 2020-10-31T22:41:32.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.151+0000 7fcae953d700 1 --2- 172.21.15.60:0/3551857592 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcac0054f90 0x7fcac0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.151+0000 7fcae953d700 1 --2- 172.21.15.60:0/3551857592 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcac0054f90 0x7fcac0057450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fcad800d000 tx=0x7fcad8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:32.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.159+0000 7fcad6ffd700 1 -- 172.21.15.60:0/3551857592 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcadc044a50 con 0x7fcae4141f00 2020-10-31T22:41:32.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.299+0000 7fcaea53f700 1 -- 172.21.15.60:0/3551857592 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcae4146fc0 con 0x7fcae4141f00 2020-10-31T22:41:32.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.299+0000 7fcad6ffd700 1 -- 172.21.15.60:0/3551857592 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcae4146fc0 con 0x7fcae4141f00 2020-10-31T22:41:32.304 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:32.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.303+0000 7fcaea53f700 1 -- 172.21.15.60:0/3551857592 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcac0054f90 msgr2=0x7fcac0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.303+0000 7fcaea53f700 1 --2- 172.21.15.60:0/3551857592 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcac0054f90 0x7fcac0057450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fcad800d000 tx=0x7fcad8008040).stop 2020-10-31T22:41:32.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.303+0000 7fcaea53f700 1 -- 172.21.15.60:0/3551857592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae4141f00 msgr2=0x7fcae41477d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.303+0000 7fcaea53f700 1 --2- 172.21.15.60:0/3551857592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae4141f00 0x7fcae41477d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fcadc0032b0 tx=0x7fcadc016000).stop 2020-10-31T22:41:32.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.303+0000 7fcaea53f700 1 -- 172.21.15.60:0/3551857592 shutdown_connections 2020-10-31T22:41:32.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.303+0000 7fcaea53f700 1 --2- 172.21.15.60:0/3551857592 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcae4141f00 0x7fcae41477d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.303+0000 7fcaea53f700 1 --2- 172.21.15.60:0/3551857592 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcac0054f90 0x7fcac0057450 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.303+0000 7fcaea53f700 1 --2- 172.21.15.60:0/3551857592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcae40b24a0 0x7fcae4151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.303+0000 7fcaea53f700 1 --2- 172.21.15.60:0/3551857592 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcae40b5570 0x7fcae4146450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.303+0000 7fcaea53f700 1 -- 172.21.15.60:0/3551857592 >> 172.21.15.60:0/3551857592 conn(0x7fcae40b8e90 msgr2=0x7fcae4142310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:32.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.303+0000 7fcaea53f700 1 -- 172.21.15.60:0/3551857592 shutdown_connections 2020-10-31T22:41:32.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.303+0000 7fcaea53f700 1 -- 172.21.15.60:0/3551857592 wait complete. 2020-10-31T22:41:32.318 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:41:32.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.435+0000 7fd301a3e700 1 Processor -- start 2020-10-31T22:41:32.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.435+0000 7fd301a3e700 1 -- start start 2020-10-31T22:41:32.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd301a3e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd2fc0b5380 0x7fd2fc0ac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd301a3e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2fc0b1000 0x7fd2fc0b2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd301a3e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2fc0acd60 con 0x7fd2fc0b0b50 2020-10-31T22:41:32.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd301a3e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc0ad650 con 0x7fd2fc0b5380 2020-10-31T22:41:32.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd301a3e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0b5760 con 0x7fd2fc0b1000 2020-10-31T22:41:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd300a3c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd2fc0b5380 0x7fd2fc0ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd30123d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2fc0b1000 0x7fd2fc0b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd2f3fff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd2fc0b0b50 0x7fd2fc0b1b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:44118/0 (socket says 172.21.15.60:44118) 2020-10-31T22:41:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd2f3fff700 1 -- 172.21.15.60:0/2714864574 learned_addr learned my addr 172.21.15.60:0/2714864574 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:32.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd30123d700 1 -- 172.21.15.60:0/2714864574 >> v2:172.21.15.66:3300/0 conn(0x7fd2fc0b5380 msgr2=0x7fd2fc0ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:32.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd30123d700 1 --2- 172.21.15.60:0/2714864574 >> v2:172.21.15.66:3300/0 conn(0x7fd2fc0b5380 0x7fd2fc0ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd30123d700 1 -- 172.21.15.60:0/2714864574 >> v1:172.21.15.66:6789/0 conn(0x7fd2fc0b0b50 legacy=0x7fd2fc0b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd30123d700 1 -- 172.21.15.60:0/2714864574 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc0afba0 con 0x7fd2fc0b1000 2020-10-31T22:41:32.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd30123d700 1 --2- 172.21.15.60:0/2714864574 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2fc0b1000 0x7fd2fc0b2230 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd2f40032b0 tx=0x7fd2f40091a0).ready entity=mon.2 client_cookie=600b501d0d45aa25 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:32.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd2f37fe700 1 -- 172.21.15.60:0/2714864574 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f400b9a0 con 0x7fd2fc0b1000 2020-10-31T22:41:32.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd2f37fe700 1 -- 172.21.15.60:0/2714864574 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f400bb00 con 0x7fd2fc0b1000 2020-10-31T22:41:32.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd2f37fe700 1 -- 172.21.15.60:0/2714864574 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f400bc70 con 0x7fd2fc0b1000 2020-10-31T22:41:32.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd301a3e700 1 -- 172.21.15.60:0/2714864574 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2fc0b1000 msgr2=0x7fd2fc0b2230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd301a3e700 1 --2- 172.21.15.60:0/2714864574 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2fc0b1000 0x7fd2fc0b2230 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd2f40032b0 tx=0x7fd2f40091a0).stop 2020-10-31T22:41:32.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd301a3e700 1 -- 172.21.15.60:0/2714864574 shutdown_connections 2020-10-31T22:41:32.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd301a3e700 1 --2- 172.21.15.60:0/2714864574 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2fc0b1000 0x7fd2fc0b2230 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd301a3e700 1 --2- 172.21.15.60:0/2714864574 >> v2:172.21.15.66:3300/0 conn(0x7fd2fc0b5380 0x7fd2fc0ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd301a3e700 1 -- 172.21.15.60:0/2714864574 >> 172.21.15.60:0/2714864574 conn(0x7fd2fc06a600 msgr2=0x7fd2fc060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:32.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd301a3e700 1 -- 172.21.15.60:0/2714864574 shutdown_connections 2020-10-31T22:41:32.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.439+0000 7fd301a3e700 1 -- 172.21.15.60:0/2714864574 wait complete. 2020-10-31T22:41:32.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd301a3e700 1 Processor -- start 2020-10-31T22:41:32.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd301a3e700 1 -- start start 2020-10-31T22:41:32.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd301a3e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2fc0b0b50 0x7fd2fc05b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd301a3e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2fc0b1000 0x7fd2fc146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd301a3e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2fc0b5380 0x7fd2fc0a7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd301a3e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc144910 con 0x7fd2fc0b5380 2020-10-31T22:41:32.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd301a3e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc145a90 con 0x7fd2fc0b1000 2020-10-31T22:41:32.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd301a3e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc144d80 con 0x7fd2fc0b0b50 2020-10-31T22:41:32.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd30123d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2fc0b5380 0x7fd2fc0a7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd30123d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2fc0b5380 0x7fd2fc0a7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42124/0 (socket says 172.21.15.60:42124) 2020-10-31T22:41:32.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd30123d700 1 -- 172.21.15.60:0/3954576286 learned_addr learned my addr 172.21.15.60:0/3954576286 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:32.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd300a3c700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2fc0b0b50 0x7fd2fc05b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd2f3fff700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2fc0b1000 0x7fd2fc146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd30123d700 1 -- 172.21.15.60:0/3954576286 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2fc0b0b50 msgr2=0x7fd2fc05b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd30123d700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2fc0b0b50 0x7fd2fc05b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd30123d700 1 -- 172.21.15.60:0/3954576286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2fc0b1000 msgr2=0x7fd2fc146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd30123d700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2fc0b1000 0x7fd2fc146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd30123d700 1 -- 172.21.15.60:0/3954576286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc145020 con 0x7fd2fc0b5380 2020-10-31T22:41:32.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd2f3fff700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2fc0b1000 0x7fd2fc146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:32.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd30123d700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2fc0b5380 0x7fd2fc0a7c90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fd2f40032b0 tx=0x7fd2f4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:32.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd2f1ffb700 1 -- 172.21.15.60:0/3954576286 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f401f3f0 con 0x7fd2fc0b5380 2020-10-31T22:41:32.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd2f1ffb700 1 -- 172.21.15.60:0/3954576286 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f401f550 con 0x7fd2fc0b5380 2020-10-31T22:41:32.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd301a3e700 1 -- 172.21.15.60:0/3954576286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc1452c0 con 0x7fd2fc0b5380 2020-10-31T22:41:32.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd2f1ffb700 1 -- 172.21.15.60:0/3954576286 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2f401f8b0 con 0x7fd2fc0b5380 2020-10-31T22:41:32.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.443+0000 7fd301a3e700 1 -- 172.21.15.60:0/3954576286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc0a36f0 con 0x7fd2fc0b5380 2020-10-31T22:41:32.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.447+0000 7fd301a3e700 1 -- 172.21.15.60:0/3954576286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2fc057100 con 0x7fd2fc0b5380 2020-10-31T22:41:32.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.447+0000 7fd2f1ffb700 1 -- 172.21.15.60:0/3954576286 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd2f400f070 con 0x7fd2fc0b5380 2020-10-31T22:41:32.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.447+0000 7fd2f1ffb700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd2dc054f10 0x7fd2dc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.447+0000 7fd300a3c700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd2dc054f10 0x7fd2dc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.447+0000 7fd2f1ffb700 1 -- 172.21.15.60:0/3954576286 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd2f406e950 con 0x7fd2fc0b5380 2020-10-31T22:41:32.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.447+0000 7fd300a3c700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd2dc054f10 0x7fd2dc0573d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd2f8008000 tx=0x7fd2f8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:32.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.451+0000 7fd2f1ffb700 1 -- 172.21.15.60:0/3954576286 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd2f4044df0 con 0x7fd2fc0b5380 2020-10-31T22:41:32.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.595+0000 7fd301a3e700 1 -- 172.21.15.60:0/3954576286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2fc062750 con 0x7fd2fc0b5380 2020-10-31T22:41:32.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.599+0000 7fd2f1ffb700 1 -- 172.21.15.60:0/3954576286 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd2f40150a0 con 0x7fd2fc0b5380 2020-10-31T22:41:32.601 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:32.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.599+0000 7fd301a3e700 1 -- 172.21.15.60:0/3954576286 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd2dc054f10 msgr2=0x7fd2dc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.599+0000 7fd301a3e700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd2dc054f10 0x7fd2dc0573d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd2f8008000 tx=0x7fd2f8008040).stop 2020-10-31T22:41:32.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.599+0000 7fd301a3e700 1 -- 172.21.15.60:0/3954576286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2fc0b5380 msgr2=0x7fd2fc0a7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.599+0000 7fd301a3e700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2fc0b5380 0x7fd2fc0a7c90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fd2f40032b0 tx=0x7fd2f4016000).stop 2020-10-31T22:41:32.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.599+0000 7fd301a3e700 1 -- 172.21.15.60:0/3954576286 shutdown_connections 2020-10-31T22:41:32.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.599+0000 7fd301a3e700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2fc0b5380 0x7fd2fc0a7c90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.599+0000 7fd301a3e700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2fc0b0b50 0x7fd2fc05b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.599+0000 7fd301a3e700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd2dc054f10 0x7fd2dc0573d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.599+0000 7fd301a3e700 1 --2- 172.21.15.60:0/3954576286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2fc0b1000 0x7fd2fc146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.599+0000 7fd301a3e700 1 -- 172.21.15.60:0/3954576286 >> 172.21.15.60:0/3954576286 conn(0x7fd2fc06a600 msgr2=0x7fd2fc0ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:32.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.599+0000 7fd301a3e700 1 -- 172.21.15.60:0/3954576286 shutdown_connections 2020-10-31T22:41:32.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.599+0000 7fd301a3e700 1 -- 172.21.15.60:0/3954576286 wait complete. 2020-10-31T22:41:32.615 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:41:32.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daf59e700 1 Processor -- start 2020-10-31T22:41:32.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daf59e700 1 -- start start 2020-10-31T22:41:32.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daf59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db0145ac0 0x7f2db00b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daf59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2db0066820 0x7f2db0066c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daf59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db00b22b0 con 0x7f2db00b0de0 2020-10-31T22:41:32.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daf59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db00b2930 con 0x7f2db0066820 2020-10-31T22:41:32.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daf59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00b2bd0 con 0x7f2db0145ac0 2020-10-31T22:41:32.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2db0066820 0x7f2db0066c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2db0066820 0x7f2db0066c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42132/0 (socket says 172.21.15.60:42132) 2020-10-31T22:41:32.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daed9d700 1 -- 172.21.15.60:0/1072278932 learned_addr learned my addr 172.21.15.60:0/1072278932 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:32.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2da7fff700 1 --2- 172.21.15.60:0/1072278932 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db0145ac0 0x7f2db00b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daed9d700 1 -- 172.21.15.60:0/1072278932 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db0145ac0 msgr2=0x7f2db00b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:32.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daed9d700 1 --2- 172.21.15.60:0/1072278932 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db0145ac0 0x7f2db00b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daed9d700 1 -- 172.21.15.60:0/1072278932 >> v1:172.21.15.66:6789/0 conn(0x7f2db00b0de0 legacy=0x7f2db01453b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daed9d700 1 -- 172.21.15.60:0/1072278932 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db00b2e70 con 0x7f2db0066820 2020-10-31T22:41:32.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daed9d700 1 --2- 172.21.15.60:0/1072278932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db0066820 0x7f2db0066c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f2da80032b0 tx=0x7f2da8009270).ready entity=mon.0 client_cookie=61fd979297df749b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:32.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2dadd9b700 1 -- 172.21.15.60:0/1072278932 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da800bc00 con 0x7f2db0066820 2020-10-31T22:41:32.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2dadd9b700 1 -- 172.21.15.60:0/1072278932 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da800bd60 con 0x7f2db0066820 2020-10-31T22:41:32.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daf59e700 1 -- 172.21.15.60:0/1072278932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db0066820 msgr2=0x7f2db0066c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2dadd9b700 1 -- 172.21.15.60:0/1072278932 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da8011400 con 0x7f2db0066820 2020-10-31T22:41:32.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.735+0000 7f2daf59e700 1 --2- 172.21.15.60:0/1072278932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db0066820 0x7f2db0066c80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f2da80032b0 tx=0x7f2da8009270).stop 2020-10-31T22:41:32.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daf59e700 1 -- 172.21.15.60:0/1072278932 shutdown_connections 2020-10-31T22:41:32.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daf59e700 1 --2- 172.21.15.60:0/1072278932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db0066820 0x7f2db0066c80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daf59e700 1 --2- 172.21.15.60:0/1072278932 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db0145ac0 0x7f2db00b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daf59e700 1 -- 172.21.15.60:0/1072278932 >> 172.21.15.60:0/1072278932 conn(0x7f2db0062480 msgr2=0x7f2db0063b00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:32.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daf59e700 1 -- 172.21.15.60:0/1072278932 shutdown_connections 2020-10-31T22:41:32.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daf59e700 1 -- 172.21.15.60:0/1072278932 wait complete. 2020-10-31T22:41:32.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daf59e700 1 Processor -- start 2020-10-31T22:41:32.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daf59e700 1 -- start start 2020-10-31T22:41:32.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daf59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db0066820 0x7f2db00ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daf59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2db00b0de0 0x7f2db01514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daf59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db0145ac0 0x7f2db0144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daf59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00abfd0 con 0x7f2db0145ac0 2020-10-31T22:41:32.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daf59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db01519e0 con 0x7f2db00b0de0 2020-10-31T22:41:32.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daf59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db00ae5b0 con 0x7f2db0066820 2020-10-31T22:41:32.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db0145ac0 0x7f2db0144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db0145ac0 0x7f2db0144410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42138/0 (socket says 172.21.15.60:42138) 2020-10-31T22:41:32.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2daed9d700 1 -- 172.21.15.60:0/1352893572 learned_addr learned my addr 172.21.15.60:0/1352893572 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:32.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2da7fff700 1 --2- 172.21.15.60:0/1352893572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2db00b0de0 0x7f2db01514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.739+0000 7f2dae59c700 1 --2- 172.21.15.60:0/1352893572 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db0066820 0x7f2db00ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2daed9d700 1 -- 172.21.15.60:0/1352893572 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db0066820 msgr2=0x7f2db00ab3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2daed9d700 1 --2- 172.21.15.60:0/1352893572 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db0066820 0x7f2db00ab3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2daed9d700 1 -- 172.21.15.60:0/1352893572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2db00b0de0 msgr2=0x7f2db01514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2daed9d700 1 --2- 172.21.15.60:0/1352893572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2db00b0de0 0x7f2db01514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2daed9d700 1 -- 172.21.15.60:0/1352893572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db00ae850 con 0x7f2db0145ac0 2020-10-31T22:41:32.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2daed9d700 1 --2- 172.21.15.60:0/1352893572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db0145ac0 0x7f2db0144410 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f2da80032b0 tx=0x7f2da8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:32.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2da77fe700 1 -- 172.21.15.60:0/1352893572 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da80107a0 con 0x7f2db0145ac0 2020-10-31T22:41:32.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2da77fe700 1 -- 172.21.15.60:0/1352893572 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da8010900 con 0x7f2db0145ac0 2020-10-31T22:41:32.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2daf59e700 1 -- 172.21.15.60:0/1352893572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db00aeaf0 con 0x7f2db0145ac0 2020-10-31T22:41:32.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2daf59e700 1 -- 172.21.15.60:0/1352893572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db00a6570 con 0x7f2db0145ac0 2020-10-31T22:41:32.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2da77fe700 1 -- 172.21.15.60:0/1352893572 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2da8010c60 con 0x7f2db0145ac0 2020-10-31T22:41:32.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2daf59e700 1 -- 172.21.15.60:0/1352893572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db0057100 con 0x7f2db0145ac0 2020-10-31T22:41:32.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2da77fe700 1 -- 172.21.15.60:0/1352893572 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2da8026030 con 0x7f2db0145ac0 2020-10-31T22:41:32.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2da77fe700 1 --2- 172.21.15.60:0/1352893572 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2d94054f10 0x7f2d940573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:32.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2da77fe700 1 -- 172.21.15.60:0/1352893572 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2da806ec50 con 0x7f2db0145ac0 2020-10-31T22:41:32.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2dae59c700 1 --2- 172.21.15.60:0/1352893572 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2d94054f10 0x7f2d940573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:32.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.743+0000 7f2dae59c700 1 --2- 172.21.15.60:0/1352893572 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2d94054f10 0x7f2d940573d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2da000b000 tx=0x7f2da0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:32.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.755+0000 7f2da77fe700 1 -- 172.21.15.60:0/1352893572 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2da80451c0 con 0x7f2db0145ac0 2020-10-31T22:41:32.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.899+0000 7f2daf59e700 1 -- 172.21.15.60:0/1352893572 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2db005a870 con 0x7f2db0145ac0 2020-10-31T22:41:32.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.899+0000 7f2da77fe700 1 -- 172.21.15.60:0/1352893572 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f2da80240a0 con 0x7f2db0145ac0 2020-10-31T22:41:32.903 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:32.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.903+0000 7f2daf59e700 1 -- 172.21.15.60:0/1352893572 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2d94054f10 msgr2=0x7f2d940573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.903+0000 7f2daf59e700 1 --2- 172.21.15.60:0/1352893572 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2d94054f10 0x7f2d940573d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f2da000b000 tx=0x7f2da0009040).stop 2020-10-31T22:41:32.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.903+0000 7f2daf59e700 1 -- 172.21.15.60:0/1352893572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db0145ac0 msgr2=0x7f2db0144410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:32.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.903+0000 7f2daf59e700 1 --2- 172.21.15.60:0/1352893572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db0145ac0 0x7f2db0144410 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f2da80032b0 tx=0x7f2da8016000).stop 2020-10-31T22:41:32.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.903+0000 7f2daf59e700 1 -- 172.21.15.60:0/1352893572 shutdown_connections 2020-10-31T22:41:32.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.903+0000 7f2daf59e700 1 --2- 172.21.15.60:0/1352893572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2db0145ac0 0x7f2db0144410 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.903+0000 7f2daf59e700 1 --2- 172.21.15.60:0/1352893572 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db0066820 0x7f2db00ab3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.903+0000 7f2daf59e700 1 --2- 172.21.15.60:0/1352893572 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2d94054f10 0x7f2d940573d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.903+0000 7f2daf59e700 1 --2- 172.21.15.60:0/1352893572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2db00b0de0 0x7f2db01514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:32.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.903+0000 7f2daf59e700 1 -- 172.21.15.60:0/1352893572 >> 172.21.15.60:0/1352893572 conn(0x7f2db0062480 msgr2=0x7f2db0065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:32.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.903+0000 7f2daf59e700 1 -- 172.21.15.60:0/1352893572 shutdown_connections 2020-10-31T22:41:32.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:32.903+0000 7f2daf59e700 1 -- 172.21.15.60:0/1352893572 wait complete. 2020-10-31T22:41:32.917 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:33.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70d15ef700 1 Processor -- start 2020-10-31T22:41:33.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70d15ef700 1 -- start start 2020-10-31T22:41:33.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70d15ef700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f70cc0631c0 0x7f70cc0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70d15ef700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f70cc0a9130 0x7f70cc143010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70d15ef700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70cc0b03b0 con 0x7f70cc0ae740 2020-10-31T22:41:33.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70d15ef700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70cc0b15e0 con 0x7f70cc0a9130 2020-10-31T22:41:33.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70d15ef700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70cc0635a0 con 0x7f70cc0631c0 2020-10-31T22:41:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70d0dee700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f70cc0ae740 0x7f70cc0ab860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46282/0 (socket says 172.21.15.60:46282) 2020-10-31T22:41:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70d0dee700 1 -- 172.21.15.60:0/86374637 learned_addr learned my addr 172.21.15.60:0/86374637 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:33.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70cb7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f70cc0a9130 0x7f70cc143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70cbfff700 1 --2- 172.21.15.60:0/86374637 >> v2:172.21.15.66:3300/0 conn(0x7f70cc0631c0 0x7f70cc0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70caffd700 1 -- 172.21.15.60:0/86374637 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820218603 0 0) 0x7f70cc0b03b0 con 0x7f70cc0ae740 2020-10-31T22:41:33.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70caffd700 1 -- 172.21.15.60:0/86374637 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70b8003230 con 0x7f70cc0ae740 2020-10-31T22:41:33.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70cb7fe700 1 -- 172.21.15.60:0/86374637 >> v2:172.21.15.66:3300/0 conn(0x7f70cc0631c0 msgr2=0x7f70cc0b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:33.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70cb7fe700 1 --2- 172.21.15.60:0/86374637 >> v2:172.21.15.66:3300/0 conn(0x7f70cc0631c0 0x7f70cc0b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70cb7fe700 1 -- 172.21.15.60:0/86374637 >> v1:172.21.15.60:6789/0 conn(0x7f70cc0ae740 legacy=0x7f70cc0ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70cb7fe700 1 -- 172.21.15.60:0/86374637 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc0af2c0 con 0x7f70cc0a9130 2020-10-31T22:41:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.027+0000 7f70cb7fe700 1 --2- 172.21.15.60:0/86374637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70cc0a9130 0x7f70cc143010 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f70bc002f30 tx=0x7f70bc006dc0).ready entity=mon.0 client_cookie=10764e6d4c5506b1 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70caffd700 1 -- 172.21.15.60:0/86374637 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70bc0096f0 con 0x7f70cc0a9130 2020-10-31T22:41:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70caffd700 1 -- 172.21.15.60:0/86374637 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70bc009850 con 0x7f70cc0a9130 2020-10-31T22:41:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70caffd700 1 -- 172.21.15.60:0/86374637 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70bc009bb0 con 0x7f70cc0a9130 2020-10-31T22:41:33.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 -- 172.21.15.60:0/86374637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70cc0a9130 msgr2=0x7f70cc143010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 --2- 172.21.15.60:0/86374637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70cc0a9130 0x7f70cc143010 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f70bc002f30 tx=0x7f70bc006dc0).stop 2020-10-31T22:41:33.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 -- 172.21.15.60:0/86374637 shutdown_connections 2020-10-31T22:41:33.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 --2- 172.21.15.60:0/86374637 >> v2:172.21.15.66:3300/0 conn(0x7f70cc0631c0 0x7f70cc0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 --2- 172.21.15.60:0/86374637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70cc0a9130 0x7f70cc143010 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 -- 172.21.15.60:0/86374637 >> 172.21.15.60:0/86374637 conn(0x7f70cc06a600 msgr2=0x7f70cc060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:33.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 -- 172.21.15.60:0/86374637 shutdown_connections 2020-10-31T22:41:33.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 -- 172.21.15.60:0/86374637 wait complete. 2020-10-31T22:41:33.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 Processor -- start 2020-10-31T22:41:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 -- start start 2020-10-31T22:41:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70cc0631c0 0x7f70cc064940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70cc0a9130 0x7f70cc154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70cc0ae740 0x7f70cc0a3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0658c0 con 0x7f70cc0631c0 2020-10-31T22:41:33.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc153e20 con 0x7f70cc0ae740 2020-10-31T22:41:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70d15ef700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc0a8570 con 0x7f70cc0a9130 2020-10-31T22:41:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.031+0000 7f70cbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70cc0631c0 0x7f70cc064940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70cbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70cc0631c0 0x7f70cc064940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42148/0 (socket says 172.21.15.60:42148) 2020-10-31T22:41:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70cbfff700 1 -- 172.21.15.60:0/4098801967 learned_addr learned my addr 172.21.15.60:0/4098801967 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:33.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70d0dee700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70cc0ae740 0x7f70cc0a3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70cb7fe700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70cc0a9130 0x7f70cc154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70cbfff700 1 -- 172.21.15.60:0/4098801967 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70cc0a9130 msgr2=0x7f70cc154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70cbfff700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70cc0a9130 0x7f70cc154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70cbfff700 1 -- 172.21.15.60:0/4098801967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70cc0ae740 msgr2=0x7f70cc0a3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70cbfff700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70cc0ae740 0x7f70cc0a3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70cbfff700 1 -- 172.21.15.60:0/4098801967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70cc0a82d0 con 0x7f70cc0631c0 2020-10-31T22:41:33.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70d0dee700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70cc0ae740 0x7f70cc0a3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:33.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70cbfff700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70cc0631c0 0x7f70cc064940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f70c000c000 tx=0x7f70c0006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:33.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70c97fa700 1 -- 172.21.15.60:0/4098801967 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c000ca80 con 0x7f70cc0631c0 2020-10-31T22:41:33.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70c97fa700 1 -- 172.21.15.60:0/4098801967 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c000cbe0 con 0x7f70cc0631c0 2020-10-31T22:41:33.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70c97fa700 1 -- 172.21.15.60:0/4098801967 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70c00123f0 con 0x7f70cc0631c0 2020-10-31T22:41:33.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70d15ef700 1 -- 172.21.15.60:0/4098801967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70cc154080 con 0x7f70cc0631c0 2020-10-31T22:41:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70d15ef700 1 -- 172.21.15.60:0/4098801967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70cc066fb0 con 0x7f70cc0631c0 2020-10-31T22:41:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70d15ef700 1 -- 172.21.15.60:0/4098801967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70cc057100 con 0x7f70cc0631c0 2020-10-31T22:41:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70c97fa700 1 -- 172.21.15.60:0/4098801967 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f70c0012550 con 0x7f70cc0631c0 2020-10-31T22:41:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70c97fa700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f70ac054f10 0x7f70ac0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70c97fa700 1 -- 172.21.15.60:0/4098801967 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f70c006de90 con 0x7f70cc0631c0 2020-10-31T22:41:33.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70cb7fe700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f70ac054f10 0x7f70ac0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.035+0000 7f70cb7fe700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f70ac054f10 0x7f70ac0573d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f70bc019000 tx=0x7f70bc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:33.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.043+0000 7f70c97fa700 1 -- 172.21.15.60:0/4098801967 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f70c0044350 con 0x7f70cc0631c0 2020-10-31T22:41:33.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.187+0000 7f70d15ef700 1 -- 172.21.15.60:0/4098801967 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70cc05ed50 con 0x7f70cc0631c0 2020-10-31T22:41:33.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.191+0000 7f70c97fa700 1 -- 172.21.15.60:0/4098801967 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f70c0047970 con 0x7f70cc0631c0 2020-10-31T22:41:33.192 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:33.193 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":22,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:11.059362+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:07.982891+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:08.927092+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:33.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.191+0000 7f70d15ef700 1 -- 172.21.15.60:0/4098801967 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f70ac054f10 msgr2=0x7f70ac0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.191+0000 7f70d15ef700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f70ac054f10 0x7f70ac0573d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f70bc019000 tx=0x7f70bc015000).stop 2020-10-31T22:41:33.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.191+0000 7f70d15ef700 1 -- 172.21.15.60:0/4098801967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70cc0631c0 msgr2=0x7f70cc064940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.191+0000 7f70d15ef700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70cc0631c0 0x7f70cc064940 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f70c000c000 tx=0x7f70c0006dc0).stop 2020-10-31T22:41:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.191+0000 7f70d15ef700 1 -- 172.21.15.60:0/4098801967 shutdown_connections 2020-10-31T22:41:33.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.191+0000 7f70d15ef700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f70ac054f10 0x7f70ac0573d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.191+0000 7f70d15ef700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70cc0ae740 0x7f70cc0a3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.191+0000 7f70d15ef700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70cc0631c0 0x7f70cc064940 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.191+0000 7f70d15ef700 1 --2- 172.21.15.60:0/4098801967 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70cc0a9130 0x7f70cc154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.191+0000 7f70d15ef700 1 -- 172.21.15.60:0/4098801967 >> 172.21.15.60:0/4098801967 conn(0x7f70cc06a600 msgr2=0x7f70cc141ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.191+0000 7f70d15ef700 1 -- 172.21.15.60:0/4098801967 shutdown_connections 2020-10-31T22:41:33.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.191+0000 7f70d15ef700 1 -- 172.21.15.60:0/4098801967 wait complete. 2020-10-31T22:41:33.207 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:41:07.982891+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:41:08.927092+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:41:33.208 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:41:33.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.323+0000 7f703d37a700 1 Processor -- start 2020-10-31T22:41:33.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.323+0000 7f703d37a700 1 -- start start 2020-10-31T22:41:33.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f703d37a700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f703813fd20 0x7f70380b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f703d37a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f70380664e0 0x7f7038143890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f703d37a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70380653c0 con 0x7f70380b0dc0 2020-10-31T22:41:33.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f703d37a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7038066930 con 0x7f70380664e0 2020-10-31T22:41:33.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f703d37a700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7038066b10 con 0x7f703813fd20 2020-10-31T22:41:33.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f70377fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f70380664e0 0x7f7038143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f70377fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f70380664e0 0x7f7038143890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42160/0 (socket says 172.21.15.60:42160) 2020-10-31T22:41:33.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f70377fe700 1 -- 172.21.15.60:0/3709466589 learned_addr learned my addr 172.21.15.60:0/3709466589 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:33.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f7036ffd700 1 --1- 172.21.15.60:0/3709466589 >> v1:172.21.15.60:6789/0 conn(0x7f70380b0dc0 0x7f703813d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46292/0 (socket says 172.21.15.60:46292) 2020-10-31T22:41:33.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f70367fc700 1 --2- 172.21.15.60:0/3709466589 >> v2:172.21.15.66:3300/0 conn(0x7f703813fd20 0x7f70380b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f70377fe700 1 -- 172.21.15.60:0/3709466589 >> v2:172.21.15.66:3300/0 conn(0x7f703813fd20 msgr2=0x7f70380b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:33.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f70377fe700 1 --2- 172.21.15.60:0/3709466589 >> v2:172.21.15.66:3300/0 conn(0x7f703813fd20 0x7f70380b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f70377fe700 1 -- 172.21.15.60:0/3709466589 >> v1:172.21.15.60:6789/0 conn(0x7f70380b0dc0 legacy=0x7f703813d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f70377fe700 1 -- 172.21.15.60:0/3709466589 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038066db0 con 0x7f70380664e0 2020-10-31T22:41:33.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f70367fc700 1 --2- 172.21.15.60:0/3709466589 >> v2:172.21.15.66:3300/0 conn(0x7f703813fd20 0x7f70380b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:33.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f70377fe700 1 --2- 172.21.15.60:0/3709466589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70380664e0 0x7f7038143890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f70300032b0 tx=0x7f7030009270).ready entity=mon.0 client_cookie=93892c84d7715053 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:33.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f7035ffb700 1 -- 172.21.15.60:0/3709466589 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f703000bc00 con 0x7f70380664e0 2020-10-31T22:41:33.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f7035ffb700 1 -- 172.21.15.60:0/3709466589 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703000bd60 con 0x7f70380664e0 2020-10-31T22:41:33.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f7035ffb700 1 -- 172.21.15.60:0/3709466589 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7030011400 con 0x7f70380664e0 2020-10-31T22:41:33.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f703d37a700 1 -- 172.21.15.60:0/3709466589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70380664e0 msgr2=0x7f7038143890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f703d37a700 1 --2- 172.21.15.60:0/3709466589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70380664e0 0x7f7038143890 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f70300032b0 tx=0x7f7030009270).stop 2020-10-31T22:41:33.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f703d37a700 1 -- 172.21.15.60:0/3709466589 shutdown_connections 2020-10-31T22:41:33.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f703d37a700 1 --2- 172.21.15.60:0/3709466589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70380664e0 0x7f7038143890 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f703d37a700 1 --2- 172.21.15.60:0/3709466589 >> v2:172.21.15.66:3300/0 conn(0x7f703813fd20 0x7f70380b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f703d37a700 1 -- 172.21.15.60:0/3709466589 >> 172.21.15.60:0/3709466589 conn(0x7f703806a260 msgr2=0x7f7038063c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:33.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f703d37a700 1 -- 172.21.15.60:0/3709466589 shutdown_connections 2020-10-31T22:41:33.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.327+0000 7f703d37a700 1 -- 172.21.15.60:0/3709466589 wait complete. 2020-10-31T22:41:33.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f703d37a700 1 Processor -- start 2020-10-31T22:41:33.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f703d37a700 1 -- start start 2020-10-31T22:41:33.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f703d37a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70380664e0 0x7f7038141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f703d37a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70380b0dc0 0x7f70380b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f703d37a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f703813fd20 0x7f70380b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f703d37a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7038151c80 con 0x7f703813fd20 2020-10-31T22:41:33.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f703d37a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70381410a0 con 0x7f70380664e0 2020-10-31T22:41:33.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f703d37a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70381412d0 con 0x7f70380b0dc0 2020-10-31T22:41:33.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f70377fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f703813fd20 0x7f70380b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f70377fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f703813fd20 0x7f70380b56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42166/0 (socket says 172.21.15.60:42166) 2020-10-31T22:41:33.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f70377fe700 1 -- 172.21.15.60:0/3525835843 learned_addr learned my addr 172.21.15.60:0/3525835843 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:33.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f70367fc700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70380b0dc0 0x7f70380b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f7036ffd700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70380664e0 0x7f7038141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f70377fe700 1 -- 172.21.15.60:0/3525835843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70380b0dc0 msgr2=0x7f70380b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f70377fe700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70380b0dc0 0x7f70380b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f70377fe700 1 -- 172.21.15.60:0/3525835843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70380664e0 msgr2=0x7f7038141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f70377fe700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70380664e0 0x7f7038141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f70377fe700 1 -- 172.21.15.60:0/3525835843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038141570 con 0x7f703813fd20 2020-10-31T22:41:33.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f7036ffd700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70380664e0 0x7f7038141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:33.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.331+0000 7f70377fe700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f703813fd20 0x7f70380b56f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f70300032b0 tx=0x7f7030016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:33.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.335+0000 7f7027fff700 1 -- 172.21.15.60:0/3525835843 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f703001f670 con 0x7f703813fd20 2020-10-31T22:41:33.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.335+0000 7f7027fff700 1 -- 172.21.15.60:0/3525835843 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703001f7d0 con 0x7f703813fd20 2020-10-31T22:41:33.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.335+0000 7f7027fff700 1 -- 172.21.15.60:0/3525835843 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f703001fb30 con 0x7f703813fd20 2020-10-31T22:41:33.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.335+0000 7f703d37a700 1 -- 172.21.15.60:0/3525835843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7038060ea0 con 0x7f703813fd20 2020-10-31T22:41:33.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.335+0000 7f703d37a700 1 -- 172.21.15.60:0/3525835843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7038150ec0 con 0x7f703813fd20 2020-10-31T22:41:33.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.335+0000 7f703d37a700 1 -- 172.21.15.60:0/3525835843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70380b4290 con 0x7f703813fd20 2020-10-31T22:41:33.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.335+0000 7f7027fff700 1 -- 172.21.15.60:0/3525835843 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7030026030 con 0x7f703813fd20 2020-10-31T22:41:33.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.335+0000 7f7027fff700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7014054f10 0x7f70140573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.335+0000 7f7027fff700 1 -- 172.21.15.60:0/3525835843 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f703006f170 con 0x7f703813fd20 2020-10-31T22:41:33.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.335+0000 7f7036ffd700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7014054f10 0x7f70140573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.339+0000 7f7036ffd700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7014054f10 0x7f70140573d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f702800b000 tx=0x7f70280070d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:33.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.343+0000 7f7027fff700 1 -- 172.21.15.60:0/3525835843 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f70380b4290 con 0x7f703813fd20 2020-10-31T22:41:33.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.483+0000 7f703d37a700 1 -- 172.21.15.60:0/3525835843 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f70380b4290 con 0x7f703813fd20 2020-10-31T22:41:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.483+0000 7f7027fff700 1 -- 172.21.15.60:0/3525835843 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7f70380b4290 con 0x7f703813fd20 2020-10-31T22:41:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.487+0000 7f703d37a700 1 -- 172.21.15.60:0/3525835843 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7014054f10 msgr2=0x7f70140573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.487+0000 7f703d37a700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7014054f10 0x7f70140573d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f702800b000 tx=0x7f70280070d0).stop 2020-10-31T22:41:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.487+0000 7f703d37a700 1 -- 172.21.15.60:0/3525835843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f703813fd20 msgr2=0x7f70380b56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.487+0000 7f703d37a700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f703813fd20 0x7f70380b56f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f70300032b0 tx=0x7f7030016000).stop 2020-10-31T22:41:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.487+0000 7f703d37a700 1 -- 172.21.15.60:0/3525835843 shutdown_connections 2020-10-31T22:41:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.487+0000 7f703d37a700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f703813fd20 0x7f70380b56f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.487+0000 7f703d37a700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7014054f10 0x7f70140573d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.487+0000 7f703d37a700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70380664e0 0x7f7038141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.487+0000 7f703d37a700 1 --2- 172.21.15.60:0/3525835843 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70380b0dc0 0x7f70380b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.487+0000 7f703d37a700 1 -- 172.21.15.60:0/3525835843 >> 172.21.15.60:0/3525835843 conn(0x7f703806a260 msgr2=0x7f703813f050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:33.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.487+0000 7f703d37a700 1 -- 172.21.15.60:0/3525835843 shutdown_connections 2020-10-31T22:41:33.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.487+0000 7f703d37a700 1 -- 172.21.15.60:0/3525835843 wait complete. 2020-10-31T22:41:33.494 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:41:33.502 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:41:33.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.619+0000 7f20fffff700 1 Processor -- start 2020-10-31T22:41:33.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.619+0000 7f20fffff700 1 -- start start 2020-10-31T22:41:33.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.619+0000 7f20fffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f210005b320 0x7f21000b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.619+0000 7f20fffff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f21000acc60 0x7f21000b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.619+0000 7f20fffff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210005b700 con 0x7f21000ad610 2020-10-31T22:41:33.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.619+0000 7f20fffff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2100140750 con 0x7f21000acc60 2020-10-31T22:41:33.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.619+0000 7f20fffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21000b0340 con 0x7f210005b320 2020-10-31T22:41:33.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.619+0000 7f20feffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f210005b320 0x7f21000b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.619+0000 7f20fe7fc700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f21000acc60 0x7f21000b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.619+0000 7f20ff7fe700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f21000ad610 0x7f21000ada70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:44178/0 (socket says 172.21.15.60:44178) 2020-10-31T22:41:33.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.619+0000 7f20ff7fe700 1 -- 172.21.15.60:0/3704601895 learned_addr learned my addr 172.21.15.60:0/3704601895 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:33.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20feffd700 1 -- 172.21.15.60:0/3704601895 >> v2:172.21.15.66:3300/0 conn(0x7f21000acc60 msgr2=0x7f21000b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:33.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20feffd700 1 --2- 172.21.15.60:0/3704601895 >> v2:172.21.15.66:3300/0 conn(0x7f21000acc60 0x7f21000b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20feffd700 1 -- 172.21.15.60:0/3704601895 >> v1:172.21.15.66:6789/0 conn(0x7f21000ad610 legacy=0x7f21000ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20feffd700 1 -- 172.21.15.60:0/3704601895 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21000b05e0 con 0x7f210005b320 2020-10-31T22:41:33.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20fe7fc700 1 --2- 172.21.15.60:0/3704601895 >> v2:172.21.15.66:3300/0 conn(0x7f21000acc60 0x7f21000b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:33.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20feffd700 1 --2- 172.21.15.60:0/3704601895 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f210005b320 0x7f21000b1db0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f20f00032b0 tx=0x7f20f00091a0).ready entity=mon.2 client_cookie=ed2bb16a6a6e8db3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:33.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20fdffb700 1 -- 172.21.15.60:0/3704601895 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20f000b9a0 con 0x7f210005b320 2020-10-31T22:41:33.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20fdffb700 1 -- 172.21.15.60:0/3704601895 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f000bb00 con 0x7f210005b320 2020-10-31T22:41:33.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20fdffb700 1 -- 172.21.15.60:0/3704601895 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20f000bc70 con 0x7f210005b320 2020-10-31T22:41:33.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20fffff700 1 -- 172.21.15.60:0/3704601895 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f210005b320 msgr2=0x7f21000b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20fffff700 1 --2- 172.21.15.60:0/3704601895 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f210005b320 0x7f21000b1db0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f20f00032b0 tx=0x7f20f00091a0).stop 2020-10-31T22:41:33.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20fffff700 1 -- 172.21.15.60:0/3704601895 shutdown_connections 2020-10-31T22:41:33.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20fffff700 1 --2- 172.21.15.60:0/3704601895 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f210005b320 0x7f21000b1db0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20fffff700 1 --2- 172.21.15.60:0/3704601895 >> v2:172.21.15.66:3300/0 conn(0x7f21000acc60 0x7f21000b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20fffff700 1 -- 172.21.15.60:0/3704601895 >> 172.21.15.60:0/3704601895 conn(0x7f21000b61d0 msgr2=0x7f21000b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20fffff700 1 -- 172.21.15.60:0/3704601895 shutdown_connections 2020-10-31T22:41:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20fffff700 1 -- 172.21.15.60:0/3704601895 wait complete. 2020-10-31T22:41:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20fffff700 1 Processor -- start 2020-10-31T22:41:33.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.623+0000 7f20fffff700 1 -- start start 2020-10-31T22:41:33.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20fffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f210005b320 0x7f21000649b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20fffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21000acc60 0x7f210013c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20fffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21000ad610 0x7f210013c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20fffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2100063e50 con 0x7f210005b320 2020-10-31T22:41:33.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20fffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210013aad0 con 0x7f21000ad610 2020-10-31T22:41:33.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20fffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210013ad00 con 0x7f21000acc60 2020-10-31T22:41:33.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20feffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f210005b320 0x7f21000649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20feffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f210005b320 0x7f21000649b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42176/0 (socket says 172.21.15.60:42176) 2020-10-31T22:41:33.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20feffd700 1 -- 172.21.15.60:0/2596285588 learned_addr learned my addr 172.21.15.60:0/2596285588 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:33.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20ff7fe700 1 --2- 172.21.15.60:0/2596285588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21000ad610 0x7f210013c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20fe7fc700 1 --2- 172.21.15.60:0/2596285588 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21000acc60 0x7f210013c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20feffd700 1 -- 172.21.15.60:0/2596285588 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21000acc60 msgr2=0x7f210013c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20feffd700 1 --2- 172.21.15.60:0/2596285588 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21000acc60 0x7f210013c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20feffd700 1 -- 172.21.15.60:0/2596285588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21000ad610 msgr2=0x7f210013c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20feffd700 1 --2- 172.21.15.60:0/2596285588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21000ad610 0x7f210013c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20feffd700 1 -- 172.21.15.60:0/2596285588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210014f7a0 con 0x7f210005b320 2020-10-31T22:41:33.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20feffd700 1 --2- 172.21.15.60:0/2596285588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f210005b320 0x7f21000649b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f20f00032b0 tx=0x7f20f0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:33.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20f7fff700 1 -- 172.21.15.60:0/2596285588 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20f001f3f0 con 0x7f210005b320 2020-10-31T22:41:33.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20f7fff700 1 -- 172.21.15.60:0/2596285588 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f001f550 con 0x7f210005b320 2020-10-31T22:41:33.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20f7fff700 1 -- 172.21.15.60:0/2596285588 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20f001f8b0 con 0x7f210005b320 2020-10-31T22:41:33.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20fffff700 1 -- 172.21.15.60:0/2596285588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21000ac680 con 0x7f210005b320 2020-10-31T22:41:33.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.627+0000 7f20fffff700 1 -- 172.21.15.60:0/2596285588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f210013ce10 con 0x7f210005b320 2020-10-31T22:41:33.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.631+0000 7f20fffff700 1 -- 172.21.15.60:0/2596285588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2100057100 con 0x7f210005b320 2020-10-31T22:41:33.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.631+0000 7f20f7fff700 1 -- 172.21.15.60:0/2596285588 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f20f0026030 con 0x7f210005b320 2020-10-31T22:41:33.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.631+0000 7f20f7fff700 1 --2- 172.21.15.60:0/2596285588 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f20e4054f10 0x7f20e40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.631+0000 7f20fe7fc700 1 --2- 172.21.15.60:0/2596285588 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f20e4054f10 0x7f20e40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.631+0000 7f20f7fff700 1 -- 172.21.15.60:0/2596285588 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f20f006e4a0 con 0x7f210005b320 2020-10-31T22:41:33.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.631+0000 7f20fe7fc700 1 --2- 172.21.15.60:0/2596285588 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f20e4054f10 0x7f20e40573d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f20e8008000 tx=0x7f20e8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:33.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.639+0000 7f20f7fff700 1 -- 172.21.15.60:0/2596285588 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f20f00448b0 con 0x7f210005b320 2020-10-31T22:41:33.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.783+0000 7f20fffff700 1 -- 172.21.15.60:0/2596285588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f21000ae950 con 0x7f210005b320 2020-10-31T22:41:33.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.783+0000 7f20f7fff700 1 -- 172.21.15.60:0/2596285588 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f20f0024020 con 0x7f210005b320 2020-10-31T22:41:33.786 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:33.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.783+0000 7f20fffff700 1 -- 172.21.15.60:0/2596285588 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f20e4054f10 msgr2=0x7f20e40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.783+0000 7f20fffff700 1 --2- 172.21.15.60:0/2596285588 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f20e4054f10 0x7f20e40573d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f20e8008000 tx=0x7f20e8008040).stop 2020-10-31T22:41:33.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.783+0000 7f20fffff700 1 -- 172.21.15.60:0/2596285588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f210005b320 msgr2=0x7f21000649b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.783+0000 7f20fffff700 1 --2- 172.21.15.60:0/2596285588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f210005b320 0x7f21000649b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f20f00032b0 tx=0x7f20f0016000).stop 2020-10-31T22:41:33.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.783+0000 7f20fffff700 1 -- 172.21.15.60:0/2596285588 shutdown_connections 2020-10-31T22:41:33.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.783+0000 7f20fffff700 1 --2- 172.21.15.60:0/2596285588 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f20e4054f10 0x7f20e40573d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.783+0000 7f20fffff700 1 --2- 172.21.15.60:0/2596285588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21000ad610 0x7f210013c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.783+0000 7f20fffff700 1 --2- 172.21.15.60:0/2596285588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f210005b320 0x7f21000649b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.783+0000 7f20fffff700 1 --2- 172.21.15.60:0/2596285588 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21000acc60 0x7f210013c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.783+0000 7f20fffff700 1 -- 172.21.15.60:0/2596285588 >> 172.21.15.60:0/2596285588 conn(0x7f21000b61d0 msgr2=0x7f21000b1190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:33.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.783+0000 7f20fffff700 1 -- 172.21.15.60:0/2596285588 shutdown_connections 2020-10-31T22:41:33.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.783+0000 7f20fffff700 1 -- 172.21.15.60:0/2596285588 wait complete. 2020-10-31T22:41:33.799 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:41:33.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.915+0000 7fd8fec94700 1 Processor -- start 2020-10-31T22:41:33.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.915+0000 7fd8fec94700 1 -- start start 2020-10-31T22:41:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.915+0000 7fd8fec94700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8f80ae000 0x7fd8f80b0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.915+0000 7fd8fec94700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd8f80af9b0 0x7fd8f80ac520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.915+0000 7fd8fec94700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f80ae3e0 con 0x7fd8f80ae9c0 2020-10-31T22:41:33.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.915+0000 7fd8fec94700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f80afe30 con 0x7fd8f80af9b0 2020-10-31T22:41:33.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.915+0000 7fd8fec94700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80ad4a0 con 0x7fd8f80ae000 2020-10-31T22:41:33.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.915+0000 7fd8fe493700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd8f80ae9c0 0x7fd8f80b1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46324/0 (socket says 172.21.15.60:46324) 2020-10-31T22:41:33.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.915+0000 7fd8fe493700 1 -- 172.21.15.60:0/3861599297 learned_addr learned my addr 172.21.15.60:0/3861599297 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:33.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.915+0000 7fd8fd491700 1 --2- 172.21.15.60:0/3861599297 >> v2:172.21.15.66:3300/0 conn(0x7fd8f80af9b0 0x7fd8f80ac520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.915+0000 7fd8fdc92700 1 --2- 172.21.15.60:0/3861599297 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8f80ae000 0x7fd8f80b0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.919+0000 7fd8fd491700 1 -- 172.21.15.60:0/3861599297 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8f80ae000 msgr2=0x7fd8f80b0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:33.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.919+0000 7fd8fd491700 1 --2- 172.21.15.60:0/3861599297 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8f80ae000 0x7fd8f80b0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.919+0000 7fd8fd491700 1 -- 172.21.15.60:0/3861599297 >> v1:172.21.15.60:6789/0 conn(0x7fd8f80ae9c0 legacy=0x7fd8f80b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.919+0000 7fd8fd491700 1 -- 172.21.15.60:0/3861599297 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f80b0930 con 0x7fd8f80af9b0 2020-10-31T22:41:33.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.919+0000 7fd8fdc92700 1 --2- 172.21.15.60:0/3861599297 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8f80ae000 0x7fd8f80b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:33.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.919+0000 7fd8fd491700 1 --2- 172.21.15.60:0/3861599297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8f80af9b0 0x7fd8f80ac520 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fd8e8002f30 tx=0x7fd8e8006dc0).ready entity=mon.1 client_cookie=70bf48aa797bfcae server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.919+0000 7fd8fcc90700 1 -- 172.21.15.60:0/3861599297 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e8009760 con 0x7fd8f80af9b0 2020-10-31T22:41:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.919+0000 7fd8fcc90700 1 -- 172.21.15.60:0/3861599297 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e80098c0 con 0x7fd8f80af9b0 2020-10-31T22:41:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.923+0000 7fd8fcc90700 1 -- 172.21.15.60:0/3861599297 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8e8009c20 con 0x7fd8f80af9b0 2020-10-31T22:41:33.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.923+0000 7fd8fec94700 1 -- 172.21.15.60:0/3861599297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8f80af9b0 msgr2=0x7fd8f80ac520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.923+0000 7fd8fec94700 1 --2- 172.21.15.60:0/3861599297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8f80af9b0 0x7fd8f80ac520 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fd8e8002f30 tx=0x7fd8e8006dc0).stop 2020-10-31T22:41:33.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.923+0000 7fd8fec94700 1 -- 172.21.15.60:0/3861599297 shutdown_connections 2020-10-31T22:41:33.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.923+0000 7fd8fec94700 1 --2- 172.21.15.60:0/3861599297 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8f80ae000 0x7fd8f80b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.923+0000 7fd8fec94700 1 --2- 172.21.15.60:0/3861599297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8f80af9b0 0x7fd8f80ac520 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.923+0000 7fd8fec94700 1 -- 172.21.15.60:0/3861599297 >> 172.21.15.60:0/3861599297 conn(0x7fd8f8060de0 msgr2=0x7fd8f8062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:33.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.923+0000 7fd8fec94700 1 -- 172.21.15.60:0/3861599297 shutdown_connections 2020-10-31T22:41:33.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.923+0000 7fd8fec94700 1 -- 172.21.15.60:0/3861599297 wait complete. 2020-10-31T22:41:33.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.923+0000 7fd8fec94700 1 Processor -- start 2020-10-31T22:41:33.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.923+0000 7fd8fec94700 1 -- start start 2020-10-31T22:41:33.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fec94700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8f80ae000 0x7fd8f8137fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fec94700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8f80ae9c0 0x7fd8f80a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fec94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8f80af9b0 0x7fd8f80a5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fec94700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80a6370 con 0x7fd8f80af9b0 2020-10-31T22:41:33.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fec94700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80abc50 con 0x7fd8f80ae000 2020-10-31T22:41:33.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fec94700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80a9080 con 0x7fd8f80ae9c0 2020-10-31T22:41:33.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fe493700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8f80af9b0 0x7fd8f80a5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fe493700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8f80af9b0 0x7fd8f80a5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42194/0 (socket says 172.21.15.60:42194) 2020-10-31T22:41:33.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fe493700 1 -- 172.21.15.60:0/4145792230 learned_addr learned my addr 172.21.15.60:0/4145792230 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:33.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fdc92700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8f80ae000 0x7fd8f8137fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fd491700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8f80ae9c0 0x7fd8f80a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fe493700 1 -- 172.21.15.60:0/4145792230 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8f80ae9c0 msgr2=0x7fd8f80a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fe493700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8f80ae9c0 0x7fd8f80a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fe493700 1 -- 172.21.15.60:0/4145792230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8f80ae000 msgr2=0x7fd8f8137fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:33.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fe493700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8f80ae000 0x7fd8f8137fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:33.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fe493700 1 -- 172.21.15.60:0/4145792230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f8148be0 con 0x7fd8f80af9b0 2020-10-31T22:41:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fd491700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8f80ae9c0 0x7fd8f80a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fe493700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8f80af9b0 0x7fd8f80a5e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fd8f80a64b0 tx=0x7fd8f0007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:33.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8e6ffd700 1 -- 172.21.15.60:0/4145792230 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8f00059b0 con 0x7fd8f80af9b0 2020-10-31T22:41:33.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8e6ffd700 1 -- 172.21.15.60:0/4145792230 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f0005b10 con 0x7fd8f80af9b0 2020-10-31T22:41:33.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fec94700 1 -- 172.21.15.60:0/4145792230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f8148e80 con 0x7fd8f80af9b0 2020-10-31T22:41:33.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8e6ffd700 1 -- 172.21.15.60:0/4145792230 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8f0005e70 con 0x7fd8f80af9b0 2020-10-31T22:41:33.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fec94700 1 -- 172.21.15.60:0/4145792230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f81384c0 con 0x7fd8f80af9b0 2020-10-31T22:41:33.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.927+0000 7fd8fec94700 1 -- 172.21.15.60:0/4145792230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f80aba70 con 0x7fd8f80af9b0 2020-10-31T22:41:33.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.931+0000 7fd8e6ffd700 1 -- 172.21.15.60:0/4145792230 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd8f0010030 con 0x7fd8f80af9b0 2020-10-31T22:41:33.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.931+0000 7fd8e6ffd700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd8d8054f10 0x7fd8d80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:33.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.931+0000 7fd8fdc92700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd8d8054f10 0x7fd8d80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:33.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.931+0000 7fd8e6ffd700 1 -- 172.21.15.60:0/4145792230 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd8f006d800 con 0x7fd8f80af9b0 2020-10-31T22:41:33.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.931+0000 7fd8fdc92700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd8d8054f10 0x7fd8d80573d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fd8f400b000 tx=0x7fd8f4006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:33.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:33.935+0000 7fd8e6ffd700 1 -- 172.21.15.60:0/4145792230 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd8f0043d20 con 0x7fd8f80af9b0 2020-10-31T22:41:34.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.079+0000 7fd8fec94700 1 -- 172.21.15.60:0/4145792230 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8f8057100 con 0x7fd8f80af9b0 2020-10-31T22:41:34.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.083+0000 7fd8e6ffd700 1 -- 172.21.15.60:0/4145792230 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd8f0047340 con 0x7fd8f80af9b0 2020-10-31T22:41:34.085 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:34.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.083+0000 7fd8fec94700 1 -- 172.21.15.60:0/4145792230 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd8d8054f10 msgr2=0x7fd8d80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.083+0000 7fd8fec94700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd8d8054f10 0x7fd8d80573d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fd8f400b000 tx=0x7fd8f4006dc0).stop 2020-10-31T22:41:34.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.083+0000 7fd8fec94700 1 -- 172.21.15.60:0/4145792230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8f80af9b0 msgr2=0x7fd8f80a5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.083+0000 7fd8fec94700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8f80af9b0 0x7fd8f80a5e80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fd8f80a64b0 tx=0x7fd8f0007e40).stop 2020-10-31T22:41:34.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.083+0000 7fd8fec94700 1 -- 172.21.15.60:0/4145792230 shutdown_connections 2020-10-31T22:41:34.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.083+0000 7fd8fec94700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8f80af9b0 0x7fd8f80a5e80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.083+0000 7fd8fec94700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd8d8054f10 0x7fd8d80573d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.083+0000 7fd8fec94700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8f80ae000 0x7fd8f8137fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.083+0000 7fd8fec94700 1 --2- 172.21.15.60:0/4145792230 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8f80ae9c0 0x7fd8f80a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.083+0000 7fd8fec94700 1 -- 172.21.15.60:0/4145792230 >> 172.21.15.60:0/4145792230 conn(0x7fd8f8060de0 msgr2=0x7fd8f805fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:34.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.083+0000 7fd8fec94700 1 -- 172.21.15.60:0/4145792230 shutdown_connections 2020-10-31T22:41:34.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.083+0000 7fd8fec94700 1 -- 172.21.15.60:0/4145792230 wait complete. 2020-10-31T22:41:34.099 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:41:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.219+0000 7f12e2040700 1 Processor -- start 2020-10-31T22:41:34.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.219+0000 7f12e2040700 1 -- start start 2020-10-31T22:41:34.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.219+0000 7f12e2040700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f12dc05c660 0x7f12dc0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.219+0000 7f12e2040700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12dc0b2e20 0x7f12dc142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.219+0000 7f12e2040700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12dc066410 con 0x7f12dc065f70 2020-10-31T22:41:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.219+0000 7f12e2040700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12dc066d60 con 0x7f12dc05c660 2020-10-31T22:41:34.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.219+0000 7f12e2040700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc0b5e80 con 0x7f12dc0b2e20 2020-10-31T22:41:34.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.219+0000 7f12daffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f12dc065f70 0x7f12dc13f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46334/0 (socket says 172.21.15.60:46334) 2020-10-31T22:41:34.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.219+0000 7f12daffd700 1 -- 172.21.15.60:0/1188085128 learned_addr learned my addr 172.21.15.60:0/1188085128 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:34.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.219+0000 7f12dbfff700 1 --2- 172.21.15.60:0/1188085128 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12dc0b2e20 0x7f12dc142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:34.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.219+0000 7f12db7fe700 1 --2- 172.21.15.60:0/1188085128 >> v2:172.21.15.66:3300/0 conn(0x7f12dc05c660 0x7f12dc0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:34.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12da7fc700 1 -- 172.21.15.60:0/1188085128 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 181535401 0 0) 0x7f12dc066410 con 0x7f12dc065f70 2020-10-31T22:41:34.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12da7fc700 1 -- 172.21.15.60:0/1188085128 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12bc003230 con 0x7f12dc065f70 2020-10-31T22:41:34.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12dbfff700 1 -- 172.21.15.60:0/1188085128 >> v2:172.21.15.66:3300/0 conn(0x7f12dc05c660 msgr2=0x7f12dc0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:34.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12dbfff700 1 --2- 172.21.15.60:0/1188085128 >> v2:172.21.15.66:3300/0 conn(0x7f12dc05c660 0x7f12dc0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12dbfff700 1 -- 172.21.15.60:0/1188085128 >> v1:172.21.15.60:6789/0 conn(0x7f12dc065f70 legacy=0x7f12dc13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12dbfff700 1 -- 172.21.15.60:0/1188085128 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc0666b0 con 0x7f12dc0b2e20 2020-10-31T22:41:34.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12dbfff700 1 --2- 172.21.15.60:0/1188085128 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12dc0b2e20 0x7f12dc142610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f12c40010d0 tx=0x7f12d40091a0).ready entity=mon.2 client_cookie=e272fee24daf4f7 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:34.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12da7fc700 1 -- 172.21.15.60:0/1188085128 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12d400b900 con 0x7f12dc0b2e20 2020-10-31T22:41:34.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12da7fc700 1 -- 172.21.15.60:0/1188085128 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d400ba60 con 0x7f12dc0b2e20 2020-10-31T22:41:34.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12da7fc700 1 -- 172.21.15.60:0/1188085128 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12d400bc10 con 0x7f12dc0b2e20 2020-10-31T22:41:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12e2040700 1 -- 172.21.15.60:0/1188085128 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12dc0b2e20 msgr2=0x7f12dc142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12e2040700 1 --2- 172.21.15.60:0/1188085128 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12dc0b2e20 0x7f12dc142610 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f12c40010d0 tx=0x7f12d40091a0).stop 2020-10-31T22:41:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12e2040700 1 -- 172.21.15.60:0/1188085128 shutdown_connections 2020-10-31T22:41:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12e2040700 1 --2- 172.21.15.60:0/1188085128 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12dc0b2e20 0x7f12dc142610 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12e2040700 1 --2- 172.21.15.60:0/1188085128 >> v2:172.21.15.66:3300/0 conn(0x7f12dc05c660 0x7f12dc0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12e2040700 1 -- 172.21.15.60:0/1188085128 >> 172.21.15.60:0/1188085128 conn(0x7f12dc0601e0 msgr2=0x7f12dc05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:34.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12e2040700 1 -- 172.21.15.60:0/1188085128 shutdown_connections 2020-10-31T22:41:34.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12e2040700 1 -- 172.21.15.60:0/1188085128 wait complete. 2020-10-31T22:41:34.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12e2040700 1 Processor -- start 2020-10-31T22:41:34.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.223+0000 7f12e2040700 1 -- start start 2020-10-31T22:41:34.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12e2040700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc05c660 0x7f12dc0ab110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:34.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12e2040700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12dc065f70 0x7f12dc0ac380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:34.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12e2040700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12dc0b2e20 0x7f12dc0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:34.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12e2040700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc0abab0 con 0x7f12dc05c660 2020-10-31T22:41:34.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12e2040700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc0a8ec0 con 0x7f12dc0b2e20 2020-10-31T22:41:34.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12e2040700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12dc0ab750 con 0x7f12dc065f70 2020-10-31T22:41:34.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12db7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc05c660 0x7f12dc0ab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:34.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12db7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc05c660 0x7f12dc0ab110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42204/0 (socket says 172.21.15.60:42204) 2020-10-31T22:41:34.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12db7fe700 1 -- 172.21.15.60:0/819295233 learned_addr learned my addr 172.21.15.60:0/819295233 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:34.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12dbfff700 1 --2- 172.21.15.60:0/819295233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12dc0b2e20 0x7f12dc0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:34.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12daffd700 1 --2- 172.21.15.60:0/819295233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12dc065f70 0x7f12dc0ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12db7fe700 1 -- 172.21.15.60:0/819295233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12dc065f70 msgr2=0x7f12dc0ac380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12db7fe700 1 --2- 172.21.15.60:0/819295233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12dc065f70 0x7f12dc0ac380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12db7fe700 1 -- 172.21.15.60:0/819295233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12dc0b2e20 msgr2=0x7f12dc0ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12db7fe700 1 --2- 172.21.15.60:0/819295233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12dc0b2e20 0x7f12dc0ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12db7fe700 1 -- 172.21.15.60:0/819295233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc0abd00 con 0x7f12dc05c660 2020-10-31T22:41:34.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12db7fe700 1 --2- 172.21.15.60:0/819295233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc05c660 0x7f12dc0ab110 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f12cc00c000 tx=0x7f12cc006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12d8ff9700 1 -- 172.21.15.60:0/819295233 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12cc00ca10 con 0x7f12dc05c660 2020-10-31T22:41:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12d8ff9700 1 -- 172.21.15.60:0/819295233 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc00cb70 con 0x7f12dc05c660 2020-10-31T22:41:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12d8ff9700 1 -- 172.21.15.60:0/819295233 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f12cc0123f0 con 0x7f12dc05c660 2020-10-31T22:41:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12e2040700 1 -- 172.21.15.60:0/819295233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12dc0af9c0 con 0x7f12dc05c660 2020-10-31T22:41:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12e2040700 1 -- 172.21.15.60:0/819295233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12dc0ad6b0 con 0x7f12dc05c660 2020-10-31T22:41:34.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.227+0000 7f12e2040700 1 -- 172.21.15.60:0/819295233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12dc0ab8c0 con 0x7f12dc05c660 2020-10-31T22:41:34.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.231+0000 7f12d8ff9700 1 -- 172.21.15.60:0/819295233 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f12cc012550 con 0x7f12dc05c660 2020-10-31T22:41:34.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.231+0000 7f12d8ff9700 1 --2- 172.21.15.60:0/819295233 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f12c0055020 0x7f12c00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:34.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.231+0000 7f12daffd700 1 --2- 172.21.15.60:0/819295233 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f12c0055020 0x7f12c00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:34.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.231+0000 7f12d8ff9700 1 -- 172.21.15.60:0/819295233 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f12cc06de10 con 0x7f12dc05c660 2020-10-31T22:41:34.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.231+0000 7f12daffd700 1 --2- 172.21.15.60:0/819295233 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f12c0055020 0x7f12c00574e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f12c400d000 tx=0x7f12c4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:34.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.239+0000 7f12d8ff9700 1 -- 172.21.15.60:0/819295233 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f12dc0ab8c0 con 0x7f12dc05c660 2020-10-31T22:41:34.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.379+0000 7f12e2040700 1 -- 172.21.15.60:0/819295233 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12dc0ab8c0 con 0x7f12dc05c660 2020-10-31T22:41:34.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.383+0000 7f12d8ff9700 1 -- 172.21.15.60:0/819295233 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+10 (secure 0 0 0) 0x7f12dc0ab8c0 con 0x7f12dc05c660 2020-10-31T22:41:34.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.383+0000 7f12e2040700 1 -- 172.21.15.60:0/819295233 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f12c0055020 msgr2=0x7f12c00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.383+0000 7f12e2040700 1 --2- 172.21.15.60:0/819295233 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f12c0055020 0x7f12c00574e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f12c400d000 tx=0x7f12c4009040).stop 2020-10-31T22:41:34.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.383+0000 7f12e2040700 1 -- 172.21.15.60:0/819295233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc05c660 msgr2=0x7f12dc0ab110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.383+0000 7f12e2040700 1 --2- 172.21.15.60:0/819295233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc05c660 0x7f12dc0ab110 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f12cc00c000 tx=0x7f12cc006dc0).stop 2020-10-31T22:41:34.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.383+0000 7f12e2040700 1 -- 172.21.15.60:0/819295233 shutdown_connections 2020-10-31T22:41:34.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.383+0000 7f12e2040700 1 --2- 172.21.15.60:0/819295233 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f12c0055020 0x7f12c00574e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.383+0000 7f12e2040700 1 --2- 172.21.15.60:0/819295233 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12dc0b2e20 0x7f12dc0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.383+0000 7f12e2040700 1 --2- 172.21.15.60:0/819295233 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12dc05c660 0x7f12dc0ab110 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.383+0000 7f12e2040700 1 --2- 172.21.15.60:0/819295233 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12dc065f70 0x7f12dc0ac380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.383+0000 7f12e2040700 1 -- 172.21.15.60:0/819295233 >> 172.21.15.60:0/819295233 conn(0x7f12dc0601e0 msgr2=0x7f12dc0b78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:34.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.383+0000 7f12e2040700 1 -- 172.21.15.60:0/819295233 shutdown_connections 2020-10-31T22:41:34.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.383+0000 7f12e2040700 1 -- 172.21.15.60:0/819295233 wait complete. 2020-10-31T22:41:34.392 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:34.407 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) 2020-10-31T22:41:34.409 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2020-10-31T22:41:34.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c3759e700 1 Processor -- start 2020-10-31T22:41:34.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c3759e700 1 -- start start 2020-10-31T22:41:34.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c3759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8c38140420 0x7f8c380ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:34.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c3759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3805b700 con 0x7f8c380b2560 2020-10-31T22:41:34.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c3759e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c381408a0 con 0x7f8c3805b320 2020-10-31T22:41:34.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c3759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c380b0220 con 0x7f8c38140420 2020-10-31T22:41:34.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c35d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8c38140420 0x7f8c380ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:34.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c35d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8c38140420 0x7f8c380ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42214/0 (socket says 172.21.15.60:42214) 2020-10-31T22:41:34.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c35d9b700 1 -- 172.21.15.60:0/2947110455 learned_addr learned my addr 172.21.15.60:0/2947110455 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:34.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c36d9d700 1 --1- 172.21.15.60:0/2947110455 >> v1:172.21.15.60:6789/0 conn(0x7f8c380b2560 0x7f8c380adc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46352/0 (socket says 172.21.15.60:46352) 2020-10-31T22:41:34.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c35d9b700 1 -- 172.21.15.60:0/2947110455 >> v1:172.21.15.66:6789/0 conn(0x7f8c3805b320 legacy=0x7f8c380b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c35d9b700 1 -- 172.21.15.60:0/2947110455 >> v1:172.21.15.60:6789/0 conn(0x7f8c380b2560 legacy=0x7f8c380adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c3559a700 1 -- 172.21.15.60:0/2947110455 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130724431 0 0) 0x7f8c381408a0 con 0x7f8c3805b320 2020-10-31T22:41:34.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c35d9b700 1 -- 172.21.15.60:0/2947110455 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c380b04c0 con 0x7f8c38140420 2020-10-31T22:41:34.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c35d9b700 1 --2- 172.21.15.60:0/2947110455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c38140420 0x7f8c380ad7a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f8c300010d0 tx=0x7f8c20006e80).ready entity=mon.0 client_cookie=81738d258ca34dab server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:34.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c3559a700 1 -- 172.21.15.60:0/2947110455 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c200096b0 con 0x7f8c38140420 2020-10-31T22:41:34.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c3559a700 1 -- 172.21.15.60:0/2947110455 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c20009810 con 0x7f8c38140420 2020-10-31T22:41:34.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c3559a700 1 -- 172.21.15.60:0/2947110455 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c20009980 con 0x7f8c38140420 2020-10-31T22:41:34.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c3759e700 1 -- 172.21.15.60:0/2947110455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c38140420 msgr2=0x7f8c380ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c3759e700 1 --2- 172.21.15.60:0/2947110455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c38140420 0x7f8c380ad7a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f8c300010d0 tx=0x7f8c20006e80).stop 2020-10-31T22:41:34.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c3759e700 1 -- 172.21.15.60:0/2947110455 shutdown_connections 2020-10-31T22:41:34.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.527+0000 7f8c3759e700 1 --2- 172.21.15.60:0/2947110455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c38140420 0x7f8c380ad7a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.531+0000 7f8c3759e700 1 -- 172.21.15.60:0/2947110455 >> 172.21.15.60:0/2947110455 conn(0x7f8c380b61d0 msgr2=0x7f8c380b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:34.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.531+0000 7f8c3759e700 1 -- 172.21.15.60:0/2947110455 shutdown_connections 2020-10-31T22:41:34.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.531+0000 7f8c3759e700 1 -- 172.21.15.60:0/2947110455 wait complete. 2020-10-31T22:41:34.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.531+0000 7f8c3759e700 1 Processor -- start 2020-10-31T22:41:34.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.531+0000 7f8c3759e700 1 -- start start 2020-10-31T22:41:34.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c3805b320 0x7f8c38134180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:34.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c380b2560 0x7f8c3814e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:34.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c38140420 0x7f8c3814ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:34.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38134670 con 0x7f8c3805b320 2020-10-31T22:41:34.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c381457f0 con 0x7f8c380b2560 2020-10-31T22:41:34.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38145a90 con 0x7f8c38140420 2020-10-31T22:41:34.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c3805b320 0x7f8c38134180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:34.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c3805b320 0x7f8c38134180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42218/0 (socket says 172.21.15.60:42218) 2020-10-31T22:41:34.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3659c700 1 -- 172.21.15.60:0/3351247323 learned_addr learned my addr 172.21.15.60:0/3351247323 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:34.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c35d9b700 1 --2- 172.21.15.60:0/3351247323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c380b2560 0x7f8c3814e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:34.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c36d9d700 1 --2- 172.21.15.60:0/3351247323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c38140420 0x7f8c3814ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:34.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3659c700 1 -- 172.21.15.60:0/3351247323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c38140420 msgr2=0x7f8c3814ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3659c700 1 --2- 172.21.15.60:0/3351247323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c38140420 0x7f8c3814ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3659c700 1 -- 172.21.15.60:0/3351247323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c380b2560 msgr2=0x7f8c3814e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3659c700 1 --2- 172.21.15.60:0/3351247323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c380b2560 0x7f8c3814e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3659c700 1 -- 172.21.15.60:0/3351247323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c38145d30 con 0x7f8c3805b320 2020-10-31T22:41:34.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3659c700 1 --2- 172.21.15.60:0/3351247323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c3805b320 0x7f8c38134180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f8c28001210 tx=0x7f8c28007df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:34.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c2f7fe700 1 -- 172.21.15.60:0/3351247323 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c2800a840 con 0x7f8c3805b320 2020-10-31T22:41:34.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c2f7fe700 1 -- 172.21.15.60:0/3351247323 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2800a9a0 con 0x7f8c3805b320 2020-10-31T22:41:34.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3759e700 1 -- 172.21.15.60:0/3351247323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c380abd00 con 0x7f8c3805b320 2020-10-31T22:41:34.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c2f7fe700 1 -- 172.21.15.60:0/3351247323 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c2800ad00 con 0x7f8c3805b320 2020-10-31T22:41:34.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3759e700 1 -- 172.21.15.60:0/3351247323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c381408a0 con 0x7f8c3805b320 2020-10-31T22:41:34.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.535+0000 7f8c3759e700 1 -- 172.21.15.60:0/3351247323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c38145ec0 con 0x7f8c3805b320 2020-10-31T22:41:34.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.539+0000 7f8c2f7fe700 1 -- 172.21.15.60:0/3351247323 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8c28019030 con 0x7f8c3805b320 2020-10-31T22:41:34.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.539+0000 7f8c2f7fe700 1 --2- 172.21.15.60:0/3351247323 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8c1c054f90 0x7f8c1c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:34.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.539+0000 7f8c2f7fe700 1 -- 172.21.15.60:0/3351247323 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8c2806d530 con 0x7f8c3805b320 2020-10-31T22:41:34.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.539+0000 7f8c35d9b700 1 --2- 172.21.15.60:0/3351247323 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8c1c054f90 0x7f8c1c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:34.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.539+0000 7f8c35d9b700 1 --2- 172.21.15.60:0/3351247323 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8c1c054f90 0x7f8c1c057450 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f8c2001c000 tx=0x7f8c20016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:34.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.547+0000 7f8c2f7fe700 1 -- 172.21.15.60:0/3351247323 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8c28043a50 con 0x7f8c3805b320 2020-10-31T22:41:34.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.739+0000 7f8c3759e700 1 -- 172.21.15.60:0/3351247323 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7f8c38133930 con 0x7f8c3805b320 2020-10-31T22:41:34.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.927+0000 7f8c2f7fe700 1 -- 172.21.15.60:0/3351247323 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v42) v1 ==== 142+0+0 (secure 0 0 0) 0x7f8c28047070 con 0x7f8c3805b320 2020-10-31T22:41:34.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.931+0000 7f8c3759e700 1 -- 172.21.15.60:0/3351247323 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8c1c054f90 msgr2=0x7f8c1c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.931+0000 7f8c3759e700 1 --2- 172.21.15.60:0/3351247323 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8c1c054f90 0x7f8c1c057450 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f8c2001c000 tx=0x7f8c20016000).stop 2020-10-31T22:41:34.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.931+0000 7f8c3759e700 1 -- 172.21.15.60:0/3351247323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c3805b320 msgr2=0x7f8c38134180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:34.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.931+0000 7f8c3759e700 1 --2- 172.21.15.60:0/3351247323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c3805b320 0x7f8c38134180 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f8c28001210 tx=0x7f8c28007df0).stop 2020-10-31T22:41:34.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.931+0000 7f8c3759e700 1 -- 172.21.15.60:0/3351247323 shutdown_connections 2020-10-31T22:41:34.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.931+0000 7f8c3759e700 1 --2- 172.21.15.60:0/3351247323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c38140420 0x7f8c3814ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.931+0000 7f8c3759e700 1 --2- 172.21.15.60:0/3351247323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c3805b320 0x7f8c38134180 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.931+0000 7f8c3759e700 1 --2- 172.21.15.60:0/3351247323 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8c1c054f90 0x7f8c1c057450 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.931+0000 7f8c3759e700 1 --2- 172.21.15.60:0/3351247323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c380b2560 0x7f8c3814e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:34.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.931+0000 7f8c3759e700 1 -- 172.21.15.60:0/3351247323 >> 172.21.15.60:0/3351247323 conn(0x7f8c380b61d0 msgr2=0x7f8c3813d890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:34.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.931+0000 7f8c3759e700 1 -- 172.21.15.60:0/3351247323 shutdown_connections 2020-10-31T22:41:34.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:34.931+0000 7f8c3759e700 1 -- 172.21.15.60:0/3351247323 wait complete. 2020-10-31T22:41:34.952 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2020-10-31T22:41:35.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.071+0000 7fe36e923700 1 Processor -- start 2020-10-31T22:41:35.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.071+0000 7fe36e923700 1 -- start start 2020-10-31T22:41:35.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.071+0000 7fe36e923700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3680b1000 0x7fe368141690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:35.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.071+0000 7fe36e923700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3680acd60 con 0x7fe3680b0b50 2020-10-31T22:41:35.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.071+0000 7fe36e923700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3680b5760 con 0x7fe3680b5380 2020-10-31T22:41:35.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.071+0000 7fe36e923700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3680ad650 con 0x7fe3680b1000 2020-10-31T22:41:35.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36d120700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe3680b0b50 0x7fe368140f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46364/0 (socket says 172.21.15.60:46364) 2020-10-31T22:41:35.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36d120700 1 -- 172.21.15.60:0/263437245 learned_addr learned my addr 172.21.15.60:0/263437245 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:35.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36e122700 1 --2- 172.21.15.60:0/263437245 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3680b1000 0x7fe368141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:35.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36c91f700 1 -- 172.21.15.60:0/263437245 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3181260330 0 0) 0x7fe3680acd60 con 0x7fe3680b0b50 2020-10-31T22:41:35.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36c91f700 1 -- 172.21.15.60:0/263437245 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe350003230 con 0x7fe3680b0b50 2020-10-31T22:41:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36c91f700 1 -- 172.21.15.60:0/263437245 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432199557 0 0) 0x7fe3680b5760 con 0x7fe3680b5380 2020-10-31T22:41:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36c91f700 1 -- 172.21.15.60:0/263437245 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3680acd60 con 0x7fe3680b5380 2020-10-31T22:41:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36e122700 1 -- 172.21.15.60:0/263437245 >> v1:172.21.15.66:6789/0 conn(0x7fe3680b5380 legacy=0x7fe3680ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:35.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36e122700 1 -- 172.21.15.60:0/263437245 >> v1:172.21.15.60:6789/0 conn(0x7fe3680b0b50 legacy=0x7fe368140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:35.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36e122700 1 -- 172.21.15.60:0/263437245 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3680afba0 con 0x7fe3680b1000 2020-10-31T22:41:35.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36e122700 1 --2- 172.21.15.60:0/263437245 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3680b1000 0x7fe368141690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe3600032b0 tx=0x7fe3600091a0).ready entity=mon.2 client_cookie=9976880383df8478 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:35.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36c91f700 1 -- 172.21.15.60:0/263437245 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe36000b940 con 0x7fe3680b1000 2020-10-31T22:41:35.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36c91f700 1 -- 172.21.15.60:0/263437245 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36000baa0 con 0x7fe3680b1000 2020-10-31T22:41:35.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36e923700 1 -- 172.21.15.60:0/263437245 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3680b1000 msgr2=0x7fe368141690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:35.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36c91f700 1 -- 172.21.15.60:0/263437245 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe36000bc10 con 0x7fe3680b1000 2020-10-31T22:41:35.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36e923700 1 --2- 172.21.15.60:0/263437245 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3680b1000 0x7fe368141690 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fe3600032b0 tx=0x7fe3600091a0).stop 2020-10-31T22:41:35.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36e923700 1 -- 172.21.15.60:0/263437245 shutdown_connections 2020-10-31T22:41:35.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36e923700 1 --2- 172.21.15.60:0/263437245 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3680b1000 0x7fe368141690 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:35.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36e923700 1 -- 172.21.15.60:0/263437245 >> 172.21.15.60:0/263437245 conn(0x7fe36806a600 msgr2=0x7fe368060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:35.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36e923700 1 -- 172.21.15.60:0/263437245 shutdown_connections 2020-10-31T22:41:35.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.075+0000 7fe36e923700 1 -- 172.21.15.60:0/263437245 wait complete. 2020-10-31T22:41:35.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36e923700 1 Processor -- start 2020-10-31T22:41:35.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36e923700 1 -- start start 2020-10-31T22:41:35.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36e923700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3680b0b50 0x7fe3681527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:35.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36e923700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3680b1000 0x7fe36813ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:35.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36e923700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3680b5380 0x7fe368139130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:35.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36e923700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe368152cd0 con 0x7fe3680b1000 2020-10-31T22:41:35.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36e923700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3681400a0 con 0x7fe3680b0b50 2020-10-31T22:41:35.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36e923700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe368140340 con 0x7fe3680b5380 2020-10-31T22:41:35.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36d120700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3680b1000 0x7fe36813ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:35.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36d120700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3680b1000 0x7fe36813ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42234/0 (socket says 172.21.15.60:42234) 2020-10-31T22:41:35.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36d120700 1 -- 172.21.15.60:0/1783149485 learned_addr learned my addr 172.21.15.60:0/1783149485 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:35.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36d921700 1 --2- 172.21.15.60:0/1783149485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3680b0b50 0x7fe3681527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:35.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36e122700 1 --2- 172.21.15.60:0/1783149485 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3680b5380 0x7fe368139130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:35.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36d120700 1 -- 172.21.15.60:0/1783149485 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3680b5380 msgr2=0x7fe368139130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:35.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36d120700 1 --2- 172.21.15.60:0/1783149485 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3680b5380 0x7fe368139130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:35.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36d120700 1 -- 172.21.15.60:0/1783149485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3680b0b50 msgr2=0x7fe3681527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:35.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36d120700 1 --2- 172.21.15.60:0/1783149485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3680b0b50 0x7fe3681527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:35.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36d120700 1 -- 172.21.15.60:0/1783149485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3681405e0 con 0x7fe3680b1000 2020-10-31T22:41:35.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36d120700 1 --2- 172.21.15.60:0/1783149485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3680b1000 0x7fe36813ca10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fe358001190 tx=0x7fe358007b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:35.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe356ffd700 1 -- 172.21.15.60:0/1783149485 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3580073b0 con 0x7fe3680b1000 2020-10-31T22:41:35.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe356ffd700 1 -- 172.21.15.60:0/1783149485 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3580055e0 con 0x7fe3680b1000 2020-10-31T22:41:35.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe356ffd700 1 -- 172.21.15.60:0/1783149485 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe358005940 con 0x7fe3680b1000 2020-10-31T22:41:35.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36e923700 1 -- 172.21.15.60:0/1783149485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe368140880 con 0x7fe3680b1000 2020-10-31T22:41:35.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.079+0000 7fe36e923700 1 -- 172.21.15.60:0/1783149485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe36813d0a0 con 0x7fe3680b1000 2020-10-31T22:41:35.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.083+0000 7fe356ffd700 1 -- 172.21.15.60:0/1783149485 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe358010070 con 0x7fe3680b1000 2020-10-31T22:41:35.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.083+0000 7fe36e923700 1 -- 172.21.15.60:0/1783149485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe368140a40 con 0x7fe3680b1000 2020-10-31T22:41:35.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.083+0000 7fe356ffd700 1 --2- 172.21.15.60:0/1783149485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe348054f10 0x7fe3480573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:35.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.083+0000 7fe356ffd700 1 -- 172.21.15.60:0/1783149485 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe35806d170 con 0x7fe3680b1000 2020-10-31T22:41:35.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.083+0000 7fe36d921700 1 --2- 172.21.15.60:0/1783149485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe348054f10 0x7fe3480573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:35.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.083+0000 7fe36d921700 1 --2- 172.21.15.60:0/1783149485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe348054f10 0x7fe3480573d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe36400d000 tx=0x7fe364007960).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:35.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.091+0000 7fe356ffd700 1 -- 172.21.15.60:0/1783149485 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe358043690 con 0x7fe3680b1000 2020-10-31T22:41:35.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.235+0000 7fe36e923700 1 -- 172.21.15.60:0/1783149485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7fe368057100 con 0x7fe3680b1000 2020-10-31T22:41:35.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.243+0000 7fe356ffd700 1 -- 172.21.15.60:0/1783149485 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe358046cb0 con 0x7fe3680b1000 2020-10-31T22:41:35.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.243+0000 7fe36e923700 1 -- 172.21.15.60:0/1783149485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe348054f10 msgr2=0x7fe3480573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:35.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.243+0000 7fe36e923700 1 --2- 172.21.15.60:0/1783149485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe348054f10 0x7fe3480573d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe36400d000 tx=0x7fe364007960).stop 2020-10-31T22:41:35.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.243+0000 7fe36e923700 1 -- 172.21.15.60:0/1783149485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3680b1000 msgr2=0x7fe36813ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:35.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.243+0000 7fe36e923700 1 --2- 172.21.15.60:0/1783149485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3680b1000 0x7fe36813ca10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7fe358001190 tx=0x7fe358007b20).stop 2020-10-31T22:41:35.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.243+0000 7fe36e923700 1 -- 172.21.15.60:0/1783149485 shutdown_connections 2020-10-31T22:41:35.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.243+0000 7fe36e923700 1 --2- 172.21.15.60:0/1783149485 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3680b5380 0x7fe368139130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:35.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.243+0000 7fe36e923700 1 --2- 172.21.15.60:0/1783149485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe348054f10 0x7fe3480573d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:35.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.243+0000 7fe36e923700 1 --2- 172.21.15.60:0/1783149485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3680b0b50 0x7fe3681527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:35.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.243+0000 7fe36e923700 1 --2- 172.21.15.60:0/1783149485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3680b1000 0x7fe36813ca10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:35.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.243+0000 7fe36e923700 1 -- 172.21.15.60:0/1783149485 >> 172.21.15.60:0/1783149485 conn(0x7fe36806a600 msgr2=0x7fe3680b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:35.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.243+0000 7fe36e923700 1 -- 172.21.15.60:0/1783149485 shutdown_connections 2020-10-31T22:41:35.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:35.243+0000 7fe36e923700 1 -- 172.21.15.60:0/1783149485 wait complete. 2020-10-31T22:41:35.261 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:41:35.262 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:41:35.291 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:41:35.320 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:41:35.355 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:41:35.397 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:41:35.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:35.399 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:41:35.400 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:35.446 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:41:35.448 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:41:35.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:35.450 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:41:35.450 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:35.498 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:41:35.500 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:41:35.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:35.501 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:41:35.502 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:35.550 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2020-10-31T22:41:35.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:41:35.552 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2020-10-31T22:41:35.553 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:41:35.553 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:41:35.554 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:35.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:35.652 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:41:35.653 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:35.703 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:41:35.705 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:41:35.705 INFO:teuthology.orchestra.run:waiting for 900 2020-10-31T22:41:35.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:41:35.707 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:35.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:35.755 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:41:35.755 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:41:35.763 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:41:35.764 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:41:35.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:35.765 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:41:35.765 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:41:35.814 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:41:35.815 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:41:35.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:35.817 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:41:35.817 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:41:35.869 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': Transport endpoint is not connected 2020-10-31T22:41:35.870 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:41:35.872 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.1 2020-10-31T22:41:35.872 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi085.front.sepia.ceph.com... 2020-10-31T22:41:35.873 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:41:35.873 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:41:35.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:35.967 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:41:35.967 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:41:36.024 INFO:teuthology.orchestra.run.smithi085.stdout:ext2/ext3 2020-10-31T22:41:36.025 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:41:36.026 INFO:teuthology.orchestra.run:waiting for 900 2020-10-31T22:41:36.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:41:36.027 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:41:36.073 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-10-31T22:41:36.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155e03e700 1 Processor -- start 2020-10-31T22:41:36.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155e03e700 1 -- start start 2020-10-31T22:41:36.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155e03e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f15580b5950 0x7f15581426f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:36.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155e03e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1558145180 con 0x7f15580b24a0 2020-10-31T22:41:36.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155e03e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15580b0670 con 0x7f15580b5570 2020-10-31T22:41:36.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155e03e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15580afae0 con 0x7f15580b5950 2020-10-31T22:41:36.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155c83b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f15580b24a0 0x7f1558141fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46376/0 (socket says 172.21.15.60:46376) 2020-10-31T22:41:36.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155c83b700 1 -- 172.21.15.60:0/3533105297 learned_addr learned my addr 172.21.15.60:0/3533105297 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:36.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155d83d700 1 --2- 172.21.15.60:0/3533105297 >> v2:172.21.15.60:3300/0 conn(0x7f15580b5950 0x7f15581426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:36.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f1557fff700 1 -- 172.21.15.60:0/3533105297 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3996766463 0 0) 0x7f1558145180 con 0x7f15580b24a0 2020-10-31T22:41:36.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f1557fff700 1 -- 172.21.15.60:0/3533105297 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1544003230 con 0x7f15580b24a0 2020-10-31T22:41:36.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155d83d700 1 -- 172.21.15.60:0/3533105297 >> v1:172.21.15.66:6789/0 conn(0x7f15580b5570 legacy=0x7f1558145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:36.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155d83d700 1 -- 172.21.15.60:0/3533105297 >> v1:172.21.15.60:6789/0 conn(0x7f15580b24a0 legacy=0x7f1558141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:36.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155d83d700 1 -- 172.21.15.60:0/3533105297 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15580b0910 con 0x7f15580b5950 2020-10-31T22:41:36.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155d83d700 1 --2- 172.21.15.60:0/3533105297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15580b5950 0x7f15581426f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f155805f580 tx=0x7f15500091a0).ready entity=mon.0 client_cookie=cf8aecc39553e063 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:36.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f1557fff700 1 -- 172.21.15.60:0/3533105297 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155000b9b0 con 0x7f15580b5950 2020-10-31T22:41:36.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f1557fff700 1 -- 172.21.15.60:0/3533105297 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f155000bb10 con 0x7f15580b5950 2020-10-31T22:41:36.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155e03e700 1 -- 172.21.15.60:0/3533105297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15580b5950 msgr2=0x7f15581426f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:36.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f1557fff700 1 -- 172.21.15.60:0/3533105297 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f155000bc80 con 0x7f15580b5950 2020-10-31T22:41:36.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.191+0000 7f155e03e700 1 --2- 172.21.15.60:0/3533105297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15580b5950 0x7f15581426f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f155805f580 tx=0x7f15500091a0).stop 2020-10-31T22:41:36.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155e03e700 1 -- 172.21.15.60:0/3533105297 shutdown_connections 2020-10-31T22:41:36.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155e03e700 1 --2- 172.21.15.60:0/3533105297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15580b5950 0x7f15581426f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155e03e700 1 -- 172.21.15.60:0/3533105297 >> 172.21.15.60:0/3533105297 conn(0x7f15580b8e90 msgr2=0x7f15580b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:36.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155e03e700 1 -- 172.21.15.60:0/3533105297 shutdown_connections 2020-10-31T22:41:36.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155e03e700 1 -- 172.21.15.60:0/3533105297 wait complete. 2020-10-31T22:41:36.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155e03e700 1 Processor -- start 2020-10-31T22:41:36.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155e03e700 1 -- start start 2020-10-31T22:41:36.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155e03e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15580b24a0 0x7f1558150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:36.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155e03e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15580b5570 0x7f1558154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:36.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155e03e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15580b5950 0x7f155813dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:36.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155e03e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1558147e10 con 0x7f15580b24a0 2020-10-31T22:41:36.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155e03e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15581480b0 con 0x7f15580b5570 2020-10-31T22:41:36.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155e03e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15581540d0 con 0x7f15580b5950 2020-10-31T22:41:36.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155d03c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15580b24a0 0x7f1558150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:36.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155d03c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15580b24a0 0x7f1558150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42246/0 (socket says 172.21.15.60:42246) 2020-10-31T22:41:36.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155d03c700 1 -- 172.21.15.60:0/4197436606 learned_addr learned my addr 172.21.15.60:0/4197436606 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:36.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155c83b700 1 --2- 172.21.15.60:0/4197436606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15580b5570 0x7f1558154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:36.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155d83d700 1 --2- 172.21.15.60:0/4197436606 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15580b5950 0x7f155813dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:36.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155d03c700 1 -- 172.21.15.60:0/4197436606 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15580b5950 msgr2=0x7f155813dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:36.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155d03c700 1 --2- 172.21.15.60:0/4197436606 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15580b5950 0x7f155813dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155d03c700 1 -- 172.21.15.60:0/4197436606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15580b5570 msgr2=0x7f1558154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:36.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.195+0000 7f155d03c700 1 --2- 172.21.15.60:0/4197436606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15580b5570 0x7f1558154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.199+0000 7f155d03c700 1 -- 172.21.15.60:0/4197436606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1558154370 con 0x7f15580b24a0 2020-10-31T22:41:36.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.199+0000 7f155d03c700 1 --2- 172.21.15.60:0/4197436606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15580b24a0 0x7f1558150b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f155805c9f0 tx=0x7f1548007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:36.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.199+0000 7f15567fc700 1 -- 172.21.15.60:0/4197436606 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f154800f470 con 0x7f15580b24a0 2020-10-31T22:41:36.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.199+0000 7f15567fc700 1 -- 172.21.15.60:0/4197436606 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154800f5d0 con 0x7f15580b24a0 2020-10-31T22:41:36.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.199+0000 7f155e03e700 1 -- 172.21.15.60:0/4197436606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1558141700 con 0x7f15580b24a0 2020-10-31T22:41:36.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.199+0000 7f15567fc700 1 -- 172.21.15.60:0/4197436606 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f154800f930 con 0x7f15580b24a0 2020-10-31T22:41:36.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.199+0000 7f155e03e700 1 -- 172.21.15.60:0/4197436606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1558154ea0 con 0x7f15580b24a0 2020-10-31T22:41:36.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.199+0000 7f15567fc700 1 -- 172.21.15.60:0/4197436606 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1548019030 con 0x7f15580b24a0 2020-10-31T22:41:36.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.199+0000 7f155e03e700 1 -- 172.21.15.60:0/4197436606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1558057100 con 0x7f15580b24a0 2020-10-31T22:41:36.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.203+0000 7f15567fc700 1 --2- 172.21.15.60:0/4197436606 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1538054f10 0x7f15380573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:36.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.203+0000 7f15567fc700 1 -- 172.21.15.60:0/4197436606 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f154806cdf0 con 0x7f15580b24a0 2020-10-31T22:41:36.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.203+0000 7f155c83b700 1 --2- 172.21.15.60:0/4197436606 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1538054f10 0x7f15380573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:36.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.203+0000 7f155c83b700 1 --2- 172.21.15.60:0/4197436606 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1538054f10 0x7f15380573d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f154c00d000 tx=0x7f154c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:36.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.207+0000 7f15567fc700 1 -- 172.21.15.60:0/4197436606 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1548043310 con 0x7f15580b24a0 2020-10-31T22:41:36.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.351+0000 7f155e03e700 1 -- 172.21.15.60:0/4197436606 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1558141890 con 0x7f15580b24a0 2020-10-31T22:41:36.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.351+0000 7f15567fc700 1 -- 172.21.15.60:0/4197436606 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v22) v1 ==== 81+0+33645 (secure 0 0 0) 0x7f1558141890 con 0x7f15580b24a0 2020-10-31T22:41:36.356 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:36.357 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:41:36.357 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 22, 2020-10-31T22:41:36.357 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "226f905a-1517-4a8c-8009-08779515965c", 2020-10-31T22:41:36.358 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2020-10-31T22:40:51.928572+0000", 2020-10-31T22:41:36.358 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2020-10-31T22:41:11.059362+0000", 2020-10-31T22:41:36.358 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:41:36.359 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:41:36.359 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-10-31T22:41:36.359 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2020-10-31T22:41:36.360 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2020-10-31T22:41:36.360 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2020-10-31T22:41:36.360 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2020-10-31T22:41:36.360 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2020-10-31T22:41:36.361 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2020-10-31T22:41:36.361 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:41:36.361 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2020-10-31T22:41:36.362 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2020-10-31T22:41:36.362 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-10-31T22:41:36.362 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2020-10-31T22:41:36.363 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2020-10-31T22:41:36.363 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 4, 2020-10-31T22:41:36.363 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2020-10-31T22:41:36.363 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "jewel", 2020-10-31T22:41:36.364 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2020-10-31T22:41:36.364 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "octopus", 2020-10-31T22:41:36.364 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:41:36.365 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.365 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2020-10-31T22:41:36.365 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "device_health_metrics", 2020-10-31T22:41:36.365 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:40:55.846143+0000", 2020-10-31T22:41:36.366 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:41:36.366 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:41:36.366 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:41:36.367 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:41:36.367 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:41:36.367 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:41:36.368 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:41:36.368 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:41:36.368 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2020-10-31T22:41:36.368 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2020-10-31T22:41:36.369 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2020-10-31T22:41:36.369 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2020-10-31T22:41:36.370 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2020-10-31T22:41:36.371 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:41:36.372 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:41:36.372 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:41:36.372 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:41:36.372 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:41:36.373 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:41:36.373 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:41:36.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.374 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "15", 2020-10-31T22:41:36.374 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:41:36.374 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:41:36.375 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:41:36.375 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:41:36.375 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:41:36.375 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:41:36.376 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:41:36.376 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:41:36.376 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:41:36.377 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:41:36.377 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:41:36.378 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:41:36.378 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:41:36.379 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:41:36.379 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:41:36.379 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:41:36.380 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:41:36.380 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:41:36.380 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:41:36.381 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:41:36.381 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:41:36.382 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:41:36.382 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:41:36.383 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:41:36.383 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:41:36.383 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:41:36.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.384 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:41:36.384 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:41:36.384 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:41:36.385 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:41:36.385 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:41:36.386 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:41:36.386 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:41:36.386 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:41:36.386 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:41:36.386 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:41:36.387 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:41:36.387 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:41:36.387 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2020-10-31T22:41:36.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.387 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:41:36.387 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_devicehealth": {} 2020-10-31T22:41:36.387 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.388 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.388 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2020-10-31T22:41:36.388 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2020-10-31T22:41:36.389 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:05.358501+0000", 2020-10-31T22:41:36.389 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:41:36.389 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:41:36.389 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:41:36.390 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:41:36.390 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:41:36.390 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:41:36.390 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:41:36.390 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:41:36.391 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:41:36.391 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:41:36.391 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:41:36.391 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:41:36.391 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:41:36.392 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:41:36.392 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:41:36.392 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:41:36.392 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:41:36.392 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:41:36.393 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:41:36.393 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:41:36.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.394 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "18", 2020-10-31T22:41:36.394 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:41:36.395 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:41:36.397 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:41:36.397 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:41:36.397 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:41:36.398 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:41:36.398 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:41:36.398 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:41:36.398 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:41:36.399 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:41:36.399 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:41:36.399 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:41:36.400 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:41:36.400 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:41:36.400 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:41:36.400 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:41:36.401 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:41:36.401 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:41:36.401 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:41:36.401 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:41:36.402 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:41:36.402 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:41:36.402 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:41:36.403 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:41:36.403 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:41:36.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:41:36.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.404 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:41:36.404 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:41:36.404 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:41:36.404 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:41:36.404 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:41:36.405 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:41:36.405 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:41:36.405 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:41:36.405 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:41:36.406 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:41:36.406 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:41:36.407 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:41:36.407 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:41:36.408 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2020-10-31T22:41:36.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.408 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.408 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.409 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 3, 2020-10-31T22:41:36.409 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2020-10-31T22:41:36.409 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:07.982891+0000", 2020-10-31T22:41:36.409 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:41:36.409 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:41:36.409 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:41:36.409 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:41:36.410 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:41:36.410 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:41:36.410 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:41:36.410 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:41:36.410 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:41:36.410 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:41:36.410 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:41:36.411 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:41:36.411 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:41:36.411 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:41:36.411 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:41:36.411 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:41:36.411 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:41:36.411 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:41:36.412 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:41:36.412 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:41:36.412 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.412 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "21", 2020-10-31T22:41:36.412 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:41:36.412 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:41:36.412 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:41:36.413 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:41:36.413 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:41:36.413 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:41:36.413 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:41:36.413 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:41:36.413 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:41:36.413 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:41:36.414 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:41:36.415 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:41:36.415 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:41:36.415 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:41:36.416 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:41:36.416 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:41:36.416 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:41:36.416 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:41:36.416 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:41:36.416 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:41:36.416 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:41:36.417 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:41:36.417 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:41:36.417 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:41:36.417 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:41:36.417 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:41:36.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.417 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:41:36.418 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:41:36.418 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:41:36.418 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:41:36.418 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:41:36.418 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:41:36.418 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:41:36.419 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:41:36.419 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:41:36.419 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:41:36.419 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:41:36.419 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:41:36.419 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2020-10-31T22:41:36.419 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2020-10-31T22:41:36.420 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2020-10-31T22:41:36.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.420 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:41:36.420 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:41:36.420 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2020-10-31T22:41:36.420 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.420 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.421 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 4, 2020-10-31T22:41:36.421 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2020-10-31T22:41:36.421 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:08.927092+0000", 2020-10-31T22:41:36.421 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:41:36.421 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:41:36.422 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:41:36.422 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:41:36.422 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:41:36.422 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:41:36.422 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:41:36.422 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:41:36.424 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:41:36.424 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:41:36.426 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:41:36.426 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:41:36.426 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:41:36.426 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:41:36.426 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:41:36.427 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:41:36.427 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:41:36.427 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:41:36.427 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:41:36.427 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:41:36.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.427 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "22", 2020-10-31T22:41:36.428 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:41:36.428 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:41:36.428 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:41:36.428 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:41:36.428 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:41:36.428 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:41:36.428 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:41:36.429 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:41:36.429 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:41:36.429 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:41:36.429 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:41:36.429 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:41:36.429 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:41:36.429 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:41:36.430 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:41:36.430 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:41:36.430 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:41:36.430 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:41:36.430 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:41:36.430 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:41:36.430 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:41:36.431 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:41:36.431 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:41:36.431 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:41:36.431 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:41:36.431 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:41:36.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.431 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:41:36.432 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:41:36.432 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:41:36.432 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:41:36.432 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:41:36.432 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:41:36.432 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:41:36.432 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:41:36.433 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:41:36.433 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:41:36.433 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:41:36.433 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:41:36.433 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:41:36.433 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:41:36.434 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2020-10-31T22:41:36.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.434 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:41:36.434 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2020-10-31T22:41:36.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.435 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:41:36.435 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", 2020-10-31T22:41:36.435 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:41:36.435 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:41:36.435 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:41:36.435 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:41:36.435 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:41:36.435 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:41:36.436 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:41:36.436 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 20, 2020-10-31T22:41:36.436 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:41:36.436 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:41:36.436 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:41:36.436 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.437 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.437 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2020-10-31T22:41:36.437 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:41:36.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.437 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.437 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2020-10-31T22:41:36.438 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:41:36.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.438 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.438 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:41:36.438 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.439 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.439 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2020-10-31T22:41:36.439 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:41:36.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.439 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.439 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2020-10-31T22:41:36.439 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:41:36.440 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.440 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.440 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:41:36.440 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.440 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.441 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2020-10-31T22:41:36.441 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:41:36.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.441 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.441 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2020-10-31T22:41:36.441 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:41:36.441 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.442 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.442 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:41:36.442 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.442 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.442 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2020-10-31T22:41:36.443 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:41:36.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.443 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.443 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2020-10-31T22:41:36.443 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:41:36.443 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.444 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.444 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6803/14302", 2020-10-31T22:41:36.444 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6805/14302", 2020-10-31T22:41:36.444 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6809/14302", 2020-10-31T22:41:36.444 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6807/14302", 2020-10-31T22:41:36.444 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:41:36.445 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:41:36.445 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:41:36.445 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.445 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:41:36.445 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", 2020-10-31T22:41:36.445 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:41:36.446 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:41:36.446 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:41:36.446 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:41:36.446 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:41:36.446 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:41:36.446 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:41:36.447 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 20, 2020-10-31T22:41:36.447 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:41:36.447 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:41:36.447 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:41:36.447 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.447 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.447 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.448 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2020-10-31T22:41:36.448 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:41:36.448 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.448 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.448 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2020-10-31T22:41:36.448 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:41:36.449 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.449 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.449 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:41:36.449 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.449 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.450 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2020-10-31T22:41:36.450 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:41:36.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.450 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.450 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2020-10-31T22:41:36.450 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:41:36.451 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.451 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.451 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:41:36.451 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.452 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.452 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2020-10-31T22:41:36.452 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:41:36.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.452 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.452 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2020-10-31T22:41:36.452 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:41:36.453 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.453 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.453 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:41:36.453 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.453 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.454 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2020-10-31T22:41:36.454 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:41:36.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.454 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.454 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2020-10-31T22:41:36.454 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:41:36.455 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.455 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.455 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/14300", 2020-10-31T22:41:36.455 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6813/14300", 2020-10-31T22:41:36.455 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6817/14300", 2020-10-31T22:41:36.455 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6815/14300", 2020-10-31T22:41:36.456 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:41:36.456 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:41:36.456 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:41:36.456 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.456 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.456 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:41:36.456 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", 2020-10-31T22:41:36.457 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:41:36.457 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:41:36.457 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:41:36.457 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:41:36.457 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:41:36.457 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:41:36.457 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:41:36.458 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 16, 2020-10-31T22:41:36.458 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:41:36.458 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:41:36.458 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:41:36.458 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.458 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.458 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.459 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2020-10-31T22:41:36.459 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:41:36.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.459 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.459 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2020-10-31T22:41:36.459 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:41:36.459 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.460 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.460 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:41:36.460 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.460 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.460 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2020-10-31T22:41:36.461 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:41:36.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.461 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.461 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2020-10-31T22:41:36.461 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:41:36.461 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.462 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.462 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.462 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:41:36.462 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.462 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.462 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6832", 2020-10-31T22:41:36.463 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:41:36.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.463 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.463 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6833", 2020-10-31T22:41:36.463 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:41:36.463 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.464 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.464 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:41:36.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.464 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.464 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2020-10-31T22:41:36.465 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:41:36.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.465 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.465 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2020-10-31T22:41:36.465 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:41:36.465 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.466 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.466 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.466 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6827/14318", 2020-10-31T22:41:36.466 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6829/14318", 2020-10-31T22:41:36.466 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6833/14318", 2020-10-31T22:41:36.466 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6831/14318", 2020-10-31T22:41:36.466 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:41:36.466 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:41:36.467 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:41:36.467 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.467 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:41:36.467 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", 2020-10-31T22:41:36.468 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:41:36.468 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:41:36.468 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:41:36.468 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:41:36.468 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:41:36.468 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:41:36.468 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:41:36.468 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 20, 2020-10-31T22:41:36.469 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:41:36.469 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:41:36.469 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:41:36.469 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.469 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.469 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.469 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2020-10-31T22:41:36.470 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:41:36.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.470 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.470 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.470 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2020-10-31T22:41:36.470 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:41:36.470 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.471 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.471 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.471 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:41:36.471 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.471 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.471 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.471 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2020-10-31T22:41:36.471 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:41:36.472 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.472 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.472 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.472 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2020-10-31T22:41:36.472 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:41:36.472 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.472 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.473 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:41:36.473 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.473 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.473 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.473 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2020-10-31T22:41:36.473 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:41:36.473 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.474 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.474 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.474 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2020-10-31T22:41:36.474 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:41:36.474 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.474 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.475 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:41:36.475 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.475 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.475 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.475 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2020-10-31T22:41:36.475 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:41:36.475 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.476 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.476 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.476 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2020-10-31T22:41:36.476 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:41:36.476 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.476 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.476 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.477 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6819/14301", 2020-10-31T22:41:36.477 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6821/14301", 2020-10-31T22:41:36.477 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/14301", 2020-10-31T22:41:36.477 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6823/14301", 2020-10-31T22:41:36.477 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:41:36.477 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:41:36.477 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:41:36.477 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.478 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.478 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.478 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:41:36.478 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", 2020-10-31T22:41:36.478 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:41:36.478 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:41:36.478 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:41:36.479 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:41:36.479 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:41:36.479 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:41:36.479 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:41:36.479 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 20, 2020-10-31T22:41:36.479 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:41:36.479 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:41:36.480 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:41:36.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.480 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.480 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6816", 2020-10-31T22:41:36.480 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:41:36.480 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.480 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.481 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.481 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6817", 2020-10-31T22:41:36.481 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:41:36.481 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.481 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.481 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.481 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:41:36.482 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.482 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.482 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6818", 2020-10-31T22:41:36.482 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:41:36.482 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.482 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.483 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.483 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6819", 2020-10-31T22:41:36.483 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:41:36.483 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.483 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.483 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.483 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:41:36.483 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.484 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.484 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6822", 2020-10-31T22:41:36.484 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:41:36.484 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.484 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.484 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.485 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6823", 2020-10-31T22:41:36.485 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:41:36.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.485 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.485 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:41:36.485 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.486 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.486 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6820", 2020-10-31T22:41:36.486 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:41:36.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.486 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.486 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.486 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6821", 2020-10-31T22:41:36.487 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:41:36.487 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.487 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.487 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.487 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6817/14002", 2020-10-31T22:41:36.487 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6819/14002", 2020-10-31T22:41:36.487 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6823/14002", 2020-10-31T22:41:36.488 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6821/14002", 2020-10-31T22:41:36.488 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:41:36.488 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:41:36.488 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:41:36.488 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.488 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:41:36.489 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", 2020-10-31T22:41:36.489 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:41:36.489 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:41:36.489 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:41:36.489 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:41:36.489 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:41:36.489 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:41:36.490 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:41:36.490 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 19, 2020-10-31T22:41:36.490 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:41:36.490 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:41:36.490 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:41:36.490 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.490 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6800", 2020-10-31T22:41:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:41:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6801", 2020-10-31T22:41:36.491 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:41:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:41:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.492 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6802", 2020-10-31T22:41:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:41:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6803", 2020-10-31T22:41:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:41:36.493 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:41:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.494 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6806", 2020-10-31T22:41:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:41:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6807", 2020-10-31T22:41:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:41:36.495 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:41:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.496 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6804", 2020-10-31T22:41:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:41:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6805", 2020-10-31T22:41:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:41:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.497 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6801/14001", 2020-10-31T22:41:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6803/14001", 2020-10-31T22:41:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6807/14001", 2020-10-31T22:41:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6805/14001", 2020-10-31T22:41:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:41:36.498 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:41:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:41:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:41:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", 2020-10-31T22:41:36.499 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:41:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:41:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:41:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:41:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:41:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:41:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:41:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 20, 2020-10-31T22:41:36.500 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:41:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:41:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:41:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6808", 2020-10-31T22:41:36.501 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:41:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6809", 2020-10-31T22:41:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:41:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:41:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6810", 2020-10-31T22:41:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:41:36.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.504 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.504 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6811", 2020-10-31T22:41:36.504 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:41:36.504 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.504 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.505 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:41:36.505 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.505 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.505 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6814", 2020-10-31T22:41:36.505 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:41:36.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.505 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.506 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.506 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6815", 2020-10-31T22:41:36.506 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:41:36.506 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.506 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.506 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:41:36.507 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.507 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.507 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6812", 2020-10-31T22:41:36.507 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:41:36.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.507 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.508 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.508 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6813", 2020-10-31T22:41:36.508 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:41:36.508 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.508 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.508 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6809/14003", 2020-10-31T22:41:36.508 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6811/14003", 2020-10-31T22:41:36.509 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6815/14003", 2020-10-31T22:41:36.509 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6813/14003", 2020-10-31T22:41:36.509 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:41:36.509 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:41:36.509 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:41:36.509 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.510 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.510 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:41:36.510 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", 2020-10-31T22:41:36.510 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:41:36.510 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:41:36.510 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:41:36.510 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:41:36.511 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:41:36.511 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:41:36.511 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:41:36.511 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 16, 2020-10-31T22:41:36.511 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:41:36.511 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:41:36.511 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:41:36.511 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.512 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.512 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6824", 2020-10-31T22:41:36.512 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:41:36.512 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.512 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.513 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6825", 2020-10-31T22:41:36.513 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:41:36.513 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.513 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.513 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.513 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:41:36.513 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.513 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.514 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.514 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6826", 2020-10-31T22:41:36.514 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:41:36.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.514 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.514 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6827", 2020-10-31T22:41:36.515 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:41:36.515 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.515 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.515 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:41:36.515 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.515 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.516 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.516 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6830", 2020-10-31T22:41:36.516 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:41:36.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.516 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.516 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6831", 2020-10-31T22:41:36.516 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:41:36.517 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.517 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.517 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:41:36.517 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:41:36.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.517 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:41:36.518 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6828", 2020-10-31T22:41:36.518 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:41:36.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.518 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.519 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:41:36.519 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6829", 2020-10-31T22:41:36.519 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:41:36.519 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.519 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.520 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6825/14046", 2020-10-31T22:41:36.520 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6827/14046", 2020-10-31T22:41:36.520 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6831/14046", 2020-10-31T22:41:36.520 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6829/14046", 2020-10-31T22:41:36.520 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:41:36.520 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:41:36.521 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:41:36.521 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:36.521 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.521 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:41:36.521 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2020-10-31T22:41:36.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.521 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:41:36.522 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:41:36.522 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:41:36.522 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:41:36.522 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:41:36.522 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:41:36.522 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.314917+0000", 2020-10-31T22:41:36.523 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:41:36.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.523 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:41:36.524 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:41:36.524 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:41:36.524 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:41:36.524 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:41:36.525 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:41:36.525 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.643069+0000", 2020-10-31T22:41:36.525 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:41:36.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.526 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:41:36.526 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:41:36.527 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:41:36.527 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:41:36.527 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:41:36.528 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:41:36.528 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.662572+0000", 2020-10-31T22:41:36.528 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:41:36.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.529 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.529 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:41:36.529 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:41:36.530 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:41:36.530 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:41:36.530 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:41:36.531 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:41:36.531 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.664868+0000", 2020-10-31T22:41:36.531 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:41:36.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.532 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.532 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:41:36.532 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:41:36.532 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:41:36.533 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:41:36.533 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:41:36.533 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:41:36.533 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551107+0000", 2020-10-31T22:41:36.534 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:41:36.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.534 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:41:36.535 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:41:36.535 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:41:36.535 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:41:36.535 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:41:36.536 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:41:36.536 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.400568+0000", 2020-10-31T22:41:36.536 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:41:36.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.537 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:41:36.537 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:41:36.537 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:41:36.538 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:41:36.538 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:41:36.538 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:41:36.539 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551173+0000", 2020-10-31T22:41:36.539 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:41:36.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:36.540 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:41:36.540 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:41:36.540 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:41:36.540 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:41:36.541 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:41:36.541 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:41:36.541 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.604302+0000", 2020-10-31T22:41:36.541 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:41:36.542 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.542 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:41:36.542 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2020-10-31T22:41:36.542 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2020-10-31T22:41:36.543 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2020-10-31T22:41:36.543 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2020-10-31T22:41:36.543 INFO:teuthology.orchestra.run.smithi060.stdout: "blacklist": {}, 2020-10-31T22:41:36.543 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2020-10-31T22:41:36.544 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2020-10-31T22:41:36.544 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2020-10-31T22:41:36.544 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2020-10-31T22:41:36.544 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2020-10-31T22:41:36.545 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2020-10-31T22:41:36.545 INFO:teuthology.orchestra.run.smithi060.stdout: "ruleset-failure-domain": "osd", 2020-10-31T22:41:36.545 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2020-10-31T22:41:36.546 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:36.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:36.546 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2020-10-31T22:41:36.546 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2020-10-31T22:41:36.547 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2020-10-31T22:41:36.547 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2020-10-31T22:41:36.547 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {} 2020-10-31T22:41:36.547 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:41:36.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.355+0000 7f155e03e700 1 -- 172.21.15.60:0/4197436606 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1538054f10 msgr2=0x7f15380573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:36.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.355+0000 7f155e03e700 1 --2- 172.21.15.60:0/4197436606 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1538054f10 0x7f15380573d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f154c00d000 tx=0x7f154c009040).stop 2020-10-31T22:41:36.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.355+0000 7f155e03e700 1 -- 172.21.15.60:0/4197436606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15580b24a0 msgr2=0x7f1558150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:36.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.355+0000 7f155e03e700 1 --2- 172.21.15.60:0/4197436606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15580b24a0 0x7f1558150b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f155805c9f0 tx=0x7f1548007b90).stop 2020-10-31T22:41:36.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.355+0000 7f155e03e700 1 -- 172.21.15.60:0/4197436606 shutdown_connections 2020-10-31T22:41:36.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.355+0000 7f155e03e700 1 --2- 172.21.15.60:0/4197436606 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15580b5950 0x7f155813dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.355+0000 7f155e03e700 1 --2- 172.21.15.60:0/4197436606 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15580b24a0 0x7f1558150b80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.355+0000 7f155e03e700 1 --2- 172.21.15.60:0/4197436606 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1538054f10 0x7f15380573d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.355+0000 7f155e03e700 1 --2- 172.21.15.60:0/4197436606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15580b5570 0x7f1558154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.355+0000 7f155e03e700 1 -- 172.21.15.60:0/4197436606 >> 172.21.15.60:0/4197436606 conn(0x7f15580b8e90 msgr2=0x7f155805f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:36.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.355+0000 7f155e03e700 1 -- 172.21.15.60:0/4197436606 shutdown_connections 2020-10-31T22:41:36.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.355+0000 7f155e03e700 1 -- 172.21.15.60:0/4197436606 wait complete. 2020-10-31T22:41:36.554 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.675+0000 7efe2b59e700 1 Processor -- start 2020-10-31T22:41:36.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.675+0000 7efe2b59e700 1 -- start start 2020-10-31T22:41:36.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe2b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe2c0631c0 0x7efe2c0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:36.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe2b59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe2c0a9130 0x7efe2c143010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:36.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe2b59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efe2c0ae740 0x7efe2c0ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:36.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe2b59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2c0b15e0 con 0x7efe2c0a9130 2020-10-31T22:41:36.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe2b59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2c0635a0 con 0x7efe2c0ae740 2020-10-31T22:41:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe2b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0af2c0 con 0x7efe2c0631c0 2020-10-31T22:41:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe29d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe2c0a9130 0x7efe2c143010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe29d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe2c0a9130 0x7efe2c143010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42256/0 (socket says 172.21.15.60:42256) 2020-10-31T22:41:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe29d9b700 1 -- 172.21.15.60:0/745327866 learned_addr learned my addr 172.21.15.60:0/745327866 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:36.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe2ad9d700 1 --2- 172.21.15.60:0/745327866 >> v2:172.21.15.66:3300/0 conn(0x7efe2c0ae740 0x7efe2c0ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:36.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe2a59c700 1 --2- 172.21.15.60:0/745327866 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe2c0631c0 0x7efe2c0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:36.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe29d9b700 1 -- 172.21.15.60:0/745327866 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe2c0631c0 msgr2=0x7efe2c0b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:36.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe29d9b700 1 --2- 172.21.15.60:0/745327866 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe2c0631c0 0x7efe2c0b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe29d9b700 1 -- 172.21.15.60:0/745327866 >> v2:172.21.15.66:3300/0 conn(0x7efe2c0ae740 msgr2=0x7efe2c0ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:36.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe29d9b700 1 --2- 172.21.15.60:0/745327866 >> v2:172.21.15.66:3300/0 conn(0x7efe2c0ae740 0x7efe2c0ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe29d9b700 1 -- 172.21.15.60:0/745327866 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c0af560 con 0x7efe2c0a9130 2020-10-31T22:41:36.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe29d9b700 1 --2- 172.21.15.60:0/745327866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe2c0a9130 0x7efe2c143010 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7efe20002f30 tx=0x7efe20006e80).ready entity=mon.0 client_cookie=ed7d80dedf3d2334 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:36.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe2959a700 1 -- 172.21.15.60:0/745327866 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe200097f0 con 0x7efe2c0a9130 2020-10-31T22:41:36.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe2959a700 1 -- 172.21.15.60:0/745327866 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe20009950 con 0x7efe2c0a9130 2020-10-31T22:41:36.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe2959a700 1 -- 172.21.15.60:0/745327866 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe20009cb0 con 0x7efe2c0a9130 2020-10-31T22:41:36.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe2b59e700 1 -- 172.21.15.60:0/745327866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe2c0a9130 msgr2=0x7efe2c143010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:36.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.679+0000 7efe2b59e700 1 --2- 172.21.15.60:0/745327866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe2c0a9130 0x7efe2c143010 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7efe20002f30 tx=0x7efe20006e80).stop 2020-10-31T22:41:36.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.683+0000 7efe2b59e700 1 -- 172.21.15.60:0/745327866 shutdown_connections 2020-10-31T22:41:36.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.683+0000 7efe2b59e700 1 --2- 172.21.15.60:0/745327866 >> v2:172.21.15.66:3300/0 conn(0x7efe2c0ae740 0x7efe2c0ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.683+0000 7efe2b59e700 1 --2- 172.21.15.60:0/745327866 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe2c0631c0 0x7efe2c0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.683+0000 7efe2b59e700 1 --2- 172.21.15.60:0/745327866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe2c0a9130 0x7efe2c143010 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.683+0000 7efe2b59e700 1 -- 172.21.15.60:0/745327866 >> 172.21.15.60:0/745327866 conn(0x7efe2c06a600 msgr2=0x7efe2c060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:36.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.683+0000 7efe2b59e700 1 -- 172.21.15.60:0/745327866 shutdown_connections 2020-10-31T22:41:36.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.683+0000 7efe2b59e700 1 -- 172.21.15.60:0/745327866 wait complete. 2020-10-31T22:41:36.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.683+0000 7efe2b59e700 1 Processor -- start 2020-10-31T22:41:36.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.683+0000 7efe2b59e700 1 -- start start 2020-10-31T22:41:36.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2b59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe2c0631c0 0x7efe2c066da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:36.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe2c0a9130 0x7efe2c1460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:36.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe2c0ae740 0x7efe2c152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:36.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0b5d90 con 0x7efe2c0ae740 2020-10-31T22:41:36.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2b59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0b5850 con 0x7efe2c0631c0 2020-10-31T22:41:36.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c0b5af0 con 0x7efe2c0a9130 2020-10-31T22:41:36.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe2c0ae740 0x7efe2c152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:36.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe29d9b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe2c0a9130 0x7efe2c1460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:36.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe2c0ae740 0x7efe2c152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42264/0 (socket says 172.21.15.60:42264) 2020-10-31T22:41:36.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2ad9d700 1 -- 172.21.15.60:0/2186585058 learned_addr learned my addr 172.21.15.60:0/2186585058 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:36.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2a59c700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe2c0631c0 0x7efe2c066da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:36.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2a59c700 1 -- 172.21.15.60:0/2186585058 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe2c0a9130 msgr2=0x7efe2c1460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:36.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2a59c700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe2c0a9130 0x7efe2c1460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2a59c700 1 -- 172.21.15.60:0/2186585058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe2c0ae740 msgr2=0x7efe2c152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:36.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2a59c700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe2c0ae740 0x7efe2c152290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2a59c700 1 -- 172.21.15.60:0/2186585058 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c14e750 con 0x7efe2c0631c0 2020-10-31T22:41:36.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe29d9b700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe2c0a9130 0x7efe2c1460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:36.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2ad9d700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe2c0ae740 0x7efe2c152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2a59c700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe2c0631c0 0x7efe2c066da0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7efe1c00a000 tx=0x7efe1c008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:36.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe1b7fe700 1 -- 172.21.15.60:0/2186585058 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe1c011850 con 0x7efe2c0631c0 2020-10-31T22:41:36.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe1b7fe700 1 -- 172.21.15.60:0/2186585058 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c0119b0 con 0x7efe2c0631c0 2020-10-31T22:41:36.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2b59e700 1 -- 172.21.15.60:0/2186585058 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c0b5580 con 0x7efe2c0631c0 2020-10-31T22:41:36.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe1b7fe700 1 -- 172.21.15.60:0/2186585058 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe1c011d10 con 0x7efe2c0631c0 2020-10-31T22:41:36.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.687+0000 7efe2b59e700 1 -- 172.21.15.60:0/2186585058 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c146c10 con 0x7efe2c0631c0 2020-10-31T22:41:36.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.691+0000 7efe2b59e700 1 -- 172.21.15.60:0/2186585058 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c057100 con 0x7efe2c0631c0 2020-10-31T22:41:36.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.691+0000 7efe1b7fe700 1 -- 172.21.15.60:0/2186585058 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7efe1c012420 con 0x7efe2c0631c0 2020-10-31T22:41:36.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.691+0000 7efe1b7fe700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe08054f10 0x7efe080573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.691+0000 7efe1b7fe700 1 -- 172.21.15.60:0/2186585058 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efe1c06dbc0 con 0x7efe2c0631c0 2020-10-31T22:41:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.691+0000 7efe29d9b700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe08054f10 0x7efe080573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:36.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.691+0000 7efe29d9b700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe08054f10 0x7efe080573d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7efe2001c000 tx=0x7efe20015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:36.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.703+0000 7efe1b7fe700 1 -- 172.21.15.60:0/2186585058 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7efe1c043ef0 con 0x7efe2c0631c0 2020-10-31T22:41:36.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.891+0000 7efe2b59e700 1 -- 172.21.15.60:0/2186585058 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe2c05ed50 con 0x7efe2c0631c0 2020-10-31T22:41:36.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.891+0000 7efe1b7fe700 1 -- 172.21.15.60:0/2186585058 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+2483 (secure 0 0 0) 0x7efe1c047510 con 0x7efe2c0631c0 2020-10-31T22:41:36.897 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:36.897 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/909749940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":909749940},{"type":"v1","addr":"172.21.15.60:6837","nonce":909749940}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3142095774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3142095774},{"type":"v1","addr":"172.21.15.60:6835","nonce":3142095774}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:41:10.055893+0000","modified":"2020-10-31T22:41:11.058634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4306},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4306":{"gid":4306,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.66:6833/4161698670","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4161698670},{"type":"v1","addr":"172.21.15.66:6833","nonce":4161698670}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-10-31T22:41:36.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.895+0000 7efe2b59e700 1 -- 172.21.15.60:0/2186585058 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe08054f10 msgr2=0x7efe080573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:36.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.895+0000 7efe2b59e700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe08054f10 0x7efe080573d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7efe2001c000 tx=0x7efe20015000).stop 2020-10-31T22:41:36.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.895+0000 7efe2b59e700 1 -- 172.21.15.60:0/2186585058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe2c0631c0 msgr2=0x7efe2c066da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:36.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.895+0000 7efe2b59e700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe2c0631c0 0x7efe2c066da0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7efe1c00a000 tx=0x7efe1c008040).stop 2020-10-31T22:41:36.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.895+0000 7efe2b59e700 1 -- 172.21.15.60:0/2186585058 shutdown_connections 2020-10-31T22:41:36.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.895+0000 7efe2b59e700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe2c0ae740 0x7efe2c152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.895+0000 7efe2b59e700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe08054f10 0x7efe080573d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.895+0000 7efe2b59e700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe2c0631c0 0x7efe2c066da0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.895+0000 7efe2b59e700 1 --2- 172.21.15.60:0/2186585058 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe2c0a9130 0x7efe2c1460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:36.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.895+0000 7efe2b59e700 1 -- 172.21.15.60:0/2186585058 >> 172.21.15.60:0/2186585058 conn(0x7efe2c06a600 msgr2=0x7efe2c060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:36.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.895+0000 7efe2b59e700 1 -- 172.21.15.60:0/2186585058 shutdown_connections 2020-10-31T22:41:36.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:36.895+0000 7efe2b59e700 1 -- 172.21.15.60:0/2186585058 wait complete. 2020-10-31T22:41:36.902 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 5 2020-10-31T22:41:36.916 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-10-31T22:41:37.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 Processor -- start 2020-10-31T22:41:37.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 -- start start 2020-10-31T22:41:37.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47d00b24a0 0x7f47d00b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:37.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47d0141fe0 0x7f47d0142450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:37.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d0145180 con 0x7f47d00b5570 2020-10-31T22:41:37.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47d00afae0 con 0x7f47d0141fe0 2020-10-31T22:41:37.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d0141bf0 con 0x7f47d00b24a0 2020-10-31T22:41:37.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d5c84700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f47d00b5570 0x7f47d0145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46404/0 (socket says 172.21.15.60:46404) 2020-10-31T22:41:37.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6485700 1 --2- 172.21.15.60:0/263012860 >> v2:172.21.15.60:3300/0 conn(0x7f47d0141fe0 0x7f47d0142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:37.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d5c84700 1 -- 172.21.15.60:0/263012860 learned_addr learned my addr 172.21.15.60:0/263012860 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:37.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d5483700 1 --2- 172.21.15.60:0/263012860 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47d00b24a0 0x7f47d00b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:37.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d4c82700 1 -- 172.21.15.60:0/263012860 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705711146 0 0) 0x7f47d0145180 con 0x7f47d00b5570 2020-10-31T22:41:37.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d4c82700 1 -- 172.21.15.60:0/263012860 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47bc003230 con 0x7f47d00b5570 2020-10-31T22:41:37.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d4c82700 1 -- 172.21.15.60:0/263012860 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4271132619 0 0) 0x7f47bc003230 con 0x7f47d00b5570 2020-10-31T22:41:37.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6485700 1 -- 172.21.15.60:0/263012860 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47d00b24a0 msgr2=0x7f47d00b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6485700 1 --2- 172.21.15.60:0/263012860 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47d00b24a0 0x7f47d00b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6485700 1 -- 172.21.15.60:0/263012860 >> v1:172.21.15.60:6789/0 conn(0x7f47d00b5570 legacy=0x7f47d0145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6485700 1 -- 172.21.15.60:0/263012860 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d00b0670 con 0x7f47d0141fe0 2020-10-31T22:41:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6485700 1 --2- 172.21.15.60:0/263012860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d0141fe0 0x7f47d0142450 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f47c0001bf0 tx=0x7f47c8006dc0).ready entity=mon.0 client_cookie=3c03696f17f5226 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d4c82700 1 -- 172.21.15.60:0/263012860 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47c0001a50 con 0x7f47d0141fe0 2020-10-31T22:41:37.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d4c82700 1 -- 172.21.15.60:0/263012860 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c800d570 con 0x7f47d0141fe0 2020-10-31T22:41:37.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d4c82700 1 -- 172.21.15.60:0/263012860 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47c800d6e0 con 0x7f47d0141fe0 2020-10-31T22:41:37.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 -- 172.21.15.60:0/263012860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d0141fe0 msgr2=0x7f47d0142450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:37.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 --2- 172.21.15.60:0/263012860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d0141fe0 0x7f47d0142450 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f47c0001bf0 tx=0x7f47c8006dc0).stop 2020-10-31T22:41:37.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 -- 172.21.15.60:0/263012860 shutdown_connections 2020-10-31T22:41:37.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 --2- 172.21.15.60:0/263012860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d0141fe0 0x7f47d0142450 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:37.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 --2- 172.21.15.60:0/263012860 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47d00b24a0 0x7f47d00b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:37.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 -- 172.21.15.60:0/263012860 >> 172.21.15.60:0/263012860 conn(0x7f47d00b8e90 msgr2=0x7f47d00b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:37.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 -- 172.21.15.60:0/263012860 shutdown_connections 2020-10-31T22:41:37.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.031+0000 7f47d6c86700 1 -- 172.21.15.60:0/263012860 wait complete. 2020-10-31T22:41:37.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6c86700 1 Processor -- start 2020-10-31T22:41:37.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6c86700 1 -- start start 2020-10-31T22:41:37.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6c86700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d00b24a0 0x7f47d013bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:37.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6c86700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47d00b5570 0x7f47d0144800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:37.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6c86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d0141fe0 0x7f47d0150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:37.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6c86700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d0144130 con 0x7f47d0141fe0 2020-10-31T22:41:37.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6c86700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d01549b0 con 0x7f47d00b24a0 2020-10-31T22:41:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6c86700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d0154c50 con 0x7f47d00b5570 2020-10-31T22:41:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6485700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d0141fe0 0x7f47d0150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6485700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d0141fe0 0x7f47d0150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42278/0 (socket says 172.21.15.60:42278) 2020-10-31T22:41:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6485700 1 -- 172.21.15.60:0/142017056 learned_addr learned my addr 172.21.15.60:0/142017056 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d5c84700 1 --2- 172.21.15.60:0/142017056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d00b24a0 0x7f47d013bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d5483700 1 --2- 172.21.15.60:0/142017056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47d00b5570 0x7f47d0144800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6485700 1 -- 172.21.15.60:0/142017056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47d00b5570 msgr2=0x7f47d0144800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6485700 1 --2- 172.21.15.60:0/142017056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47d00b5570 0x7f47d0144800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6485700 1 -- 172.21.15.60:0/142017056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d00b24a0 msgr2=0x7f47d013bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6485700 1 --2- 172.21.15.60:0/142017056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d00b24a0 0x7f47d013bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6485700 1 -- 172.21.15.60:0/142017056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d0144360 con 0x7f47d0141fe0 2020-10-31T22:41:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6485700 1 --2- 172.21.15.60:0/142017056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d0141fe0 0x7f47d0150940 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f47c0001bf0 tx=0x7f47c8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47ceffd700 1 -- 172.21.15.60:0/142017056 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47c8011c30 con 0x7f47d0141fe0 2020-10-31T22:41:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47ceffd700 1 -- 172.21.15.60:0/142017056 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c8011d90 con 0x7f47d0141fe0 2020-10-31T22:41:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47ceffd700 1 -- 172.21.15.60:0/142017056 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47c801e650 con 0x7f47d0141fe0 2020-10-31T22:41:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6c86700 1 -- 172.21.15.60:0/142017056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d013c400 con 0x7f47d0141fe0 2020-10-31T22:41:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.035+0000 7f47d6c86700 1 -- 172.21.15.60:0/142017056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d013fc30 con 0x7f47d0141fe0 2020-10-31T22:41:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.039+0000 7f47d6c86700 1 -- 172.21.15.60:0/142017056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d01444f0 con 0x7f47d0141fe0 2020-10-31T22:41:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.039+0000 7f47ceffd700 1 -- 172.21.15.60:0/142017056 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f47c8025030 con 0x7f47d0141fe0 2020-10-31T22:41:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.039+0000 7f47ceffd700 1 --2- 172.21.15.60:0/142017056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47b0054f90 0x7f47b0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.039+0000 7f47d5c84700 1 --2- 172.21.15.60:0/142017056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47b0054f90 0x7f47b0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.039+0000 7f47ceffd700 1 -- 172.21.15.60:0/142017056 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f47c806eea0 con 0x7f47d0141fe0 2020-10-31T22:41:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.039+0000 7f47d5c84700 1 --2- 172.21.15.60:0/142017056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47b0054f90 0x7f47b0057450 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f47c000d000 tx=0x7f47c00021d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.043+0000 7f47ceffd700 1 -- 172.21.15.60:0/142017056 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f47c8045230 con 0x7f47d0141fe0 2020-10-31T22:41:37.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.231+0000 7f47d6c86700 1 -- 172.21.15.60:0/142017056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f47d0057100 con 0x7f47d0141fe0 2020-10-31T22:41:37.937 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:41:37.935+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:41:37.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.947+0000 7f47ceffd700 1 -- 172.21.15.60:0/142017056 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v6) v1 ==== 161+0+0 (secure 0 0 0) 0x7f47c8048850 con 0x7f47d0141fe0 2020-10-31T22:41:37.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.951+0000 7f47d6c86700 1 -- 172.21.15.60:0/142017056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47b0054f90 msgr2=0x7f47b0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:37.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.951+0000 7f47d6c86700 1 --2- 172.21.15.60:0/142017056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47b0054f90 0x7f47b0057450 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f47c000d000 tx=0x7f47c00021d0).stop 2020-10-31T22:41:37.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.951+0000 7f47d6c86700 1 -- 172.21.15.60:0/142017056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d0141fe0 msgr2=0x7f47d0150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:37.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.951+0000 7f47d6c86700 1 --2- 172.21.15.60:0/142017056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d0141fe0 0x7f47d0150940 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f47c0001bf0 tx=0x7f47c8015000).stop 2020-10-31T22:41:37.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.951+0000 7f47d6c86700 1 -- 172.21.15.60:0/142017056 shutdown_connections 2020-10-31T22:41:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.951+0000 7f47d6c86700 1 --2- 172.21.15.60:0/142017056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d0141fe0 0x7f47d0150940 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.951+0000 7f47d6c86700 1 --2- 172.21.15.60:0/142017056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47b0054f90 0x7f47b0057450 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:37.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.951+0000 7f47d6c86700 1 --2- 172.21.15.60:0/142017056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d00b24a0 0x7f47d013bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:37.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.951+0000 7f47d6c86700 1 --2- 172.21.15.60:0/142017056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47d00b5570 0x7f47d0144800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:37.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.951+0000 7f47d6c86700 1 -- 172.21.15.60:0/142017056 >> 172.21.15.60:0/142017056 conn(0x7f47d00b8e90 msgr2=0x7f47d00b1400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:37.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.951+0000 7f47d6c86700 1 -- 172.21.15.60:0/142017056 shutdown_connections 2020-10-31T22:41:37.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:37.951+0000 7f47d6c86700 1 -- 172.21.15.60:0/142017056 wait complete. 2020-10-31T22:41:37.963 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-10-31T22:41:37.972 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:41:37.978 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:41:38.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3826833700 1 Processor -- start 2020-10-31T22:41:38.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3826833700 1 -- start start 2020-10-31T22:41:38.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3826833700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38200b1d50 0x7f382005c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:38.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3826833700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38200b2130 con 0x7f3820140230 2020-10-31T22:41:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3826833700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38200af380 con 0x7f38200b0d60 2020-10-31T22:41:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3826833700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382006a9b0 con 0x7f38200b1d50 2020-10-31T22:41:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3825831700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38200b1d50 0x7f382005c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3825831700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38200b1d50 0x7f382005c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42282/0 (socket says 172.21.15.60:42282) 2020-10-31T22:41:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3825831700 1 -- 172.21.15.60:0/1387949782 learned_addr learned my addr 172.21.15.60:0/1387949782 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:38.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3825831700 1 -- 172.21.15.60:0/1387949782 >> v1:172.21.15.66:6789/0 conn(0x7f38200b0d60 legacy=0x7f382013fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3825831700 1 -- 172.21.15.60:0/1387949782 >> v1:172.21.15.60:6789/0 conn(0x7f3820140230 legacy=0x7f382013c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3825831700 1 -- 172.21.15.60:0/1387949782 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382005b160 con 0x7f38200b1d50 2020-10-31T22:41:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3825831700 1 --2- 172.21.15.60:0/1387949782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38200b1d50 0x7f382005c6a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f38200af0f0 tx=0x7f3818009270).ready entity=mon.0 client_cookie=ac7c8d64985e0aab server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f382482f700 1 -- 172.21.15.60:0/1387949782 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f381800bbc0 con 0x7f38200b1d50 2020-10-31T22:41:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f382482f700 1 -- 172.21.15.60:0/1387949782 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381800bd20 con 0x7f38200b1d50 2020-10-31T22:41:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3826833700 1 -- 172.21.15.60:0/1387949782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38200b1d50 msgr2=0x7f382005c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:38.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3826833700 1 --2- 172.21.15.60:0/1387949782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38200b1d50 0x7f382005c6a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f38200af0f0 tx=0x7f3818009270).stop 2020-10-31T22:41:38.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f382482f700 1 -- 172.21.15.60:0/1387949782 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f381800be90 con 0x7f38200b1d50 2020-10-31T22:41:38.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3826833700 1 -- 172.21.15.60:0/1387949782 shutdown_connections 2020-10-31T22:41:38.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3826833700 1 --2- 172.21.15.60:0/1387949782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38200b1d50 0x7f382005c6a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:38.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3826833700 1 -- 172.21.15.60:0/1387949782 >> 172.21.15.60:0/1387949782 conn(0x7f38200b5300 msgr2=0x7f38200b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:38.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3826833700 1 -- 172.21.15.60:0/1387949782 shutdown_connections 2020-10-31T22:41:38.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.095+0000 7f3826833700 1 -- 172.21.15.60:0/1387949782 wait complete. 2020-10-31T22:41:38.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3826833700 1 Processor -- start 2020-10-31T22:41:38.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3826833700 1 -- start start 2020-10-31T22:41:38.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3826833700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38200b0d60 0x7f38200a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:38.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3826833700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38200b1d50 0x7f3820145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:38.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3826833700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3820140230 0x7f3820151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:38.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3826833700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3820147020 con 0x7f38200b1d50 2020-10-31T22:41:38.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3826833700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38200aaf60 con 0x7f3820140230 2020-10-31T22:41:38.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3826833700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38200ab190 con 0x7f38200b0d60 2020-10-31T22:41:38.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3825030700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38200b1d50 0x7f3820145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:38.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3825030700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38200b1d50 0x7f3820145d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42288/0 (socket says 172.21.15.60:42288) 2020-10-31T22:41:38.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3825030700 1 -- 172.21.15.60:0/4095203194 learned_addr learned my addr 172.21.15.60:0/4095203194 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:38.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3825831700 1 --2- 172.21.15.60:0/4095203194 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38200b0d60 0x7f38200a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:38.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3826032700 1 --2- 172.21.15.60:0/4095203194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3820140230 0x7f3820151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:38.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3825030700 1 -- 172.21.15.60:0/4095203194 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38200b0d60 msgr2=0x7f38200a96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:38.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3825030700 1 --2- 172.21.15.60:0/4095203194 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38200b0d60 0x7f38200a96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:38.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3825030700 1 -- 172.21.15.60:0/4095203194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3820140230 msgr2=0x7f3820151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3825030700 1 --2- 172.21.15.60:0/4095203194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3820140230 0x7f3820151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3825030700 1 -- 172.21.15.60:0/4095203194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38200ab430 con 0x7f38200b1d50 2020-10-31T22:41:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3825030700 1 --2- 172.21.15.60:0/4095203194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38200b1d50 0x7f3820145d30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f381c001f50 tx=0x7f381c007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3816ffd700 1 -- 172.21.15.60:0/4095203194 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f381c00e4a0 con 0x7f38200b1d50 2020-10-31T22:41:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3816ffd700 1 -- 172.21.15.60:0/4095203194 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381c00e600 con 0x7f38200b1d50 2020-10-31T22:41:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3826833700 1 -- 172.21.15.60:0/4095203194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3820150da0 con 0x7f38200b1d50 2020-10-31T22:41:38.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3816ffd700 1 -- 172.21.15.60:0/4095203194 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f381c00e770 con 0x7f38200b1d50 2020-10-31T22:41:38.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.099+0000 7f3826833700 1 -- 172.21.15.60:0/4095203194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38200abca0 con 0x7f38200b1d50 2020-10-31T22:41:38.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.103+0000 7f3826833700 1 -- 172.21.15.60:0/4095203194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3820150f30 con 0x7f38200b1d50 2020-10-31T22:41:38.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.103+0000 7f3816ffd700 1 -- 172.21.15.60:0/4095203194 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f381c010030 con 0x7f38200b1d50 2020-10-31T22:41:38.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.103+0000 7f3816ffd700 1 --2- 172.21.15.60:0/4095203194 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3800054f90 0x7f3800057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:38.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.103+0000 7f3816ffd700 1 -- 172.21.15.60:0/4095203194 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f381c06d630 con 0x7f38200b1d50 2020-10-31T22:41:38.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.103+0000 7f3825831700 1 --2- 172.21.15.60:0/4095203194 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3800054f90 0x7f3800057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:38.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.103+0000 7f3825831700 1 --2- 172.21.15.60:0/4095203194 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3800054f90 0x7f3800057450 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f381801a000 tx=0x7f3818016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:38.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.111+0000 7f3816ffd700 1 -- 172.21.15.60:0/4095203194 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f381c043b00 con 0x7f38200b1d50 2020-10-31T22:41:38.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.295+0000 7f3826833700 1 -- 172.21.15.60:0/4095203194 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3820057100 con 0x7f38200b1d50 2020-10-31T22:41:38.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.295+0000 7f3816ffd700 1 -- 172.21.15.60:0/4095203194 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2123 (secure 0 0 0) 0x7f381c047120 con 0x7f38200b1d50 2020-10-31T22:41:38.300 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:38.300 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/909749940","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":909749940},{"type":"v1","addr":"172.21.15.60:6837","nonce":909749940}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":5},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3142095774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3142095774},{"type":"v1","addr":"172.21.15.60:6835","nonce":3142095774}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:41:10.055893+0000","modified":"2020-10-31T22:41:37.937895+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":23,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-10-31T22:41:38.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.299+0000 7f3826833700 1 -- 172.21.15.60:0/4095203194 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3800054f90 msgr2=0x7f3800057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:38.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.299+0000 7f3826833700 1 --2- 172.21.15.60:0/4095203194 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3800054f90 0x7f3800057450 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f381801a000 tx=0x7f3818016000).stop 2020-10-31T22:41:38.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.299+0000 7f3826833700 1 -- 172.21.15.60:0/4095203194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38200b1d50 msgr2=0x7f3820145d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:38.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.299+0000 7f3826833700 1 --2- 172.21.15.60:0/4095203194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38200b1d50 0x7f3820145d30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f381c001f50 tx=0x7f381c007c00).stop 2020-10-31T22:41:38.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.299+0000 7f3826833700 1 -- 172.21.15.60:0/4095203194 shutdown_connections 2020-10-31T22:41:38.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.299+0000 7f3826833700 1 --2- 172.21.15.60:0/4095203194 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3800054f90 0x7f3800057450 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:38.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.299+0000 7f3826833700 1 --2- 172.21.15.60:0/4095203194 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3820140230 0x7f3820151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:38.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.299+0000 7f3826833700 1 --2- 172.21.15.60:0/4095203194 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38200b0d60 0x7f38200a96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:38.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.299+0000 7f3826833700 1 --2- 172.21.15.60:0/4095203194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38200b1d50 0x7f3820145d30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:38.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.299+0000 7f3826833700 1 -- 172.21.15.60:0/4095203194 >> 172.21.15.60:0/4095203194 conn(0x7f38200b5300 msgr2=0x7f38200b3be0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:38.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.299+0000 7f3826833700 1 -- 172.21.15.60:0/4095203194 shutdown_connections 2020-10-31T22:41:38.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.299+0000 7f3826833700 1 -- 172.21.15.60:0/4095203194 wait complete. 2020-10-31T22:41:38.306 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 6 2020-10-31T22:41:38.320 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:41:38.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.435+0000 7f6b30ce5700 1 Processor -- start 2020-10-31T22:41:38.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.435+0000 7f6b30ce5700 1 -- start start 2020-10-31T22:41:38.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b30ce5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6b2c0b2e20 0x7f6b2c05c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:38.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b30ce5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b2c0b4410 0x7f6b2c146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:38.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b30ce5700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b2c065e90 con 0x7f6b2c05c4c0 2020-10-31T22:41:38.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b30ce5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2c141ef0 con 0x7f6b2c0b2e20 2020-10-31T22:41:38.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b30ce5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c066130 con 0x7f6b2c0b4410 2020-10-31T22:41:38.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b29d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6b2c0b2e20 0x7f6b2c05c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:38.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b29d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6b2c0b2e20 0x7f6b2c05c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42298/0 (socket says 172.21.15.60:42298) 2020-10-31T22:41:38.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b29d9b700 1 -- 172.21.15.60:0/1163742642 learned_addr learned my addr 172.21.15.60:0/1163742642 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:38.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b2ad9d700 1 --2- 172.21.15.60:0/1163742642 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b2c0b4410 0x7f6b2c146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:38.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b29d9b700 1 -- 172.21.15.60:0/1163742642 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b2c0b4410 msgr2=0x7f6b2c146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:38.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b29d9b700 1 --2- 172.21.15.60:0/1163742642 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b2c0b4410 0x7f6b2c146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:38.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b29d9b700 1 -- 172.21.15.60:0/1163742642 >> v1:172.21.15.66:6789/0 conn(0x7f6b2c05c4c0 legacy=0x7f6b2c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:38.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b29d9b700 1 -- 172.21.15.60:0/1163742642 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c0663d0 con 0x7f6b2c0b2e20 2020-10-31T22:41:38.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b29d9b700 1 --2- 172.21.15.60:0/1163742642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b2c0b2e20 0x7f6b2c05c8a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f6b14002f30 tx=0x7f6b14006e80).ready entity=mon.0 client_cookie=50a0a366020dc6c9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:38.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b2959a700 1 -- 172.21.15.60:0/1163742642 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b140097f0 con 0x7f6b2c0b2e20 2020-10-31T22:41:38.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b2959a700 1 -- 172.21.15.60:0/1163742642 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b14009950 con 0x7f6b2c0b2e20 2020-10-31T22:41:38.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b2959a700 1 -- 172.21.15.60:0/1163742642 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b14009ac0 con 0x7f6b2c0b2e20 2020-10-31T22:41:38.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b30ce5700 1 -- 172.21.15.60:0/1163742642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b2c0b2e20 msgr2=0x7f6b2c05c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:38.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b30ce5700 1 --2- 172.21.15.60:0/1163742642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b2c0b2e20 0x7f6b2c05c8a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f6b14002f30 tx=0x7f6b14006e80).stop 2020-10-31T22:41:38.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b30ce5700 1 -- 172.21.15.60:0/1163742642 shutdown_connections 2020-10-31T22:41:38.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b30ce5700 1 --2- 172.21.15.60:0/1163742642 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b2c0b4410 0x7f6b2c146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:38.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b30ce5700 1 --2- 172.21.15.60:0/1163742642 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b2c0b2e20 0x7f6b2c05c8a0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:38.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b30ce5700 1 -- 172.21.15.60:0/1163742642 >> 172.21.15.60:0/1163742642 conn(0x7f6b2c0601e0 msgr2=0x7f6b2c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:38.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b30ce5700 1 -- 172.21.15.60:0/1163742642 shutdown_connections 2020-10-31T22:41:38.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.439+0000 7f6b30ce5700 1 -- 172.21.15.60:0/1163742642 wait complete. 2020-10-31T22:41:38.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b30ce5700 1 Processor -- start 2020-10-31T22:41:38.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b30ce5700 1 -- start start 2020-10-31T22:41:38.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b30ce5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b2c05c4c0 0x7f6b2c144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:38.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b30ce5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b2c0b4410 0x7f6b2c13e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:38.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b30ce5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b2c13eda0 0x7f6b2c151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:38.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b30ce5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c0acd10 con 0x7f6b2c13eda0 2020-10-31T22:41:38.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b30ce5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c13f230 con 0x7f6b2c0b4410 2020-10-31T22:41:38.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b30ce5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2c0aeca0 con 0x7f6b2c05c4c0 2020-10-31T22:41:38.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b2ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b2c13eda0 0x7f6b2c151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:38.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b29d9b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b2c0b4410 0x7f6b2c13e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:38.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b2ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b2c13eda0 0x7f6b2c151160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42306/0 (socket says 172.21.15.60:42306) 2020-10-31T22:41:38.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b2ad9d700 1 -- 172.21.15.60:0/868562627 learned_addr learned my addr 172.21.15.60:0/868562627 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:38.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b2a59c700 1 --2- 172.21.15.60:0/868562627 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b2c05c4c0 0x7f6b2c144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:38.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b2ad9d700 1 -- 172.21.15.60:0/868562627 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b2c05c4c0 msgr2=0x7f6b2c144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:38.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b2ad9d700 1 --2- 172.21.15.60:0/868562627 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b2c05c4c0 0x7f6b2c144790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:38.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b2ad9d700 1 -- 172.21.15.60:0/868562627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b2c0b4410 msgr2=0x7f6b2c13e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:38.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b2ad9d700 1 --2- 172.21.15.60:0/868562627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b2c0b4410 0x7f6b2c13e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:38.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b2ad9d700 1 -- 172.21.15.60:0/868562627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c0ae4c0 con 0x7f6b2c13eda0 2020-10-31T22:41:38.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b2ad9d700 1 --2- 172.21.15.60:0/868562627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b2c13eda0 0x7f6b2c151160 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f6b2c0ac5c0 tx=0x7f6b24008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:38.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.443+0000 7f6b237fe700 1 -- 172.21.15.60:0/868562627 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b2400b9a0 con 0x7f6b2c13eda0 2020-10-31T22:41:38.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.447+0000 7f6b237fe700 1 -- 172.21.15.60:0/868562627 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2400bb00 con 0x7f6b2c13eda0 2020-10-31T22:41:38.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.447+0000 7f6b30ce5700 1 -- 172.21.15.60:0/868562627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2c0ae760 con 0x7f6b2c13eda0 2020-10-31T22:41:38.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.447+0000 7f6b237fe700 1 -- 172.21.15.60:0/868562627 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b2400be60 con 0x7f6b2c13eda0 2020-10-31T22:41:38.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.447+0000 7f6b30ce5700 1 -- 172.21.15.60:0/868562627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2c0ae200 con 0x7f6b2c13eda0 2020-10-31T22:41:38.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.447+0000 7f6b237fe700 1 -- 172.21.15.60:0/868562627 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6b2401c460 con 0x7f6b2c13eda0 2020-10-31T22:41:38.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.447+0000 7f6b30ce5700 1 -- 172.21.15.60:0/868562627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2c057100 con 0x7f6b2c13eda0 2020-10-31T22:41:38.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.447+0000 7f6b237fe700 1 --2- 172.21.15.60:0/868562627 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6b10054f90 0x7f6b10057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:38.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.447+0000 7f6b237fe700 1 -- 172.21.15.60:0/868562627 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f6b2406e160 con 0x7f6b2c13eda0 2020-10-31T22:41:38.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.447+0000 7f6b2a59c700 1 --2- 172.21.15.60:0/868562627 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6b10054f90 0x7f6b10057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:38.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.447+0000 7f6b2a59c700 1 --2- 172.21.15.60:0/868562627 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6b10054f90 0x7f6b10057450 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f6b1c00d000 tx=0x7f6b1c000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:38.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.455+0000 7f6b237fe700 1 -- 172.21.15.60:0/868562627 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6b24047f60 con 0x7f6b2c13eda0 2020-10-31T22:41:38.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.639+0000 7f6b30ce5700 1 -- 172.21.15.60:0/868562627 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6b2c05aa70 con 0x7f6b2c13eda0 2020-10-31T22:41:38.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.951+0000 7f6b237fe700 1 -- 172.21.15.60:0/868562627 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6b24047b50 con 0x7f6b2c13eda0 2020-10-31T22:41:39.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.955+0000 7f6b30ce5700 1 -- 172.21.15.60:0/868562627 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6b10054f90 msgr2=0x7f6b10057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.955+0000 7f6b30ce5700 1 --2- 172.21.15.60:0/868562627 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6b10054f90 0x7f6b10057450 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f6b1c00d000 tx=0x7f6b1c000b80).stop 2020-10-31T22:41:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.955+0000 7f6b30ce5700 1 -- 172.21.15.60:0/868562627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b2c13eda0 msgr2=0x7f6b2c151160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.955+0000 7f6b30ce5700 1 --2- 172.21.15.60:0/868562627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b2c13eda0 0x7f6b2c151160 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f6b2c0ac5c0 tx=0x7f6b24008040).stop 2020-10-31T22:41:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.955+0000 7f6b30ce5700 1 -- 172.21.15.60:0/868562627 shutdown_connections 2020-10-31T22:41:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.955+0000 7f6b30ce5700 1 --2- 172.21.15.60:0/868562627 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b2c13eda0 0x7f6b2c151160 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.955+0000 7f6b30ce5700 1 --2- 172.21.15.60:0/868562627 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6b2c05c4c0 0x7f6b2c144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.955+0000 7f6b30ce5700 1 --2- 172.21.15.60:0/868562627 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6b10054f90 0x7f6b10057450 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.955+0000 7f6b30ce5700 1 --2- 172.21.15.60:0/868562627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b2c0b4410 0x7f6b2c13e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.955+0000 7f6b30ce5700 1 -- 172.21.15.60:0/868562627 >> 172.21.15.60:0/868562627 conn(0x7f6b2c0601e0 msgr2=0x7f6b2c13fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:39.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.955+0000 7f6b30ce5700 1 -- 172.21.15.60:0/868562627 shutdown_connections 2020-10-31T22:41:39.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:38.955+0000 7f6b30ce5700 1 -- 172.21.15.60:0/868562627 wait complete. 2020-10-31T22:41:39.074 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:41:39.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b6e7d700 1 Processor -- start 2020-10-31T22:41:39.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b6e7d700 1 -- start start 2020-10-31T22:41:39.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b6e7d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f40b00b1d50 0x7f40b01420e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:39.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b6e7d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40b00ae450 0x7f40b00ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:39.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b6e7d700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b00b2130 con 0x7f40b00afc50 2020-10-31T22:41:39.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b6e7d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b00af200 con 0x7f40b00b1d50 2020-10-31T22:41:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b6e7d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b013e140 con 0x7f40b00ae450 2020-10-31T22:41:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b5e7b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f40b00b1d50 0x7f40b01420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b5e7b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f40b00b1d50 0x7f40b01420e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42310/0 (socket says 172.21.15.60:42310) 2020-10-31T22:41:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b5e7b700 1 -- 172.21.15.60:0/1542265856 learned_addr learned my addr 172.21.15.60:0/1542265856 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:39.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b667c700 1 --2- 172.21.15.60:0/1542265856 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40b00ae450 0x7f40b00ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:39.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b5e7b700 1 -- 172.21.15.60:0/1542265856 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40b00ae450 msgr2=0x7f40b00ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:39.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b5e7b700 1 --2- 172.21.15.60:0/1542265856 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40b00ae450 0x7f40b00ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:39.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b5e7b700 1 -- 172.21.15.60:0/1542265856 >> v1:172.21.15.66:6789/0 conn(0x7f40b00afc50 legacy=0x7f40b013e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:39.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b5e7b700 1 -- 172.21.15.60:0/1542265856 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b00af3f0 con 0x7f40b00b1d50 2020-10-31T22:41:39.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b5e7b700 1 --2- 172.21.15.60:0/1542265856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40b00b1d50 0x7f40b01420e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f40b013e6b0 tx=0x7f40ac006e80).ready entity=mon.0 client_cookie=490f873910b09304 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b4e79700 1 -- 172.21.15.60:0/1542265856 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40ac0097b0 con 0x7f40b00b1d50 2020-10-31T22:41:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b4e79700 1 -- 172.21.15.60:0/1542265856 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac009910 con 0x7f40b00b1d50 2020-10-31T22:41:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b4e79700 1 -- 172.21.15.60:0/1542265856 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40ac009c70 con 0x7f40b00b1d50 2020-10-31T22:41:39.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b6e7d700 1 -- 172.21.15.60:0/1542265856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40b00b1d50 msgr2=0x7f40b01420e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:39.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.207+0000 7f40b6e7d700 1 --2- 172.21.15.60:0/1542265856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40b00b1d50 0x7f40b01420e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f40b013e6b0 tx=0x7f40ac006e80).stop 2020-10-31T22:41:39.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b6e7d700 1 -- 172.21.15.60:0/1542265856 shutdown_connections 2020-10-31T22:41:39.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b6e7d700 1 --2- 172.21.15.60:0/1542265856 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40b00ae450 0x7f40b00ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:39.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b6e7d700 1 --2- 172.21.15.60:0/1542265856 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40b00b1d50 0x7f40b01420e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:39.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b6e7d700 1 -- 172.21.15.60:0/1542265856 >> 172.21.15.60:0/1542265856 conn(0x7f40b00b5330 msgr2=0x7f40b00b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:39.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b6e7d700 1 -- 172.21.15.60:0/1542265856 shutdown_connections 2020-10-31T22:41:39.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b6e7d700 1 -- 172.21.15.60:0/1542265856 wait complete. 2020-10-31T22:41:39.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b6e7d700 1 Processor -- start 2020-10-31T22:41:39.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b6e7d700 1 -- start start 2020-10-31T22:41:39.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b6e7d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40b00ae450 0x7f40b014e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:39.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b6e7d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40b00afc50 0x7f40b013aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:39.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b6e7d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40b00b1d50 0x7f40b00a8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:39.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b6e7d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00ab220 con 0x7f40b00ae450 2020-10-31T22:41:39.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b6e7d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00ab950 con 0x7f40b00afc50 2020-10-31T22:41:39.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b6e7d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b00ab410 con 0x7f40b00b1d50 2020-10-31T22:41:39.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b5e7b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40b00ae450 0x7f40b014e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:39.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b5e7b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40b00ae450 0x7f40b014e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42316/0 (socket says 172.21.15.60:42316) 2020-10-31T22:41:39.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b5e7b700 1 -- 172.21.15.60:0/3172317609 learned_addr learned my addr 172.21.15.60:0/3172317609 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:39.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b667c700 1 --2- 172.21.15.60:0/3172317609 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40b00b1d50 0x7f40b00a8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:39.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.211+0000 7f40b567a700 1 --2- 172.21.15.60:0/3172317609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40b00afc50 0x7f40b013aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:39.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f40b5e7b700 1 -- 172.21.15.60:0/3172317609 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40b00b1d50 msgr2=0x7f40b00a8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:39.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f40b5e7b700 1 --2- 172.21.15.60:0/3172317609 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40b00b1d50 0x7f40b00a8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:39.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f40b5e7b700 1 -- 172.21.15.60:0/3172317609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40b00afc50 msgr2=0x7f40b013aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:39.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f40b5e7b700 1 --2- 172.21.15.60:0/3172317609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40b00afc50 0x7f40b013aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:39.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f40b5e7b700 1 -- 172.21.15.60:0/3172317609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b00ab6b0 con 0x7f40b00ae450 2020-10-31T22:41:39.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f40b5e7b700 1 --2- 172.21.15.60:0/3172317609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40b00ae450 0x7f40b014e240 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f40b013e6b0 tx=0x7f40ac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:39.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f409effd700 1 -- 172.21.15.60:0/3172317609 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40ac011b10 con 0x7f40b00ae450 2020-10-31T22:41:39.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f409effd700 1 -- 172.21.15.60:0/3172317609 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac011c70 con 0x7f40b00ae450 2020-10-31T22:41:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f40b6e7d700 1 -- 172.21.15.60:0/3172317609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b013b530 con 0x7f40b00ae450 2020-10-31T22:41:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f409effd700 1 -- 172.21.15.60:0/3172317609 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f40ac01e560 con 0x7f40b00ae450 2020-10-31T22:41:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f40b6e7d700 1 -- 172.21.15.60:0/3172317609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b013b9d0 con 0x7f40b00ae450 2020-10-31T22:41:39.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f40b6e7d700 1 -- 172.21.15.60:0/3172317609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b0057100 con 0x7f40b00ae450 2020-10-31T22:41:39.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f409effd700 1 -- 172.21.15.60:0/3172317609 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f40ac01a040 con 0x7f40b00ae450 2020-10-31T22:41:39.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f409effd700 1 --2- 172.21.15.60:0/3172317609 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4090054f10 0x7f40900573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:39.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f409effd700 1 -- 172.21.15.60:0/3172317609 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f40ac071000 con 0x7f40b00ae450 2020-10-31T22:41:39.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f40b567a700 1 --2- 172.21.15.60:0/3172317609 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4090054f10 0x7f40900573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:39.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.215+0000 7f40b567a700 1 --2- 172.21.15.60:0/3172317609 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4090054f10 0x7f40900573d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f40a000b000 tx=0x7f40a0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:39.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.223+0000 7f409effd700 1 -- 172.21.15.60:0/3172317609 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f40ac047430 con 0x7f40b00ae450 2020-10-31T22:41:39.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.371+0000 7f40b6e7d700 1 -- 172.21.15.60:0/3172317609 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f40b005ee00 con 0x7f40b00ae450 2020-10-31T22:41:39.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.959+0000 7f409effd700 1 -- 172.21.15.60:0/3172317609 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 185+0+0 (secure 0 0 0) 0x7f40ac04aa50 con 0x7f40b00ae450 2020-10-31T22:41:39.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.963+0000 7f40b6e7d700 1 -- 172.21.15.60:0/3172317609 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4090054f10 msgr2=0x7f40900573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.963+0000 7f40b6e7d700 1 --2- 172.21.15.60:0/3172317609 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4090054f10 0x7f40900573d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f40a000b000 tx=0x7f40a0009040).stop 2020-10-31T22:41:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.963+0000 7f40b6e7d700 1 -- 172.21.15.60:0/3172317609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40b00ae450 msgr2=0x7f40b014e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:39.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.963+0000 7f40b6e7d700 1 --2- 172.21.15.60:0/3172317609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40b00ae450 0x7f40b014e240 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f40b013e6b0 tx=0x7f40ac015000).stop 2020-10-31T22:41:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.963+0000 7f40b6e7d700 1 -- 172.21.15.60:0/3172317609 shutdown_connections 2020-10-31T22:41:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.963+0000 7f40b6e7d700 1 --2- 172.21.15.60:0/3172317609 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40b00b1d50 0x7f40b00a8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.963+0000 7f40b6e7d700 1 --2- 172.21.15.60:0/3172317609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40b00ae450 0x7f40b014e240 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:39.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.963+0000 7f40b6e7d700 1 --2- 172.21.15.60:0/3172317609 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4090054f10 0x7f40900573d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:39.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.963+0000 7f40b6e7d700 1 --2- 172.21.15.60:0/3172317609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40b00afc50 0x7f40b013aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:39.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.963+0000 7f40b6e7d700 1 -- 172.21.15.60:0/3172317609 >> 172.21.15.60:0/3172317609 conn(0x7f40b00b5330 msgr2=0x7f40b013e6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:39.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.967+0000 7f40b6e7d700 1 -- 172.21.15.60:0/3172317609 shutdown_connections 2020-10-31T22:41:39.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:39.967+0000 7f40b6e7d700 1 -- 172.21.15.60:0/3172317609 wait complete. 2020-10-31T22:41:39.972 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:41:39.988 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-10-31T22:41:40.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.111+0000 7fe8233a1700 1 Processor -- start 2020-10-31T22:41:40.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.111+0000 7fe8233a1700 1 -- start start 2020-10-31T22:41:40.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.111+0000 7fe8233a1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe81c0b5380 0x7fe81c0ac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:40.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.111+0000 7fe8233a1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe81c0b0b50 0x7fe81c0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:40.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.111+0000 7fe8233a1700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c0acd60 con 0x7fe81c0b1b20 2020-10-31T22:41:40.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.111+0000 7fe8233a1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c0ad650 con 0x7fe81c0b0b50 2020-10-31T22:41:40.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.111+0000 7fe8233a1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0b5760 con 0x7fe81c0b5380 2020-10-31T22:41:40.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.111+0000 7fe821b9e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe81c0b0b50 0x7fe81c0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:40.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.111+0000 7fe822ba0700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe81c0b1b20 0x7fe81c0b1f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46464/0 (socket says 172.21.15.60:46464) 2020-10-31T22:41:40.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.111+0000 7fe822ba0700 1 -- 172.21.15.60:0/2664045167 learned_addr learned my addr 172.21.15.60:0/2664045167 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:40.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.111+0000 7fe82239f700 1 --2- 172.21.15.60:0/2664045167 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe81c0b5380 0x7fe81c0ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:40.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.111+0000 7fe82139d700 1 -- 172.21.15.60:0/2664045167 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3570713118 0 0) 0x7fe81c0acd60 con 0x7fe81c0b1b20 2020-10-31T22:41:40.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.111+0000 7fe82139d700 1 -- 172.21.15.60:0/2664045167 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe804003230 con 0x7fe81c0b1b20 2020-10-31T22:41:40.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.111+0000 7fe821b9e700 1 -- 172.21.15.60:0/2664045167 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe81c0b5380 msgr2=0x7fe81c0ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:40.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe821b9e700 1 --2- 172.21.15.60:0/2664045167 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe81c0b5380 0x7fe81c0ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:40.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe821b9e700 1 -- 172.21.15.60:0/2664045167 >> v1:172.21.15.60:6789/0 conn(0x7fe81c0b1b20 legacy=0x7fe81c0b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:40.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe821b9e700 1 -- 172.21.15.60:0/2664045167 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0b14c0 con 0x7fe81c0b0b50 2020-10-31T22:41:40.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe821b9e700 1 --2- 172.21.15.60:0/2664045167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c0b0b50 0x7fe81c0b0fd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fe80c002f30 tx=0x7fe80c006dc0).ready entity=mon.0 client_cookie=554865c4b3029806 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:40.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe82139d700 1 -- 172.21.15.60:0/2664045167 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe80c0096a0 con 0x7fe81c0b0b50 2020-10-31T22:41:40.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe82139d700 1 -- 172.21.15.60:0/2664045167 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c009800 con 0x7fe81c0b0b50 2020-10-31T22:41:40.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe82139d700 1 -- 172.21.15.60:0/2664045167 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe80c009b60 con 0x7fe81c0b0b50 2020-10-31T22:41:40.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 -- 172.21.15.60:0/2664045167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c0b0b50 msgr2=0x7fe81c0b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:40.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 --2- 172.21.15.60:0/2664045167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c0b0b50 0x7fe81c0b0fd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fe80c002f30 tx=0x7fe80c006dc0).stop 2020-10-31T22:41:40.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 -- 172.21.15.60:0/2664045167 shutdown_connections 2020-10-31T22:41:40.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 --2- 172.21.15.60:0/2664045167 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe81c0b5380 0x7fe81c0ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:40.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 --2- 172.21.15.60:0/2664045167 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c0b0b50 0x7fe81c0b0fd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:40.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 -- 172.21.15.60:0/2664045167 >> 172.21.15.60:0/2664045167 conn(0x7fe81c06a600 msgr2=0x7fe81c060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:40.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 -- 172.21.15.60:0/2664045167 shutdown_connections 2020-10-31T22:41:40.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 -- 172.21.15.60:0/2664045167 wait complete. 2020-10-31T22:41:40.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 Processor -- start 2020-10-31T22:41:40.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 -- start start 2020-10-31T22:41:40.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c0b0b50 0x7fe81c14f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:40.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe81c0b1b20 0x7fe81c144510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:40.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe81c0b5380 0x7fe81c144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:40.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c14f8c0 con 0x7fe81c0b0b50 2020-10-31T22:41:40.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c065e40 con 0x7fe81c0b1b20 2020-10-31T22:41:40.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe8233a1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0660e0 con 0x7fe81c0b5380 2020-10-31T22:41:40.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe82239f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c0b0b50 0x7fe81c14f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:40.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe82239f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c0b0b50 0x7fe81c14f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42332/0 (socket says 172.21.15.60:42332) 2020-10-31T22:41:40.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.115+0000 7fe82239f700 1 -- 172.21.15.60:0/899959432 learned_addr learned my addr 172.21.15.60:0/899959432 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:40.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe822ba0700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe81c0b5380 0x7fe81c144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:40.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe821b9e700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe81c0b1b20 0x7fe81c144510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:40.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe82239f700 1 -- 172.21.15.60:0/899959432 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe81c0b5380 msgr2=0x7fe81c144a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:40.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe82239f700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe81c0b5380 0x7fe81c144a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:40.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe82239f700 1 -- 172.21.15.60:0/899959432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe81c0b1b20 msgr2=0x7fe81c144510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:40.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe82239f700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe81c0b1b20 0x7fe81c144510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:40.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe82239f700 1 -- 172.21.15.60:0/899959432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c066380 con 0x7fe81c0b0b50 2020-10-31T22:41:40.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe821b9e700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe81c0b1b20 0x7fe81c144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:40.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe82239f700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c0b0b50 0x7fe81c14f3d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fe81800c000 tx=0x7fe818008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:40.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe80b7fe700 1 -- 172.21.15.60:0/899959432 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe81800c8b0 con 0x7fe81c0b0b50 2020-10-31T22:41:40.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe8233a1700 1 -- 172.21.15.60:0/899959432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c066620 con 0x7fe81c0b0b50 2020-10-31T22:41:40.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe8233a1700 1 -- 172.21.15.60:0/899959432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c145140 con 0x7fe81c0b0b50 2020-10-31T22:41:40.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe80b7fe700 1 -- 172.21.15.60:0/899959432 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81800ca10 con 0x7fe81c0b0b50 2020-10-31T22:41:40.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe80b7fe700 1 -- 172.21.15.60:0/899959432 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe81800cd70 con 0x7fe81c0b0b50 2020-10-31T22:41:40.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe8233a1700 1 -- 172.21.15.60:0/899959432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c0667b0 con 0x7fe81c0b0b50 2020-10-31T22:41:40.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.119+0000 7fe80b7fe700 1 -- 172.21.15.60:0/899959432 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe818022070 con 0x7fe81c0b0b50 2020-10-31T22:41:40.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.123+0000 7fe80b7fe700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7fc054f90 0x7fe7fc057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:40.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.123+0000 7fe80b7fe700 1 -- 172.21.15.60:0/899959432 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fe81806ddc0 con 0x7fe81c0b0b50 2020-10-31T22:41:40.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.123+0000 7fe821b9e700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7fc054f90 0x7fe7fc057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:40.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.123+0000 7fe821b9e700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7fc054f90 0x7fe7fc057450 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fe80c019000 tx=0x7fe80c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:40.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.127+0000 7fe80b7fe700 1 -- 172.21.15.60:0/899959432 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe8180443a0 con 0x7fe81c0b0b50 2020-10-31T22:41:40.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.271+0000 7fe8233a1700 1 -- 172.21.15.60:0/899959432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe81c057100 con 0x7fe81c0b0b50 2020-10-31T22:41:40.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.963+0000 7fe80b7fe700 1 -- 172.21.15.60:0/899959432 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 173+0+0 (secure 0 0 0) 0x7fe8180479c0 con 0x7fe81c0b0b50 2020-10-31T22:41:40.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.967+0000 7fe8233a1700 1 -- 172.21.15.60:0/899959432 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7fc054f90 msgr2=0x7fe7fc057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:40.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.967+0000 7fe8233a1700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7fc054f90 0x7fe7fc057450 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fe80c019000 tx=0x7fe80c015000).stop 2020-10-31T22:41:40.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.967+0000 7fe8233a1700 1 -- 172.21.15.60:0/899959432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c0b0b50 msgr2=0x7fe81c14f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:40.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.967+0000 7fe8233a1700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c0b0b50 0x7fe81c14f3d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fe81800c000 tx=0x7fe818008040).stop 2020-10-31T22:41:40.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.967+0000 7fe8233a1700 1 -- 172.21.15.60:0/899959432 shutdown_connections 2020-10-31T22:41:40.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.967+0000 7fe8233a1700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe81c0b5380 0x7fe81c144a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:40.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.967+0000 7fe8233a1700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe81c0b0b50 0x7fe81c14f3d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:40.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.967+0000 7fe8233a1700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7fc054f90 0x7fe7fc057450 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:40.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.967+0000 7fe8233a1700 1 --2- 172.21.15.60:0/899959432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe81c0b1b20 0x7fe81c144510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:40.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.967+0000 7fe8233a1700 1 -- 172.21.15.60:0/899959432 >> 172.21.15.60:0/899959432 conn(0x7fe81c06a600 msgr2=0x7fe81c0ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:40.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.967+0000 7fe8233a1700 1 -- 172.21.15.60:0/899959432 shutdown_connections 2020-10-31T22:41:40.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:40.967+0000 7fe8233a1700 1 -- 172.21.15.60:0/899959432 wait complete. 2020-10-31T22:41:40.974 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2020-10-31T22:41:40.987 INFO:tasks.ceph.mds.a:Restarting daemon 2020-10-31T22:41:40.987 INFO:tasks.ceph.mds.a:Stopping old one... 2020-10-31T22:41:40.988 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-10-31T22:41:40.988 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:41:40.989 INFO:tasks.ceph.mds.c:Restarting daemon 2020-10-31T22:41:40.989 INFO:tasks.ceph.mds.c:Stopping old one... 2020-10-31T22:41:40.989 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-10-31T22:41:40.989 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:41:40.989 INFO:tasks.ceph.mds.b:Restarting daemon 2020-10-31T22:41:40.990 INFO:tasks.ceph.mds.b:Stopping old one... 2020-10-31T22:41:40.990 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-10-31T22:41:40.990 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:41:41.000 INFO:tasks.ceph.mds.a:Stopped 2020-10-31T22:41:41.000 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-10-31T22:41:41.003 INFO:tasks.ceph.mds.b:Stopped 2020-10-31T22:41:41.003 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-10-31T22:41:41.004 INFO:tasks.ceph.mds.c:Stopped 2020-10-31T22:41:41.005 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-10-31T22:41:41.048 INFO:tasks.ceph.mds.b:Started 2020-10-31T22:41:41.048 DEBUG:teuthology.parallel:result is None 2020-10-31T22:41:41.049 INFO:tasks.ceph.mds.a:Started 2020-10-31T22:41:41.050 DEBUG:teuthology.parallel:result is None 2020-10-31T22:41:41.052 INFO:tasks.ceph.mds.c:Started 2020-10-31T22:41:41.052 DEBUG:teuthology.parallel:result is None 2020-10-31T22:41:41.053 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-10-31T22:41:41.123 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:41:41.128 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:41:41.140 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:41:41.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67fea8b700 1 Processor -- start 2020-10-31T22:41:41.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67fea8b700 1 -- start start 2020-10-31T22:41:41.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67fea8b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67f80b0c70 0x7f67f80ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:41.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67fea8b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67f80afc90 0x7f67f813eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:41.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67fea8b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f67f813ef90 0x7f67f813f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67fea8b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f80abad0 con 0x7f67f80afc90 2020-10-31T22:41:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67fea8b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f80b1050 con 0x7f67f813ef90 2020-10-31T22:41:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67fea8b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f80ae070 con 0x7f67f80b0c70 2020-10-31T22:41:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67effff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67f80afc90 0x7f67f813eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67effff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67f80afc90 0x7f67f813eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42370/0 (socket says 172.21.15.60:42370) 2020-10-31T22:41:41.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67effff700 1 -- 172.21.15.60:0/1658903812 learned_addr learned my addr 172.21.15.60:0/1658903812 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:41.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67fc827700 1 --2- 172.21.15.60:0/1658903812 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67f80b0c70 0x7f67f80ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:41.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67fd028700 1 --2- 172.21.15.60:0/1658903812 >> v2:172.21.15.66:3300/0 conn(0x7f67f813ef90 0x7f67f813f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:41.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67effff700 1 -- 172.21.15.60:0/1658903812 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67f80b0c70 msgr2=0x7f67f80ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:41.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67effff700 1 --2- 172.21.15.60:0/1658903812 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67f80b0c70 0x7f67f80ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:41.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67effff700 1 -- 172.21.15.60:0/1658903812 >> v2:172.21.15.66:3300/0 conn(0x7f67f813ef90 msgr2=0x7f67f813f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:41.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67effff700 1 --2- 172.21.15.60:0/1658903812 >> v2:172.21.15.66:3300/0 conn(0x7f67f813ef90 0x7f67f813f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:41.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67effff700 1 -- 172.21.15.60:0/1658903812 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f80ab590 con 0x7f67f80afc90 2020-10-31T22:41:41.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67effff700 1 --2- 172.21.15.60:0/1658903812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f80afc90 0x7f67f813eaa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f67e8002f30 tx=0x7f67e8006e80).ready entity=mon.0 client_cookie=523a9d22435b6e6b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:41.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67ef7fe700 1 -- 172.21.15.60:0/1658903812 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67e8009640 con 0x7f67f80afc90 2020-10-31T22:41:41.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67ef7fe700 1 -- 172.21.15.60:0/1658903812 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e80097a0 con 0x7f67f80afc90 2020-10-31T22:41:41.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67ef7fe700 1 -- 172.21.15.60:0/1658903812 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67e8009b00 con 0x7f67f80afc90 2020-10-31T22:41:41.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67fea8b700 1 -- 172.21.15.60:0/1658903812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f80afc90 msgr2=0x7f67f813eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:41.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.171+0000 7f67fea8b700 1 --2- 172.21.15.60:0/1658903812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f80afc90 0x7f67f813eaa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f67e8002f30 tx=0x7f67e8006e80).stop 2020-10-31T22:41:41.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.175+0000 7f67fea8b700 1 -- 172.21.15.60:0/1658903812 shutdown_connections 2020-10-31T22:41:41.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.175+0000 7f67fea8b700 1 --2- 172.21.15.60:0/1658903812 >> v2:172.21.15.66:3300/0 conn(0x7f67f813ef90 0x7f67f813f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:41.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.175+0000 7f67fea8b700 1 --2- 172.21.15.60:0/1658903812 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67f80b0c70 0x7f67f80ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:41.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.175+0000 7f67fea8b700 1 --2- 172.21.15.60:0/1658903812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f80afc90 0x7f67f813eaa0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:41.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.175+0000 7f67fea8b700 1 -- 172.21.15.60:0/1658903812 >> 172.21.15.60:0/1658903812 conn(0x7f67f805fd60 msgr2=0x7f67f8061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:41.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.175+0000 7f67fea8b700 1 -- 172.21.15.60:0/1658903812 shutdown_connections 2020-10-31T22:41:41.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.175+0000 7f67fea8b700 1 -- 172.21.15.60:0/1658903812 wait complete. 2020-10-31T22:41:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.175+0000 7f67fea8b700 1 Processor -- start 2020-10-31T22:41:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.175+0000 7f67fea8b700 1 -- start start 2020-10-31T22:41:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fea8b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67f80afc90 0x7f67f813fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fea8b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67f80b0c70 0x7f67f8141690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:41.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fea8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f813ef90 0x7f67f8141b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:41.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fea8b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f80b2120 con 0x7f67f813ef90 2020-10-31T22:41:41.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fea8b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f80b27f0 con 0x7f67f80afc90 2020-10-31T22:41:41.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fea8b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f80b3a20 con 0x7f67f80b0c70 2020-10-31T22:41:41.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fc827700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67f80afc90 0x7f67f813fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:41.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67effff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67f80b0c70 0x7f67f8141690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:41.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fc827700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67f80afc90 0x7f67f813fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:53310/0 (socket says 172.21.15.60:53310) 2020-10-31T22:41:41.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fc827700 1 -- 172.21.15.60:0/1719652526 learned_addr learned my addr 172.21.15.60:0/1719652526 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:41.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fd028700 1 --2- 172.21.15.60:0/1719652526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f813ef90 0x7f67f8141b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:41.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fd028700 1 -- 172.21.15.60:0/1719652526 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67f80b0c70 msgr2=0x7f67f8141690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:41.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fd028700 1 --2- 172.21.15.60:0/1719652526 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67f80b0c70 0x7f67f8141690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:41.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fd028700 1 -- 172.21.15.60:0/1719652526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67f80afc90 msgr2=0x7f67f813fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:41.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fd028700 1 --2- 172.21.15.60:0/1719652526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67f80afc90 0x7f67f813fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:41.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fd028700 1 -- 172.21.15.60:0/1719652526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f80b3cc0 con 0x7f67f813ef90 2020-10-31T22:41:41.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fc827700 1 --2- 172.21.15.60:0/1719652526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67f80afc90 0x7f67f813fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:41.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fd028700 1 --2- 172.21.15.60:0/1719652526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f813ef90 0x7f67f8141b80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f67f000c000 tx=0x7f67f00091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:41.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67edffb700 1 -- 172.21.15.60:0/1719652526 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67f000c9c0 con 0x7f67f813ef90 2020-10-31T22:41:41.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67edffb700 1 -- 172.21.15.60:0/1719652526 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f000cb20 con 0x7f67f813ef90 2020-10-31T22:41:41.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fea8b700 1 -- 172.21.15.60:0/1719652526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f8142d80 con 0x7f67f813ef90 2020-10-31T22:41:41.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67edffb700 1 -- 172.21.15.60:0/1719652526 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67f000ce80 con 0x7f67f813ef90 2020-10-31T22:41:41.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fea8b700 1 -- 172.21.15.60:0/1719652526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f813e7f0 con 0x7f67f813ef90 2020-10-31T22:41:41.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.179+0000 7f67fea8b700 1 -- 172.21.15.60:0/1719652526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f80b3030 con 0x7f67f813ef90 2020-10-31T22:41:41.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.183+0000 7f67edffb700 1 -- 172.21.15.60:0/1719652526 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f67f0022070 con 0x7f67f813ef90 2020-10-31T22:41:41.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.183+0000 7f67edffb700 1 --2- 172.21.15.60:0/1719652526 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f67d8054f10 0x7f67d80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:41.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.183+0000 7f67fc827700 1 --2- 172.21.15.60:0/1719652526 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f67d8054f10 0x7f67d80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:41.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.183+0000 7f67edffb700 1 -- 172.21.15.60:0/1719652526 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f67f006dda0 con 0x7f67f813ef90 2020-10-31T22:41:41.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.183+0000 7f67fc827700 1 --2- 172.21.15.60:0/1719652526 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f67d8054f10 0x7f67d80573d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f67f400b000 tx=0x7f67f4006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:41.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.191+0000 7f67edffb700 1 -- 172.21.15.60:0/1719652526 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f67f80b3030 con 0x7f67f813ef90 2020-10-31T22:41:41.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:41.347+0000 7f67fea8b700 1 -- 172.21.15.60:0/1719652526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f67f80b3030 con 0x7f67f813ef90 2020-10-31T22:41:42.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.163+0000 7f67edffb700 1 -- 172.21.15.60:0/1719652526 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7f67f80b3030 con 0x7f67f813ef90 2020-10-31T22:41:42.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.163+0000 7f67fea8b700 1 -- 172.21.15.60:0/1719652526 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f67d8054f10 msgr2=0x7f67d80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:42.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.163+0000 7f67fea8b700 1 --2- 172.21.15.60:0/1719652526 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f67d8054f10 0x7f67d80573d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f67f400b000 tx=0x7f67f4006dc0).stop 2020-10-31T22:41:42.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.167+0000 7f67fea8b700 1 -- 172.21.15.60:0/1719652526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f813ef90 msgr2=0x7f67f8141b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:42.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.167+0000 7f67fea8b700 1 --2- 172.21.15.60:0/1719652526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f813ef90 0x7f67f8141b80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f67f000c000 tx=0x7f67f00091a0).stop 2020-10-31T22:41:42.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.167+0000 7f67fea8b700 1 -- 172.21.15.60:0/1719652526 shutdown_connections 2020-10-31T22:41:42.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.167+0000 7f67fea8b700 1 --2- 172.21.15.60:0/1719652526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f813ef90 0x7f67f8141b80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.167+0000 7f67fea8b700 1 --2- 172.21.15.60:0/1719652526 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f67d8054f10 0x7f67d80573d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.167+0000 7f67fea8b700 1 --2- 172.21.15.60:0/1719652526 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67f80afc90 0x7f67f813fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.167+0000 7f67fea8b700 1 --2- 172.21.15.60:0/1719652526 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67f80b0c70 0x7f67f8141690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.167+0000 7f67fea8b700 1 -- 172.21.15.60:0/1719652526 >> 172.21.15.60:0/1719652526 conn(0x7f67f805fd60 msgr2=0x7f67f80b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:42.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.167+0000 7f67fea8b700 1 -- 172.21.15.60:0/1719652526 shutdown_connections 2020-10-31T22:41:42.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.167+0000 7f67fea8b700 1 -- 172.21.15.60:0/1719652526 wait complete. 2020-10-31T22:41:42.170 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blacklist entries 2020-10-31T22:41:42.185 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2020-10-31T22:41:42.186 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-10-31T22:41:42.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.299+0000 7f7c6b59e700 1 Processor -- start 2020-10-31T22:41:42.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.299+0000 7f7c6b59e700 1 -- start start 2020-10-31T22:41:42.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c6c05bbb0 0x7f7c6c13ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6b59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7c6c0ae030 0x7f7c6c0ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6b59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6c05bf90 con 0x7f7c6c0ac770 2020-10-31T22:41:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6b59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c6c0ab410 con 0x7f7c6c0ae030 2020-10-31T22:41:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c0acc00 con 0x7f7c6c05bbb0 2020-10-31T22:41:42.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6ad9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7c6c0ac770 0x7f7c6c05afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46522/0 (socket says 172.21.15.60:46522) 2020-10-31T22:41:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6ad9d700 1 -- 172.21.15.60:0/1409843672 learned_addr learned my addr 172.21.15.60:0/1409843672 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6a59c700 1 --2- 172.21.15.60:0/1409843672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c6c05bbb0 0x7f7c6c13ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c69d9b700 1 --2- 172.21.15.60:0/1409843672 >> v2:172.21.15.66:3300/0 conn(0x7f7c6c0ae030 0x7f7c6c0ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 -- 172.21.15.60:0/1409843672 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 607037253 0 0) 0x7f7c6c05bf90 con 0x7f7c6c0ac770 2020-10-31T22:41:42.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 -- 172.21.15.60:0/1409843672 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c50003230 con 0x7f7c6c0ac770 2020-10-31T22:41:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 -- 172.21.15.60:0/1409843672 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2753766751 0 0) 0x7f7c50003230 con 0x7f7c6c0ac770 2020-10-31T22:41:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 -- 172.21.15.60:0/1409843672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c6c05bbb0 msgr2=0x7f7c6c13ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 --2- 172.21.15.60:0/1409843672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c6c05bbb0 0x7f7c6c13ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 -- 172.21.15.60:0/1409843672 >> v2:172.21.15.66:3300/0 conn(0x7f7c6c0ae030 msgr2=0x7f7c6c0ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 --2- 172.21.15.60:0/1409843672 >> v2:172.21.15.66:3300/0 conn(0x7f7c6c0ae030 0x7f7c6c0ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 -- 172.21.15.60:0/1409843672 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c0ab600 con 0x7f7c6c0ac770 2020-10-31T22:41:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 -- 172.21.15.60:0/1409843672 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f7c64001a50 con 0x7f7c6c0ac770 2020-10-31T22:41:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 -- 172.21.15.60:0/1409843672 >> v1:172.21.15.60:6789/0 conn(0x7f7c6c0ac770 legacy=0x7f7c6c05afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 --2- 172.21.15.60:0/1409843672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c6c05bbb0 0x7f7c50003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 --2- 172.21.15.60:0/1409843672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c50003c30 0x7f7c500044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 --2- 172.21.15.60:0/1409843672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c500049c0 0x7f7c50004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 -- 172.21.15.60:0/1409843672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c0acc00 con 0x7f7c500049c0 2020-10-31T22:41:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 -- 172.21.15.60:0/1409843672 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c500041c0 con 0x7f7c50003c30 2020-10-31T22:41:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 -- 172.21.15.60:0/1409843672 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5000b720 con 0x7f7c6c05bbb0 2020-10-31T22:41:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c69d9b700 1 --2- 172.21.15.60:0/1409843672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c50003c30 0x7f7c500044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6a59c700 1 --2- 172.21.15.60:0/1409843672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c6c05bbb0 0x7f7c50003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6ad9d700 1 --2- 172.21.15.60:0/1409843672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c500049c0 0x7f7c50004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c69d9b700 1 -- 172.21.15.60:0/1409843672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c6c05bbb0 msgr2=0x7f7c50003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c69d9b700 1 --2- 172.21.15.60:0/1409843672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c6c05bbb0 0x7f7c50003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c69d9b700 1 -- 172.21.15.60:0/1409843672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c500049c0 msgr2=0x7f7c50004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c69d9b700 1 --2- 172.21.15.60:0/1409843672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c500049c0 0x7f7c50004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c69d9b700 1 -- 172.21.15.60:0/1409843672 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c50003230 con 0x7f7c50003c30 2020-10-31T22:41:42.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6ad9d700 1 --2- 172.21.15.60:0/1409843672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c500049c0 0x7f7c50004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c69d9b700 1 --2- 172.21.15.60:0/1409843672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c50003c30 0x7f7c500044d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f7c5c00c000 tx=0x7f7c5c008040).ready entity=mon.1 client_cookie=447cd4af2cec546f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 -- 172.21.15.60:0/1409843672 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c5c00e910 con 0x7f7c50003c30 2020-10-31T22:41:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6959a700 1 -- 172.21.15.60:0/1409843672 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c00ea70 con 0x7f7c50003c30 2020-10-31T22:41:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6b59e700 1 -- 172.21.15.60:0/1409843672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c50003c30 msgr2=0x7f7c500044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6b59e700 1 --2- 172.21.15.60:0/1409843672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c50003c30 0x7f7c500044d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f7c5c00c000 tx=0x7f7c5c008040).stop 2020-10-31T22:41:42.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6ad9d700 1 -- 172.21.15.60:0/1409843672 reap_dead start 2020-10-31T22:41:42.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6b59e700 1 -- 172.21.15.60:0/1409843672 shutdown_connections 2020-10-31T22:41:42.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.303+0000 7f7c6b59e700 1 -- 172.21.15.60:0/1409843672 >> 172.21.15.60:0/1409843672 conn(0x7f7c6c0b3fd0 msgr2=0x7f7c6c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:42.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6b59e700 1 -- 172.21.15.60:0/1409843672 shutdown_connections 2020-10-31T22:41:42.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6b59e700 1 -- 172.21.15.60:0/1409843672 wait complete. 2020-10-31T22:41:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6b59e700 1 Processor -- start 2020-10-31T22:41:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6b59e700 1 -- start start 2020-10-31T22:41:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c6c13e9b0 0x7f7c6c065160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c6c13c030 0x7f7c6c13c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6b59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c6c13cc70 0x7f7c6c13d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c063bd0 con 0x7f7c6c13e9b0 2020-10-31T22:41:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6b59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c064a60 con 0x7f7c6c13cc70 2020-10-31T22:41:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c066730 con 0x7f7c6c13c030 2020-10-31T22:41:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c6c13e9b0 0x7f7c6c065160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c6c13e9b0 0x7f7c6c065160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42398/0 (socket says 172.21.15.60:42398) 2020-10-31T22:41:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6a59c700 1 -- 172.21.15.60:0/3544705767 learned_addr learned my addr 172.21.15.60:0/3544705767 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c69d9b700 1 --2- 172.21.15.60:0/3544705767 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c6c13c030 0x7f7c6c13c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6ad9d700 1 --2- 172.21.15.60:0/3544705767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c6c13cc70 0x7f7c6c13d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6a59c700 1 -- 172.21.15.60:0/3544705767 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c6c13c030 msgr2=0x7f7c6c13c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6a59c700 1 --2- 172.21.15.60:0/3544705767 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c6c13c030 0x7f7c6c13c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6a59c700 1 -- 172.21.15.60:0/3544705767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c6c13cc70 msgr2=0x7f7c6c13d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6a59c700 1 --2- 172.21.15.60:0/3544705767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c6c13cc70 0x7f7c6c13d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6a59c700 1 -- 172.21.15.60:0/3544705767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c13bcd0 con 0x7f7c6c13e9b0 2020-10-31T22:41:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6a59c700 1 --2- 172.21.15.60:0/3544705767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c6c13e9b0 0x7f7c6c065160 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f7c6c064670 tx=0x7f7c60008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c5b7fe700 1 -- 172.21.15.60:0/3544705767 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c6000fa90 con 0x7f7c6c13e9b0 2020-10-31T22:41:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c5b7fe700 1 -- 172.21.15.60:0/3544705767 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6000fbf0 con 0x7f7c6c13e9b0 2020-10-31T22:41:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6b59e700 1 -- 172.21.15.60:0/3544705767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c066490 con 0x7f7c6c13e9b0 2020-10-31T22:41:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c5b7fe700 1 -- 172.21.15.60:0/3544705767 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c6000fd60 con 0x7f7c6c13e9b0 2020-10-31T22:41:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.307+0000 7f7c6b59e700 1 -- 172.21.15.60:0/3544705767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c0a71b0 con 0x7f7c6c13e9b0 2020-10-31T22:41:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.311+0000 7f7c6b59e700 1 -- 172.21.15.60:0/3544705767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6c13ef30 con 0x7f7c6c13e9b0 2020-10-31T22:41:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.311+0000 7f7c5b7fe700 1 -- 172.21.15.60:0/3544705767 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7c60024070 con 0x7f7c6c13e9b0 2020-10-31T22:41:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.311+0000 7f7c5b7fe700 1 --2- 172.21.15.60:0/3544705767 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7c48054f10 0x7f7c480573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.311+0000 7f7c5b7fe700 1 -- 172.21.15.60:0/3544705767 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7c6006dfb0 con 0x7f7c6c13e9b0 2020-10-31T22:41:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.311+0000 7f7c69d9b700 1 --2- 172.21.15.60:0/3544705767 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7c48054f10 0x7f7c480573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.311+0000 7f7c69d9b700 1 --2- 172.21.15.60:0/3544705767 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7c48054f10 0x7f7c480573d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f7c5c008000 tx=0x7f7c5c01a000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.319+0000 7f7c5b7fe700 1 -- 172.21.15.60:0/3544705767 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7c60044800 con 0x7f7c6c13e9b0 2020-10-31T22:41:42.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.507+0000 7f7c6b59e700 1 -- 172.21.15.60:0/3544705767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7c6c057100 con 0x7f7c6c13e9b0 2020-10-31T22:41:42.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.507+0000 7f7c5b7fe700 1 -- 172.21.15.60:0/3544705767 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5621 (secure 0 0 0) 0x7f7c60047e20 con 0x7f7c6c13e9b0 2020-10-31T22:41:42.511 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:42.511 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:41:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2020-10-31T22:41:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2020-10-31T22:41:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f7D/cFRAAHQ9NU7VSs14mi5sC/GwHng==", 2020-10-31T22:41:42.512 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:41:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:41:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:41:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:41:42.513 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2020-10-31T22:41:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f5SPjJBAAVjFv2PdBZ7j94etJrAT0tA==", 2020-10-31T22:41:42.514 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:41:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:41:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:41:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:41:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.515 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2020-10-31T22:41:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKpdoHhAAhhlaYqOQoI6tTKexjRpbGA==", 2020-10-31T22:41:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.516 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:41:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:41:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:41:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:41:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2020-10-31T22:41:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDR551f7MwsMRAACZIQlAKm3BdVbDs2gQAfxg==", 2020-10-31T22:41:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.518 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:41:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:41:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:41:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.519 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2020-10-31T22:41:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDU551f07HQFxAAokMFXwsbgKGtJNpnKerdGg==", 2020-10-31T22:41:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:41:42.520 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:41:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:41:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.521 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2020-10-31T22:41:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDW551fODyjOhAAJ+j8KITJidSpltSiJaQZGw==", 2020-10-31T22:41:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:41:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:41:42.522 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:41:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2020-10-31T22:41:42.523 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDZ551fs+aCIhAAwpbmgGQjU05W3hZofTtHdg==", 2020-10-31T22:41:42.524 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.524 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:41:42.524 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:41:42.524 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:41:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2020-10-31T22:41:42.525 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDe551fI5nIMxAAwwNSHQYDPS6G2achKIpwqg==", 2020-10-31T22:41:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:41:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:41:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:41:42.526 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2020-10-31T22:41:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDh551f68p2GhAAhlGpZLPg8RqouzStqN4tFw==", 2020-10-31T22:41:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:41:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:41:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:41:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.529 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2020-10-31T22:41:42.529 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDk551fUi3kARAAsXPU7HEhqax8Go00CqgdNw==", 2020-10-31T22:41:42.530 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:41:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:41:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:41:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2020-10-31T22:41:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDm551fKh4aJRAAj+whV4kueCu2Og7wZ05tNw==", 2020-10-31T22:41:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:41:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:41:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:41:42.532 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2020-10-31T22:41:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551flXvBJxAAtD4URDL2NV0zyAympufvVA==", 2020-10-31T22:41:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:41:42.533 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2020-10-31T22:41:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2020-10-31T22:41:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2020-10-31T22:41:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2020-10-31T22:41:42.534 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fQ/OGKhAA/xGrRlUW52pP6E6SWXYAGA==", 2020-10-31T22:41:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:41:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow r", 2020-10-31T22:41:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow rw", 2020-10-31T22:41:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rwx" 2020-10-31T22:41:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.535 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2020-10-31T22:41:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDP551fITgCMxAAQy5CQzqda1YjdUtTRxbsPQ==", 2020-10-31T22:41:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:41:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:41:42.536 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:41:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:41:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-mds", 2020-10-31T22:41:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDz551fIIBwNxAAzTd30em1BHYSsiL+t2j4eQ==", 2020-10-31T22:41:42.537 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-mds" 2020-10-31T22:41:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-mgr", 2020-10-31T22:41:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDz551fKaFwNxAAkaguAI6oLsTuz66k9CJYGA==", 2020-10-31T22:41:42.538 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-mgr" 2020-10-31T22:41:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-osd", 2020-10-31T22:41:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDz551fUrpwNxAAGsBrRpZyBXnCtkzSMQc96A==", 2020-10-31T22:41:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.539 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-osd" 2020-10-31T22:41:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rbd", 2020-10-31T22:41:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDz551faNVwNxAAMxzJ+F+dGKc1hmskzYl/2w==", 2020-10-31T22:41:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.540 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rbd" 2020-10-31T22:41:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rbd-mirror", 2020-10-31T22:41:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDz551fJ+9wNxAA7IlhXY9xjBiBG3wPE6ySgA==", 2020-10-31T22:41:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.541 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2020-10-31T22:41:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.bootstrap-rgw", 2020-10-31T22:41:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDz551f0AdxNxAAoacIrdqwiBWbFj/WX9am9Q==", 2020-10-31T22:41:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.542 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile bootstrap-rgw" 2020-10-31T22:41:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2020-10-31T22:41:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551feZUgExAAvGt2fUb5GhkkFQ0dbgP5nw==", 2020-10-31T22:41:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:41:42.543 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:41:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:41:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2020-10-31T22:41:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKiN5EBAAhHtXXE4+yydXWOK7agZ14g==", 2020-10-31T22:41:42.544 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:41:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:41:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:41:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:41:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:42.545 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:41:42.545 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:41:42.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.511+0000 7f7c6b59e700 1 -- 172.21.15.60:0/3544705767 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7c48054f10 msgr2=0x7f7c480573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:42.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.511+0000 7f7c6b59e700 1 --2- 172.21.15.60:0/3544705767 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7c48054f10 0x7f7c480573d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f7c5c008000 tx=0x7f7c5c01a000).stop 2020-10-31T22:41:42.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.511+0000 7f7c6b59e700 1 -- 172.21.15.60:0/3544705767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c6c13e9b0 msgr2=0x7f7c6c065160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:42.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.511+0000 7f7c6b59e700 1 --2- 172.21.15.60:0/3544705767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c6c13e9b0 0x7f7c6c065160 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f7c6c064670 tx=0x7f7c60008040).stop 2020-10-31T22:41:42.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.511+0000 7f7c6b59e700 1 -- 172.21.15.60:0/3544705767 shutdown_connections 2020-10-31T22:41:42.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.511+0000 7f7c6b59e700 1 --2- 172.21.15.60:0/3544705767 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7c48054f10 0x7f7c480573d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.511+0000 7f7c6b59e700 1 --2- 172.21.15.60:0/3544705767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c6c13cc70 0x7f7c6c13d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.511+0000 7f7c6b59e700 1 --2- 172.21.15.60:0/3544705767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c6c13e9b0 0x7f7c6c065160 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.511+0000 7f7c6b59e700 1 --2- 172.21.15.60:0/3544705767 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c6c13c030 0x7f7c6c13c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.511+0000 7f7c6b59e700 1 -- 172.21.15.60:0/3544705767 >> 172.21.15.60:0/3544705767 conn(0x7f7c6c0b3fd0 msgr2=0x7f7c6c0ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:42.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.511+0000 7f7c6b59e700 1 -- 172.21.15.60:0/3544705767 shutdown_connections 2020-10-31T22:41:42.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.511+0000 7f7c6b59e700 1 -- 172.21.15.60:0/3544705767 wait complete. 2020-10-31T22:41:42.549 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-mds 2020-10-31T22:41:42.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7b59e700 1 Processor -- start 2020-10-31T22:41:42.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7b59e700 1 -- start start 2020-10-31T22:41:42.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7b59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7d7c0b5570 0x7f7d7c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d7c0b24a0 0x7f7d7c145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7b59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d7c145180 con 0x7f7d7c145d10 2020-10-31T22:41:42.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7b59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7c0afae0 con 0x7f7d7c0b5570 2020-10-31T22:41:42.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c141bf0 con 0x7f7d7c0b24a0 2020-10-31T22:41:42.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7a59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7d7c0b5570 0x7f7d7c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7a59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7d7c0b5570 0x7f7d7c0b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42406/0 (socket says 172.21.15.60:42406) 2020-10-31T22:41:42.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7a59c700 1 -- 172.21.15.60:0/4084218104 learned_addr learned my addr 172.21.15.60:0/4084218104 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:42.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d79d9b700 1 --2- 172.21.15.60:0/4084218104 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d7c0b24a0 0x7f7d7c145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7a59c700 1 -- 172.21.15.60:0/4084218104 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d7c0b24a0 msgr2=0x7f7d7c145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:42.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7a59c700 1 --2- 172.21.15.60:0/4084218104 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d7c0b24a0 0x7f7d7c145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7a59c700 1 -- 172.21.15.60:0/4084218104 >> v1:172.21.15.66:6789/0 conn(0x7f7d7c145d10 legacy=0x7f7d7c141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:42.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7a59c700 1 -- 172.21.15.60:0/4084218104 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c0b0670 con 0x7f7d7c0b5570 2020-10-31T22:41:42.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.659+0000 7f7d7a59c700 1 --2- 172.21.15.60:0/4084218104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d7c0b5570 0x7f7d7c0b5950 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f7d6c002f30 tx=0x7f7d6c006e80).ready entity=mon.0 client_cookie=38f9d04c4dce195b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:42.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7959a700 1 -- 172.21.15.60:0/4084218104 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d6c0097f0 con 0x7f7d7c0b5570 2020-10-31T22:41:42.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7959a700 1 -- 172.21.15.60:0/4084218104 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c009950 con 0x7f7d7c0b5570 2020-10-31T22:41:42.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 -- 172.21.15.60:0/4084218104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d7c0b5570 msgr2=0x7f7d7c0b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:42.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 --2- 172.21.15.60:0/4084218104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d7c0b5570 0x7f7d7c0b5950 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f7d6c002f30 tx=0x7f7d6c006e80).stop 2020-10-31T22:41:42.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 -- 172.21.15.60:0/4084218104 shutdown_connections 2020-10-31T22:41:42.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 --2- 172.21.15.60:0/4084218104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d7c0b5570 0x7f7d7c0b5950 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 --2- 172.21.15.60:0/4084218104 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d7c0b24a0 0x7f7d7c145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 -- 172.21.15.60:0/4084218104 >> 172.21.15.60:0/4084218104 conn(0x7f7d7c0b8e90 msgr2=0x7f7d7c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:42.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 -- 172.21.15.60:0/4084218104 shutdown_connections 2020-10-31T22:41:42.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 -- 172.21.15.60:0/4084218104 wait complete. 2020-10-31T22:41:42.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 Processor -- start 2020-10-31T22:41:42.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 -- start start 2020-10-31T22:41:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d7c0b24a0 0x7f7d7c13c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d7c0b5570 0x7f7d7c1392c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d7c145d10 0x7f7d7c1540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c141240 con 0x7f7d7c0b24a0 2020-10-31T22:41:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c139960 con 0x7f7d7c0b5570 2020-10-31T22:41:42.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7c143bb0 con 0x7f7d7c145d10 2020-10-31T22:41:42.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d7c0b24a0 0x7f7d7c13c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d7c0b24a0 0x7f7d7c13c290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42412/0 (socket says 172.21.15.60:42412) 2020-10-31T22:41:42.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.663+0000 7f7d7a59c700 1 -- 172.21.15.60:0/2835631596 learned_addr learned my addr 172.21.15.60:0/2835631596 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:42.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d79d9b700 1 --2- 172.21.15.60:0/2835631596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d7c0b5570 0x7f7d7c1392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d7ad9d700 1 --2- 172.21.15.60:0/2835631596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d7c145d10 0x7f7d7c1540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d7a59c700 1 -- 172.21.15.60:0/2835631596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d7c145d10 msgr2=0x7f7d7c1540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:42.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d7a59c700 1 --2- 172.21.15.60:0/2835631596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d7c145d10 0x7f7d7c1540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d7a59c700 1 -- 172.21.15.60:0/2835631596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d7c0b5570 msgr2=0x7f7d7c1392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:42.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d7a59c700 1 --2- 172.21.15.60:0/2835631596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d7c0b5570 0x7f7d7c1392c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d7a59c700 1 -- 172.21.15.60:0/2835631596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7c143e50 con 0x7f7d7c0b24a0 2020-10-31T22:41:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d7a59c700 1 --2- 172.21.15.60:0/2835631596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d7c0b24a0 0x7f7d7c13c290 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f7d6c002f30 tx=0x7f7d6c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d737fe700 1 -- 172.21.15.60:0/2835631596 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d6c011b70 con 0x7f7d7c0b24a0 2020-10-31T22:41:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d737fe700 1 -- 172.21.15.60:0/2835631596 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d6c011cd0 con 0x7f7d7c0b24a0 2020-10-31T22:41:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d7b59e700 1 -- 172.21.15.60:0/2835631596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d7c1442f0 con 0x7f7d7c0b24a0 2020-10-31T22:41:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d737fe700 1 -- 172.21.15.60:0/2835631596 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7d6c01e650 con 0x7f7d7c0b24a0 2020-10-31T22:41:42.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d7b59e700 1 -- 172.21.15.60:0/2835631596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d7c1445a0 con 0x7f7d7c0b24a0 2020-10-31T22:41:42.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d7b59e700 1 -- 172.21.15.60:0/2835631596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d7c1397b0 con 0x7f7d7c0b24a0 2020-10-31T22:41:42.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.667+0000 7f7d737fe700 1 -- 172.21.15.60:0/2835631596 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7d6c025030 con 0x7f7d7c0b24a0 2020-10-31T22:41:42.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.671+0000 7f7d737fe700 1 --2- 172.21.15.60:0/2835631596 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7d60054f90 0x7f7d60057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:42.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.671+0000 7f7d737fe700 1 -- 172.21.15.60:0/2835631596 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7d6c06eab0 con 0x7f7d7c0b24a0 2020-10-31T22:41:42.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.671+0000 7f7d79d9b700 1 --2- 172.21.15.60:0/2835631596 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7d60054f90 0x7f7d60057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:42.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.671+0000 7f7d79d9b700 1 --2- 172.21.15.60:0/2835631596 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7d60054f90 0x7f7d60057450 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f7d6400c000 tx=0x7f7d64008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:42.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.675+0000 7f7d737fe700 1 -- 172.21.15.60:0/2835631596 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7d6c045340 con 0x7f7d7c0b24a0 2020-10-31T22:41:42.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.867+0000 7f7d7b59e700 1 -- 172.21.15.60:0/2835631596 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7d7c057100 con 0x7f7d7c0b24a0 2020-10-31T22:41:42.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.875+0000 7f7d737fe700 1 -- 172.21.15.60:0/2835631596 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 updated v5) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7d6c023070 con 0x7f7d7c0b24a0 2020-10-31T22:41:42.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.875+0000 7f7d7b59e700 1 -- 172.21.15.60:0/2835631596 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7d60054f90 msgr2=0x7f7d60057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:42.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.875+0000 7f7d7b59e700 1 --2- 172.21.15.60:0/2835631596 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7d60054f90 0x7f7d60057450 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f7d6400c000 tx=0x7f7d64008040).stop 2020-10-31T22:41:42.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.875+0000 7f7d7b59e700 1 -- 172.21.15.60:0/2835631596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d7c0b24a0 msgr2=0x7f7d7c13c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:42.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.875+0000 7f7d7b59e700 1 --2- 172.21.15.60:0/2835631596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d7c0b24a0 0x7f7d7c13c290 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f7d6c002f30 tx=0x7f7d6c015000).stop 2020-10-31T22:41:42.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.875+0000 7f7d7b59e700 1 -- 172.21.15.60:0/2835631596 shutdown_connections 2020-10-31T22:41:42.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.875+0000 7f7d7b59e700 1 --2- 172.21.15.60:0/2835631596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d7c145d10 0x7f7d7c1540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.875+0000 7f7d7b59e700 1 --2- 172.21.15.60:0/2835631596 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d7c0b24a0 0x7f7d7c13c290 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.875+0000 7f7d7b59e700 1 --2- 172.21.15.60:0/2835631596 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7d60054f90 0x7f7d60057450 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.875+0000 7f7d7b59e700 1 --2- 172.21.15.60:0/2835631596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d7c0b5570 0x7f7d7c1392c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:42.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.875+0000 7f7d7b59e700 1 -- 172.21.15.60:0/2835631596 >> 172.21.15.60:0/2835631596 conn(0x7f7d7c0b8e90 msgr2=0x7f7d7c1426c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:42.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.875+0000 7f7d7b59e700 1 -- 172.21.15.60:0/2835631596 shutdown_connections 2020-10-31T22:41:42.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:42.875+0000 7f7d7b59e700 1 -- 172.21.15.60:0/2835631596 wait complete. 2020-10-31T22:41:42.881 INFO:teuthology.orchestra.run.smithi060.stderr:updated 2020-10-31T22:41:42.892 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-mgr 2020-10-31T22:41:43.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.003+0000 7fbdc1cc2700 1 Processor -- start 2020-10-31T22:41:43.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.003+0000 7fbdc1cc2700 1 -- start start 2020-10-31T22:41:43.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.003+0000 7fbdc1cc2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbdbc0b5570 0x7fbdbc0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.003+0000 7fbdc1cc2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbdbc0b24a0 0x7fbdbc145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.003+0000 7fbdc1cc2700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc145180 con 0x7fbdbc145d10 2020-10-31T22:41:43.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.003+0000 7fbdc1cc2700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc0afae0 con 0x7fbdbc0b5570 2020-10-31T22:41:43.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.003+0000 7fbdc1cc2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc141bf0 con 0x7fbdbc0b24a0 2020-10-31T22:41:43.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.003+0000 7fbdc14c1700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbdbc145d10 0x7fbdbc141fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46558/0 (socket says 172.21.15.60:46558) 2020-10-31T22:41:43.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.003+0000 7fbdc14c1700 1 -- 172.21.15.60:0/1568222128 learned_addr learned my addr 172.21.15.60:0/1568222128 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:43.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.003+0000 7fbdbbfff700 1 --2- 172.21.15.60:0/1568222128 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbdbc0b24a0 0x7fbdbc145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.003+0000 7fbdc0cc0700 1 --2- 172.21.15.60:0/1568222128 >> v2:172.21.15.66:3300/0 conn(0x7fbdbc0b5570 0x7fbdbc0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdbb7fe700 1 -- 172.21.15.60:0/1568222128 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241102007 0 0) 0x7fbdbc145180 con 0x7fbdbc145d10 2020-10-31T22:41:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdbb7fe700 1 -- 172.21.15.60:0/1568222128 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbda8003230 con 0x7fbdbc145d10 2020-10-31T22:41:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdbbfff700 1 -- 172.21.15.60:0/1568222128 >> v2:172.21.15.66:3300/0 conn(0x7fbdbc0b5570 msgr2=0x7fbdbc0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdbbfff700 1 --2- 172.21.15.60:0/1568222128 >> v2:172.21.15.66:3300/0 conn(0x7fbdbc0b5570 0x7fbdbc0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdbbfff700 1 -- 172.21.15.60:0/1568222128 >> v1:172.21.15.60:6789/0 conn(0x7fbdbc145d10 legacy=0x7fbdbc141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdbbfff700 1 -- 172.21.15.60:0/1568222128 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc0b0670 con 0x7fbdbc0b24a0 2020-10-31T22:41:43.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdbbfff700 1 --2- 172.21.15.60:0/1568222128 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbdbc0b24a0 0x7fbdbc145820 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fbdac002f30 tx=0x7fbdac006dc0).ready entity=mon.2 client_cookie=9b65b9e5f98ad96d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdbb7fe700 1 -- 172.21.15.60:0/1568222128 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdac0096a0 con 0x7fbdbc0b24a0 2020-10-31T22:41:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdbb7fe700 1 -- 172.21.15.60:0/1568222128 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac009800 con 0x7fbdbc0b24a0 2020-10-31T22:41:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdbb7fe700 1 -- 172.21.15.60:0/1568222128 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdac009b60 con 0x7fbdbc0b24a0 2020-10-31T22:41:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1568222128 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbdbc0b24a0 msgr2=0x7fbdbc145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdc1cc2700 1 --2- 172.21.15.60:0/1568222128 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbdbc0b24a0 0x7fbdbc145820 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fbdac002f30 tx=0x7fbdac006dc0).stop 2020-10-31T22:41:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1568222128 shutdown_connections 2020-10-31T22:41:43.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdc1cc2700 1 --2- 172.21.15.60:0/1568222128 >> v2:172.21.15.66:3300/0 conn(0x7fbdbc0b5570 0x7fbdbc0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdc1cc2700 1 --2- 172.21.15.60:0/1568222128 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbdbc0b24a0 0x7fbdbc145820 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1568222128 >> 172.21.15.60:0/1568222128 conn(0x7fbdbc0b8e90 msgr2=0x7fbdbc0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:43.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1568222128 shutdown_connections 2020-10-31T22:41:43.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1568222128 wait complete. 2020-10-31T22:41:43.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdc1cc2700 1 Processor -- start 2020-10-31T22:41:43.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.007+0000 7fbdc1cc2700 1 -- start start 2020-10-31T22:41:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdc1cc2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdbc0b24a0 0x7fbdbc151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdc1cc2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdbc0b5570 0x7fbdbc13cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdc1cc2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbdbc145d10 0x7fbdbc139590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdc1cc2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc140f80 con 0x7fbdbc0b5570 2020-10-31T22:41:43.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdc1cc2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0b67e0 con 0x7fbdbc0b24a0 2020-10-31T22:41:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdc1cc2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0b62a0 con 0x7fbdbc145d10 2020-10-31T22:41:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdbbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdbc0b5570 0x7fbdbc13cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdbbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdbc0b5570 0x7fbdbc13cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42428/0 (socket says 172.21.15.60:42428) 2020-10-31T22:41:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdbbfff700 1 -- 172.21.15.60:0/1647525206 learned_addr learned my addr 172.21.15.60:0/1647525206 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdc0cc0700 1 --2- 172.21.15.60:0/1647525206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdbc0b24a0 0x7fbdbc151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdc14c1700 1 --2- 172.21.15.60:0/1647525206 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbdbc145d10 0x7fbdbc139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdbbfff700 1 -- 172.21.15.60:0/1647525206 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbdbc145d10 msgr2=0x7fbdbc139590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdbbfff700 1 --2- 172.21.15.60:0/1647525206 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbdbc145d10 0x7fbdbc139590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdbbfff700 1 -- 172.21.15.60:0/1647525206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdbc0b24a0 msgr2=0x7fbdbc151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdbbfff700 1 --2- 172.21.15.60:0/1647525206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdbc0b24a0 0x7fbdbc151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdbbfff700 1 -- 172.21.15.60:0/1647525206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc0b6540 con 0x7fbdbc0b5570 2020-10-31T22:41:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdbbfff700 1 --2- 172.21.15.60:0/1647525206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdbc0b5570 0x7fbdbc13cab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fbdac002f30 tx=0x7fbdac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdb9ffb700 1 -- 172.21.15.60:0/1647525206 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdac011bb0 con 0x7fbdbc0b5570 2020-10-31T22:41:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdb9ffb700 1 -- 172.21.15.60:0/1647525206 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdac011d10 con 0x7fbdbc0b5570 2020-10-31T22:41:43.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdb9ffb700 1 -- 172.21.15.60:0/1647525206 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdac01c5a0 con 0x7fbdbc0b5570 2020-10-31T22:41:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1647525206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc1411c0 con 0x7fbdbc0b5570 2020-10-31T22:41:43.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1647525206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc139a80 con 0x7fbdbc0b5570 2020-10-31T22:41:43.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.011+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1647525206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdbc139fe0 con 0x7fbdbc0b5570 2020-10-31T22:41:43.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.015+0000 7fbdb9ffb700 1 -- 172.21.15.60:0/1647525206 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbdac00f070 con 0x7fbdbc0b5570 2020-10-31T22:41:43.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.015+0000 7fbdb9ffb700 1 --2- 172.21.15.60:0/1647525206 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbd9c054f30 0x7fbd9c0573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.015+0000 7fbdb9ffb700 1 -- 172.21.15.60:0/1647525206 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbdac06e540 con 0x7fbdbc0b5570 2020-10-31T22:41:43.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.015+0000 7fbdc0cc0700 1 --2- 172.21.15.60:0/1647525206 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbd9c054f30 0x7fbd9c0573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.015+0000 7fbdc0cc0700 1 --2- 172.21.15.60:0/1647525206 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbd9c054f30 0x7fbd9c0573f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fbdb000b000 tx=0x7fbdb0006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:43.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.019+0000 7fbdb9ffb700 1 -- 172.21.15.60:0/1647525206 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbdac044c80 con 0x7fbdbc0b5570 2020-10-31T22:41:43.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.215+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1647525206 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fbdbc057100 con 0x7fbdbc0b5570 2020-10-31T22:41:43.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.223+0000 7fbdb9ffb700 1 -- 172.21.15.60:0/1647525206 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 updated v6) v1 ==== 97+0+0 (secure 0 0 0) 0x7fbdac023020 con 0x7fbdbc0b5570 2020-10-31T22:41:43.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.227+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1647525206 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbd9c054f30 msgr2=0x7fbd9c0573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.227+0000 7fbdc1cc2700 1 --2- 172.21.15.60:0/1647525206 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbd9c054f30 0x7fbd9c0573f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fbdb000b000 tx=0x7fbdb0006dc0).stop 2020-10-31T22:41:43.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.227+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1647525206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdbc0b5570 msgr2=0x7fbdbc13cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.227+0000 7fbdc1cc2700 1 --2- 172.21.15.60:0/1647525206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdbc0b5570 0x7fbdbc13cab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fbdac002f30 tx=0x7fbdac015000).stop 2020-10-31T22:41:43.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.227+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1647525206 shutdown_connections 2020-10-31T22:41:43.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.227+0000 7fbdc1cc2700 1 --2- 172.21.15.60:0/1647525206 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbdbc145d10 0x7fbdbc139590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.227+0000 7fbdc1cc2700 1 --2- 172.21.15.60:0/1647525206 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbd9c054f30 0x7fbd9c0573f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.227+0000 7fbdc1cc2700 1 --2- 172.21.15.60:0/1647525206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbdbc0b24a0 0x7fbdbc151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.227+0000 7fbdc1cc2700 1 --2- 172.21.15.60:0/1647525206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbdbc0b5570 0x7fbdbc13cab0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.227+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1647525206 >> 172.21.15.60:0/1647525206 conn(0x7fbdbc0b8e90 msgr2=0x7fbdbc0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:43.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.227+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1647525206 shutdown_connections 2020-10-31T22:41:43.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.227+0000 7fbdc1cc2700 1 -- 172.21.15.60:0/1647525206 wait complete. 2020-10-31T22:41:43.231 INFO:teuthology.orchestra.run.smithi060.stderr:updated 2020-10-31T22:41:43.247 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-osd 2020-10-31T22:41:43.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b10a4d700 1 Processor -- start 2020-10-31T22:41:43.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b10a4d700 1 -- start start 2020-10-31T22:41:43.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b10a4d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1b0c0a95e0 0x7f1b0c0a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b10a4d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b0c05b440 0x7f1b0c05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b10a4d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1b0c066830 0x7f1b0c066c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b10a4d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0c0a75d0 con 0x7f1b0c066830 2020-10-31T22:41:43.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b10a4d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0c05afe0 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b10a4d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c0a8e00 con 0x7f1b0c05b440 2020-10-31T22:41:43.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b0bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1b0c066830 0x7f1b0c066c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b0b7fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1b0c0a95e0 0x7f1b0c0a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b0b7fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1b0c0a95e0 0x7f1b0c0a99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:53370/0 (socket says 172.21.15.60:53370) 2020-10-31T22:41:43.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b0bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1b0c066830 0x7f1b0c066c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42438/0 (socket says 172.21.15.60:42438) 2020-10-31T22:41:43.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b0b7fe700 1 -- 172.21.15.60:0/1010038354 learned_addr learned my addr 172.21.15.60:0/1010038354 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:43.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b0affd700 1 --2- 172.21.15.60:0/1010038354 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b0c05b440 0x7f1b0c05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b0b7fe700 1 -- 172.21.15.60:0/1010038354 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b0c05b440 msgr2=0x7f1b0c05b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:43.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.363+0000 7f1b0b7fe700 1 --2- 172.21.15.60:0/1010038354 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b0c05b440 0x7f1b0c05b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b0b7fe700 1 -- 172.21.15.60:0/1010038354 >> v2:172.21.15.60:3300/0 conn(0x7f1b0c066830 msgr2=0x7f1b0c066c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:43.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b0b7fe700 1 --2- 172.21.15.60:0/1010038354 >> v2:172.21.15.60:3300/0 conn(0x7f1b0c066830 0x7f1b0c066c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b0b7fe700 1 -- 172.21.15.60:0/1010038354 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c0aeaf0 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b0bfff700 1 --2- 172.21.15.60:0/1010038354 >> v2:172.21.15.60:3300/0 conn(0x7f1b0c066830 0x7f1b0c066c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:43.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b0b7fe700 1 --2- 172.21.15.60:0/1010038354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b0c0a95e0 0x7f1b0c0a99c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f1afc002f30 tx=0x7f1afc006e80).ready entity=mon.1 client_cookie=81885d31391d5393 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:43.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b0a7fc700 1 -- 172.21.15.60:0/1010038354 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1afc009640 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b0a7fc700 1 -- 172.21.15.60:0/1010038354 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1afc0097a0 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b0a7fc700 1 -- 172.21.15.60:0/1010038354 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1afc009b00 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 -- 172.21.15.60:0/1010038354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b0c0a95e0 msgr2=0x7f1b0c0a99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 --2- 172.21.15.60:0/1010038354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b0c0a95e0 0x7f1b0c0a99c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f1afc002f30 tx=0x7f1afc006e80).stop 2020-10-31T22:41:43.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 -- 172.21.15.60:0/1010038354 shutdown_connections 2020-10-31T22:41:43.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 --2- 172.21.15.60:0/1010038354 >> v2:172.21.15.60:3300/0 conn(0x7f1b0c066830 0x7f1b0c066c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 --2- 172.21.15.60:0/1010038354 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b0c0a95e0 0x7f1b0c0a99c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 --2- 172.21.15.60:0/1010038354 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b0c05b440 0x7f1b0c05b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 -- 172.21.15.60:0/1010038354 >> 172.21.15.60:0/1010038354 conn(0x7f1b0c0b3fd0 msgr2=0x7f1b0c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 -- 172.21.15.60:0/1010038354 shutdown_connections 2020-10-31T22:41:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 -- 172.21.15.60:0/1010038354 wait complete. 2020-10-31T22:41:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 Processor -- start 2020-10-31T22:41:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 -- start start 2020-10-31T22:41:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b0c05b440 0x7f1b0c13f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b0c066830 0x7f1b0c062ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b0c0a95e0 0x7f1b0c0633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c140650 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c144260 con 0x7f1b0c066830 2020-10-31T22:41:43.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b10a4d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0c061560 con 0x7f1b0c05b440 2020-10-31T22:41:43.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b0bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b0c0a95e0 0x7f1b0c0633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b0bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b0c0a95e0 0x7f1b0c0633e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42444/0 (socket says 172.21.15.60:42444) 2020-10-31T22:41:43.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b0affd700 1 --2- 172.21.15.60:0/794309316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b0c066830 0x7f1b0c062ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b0bfff700 1 -- 172.21.15.60:0/794309316 learned_addr learned my addr 172.21.15.60:0/794309316 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:43.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.367+0000 7f1b0b7fe700 1 --2- 172.21.15.60:0/794309316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b0c05b440 0x7f1b0c13f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b0bfff700 1 -- 172.21.15.60:0/794309316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b0c05b440 msgr2=0x7f1b0c13f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b0bfff700 1 --2- 172.21.15.60:0/794309316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b0c05b440 0x7f1b0c13f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b0bfff700 1 -- 172.21.15.60:0/794309316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b0c066830 msgr2=0x7f1b0c062ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b0bfff700 1 --2- 172.21.15.60:0/794309316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b0c066830 0x7f1b0c062ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b0bfff700 1 -- 172.21.15.60:0/794309316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b0c146c30 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b0bfff700 1 --2- 172.21.15.60:0/794309316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b0c0a95e0 0x7f1b0c0633e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f1b0c062e40 tx=0x7f1b040091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:43.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b08ff9700 1 -- 172.21.15.60:0/794309316 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b0400ccc0 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b08ff9700 1 -- 172.21.15.60:0/794309316 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0400ce20 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b10a4d700 1 -- 172.21.15.60:0/794309316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0c0617c0 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b08ff9700 1 -- 172.21.15.60:0/794309316 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b040125e0 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b10a4d700 1 -- 172.21.15.60:0/794309316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b0c0662e0 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b10a4d700 1 -- 172.21.15.60:0/794309316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b0c057100 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b08ff9700 1 -- 172.21.15.60:0/794309316 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1b04022070 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b08ff9700 1 --2- 172.21.15.60:0/794309316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1af0054f10 0x7f1af00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b08ff9700 1 -- 172.21.15.60:0/794309316 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1b0406e100 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b0b7fe700 1 --2- 172.21.15.60:0/794309316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1af0054f10 0x7f1af00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.371+0000 7f1b0b7fe700 1 --2- 172.21.15.60:0/794309316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1af0054f10 0x7f1af00573d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f1afc01b000 tx=0x7f1afc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:43.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.379+0000 7f1b08ff9700 1 -- 172.21.15.60:0/794309316 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1b04044950 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.567+0000 7f1b10a4d700 1 -- 172.21.15.60:0/794309316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f1b0c0b0850 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.575+0000 7f1b08ff9700 1 -- 172.21.15.60:0/794309316 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 updated v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1b040160a0 con 0x7f1b0c0a95e0 2020-10-31T22:41:43.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.575+0000 7f1b10a4d700 1 -- 172.21.15.60:0/794309316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1af0054f10 msgr2=0x7f1af00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.575+0000 7f1b10a4d700 1 --2- 172.21.15.60:0/794309316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1af0054f10 0x7f1af00573d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f1afc01b000 tx=0x7f1afc015000).stop 2020-10-31T22:41:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.575+0000 7f1b10a4d700 1 -- 172.21.15.60:0/794309316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b0c0a95e0 msgr2=0x7f1b0c0633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.575+0000 7f1b10a4d700 1 --2- 172.21.15.60:0/794309316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b0c0a95e0 0x7f1b0c0633e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f1b0c062e40 tx=0x7f1b040091a0).stop 2020-10-31T22:41:43.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.575+0000 7f1b10a4d700 1 -- 172.21.15.60:0/794309316 shutdown_connections 2020-10-31T22:41:43.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.575+0000 7f1b10a4d700 1 --2- 172.21.15.60:0/794309316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b0c0a95e0 0x7f1b0c0633e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.575+0000 7f1b10a4d700 1 --2- 172.21.15.60:0/794309316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b0c05b440 0x7f1b0c13f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.575+0000 7f1b10a4d700 1 --2- 172.21.15.60:0/794309316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1af0054f10 0x7f1af00573d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.575+0000 7f1b10a4d700 1 --2- 172.21.15.60:0/794309316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b0c066830 0x7f1b0c062ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.575+0000 7f1b10a4d700 1 -- 172.21.15.60:0/794309316 >> 172.21.15.60:0/794309316 conn(0x7f1b0c0b3fd0 msgr2=0x7f1b0c0b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:43.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.575+0000 7f1b10a4d700 1 -- 172.21.15.60:0/794309316 shutdown_connections 2020-10-31T22:41:43.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.575+0000 7f1b10a4d700 1 -- 172.21.15.60:0/794309316 wait complete. 2020-10-31T22:41:43.582 INFO:teuthology.orchestra.run.smithi060.stderr:updated 2020-10-31T22:41:43.603 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rbd 2020-10-31T22:41:43.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 Processor -- start 2020-10-31T22:41:43.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 -- start start 2020-10-31T22:41:43.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f29780b5570 0x7f29780b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29780b24a0 0x7f2978145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2978145d10 0x7f2978141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29780afae0 con 0x7f2978145d10 2020-10-31T22:41:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2978141bf0 con 0x7f29780b5570 2020-10-31T22:41:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297813f930 con 0x7f29780b24a0 2020-10-31T22:41:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297dee6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2978145d10 0x7f2978141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297dee6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2978145d10 0x7f2978141fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42452/0 (socket says 172.21.15.60:42452) 2020-10-31T22:41:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297dee6700 1 -- 172.21.15.60:0/3978704017 learned_addr learned my addr 172.21.15.60:0/3978704017 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297d6e5700 1 --2- 172.21.15.60:0/3978704017 >> v2:172.21.15.66:3300/0 conn(0x7f29780b5570 0x7f29780b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297cee4700 1 --2- 172.21.15.60:0/3978704017 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29780b24a0 0x7f2978145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297dee6700 1 -- 172.21.15.60:0/3978704017 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29780b24a0 msgr2=0x7f2978145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:43.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297dee6700 1 --2- 172.21.15.60:0/3978704017 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29780b24a0 0x7f2978145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297dee6700 1 -- 172.21.15.60:0/3978704017 >> v2:172.21.15.66:3300/0 conn(0x7f29780b5570 msgr2=0x7f29780b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:43.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297dee6700 1 --2- 172.21.15.60:0/3978704017 >> v2:172.21.15.66:3300/0 conn(0x7f29780b5570 0x7f29780b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297dee6700 1 -- 172.21.15.60:0/3978704017 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978145180 con 0x7f2978145d10 2020-10-31T22:41:43.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297cee4700 1 --2- 172.21.15.60:0/3978704017 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29780b24a0 0x7f2978145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:43.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297dee6700 1 --2- 172.21.15.60:0/3978704017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2978145d10 0x7f2978141fe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f2978061290 tx=0x7f2968009270).ready entity=mon.0 client_cookie=b72ff7fd7fc730df server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:43.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f2977fff700 1 -- 172.21.15.60:0/3978704017 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2968009e90 con 0x7f2978145d10 2020-10-31T22:41:43.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f2977fff700 1 -- 172.21.15.60:0/3978704017 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296800bbc0 con 0x7f2978145d10 2020-10-31T22:41:43.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f2977fff700 1 -- 172.21.15.60:0/3978704017 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f296800bd30 con 0x7f2978145d10 2020-10-31T22:41:43.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 -- 172.21.15.60:0/3978704017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2978145d10 msgr2=0x7f2978141fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 --2- 172.21.15.60:0/3978704017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2978145d10 0x7f2978141fe0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f2978061290 tx=0x7f2968009270).stop 2020-10-31T22:41:43.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 -- 172.21.15.60:0/3978704017 shutdown_connections 2020-10-31T22:41:43.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 --2- 172.21.15.60:0/3978704017 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2978145d10 0x7f2978141fe0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 --2- 172.21.15.60:0/3978704017 >> v2:172.21.15.66:3300/0 conn(0x7f29780b5570 0x7f29780b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 --2- 172.21.15.60:0/3978704017 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29780b24a0 0x7f2978145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 -- 172.21.15.60:0/3978704017 >> 172.21.15.60:0/3978704017 conn(0x7f29780b8e90 msgr2=0x7f29780b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:43.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 -- 172.21.15.60:0/3978704017 shutdown_connections 2020-10-31T22:41:43.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.727+0000 7f297e6e7700 1 -- 172.21.15.60:0/3978704017 wait complete. 2020-10-31T22:41:43.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297e6e7700 1 Processor -- start 2020-10-31T22:41:43.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297e6e7700 1 -- start start 2020-10-31T22:41:43.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297e6e7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29780b24a0 0x7f297813e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297e6e7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29780b5570 0x7f29781507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297e6e7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2978145d10 0x7f2978150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297e6e7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29781442b0 con 0x7f29780b5570 2020-10-31T22:41:43.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297e6e7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29781449d0 con 0x7f29780b24a0 2020-10-31T22:41:43.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297e6e7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2978151180 con 0x7f2978145d10 2020-10-31T22:41:43.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297cee4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29780b5570 0x7f29781507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297cee4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29780b5570 0x7f29781507a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42456/0 (socket says 172.21.15.60:42456) 2020-10-31T22:41:43.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297cee4700 1 -- 172.21.15.60:0/847656269 learned_addr learned my addr 172.21.15.60:0/847656269 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:43.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297d6e5700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29780b24a0 0x7f297813e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297dee6700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2978145d10 0x7f2978150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297cee4700 1 -- 172.21.15.60:0/847656269 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2978145d10 msgr2=0x7f2978150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297cee4700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2978145d10 0x7f2978150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297cee4700 1 -- 172.21.15.60:0/847656269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29780b24a0 msgr2=0x7f297813e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297cee4700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29780b24a0 0x7f297813e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297cee4700 1 -- 172.21.15.60:0/847656269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2978154a80 con 0x7f29780b5570 2020-10-31T22:41:43.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297d6e5700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29780b24a0 0x7f297813e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:43.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297cee4700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29780b5570 0x7f29781507a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f2960006910 tx=0x7f2960008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:43.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f29767fc700 1 -- 172.21.15.60:0/847656269 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2960009920 con 0x7f29780b5570 2020-10-31T22:41:43.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f29767fc700 1 -- 172.21.15.60:0/847656269 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2960009a80 con 0x7f29780b5570 2020-10-31T22:41:43.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297e6e7700 1 -- 172.21.15.60:0/847656269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2978144ea0 con 0x7f29780b5570 2020-10-31T22:41:43.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f29767fc700 1 -- 172.21.15.60:0/847656269 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2960009de0 con 0x7f29780b5570 2020-10-31T22:41:43.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.731+0000 7f297e6e7700 1 -- 172.21.15.60:0/847656269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2978143ed0 con 0x7f29780b5570 2020-10-31T22:41:43.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.735+0000 7f297e6e7700 1 -- 172.21.15.60:0/847656269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2978144420 con 0x7f29780b5570 2020-10-31T22:41:43.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.735+0000 7f29767fc700 1 -- 172.21.15.60:0/847656269 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2960013480 con 0x7f29780b5570 2020-10-31T22:41:43.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.735+0000 7f29767fc700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f295c055020 0x7f295c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:43.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.735+0000 7f29767fc700 1 -- 172.21.15.60:0/847656269 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f296006df40 con 0x7f29780b5570 2020-10-31T22:41:43.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.735+0000 7f297d6e5700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f295c055020 0x7f295c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:43.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.735+0000 7f297d6e5700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f295c055020 0x7f295c0574e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f297000b000 tx=0x7f2970008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:43.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.739+0000 7f29767fc700 1 -- 172.21.15.60:0/847656269 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2978144420 con 0x7f29780b5570 2020-10-31T22:41:43.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.931+0000 7f297e6e7700 1 -- 172.21.15.60:0/847656269 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f29781443f0 con 0x7f29780b5570 2020-10-31T22:41:43.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.939+0000 7f29767fc700 1 -- 172.21.15.60:0/847656269 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 updated v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2960044730 con 0x7f29780b5570 2020-10-31T22:41:43.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.939+0000 7f297e6e7700 1 -- 172.21.15.60:0/847656269 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f295c055020 msgr2=0x7f295c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.939+0000 7f297e6e7700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f295c055020 0x7f295c0574e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f297000b000 tx=0x7f2970008040).stop 2020-10-31T22:41:43.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.939+0000 7f297e6e7700 1 -- 172.21.15.60:0/847656269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29780b5570 msgr2=0x7f29781507a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:43.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.939+0000 7f297e6e7700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29780b5570 0x7f29781507a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f2960006910 tx=0x7f2960008040).stop 2020-10-31T22:41:43.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.939+0000 7f297e6e7700 1 -- 172.21.15.60:0/847656269 shutdown_connections 2020-10-31T22:41:43.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.939+0000 7f297e6e7700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2978145d10 0x7f2978150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.939+0000 7f297e6e7700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f295c055020 0x7f295c0574e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.939+0000 7f297e6e7700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29780b24a0 0x7f297813e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.939+0000 7f297e6e7700 1 --2- 172.21.15.60:0/847656269 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29780b5570 0x7f29781507a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:43.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.939+0000 7f297e6e7700 1 -- 172.21.15.60:0/847656269 >> 172.21.15.60:0/847656269 conn(0x7f29780b8e90 msgr2=0x7f297805f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:43.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.939+0000 7f297e6e7700 1 -- 172.21.15.60:0/847656269 shutdown_connections 2020-10-31T22:41:43.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:43.939+0000 7f297e6e7700 1 -- 172.21.15.60:0/847656269 wait complete. 2020-10-31T22:41:43.945 INFO:teuthology.orchestra.run.smithi060.stderr:updated 2020-10-31T22:41:43.960 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rbd-mirror 2020-10-31T22:41:44.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff603fff700 1 Processor -- start 2020-10-31T22:41:44.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff603fff700 1 -- start start 2020-10-31T22:41:44.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff603fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff6040af520 0x7ff6040ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff603fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6040670f0 0x7ff604150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff603fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6040af900 con 0x7ff604066c90 2020-10-31T22:41:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff603fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6040afc10 con 0x7ff6040af520 2020-10-31T22:41:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff603fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60405bb70 con 0x7ff6040670f0 2020-10-31T22:41:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff6027fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff604066c90 0x7ff604146060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46598/0 (socket says 172.21.15.60:46598) 2020-10-31T22:41:44.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff6027fc700 1 -- 172.21.15.60:0/755966826 learned_addr learned my addr 172.21.15.60:0/755966826 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff602ffd700 1 --2- 172.21.15.60:0/755966826 >> v2:172.21.15.66:3300/0 conn(0x7ff6040af520 0x7ff6040ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff6037fe700 1 --2- 172.21.15.60:0/755966826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6040670f0 0x7ff604150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 -- 172.21.15.60:0/755966826 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2011587165 0 0) 0x7ff6040af900 con 0x7ff604066c90 2020-10-31T22:41:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 -- 172.21.15.60:0/755966826 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e8003230 con 0x7ff604066c90 2020-10-31T22:41:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 -- 172.21.15.60:0/755966826 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3856193726 0 0) 0x7ff5e8003230 con 0x7ff604066c90 2020-10-31T22:41:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 -- 172.21.15.60:0/755966826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6040670f0 msgr2=0x7ff604150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:44.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 --2- 172.21.15.60:0/755966826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6040670f0 0x7ff604150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 -- 172.21.15.60:0/755966826 >> v2:172.21.15.66:3300/0 conn(0x7ff6040af520 msgr2=0x7ff6040ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 --2- 172.21.15.60:0/755966826 >> v2:172.21.15.66:3300/0 conn(0x7ff6040af520 0x7ff6040ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 -- 172.21.15.60:0/755966826 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6040ac130 con 0x7ff604066c90 2020-10-31T22:41:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 -- 172.21.15.60:0/755966826 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7ff5f4001a50 con 0x7ff604066c90 2020-10-31T22:41:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 -- 172.21.15.60:0/755966826 >> v1:172.21.15.60:6789/0 conn(0x7ff604066c90 legacy=0x7ff604146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 --2- 172.21.15.60:0/755966826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5e8003720 0x7ff5e8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 --2- 172.21.15.60:0/755966826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6040670f0 0x7ff5e80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 --2- 172.21.15.60:0/755966826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e80049c0 0x7ff5e8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 -- 172.21.15.60:0/755966826 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040afc10 con 0x7ff5e8003720 2020-10-31T22:41:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 -- 172.21.15.60:0/755966826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60405bb70 con 0x7ff5e80049c0 2020-10-31T22:41:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 -- 172.21.15.60:0/755966826 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e80041c0 con 0x7ff6040670f0 2020-10-31T22:41:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff602ffd700 1 --2- 172.21.15.60:0/755966826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5e8003720 0x7ff5e8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff6027fc700 1 --2- 172.21.15.60:0/755966826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6040670f0 0x7ff5e80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff6037fe700 1 --2- 172.21.15.60:0/755966826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e80049c0 0x7ff5e8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff6037fe700 1 -- 172.21.15.60:0/755966826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6040670f0 msgr2=0x7ff5e80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:44.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff6037fe700 1 --2- 172.21.15.60:0/755966826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6040670f0 0x7ff5e80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff6037fe700 1 -- 172.21.15.60:0/755966826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5e8003720 msgr2=0x7ff5e8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:44.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff6037fe700 1 --2- 172.21.15.60:0/755966826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5e8003720 0x7ff5e8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff6037fe700 1 -- 172.21.15.60:0/755966826 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e8003230 con 0x7ff5e80049c0 2020-10-31T22:41:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff602ffd700 1 --2- 172.21.15.60:0/755966826 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5e8003720 0x7ff5e8003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:44.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff6037fe700 1 --2- 172.21.15.60:0/755966826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e80049c0 0x7ff5e8004e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7ff5fc00c000 tx=0x7ff5fc008040).ready entity=mon.1 client_cookie=2c64202391642598 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:44.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 -- 172.21.15.60:0/755966826 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5fc00e970 con 0x7ff5e80049c0 2020-10-31T22:41:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 -- 172.21.15.60:0/755966826 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc00ead0 con 0x7ff5e80049c0 2020-10-31T22:41:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.095+0000 7ff601ffb700 1 -- 172.21.15.60:0/755966826 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5fc00ee30 con 0x7ff5e80049c0 2020-10-31T22:41:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.099+0000 7ff603fff700 1 -- 172.21.15.60:0/755966826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e80049c0 msgr2=0x7ff5e8004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.099+0000 7ff603fff700 1 --2- 172.21.15.60:0/755966826 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5e80049c0 0x7ff5e8004e40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7ff5fc00c000 tx=0x7ff5fc008040).stop 2020-10-31T22:41:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.099+0000 7ff6037fe700 1 -- 172.21.15.60:0/755966826 reap_dead start 2020-10-31T22:41:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.099+0000 7ff603fff700 1 -- 172.21.15.60:0/755966826 shutdown_connections 2020-10-31T22:41:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.099+0000 7ff603fff700 1 -- 172.21.15.60:0/755966826 >> 172.21.15.60:0/755966826 conn(0x7ff6040b3fd0 msgr2=0x7ff6040b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.099+0000 7ff603fff700 1 -- 172.21.15.60:0/755966826 shutdown_connections 2020-10-31T22:41:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.099+0000 7ff603fff700 1 -- 172.21.15.60:0/755966826 wait complete. 2020-10-31T22:41:44.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.099+0000 7ff603fff700 1 Processor -- start 2020-10-31T22:41:44.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.099+0000 7ff603fff700 1 -- start start 2020-10-31T22:41:44.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff603fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6040a8290 0x7ff6040a8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff603fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6041559a0 0x7ff604141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff603fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff604142370 0x7ff604149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff603fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff604147910 con 0x7ff6041559a0 2020-10-31T22:41:44.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff603fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff604148a60 con 0x7ff604142370 2020-10-31T22:41:44.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff603fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff604149010 con 0x7ff6040a8290 2020-10-31T22:41:44.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff6027fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6041559a0 0x7ff604141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff6027fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6041559a0 0x7ff604141e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42476/0 (socket says 172.21.15.60:42476) 2020-10-31T22:41:44.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff6027fc700 1 -- 172.21.15.60:0/800756507 learned_addr learned my addr 172.21.15.60:0/800756507 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:44.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff602ffd700 1 --2- 172.21.15.60:0/800756507 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6040a8290 0x7ff6040a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff6037fe700 1 --2- 172.21.15.60:0/800756507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff604142370 0x7ff604149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff6027fc700 1 -- 172.21.15.60:0/800756507 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6040a8290 msgr2=0x7ff6040a8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff6027fc700 1 --2- 172.21.15.60:0/800756507 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6040a8290 0x7ff6040a8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff6027fc700 1 -- 172.21.15.60:0/800756507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff604142370 msgr2=0x7ff604149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff6027fc700 1 --2- 172.21.15.60:0/800756507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff604142370 0x7ff604149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff6027fc700 1 -- 172.21.15.60:0/800756507 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6041492b0 con 0x7ff6041559a0 2020-10-31T22:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff6027fc700 1 --2- 172.21.15.60:0/800756507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6041559a0 0x7ff604141e80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff5f40020b0 tx=0x7ff5f4007b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff5f3fff700 1 -- 172.21.15.60:0/800756507 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f400fd70 con 0x7ff6041559a0 2020-10-31T22:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff5f3fff700 1 -- 172.21.15.60:0/800756507 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f400fed0 con 0x7ff6041559a0 2020-10-31T22:41:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff5f3fff700 1 -- 172.21.15.60:0/800756507 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5f4012540 con 0x7ff6041559a0 2020-10-31T22:41:44.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff603fff700 1 -- 172.21.15.60:0/800756507 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff604148790 con 0x7ff6041559a0 2020-10-31T22:41:44.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.103+0000 7ff603fff700 1 -- 172.21.15.60:0/800756507 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff604148190 con 0x7ff6041559a0 2020-10-31T22:41:44.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.107+0000 7ff603fff700 1 -- 172.21.15.60:0/800756507 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff604057100 con 0x7ff6041559a0 2020-10-31T22:41:44.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.107+0000 7ff5f3fff700 1 -- 172.21.15.60:0/800756507 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff5f401b030 con 0x7ff6041559a0 2020-10-31T22:41:44.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.107+0000 7ff5f3fff700 1 --2- 172.21.15.60:0/800756507 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5e0055020 0x7ff5e00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.107+0000 7ff5f3fff700 1 -- 172.21.15.60:0/800756507 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff5f406d370 con 0x7ff6041559a0 2020-10-31T22:41:44.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.107+0000 7ff602ffd700 1 --2- 172.21.15.60:0/800756507 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5e0055020 0x7ff5e00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.107+0000 7ff602ffd700 1 --2- 172.21.15.60:0/800756507 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5e0055020 0x7ff5e00574e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7ff5f8008000 tx=0x7ff5f8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:44.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.111+0000 7ff5f3fff700 1 -- 172.21.15.60:0/800756507 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff5f4043bc0 con 0x7ff6041559a0 2020-10-31T22:41:44.291 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:41:44.295 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:41:44.307 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:41:44.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.307+0000 7ff603fff700 1 -- 172.21.15.60:0/800756507 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7ff6040afe20 con 0x7ff6041559a0 2020-10-31T22:41:44.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.311+0000 7ff5f3fff700 1 -- 172.21.15.60:0/800756507 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 updated v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff5f4019030 con 0x7ff6041559a0 2020-10-31T22:41:44.319 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:41:44.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.315+0000 7ff603fff700 1 -- 172.21.15.60:0/800756507 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5e0055020 msgr2=0x7ff5e00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.315+0000 7ff603fff700 1 --2- 172.21.15.60:0/800756507 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5e0055020 0x7ff5e00574e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7ff5f8008000 tx=0x7ff5f8008040).stop 2020-10-31T22:41:44.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.315+0000 7ff603fff700 1 -- 172.21.15.60:0/800756507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6041559a0 msgr2=0x7ff604141e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.315+0000 7ff603fff700 1 --2- 172.21.15.60:0/800756507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6041559a0 0x7ff604141e80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7ff5f40020b0 tx=0x7ff5f4007b40).stop 2020-10-31T22:41:44.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.315+0000 7ff603fff700 1 -- 172.21.15.60:0/800756507 shutdown_connections 2020-10-31T22:41:44.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.315+0000 7ff603fff700 1 --2- 172.21.15.60:0/800756507 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff5e0055020 0x7ff5e00574e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.315+0000 7ff603fff700 1 --2- 172.21.15.60:0/800756507 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff604142370 0x7ff604149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.315+0000 7ff603fff700 1 --2- 172.21.15.60:0/800756507 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6040a8290 0x7ff6040a8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.315+0000 7ff603fff700 1 --2- 172.21.15.60:0/800756507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6041559a0 0x7ff604141e80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.315+0000 7ff603fff700 1 -- 172.21.15.60:0/800756507 >> 172.21.15.60:0/800756507 conn(0x7ff6040b3fd0 msgr2=0x7ff6040b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:44.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.315+0000 7ff603fff700 1 -- 172.21.15.60:0/800756507 shutdown_connections 2020-10-31T22:41:44.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.315+0000 7ff603fff700 1 -- 172.21.15.60:0/800756507 wait complete. 2020-10-31T22:41:44.327 INFO:teuthology.orchestra.run.smithi060.stderr:updated 2020-10-31T22:41:44.332 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth del client.bootstrap-rgw 2020-10-31T22:41:44.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.503+0000 7f36157d1700 1 Processor -- start 2020-10-31T22:41:44.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.503+0000 7f36157d1700 1 -- start start 2020-10-31T22:41:44.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f36157d1700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f36100b5950 0x7f36101426f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f36157d1700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3610145180 con 0x7f36100b24a0 2020-10-31T22:41:44.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f36157d1700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36100b0670 con 0x7f36100b5570 2020-10-31T22:41:44.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f36157d1700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36100afae0 con 0x7f36100b5950 2020-10-31T22:41:44.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f360f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f36100b24a0 0x7f3610141fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46618/0 (socket says 172.21.15.60:46618) 2020-10-31T22:41:44.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f360f7fe700 1 -- 172.21.15.60:0/3432777875 learned_addr learned my addr 172.21.15.60:0/3432777875 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:44.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f3614fd0700 1 --2- 172.21.15.60:0/3432777875 >> v2:172.21.15.66:3300/0 conn(0x7f36100b5950 0x7f36101426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f360effd700 1 -- 172.21.15.60:0/3432777875 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851514086 0 0) 0x7f3610145180 con 0x7f36100b24a0 2020-10-31T22:41:44.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f360effd700 1 -- 172.21.15.60:0/3432777875 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35f0003230 con 0x7f36100b24a0 2020-10-31T22:41:44.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f3614fd0700 1 -- 172.21.15.60:0/3432777875 >> v1:172.21.15.66:6789/0 conn(0x7f36100b5570 legacy=0x7f3610145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f3614fd0700 1 -- 172.21.15.60:0/3432777875 >> v1:172.21.15.60:6789/0 conn(0x7f36100b24a0 legacy=0x7f3610141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f3614fd0700 1 -- 172.21.15.60:0/3432777875 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36100b0910 con 0x7f36100b5950 2020-10-31T22:41:44.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f3614fd0700 1 --2- 172.21.15.60:0/3432777875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36100b5950 0x7f36101426f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f361005f580 tx=0x7f36080091a0).ready entity=mon.1 client_cookie=c18a3ca4af010c10 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:44.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f360effd700 1 -- 172.21.15.60:0/3432777875 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f360800ba00 con 0x7f36100b5950 2020-10-31T22:41:44.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f360effd700 1 -- 172.21.15.60:0/3432777875 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360800bb60 con 0x7f36100b5950 2020-10-31T22:41:44.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f360effd700 1 -- 172.21.15.60:0/3432777875 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f360800bcd0 con 0x7f36100b5950 2020-10-31T22:41:44.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f36157d1700 1 -- 172.21.15.60:0/3432777875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36100b5950 msgr2=0x7f36101426f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f36157d1700 1 --2- 172.21.15.60:0/3432777875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36100b5950 0x7f36101426f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f361005f580 tx=0x7f36080091a0).stop 2020-10-31T22:41:44.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f36157d1700 1 -- 172.21.15.60:0/3432777875 shutdown_connections 2020-10-31T22:41:44.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f36157d1700 1 --2- 172.21.15.60:0/3432777875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36100b5950 0x7f36101426f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f36157d1700 1 -- 172.21.15.60:0/3432777875 >> 172.21.15.60:0/3432777875 conn(0x7f36100b8e90 msgr2=0x7f36100b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:44.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f36157d1700 1 -- 172.21.15.60:0/3432777875 shutdown_connections 2020-10-31T22:41:44.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.507+0000 7f36157d1700 1 -- 172.21.15.60:0/3432777875 wait complete. 2020-10-31T22:41:44.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f36157d1700 1 Processor -- start 2020-10-31T22:41:44.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f36157d1700 1 -- start start 2020-10-31T22:41:44.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f36157d1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36100b24a0 0x7f36100b74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f36157d1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36100b5570 0x7f3610138d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f36157d1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36100b5950 0x7f3610139240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f36157d1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361013b400 con 0x7f36100b5570 2020-10-31T22:41:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f36157d1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3610139730 con 0x7f36100b5950 2020-10-31T22:41:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f36157d1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36100b8030 con 0x7f36100b24a0 2020-10-31T22:41:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f360f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36100b5570 0x7f3610138d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f360f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36100b5570 0x7f3610138d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42490/0 (socket says 172.21.15.60:42490) 2020-10-31T22:41:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f360f7fe700 1 -- 172.21.15.60:0/261688483 learned_addr learned my addr 172.21.15.60:0/261688483 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f3614fd0700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36100b5950 0x7f3610139240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f360ffff700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36100b24a0 0x7f36100b74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f360f7fe700 1 -- 172.21.15.60:0/261688483 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36100b24a0 msgr2=0x7f36100b74f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f360f7fe700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36100b24a0 0x7f36100b74f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f360f7fe700 1 -- 172.21.15.60:0/261688483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36100b5950 msgr2=0x7f3610139240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f360f7fe700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36100b5950 0x7f3610139240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f360f7fe700 1 -- 172.21.15.60:0/261688483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f361013b650 con 0x7f36100b5570 2020-10-31T22:41:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f3614fd0700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36100b5950 0x7f3610139240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.511+0000 7f360ffff700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36100b24a0 0x7f36100b74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.515+0000 7f360f7fe700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36100b5570 0x7f3610138d50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f35f80010d0 tx=0x7f35f8007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.515+0000 7f360d7fa700 1 -- 172.21.15.60:0/261688483 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35f80072e0 con 0x7f36100b5570 2020-10-31T22:41:44.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.515+0000 7f360d7fa700 1 -- 172.21.15.60:0/261688483 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f8007440 con 0x7f36100b5570 2020-10-31T22:41:44.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.515+0000 7f36157d1700 1 -- 172.21.15.60:0/261688483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f361013c730 con 0x7f36100b5570 2020-10-31T22:41:44.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.515+0000 7f360d7fa700 1 -- 172.21.15.60:0/261688483 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35f80057d0 con 0x7f36100b5570 2020-10-31T22:41:44.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.515+0000 7f36157d1700 1 -- 172.21.15.60:0/261688483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3610146240 con 0x7f36100b5570 2020-10-31T22:41:44.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.515+0000 7f36157d1700 1 -- 172.21.15.60:0/261688483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3610057100 con 0x7f36100b5570 2020-10-31T22:41:44.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.515+0000 7f360d7fa700 1 -- 172.21.15.60:0/261688483 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f35f8010070 con 0x7f36100b5570 2020-10-31T22:41:44.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.515+0000 7f360d7fa700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35f4054f10 0x7f35f40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.515+0000 7f360d7fa700 1 -- 172.21.15.60:0/261688483 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f35f806ce10 con 0x7f36100b5570 2020-10-31T22:41:44.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.519+0000 7f360ffff700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35f4054f10 0x7f35f40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.519+0000 7f360ffff700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35f4054f10 0x7f35f40573d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f360000b000 tx=0x7f3600009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.527+0000 7f360d7fa700 1 -- 172.21.15.60:0/261688483 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f35f80435c0 con 0x7f36100b5570 2020-10-31T22:41:44.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.711+0000 7f36157d1700 1 -- 172.21.15.60:0/261688483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f361005a8e0 con 0x7f36100b5570 2020-10-31T22:41:44.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.719+0000 7f360d7fa700 1 -- 172.21.15.60:0/261688483 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 updated v10) v1 ==== 97+0+0 (secure 0 0 0) 0x7f35f8018030 con 0x7f36100b5570 2020-10-31T22:41:44.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.719+0000 7f36157d1700 1 -- 172.21.15.60:0/261688483 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35f4054f10 msgr2=0x7f35f40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.719+0000 7f36157d1700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35f4054f10 0x7f35f40573d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f360000b000 tx=0x7f3600009040).stop 2020-10-31T22:41:44.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.719+0000 7f36157d1700 1 -- 172.21.15.60:0/261688483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36100b5570 msgr2=0x7f3610138d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.719+0000 7f36157d1700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36100b5570 0x7f3610138d50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f35f80010d0 tx=0x7f35f8007a70).stop 2020-10-31T22:41:44.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.719+0000 7f36157d1700 1 -- 172.21.15.60:0/261688483 shutdown_connections 2020-10-31T22:41:44.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.719+0000 7f36157d1700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35f4054f10 0x7f35f40573d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.719+0000 7f36157d1700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36100b5950 0x7f3610139240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.719+0000 7f36157d1700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36100b24a0 0x7f36100b74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.719+0000 7f36157d1700 1 --2- 172.21.15.60:0/261688483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36100b5570 0x7f3610138d50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.719+0000 7f36157d1700 1 -- 172.21.15.60:0/261688483 >> 172.21.15.60:0/261688483 conn(0x7f36100b8e90 msgr2=0x7f3610141f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:44.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.719+0000 7f36157d1700 1 -- 172.21.15.60:0/261688483 shutdown_connections 2020-10-31T22:41:44.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.719+0000 7f36157d1700 1 -- 172.21.15.60:0/261688483 wait complete. 2020-10-31T22:41:44.727 INFO:teuthology.orchestra.run.smithi060.stderr:updated 2020-10-31T22:41:44.738 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:44.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.851+0000 7f7c008d3700 1 Processor -- start 2020-10-31T22:41:44.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.851+0000 7f7c008d3700 1 -- start start 2020-10-31T22:41:44.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.851+0000 7f7c008d3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7bfc0ac870 0x7f7bfc146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.851+0000 7f7c008d3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bfc0af900 con 0x7f7bfc146550 2020-10-31T22:41:44.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.851+0000 7f7c008d3700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bfc0afc10 con 0x7f7bfc0af520 2020-10-31T22:41:44.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.851+0000 7f7c008d3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bfc05bb70 con 0x7f7bfc0ac870 2020-10-31T22:41:44.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.851+0000 7f7bfa59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7bfc0ac870 0x7f7bfc146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7bfa59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7bfc0ac870 0x7f7bfc146060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42496/0 (socket says 172.21.15.60:42496) 2020-10-31T22:41:44.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7bfa59c700 1 -- 172.21.15.60:0/2686248484 learned_addr learned my addr 172.21.15.60:0/2686248484 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:44.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7bfb59e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7bfc146550 0x7f7bfc150980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46636/0 (socket says 172.21.15.60:46636) 2020-10-31T22:41:44.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7bfa59c700 1 -- 172.21.15.60:0/2686248484 >> v1:172.21.15.66:6789/0 conn(0x7f7bfc0af520 legacy=0x7f7bfc066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7bfa59c700 1 -- 172.21.15.60:0/2686248484 >> v1:172.21.15.60:6789/0 conn(0x7f7bfc146550 legacy=0x7f7bfc150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7bfa59c700 1 -- 172.21.15.60:0/2686248484 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc0ac130 con 0x7f7bfc0ac870 2020-10-31T22:41:44.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7bf9d9b700 1 -- 172.21.15.60:0/2686248484 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807802023 0 0) 0x7f7bfc0af900 con 0x7f7bfc146550 2020-10-31T22:41:44.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7bfa59c700 1 --2- 172.21.15.60:0/2686248484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bfc0ac870 0x7f7bfc146060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f7be4002f30 tx=0x7f7be4006e80).ready entity=mon.0 client_cookie=821b360a88874f89 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:44.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7bf9d9b700 1 -- 172.21.15.60:0/2686248484 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be40097f0 con 0x7f7bfc0ac870 2020-10-31T22:41:44.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7bf9d9b700 1 -- 172.21.15.60:0/2686248484 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be4009950 con 0x7f7bfc0ac870 2020-10-31T22:41:44.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7bf9d9b700 1 -- 172.21.15.60:0/2686248484 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be4009cb0 con 0x7f7bfc0ac870 2020-10-31T22:41:44.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7c008d3700 1 -- 172.21.15.60:0/2686248484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bfc0ac870 msgr2=0x7f7bfc146060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7c008d3700 1 --2- 172.21.15.60:0/2686248484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bfc0ac870 0x7f7bfc146060 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f7be4002f30 tx=0x7f7be4006e80).stop 2020-10-31T22:41:44.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7c008d3700 1 -- 172.21.15.60:0/2686248484 shutdown_connections 2020-10-31T22:41:44.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7c008d3700 1 --2- 172.21.15.60:0/2686248484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bfc0ac870 0x7f7bfc146060 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7c008d3700 1 -- 172.21.15.60:0/2686248484 >> 172.21.15.60:0/2686248484 conn(0x7f7bfc0b3fd0 msgr2=0x7f7bfc0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:44.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7c008d3700 1 -- 172.21.15.60:0/2686248484 shutdown_connections 2020-10-31T22:41:44.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.855+0000 7f7c008d3700 1 -- 172.21.15.60:0/2686248484 wait complete. 2020-10-31T22:41:44.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7c008d3700 1 Processor -- start 2020-10-31T22:41:44.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7c008d3700 1 -- start start 2020-10-31T22:41:44.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7c008d3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bfc0ac870 0x7f7bfc0ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7c008d3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7bfc0af520 0x7f7bfc148eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7c008d3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bfc146550 0x7f7bfc1558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7c008d3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc1499d0 con 0x7f7bfc0ac870 2020-10-31T22:41:44.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7c008d3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc14a140 con 0x7f7bfc0af520 2020-10-31T22:41:44.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7c008d3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bfc062d50 con 0x7f7bfc146550 2020-10-31T22:41:44.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7bfad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bfc0ac870 0x7f7bfc0ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7bfad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bfc0ac870 0x7f7bfc0ae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42502/0 (socket says 172.21.15.60:42502) 2020-10-31T22:41:44.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7bfad9d700 1 -- 172.21.15.60:0/3683165582 learned_addr learned my addr 172.21.15.60:0/3683165582 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:44.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7bfa59c700 1 --2- 172.21.15.60:0/3683165582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7bfc0af520 0x7f7bfc148eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7bfb59e700 1 --2- 172.21.15.60:0/3683165582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bfc146550 0x7f7bfc1558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7bfad9d700 1 -- 172.21.15.60:0/3683165582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bfc146550 msgr2=0x7f7bfc1558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7bfad9d700 1 --2- 172.21.15.60:0/3683165582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bfc146550 0x7f7bfc1558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7bfad9d700 1 -- 172.21.15.60:0/3683165582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7bfc0af520 msgr2=0x7f7bfc148eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:44.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7bfad9d700 1 --2- 172.21.15.60:0/3683165582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7bfc0af520 0x7f7bfc148eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:44.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7bfad9d700 1 -- 172.21.15.60:0/3683165582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bfc149c00 con 0x7f7bfc0ac870 2020-10-31T22:41:44.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7bfad9d700 1 --2- 172.21.15.60:0/3683165582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bfc0ac870 0x7f7bfc0ae100 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f7bfc0b3f70 tx=0x7f7bec007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:44.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7bf3fff700 1 -- 172.21.15.60:0/3683165582 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bec007030 con 0x7f7bfc0ac870 2020-10-31T22:41:44.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7bf3fff700 1 -- 172.21.15.60:0/3683165582 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bec007190 con 0x7f7bfc0ac870 2020-10-31T22:41:44.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7c008d3700 1 -- 172.21.15.60:0/3683165582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bfc149ea0 con 0x7f7bfc0ac870 2020-10-31T22:41:44.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7bf3fff700 1 -- 172.21.15.60:0/3683165582 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bec0064e0 con 0x7f7bfc0ac870 2020-10-31T22:41:44.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7c008d3700 1 -- 172.21.15.60:0/3683165582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bfc1474b0 con 0x7f7bfc0ac870 2020-10-31T22:41:44.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.859+0000 7f7c008d3700 1 -- 172.21.15.60:0/3683165582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bfc057100 con 0x7f7bfc0ac870 2020-10-31T22:41:44.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.863+0000 7f7bf3fff700 1 -- 172.21.15.60:0/3683165582 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7bec010070 con 0x7f7bfc0ac870 2020-10-31T22:41:44.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.863+0000 7f7bf3fff700 1 --2- 172.21.15.60:0/3683165582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7be0054f90 0x7f7be0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:44.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.863+0000 7f7bf3fff700 1 -- 172.21.15.60:0/3683165582 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7bec06cff0 con 0x7f7bfc0ac870 2020-10-31T22:41:44.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.863+0000 7f7bfa59c700 1 --2- 172.21.15.60:0/3683165582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7be0054f90 0x7f7be0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:44.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.863+0000 7f7bfa59c700 1 --2- 172.21.15.60:0/3683165582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7be0054f90 0x7f7be0057450 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f7be401a000 tx=0x7f7be4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:44.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:44.867+0000 7f7bf3fff700 1 -- 172.21.15.60:0/3683165582 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7bec043730 con 0x7f7bfc0ac870 2020-10-31T22:41:45.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.007+0000 7f7c008d3700 1 -- 172.21.15.60:0/3683165582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7bfc0b25d0 con 0x7f7bfc0ac870 2020-10-31T22:41:45.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.007+0000 7f7bf3fff700 1 -- 172.21.15.60:0/3683165582 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+13181 (secure 0 0 0) 0x7f7bec046d50 con 0x7f7bfc0ac870 2020-10-31T22:41:45.011 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:45.012 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":28,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:42.157179+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:45.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.011+0000 7f7c008d3700 1 -- 172.21.15.60:0/3683165582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7be0054f90 msgr2=0x7f7be0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.011+0000 7f7c008d3700 1 --2- 172.21.15.60:0/3683165582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7be0054f90 0x7f7be0057450 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f7be401a000 tx=0x7f7be4015000).stop 2020-10-31T22:41:45.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.011+0000 7f7c008d3700 1 -- 172.21.15.60:0/3683165582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bfc0ac870 msgr2=0x7f7bfc0ae100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.011+0000 7f7c008d3700 1 --2- 172.21.15.60:0/3683165582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bfc0ac870 0x7f7bfc0ae100 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f7bfc0b3f70 tx=0x7f7bec007b50).stop 2020-10-31T22:41:45.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.011+0000 7f7c008d3700 1 -- 172.21.15.60:0/3683165582 shutdown_connections 2020-10-31T22:41:45.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.011+0000 7f7c008d3700 1 --2- 172.21.15.60:0/3683165582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bfc146550 0x7f7bfc1558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.011+0000 7f7c008d3700 1 --2- 172.21.15.60:0/3683165582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bfc0ac870 0x7f7bfc0ae100 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.011+0000 7f7c008d3700 1 --2- 172.21.15.60:0/3683165582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7be0054f90 0x7f7be0057450 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.011+0000 7f7c008d3700 1 --2- 172.21.15.60:0/3683165582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7bfc0af520 0x7f7bfc148eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.011+0000 7f7c008d3700 1 -- 172.21.15.60:0/3683165582 >> 172.21.15.60:0/3683165582 conn(0x7f7bfc0b3fd0 msgr2=0x7f7bfc0a66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:45.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.011+0000 7f7c008d3700 1 -- 172.21.15.60:0/3683165582 shutdown_connections 2020-10-31T22:41:45.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.011+0000 7f7c008d3700 1 -- 172.21.15.60:0/3683165582 wait complete. 2020-10-31T22:41:45.031 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-31T22:41:45.032 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:41:45.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fd802700 1 Processor -- start 2020-10-31T22:41:45.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fd802700 1 -- start start 2020-10-31T22:41:45.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fd802700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80b5570 0x7f88f80b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fd802700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f88f8141f00 0x7f88f8142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fd802700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88f80b4440 con 0x7f88f80b24a0 2020-10-31T22:41:45.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fd802700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88f813f930 con 0x7f88f8141f00 2020-10-31T22:41:45.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fd802700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8146060 con 0x7f88f80b5570 2020-10-31T22:41:45.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f7fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f88f80b24a0 0x7f88f8145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46648/0 (socket says 172.21.15.60:46648) 2020-10-31T22:41:45.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f7fff700 1 -- 172.21.15.60:0/1529203520 learned_addr learned my addr 172.21.15.60:0/1529203520 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:45.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fd001700 1 --2- 172.21.15.60:0/1529203520 >> v2:172.21.15.60:3300/0 conn(0x7f88f8141f00 0x7f88f8142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fc800700 1 --2- 172.21.15.60:0/1529203520 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80b5570 0x7f88f80b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 -- 172.21.15.60:0/1529203520 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701119256 0 0) 0x7f88f80b4440 con 0x7f88f80b24a0 2020-10-31T22:41:45.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 -- 172.21.15.60:0/1529203520 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e4003230 con 0x7f88f80b24a0 2020-10-31T22:41:45.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 -- 172.21.15.60:0/1529203520 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1104884025 0 0) 0x7f88e4003230 con 0x7f88f80b24a0 2020-10-31T22:41:45.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 -- 172.21.15.60:0/1529203520 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80b5570 msgr2=0x7f88f80b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:45.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 --2- 172.21.15.60:0/1529203520 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80b5570 0x7f88f80b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 -- 172.21.15.60:0/1529203520 >> v2:172.21.15.60:3300/0 conn(0x7f88f8141f00 msgr2=0x7f88f8142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:45.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 --2- 172.21.15.60:0/1529203520 >> v2:172.21.15.60:3300/0 conn(0x7f88f8141f00 0x7f88f8142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 -- 172.21.15.60:0/1529203520 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f80b02f0 con 0x7f88f80b24a0 2020-10-31T22:41:45.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 -- 172.21.15.60:0/1529203520 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f88ec0016d0 con 0x7f88f80b24a0 2020-10-31T22:41:45.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fd001700 1 --2- 172.21.15.60:0/1529203520 >> v2:172.21.15.60:3300/0 conn(0x7f88f8141f00 0x7f88f8142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:45.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 -- 172.21.15.60:0/1529203520 >> v1:172.21.15.60:6789/0 conn(0x7f88f80b24a0 legacy=0x7f88f8145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 --2- 172.21.15.60:0/1529203520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88e4003720 0x7f88e4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 --2- 172.21.15.60:0/1529203520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e40044d0 0x7f88e4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 --2- 172.21.15.60:0/1529203520 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80b5570 0x7f88e4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 -- 172.21.15.60:0/1529203520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f813f930 con 0x7f88e40044d0 2020-10-31T22:41:45.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 -- 172.21.15.60:0/1529203520 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8146060 con 0x7f88e4003720 2020-10-31T22:41:45.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 -- 172.21.15.60:0/1529203520 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e4004260 con 0x7f88f80b5570 2020-10-31T22:41:45.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f7fff700 1 --2- 172.21.15.60:0/1529203520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e40044d0 0x7f88e4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fc800700 1 --2- 172.21.15.60:0/1529203520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88e4003720 0x7f88e4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fd001700 1 --2- 172.21.15.60:0/1529203520 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80b5570 0x7f88e4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f7fff700 1 -- 172.21.15.60:0/1529203520 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80b5570 msgr2=0x7f88e4004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:45.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f7fff700 1 --2- 172.21.15.60:0/1529203520 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f80b5570 0x7f88e4004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f7fff700 1 -- 172.21.15.60:0/1529203520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88e4003720 msgr2=0x7f88e4003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:45.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f7fff700 1 --2- 172.21.15.60:0/1529203520 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88e4003720 0x7f88e4003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f7fff700 1 -- 172.21.15.60:0/1529203520 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e4003230 con 0x7f88e40044d0 2020-10-31T22:41:45.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f7fff700 1 --2- 172.21.15.60:0/1529203520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e40044d0 0x7f88e4004950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f88ec0013e0 tx=0x7f88f80b0210).ready entity=mon.0 client_cookie=2ffdbe3237ad44fa server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:45.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 -- 172.21.15.60:0/1529203520 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88ec00ce00 con 0x7f88e40044d0 2020-10-31T22:41:45.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 -- 172.21.15.60:0/1529203520 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88ec0072e0 con 0x7f88e40044d0 2020-10-31T22:41:45.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88f77fe700 1 -- 172.21.15.60:0/1529203520 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88ec0055e0 con 0x7f88e40044d0 2020-10-31T22:41:45.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fd802700 1 -- 172.21.15.60:0/1529203520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e40044d0 msgr2=0x7f88e4004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fd802700 1 --2- 172.21.15.60:0/1529203520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88e40044d0 0x7f88e4004950 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f88ec0013e0 tx=0x7f88f80b0210).stop 2020-10-31T22:41:45.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.155+0000 7f88fd001700 1 -- 172.21.15.60:0/1529203520 reap_dead start 2020-10-31T22:41:45.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd802700 1 -- 172.21.15.60:0/1529203520 shutdown_connections 2020-10-31T22:41:45.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd802700 1 -- 172.21.15.60:0/1529203520 >> 172.21.15.60:0/1529203520 conn(0x7f88f80b8e90 msgr2=0x7f88f80b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:45.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd802700 1 -- 172.21.15.60:0/1529203520 shutdown_connections 2020-10-31T22:41:45.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd802700 1 -- 172.21.15.60:0/1529203520 wait complete. 2020-10-31T22:41:45.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd802700 1 Processor -- start 2020-10-31T22:41:45.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd802700 1 -- start start 2020-10-31T22:41:45.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd802700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88f80b7a80 0x7f88f8145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd802700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f8144370 0x7f88f8150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd802700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f8151000 0x7f88f8154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd802700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80b7e60 con 0x7f88f80b7a80 2020-10-31T22:41:45.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd802700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f81448f0 con 0x7f88f8151000 2020-10-31T22:41:45.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd802700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88f80aeb70 con 0x7f88f8144370 2020-10-31T22:41:45.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fc800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88f80b7a80 0x7f88f8145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fc800700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88f80b7a80 0x7f88f8145340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42522/0 (socket says 172.21.15.60:42522) 2020-10-31T22:41:45.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fc800700 1 -- 172.21.15.60:0/2452730589 learned_addr learned my addr 172.21.15.60:0/2452730589 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:45.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88f7fff700 1 --2- 172.21.15.60:0/2452730589 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f8144370 0x7f88f8150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd001700 1 --2- 172.21.15.60:0/2452730589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f8151000 0x7f88f8154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fc800700 1 -- 172.21.15.60:0/2452730589 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f8144370 msgr2=0x7f88f8150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fc800700 1 --2- 172.21.15.60:0/2452730589 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f8144370 0x7f88f8150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fc800700 1 -- 172.21.15.60:0/2452730589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f8151000 msgr2=0x7f88f8154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fc800700 1 --2- 172.21.15.60:0/2452730589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f8151000 0x7f88f8154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fc800700 1 -- 172.21.15.60:0/2452730589 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f80aee10 con 0x7f88f80b7a80 2020-10-31T22:41:45.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fc800700 1 --2- 172.21.15.60:0/2452730589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88f80b7a80 0x7f88f8145340 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f88f0000b20 tx=0x7f88f0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:45.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88f5ffb700 1 -- 172.21.15.60:0/2452730589 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88f000eb40 con 0x7f88f80b7a80 2020-10-31T22:41:45.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88f5ffb700 1 -- 172.21.15.60:0/2452730589 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f000eca0 con 0x7f88f80b7a80 2020-10-31T22:41:45.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88f5ffb700 1 -- 172.21.15.60:0/2452730589 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88f0014430 con 0x7f88f80b7a80 2020-10-31T22:41:45.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd802700 1 -- 172.21.15.60:0/2452730589 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f80a1020 con 0x7f88f80b7a80 2020-10-31T22:41:45.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.159+0000 7f88fd802700 1 -- 172.21.15.60:0/2452730589 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f8151620 con 0x7f88f80b7a80 2020-10-31T22:41:45.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.163+0000 7f88fd802700 1 -- 172.21.15.60:0/2452730589 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f8144a60 con 0x7f88f80b7a80 2020-10-31T22:41:45.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.163+0000 7f88f5ffb700 1 -- 172.21.15.60:0/2452730589 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f88f0024070 con 0x7f88f80b7a80 2020-10-31T22:41:45.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.163+0000 7f88f5ffb700 1 --2- 172.21.15.60:0/2452730589 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f88d8054f90 0x7f88d8057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.163+0000 7f88f5ffb700 1 -- 172.21.15.60:0/2452730589 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f88f006dfc0 con 0x7f88f80b7a80 2020-10-31T22:41:45.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.163+0000 7f88f7fff700 1 --2- 172.21.15.60:0/2452730589 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f88d8054f90 0x7f88d8057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.163+0000 7f88f7fff700 1 --2- 172.21.15.60:0/2452730589 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f88d8054f90 0x7f88d8057450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f88ec018000 tx=0x7f88ec013000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:45.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.167+0000 7f88f5ffb700 1 -- 172.21.15.60:0/2452730589 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f88f8144a60 con 0x7f88f80b7a80 2020-10-31T22:41:45.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.307+0000 7f88fd802700 1 -- 172.21.15.60:0/2452730589 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f88f8144a60 con 0x7f88f80b7a80 2020-10-31T22:41:45.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.311+0000 7f88f5ffb700 1 -- 172.21.15.60:0/2452730589 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v29) v1 ==== 110+0+10 (secure 0 0 0) 0x7f88f8144a60 con 0x7f88f80b7a80 2020-10-31T22:41:45.312 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:41:45.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.311+0000 7f88fd802700 1 -- 172.21.15.60:0/2452730589 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f88d8054f90 msgr2=0x7f88d8057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.311+0000 7f88fd802700 1 --2- 172.21.15.60:0/2452730589 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f88d8054f90 0x7f88d8057450 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f88ec018000 tx=0x7f88ec013000).stop 2020-10-31T22:41:45.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.311+0000 7f88fd802700 1 -- 172.21.15.60:0/2452730589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88f80b7a80 msgr2=0x7f88f8145340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.311+0000 7f88fd802700 1 --2- 172.21.15.60:0/2452730589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88f80b7a80 0x7f88f8145340 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f88f0000b20 tx=0x7f88f0008040).stop 2020-10-31T22:41:45.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.311+0000 7f88fd802700 1 -- 172.21.15.60:0/2452730589 shutdown_connections 2020-10-31T22:41:45.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.311+0000 7f88fd802700 1 --2- 172.21.15.60:0/2452730589 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f88d8054f90 0x7f88d8057450 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.311+0000 7f88fd802700 1 --2- 172.21.15.60:0/2452730589 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88f8151000 0x7f88f8154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.311+0000 7f88fd802700 1 --2- 172.21.15.60:0/2452730589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88f80b7a80 0x7f88f8145340 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.311+0000 7f88fd802700 1 --2- 172.21.15.60:0/2452730589 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88f8144370 0x7f88f8150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.311+0000 7f88fd802700 1 -- 172.21.15.60:0/2452730589 >> 172.21.15.60:0/2452730589 conn(0x7f88f80b8e90 msgr2=0x7f88f80b37d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:45.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.311+0000 7f88fd802700 1 -- 172.21.15.60:0/2452730589 shutdown_connections 2020-10-31T22:41:45.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.311+0000 7f88fd802700 1 -- 172.21.15.60:0/2452730589 wait complete. 2020-10-31T22:41:45.326 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:41:45.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.443+0000 7f8c3d5b5700 1 Processor -- start 2020-10-31T22:41:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.443+0000 7f8c3d5b5700 1 -- start start 2020-10-31T22:41:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3d5b5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c380b0040 0x7f8c380aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3d5b5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3805f3c0 con 0x7f8c3805b180 2020-10-31T22:41:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3d5b5700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c38145f70 con 0x7f8c380b0b70 2020-10-31T22:41:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3d5b5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3805f5f0 con 0x7f8c380b0040 2020-10-31T22:41:45.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c37fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8c3805b180 0x7f8c3805fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46666/0 (socket says 172.21.15.60:46666) 2020-10-31T22:41:45.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c37fff700 1 -- 172.21.15.60:0/1775882 learned_addr learned my addr 172.21.15.60:0/1775882 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:45.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3cdb4700 1 --2- 172.21.15.60:0/1775882 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c380b0040 0x7f8c380aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c36ffd700 1 -- 172.21.15.60:0/1775882 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005567718 0 0) 0x7f8c3805f3c0 con 0x7f8c3805b180 2020-10-31T22:41:45.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c36ffd700 1 -- 172.21.15.60:0/1775882 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c24003230 con 0x7f8c3805b180 2020-10-31T22:41:45.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c36ffd700 1 -- 172.21.15.60:0/1775882 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3269783956 0 0) 0x7f8c38145f70 con 0x7f8c380b0b70 2020-10-31T22:41:45.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3cdb4700 1 -- 172.21.15.60:0/1775882 >> v1:172.21.15.66:6789/0 conn(0x7f8c380b0b70 legacy=0x7f8c3813f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3cdb4700 1 -- 172.21.15.60:0/1775882 >> v1:172.21.15.60:6789/0 conn(0x7f8c3805b180 legacy=0x7f8c3805fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3cdb4700 1 -- 172.21.15.60:0/1775882 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3805f890 con 0x7f8c380b0040 2020-10-31T22:41:45.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3cdb4700 1 --2- 172.21.15.60:0/1775882 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c380b0040 0x7f8c380aef50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8c28001870 tx=0x7f8c300091a0).ready entity=mon.2 client_cookie=5650031ae4b915f0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:45.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c36ffd700 1 -- 172.21.15.60:0/1775882 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c280016d0 con 0x7f8c380b0040 2020-10-31T22:41:45.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c36ffd700 1 -- 172.21.15.60:0/1775882 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3000b8b0 con 0x7f8c380b0040 2020-10-31T22:41:45.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c36ffd700 1 -- 172.21.15.60:0/1775882 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c3000ba20 con 0x7f8c380b0040 2020-10-31T22:41:45.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/1775882 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c380b0040 msgr2=0x7f8c380aef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3d5b5700 1 --2- 172.21.15.60:0/1775882 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c380b0040 0x7f8c380aef50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f8c28001870 tx=0x7f8c300091a0).stop 2020-10-31T22:41:45.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/1775882 shutdown_connections 2020-10-31T22:41:45.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3d5b5700 1 --2- 172.21.15.60:0/1775882 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c380b0040 0x7f8c380aef50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/1775882 >> 172.21.15.60:0/1775882 conn(0x7f8c380b61d0 msgr2=0x7f8c380b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:45.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/1775882 shutdown_connections 2020-10-31T22:41:45.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.447+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/1775882 wait complete. 2020-10-31T22:41:45.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c3d5b5700 1 Processor -- start 2020-10-31T22:41:45.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c3d5b5700 1 -- start start 2020-10-31T22:41:45.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c3d5b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c3805b180 0x7f8c380ab680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c3d5b5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c380b0040 0x7f8c3813fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c3d5b5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c380b0b70 0x7f8c381416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c3d5b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38144ab0 con 0x7f8c3805b180 2020-10-31T22:41:45.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c3d5b5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38144d50 con 0x7f8c380b0040 2020-10-31T22:41:45.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c37fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c3805b180 0x7f8c380ab680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c3d5b5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c38144ff0 con 0x7f8c380b0b70 2020-10-31T22:41:45.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c37fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c3805b180 0x7f8c380ab680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42536/0 (socket says 172.21.15.60:42536) 2020-10-31T22:41:45.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c37fff700 1 -- 172.21.15.60:0/2389641956 learned_addr learned my addr 172.21.15.60:0/2389641956 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:45.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c3cdb4700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c380b0b70 0x7f8c381416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c377fe700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c380b0040 0x7f8c3813fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c37fff700 1 -- 172.21.15.60:0/2389641956 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c380b0b70 msgr2=0x7f8c381416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c37fff700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c380b0b70 0x7f8c381416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c37fff700 1 -- 172.21.15.60:0/2389641956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c380b0040 msgr2=0x7f8c3813fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c37fff700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c380b0040 0x7f8c3813fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c37fff700 1 -- 172.21.15.60:0/2389641956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c381447a0 con 0x7f8c3805b180 2020-10-31T22:41:45.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c3cdb4700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c380b0b70 0x7f8c381416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:45.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c377fe700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c380b0040 0x7f8c3813fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:45.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.451+0000 7f8c37fff700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c3805b180 0x7f8c380ab680 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f8c280018b0 tx=0x7f8c28001a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:45.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.455+0000 7f8c357fa700 1 -- 172.21.15.60:0/2389641956 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c28007170 con 0x7f8c3805b180 2020-10-31T22:41:45.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.455+0000 7f8c357fa700 1 -- 172.21.15.60:0/2389641956 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c280072d0 con 0x7f8c3805b180 2020-10-31T22:41:45.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.455+0000 7f8c357fa700 1 -- 172.21.15.60:0/2389641956 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8c2800a960 con 0x7f8c3805b180 2020-10-31T22:41:45.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.455+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/2389641956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c38141be0 con 0x7f8c3805b180 2020-10-31T22:41:45.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.455+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/2389641956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c380ac970 con 0x7f8c3805b180 2020-10-31T22:41:45.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.455+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/2389641956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c380acf40 con 0x7f8c3805b180 2020-10-31T22:41:45.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.455+0000 7f8c357fa700 1 -- 172.21.15.60:0/2389641956 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8c28010070 con 0x7f8c3805b180 2020-10-31T22:41:45.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.455+0000 7f8c357fa700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8c18054fd0 0x7f8c18057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.455+0000 7f8c357fa700 1 -- 172.21.15.60:0/2389641956 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f8c2806d260 con 0x7f8c3805b180 2020-10-31T22:41:45.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.455+0000 7f8c377fe700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8c18054fd0 0x7f8c18057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.459+0000 7f8c377fe700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8c18054fd0 0x7f8c18057490 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f8c2c00b000 tx=0x7f8c2c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:45.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.463+0000 7f8c357fa700 1 -- 172.21.15.60:0/2389641956 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8c380acf40 con 0x7f8c3805b180 2020-10-31T22:41:45.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.603+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/2389641956 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8c380acf40 con 0x7f8c3805b180 2020-10-31T22:41:45.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.607+0000 7f8c357fa700 1 -- 172.21.15.60:0/2389641956 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8c380acf40 con 0x7f8c3805b180 2020-10-31T22:41:45.609 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.607+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/2389641956 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8c18054fd0 msgr2=0x7f8c18057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.607+0000 7f8c3d5b5700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8c18054fd0 0x7f8c18057490 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f8c2c00b000 tx=0x7f8c2c009040).stop 2020-10-31T22:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.607+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/2389641956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c3805b180 msgr2=0x7f8c380ab680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.607+0000 7f8c3d5b5700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c3805b180 0x7f8c380ab680 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f8c280018b0 tx=0x7f8c28001a40).stop 2020-10-31T22:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.607+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/2389641956 shutdown_connections 2020-10-31T22:41:45.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.607+0000 7f8c3d5b5700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8c380b0b70 0x7f8c381416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.607+0000 7f8c3d5b5700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8c3805b180 0x7f8c380ab680 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.607+0000 7f8c3d5b5700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8c18054fd0 0x7f8c18057490 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.607+0000 7f8c3d5b5700 1 --2- 172.21.15.60:0/2389641956 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c380b0040 0x7f8c3813fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.607+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/2389641956 >> 172.21.15.60:0/2389641956 conn(0x7f8c380b61d0 msgr2=0x7f8c380b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:45.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.607+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/2389641956 shutdown_connections 2020-10-31T22:41:45.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.607+0000 7f8c3d5b5700 1 -- 172.21.15.60:0/2389641956 wait complete. 2020-10-31T22:41:45.623 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-10-31T22:41:45.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.735+0000 7fd35a916700 1 Processor -- start 2020-10-31T22:41:45.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.735+0000 7fd35a916700 1 -- start start 2020-10-31T22:41:45.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd35a916700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd3540ae750 0x7fd35413b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd35a916700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3540afbe0 con 0x7fd3540b0880 2020-10-31T22:41:45.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd35a916700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3540631f0 con 0x7fd354062e10 2020-10-31T22:41:45.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd35a916700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3540afe10 con 0x7fd3540ae750 2020-10-31T22:41:45.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd358eb3700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd3540b0880 0x7fd35413beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46684/0 (socket says 172.21.15.60:46684) 2020-10-31T22:41:45.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd358eb3700 1 -- 172.21.15.60:0/460662625 learned_addr learned my addr 172.21.15.60:0/460662625 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:45.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd34bfff700 1 --2- 172.21.15.60:0/460662625 >> v2:172.21.15.66:3300/0 conn(0x7fd3540ae750 0x7fd35413b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd3537fe700 1 -- 172.21.15.60:0/460662625 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1348128236 0 0) 0x7fd3540afbe0 con 0x7fd3540b0880 2020-10-31T22:41:45.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd3537fe700 1 -- 172.21.15.60:0/460662625 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd334003230 con 0x7fd3540b0880 2020-10-31T22:41:45.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd3537fe700 1 -- 172.21.15.60:0/460662625 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828274956 0 0) 0x7fd3540631f0 con 0x7fd354062e10 2020-10-31T22:41:45.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd3537fe700 1 -- 172.21.15.60:0/460662625 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3540afbe0 con 0x7fd354062e10 2020-10-31T22:41:45.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd34bfff700 1 -- 172.21.15.60:0/460662625 >> v1:172.21.15.66:6789/0 conn(0x7fd354062e10 legacy=0x7fd3540b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd34bfff700 1 -- 172.21.15.60:0/460662625 >> v1:172.21.15.60:6789/0 conn(0x7fd3540b0880 legacy=0x7fd35413beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd34bfff700 1 -- 172.21.15.60:0/460662625 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3540ae010 con 0x7fd3540ae750 2020-10-31T22:41:45.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd34bfff700 1 --2- 172.21.15.60:0/460662625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3540ae750 0x7fd35413b9c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fd33c002f30 tx=0x7fd33c006dc0).ready entity=mon.1 client_cookie=50fbf1f7d5a7335b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:45.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd3537fe700 1 -- 172.21.15.60:0/460662625 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd33c009740 con 0x7fd3540ae750 2020-10-31T22:41:45.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd3537fe700 1 -- 172.21.15.60:0/460662625 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c0098a0 con 0x7fd3540ae750 2020-10-31T22:41:45.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd35a916700 1 -- 172.21.15.60:0/460662625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3540ae750 msgr2=0x7fd35413b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd35a916700 1 --2- 172.21.15.60:0/460662625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3540ae750 0x7fd35413b9c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fd33c002f30 tx=0x7fd33c006dc0).stop 2020-10-31T22:41:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd35a916700 1 -- 172.21.15.60:0/460662625 shutdown_connections 2020-10-31T22:41:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd35a916700 1 --2- 172.21.15.60:0/460662625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3540ae750 0x7fd35413b9c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd35a916700 1 -- 172.21.15.60:0/460662625 >> 172.21.15.60:0/460662625 conn(0x7fd35405fae0 msgr2=0x7fd35405fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:45.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd35a916700 1 -- 172.21.15.60:0/460662625 shutdown_connections 2020-10-31T22:41:45.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.739+0000 7fd35a916700 1 -- 172.21.15.60:0/460662625 wait complete. 2020-10-31T22:41:45.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd35a916700 1 Processor -- start 2020-10-31T22:41:45.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd35a916700 1 -- start start 2020-10-31T22:41:45.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd35a916700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd354062e10 0x7fd3540b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd35a916700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3540ae750 0x7fd35413bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd35a916700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3540b0880 0x7fd3540b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd35a916700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3540b2fc0 con 0x7fd3540ae750 2020-10-31T22:41:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd35a916700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3540b3260 con 0x7fd3540b0880 2020-10-31T22:41:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd35a916700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3540b4600 con 0x7fd354062e10 2020-10-31T22:41:45.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd34bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3540ae750 0x7fd35413bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd34bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3540ae750 0x7fd35413bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42552/0 (socket says 172.21.15.60:42552) 2020-10-31T22:41:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd34bfff700 1 -- 172.21.15.60:0/828685750 learned_addr learned my addr 172.21.15.60:0/828685750 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd353fff700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd354062e10 0x7fd3540b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd358eb3700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3540b0880 0x7fd3540b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd34bfff700 1 -- 172.21.15.60:0/828685750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd354062e10 msgr2=0x7fd3540b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd34bfff700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd354062e10 0x7fd3540b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd34bfff700 1 -- 172.21.15.60:0/828685750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3540b0880 msgr2=0x7fd3540b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd34bfff700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3540b0880 0x7fd3540b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd34bfff700 1 -- 172.21.15.60:0/828685750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd354140ee0 con 0x7fd3540ae750 2020-10-31T22:41:45.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd358eb3700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3540b0880 0x7fd3540b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:45.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd34bfff700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3540ae750 0x7fd35413bf10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fd33c002f30 tx=0x7fd33c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:45.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd351ffb700 1 -- 172.21.15.60:0/828685750 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd33c011c40 con 0x7fd3540ae750 2020-10-31T22:41:45.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd351ffb700 1 -- 172.21.15.60:0/828685750 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c011da0 con 0x7fd3540ae750 2020-10-31T22:41:45.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd351ffb700 1 -- 172.21.15.60:0/828685750 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd33c01e750 con 0x7fd3540ae750 2020-10-31T22:41:45.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd35a916700 1 -- 172.21.15.60:0/828685750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35413b470 con 0x7fd3540ae750 2020-10-31T22:41:45.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.743+0000 7fd35a916700 1 -- 172.21.15.60:0/828685750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3540b51b0 con 0x7fd3540ae750 2020-10-31T22:41:45.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.747+0000 7fd35a916700 1 -- 172.21.15.60:0/828685750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3540b3420 con 0x7fd3540ae750 2020-10-31T22:41:45.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.747+0000 7fd351ffb700 1 -- 172.21.15.60:0/828685750 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd33c01a040 con 0x7fd3540ae750 2020-10-31T22:41:45.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.747+0000 7fd351ffb700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd338054f30 0x7fd3380573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:45.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.747+0000 7fd353fff700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd338054f30 0x7fd3380573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:45.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.747+0000 7fd351ffb700 1 -- 172.21.15.60:0/828685750 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fd33c070f00 con 0x7fd3540ae750 2020-10-31T22:41:45.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.747+0000 7fd353fff700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd338054f30 0x7fd3380573f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd34400d000 tx=0x7fd344007960).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:45.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.751+0000 7fd351ffb700 1 -- 172.21.15.60:0/828685750 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd33c047640 con 0x7fd3540ae750 2020-10-31T22:41:45.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.895+0000 7fd35a916700 1 -- 172.21.15.60:0/828685750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd3540b47c0 con 0x7fd3540ae750 2020-10-31T22:41:45.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.895+0000 7fd351ffb700 1 -- 172.21.15.60:0/828685750 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+143 (secure 0 0 0) 0x7fd33c04ac60 con 0x7fd3540ae750 2020-10-31T22:41:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:45.900 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2020-10-31T22:41:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2020-10-31T22:41:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "device_health_metrics" 2020-10-31T22:41:45.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:41:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:41:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2020-10-31T22:41:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2020-10-31T22:41:45.901 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:41:45.901 INFO:teuthology.orchestra.run.smithi060.stdout:] 2020-10-31T22:41:45.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.895+0000 7fd35a916700 1 -- 172.21.15.60:0/828685750 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd338054f30 msgr2=0x7fd3380573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.895+0000 7fd35a916700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd338054f30 0x7fd3380573f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd34400d000 tx=0x7fd344007960).stop 2020-10-31T22:41:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.895+0000 7fd35a916700 1 -- 172.21.15.60:0/828685750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3540ae750 msgr2=0x7fd35413bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.895+0000 7fd35a916700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3540ae750 0x7fd35413bf10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fd33c002f30 tx=0x7fd33c015000).stop 2020-10-31T22:41:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.899+0000 7fd35a916700 1 -- 172.21.15.60:0/828685750 shutdown_connections 2020-10-31T22:41:45.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.899+0000 7fd35a916700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd338054f30 0x7fd3380573f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.899+0000 7fd35a916700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3540b0880 0x7fd3540b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.899+0000 7fd35a916700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd354062e10 0x7fd3540b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.899+0000 7fd35a916700 1 --2- 172.21.15.60:0/828685750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3540ae750 0x7fd35413bf10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:45.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.899+0000 7fd35a916700 1 -- 172.21.15.60:0/828685750 >> 172.21.15.60:0/828685750 conn(0x7fd35405fae0 msgr2=0x7fd354135620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:45.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.899+0000 7fd35a916700 1 -- 172.21.15.60:0/828685750 shutdown_connections 2020-10-31T22:41:45.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:45.899+0000 7fd35a916700 1 -- 172.21.15.60:0/828685750 wait complete. 2020-10-31T22:41:45.914 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-10-31T22:41:45.918 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.035+0000 7f33d73ef700 1 Processor -- start 2020-10-31T22:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.035+0000 7f33d73ef700 1 -- start start 2020-10-31T22:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d73ef700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33d00b5380 0x7f33d00ac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d73ef700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f33d00b0b50 0x7f33d00b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:46.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d73ef700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d00acd60 con 0x7f33d00b1b20 2020-10-31T22:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d73ef700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d00ad650 con 0x7f33d00b0b50 2020-10-31T22:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d73ef700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d00b5760 con 0x7f33d00b5380 2020-10-31T22:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d5bec700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f33d00b0b50 0x7f33d00b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d5bec700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f33d00b0b50 0x7f33d00b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42562/0 (socket says 172.21.15.60:42562) 2020-10-31T22:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d6bee700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f33d00b1b20 0x7f33d00b1f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:44564/0 (socket says 172.21.15.60:44564) 2020-10-31T22:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d63ed700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33d00b5380 0x7f33d00ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:46.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d5bec700 1 -- 172.21.15.60:0/1444616991 learned_addr learned my addr 172.21.15.60:0/1444616991 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d5bec700 1 -- 172.21.15.60:0/1444616991 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33d00b5380 msgr2=0x7f33d00ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d5bec700 1 --2- 172.21.15.60:0/1444616991 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33d00b5380 0x7f33d00ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d5bec700 1 -- 172.21.15.60:0/1444616991 >> v1:172.21.15.66:6789/0 conn(0x7f33d00b1b20 legacy=0x7f33d00b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d5bec700 1 -- 172.21.15.60:0/1444616991 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00b14c0 con 0x7f33d00b0b50 2020-10-31T22:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d5bec700 1 --2- 172.21.15.60:0/1444616991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33d00b0b50 0x7f33d00b0fd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f33c0002f30 tx=0x7f33c0006e80).ready entity=mon.0 client_cookie=614ee2b07ecf8494 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d53eb700 1 -- 172.21.15.60:0/1444616991 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33c00097f0 con 0x7f33d00b0b50 2020-10-31T22:41:46.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d53eb700 1 -- 172.21.15.60:0/1444616991 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c0009950 con 0x7f33d00b0b50 2020-10-31T22:41:46.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d53eb700 1 -- 172.21.15.60:0/1444616991 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33c0009cb0 con 0x7f33d00b0b50 2020-10-31T22:41:46.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d73ef700 1 -- 172.21.15.60:0/1444616991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33d00b0b50 msgr2=0x7f33d00b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:46.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d73ef700 1 --2- 172.21.15.60:0/1444616991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33d00b0b50 0x7f33d00b0fd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f33c0002f30 tx=0x7f33c0006e80).stop 2020-10-31T22:41:46.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d73ef700 1 -- 172.21.15.60:0/1444616991 shutdown_connections 2020-10-31T22:41:46.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d73ef700 1 --2- 172.21.15.60:0/1444616991 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33d00b5380 0x7f33d00ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:46.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d73ef700 1 --2- 172.21.15.60:0/1444616991 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33d00b0b50 0x7f33d00b0fd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:46.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d73ef700 1 -- 172.21.15.60:0/1444616991 >> 172.21.15.60:0/1444616991 conn(0x7f33d006a600 msgr2=0x7f33d0060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:46.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d73ef700 1 -- 172.21.15.60:0/1444616991 shutdown_connections 2020-10-31T22:41:46.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.039+0000 7f33d73ef700 1 -- 172.21.15.60:0/1444616991 wait complete. 2020-10-31T22:41:46.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d73ef700 1 Processor -- start 2020-10-31T22:41:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d73ef700 1 -- start start 2020-10-31T22:41:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d73ef700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33d00b0b50 0x7f33d0066be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d73ef700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33d00b1b20 0x7f33d009e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d73ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33d00b5380 0x7f33d009ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:46.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d73ef700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0066350 con 0x7f33d00b5380 2020-10-31T22:41:46.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d73ef700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d009efc0 con 0x7f33d00b0b50 2020-10-31T22:41:46.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d73ef700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d014e7a0 con 0x7f33d00b1b20 2020-10-31T22:41:46.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d6bee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33d00b5380 0x7f33d009ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:46.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d6bee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33d00b5380 0x7f33d009ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42568/0 (socket says 172.21.15.60:42568) 2020-10-31T22:41:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d6bee700 1 -- 172.21.15.60:0/2956915750 learned_addr learned my addr 172.21.15.60:0/2956915750 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d63ed700 1 --2- 172.21.15.60:0/2956915750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33d00b0b50 0x7f33d0066be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d5bec700 1 --2- 172.21.15.60:0/2956915750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33d00b1b20 0x7f33d009e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d6bee700 1 -- 172.21.15.60:0/2956915750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33d00b1b20 msgr2=0x7f33d009e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d6bee700 1 --2- 172.21.15.60:0/2956915750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33d00b1b20 0x7f33d009e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:46.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d6bee700 1 -- 172.21.15.60:0/2956915750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33d00b0b50 msgr2=0x7f33d0066be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d6bee700 1 --2- 172.21.15.60:0/2956915750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33d00b0b50 0x7f33d0066be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d6bee700 1 -- 172.21.15.60:0/2956915750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d00a0a10 con 0x7f33d00b5380 2020-10-31T22:41:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d6bee700 1 --2- 172.21.15.60:0/2956915750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33d00b5380 0x7f33d009ead0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f33d00b5a50 tx=0x7f33c8007ea0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33bf7fe700 1 -- 172.21.15.60:0/2956915750 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33c8005ca0 con 0x7f33d00b5380 2020-10-31T22:41:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d73ef700 1 -- 172.21.15.60:0/2956915750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d00a0cb0 con 0x7f33d00b5380 2020-10-31T22:41:46.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.043+0000 7f33d73ef700 1 -- 172.21.15.60:0/2956915750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d00a13f0 con 0x7f33d00b5380 2020-10-31T22:41:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.047+0000 7f33bf7fe700 1 -- 172.21.15.60:0/2956915750 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c8005e00 con 0x7f33d00b5380 2020-10-31T22:41:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.047+0000 7f33bf7fe700 1 -- 172.21.15.60:0/2956915750 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33c8007300 con 0x7f33d00b5380 2020-10-31T22:41:46.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.047+0000 7f33d73ef700 1 -- 172.21.15.60:0/2956915750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ac003340 con 0x7f33d00b5380 2020-10-31T22:41:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.047+0000 7f33bf7fe700 1 -- 172.21.15.60:0/2956915750 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f33c8007460 con 0x7f33d00b5380 2020-10-31T22:41:46.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.047+0000 7f33bf7fe700 1 --2- 172.21.15.60:0/2956915750 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33b0055020 0x7f33b00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.047+0000 7f33bf7fe700 1 -- 172.21.15.60:0/2956915750 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f33c806fa20 con 0x7f33d00b5380 2020-10-31T22:41:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.047+0000 7f33d63ed700 1 --2- 172.21.15.60:0/2956915750 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33b0055020 0x7f33b00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:46.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.047+0000 7f33d63ed700 1 --2- 172.21.15.60:0/2956915750 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33b0055020 0x7f33b00574e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f33cc008000 tx=0x7f33cc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:46.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.059+0000 7f33bf7fe700 1 -- 172.21.15.60:0/2956915750 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f33c80461d0 con 0x7f33d00b5380 2020-10-31T22:41:46.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:46.203+0000 7f33d73ef700 1 -- 172.21.15.60:0/2956915750 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f33ac002200 con 0x7f33d00b5380 2020-10-31T22:41:47.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.151+0000 7f33bf7fe700 1 -- 172.21.15.60:0/2956915750 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v30) v1 ==== 133+0+0 (secure 0 0 0) 0x7f33c80497f0 con 0x7f33d00b5380 2020-10-31T22:41:47.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.159+0000 7f33d73ef700 1 -- 172.21.15.60:0/2956915750 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33b0055020 msgr2=0x7f33b00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:47.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.159+0000 7f33d73ef700 1 --2- 172.21.15.60:0/2956915750 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33b0055020 0x7f33b00574e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f33cc008000 tx=0x7f33cc008040).stop 2020-10-31T22:41:47.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.159+0000 7f33d73ef700 1 -- 172.21.15.60:0/2956915750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33d00b5380 msgr2=0x7f33d009ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:47.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.159+0000 7f33d73ef700 1 --2- 172.21.15.60:0/2956915750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33d00b5380 0x7f33d009ead0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f33d00b5a50 tx=0x7f33c8007ea0).stop 2020-10-31T22:41:47.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.159+0000 7f33d73ef700 1 -- 172.21.15.60:0/2956915750 shutdown_connections 2020-10-31T22:41:47.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.159+0000 7f33d73ef700 1 --2- 172.21.15.60:0/2956915750 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33d00b5380 0x7f33d009ead0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:47.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.159+0000 7f33d73ef700 1 --2- 172.21.15.60:0/2956915750 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33b0055020 0x7f33b00574e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:47.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.159+0000 7f33d73ef700 1 --2- 172.21.15.60:0/2956915750 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33d00b0b50 0x7f33d0066be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:47.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.159+0000 7f33d73ef700 1 --2- 172.21.15.60:0/2956915750 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33d00b1b20 0x7f33d009e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:47.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.159+0000 7f33d73ef700 1 -- 172.21.15.60:0/2956915750 >> 172.21.15.60:0/2956915750 conn(0x7f33d006a600 msgr2=0x7f33d0145390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:47.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.159+0000 7f33d73ef700 1 -- 172.21.15.60:0/2956915750 shutdown_connections 2020-10-31T22:41:47.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.159+0000 7f33d73ef700 1 -- 172.21.15.60:0/2956915750 wait complete. 2020-10-31T22:41:47.165 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:41:47.179 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-10-31T22:41:47.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccff143700 1 Processor -- start 2020-10-31T22:41:47.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccff143700 1 -- start start 2020-10-31T22:41:47.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccff143700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fccf80adae0 0x7fccf80aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:47.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccff143700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf80adec0 con 0x7fccf813fb60 2020-10-31T22:41:47.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccff143700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccf81434f0 con 0x7fccf80a9b20 2020-10-31T22:41:47.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccff143700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf8143790 con 0x7fccf80adae0 2020-10-31T22:41:47.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccfd6e0700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fccf813fb60 0x7fccf813ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46712/0 (socket says 172.21.15.60:46712) 2020-10-31T22:41:47.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccfd6e0700 1 -- 172.21.15.60:0/691146824 learned_addr learned my addr 172.21.15.60:0/691146824 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:47.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccfcedf700 1 --2- 172.21.15.60:0/691146824 >> v2:172.21.15.66:3300/0 conn(0x7fccf80adae0 0x7fccf80aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:47.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccf77fe700 1 -- 172.21.15.60:0/691146824 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1407834610 0 0) 0x7fccf80adec0 con 0x7fccf813fb60 2020-10-31T22:41:47.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccf77fe700 1 -- 172.21.15.60:0/691146824 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcce4003230 con 0x7fccf813fb60 2020-10-31T22:41:47.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccfcedf700 1 -- 172.21.15.60:0/691146824 >> v1:172.21.15.66:6789/0 conn(0x7fccf80a9b20 legacy=0x7fccf80a9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:47.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccfcedf700 1 -- 172.21.15.60:0/691146824 >> v1:172.21.15.60:6789/0 conn(0x7fccf813fb60 legacy=0x7fccf813ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:47.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccfcedf700 1 -- 172.21.15.60:0/691146824 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8143a30 con 0x7fccf80adae0 2020-10-31T22:41:47.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccfcedf700 1 --2- 172.21.15.60:0/691146824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf80adae0 0x7fccf80aaa40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fcce8002f30 tx=0x7fcce8006dc0).ready entity=mon.1 client_cookie=f546321351ee41dd server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:47.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccf77fe700 1 -- 172.21.15.60:0/691146824 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce8009800 con 0x7fccf80adae0 2020-10-31T22:41:47.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccf77fe700 1 -- 172.21.15.60:0/691146824 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce8009960 con 0x7fccf80adae0 2020-10-31T22:41:47.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccf77fe700 1 -- 172.21.15.60:0/691146824 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce8009cc0 con 0x7fccf80adae0 2020-10-31T22:41:47.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccff143700 1 -- 172.21.15.60:0/691146824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf80adae0 msgr2=0x7fccf80aaa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:47.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.291+0000 7fccff143700 1 --2- 172.21.15.60:0/691146824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf80adae0 0x7fccf80aaa40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fcce8002f30 tx=0x7fcce8006dc0).stop 2020-10-31T22:41:47.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccff143700 1 -- 172.21.15.60:0/691146824 shutdown_connections 2020-10-31T22:41:47.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccff143700 1 --2- 172.21.15.60:0/691146824 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf80adae0 0x7fccf80aaa40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:47.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccff143700 1 -- 172.21.15.60:0/691146824 >> 172.21.15.60:0/691146824 conn(0x7fccf806a260 msgr2=0x7fccf8061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:47.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccff143700 1 -- 172.21.15.60:0/691146824 shutdown_connections 2020-10-31T22:41:47.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccff143700 1 -- 172.21.15.60:0/691146824 wait complete. 2020-10-31T22:41:47.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccff143700 1 Processor -- start 2020-10-31T22:41:47.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccff143700 1 -- start start 2020-10-31T22:41:47.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccff143700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf80a9b20 0x7fccf813f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:47.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccff143700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf80adae0 0x7fccf81396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:47.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccff143700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fccf813fb60 0x7fccf8146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:47.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccff143700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf8145c50 con 0x7fccf80a9b20 2020-10-31T22:41:47.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccff143700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf80ac160 con 0x7fccf80adae0 2020-10-31T22:41:47.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccff143700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf80ad100 con 0x7fccf813fb60 2020-10-31T22:41:47.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccfcedf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf80a9b20 0x7fccf813f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccfcedf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf80a9b20 0x7fccf813f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42578/0 (socket says 172.21.15.60:42578) 2020-10-31T22:41:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccfcedf700 1 -- 172.21.15.60:0/2836687141 learned_addr learned my addr 172.21.15.60:0/2836687141 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccfd6e0700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fccf813fb60 0x7fccf8146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccf7fff700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf80adae0 0x7fccf81396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccfcedf700 1 -- 172.21.15.60:0/2836687141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fccf813fb60 msgr2=0x7fccf8146490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccfcedf700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fccf813fb60 0x7fccf8146490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:47.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccfcedf700 1 -- 172.21.15.60:0/2836687141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf80adae0 msgr2=0x7fccf81396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:47.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccfcedf700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf80adae0 0x7fccf81396d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:47.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccfcedf700 1 -- 172.21.15.60:0/2836687141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf80ab760 con 0x7fccf80a9b20 2020-10-31T22:41:47.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccf7fff700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf80adae0 0x7fccf81396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:41:47.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.295+0000 7fccfcedf700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf80a9b20 0x7fccf813f220 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fccf80ad290 tx=0x7fcce8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:47.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.299+0000 7fccf5ffb700 1 -- 172.21.15.60:0/2836687141 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce8011b40 con 0x7fccf80a9b20 2020-10-31T22:41:47.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.299+0000 7fccf5ffb700 1 -- 172.21.15.60:0/2836687141 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce8011ca0 con 0x7fccf80a9b20 2020-10-31T22:41:47.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.299+0000 7fccff143700 1 -- 172.21.15.60:0/2836687141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf80ace60 con 0x7fccf80a9b20 2020-10-31T22:41:47.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.299+0000 7fccf5ffb700 1 -- 172.21.15.60:0/2836687141 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcce801d440 con 0x7fccf80a9b20 2020-10-31T22:41:47.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.299+0000 7fccff143700 1 -- 172.21.15.60:0/2836687141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf80a7ad0 con 0x7fccf80a9b20 2020-10-31T22:41:47.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.299+0000 7fccff143700 1 -- 172.21.15.60:0/2836687141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf8057100 con 0x7fccf80a9b20 2020-10-31T22:41:47.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.299+0000 7fccf5ffb700 1 -- 172.21.15.60:0/2836687141 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fcce8024030 con 0x7fccf80a9b20 2020-10-31T22:41:47.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.299+0000 7fccf5ffb700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fccd8055020 0x7fccd80574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:47.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.299+0000 7fccf5ffb700 1 -- 172.21.15.60:0/2836687141 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fcce806e850 con 0x7fccf80a9b20 2020-10-31T22:41:47.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.299+0000 7fccf7fff700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fccd8055020 0x7fccd80574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:47.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.303+0000 7fccf7fff700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fccd8055020 0x7fccd80574e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fccec008000 tx=0x7fccec009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:47.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.307+0000 7fccf5ffb700 1 -- 172.21.15.60:0/2836687141 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcce8044f40 con 0x7fccf80a9b20 2020-10-31T22:41:47.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:47.451+0000 7fccff143700 1 -- 172.21.15.60:0/2836687141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fccf80ad360 con 0x7fccf80a9b20 2020-10-31T22:41:48.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.167+0000 7fccf5ffb700 1 -- 172.21.15.60:0/2836687141 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v31) v1 ==== 125+0+0 (secure 0 0 0) 0x7fcce8022020 con 0x7fccf80a9b20 2020-10-31T22:41:48.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.171+0000 7fccff143700 1 -- 172.21.15.60:0/2836687141 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fccd8055020 msgr2=0x7fccd80574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.171+0000 7fccff143700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fccd8055020 0x7fccd80574e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7fccec008000 tx=0x7fccec009040).stop 2020-10-31T22:41:48.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.171+0000 7fccff143700 1 -- 172.21.15.60:0/2836687141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf80a9b20 msgr2=0x7fccf813f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.171+0000 7fccff143700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf80a9b20 0x7fccf813f220 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fccf80ad290 tx=0x7fcce8015000).stop 2020-10-31T22:41:48.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.175+0000 7fccff143700 1 -- 172.21.15.60:0/2836687141 shutdown_connections 2020-10-31T22:41:48.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.175+0000 7fccff143700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fccf813fb60 0x7fccf8146490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.175+0000 7fccff143700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fccf80a9b20 0x7fccf813f220 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.175+0000 7fccff143700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fccd8055020 0x7fccd80574e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.175+0000 7fccff143700 1 --2- 172.21.15.60:0/2836687141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fccf80adae0 0x7fccf81396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.175+0000 7fccff143700 1 -- 172.21.15.60:0/2836687141 >> 172.21.15.60:0/2836687141 conn(0x7fccf806a260 msgr2=0x7fccf80b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:48.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.179+0000 7fccff143700 1 -- 172.21.15.60:0/2836687141 shutdown_connections 2020-10-31T22:41:48.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.179+0000 7fccff143700 1 -- 172.21.15.60:0/2836687141 wait complete. 2020-10-31T22:41:48.182 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2020-10-31T22:41:48.195 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-10-31T22:41:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.311+0000 7f2737fff700 1 Processor -- start 2020-10-31T22:41:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.311+0000 7f2737fff700 1 -- start start 2020-10-31T22:41:48.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2737fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f27380b5570 0x7f27380b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2737fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2738141f00 0x7f2738142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2737fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27380b4440 con 0x7f27380b24a0 2020-10-31T22:41:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2737fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273813f930 con 0x7f27380b5570 2020-10-31T22:41:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2737fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2738146060 con 0x7f2738141f00 2020-10-31T22:41:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2736ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f27380b5570 0x7f27380b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2736ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f27380b5570 0x7f27380b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42586/0 (socket says 172.21.15.60:42586) 2020-10-31T22:41:48.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2736ffd700 1 -- 172.21.15.60:0/2026422177 learned_addr learned my addr 172.21.15.60:0/2026422177 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:48.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f27377fe700 1 --2- 172.21.15.60:0/2026422177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2738141f00 0x7f2738142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2736ffd700 1 -- 172.21.15.60:0/2026422177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2738141f00 msgr2=0x7f2738142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:48.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2736ffd700 1 --2- 172.21.15.60:0/2026422177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2738141f00 0x7f2738142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2736ffd700 1 -- 172.21.15.60:0/2026422177 >> v1:172.21.15.66:6789/0 conn(0x7f27380b24a0 legacy=0x7f2738145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2736ffd700 1 -- 172.21.15.60:0/2026422177 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27380b02f0 con 0x7f27380b5570 2020-10-31T22:41:48.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2736ffd700 1 --2- 172.21.15.60:0/2026422177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27380b5570 0x7f27380b5950 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f2728002f30 tx=0x7f2728006e80).ready entity=mon.0 client_cookie=68c86e5a5a69a7bd server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:48.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f27367fc700 1 -- 172.21.15.60:0/2026422177 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27280097f0 con 0x7f27380b5570 2020-10-31T22:41:48.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f27367fc700 1 -- 172.21.15.60:0/2026422177 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2728009950 con 0x7f27380b5570 2020-10-31T22:41:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f27367fc700 1 -- 172.21.15.60:0/2026422177 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2728009cb0 con 0x7f27380b5570 2020-10-31T22:41:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2737fff700 1 -- 172.21.15.60:0/2026422177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27380b5570 msgr2=0x7f27380b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2737fff700 1 --2- 172.21.15.60:0/2026422177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27380b5570 0x7f27380b5950 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f2728002f30 tx=0x7f2728006e80).stop 2020-10-31T22:41:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2737fff700 1 -- 172.21.15.60:0/2026422177 shutdown_connections 2020-10-31T22:41:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2737fff700 1 --2- 172.21.15.60:0/2026422177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2738141f00 0x7f2738142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2737fff700 1 --2- 172.21.15.60:0/2026422177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f27380b5570 0x7f27380b5950 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2737fff700 1 -- 172.21.15.60:0/2026422177 >> 172.21.15.60:0/2026422177 conn(0x7f27380b8e90 msgr2=0x7f27380b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2737fff700 1 -- 172.21.15.60:0/2026422177 shutdown_connections 2020-10-31T22:41:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.315+0000 7f2737fff700 1 -- 172.21.15.60:0/2026422177 wait complete. 2020-10-31T22:41:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f2737fff700 1 Processor -- start 2020-10-31T22:41:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f2737fff700 1 -- start start 2020-10-31T22:41:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f2737fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27380b24a0 0x7f2738144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f2737fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f27380b5570 0x7f27380ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f2737fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738141f00 0x7f273813c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f2737fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27380adc20 con 0x7f2738141f00 2020-10-31T22:41:48.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f2737fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27380adec0 con 0x7f27380b24a0 2020-10-31T22:41:48.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f2737fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27380ae160 con 0x7f27380b5570 2020-10-31T22:41:48.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f27377fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738141f00 0x7f273813c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f27377fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738141f00 0x7f273813c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42596/0 (socket says 172.21.15.60:42596) 2020-10-31T22:41:48.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f27377fe700 1 -- 172.21.15.60:0/3004742874 learned_addr learned my addr 172.21.15.60:0/3004742874 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:48.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f2736ffd700 1 --2- 172.21.15.60:0/3004742874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27380b24a0 0x7f2738144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f272e7fc700 1 --2- 172.21.15.60:0/3004742874 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f27380b5570 0x7f27380ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f27377fe700 1 -- 172.21.15.60:0/3004742874 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f27380b5570 msgr2=0x7f27380ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f27377fe700 1 --2- 172.21.15.60:0/3004742874 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f27380b5570 0x7f27380ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f27377fe700 1 -- 172.21.15.60:0/3004742874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27380b24a0 msgr2=0x7f2738144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f27377fe700 1 --2- 172.21.15.60:0/3004742874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27380b24a0 0x7f2738144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f27377fe700 1 -- 172.21.15.60:0/3004742874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27380ae400 con 0x7f2738141f00 2020-10-31T22:41:48.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f27377fe700 1 --2- 172.21.15.60:0/3004742874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738141f00 0x7f273813c530 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f2730006dd0 tx=0x7f27300091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:48.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f2734ff9700 1 -- 172.21.15.60:0/3004742874 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f273000c950 con 0x7f2738141f00 2020-10-31T22:41:48.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f2734ff9700 1 -- 172.21.15.60:0/3004742874 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273000cab0 con 0x7f2738141f00 2020-10-31T22:41:48.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f2737fff700 1 -- 172.21.15.60:0/3004742874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27380b7ac0 con 0x7f2738141f00 2020-10-31T22:41:48.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f2734ff9700 1 -- 172.21.15.60:0/3004742874 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f273000ce10 con 0x7f2738141f00 2020-10-31T22:41:48.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.319+0000 7f2737fff700 1 -- 172.21.15.60:0/3004742874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27380ac8e0 con 0x7f2738141f00 2020-10-31T22:41:48.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.323+0000 7f2737fff700 1 -- 172.21.15.60:0/3004742874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27380ae590 con 0x7f2738141f00 2020-10-31T22:41:48.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.323+0000 7f2734ff9700 1 -- 172.21.15.60:0/3004742874 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2730022070 con 0x7f2738141f00 2020-10-31T22:41:48.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.323+0000 7f2734ff9700 1 --2- 172.21.15.60:0/3004742874 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f271c054f10 0x7f271c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.323+0000 7f2734ff9700 1 -- 172.21.15.60:0/3004742874 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f273006e010 con 0x7f2738141f00 2020-10-31T22:41:48.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.323+0000 7f2736ffd700 1 --2- 172.21.15.60:0/3004742874 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f271c054f10 0x7f271c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.323+0000 7f2736ffd700 1 --2- 172.21.15.60:0/3004742874 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f271c054f10 0x7f271c0573d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f272801c000 tx=0x7f2728015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:48.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.331+0000 7f2734ff9700 1 -- 172.21.15.60:0/3004742874 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f27300445a0 con 0x7f2738141f00 2020-10-31T22:41:48.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.519+0000 7f2737fff700 1 -- 172.21.15.60:0/3004742874 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f2738057100 con 0x7f2738141f00 2020-10-31T22:41:48.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.527+0000 7f2734ff9700 1 -- 172.21.15.60:0/3004742874 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 5 and data pool 6 v10) v1 ==== 187+0+0 (secure 0 0 0) 0x7f2730016070 con 0x7f2738141f00 2020-10-31T22:41:48.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.535+0000 7f2737fff700 1 -- 172.21.15.60:0/3004742874 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f271c054f10 msgr2=0x7f271c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.535+0000 7f2737fff700 1 --2- 172.21.15.60:0/3004742874 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f271c054f10 0x7f271c0573d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f272801c000 tx=0x7f2728015000).stop 2020-10-31T22:41:48.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.535+0000 7f2737fff700 1 -- 172.21.15.60:0/3004742874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738141f00 msgr2=0x7f273813c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.535+0000 7f2737fff700 1 --2- 172.21.15.60:0/3004742874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738141f00 0x7f273813c530 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f2730006dd0 tx=0x7f27300091a0).stop 2020-10-31T22:41:48.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.539+0000 7f2737fff700 1 -- 172.21.15.60:0/3004742874 shutdown_connections 2020-10-31T22:41:48.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.539+0000 7f2737fff700 1 --2- 172.21.15.60:0/3004742874 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2738141f00 0x7f273813c530 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.539+0000 7f2737fff700 1 --2- 172.21.15.60:0/3004742874 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f271c054f10 0x7f271c0573d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.539+0000 7f2737fff700 1 --2- 172.21.15.60:0/3004742874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f27380b24a0 0x7f2738144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.539+0000 7f2737fff700 1 --2- 172.21.15.60:0/3004742874 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f27380b5570 0x7f27380ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.539+0000 7f2737fff700 1 -- 172.21.15.60:0/3004742874 >> 172.21.15.60:0/3004742874 conn(0x7f27380b8e90 msgr2=0x7f273806ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:48.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.539+0000 7f2737fff700 1 -- 172.21.15.60:0/3004742874 shutdown_connections 2020-10-31T22:41:48.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.539+0000 7f2737fff700 1 -- 172.21.15.60:0/3004742874 wait complete. 2020-10-31T22:41:48.545 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 5 and data pool 6 2020-10-31T22:41:48.557 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:48.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.655+0000 7fcedf59e700 1 Processor -- start 2020-10-31T22:41:48.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.655+0000 7fcedf59e700 1 -- start start 2020-10-31T22:41:48.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.655+0000 7fcedf59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcee00ae630 0x7fcee005c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.655+0000 7fcedf59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee005c800 con 0x7fcee013f3d0 2020-10-31T22:41:48.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.655+0000 7fcedf59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee00adc50 con 0x7fcee00b1bb0 2020-10-31T22:41:48.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.655+0000 7fcedf59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee00adef0 con 0x7fcee00ae630 2020-10-31T22:41:48.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.655+0000 7fceded9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcee00ae630 0x7fcee005c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.655+0000 7fceddd9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcee013f3d0 0x7fcee00b0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46748/0 (socket says 172.21.15.60:46748) 2020-10-31T22:41:48.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.655+0000 7fceddd9b700 1 -- 172.21.15.60:0/118882375 learned_addr learned my addr 172.21.15.60:0/118882375 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:48.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fceded9d700 1 -- 172.21.15.60:0/118882375 >> v1:172.21.15.66:6789/0 conn(0x7fcee00b1bb0 legacy=0x7fcee013ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fceded9d700 1 -- 172.21.15.60:0/118882375 >> v1:172.21.15.60:6789/0 conn(0x7fcee013f3d0 legacy=0x7fcee00b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedd59a700 1 -- 172.21.15.60:0/118882375 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2254033487 0 0) 0x7fcee005c800 con 0x7fcee013f3d0 2020-10-31T22:41:48.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fceded9d700 1 -- 172.21.15.60:0/118882375 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee00ae190 con 0x7fcee00ae630 2020-10-31T22:41:48.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fceded9d700 1 --2- 172.21.15.60:0/118882375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee00ae630 0x7fcee005c0f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fced80032b0 tx=0x7fced80091a0).ready entity=mon.0 client_cookie=5e17187284310fb5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:48.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedd59a700 1 -- 172.21.15.60:0/118882375 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fced800ba50 con 0x7fcee00ae630 2020-10-31T22:41:48.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedd59a700 1 -- 172.21.15.60:0/118882375 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced800bbb0 con 0x7fcee00ae630 2020-10-31T22:41:48.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedd59a700 1 -- 172.21.15.60:0/118882375 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fced800bd20 con 0x7fcee00ae630 2020-10-31T22:41:48.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 -- 172.21.15.60:0/118882375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee00ae630 msgr2=0x7fcee005c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 --2- 172.21.15.60:0/118882375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee00ae630 0x7fcee005c0f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7fced80032b0 tx=0x7fced80091a0).stop 2020-10-31T22:41:48.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 -- 172.21.15.60:0/118882375 shutdown_connections 2020-10-31T22:41:48.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 --2- 172.21.15.60:0/118882375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee00ae630 0x7fcee005c0f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 -- 172.21.15.60:0/118882375 >> 172.21.15.60:0/118882375 conn(0x7fcee00b5300 msgr2=0x7fcee00b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:48.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 -- 172.21.15.60:0/118882375 shutdown_connections 2020-10-31T22:41:48.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 -- 172.21.15.60:0/118882375 wait complete. 2020-10-31T22:41:48.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 Processor -- start 2020-10-31T22:41:48.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 -- start start 2020-10-31T22:41:48.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcee00b1bb0 0x7fcee0154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee013f3d0 0x7fcee00b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcee00aad10 0x7fcee0150b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee0154210 con 0x7fcee013f3d0 2020-10-31T22:41:48.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee01544b0 con 0x7fcee00b1bb0 2020-10-31T22:41:48.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcedf59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee0154750 con 0x7fcee00aad10 2020-10-31T22:41:48.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fceddd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee013f3d0 0x7fcee00b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fceddd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee013f3d0 0x7fcee00b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42620/0 (socket says 172.21.15.60:42620) 2020-10-31T22:41:48.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fceddd9b700 1 -- 172.21.15.60:0/998016969 learned_addr learned my addr 172.21.15.60:0/998016969 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:48.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fceded9d700 1 --2- 172.21.15.60:0/998016969 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcee00aad10 0x7fcee0150b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.659+0000 7fcede59c700 1 --2- 172.21.15.60:0/998016969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcee00b1bb0 0x7fcee0154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fceddd9b700 1 -- 172.21.15.60:0/998016969 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcee00aad10 msgr2=0x7fcee0150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fceddd9b700 1 --2- 172.21.15.60:0/998016969 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcee00aad10 0x7fcee0150b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fceddd9b700 1 -- 172.21.15.60:0/998016969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcee00b1bb0 msgr2=0x7fcee0154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fceddd9b700 1 --2- 172.21.15.60:0/998016969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcee00b1bb0 0x7fcee0154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fceddd9b700 1 -- 172.21.15.60:0/998016969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee00ab1c0 con 0x7fcee013f3d0 2020-10-31T22:41:48.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fceddd9b700 1 --2- 172.21.15.60:0/998016969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee013f3d0 0x7fcee00b3eb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fced0000b80 tx=0x7fced0007a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fced77fe700 1 -- 172.21.15.60:0/998016969 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fced00073b0 con 0x7fcee013f3d0 2020-10-31T22:41:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fced77fe700 1 -- 172.21.15.60:0/998016969 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced00055e0 con 0x7fcee013f3d0 2020-10-31T22:41:48.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fcedf59e700 1 -- 172.21.15.60:0/998016969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee00a96c0 con 0x7fcee013f3d0 2020-10-31T22:41:48.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fced77fe700 1 -- 172.21.15.60:0/998016969 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fced0005940 con 0x7fcee013f3d0 2020-10-31T22:41:48.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fcedf59e700 1 -- 172.21.15.60:0/998016969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee01511d0 con 0x7fcee013f3d0 2020-10-31T22:41:48.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fcedf59e700 1 -- 172.21.15.60:0/998016969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee00ab3b0 con 0x7fcee013f3d0 2020-10-31T22:41:48.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fced77fe700 1 -- 172.21.15.60:0/998016969 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fced001a060 con 0x7fcee013f3d0 2020-10-31T22:41:48.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fced77fe700 1 --2- 172.21.15.60:0/998016969 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcec4054f10 0x7fcec40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fced77fe700 1 -- 172.21.15.60:0/998016969 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fced006d1e0 con 0x7fcee013f3d0 2020-10-31T22:41:48.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fcede59c700 1 --2- 172.21.15.60:0/998016969 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcec4054f10 0x7fcec40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.663+0000 7fcede59c700 1 --2- 172.21.15.60:0/998016969 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcec4054f10 0x7fcec40573d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fcec800d000 tx=0x7fcec8000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:48.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.671+0000 7fced77fe700 1 -- 172.21.15.60:0/998016969 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fced0043700 con 0x7fcee013f3d0 2020-10-31T22:41:48.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.811+0000 7fcedf59e700 1 -- 172.21.15.60:0/998016969 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcee0154910 con 0x7fcee013f3d0 2020-10-31T22:41:48.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.815+0000 7fced77fe700 1 -- 172.21.15.60:0/998016969 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fced0018070 con 0x7fcee013f3d0 2020-10-31T22:41:48.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.815+0000 7fcedf59e700 1 -- 172.21.15.60:0/998016969 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcec4054f10 msgr2=0x7fcec40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.815+0000 7fcedf59e700 1 --2- 172.21.15.60:0/998016969 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcec4054f10 0x7fcec40573d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fcec800d000 tx=0x7fcec8000b80).stop 2020-10-31T22:41:48.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.815+0000 7fcedf59e700 1 -- 172.21.15.60:0/998016969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee013f3d0 msgr2=0x7fcee00b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.815+0000 7fcedf59e700 1 --2- 172.21.15.60:0/998016969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee013f3d0 0x7fcee00b3eb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7fced0000b80 tx=0x7fced0007a50).stop 2020-10-31T22:41:48.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.815+0000 7fcedf59e700 1 -- 172.21.15.60:0/998016969 shutdown_connections 2020-10-31T22:41:48.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.815+0000 7fcedf59e700 1 --2- 172.21.15.60:0/998016969 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcee00aad10 0x7fcee0150b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.815+0000 7fcedf59e700 1 --2- 172.21.15.60:0/998016969 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcec4054f10 0x7fcec40573d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.815+0000 7fcedf59e700 1 --2- 172.21.15.60:0/998016969 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcee00b1bb0 0x7fcee0154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.815+0000 7fcedf59e700 1 --2- 172.21.15.60:0/998016969 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcee013f3d0 0x7fcee00b3eb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.815+0000 7fcedf59e700 1 -- 172.21.15.60:0/998016969 >> 172.21.15.60:0/998016969 conn(0x7fcee00b5300 msgr2=0x7fcee0149830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:48.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.815+0000 7fcedf59e700 1 -- 172.21.15.60:0/998016969 shutdown_connections 2020-10-31T22:41:48.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.815+0000 7fcedf59e700 1 -- 172.21.15.60:0/998016969 wait complete. 2020-10-31T22:41:48.821 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:48.821 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":32,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:48.522936+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:46.258748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:47.507555+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:48.831 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:48.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe39d359700 1 Processor -- start 2020-10-31T22:41:48.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe39d359700 1 -- start start 2020-10-31T22:41:48.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe39d359700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3980b58b0 0x7fe3980b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe39d359700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe398066830 0x7fe3980af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe39d359700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe39805f3c0 0x7fe39805f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe39d359700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3980607c0 con 0x7fe3980b58b0 2020-10-31T22:41:48.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe39d359700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3980b5c90 con 0x7fe39805f3c0 2020-10-31T22:41:48.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe39d359700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980b4860 con 0x7fe398066830 2020-10-31T22:41:48.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe397fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3980b58b0 0x7fe3980b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe397fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3980b58b0 0x7fe3980b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42626/0 (socket says 172.21.15.60:42626) 2020-10-31T22:41:48.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe397fff700 1 -- 172.21.15.60:0/2241246105 learned_addr learned my addr 172.21.15.60:0/2241246105 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:48.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe39cb58700 1 --2- 172.21.15.60:0/2241246105 >> v2:172.21.15.66:3300/0 conn(0x7fe39805f3c0 0x7fe39805f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe38ffff700 1 --2- 172.21.15.60:0/2241246105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe398066830 0x7fe3980af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe397fff700 1 -- 172.21.15.60:0/2241246105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe398066830 msgr2=0x7fe3980af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:48.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe397fff700 1 --2- 172.21.15.60:0/2241246105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe398066830 0x7fe3980af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe397fff700 1 -- 172.21.15.60:0/2241246105 >> v2:172.21.15.66:3300/0 conn(0x7fe39805f3c0 msgr2=0x7fe39805f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:48.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe397fff700 1 --2- 172.21.15.60:0/2241246105 >> v2:172.21.15.66:3300/0 conn(0x7fe39805f3c0 0x7fe39805f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe397fff700 1 -- 172.21.15.60:0/2241246105 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3980b44d0 con 0x7fe3980b58b0 2020-10-31T22:41:48.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe39cb58700 1 --2- 172.21.15.60:0/2241246105 >> v2:172.21.15.66:3300/0 conn(0x7fe39805f3c0 0x7fe39805f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:48.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe397fff700 1 --2- 172.21.15.60:0/2241246105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980b58b0 0x7fe3980b3660 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fe388002f30 tx=0x7fe388006e80).ready entity=mon.0 client_cookie=13784d92b078b978 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:48.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe3977fe700 1 -- 172.21.15.60:0/2241246105 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3880097f0 con 0x7fe3980b58b0 2020-10-31T22:41:48.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe3977fe700 1 -- 172.21.15.60:0/2241246105 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe388009950 con 0x7fe3980b58b0 2020-10-31T22:41:48.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe3977fe700 1 -- 172.21.15.60:0/2241246105 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe388009ac0 con 0x7fe3980b58b0 2020-10-31T22:41:48.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe39d359700 1 -- 172.21.15.60:0/2241246105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980b58b0 msgr2=0x7fe3980b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.943+0000 7fe39d359700 1 --2- 172.21.15.60:0/2241246105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980b58b0 0x7fe3980b3660 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7fe388002f30 tx=0x7fe388006e80).stop 2020-10-31T22:41:48.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.947+0000 7fe39d359700 1 -- 172.21.15.60:0/2241246105 shutdown_connections 2020-10-31T22:41:48.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.947+0000 7fe39d359700 1 --2- 172.21.15.60:0/2241246105 >> v2:172.21.15.66:3300/0 conn(0x7fe39805f3c0 0x7fe39805f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.947+0000 7fe39d359700 1 --2- 172.21.15.60:0/2241246105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980b58b0 0x7fe3980b3660 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.947+0000 7fe39d359700 1 --2- 172.21.15.60:0/2241246105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe398066830 0x7fe3980af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.947+0000 7fe39d359700 1 -- 172.21.15.60:0/2241246105 >> 172.21.15.60:0/2241246105 conn(0x7fe3980b8e90 msgr2=0x7fe3980b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:48.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.947+0000 7fe39d359700 1 -- 172.21.15.60:0/2241246105 shutdown_connections 2020-10-31T22:41:48.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.947+0000 7fe39d359700 1 -- 172.21.15.60:0/2241246105 wait complete. 2020-10-31T22:41:48.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.947+0000 7fe39d359700 1 Processor -- start 2020-10-31T22:41:48.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.947+0000 7fe39d359700 1 -- start start 2020-10-31T22:41:48.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe39d359700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe39805f3c0 0x7fe3980a8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe39d359700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe398066830 0x7fe3980a7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe39d359700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3980b58b0 0x7fe398154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe39d359700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe398155270 con 0x7fe398066830 2020-10-31T22:41:48.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe39d359700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe398064fa0 con 0x7fe39805f3c0 2020-10-31T22:41:48.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe39d359700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe398065240 con 0x7fe3980b58b0 2020-10-31T22:41:48.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe38ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe398066830 0x7fe3980a7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe38ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe398066830 0x7fe3980a7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42634/0 (socket says 172.21.15.60:42634) 2020-10-31T22:41:48.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe38ffff700 1 -- 172.21.15.60:0/1127495760 learned_addr learned my addr 172.21.15.60:0/1127495760 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:48.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe39cb58700 1 --2- 172.21.15.60:0/1127495760 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3980b58b0 0x7fe398154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe397fff700 1 --2- 172.21.15.60:0/1127495760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe39805f3c0 0x7fe3980a8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe38ffff700 1 -- 172.21.15.60:0/1127495760 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3980b58b0 msgr2=0x7fe398154d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe38ffff700 1 --2- 172.21.15.60:0/1127495760 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3980b58b0 0x7fe398154d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe38ffff700 1 -- 172.21.15.60:0/1127495760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe39805f3c0 msgr2=0x7fe3980a8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:48.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe38ffff700 1 --2- 172.21.15.60:0/1127495760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe39805f3c0 0x7fe3980a8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:48.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe38ffff700 1 -- 172.21.15.60:0/1127495760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe398158370 con 0x7fe398066830 2020-10-31T22:41:48.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe38ffff700 1 --2- 172.21.15.60:0/1127495760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe398066830 0x7fe3980a7aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fe38000c000 tx=0x7fe380006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:48.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe395ffb700 1 -- 172.21.15.60:0/1127495760 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe38000ca10 con 0x7fe398066830 2020-10-31T22:41:48.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe395ffb700 1 -- 172.21.15.60:0/1127495760 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38000cb70 con 0x7fe398066830 2020-10-31T22:41:48.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe395ffb700 1 -- 172.21.15.60:0/1127495760 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe38000ee80 con 0x7fe398066830 2020-10-31T22:41:48.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe39d359700 1 -- 172.21.15.60:0/1127495760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe398158610 con 0x7fe398066830 2020-10-31T22:41:48.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe39d359700 1 -- 172.21.15.60:0/1127495760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe398064b00 con 0x7fe398066830 2020-10-31T22:41:48.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe395ffb700 1 -- 172.21.15.60:0/1127495760 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe38001c460 con 0x7fe398066830 2020-10-31T22:41:48.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.951+0000 7fe39d359700 1 -- 172.21.15.60:0/1127495760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe398064e10 con 0x7fe398066830 2020-10-31T22:41:48.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.955+0000 7fe395ffb700 1 --2- 172.21.15.60:0/1127495760 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe37c054f30 0x7fe37c0573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:48.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.955+0000 7fe395ffb700 1 -- 172.21.15.60:0/1127495760 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe38006ded0 con 0x7fe398066830 2020-10-31T22:41:48.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.955+0000 7fe397fff700 1 --2- 172.21.15.60:0/1127495760 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe37c054f30 0x7fe37c0573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:48.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.955+0000 7fe397fff700 1 --2- 172.21.15.60:0/1127495760 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe37c054f30 0x7fe37c0573f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fe38801c000 tx=0x7fe388016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:48.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:48.959+0000 7fe395ffb700 1 -- 172.21.15.60:0/1127495760 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe3800442f0 con 0x7fe398066830 2020-10-31T22:41:49.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.103+0000 7fe39d359700 1 -- 172.21.15.60:0/1127495760 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3981587a0 con 0x7fe398066830 2020-10-31T22:41:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.103+0000 7fe395ffb700 1 -- 172.21.15.60:0/1127495760 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fe380047910 con 0x7fe398066830 2020-10-31T22:41:49.107 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:49.108 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":32,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:48.522936+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:46.258748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:47.507555+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:49.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.107+0000 7fe39d359700 1 -- 172.21.15.60:0/1127495760 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe37c054f30 msgr2=0x7fe37c0573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:49.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.107+0000 7fe39d359700 1 --2- 172.21.15.60:0/1127495760 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe37c054f30 0x7fe37c0573f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fe38801c000 tx=0x7fe388016000).stop 2020-10-31T22:41:49.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.107+0000 7fe39d359700 1 -- 172.21.15.60:0/1127495760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe398066830 msgr2=0x7fe3980a7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:49.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.107+0000 7fe39d359700 1 --2- 172.21.15.60:0/1127495760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe398066830 0x7fe3980a7aa0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fe38000c000 tx=0x7fe380006dc0).stop 2020-10-31T22:41:49.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.107+0000 7fe39d359700 1 -- 172.21.15.60:0/1127495760 shutdown_connections 2020-10-31T22:41:49.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.107+0000 7fe39d359700 1 --2- 172.21.15.60:0/1127495760 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3980b58b0 0x7fe398154d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.107+0000 7fe39d359700 1 --2- 172.21.15.60:0/1127495760 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe37c054f30 0x7fe37c0573f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.107+0000 7fe39d359700 1 --2- 172.21.15.60:0/1127495760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe39805f3c0 0x7fe3980a8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.107+0000 7fe39d359700 1 --2- 172.21.15.60:0/1127495760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe398066830 0x7fe3980a7aa0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.107+0000 7fe39d359700 1 -- 172.21.15.60:0/1127495760 >> 172.21.15.60:0/1127495760 conn(0x7fe3980b8e90 msgr2=0x7fe39805f800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:49.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.107+0000 7fe39d359700 1 -- 172.21.15.60:0/1127495760 shutdown_connections 2020-10-31T22:41:49.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.107+0000 7fe39d359700 1 -- 172.21.15.60:0/1127495760 wait complete. 2020-10-31T22:41:49.123 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-10-31T22:41:49.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.239+0000 7fd06c91e700 1 Processor -- start 2020-10-31T22:41:49.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.239+0000 7fd06c91e700 1 -- start start 2020-10-31T22:41:49.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd0680a7530 0x7fd06813edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd0680b01a0 0x7fd06813f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06813f7d0 con 0x7fd0680afdc0 2020-10-31T22:41:49.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0681429d0 con 0x7fd0680b01a0 2020-10-31T22:41:49.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd068142c70 con 0x7fd0680a7530 2020-10-31T22:41:49.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd0680b01a0 0x7fd06813f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd0680b01a0 0x7fd06813f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42644/0 (socket says 172.21.15.60:42644) 2020-10-31T22:41:49.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06759e700 1 -- 172.21.15.60:0/4037035108 learned_addr learned my addr 172.21.15.60:0/4037035108 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:49.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd066d9d700 1 --1- 172.21.15.60:0/4037035108 >> v1:172.21.15.60:6789/0 conn(0x7fd0680afdc0 0x7fd06813be20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46776/0 (socket says 172.21.15.60:46776) 2020-10-31T22:41:49.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06659c700 1 --2- 172.21.15.60:0/4037035108 >> v2:172.21.15.66:3300/0 conn(0x7fd0680a7530 0x7fd06813edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06759e700 1 -- 172.21.15.60:0/4037035108 >> v2:172.21.15.66:3300/0 conn(0x7fd0680a7530 msgr2=0x7fd06813edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:49.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06759e700 1 --2- 172.21.15.60:0/4037035108 >> v2:172.21.15.66:3300/0 conn(0x7fd0680a7530 0x7fd06813edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06759e700 1 -- 172.21.15.60:0/4037035108 >> v1:172.21.15.60:6789/0 conn(0x7fd0680afdc0 legacy=0x7fd06813be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:49.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06759e700 1 -- 172.21.15.60:0/4037035108 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06813c530 con 0x7fd0680b01a0 2020-10-31T22:41:49.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06759e700 1 --2- 172.21.15.60:0/4037035108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680b01a0 0x7fd06813f2e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fd060002f30 tx=0x7fd060006e80).ready entity=mon.0 client_cookie=c2dfced05b899081 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:49.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd065d9b700 1 -- 172.21.15.60:0/4037035108 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd0600097f0 con 0x7fd0680b01a0 2020-10-31T22:41:49.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd065d9b700 1 -- 172.21.15.60:0/4037035108 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd060009950 con 0x7fd0680b01a0 2020-10-31T22:41:49.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd065d9b700 1 -- 172.21.15.60:0/4037035108 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd060009cb0 con 0x7fd0680b01a0 2020-10-31T22:41:49.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 -- 172.21.15.60:0/4037035108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680b01a0 msgr2=0x7fd06813f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 --2- 172.21.15.60:0/4037035108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680b01a0 0x7fd06813f2e0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fd060002f30 tx=0x7fd060006e80).stop 2020-10-31T22:41:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 -- 172.21.15.60:0/4037035108 shutdown_connections 2020-10-31T22:41:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 --2- 172.21.15.60:0/4037035108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680b01a0 0x7fd06813f2e0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 --2- 172.21.15.60:0/4037035108 >> v2:172.21.15.66:3300/0 conn(0x7fd0680a7530 0x7fd06813edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 -- 172.21.15.60:0/4037035108 >> 172.21.15.60:0/4037035108 conn(0x7fd0680b3fd0 msgr2=0x7fd0680b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 -- 172.21.15.60:0/4037035108 shutdown_connections 2020-10-31T22:41:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 -- 172.21.15.60:0/4037035108 wait complete. 2020-10-31T22:41:49.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 Processor -- start 2020-10-31T22:41:49.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.243+0000 7fd06c91e700 1 -- start start 2020-10-31T22:41:49.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd06c91e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680afdc0 0x7fd06813d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd06c91e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0680b01a0 0x7fd0680a8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd06c91e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd06813dc00 0x7fd0680a8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd06c91e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06813ea70 con 0x7fd0680afdc0 2020-10-31T22:41:49.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd06c91e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd068141da0 con 0x7fd0680b01a0 2020-10-31T22:41:49.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd06c91e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd068130930 con 0x7fd06813dc00 2020-10-31T22:41:49.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd066d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680afdc0 0x7fd06813d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd066d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680afdc0 0x7fd06813d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42650/0 (socket says 172.21.15.60:42650) 2020-10-31T22:41:49.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd066d9d700 1 -- 172.21.15.60:0/3061746674 learned_addr learned my addr 172.21.15.60:0/3061746674 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:49.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd06659c700 1 --2- 172.21.15.60:0/3061746674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0680b01a0 0x7fd0680a8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd06759e700 1 --2- 172.21.15.60:0/3061746674 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd06813dc00 0x7fd0680a8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd066d9d700 1 -- 172.21.15.60:0/3061746674 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd06813dc00 msgr2=0x7fd0680a8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd066d9d700 1 --2- 172.21.15.60:0/3061746674 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd06813dc00 0x7fd0680a8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd066d9d700 1 -- 172.21.15.60:0/3061746674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0680b01a0 msgr2=0x7fd0680a8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd066d9d700 1 --2- 172.21.15.60:0/3061746674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0680b01a0 0x7fd0680a8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd066d9d700 1 -- 172.21.15.60:0/3061746674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd068141660 con 0x7fd0680afdc0 2020-10-31T22:41:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd066d9d700 1 --2- 172.21.15.60:0/3061746674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680afdc0 0x7fd06813d710 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fd0680ae670 tx=0x7fd058007e30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd05ffff700 1 -- 172.21.15.60:0/3061746674 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd05800ce10 con 0x7fd0680afdc0 2020-10-31T22:41:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd05ffff700 1 -- 172.21.15.60:0/3061746674 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd058005a40 con 0x7fd0680afdc0 2020-10-31T22:41:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd06c91e700 1 -- 172.21.15.60:0/3061746674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd068141900 con 0x7fd0680afdc0 2020-10-31T22:41:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd05ffff700 1 -- 172.21.15.60:0/3061746674 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd058005da0 con 0x7fd0680afdc0 2020-10-31T22:41:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd06c91e700 1 -- 172.21.15.60:0/3061746674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0680a9460 con 0x7fd0680afdc0 2020-10-31T22:41:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.247+0000 7fd06c91e700 1 -- 172.21.15.60:0/3061746674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0680a9a90 con 0x7fd0680afdc0 2020-10-31T22:41:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.251+0000 7fd05ffff700 1 -- 172.21.15.60:0/3061746674 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd058010070 con 0x7fd0680afdc0 2020-10-31T22:41:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.251+0000 7fd05ffff700 1 --2- 172.21.15.60:0/3061746674 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd04c054f30 0x7fd04c0573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.251+0000 7fd05ffff700 1 -- 172.21.15.60:0/3061746674 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd05806d5d0 con 0x7fd0680afdc0 2020-10-31T22:41:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.251+0000 7fd06659c700 1 --2- 172.21.15.60:0/3061746674 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd04c054f30 0x7fd04c0573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.251+0000 7fd06659c700 1 --2- 172.21.15.60:0/3061746674 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd04c054f30 0x7fd04c0573f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fd05000c000 tx=0x7fd050008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.255+0000 7fd05ffff700 1 -- 172.21.15.60:0/3061746674 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd058043af0 con 0x7fd0680afdc0 2020-10-31T22:41:49.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.439+0000 7fd06c91e700 1 -- 172.21.15.60:0/3061746674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd068130b30 con 0x7fd0680afdc0 2020-10-31T22:41:49.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.539+0000 7fd05ffff700 1 -- 172.21.15.60:0/3061746674 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v11) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd058047110 con 0x7fd0680afdc0 2020-10-31T22:41:49.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.543+0000 7fd06c91e700 1 -- 172.21.15.60:0/3061746674 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd04c054f30 msgr2=0x7fd04c0573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:49.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.543+0000 7fd06c91e700 1 --2- 172.21.15.60:0/3061746674 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd04c054f30 0x7fd04c0573f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fd05000c000 tx=0x7fd050008040).stop 2020-10-31T22:41:49.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.543+0000 7fd06c91e700 1 -- 172.21.15.60:0/3061746674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680afdc0 msgr2=0x7fd06813d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:49.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.543+0000 7fd06c91e700 1 --2- 172.21.15.60:0/3061746674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680afdc0 0x7fd06813d710 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fd0680ae670 tx=0x7fd058007e30).stop 2020-10-31T22:41:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.543+0000 7fd06c91e700 1 -- 172.21.15.60:0/3061746674 shutdown_connections 2020-10-31T22:41:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.543+0000 7fd06c91e700 1 --2- 172.21.15.60:0/3061746674 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd06813dc00 0x7fd0680a8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.543+0000 7fd06c91e700 1 --2- 172.21.15.60:0/3061746674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0680afdc0 0x7fd06813d710 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.543+0000 7fd06c91e700 1 --2- 172.21.15.60:0/3061746674 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd04c054f30 0x7fd04c0573f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.543+0000 7fd06c91e700 1 --2- 172.21.15.60:0/3061746674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0680b01a0 0x7fd0680a8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.543+0000 7fd06c91e700 1 -- 172.21.15.60:0/3061746674 >> 172.21.15.60:0/3061746674 conn(0x7fd0680b3fd0 msgr2=0x7fd06813f020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:49.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.543+0000 7fd06c91e700 1 -- 172.21.15.60:0/3061746674 shutdown_connections 2020-10-31T22:41:49.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.543+0000 7fd06c91e700 1 -- 172.21.15.60:0/3061746674 wait complete. 2020-10-31T22:41:49.562 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:41:49.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c7326700 1 Processor -- start 2020-10-31T22:41:49.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c7326700 1 -- start start 2020-10-31T22:41:49.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c7326700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb7c00af520 0x7fb7c00ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c7326700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb7c00670f0 0x7fb7c0150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c7326700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7c00af900 con 0x7fb7c0066c90 2020-10-31T22:41:49.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c7326700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7c00afc10 con 0x7fb7c00af520 2020-10-31T22:41:49.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c7326700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c005bb70 con 0x7fb7c00670f0 2020-10-31T22:41:49.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5b23700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb7c0066c90 0x7fb7c0146060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46792/0 (socket says 172.21.15.60:46792) 2020-10-31T22:41:49.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5b23700 1 -- 172.21.15.60:0/3106913479 learned_addr learned my addr 172.21.15.60:0/3106913479 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:49.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c6b25700 1 --2- 172.21.15.60:0/3106913479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb7c00670f0 0x7fb7c0150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c6324700 1 --2- 172.21.15.60:0/3106913479 >> v2:172.21.15.66:3300/0 conn(0x7fb7c00af520 0x7fb7c00ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 -- 172.21.15.60:0/3106913479 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825630609 0 0) 0x7fb7c00af900 con 0x7fb7c0066c90 2020-10-31T22:41:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 -- 172.21.15.60:0/3106913479 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7a8003230 con 0x7fb7c0066c90 2020-10-31T22:41:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 -- 172.21.15.60:0/3106913479 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1198700127 0 0) 0x7fb7a8003230 con 0x7fb7c0066c90 2020-10-31T22:41:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 -- 172.21.15.60:0/3106913479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb7c00670f0 msgr2=0x7fb7c0150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 --2- 172.21.15.60:0/3106913479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb7c00670f0 0x7fb7c0150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 -- 172.21.15.60:0/3106913479 >> v2:172.21.15.66:3300/0 conn(0x7fb7c00af520 msgr2=0x7fb7c00ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:49.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 --2- 172.21.15.60:0/3106913479 >> v2:172.21.15.66:3300/0 conn(0x7fb7c00af520 0x7fb7c00ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 -- 172.21.15.60:0/3106913479 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c00ac130 con 0x7fb7c0066c90 2020-10-31T22:41:49.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 -- 172.21.15.60:0/3106913479 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fb7b00016d0 con 0x7fb7c0066c90 2020-10-31T22:41:49.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c6324700 1 --2- 172.21.15.60:0/3106913479 >> v2:172.21.15.66:3300/0 conn(0x7fb7c00af520 0x7fb7c00ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:49.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 -- 172.21.15.60:0/3106913479 >> v1:172.21.15.60:6789/0 conn(0x7fb7c0066c90 legacy=0x7fb7c0146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:49.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 --2- 172.21.15.60:0/3106913479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb7c00670f0 0x7fb7a8003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 --2- 172.21.15.60:0/3106913479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a8003c30 0x7fb7a80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 --2- 172.21.15.60:0/3106913479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7a80049c0 0x7fb7a8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 -- 172.21.15.60:0/3106913479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c00afc10 con 0x7fb7a8003c30 2020-10-31T22:41:49.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 -- 172.21.15.60:0/3106913479 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c005bb70 con 0x7fb7a80049c0 2020-10-31T22:41:49.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 -- 172.21.15.60:0/3106913479 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7a80041f0 con 0x7fb7c00670f0 2020-10-31T22:41:49.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5b23700 1 --2- 172.21.15.60:0/3106913479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a8003c30 0x7fb7a80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c6324700 1 --2- 172.21.15.60:0/3106913479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb7c00670f0 0x7fb7a8003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c6b25700 1 --2- 172.21.15.60:0/3106913479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7a80049c0 0x7fb7a8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5b23700 1 -- 172.21.15.60:0/3106913479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb7c00670f0 msgr2=0x7fb7a8003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:49.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5b23700 1 --2- 172.21.15.60:0/3106913479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb7c00670f0 0x7fb7a8003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5b23700 1 -- 172.21.15.60:0/3106913479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7a80049c0 msgr2=0x7fb7a8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:49.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5b23700 1 --2- 172.21.15.60:0/3106913479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7a80049c0 0x7fb7a8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5b23700 1 -- 172.21.15.60:0/3106913479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7a8003230 con 0x7fb7a8003c30 2020-10-31T22:41:49.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5b23700 1 --2- 172.21.15.60:0/3106913479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a8003c30 0x7fb7a80044d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fb7b00013e0 tx=0x7fb7b00077c0).ready entity=mon.0 client_cookie=57a9cc3c3a995f82 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:49.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 -- 172.21.15.60:0/3106913479 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7b00070d0 con 0x7fb7a8003c30 2020-10-31T22:41:49.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 -- 172.21.15.60:0/3106913479 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7b0007230 con 0x7fb7a8003c30 2020-10-31T22:41:49.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c5322700 1 -- 172.21.15.60:0/3106913479 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7b00055e0 con 0x7fb7a8003c30 2020-10-31T22:41:49.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c7326700 1 -- 172.21.15.60:0/3106913479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a8003c30 msgr2=0x7fb7a80044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:49.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.675+0000 7fb7c7326700 1 --2- 172.21.15.60:0/3106913479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7a8003c30 0x7fb7a80044d0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7fb7b00013e0 tx=0x7fb7b00077c0).stop 2020-10-31T22:41:49.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.679+0000 7fb7c6b25700 1 -- 172.21.15.60:0/3106913479 reap_dead start 2020-10-31T22:41:49.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.679+0000 7fb7c7326700 1 -- 172.21.15.60:0/3106913479 shutdown_connections 2020-10-31T22:41:49.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.679+0000 7fb7c7326700 1 -- 172.21.15.60:0/3106913479 >> 172.21.15.60:0/3106913479 conn(0x7fb7c00b3fd0 msgr2=0x7fb7c00b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:49.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.679+0000 7fb7c7326700 1 -- 172.21.15.60:0/3106913479 shutdown_connections 2020-10-31T22:41:49.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.679+0000 7fb7c7326700 1 -- 172.21.15.60:0/3106913479 wait complete. 2020-10-31T22:41:49.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.679+0000 7fb7c7326700 1 Processor -- start 2020-10-31T22:41:49.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.679+0000 7fb7c7326700 1 -- start start 2020-10-31T22:41:49.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c7326700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7c01482b0 0x7fb7c0145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c7326700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7c01497e0 0x7fb7c0145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c7326700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb7c0149290 0x7fb7c0154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c7326700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0148690 con 0x7fb7c01482b0 2020-10-31T22:41:49.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c7326700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0145d50 con 0x7fb7c01497e0 2020-10-31T22:41:49.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c7326700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0149d10 con 0x7fb7c0149290 2020-10-31T22:41:49.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c6324700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7c01482b0 0x7fb7c0145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c6324700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7c01482b0 0x7fb7c0145370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42666/0 (socket says 172.21.15.60:42666) 2020-10-31T22:41:49.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c6324700 1 -- 172.21.15.60:0/2812055349 learned_addr learned my addr 172.21.15.60:0/2812055349 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:49.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c6b25700 1 --2- 172.21.15.60:0/2812055349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb7c0149290 0x7fb7c0154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c5b23700 1 --2- 172.21.15.60:0/2812055349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7c01497e0 0x7fb7c0145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c6324700 1 -- 172.21.15.60:0/2812055349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb7c0149290 msgr2=0x7fb7c0154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:49.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c6324700 1 --2- 172.21.15.60:0/2812055349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb7c0149290 0x7fb7c0154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c6324700 1 -- 172.21.15.60:0/2812055349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7c01497e0 msgr2=0x7fb7c0145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:49.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c6324700 1 --2- 172.21.15.60:0/2812055349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7c01497e0 0x7fb7c0145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c6324700 1 -- 172.21.15.60:0/2812055349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c0062fb0 con 0x7fb7c01482b0 2020-10-31T22:41:49.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c6324700 1 --2- 172.21.15.60:0/2812055349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7c01482b0 0x7fb7c0145370 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fb7bc008000 tx=0x7fb7bc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:49.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7af7fe700 1 -- 172.21.15.60:0/2812055349 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7bc00fab0 con 0x7fb7c01482b0 2020-10-31T22:41:49.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7af7fe700 1 -- 172.21.15.60:0/2812055349 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7bc00fc10 con 0x7fb7c01482b0 2020-10-31T22:41:49.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c7326700 1 -- 172.21.15.60:0/2812055349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c0063250 con 0x7fb7c01482b0 2020-10-31T22:41:49.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7af7fe700 1 -- 172.21.15.60:0/2812055349 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7bc00fd80 con 0x7fb7c01482b0 2020-10-31T22:41:49.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c7326700 1 -- 172.21.15.60:0/2812055349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c0063990 con 0x7fb7c01482b0 2020-10-31T22:41:49.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7c7326700 1 -- 172.21.15.60:0/2812055349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c0057100 con 0x7fb7c01482b0 2020-10-31T22:41:49.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.683+0000 7fb7af7fe700 1 -- 172.21.15.60:0/2812055349 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb7bc014440 con 0x7fb7c01482b0 2020-10-31T22:41:49.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.687+0000 7fb7af7fe700 1 --2- 172.21.15.60:0/2812055349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb7a00550c0 0x7fb7a0057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:49.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.687+0000 7fb7af7fe700 1 -- 172.21.15.60:0/2812055349 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb7bc06e070 con 0x7fb7c01482b0 2020-10-31T22:41:49.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.687+0000 7fb7c5b23700 1 --2- 172.21.15.60:0/2812055349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb7a00550c0 0x7fb7a0057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:49.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.687+0000 7fb7c5b23700 1 --2- 172.21.15.60:0/2812055349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb7a00550c0 0x7fb7a0057580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fb7b0019000 tx=0x7fb7b0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:49.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.691+0000 7fb7af7fe700 1 -- 172.21.15.60:0/2812055349 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb7bc044420 con 0x7fb7c01482b0 2020-10-31T22:41:49.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.883+0000 7fb7c7326700 1 -- 172.21.15.60:0/2812055349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7c00afe20 con 0x7fb7c01482b0 2020-10-31T22:41:49.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.883+0000 7fb7af7fe700 1 -- 172.21.15.60:0/2812055349 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2489 (secure 0 0 0) 0x7fb7bc06b020 con 0x7fb7c01482b0 2020-10-31T22:41:49.888 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:49.888 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3880421132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3880421132},{"type":"v1","addr":"172.21.15.60:6835","nonce":3880421132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1151967847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1151967847},{"type":"v1","addr":"172.21.15.66:6833","nonce":1151967847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:41:48.523345+0000","modified":"2020-10-31T22:41:49.526988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4855":{"gid":4855,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2802890928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2802890928},{"type":"v1","addr":"172.21.15.60:6837","nonce":2802890928}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-10-31T22:41:49.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.887+0000 7fb7c7326700 1 -- 172.21.15.60:0/2812055349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb7a00550c0 msgr2=0x7fb7a0057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.887+0000 7fb7c7326700 1 --2- 172.21.15.60:0/2812055349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb7a00550c0 0x7fb7a0057580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7fb7b0019000 tx=0x7fb7b0015000).stop 2020-10-31T22:41:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.887+0000 7fb7c7326700 1 -- 172.21.15.60:0/2812055349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7c01482b0 msgr2=0x7fb7c0145370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.887+0000 7fb7c7326700 1 --2- 172.21.15.60:0/2812055349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7c01482b0 0x7fb7c0145370 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fb7bc008000 tx=0x7fb7bc008040).stop 2020-10-31T22:41:49.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.887+0000 7fb7c7326700 1 -- 172.21.15.60:0/2812055349 shutdown_connections 2020-10-31T22:41:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.887+0000 7fb7c7326700 1 --2- 172.21.15.60:0/2812055349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb7c0149290 0x7fb7c0154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.887+0000 7fb7c7326700 1 --2- 172.21.15.60:0/2812055349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb7c01482b0 0x7fb7c0145370 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.887+0000 7fb7c7326700 1 --2- 172.21.15.60:0/2812055349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb7a00550c0 0x7fb7a0057580 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.887+0000 7fb7c7326700 1 --2- 172.21.15.60:0/2812055349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb7c01497e0 0x7fb7c0145860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:49.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.887+0000 7fb7c7326700 1 -- 172.21.15.60:0/2812055349 >> 172.21.15.60:0/2812055349 conn(0x7fb7c00b3fd0 msgr2=0x7fb7c00b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:49.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.887+0000 7fb7c7326700 1 -- 172.21.15.60:0/2812055349 shutdown_connections 2020-10-31T22:41:49.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:49.887+0000 7fb7c7326700 1 -- 172.21.15.60:0/2812055349 wait complete. 2020-10-31T22:41:49.896 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2020-10-31T22:41:49.906 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:50.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6f22a700 1 Processor -- start 2020-10-31T22:41:50.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6f22a700 1 -- start start 2020-10-31T22:41:50.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6f22a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6805c4c0 0x7f9c6805c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6f22a700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9c680b2e20 0x7f9c68146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6f22a700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c68065e90 con 0x7f9c680b4410 2020-10-31T22:41:50.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6f22a700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c68141ef0 con 0x7f9c680b2e20 2020-10-31T22:41:50.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6f22a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c68066130 con 0x7f9c6805c4c0 2020-10-31T22:41:50.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6cfc6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6805c4c0 0x7f9c6805c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c67fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9c680b2e20 0x7f9c68146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c67fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9c680b2e20 0x7f9c68146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:53612/0 (socket says 172.21.15.60:53612) 2020-10-31T22:41:50.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6cfc6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6805c4c0 0x7f9c6805c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:55862/0 (socket says 172.21.15.60:55862) 2020-10-31T22:41:50.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c67fff700 1 -- 172.21.15.60:0/2292931989 learned_addr learned my addr 172.21.15.60:0/2292931989 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:50.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6cfc6700 1 -- 172.21.15.60:0/2292931989 >> v2:172.21.15.66:3300/0 conn(0x7f9c680b2e20 msgr2=0x7f9c68146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:50.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6cfc6700 1 --2- 172.21.15.60:0/2292931989 >> v2:172.21.15.66:3300/0 conn(0x7f9c680b2e20 0x7f9c68146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6cfc6700 1 -- 172.21.15.60:0/2292931989 >> v1:172.21.15.66:6789/0 conn(0x7f9c680b4410 legacy=0x7f9c6813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6cfc6700 1 -- 172.21.15.60:0/2292931989 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c680663d0 con 0x7f9c6805c4c0 2020-10-31T22:41:50.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c67fff700 1 --2- 172.21.15.60:0/2292931989 >> v2:172.21.15.66:3300/0 conn(0x7f9c680b2e20 0x7f9c68146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:50.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6cfc6700 1 --2- 172.21.15.60:0/2292931989 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6805c4c0 0x7f9c6805c8a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9c50002f30 tx=0x7f9c50006dc0).ready entity=mon.2 client_cookie=9edbf0f5f7e3f79a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:50.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c677fe700 1 -- 172.21.15.60:0/2292931989 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c50009760 con 0x7f9c6805c4c0 2020-10-31T22:41:50.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c677fe700 1 -- 172.21.15.60:0/2292931989 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c500098c0 con 0x7f9c6805c4c0 2020-10-31T22:41:50.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c677fe700 1 -- 172.21.15.60:0/2292931989 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c50009c20 con 0x7f9c6805c4c0 2020-10-31T22:41:50.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6f22a700 1 -- 172.21.15.60:0/2292931989 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6805c4c0 msgr2=0x7f9c6805c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6f22a700 1 --2- 172.21.15.60:0/2292931989 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6805c4c0 0x7f9c6805c8a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f9c50002f30 tx=0x7f9c50006dc0).stop 2020-10-31T22:41:50.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6f22a700 1 -- 172.21.15.60:0/2292931989 shutdown_connections 2020-10-31T22:41:50.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6f22a700 1 --2- 172.21.15.60:0/2292931989 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6805c4c0 0x7f9c6805c8a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6f22a700 1 --2- 172.21.15.60:0/2292931989 >> v2:172.21.15.66:3300/0 conn(0x7f9c680b2e20 0x7f9c68146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.011+0000 7f9c6f22a700 1 -- 172.21.15.60:0/2292931989 >> 172.21.15.60:0/2292931989 conn(0x7f9c680601e0 msgr2=0x7f9c6805b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:50.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c6f22a700 1 -- 172.21.15.60:0/2292931989 shutdown_connections 2020-10-31T22:41:50.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c6f22a700 1 -- 172.21.15.60:0/2292931989 wait complete. 2020-10-31T22:41:50.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c6f22a700 1 Processor -- start 2020-10-31T22:41:50.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c6f22a700 1 -- start start 2020-10-31T22:41:50.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c6f22a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6805c4c0 0x7f9c681445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c6f22a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c680b4410 0x7f9c680ac1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c6f22a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c680adb00 0x7f9c681513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c6f22a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680ac6b0 con 0x7f9c680b4410 2020-10-31T22:41:50.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c6f22a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c68144ef0 con 0x7f9c680adb00 2020-10-31T22:41:50.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c6f22a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c680ae010 con 0x7f9c6805c4c0 2020-10-31T22:41:50.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c67fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c680b4410 0x7f9c680ac1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c67fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c680b4410 0x7f9c680ac1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42680/0 (socket says 172.21.15.60:42680) 2020-10-31T22:41:50.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c67fff700 1 -- 172.21.15.60:0/3835430387 learned_addr learned my addr 172.21.15.60:0/3835430387 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:50.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c6cfc6700 1 --2- 172.21.15.60:0/3835430387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6805c4c0 0x7f9c681445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c6d7c7700 1 --2- 172.21.15.60:0/3835430387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c680adb00 0x7f9c681513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c67fff700 1 -- 172.21.15.60:0/3835430387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6805c4c0 msgr2=0x7f9c681445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c67fff700 1 --2- 172.21.15.60:0/3835430387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6805c4c0 0x7f9c681445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c67fff700 1 -- 172.21.15.60:0/3835430387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c680adb00 msgr2=0x7f9c681513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c67fff700 1 --2- 172.21.15.60:0/3835430387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c680adb00 0x7f9c681513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.015+0000 7f9c67fff700 1 -- 172.21.15.60:0/3835430387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c680ae2b0 con 0x7f9c680b4410 2020-10-31T22:41:50.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.019+0000 7f9c67fff700 1 --2- 172.21.15.60:0/3835430387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c680b4410 0x7f9c680ac1c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f9c6000c000 tx=0x7f9c60009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:50.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.019+0000 7f9c65ffb700 1 -- 172.21.15.60:0/3835430387 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c6000cb50 con 0x7f9c680b4410 2020-10-31T22:41:50.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.019+0000 7f9c65ffb700 1 -- 172.21.15.60:0/3835430387 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6000ccb0 con 0x7f9c680b4410 2020-10-31T22:41:50.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.019+0000 7f9c6f22a700 1 -- 172.21.15.60:0/3835430387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c68150f00 con 0x7f9c680b4410 2020-10-31T22:41:50.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.019+0000 7f9c65ffb700 1 -- 172.21.15.60:0/3835430387 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c600125e0 con 0x7f9c680b4410 2020-10-31T22:41:50.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.019+0000 7f9c6f22a700 1 -- 172.21.15.60:0/3835430387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c681522c0 con 0x7f9c680b4410 2020-10-31T22:41:50.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.019+0000 7f9c6f22a700 1 -- 172.21.15.60:0/3835430387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c68057100 con 0x7f9c680b4410 2020-10-31T22:41:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.019+0000 7f9c65ffb700 1 -- 172.21.15.60:0/3835430387 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9c60012740 con 0x7f9c680b4410 2020-10-31T22:41:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.019+0000 7f9c65ffb700 1 --2- 172.21.15.60:0/3835430387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9c4c054f90 0x7f9c4c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.019+0000 7f9c65ffb700 1 -- 172.21.15.60:0/3835430387 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9c6006e560 con 0x7f9c680b4410 2020-10-31T22:41:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.019+0000 7f9c6cfc6700 1 --2- 172.21.15.60:0/3835430387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9c4c054f90 0x7f9c4c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.019+0000 7f9c6cfc6700 1 --2- 172.21.15.60:0/3835430387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9c4c054f90 0x7f9c4c057450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f9c5001a000 tx=0x7f9c50015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:50.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.027+0000 7f9c65ffb700 1 -- 172.21.15.60:0/3835430387 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9c600449e0 con 0x7f9c680b4410 2020-10-31T22:41:50.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.171+0000 7f9c6f22a700 1 -- 172.21.15.60:0/3835430387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c6805aa70 con 0x7f9c680b4410 2020-10-31T22:41:50.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.175+0000 7f9c65ffb700 1 -- 172.21.15.60:0/3835430387 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16038 (secure 0 0 0) 0x7f9c60048000 con 0x7f9c680b4410 2020-10-31T22:41:50.176 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:50.177 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":33,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:49.525944+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:46.258748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:47.507555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:50.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.175+0000 7f9c6f22a700 1 -- 172.21.15.60:0/3835430387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9c4c054f90 msgr2=0x7f9c4c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.175+0000 7f9c6f22a700 1 --2- 172.21.15.60:0/3835430387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9c4c054f90 0x7f9c4c057450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f9c5001a000 tx=0x7f9c50015000).stop 2020-10-31T22:41:50.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.175+0000 7f9c6f22a700 1 -- 172.21.15.60:0/3835430387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c680b4410 msgr2=0x7f9c680ac1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.175+0000 7f9c6f22a700 1 --2- 172.21.15.60:0/3835430387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c680b4410 0x7f9c680ac1c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f9c6000c000 tx=0x7f9c60009270).stop 2020-10-31T22:41:50.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.175+0000 7f9c6f22a700 1 -- 172.21.15.60:0/3835430387 shutdown_connections 2020-10-31T22:41:50.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.175+0000 7f9c6f22a700 1 --2- 172.21.15.60:0/3835430387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9c4c054f90 0x7f9c4c057450 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.175+0000 7f9c6f22a700 1 --2- 172.21.15.60:0/3835430387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c680adb00 0x7f9c681513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.175+0000 7f9c6f22a700 1 --2- 172.21.15.60:0/3835430387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c6805c4c0 0x7f9c681445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.175+0000 7f9c6f22a700 1 --2- 172.21.15.60:0/3835430387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c680b4410 0x7f9c680ac1c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.175+0000 7f9c6f22a700 1 -- 172.21.15.60:0/3835430387 >> 172.21.15.60:0/3835430387 conn(0x7f9c680601e0 msgr2=0x7f9c680b84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:50.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.175+0000 7f9c6f22a700 1 -- 172.21.15.60:0/3835430387 shutdown_connections 2020-10-31T22:41:50.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.175+0000 7f9c6f22a700 1 -- 172.21.15.60:0/3835430387 wait complete. 2020-10-31T22:41:50.195 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:41:50.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2ee915d700 1 Processor -- start 2020-10-31T22:41:50.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2ee915d700 1 -- start start 2020-10-31T22:41:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2ee915d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ee40803e0 0x7f2ee415a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2ee915d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee40b1950 con 0x7f2ee40256a0 2020-10-31T22:41:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2ee915d700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ee4062720 con 0x7f2ee40b1570 2020-10-31T22:41:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2ee915d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee4080870 con 0x7f2ee40803e0 2020-10-31T22:41:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2edbfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2ee40256a0 0x7f2ee407fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46824/0 (socket says 172.21.15.60:46824) 2020-10-31T22:41:50.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2edbfff700 1 -- 172.21.15.60:0/258620554 learned_addr learned my addr 172.21.15.60:0/258620554 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:50.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2eea3bf700 1 --2- 172.21.15.60:0/258620554 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ee40803e0 0x7f2ee415a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2edb7fe700 1 -- 172.21.15.60:0/258620554 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341726126 0 0) 0x7f2ee40b1950 con 0x7f2ee40256a0 2020-10-31T22:41:50.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2edb7fe700 1 -- 172.21.15.60:0/258620554 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ecc003230 con 0x7f2ee40256a0 2020-10-31T22:41:50.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2edb7fe700 1 -- 172.21.15.60:0/258620554 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1978731545 0 0) 0x7f2ee4062720 con 0x7f2ee40b1570 2020-10-31T22:41:50.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2edb7fe700 1 -- 172.21.15.60:0/258620554 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ee40b1950 con 0x7f2ee40b1570 2020-10-31T22:41:50.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2eea3bf700 1 -- 172.21.15.60:0/258620554 >> v1:172.21.15.66:6789/0 conn(0x7f2ee40b1570 legacy=0x7f2ee4024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2eea3bf700 1 -- 172.21.15.60:0/258620554 >> v1:172.21.15.60:6789/0 conn(0x7f2ee40256a0 legacy=0x7f2ee407fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2eea3bf700 1 -- 172.21.15.60:0/258620554 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee4066cb0 con 0x7f2ee40803e0 2020-10-31T22:41:50.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2eea3bf700 1 --2- 172.21.15.60:0/258620554 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ee40803e0 0x7f2ee415a220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2edc0032b0 tx=0x7f2edc0091a0).ready entity=mon.2 client_cookie=b08d80ccf1d2e48c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:50.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2edb7fe700 1 -- 172.21.15.60:0/258620554 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2edc00b940 con 0x7f2ee40803e0 2020-10-31T22:41:50.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2edb7fe700 1 -- 172.21.15.60:0/258620554 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc00baa0 con 0x7f2ee40803e0 2020-10-31T22:41:50.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2edb7fe700 1 -- 172.21.15.60:0/258620554 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2edc00bc10 con 0x7f2ee40803e0 2020-10-31T22:41:50.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2ee915d700 1 -- 172.21.15.60:0/258620554 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ee40803e0 msgr2=0x7f2ee415a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.319+0000 7f2ee915d700 1 --2- 172.21.15.60:0/258620554 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ee40803e0 0x7f2ee415a220 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2edc0032b0 tx=0x7f2edc0091a0).stop 2020-10-31T22:41:50.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2ee915d700 1 -- 172.21.15.60:0/258620554 shutdown_connections 2020-10-31T22:41:50.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2ee915d700 1 --2- 172.21.15.60:0/258620554 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ee40803e0 0x7f2ee415a220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2ee915d700 1 -- 172.21.15.60:0/258620554 >> 172.21.15.60:0/258620554 conn(0x7f2ee40b5440 msgr2=0x7f2ee40b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:50.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2ee915d700 1 -- 172.21.15.60:0/258620554 shutdown_connections 2020-10-31T22:41:50.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2ee915d700 1 -- 172.21.15.60:0/258620554 wait complete. 2020-10-31T22:41:50.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2ee915d700 1 Processor -- start 2020-10-31T22:41:50.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2ee915d700 1 -- start start 2020-10-31T22:41:50.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2ee915d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ee40256a0 0x7f2ee412fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2ee915d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ee40803e0 0x7f2ee407e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2ee915d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee40b1570 0x7f2ee41402b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2ee915d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee412d580 con 0x7f2ee40b1570 2020-10-31T22:41:50.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2ee915d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee413fe80 con 0x7f2ee40256a0 2020-10-31T22:41:50.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2ee915d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ee40b3730 con 0x7f2ee40803e0 2020-10-31T22:41:50.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2eea3bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee40b1570 0x7f2ee41402b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2eea3bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee40b1570 0x7f2ee41402b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42696/0 (socket says 172.21.15.60:42696) 2020-10-31T22:41:50.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.323+0000 7f2eea3bf700 1 -- 172.21.15.60:0/496025979 learned_addr learned my addr 172.21.15.60:0/496025979 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:50.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2edbfff700 1 --2- 172.21.15.60:0/496025979 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ee40803e0 0x7f2ee407e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2ee895c700 1 --2- 172.21.15.60:0/496025979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ee40256a0 0x7f2ee412fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2eea3bf700 1 -- 172.21.15.60:0/496025979 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ee40803e0 msgr2=0x7f2ee407e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2eea3bf700 1 --2- 172.21.15.60:0/496025979 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ee40803e0 0x7f2ee407e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2eea3bf700 1 -- 172.21.15.60:0/496025979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ee40256a0 msgr2=0x7f2ee412fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2eea3bf700 1 --2- 172.21.15.60:0/496025979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ee40256a0 0x7f2ee412fbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2eea3bf700 1 -- 172.21.15.60:0/496025979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee40b39d0 con 0x7f2ee40b1570 2020-10-31T22:41:50.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2eea3bf700 1 --2- 172.21.15.60:0/496025979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee40b1570 0x7f2ee41402b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f2edc0032b0 tx=0x7f2edc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:50.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2ed97fa700 1 -- 172.21.15.60:0/496025979 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2edc011d70 con 0x7f2ee40b1570 2020-10-31T22:41:50.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2ee915d700 1 -- 172.21.15.60:0/496025979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ee40b3c70 con 0x7f2ee40b1570 2020-10-31T22:41:50.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2ee915d700 1 -- 172.21.15.60:0/496025979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ee407e9e0 con 0x7f2ee40b1570 2020-10-31T22:41:50.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2ed97fa700 1 -- 172.21.15.60:0/496025979 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2edc0283f0 con 0x7f2ee40b1570 2020-10-31T22:41:50.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2ed97fa700 1 -- 172.21.15.60:0/496025979 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2edc028750 con 0x7f2ee40b1570 2020-10-31T22:41:50.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2ee915d700 1 -- 172.21.15.60:0/496025979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ebc003340 con 0x7f2ee40b1570 2020-10-31T22:41:50.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2ed97fa700 1 -- 172.21.15.60:0/496025979 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2edc00f070 con 0x7f2ee40b1570 2020-10-31T22:41:50.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.327+0000 7f2ed97fa700 1 --2- 172.21.15.60:0/496025979 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ec40571a0 0x7f2ec4059660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.331+0000 7f2ed97fa700 1 -- 172.21.15.60:0/496025979 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2edc06e270 con 0x7f2ee40b1570 2020-10-31T22:41:50.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.331+0000 7f2ee895c700 1 --2- 172.21.15.60:0/496025979 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ec40571a0 0x7f2ec4059660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.331+0000 7f2ee895c700 1 --2- 172.21.15.60:0/496025979 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ec40571a0 0x7f2ec4059660 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f2ee000d000 tx=0x7f2ee0007940).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:50.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.335+0000 7f2ed97fa700 1 -- 172.21.15.60:0/496025979 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2edc044690 con 0x7f2ee40b1570 2020-10-31T22:41:50.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.523+0000 7f2ee915d700 1 -- 172.21.15.60:0/496025979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f2ebc002280 con 0x7f2ee40b1570 2020-10-31T22:41:50.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.527+0000 7f2ed97fa700 1 -- 172.21.15.60:0/496025979 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v11) v1 ==== 184+0+0 (secure 0 0 0) 0x7f2edc047cb0 con 0x7f2ee40b1570 2020-10-31T22:41:50.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.531+0000 7f2ee915d700 1 -- 172.21.15.60:0/496025979 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ec40571a0 msgr2=0x7f2ec4059660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.531+0000 7f2ee915d700 1 --2- 172.21.15.60:0/496025979 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ec40571a0 0x7f2ec4059660 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f2ee000d000 tx=0x7f2ee0007940).stop 2020-10-31T22:41:50.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.531+0000 7f2ee915d700 1 -- 172.21.15.60:0/496025979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee40b1570 msgr2=0x7f2ee41402b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.531+0000 7f2ee915d700 1 --2- 172.21.15.60:0/496025979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee40b1570 0x7f2ee41402b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f2edc0032b0 tx=0x7f2edc016000).stop 2020-10-31T22:41:50.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.531+0000 7f2ee915d700 1 -- 172.21.15.60:0/496025979 shutdown_connections 2020-10-31T22:41:50.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.531+0000 7f2ee915d700 1 --2- 172.21.15.60:0/496025979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ee40b1570 0x7f2ee41402b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.531+0000 7f2ee915d700 1 --2- 172.21.15.60:0/496025979 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ec40571a0 0x7f2ec4059660 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.531+0000 7f2ee915d700 1 --2- 172.21.15.60:0/496025979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ee40256a0 0x7f2ee412fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.531+0000 7f2ee915d700 1 --2- 172.21.15.60:0/496025979 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ee40803e0 0x7f2ee407e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.531+0000 7f2ee915d700 1 -- 172.21.15.60:0/496025979 >> 172.21.15.60:0/496025979 conn(0x7f2ee40b5440 msgr2=0x7f2ee40ae400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:50.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.531+0000 7f2ee915d700 1 -- 172.21.15.60:0/496025979 shutdown_connections 2020-10-31T22:41:50.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.531+0000 7f2ee915d700 1 -- 172.21.15.60:0/496025979 wait complete. 2020-10-31T22:41:50.537 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2020-10-31T22:41:50.555 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:41:50.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.675+0000 7f1116960700 1 Processor -- start 2020-10-31T22:41:50.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.675+0000 7f1116960700 1 -- start start 2020-10-31T22:41:50.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f11100b1570 0x7f1110024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1110025480 0x7f111007fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11100801c0 0x7f11100afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11100b1950 con 0x7f1110025480 2020-10-31T22:41:50.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1110025910 con 0x7f11100b1570 2020-10-31T22:41:50.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1110062720 con 0x7f11100801c0 2020-10-31T22:41:50.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f111595e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1110025480 0x7f111007fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f111595e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1110025480 0x7f111007fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42700/0 (socket says 172.21.15.60:42700) 2020-10-31T22:41:50.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f111595e700 1 -- 172.21.15.60:0/507630174 learned_addr learned my addr 172.21.15.60:0/507630174 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:50.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f111615f700 1 --2- 172.21.15.60:0/507630174 >> v2:172.21.15.66:3300/0 conn(0x7f11100b1570 0x7f1110024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1117bc2700 1 --2- 172.21.15.60:0/507630174 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11100801c0 0x7f11100afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f111595e700 1 -- 172.21.15.60:0/507630174 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11100801c0 msgr2=0x7f11100afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:50.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f111595e700 1 --2- 172.21.15.60:0/507630174 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11100801c0 0x7f11100afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f111595e700 1 -- 172.21.15.60:0/507630174 >> v2:172.21.15.66:3300/0 conn(0x7f11100b1570 msgr2=0x7f1110024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:50.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f111595e700 1 --2- 172.21.15.60:0/507630174 >> v2:172.21.15.66:3300/0 conn(0x7f11100b1570 0x7f1110024f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f111595e700 1 -- 172.21.15.60:0/507630174 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1110066cb0 con 0x7f1110025480 2020-10-31T22:41:50.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f111615f700 1 --2- 172.21.15.60:0/507630174 >> v2:172.21.15.66:3300/0 conn(0x7f11100b1570 0x7f1110024f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:50.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f111595e700 1 --2- 172.21.15.60:0/507630174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1110025480 0x7f111007fcd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f1100002f30 tx=0x7f1100006e80).ready entity=mon.0 client_cookie=b0032db50151970e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:50.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f111515d700 1 -- 172.21.15.60:0/507630174 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11000097f0 con 0x7f1110025480 2020-10-31T22:41:50.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f111515d700 1 -- 172.21.15.60:0/507630174 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1100009950 con 0x7f1110025480 2020-10-31T22:41:50.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f111515d700 1 -- 172.21.15.60:0/507630174 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1100009cb0 con 0x7f1110025480 2020-10-31T22:41:50.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 -- 172.21.15.60:0/507630174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1110025480 msgr2=0x7f111007fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 --2- 172.21.15.60:0/507630174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1110025480 0x7f111007fcd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f1100002f30 tx=0x7f1100006e80).stop 2020-10-31T22:41:50.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 -- 172.21.15.60:0/507630174 shutdown_connections 2020-10-31T22:41:50.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 --2- 172.21.15.60:0/507630174 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11100801c0 0x7f11100afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 --2- 172.21.15.60:0/507630174 >> v2:172.21.15.66:3300/0 conn(0x7f11100b1570 0x7f1110024f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 --2- 172.21.15.60:0/507630174 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1110025480 0x7f111007fcd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 -- 172.21.15.60:0/507630174 >> 172.21.15.60:0/507630174 conn(0x7f11100b5440 msgr2=0x7f11100b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:50.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 -- 172.21.15.60:0/507630174 shutdown_connections 2020-10-31T22:41:50.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.679+0000 7f1116960700 1 -- 172.21.15.60:0/507630174 wait complete. 2020-10-31T22:41:50.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1116960700 1 Processor -- start 2020-10-31T22:41:50.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1116960700 1 -- start start 2020-10-31T22:41:50.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1116960700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1110025480 0x7f1110130b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1116960700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11100801c0 0x7f1110141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1116960700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11100b1570 0x7f111013e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1116960700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1110141f80 con 0x7f11100801c0 2020-10-31T22:41:50.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1116960700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11100660d0 con 0x7f11100b1570 2020-10-31T22:41:50.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1116960700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1110066370 con 0x7f1110025480 2020-10-31T22:41:50.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f111595e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11100801c0 0x7f1110141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f111595e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11100801c0 0x7f1110141a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42708/0 (socket says 172.21.15.60:42708) 2020-10-31T22:41:50.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f111595e700 1 -- 172.21.15.60:0/3489956335 learned_addr learned my addr 172.21.15.60:0/3489956335 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:50.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f111615f700 1 --2- 172.21.15.60:0/3489956335 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1110025480 0x7f1110130b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1117bc2700 1 --2- 172.21.15.60:0/3489956335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11100b1570 0x7f111013e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f111595e700 1 -- 172.21.15.60:0/3489956335 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1110025480 msgr2=0x7f1110130b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f111595e700 1 --2- 172.21.15.60:0/3489956335 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1110025480 0x7f1110130b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f111595e700 1 -- 172.21.15.60:0/3489956335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11100b1570 msgr2=0x7f111013e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f111595e700 1 --2- 172.21.15.60:0/3489956335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11100b1570 0x7f111013e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f111595e700 1 -- 172.21.15.60:0/3489956335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111013dbd0 con 0x7f11100801c0 2020-10-31T22:41:50.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f111595e700 1 --2- 172.21.15.60:0/3489956335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11100801c0 0x7f1110141a90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f1100002f30 tx=0x7f1100015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:50.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1106ffd700 1 -- 172.21.15.60:0/3489956335 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1100011ca0 con 0x7f11100801c0 2020-10-31T22:41:50.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1106ffd700 1 -- 172.21.15.60:0/3489956335 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1100011e00 con 0x7f11100801c0 2020-10-31T22:41:50.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1116960700 1 -- 172.21.15.60:0/3489956335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1110066610 con 0x7f11100801c0 2020-10-31T22:41:50.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1106ffd700 1 -- 172.21.15.60:0/3489956335 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f110001e650 con 0x7f11100801c0 2020-10-31T22:41:50.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1116960700 1 -- 172.21.15.60:0/3489956335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1110065bc0 con 0x7f11100801c0 2020-10-31T22:41:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1116960700 1 -- 172.21.15.60:0/3489956335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111013dd60 con 0x7f11100801c0 2020-10-31T22:41:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.683+0000 7f1106ffd700 1 -- 172.21.15.60:0/3489956335 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1100025030 con 0x7f11100801c0 2020-10-31T22:41:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.687+0000 7f1106ffd700 1 --2- 172.21.15.60:0/3489956335 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f10f8054f90 0x7f10f8057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.687+0000 7f1106ffd700 1 -- 172.21.15.60:0/3489956335 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f110006ed40 con 0x7f11100801c0 2020-10-31T22:41:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.687+0000 7f111615f700 1 --2- 172.21.15.60:0/3489956335 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f10f8054f90 0x7f10f8057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.687+0000 7f111615f700 1 --2- 172.21.15.60:0/3489956335 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f10f8054f90 0x7f10f8057450 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f110c00d000 tx=0x7f110c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.695+0000 7f1106ffd700 1 -- 172.21.15.60:0/3489956335 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1100045260 con 0x7f11100801c0 2020-10-31T22:41:50.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.883+0000 7f1116960700 1 -- 172.21.15.60:0/3489956335 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1110057100 con 0x7f11100801c0 2020-10-31T22:41:50.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.891+0000 7f1106ffd700 1 -- 172.21.15.60:0/3489956335 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v12) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1100023070 con 0x7f11100801c0 2020-10-31T22:41:50.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.891+0000 7f1116960700 1 -- 172.21.15.60:0/3489956335 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f10f8054f90 msgr2=0x7f10f8057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.891+0000 7f1116960700 1 --2- 172.21.15.60:0/3489956335 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f10f8054f90 0x7f10f8057450 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f110c00d000 tx=0x7f110c008040).stop 2020-10-31T22:41:50.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.891+0000 7f1116960700 1 -- 172.21.15.60:0/3489956335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11100801c0 msgr2=0x7f1110141a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:50.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.891+0000 7f1116960700 1 --2- 172.21.15.60:0/3489956335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11100801c0 0x7f1110141a90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f1100002f30 tx=0x7f1100015000).stop 2020-10-31T22:41:50.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.891+0000 7f1116960700 1 -- 172.21.15.60:0/3489956335 shutdown_connections 2020-10-31T22:41:50.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.891+0000 7f1116960700 1 --2- 172.21.15.60:0/3489956335 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f10f8054f90 0x7f10f8057450 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.891+0000 7f1116960700 1 --2- 172.21.15.60:0/3489956335 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11100b1570 0x7f111013e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.891+0000 7f1116960700 1 --2- 172.21.15.60:0/3489956335 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1110025480 0x7f1110130b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.891+0000 7f1116960700 1 --2- 172.21.15.60:0/3489956335 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11100801c0 0x7f1110141a90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.891+0000 7f1116960700 1 -- 172.21.15.60:0/3489956335 >> 172.21.15.60:0/3489956335 conn(0x7f11100b5440 msgr2=0x7f11100b3e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.891+0000 7f1116960700 1 -- 172.21.15.60:0/3489956335 shutdown_connections 2020-10-31T22:41:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:50.891+0000 7f1116960700 1 -- 172.21.15.60:0/3489956335 wait complete. 2020-10-31T22:41:50.897 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.1 2020-10-31T22:41:50.910 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:41:51.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 Processor -- start 2020-10-31T22:41:51.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 -- start start 2020-10-31T22:41:51.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb5bc0b5570 0x7fb5bc0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:51.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5bc0b24a0 0x7fb5bc145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:51.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb5bc145d10 0x7fb5bc141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:51.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5bc0afae0 con 0x7fb5bc145d10 2020-10-31T22:41:51.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5bc141bf0 con 0x7fb5bc0b5570 2020-10-31T22:41:51.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc13f930 con 0x7fb5bc0b24a0 2020-10-31T22:41:51.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c20ac700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb5bc145d10 0x7fb5bc141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:51.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c20ac700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb5bc145d10 0x7fb5bc141fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42718/0 (socket says 172.21.15.60:42718) 2020-10-31T22:41:51.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c20ac700 1 -- 172.21.15.60:0/2774240064 learned_addr learned my addr 172.21.15.60:0/2774240064 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:51.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c10aa700 1 --2- 172.21.15.60:0/2774240064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5bc0b24a0 0x7fb5bc145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:51.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c18ab700 1 --2- 172.21.15.60:0/2774240064 >> v2:172.21.15.66:3300/0 conn(0x7fb5bc0b5570 0x7fb5bc0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:51.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c20ac700 1 -- 172.21.15.60:0/2774240064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5bc0b24a0 msgr2=0x7fb5bc145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:51.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c20ac700 1 --2- 172.21.15.60:0/2774240064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5bc0b24a0 0x7fb5bc145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c20ac700 1 -- 172.21.15.60:0/2774240064 >> v2:172.21.15.66:3300/0 conn(0x7fb5bc0b5570 msgr2=0x7fb5bc0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:51.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c20ac700 1 --2- 172.21.15.60:0/2774240064 >> v2:172.21.15.66:3300/0 conn(0x7fb5bc0b5570 0x7fb5bc0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c20ac700 1 -- 172.21.15.60:0/2774240064 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc145180 con 0x7fb5bc145d10 2020-10-31T22:41:51.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c18ab700 1 --2- 172.21.15.60:0/2774240064 >> v2:172.21.15.66:3300/0 conn(0x7fb5bc0b5570 0x7fb5bc0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:41:51.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c20ac700 1 --2- 172.21.15.60:0/2774240064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc145d10 0x7fb5bc141fe0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fb5bc061290 tx=0x7fb5b4009270).ready entity=mon.0 client_cookie=1ee6ccd10989de4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:51.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c08a9700 1 -- 172.21.15.60:0/2774240064 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b400bbc0 con 0x7fb5bc145d10 2020-10-31T22:41:51.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c08a9700 1 -- 172.21.15.60:0/2774240064 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b400bd20 con 0x7fb5bc145d10 2020-10-31T22:41:51.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c08a9700 1 -- 172.21.15.60:0/2774240064 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b400be90 con 0x7fb5bc145d10 2020-10-31T22:41:51.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2774240064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc145d10 msgr2=0x7fb5bc141fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:51.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 --2- 172.21.15.60:0/2774240064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc145d10 0x7fb5bc141fe0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fb5bc061290 tx=0x7fb5b4009270).stop 2020-10-31T22:41:51.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2774240064 shutdown_connections 2020-10-31T22:41:51.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 --2- 172.21.15.60:0/2774240064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc145d10 0x7fb5bc141fe0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 --2- 172.21.15.60:0/2774240064 >> v2:172.21.15.66:3300/0 conn(0x7fb5bc0b5570 0x7fb5bc0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 --2- 172.21.15.60:0/2774240064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5bc0b24a0 0x7fb5bc145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2774240064 >> 172.21.15.60:0/2774240064 conn(0x7fb5bc0b8e90 msgr2=0x7fb5bc0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:51.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2774240064 shutdown_connections 2020-10-31T22:41:51.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.039+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2774240064 wait complete. 2020-10-31T22:41:51.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c28ad700 1 Processor -- start 2020-10-31T22:41:51.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c28ad700 1 -- start start 2020-10-31T22:41:51.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c28ad700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5bc0b24a0 0x7fb5bc13cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:51.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c28ad700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0b5570 0x7fb5bc1508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:51.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c28ad700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5bc145d10 0x7fb5bc150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:51.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c28ad700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc0b65c0 con 0x7fb5bc0b5570 2020-10-31T22:41:51.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c28ad700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc13e790 con 0x7fb5bc145d10 2020-10-31T22:41:51.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c28ad700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5bc0b68f0 con 0x7fb5bc0b24a0 2020-10-31T22:41:51.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c10aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0b5570 0x7fb5bc1508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:51.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c10aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0b5570 0x7fb5bc1508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42722/0 (socket says 172.21.15.60:42722) 2020-10-31T22:41:51.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c10aa700 1 -- 172.21.15.60:0/2050846729 learned_addr learned my addr 172.21.15.60:0/2050846729 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:51.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c18ab700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5bc0b24a0 0x7fb5bc13cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:51.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c20ac700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5bc145d10 0x7fb5bc150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:51.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c10aa700 1 -- 172.21.15.60:0/2050846729 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5bc0b24a0 msgr2=0x7fb5bc13cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:51.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c10aa700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5bc0b24a0 0x7fb5bc13cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c10aa700 1 -- 172.21.15.60:0/2050846729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5bc145d10 msgr2=0x7fb5bc150db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:51.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c10aa700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5bc145d10 0x7fb5bc150db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c10aa700 1 -- 172.21.15.60:0/2050846729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5bc0b6b90 con 0x7fb5bc0b5570 2020-10-31T22:41:51.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c20ac700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5bc145d10 0x7fb5bc150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:41:51.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c10aa700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0b5570 0x7fb5bc1508c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fb5b0003070 tx=0x7fb5b0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:51.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5aeffd700 1 -- 172.21.15.60:0/2050846729 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b0009980 con 0x7fb5bc0b5570 2020-10-31T22:41:51.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5aeffd700 1 -- 172.21.15.60:0/2050846729 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5b0009ae0 con 0x7fb5bc0b5570 2020-10-31T22:41:51.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2050846729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5bc0b6e30 con 0x7fb5bc0b5570 2020-10-31T22:41:51.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5aeffd700 1 -- 172.21.15.60:0/2050846729 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5b0009e40 con 0x7fb5bc0b5570 2020-10-31T22:41:51.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.043+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2050846729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5bc1512a0 con 0x7fb5bc0b5570 2020-10-31T22:41:51.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.047+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2050846729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5bc0b63e0 con 0x7fb5bc0b5570 2020-10-31T22:41:51.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.047+0000 7fb5aeffd700 1 -- 172.21.15.60:0/2050846729 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb5b0013480 con 0x7fb5bc0b5570 2020-10-31T22:41:51.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.047+0000 7fb5aeffd700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb59c054f10 0x7fb59c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:51.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.047+0000 7fb5aeffd700 1 -- 172.21.15.60:0/2050846729 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb5b006e1a0 con 0x7fb5bc0b5570 2020-10-31T22:41:51.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.047+0000 7fb5c18ab700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb59c054f10 0x7fb59c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:51.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.047+0000 7fb5c18ab700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb59c054f10 0x7fb59c0573d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fb5b800b000 tx=0x7fb5b8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:51.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.051+0000 7fb5aeffd700 1 -- 172.21.15.60:0/2050846729 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb5b0044660 con 0x7fb5bc0b5570 2020-10-31T22:41:51.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.235+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2050846729 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5bc057100 con 0x7fb5bc0b5570 2020-10-31T22:41:51.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.235+0000 7fb5aeffd700 1 -- 172.21.15.60:0/2050846729 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2489 (secure 0 0 0) 0x7fb5b0047c80 con 0x7fb5bc0b5570 2020-10-31T22:41:51.239 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:51.239 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3880421132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3880421132},{"type":"v1","addr":"172.21.15.60:6835","nonce":3880421132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1151967847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1151967847},{"type":"v1","addr":"172.21.15.66:6833","nonce":1151967847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:41:48.523345+0000","modified":"2020-10-31T22:41:49.526988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4855":{"gid":4855,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2802890928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2802890928},{"type":"v1","addr":"172.21.15.60:6837","nonce":2802890928}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-10-31T22:41:51.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.239+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2050846729 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb59c054f10 msgr2=0x7fb59c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:51.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.239+0000 7fb5c28ad700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb59c054f10 0x7fb59c0573d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fb5b800b000 tx=0x7fb5b8008040).stop 2020-10-31T22:41:51.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.239+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2050846729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0b5570 msgr2=0x7fb5bc1508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:51.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.239+0000 7fb5c28ad700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0b5570 0x7fb5bc1508c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fb5b0003070 tx=0x7fb5b0008040).stop 2020-10-31T22:41:51.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.239+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2050846729 shutdown_connections 2020-10-31T22:41:51.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.239+0000 7fb5c28ad700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb59c054f10 0x7fb59c0573d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.239+0000 7fb5c28ad700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5bc145d10 0x7fb5bc150db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.239+0000 7fb5c28ad700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb5bc0b24a0 0x7fb5bc13cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.239+0000 7fb5c28ad700 1 --2- 172.21.15.60:0/2050846729 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb5bc0b5570 0x7fb5bc1508c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.239+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2050846729 >> 172.21.15.60:0/2050846729 conn(0x7fb5bc0b8e90 msgr2=0x7fb5bc05f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:51.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.239+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2050846729 shutdown_connections 2020-10-31T22:41:51.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.239+0000 7fb5c28ad700 1 -- 172.21.15.60:0/2050846729 wait complete. 2020-10-31T22:41:51.245 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2020-10-31T22:41:51.556 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:41:48.523345+0000', 'modified': '2020-10-31T22:41:49.526988+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4855}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4855': {'gid': 4855, 'name': 'a', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/2802890928', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 2802890928}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 2802890928}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:41:51.557 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:41:51.557 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-10-31T22:41:51.687 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":4855,"want_state":"up:active","state":"up:active","rank_uptime":3.1507836010000001,"mdsmap_epoch":11,"osdmap_epoch":33,"osdmap_epoch_barrier":33,"uptime":10.534830439} 2020-10-31T22:41:51.688 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 4855, "mdsmap_epoch": 11, "osdmap_epoch": 33, "osdmap_epoch_barrier": 33, "rank_uptime": 3.150783601, "state": "up:active", "uptime": 10.534830439, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:41:51.689 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:41:51.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd34d8ae700 1 Processor -- start 2020-10-31T22:41:51.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd34d8ae700 1 -- start start 2020-10-31T22:41:51.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd34d8ae700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd34805b960 0x7fd34805bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:51.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd34d8ae700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd3480a7850 0x7fd3480aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:51.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd34d8ae700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd3480aefe0 0x7fd348146790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:51.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd34d8ae700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3480b0f00 con 0x7fd3480a7850 2020-10-31T22:41:51.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd34d8ae700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3480b11a0 con 0x7fd3480aefe0 2020-10-31T22:41:51.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd34d8ae700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3480b1440 con 0x7fd34805b960 2020-10-31T22:41:51.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd33ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd3480a7850 0x7fd3480aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:51.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd33ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd3480a7850 0x7fd3480aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42730/0 (socket says 172.21.15.60:42730) 2020-10-31T22:41:51.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd33ffff700 1 -- 172.21.15.60:0/407198537 learned_addr learned my addr 172.21.15.60:0/407198537 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:51.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd346ffd700 1 --2- 172.21.15.60:0/407198537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd34805b960 0x7fd34805bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:51.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd3477fe700 1 --2- 172.21.15.60:0/407198537 >> v2:172.21.15.66:3300/0 conn(0x7fd3480aefe0 0x7fd348146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:51.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd33ffff700 1 -- 172.21.15.60:0/407198537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd34805b960 msgr2=0x7fd34805bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:51.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd33ffff700 1 --2- 172.21.15.60:0/407198537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd34805b960 0x7fd34805bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd33ffff700 1 -- 172.21.15.60:0/407198537 >> v2:172.21.15.66:3300/0 conn(0x7fd3480aefe0 msgr2=0x7fd348146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:51.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd33ffff700 1 --2- 172.21.15.60:0/407198537 >> v2:172.21.15.66:3300/0 conn(0x7fd3480aefe0 0x7fd348146790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd33ffff700 1 -- 172.21.15.60:0/407198537 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3481462f0 con 0x7fd3480a7850 2020-10-31T22:41:51.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd33ffff700 1 --2- 172.21.15.60:0/407198537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3480a7850 0x7fd3480aeaf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fd330002f30 tx=0x7fd330006e80).ready entity=mon.0 client_cookie=fa13d34a6ede05b0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:51.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd3467fc700 1 -- 172.21.15.60:0/407198537 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3300097f0 con 0x7fd3480a7850 2020-10-31T22:41:51.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd3467fc700 1 -- 172.21.15.60:0/407198537 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd330009950 con 0x7fd3480a7850 2020-10-31T22:41:51.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd3467fc700 1 -- 172.21.15.60:0/407198537 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd330009cb0 con 0x7fd3480a7850 2020-10-31T22:41:51.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd34d8ae700 1 -- 172.21.15.60:0/407198537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3480a7850 msgr2=0x7fd3480aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:51.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd34d8ae700 1 --2- 172.21.15.60:0/407198537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3480a7850 0x7fd3480aeaf0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7fd330002f30 tx=0x7fd330006e80).stop 2020-10-31T22:41:51.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.799+0000 7fd34d8ae700 1 -- 172.21.15.60:0/407198537 shutdown_connections 2020-10-31T22:41:51.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd34d8ae700 1 --2- 172.21.15.60:0/407198537 >> v2:172.21.15.66:3300/0 conn(0x7fd3480aefe0 0x7fd348146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd34d8ae700 1 --2- 172.21.15.60:0/407198537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd34805b960 0x7fd34805bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd34d8ae700 1 --2- 172.21.15.60:0/407198537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3480a7850 0x7fd3480aeaf0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd34d8ae700 1 -- 172.21.15.60:0/407198537 >> 172.21.15.60:0/407198537 conn(0x7fd34806a260 msgr2=0x7fd348061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:51.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd34d8ae700 1 -- 172.21.15.60:0/407198537 shutdown_connections 2020-10-31T22:41:51.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd34d8ae700 1 -- 172.21.15.60:0/407198537 wait complete. 2020-10-31T22:41:51.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd34d8ae700 1 Processor -- start 2020-10-31T22:41:51.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd34d8ae700 1 -- start start 2020-10-31T22:41:51.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd34d8ae700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd34805b960 0x7fd3480a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:51.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd34d8ae700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3480a7850 0x7fd3480ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:51.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd34d8ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd348143400 0x7fd348141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:51.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd34d8ae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3481409b0 con 0x7fd348143400 2020-10-31T22:41:51.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd34d8ae700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3481421e0 con 0x7fd34805b960 2020-10-31T22:41:51.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd34d8ae700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd348142470 con 0x7fd3480a7850 2020-10-31T22:41:51.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd3477fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd348143400 0x7fd348141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:51.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd3477fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd348143400 0x7fd348141cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42738/0 (socket says 172.21.15.60:42738) 2020-10-31T22:41:51.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd3477fe700 1 -- 172.21.15.60:0/1031683771 learned_addr learned my addr 172.21.15.60:0/1031683771 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:51.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd346ffd700 1 --2- 172.21.15.60:0/1031683771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd34805b960 0x7fd3480a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:51.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd33ffff700 1 --2- 172.21.15.60:0/1031683771 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3480a7850 0x7fd3480ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:51.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd3477fe700 1 -- 172.21.15.60:0/1031683771 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3480a7850 msgr2=0x7fd3480ac980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:51.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd3477fe700 1 --2- 172.21.15.60:0/1031683771 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3480a7850 0x7fd3480ac980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd3477fe700 1 -- 172.21.15.60:0/1031683771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd34805b960 msgr2=0x7fd3480a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:51.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd3477fe700 1 --2- 172.21.15.60:0/1031683771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd34805b960 0x7fd3480a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd3477fe700 1 -- 172.21.15.60:0/1031683771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd348142710 con 0x7fd348143400 2020-10-31T22:41:51.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd3477fe700 1 --2- 172.21.15.60:0/1031683771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd348143400 0x7fd348141cf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fd34000a000 tx=0x7fd340008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:51.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.803+0000 7fd344ff9700 1 -- 172.21.15.60:0/1031683771 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd34000b9a0 con 0x7fd348143400 2020-10-31T22:41:51.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.807+0000 7fd344ff9700 1 -- 172.21.15.60:0/1031683771 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34000bb00 con 0x7fd348143400 2020-10-31T22:41:51.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.807+0000 7fd34d8ae700 1 -- 172.21.15.60:0/1031683771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd348155220 con 0x7fd348143400 2020-10-31T22:41:51.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.807+0000 7fd344ff9700 1 -- 172.21.15.60:0/1031683771 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd34000be60 con 0x7fd348143400 2020-10-31T22:41:51.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.807+0000 7fd34d8ae700 1 -- 172.21.15.60:0/1031683771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3481556c0 con 0x7fd348143400 2020-10-31T22:41:51.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.807+0000 7fd34d8ae700 1 -- 172.21.15.60:0/1031683771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd348057100 con 0x7fd348143400 2020-10-31T22:41:51.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.807+0000 7fd344ff9700 1 -- 172.21.15.60:0/1031683771 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd34001c460 con 0x7fd348143400 2020-10-31T22:41:51.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.807+0000 7fd344ff9700 1 --2- 172.21.15.60:0/1031683771 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd32c054f10 0x7fd32c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:51.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.807+0000 7fd344ff9700 1 -- 172.21.15.60:0/1031683771 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd34006e0d0 con 0x7fd348143400 2020-10-31T22:41:51.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.807+0000 7fd346ffd700 1 --2- 172.21.15.60:0/1031683771 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd32c054f10 0x7fd32c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:51.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.807+0000 7fd346ffd700 1 --2- 172.21.15.60:0/1031683771 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd32c054f10 0x7fd32c0573d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fd33800c000 tx=0x7fd338008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:51.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.815+0000 7fd344ff9700 1 -- 172.21.15.60:0/1031683771 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd340044590 con 0x7fd348143400 2020-10-31T22:41:51.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.959+0000 7fd34d8ae700 1 -- 172.21.15.60:0/1031683771 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd34805aa70 con 0x7fd348143400 2020-10-31T22:41:51.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.959+0000 7fd344ff9700 1 -- 172.21.15.60:0/1031683771 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fd340047bb0 con 0x7fd348143400 2020-10-31T22:41:51.964 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:51.964 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":33,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:41:49.525944+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:41:46.258748+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2020-10-31T22:41:47.507555+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:41:51.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.963+0000 7fd34d8ae700 1 -- 172.21.15.60:0/1031683771 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd32c054f10 msgr2=0x7fd32c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:51.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.963+0000 7fd34d8ae700 1 --2- 172.21.15.60:0/1031683771 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd32c054f10 0x7fd32c0573d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fd33800c000 tx=0x7fd338008040).stop 2020-10-31T22:41:51.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.963+0000 7fd34d8ae700 1 -- 172.21.15.60:0/1031683771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd348143400 msgr2=0x7fd348141cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:51.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.963+0000 7fd34d8ae700 1 --2- 172.21.15.60:0/1031683771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd348143400 0x7fd348141cf0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fd34000a000 tx=0x7fd340008040).stop 2020-10-31T22:41:51.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.963+0000 7fd34d8ae700 1 -- 172.21.15.60:0/1031683771 shutdown_connections 2020-10-31T22:41:51.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.963+0000 7fd34d8ae700 1 --2- 172.21.15.60:0/1031683771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd348143400 0x7fd348141cf0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.963+0000 7fd34d8ae700 1 --2- 172.21.15.60:0/1031683771 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd32c054f10 0x7fd32c0573d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.963+0000 7fd34d8ae700 1 --2- 172.21.15.60:0/1031683771 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd34805b960 0x7fd3480a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.963+0000 7fd34d8ae700 1 --2- 172.21.15.60:0/1031683771 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3480a7850 0x7fd3480ac980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:51.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.963+0000 7fd34d8ae700 1 -- 172.21.15.60:0/1031683771 >> 172.21.15.60:0/1031683771 conn(0x7fd34806a260 msgr2=0x7fd3481466b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:51.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.963+0000 7fd34d8ae700 1 -- 172.21.15.60:0/1031683771 shutdown_connections 2020-10-31T22:41:51.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:51.963+0000 7fd34d8ae700 1 -- 172.21.15.60:0/1031683771 wait complete. 2020-10-31T22:41:51.979 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:41:46.258748+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:41:47.507555+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:41:51.980 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:41:52.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.095+0000 7f96e015e700 1 Processor -- start 2020-10-31T22:41:52.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96e015e700 1 -- start start 2020-10-31T22:41:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96e015e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d8066ec0 0x7f96d81429a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96e015e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f96d80ae1d0 0x7f96d813efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96e015e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d805be00 con 0x7f96d80aeaf0 2020-10-31T22:41:52.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96e015e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d80672a0 con 0x7f96d80ae1d0 2020-10-31T22:41:52.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96e015e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d805bb60 con 0x7f96d8066ec0 2020-10-31T22:41:52.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dd6f9700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f96d80aeaf0 0x7f96d80b1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46878/0 (socket says 172.21.15.60:46878) 2020-10-31T22:41:52.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dd6f9700 1 -- 172.21.15.60:0/2323023418 learned_addr learned my addr 172.21.15.60:0/2323023418 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96de6fb700 1 --2- 172.21.15.60:0/2323023418 >> v2:172.21.15.66:3300/0 conn(0x7f96d80ae1d0 0x7f96d813efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96ddefa700 1 --2- 172.21.15.60:0/2323023418 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d8066ec0 0x7f96d81429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 -- 172.21.15.60:0/2323023418 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99046942 0 0) 0x7f96d805be00 con 0x7f96d80aeaf0 2020-10-31T22:41:52.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 -- 172.21.15.60:0/2323023418 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96c4003230 con 0x7f96d80aeaf0 2020-10-31T22:41:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 -- 172.21.15.60:0/2323023418 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1988984426 0 0) 0x7f96c4003230 con 0x7f96d80aeaf0 2020-10-31T22:41:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 -- 172.21.15.60:0/2323023418 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d8066ec0 msgr2=0x7f96d81429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 --2- 172.21.15.60:0/2323023418 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d8066ec0 0x7f96d81429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 -- 172.21.15.60:0/2323023418 >> v2:172.21.15.66:3300/0 conn(0x7f96d80ae1d0 msgr2=0x7f96d813efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:52.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 --2- 172.21.15.60:0/2323023418 >> v2:172.21.15.66:3300/0 conn(0x7f96d80ae1d0 0x7f96d813efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 -- 172.21.15.60:0/2323023418 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d80b0a40 con 0x7f96d80aeaf0 2020-10-31T22:41:52.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 -- 172.21.15.60:0/2323023418 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f96c80016d0 con 0x7f96d80aeaf0 2020-10-31T22:41:52.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 -- 172.21.15.60:0/2323023418 >> v1:172.21.15.60:6789/0 conn(0x7f96d80aeaf0 legacy=0x7f96d80b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 --2- 172.21.15.60:0/2323023418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4003720 0x7f96c4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 --2- 172.21.15.60:0/2323023418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96c40044d0 0x7f96c4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 --2- 172.21.15.60:0/2323023418 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d8066ec0 0x7f96c4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 -- 172.21.15.60:0/2323023418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d80672a0 con 0x7f96c4003720 2020-10-31T22:41:52.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 -- 172.21.15.60:0/2323023418 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d805bb60 con 0x7f96c40044d0 2020-10-31T22:41:52.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 -- 172.21.15.60:0/2323023418 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4004260 con 0x7f96d8066ec0 2020-10-31T22:41:52.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96ddefa700 1 --2- 172.21.15.60:0/2323023418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4003720 0x7f96c4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dd6f9700 1 --2- 172.21.15.60:0/2323023418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96c40044d0 0x7f96c4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96de6fb700 1 --2- 172.21.15.60:0/2323023418 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d8066ec0 0x7f96c4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96ddefa700 1 -- 172.21.15.60:0/2323023418 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d8066ec0 msgr2=0x7f96c4004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:52.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96ddefa700 1 --2- 172.21.15.60:0/2323023418 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d8066ec0 0x7f96c4004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96ddefa700 1 -- 172.21.15.60:0/2323023418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96c40044d0 msgr2=0x7f96c4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:52.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96ddefa700 1 --2- 172.21.15.60:0/2323023418 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96c40044d0 0x7f96c4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96ddefa700 1 -- 172.21.15.60:0/2323023418 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4003230 con 0x7f96c4003720 2020-10-31T22:41:52.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96ddefa700 1 --2- 172.21.15.60:0/2323023418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4003720 0x7f96c4003b40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f96cc00c000 tx=0x7f96cc008040).ready entity=mon.0 client_cookie=93977a99ad885fce server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:52.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 -- 172.21.15.60:0/2323023418 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96cc00e9d0 con 0x7f96c4003720 2020-10-31T22:41:52.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 -- 172.21.15.60:0/2323023418 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96cc00eb30 con 0x7f96c4003720 2020-10-31T22:41:52.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96dcef8700 1 -- 172.21.15.60:0/2323023418 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96cc00ee90 con 0x7f96c4003720 2020-10-31T22:41:52.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96e015e700 1 -- 172.21.15.60:0/2323023418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4003720 msgr2=0x7f96c4003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96e015e700 1 --2- 172.21.15.60:0/2323023418 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96c4003720 0x7f96c4003b40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f96cc00c000 tx=0x7f96cc008040).stop 2020-10-31T22:41:52.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96de6fb700 1 -- 172.21.15.60:0/2323023418 reap_dead start 2020-10-31T22:41:52.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96e015e700 1 -- 172.21.15.60:0/2323023418 shutdown_connections 2020-10-31T22:41:52.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96e015e700 1 -- 172.21.15.60:0/2323023418 >> 172.21.15.60:0/2323023418 conn(0x7f96d806a260 msgr2=0x7f96d8061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:52.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96e015e700 1 -- 172.21.15.60:0/2323023418 shutdown_connections 2020-10-31T22:41:52.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.099+0000 7f96e015e700 1 -- 172.21.15.60:0/2323023418 wait complete. 2020-10-31T22:41:52.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96e015e700 1 Processor -- start 2020-10-31T22:41:52.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96e015e700 1 -- start start 2020-10-31T22:41:52.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96e015e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d81488c0 0x7f96d81515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96e015e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96d813d730 0x7f96d81475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96e015e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d8147ae0 0x7f96d80a9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96e015e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d81403c0 con 0x7f96d813d730 2020-10-31T22:41:52.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96e015e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d813deb0 con 0x7f96d8147ae0 2020-10-31T22:41:52.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96e015e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d8150bf0 con 0x7f96d81488c0 2020-10-31T22:41:52.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96dd6f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96d813d730 0x7f96d81475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96dd6f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96d813d730 0x7f96d81475f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42756/0 (socket says 172.21.15.60:42756) 2020-10-31T22:41:52.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96dd6f9700 1 -- 172.21.15.60:0/1373494041 learned_addr learned my addr 172.21.15.60:0/1373494041 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:52.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96de6fb700 1 --2- 172.21.15.60:0/1373494041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d8147ae0 0x7f96d80a9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96ddefa700 1 --2- 172.21.15.60:0/1373494041 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d81488c0 0x7f96d81515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96dd6f9700 1 -- 172.21.15.60:0/1373494041 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d81488c0 msgr2=0x7f96d81515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96dd6f9700 1 --2- 172.21.15.60:0/1373494041 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d81488c0 0x7f96d81515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96dd6f9700 1 -- 172.21.15.60:0/1373494041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d8147ae0 msgr2=0x7f96d80a9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96dd6f9700 1 --2- 172.21.15.60:0/1373494041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d8147ae0 0x7f96d80a9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96dd6f9700 1 -- 172.21.15.60:0/1373494041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d8150e90 con 0x7f96d813d730 2020-10-31T22:41:52.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96dd6f9700 1 --2- 172.21.15.60:0/1373494041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96d813d730 0x7f96d81475f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f96d8147ee0 tx=0x7f96c8001420).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:52.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96d6ffd700 1 -- 172.21.15.60:0/1373494041 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96c800a710 con 0x7f96d813d730 2020-10-31T22:41:52.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96d6ffd700 1 -- 172.21.15.60:0/1373494041 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c8010040 con 0x7f96d813d730 2020-10-31T22:41:52.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96e015e700 1 -- 172.21.15.60:0/1373494041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d8151130 con 0x7f96d813d730 2020-10-31T22:41:52.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96d6ffd700 1 -- 172.21.15.60:0/1373494041 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96c800aa60 con 0x7f96d813d730 2020-10-31T22:41:52.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.103+0000 7f96e015e700 1 -- 172.21.15.60:0/1373494041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d813c520 con 0x7f96d813d730 2020-10-31T22:41:52.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.107+0000 7f96e015e700 1 -- 172.21.15.60:0/1373494041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d8057100 con 0x7f96d813d730 2020-10-31T22:41:52.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.107+0000 7f96d6ffd700 1 -- 172.21.15.60:0/1373494041 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f96c801b020 con 0x7f96d813d730 2020-10-31T22:41:52.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.107+0000 7f96d6ffd700 1 --2- 172.21.15.60:0/1373494041 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f96b8055050 0x7f96b8057510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.107+0000 7f96d6ffd700 1 -- 172.21.15.60:0/1373494041 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f96c806d1b0 con 0x7f96d813d730 2020-10-31T22:41:52.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.107+0000 7f96ddefa700 1 --2- 172.21.15.60:0/1373494041 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f96b8055050 0x7f96b8057510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.107+0000 7f96ddefa700 1 --2- 172.21.15.60:0/1373494041 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f96b8055050 0x7f96b8057510 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f96cc00c000 tx=0x7f96cc01a000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:52.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.115+0000 7f96d6ffd700 1 -- 172.21.15.60:0/1373494041 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f96c80435c0 con 0x7f96d813d730 2020-10-31T22:41:52.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.263+0000 7f96e015e700 1 -- 172.21.15.60:0/1373494041 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f96d805aa70 con 0x7f96d813d730 2020-10-31T22:41:52.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.263+0000 7f96d6ffd700 1 -- 172.21.15.60:0/1373494041 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v33) v1 ==== 110+0+10 (secure 0 0 0) 0x7f96c8046be0 con 0x7f96d813d730 2020-10-31T22:41:52.266 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:41:52.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.263+0000 7f96e015e700 1 -- 172.21.15.60:0/1373494041 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f96b8055050 msgr2=0x7f96b8057510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.263+0000 7f96e015e700 1 --2- 172.21.15.60:0/1373494041 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f96b8055050 0x7f96b8057510 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f96cc00c000 tx=0x7f96cc01a000).stop 2020-10-31T22:41:52.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.263+0000 7f96e015e700 1 -- 172.21.15.60:0/1373494041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96d813d730 msgr2=0x7f96d81475f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.263+0000 7f96e015e700 1 --2- 172.21.15.60:0/1373494041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96d813d730 0x7f96d81475f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f96d8147ee0 tx=0x7f96c8001420).stop 2020-10-31T22:41:52.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.263+0000 7f96e015e700 1 -- 172.21.15.60:0/1373494041 shutdown_connections 2020-10-31T22:41:52.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.263+0000 7f96e015e700 1 --2- 172.21.15.60:0/1373494041 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f96b8055050 0x7f96b8057510 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.263+0000 7f96e015e700 1 --2- 172.21.15.60:0/1373494041 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d8147ae0 0x7f96d80a9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.263+0000 7f96e015e700 1 --2- 172.21.15.60:0/1373494041 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96d81488c0 0x7f96d81515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.263+0000 7f96e015e700 1 --2- 172.21.15.60:0/1373494041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96d813d730 0x7f96d81475f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.263+0000 7f96e015e700 1 -- 172.21.15.60:0/1373494041 >> 172.21.15.60:0/1373494041 conn(0x7f96d806a260 msgr2=0x7f96d80b2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:52.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.267+0000 7f96e015e700 1 -- 172.21.15.60:0/1373494041 shutdown_connections 2020-10-31T22:41:52.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.267+0000 7f96e015e700 1 -- 172.21.15.60:0/1373494041 wait complete. 2020-10-31T22:41:52.283 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:41:52.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.399+0000 7f03fffff700 1 Processor -- start 2020-10-31T22:41:52.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.399+0000 7f03fffff700 1 -- start start 2020-10-31T22:41:52.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.399+0000 7f03fffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04000b5570 0x7f04000b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.399+0000 7f03fffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f04000b24a0 0x7f0400145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.399+0000 7f03fffff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0400145e40 0x7f0400141f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.399+0000 7f03fffff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040013f930 con 0x7f04000b24a0 2020-10-31T22:41:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.399+0000 7f03fffff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04000b4440 con 0x7f0400145e40 2020-10-31T22:41:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.399+0000 7f03fffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04000b02f0 con 0x7f04000b5570 2020-10-31T22:41:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.399+0000 7f03fe7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f04000b24a0 0x7f0400145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.399+0000 7f03fe7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f04000b24a0 0x7f0400145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42766/0 (socket says 172.21.15.60:42766) 2020-10-31T22:41:52.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.399+0000 7f03feffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04000b5570 0x7f04000b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.399+0000 7f03ff7fe700 1 --2- 172.21.15.60:0/2746754396 >> v2:172.21.15.66:3300/0 conn(0x7f0400145e40 0x7f0400141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.399+0000 7f03fe7fc700 1 -- 172.21.15.60:0/2746754396 learned_addr learned my addr 172.21.15.60:0/2746754396 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fe7fc700 1 -- 172.21.15.60:0/2746754396 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04000b5570 msgr2=0x7f04000b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:52.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fe7fc700 1 --2- 172.21.15.60:0/2746754396 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04000b5570 0x7f04000b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fe7fc700 1 -- 172.21.15.60:0/2746754396 >> v2:172.21.15.66:3300/0 conn(0x7f0400145e40 msgr2=0x7f0400141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:52.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fe7fc700 1 --2- 172.21.15.60:0/2746754396 >> v2:172.21.15.66:3300/0 conn(0x7f0400145e40 0x7f0400141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fe7fc700 1 -- 172.21.15.60:0/2746754396 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04000b0590 con 0x7f04000b24a0 2020-10-31T22:41:52.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03ff7fe700 1 --2- 172.21.15.60:0/2746754396 >> v2:172.21.15.66:3300/0 conn(0x7f0400145e40 0x7f0400141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:52.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fe7fc700 1 --2- 172.21.15.60:0/2746754396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04000b24a0 0x7f0400145950 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f0400141c20 tx=0x7f03f4006e80).ready entity=mon.0 client_cookie=a713f08fffdff232 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:52.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fdffb700 1 -- 172.21.15.60:0/2746754396 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f4009600 con 0x7f04000b24a0 2020-10-31T22:41:52.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fdffb700 1 -- 172.21.15.60:0/2746754396 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f4009760 con 0x7f04000b24a0 2020-10-31T22:41:52.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fdffb700 1 -- 172.21.15.60:0/2746754396 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f4009ac0 con 0x7f04000b24a0 2020-10-31T22:41:52.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fffff700 1 -- 172.21.15.60:0/2746754396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04000b24a0 msgr2=0x7f0400145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fffff700 1 --2- 172.21.15.60:0/2746754396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04000b24a0 0x7f0400145950 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f0400141c20 tx=0x7f03f4006e80).stop 2020-10-31T22:41:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fffff700 1 -- 172.21.15.60:0/2746754396 shutdown_connections 2020-10-31T22:41:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fffff700 1 --2- 172.21.15.60:0/2746754396 >> v2:172.21.15.66:3300/0 conn(0x7f0400145e40 0x7f0400141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fffff700 1 --2- 172.21.15.60:0/2746754396 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04000b5570 0x7f04000b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fffff700 1 --2- 172.21.15.60:0/2746754396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04000b24a0 0x7f0400145950 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fffff700 1 -- 172.21.15.60:0/2746754396 >> 172.21.15.60:0/2746754396 conn(0x7f04000b8e90 msgr2=0x7f04000b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fffff700 1 -- 172.21.15.60:0/2746754396 shutdown_connections 2020-10-31T22:41:52.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.403+0000 7f03fffff700 1 -- 172.21.15.60:0/2746754396 wait complete. 2020-10-31T22:41:52.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03fffff700 1 Processor -- start 2020-10-31T22:41:52.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03fffff700 1 -- start start 2020-10-31T22:41:52.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03fffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04000b24a0 0x7f04000ac510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03fffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04000b5570 0x7f0400150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03fffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0400145e40 0x7f0400150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03fffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040009e3d0 con 0x7f0400145e40 2020-10-31T22:41:52.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03fffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040009e630 con 0x7f04000b24a0 2020-10-31T22:41:52.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03fffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040009e8d0 con 0x7f04000b5570 2020-10-31T22:41:52.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03ff7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0400145e40 0x7f0400150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03ff7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0400145e40 0x7f0400150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42772/0 (socket says 172.21.15.60:42772) 2020-10-31T22:41:52.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03feffd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04000b24a0 0x7f04000ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03ff7fe700 1 -- 172.21.15.60:0/2819517237 learned_addr learned my addr 172.21.15.60:0/2819517237 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:52.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03fe7fc700 1 --2- 172.21.15.60:0/2819517237 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04000b5570 0x7f0400150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03ff7fe700 1 -- 172.21.15.60:0/2819517237 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04000b5570 msgr2=0x7f0400150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03ff7fe700 1 --2- 172.21.15.60:0/2819517237 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04000b5570 0x7f0400150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03ff7fe700 1 -- 172.21.15.60:0/2819517237 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04000b24a0 msgr2=0x7f04000ac510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03ff7fe700 1 --2- 172.21.15.60:0/2819517237 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04000b24a0 0x7f04000ac510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03ff7fe700 1 -- 172.21.15.60:0/2819517237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0400151470 con 0x7f0400145e40 2020-10-31T22:41:52.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03feffd700 1 --2- 172.21.15.60:0/2819517237 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04000b24a0 0x7f04000ac510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:41:52.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03ff7fe700 1 --2- 172.21.15.60:0/2819517237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0400145e40 0x7f0400150f80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f03f800c000 tx=0x7f03f8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03effff700 1 -- 172.21.15.60:0/2819517237 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f800cae0 con 0x7f0400145e40 2020-10-31T22:41:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03effff700 1 -- 172.21.15.60:0/2819517237 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f800cc40 con 0x7f0400145e40 2020-10-31T22:41:52.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03effff700 1 -- 172.21.15.60:0/2819517237 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f03f80123f0 con 0x7f0400145e40 2020-10-31T22:41:52.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03fffff700 1 -- 172.21.15.60:0/2819517237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f040009ed70 con 0x7f0400145e40 2020-10-31T22:41:52.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.407+0000 7f03fffff700 1 -- 172.21.15.60:0/2819517237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04000adb90 con 0x7f0400145e40 2020-10-31T22:41:52.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.411+0000 7f03fffff700 1 -- 172.21.15.60:0/2819517237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0400057100 con 0x7f0400145e40 2020-10-31T22:41:52.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.411+0000 7f03effff700 1 -- 172.21.15.60:0/2819517237 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f03f8012550 con 0x7f0400145e40 2020-10-31T22:41:52.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.411+0000 7f03effff700 1 --2- 172.21.15.60:0/2819517237 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f03dc054f10 0x7f03dc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.411+0000 7f03effff700 1 -- 172.21.15.60:0/2819517237 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f03f806e1f0 con 0x7f0400145e40 2020-10-31T22:41:52.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.411+0000 7f03feffd700 1 --2- 172.21.15.60:0/2819517237 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f03dc054f10 0x7f03dc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.411+0000 7f03feffd700 1 --2- 172.21.15.60:0/2819517237 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f03dc054f10 0x7f03dc0573d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f03f000b000 tx=0x7f03f00091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:52.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.423+0000 7f03effff700 1 -- 172.21.15.60:0/2819517237 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f03f8044520 con 0x7f0400145e40 2020-10-31T22:41:52.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.559+0000 7f03fffff700 1 -- 172.21.15.60:0/2819517237 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f040005a8e0 con 0x7f0400145e40 2020-10-31T22:41:52.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.559+0000 7f03effff700 1 -- 172.21.15.60:0/2819517237 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v33) v1 ==== 92+0+10 (secure 0 0 0) 0x7f03f8047b40 con 0x7f0400145e40 2020-10-31T22:41:52.563 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:52.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.563+0000 7f03fffff700 1 -- 172.21.15.60:0/2819517237 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f03dc054f10 msgr2=0x7f03dc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.563+0000 7f03fffff700 1 --2- 172.21.15.60:0/2819517237 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f03dc054f10 0x7f03dc0573d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f03f000b000 tx=0x7f03f00091a0).stop 2020-10-31T22:41:52.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.563+0000 7f03fffff700 1 -- 172.21.15.60:0/2819517237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0400145e40 msgr2=0x7f0400150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.563+0000 7f03fffff700 1 --2- 172.21.15.60:0/2819517237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0400145e40 0x7f0400150f80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f03f800c000 tx=0x7f03f8006dc0).stop 2020-10-31T22:41:52.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.563+0000 7f03fffff700 1 -- 172.21.15.60:0/2819517237 shutdown_connections 2020-10-31T22:41:52.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.563+0000 7f03fffff700 1 --2- 172.21.15.60:0/2819517237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0400145e40 0x7f0400150f80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.563+0000 7f03fffff700 1 --2- 172.21.15.60:0/2819517237 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f03dc054f10 0x7f03dc0573d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.563+0000 7f03fffff700 1 --2- 172.21.15.60:0/2819517237 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04000b24a0 0x7f04000ac510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.563+0000 7f03fffff700 1 --2- 172.21.15.60:0/2819517237 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04000b5570 0x7f0400150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.563+0000 7f03fffff700 1 -- 172.21.15.60:0/2819517237 >> 172.21.15.60:0/2819517237 conn(0x7f04000b8e90 msgr2=0x7f04000659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:52.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.563+0000 7f03fffff700 1 -- 172.21.15.60:0/2819517237 shutdown_connections 2020-10-31T22:41:52.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.563+0000 7f03fffff700 1 -- 172.21.15.60:0/2819517237 wait complete. 2020-10-31T22:41:52.577 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:41:52.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 Processor -- start 2020-10-31T22:41:52.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 -- start start 2020-10-31T22:41:52.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbb280b2790 0x7fbb28142460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb28145d90 0x7fbb2814c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb280b2b70 con 0x7fbb28142950 2020-10-31T22:41:52.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2805fe60 con 0x7fbb28145d90 2020-10-31T22:41:52.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb28060100 con 0x7fbb280b2790 2020-10-31T22:41:52.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2cf65700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb28145d90 0x7fbb2814c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2cf65700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbb28145d90 0x7fbb2814c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42780/0 (socket says 172.21.15.60:42780) 2020-10-31T22:41:52.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2cf65700 1 -- 172.21.15.60:0/3971076564 learned_addr learned my addr 172.21.15.60:0/3971076564 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:52.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb27fff700 1 --2- 172.21.15.60:0/3971076564 >> v2:172.21.15.66:3300/0 conn(0x7fbb280b2790 0x7fbb28142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2cf65700 1 -- 172.21.15.60:0/3971076564 >> v2:172.21.15.66:3300/0 conn(0x7fbb280b2790 msgr2=0x7fbb28142460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:52.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2cf65700 1 --2- 172.21.15.60:0/3971076564 >> v2:172.21.15.66:3300/0 conn(0x7fbb280b2790 0x7fbb28142460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2cf65700 1 -- 172.21.15.60:0/3971076564 >> v1:172.21.15.66:6789/0 conn(0x7fbb28142950 legacy=0x7fbb28145680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2cf65700 1 -- 172.21.15.60:0/3971076564 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb28062900 con 0x7fbb28145d90 2020-10-31T22:41:52.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb27fff700 1 --2- 172.21.15.60:0/3971076564 >> v2:172.21.15.66:3300/0 conn(0x7fbb280b2790 0x7fbb28142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:41:52.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2cf65700 1 --2- 172.21.15.60:0/3971076564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb28145d90 0x7fbb2814c830 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fbb200032b0 tx=0x7fbb20009270).ready entity=mon.0 client_cookie=3e1fce2c3bb469b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:52.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb26ffd700 1 -- 172.21.15.60:0/3971076564 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb2000bc00 con 0x7fbb28145d90 2020-10-31T22:41:52.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb26ffd700 1 -- 172.21.15.60:0/3971076564 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2000bd60 con 0x7fbb28145d90 2020-10-31T22:41:52.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb26ffd700 1 -- 172.21.15.60:0/3971076564 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb20011400 con 0x7fbb28145d90 2020-10-31T22:41:52.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/3971076564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb28145d90 msgr2=0x7fbb2814c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 --2- 172.21.15.60:0/3971076564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb28145d90 0x7fbb2814c830 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fbb200032b0 tx=0x7fbb20009270).stop 2020-10-31T22:41:52.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/3971076564 shutdown_connections 2020-10-31T22:41:52.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 --2- 172.21.15.60:0/3971076564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb28145d90 0x7fbb2814c830 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 --2- 172.21.15.60:0/3971076564 >> v2:172.21.15.66:3300/0 conn(0x7fbb280b2790 0x7fbb28142460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/3971076564 >> 172.21.15.60:0/3971076564 conn(0x7fbb280b5d30 msgr2=0x7fbb280b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:52.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/3971076564 shutdown_connections 2020-10-31T22:41:52.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.699+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/3971076564 wait complete. 2020-10-31T22:41:52.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2e9c8700 1 Processor -- start 2020-10-31T22:41:52.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2e9c8700 1 -- start start 2020-10-31T22:41:52.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2e9c8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb280b2790 0x7fbb280638f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2e9c8700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb28142950 0x7fbb28144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2e9c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb28145d90 0x7fbb28141450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2e9c8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb280a9700 con 0x7fbb28145d90 2020-10-31T22:41:52.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2e9c8700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb280651a0 con 0x7fbb28142950 2020-10-31T22:41:52.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2e9c8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb28065440 con 0x7fbb280b2790 2020-10-31T22:41:52.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2cf65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb28145d90 0x7fbb28141450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2cf65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb28145d90 0x7fbb28141450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42786/0 (socket says 172.21.15.60:42786) 2020-10-31T22:41:52.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2cf65700 1 -- 172.21.15.60:0/720587120 learned_addr learned my addr 172.21.15.60:0/720587120 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:52.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb277fe700 1 --2- 172.21.15.60:0/720587120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb28142950 0x7fbb28144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb27fff700 1 --2- 172.21.15.60:0/720587120 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb280b2790 0x7fbb280638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2cf65700 1 -- 172.21.15.60:0/720587120 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb280b2790 msgr2=0x7fbb280638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2cf65700 1 --2- 172.21.15.60:0/720587120 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb280b2790 0x7fbb280638f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2cf65700 1 -- 172.21.15.60:0/720587120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb28142950 msgr2=0x7fbb28144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2cf65700 1 --2- 172.21.15.60:0/720587120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb28142950 0x7fbb28144210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2cf65700 1 -- 172.21.15.60:0/720587120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb280656e0 con 0x7fbb28145d90 2020-10-31T22:41:52.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2cf65700 1 --2- 172.21.15.60:0/720587120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb28145d90 0x7fbb28141450 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fbb200032b0 tx=0x7fbb20016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:52.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb257fa700 1 -- 172.21.15.60:0/720587120 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb20011e90 con 0x7fbb28145d90 2020-10-31T22:41:52.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb257fa700 1 -- 172.21.15.60:0/720587120 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2001f3f0 con 0x7fbb28145d90 2020-10-31T22:41:52.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/720587120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb28065980 con 0x7fbb28145d90 2020-10-31T22:41:52.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb257fa700 1 -- 172.21.15.60:0/720587120 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb2001f750 con 0x7fbb28145d90 2020-10-31T22:41:52.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.703+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/720587120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb280ab700 con 0x7fbb28145d90 2020-10-31T22:41:52.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.707+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/720587120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb28065b40 con 0x7fbb28145d90 2020-10-31T22:41:52.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.707+0000 7fbb257fa700 1 -- 172.21.15.60:0/720587120 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbb20026030 con 0x7fbb28145d90 2020-10-31T22:41:52.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.707+0000 7fbb257fa700 1 --2- 172.21.15.60:0/720587120 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb08054f10 0x7fbb080573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:52.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.707+0000 7fbb257fa700 1 -- 172.21.15.60:0/720587120 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbb2006e690 con 0x7fbb28145d90 2020-10-31T22:41:52.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.707+0000 7fbb27fff700 1 --2- 172.21.15.60:0/720587120 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb08054f10 0x7fbb080573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:52.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.707+0000 7fbb27fff700 1 --2- 172.21.15.60:0/720587120 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb08054f10 0x7fbb080573d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fbb1800c000 tx=0x7fbb18008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:52.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.715+0000 7fbb257fa700 1 -- 172.21.15.60:0/720587120 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbb20044b10 con 0x7fbb28145d90 2020-10-31T22:41:52.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.855+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/720587120 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb28057100 con 0x7fbb28145d90 2020-10-31T22:41:52.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.855+0000 7fbb257fa700 1 -- 172.21.15.60:0/720587120 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+10 (secure 0 0 0) 0x7fbb200150a0 con 0x7fbb28145d90 2020-10-31T22:41:52.859 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:52.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.859+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/720587120 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb08054f10 msgr2=0x7fbb080573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.859+0000 7fbb2e9c8700 1 --2- 172.21.15.60:0/720587120 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb08054f10 0x7fbb080573d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fbb1800c000 tx=0x7fbb18008040).stop 2020-10-31T22:41:52.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.859+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/720587120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb28145d90 msgr2=0x7fbb28141450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:52.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.859+0000 7fbb2e9c8700 1 --2- 172.21.15.60:0/720587120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb28145d90 0x7fbb28141450 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fbb200032b0 tx=0x7fbb20016000).stop 2020-10-31T22:41:52.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.859+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/720587120 shutdown_connections 2020-10-31T22:41:52.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.859+0000 7fbb2e9c8700 1 --2- 172.21.15.60:0/720587120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb28145d90 0x7fbb28141450 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.859+0000 7fbb2e9c8700 1 --2- 172.21.15.60:0/720587120 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb280b2790 0x7fbb280638f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.859+0000 7fbb2e9c8700 1 --2- 172.21.15.60:0/720587120 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb08054f10 0x7fbb080573d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.859+0000 7fbb2e9c8700 1 --2- 172.21.15.60:0/720587120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb28142950 0x7fbb28144210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:52.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.859+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/720587120 >> 172.21.15.60:0/720587120 conn(0x7fbb280b5d30 msgr2=0x7fbb280b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:52.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.859+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/720587120 shutdown_connections 2020-10-31T22:41:52.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.859+0000 7fbb2e9c8700 1 -- 172.21.15.60:0/720587120 wait complete. 2020-10-31T22:41:52.877 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:41:52.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 Processor -- start 2020-10-31T22:41:52.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 -- start start 2020-10-31T22:41:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f888c0b24a0 0x7f888c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:53.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f888c141f00 0x7f888c142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:53.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f888c0b4440 con 0x7f888c0b5570 2020-10-31T22:41:53.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f888c13f930 con 0x7f888c141f00 2020-10-31T22:41:53.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888c146060 con 0x7f888c0b24a0 2020-10-31T22:41:53.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888a59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f888c0b5570 0x7f888c145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46926/0 (socket says 172.21.15.60:46926) 2020-10-31T22:41:53.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888a59c700 1 -- 172.21.15.60:0/1355171546 learned_addr learned my addr 172.21.15.60:0/1355171546 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:53.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888ad9d700 1 --2- 172.21.15.60:0/1355171546 >> v2:172.21.15.60:3300/0 conn(0x7f888c141f00 0x7f888c142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:53.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f8889d9b700 1 --2- 172.21.15.60:0/1355171546 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f888c0b24a0 0x7f888c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:53.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888ad9d700 1 -- 172.21.15.60:0/1355171546 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f888c0b24a0 msgr2=0x7f888c0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:53.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888ad9d700 1 --2- 172.21.15.60:0/1355171546 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f888c0b24a0 0x7f888c0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888ad9d700 1 -- 172.21.15.60:0/1355171546 >> v1:172.21.15.60:6789/0 conn(0x7f888c0b5570 legacy=0x7f888c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:53.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888ad9d700 1 -- 172.21.15.60:0/1355171546 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c0b02f0 con 0x7f888c141f00 2020-10-31T22:41:53.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888ad9d700 1 --2- 172.21.15.60:0/1355171546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c141f00 0x7f888c142390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f8884002f30 tx=0x7f8884006dc0).ready entity=mon.0 client_cookie=3dbb71d2436e60f8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:53.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888959a700 1 -- 172.21.15.60:0/1355171546 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88840097f0 con 0x7f888c141f00 2020-10-31T22:41:53.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888959a700 1 -- 172.21.15.60:0/1355171546 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8884009950 con 0x7f888c141f00 2020-10-31T22:41:53.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888959a700 1 -- 172.21.15.60:0/1355171546 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8884009cb0 con 0x7f888c141f00 2020-10-31T22:41:53.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 -- 172.21.15.60:0/1355171546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c141f00 msgr2=0x7f888c142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:53.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 --2- 172.21.15.60:0/1355171546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c141f00 0x7f888c142390 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f8884002f30 tx=0x7f8884006dc0).stop 2020-10-31T22:41:53.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 -- 172.21.15.60:0/1355171546 shutdown_connections 2020-10-31T22:41:53.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 --2- 172.21.15.60:0/1355171546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c141f00 0x7f888c142390 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 --2- 172.21.15.60:0/1355171546 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f888c0b24a0 0x7f888c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 -- 172.21.15.60:0/1355171546 >> 172.21.15.60:0/1355171546 conn(0x7f888c0b8e90 msgr2=0x7f888c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:53.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 -- 172.21.15.60:0/1355171546 shutdown_connections 2020-10-31T22:41:53.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.995+0000 7f888b59e700 1 -- 172.21.15.60:0/1355171546 wait complete. 2020-10-31T22:41:53.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888b59e700 1 Processor -- start 2020-10-31T22:41:53.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888b59e700 1 -- start start 2020-10-31T22:41:53.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888b59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f888c0b24a0 0x7f888c143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:53.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f888c0b5570 0x7f888c150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:53.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c141f00 0x7f888c150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:53.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0ae7c0 con 0x7f888c141f00 2020-10-31T22:41:53.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888b59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0aea60 con 0x7f888c0b24a0 2020-10-31T22:41:53.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888c0aed00 con 0x7f888c0b5570 2020-10-31T22:41:53.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c141f00 0x7f888c150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:53.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c141f00 0x7f888c150fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42800/0 (socket says 172.21.15.60:42800) 2020-10-31T22:41:53.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888ad9d700 1 -- 172.21.15.60:0/2959351291 learned_addr learned my addr 172.21.15.60:0/2959351291 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:53.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f8889d9b700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f888c0b5570 0x7f888c150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:53.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888a59c700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f888c0b24a0 0x7f888c143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:53.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888ad9d700 1 -- 172.21.15.60:0/2959351291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f888c0b5570 msgr2=0x7f888c150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:53.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888ad9d700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f888c0b5570 0x7f888c150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888ad9d700 1 -- 172.21.15.60:0/2959351291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f888c0b24a0 msgr2=0x7f888c143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:53.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888ad9d700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f888c0b24a0 0x7f888c143f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888ad9d700 1 -- 172.21.15.60:0/2959351291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c0af1a0 con 0x7f888c141f00 2020-10-31T22:41:53.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888a59c700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f888c0b24a0 0x7f888c143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:41:53.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888ad9d700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c141f00 0x7f888c150fe0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f8884002f30 tx=0x7f8884015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:53.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f88837fe700 1 -- 172.21.15.60:0/2959351291 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888400bed0 con 0x7f888c141f00 2020-10-31T22:41:53.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f88837fe700 1 -- 172.21.15.60:0/2959351291 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8884009c50 con 0x7f888c141f00 2020-10-31T22:41:53.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f88837fe700 1 -- 172.21.15.60:0/2959351291 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f888401d640 con 0x7f888c141f00 2020-10-31T22:41:53.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888b59e700 1 -- 172.21.15.60:0/2959351291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888c144cd0 con 0x7f888c141f00 2020-10-31T22:41:53.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888b59e700 1 -- 172.21.15.60:0/2959351291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888c1514d0 con 0x7f888c141f00 2020-10-31T22:41:53.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:52.999+0000 7f888b59e700 1 -- 172.21.15.60:0/2959351291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f888c0aeec0 con 0x7f888c141f00 2020-10-31T22:41:53.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.003+0000 7f88837fe700 1 -- 172.21.15.60:0/2959351291 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8884024030 con 0x7f888c141f00 2020-10-31T22:41:53.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.003+0000 7f88837fe700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8864054f10 0x7f88640573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:53.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.003+0000 7f888a59c700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8864054f10 0x7f88640573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:53.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.003+0000 7f88837fe700 1 -- 172.21.15.60:0/2959351291 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f888406edf0 con 0x7f888c141f00 2020-10-31T22:41:53.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.003+0000 7f888a59c700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8864054f10 0x7f88640573d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f8874008000 tx=0x7f8874009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:53.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.011+0000 7f88837fe700 1 -- 172.21.15.60:0/2959351291 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8884045290 con 0x7f888c141f00 2020-10-31T22:41:53.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.151+0000 7f888b59e700 1 -- 172.21.15.60:0/2959351291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f888c057100 con 0x7f888c141f00 2020-10-31T22:41:53.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.151+0000 7f88837fe700 1 -- 172.21.15.60:0/2959351291 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8884022070 con 0x7f888c141f00 2020-10-31T22:41:53.158 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:41:53.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.155+0000 7f888b59e700 1 -- 172.21.15.60:0/2959351291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8864054f10 msgr2=0x7f88640573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:53.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.155+0000 7f888b59e700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8864054f10 0x7f88640573d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f8874008000 tx=0x7f8874009040).stop 2020-10-31T22:41:53.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.155+0000 7f888b59e700 1 -- 172.21.15.60:0/2959351291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c141f00 msgr2=0x7f888c150fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:53.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.155+0000 7f888b59e700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c141f00 0x7f888c150fe0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f8884002f30 tx=0x7f8884015000).stop 2020-10-31T22:41:53.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.155+0000 7f888b59e700 1 -- 172.21.15.60:0/2959351291 shutdown_connections 2020-10-31T22:41:53.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.155+0000 7f888b59e700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f888c141f00 0x7f888c150fe0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.155+0000 7f888b59e700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8864054f10 0x7f88640573d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.155+0000 7f888b59e700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f888c0b24a0 0x7f888c143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.155+0000 7f888b59e700 1 --2- 172.21.15.60:0/2959351291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f888c0b5570 0x7f888c150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.155+0000 7f888b59e700 1 -- 172.21.15.60:0/2959351291 >> 172.21.15.60:0/2959351291 conn(0x7f888c0b8e90 msgr2=0x7f888c0b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:53.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.155+0000 7f888b59e700 1 -- 172.21.15.60:0/2959351291 shutdown_connections 2020-10-31T22:41:53.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.155+0000 7f888b59e700 1 -- 172.21.15.60:0/2959351291 wait complete. 2020-10-31T22:41:53.171 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:41:53.172 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:41:53.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.279+0000 7effe49a2700 1 Processor -- start 2020-10-31T22:41:53.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.279+0000 7effe49a2700 1 -- start start 2020-10-31T22:41:53.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effe49a2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7effe00b1d50 0x7effe005c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:53.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effe49a2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7effe00b0d60 0x7effe013fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:53.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effe49a2700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effe00b2130 con 0x7effe0140010 2020-10-31T22:41:53.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effe49a2700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe006a9b0 con 0x7effe00b0d60 2020-10-31T22:41:53.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effe49a2700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effe00af380 con 0x7effe00b1d50 2020-10-31T22:41:53.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effd6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7effe00b0d60 0x7effe013fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:53.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effdffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7effe0140010 0x7effe00adeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46940/0 (socket says 172.21.15.60:46940) 2020-10-31T22:41:53.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effdffff700 1 -- 172.21.15.60:0/1936699909 learned_addr learned my addr 172.21.15.60:0/1936699909 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:41:53.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effdf7fe700 1 --2- 172.21.15.60:0/1936699909 >> v2:172.21.15.66:3300/0 conn(0x7effe00b1d50 0x7effe005c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:53.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effd6ffd700 1 -- 172.21.15.60:0/1936699909 >> v2:172.21.15.66:3300/0 conn(0x7effe00b1d50 msgr2=0x7effe005c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:41:53.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effd6ffd700 1 --2- 172.21.15.60:0/1936699909 >> v2:172.21.15.66:3300/0 conn(0x7effe00b1d50 0x7effe005c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effd6ffd700 1 -- 172.21.15.60:0/1936699909 >> v1:172.21.15.60:6789/0 conn(0x7effe0140010 legacy=0x7effe00adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:53.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effdeffd700 1 -- 172.21.15.60:0/1936699909 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800924450 0 0) 0x7effe00b2130 con 0x7effe0140010 2020-10-31T22:41:53.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effd6ffd700 1 -- 172.21.15.60:0/1936699909 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe005b160 con 0x7effe00b0d60 2020-10-31T22:41:53.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effd6ffd700 1 --2- 172.21.15.60:0/1936699909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe00b0d60 0x7effe013fb20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7effc8002f30 tx=0x7effc8006dc0).ready entity=mon.0 client_cookie=92117a94aac9cdcc server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:53.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effdeffd700 1 -- 172.21.15.60:0/1936699909 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effc80097b0 con 0x7effe00b0d60 2020-10-31T22:41:53.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effdeffd700 1 -- 172.21.15.60:0/1936699909 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc8009910 con 0x7effe00b0d60 2020-10-31T22:41:53.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effe49a2700 1 -- 172.21.15.60:0/1936699909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe00b0d60 msgr2=0x7effe013fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:53.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effdeffd700 1 -- 172.21.15.60:0/1936699909 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effc8009c70 con 0x7effe00b0d60 2020-10-31T22:41:53.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effe49a2700 1 --2- 172.21.15.60:0/1936699909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe00b0d60 0x7effe013fb20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7effc8002f30 tx=0x7effc8006dc0).stop 2020-10-31T22:41:53.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effe49a2700 1 -- 172.21.15.60:0/1936699909 shutdown_connections 2020-10-31T22:41:53.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effe49a2700 1 --2- 172.21.15.60:0/1936699909 >> v2:172.21.15.66:3300/0 conn(0x7effe00b1d50 0x7effe005c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effe49a2700 1 --2- 172.21.15.60:0/1936699909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe00b0d60 0x7effe013fb20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effe49a2700 1 -- 172.21.15.60:0/1936699909 >> 172.21.15.60:0/1936699909 conn(0x7effe00b5300 msgr2=0x7effe00b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:53.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effe49a2700 1 -- 172.21.15.60:0/1936699909 shutdown_connections 2020-10-31T22:41:53.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.283+0000 7effe49a2700 1 -- 172.21.15.60:0/1936699909 wait complete. 2020-10-31T22:41:53.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effe49a2700 1 Processor -- start 2020-10-31T22:41:53.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effe49a2700 1 -- start start 2020-10-31T22:41:53.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effe49a2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effe00b0d60 0x7effe01468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:53.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effe49a2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effe00b1d50 0x7effe014e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:53.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effe49a2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe0140010 0x7effe00649b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:53.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effe49a2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe00ab3d0 con 0x7effe0140010 2020-10-31T22:41:53.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effe49a2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effe00ab670 con 0x7effe00b0d60 2020-10-31T22:41:53.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effe49a2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effe0064510 con 0x7effe00b1d50 2020-10-31T22:41:53.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effdffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe0140010 0x7effe00649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:53.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effdffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe0140010 0x7effe00649b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42814/0 (socket says 172.21.15.60:42814) 2020-10-31T22:41:53.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effdffff700 1 -- 172.21.15.60:0/480662443 learned_addr learned my addr 172.21.15.60:0/480662443 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:41:53.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effd6ffd700 1 --2- 172.21.15.60:0/480662443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effe00b1d50 0x7effe014e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:53.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effdf7fe700 1 --2- 172.21.15.60:0/480662443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effe00b0d60 0x7effe01468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:53.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effdffff700 1 -- 172.21.15.60:0/480662443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effe00b1d50 msgr2=0x7effe014e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:53.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effdffff700 1 --2- 172.21.15.60:0/480662443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effe00b1d50 0x7effe014e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effdffff700 1 -- 172.21.15.60:0/480662443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effe00b0d60 msgr2=0x7effe01468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:53.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effdffff700 1 --2- 172.21.15.60:0/480662443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effe00b0d60 0x7effe01468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effdffff700 1 -- 172.21.15.60:0/480662443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe00ab910 con 0x7effe0140010 2020-10-31T22:41:53.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effdffff700 1 --2- 172.21.15.60:0/480662443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe0140010 0x7effe00649b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7effd8001210 tx=0x7effd8007cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:53.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effdd7fa700 1 -- 172.21.15.60:0/480662443 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effd8005b70 con 0x7effe0140010 2020-10-31T22:41:53.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effdd7fa700 1 -- 172.21.15.60:0/480662443 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd8005cd0 con 0x7effe0140010 2020-10-31T22:41:53.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effe49a2700 1 -- 172.21.15.60:0/480662443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effe014ecf0 con 0x7effe0140010 2020-10-31T22:41:53.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effdd7fa700 1 -- 172.21.15.60:0/480662443 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effd8004a60 con 0x7effe0140010 2020-10-31T22:41:53.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.287+0000 7effe49a2700 1 -- 172.21.15.60:0/480662443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effe0064ea0 con 0x7effe0140010 2020-10-31T22:41:53.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.291+0000 7effe49a2700 1 -- 172.21.15.60:0/480662443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effe00646d0 con 0x7effe0140010 2020-10-31T22:41:53.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.291+0000 7effdd7fa700 1 -- 172.21.15.60:0/480662443 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7effd8010070 con 0x7effe0140010 2020-10-31T22:41:53.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.291+0000 7effdd7fa700 1 --2- 172.21.15.60:0/480662443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7effc4054f10 0x7effc40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:41:53.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.291+0000 7effdd7fa700 1 -- 172.21.15.60:0/480662443 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7effd806d410 con 0x7effe0140010 2020-10-31T22:41:53.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.291+0000 7effdf7fe700 1 --2- 172.21.15.60:0/480662443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7effc4054f10 0x7effc40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:41:53.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.291+0000 7effdf7fe700 1 --2- 172.21.15.60:0/480662443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7effc4054f10 0x7effc40573d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7effd000b000 tx=0x7effd0006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:41:53.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.299+0000 7effdd7fa700 1 -- 172.21.15.60:0/480662443 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7effd8043930 con 0x7effe0140010 2020-10-31T22:41:53.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.487+0000 7effe49a2700 1 -- 172.21.15.60:0/480662443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effe00ab200 con 0x7effe0140010 2020-10-31T22:41:53.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.487+0000 7effdd7fa700 1 -- 172.21.15.60:0/480662443 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2489 (secure 0 0 0) 0x7effd8046f50 con 0x7effe0140010 2020-10-31T22:41:53.489 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:41:53.489 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3880421132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3880421132},{"type":"v1","addr":"172.21.15.60:6835","nonce":3880421132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1151967847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1151967847},{"type":"v1","addr":"172.21.15.66:6833","nonce":1151967847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:41:48.523345+0000","modified":"2020-10-31T22:41:49.526988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4855":{"gid":4855,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2802890928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2802890928},{"type":"v1","addr":"172.21.15.60:6837","nonce":2802890928}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-10-31T22:41:53.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.487+0000 7effe49a2700 1 -- 172.21.15.60:0/480662443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7effc4054f10 msgr2=0x7effc40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:53.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.487+0000 7effe49a2700 1 --2- 172.21.15.60:0/480662443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7effc4054f10 0x7effc40573d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7effd000b000 tx=0x7effd0006dc0).stop 2020-10-31T22:41:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.487+0000 7effe49a2700 1 -- 172.21.15.60:0/480662443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe0140010 msgr2=0x7effe00649b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:41:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.487+0000 7effe49a2700 1 --2- 172.21.15.60:0/480662443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe0140010 0x7effe00649b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7effd8001210 tx=0x7effd8007cf0).stop 2020-10-31T22:41:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.487+0000 7effe49a2700 1 -- 172.21.15.60:0/480662443 shutdown_connections 2020-10-31T22:41:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.487+0000 7effe49a2700 1 --2- 172.21.15.60:0/480662443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effe0140010 0x7effe00649b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.487+0000 7effe49a2700 1 --2- 172.21.15.60:0/480662443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7effc4054f10 0x7effc40573d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.487+0000 7effe49a2700 1 --2- 172.21.15.60:0/480662443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effe00b0d60 0x7effe01468d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.487+0000 7effe49a2700 1 --2- 172.21.15.60:0/480662443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effe00b1d50 0x7effe014e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:41:53.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.487+0000 7effe49a2700 1 -- 172.21.15.60:0/480662443 >> 172.21.15.60:0/480662443 conn(0x7effe00b5300 msgr2=0x7effe0141a60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:41:53.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.487+0000 7effe49a2700 1 -- 172.21.15.60:0/480662443 shutdown_connections 2020-10-31T22:41:53.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:41:53.487+0000 7effe49a2700 1 -- 172.21.15.60:0/480662443 wait complete. 2020-10-31T22:41:53.492 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2020-10-31T22:41:53.806 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:41:48.523345+0000', 'modified': '2020-10-31T22:41:49.526988+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4855}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4855': {'gid': 4855, 'name': 'a', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/2802890928', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 2802890928}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 2802890928}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:41:53.806 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:41:53.807 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-10-31T22:41:53.940 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":4855,"want_state":"up:active","state":"up:active","rank_uptime":5.4023779369999998,"mdsmap_epoch":11,"osdmap_epoch":33,"osdmap_epoch_barrier":33,"uptime":12.786433177999999} 2020-10-31T22:41:53.941 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 4855, "mdsmap_epoch": 11, "osdmap_epoch": 33, "osdmap_epoch_barrier": 33, "rank_uptime": 5.402377937, "state": "up:active", "uptime": 12.786433178, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:41:53.943 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:41:53.943 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:41:53.943 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:41:53.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:53.944 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:53.954 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:41:54.012 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:41:54.013 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:41:54.075 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:41:54.075 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:41:54.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:54.076 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:41:54.127 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:41:54.128 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:54.170 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:41:54.187 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:41:54.188 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:41:54.245 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:41:54.246 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:41:54.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:54.248 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:41:54.249 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:41:54.244+0000 7fd3ba2720c0 -1 init, newargv = 0x55d092f4a3a0 newargc=9 2020-10-31T22:41:54.249 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13009]: starting ceph client 2020-10-31T22:41:54.259 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13009]: starting fuse 2020-10-31T22:41:55.362 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:41:55.378 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:41:55.379 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:41:55.449 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:41:55.449 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:41:55.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:55.451 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:41:55.497 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:41:55.498 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:41:55.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:55.500 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:41:55.500 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:41:55.501 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:41:55.501 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:41:55.502 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:41:55.502 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:41:55.503 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:41:55.503 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:41:55.504 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:41:55.504 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:41:55.505 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:41:55.505 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:41:55.506 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:41:55.506 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:41:55.507 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:41:55.508 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:41:55.508 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:41:55.509 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:41:55.509 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:41:55.510 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:41:55.510 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:41:55.511 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:41:55.511 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:41:55.587 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.13009.asok 2020-10-31T22:41:55.591 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13009.asok 2020-10-31T22:41:55.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:55.593 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13009.asok status 2020-10-31T22:41:55.692 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:41:55.692 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:41:55.693 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:41:55.693 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:41:55.693 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:41:55.694 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:41:55.694 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:41:55.694 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "13009", 2020-10-31T22:41:55.695 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:41:55.695 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:41:55.695 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:41:55.695 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:41:55.696 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 5067, 2020-10-31T22:41:55.696 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:41:55.696 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:41:55.697 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:41:55.697 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5067 2020-10-31T22:41:55.697 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:41:55.697 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:41:55.698 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:41:55.698 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:41:55.698 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 3485279989 2020-10-31T22:41:55.698 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:41:55.699 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:41:55.699 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:41:55.699 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:41:55.699 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:41:55.699 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 3485279989 2020-10-31T22:41:55.700 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:41:55.700 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.5067 172.21.15.152:0/3485279989", 2020-10-31T22:41:55.700 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/3485279989", 2020-10-31T22:41:55.700 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:41:55.700 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 11, 2020-10-31T22:41:55.701 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 33, 2020-10-31T22:41:55.701 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:41:55.701 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:41:55.701 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:41:55.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:55.703 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:41:55.704 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:55.711 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:41:55.711 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:41:55.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:55.712 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:55.772 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mds_min_caps_per_client 2020-10-31T22:41:55.898 INFO:teuthology.orchestra.run.smithi060.stdout:{"mds_min_caps_per_client":"100"} 2020-10-31T22:41:55.898 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mds_min_caps_per_client": "100" } 2020-10-31T22:41:55.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:41:55.899 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:41:55.899 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:41:55.911 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:41:55.911 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:41:55.912 INFO:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-10-31T22:41:55.912 INFO:teuthology.orchestra.run.smithi152:> import sys 2020-10-31T22:41:55.913 INFO:teuthology.orchestra.run.smithi152:> import time 2020-10-31T22:41:55.913 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:41:55.913 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:41:55.914 INFO:teuthology.orchestra.run.smithi152:> n = 1000 2020-10-31T22:41:55.915 INFO:teuthology.orchestra.run.smithi152:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2020-10-31T22:41:55.915 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:41:55.916 INFO:teuthology.orchestra.run.smithi152:> if not os.path.exists(os.path.dirname(abs_path)): 2020-10-31T22:41:55.916 INFO:teuthology.orchestra.run.smithi152:> os.makedirs(os.path.dirname(abs_path)) 2020-10-31T22:41:55.916 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:41:55.917 INFO:teuthology.orchestra.run.smithi152:> for i in range(0, n): 2020-10-31T22:41:55.917 INFO:teuthology.orchestra.run.smithi152:> fname = "{0}_{1}".format(abs_path, i) 2020-10-31T22:41:55.918 INFO:teuthology.orchestra.run.smithi152:> with open(fname, '"'"'w'"'"') as f: 2020-10-31T22:41:55.918 INFO:teuthology.orchestra.run.smithi152:> f.write('"'"'content'"'"') 2020-10-31T22:41:55.918 INFO:teuthology.orchestra.run.smithi152:> if True: 2020-10-31T22:41:55.919 INFO:teuthology.orchestra.run.smithi152:> f.flush() 2020-10-31T22:41:55.919 INFO:teuthology.orchestra.run.smithi152:> os.fsync(f.fileno()) 2020-10-31T22:41:55.919 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:42:08.838 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:42:08.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff53759e700 1 Processor -- start 2020-10-31T22:42:08.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff53759e700 1 -- start start 2020-10-31T22:42:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff53759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5380b0e20 0x7ff5380ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:08.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff53759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5380b5060 0x7ff5381412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff53759e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5380acc50 con 0x7ff5380ac870 2020-10-31T22:42:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff53759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5380b5490 con 0x7ff5380b0e20 2020-10-31T22:42:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff53759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5380b14c0 con 0x7ff5380b5060 2020-10-31T22:42:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff535d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5380b0e20 0x7ff5380ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff535d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff5380b0e20 0x7ff5380ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42826/0 (socket says 172.21.15.60:42826) 2020-10-31T22:42:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff535d9b700 1 -- 172.21.15.60:0/2354204263 learned_addr learned my addr 172.21.15.60:0/2354204263 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff536d9d700 1 --2- 172.21.15.60:0/2354204263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5380b5060 0x7ff5381412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff535d9b700 1 -- 172.21.15.60:0/2354204263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5380b5060 msgr2=0x7ff5381412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff535d9b700 1 --2- 172.21.15.60:0/2354204263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5380b5060 0x7ff5381412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff535d9b700 1 -- 172.21.15.60:0/2354204263 >> v1:172.21.15.66:6789/0 conn(0x7ff5380ac870 legacy=0x7ff5380ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff53559a700 1 -- 172.21.15.60:0/2354204263 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571360858 0 0) 0x7ff5380acc50 con 0x7ff5380ac870 2020-10-31T22:42:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff535d9b700 1 -- 172.21.15.60:0/2354204263 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5380b5690 con 0x7ff5380b0e20 2020-10-31T22:42:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff535d9b700 1 --2- 172.21.15.60:0/2354204263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380b0e20 0x7ff5380ae8b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7ff520002f30 tx=0x7ff520006e80).ready entity=mon.0 client_cookie=89f23ecb562a60b8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.959+0000 7ff53559a700 1 -- 172.21.15.60:0/2354204263 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff5200097f0 con 0x7ff5380b0e20 2020-10-31T22:42:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53559a700 1 -- 172.21.15.60:0/2354204263 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff520009950 con 0x7ff5380b0e20 2020-10-31T22:42:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53559a700 1 -- 172.21.15.60:0/2354204263 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff520009cb0 con 0x7ff5380b0e20 2020-10-31T22:42:08.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 -- 172.21.15.60:0/2354204263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380b0e20 msgr2=0x7ff5380ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:08.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 --2- 172.21.15.60:0/2354204263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380b0e20 0x7ff5380ae8b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7ff520002f30 tx=0x7ff520006e80).stop 2020-10-31T22:42:08.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 -- 172.21.15.60:0/2354204263 shutdown_connections 2020-10-31T22:42:08.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 --2- 172.21.15.60:0/2354204263 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5380b5060 0x7ff5381412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 --2- 172.21.15.60:0/2354204263 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380b0e20 0x7ff5380ae8b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 -- 172.21.15.60:0/2354204263 >> 172.21.15.60:0/2354204263 conn(0x7ff53806a600 msgr2=0x7ff538060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:08.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 -- 172.21.15.60:0/2354204263 shutdown_connections 2020-10-31T22:42:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 -- 172.21.15.60:0/2354204263 wait complete. 2020-10-31T22:42:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 Processor -- start 2020-10-31T22:42:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 -- start start 2020-10-31T22:42:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5380ac870 0x7ff538067170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:08.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380b0e20 0x7ff538065660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5380b5060 0x7ff538065b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5380a43c0 con 0x7ff5380b0e20 2020-10-31T22:42:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.963+0000 7ff53759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff538066040 con 0x7ff5380ac870 2020-10-31T22:42:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff53759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5380a2b20 con 0x7ff5380b5060 2020-10-31T22:42:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff535d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380b0e20 0x7ff538065660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff535d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380b0e20 0x7ff538065660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42832/0 (socket says 172.21.15.60:42832) 2020-10-31T22:42:08.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff535d9b700 1 -- 172.21.15.60:0/313157012 learned_addr learned my addr 172.21.15.60:0/313157012 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:08.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff536d9d700 1 --2- 172.21.15.60:0/313157012 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5380b5060 0x7ff538065b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:08.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff53659c700 1 --2- 172.21.15.60:0/313157012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5380ac870 0x7ff538067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff535d9b700 1 -- 172.21.15.60:0/313157012 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5380b5060 msgr2=0x7ff538065b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff535d9b700 1 --2- 172.21.15.60:0/313157012 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5380b5060 0x7ff538065b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff535d9b700 1 -- 172.21.15.60:0/313157012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5380ac870 msgr2=0x7ff538067170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff535d9b700 1 --2- 172.21.15.60:0/313157012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5380ac870 0x7ff538067170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:08.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff535d9b700 1 -- 172.21.15.60:0/313157012 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5380a2dc0 con 0x7ff5380b0e20 2020-10-31T22:42:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff535d9b700 1 --2- 172.21.15.60:0/313157012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380b0e20 0x7ff538065660 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7ff520002f30 tx=0x7ff520015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff52f7fe700 1 -- 172.21.15.60:0/313157012 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff520011a20 con 0x7ff5380b0e20 2020-10-31T22:42:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff52f7fe700 1 -- 172.21.15.60:0/313157012 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff520011b80 con 0x7ff5380b0e20 2020-10-31T22:42:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff52f7fe700 1 -- 172.21.15.60:0/313157012 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff52001e460 con 0x7ff5380b0e20 2020-10-31T22:42:08.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff53759e700 1 -- 172.21.15.60:0/313157012 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5380a3060 con 0x7ff5380b0e20 2020-10-31T22:42:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff53759e700 1 -- 172.21.15.60:0/313157012 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff538067660 con 0x7ff5380b0e20 2020-10-31T22:42:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff53759e700 1 -- 172.21.15.60:0/313157012 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff538066550 con 0x7ff5380b0e20 2020-10-31T22:42:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.967+0000 7ff52f7fe700 1 -- 172.21.15.60:0/313157012 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff520025030 con 0x7ff5380b0e20 2020-10-31T22:42:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.971+0000 7ff52f7fe700 1 --2- 172.21.15.60:0/313157012 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff51c054f90 0x7ff51c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.971+0000 7ff52f7fe700 1 -- 172.21.15.60:0/313157012 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff52006ef30 con 0x7ff5380b0e20 2020-10-31T22:42:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.971+0000 7ff53659c700 1 --2- 172.21.15.60:0/313157012 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff51c054f90 0x7ff51c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:08.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.971+0000 7ff53659c700 1 --2- 172.21.15.60:0/313157012 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff51c054f90 0x7ff51c057450 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7ff52800d000 tx=0x7ff528007cc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:08.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:08.979+0000 7ff52f7fe700 1 -- 172.21.15.60:0/313157012 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff520045450 con 0x7ff5380b0e20 2020-10-31T22:42:09.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.163+0000 7ff53759e700 1 -- 172.21.15.60:0/313157012 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff538057100 con 0x7ff5380b0e20 2020-10-31T22:42:09.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.163+0000 7ff52f7fe700 1 -- 172.21.15.60:0/313157012 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2489 (secure 0 0 0) 0x7ff520023070 con 0x7ff5380b0e20 2020-10-31T22:42:09.168 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:42:09.169 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3880421132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3880421132},{"type":"v1","addr":"172.21.15.60:6835","nonce":3880421132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1151967847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1151967847},{"type":"v1","addr":"172.21.15.66:6833","nonce":1151967847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:41:48.523345+0000","modified":"2020-10-31T22:41:49.526988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4855":{"gid":4855,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2802890928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2802890928},{"type":"v1","addr":"172.21.15.60:6837","nonce":2802890928}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-10-31T22:42:09.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.163+0000 7ff53759e700 1 -- 172.21.15.60:0/313157012 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff51c054f90 msgr2=0x7ff51c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:09.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.163+0000 7ff53759e700 1 --2- 172.21.15.60:0/313157012 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff51c054f90 0x7ff51c057450 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7ff52800d000 tx=0x7ff528007cc0).stop 2020-10-31T22:42:09.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.163+0000 7ff53759e700 1 -- 172.21.15.60:0/313157012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380b0e20 msgr2=0x7ff538065660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:09.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.163+0000 7ff53759e700 1 --2- 172.21.15.60:0/313157012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380b0e20 0x7ff538065660 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7ff520002f30 tx=0x7ff520015000).stop 2020-10-31T22:42:09.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.163+0000 7ff53759e700 1 -- 172.21.15.60:0/313157012 shutdown_connections 2020-10-31T22:42:09.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.163+0000 7ff53759e700 1 --2- 172.21.15.60:0/313157012 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5380b5060 0x7ff538065b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:09.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.163+0000 7ff53759e700 1 --2- 172.21.15.60:0/313157012 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff51c054f90 0x7ff51c057450 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:09.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.163+0000 7ff53759e700 1 --2- 172.21.15.60:0/313157012 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff5380ac870 0x7ff538067170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:09.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.163+0000 7ff53759e700 1 --2- 172.21.15.60:0/313157012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5380b0e20 0x7ff538065660 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:09.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.163+0000 7ff53759e700 1 -- 172.21.15.60:0/313157012 >> 172.21.15.60:0/313157012 conn(0x7ff53806a600 msgr2=0x7ff538060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:09.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.167+0000 7ff53759e700 1 -- 172.21.15.60:0/313157012 shutdown_connections 2020-10-31T22:42:09.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.167+0000 7ff53759e700 1 -- 172.21.15.60:0/313157012 wait complete. 2020-10-31T22:42:09.172 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2020-10-31T22:42:09.183 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_caps 20 2020-10-31T22:42:09.298 INFO:teuthology.orchestra.run.smithi060.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2020-10-31T22:42:09.299 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2020-10-31T22:42:09.300 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:42:09.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f7080d3d700 1 Processor -- start 2020-10-31T22:42:09.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f7080d3d700 1 -- start start 2020-10-31T22:42:09.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f7080d3d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f707c0b4410 0x7f707c05c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:09.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f7080d3d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707c065e90 con 0x7f707c0b2e20 2020-10-31T22:42:09.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f7080d3d700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f707c066130 con 0x7f707c05c4c0 2020-10-31T22:42:09.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f7080d3d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c141ef0 con 0x7f707c0b4410 2020-10-31T22:42:09.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f7079d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f707c0b2e20 0x7f707c142580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46976/0 (socket says 172.21.15.60:46976) 2020-10-31T22:42:09.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f7079d9b700 1 -- 172.21.15.60:0/2317256175 learned_addr learned my addr 172.21.15.60:0/2317256175 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:42:09.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f707ad9d700 1 --2- 172.21.15.60:0/2317256175 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f707c0b4410 0x7f707c05c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:09.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f707959a700 1 -- 172.21.15.60:0/2317256175 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1905120897 0 0) 0x7f707c065e90 con 0x7f707c0b2e20 2020-10-31T22:42:09.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f707959a700 1 -- 172.21.15.60:0/2317256175 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f705c003230 con 0x7f707c0b2e20 2020-10-31T22:42:09.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f707959a700 1 -- 172.21.15.60:0/2317256175 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139088902 0 0) 0x7f707c066130 con 0x7f707c05c4c0 2020-10-31T22:42:09.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f707959a700 1 -- 172.21.15.60:0/2317256175 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f707c065e90 con 0x7f707c05c4c0 2020-10-31T22:42:09.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f707ad9d700 1 -- 172.21.15.60:0/2317256175 >> v1:172.21.15.66:6789/0 conn(0x7f707c05c4c0 legacy=0x7f707c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:09.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f707959a700 1 -- 172.21.15.60:0/2317256175 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2317995036 0 0) 0x7f705c003230 con 0x7f707c0b2e20 2020-10-31T22:42:09.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f707ad9d700 1 -- 172.21.15.60:0/2317256175 >> v1:172.21.15.60:6789/0 conn(0x7f707c0b2e20 legacy=0x7f707c142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:09.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f707ad9d700 1 -- 172.21.15.60:0/2317256175 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c0663d0 con 0x7f707c0b4410 2020-10-31T22:42:09.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f707ad9d700 1 --2- 172.21.15.60:0/2317256175 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f707c0b4410 0x7f707c05c8a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f70640010d0 tx=0x7f7074006dc0).ready entity=mon.2 client_cookie=2b899e6881d7f3aa server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:09.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f707959a700 1 -- 172.21.15.60:0/2317256175 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70640016d0 con 0x7f707c0b4410 2020-10-31T22:42:09.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f707959a700 1 -- 172.21.15.60:0/2317256175 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707400d5c0 con 0x7f707c0b4410 2020-10-31T22:42:09.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f707959a700 1 -- 172.21.15.60:0/2317256175 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f707400d730 con 0x7f707c0b4410 2020-10-31T22:42:09.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f7080d3d700 1 -- 172.21.15.60:0/2317256175 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f707c0b4410 msgr2=0x7f707c05c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:09.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.403+0000 7f7080d3d700 1 --2- 172.21.15.60:0/2317256175 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f707c0b4410 0x7f707c05c8a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f70640010d0 tx=0x7f7074006dc0).stop 2020-10-31T22:42:09.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 -- 172.21.15.60:0/2317256175 shutdown_connections 2020-10-31T22:42:09.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 --2- 172.21.15.60:0/2317256175 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f707c0b4410 0x7f707c05c8a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:09.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 -- 172.21.15.60:0/2317256175 >> 172.21.15.60:0/2317256175 conn(0x7f707c0601e0 msgr2=0x7f707c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:09.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 -- 172.21.15.60:0/2317256175 shutdown_connections 2020-10-31T22:42:09.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 -- 172.21.15.60:0/2317256175 wait complete. 2020-10-31T22:42:09.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 Processor -- start 2020-10-31T22:42:09.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 -- start start 2020-10-31T22:42:09.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c05c4c0 0x7f707c1445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:09.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f707c0b4410 0x7f707c0aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:09.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f707c1544e0 0x7f707c0ab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:09.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c1493c0 con 0x7f707c05c4c0 2020-10-31T22:42:09.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c148150 con 0x7f707c0b4410 2020-10-31T22:42:09.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f707c1483f0 con 0x7f707c1544e0 2020-10-31T22:42:09.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f707a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c05c4c0 0x7f707c1445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:09.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f707a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c05c4c0 0x7f707c1445c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42844/0 (socket says 172.21.15.60:42844) 2020-10-31T22:42:09.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f707a59c700 1 -- 172.21.15.60:0/3735615636 learned_addr learned my addr 172.21.15.60:0/3735615636 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:09.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7079d9b700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f707c0b4410 0x7f707c0aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:09.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f707ad9d700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f707c1544e0 0x7f707c0ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:09.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f707a59c700 1 -- 172.21.15.60:0/3735615636 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f707c1544e0 msgr2=0x7f707c0ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:09.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f707a59c700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f707c1544e0 0x7f707c0ab3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:09.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f707a59c700 1 -- 172.21.15.60:0/3735615636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f707c0b4410 msgr2=0x7f707c0aaef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:09.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f707a59c700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f707c0b4410 0x7f707c0aaef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:09.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f707a59c700 1 -- 172.21.15.60:0/3735615636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f707c148690 con 0x7f707c05c4c0 2020-10-31T22:42:09.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7079d9b700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f707c0b4410 0x7f707c0aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:42:09.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f707a59c700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c05c4c0 0x7f707c1445c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f706c001450 tx=0x7f706c007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:09.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f70737fe700 1 -- 172.21.15.60:0/3735615636 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f706c002310 con 0x7f707c05c4c0 2020-10-31T22:42:09.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f70737fe700 1 -- 172.21.15.60:0/3735615636 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c002470 con 0x7f707c05c4c0 2020-10-31T22:42:09.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 -- 172.21.15.60:0/3735615636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c1490b0 con 0x7f707c05c4c0 2020-10-31T22:42:09.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f70737fe700 1 -- 172.21.15.60:0/3735615636 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f706c0017f0 con 0x7f707c05c4c0 2020-10-31T22:42:09.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.407+0000 7f7080d3d700 1 -- 172.21.15.60:0/3735615636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c1479c0 con 0x7f707c05c4c0 2020-10-31T22:42:09.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.411+0000 7f7080d3d700 1 -- 172.21.15.60:0/3735615636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c057100 con 0x7f707c05c4c0 2020-10-31T22:42:09.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.411+0000 7f70737fe700 1 -- 172.21.15.60:0/3735615636 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f706c019030 con 0x7f707c05c4c0 2020-10-31T22:42:09.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.411+0000 7f70737fe700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7060054f90 0x7f7060057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:09.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.411+0000 7f70737fe700 1 -- 172.21.15.60:0/3735615636 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f706c06d120 con 0x7f707c05c4c0 2020-10-31T22:42:09.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.411+0000 7f7079d9b700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7060054f90 0x7f7060057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:09.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.411+0000 7f7079d9b700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7060054f90 0x7f7060057450 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f706400b000 tx=0x7f7064000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:09.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.419+0000 7f70737fe700 1 -- 172.21.15.60:0/3735615636 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f706c043640 con 0x7f707c05c4c0 2020-10-31T22:42:09.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.603+0000 7f7080d3d700 1 -- 172.21.15.60:0/3735615636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f707c1479c0 con 0x7f707c05c4c0 2020-10-31T22:42:09.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.603+0000 7f70737fe700 1 -- 172.21.15.60:0/3735615636 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f707c1479c0 con 0x7f707c05c4c0 2020-10-31T22:42:09.845 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:42:09.846 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3880421132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3880421132},{"type":"v1","addr":"172.21.15.60:6835","nonce":3880421132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1151967847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1151967847},{"type":"v1","addr":"172.21.15.66:6833","nonce":1151967847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:41:48.523345+0000","modified":"2020-10-31T22:41:49.526988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4855":{"gid":4855,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2802890928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2802890928},{"type":"v1","addr":"172.21.15.60:6837","nonce":2802890928}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-10-31T22:42:09.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.607+0000 7f7080d3d700 1 -- 172.21.15.60:0/3735615636 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7060054f90 msgr2=0x7f7060057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:09.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.607+0000 7f7080d3d700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7060054f90 0x7f7060057450 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f706400b000 tx=0x7f7064000b80).stop 2020-10-31T22:42:09.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.607+0000 7f7080d3d700 1 -- 172.21.15.60:0/3735615636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c05c4c0 msgr2=0x7f707c1445c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:09.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.607+0000 7f7080d3d700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c05c4c0 0x7f707c1445c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f706c001450 tx=0x7f706c007da0).stop 2020-10-31T22:42:09.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.607+0000 7f7080d3d700 1 -- 172.21.15.60:0/3735615636 shutdown_connections 2020-10-31T22:42:09.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.607+0000 7f7080d3d700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f707c1544e0 0x7f707c0ab3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:09.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.607+0000 7f7080d3d700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f707c05c4c0 0x7f707c1445c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:09.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.607+0000 7f7080d3d700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7060054f90 0x7f7060057450 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:09.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.607+0000 7f7080d3d700 1 --2- 172.21.15.60:0/3735615636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f707c0b4410 0x7f707c0aaef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:09.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.607+0000 7f7080d3d700 1 -- 172.21.15.60:0/3735615636 >> 172.21.15.60:0/3735615636 conn(0x7f707c0601e0 msgr2=0x7f707c0b89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:09.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.607+0000 7f7080d3d700 1 -- 172.21.15.60:0/3735615636 shutdown_connections 2020-10-31T22:42:09.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:09.607+0000 7f7080d3d700 1 -- 172.21.15.60:0/3735615636 wait complete. 2020-10-31T22:42:09.850 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2020-10-31T22:42:09.851 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_recall_max_decay_threshold 400 2020-10-31T22:42:09.973 INFO:teuthology.orchestra.run.smithi060.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2020-10-31T22:42:09.973 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2020-10-31T22:42:09.974 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:42:10.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c7bfb700 1 Processor -- start 2020-10-31T22:42:10.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c7bfb700 1 -- start start 2020-10-31T22:42:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c7bfb700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f01c005b960 0x7f01c005bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c7bfb700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01c0146790 0x7f01c0146be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c7bfb700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01c00af200 con 0x7f01c00a7850 2020-10-31T22:42:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c7bfb700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01c00b0f00 con 0x7f01c005b960 2020-10-31T22:42:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c7bfb700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c00b11a0 con 0x7f01c0146790 2020-10-31T22:42:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c5997700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f01c005b960 0x7f01c005bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c5196700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f01c00a7850 0x7f01c00aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:46988/0 (socket says 172.21.15.60:46988) 2020-10-31T22:42:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c5196700 1 -- 172.21.15.60:0/3331200122 learned_addr learned my addr 172.21.15.60:0/3331200122 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:42:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c6198700 1 --2- 172.21.15.60:0/3331200122 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01c0146790 0x7f01c0146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c4995700 1 -- 172.21.15.60:0/3331200122 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110085129 0 0) 0x7f01c00af200 con 0x7f01c00a7850 2020-10-31T22:42:10.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c4995700 1 -- 172.21.15.60:0/3331200122 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01a8003230 con 0x7f01c00a7850 2020-10-31T22:42:10.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c5997700 1 -- 172.21.15.60:0/3331200122 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01c0146790 msgr2=0x7f01c0146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c5997700 1 --2- 172.21.15.60:0/3331200122 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01c0146790 0x7f01c0146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c5997700 1 -- 172.21.15.60:0/3331200122 >> v1:172.21.15.60:6789/0 conn(0x7f01c00a7850 legacy=0x7f01c00aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c5997700 1 -- 172.21.15.60:0/3331200122 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c00b1440 con 0x7f01c005b960 2020-10-31T22:42:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c5997700 1 --2- 172.21.15.60:0/3331200122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c005b960 0x7f01c005bd40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f01b0002f30 tx=0x7f01b0006dc0).ready entity=mon.0 client_cookie=826e927048e7f5b5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c4995700 1 -- 172.21.15.60:0/3331200122 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01b00096a0 con 0x7f01c005b960 2020-10-31T22:42:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c4995700 1 -- 172.21.15.60:0/3331200122 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b0009800 con 0x7f01c005b960 2020-10-31T22:42:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c4995700 1 -- 172.21.15.60:0/3331200122 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01b0009b60 con 0x7f01c005b960 2020-10-31T22:42:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c7bfb700 1 -- 172.21.15.60:0/3331200122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c005b960 msgr2=0x7f01c005bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.079+0000 7f01c7bfb700 1 --2- 172.21.15.60:0/3331200122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c005b960 0x7f01c005bd40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f01b0002f30 tx=0x7f01b0006dc0).stop 2020-10-31T22:42:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.083+0000 7f01c7bfb700 1 -- 172.21.15.60:0/3331200122 shutdown_connections 2020-10-31T22:42:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.083+0000 7f01c7bfb700 1 --2- 172.21.15.60:0/3331200122 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01c0146790 0x7f01c0146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.083+0000 7f01c7bfb700 1 --2- 172.21.15.60:0/3331200122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c005b960 0x7f01c005bd40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.083+0000 7f01c7bfb700 1 -- 172.21.15.60:0/3331200122 >> 172.21.15.60:0/3331200122 conn(0x7f01c006a260 msgr2=0x7f01c0061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:10.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.083+0000 7f01c7bfb700 1 -- 172.21.15.60:0/3331200122 shutdown_connections 2020-10-31T22:42:10.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.083+0000 7f01c7bfb700 1 -- 172.21.15.60:0/3331200122 wait complete. 2020-10-31T22:42:10.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.083+0000 7f01c7bfb700 1 Processor -- start 2020-10-31T22:42:10.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.083+0000 7f01c7bfb700 1 -- start start 2020-10-31T22:42:10.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c7bfb700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01c005b960 0x7f01c014ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c7bfb700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01c00a7850 0x7f01c00b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c7bfb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0146790 0x7f01c0158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c7bfb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c014bff0 con 0x7f01c0146790 2020-10-31T22:42:10.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c7bfb700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01c00b4b00 con 0x7f01c00a7850 2020-10-31T22:42:10.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c7bfb700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01c00ade20 con 0x7f01c005b960 2020-10-31T22:42:10.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c6198700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0146790 0x7f01c0158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c6198700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0146790 0x7f01c0158680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42862/0 (socket says 172.21.15.60:42862) 2020-10-31T22:42:10.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c6198700 1 -- 172.21.15.60:0/409539616 learned_addr learned my addr 172.21.15.60:0/409539616 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:10.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c5997700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01c005b960 0x7f01c014ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c5196700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01c00a7850 0x7f01c00b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c6198700 1 -- 172.21.15.60:0/409539616 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01c005b960 msgr2=0x7f01c014ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:10.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c6198700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01c005b960 0x7f01c014ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c6198700 1 -- 172.21.15.60:0/409539616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01c00a7850 msgr2=0x7f01c00b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:10.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c6198700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01c00a7850 0x7f01c00b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c6198700 1 -- 172.21.15.60:0/409539616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c00b4d60 con 0x7f01c0146790 2020-10-31T22:42:10.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c5997700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01c005b960 0x7f01c014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:42:10.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c6198700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0146790 0x7f01c0158680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f01b8006dd0 tx=0x7f01b80091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:10.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01aeffd700 1 -- 172.21.15.60:0/409539616 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01b800ee70 con 0x7f01c0146790 2020-10-31T22:42:10.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01aeffd700 1 -- 172.21.15.60:0/409539616 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b800cb00 con 0x7f01c0146790 2020-10-31T22:42:10.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01aeffd700 1 -- 172.21.15.60:0/409539616 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01b800ce60 con 0x7f01c0146790 2020-10-31T22:42:10.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c7bfb700 1 -- 172.21.15.60:0/409539616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01c00b3610 con 0x7f01c0146790 2020-10-31T22:42:10.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.087+0000 7f01c7bfb700 1 -- 172.21.15.60:0/409539616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01c014b930 con 0x7f01c0146790 2020-10-31T22:42:10.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.091+0000 7f01c7bfb700 1 -- 172.21.15.60:0/409539616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01c0057100 con 0x7f01c0146790 2020-10-31T22:42:10.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.091+0000 7f01aeffd700 1 -- 172.21.15.60:0/409539616 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f01b8022070 con 0x7f01c0146790 2020-10-31T22:42:10.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.091+0000 7f01aeffd700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f01a0054f10 0x7f01a00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.091+0000 7f01aeffd700 1 -- 172.21.15.60:0/409539616 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f01b806e130 con 0x7f01c0146790 2020-10-31T22:42:10.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.091+0000 7f01c5997700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f01a0054f10 0x7f01a00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.091+0000 7f01c5997700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f01a0054f10 0x7f01a00573d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f01b001b000 tx=0x7f01b0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:10.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.099+0000 7f01aeffd700 1 -- 172.21.15.60:0/409539616 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f01b8044540 con 0x7f01c0146790 2020-10-31T22:42:10.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.303+0000 7f01c7bfb700 1 -- 172.21.15.60:0/409539616 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01c005aa70 con 0x7f01c0146790 2020-10-31T22:42:10.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.303+0000 7f01aeffd700 1 -- 172.21.15.60:0/409539616 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2489 (secure 0 0 0) 0x7f01b8016070 con 0x7f01c0146790 2020-10-31T22:42:10.305 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:42:10.306 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3880421132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3880421132},{"type":"v1","addr":"172.21.15.60:6835","nonce":3880421132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1151967847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1151967847},{"type":"v1","addr":"172.21.15.66:6833","nonce":1151967847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:41:48.523345+0000","modified":"2020-10-31T22:41:49.526988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4855":{"gid":4855,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2802890928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2802890928},{"type":"v1","addr":"172.21.15.60:6837","nonce":2802890928}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-10-31T22:42:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.303+0000 7f01c7bfb700 1 -- 172.21.15.60:0/409539616 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f01a0054f10 msgr2=0x7f01a00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.303+0000 7f01c7bfb700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f01a0054f10 0x7f01a00573d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f01b001b000 tx=0x7f01b0015000).stop 2020-10-31T22:42:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.303+0000 7f01c7bfb700 1 -- 172.21.15.60:0/409539616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0146790 msgr2=0x7f01c0158680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.303+0000 7f01c7bfb700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0146790 0x7f01c0158680 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7f01b8006dd0 tx=0x7f01b80091a0).stop 2020-10-31T22:42:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.303+0000 7f01c7bfb700 1 -- 172.21.15.60:0/409539616 shutdown_connections 2020-10-31T22:42:10.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.303+0000 7f01c7bfb700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c0146790 0x7f01c0158680 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.303+0000 7f01c7bfb700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01c005b960 0x7f01c014ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.303+0000 7f01c7bfb700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f01a0054f10 0x7f01a00573d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.303+0000 7f01c7bfb700 1 --2- 172.21.15.60:0/409539616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01c00a7850 0x7f01c00b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.303+0000 7f01c7bfb700 1 -- 172.21.15.60:0/409539616 >> 172.21.15.60:0/409539616 conn(0x7f01c006a260 msgr2=0x7f01c00ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:10.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.303+0000 7f01c7bfb700 1 -- 172.21.15.60:0/409539616 shutdown_connections 2020-10-31T22:42:10.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.303+0000 7f01c7bfb700 1 -- 172.21.15.60:0/409539616 wait complete. 2020-10-31T22:42:10.310 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2020-10-31T22:42:10.319 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mds.a cache drop 2020-10-31T22:42:10.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7f14a4700 1 Processor -- start 2020-10-31T22:42:10.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7f14a4700 1 -- start start 2020-10-31T22:42:10.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7f14a4700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd7ec0ac870 0x7fd7ec0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7f14a4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd7ec0b0e20 0x7fd7ec0ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7f14a4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0ae690 0x7fd7ec1412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7f14a4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec0b14c0 con 0x7fd7ec0b0e20 2020-10-31T22:42:10.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7f14a4700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7ec0acc50 con 0x7fd7ec0ac870 2020-10-31T22:42:10.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7f14a4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0b5690 con 0x7fd7ec0ae690 2020-10-31T22:42:10.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7eb7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd7ec0b0e20 0x7fd7ec0ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7eb7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd7ec0b0e20 0x7fd7ec0ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42868/0 (socket says 172.21.15.60:42868) 2020-10-31T22:42:10.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7eb7fe700 1 -- 172.21.15.60:0/2646335028 learned_addr learned my addr 172.21.15.60:0/2646335028 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:10.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7f0ca3700 1 --2- 172.21.15.60:0/2646335028 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0ae690 0x7fd7ec1412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7ebfff700 1 --2- 172.21.15.60:0/2646335028 >> v2:172.21.15.66:3300/0 conn(0x7fd7ec0ac870 0x7fd7ec0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7eb7fe700 1 -- 172.21.15.60:0/2646335028 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0ae690 msgr2=0x7fd7ec1412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:10.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/2646335028 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0ae690 0x7fd7ec1412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7eb7fe700 1 -- 172.21.15.60:0/2646335028 >> v2:172.21.15.66:3300/0 conn(0x7fd7ec0ac870 msgr2=0x7fd7ec0b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:10.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/2646335028 >> v2:172.21.15.66:3300/0 conn(0x7fd7ec0ac870 0x7fd7ec0b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7eb7fe700 1 -- 172.21.15.60:0/2646335028 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec0afc10 con 0x7fd7ec0b0e20 2020-10-31T22:42:10.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/2646335028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec0b0e20 0x7fd7ec0ae1a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fd7dc002f30 tx=0x7fd7dc006e80).ready entity=mon.0 client_cookie=cc87647ce792656b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:10.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7eaffd700 1 -- 172.21.15.60:0/2646335028 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7dc0096d0 con 0x7fd7ec0b0e20 2020-10-31T22:42:10.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7eaffd700 1 -- 172.21.15.60:0/2646335028 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc009830 con 0x7fd7ec0b0e20 2020-10-31T22:42:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7eaffd700 1 -- 172.21.15.60:0/2646335028 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7dc009b90 con 0x7fd7ec0b0e20 2020-10-31T22:42:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7f14a4700 1 -- 172.21.15.60:0/2646335028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec0b0e20 msgr2=0x7fd7ec0ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.423+0000 7fd7f14a4700 1 --2- 172.21.15.60:0/2646335028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec0b0e20 0x7fd7ec0ae1a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fd7dc002f30 tx=0x7fd7dc006e80).stop 2020-10-31T22:42:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 -- 172.21.15.60:0/2646335028 shutdown_connections 2020-10-31T22:42:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 --2- 172.21.15.60:0/2646335028 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0ae690 0x7fd7ec1412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 --2- 172.21.15.60:0/2646335028 >> v2:172.21.15.66:3300/0 conn(0x7fd7ec0ac870 0x7fd7ec0b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 --2- 172.21.15.60:0/2646335028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec0b0e20 0x7fd7ec0ae1a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 -- 172.21.15.60:0/2646335028 >> 172.21.15.60:0/2646335028 conn(0x7fd7ec06a600 msgr2=0x7fd7ec060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:10.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 -- 172.21.15.60:0/2646335028 shutdown_connections 2020-10-31T22:42:10.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 -- 172.21.15.60:0/2646335028 wait complete. 2020-10-31T22:42:10.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 Processor -- start 2020-10-31T22:42:10.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 -- start start 2020-10-31T22:42:10.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0ac870 0x7fd7ec05b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7ec0ae690 0x7fd7ec13a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec0b0e20 0x7fd7ec13aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec13e060 con 0x7fd7ec0b0e20 2020-10-31T22:42:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec140580 con 0x7fd7ec0ae690 2020-10-31T22:42:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f14a4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec13b320 con 0x7fd7ec0ac870 2020-10-31T22:42:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f0ca3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec0b0e20 0x7fd7ec13aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f0ca3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec0b0e20 0x7fd7ec13aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42876/0 (socket says 172.21.15.60:42876) 2020-10-31T22:42:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f0ca3700 1 -- 172.21.15.60:0/2054565537 learned_addr learned my addr 172.21.15.60:0/2054565537 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7ebfff700 1 --2- 172.21.15.60:0/2054565537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0ac870 0x7fd7ec05b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/2054565537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7ec0ae690 0x7fd7ec13a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f0ca3700 1 -- 172.21.15.60:0/2054565537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0ac870 msgr2=0x7fd7ec05b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f0ca3700 1 --2- 172.21.15.60:0/2054565537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0ac870 0x7fd7ec05b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f0ca3700 1 -- 172.21.15.60:0/2054565537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7ec0ae690 msgr2=0x7fd7ec13a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f0ca3700 1 --2- 172.21.15.60:0/2054565537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7ec0ae690 0x7fd7ec13a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f0ca3700 1 -- 172.21.15.60:0/2054565537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec13b5c0 con 0x7fd7ec0b0e20 2020-10-31T22:42:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7f0ca3700 1 --2- 172.21.15.60:0/2054565537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec0b0e20 0x7fd7ec13aad0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fd7ec1408c0 tx=0x7fd7e0006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.427+0000 7fd7e97fa700 1 -- 172.21.15.60:0/2054565537 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e000ca10 con 0x7fd7ec0b0e20 2020-10-31T22:42:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.431+0000 7fd7e97fa700 1 -- 172.21.15.60:0/2054565537 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e000cb70 con 0x7fd7ec0b0e20 2020-10-31T22:42:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.431+0000 7fd7e97fa700 1 -- 172.21.15.60:0/2054565537 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e000ced0 con 0x7fd7ec0b0e20 2020-10-31T22:42:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.431+0000 7fd7f14a4700 1 -- 172.21.15.60:0/2054565537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec0a8200 con 0x7fd7ec0b0e20 2020-10-31T22:42:10.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.431+0000 7fd7f14a4700 1 -- 172.21.15.60:0/2054565537 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec13afc0 con 0x7fd7ec0b0e20 2020-10-31T22:42:10.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.431+0000 7fd7e97fa700 1 -- 172.21.15.60:0/2054565537 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd7e001c460 con 0x7fd7ec0b0e20 2020-10-31T22:42:10.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.431+0000 7fd7e97fa700 1 --2- 172.21.15.60:0/2054565537 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd7cc054f30 0x7fd7cc0573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.431+0000 7fd7e97fa700 1 -- 172.21.15.60:0/2054565537 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd7e006dda0 con 0x7fd7ec0b0e20 2020-10-31T22:42:10.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.431+0000 7fd7ebfff700 1 --2- 172.21.15.60:0/2054565537 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd7cc054f30 0x7fd7cc0573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.431+0000 7fd7ebfff700 1 --2- 172.21.15.60:0/2054565537 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd7cc054f30 0x7fd7cc0573f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fd7e400b000 tx=0x7fd7e40091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:10.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 Processor -- start 2020-10-31T22:42:10.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 -- start start 2020-10-31T22:42:10.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf0cb10 0xf587f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf90020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd07c00 0xf90510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0xe12230 con 0xd75800 2020-10-31T22:42:10.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0xe81dd0 con 0xd07c00 2020-10-31T22:42:10.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0xd8e690 con 0xf0cb10 2020-10-31T22:42:10.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7eb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf90020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7eb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf90020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42882/0 (socket says 172.21.15.60:42882) 2020-10-31T22:42:10.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7eb7fe700 1 -- 172.21.15.60:0/289065710 learned_addr learned my addr 172.21.15.60:0/289065710 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:10.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7ebfff700 1 --2- 172.21.15.60:0/289065710 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf0cb10 0xf587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7f0ca3700 1 --2- 172.21.15.60:0/289065710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd07c00 0xf90510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7eb7fe700 1 -- 172.21.15.60:0/289065710 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf0cb10 msgr2=0xf587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:10.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/289065710 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf0cb10 0xf587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7eb7fe700 1 -- 172.21.15.60:0/289065710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd07c00 msgr2=0xf90510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:10.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/289065710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd07c00 0xf90510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7eb7fe700 1 -- 172.21.15.60:0/289065710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xea2b90 con 0xd75800 2020-10-31T22:42:10.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7f0ca3700 1 --2- 172.21.15.60:0/289065710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd07c00 0xf90510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:42:10.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/289065710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf90020 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0xf91420 tx=0x7fd7dc015000).ready entity=mon.0 client_cookie=204af255afac71a3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:10.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7f14a4700 1 -- 172.21.15.60:0/289065710 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7dc0098e0 con 0xd75800 2020-10-31T22:42:10.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7f14a4700 1 -- 172.21.15.60:0/289065710 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc009a40 con 0xd75800 2020-10-31T22:42:10.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd7f14a4700 1 -- 172.21.15.60:0/289065710 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7dc01e430 con 0xd75800 2020-10-31T22:42:10.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 -- 172.21.15.60:0/289065710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 msgr2=0xf90020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:10.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 --2- 172.21.15.60:0/289065710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf90020 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0xf91420 tx=0x7fd7dc015000).stop 2020-10-31T22:42:10.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 -- 172.21.15.60:0/289065710 shutdown_connections 2020-10-31T22:42:10.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 --2- 172.21.15.60:0/289065710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd07c00 0xf90510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 --2- 172.21.15.60:0/289065710 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf0cb10 0xf587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 --2- 172.21.15.60:0/289065710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf90020 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 -- 172.21.15.60:0/289065710 >> 172.21.15.60:0/289065710 conn(0xf3c710 msgr2=0xf540d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:10.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 -- 172.21.15.60:0/289065710 shutdown_connections 2020-10-31T22:42:10.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.435+0000 7fd80109e740 1 -- 172.21.15.60:0/289065710 wait complete. 2020-10-31T22:42:10.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd80109e740 1 -- start start 2020-10-31T22:42:10.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd80109e740 1 Processor -- start 2020-10-31T22:42:10.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd80109e740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xd07c00 0xf89a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd80109e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf89f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd80109e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xf0cb10 0xf92560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd80109e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0xeb1840 con 0xd75800 2020-10-31T22:42:10.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd80109e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0xeb1980 con 0xf0cb10 2020-10-31T22:42:10.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd80109e740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0xeb2f50 con 0xd07c00 2020-10-31T22:42:10.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd80109e740 10 client.0 ll_register_callbacks cb 0xea84e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2020-10-31T22:42:10.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd7ebfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xd07c00 0xf89a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd7ebfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xd07c00 0xf89a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:56074/0 (socket says 172.21.15.60:56074) 2020-10-31T22:42:10.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd7ebfff700 1 -- 172.21.15.60:0/2924038500 learned_addr learned my addr 172.21.15.60:0/2924038500 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:10.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd7ebfff700 1 -- 172.21.15.60:0/2924038500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xf0cb10 msgr2=0xf92560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:10.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd7ebfff700 1 --2- 172.21.15.60:0/2924038500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xf0cb10 0xf92560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-10-31T22:42:10.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd7ebfff700 1 -- 172.21.15.60:0/2924038500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 msgr2=0xf89f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:10.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd7ebfff700 1 --2- 172.21.15.60:0/2924038500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf89f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-10-31T22:42:10.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd7ebfff700 1 -- 172.21.15.60:0/2924038500 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0xd25770 con 0xd07c00 2020-10-31T22:42:10.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd7ebfff700 1 --2- 172.21.15.60:0/2924038500 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xd07c00 0xf89a30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd7e4009320 tx=0x7fd7e4014000).ready entity=mon.2 client_cookie=e26a53d7dba73d2c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:10.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd7c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.66:3301/0 2020-10-31T22:42:10.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd7c6ffd700 1 -- 172.21.15.60:0/2924038500 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e4012a30 con 0xd07c00 2020-10-31T22:42:10.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd7c6ffd700 1 -- 172.21.15.60:0/2924038500 <== mon.2 v2:172.21.15.66:3301/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd7e4012b90 con 0xd07c00 2020-10-31T22:42:10.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.439+0000 7fd80109e740 1 -- 172.21.15.60:0/2924038500 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xe627f0 con 0xd07c00 2020-10-31T22:42:10.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd7c6ffd700 1 -- 172.21.15.60:0/2924038500 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_get_version_reply(handle=1 version=11) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7e4012d50 con 0xd07c00 2020-10-31T22:42:10.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 10 client.4859 fetch_fsmap learned FSMap version 11 2020-10-31T22:42:10.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 1 -- 172.21.15.60:0/2924038500 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) v3 -- 0xd30e50 con 0xd07c00 2020-10-31T22:42:10.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd7c6ffd700 1 -- 172.21.15.60:0/2924038500 <== mon.2 v2:172.21.15.66:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xe627f0 con 0xd07c00 2020-10-31T22:42:10.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd7c6ffd700 1 -- 172.21.15.60:0/2924038500 <== mon.2 v2:172.21.15.66:3301/0 5 ==== fsmap(e 11) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fd7e401fa00 con 0xd07c00 2020-10-31T22:42:10.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 10 client.4859 fetch_fsmap finished waiting for FSMap version 11 2020-10-31T22:42:10.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 10 client.4859 resolve_mds: resolved ID 'a' to GID 4855 2020-10-31T22:42:10.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 20 client.4859 populate_metadata read hostname 'smithi060' 2020-10-31T22:42:10.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 1 --2- 172.21.15.60:0/2924038500 >> [v2:172.21.15.60:6836/2802890928,v1:172.21.15.60:6837/2802890928] conn(0xf96f00 0xf94250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 4 client.4859 mds_command: new command op to 4855 tid=0[{"prefix": "get_command_descriptions"}] 2020-10-31T22:42:10.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 1 -- 172.21.15.60:0/2924038500 --> [v2:172.21.15.60:6836/2802890928,v1:172.21.15.60:6837/2802890928] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xd9a8b0 con 0xf96f00 2020-10-31T22:42:10.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/2924038500 >> [v2:172.21.15.60:6836/2802890928,v1:172.21.15.60:6837/2802890928] conn(0xf96f00 0xf94250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd7c6ffd700 10 client.4859 ms_handle_connect on v2:172.21.15.60:6836/2802890928 2020-10-31T22:42:10.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/2924038500 >> [v2:172.21.15.60:6836/2802890928,v1:172.21.15.60:6837/2802890928] conn(0xf96f00 0xf94250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=be9595cfa2e98ecf server_cookie=d9c2b4a594bf2a6 in_seq=0 out_seq=0 2020-10-31T22:42:10.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd7c6ffd700 1 -- 172.21.15.60:0/2924038500 <== mds.0 v2:172.21.15.60:6836/2802890928 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16606 (crc 0 0 0) 0xd9a8b0 con 0xf96f00 2020-10-31T22:42:10.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd7c6ffd700 10 client.4859 handle_command_reply: tid=0 2020-10-31T22:42:10.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 1 client.4859 shutdown 2020-10-31T22:42:10.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 1 -- 172.21.15.60:0/2924038500 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xd07c00 msgr2=0xf89a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:10.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 1 --2- 172.21.15.60:0/2924038500 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xd07c00 0xf89a30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd7e4009320 tx=0x7fd7e4014000).stop 2020-10-31T22:42:10.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 1 -- 172.21.15.60:0/2924038500 shutdown_connections 2020-10-31T22:42:10.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 1 --2- 172.21.15.60:0/2924038500 >> [v2:172.21.15.60:6836/2802890928,v1:172.21.15.60:6837/2802890928] conn(0xf96f00 0xf94250 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 1 --2- 172.21.15.60:0/2924038500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xf0cb10 0xf92560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-10-31T22:42:10.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 1 --2- 172.21.15.60:0/2924038500 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xd07c00 0xf89a30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 1 --2- 172.21.15.60:0/2924038500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf89f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-10-31T22:42:10.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 1 -- 172.21.15.60:0/2924038500 >> 172.21.15.60:0/2924038500 conn(0xf3c710 msgr2=0xf5a910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:10.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd7c6ffd700 0 client.4859 ms_handle_reset on v2:172.21.15.60:6836/2802890928 2020-10-31T22:42:10.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 1 -- 172.21.15.60:0/2924038500 shutdown_connections 2020-10-31T22:42:10.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 1 -- 172.21.15.60:0/2924038500 wait complete. 2020-10-31T22:42:10.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.443+0000 7fd80109e740 20 client.4859 trim_cache size 0 max 16384 2020-10-31T22:42:10.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 Processor -- start 2020-10-31T22:42:10.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 -- start start 2020-10-31T22:42:10.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd07c00 0xf5a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf53ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf0cb10 0xf543d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0xe94390 con 0xd75800 2020-10-31T22:42:10.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0xf3bdd0 con 0xd07c00 2020-10-31T22:42:10.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0xd9a8b0 con 0xf0cb10 2020-10-31T22:42:10.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7eb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf53ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7eb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf53ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42896/0 (socket says 172.21.15.60:42896) 2020-10-31T22:42:10.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7eb7fe700 1 -- 172.21.15.60:0/1270286231 learned_addr learned my addr 172.21.15.60:0/1270286231 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:10.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7ebfff700 1 --2- 172.21.15.60:0/1270286231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd07c00 0xf5a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7f0ca3700 1 --2- 172.21.15.60:0/1270286231 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf0cb10 0xf543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7eb7fe700 1 -- 172.21.15.60:0/1270286231 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf0cb10 msgr2=0xf543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:10.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/1270286231 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf0cb10 0xf543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7eb7fe700 1 -- 172.21.15.60:0/1270286231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd07c00 msgr2=0xf5a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:10.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/1270286231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd07c00 0xf5a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7eb7fe700 1 -- 172.21.15.60:0/1270286231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec0a9420 con 0xd75800 2020-10-31T22:42:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7ebfff700 1 --2- 172.21.15.60:0/1270286231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd07c00 0xf5a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:42:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7f0ca3700 1 --2- 172.21.15.60:0/1270286231 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf0cb10 0xf543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:42:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/1270286231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf53ee0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0xf57280 tx=0x7fd7dc02d0f0).ready entity=mon.0 client_cookie=632683275e408c38 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7d17fa700 1 -- 172.21.15.60:0/1270286231 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7dc006880 con 0xd75800 2020-10-31T22:42:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7d17fa700 1 -- 172.21.15.60:0/1270286231 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc01e430 con 0xd75800 2020-10-31T22:42:10.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd7d17fa700 1 -- 172.21.15.60:0/1270286231 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7dc01e790 con 0xd75800 2020-10-31T22:42:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 -- 172.21.15.60:0/1270286231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 msgr2=0xf53ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 --2- 172.21.15.60:0/1270286231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf53ee0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0xf57280 tx=0x7fd7dc02d0f0).stop 2020-10-31T22:42:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 -- 172.21.15.60:0/1270286231 shutdown_connections 2020-10-31T22:42:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 --2- 172.21.15.60:0/1270286231 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf0cb10 0xf543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 --2- 172.21.15.60:0/1270286231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd07c00 0xf5a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 --2- 172.21.15.60:0/1270286231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd75800 0xf53ee0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 -- 172.21.15.60:0/1270286231 >> 172.21.15.60:0/1270286231 conn(0xf3c710 msgr2=0xf56610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:10.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 -- 172.21.15.60:0/1270286231 shutdown_connections 2020-10-31T22:42:10.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 -- 172.21.15.60:0/1270286231 wait complete. 2020-10-31T22:42:10.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 -- start start 2020-10-31T22:42:10.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.459+0000 7fd80109e740 1 Processor -- start 2020-10-31T22:42:10.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd07c00 0xf589a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xd75800 0xf58e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xf0cb10 0xf53e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0xf8bba0 con 0xd07c00 2020-10-31T22:42:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0xf59720 con 0xf0cb10 2020-10-31T22:42:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0xfa2a40 con 0xd75800 2020-10-31T22:42:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 10 client.0 ll_register_callbacks cb 0xf8b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2020-10-31T22:42:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7ebfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd07c00 0xf589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7ebfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd07c00 0xf589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42900/0 (socket says 172.21.15.60:42900) 2020-10-31T22:42:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7ebfff700 1 -- 172.21.15.60:0/2885055731 learned_addr learned my addr 172.21.15.60:0/2885055731 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7f0ca3700 1 --2- 172.21.15.60:0/2885055731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xf0cb10 0xf53e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/2885055731 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xd75800 0xf58e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7ebfff700 1 -- 172.21.15.60:0/2885055731 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xd75800 msgr2=0xf58e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7ebfff700 1 --2- 172.21.15.60:0/2885055731 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xd75800 0xf58e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7ebfff700 1 -- 172.21.15.60:0/2885055731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xf0cb10 msgr2=0xf53e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7ebfff700 1 --2- 172.21.15.60:0/2885055731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xf0cb10 0xf53e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7ebfff700 1 -- 172.21.15.60:0/2885055731 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xf8fc80 con 0xd07c00 2020-10-31T22:42:10.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7ebfff700 1 --2- 172.21.15.60:0/2885055731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd07c00 0xf589a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fd7e4031000 tx=0x7fd7e4024000).ready entity=mon.0 client_cookie=bed78e80f83e053c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:10.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7c7fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2020-10-31T22:42:10.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7c7fff700 1 -- 172.21.15.60:0/2885055731 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e4036070 con 0xd07c00 2020-10-31T22:42:10.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7c7fff700 1 -- 172.21.15.60:0/2885055731 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd7e4005a40 con 0xd07c00 2020-10-31T22:42:10.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 1 -- 172.21.15.60:0/2885055731 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xd6b4b0 con 0xd07c00 2020-10-31T22:42:10.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7c7fff700 1 -- 172.21.15.60:0/2885055731 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=11) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7e4005c00 con 0xd07c00 2020-10-31T22:42:10.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 10 client.5103 fetch_fsmap learned FSMap version 11 2020-10-31T22:42:10.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 1 -- 172.21.15.60:0/2885055731 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=11,monmap=2+}) v3 -- 0xf8bdd0 con 0xd07c00 2020-10-31T22:42:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7c7fff700 1 -- 172.21.15.60:0/2885055731 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xd6b4b0 con 0xd07c00 2020-10-31T22:42:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7c7fff700 1 -- 172.21.15.60:0/2885055731 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 11) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fd7e4039030 con 0xd07c00 2020-10-31T22:42:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 10 client.5103 fetch_fsmap finished waiting for FSMap version 11 2020-10-31T22:42:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 10 client.5103 resolve_mds: resolved ID 'a' to GID 4855 2020-10-31T22:42:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 20 client.5103 populate_metadata read hostname 'smithi060' 2020-10-31T22:42:10.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 1 --2- 172.21.15.60:0/2885055731 >> [v2:172.21.15.60:6836/2802890928,v1:172.21.15.60:6837/2802890928] conn(0xf54360 0xf57510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 4 client.5103 mds_command: new command op to 4855 tid=0[{"prefix": "cache drop"}] 2020-10-31T22:42:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd80109e740 1 -- 172.21.15.60:0/2885055731 --> [v2:172.21.15.60:6836/2802890928,v1:172.21.15.60:6837/2802890928] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0xdb9710 con 0xf54360 2020-10-31T22:42:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/2885055731 >> [v2:172.21.15.60:6836/2802890928,v1:172.21.15.60:6837/2802890928] conn(0xf54360 0xf57510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7c7fff700 10 client.5103 ms_handle_connect on v2:172.21.15.60:6836/2802890928 2020-10-31T22:42:10.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:10.463+0000 7fd7eb7fe700 1 --2- 172.21.15.60:0/2885055731 >> [v2:172.21.15.60:6836/2802890928,v1:172.21.15.60:6837/2802890928] conn(0xf54360 0xf57510 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=4341636f66c9d6ab server_cookie=535cbeaf8e644956 in_seq=0 out_seq=0 2020-10-31T22:42:14.370 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:42:14.373 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:42:14.376 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:42:14.378 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:42:44.426 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:42:44.429 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:42:44.431 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:42:44.433 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:42:54.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7c7fff700 1 -- 172.21.15.60:0/2885055731 <== mds.0 v2:172.21.15.60:6836/2802890928 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+386 (crc 0 0 0) 0xdb9710 con 0xf54360 2020-10-31T22:42:54.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7c7fff700 10 client.5103 handle_command_reply: tid=0 2020-10-31T22:42:54.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd80109e740 1 client.5103 shutdown 2020-10-31T22:42:54.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd80109e740 1 -- 172.21.15.60:0/2885055731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd07c00 msgr2=0xf589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:54.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd80109e740 1 --2- 172.21.15.60:0/2885055731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd07c00 0xf589a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fd7e4031000 tx=0x7fd7e4024000).stop 2020-10-31T22:42:54.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd80109e740 1 -- 172.21.15.60:0/2885055731 shutdown_connections 2020-10-31T22:42:54.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd80109e740 1 --2- 172.21.15.60:0/2885055731 >> [v2:172.21.15.60:6836/2802890928,v1:172.21.15.60:6837/2802890928] conn(0xf54360 0xf57510 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:54.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd80109e740 1 --2- 172.21.15.60:0/2885055731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xf0cb10 0xf53e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:54.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd80109e740 1 --2- 172.21.15.60:0/2885055731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd07c00 0xf589a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:54.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7c7fff700 0 client.5103 ms_handle_reset on v2:172.21.15.60:6836/2802890928 2020-10-31T22:42:54.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd80109e740 1 --2- 172.21.15.60:0/2885055731 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xd75800 0xf58e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:54.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd80109e740 1 -- 172.21.15.60:0/2885055731 >> 172.21.15.60:0/2885055731 conn(0xf3c710 msgr2=0xf5a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:54.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd80109e740 1 -- 172.21.15.60:0/2885055731 shutdown_connections 2020-10-31T22:42:54.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd80109e740 1 -- 172.21.15.60:0/2885055731 wait complete. 2020-10-31T22:42:54.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd80109e740 20 client.5103 trim_cache size 0 max 16384 2020-10-31T22:42:54.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7f14a4700 1 -- 172.21.15.60:0/2054565537 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd7cc054f30 msgr2=0x7fd7cc0573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:54.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7f14a4700 1 --2- 172.21.15.60:0/2054565537 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd7cc054f30 0x7fd7cc0573f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fd7e400b000 tx=0x7fd7e40091a0).stop 2020-10-31T22:42:54.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7f14a4700 1 -- 172.21.15.60:0/2054565537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec0b0e20 msgr2=0x7fd7ec13aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:54.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7f14a4700 1 --2- 172.21.15.60:0/2054565537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec0b0e20 0x7fd7ec13aad0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7fd7ec1408c0 tx=0x7fd7e0006dc0).stop 2020-10-31T22:42:54.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7f14a4700 1 -- 172.21.15.60:0/2054565537 shutdown_connections 2020-10-31T22:42:54.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7f14a4700 1 --2- 172.21.15.60:0/2054565537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec0b0e20 0x7fd7ec13aad0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:54.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7f14a4700 1 --2- 172.21.15.60:0/2054565537 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0ac870 0x7fd7ec05b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:54.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7f14a4700 1 --2- 172.21.15.60:0/2054565537 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd7cc054f30 0x7fd7cc0573f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:54.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7f14a4700 1 --2- 172.21.15.60:0/2054565537 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7ec0ae690 0x7fd7ec13a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:54.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7f14a4700 1 -- 172.21.15.60:0/2054565537 >> 172.21.15.60:0/2054565537 conn(0x7fd7ec06a600 msgr2=0x7fd7ec144f20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:54.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7f14a4700 1 -- 172.21.15.60:0/2054565537 shutdown_connections 2020-10-31T22:42:54.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:54.931+0000 7fd7f14a4700 1 -- 172.21.15.60:0/2054565537 wait complete. 2020-10-31T22:42:54.948 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:42:54.948 INFO:teuthology.orchestra.run.smithi060.stdout: "client_recall": { 2020-10-31T22:42:54.949 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2020-10-31T22:42:54.949 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "(0) Success", 2020-10-31T22:42:54.949 INFO:teuthology.orchestra.run.smithi060.stdout: "recalled": 920 2020-10-31T22:42:54.949 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:54.949 INFO:teuthology.orchestra.run.smithi060.stdout: "flush_journal": { 2020-10-31T22:42:54.949 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2020-10-31T22:42:54.950 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "" 2020-10-31T22:42:54.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:54.950 INFO:teuthology.orchestra.run.smithi060.stdout: "trim_cache": { 2020-10-31T22:42:54.950 INFO:teuthology.orchestra.run.smithi060.stdout: "trimmed": 900 2020-10-31T22:42:54.950 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:54.950 INFO:teuthology.orchestra.run.smithi060.stdout: "cache": { 2020-10-31T22:42:54.950 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": { 2020-10-31T22:42:54.951 INFO:teuthology.orchestra.run.smithi060.stdout: "items": 2529, 2020-10-31T22:42:54.951 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes": 431952 2020-10-31T22:42:54.951 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:54.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:54.951 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 44.467288621999998 2020-10-31T22:42:54.951 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:42:54.952 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:42:54.953 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:42:54.966 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:42:54.982 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:42:55.000 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:42:55.022 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:42:55.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:42:55.025 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:42:55.025 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:42:55.075 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:42:55.076 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:42:55.076 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:42:55.077 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:42:55.077 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:42:55.161 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13009]: fuse finished with error 0 and tester_r 0 2020-10-31T22:42:55.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:42:55.162 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:42:55.162 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:42:55.209 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:42:55.210 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:42:55.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:42:55.325 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:42:55.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:42:55.374 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:42:55.374 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:42:55.384 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:42:55.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:42:55.385 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:42:55.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:42:55.386 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:42:55.438 INFO:teuthology.orchestra.run.smithi085.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:42:55.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:42:55.440 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2020-10-31T22:42:55.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.563+0000 7f54dc9c1700 1 Processor -- start 2020-10-31T22:42:55.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.563+0000 7f54dc9c1700 1 -- start start 2020-10-31T22:42:55.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.563+0000 7f54dc9c1700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f54d80ac870 0x7f54d80b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:55.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54dc9c1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f54d80ae8b0 0x7f54d81412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:55.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54dc9c1700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d80acc50 con 0x7f54d80b0e20 2020-10-31T22:42:55.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54dc9c1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d80b14c0 con 0x7f54d80ae8b0 2020-10-31T22:42:55.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54dc9c1700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d80b5690 con 0x7f54d80ac870 2020-10-31T22:42:55.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54d7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f54d80ae8b0 0x7f54d81412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:55.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54d6ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f54d80b0e20 0x7f54d80ae1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47046/0 (socket says 172.21.15.60:47046) 2020-10-31T22:42:55.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54d6ffd700 1 -- 172.21.15.60:0/641803332 learned_addr learned my addr 172.21.15.60:0/641803332 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:42:55.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54d77fe700 1 --2- 172.21.15.60:0/641803332 >> v2:172.21.15.66:3300/0 conn(0x7f54d80ac870 0x7f54d80b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:55.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54d7fff700 1 -- 172.21.15.60:0/641803332 >> v2:172.21.15.66:3300/0 conn(0x7f54d80ac870 msgr2=0x7f54d80b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:55.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54d7fff700 1 --2- 172.21.15.60:0/641803332 >> v2:172.21.15.66:3300/0 conn(0x7f54d80ac870 0x7f54d80b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:55.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54d67fc700 1 -- 172.21.15.60:0/641803332 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444475073 0 0) 0x7f54d80acc50 con 0x7f54d80b0e20 2020-10-31T22:42:55.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54d7fff700 1 -- 172.21.15.60:0/641803332 >> v1:172.21.15.60:6789/0 conn(0x7f54d80b0e20 legacy=0x7f54d80ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:55.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54d7fff700 1 -- 172.21.15.60:0/641803332 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d80afc10 con 0x7f54d80ae8b0 2020-10-31T22:42:55.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54d7fff700 1 --2- 172.21.15.60:0/641803332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54d80ae8b0 0x7f54d81412e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f54d0002f30 tx=0x7f54d0006dc0).ready entity=mon.0 client_cookie=329ebee85d94dfee server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:55.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54d67fc700 1 -- 172.21.15.60:0/641803332 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d0009840 con 0x7f54d80ae8b0 2020-10-31T22:42:55.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54d67fc700 1 -- 172.21.15.60:0/641803332 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d00099a0 con 0x7f54d80ae8b0 2020-10-31T22:42:55.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54d67fc700 1 -- 172.21.15.60:0/641803332 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d0009d00 con 0x7f54d80ae8b0 2020-10-31T22:42:55.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54dc9c1700 1 -- 172.21.15.60:0/641803332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54d80ae8b0 msgr2=0x7f54d81412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:55.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54dc9c1700 1 --2- 172.21.15.60:0/641803332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54d80ae8b0 0x7f54d81412e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f54d0002f30 tx=0x7f54d0006dc0).stop 2020-10-31T22:42:55.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54dc9c1700 1 -- 172.21.15.60:0/641803332 shutdown_connections 2020-10-31T22:42:55.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54dc9c1700 1 --2- 172.21.15.60:0/641803332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54d80ae8b0 0x7f54d81412e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:55.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54dc9c1700 1 --2- 172.21.15.60:0/641803332 >> v2:172.21.15.66:3300/0 conn(0x7f54d80ac870 0x7f54d80b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:55.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54dc9c1700 1 -- 172.21.15.60:0/641803332 >> 172.21.15.60:0/641803332 conn(0x7f54d806a600 msgr2=0x7f54d8060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:55.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54dc9c1700 1 -- 172.21.15.60:0/641803332 shutdown_connections 2020-10-31T22:42:55.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54dc9c1700 1 -- 172.21.15.60:0/641803332 wait complete. 2020-10-31T22:42:55.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54dc9c1700 1 Processor -- start 2020-10-31T22:42:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.567+0000 7f54dc9c1700 1 -- start start 2020-10-31T22:42:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54dc9c1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54d80ac870 0x7f54d8064580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54dc9c1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54d80ae8b0 0x7f54d8064a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54dc9c1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54d80b0e20 0x7f54d80a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54dc9c1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d8064f60 con 0x7f54d80ac870 2020-10-31T22:42:55.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54dc9c1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d80abb90 con 0x7f54d80b0e20 2020-10-31T22:42:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54dc9c1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d814c340 con 0x7f54d80ae8b0 2020-10-31T22:42:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54d80ac870 0x7f54d8064580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54d80ac870 0x7f54d8064580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42916/0 (socket says 172.21.15.60:42916) 2020-10-31T22:42:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d77fe700 1 -- 172.21.15.60:0/3663823062 learned_addr learned my addr 172.21.15.60:0/3663823062 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d7fff700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54d80b0e20 0x7f54d80a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d6ffd700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54d80ae8b0 0x7f54d8064a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:55.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d77fe700 1 -- 172.21.15.60:0/3663823062 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54d80ae8b0 msgr2=0x7f54d8064a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:55.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d77fe700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54d80ae8b0 0x7f54d8064a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:55.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d77fe700 1 -- 172.21.15.60:0/3663823062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54d80b0e20 msgr2=0x7f54d80a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:55.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d77fe700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54d80b0e20 0x7f54d80a9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:55.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d77fe700 1 -- 172.21.15.60:0/3663823062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d8132fd0 con 0x7f54d80ac870 2020-10-31T22:42:55.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d7fff700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54d80b0e20 0x7f54d80a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:42:55.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d6ffd700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54d80ae8b0 0x7f54d8064a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:42:55.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d77fe700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54d80ac870 0x7f54d8064580 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f54d80650a0 tx=0x7f54c80091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:55.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d4ff9700 1 -- 172.21.15.60:0/3663823062 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54c800cba0 con 0x7f54d80ac870 2020-10-31T22:42:55.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d4ff9700 1 -- 172.21.15.60:0/3663823062 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54c800cd00 con 0x7f54d80ac870 2020-10-31T22:42:55.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54dc9c1700 1 -- 172.21.15.60:0/3663823062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d80ab650 con 0x7f54d80ac870 2020-10-31T22:42:55.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54d4ff9700 1 -- 172.21.15.60:0/3663823062 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54c80125e0 con 0x7f54d80ac870 2020-10-31T22:42:55.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54dc9c1700 1 -- 172.21.15.60:0/3663823062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d8132cc0 con 0x7f54d80ac870 2020-10-31T22:42:55.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.571+0000 7f54dc9c1700 1 -- 172.21.15.60:0/3663823062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d8057100 con 0x7f54d80ac870 2020-10-31T22:42:55.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.575+0000 7f54d4ff9700 1 -- 172.21.15.60:0/3663823062 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f54c8022070 con 0x7f54d80ac870 2020-10-31T22:42:55.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.575+0000 7f54d4ff9700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54bc054f10 0x7f54bc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:55.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.575+0000 7f54d4ff9700 1 -- 172.21.15.60:0/3663823062 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f54c806e170 con 0x7f54d80ac870 2020-10-31T22:42:55.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.575+0000 7f54d6ffd700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54bc054f10 0x7f54bc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:55.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.575+0000 7f54d6ffd700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54bc054f10 0x7f54bc0573d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f54c0008000 tx=0x7f54c0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:55.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.579+0000 7f54d4ff9700 1 -- 172.21.15.60:0/3663823062 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f54c8044690 con 0x7f54d80ac870 2020-10-31T22:42:55.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.723+0000 7f54dc9c1700 1 -- 172.21.15.60:0/3663823062 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f54d80b2470 con 0x7f54d80ac870 2020-10-31T22:42:55.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.731+0000 7f54d4ff9700 1 -- 172.21.15.60:0/3663823062 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f54c8047cb0 con 0x7f54d80ac870 2020-10-31T22:42:55.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.735+0000 7f54dc9c1700 1 -- 172.21.15.60:0/3663823062 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54bc054f10 msgr2=0x7f54bc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:55.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.735+0000 7f54dc9c1700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54bc054f10 0x7f54bc0573d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f54c0008000 tx=0x7f54c0009040).stop 2020-10-31T22:42:55.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.735+0000 7f54dc9c1700 1 -- 172.21.15.60:0/3663823062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54d80ac870 msgr2=0x7f54d8064580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:55.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.735+0000 7f54dc9c1700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54d80ac870 0x7f54d8064580 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f54d80650a0 tx=0x7f54c80091a0).stop 2020-10-31T22:42:55.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.735+0000 7f54dc9c1700 1 -- 172.21.15.60:0/3663823062 shutdown_connections 2020-10-31T22:42:55.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.735+0000 7f54dc9c1700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54bc054f10 0x7f54bc0573d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:55.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.735+0000 7f54dc9c1700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54d80b0e20 0x7f54d80a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:55.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.735+0000 7f54dc9c1700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54d80ac870 0x7f54d8064580 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:55.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.735+0000 7f54dc9c1700 1 --2- 172.21.15.60:0/3663823062 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54d80ae8b0 0x7f54d8064a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:55.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.735+0000 7f54dc9c1700 1 -- 172.21.15.60:0/3663823062 >> 172.21.15.60:0/3663823062 conn(0x7f54d806a600 msgr2=0x7f54d80b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:55.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.735+0000 7f54dc9c1700 1 -- 172.21.15.60:0/3663823062 shutdown_connections 2020-10-31T22:42:55.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.735+0000 7f54dc9c1700 1 -- 172.21.15.60:0/3663823062 wait complete. 2020-10-31T22:42:55.751 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command' 2020-10-31T22:42:55.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.859+0000 7faa3c874700 1 Processor -- start 2020-10-31T22:42:55.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.859+0000 7faa3c874700 1 -- start start 2020-10-31T22:42:55.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa3c874700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa380ae020 0x7faa380aac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:55.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa3c874700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa38142210 con 0x7faa3813eac0 2020-10-31T22:42:55.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa3c874700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa381424b0 con 0x7faa380afeb0 2020-10-31T22:42:55.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa3c874700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa38142750 con 0x7faa380ae020 2020-10-31T22:42:55.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa36d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7faa3813eac0 0x7faa3813ef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47064/0 (socket says 172.21.15.60:47064) 2020-10-31T22:42:55.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa36d9d700 1 -- 172.21.15.60:0/1837633477 learned_addr learned my addr 172.21.15.60:0/1837633477 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:42:55.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa2dd9b700 1 --2- 172.21.15.60:0/1837633477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa380ae020 0x7faa380aac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:55.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa35d9b700 1 -- 172.21.15.60:0/1837633477 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 434070890 0 0) 0x7faa38142210 con 0x7faa3813eac0 2020-10-31T22:42:55.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa35d9b700 1 -- 172.21.15.60:0/1837633477 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa18003230 con 0x7faa3813eac0 2020-10-31T22:42:55.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa2dd9b700 1 -- 172.21.15.60:0/1837633477 >> v1:172.21.15.66:6789/0 conn(0x7faa380afeb0 legacy=0x7faa3813bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:55.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa2dd9b700 1 -- 172.21.15.60:0/1837633477 >> v1:172.21.15.60:6789/0 conn(0x7faa3813eac0 legacy=0x7faa3813ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:55.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa35d9b700 1 -- 172.21.15.60:0/1837633477 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200952924 0 0) 0x7faa381424b0 con 0x7faa380afeb0 2020-10-31T22:42:55.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa2dd9b700 1 -- 172.21.15.60:0/1837633477 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa381429f0 con 0x7faa380ae020 2020-10-31T22:42:55.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa2dd9b700 1 --2- 172.21.15.60:0/1837633477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa380ae020 0x7faa380aac90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7faa30001bf0 tx=0x7faa20006dc0).ready entity=mon.2 client_cookie=3608c85e9d13018a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:55.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa35d9b700 1 -- 172.21.15.60:0/1837633477 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa30001a50 con 0x7faa380ae020 2020-10-31T22:42:55.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa35d9b700 1 -- 172.21.15.60:0/1837633477 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa20009740 con 0x7faa380ae020 2020-10-31T22:42:55.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa3c874700 1 -- 172.21.15.60:0/1837633477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa380ae020 msgr2=0x7faa380aac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:55.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa35d9b700 1 -- 172.21.15.60:0/1837633477 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa200098b0 con 0x7faa380ae020 2020-10-31T22:42:55.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa3c874700 1 --2- 172.21.15.60:0/1837633477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa380ae020 0x7faa380aac90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7faa30001bf0 tx=0x7faa20006dc0).stop 2020-10-31T22:42:55.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa3c874700 1 -- 172.21.15.60:0/1837633477 shutdown_connections 2020-10-31T22:42:55.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa3c874700 1 --2- 172.21.15.60:0/1837633477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa380ae020 0x7faa380aac90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:55.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa3c874700 1 -- 172.21.15.60:0/1837633477 >> 172.21.15.60:0/1837633477 conn(0x7faa3806a260 msgr2=0x7faa38061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:55.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa3c874700 1 -- 172.21.15.60:0/1837633477 shutdown_connections 2020-10-31T22:42:55.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.863+0000 7faa3c874700 1 -- 172.21.15.60:0/1837633477 wait complete. 2020-10-31T22:42:55.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3c874700 1 Processor -- start 2020-10-31T22:42:55.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3c874700 1 -- start start 2020-10-31T22:42:55.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3c874700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa380ae020 0x7faa38124de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:55.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3c874700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa380afeb0 0x7faa38132240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:55.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3c874700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3813eac0 0x7faa38132730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:55.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3c874700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa38131cc0 con 0x7faa380ae020 2020-10-31T22:42:55.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3c874700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa38131100 con 0x7faa380afeb0 2020-10-31T22:42:55.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3c874700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa381313a0 con 0x7faa3813eac0 2020-10-31T22:42:55.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa380ae020 0x7faa38124de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:55.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa380ae020 0x7faa38124de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42930/0 (socket says 172.21.15.60:42930) 2020-10-31T22:42:55.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3659c700 1 -- 172.21.15.60:0/377370710 learned_addr learned my addr 172.21.15.60:0/377370710 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:55.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa2dd9b700 1 --2- 172.21.15.60:0/377370710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa380afeb0 0x7faa38132240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:55.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa36d9d700 1 --2- 172.21.15.60:0/377370710 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3813eac0 0x7faa38132730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:55.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3659c700 1 -- 172.21.15.60:0/377370710 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3813eac0 msgr2=0x7faa38132730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:55.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3659c700 1 --2- 172.21.15.60:0/377370710 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3813eac0 0x7faa38132730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:55.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3659c700 1 -- 172.21.15.60:0/377370710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa380afeb0 msgr2=0x7faa38132240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:55.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3659c700 1 --2- 172.21.15.60:0/377370710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa380afeb0 0x7faa38132240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:55.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3659c700 1 -- 172.21.15.60:0/377370710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38131640 con 0x7faa380ae020 2020-10-31T22:42:55.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3659c700 1 --2- 172.21.15.60:0/377370710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa380ae020 0x7faa38124de0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7faa28000b80 tx=0x7faa280079b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:55.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa2ffff700 1 -- 172.21.15.60:0/377370710 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2800f470 con 0x7faa380ae020 2020-10-31T22:42:55.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa2ffff700 1 -- 172.21.15.60:0/377370710 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2800f5d0 con 0x7faa380ae020 2020-10-31T22:42:55.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3c874700 1 -- 172.21.15.60:0/377370710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa38133c30 con 0x7faa380ae020 2020-10-31T22:42:55.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa2ffff700 1 -- 172.21.15.60:0/377370710 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2800f930 con 0x7faa380ae020 2020-10-31T22:42:55.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.867+0000 7faa3c874700 1 -- 172.21.15.60:0/377370710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3813fec0 con 0x7faa380ae020 2020-10-31T22:42:55.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.871+0000 7faa3c874700 1 -- 172.21.15.60:0/377370710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa38057100 con 0x7faa380ae020 2020-10-31T22:42:55.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.871+0000 7faa2ffff700 1 -- 172.21.15.60:0/377370710 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7faa28019030 con 0x7faa380ae020 2020-10-31T22:42:55.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.871+0000 7faa2ffff700 1 --2- 172.21.15.60:0/377370710 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa1c055020 0x7faa1c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:55.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.871+0000 7faa2dd9b700 1 --2- 172.21.15.60:0/377370710 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa1c055020 0x7faa1c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:55.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.871+0000 7faa2ffff700 1 -- 172.21.15.60:0/377370710 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faa2806cd20 con 0x7faa380ae020 2020-10-31T22:42:55.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.871+0000 7faa2dd9b700 1 --2- 172.21.15.60:0/377370710 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa1c055020 0x7faa1c0574e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7faa2001a000 tx=0x7faa20006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:55.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:55.875+0000 7faa2ffff700 1 -- 172.21.15.60:0/377370710 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7faa28041df0 con 0x7faa380ae020 2020-10-31T22:42:56.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:56.067+0000 7faa3c874700 1 -- 172.21.15.60:0/377370710 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]} v 0) v1 -- 0x7faa3805aa70 con 0x7faa380ae020 2020-10-31T22:42:56.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:56.887+0000 7faa2ffff700 1 -- 172.21.15.60:0/377370710 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command"]}]=0 v94) v1 ==== 139+0+0 (secure 0 0 0) 0x7faa28046d20 con 0x7faa380ae020 2020-10-31T22:42:56.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:56.891+0000 7faa3c874700 1 -- 172.21.15.60:0/377370710 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa1c055020 msgr2=0x7faa1c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:56.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:56.891+0000 7faa3c874700 1 --2- 172.21.15.60:0/377370710 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa1c055020 0x7faa1c0574e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7faa2001a000 tx=0x7faa20006dc0).stop 2020-10-31T22:42:56.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:56.891+0000 7faa3c874700 1 -- 172.21.15.60:0/377370710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa380ae020 msgr2=0x7faa38124de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:56.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:56.891+0000 7faa3c874700 1 --2- 172.21.15.60:0/377370710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa380ae020 0x7faa38124de0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7faa28000b80 tx=0x7faa280079b0).stop 2020-10-31T22:42:56.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:56.891+0000 7faa3c874700 1 -- 172.21.15.60:0/377370710 shutdown_connections 2020-10-31T22:42:56.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:56.891+0000 7faa3c874700 1 --2- 172.21.15.60:0/377370710 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3813eac0 0x7faa38132730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:56.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:56.891+0000 7faa3c874700 1 --2- 172.21.15.60:0/377370710 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa380ae020 0x7faa38124de0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:56.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:56.891+0000 7faa3c874700 1 --2- 172.21.15.60:0/377370710 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa1c055020 0x7faa1c0574e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:56.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:56.891+0000 7faa3c874700 1 --2- 172.21.15.60:0/377370710 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa380afeb0 0x7faa38132240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:56.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:56.891+0000 7faa3c874700 1 -- 172.21.15.60:0/377370710 >> 172.21.15.60:0/377370710 conn(0x7faa3806a260 msgr2=0x7faa38133220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:56.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:56.891+0000 7faa3c874700 1 -- 172.21.15.60:0/377370710 shutdown_connections 2020-10-31T22:42:56.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:56.891+0000 7faa3c874700 1 -- 172.21.15.60:0/377370710 wait complete. 2020-10-31T22:42:56.909 INFO:tasks.cephfs_test_runner:test_drop_cache_command (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2020-10-31T22:42:56.910 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) 2020-10-31T22:42:56.911 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2020-10-31T22:42:57.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.027+0000 7f9a46cb6700 1 Processor -- start 2020-10-31T22:42:57.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.027+0000 7f9a46cb6700 1 -- start start 2020-10-31T22:42:57.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a46cb6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9a400b2790 0x7f9a40142a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:57.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a46cb6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a400afef0 0x7f9a4013ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:57.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a46cb6700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a400acfa0 con 0x7f9a4013f360 2020-10-31T22:42:57.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a46cb6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a400b2b70 con 0x7f9a400b2790 2020-10-31T22:42:57.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a46cb6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400ac800 con 0x7f9a400afef0 2020-10-31T22:42:57.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a44a52700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9a400b2790 0x7f9a40142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:57.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a44a52700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9a400b2790 0x7f9a40142a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42938/0 (socket says 172.21.15.60:42938) 2020-10-31T22:42:57.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a37fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a400afef0 0x7f9a4013ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:57.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a44a52700 1 -- 172.21.15.60:0/2875325328 learned_addr learned my addr 172.21.15.60:0/2875325328 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:57.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a377fe700 1 -- 172.21.15.60:0/2875325328 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846924384 0 0) 0x7f9a400acfa0 con 0x7f9a4013f360 2020-10-31T22:42:57.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a44a52700 1 -- 172.21.15.60:0/2875325328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a400afef0 msgr2=0x7f9a4013ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:57.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a44a52700 1 --2- 172.21.15.60:0/2875325328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a400afef0 0x7f9a4013ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:57.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a44a52700 1 -- 172.21.15.60:0/2875325328 >> v1:172.21.15.66:6789/0 conn(0x7f9a4013f360 legacy=0x7f9a4013b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:57.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a44a52700 1 -- 172.21.15.60:0/2875325328 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a40142f60 con 0x7f9a400b2790 2020-10-31T22:42:57.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a37fff700 1 --2- 172.21.15.60:0/2875325328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a400afef0 0x7f9a4013ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:42:57.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a44a52700 1 --2- 172.21.15.60:0/2875325328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a400b2790 0x7f9a40142a70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f9a3c002f30 tx=0x7f9a3c006e80).ready entity=mon.0 client_cookie=d576d924857bdd80 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:57.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a377fe700 1 -- 172.21.15.60:0/2875325328 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a3c009880 con 0x7f9a400b2790 2020-10-31T22:42:57.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a377fe700 1 -- 172.21.15.60:0/2875325328 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c0099e0 con 0x7f9a400b2790 2020-10-31T22:42:57.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a377fe700 1 -- 172.21.15.60:0/2875325328 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a3c009d40 con 0x7f9a400b2790 2020-10-31T22:42:57.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2875325328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a400b2790 msgr2=0x7f9a40142a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:57.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a46cb6700 1 --2- 172.21.15.60:0/2875325328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a400b2790 0x7f9a40142a70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7f9a3c002f30 tx=0x7f9a3c006e80).stop 2020-10-31T22:42:57.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2875325328 shutdown_connections 2020-10-31T22:42:57.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a46cb6700 1 --2- 172.21.15.60:0/2875325328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a400b2790 0x7f9a40142a70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:57.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a46cb6700 1 --2- 172.21.15.60:0/2875325328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a400afef0 0x7f9a4013ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:57.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2875325328 >> 172.21.15.60:0/2875325328 conn(0x7f9a400b5d30 msgr2=0x7f9a400b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:57.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2875325328 shutdown_connections 2020-10-31T22:42:57.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.031+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2875325328 wait complete. 2020-10-31T22:42:57.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a46cb6700 1 Processor -- start 2020-10-31T22:42:57.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a46cb6700 1 -- start start 2020-10-31T22:42:57.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a46cb6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a400afef0 0x7f9a401410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:57.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a46cb6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a400b2790 0x7f9a40151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:57.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a46cb6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a4013f360 0x7f9a4014f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:57.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a46cb6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40141a20 con 0x7f9a4013f360 2020-10-31T22:42:57.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a46cb6700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4013e0e0 con 0x7f9a400afef0 2020-10-31T22:42:57.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a46cb6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4013de40 con 0x7f9a400b2790 2020-10-31T22:42:57.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a45253700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a4013f360 0x7f9a4014f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:57.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a45253700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a4013f360 0x7f9a4014f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42946/0 (socket says 172.21.15.60:42946) 2020-10-31T22:42:57.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a45253700 1 -- 172.21.15.60:0/2792813401 learned_addr learned my addr 172.21.15.60:0/2792813401 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:57.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a44a52700 1 --2- 172.21.15.60:0/2792813401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a400afef0 0x7f9a401410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:57.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a37fff700 1 --2- 172.21.15.60:0/2792813401 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a400b2790 0x7f9a40151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:57.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a45253700 1 -- 172.21.15.60:0/2792813401 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a400b2790 msgr2=0x7f9a40151ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:57.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a45253700 1 --2- 172.21.15.60:0/2792813401 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a400b2790 0x7f9a40151ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:57.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a45253700 1 -- 172.21.15.60:0/2792813401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a400afef0 msgr2=0x7f9a401410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:57.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a45253700 1 --2- 172.21.15.60:0/2792813401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a400afef0 0x7f9a401410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:57.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a45253700 1 -- 172.21.15.60:0/2792813401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4014eaa0 con 0x7f9a4013f360 2020-10-31T22:42:57.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.035+0000 7f9a45253700 1 --2- 172.21.15.60:0/2792813401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a4013f360 0x7f9a4014f1e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f9a38000f00 tx=0x7f9a38007cc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:57.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.039+0000 7f9a35ffb700 1 -- 172.21.15.60:0/2792813401 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a3800a5e0 con 0x7f9a4013f360 2020-10-31T22:42:57.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.039+0000 7f9a35ffb700 1 -- 172.21.15.60:0/2792813401 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3800a740 con 0x7f9a4013f360 2020-10-31T22:42:57.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.039+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2792813401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4014ed40 con 0x7f9a4013f360 2020-10-31T22:42:57.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.039+0000 7f9a35ffb700 1 -- 172.21.15.60:0/2792813401 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a3800aaa0 con 0x7f9a4013f360 2020-10-31T22:42:57.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.039+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2792813401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4013dac0 con 0x7f9a4013f360 2020-10-31T22:42:57.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.039+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2792813401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a40057100 con 0x7f9a4013f360 2020-10-31T22:42:57.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.039+0000 7f9a35ffb700 1 -- 172.21.15.60:0/2792813401 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9a38019030 con 0x7f9a4013f360 2020-10-31T22:42:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.039+0000 7f9a35ffb700 1 --2- 172.21.15.60:0/2792813401 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a20054f10 0x7f9a200573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.039+0000 7f9a44a52700 1 --2- 172.21.15.60:0/2792813401 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a20054f10 0x7f9a200573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.039+0000 7f9a35ffb700 1 -- 172.21.15.60:0/2792813401 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9a3806d0c0 con 0x7f9a4013f360 2020-10-31T22:42:57.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.039+0000 7f9a44a52700 1 --2- 172.21.15.60:0/2792813401 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a20054f10 0x7f9a200573d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f9a3c01c000 tx=0x7f9a3c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:57.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.047+0000 7f9a35ffb700 1 -- 172.21.15.60:0/2792813401 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9a38041df0 con 0x7f9a4013f360 2020-10-31T22:42:57.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.247+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2792813401 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f9a40139070 con 0x7f9a4013f360 2020-10-31T22:42:57.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.895+0000 7f9a35ffb700 1 -- 172.21.15.60:0/2792813401 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v95) v1 ==== 147+0+0 (secure 0 0 0) 0x7f9a38043580 con 0x7f9a4013f360 2020-10-31T22:42:57.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.899+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2792813401 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a20054f10 msgr2=0x7f9a200573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:57.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.899+0000 7f9a46cb6700 1 --2- 172.21.15.60:0/2792813401 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a20054f10 0x7f9a200573d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f9a3c01c000 tx=0x7f9a3c015000).stop 2020-10-31T22:42:57.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.899+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2792813401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a4013f360 msgr2=0x7f9a4014f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:57.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.899+0000 7f9a46cb6700 1 --2- 172.21.15.60:0/2792813401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a4013f360 0x7f9a4014f1e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f9a38000f00 tx=0x7f9a38007cc0).stop 2020-10-31T22:42:57.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.899+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2792813401 shutdown_connections 2020-10-31T22:42:57.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.899+0000 7f9a46cb6700 1 --2- 172.21.15.60:0/2792813401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a4013f360 0x7f9a4014f1e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:57.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.899+0000 7f9a46cb6700 1 --2- 172.21.15.60:0/2792813401 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a20054f10 0x7f9a200573d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:57.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.899+0000 7f9a46cb6700 1 --2- 172.21.15.60:0/2792813401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a400afef0 0x7f9a401410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:57.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.899+0000 7f9a46cb6700 1 --2- 172.21.15.60:0/2792813401 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a400b2790 0x7f9a40151ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:57.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.899+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2792813401 >> 172.21.15.60:0/2792813401 conn(0x7f9a400b5d30 msgr2=0x7f9a4005f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:57.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.899+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2792813401 shutdown_connections 2020-10-31T22:42:57.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:57.899+0000 7f9a46cb6700 1 -- 172.21.15.60:0/2792813401 wait complete. 2020-10-31T22:42:57.918 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2020-10-31T22:42:58.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfde86f700 1 Processor -- start 2020-10-31T22:42:58.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfde86f700 1 -- start start 2020-10-31T22:42:58.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfde86f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfd80ac870 0x7fdfd8146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:58.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfde86f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd80af900 con 0x7fdfd80af520 2020-10-31T22:42:58.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfde86f700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd80afc10 con 0x7fdfd8146550 2020-10-31T22:42:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfde86f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd805bb70 con 0x7fdfd80ac870 2020-10-31T22:42:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdd86d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdfd80af520 0x7fdfd8066c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47088/0 (socket says 172.21.15.60:47088) 2020-10-31T22:42:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdd86d700 1 -- 172.21.15.60:0/1060387586 learned_addr learned my addr 172.21.15.60:0/1060387586 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:42:58.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 -- 172.21.15.60:0/1060387586 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178463974 0 0) 0x7fdfd80af900 con 0x7fdfd80af520 2020-10-31T22:42:58.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 -- 172.21.15.60:0/1060387586 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfc0003230 con 0x7fdfd80af520 2020-10-31T22:42:58.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdd06c700 1 --2- 172.21.15.60:0/1060387586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfd80ac870 0x7fdfd8146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:58.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 -- 172.21.15.60:0/1060387586 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 268922022 0 0) 0x7fdfc0003230 con 0x7fdfd80af520 2020-10-31T22:42:58.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 -- 172.21.15.60:0/1060387586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfd80ac870 msgr2=0x7fdfd8146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:58.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 --2- 172.21.15.60:0/1060387586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfd80ac870 0x7fdfd8146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 -- 172.21.15.60:0/1060387586 >> v1:172.21.15.66:6789/0 conn(0x7fdfd8146550 legacy=0x7fdfd8150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:58.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 -- 172.21.15.60:0/1060387586 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd80ac130 con 0x7fdfd80af520 2020-10-31T22:42:58.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 -- 172.21.15.60:0/1060387586 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fdfd4001850 con 0x7fdfd80af520 2020-10-31T22:42:58.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 -- 172.21.15.60:0/1060387586 >> v1:172.21.15.60:6789/0 conn(0x7fdfd80af520 legacy=0x7fdfd8066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:58.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 --2- 172.21.15.60:0/1060387586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfc0003750 0x7fdfc0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:58.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 --2- 172.21.15.60:0/1060387586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfc00044d0 0x7fdfc0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:58.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 --2- 172.21.15.60:0/1060387586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfd80ac870 0x7fdfc0004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:58.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 -- 172.21.15.60:0/1060387586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd805bb70 con 0x7fdfc0003750 2020-10-31T22:42:58.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 -- 172.21.15.60:0/1060387586 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0005380 con 0x7fdfc00044d0 2020-10-31T22:42:58.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdc86b700 1 -- 172.21.15.60:0/1060387586 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0004310 con 0x7fdfd80ac870 2020-10-31T22:42:58.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdd86d700 1 --2- 172.21.15.60:0/1060387586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfc0003750 0x7fdfc0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:58.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfdd06c700 1 --2- 172.21.15.60:0/1060387586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfc00044d0 0x7fdfc0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:58.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.043+0000 7fdfde06e700 1 --2- 172.21.15.60:0/1060387586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfd80ac870 0x7fdfc0004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:58.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfdd86d700 1 -- 172.21.15.60:0/1060387586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfd80ac870 msgr2=0x7fdfc0004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:58.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfdd86d700 1 --2- 172.21.15.60:0/1060387586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfd80ac870 0x7fdfc0004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfdd86d700 1 -- 172.21.15.60:0/1060387586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfc00044d0 msgr2=0x7fdfc0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:58.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfdd86d700 1 --2- 172.21.15.60:0/1060387586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfc00044d0 0x7fdfc0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfdd86d700 1 -- 172.21.15.60:0/1060387586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc0003230 con 0x7fdfc0003750 2020-10-31T22:42:58.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfde06e700 1 --2- 172.21.15.60:0/1060387586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfd80ac870 0x7fdfc0004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:42:58.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfdd86d700 1 --2- 172.21.15.60:0/1060387586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfc0003750 0x7fdfc0003b70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fdfd4001560 tx=0x7fdfd4007700).ready entity=mon.0 client_cookie=a4f420fb9b74f197 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:58.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfdc86b700 1 -- 172.21.15.60:0/1060387586 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfd4007770 con 0x7fdfc0003750 2020-10-31T22:42:58.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfdc86b700 1 -- 172.21.15.60:0/1060387586 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd400ce00 con 0x7fdfc0003750 2020-10-31T22:42:58.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfdc86b700 1 -- 172.21.15.60:0/1060387586 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfd40054b0 con 0x7fdfc0003750 2020-10-31T22:42:58.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfde86f700 1 -- 172.21.15.60:0/1060387586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfc0003750 msgr2=0x7fdfc0003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:58.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfde86f700 1 --2- 172.21.15.60:0/1060387586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfc0003750 0x7fdfc0003b70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7fdfd4001560 tx=0x7fdfd4007700).stop 2020-10-31T22:42:58.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfde06e700 1 -- 172.21.15.60:0/1060387586 reap_dead start 2020-10-31T22:42:58.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfde86f700 1 -- 172.21.15.60:0/1060387586 shutdown_connections 2020-10-31T22:42:58.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfde86f700 1 -- 172.21.15.60:0/1060387586 >> 172.21.15.60:0/1060387586 conn(0x7fdfd80b3fd0 msgr2=0x7fdfd80b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:58.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfde86f700 1 -- 172.21.15.60:0/1060387586 shutdown_connections 2020-10-31T22:42:58.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfde86f700 1 -- 172.21.15.60:0/1060387586 wait complete. 2020-10-31T22:42:58.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfde86f700 1 Processor -- start 2020-10-31T22:42:58.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.047+0000 7fdfde86f700 1 -- start start 2020-10-31T22:42:58.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfde86f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfd80a8510 0x7fdfd81490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:58.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfde86f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfd8148650 0x7fdfd81495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:58.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfde86f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfd8065cb0 0x7fdfd8066160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:58.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfde86f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80a88f0 con 0x7fdfd8148650 2020-10-31T22:42:58.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfde86f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd8062300 con 0x7fdfd80a8510 2020-10-31T22:42:58.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfde86f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd80625a0 con 0x7fdfd8065cb0 2020-10-31T22:42:58.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfdd06c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfd8148650 0x7fdfd81495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:58.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfdd06c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfd8148650 0x7fdfd81495b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42966/0 (socket says 172.21.15.60:42966) 2020-10-31T22:42:58.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfdd06c700 1 -- 172.21.15.60:0/3980156766 learned_addr learned my addr 172.21.15.60:0/3980156766 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:58.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfde06e700 1 --2- 172.21.15.60:0/3980156766 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfd8065cb0 0x7fdfd8066160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:58.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfdd86d700 1 --2- 172.21.15.60:0/3980156766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfd80a8510 0x7fdfd81490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:58.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfdd06c700 1 -- 172.21.15.60:0/3980156766 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfd8065cb0 msgr2=0x7fdfd8066160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:58.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfdd06c700 1 --2- 172.21.15.60:0/3980156766 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfd8065cb0 0x7fdfd8066160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfdd06c700 1 -- 172.21.15.60:0/3980156766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfd80a8510 msgr2=0x7fdfd81490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:58.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfdd06c700 1 --2- 172.21.15.60:0/3980156766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfd80a8510 0x7fdfd81490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfdd06c700 1 -- 172.21.15.60:0/3980156766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd8062840 con 0x7fdfd8148650 2020-10-31T22:42:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfdd06c700 1 --2- 172.21.15.60:0/3980156766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfd8148650 0x7fdfd81495b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fdfcc006750 tx=0x7fdfcc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfcaffd700 1 -- 172.21.15.60:0/3980156766 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfcc00f910 con 0x7fdfd8148650 2020-10-31T22:42:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfcaffd700 1 -- 172.21.15.60:0/3980156766 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfcc00fa70 con 0x7fdfd8148650 2020-10-31T22:42:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfde86f700 1 -- 172.21.15.60:0/3980156766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfd8061f80 con 0x7fdfd8148650 2020-10-31T22:42:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfcaffd700 1 -- 172.21.15.60:0/3980156766 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfcc00fbe0 con 0x7fdfd8148650 2020-10-31T22:42:58.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfde86f700 1 -- 172.21.15.60:0/3980156766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd80aae10 con 0x7fdfd8148650 2020-10-31T22:42:58.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.051+0000 7fdfde86f700 1 -- 172.21.15.60:0/3980156766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd8062a40 con 0x7fdfd8148650 2020-10-31T22:42:58.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.055+0000 7fdfcaffd700 1 -- 172.21.15.60:0/3980156766 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fdfcc024070 con 0x7fdfd8148650 2020-10-31T22:42:58.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.055+0000 7fdfcaffd700 1 --2- 172.21.15.60:0/3980156766 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdfb8055020 0x7fdfb80574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:58.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.055+0000 7fdfcaffd700 1 -- 172.21.15.60:0/3980156766 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdfcc06e200 con 0x7fdfd8148650 2020-10-31T22:42:58.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.055+0000 7fdfdd86d700 1 --2- 172.21.15.60:0/3980156766 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdfb8055020 0x7fdfb80574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:58.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.055+0000 7fdfdd86d700 1 --2- 172.21.15.60:0/3980156766 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdfb8055020 0x7fdfb80574e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fdfd4017000 tx=0x7fdfd4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:58.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.063+0000 7fdfcaffd700 1 -- 172.21.15.60:0/3980156766 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdfcc044720 con 0x7fdfd8148650 2020-10-31T22:42:58.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.199+0000 7fdfde86f700 1 -- 172.21.15.60:0/3980156766 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7fdfd8057100 con 0x7fdfd8148650 2020-10-31T22:42:58.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.207+0000 7fdfcaffd700 1 -- 172.21.15.60:0/3980156766 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdfcc047d40 con 0x7fdfd8148650 2020-10-31T22:42:58.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.207+0000 7fdfde86f700 1 -- 172.21.15.60:0/3980156766 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdfb8055020 msgr2=0x7fdfb80574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:58.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.207+0000 7fdfde86f700 1 --2- 172.21.15.60:0/3980156766 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdfb8055020 0x7fdfb80574e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fdfd4017000 tx=0x7fdfd4015000).stop 2020-10-31T22:42:58.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.207+0000 7fdfde86f700 1 -- 172.21.15.60:0/3980156766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfd8148650 msgr2=0x7fdfd81495b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:58.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.207+0000 7fdfde86f700 1 --2- 172.21.15.60:0/3980156766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfd8148650 0x7fdfd81495b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fdfcc006750 tx=0x7fdfcc008040).stop 2020-10-31T22:42:58.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.211+0000 7fdfde86f700 1 -- 172.21.15.60:0/3980156766 shutdown_connections 2020-10-31T22:42:58.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.211+0000 7fdfde86f700 1 --2- 172.21.15.60:0/3980156766 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfd8065cb0 0x7fdfd8066160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.211+0000 7fdfde86f700 1 --2- 172.21.15.60:0/3980156766 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdfb8055020 0x7fdfb80574e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.211+0000 7fdfde86f700 1 --2- 172.21.15.60:0/3980156766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfd80a8510 0x7fdfd81490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.211+0000 7fdfde86f700 1 --2- 172.21.15.60:0/3980156766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdfd8148650 0x7fdfd81495b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.211+0000 7fdfde86f700 1 -- 172.21.15.60:0/3980156766 >> 172.21.15.60:0/3980156766 conn(0x7fdfd80b3fd0 msgr2=0x7fdfd80adcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:58.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.211+0000 7fdfde86f700 1 -- 172.21.15.60:0/3980156766 shutdown_connections 2020-10-31T22:42:58.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.211+0000 7fdfde86f700 1 -- 172.21.15.60:0/3980156766 wait complete. 2020-10-31T22:42:58.227 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:42:58.227 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:42:58.243 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:42:58.261 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:42:58.287 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:42:58.305 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:42:58.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:42:58.306 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:42:58.306 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:42:58.352 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-10-31T22:42:58.353 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:42:58.354 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2020-10-31T22:42:58.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:42:58.355 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:42:58.355 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:42:58.362 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:42:58.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:42:58.363 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:42:58.363 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-10-31T22:42:58.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9889c08700 1 Processor -- start 2020-10-31T22:42:58.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9889c08700 1 -- start start 2020-10-31T22:42:58.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9889c08700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f98840b2d50 0x7f9884066430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:58.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9889c08700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f988413d8a0 con 0x7f98840b0dc0 2020-10-31T22:42:58.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9889c08700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9884066a60 con 0x7f988413fbe0 2020-10-31T22:42:58.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9889c08700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9884140bb0 con 0x7f98840b2d50 2020-10-31T22:42:58.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f98837fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f98840b0dc0 0x7f988413d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47108/0 (socket says 172.21.15.60:47108) 2020-10-31T22:42:58.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f98837fe700 1 -- 172.21.15.60:0/2848818877 learned_addr learned my addr 172.21.15.60:0/2848818877 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:42:58.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9883fff700 1 --2- 172.21.15.60:0/2848818877 >> v2:172.21.15.66:3300/0 conn(0x7f98840b2d50 0x7f9884066430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:58.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f98827fc700 1 -- 172.21.15.60:0/2848818877 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249349550 0 0) 0x7f988413d8a0 con 0x7f98840b0dc0 2020-10-31T22:42:58.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f98827fc700 1 -- 172.21.15.60:0/2848818877 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9864003230 con 0x7f98840b0dc0 2020-10-31T22:42:58.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9883fff700 1 -- 172.21.15.60:0/2848818877 >> v1:172.21.15.66:6789/0 conn(0x7f988413fbe0 legacy=0x7f98841437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:58.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9883fff700 1 -- 172.21.15.60:0/2848818877 >> v1:172.21.15.60:6789/0 conn(0x7f98840b0dc0 legacy=0x7f988413d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:58.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9883fff700 1 -- 172.21.15.60:0/2848818877 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9884066d00 con 0x7f98840b2d50 2020-10-31T22:42:58.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9883fff700 1 --2- 172.21.15.60:0/2848818877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98840b2d50 0x7f9884066430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f987c002f30 tx=0x7f987c006dc0).ready entity=mon.1 client_cookie=bccc7e013799ffc9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:58.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f98827fc700 1 -- 172.21.15.60:0/2848818877 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f987c009800 con 0x7f98840b2d50 2020-10-31T22:42:58.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f98827fc700 1 -- 172.21.15.60:0/2848818877 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c009960 con 0x7f98840b2d50 2020-10-31T22:42:58.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f98827fc700 1 -- 172.21.15.60:0/2848818877 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f987c009cc0 con 0x7f98840b2d50 2020-10-31T22:42:58.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9889c08700 1 -- 172.21.15.60:0/2848818877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98840b2d50 msgr2=0x7f9884066430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:58.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9889c08700 1 --2- 172.21.15.60:0/2848818877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98840b2d50 0x7f9884066430 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f987c002f30 tx=0x7f987c006dc0).stop 2020-10-31T22:42:58.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9889c08700 1 -- 172.21.15.60:0/2848818877 shutdown_connections 2020-10-31T22:42:58.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9889c08700 1 --2- 172.21.15.60:0/2848818877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98840b2d50 0x7f9884066430 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9889c08700 1 -- 172.21.15.60:0/2848818877 >> 172.21.15.60:0/2848818877 conn(0x7f988406a260 msgr2=0x7f9884063c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:58.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9889c08700 1 -- 172.21.15.60:0/2848818877 shutdown_connections 2020-10-31T22:42:58.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.487+0000 7f9889c08700 1 -- 172.21.15.60:0/2848818877 wait complete. 2020-10-31T22:42:58.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f9889c08700 1 Processor -- start 2020-10-31T22:42:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f9889c08700 1 -- start start 2020-10-31T22:42:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f9889c08700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98840b0dc0 0x7f9884146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f9889c08700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98840b2d50 0x7f98840aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f9889c08700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f988413fbe0 0x7f98840aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f9889c08700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9884145f20 con 0x7f98840b0dc0 2020-10-31T22:42:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f9889c08700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98840ad760 con 0x7f988413fbe0 2020-10-31T22:42:58.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f9889c08700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98840acd80 con 0x7f98840b2d50 2020-10-31T22:42:58.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f98837fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98840b0dc0 0x7f9884146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:58.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f98837fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98840b0dc0 0x7f9884146600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42978/0 (socket says 172.21.15.60:42978) 2020-10-31T22:42:58.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f98837fe700 1 -- 172.21.15.60:0/1974970045 learned_addr learned my addr 172.21.15.60:0/1974970045 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:58.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f9883fff700 1 --2- 172.21.15.60:0/1974970045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f988413fbe0 0x7f98840aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:58.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f9882ffd700 1 --2- 172.21.15.60:0/1974970045 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98840b2d50 0x7f98840aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:58.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f98837fe700 1 -- 172.21.15.60:0/1974970045 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98840b2d50 msgr2=0x7f98840aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:58.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f98837fe700 1 --2- 172.21.15.60:0/1974970045 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98840b2d50 0x7f98840aa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f98837fe700 1 -- 172.21.15.60:0/1974970045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f988413fbe0 msgr2=0x7f98840aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:58.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f98837fe700 1 --2- 172.21.15.60:0/1974970045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f988413fbe0 0x7f98840aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f98837fe700 1 -- 172.21.15.60:0/1974970045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98840ad020 con 0x7f98840b0dc0 2020-10-31T22:42:58.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.491+0000 7f98837fe700 1 --2- 172.21.15.60:0/1974970045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98840b0dc0 0x7f9884146600 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f98740015d0 tx=0x7f9874007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:58.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.495+0000 7f9880ff9700 1 -- 172.21.15.60:0/1974970045 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f987400ce10 con 0x7f98840b0dc0 2020-10-31T22:42:58.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.495+0000 7f9880ff9700 1 -- 172.21.15.60:0/1974970045 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9874007320 con 0x7f98840b0dc0 2020-10-31T22:42:58.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.495+0000 7f9889c08700 1 -- 172.21.15.60:0/1974970045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98840ad2c0 con 0x7f98840b0dc0 2020-10-31T22:42:58.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.495+0000 7f9880ff9700 1 -- 172.21.15.60:0/1974970045 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9874007680 con 0x7f98840b0dc0 2020-10-31T22:42:58.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.495+0000 7f9889c08700 1 -- 172.21.15.60:0/1974970045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98840aae30 con 0x7f98840b0dc0 2020-10-31T22:42:58.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.495+0000 7f9889c08700 1 -- 172.21.15.60:0/1974970045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9884057100 con 0x7f98840b0dc0 2020-10-31T22:42:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.495+0000 7f9880ff9700 1 -- 172.21.15.60:0/1974970045 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9874010030 con 0x7f98840b0dc0 2020-10-31T22:42:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.495+0000 7f9880ff9700 1 --2- 172.21.15.60:0/1974970045 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9868054f10 0x7f98680573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.495+0000 7f9882ffd700 1 --2- 172.21.15.60:0/1974970045 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9868054f10 0x7f98680573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.495+0000 7f9880ff9700 1 -- 172.21.15.60:0/1974970045 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f987406d910 con 0x7f98840b0dc0 2020-10-31T22:42:58.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.495+0000 7f9882ffd700 1 --2- 172.21.15.60:0/1974970045 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9868054f10 0x7f98680573d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f986c00d000 tx=0x7f986c007b60).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:58.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.503+0000 7f9880ff9700 1 -- 172.21.15.60:0/1974970045 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9874043e30 con 0x7f98840b0dc0 2020-10-31T22:42:58.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.655+0000 7f9889c08700 1 -- 172.21.15.60:0/1974970045 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f988413d860 con 0x7f98840b0dc0 2020-10-31T22:42:58.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.655+0000 7f9880ff9700 1 -- 172.21.15.60:0/1974970045 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v33) v1 ==== 81+0+33645 (secure 0 0 0) 0x7f9874047450 con 0x7f98840b0dc0 2020-10-31T22:42:58.660 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:42:58.661 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:42:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 33, 2020-10-31T22:42:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "226f905a-1517-4a8c-8009-08779515965c", 2020-10-31T22:42:58.661 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2020-10-31T22:40:51.928572+0000", 2020-10-31T22:42:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2020-10-31T22:41:49.525944+0000", 2020-10-31T22:42:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:42:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:42:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-10-31T22:42:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2020-10-31T22:42:58.662 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2020-10-31T22:42:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2020-10-31T22:42:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2020-10-31T22:42:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2020-10-31T22:42:58.663 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2020-10-31T22:42:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:42:58.664 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2020-10-31T22:42:58.666 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2020-10-31T22:42:58.667 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-10-31T22:42:58.667 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2020-10-31T22:42:58.667 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2020-10-31T22:42:58.667 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 6, 2020-10-31T22:42:58.667 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2020-10-31T22:42:58.668 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "jewel", 2020-10-31T22:42:58.668 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2020-10-31T22:42:58.668 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "octopus", 2020-10-31T22:42:58.668 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:42:58.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.669 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2020-10-31T22:42:58.669 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "device_health_metrics", 2020-10-31T22:42:58.669 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:40:55.846143+0000", 2020-10-31T22:42:58.669 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:42:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:42:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:42:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:42:58.670 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:42:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:42:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:42:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:42:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2020-10-31T22:42:58.671 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2020-10-31T22:42:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2020-10-31T22:42:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2020-10-31T22:42:58.672 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2020-10-31T22:42:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:42:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:42:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:42:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:42:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:42:58.675 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:42:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:42:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.676 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "15", 2020-10-31T22:42:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:42:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:42:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:42:58.677 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:42:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:42:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:42:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:42:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:42:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:42:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:42:58.678 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:42:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:42:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:42:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:42:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:42:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:42:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:42:58.679 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:42:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:42:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:42:58.680 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:42:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:42:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:42:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:42:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:42:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:42:58.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:42:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:42:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:42:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:42:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:42:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:42:58.682 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:42:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:42:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:42:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:42:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:42:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:42:58.683 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2020-10-31T22:42:58.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.684 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:42:58.684 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_devicehealth": {} 2020-10-31T22:42:58.684 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.685 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2020-10-31T22:42:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2020-10-31T22:42:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:05.358501+0000", 2020-10-31T22:42:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:42:58.686 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:42:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:42:58.687 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:42:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:42:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:42:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:42:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:42:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:42:58.688 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:42:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:42:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:42:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:42:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:42:58.689 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:42:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:42:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:42:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:42:58.690 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:42:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:42:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "18", 2020-10-31T22:42:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:42:58.691 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:42:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:42:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:42:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:42:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:42:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:42:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:42:58.692 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:42:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:42:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:42:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:42:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:42:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:42:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:42:58.693 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:42:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:42:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:42:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:42:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:42:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:42:58.694 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:42:58.695 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:42:58.695 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:42:58.695 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:42:58.695 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:42:58.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.695 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:42:58.696 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:42:58.696 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:42:58.696 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:42:58.696 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:42:58.696 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:42:58.696 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:42:58.696 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:42:58.697 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:42:58.697 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:42:58.697 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:42:58.697 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:42:58.697 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:42:58.697 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2020-10-31T22:42:58.698 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.698 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.698 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 5, 2020-10-31T22:42:58.698 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2020-10-31T22:42:58.698 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:46.258748+0000", 2020-10-31T22:42:58.699 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:42:58.699 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:42:58.699 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:42:58.699 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:42:58.699 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:42:58.699 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:42:58.699 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:42:58.700 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:42:58.700 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:42:58.700 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:42:58.700 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:42:58.700 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:42:58.700 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:42:58.701 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:42:58.701 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:42:58.701 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:42:58.701 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:42:58.701 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:42:58.701 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:42:58.701 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:42:58.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.702 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "32", 2020-10-31T22:42:58.702 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:42:58.702 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:42:58.702 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:42:58.702 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:42:58.703 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:42:58.703 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:42:58.703 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:42:58.703 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:42:58.703 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:42:58.703 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:42:58.703 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:42:58.704 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:42:58.704 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:42:58.704 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:42:58.704 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:42:58.704 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:42:58.704 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:42:58.705 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:42:58.706 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:42:58.706 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:42:58.706 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:42:58.706 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:42:58.707 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:42:58.707 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:42:58.707 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:42:58.707 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:42:58.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.707 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:42:58.707 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:42:58.708 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:42:58.708 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:42:58.708 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:42:58.708 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:42:58.709 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:42:58.709 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:42:58.709 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:42:58.709 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:42:58.709 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:42:58.709 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:42:58.709 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2020-10-31T22:42:58.710 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2020-10-31T22:42:58.710 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2020-10-31T22:42:58.710 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.710 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:42:58.710 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:42:58.710 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2020-10-31T22:42:58.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.711 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 6, 2020-10-31T22:42:58.712 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2020-10-31T22:42:58.712 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:47.507555+0000", 2020-10-31T22:42:58.712 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:42:58.712 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:42:58.714 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:42:58.715 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:42:58.717 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:42:58.718 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.719 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "33", 2020-10-31T22:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:42:58.720 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:42:58.721 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:42:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:42:58.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:42:58.724 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:42:58.725 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:42:58.726 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2020-10-31T22:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2020-10-31T22:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.727 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", 2020-10-31T22:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:42:58.728 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 31, 2020-10-31T22:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2020-10-31T22:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.730 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2020-10-31T22:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2020-10-31T22:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2020-10-31T22:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:42:58.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2020-10-31T22:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.734 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2020-10-31T22:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.735 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2020-10-31T22:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.736 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2020-10-31T22:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6803/14302", 2020-10-31T22:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6805/14302", 2020-10-31T22:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6809/14302", 2020-10-31T22:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6807/14302", 2020-10-31T22:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:42:58.738 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", 2020-10-31T22:42:58.739 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:42:58.740 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 31, 2020-10-31T22:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2020-10-31T22:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2020-10-31T22:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:42:58.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.743 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2020-10-31T22:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2020-10-31T22:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.744 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2020-10-31T22:42:58.745 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2020-10-31T22:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.746 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2020-10-31T22:42:58.747 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2020-10-31T22:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.748 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/14300", 2020-10-31T22:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6813/14300", 2020-10-31T22:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6817/14300", 2020-10-31T22:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6815/14300", 2020-10-31T22:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:42:58.749 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", 2020-10-31T22:42:58.750 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:42:58.751 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 30, 2020-10-31T22:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2020-10-31T22:42:58.752 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2020-10-31T22:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.753 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2020-10-31T22:42:58.754 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2020-10-31T22:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.755 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6832", 2020-10-31T22:42:58.756 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.757 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6833", 2020-10-31T22:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2020-10-31T22:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.759 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2020-10-31T22:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.761 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6827/14318", 2020-10-31T22:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6829/14318", 2020-10-31T22:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6833/14318", 2020-10-31T22:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6831/14318", 2020-10-31T22:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:42:58.762 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", 2020-10-31T22:42:58.763 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:42:58.764 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 31, 2020-10-31T22:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2020-10-31T22:42:58.765 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2020-10-31T22:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.767 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2020-10-31T22:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2020-10-31T22:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:42:58.768 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.769 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2020-10-31T22:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2020-10-31T22:42:58.770 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.771 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2020-10-31T22:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2020-10-31T22:42:58.772 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6819/14301", 2020-10-31T22:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6821/14301", 2020-10-31T22:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/14301", 2020-10-31T22:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6823/14301", 2020-10-31T22:42:58.773 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:42:58.774 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", 2020-10-31T22:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:42:58.775 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 31, 2020-10-31T22:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.776 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6816", 2020-10-31T22:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6817", 2020-10-31T22:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:42:58.777 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6818", 2020-10-31T22:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6819", 2020-10-31T22:42:58.779 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6822", 2020-10-31T22:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.781 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6823", 2020-10-31T22:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.785 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6820", 2020-10-31T22:42:58.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6821", 2020-10-31T22:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:42:58.787 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6817/14002", 2020-10-31T22:42:58.788 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6819/14002", 2020-10-31T22:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6823/14002", 2020-10-31T22:42:58.789 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6821/14002", 2020-10-31T22:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", 2020-10-31T22:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:42:58.791 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:42:58.792 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 31, 2020-10-31T22:42:58.793 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6800", 2020-10-31T22:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:42:58.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.796 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6801", 2020-10-31T22:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:42:58.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6802", 2020-10-31T22:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6803", 2020-10-31T22:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6806", 2020-10-31T22:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6807", 2020-10-31T22:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6804", 2020-10-31T22:42:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6805", 2020-10-31T22:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6801/14001", 2020-10-31T22:42:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6803/14001", 2020-10-31T22:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6807/14001", 2020-10-31T22:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6805/14001", 2020-10-31T22:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:42:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", 2020-10-31T22:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:42:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:42:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 30, 2020-10-31T22:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:42:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6808", 2020-10-31T22:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6809", 2020-10-31T22:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6810", 2020-10-31T22:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6811", 2020-10-31T22:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:42:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6814", 2020-10-31T22:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6815", 2020-10-31T22:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:42:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6812", 2020-10-31T22:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6813", 2020-10-31T22:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6809/14003", 2020-10-31T22:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6811/14003", 2020-10-31T22:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6815/14003", 2020-10-31T22:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6813/14003", 2020-10-31T22:42:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", 2020-10-31T22:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:42:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 31, 2020-10-31T22:42:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6824", 2020-10-31T22:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:42:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6825", 2020-10-31T22:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6826", 2020-10-31T22:42:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6827", 2020-10-31T22:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6830", 2020-10-31T22:42:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:42:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6831", 2020-10-31T22:42:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:42:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:42:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:42:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:42:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6828", 2020-10-31T22:42:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:42:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:42:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6829", 2020-10-31T22:42:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:42:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6825/14046", 2020-10-31T22:42:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6827/14046", 2020-10-31T22:42:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6831/14046", 2020-10-31T22:42:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6829/14046", 2020-10-31T22:42:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:42:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:42:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:42:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:42:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:42:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2020-10-31T22:42:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:42:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:42:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:42:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:42:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:42:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:42:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.314917+0000", 2020-10-31T22:42:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:42:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:42:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:42:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:42:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:42:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:42:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:42:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.643069+0000", 2020-10-31T22:42:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:42:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:42:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:42:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:42:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:42:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:42:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:42:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.662572+0000", 2020-10-31T22:42:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:42:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:42:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:42:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:42:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:42:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:42:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:42:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.664868+0000", 2020-10-31T22:42:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:42:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:42:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:42:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:42:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:42:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:42:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:42:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551107+0000", 2020-10-31T22:42:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:42:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:42:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:42:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:42:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:42:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:42:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:42:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.400568+0000", 2020-10-31T22:42:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:42:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:42:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:42:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:42:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:42:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:42:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:42:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551173+0000", 2020-10-31T22:42:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:42:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:42:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:42:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:42:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:42:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:42:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:42:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:42:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.604302+0000", 2020-10-31T22:42:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:42:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:42:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2020-10-31T22:42:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2020-10-31T22:42:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2020-10-31T22:42:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2020-10-31T22:42:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "blacklist": {}, 2020-10-31T22:42:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2020-10-31T22:42:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2020-10-31T22:42:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2020-10-31T22:42:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2020-10-31T22:42:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2020-10-31T22:42:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2020-10-31T22:42:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "ruleset-failure-domain": "osd", 2020-10-31T22:42:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2020-10-31T22:42:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:42:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:42:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2020-10-31T22:42:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2020-10-31T22:42:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2020-10-31T22:42:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2020-10-31T22:42:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {} 2020-10-31T22:42:58.862 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:42:58.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.659+0000 7f9889c08700 1 -- 172.21.15.60:0/1974970045 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9868054f10 msgr2=0x7f98680573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.659+0000 7f9889c08700 1 --2- 172.21.15.60:0/1974970045 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9868054f10 0x7f98680573d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f986c00d000 tx=0x7f986c007b60).stop 2020-10-31T22:42:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.659+0000 7f9889c08700 1 -- 172.21.15.60:0/1974970045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98840b0dc0 msgr2=0x7f9884146600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.659+0000 7f9889c08700 1 --2- 172.21.15.60:0/1974970045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98840b0dc0 0x7f9884146600 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f98740015d0 tx=0x7f9874007c20).stop 2020-10-31T22:42:58.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.659+0000 7f9889c08700 1 -- 172.21.15.60:0/1974970045 shutdown_connections 2020-10-31T22:42:58.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.659+0000 7f9889c08700 1 --2- 172.21.15.60:0/1974970045 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9868054f10 0x7f98680573d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.659+0000 7f9889c08700 1 --2- 172.21.15.60:0/1974970045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f988413fbe0 0x7f98840aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.659+0000 7f9889c08700 1 --2- 172.21.15.60:0/1974970045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98840b0dc0 0x7f9884146600 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.659+0000 7f9889c08700 1 --2- 172.21.15.60:0/1974970045 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98840b2d50 0x7f98840aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:58.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.659+0000 7f9889c08700 1 -- 172.21.15.60:0/1974970045 >> 172.21.15.60:0/1974970045 conn(0x7f988406a260 msgr2=0x7f988413dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:58.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.659+0000 7f9889c08700 1 -- 172.21.15.60:0/1974970045 shutdown_connections 2020-10-31T22:42:58.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.659+0000 7f9889c08700 1 -- 172.21.15.60:0/1974970045 wait complete. 2020-10-31T22:42:58.868 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:42:58.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.991+0000 7fe3e6cd3700 1 Processor -- start 2020-10-31T22:42:58.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e6cd3700 1 -- start start 2020-10-31T22:42:59.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e6cd3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3e00ab590 0x7fe3e013ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:59.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e6cd3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e0137f60 0x7fe3e0138370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:59.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e6cd3700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e00ae550 con 0x7fe3e00aeaf0 2020-10-31T22:42:59.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e6cd3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e013e360 con 0x7fe3e00ab590 2020-10-31T22:42:59.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e6cd3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e013e600 con 0x7fe3e0137f60 2020-10-31T22:42:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e4a6f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3e00ab590 0x7fe3e013ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e4a6f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3e00ab590 0x7fe3e013ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42988/0 (socket says 172.21.15.60:42988) 2020-10-31T22:42:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e4a6f700 1 -- 172.21.15.60:0/3814441497 learned_addr learned my addr 172.21.15.60:0/3814441497 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e5270700 1 --2- 172.21.15.60:0/3814441497 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e0137f60 0x7fe3e0138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e4a6f700 1 -- 172.21.15.60:0/3814441497 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e0137f60 msgr2=0x7fe3e0138370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:42:59.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e4a6f700 1 --2- 172.21.15.60:0/3814441497 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e0137f60 0x7fe3e0138370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e4a6f700 1 -- 172.21.15.60:0/3814441497 >> v1:172.21.15.66:6789/0 conn(0x7fe3e00aeaf0 legacy=0x7fe3e00ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3df7fe700 1 -- 172.21.15.60:0/3814441497 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991044918 0 0) 0x7fe3e00ae550 con 0x7fe3e00aeaf0 2020-10-31T22:42:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e4a6f700 1 -- 172.21.15.60:0/3814441497 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e013e8a0 con 0x7fe3e00ab590 2020-10-31T22:42:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e4a6f700 1 --2- 172.21.15.60:0/3814441497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e00ab590 0x7fe3e013ed40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fe3e00ad660 tx=0x7fe3d0006e80).ready entity=mon.0 client_cookie=4caf8f5301183c40 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3df7fe700 1 -- 172.21.15.60:0/3814441497 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d00097b0 con 0x7fe3e00ab590 2020-10-31T22:42:59.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3df7fe700 1 -- 172.21.15.60:0/3814441497 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d0009910 con 0x7fe3e00ab590 2020-10-31T22:42:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3df7fe700 1 -- 172.21.15.60:0/3814441497 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d0009c70 con 0x7fe3e00ab590 2020-10-31T22:42:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/3814441497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e00ab590 msgr2=0x7fe3e013ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e6cd3700 1 --2- 172.21.15.60:0/3814441497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e00ab590 0x7fe3e013ed40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fe3e00ad660 tx=0x7fe3d0006e80).stop 2020-10-31T22:42:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/3814441497 shutdown_connections 2020-10-31T22:42:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e6cd3700 1 --2- 172.21.15.60:0/3814441497 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e0137f60 0x7fe3e0138370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e6cd3700 1 --2- 172.21.15.60:0/3814441497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e00ab590 0x7fe3e013ed40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/3814441497 >> 172.21.15.60:0/3814441497 conn(0x7fe3e006a260 msgr2=0x7fe3e0061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:59.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/3814441497 shutdown_connections 2020-10-31T22:42:59.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.995+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/3814441497 wait complete. 2020-10-31T22:42:59.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.999+0000 7fe3e6cd3700 1 Processor -- start 2020-10-31T22:42:59.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.999+0000 7fe3e6cd3700 1 -- start start 2020-10-31T22:42:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.999+0000 7fe3e6cd3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e00ab590 0x7fe3e0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.999+0000 7fe3e6cd3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e00aeaf0 0x7fe3e0129c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:59.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.999+0000 7fe3e6cd3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3e0137f60 0x7fe3e0139da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:59.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.999+0000 7fe3e6cd3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e012fd60 con 0x7fe3e00ab590 2020-10-31T22:42:59.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.999+0000 7fe3e6cd3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e0139b60 con 0x7fe3e0137f60 2020-10-31T22:42:59.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.999+0000 7fe3e6cd3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e0152200 con 0x7fe3e00aeaf0 2020-10-31T22:42:59.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.999+0000 7fe3e4a6f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e00ab590 0x7fe3e0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:59.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.999+0000 7fe3e4a6f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e00ab590 0x7fe3e0152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:42992/0 (socket says 172.21.15.60:42992) 2020-10-31T22:42:59.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.999+0000 7fe3e4a6f700 1 -- 172.21.15.60:0/2245307155 learned_addr learned my addr 172.21.15.60:0/2245307155 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:59.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.999+0000 7fe3e5270700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3e0137f60 0x7fe3e0139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:59.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:58.999+0000 7fe3dffff700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e00aeaf0 0x7fe3e0129c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:59.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.003+0000 7fe3e4a6f700 1 -- 172.21.15.60:0/2245307155 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e00aeaf0 msgr2=0x7fe3e0129c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:59.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.003+0000 7fe3e4a6f700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e00aeaf0 0x7fe3e0129c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.003+0000 7fe3e4a6f700 1 -- 172.21.15.60:0/2245307155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3e0137f60 msgr2=0x7fe3e0139da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:59.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.003+0000 7fe3e4a6f700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3e0137f60 0x7fe3e0139da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.003+0000 7fe3e4a6f700 1 -- 172.21.15.60:0/2245307155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e01524a0 con 0x7fe3e00ab590 2020-10-31T22:42:59.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.003+0000 7fe3e5270700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3e0137f60 0x7fe3e0139da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:42:59.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.003+0000 7fe3e4a6f700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e00ab590 0x7fe3e0152be0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fe3e00ad660 tx=0x7fe3d0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:59.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.003+0000 7fe3ddffb700 1 -- 172.21.15.60:0/2245307155 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d0011b00 con 0x7fe3e00ab590 2020-10-31T22:42:59.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.003+0000 7fe3ddffb700 1 -- 172.21.15.60:0/2245307155 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d0011c60 con 0x7fe3e00ab590 2020-10-31T22:42:59.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.003+0000 7fe3ddffb700 1 -- 172.21.15.60:0/2245307155 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d001e460 con 0x7fe3e00ab590 2020-10-31T22:42:59.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.003+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/2245307155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e0152740 con 0x7fe3e00ab590 2020-10-31T22:42:59.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.003+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/2245307155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e012f9e0 con 0x7fe3e00ab590 2020-10-31T22:42:59.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.003+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/2245307155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e0152940 con 0x7fe3e00ab590 2020-10-31T22:42:59.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.007+0000 7fe3ddffb700 1 -- 172.21.15.60:0/2245307155 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe3d0025030 con 0x7fe3e00ab590 2020-10-31T22:42:59.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.007+0000 7fe3ddffb700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe3c0055020 0x7fe3c00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:59.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.007+0000 7fe3ddffb700 1 -- 172.21.15.60:0/2245307155 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe3d006ec80 con 0x7fe3e00ab590 2020-10-31T22:42:59.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.007+0000 7fe3dffff700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe3c0055020 0x7fe3c00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:59.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.007+0000 7fe3dffff700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe3c0055020 0x7fe3c00574e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fe3d400d000 tx=0x7fe3d40079d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:59.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.015+0000 7fe3ddffb700 1 -- 172.21.15.60:0/2245307155 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe3e0152940 con 0x7fe3e00ab590 2020-10-31T22:42:59.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.203+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/2245307155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3e0152940 con 0x7fe3e00ab590 2020-10-31T22:42:59.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.203+0000 7fe3ddffb700 1 -- 172.21.15.60:0/2245307155 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2489 (secure 0 0 0) 0x7fe3e0152940 con 0x7fe3e00ab590 2020-10-31T22:42:59.207 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:42:59.207 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":11,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3880421132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3880421132},{"type":"v1","addr":"172.21.15.60:6835","nonce":3880421132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1151967847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1151967847},{"type":"v1","addr":"172.21.15.66:6833","nonce":1151967847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:41:48.523345+0000","modified":"2020-10-31T22:41:49.526988+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4855},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4855":{"gid":4855,"name":"a","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2802890928","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2802890928},{"type":"v1","addr":"172.21.15.60:6837","nonce":2802890928}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-10-31T22:42:59.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.207+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/2245307155 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe3c0055020 msgr2=0x7fe3c00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:59.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.207+0000 7fe3e6cd3700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe3c0055020 0x7fe3c00574e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7fe3d400d000 tx=0x7fe3d40079d0).stop 2020-10-31T22:42:59.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.207+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/2245307155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e00ab590 msgr2=0x7fe3e0152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:59.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.207+0000 7fe3e6cd3700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e00ab590 0x7fe3e0152be0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7fe3e00ad660 tx=0x7fe3d0015000).stop 2020-10-31T22:42:59.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.207+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/2245307155 shutdown_connections 2020-10-31T22:42:59.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.207+0000 7fe3e6cd3700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe3c0055020 0x7fe3c00574e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.207+0000 7fe3e6cd3700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3e0137f60 0x7fe3e0139da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.207+0000 7fe3e6cd3700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3e00ab590 0x7fe3e0152be0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.207+0000 7fe3e6cd3700 1 --2- 172.21.15.60:0/2245307155 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e00aeaf0 0x7fe3e0129c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.207+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/2245307155 >> 172.21.15.60:0/2245307155 conn(0x7fe3e006a260 msgr2=0x7fe3e012ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:59.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.207+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/2245307155 shutdown_connections 2020-10-31T22:42:59.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.207+0000 7fe3e6cd3700 1 -- 172.21.15.60:0/2245307155 wait complete. 2020-10-31T22:42:59.211 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 11 2020-10-31T22:42:59.221 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-10-31T22:42:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc359e700 1 Processor -- start 2020-10-31T22:42:59.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc359e700 1 -- start start 2020-10-31T22:42:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc359e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdcc40b24a0 0x7fdcc40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:59.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc359e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc4145180 con 0x7fdcc4141fe0 2020-10-31T22:42:59.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc359e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc40b0670 con 0x7fdcc40b5570 2020-10-31T22:42:59.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc359e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc40afae0 con 0x7fdcc40b24a0 2020-10-31T22:42:59.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcb9d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdcc40b24a0 0x7fdcc40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:59.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc2d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdcc4141fe0 0x7fdcc4142490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47140/0 (socket says 172.21.15.60:47140) 2020-10-31T22:42:59.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcb9d9b700 1 --2- 172.21.15.60:0/2137878128 >> v2:172.21.15.60:3300/0 conn(0x7fdcc40b24a0 0x7fdcc40b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43002/0 (socket says 172.21.15.60:43002) 2020-10-31T22:42:59.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc2d9d700 1 -- 172.21.15.60:0/2137878128 learned_addr learned my addr 172.21.15.60:0/2137878128 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:42:59.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcb9d9b700 1 -- 172.21.15.60:0/2137878128 >> v1:172.21.15.66:6789/0 conn(0x7fdcc40b5570 legacy=0x7fdcc4145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:59.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcb9d9b700 1 -- 172.21.15.60:0/2137878128 >> v1:172.21.15.60:6789/0 conn(0x7fdcc4141fe0 legacy=0x7fdcc4142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:59.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcb9d9b700 1 -- 172.21.15.60:0/2137878128 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40b0910 con 0x7fdcc40b24a0 2020-10-31T22:42:59.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc1d9b700 1 -- 172.21.15.60:0/2137878128 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1173921946 0 0) 0x7fdcc40b0670 con 0x7fdcc40b5570 2020-10-31T22:42:59.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcb9d9b700 1 --2- 172.21.15.60:0/2137878128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc40b24a0 0x7fdcc40b5950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fdcbc001450 tx=0x7fdcac006dc0).ready entity=mon.0 client_cookie=13d343f556d89b74 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:59.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc1d9b700 1 -- 172.21.15.60:0/2137878128 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcac0096b0 con 0x7fdcc40b24a0 2020-10-31T22:42:59.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc1d9b700 1 -- 172.21.15.60:0/2137878128 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcac009810 con 0x7fdcc40b24a0 2020-10-31T22:42:59.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc1d9b700 1 -- 172.21.15.60:0/2137878128 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcac009b70 con 0x7fdcc40b24a0 2020-10-31T22:42:59.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc359e700 1 -- 172.21.15.60:0/2137878128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc40b24a0 msgr2=0x7fdcc40b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:59.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc359e700 1 --2- 172.21.15.60:0/2137878128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc40b24a0 0x7fdcc40b5950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fdcbc001450 tx=0x7fdcac006dc0).stop 2020-10-31T22:42:59.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc359e700 1 -- 172.21.15.60:0/2137878128 shutdown_connections 2020-10-31T22:42:59.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc359e700 1 --2- 172.21.15.60:0/2137878128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc40b24a0 0x7fdcc40b5950 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc359e700 1 -- 172.21.15.60:0/2137878128 >> 172.21.15.60:0/2137878128 conn(0x7fdcc40b8e90 msgr2=0x7fdcc40b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:59.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc359e700 1 -- 172.21.15.60:0/2137878128 shutdown_connections 2020-10-31T22:42:59.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.339+0000 7fdcc359e700 1 -- 172.21.15.60:0/2137878128 wait complete. 2020-10-31T22:42:59.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc359e700 1 Processor -- start 2020-10-31T22:42:59.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc359e700 1 -- start start 2020-10-31T22:42:59.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcc40b24a0 0x7fdcc41555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:59.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcc40b5570 0x7fdcc40aea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:59.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4141fe0 0x7fdcc4147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:59.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4147f20 con 0x7fdcc4141fe0 2020-10-31T22:42:59.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc41481c0 con 0x7fdcc40b24a0 2020-10-31T22:42:59.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc4148460 con 0x7fdcc40b5570 2020-10-31T22:42:59.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc2d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4141fe0 0x7fdcc4147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:59.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc2d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4141fe0 0x7fdcc4147230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43010/0 (socket says 172.21.15.60:43010) 2020-10-31T22:42:59.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc2d9d700 1 -- 172.21.15.60:0/3075018853 learned_addr learned my addr 172.21.15.60:0/3075018853 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:42:59.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcb9d9b700 1 --2- 172.21.15.60:0/3075018853 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcc40b5570 0x7fdcc40aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:59.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc259c700 1 --2- 172.21.15.60:0/3075018853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcc40b24a0 0x7fdcc41555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:59.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc2d9d700 1 -- 172.21.15.60:0/3075018853 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcc40b5570 msgr2=0x7fdcc40aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:59.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc2d9d700 1 --2- 172.21.15.60:0/3075018853 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcc40b5570 0x7fdcc40aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc2d9d700 1 -- 172.21.15.60:0/3075018853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcc40b24a0 msgr2=0x7fdcc41555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:59.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc2d9d700 1 --2- 172.21.15.60:0/3075018853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcc40b24a0 0x7fdcc41555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc2d9d700 1 -- 172.21.15.60:0/3075018853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc4148700 con 0x7fdcc4141fe0 2020-10-31T22:42:59.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.343+0000 7fdcc2d9d700 1 --2- 172.21.15.60:0/3075018853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4141fe0 0x7fdcc4147230 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fdcbc001490 tx=0x7fdcbc007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:59.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.347+0000 7fdcbbfff700 1 -- 172.21.15.60:0/3075018853 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcbc00cea0 con 0x7fdcc4141fe0 2020-10-31T22:42:59.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.347+0000 7fdcbbfff700 1 -- 172.21.15.60:0/3075018853 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc005b70 con 0x7fdcc4141fe0 2020-10-31T22:42:59.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.347+0000 7fdcbbfff700 1 -- 172.21.15.60:0/3075018853 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdcbc007110 con 0x7fdcc4141fe0 2020-10-31T22:42:59.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.347+0000 7fdcc359e700 1 -- 172.21.15.60:0/3075018853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc4155ad0 con 0x7fdcc4141fe0 2020-10-31T22:42:59.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.347+0000 7fdcc359e700 1 -- 172.21.15.60:0/3075018853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc40af190 con 0x7fdcc4141fe0 2020-10-31T22:42:59.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.347+0000 7fdcc359e700 1 -- 172.21.15.60:0/3075018853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc4057100 con 0x7fdcc4141fe0 2020-10-31T22:42:59.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.347+0000 7fdcbbfff700 1 -- 172.21.15.60:0/3075018853 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fdcbc010030 con 0x7fdcc4141fe0 2020-10-31T22:42:59.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.347+0000 7fdcbbfff700 1 --2- 172.21.15.60:0/3075018853 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdca8054f10 0x7fdca80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:42:59.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.347+0000 7fdcbbfff700 1 -- 172.21.15.60:0/3075018853 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdcbc06da30 con 0x7fdcc4141fe0 2020-10-31T22:42:59.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.347+0000 7fdcc259c700 1 --2- 172.21.15.60:0/3075018853 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdca8054f10 0x7fdca80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:42:59.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.347+0000 7fdcc259c700 1 --2- 172.21.15.60:0/3075018853 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdca8054f10 0x7fdca80573d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fdcb400d000 tx=0x7fdcb40079a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:42:59.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.359+0000 7fdcbbfff700 1 -- 172.21.15.60:0/3075018853 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdcbc043f50 con 0x7fdcc4141fe0 2020-10-31T22:42:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.547+0000 7fdcc359e700 1 -- 172.21.15.60:0/3075018853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdcc4148890 con 0x7fdcc4141fe0 2020-10-31T22:42:59.901 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:42:59.899+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:42:59.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.911+0000 7fdcbbfff700 1 -- 172.21.15.60:0/3075018853 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v12) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdcbc047570 con 0x7fdcc4141fe0 2020-10-31T22:42:59.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.915+0000 7fdcc359e700 1 -- 172.21.15.60:0/3075018853 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdca8054f10 msgr2=0x7fdca80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:59.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.915+0000 7fdcc359e700 1 --2- 172.21.15.60:0/3075018853 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdca8054f10 0x7fdca80573d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fdcb400d000 tx=0x7fdcb40079a0).stop 2020-10-31T22:42:59.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.915+0000 7fdcc359e700 1 -- 172.21.15.60:0/3075018853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4141fe0 msgr2=0x7fdcc4147230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:42:59.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.915+0000 7fdcc359e700 1 --2- 172.21.15.60:0/3075018853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4141fe0 0x7fdcc4147230 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fdcbc001490 tx=0x7fdcbc007e50).stop 2020-10-31T22:42:59.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.915+0000 7fdcc359e700 1 -- 172.21.15.60:0/3075018853 shutdown_connections 2020-10-31T22:42:59.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.915+0000 7fdcc359e700 1 --2- 172.21.15.60:0/3075018853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdcc4141fe0 0x7fdcc4147230 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.915+0000 7fdcc359e700 1 --2- 172.21.15.60:0/3075018853 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdca8054f10 0x7fdca80573d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.915+0000 7fdcc359e700 1 --2- 172.21.15.60:0/3075018853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdcc40b24a0 0x7fdcc41555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.915+0000 7fdcc359e700 1 --2- 172.21.15.60:0/3075018853 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdcc40b5570 0x7fdcc40aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:42:59.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.915+0000 7fdcc359e700 1 -- 172.21.15.60:0/3075018853 >> 172.21.15.60:0/3075018853 conn(0x7fdcc40b8e90 msgr2=0x7fdcc4065ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:42:59.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.915+0000 7fdcc359e700 1 -- 172.21.15.60:0/3075018853 shutdown_connections 2020-10-31T22:42:59.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:42:59.915+0000 7fdcc359e700 1 -- 172.21.15.60:0/3075018853 wait complete. 2020-10-31T22:42:59.920 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-10-31T22:42:59.934 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:42:59.951 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:43:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f289ca84700 1 Processor -- start 2020-10-31T22:43:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f289ca84700 1 -- start start 2020-10-31T22:43:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f289ca84700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28980b1d50 0x7f28980b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f289ca84700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f28980b0950 0x7f289805bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f289ca84700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28980b2130 con 0x7f2898141d80 2020-10-31T22:43:00.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f289ca84700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f289813fab0 con 0x7f28980b0950 2020-10-31T22:43:00.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f289ca84700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28980af380 con 0x7f28980b1d50 2020-10-31T22:43:00.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f2897fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f28980b0950 0x7f289805bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:00.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f28977fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28980b1d50 0x7f28980b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:00.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f2897fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f28980b0950 0x7f289805bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:53966/0 (socket says 172.21.15.60:53966) 2020-10-31T22:43:00.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f28977fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28980b1d50 0x7f28980b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:56214/0 (socket says 172.21.15.60:56214) 2020-10-31T22:43:00.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f2897fff700 1 -- 172.21.15.60:0/3946849210 learned_addr learned my addr 172.21.15.60:0/3946849210 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:00.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f28977fe700 1 -- 172.21.15.60:0/3946849210 >> v2:172.21.15.66:3300/0 conn(0x7f28980b0950 msgr2=0x7f289805bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:00.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f28977fe700 1 --2- 172.21.15.60:0/3946849210 >> v2:172.21.15.66:3300/0 conn(0x7f28980b0950 0x7f289805bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f28977fe700 1 -- 172.21.15.60:0/3946849210 >> v1:172.21.15.66:6789/0 conn(0x7f2898141d80 legacy=0x7f289805afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:00.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f28977fe700 1 -- 172.21.15.60:0/3946849210 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28980af620 con 0x7f28980b1d50 2020-10-31T22:43:00.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.043+0000 7f2897fff700 1 --2- 172.21.15.60:0/3946849210 >> v2:172.21.15.66:3300/0 conn(0x7f28980b0950 0x7f289805bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:00.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.047+0000 7f28977fe700 1 --2- 172.21.15.60:0/3946849210 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28980b1d50 0x7f28980b0000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2888002f30 tx=0x7f2888006dc0).ready entity=mon.2 client_cookie=648e6f61f42d07b8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:00.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.047+0000 7f28967fc700 1 -- 172.21.15.60:0/3946849210 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2888009760 con 0x7f28980b1d50 2020-10-31T22:43:00.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.047+0000 7f28967fc700 1 -- 172.21.15.60:0/3946849210 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28880098c0 con 0x7f28980b1d50 2020-10-31T22:43:00.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.047+0000 7f28967fc700 1 -- 172.21.15.60:0/3946849210 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2888009c20 con 0x7f28980b1d50 2020-10-31T22:43:00.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.047+0000 7f289ca84700 1 -- 172.21.15.60:0/3946849210 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28980b1d50 msgr2=0x7f28980b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:00.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.047+0000 7f289ca84700 1 --2- 172.21.15.60:0/3946849210 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28980b1d50 0x7f28980b0000 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f2888002f30 tx=0x7f2888006dc0).stop 2020-10-31T22:43:00.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.047+0000 7f289ca84700 1 -- 172.21.15.60:0/3946849210 shutdown_connections 2020-10-31T22:43:00.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.047+0000 7f289ca84700 1 --2- 172.21.15.60:0/3946849210 >> v2:172.21.15.66:3300/0 conn(0x7f28980b0950 0x7f289805bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.047+0000 7f289ca84700 1 --2- 172.21.15.60:0/3946849210 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28980b1d50 0x7f28980b0000 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.047+0000 7f289ca84700 1 -- 172.21.15.60:0/3946849210 >> 172.21.15.60:0/3946849210 conn(0x7f28980b5300 msgr2=0x7f28980b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:00.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.047+0000 7f289ca84700 1 -- 172.21.15.60:0/3946849210 shutdown_connections 2020-10-31T22:43:00.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.047+0000 7f289ca84700 1 -- 172.21.15.60:0/3946849210 wait complete. 2020-10-31T22:43:00.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.047+0000 7f289ca84700 1 Processor -- start 2020-10-31T22:43:00.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.047+0000 7f289ca84700 1 -- start start 2020-10-31T22:43:00.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f289ca84700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28980b0950 0x7f28981514b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:00.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f289ca84700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28980b1d50 0x7f28980ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:00.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f289ca84700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2898141d80 0x7f28980a8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:00.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f289ca84700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2898145500 con 0x7f2898141d80 2020-10-31T22:43:00.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f289ca84700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28981457a0 con 0x7f28980b1d50 2020-10-31T22:43:00.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f289ca84700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2898145a40 con 0x7f28980b0950 2020-10-31T22:43:00.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f28977fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28980b0950 0x7f28981514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:00.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f2896ffd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28980b1d50 0x7f28980ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:00.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f28977fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28980b0950 0x7f28981514b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:56220/0 (socket says 172.21.15.60:56220) 2020-10-31T22:43:00.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f28977fe700 1 -- 172.21.15.60:0/1954206891 learned_addr learned my addr 172.21.15.60:0/1954206891 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:00.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f2897fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2898141d80 0x7f28980a8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:00.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f28977fe700 1 -- 172.21.15.60:0/1954206891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28980b1d50 msgr2=0x7f28980ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:00.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f28977fe700 1 --2- 172.21.15.60:0/1954206891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28980b1d50 0x7f28980ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f28977fe700 1 -- 172.21.15.60:0/1954206891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2898141d80 msgr2=0x7f28980a8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:00.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f28977fe700 1 --2- 172.21.15.60:0/1954206891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2898141d80 0x7f28980a8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f28977fe700 1 -- 172.21.15.60:0/1954206891 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2898149160 con 0x7f28980b0950 2020-10-31T22:43:00.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f2897fff700 1 --2- 172.21.15.60:0/1954206891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2898141d80 0x7f28980a8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:00.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f28977fe700 1 --2- 172.21.15.60:0/1954206891 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28980b0950 0x7f28981514b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2888002f30 tx=0x7f2888015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:00.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f2894ff9700 1 -- 172.21.15.60:0/1954206891 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2888011a20 con 0x7f28980b0950 2020-10-31T22:43:00.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f2894ff9700 1 -- 172.21.15.60:0/1954206891 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2888011b80 con 0x7f28980b0950 2020-10-31T22:43:00.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f2894ff9700 1 -- 172.21.15.60:0/1954206891 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f288801d440 con 0x7f28980b0950 2020-10-31T22:43:00.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f289ca84700 1 -- 172.21.15.60:0/1954206891 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2898145dd0 con 0x7f28980b0950 2020-10-31T22:43:00.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f289ca84700 1 -- 172.21.15.60:0/1954206891 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28980a93f0 con 0x7f28980b0950 2020-10-31T22:43:00.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.051+0000 7f289ca84700 1 -- 172.21.15.60:0/1954206891 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28980a8bd0 con 0x7f28980b0950 2020-10-31T22:43:00.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.055+0000 7f2894ff9700 1 -- 172.21.15.60:0/1954206891 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2888024030 con 0x7f28980b0950 2020-10-31T22:43:00.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.055+0000 7f2894ff9700 1 --2- 172.21.15.60:0/1954206891 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f287c054f10 0x7f287c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:00.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.055+0000 7f2894ff9700 1 -- 172.21.15.60:0/1954206891 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f288806e800 con 0x7f28980b0950 2020-10-31T22:43:00.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.055+0000 7f2896ffd700 1 --2- 172.21.15.60:0/1954206891 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f287c054f10 0x7f287c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:00.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.055+0000 7f2896ffd700 1 --2- 172.21.15.60:0/1954206891 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f287c054f10 0x7f287c0573d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f288000d000 tx=0x7f2880007b20).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:00.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.063+0000 7f2894ff9700 1 -- 172.21.15.60:0/1954206891 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2888044c00 con 0x7f28980b0950 2020-10-31T22:43:00.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.251+0000 7f289ca84700 1 -- 172.21.15.60:0/1954206891 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2898145b80 con 0x7f28980b0950 2020-10-31T22:43:00.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.255+0000 7f2894ff9700 1 -- 172.21.15.60:0/1954206891 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2128 (secure 0 0 0) 0x7f2888022020 con 0x7f28980b0950 2020-10-31T22:43:00.256 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:00.256 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":12,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4667,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3880421132","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3880421132},{"type":"v1","addr":"172.21.15.60:6835","nonce":3880421132}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":8},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1151967847","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1151967847},{"type":"v1","addr":"172.21.15.66:6833","nonce":1151967847}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":9}],"filesystems":[{"mdsmap":{"epoch":12,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:41:48.523345+0000","modified":"2020-10-31T22:42:59.901115+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2020-10-31T22:43:00.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.255+0000 7f289ca84700 1 -- 172.21.15.60:0/1954206891 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f287c054f10 msgr2=0x7f287c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:00.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.255+0000 7f289ca84700 1 --2- 172.21.15.60:0/1954206891 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f287c054f10 0x7f287c0573d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f288000d000 tx=0x7f2880007b20).stop 2020-10-31T22:43:00.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.255+0000 7f289ca84700 1 -- 172.21.15.60:0/1954206891 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28980b0950 msgr2=0x7f28981514b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:00.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.255+0000 7f289ca84700 1 --2- 172.21.15.60:0/1954206891 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28980b0950 0x7f28981514b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f2888002f30 tx=0x7f2888015000).stop 2020-10-31T22:43:00.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.255+0000 7f289ca84700 1 -- 172.21.15.60:0/1954206891 shutdown_connections 2020-10-31T22:43:00.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.255+0000 7f289ca84700 1 --2- 172.21.15.60:0/1954206891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2898141d80 0x7f28980a8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.255+0000 7f289ca84700 1 --2- 172.21.15.60:0/1954206891 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28980b0950 0x7f28981514b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.255+0000 7f289ca84700 1 --2- 172.21.15.60:0/1954206891 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f287c054f10 0x7f287c0573d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.255+0000 7f289ca84700 1 --2- 172.21.15.60:0/1954206891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28980b1d50 0x7f28980ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.255+0000 7f289ca84700 1 -- 172.21.15.60:0/1954206891 >> 172.21.15.60:0/1954206891 conn(0x7f28980b5300 msgr2=0x7f289805bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:00.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.255+0000 7f289ca84700 1 -- 172.21.15.60:0/1954206891 shutdown_connections 2020-10-31T22:43:00.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.255+0000 7f289ca84700 1 -- 172.21.15.60:0/1954206891 wait complete. 2020-10-31T22:43:00.261 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 12 2020-10-31T22:43:00.270 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:43:00.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.419+0000 7f3acdb03700 1 Processor -- start 2020-10-31T22:43:00.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.419+0000 7f3acdb03700 1 -- start start 2020-10-31T22:43:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3ac80b5570 0x7f3ac80b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:00.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ac80b24a0 0x7f3ac8145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3ac8145d10 0x7f3ac8141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac80afae0 con 0x7f3ac80b5570 2020-10-31T22:43:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ac8141bf0 con 0x7f3ac8145d10 2020-10-31T22:43:00.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac813f930 con 0x7f3ac80b24a0 2020-10-31T22:43:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3accb01700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3ac80b5570 0x7f3ac80b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3accb01700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3ac80b5570 0x7f3ac80b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43044/0 (socket says 172.21.15.60:43044) 2020-10-31T22:43:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3ac7fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ac80b24a0 0x7f3ac8145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acd302700 1 --2- 172.21.15.60:0/2358064711 >> v2:172.21.15.66:3300/0 conn(0x7f3ac8145d10 0x7f3ac8141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:00.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3accb01700 1 -- 172.21.15.60:0/2358064711 learned_addr learned my addr 172.21.15.60:0/2358064711 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:00.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3accb01700 1 -- 172.21.15.60:0/2358064711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ac80b24a0 msgr2=0x7f3ac8145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:00.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3accb01700 1 --2- 172.21.15.60:0/2358064711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ac80b24a0 0x7f3ac8145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3accb01700 1 -- 172.21.15.60:0/2358064711 >> v2:172.21.15.66:3300/0 conn(0x7f3ac8145d10 msgr2=0x7f3ac8141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:00.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3accb01700 1 --2- 172.21.15.60:0/2358064711 >> v2:172.21.15.66:3300/0 conn(0x7f3ac8145d10 0x7f3ac8141fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3accb01700 1 -- 172.21.15.60:0/2358064711 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac8145180 con 0x7f3ac80b5570 2020-10-31T22:43:00.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acd302700 1 --2- 172.21.15.60:0/2358064711 >> v2:172.21.15.66:3300/0 conn(0x7f3ac8145d10 0x7f3ac8141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:00.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3ac7fff700 1 --2- 172.21.15.60:0/2358064711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ac80b24a0 0x7f3ac8145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:00.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3accb01700 1 --2- 172.21.15.60:0/2358064711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac80b5570 0x7f3ac80b5950 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f3ac8061290 tx=0x7f3ab8009270).ready entity=mon.0 client_cookie=98c1e3445f5a2789 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:00.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3ac77fe700 1 -- 172.21.15.60:0/2358064711 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ab8009e90 con 0x7f3ac80b5570 2020-10-31T22:43:00.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3ac77fe700 1 -- 172.21.15.60:0/2358064711 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab800bb10 con 0x7f3ac80b5570 2020-10-31T22:43:00.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3ac77fe700 1 -- 172.21.15.60:0/2358064711 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ab800bc80 con 0x7f3ac80b5570 2020-10-31T22:43:00.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 -- 172.21.15.60:0/2358064711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac80b5570 msgr2=0x7f3ac80b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:00.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 --2- 172.21.15.60:0/2358064711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac80b5570 0x7f3ac80b5950 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f3ac8061290 tx=0x7f3ab8009270).stop 2020-10-31T22:43:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 -- 172.21.15.60:0/2358064711 shutdown_connections 2020-10-31T22:43:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 --2- 172.21.15.60:0/2358064711 >> v2:172.21.15.66:3300/0 conn(0x7f3ac8145d10 0x7f3ac8141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 --2- 172.21.15.60:0/2358064711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac80b5570 0x7f3ac80b5950 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 --2- 172.21.15.60:0/2358064711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ac80b24a0 0x7f3ac8145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 -- 172.21.15.60:0/2358064711 >> 172.21.15.60:0/2358064711 conn(0x7f3ac80b8e90 msgr2=0x7f3ac80b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 -- 172.21.15.60:0/2358064711 shutdown_connections 2020-10-31T22:43:00.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 -- 172.21.15.60:0/2358064711 wait complete. 2020-10-31T22:43:00.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 Processor -- start 2020-10-31T22:43:00.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.423+0000 7f3acdb03700 1 -- start start 2020-10-31T22:43:00.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3acdb03700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac80b24a0 0x7f3ac80b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:00.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3acdb03700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80b5570 0x7f3ac8150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:00.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3acdb03700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ac8145d10 0x7f3ac813fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:00.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3acdb03700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac8150f90 con 0x7f3ac80b24a0 2020-10-31T22:43:00.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3acdb03700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac8141620 con 0x7f3ac80b5570 2020-10-31T22:43:00.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3acdb03700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac8147a20 con 0x7f3ac8145d10 2020-10-31T22:43:00.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3accb01700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac80b24a0 0x7f3ac80b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:00.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3accb01700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac80b24a0 0x7f3ac80b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43046/0 (socket says 172.21.15.60:43046) 2020-10-31T22:43:00.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3accb01700 1 -- 172.21.15.60:0/2530296199 learned_addr learned my addr 172.21.15.60:0/2530296199 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:00.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3ac7fff700 1 --2- 172.21.15.60:0/2530296199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80b5570 0x7f3ac8150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:00.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3acd302700 1 --2- 172.21.15.60:0/2530296199 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ac8145d10 0x7f3ac813fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:00.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3accb01700 1 -- 172.21.15.60:0/2530296199 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ac8145d10 msgr2=0x7f3ac813fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:00.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3accb01700 1 --2- 172.21.15.60:0/2530296199 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ac8145d10 0x7f3ac813fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3accb01700 1 -- 172.21.15.60:0/2530296199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80b5570 msgr2=0x7f3ac8150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:00.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3accb01700 1 --2- 172.21.15.60:0/2530296199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80b5570 0x7f3ac8150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3accb01700 1 -- 172.21.15.60:0/2530296199 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac8147c80 con 0x7f3ac80b24a0 2020-10-31T22:43:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3accb01700 1 --2- 172.21.15.60:0/2530296199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac80b24a0 0x7f3ac80b39f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f3ac81510d0 tx=0x7f3ab8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3ac5ffb700 1 -- 172.21.15.60:0/2530296199 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ab801e610 con 0x7f3ac80b24a0 2020-10-31T22:43:00.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3ac5ffb700 1 -- 172.21.15.60:0/2530296199 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab801e770 con 0x7f3ac80b24a0 2020-10-31T22:43:00.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3acdb03700 1 -- 172.21.15.60:0/2530296199 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ac8141850 con 0x7f3ac80b24a0 2020-10-31T22:43:00.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3ac5ffb700 1 -- 172.21.15.60:0/2530296199 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ab801ead0 con 0x7f3ac80b24a0 2020-10-31T22:43:00.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.427+0000 7f3acdb03700 1 -- 172.21.15.60:0/2530296199 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac813bc50 con 0x7f3ac80b24a0 2020-10-31T22:43:00.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.431+0000 7f3acdb03700 1 -- 172.21.15.60:0/2530296199 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ac8057100 con 0x7f3ac80b24a0 2020-10-31T22:43:00.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.431+0000 7f3ac5ffb700 1 -- 172.21.15.60:0/2530296199 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3ab800f070 con 0x7f3ac80b24a0 2020-10-31T22:43:00.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.431+0000 7f3ac5ffb700 1 --2- 172.21.15.60:0/2530296199 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3aac054f90 0x7f3aac057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:00.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.431+0000 7f3ac5ffb700 1 -- 172.21.15.60:0/2530296199 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3ab806eff0 con 0x7f3ac80b24a0 2020-10-31T22:43:00.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.431+0000 7f3ac7fff700 1 --2- 172.21.15.60:0/2530296199 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3aac054f90 0x7f3aac057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:00.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.431+0000 7f3ac7fff700 1 --2- 172.21.15.60:0/2530296199 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3aac054f90 0x7f3aac057450 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f3ab000b000 tx=0x7f3ab0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:00.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.435+0000 7f3ac5ffb700 1 -- 172.21.15.60:0/2530296199 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3ab80454a0 con 0x7f3ac80b24a0 2020-10-31T22:43:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.627+0000 7f3acdb03700 1 -- 172.21.15.60:0/2530296199 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3ac8140120 con 0x7f3ac80b24a0 2020-10-31T22:43:00.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.915+0000 7f3ac5ffb700 1 -- 172.21.15.60:0/2530296199 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3ab80150a0 con 0x7f3ac80b24a0 2020-10-31T22:43:00.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.919+0000 7f3acdb03700 1 -- 172.21.15.60:0/2530296199 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3aac054f90 msgr2=0x7f3aac057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:00.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.919+0000 7f3acdb03700 1 --2- 172.21.15.60:0/2530296199 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3aac054f90 0x7f3aac057450 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f3ab000b000 tx=0x7f3ab0008040).stop 2020-10-31T22:43:00.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.919+0000 7f3acdb03700 1 -- 172.21.15.60:0/2530296199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac80b24a0 msgr2=0x7f3ac80b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:00.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.919+0000 7f3acdb03700 1 --2- 172.21.15.60:0/2530296199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac80b24a0 0x7f3ac80b39f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f3ac81510d0 tx=0x7f3ab8016000).stop 2020-10-31T22:43:00.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.919+0000 7f3acdb03700 1 -- 172.21.15.60:0/2530296199 shutdown_connections 2020-10-31T22:43:00.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.919+0000 7f3acdb03700 1 --2- 172.21.15.60:0/2530296199 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ac8145d10 0x7f3ac813fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.919+0000 7f3acdb03700 1 --2- 172.21.15.60:0/2530296199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ac80b24a0 0x7f3ac80b39f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.919+0000 7f3acdb03700 1 --2- 172.21.15.60:0/2530296199 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3aac054f90 0x7f3aac057450 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.919+0000 7f3acdb03700 1 --2- 172.21.15.60:0/2530296199 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ac80b5570 0x7f3ac8150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:00.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.919+0000 7f3acdb03700 1 -- 172.21.15.60:0/2530296199 >> 172.21.15.60:0/2530296199 conn(0x7f3ac80b8e90 msgr2=0x7f3ac813d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:00.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.919+0000 7f3acdb03700 1 -- 172.21.15.60:0/2530296199 shutdown_connections 2020-10-31T22:43:00.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:00.919+0000 7f3acdb03700 1 -- 172.21.15.60:0/2530296199 wait complete. 2020-10-31T22:43:00.938 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:43:01.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457eb85700 1 Processor -- start 2020-10-31T22:43:01.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457eb85700 1 -- start start 2020-10-31T22:43:01.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457eb85700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f45780b1d50 0x7f4578145c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457eb85700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f457805c2d0 0x7f457805bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457eb85700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45780aef60 con 0x7f45780af410 2020-10-31T22:43:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457eb85700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45780b2130 con 0x7f457805c2d0 2020-10-31T22:43:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457eb85700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457805afe0 con 0x7f45780b1d50 2020-10-31T22:43:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457d382700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f457805c2d0 0x7f457805bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457d382700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f457805c2d0 0x7f457805bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43058/0 (socket says 172.21.15.60:43058) 2020-10-31T22:43:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457d382700 1 -- 172.21.15.60:0/1625061376 learned_addr learned my addr 172.21.15.60:0/1625061376 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457e384700 1 --1- 172.21.15.60:0/1625061376 >> v1:172.21.15.60:6789/0 conn(0x7f45780af410 0x7f457813f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47196/0 (socket says 172.21.15.60:47196) 2020-10-31T22:43:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457db83700 1 --2- 172.21.15.60:0/1625061376 >> v2:172.21.15.66:3300/0 conn(0x7f45780b1d50 0x7f4578145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457d382700 1 -- 172.21.15.60:0/1625061376 >> v2:172.21.15.66:3300/0 conn(0x7f45780b1d50 msgr2=0x7f4578145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:01.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457d382700 1 --2- 172.21.15.60:0/1625061376 >> v2:172.21.15.66:3300/0 conn(0x7f45780b1d50 0x7f4578145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:01.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457d382700 1 -- 172.21.15.60:0/1625061376 >> v1:172.21.15.60:6789/0 conn(0x7f45780af410 legacy=0x7f457813f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:01.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457d382700 1 -- 172.21.15.60:0/1625061376 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457805b280 con 0x7f457805c2d0 2020-10-31T22:43:01.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457d382700 1 --2- 172.21.15.60:0/1625061376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f457805c2d0 0x7f457805bc60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f4568002f30 tx=0x7f4568006e80).ready entity=mon.0 client_cookie=ffa412655adb1a33 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:01.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457cb81700 1 -- 172.21.15.60:0/1625061376 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45680097f0 con 0x7f457805c2d0 2020-10-31T22:43:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457cb81700 1 -- 172.21.15.60:0/1625061376 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4568009950 con 0x7f457805c2d0 2020-10-31T22:43:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457cb81700 1 -- 172.21.15.60:0/1625061376 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4568009cb0 con 0x7f457805c2d0 2020-10-31T22:43:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457eb85700 1 -- 172.21.15.60:0/1625061376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f457805c2d0 msgr2=0x7f457805bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.063+0000 7f457eb85700 1 --2- 172.21.15.60:0/1625061376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f457805c2d0 0x7f457805bc60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f4568002f30 tx=0x7f4568006e80).stop 2020-10-31T22:43:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.067+0000 7f457eb85700 1 -- 172.21.15.60:0/1625061376 shutdown_connections 2020-10-31T22:43:01.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.067+0000 7f457eb85700 1 --2- 172.21.15.60:0/1625061376 >> v2:172.21.15.66:3300/0 conn(0x7f45780b1d50 0x7f4578145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:01.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.067+0000 7f457eb85700 1 --2- 172.21.15.60:0/1625061376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f457805c2d0 0x7f457805bc60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:01.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.067+0000 7f457eb85700 1 -- 172.21.15.60:0/1625061376 >> 172.21.15.60:0/1625061376 conn(0x7f45780b5330 msgr2=0x7f45780b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:01.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.067+0000 7f457eb85700 1 -- 172.21.15.60:0/1625061376 shutdown_connections 2020-10-31T22:43:01.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.067+0000 7f457eb85700 1 -- 172.21.15.60:0/1625061376 wait complete. 2020-10-31T22:43:01.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.067+0000 7f457eb85700 1 Processor -- start 2020-10-31T22:43:01.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.067+0000 7f457eb85700 1 -- start start 2020-10-31T22:43:01.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457eb85700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f457805c2d0 0x7f45780aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:01.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457eb85700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45780af410 0x7f45781441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:01.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457eb85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45780b1d50 0x7f4578150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:01.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457eb85700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4578140050 con 0x7f45780b1d50 2020-10-31T22:43:01.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457eb85700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45780ae990 con 0x7f457805c2d0 2020-10-31T22:43:01.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457eb85700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45780aec30 con 0x7f45780af410 2020-10-31T22:43:01.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457e384700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45780b1d50 0x7f4578150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:01.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457e384700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45780b1d50 0x7f4578150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43066/0 (socket says 172.21.15.60:43066) 2020-10-31T22:43:01.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457d382700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45780af410 0x7f45781441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:01.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457db83700 1 --2- 172.21.15.60:0/2813089298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f457805c2d0 0x7f45780aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:01.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457e384700 1 -- 172.21.15.60:0/2813089298 learned_addr learned my addr 172.21.15.60:0/2813089298 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:01.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457e384700 1 -- 172.21.15.60:0/2813089298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45780af410 msgr2=0x7f45781441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:01.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457e384700 1 --2- 172.21.15.60:0/2813089298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45780af410 0x7f45781441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:01.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457e384700 1 -- 172.21.15.60:0/2813089298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f457805c2d0 msgr2=0x7f45780aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:01.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457e384700 1 --2- 172.21.15.60:0/2813089298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f457805c2d0 0x7f45780aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:01.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457e384700 1 -- 172.21.15.60:0/2813089298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4578140280 con 0x7f45780b1d50 2020-10-31T22:43:01.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457e384700 1 --2- 172.21.15.60:0/2813089298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45780b1d50 0x7f4578150c90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f4578062c50 tx=0x7f4570007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:01.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f4566ffd700 1 -- 172.21.15.60:0/2813089298 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45700072e0 con 0x7f45780b1d50 2020-10-31T22:43:01.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f4566ffd700 1 -- 172.21.15.60:0/2813089298 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4570005520 con 0x7f45780b1d50 2020-10-31T22:43:01.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f4566ffd700 1 -- 172.21.15.60:0/2813089298 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4570005880 con 0x7f45780b1d50 2020-10-31T22:43:01.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457eb85700 1 -- 172.21.15.60:0/2813089298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45780ae610 con 0x7f45780b1d50 2020-10-31T22:43:01.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.071+0000 7f457eb85700 1 -- 172.21.15.60:0/2813089298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45780add10 con 0x7f45780b1d50 2020-10-31T22:43:01.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.075+0000 7f457eb85700 1 -- 172.21.15.60:0/2813089298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45780ae7a0 con 0x7f45780b1d50 2020-10-31T22:43:01.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.075+0000 7f4566ffd700 1 -- 172.21.15.60:0/2813089298 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4570010070 con 0x7f45780b1d50 2020-10-31T22:43:01.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.075+0000 7f4566ffd700 1 --2- 172.21.15.60:0/2813089298 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4558054f90 0x7f4558057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:01.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.075+0000 7f457db83700 1 --2- 172.21.15.60:0/2813089298 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4558054f90 0x7f4558057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:01.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.075+0000 7f4566ffd700 1 -- 172.21.15.60:0/2813089298 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f457006cdf0 con 0x7f45780b1d50 2020-10-31T22:43:01.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.075+0000 7f457db83700 1 --2- 172.21.15.60:0/2813089298 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4558054f90 0x7f4558057450 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f457400b000 tx=0x7f45740091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:01.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.079+0000 7f4566ffd700 1 -- 172.21.15.60:0/2813089298 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f45700431b0 con 0x7f45780b1d50 2020-10-31T22:43:01.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.223+0000 7f457eb85700 1 -- 172.21.15.60:0/2813089298 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f45780aef60 con 0x7f45780b1d50 2020-10-31T22:43:01.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.919+0000 7f4566ffd700 1 -- 172.21.15.60:0/2813089298 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) v1 ==== 185+0+0 (secure 0 0 0) 0x7f45780aef60 con 0x7f45780b1d50 2020-10-31T22:43:01.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.923+0000 7f457eb85700 1 -- 172.21.15.60:0/2813089298 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4558054f90 msgr2=0x7f4558057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:01.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.923+0000 7f457eb85700 1 --2- 172.21.15.60:0/2813089298 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4558054f90 0x7f4558057450 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f457400b000 tx=0x7f45740091a0).stop 2020-10-31T22:43:01.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.923+0000 7f457eb85700 1 -- 172.21.15.60:0/2813089298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45780b1d50 msgr2=0x7f4578150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:01.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.923+0000 7f457eb85700 1 --2- 172.21.15.60:0/2813089298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45780b1d50 0x7f4578150c90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f4578062c50 tx=0x7f4570007b00).stop 2020-10-31T22:43:01.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.927+0000 7f457eb85700 1 -- 172.21.15.60:0/2813089298 shutdown_connections 2020-10-31T22:43:01.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.927+0000 7f457eb85700 1 --2- 172.21.15.60:0/2813089298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45780b1d50 0x7f4578150c90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:01.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.927+0000 7f457eb85700 1 --2- 172.21.15.60:0/2813089298 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4558054f90 0x7f4558057450 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:01.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.927+0000 7f457eb85700 1 --2- 172.21.15.60:0/2813089298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f457805c2d0 0x7f45780aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:01.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.927+0000 7f457eb85700 1 --2- 172.21.15.60:0/2813089298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45780af410 0x7f45781441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:01.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.927+0000 7f457eb85700 1 -- 172.21.15.60:0/2813089298 >> 172.21.15.60:0/2813089298 conn(0x7f45780b5330 msgr2=0x7f45780b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:01.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.927+0000 7f457eb85700 1 -- 172.21.15.60:0/2813089298 shutdown_connections 2020-10-31T22:43:01.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:01.927+0000 7f457eb85700 1 -- 172.21.15.60:0/2813089298 wait complete. 2020-10-31T22:43:01.930 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:43:01.943 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-10-31T22:43:02.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb319fd6700 1 Processor -- start 2020-10-31T22:43:02.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb319fd6700 1 -- start start 2020-10-31T22:43:02.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb319fd6700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb31405c8a0 0x7fb314141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:02.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb319fd6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb3140af400 0x7fb3140adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:02.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb319fd6700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31406a8f0 con 0x7fb3140b52a0 2020-10-31T22:43:02.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb319fd6700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31405c4f0 con 0x7fb31405c8a0 2020-10-31T22:43:02.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb319fd6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140af870 con 0x7fb3140af400 2020-10-31T22:43:02.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb312ffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb31405c8a0 0x7fb314141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:02.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb313fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb3140af400 0x7fb3140adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:02.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb312ffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb31405c8a0 0x7fb314141d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:54008/0 (socket says 172.21.15.60:54008) 2020-10-31T22:43:02.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb3137fe700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fb3140b52a0 0x7fb31405bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:45074/0 (socket says 172.21.15.60:45074) 2020-10-31T22:43:02.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb313fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb3140af400 0x7fb3140adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:56262/0 (socket says 172.21.15.60:56262) 2020-10-31T22:43:02.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb312ffd700 1 -- 172.21.15.60:0/3096069198 learned_addr learned my addr 172.21.15.60:0/3096069198 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:02.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb312ffd700 1 -- 172.21.15.60:0/3096069198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb3140af400 msgr2=0x7fb3140adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb312ffd700 1 --2- 172.21.15.60:0/3096069198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb3140af400 0x7fb3140adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb312ffd700 1 -- 172.21.15.60:0/3096069198 >> v1:172.21.15.66:6789/0 conn(0x7fb3140b52a0 legacy=0x7fb31405bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb312ffd700 1 -- 172.21.15.60:0/3096069198 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31405b160 con 0x7fb31405c8a0 2020-10-31T22:43:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.067+0000 7fb313fff700 1 --2- 172.21.15.60:0/3096069198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb3140af400 0x7fb3140adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb312ffd700 1 --2- 172.21.15.60:0/3096069198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb31405c8a0 0x7fb314141d50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fb3040032b0 tx=0x7fb304009270).ready entity=mon.1 client_cookie=517dbb02650bb069 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:02.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb3127fc700 1 -- 172.21.15.60:0/3096069198 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb304009e60 con 0x7fb31405c8a0 2020-10-31T22:43:02.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb3127fc700 1 -- 172.21.15.60:0/3096069198 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30400bc00 con 0x7fb31405c8a0 2020-10-31T22:43:02.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 -- 172.21.15.60:0/3096069198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb31405c8a0 msgr2=0x7fb314141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:02.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb3127fc700 1 -- 172.21.15.60:0/3096069198 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb30400bd70 con 0x7fb31405c8a0 2020-10-31T22:43:02.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 --2- 172.21.15.60:0/3096069198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb31405c8a0 0x7fb314141d50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fb3040032b0 tx=0x7fb304009270).stop 2020-10-31T22:43:02.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 -- 172.21.15.60:0/3096069198 shutdown_connections 2020-10-31T22:43:02.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 --2- 172.21.15.60:0/3096069198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb3140af400 0x7fb3140adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:02.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 --2- 172.21.15.60:0/3096069198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb31405c8a0 0x7fb314141d50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:02.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 -- 172.21.15.60:0/3096069198 >> 172.21.15.60:0/3096069198 conn(0x7fb314060c50 msgr2=0x7fb3140b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:02.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 -- 172.21.15.60:0/3096069198 shutdown_connections 2020-10-31T22:43:02.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 -- 172.21.15.60:0/3096069198 wait complete. 2020-10-31T22:43:02.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 Processor -- start 2020-10-31T22:43:02.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 -- start start 2020-10-31T22:43:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb31405c8a0 0x7fb3141470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb3140af400 0x7fb31409de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3140b52a0 0x7fb3141546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31409f120 con 0x7fb31405c8a0 2020-10-31T22:43:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140ab670 con 0x7fb3140b52a0 2020-10-31T22:43:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.071+0000 7fb319fd6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb314154270 con 0x7fb3140af400 2020-10-31T22:43:02.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb3137fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb31405c8a0 0x7fb3141470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:02.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb3137fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb31405c8a0 0x7fb3141470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43076/0 (socket says 172.21.15.60:43076) 2020-10-31T22:43:02.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb3137fe700 1 -- 172.21.15.60:0/996135622 learned_addr learned my addr 172.21.15.60:0/996135622 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:02.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb313fff700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3140b52a0 0x7fb3141546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:02.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb312ffd700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb3140af400 0x7fb31409de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:02.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb313fff700 1 -- 172.21.15.60:0/996135622 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb3140af400 msgr2=0x7fb31409de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:02.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb313fff700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb3140af400 0x7fb31409de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb313fff700 1 -- 172.21.15.60:0/996135622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb31405c8a0 msgr2=0x7fb3141470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb313fff700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb31405c8a0 0x7fb3141470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb313fff700 1 -- 172.21.15.60:0/996135622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb314144f60 con 0x7fb3140b52a0 2020-10-31T22:43:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb312ffd700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb3140af400 0x7fb31409de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb313fff700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3140b52a0 0x7fb3141546a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fb30800c000 tx=0x7fb308006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb310ff9700 1 -- 172.21.15.60:0/996135622 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb30800ca10 con 0x7fb3140b52a0 2020-10-31T22:43:02.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb310ff9700 1 -- 172.21.15.60:0/996135622 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30800cb70 con 0x7fb3140b52a0 2020-10-31T22:43:02.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb310ff9700 1 -- 172.21.15.60:0/996135622 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3080123f0 con 0x7fb3140b52a0 2020-10-31T22:43:02.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb319fd6700 1 -- 172.21.15.60:0/996135622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb314145200 con 0x7fb3140b52a0 2020-10-31T22:43:02.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb319fd6700 1 -- 172.21.15.60:0/996135622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3140a05a0 con 0x7fb3140b52a0 2020-10-31T22:43:02.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb319fd6700 1 -- 172.21.15.60:0/996135622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb314146100 con 0x7fb3140b52a0 2020-10-31T22:43:02.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.075+0000 7fb310ff9700 1 -- 172.21.15.60:0/996135622 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb308012550 con 0x7fb3140b52a0 2020-10-31T22:43:02.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.079+0000 7fb310ff9700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb2f4054f30 0x7fb2f40573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:02.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.079+0000 7fb310ff9700 1 -- 172.21.15.60:0/996135622 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fb30806de50 con 0x7fb3140b52a0 2020-10-31T22:43:02.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.079+0000 7fb3137fe700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb2f4054f30 0x7fb2f40573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:02.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.079+0000 7fb3137fe700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb2f4054f30 0x7fb2f40573f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fb30c00d000 tx=0x7fb30c007b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:02.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.087+0000 7fb310ff9700 1 -- 172.21.15.60:0/996135622 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb3080443d0 con 0x7fb3140b52a0 2020-10-31T22:43:02.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.231+0000 7fb319fd6700 1 -- 172.21.15.60:0/996135622 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb314145390 con 0x7fb3140b52a0 2020-10-31T22:43:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.931+0000 7fb310ff9700 1 -- 172.21.15.60:0/996135622 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) v1 ==== 173+0+0 (secure 0 0 0) 0x7fb3080479f0 con 0x7fb3140b52a0 2020-10-31T22:43:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.935+0000 7fb319fd6700 1 -- 172.21.15.60:0/996135622 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb2f4054f30 msgr2=0x7fb2f40573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.935+0000 7fb319fd6700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb2f4054f30 0x7fb2f40573f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fb30c00d000 tx=0x7fb30c007b80).stop 2020-10-31T22:43:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.935+0000 7fb319fd6700 1 -- 172.21.15.60:0/996135622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3140b52a0 msgr2=0x7fb3141546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:02.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.935+0000 7fb319fd6700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3140b52a0 0x7fb3141546a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fb30800c000 tx=0x7fb308006dc0).stop 2020-10-31T22:43:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.935+0000 7fb319fd6700 1 -- 172.21.15.60:0/996135622 shutdown_connections 2020-10-31T22:43:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.935+0000 7fb319fd6700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb2f4054f30 0x7fb2f40573f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.935+0000 7fb319fd6700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb3140b52a0 0x7fb3141546a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.935+0000 7fb319fd6700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb31405c8a0 0x7fb3141470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.935+0000 7fb319fd6700 1 --2- 172.21.15.60:0/996135622 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb3140af400 0x7fb31409de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.935+0000 7fb319fd6700 1 -- 172.21.15.60:0/996135622 >> 172.21.15.60:0/996135622 conn(0x7fb314060c50 msgr2=0x7fb31413ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.935+0000 7fb319fd6700 1 -- 172.21.15.60:0/996135622 shutdown_connections 2020-10-31T22:43:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:02.935+0000 7fb319fd6700 1 -- 172.21.15.60:0/996135622 wait complete. 2020-10-31T22:43:02.943 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2020-10-31T22:43:02.963 INFO:tasks.ceph.mds.a:Restarting daemon 2020-10-31T22:43:02.963 INFO:tasks.ceph.mds.a:Stopping old one... 2020-10-31T22:43:02.964 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-10-31T22:43:02.964 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:43:02.964 INFO:tasks.ceph.mds.c:Restarting daemon 2020-10-31T22:43:02.965 INFO:tasks.ceph.mds.c:Stopping old one... 2020-10-31T22:43:02.965 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-10-31T22:43:02.965 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:43:02.965 INFO:tasks.ceph.mds.b:Restarting daemon 2020-10-31T22:43:02.966 INFO:tasks.ceph.mds.b:Stopping old one... 2020-10-31T22:43:02.966 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-10-31T22:43:02.966 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:43:02.980 INFO:tasks.ceph.mds.a:Stopped 2020-10-31T22:43:02.980 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-10-31T22:43:02.981 INFO:tasks.ceph.mds.c:Stopped 2020-10-31T22:43:02.982 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-10-31T22:43:02.983 INFO:tasks.ceph.mds.b:Stopped 2020-10-31T22:43:02.987 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-10-31T22:43:03.021 INFO:tasks.ceph.mds.a:Started 2020-10-31T22:43:03.021 DEBUG:teuthology.parallel:result is None 2020-10-31T22:43:03.023 INFO:tasks.ceph.mds.c:Started 2020-10-31T22:43:03.023 DEBUG:teuthology.parallel:result is None 2020-10-31T22:43:03.024 INFO:tasks.ceph.mds.b:Started 2020-10-31T22:43:03.024 DEBUG:teuthology.parallel:result is None 2020-10-31T22:43:03.025 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-10-31T22:43:03.094 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:43:03.101 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:43:03.122 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:43:03.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.155+0000 7ff056276700 1 Processor -- start 2020-10-31T22:43:03.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.155+0000 7ff056276700 1 -- start start 2020-10-31T22:43:03.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.155+0000 7ff056276700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff0500b2010 0x7ff050150c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:03.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.155+0000 7ff056276700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0500ae220 con 0x7ff0500add70 2020-10-31T22:43:03.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.155+0000 7ff056276700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff050063520 con 0x7ff050063140 2020-10-31T22:43:03.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.155+0000 7ff056276700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0500adbd0 con 0x7ff0500b2010 2020-10-31T22:43:03.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.155+0000 7ff054a73700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff0500add70 0x7ff0500b1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47252/0 (socket says 172.21.15.60:47252) 2020-10-31T22:43:03.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.155+0000 7ff054a73700 1 -- 172.21.15.60:0/2359309098 learned_addr learned my addr 172.21.15.60:0/2359309098 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:03.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff055a75700 1 --2- 172.21.15.60:0/2359309098 >> v2:172.21.15.66:3300/0 conn(0x7ff0500b2010 0x7ff050150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:03.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff04ffff700 1 -- 172.21.15.60:0/2359309098 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907131083 0 0) 0x7ff0500ae220 con 0x7ff0500add70 2020-10-31T22:43:03.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff04ffff700 1 -- 172.21.15.60:0/2359309098 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff03c003230 con 0x7ff0500add70 2020-10-31T22:43:03.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff04ffff700 1 -- 172.21.15.60:0/2359309098 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482942950 0 0) 0x7ff050063520 con 0x7ff050063140 2020-10-31T22:43:03.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff04ffff700 1 -- 172.21.15.60:0/2359309098 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0500ae220 con 0x7ff050063140 2020-10-31T22:43:03.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff055a75700 1 -- 172.21.15.60:0/2359309098 >> v1:172.21.15.66:6789/0 conn(0x7ff050063140 legacy=0x7ff0500b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:03.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff055a75700 1 -- 172.21.15.60:0/2359309098 >> v1:172.21.15.60:6789/0 conn(0x7ff0500add70 legacy=0x7ff0500b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:03.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff055a75700 1 -- 172.21.15.60:0/2359309098 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0500afed0 con 0x7ff0500b2010 2020-10-31T22:43:03.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff055a75700 1 --2- 172.21.15.60:0/2359309098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0500b2010 0x7ff050150c70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff040002f30 tx=0x7ff040006dc0).ready entity=mon.1 client_cookie=deb2b025cfcdd1e8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:03.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff04ffff700 1 -- 172.21.15.60:0/2359309098 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff040009740 con 0x7ff0500b2010 2020-10-31T22:43:03.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff04ffff700 1 -- 172.21.15.60:0/2359309098 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0400098a0 con 0x7ff0500b2010 2020-10-31T22:43:03.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff04ffff700 1 -- 172.21.15.60:0/2359309098 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff040009c00 con 0x7ff0500b2010 2020-10-31T22:43:03.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff056276700 1 -- 172.21.15.60:0/2359309098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0500b2010 msgr2=0x7ff050150c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:03.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff056276700 1 --2- 172.21.15.60:0/2359309098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0500b2010 0x7ff050150c70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7ff040002f30 tx=0x7ff040006dc0).stop 2020-10-31T22:43:03.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff056276700 1 -- 172.21.15.60:0/2359309098 shutdown_connections 2020-10-31T22:43:03.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff056276700 1 --2- 172.21.15.60:0/2359309098 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0500b2010 0x7ff050150c70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:03.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff056276700 1 -- 172.21.15.60:0/2359309098 >> 172.21.15.60:0/2359309098 conn(0x7ff05006a600 msgr2=0x7ff050060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:03.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff056276700 1 -- 172.21.15.60:0/2359309098 shutdown_connections 2020-10-31T22:43:03.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff056276700 1 -- 172.21.15.60:0/2359309098 wait complete. 2020-10-31T22:43:03.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff056276700 1 Processor -- start 2020-10-31T22:43:03.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.159+0000 7ff056276700 1 -- start start 2020-10-31T22:43:03.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff056276700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff050063140 0x7ff0500aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:03.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff056276700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff0500add70 0x7ff05014d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:03.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff056276700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500b2010 0x7ff050065450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:03.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff056276700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05014c2f0 con 0x7ff0500b2010 2020-10-31T22:43:03.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff056276700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05014cd70 con 0x7ff050063140 2020-10-31T22:43:03.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff056276700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05014bc40 con 0x7ff0500add70 2020-10-31T22:43:03.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff055a75700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500b2010 0x7ff050065450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:03.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff055a75700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500b2010 0x7ff050065450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43124/0 (socket says 172.21.15.60:43124) 2020-10-31T22:43:03.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff055a75700 1 -- 172.21.15.60:0/3952024216 learned_addr learned my addr 172.21.15.60:0/3952024216 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:03.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff055274700 1 --2- 172.21.15.60:0/3952024216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff050063140 0x7ff0500aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:03.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff054a73700 1 --2- 172.21.15.60:0/3952024216 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff0500add70 0x7ff05014d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:03.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff055a75700 1 -- 172.21.15.60:0/3952024216 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff0500add70 msgr2=0x7ff05014d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:03.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff055a75700 1 --2- 172.21.15.60:0/3952024216 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff0500add70 0x7ff05014d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:03.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff055a75700 1 -- 172.21.15.60:0/3952024216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff050063140 msgr2=0x7ff0500aa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:03.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff055a75700 1 --2- 172.21.15.60:0/3952024216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff050063140 0x7ff0500aa1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:03.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff055a75700 1 -- 172.21.15.60:0/3952024216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff050065940 con 0x7ff0500b2010 2020-10-31T22:43:03.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff055a75700 1 --2- 172.21.15.60:0/3952024216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500b2010 0x7ff050065450 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7ff040002f30 tx=0x7ff040015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:03.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff04e7fc700 1 -- 172.21.15.60:0/3952024216 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff040011b10 con 0x7ff0500b2010 2020-10-31T22:43:03.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff04e7fc700 1 -- 172.21.15.60:0/3952024216 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff040011c70 con 0x7ff0500b2010 2020-10-31T22:43:03.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff056276700 1 -- 172.21.15.60:0/3952024216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05014b860 con 0x7ff0500b2010 2020-10-31T22:43:03.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff04e7fc700 1 -- 172.21.15.60:0/3952024216 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff04001d450 con 0x7ff0500b2010 2020-10-31T22:43:03.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff056276700 1 -- 172.21.15.60:0/3952024216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0500ab3e0 con 0x7ff0500b2010 2020-10-31T22:43:03.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff056276700 1 -- 172.21.15.60:0/3952024216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff050065ad0 con 0x7ff0500b2010 2020-10-31T22:43:03.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff04e7fc700 1 -- 172.21.15.60:0/3952024216 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff04000f070 con 0x7ff0500b2010 2020-10-31T22:43:03.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff04e7fc700 1 --2- 172.21.15.60:0/3952024216 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff030054f60 0x7ff030057420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:03.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff04e7fc700 1 -- 172.21.15.60:0/3952024216 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5339+0+0 (secure 0 0 0) 0x7ff04006ef60 con 0x7ff0500b2010 2020-10-31T22:43:03.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.163+0000 7ff055274700 1 --2- 172.21.15.60:0/3952024216 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff030054f60 0x7ff030057420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:03.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.167+0000 7ff055274700 1 --2- 172.21.15.60:0/3952024216 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff030054f60 0x7ff030057420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7ff04800d000 tx=0x7ff048007ce0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:03.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.171+0000 7ff04e7fc700 1 -- 172.21.15.60:0/3952024216 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff0400457e0 con 0x7ff0500b2010 2020-10-31T22:43:03.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:03.343+0000 7ff056276700 1 -- 172.21.15.60:0/3952024216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7ff050057100 con 0x7ff0500b2010 2020-10-31T22:43:04.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.155+0000 7ff04e7fc700 1 -- 172.21.15.60:0/3952024216 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v40) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff040048d80 con 0x7ff0500b2010 2020-10-31T22:43:04.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.159+0000 7ff056276700 1 -- 172.21.15.60:0/3952024216 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff030054f60 msgr2=0x7ff030057420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.159+0000 7ff056276700 1 --2- 172.21.15.60:0/3952024216 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff030054f60 0x7ff030057420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7ff04800d000 tx=0x7ff048007ce0).stop 2020-10-31T22:43:04.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.159+0000 7ff056276700 1 -- 172.21.15.60:0/3952024216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500b2010 msgr2=0x7ff050065450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.159+0000 7ff056276700 1 --2- 172.21.15.60:0/3952024216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500b2010 0x7ff050065450 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7ff040002f30 tx=0x7ff040015000).stop 2020-10-31T22:43:04.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.159+0000 7ff056276700 1 -- 172.21.15.60:0/3952024216 shutdown_connections 2020-10-31T22:43:04.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.159+0000 7ff056276700 1 --2- 172.21.15.60:0/3952024216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff0500b2010 0x7ff050065450 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.159+0000 7ff056276700 1 --2- 172.21.15.60:0/3952024216 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff030054f60 0x7ff030057420 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.159+0000 7ff056276700 1 --2- 172.21.15.60:0/3952024216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff050063140 0x7ff0500aa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.159+0000 7ff056276700 1 --2- 172.21.15.60:0/3952024216 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff0500add70 0x7ff05014d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.159+0000 7ff056276700 1 -- 172.21.15.60:0/3952024216 >> 172.21.15.60:0/3952024216 conn(0x7ff05006a600 msgr2=0x7ff0500b5040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:04.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.159+0000 7ff056276700 1 -- 172.21.15.60:0/3952024216 shutdown_connections 2020-10-31T22:43:04.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.159+0000 7ff056276700 1 -- 172.21.15.60:0/3952024216 wait complete. 2020-10-31T22:43:04.164 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blacklist entries 2020-10-31T22:43:04.179 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2020-10-31T22:43:04.180 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-10-31T22:43:04.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.299+0000 7f5dc53fe700 1 Processor -- start 2020-10-31T22:43:04.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.299+0000 7f5dc53fe700 1 -- start start 2020-10-31T22:43:04.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.299+0000 7f5dc53fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5dc00b5570 0x7f5dc00b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:04.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.299+0000 7f5dc53fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5dc0141fe0 0x7f5dc0142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:04.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.299+0000 7f5dc53fe700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dc0145180 con 0x7f5dc00b24a0 2020-10-31T22:43:04.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.299+0000 7f5dc53fe700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc00afae0 con 0x7f5dc00b5570 2020-10-31T22:43:04.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.299+0000 7f5dc53fe700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc0141bf0 con 0x7f5dc0141fe0 2020-10-31T22:43:04.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.299+0000 7f5dbffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5dc00b5570 0x7f5dc00b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:04.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dbffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5dc00b5570 0x7f5dc00b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43134/0 (socket says 172.21.15.60:43134) 2020-10-31T22:43:04.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dbffff700 1 -- 172.21.15.60:0/287192933 learned_addr learned my addr 172.21.15.60:0/287192933 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:04.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dc4bfd700 1 --2- 172.21.15.60:0/287192933 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5dc0141fe0 0x7f5dc0142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:04.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dbffff700 1 -- 172.21.15.60:0/287192933 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5dc0141fe0 msgr2=0x7f5dc0142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:04.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dbffff700 1 --2- 172.21.15.60:0/287192933 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5dc0141fe0 0x7f5dc0142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dbffff700 1 -- 172.21.15.60:0/287192933 >> v1:172.21.15.66:6789/0 conn(0x7f5dc00b24a0 legacy=0x7f5dc0145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dbffff700 1 -- 172.21.15.60:0/287192933 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc00b0670 con 0x7f5dc00b5570 2020-10-31T22:43:04.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dbffff700 1 --2- 172.21.15.60:0/287192933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc00b5570 0x7f5dc00b5950 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f5dc005f580 tx=0x7f5db0006e80).ready entity=mon.0 client_cookie=ef39bf84b3b5f152 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:04.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dbf7fe700 1 -- 172.21.15.60:0/287192933 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5db00097b0 con 0x7f5dc00b5570 2020-10-31T22:43:04.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dbf7fe700 1 -- 172.21.15.60:0/287192933 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db0009910 con 0x7f5dc00b5570 2020-10-31T22:43:04.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dbf7fe700 1 -- 172.21.15.60:0/287192933 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5db0009c70 con 0x7f5dc00b5570 2020-10-31T22:43:04.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dc53fe700 1 -- 172.21.15.60:0/287192933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc00b5570 msgr2=0x7f5dc00b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dc53fe700 1 --2- 172.21.15.60:0/287192933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc00b5570 0x7f5dc00b5950 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f5dc005f580 tx=0x7f5db0006e80).stop 2020-10-31T22:43:04.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dc53fe700 1 -- 172.21.15.60:0/287192933 shutdown_connections 2020-10-31T22:43:04.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dc53fe700 1 --2- 172.21.15.60:0/287192933 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5dc0141fe0 0x7f5dc0142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dc53fe700 1 --2- 172.21.15.60:0/287192933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc00b5570 0x7f5dc00b5950 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dc53fe700 1 -- 172.21.15.60:0/287192933 >> 172.21.15.60:0/287192933 conn(0x7f5dc00b8e90 msgr2=0x7f5dc00b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:04.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dc53fe700 1 -- 172.21.15.60:0/287192933 shutdown_connections 2020-10-31T22:43:04.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dc53fe700 1 -- 172.21.15.60:0/287192933 wait complete. 2020-10-31T22:43:04.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dc53fe700 1 Processor -- start 2020-10-31T22:43:04.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.303+0000 7f5dc53fe700 1 -- start start 2020-10-31T22:43:04.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dc53fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc00b24a0 0x7f5dc0144b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:04.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dc53fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5dc00b5570 0x7f5dc01488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:04.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dc53fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc0141fe0 0x7f5dc0154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:04.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dc53fe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc0148dd0 con 0x7f5dc00b24a0 2020-10-31T22:43:04.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dc53fe700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc0143620 con 0x7f5dc0141fe0 2020-10-31T22:43:04.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dc53fe700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc0141080 con 0x7f5dc00b5570 2020-10-31T22:43:04.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dbffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc00b24a0 0x7f5dc0144b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:04.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dbffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc00b24a0 0x7f5dc0144b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43138/0 (socket says 172.21.15.60:43138) 2020-10-31T22:43:04.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dbffff700 1 -- 172.21.15.60:0/64918291 learned_addr learned my addr 172.21.15.60:0/64918291 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:04.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dc4bfd700 1 --2- 172.21.15.60:0/64918291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc0141fe0 0x7f5dc0154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:04.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5db77fe700 1 --2- 172.21.15.60:0/64918291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5dc00b5570 0x7f5dc01488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:04.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dbffff700 1 -- 172.21.15.60:0/64918291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5dc00b5570 msgr2=0x7f5dc01488e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dbffff700 1 --2- 172.21.15.60:0/64918291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5dc00b5570 0x7f5dc01488e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dbffff700 1 -- 172.21.15.60:0/64918291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc0141fe0 msgr2=0x7f5dc0154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dbffff700 1 --2- 172.21.15.60:0/64918291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc0141fe0 0x7f5dc0154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dbffff700 1 -- 172.21.15.60:0/64918291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc0141320 con 0x7f5dc00b24a0 2020-10-31T22:43:04.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dbffff700 1 --2- 172.21.15.60:0/64918291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc00b24a0 0x7f5dc0144b70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f5dc005f580 tx=0x7f5db0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:04.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dbdffb700 1 -- 172.21.15.60:0/64918291 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5db0011b40 con 0x7f5dc00b24a0 2020-10-31T22:43:04.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dbdffb700 1 -- 172.21.15.60:0/64918291 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db0011ca0 con 0x7f5dc00b24a0 2020-10-31T22:43:04.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dc53fe700 1 -- 172.21.15.60:0/64918291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc0143020 con 0x7f5dc00b24a0 2020-10-31T22:43:04.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dbdffb700 1 -- 172.21.15.60:0/64918291 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5db001e460 con 0x7f5dc00b24a0 2020-10-31T22:43:04.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dc53fe700 1 -- 172.21.15.60:0/64918291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc0154550 con 0x7f5dc00b24a0 2020-10-31T22:43:04.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dc53fe700 1 -- 172.21.15.60:0/64918291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc0057100 con 0x7f5dc00b24a0 2020-10-31T22:43:04.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.307+0000 7f5dbdffb700 1 -- 172.21.15.60:0/64918291 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5db0025030 con 0x7f5dc00b24a0 2020-10-31T22:43:04.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.311+0000 7f5dbdffb700 1 --2- 172.21.15.60:0/64918291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5da4054f10 0x7f5da40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:04.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.311+0000 7f5db77fe700 1 --2- 172.21.15.60:0/64918291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5da4054f10 0x7f5da40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:04.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.311+0000 7f5dbdffb700 1 -- 172.21.15.60:0/64918291 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5db006ea70 con 0x7f5dc00b24a0 2020-10-31T22:43:04.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.311+0000 7f5db77fe700 1 --2- 172.21.15.60:0/64918291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5da4054f10 0x7f5da40573d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f5da800d000 tx=0x7f5da8000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:04.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.315+0000 7f5dbdffb700 1 -- 172.21.15.60:0/64918291 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5db0045220 con 0x7f5dc00b24a0 2020-10-31T22:43:04.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.511+0000 7f5dc53fe700 1 -- 172.21.15.60:0/64918291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5dc005a8e0 con 0x7f5dc00b24a0 2020-10-31T22:43:04.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.511+0000 7f5dbdffb700 1 -- 172.21.15.60:0/64918291 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f5db006ee60 con 0x7f5dc00b24a0 2020-10-31T22:43:04.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.515+0000 7f5dc53fe700 1 -- 172.21.15.60:0/64918291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5da4054f10 msgr2=0x7f5da40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.515+0000 7f5dc53fe700 1 --2- 172.21.15.60:0/64918291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5da4054f10 0x7f5da40573d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f5da800d000 tx=0x7f5da8000b80).stop 2020-10-31T22:43:04.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.515+0000 7f5dc53fe700 1 -- 172.21.15.60:0/64918291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc00b24a0 msgr2=0x7f5dc0144b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.515+0000 7f5dc53fe700 1 --2- 172.21.15.60:0/64918291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc00b24a0 0x7f5dc0144b70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f5dc005f580 tx=0x7f5db0015000).stop 2020-10-31T22:43:04.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.515+0000 7f5dc53fe700 1 -- 172.21.15.60:0/64918291 shutdown_connections 2020-10-31T22:43:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.515+0000 7f5dc53fe700 1 --2- 172.21.15.60:0/64918291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5da4054f10 0x7f5da40573d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.515+0000 7f5dc53fe700 1 --2- 172.21.15.60:0/64918291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5dc0141fe0 0x7f5dc0154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.515+0000 7f5dc53fe700 1 --2- 172.21.15.60:0/64918291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5dc00b24a0 0x7f5dc0144b70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.515+0000 7f5dc53fe700 1 --2- 172.21.15.60:0/64918291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5dc00b5570 0x7f5dc01488e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.515+0000 7f5dc53fe700 1 -- 172.21.15.60:0/64918291 >> 172.21.15.60:0/64918291 conn(0x7f5dc00b8e90 msgr2=0x7f5dc0066260 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:04.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.515+0000 7f5dc53fe700 1 -- 172.21.15.60:0/64918291 shutdown_connections 2020-10-31T22:43:04.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.515+0000 7f5dc53fe700 1 -- 172.21.15.60:0/64918291 wait complete. 2020-10-31T22:43:04.524 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:04.524 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:43:04.524 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2020-10-31T22:43:04.525 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.526 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2020-10-31T22:43:04.526 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f7D/cFRAAHQ9NU7VSs14mi5sC/GwHng==", 2020-10-31T22:43:04.526 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:43:04.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:43:04.527 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:43:04.527 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:43:04.528 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.528 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.528 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2020-10-31T22:43:04.529 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f5SPjJBAAVjFv2PdBZ7j94etJrAT0tA==", 2020-10-31T22:43:04.529 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.529 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:43:04.529 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:43:04.530 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:43:04.530 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:43:04.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.531 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2020-10-31T22:43:04.531 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKpdoHhAAhhlaYqOQoI6tTKexjRpbGA==", 2020-10-31T22:43:04.531 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.532 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:43:04.532 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:43:04.532 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:43:04.532 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:43:04.533 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.533 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.533 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.534 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2020-10-31T22:43:04.534 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDR551f7MwsMRAACZIQlAKm3BdVbDs2gQAfxg==", 2020-10-31T22:43:04.534 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.534 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:43:04.535 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:43:04.535 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:43:04.535 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.536 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.536 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.537 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2020-10-31T22:43:04.537 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDU551f07HQFxAAokMFXwsbgKGtJNpnKerdGg==", 2020-10-31T22:43:04.537 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.538 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:43:04.538 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:43:04.538 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:43:04.538 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.539 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.539 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.539 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2020-10-31T22:43:04.540 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDW551fODyjOhAAJ+j8KITJidSpltSiJaQZGw==", 2020-10-31T22:43:04.540 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.540 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:43:04.541 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:43:04.541 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:43:04.541 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.542 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.542 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.542 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2020-10-31T22:43:04.542 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDZ551fs+aCIhAAwpbmgGQjU05W3hZofTtHdg==", 2020-10-31T22:43:04.543 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.543 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:43:04.543 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:43:04.544 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:43:04.544 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.544 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.545 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2020-10-31T22:43:04.545 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDe551fI5nIMxAAwwNSHQYDPS6G2achKIpwqg==", 2020-10-31T22:43:04.545 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.545 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:43:04.546 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:43:04.547 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:43:04.547 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.547 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.548 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2020-10-31T22:43:04.548 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDh551f68p2GhAAhlGpZLPg8RqouzStqN4tFw==", 2020-10-31T22:43:04.548 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.548 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:43:04.549 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:43:04.549 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:43:04.549 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.550 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2020-10-31T22:43:04.550 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDk551fUi3kARAAsXPU7HEhqax8Go00CqgdNw==", 2020-10-31T22:43:04.551 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.551 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:43:04.551 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:43:04.551 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:43:04.552 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.552 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.552 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.552 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2020-10-31T22:43:04.553 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDm551fKh4aJRAAj+whV4kueCu2Og7wZ05tNw==", 2020-10-31T22:43:04.553 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.553 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:43:04.553 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:43:04.554 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:43:04.554 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.555 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2020-10-31T22:43:04.555 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551flXvBJxAAtD4URDL2NV0zyAympufvVA==", 2020-10-31T22:43:04.555 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.555 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:43:04.556 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:43:04.556 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:43:04.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.557 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.558 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2020-10-31T22:43:04.558 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fQ/OGKhAA/xGrRlUW52pP6E6SWXYAGA==", 2020-10-31T22:43:04.558 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.558 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:43:04.559 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:43:04.559 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:43:04.559 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.560 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.560 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2020-10-31T22:43:04.560 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDP551fITgCMxAAQy5CQzqda1YjdUtTRxbsPQ==", 2020-10-31T22:43:04.561 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.561 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:43:04.561 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:43:04.561 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:43:04.562 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:43:04.562 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.562 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.563 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.563 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2020-10-31T22:43:04.563 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551feZUgExAAvGt2fUb5GhkkFQ0dbgP5nw==", 2020-10-31T22:43:04.563 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.564 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:43:04.564 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:43:04.564 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:43:04.564 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.565 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:04.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:04.575 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2020-10-31T22:43:04.575 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKiN5EBAAhHtXXE4+yydXWOK7agZ14g==", 2020-10-31T22:43:04.575 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:43:04.576 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:43:04.576 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:43:04.576 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:43:04.576 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.577 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:04.577 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:43:04.577 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:43:04.582 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:43:04.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.703+0000 7f0803fff700 1 Processor -- start 2020-10-31T22:43:04.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.703+0000 7f0803fff700 1 -- start start 2020-10-31T22:43:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.703+0000 7f0803fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f08040ac990 0x7f080413ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.703+0000 7f0803fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080405bf90 con 0x7f08040ae030 2020-10-31T22:43:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.703+0000 7f0803fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08040ab600 con 0x7f080405bbb0 2020-10-31T22:43:04.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.703+0000 7f0803fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08040ab410 con 0x7f08040ac990 2020-10-31T22:43:04.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.703+0000 7f08037fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f08040ae030 0x7f08040a7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47282/0 (socket says 172.21.15.60:47282) 2020-10-31T22:43:04.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.703+0000 7f08037fe700 1 -- 172.21.15.60:0/3995032641 learned_addr learned my addr 172.21.15.60:0/3995032641 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:04.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.703+0000 7f08027fc700 1 --2- 172.21.15.60:0/3995032641 >> v2:172.21.15.66:3300/0 conn(0x7f08040ac990 0x7f080413ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:04.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0801ffb700 1 -- 172.21.15.60:0/3995032641 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414185532 0 0) 0x7f080405bf90 con 0x7f08040ae030 2020-10-31T22:43:04.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0801ffb700 1 -- 172.21.15.60:0/3995032641 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e4003230 con 0x7f08040ae030 2020-10-31T22:43:04.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f08027fc700 1 -- 172.21.15.60:0/3995032641 >> v1:172.21.15.66:6789/0 conn(0x7f080405bbb0 legacy=0x7f08040ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0801ffb700 1 -- 172.21.15.60:0/3995032641 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1974172153 0 0) 0x7f08040ab600 con 0x7f080405bbb0 2020-10-31T22:43:04.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f08027fc700 1 -- 172.21.15.60:0/3995032641 >> v1:172.21.15.60:6789/0 conn(0x7f08040ae030 legacy=0x7f08040a7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f08027fc700 1 -- 172.21.15.60:0/3995032641 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08040ab8a0 con 0x7f08040ac990 2020-10-31T22:43:04.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f08027fc700 1 --2- 172.21.15.60:0/3995032641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08040ac990 0x7f080413ecf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f07ec002f30 tx=0x7f07ec006dc0).ready entity=mon.1 client_cookie=a60836013204d6c9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:04.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0801ffb700 1 -- 172.21.15.60:0/3995032641 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec009890 con 0x7f08040ac990 2020-10-31T22:43:04.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0801ffb700 1 -- 172.21.15.60:0/3995032641 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec0099f0 con 0x7f08040ac990 2020-10-31T22:43:04.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0801ffb700 1 -- 172.21.15.60:0/3995032641 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec009d50 con 0x7f08040ac990 2020-10-31T22:43:04.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0803fff700 1 -- 172.21.15.60:0/3995032641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08040ac990 msgr2=0x7f080413ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0803fff700 1 --2- 172.21.15.60:0/3995032641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08040ac990 0x7f080413ecf0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f07ec002f30 tx=0x7f07ec006dc0).stop 2020-10-31T22:43:04.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0803fff700 1 -- 172.21.15.60:0/3995032641 shutdown_connections 2020-10-31T22:43:04.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0803fff700 1 --2- 172.21.15.60:0/3995032641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08040ac990 0x7f080413ecf0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0803fff700 1 -- 172.21.15.60:0/3995032641 >> 172.21.15.60:0/3995032641 conn(0x7f08040b3fd0 msgr2=0x7f08040b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:04.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0803fff700 1 -- 172.21.15.60:0/3995032641 shutdown_connections 2020-10-31T22:43:04.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0803fff700 1 -- 172.21.15.60:0/3995032641 wait complete. 2020-10-31T22:43:04.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0803fff700 1 Processor -- start 2020-10-31T22:43:04.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.707+0000 7f0803fff700 1 -- start start 2020-10-31T22:43:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f0803fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f080405bbb0 0x7f08040a6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f0803fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08040ac990 0x7f08041584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:04.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f0803fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08040ae030 0x7f08041589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f0803fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0804066d40 con 0x7f08040ac990 2020-10-31T22:43:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f0803fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0804066560 con 0x7f08040ae030 2020-10-31T22:43:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f0803fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0804066800 con 0x7f080405bbb0 2020-10-31T22:43:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f08027fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08040ac990 0x7f08041584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:04.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f08027fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08040ac990 0x7f08041584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43156/0 (socket says 172.21.15.60:43156) 2020-10-31T22:43:04.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f08027fc700 1 -- 172.21.15.60:0/3898145916 learned_addr learned my addr 172.21.15.60:0/3898145916 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:04.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f08037fe700 1 --2- 172.21.15.60:0/3898145916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08040ae030 0x7f08041589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:04.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f0802ffd700 1 --2- 172.21.15.60:0/3898145916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f080405bbb0 0x7f08040a6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:04.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f08027fc700 1 -- 172.21.15.60:0/3898145916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f080405bbb0 msgr2=0x7f08040a6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f08027fc700 1 --2- 172.21.15.60:0/3898145916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f080405bbb0 0x7f08040a6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f08027fc700 1 -- 172.21.15.60:0/3898145916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08040ae030 msgr2=0x7f08041589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f08027fc700 1 --2- 172.21.15.60:0/3898145916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08040ae030 0x7f08041589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f08027fc700 1 -- 172.21.15.60:0/3898145916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804066aa0 con 0x7f08040ac990 2020-10-31T22:43:04.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f08027fc700 1 --2- 172.21.15.60:0/3898145916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08040ac990 0x7f08041584e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f07ec002f30 tx=0x7f07ec015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f07fbfff700 1 -- 172.21.15.60:0/3898145916 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec009cf0 con 0x7f08040ac990 2020-10-31T22:43:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f0803fff700 1 -- 172.21.15.60:0/3898145916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0804061ae0 con 0x7f08040ac990 2020-10-31T22:43:04.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f07fbfff700 1 -- 172.21.15.60:0/3898145916 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec011db0 con 0x7f08040ac990 2020-10-31T22:43:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f07fbfff700 1 -- 172.21.15.60:0/3898145916 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f07ec01d640 con 0x7f08040ac990 2020-10-31T22:43:04.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.711+0000 7f0803fff700 1 -- 172.21.15.60:0/3898145916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08040625c0 con 0x7f08040ac990 2020-10-31T22:43:04.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.715+0000 7f0803fff700 1 -- 172.21.15.60:0/3898145916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08041581d0 con 0x7f08040ac990 2020-10-31T22:43:04.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.715+0000 7f07fbfff700 1 -- 172.21.15.60:0/3898145916 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f07ec00f070 con 0x7f08040ac990 2020-10-31T22:43:04.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.715+0000 7f07fbfff700 1 --2- 172.21.15.60:0/3898145916 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f07e8054f30 0x7f07e80573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:04.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.715+0000 7f07fbfff700 1 -- 172.21.15.60:0/3898145916 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f07ec06e7e0 con 0x7f08040ac990 2020-10-31T22:43:04.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.715+0000 7f0802ffd700 1 --2- 172.21.15.60:0/3898145916 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f07e8054f30 0x7f07e80573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:04.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.715+0000 7f0802ffd700 1 --2- 172.21.15.60:0/3898145916 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f07e8054f30 0x7f07e80573f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f07f400d000 tx=0x7f07f4007940).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:04.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.719+0000 7f07fbfff700 1 -- 172.21.15.60:0/3898145916 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f07ec045030 con 0x7f08040ac990 2020-10-31T22:43:04.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.859+0000 7f0803fff700 1 -- 172.21.15.60:0/3898145916 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0804057100 con 0x7f08040ac990 2020-10-31T22:43:04.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.863+0000 7f07fbfff700 1 -- 172.21.15.60:0/3898145916 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13181 (secure 0 0 0) 0x7f07ec022070 con 0x7f08040ac990 2020-10-31T22:43:04.865 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:04.865 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":40,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:43:04.143824+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:43:04.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.863+0000 7f0803fff700 1 -- 172.21.15.60:0/3898145916 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f07e8054f30 msgr2=0x7f07e80573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.863+0000 7f0803fff700 1 --2- 172.21.15.60:0/3898145916 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f07e8054f30 0x7f07e80573f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f07f400d000 tx=0x7f07f4007940).stop 2020-10-31T22:43:04.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.863+0000 7f0803fff700 1 -- 172.21.15.60:0/3898145916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08040ac990 msgr2=0x7f08041584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:04.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.863+0000 7f0803fff700 1 --2- 172.21.15.60:0/3898145916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08040ac990 0x7f08041584e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f07ec002f30 tx=0x7f07ec015000).stop 2020-10-31T22:43:04.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.863+0000 7f0803fff700 1 -- 172.21.15.60:0/3898145916 shutdown_connections 2020-10-31T22:43:04.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.863+0000 7f0803fff700 1 --2- 172.21.15.60:0/3898145916 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f07e8054f30 0x7f07e80573f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.863+0000 7f0803fff700 1 --2- 172.21.15.60:0/3898145916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08040ae030 0x7f08041589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.863+0000 7f0803fff700 1 --2- 172.21.15.60:0/3898145916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f080405bbb0 0x7f08040a6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.863+0000 7f0803fff700 1 --2- 172.21.15.60:0/3898145916 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08040ac990 0x7f08041584e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:04.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.863+0000 7f0803fff700 1 -- 172.21.15.60:0/3898145916 >> 172.21.15.60:0/3898145916 conn(0x7f08040b3fd0 msgr2=0x7f08040b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:04.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.863+0000 7f0803fff700 1 -- 172.21.15.60:0/3898145916 shutdown_connections 2020-10-31T22:43:04.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.863+0000 7f0803fff700 1 -- 172.21.15.60:0/3898145916 wait complete. 2020-10-31T22:43:04.879 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-31T22:43:04.880 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:43:05.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.999+0000 7f727c8ef700 1 Processor -- start 2020-10-31T22:43:05.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.999+0000 7f727c8ef700 1 -- start start 2020-10-31T22:43:05.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.999+0000 7f727c8ef700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72780b5570 0x7f72780b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.999+0000 7f727c8ef700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7278141f00 0x7f7278142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.999+0000 7f727c8ef700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72780b4440 con 0x7f72780b24a0 2020-10-31T22:43:05.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.999+0000 7f727c8ef700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727813f930 con 0x7f7278141f00 2020-10-31T22:43:05.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.999+0000 7f727c8ef700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7278146060 con 0x7f72780b5570 2020-10-31T22:43:05.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.999+0000 7f727659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f72780b24a0 0x7f7278145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47296/0 (socket says 172.21.15.60:47296) 2020-10-31T22:43:05.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.999+0000 7f727659c700 1 -- 172.21.15.60:0/1837892807 learned_addr learned my addr 172.21.15.60:0/1837892807 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:05.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.999+0000 7f727759e700 1 --2- 172.21.15.60:0/1837892807 >> v2:172.21.15.66:3300/0 conn(0x7f7278141f00 0x7f7278142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.999+0000 7f7276d9d700 1 --2- 172.21.15.60:0/1837892807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72780b5570 0x7f72780b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.999+0000 7f7275d9b700 1 -- 172.21.15.60:0/1837892807 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484237704 0 0) 0x7f72780b4440 con 0x7f72780b24a0 2020-10-31T22:43:05.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:04.999+0000 7f7275d9b700 1 -- 172.21.15.60:0/1837892807 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7258003230 con 0x7f72780b24a0 2020-10-31T22:43:05.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727759e700 1 -- 172.21.15.60:0/1837892807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72780b5570 msgr2=0x7f72780b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:05.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727759e700 1 --2- 172.21.15.60:0/1837892807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72780b5570 0x7f72780b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727759e700 1 -- 172.21.15.60:0/1837892807 >> v1:172.21.15.60:6789/0 conn(0x7f72780b24a0 legacy=0x7f7278145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727759e700 1 -- 172.21.15.60:0/1837892807 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72780b02f0 con 0x7f7278141f00 2020-10-31T22:43:05.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727759e700 1 --2- 172.21.15.60:0/1837892807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7278141f00 0x7f7278142390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f72700032b0 tx=0x7f72700091a0).ready entity=mon.1 client_cookie=912e79d5bfca1a53 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:05.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f7275d9b700 1 -- 172.21.15.60:0/1837892807 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f727000b940 con 0x7f7278141f00 2020-10-31T22:43:05.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f7275d9b700 1 -- 172.21.15.60:0/1837892807 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f727000baa0 con 0x7f7278141f00 2020-10-31T22:43:05.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f7275d9b700 1 -- 172.21.15.60:0/1837892807 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f727000bc10 con 0x7f7278141f00 2020-10-31T22:43:05.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 -- 172.21.15.60:0/1837892807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7278141f00 msgr2=0x7f7278142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 --2- 172.21.15.60:0/1837892807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7278141f00 0x7f7278142390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f72700032b0 tx=0x7f72700091a0).stop 2020-10-31T22:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 -- 172.21.15.60:0/1837892807 shutdown_connections 2020-10-31T22:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 --2- 172.21.15.60:0/1837892807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7278141f00 0x7f7278142390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 --2- 172.21.15.60:0/1837892807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72780b5570 0x7f72780b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 -- 172.21.15.60:0/1837892807 >> 172.21.15.60:0/1837892807 conn(0x7f72780b8e90 msgr2=0x7f72780b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 -- 172.21.15.60:0/1837892807 shutdown_connections 2020-10-31T22:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 -- 172.21.15.60:0/1837892807 wait complete. 2020-10-31T22:43:05.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 Processor -- start 2020-10-31T22:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 -- start start 2020-10-31T22:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72780b24a0 0x7f7278140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72780b5570 0x7f72781435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7278141f00 0x7f7278143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7278144270 con 0x7f72780b24a0 2020-10-31T22:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7278144510 con 0x7f7278141f00 2020-10-31T22:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727c8ef700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72781447b0 con 0x7f72780b5570 2020-10-31T22:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f7276d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72780b24a0 0x7f7278140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f7276d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72780b24a0 0x7f7278140d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43166/0 (socket says 172.21.15.60:43166) 2020-10-31T22:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f7276d9d700 1 -- 172.21.15.60:0/2703873452 learned_addr learned my addr 172.21.15.60:0/2703873452 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:05.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727759e700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7278141f00 0x7f7278143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.003+0000 7f727659c700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72780b5570 0x7f72781435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f7276d9d700 1 -- 172.21.15.60:0/2703873452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72780b5570 msgr2=0x7f72781435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f7276d9d700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72780b5570 0x7f72781435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f7276d9d700 1 -- 172.21.15.60:0/2703873452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7278141f00 msgr2=0x7f7278143ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f7276d9d700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7278141f00 0x7f7278143ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f7276d9d700 1 -- 172.21.15.60:0/2703873452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7278143130 con 0x7f72780b24a0 2020-10-31T22:43:05.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f727759e700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7278141f00 0x7f7278143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:05.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f7276d9d700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72780b24a0 0x7f7278140d60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f726000c000 tx=0x7f7260006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:05.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f726ffff700 1 -- 172.21.15.60:0/2703873452 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f726000ca10 con 0x7f72780b24a0 2020-10-31T22:43:05.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f726ffff700 1 -- 172.21.15.60:0/2703873452 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726000cb70 con 0x7f72780b24a0 2020-10-31T22:43:05.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f727c8ef700 1 -- 172.21.15.60:0/2703873452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72781452e0 con 0x7f72780b24a0 2020-10-31T22:43:05.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f726ffff700 1 -- 172.21.15.60:0/2703873452 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72600123f0 con 0x7f72780b24a0 2020-10-31T22:43:05.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f727c8ef700 1 -- 172.21.15.60:0/2703873452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7278144fb0 con 0x7f72780b24a0 2020-10-31T22:43:05.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f726ffff700 1 -- 172.21.15.60:0/2703873452 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7260012550 con 0x7f72780b24a0 2020-10-31T22:43:05.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f727c8ef700 1 -- 172.21.15.60:0/2703873452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727805b340 con 0x7f72780b24a0 2020-10-31T22:43:05.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f726ffff700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f725c054f90 0x7f725c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f727659c700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f725c054f90 0x7f725c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.007+0000 7f726ffff700 1 -- 172.21.15.60:0/2703873452 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f726006db30 con 0x7f72780b24a0 2020-10-31T22:43:05.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.011+0000 7f727659c700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f725c054f90 0x7f725c057450 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f726800d000 tx=0x7f7268009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:05.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.015+0000 7f726ffff700 1 -- 172.21.15.60:0/2703873452 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f727805b340 con 0x7f72780b24a0 2020-10-31T22:43:05.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.159+0000 7f727c8ef700 1 -- 172.21.15.60:0/2703873452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f727805b340 con 0x7f72780b24a0 2020-10-31T22:43:05.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.159+0000 7f726ffff700 1 -- 172.21.15.60:0/2703873452 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v40) v1 ==== 110+0+10 (secure 0 0 0) 0x7f727805b340 con 0x7f72780b24a0 2020-10-31T22:43:05.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.159+0000 7f727c8ef700 1 -- 172.21.15.60:0/2703873452 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f725c054f90 msgr2=0x7f725c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.159+0000 7f727c8ef700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f725c054f90 0x7f725c057450 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f726800d000 tx=0x7f7268009040).stop 2020-10-31T22:43:05.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.159+0000 7f727c8ef700 1 -- 172.21.15.60:0/2703873452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72780b24a0 msgr2=0x7f7278140d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.159+0000 7f727c8ef700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72780b24a0 0x7f7278140d60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7f726000c000 tx=0x7f7260006dc0).stop 2020-10-31T22:43:05.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.159+0000 7f727c8ef700 1 -- 172.21.15.60:0/2703873452 shutdown_connections 2020-10-31T22:43:05.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.159+0000 7f727c8ef700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f725c054f90 0x7f725c057450 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.159+0000 7f727c8ef700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7278141f00 0x7f7278143ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.159+0000 7f727c8ef700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72780b24a0 0x7f7278140d60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.159+0000 7f727c8ef700 1 --2- 172.21.15.60:0/2703873452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72780b5570 0x7f72781435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.159+0000 7f727c8ef700 1 -- 172.21.15.60:0/2703873452 >> 172.21.15.60:0/2703873452 conn(0x7f72780b8e90 msgr2=0x7f72780b2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:05.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.159+0000 7f727c8ef700 1 -- 172.21.15.60:0/2703873452 shutdown_connections 2020-10-31T22:43:05.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.159+0000 7f727c8ef700 1 -- 172.21.15.60:0/2703873452 wait complete. 2020-10-31T22:43:05.165 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:43:05.174 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:43:05.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.287+0000 7fa9a2d28700 1 Processor -- start 2020-10-31T22:43:05.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.287+0000 7fa9a2d28700 1 -- start start 2020-10-31T22:43:05.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa99c0b52a0 0x7fa99c0af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa99c0ae040 0x7fa99c140260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99c0aff00 con 0x7fa99c140750 2020-10-31T22:43:05.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c0b0320 con 0x7fa99c0ae040 2020-10-31T22:43:05.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99c140ba0 con 0x7fa99c0b52a0 2020-10-31T22:43:05.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa99bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa99c0ae040 0x7fa99c140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa99bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa99c0ae040 0x7fa99c140260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43174/0 (socket says 172.21.15.60:43174) 2020-10-31T22:43:05.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa99bfff700 1 -- 172.21.15.60:0/1892050849 learned_addr learned my addr 172.21.15.60:0/1892050849 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:05.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a0ac4700 1 --2- 172.21.15.60:0/1892050849 >> v2:172.21.15.66:3300/0 conn(0x7fa99c0b52a0 0x7fa99c0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa99bfff700 1 -- 172.21.15.60:0/1892050849 >> v2:172.21.15.66:3300/0 conn(0x7fa99c0b52a0 msgr2=0x7fa99c0af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:05.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa99bfff700 1 --2- 172.21.15.60:0/1892050849 >> v2:172.21.15.66:3300/0 conn(0x7fa99c0b52a0 0x7fa99c0af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa99bfff700 1 -- 172.21.15.60:0/1892050849 >> v1:172.21.15.66:6789/0 conn(0x7fa99c140750 legacy=0x7fa99c0aac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:05.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa99bfff700 1 -- 172.21.15.60:0/1892050849 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c0af9c0 con 0x7fa99c0ae040 2020-10-31T22:43:05.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa99bfff700 1 --2- 172.21.15.60:0/1892050849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99c0ae040 0x7fa99c140260 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fa99c0b4900 tx=0x7fa984006e80).ready entity=mon.0 client_cookie=edf52afe3de22da4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:05.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa99b7fe700 1 -- 172.21.15.60:0/1892050849 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9840097b0 con 0x7fa99c0ae040 2020-10-31T22:43:05.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa99b7fe700 1 -- 172.21.15.60:0/1892050849 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa984009910 con 0x7fa99c0ae040 2020-10-31T22:43:05.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa99b7fe700 1 -- 172.21.15.60:0/1892050849 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa984009a80 con 0x7fa99c0ae040 2020-10-31T22:43:05.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 -- 172.21.15.60:0/1892050849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99c0ae040 msgr2=0x7fa99c140260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 --2- 172.21.15.60:0/1892050849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99c0ae040 0x7fa99c140260 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fa99c0b4900 tx=0x7fa984006e80).stop 2020-10-31T22:43:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 -- 172.21.15.60:0/1892050849 shutdown_connections 2020-10-31T22:43:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 --2- 172.21.15.60:0/1892050849 >> v2:172.21.15.66:3300/0 conn(0x7fa99c0b52a0 0x7fa99c0af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 --2- 172.21.15.60:0/1892050849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99c0ae040 0x7fa99c140260 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 -- 172.21.15.60:0/1892050849 >> 172.21.15.60:0/1892050849 conn(0x7fa99c060c50 msgr2=0x7fa99c0b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:05.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 -- 172.21.15.60:0/1892050849 shutdown_connections 2020-10-31T22:43:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 -- 172.21.15.60:0/1892050849 wait complete. 2020-10-31T22:43:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 Processor -- start 2020-10-31T22:43:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.291+0000 7fa9a2d28700 1 -- start start 2020-10-31T22:43:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa9a2d28700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa99c0ae040 0x7fa99c13efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa9a2d28700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99c0b52a0 0x7fa99c063a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa9a2d28700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa99c140750 0x7fa99c150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa9a2d28700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c154480 con 0x7fa99c0b52a0 2020-10-31T22:43:05.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa9a2d28700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c154720 con 0x7fa99c140750 2020-10-31T22:43:05.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa9a2d28700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c1549c0 con 0x7fa99c0ae040 2020-10-31T22:43:05.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa99bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99c0b52a0 0x7fa99c063a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa99bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99c0b52a0 0x7fa99c063a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43180/0 (socket says 172.21.15.60:43180) 2020-10-31T22:43:05.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa99bfff700 1 -- 172.21.15.60:0/738365872 learned_addr learned my addr 172.21.15.60:0/738365872 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:05.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa9a0ac4700 1 --2- 172.21.15.60:0/738365872 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa99c0ae040 0x7fa99c13efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa9a12c5700 1 --2- 172.21.15.60:0/738365872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa99c140750 0x7fa99c150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa99bfff700 1 -- 172.21.15.60:0/738365872 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa99c0ae040 msgr2=0x7fa99c13efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa99bfff700 1 --2- 172.21.15.60:0/738365872 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa99c0ae040 0x7fa99c13efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa99bfff700 1 -- 172.21.15.60:0/738365872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa99c140750 msgr2=0x7fa99c150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa99bfff700 1 --2- 172.21.15.60:0/738365872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa99c140750 0x7fa99c150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa99bfff700 1 -- 172.21.15.60:0/738365872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa99c154c60 con 0x7fa99c0b52a0 2020-10-31T22:43:05.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa99bfff700 1 --2- 172.21.15.60:0/738365872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99c0b52a0 0x7fa99c063a30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fa99c0b4900 tx=0x7fa984016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:05.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa999ffb700 1 -- 172.21.15.60:0/738365872 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa984011d30 con 0x7fa99c0b52a0 2020-10-31T22:43:05.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa999ffb700 1 -- 172.21.15.60:0/738365872 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa984011e90 con 0x7fa99c0b52a0 2020-10-31T22:43:05.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa9a2d28700 1 -- 172.21.15.60:0/738365872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c154100 con 0x7fa99c0b52a0 2020-10-31T22:43:05.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa999ffb700 1 -- 172.21.15.60:0/738365872 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa984021620 con 0x7fa99c0b52a0 2020-10-31T22:43:05.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa9a2d28700 1 -- 172.21.15.60:0/738365872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c064140 con 0x7fa99c0b52a0 2020-10-31T22:43:05.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.295+0000 7fa9a2d28700 1 -- 172.21.15.60:0/738365872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa99c057100 con 0x7fa99c0b52a0 2020-10-31T22:43:05.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.299+0000 7fa999ffb700 1 -- 172.21.15.60:0/738365872 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa984028070 con 0x7fa99c0b52a0 2020-10-31T22:43:05.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.299+0000 7fa999ffb700 1 --2- 172.21.15.60:0/738365872 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa980054f90 0x7fa980057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.299+0000 7fa999ffb700 1 -- 172.21.15.60:0/738365872 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa98406e5d0 con 0x7fa99c0b52a0 2020-10-31T22:43:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.299+0000 7fa9a0ac4700 1 --2- 172.21.15.60:0/738365872 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa980054f90 0x7fa980057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.299+0000 7fa9a0ac4700 1 --2- 172.21.15.60:0/738365872 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa980054f90 0x7fa980057450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fa98c00c000 tx=0x7fa98c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:05.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.307+0000 7fa999ffb700 1 -- 172.21.15.60:0/738365872 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa984044d10 con 0x7fa99c0b52a0 2020-10-31T22:43:05.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.455+0000 7fa9a2d28700 1 -- 172.21.15.60:0/738365872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa99c05aa30 con 0x7fa99c0b52a0 2020-10-31T22:43:05.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.455+0000 7fa999ffb700 1 -- 172.21.15.60:0/738365872 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa984026020 con 0x7fa99c0b52a0 2020-10-31T22:43:05.459 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:43:05.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.459+0000 7fa9a2d28700 1 -- 172.21.15.60:0/738365872 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa980054f90 msgr2=0x7fa980057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.459+0000 7fa9a2d28700 1 --2- 172.21.15.60:0/738365872 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa980054f90 0x7fa980057450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fa98c00c000 tx=0x7fa98c008040).stop 2020-10-31T22:43:05.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.459+0000 7fa9a2d28700 1 -- 172.21.15.60:0/738365872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99c0b52a0 msgr2=0x7fa99c063a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.459+0000 7fa9a2d28700 1 --2- 172.21.15.60:0/738365872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99c0b52a0 0x7fa99c063a30 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7fa99c0b4900 tx=0x7fa984016000).stop 2020-10-31T22:43:05.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.459+0000 7fa9a2d28700 1 -- 172.21.15.60:0/738365872 shutdown_connections 2020-10-31T22:43:05.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.459+0000 7fa9a2d28700 1 --2- 172.21.15.60:0/738365872 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa980054f90 0x7fa980057450 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.459+0000 7fa9a2d28700 1 --2- 172.21.15.60:0/738365872 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa99c140750 0x7fa99c150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.459+0000 7fa9a2d28700 1 --2- 172.21.15.60:0/738365872 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa99c0ae040 0x7fa99c13efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.459+0000 7fa9a2d28700 1 --2- 172.21.15.60:0/738365872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99c0b52a0 0x7fa99c063a30 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.459+0000 7fa9a2d28700 1 -- 172.21.15.60:0/738365872 >> 172.21.15.60:0/738365872 conn(0x7fa99c060c50 msgr2=0x7fa99c0672f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:05.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.459+0000 7fa9a2d28700 1 -- 172.21.15.60:0/738365872 shutdown_connections 2020-10-31T22:43:05.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.459+0000 7fa9a2d28700 1 -- 172.21.15.60:0/738365872 wait complete. 2020-10-31T22:43:05.476 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-10-31T22:43:05.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 Processor -- start 2020-10-31T22:43:05.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 -- start start 2020-10-31T22:43:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2f600b24a0 0x7f2f600b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f60141fe0 0x7f2f60142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f60145180 con 0x7f2f600b5570 2020-10-31T22:43:05.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f600afae0 con 0x7f2f60141fe0 2020-10-31T22:43:05.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f60141bf0 con 0x7f2f600b24a0 2020-10-31T22:43:05.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f65c11700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f60141fe0 0x7f2f60142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f65410700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2f600b5570 0x7f2f60145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47326/0 (socket says 172.21.15.60:47326) 2020-10-31T22:43:05.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f65410700 1 -- 172.21.15.60:0/289455292 learned_addr learned my addr 172.21.15.60:0/289455292 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:05.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f64c0f700 1 --2- 172.21.15.60:0/289455292 >> v2:172.21.15.66:3300/0 conn(0x7f2f600b24a0 0x7f2f600b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f65c11700 1 -- 172.21.15.60:0/289455292 >> v2:172.21.15.66:3300/0 conn(0x7f2f600b24a0 msgr2=0x7f2f600b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:05.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f65c11700 1 --2- 172.21.15.60:0/289455292 >> v2:172.21.15.66:3300/0 conn(0x7f2f600b24a0 0x7f2f600b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f65c11700 1 -- 172.21.15.60:0/289455292 >> v1:172.21.15.60:6789/0 conn(0x7f2f600b5570 legacy=0x7f2f60145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f4ffff700 1 -- 172.21.15.60:0/289455292 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3295424769 0 0) 0x7f2f60145180 con 0x7f2f600b5570 2020-10-31T22:43:05.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f65c11700 1 -- 172.21.15.60:0/289455292 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f600b0670 con 0x7f2f60141fe0 2020-10-31T22:43:05.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f65c11700 1 --2- 172.21.15.60:0/289455292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f60141fe0 0x7f2f60142490 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f2f6005f580 tx=0x7f2f580091a0).ready entity=mon.0 client_cookie=c69f5e7a776d5b23 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:05.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f4ffff700 1 -- 172.21.15.60:0/289455292 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5800b960 con 0x7f2f60141fe0 2020-10-31T22:43:05.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f4ffff700 1 -- 172.21.15.60:0/289455292 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5800bac0 con 0x7f2f60141fe0 2020-10-31T22:43:05.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f4ffff700 1 -- 172.21.15.60:0/289455292 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5800bc30 con 0x7f2f60141fe0 2020-10-31T22:43:05.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 -- 172.21.15.60:0/289455292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f60141fe0 msgr2=0x7f2f60142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 --2- 172.21.15.60:0/289455292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f60141fe0 0x7f2f60142490 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f2f6005f580 tx=0x7f2f580091a0).stop 2020-10-31T22:43:05.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 -- 172.21.15.60:0/289455292 shutdown_connections 2020-10-31T22:43:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 --2- 172.21.15.60:0/289455292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f60141fe0 0x7f2f60142490 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 --2- 172.21.15.60:0/289455292 >> v2:172.21.15.66:3300/0 conn(0x7f2f600b24a0 0x7f2f600b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 -- 172.21.15.60:0/289455292 >> 172.21.15.60:0/289455292 conn(0x7f2f600b8e90 msgr2=0x7f2f600b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:05.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 -- 172.21.15.60:0/289455292 shutdown_connections 2020-10-31T22:43:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.591+0000 7f2f66412700 1 -- 172.21.15.60:0/289455292 wait complete. 2020-10-31T22:43:05.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f66412700 1 Processor -- start 2020-10-31T22:43:05.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f66412700 1 -- start start 2020-10-31T22:43:05.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f66412700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f600b24a0 0x7f2f6013caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f66412700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f600b5570 0x7f2f60140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f66412700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f60141fe0 0x7f2f6013e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f66412700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f601479b0 con 0x7f2f600b24a0 2020-10-31T22:43:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f66412700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f60154be0 con 0x7f2f600b5570 2020-10-31T22:43:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f66412700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6013d220 con 0x7f2f60141fe0 2020-10-31T22:43:05.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f65410700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f600b24a0 0x7f2f6013caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f65410700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f600b24a0 0x7f2f6013caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43194/0 (socket says 172.21.15.60:43194) 2020-10-31T22:43:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f65410700 1 -- 172.21.15.60:0/1324276299 learned_addr learned my addr 172.21.15.60:0/1324276299 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f64c0f700 1 --2- 172.21.15.60:0/1324276299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f600b5570 0x7f2f60140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f65c11700 1 --2- 172.21.15.60:0/1324276299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f60141fe0 0x7f2f6013e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f65410700 1 -- 172.21.15.60:0/1324276299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f60141fe0 msgr2=0x7f2f6013e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f65410700 1 --2- 172.21.15.60:0/1324276299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f60141fe0 0x7f2f6013e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f65410700 1 -- 172.21.15.60:0/1324276299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f600b5570 msgr2=0x7f2f60140e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f65410700 1 --2- 172.21.15.60:0/1324276299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f600b5570 0x7f2f60140e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f65410700 1 -- 172.21.15.60:0/1324276299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f60154e10 con 0x7f2f600b24a0 2020-10-31T22:43:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f65410700 1 --2- 172.21.15.60:0/1324276299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f600b24a0 0x7f2f6013caf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f2f5c000e90 tx=0x7f2f5c0079f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f4e7fc700 1 -- 172.21.15.60:0/1324276299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5c007320 con 0x7f2f600b24a0 2020-10-31T22:43:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f4e7fc700 1 -- 172.21.15.60:0/1324276299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5c007480 con 0x7f2f600b24a0 2020-10-31T22:43:05.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f66412700 1 -- 172.21.15.60:0/1324276299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6013d4c0 con 0x7f2f600b24a0 2020-10-31T22:43:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f4e7fc700 1 -- 172.21.15.60:0/1324276299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f5c0057d0 con 0x7f2f600b24a0 2020-10-31T22:43:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f66412700 1 -- 172.21.15.60:0/1324276299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f60144ef0 con 0x7f2f600b24a0 2020-10-31T22:43:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f66412700 1 -- 172.21.15.60:0/1324276299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6013c800 con 0x7f2f600b24a0 2020-10-31T22:43:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f4e7fc700 1 -- 172.21.15.60:0/1324276299 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2f5c010030 con 0x7f2f600b24a0 2020-10-31T22:43:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f4e7fc700 1 --2- 172.21.15.60:0/1324276299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2f40054f30 0x7f2f400573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f4e7fc700 1 -- 172.21.15.60:0/1324276299 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f2f5c06d3f0 con 0x7f2f600b24a0 2020-10-31T22:43:05.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.595+0000 7f2f64c0f700 1 --2- 172.21.15.60:0/1324276299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2f40054f30 0x7f2f400573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.599+0000 7f2f64c0f700 1 --2- 172.21.15.60:0/1324276299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2f40054f30 0x7f2f400573f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f2f5000b000 tx=0x7f2f50008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:05.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.603+0000 7f2f4e7fc700 1 -- 172.21.15.60:0/1324276299 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2f5c043c40 con 0x7f2f600b24a0 2020-10-31T22:43:05.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.755+0000 7f2f66412700 1 -- 172.21.15.60:0/1324276299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2f60154fa0 con 0x7f2f600b24a0 2020-10-31T22:43:05.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.755+0000 7f2f4e7fc700 1 -- 172.21.15.60:0/1324276299 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v40) v1 ==== 84+0+143 (secure 0 0 0) 0x7f2f5c0102c0 con 0x7f2f600b24a0 2020-10-31T22:43:05.756 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:05.756 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2020-10-31T22:43:05.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:05.757 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2020-10-31T22:43:05.757 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "device_health_metrics" 2020-10-31T22:43:05.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:05.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:43:05.757 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2020-10-31T22:43:05.757 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2020-10-31T22:43:05.758 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:05.758 INFO:teuthology.orchestra.run.smithi060.stdout:] 2020-10-31T22:43:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.755+0000 7f2f66412700 1 -- 172.21.15.60:0/1324276299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2f40054f30 msgr2=0x7f2f400573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.755+0000 7f2f66412700 1 --2- 172.21.15.60:0/1324276299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2f40054f30 0x7f2f400573f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f2f5000b000 tx=0x7f2f50008040).stop 2020-10-31T22:43:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.755+0000 7f2f66412700 1 -- 172.21.15.60:0/1324276299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f600b24a0 msgr2=0x7f2f6013caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.755+0000 7f2f66412700 1 --2- 172.21.15.60:0/1324276299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f600b24a0 0x7f2f6013caf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f2f5c000e90 tx=0x7f2f5c0079f0).stop 2020-10-31T22:43:05.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.755+0000 7f2f66412700 1 -- 172.21.15.60:0/1324276299 shutdown_connections 2020-10-31T22:43:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.755+0000 7f2f66412700 1 --2- 172.21.15.60:0/1324276299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f60141fe0 0x7f2f6013e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.755+0000 7f2f66412700 1 --2- 172.21.15.60:0/1324276299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f600b24a0 0x7f2f6013caf0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.755+0000 7f2f66412700 1 --2- 172.21.15.60:0/1324276299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2f40054f30 0x7f2f400573f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.755+0000 7f2f66412700 1 --2- 172.21.15.60:0/1324276299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f600b5570 0x7f2f60140e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.755+0000 7f2f66412700 1 -- 172.21.15.60:0/1324276299 >> 172.21.15.60:0/1324276299 conn(0x7f2f600b8e90 msgr2=0x7f2f600b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:05.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.755+0000 7f2f66412700 1 -- 172.21.15.60:0/1324276299 shutdown_connections 2020-10-31T22:43:05.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.755+0000 7f2f66412700 1 -- 172.21.15.60:0/1324276299 wait complete. 2020-10-31T22:43:05.769 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-10-31T22:43:05.770 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:43:05.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.887+0000 7f1b3213a700 1 Processor -- start 2020-10-31T22:43:05.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.887+0000 7f1b3213a700 1 -- start start 2020-10-31T22:43:05.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b3213a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1b2c0b24a0 0x7f1b2c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b3213a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c0b4440 con 0x7f1b2c141f00 2020-10-31T22:43:05.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b3213a700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b2c146060 con 0x7f1b2c0b5570 2020-10-31T22:43:05.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b3213a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b2c13f930 con 0x7f1b2c0b24a0 2020-10-31T22:43:05.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b31939700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1b2c141f00 0x7f1b2c142360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47342/0 (socket says 172.21.15.60:47342) 2020-10-31T22:43:05.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b30937700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1b2c0b24a0 0x7f1b2c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b31939700 1 -- 172.21.15.60:0/3571134007 learned_addr learned my addr 172.21.15.60:0/3571134007 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:05.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b23fff700 1 -- 172.21.15.60:0/3571134007 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2527918950 0 0) 0x7f1b2c0b4440 con 0x7f1b2c141f00 2020-10-31T22:43:05.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b23fff700 1 -- 172.21.15.60:0/3571134007 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b10003230 con 0x7f1b2c141f00 2020-10-31T22:43:05.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b30937700 1 -- 172.21.15.60:0/3571134007 >> v1:172.21.15.66:6789/0 conn(0x7f1b2c0b5570 legacy=0x7f1b2c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b23fff700 1 -- 172.21.15.60:0/3571134007 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2706817962 0 0) 0x7f1b10003230 con 0x7f1b2c141f00 2020-10-31T22:43:05.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b30937700 1 -- 172.21.15.60:0/3571134007 >> v1:172.21.15.60:6789/0 conn(0x7f1b2c141f00 legacy=0x7f1b2c142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b30937700 1 -- 172.21.15.60:0/3571134007 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0b02f0 con 0x7f1b2c0b24a0 2020-10-31T22:43:05.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b30937700 1 --2- 172.21.15.60:0/3571134007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b2c0b24a0 0x7f1b2c0b5950 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f1b24001bf0 tx=0x7f1b1c006dc0).ready entity=mon.0 client_cookie=cf1d03c4b754093c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:05.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b23fff700 1 -- 172.21.15.60:0/3571134007 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b24001a50 con 0x7f1b2c0b24a0 2020-10-31T22:43:05.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b23fff700 1 -- 172.21.15.60:0/3571134007 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c00d5c0 con 0x7f1b2c0b24a0 2020-10-31T22:43:05.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b23fff700 1 -- 172.21.15.60:0/3571134007 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b1c00d730 con 0x7f1b2c0b24a0 2020-10-31T22:43:05.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b3213a700 1 -- 172.21.15.60:0/3571134007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b2c0b24a0 msgr2=0x7f1b2c0b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b3213a700 1 --2- 172.21.15.60:0/3571134007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b2c0b24a0 0x7f1b2c0b5950 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f1b24001bf0 tx=0x7f1b1c006dc0).stop 2020-10-31T22:43:05.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b3213a700 1 -- 172.21.15.60:0/3571134007 shutdown_connections 2020-10-31T22:43:05.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b3213a700 1 --2- 172.21.15.60:0/3571134007 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b2c0b24a0 0x7f1b2c0b5950 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b3213a700 1 -- 172.21.15.60:0/3571134007 >> 172.21.15.60:0/3571134007 conn(0x7f1b2c0b8e90 msgr2=0x7f1b2c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:05.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b3213a700 1 -- 172.21.15.60:0/3571134007 shutdown_connections 2020-10-31T22:43:05.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.891+0000 7f1b3213a700 1 -- 172.21.15.60:0/3571134007 wait complete. 2020-10-31T22:43:05.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b3213a700 1 Processor -- start 2020-10-31T22:43:05.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b3213a700 1 -- start start 2020-10-31T22:43:05.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b3213a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b2c0b24a0 0x7f1b2c148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b3213a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b2c0b5570 0x7f1b2c0ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b3213a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b2c141f00 0x7f1b2c0aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b3213a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0b7090 con 0x7f1b2c0b5570 2020-10-31T22:43:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b3213a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0b1bc0 con 0x7f1b2c141f00 2020-10-31T22:43:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b3213a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c0b75f0 con 0x7f1b2c0b24a0 2020-10-31T22:43:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b30937700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b2c0b5570 0x7f1b2c0ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b30937700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b2c0b5570 0x7f1b2c0ae5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43210/0 (socket says 172.21.15.60:43210) 2020-10-31T22:43:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b30937700 1 -- 172.21.15.60:0/3637964168 learned_addr learned my addr 172.21.15.60:0/3637964168 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:05.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b31138700 1 --2- 172.21.15.60:0/3637964168 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b2c0b24a0 0x7f1b2c148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b31939700 1 --2- 172.21.15.60:0/3637964168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b2c141f00 0x7f1b2c0aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b30937700 1 -- 172.21.15.60:0/3637964168 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b2c0b24a0 msgr2=0x7f1b2c148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b30937700 1 --2- 172.21.15.60:0/3637964168 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b2c0b24a0 0x7f1b2c148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b30937700 1 -- 172.21.15.60:0/3637964168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b2c141f00 msgr2=0x7f1b2c0aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:05.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b30937700 1 --2- 172.21.15.60:0/3637964168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b2c141f00 0x7f1b2c0aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:05.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b30937700 1 -- 172.21.15.60:0/3637964168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c154030 con 0x7f1b2c0b5570 2020-10-31T22:43:05.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b30937700 1 --2- 172.21.15.60:0/3637964168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b2c0b5570 0x7f1b2c0ae5d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f1b24001bf0 tx=0x7f1b2c0b0210).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:05.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b227fc700 1 -- 172.21.15.60:0/3637964168 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b1c013bb0 con 0x7f1b2c0b5570 2020-10-31T22:43:05.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b227fc700 1 -- 172.21.15.60:0/3637964168 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b1c013d10 con 0x7f1b2c0b5570 2020-10-31T22:43:05.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b227fc700 1 -- 172.21.15.60:0/3637964168 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b1c01e5f0 con 0x7f1b2c0b5570 2020-10-31T22:43:05.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b3213a700 1 -- 172.21.15.60:0/3637964168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2c0b6df0 con 0x7f1b2c0b5570 2020-10-31T22:43:05.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b3213a700 1 -- 172.21.15.60:0/3637964168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2c0b7fb0 con 0x7f1b2c0b5570 2020-10-31T22:43:05.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.895+0000 7f1b3213a700 1 -- 172.21.15.60:0/3637964168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2c0b6a80 con 0x7f1b2c0b5570 2020-10-31T22:43:05.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.899+0000 7f1b227fc700 1 -- 172.21.15.60:0/3637964168 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1b1c025030 con 0x7f1b2c0b5570 2020-10-31T22:43:05.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.899+0000 7f1b227fc700 1 --2- 172.21.15.60:0/3637964168 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1b14054f90 0x7f1b14057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:05.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.899+0000 7f1b227fc700 1 -- 172.21.15.60:0/3637964168 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1b1c06e7f0 con 0x7f1b2c0b5570 2020-10-31T22:43:05.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.899+0000 7f1b31138700 1 --2- 172.21.15.60:0/3637964168 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1b14054f90 0x7f1b14057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:05.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.899+0000 7f1b31138700 1 --2- 172.21.15.60:0/3637964168 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1b14054f90 0x7f1b14057450 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f1b2800d000 tx=0x7f1b28007a30).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:05.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:05.903+0000 7f1b227fc700 1 -- 172.21.15.60:0/3637964168 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1b1c0450c0 con 0x7f1b2c0b5570 2020-10-31T22:43:06.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:06.043+0000 7f1b3213a700 1 -- 172.21.15.60:0/3637964168 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f1b2c057100 con 0x7f1b2c0b5570 2020-10-31T22:43:06.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:06.963+0000 7f1b227fc700 1 -- 172.21.15.60:0/3637964168 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v41) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1b1c023070 con 0x7f1b2c0b5570 2020-10-31T22:43:06.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:06.971+0000 7f1b3213a700 1 -- 172.21.15.60:0/3637964168 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1b14054f90 msgr2=0x7f1b14057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:06.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:06.971+0000 7f1b3213a700 1 --2- 172.21.15.60:0/3637964168 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1b14054f90 0x7f1b14057450 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f1b2800d000 tx=0x7f1b28007a30).stop 2020-10-31T22:43:06.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:06.971+0000 7f1b3213a700 1 -- 172.21.15.60:0/3637964168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b2c0b5570 msgr2=0x7f1b2c0ae5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:06.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:06.971+0000 7f1b3213a700 1 --2- 172.21.15.60:0/3637964168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b2c0b5570 0x7f1b2c0ae5d0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f1b24001bf0 tx=0x7f1b2c0b0210).stop 2020-10-31T22:43:06.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:06.971+0000 7f1b3213a700 1 -- 172.21.15.60:0/3637964168 shutdown_connections 2020-10-31T22:43:06.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:06.971+0000 7f1b3213a700 1 --2- 172.21.15.60:0/3637964168 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1b14054f90 0x7f1b14057450 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:06.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:06.971+0000 7f1b3213a700 1 --2- 172.21.15.60:0/3637964168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b2c141f00 0x7f1b2c0aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:06.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:06.971+0000 7f1b3213a700 1 --2- 172.21.15.60:0/3637964168 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b2c0b24a0 0x7f1b2c148d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:06.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:06.971+0000 7f1b3213a700 1 --2- 172.21.15.60:0/3637964168 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b2c0b5570 0x7f1b2c0ae5d0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:06.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:06.971+0000 7f1b3213a700 1 -- 172.21.15.60:0/3637964168 >> 172.21.15.60:0/3637964168 conn(0x7f1b2c0b8e90 msgr2=0x7f1b2c0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:06.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:06.971+0000 7f1b3213a700 1 -- 172.21.15.60:0/3637964168 shutdown_connections 2020-10-31T22:43:06.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:06.971+0000 7f1b3213a700 1 -- 172.21.15.60:0/3637964168 wait complete. 2020-10-31T22:43:06.975 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:43:06.989 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-10-31T22:43:07.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.111+0000 7fd25f59e700 1 Processor -- start 2020-10-31T22:43:07.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.111+0000 7fd25f59e700 1 -- start start 2020-10-31T22:43:07.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.111+0000 7fd25f59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd260063140 0x7fd2600afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:07.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.111+0000 7fd25f59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2600b14d0 0x7fd2600ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:07.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.111+0000 7fd25f59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2600b0390 con 0x7fd2600ae740 2020-10-31T22:43:07.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.111+0000 7fd25f59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd260063520 con 0x7fd260063140 2020-10-31T22:43:07.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.111+0000 7fd25f59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600a9070 con 0x7fd2600b14d0 2020-10-31T22:43:07.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25e59c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd260063140 0x7fd2600afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25ed9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2600b14d0 0x7fd2600ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25e59c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd260063140 0x7fd2600afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:54152/0 (socket says 172.21.15.60:54152) 2020-10-31T22:43:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25dd9b700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd2600ae740 0x7fd2600aee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:45224/0 (socket says 172.21.15.60:45224) 2020-10-31T22:43:07.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25e59c700 1 -- 172.21.15.60:0/2568245682 learned_addr learned my addr 172.21.15.60:0/2568245682 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:07.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25e59c700 1 -- 172.21.15.60:0/2568245682 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2600b14d0 msgr2=0x7fd2600ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:07.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25e59c700 1 --2- 172.21.15.60:0/2568245682 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2600b14d0 0x7fd2600ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:07.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25e59c700 1 -- 172.21.15.60:0/2568245682 >> v1:172.21.15.66:6789/0 conn(0x7fd2600ae740 legacy=0x7fd2600aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:07.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25d59a700 1 -- 172.21.15.60:0/2568245682 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597989882 0 0) 0x7fd2600b0390 con 0x7fd2600ae740 2020-10-31T22:43:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25e59c700 1 -- 172.21.15.60:0/2568245682 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2600a9310 con 0x7fd260063140 2020-10-31T22:43:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25ed9d700 1 --2- 172.21.15.60:0/2568245682 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2600b14d0 0x7fd2600ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25e59c700 1 --2- 172.21.15.60:0/2568245682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd260063140 0x7fd2600afea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fd250002f30 tx=0x7fd250006e80).ready entity=mon.1 client_cookie=ec2a76d87f1ae877 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:07.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25d59a700 1 -- 172.21.15.60:0/2568245682 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2500097f0 con 0x7fd260063140 2020-10-31T22:43:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25d59a700 1 -- 172.21.15.60:0/2568245682 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd250009950 con 0x7fd260063140 2020-10-31T22:43:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25d59a700 1 -- 172.21.15.60:0/2568245682 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd250009cb0 con 0x7fd260063140 2020-10-31T22:43:07.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25f59e700 1 -- 172.21.15.60:0/2568245682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd260063140 msgr2=0x7fd2600afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25f59e700 1 --2- 172.21.15.60:0/2568245682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd260063140 0x7fd2600afea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7fd250002f30 tx=0x7fd250006e80).stop 2020-10-31T22:43:07.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25f59e700 1 -- 172.21.15.60:0/2568245682 shutdown_connections 2020-10-31T22:43:07.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25f59e700 1 --2- 172.21.15.60:0/2568245682 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2600b14d0 0x7fd2600ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:07.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25f59e700 1 --2- 172.21.15.60:0/2568245682 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd260063140 0x7fd2600afea0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:07.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25f59e700 1 -- 172.21.15.60:0/2568245682 >> 172.21.15.60:0/2568245682 conn(0x7fd26006a600 msgr2=0x7fd260060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:07.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25f59e700 1 -- 172.21.15.60:0/2568245682 shutdown_connections 2020-10-31T22:43:07.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.115+0000 7fd25f59e700 1 -- 172.21.15.60:0/2568245682 wait complete. 2020-10-31T22:43:07.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25f59e700 1 Processor -- start 2020-10-31T22:43:07.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25f59e700 1 -- start start 2020-10-31T22:43:07.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25f59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd260063140 0x7fd260143bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:07.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2600ae740 0x7fd260146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:07.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25f59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2600b14d0 0x7fd260140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:07.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd260067610 con 0x7fd2600ae740 2020-10-31T22:43:07.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25f59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600b5220 con 0x7fd260063140 2020-10-31T22:43:07.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25f59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2600637e0 con 0x7fd2600b14d0 2020-10-31T22:43:07.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2600ae740 0x7fd260146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:07.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2600ae740 0x7fd260146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43224/0 (socket says 172.21.15.60:43224) 2020-10-31T22:43:07.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25dd9b700 1 -- 172.21.15.60:0/1052226014 learned_addr learned my addr 172.21.15.60:0/1052226014 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:07.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25e59c700 1 --2- 172.21.15.60:0/1052226014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd260063140 0x7fd260143bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:07.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25ed9d700 1 --2- 172.21.15.60:0/1052226014 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2600b14d0 0x7fd260140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:07.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25dd9b700 1 -- 172.21.15.60:0/1052226014 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2600b14d0 msgr2=0x7fd260140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:07.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25dd9b700 1 --2- 172.21.15.60:0/1052226014 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2600b14d0 0x7fd260140d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:07.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25dd9b700 1 -- 172.21.15.60:0/1052226014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd260063140 msgr2=0x7fd260143bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:07.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25dd9b700 1 --2- 172.21.15.60:0/1052226014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd260063140 0x7fd260143bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:07.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25dd9b700 1 -- 172.21.15.60:0/1052226014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd260067370 con 0x7fd2600ae740 2020-10-31T22:43:07.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25dd9b700 1 --2- 172.21.15.60:0/1052226014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2600ae740 0x7fd260146810 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fd248000b80 tx=0x7fd248007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:07.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd2577fe700 1 -- 172.21.15.60:0/1052226014 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2480073b0 con 0x7fd2600ae740 2020-10-31T22:43:07.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25f59e700 1 -- 172.21.15.60:0/1052226014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd260063a40 con 0x7fd2600ae740 2020-10-31T22:43:07.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd2577fe700 1 -- 172.21.15.60:0/1052226014 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd248005520 con 0x7fd2600ae740 2020-10-31T22:43:07.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd2577fe700 1 -- 172.21.15.60:0/1052226014 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd248005880 con 0x7fd2600ae740 2020-10-31T22:43:07.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.119+0000 7fd25f59e700 1 -- 172.21.15.60:0/1052226014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd260142500 con 0x7fd2600ae740 2020-10-31T22:43:07.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.123+0000 7fd2577fe700 1 -- 172.21.15.60:0/1052226014 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd248010070 con 0x7fd2600ae740 2020-10-31T22:43:07.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.123+0000 7fd25f59e700 1 -- 172.21.15.60:0/1052226014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd260141590 con 0x7fd2600ae740 2020-10-31T22:43:07.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.123+0000 7fd2577fe700 1 --2- 172.21.15.60:0/1052226014 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd244054f30 0x7fd2440573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:07.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.123+0000 7fd25e59c700 1 --2- 172.21.15.60:0/1052226014 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd244054f30 0x7fd2440573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:07.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.123+0000 7fd2577fe700 1 -- 172.21.15.60:0/1052226014 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fd24806d080 con 0x7fd2600ae740 2020-10-31T22:43:07.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.123+0000 7fd25e59c700 1 --2- 172.21.15.60:0/1052226014 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd244054f30 0x7fd2440573f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fd25001c000 tx=0x7fd250015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:07.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.131+0000 7fd2577fe700 1 -- 172.21.15.60:0/1052226014 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd260141590 con 0x7fd2600ae740 2020-10-31T22:43:07.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.275+0000 7fd25f59e700 1 -- 172.21.15.60:0/1052226014 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fd260141590 con 0x7fd2600ae740 2020-10-31T22:43:07.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.979+0000 7fd2577fe700 1 -- 172.21.15.60:0/1052226014 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v42) v1 ==== 125+0+0 (secure 0 0 0) 0x7fd260141590 con 0x7fd2600ae740 2020-10-31T22:43:07.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.987+0000 7fd25f59e700 1 -- 172.21.15.60:0/1052226014 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd244054f30 msgr2=0x7fd2440573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:07.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.987+0000 7fd25f59e700 1 --2- 172.21.15.60:0/1052226014 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd244054f30 0x7fd2440573f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fd25001c000 tx=0x7fd250015000).stop 2020-10-31T22:43:07.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.987+0000 7fd25f59e700 1 -- 172.21.15.60:0/1052226014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2600ae740 msgr2=0x7fd260146810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:07.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.987+0000 7fd25f59e700 1 --2- 172.21.15.60:0/1052226014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2600ae740 0x7fd260146810 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fd248000b80 tx=0x7fd248007a30).stop 2020-10-31T22:43:07.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.987+0000 7fd25f59e700 1 -- 172.21.15.60:0/1052226014 shutdown_connections 2020-10-31T22:43:07.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.987+0000 7fd25f59e700 1 --2- 172.21.15.60:0/1052226014 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd2600b14d0 0x7fd260140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:07.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.987+0000 7fd25f59e700 1 --2- 172.21.15.60:0/1052226014 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd244054f30 0x7fd2440573f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:07.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.987+0000 7fd25f59e700 1 --2- 172.21.15.60:0/1052226014 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd260063140 0x7fd260143bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:07.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.987+0000 7fd25f59e700 1 --2- 172.21.15.60:0/1052226014 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd2600ae740 0x7fd260146810 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:07.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.987+0000 7fd25f59e700 1 -- 172.21.15.60:0/1052226014 >> 172.21.15.60:0/1052226014 conn(0x7fd26006a600 msgr2=0x7fd2600b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:07.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.987+0000 7fd25f59e700 1 -- 172.21.15.60:0/1052226014 shutdown_connections 2020-10-31T22:43:07.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:07.987+0000 7fd25f59e700 1 -- 172.21.15.60:0/1052226014 wait complete. 2020-10-31T22:43:07.998 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2020-10-31T22:43:08.003 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-10-31T22:43:08.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.119+0000 7fee94c3f700 1 Processor -- start 2020-10-31T22:43:08.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.119+0000 7fee94c3f700 1 -- start start 2020-10-31T22:43:08.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee94c3f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bb0 0x7fee901427d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee94c3f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee900acca0 0x7fee9005bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee94c3f700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee900ad170 con 0x7fee9005c4e0 2020-10-31T22:43:08.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee94c3f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee900ad410 con 0x7fee900acca0 2020-10-31T22:43:08.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee94c3f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee900ad6b0 con 0x7fee900b1bb0 2020-10-31T22:43:08.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee8dd9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee900acca0 0x7fee9005bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee8dd9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee900acca0 0x7fee9005bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43232/0 (socket says 172.21.15.60:43232) 2020-10-31T22:43:08.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee8dd9b700 1 -- 172.21.15.60:0/4204450115 learned_addr learned my addr 172.21.15.60:0/4204450115 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:08.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee8e59c700 1 --2- 172.21.15.60:0/4204450115 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bb0 0x7fee901427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee8dd9b700 1 -- 172.21.15.60:0/4204450115 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bb0 msgr2=0x7fee901427d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee8dd9b700 1 --2- 172.21.15.60:0/4204450115 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bb0 0x7fee901427d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee8dd9b700 1 -- 172.21.15.60:0/4204450115 >> v1:172.21.15.66:6789/0 conn(0x7fee9005c4e0 legacy=0x7fee900afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee8dd9b700 1 -- 172.21.15.60:0/4204450115 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee900af5a0 con 0x7fee900acca0 2020-10-31T22:43:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee8dd9b700 1 --2- 172.21.15.60:0/4204450115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900acca0 0x7fee9005bff0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fee84002f30 tx=0x7fee84006e80).ready entity=mon.0 client_cookie=6856160c362c36bc server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee8d59a700 1 -- 172.21.15.60:0/4204450115 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee84009880 con 0x7fee900acca0 2020-10-31T22:43:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee8d59a700 1 -- 172.21.15.60:0/4204450115 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee840099e0 con 0x7fee900acca0 2020-10-31T22:43:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee8d59a700 1 -- 172.21.15.60:0/4204450115 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee84009d40 con 0x7fee900acca0 2020-10-31T22:43:08.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee94c3f700 1 -- 172.21.15.60:0/4204450115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900acca0 msgr2=0x7fee9005bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee94c3f700 1 --2- 172.21.15.60:0/4204450115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900acca0 0x7fee9005bff0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7fee84002f30 tx=0x7fee84006e80).stop 2020-10-31T22:43:08.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee94c3f700 1 -- 172.21.15.60:0/4204450115 shutdown_connections 2020-10-31T22:43:08.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee94c3f700 1 --2- 172.21.15.60:0/4204450115 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bb0 0x7fee901427d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee94c3f700 1 --2- 172.21.15.60:0/4204450115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900acca0 0x7fee9005bff0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee94c3f700 1 -- 172.21.15.60:0/4204450115 >> 172.21.15.60:0/4204450115 conn(0x7fee90062310 msgr2=0x7fee900626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:08.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee94c3f700 1 -- 172.21.15.60:0/4204450115 shutdown_connections 2020-10-31T22:43:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.123+0000 7fee94c3f700 1 -- 172.21.15.60:0/4204450115 wait complete. 2020-10-31T22:43:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee94c3f700 1 Processor -- start 2020-10-31T22:43:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee94c3f700 1 -- start start 2020-10-31T22:43:08.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee94c3f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee9005c4e0 0x7fee900b5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee94c3f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900acca0 0x7fee90145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee94c3f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bb0 0x7fee90065570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee94c3f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee900b4980 con 0x7fee900acca0 2020-10-31T22:43:08.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee94c3f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee90063010 con 0x7fee9005c4e0 2020-10-31T22:43:08.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee94c3f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee90063240 con 0x7fee900b1bb0 2020-10-31T22:43:08.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee8dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900acca0 0x7fee90145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee8e59c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee9005c4e0 0x7fee900b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee8dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900acca0 0x7fee90145060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43238/0 (socket says 172.21.15.60:43238) 2020-10-31T22:43:08.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee8dd9b700 1 -- 172.21.15.60:0/1043378468 learned_addr learned my addr 172.21.15.60:0/1043378468 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:08.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee8ed9d700 1 --2- 172.21.15.60:0/1043378468 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bb0 0x7fee90065570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee8dd9b700 1 -- 172.21.15.60:0/1043378468 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bb0 msgr2=0x7fee90065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee8dd9b700 1 --2- 172.21.15.60:0/1043378468 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bb0 0x7fee90065570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee8dd9b700 1 -- 172.21.15.60:0/1043378468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee9005c4e0 msgr2=0x7fee900b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee8dd9b700 1 --2- 172.21.15.60:0/1043378468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee9005c4e0 0x7fee900b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee8dd9b700 1 -- 172.21.15.60:0/1043378468 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee900634e0 con 0x7fee900acca0 2020-10-31T22:43:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.127+0000 7fee8e59c700 1 --2- 172.21.15.60:0/1043378468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee9005c4e0 0x7fee900b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.131+0000 7fee8dd9b700 1 --2- 172.21.15.60:0/1043378468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900acca0 0x7fee90145060 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fee84002f30 tx=0x7fee84015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.131+0000 7fee7f7fe700 1 -- 172.21.15.60:0/1043378468 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee84011b60 con 0x7fee900acca0 2020-10-31T22:43:08.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.131+0000 7fee7f7fe700 1 -- 172.21.15.60:0/1043378468 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee84011cc0 con 0x7fee900acca0 2020-10-31T22:43:08.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.131+0000 7fee94c3f700 1 -- 172.21.15.60:0/1043378468 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee90063780 con 0x7fee900acca0 2020-10-31T22:43:08.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.131+0000 7fee7f7fe700 1 -- 172.21.15.60:0/1043378468 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee8401e650 con 0x7fee900acca0 2020-10-31T22:43:08.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.131+0000 7fee94c3f700 1 -- 172.21.15.60:0/1043378468 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee90154200 con 0x7fee900acca0 2020-10-31T22:43:08.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.131+0000 7fee94c3f700 1 -- 172.21.15.60:0/1043378468 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee90057100 con 0x7fee900acca0 2020-10-31T22:43:08.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.131+0000 7fee7f7fe700 1 -- 172.21.15.60:0/1043378468 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fee8401a040 con 0x7fee900acca0 2020-10-31T22:43:08.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.135+0000 7fee7f7fe700 1 --2- 172.21.15.60:0/1043378468 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee6c054f90 0x7fee6c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.135+0000 7fee7f7fe700 1 -- 172.21.15.60:0/1043378468 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fee8406ea50 con 0x7fee900acca0 2020-10-31T22:43:08.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.135+0000 7fee8e59c700 1 --2- 172.21.15.60:0/1043378468 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee6c054f90 0x7fee6c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.135+0000 7fee8e59c700 1 --2- 172.21.15.60:0/1043378468 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee6c054f90 0x7fee6c057450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fee8000b000 tx=0x7fee800091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:08.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.139+0000 7fee7f7fe700 1 -- 172.21.15.60:0/1043378468 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fee84044f40 con 0x7fee900acca0 2020-10-31T22:43:08.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.327+0000 7fee94c3f700 1 -- 172.21.15.60:0/1043378468 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fee9005f000 con 0x7fee900acca0 2020-10-31T22:43:08.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.343+0000 7fee7f7fe700 1 -- 172.21.15.60:0/1043378468 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 7 and data pool 8 v15) v1 ==== 187+0+0 (secure 0 0 0) 0x7fee84023070 con 0x7fee900acca0 2020-10-31T22:43:08.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.347+0000 7fee94c3f700 1 -- 172.21.15.60:0/1043378468 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee6c054f90 msgr2=0x7fee6c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.347+0000 7fee94c3f700 1 --2- 172.21.15.60:0/1043378468 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee6c054f90 0x7fee6c057450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fee8000b000 tx=0x7fee800091a0).stop 2020-10-31T22:43:08.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.347+0000 7fee94c3f700 1 -- 172.21.15.60:0/1043378468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900acca0 msgr2=0x7fee90145060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.347+0000 7fee94c3f700 1 --2- 172.21.15.60:0/1043378468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900acca0 0x7fee90145060 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7fee84002f30 tx=0x7fee84015000).stop 2020-10-31T22:43:08.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.351+0000 7fee94c3f700 1 -- 172.21.15.60:0/1043378468 shutdown_connections 2020-10-31T22:43:08.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.351+0000 7fee94c3f700 1 --2- 172.21.15.60:0/1043378468 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee900b1bb0 0x7fee90065570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.351+0000 7fee94c3f700 1 --2- 172.21.15.60:0/1043378468 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee6c054f90 0x7fee6c057450 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.351+0000 7fee94c3f700 1 --2- 172.21.15.60:0/1043378468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee9005c4e0 0x7fee900b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.351+0000 7fee94c3f700 1 --2- 172.21.15.60:0/1043378468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee900acca0 0x7fee90145060 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.351+0000 7fee94c3f700 1 -- 172.21.15.60:0/1043378468 >> 172.21.15.60:0/1043378468 conn(0x7fee90062310 msgr2=0x7fee901486b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:08.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.351+0000 7fee94c3f700 1 -- 172.21.15.60:0/1043378468 shutdown_connections 2020-10-31T22:43:08.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.351+0000 7fee94c3f700 1 -- 172.21.15.60:0/1043378468 wait complete. 2020-10-31T22:43:08.355 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 7 and data pool 8 2020-10-31T22:43:08.369 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:43:08.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 Processor -- start 2020-10-31T22:43:08.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 -- start start 2020-10-31T22:43:08.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4740b5440 0x7fe4740af420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe4740b0db0 0x7fe4740af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4740a8320 con 0x7fe474141bf0 2020-10-31T22:43:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4740afe00 con 0x7fe4740b0db0 2020-10-31T22:43:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe474142790 con 0x7fe4740b5440 2020-10-31T22:43:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe479863700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe4740b0db0 0x7fe4740af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe479863700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe4740b0db0 0x7fe4740af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43254/0 (socket says 172.21.15.60:43254) 2020-10-31T22:43:08.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe479863700 1 -- 172.21.15.60:0/3936124760 learned_addr learned my addr 172.21.15.60:0/3936124760 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:08.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47a064700 1 --2- 172.21.15.60:0/3936124760 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4740b5440 0x7fe4740af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe479863700 1 -- 172.21.15.60:0/3936124760 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4740b5440 msgr2=0x7fe4740af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:08.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe479863700 1 --2- 172.21.15.60:0/3936124760 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4740b5440 0x7fe4740af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe479863700 1 -- 172.21.15.60:0/3936124760 >> v1:172.21.15.66:6789/0 conn(0x7fe474141bf0 legacy=0x7fe474142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:08.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe479863700 1 -- 172.21.15.60:0/3936124760 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4740ad870 con 0x7fe4740b0db0 2020-10-31T22:43:08.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47a064700 1 --2- 172.21.15.60:0/3936124760 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4740b5440 0x7fe4740af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:43:08.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe479863700 1 --2- 172.21.15.60:0/3936124760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4740b0db0 0x7fe4740af910 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fe4740ae0c0 tx=0x7fe46c009270).ready entity=mon.0 client_cookie=e967952279458506 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:08.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe479062700 1 -- 172.21.15.60:0/3936124760 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe46c00bdb0 con 0x7fe4740b0db0 2020-10-31T22:43:08.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe479062700 1 -- 172.21.15.60:0/3936124760 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c010470 con 0x7fe4740b0db0 2020-10-31T22:43:08.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe479062700 1 -- 172.21.15.60:0/3936124760 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe46c010810 con 0x7fe4740b0db0 2020-10-31T22:43:08.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 -- 172.21.15.60:0/3936124760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4740b0db0 msgr2=0x7fe4740af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 --2- 172.21.15.60:0/3936124760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4740b0db0 0x7fe4740af910 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fe4740ae0c0 tx=0x7fe46c009270).stop 2020-10-31T22:43:08.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 -- 172.21.15.60:0/3936124760 shutdown_connections 2020-10-31T22:43:08.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 --2- 172.21.15.60:0/3936124760 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4740b5440 0x7fe4740af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 --2- 172.21.15.60:0/3936124760 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4740b0db0 0x7fe4740af910 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 -- 172.21.15.60:0/3936124760 >> 172.21.15.60:0/3936124760 conn(0x7fe474060c10 msgr2=0x7fe4740b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:08.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 -- 172.21.15.60:0/3936124760 shutdown_connections 2020-10-31T22:43:08.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.471+0000 7fe47c2c8700 1 -- 172.21.15.60:0/3936124760 wait complete. 2020-10-31T22:43:08.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe47c2c8700 1 Processor -- start 2020-10-31T22:43:08.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe47c2c8700 1 -- start start 2020-10-31T22:43:08.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe47c2c8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4740b0db0 0x7fe474066220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe47c2c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4740b5440 0x7fe474151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe47c2c8700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe474141bf0 0x7fe4740a7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe47c2c8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe474067270 con 0x7fe4740b5440 2020-10-31T22:43:08.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe47c2c8700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4740674a0 con 0x7fe474141bf0 2020-10-31T22:43:08.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe47c2c8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe474067740 con 0x7fe4740b0db0 2020-10-31T22:43:08.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe479863700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4740b5440 0x7fe474151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe479863700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4740b5440 0x7fe474151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43260/0 (socket says 172.21.15.60:43260) 2020-10-31T22:43:08.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe479863700 1 -- 172.21.15.60:0/2604536610 learned_addr learned my addr 172.21.15.60:0/2604536610 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:08.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe47a865700 1 --2- 172.21.15.60:0/2604536610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe474141bf0 0x7fe4740a7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe47a064700 1 --2- 172.21.15.60:0/2604536610 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4740b0db0 0x7fe474066220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe479863700 1 -- 172.21.15.60:0/2604536610 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4740b0db0 msgr2=0x7fe474066220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe479863700 1 --2- 172.21.15.60:0/2604536610 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4740b0db0 0x7fe474066220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe479863700 1 -- 172.21.15.60:0/2604536610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe474141bf0 msgr2=0x7fe4740a7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe479863700 1 --2- 172.21.15.60:0/2604536610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe474141bf0 0x7fe4740a7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe479863700 1 -- 172.21.15.60:0/2604536610 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe474150bf0 con 0x7fe4740b5440 2020-10-31T22:43:08.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe479863700 1 --2- 172.21.15.60:0/2604536610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4740b5440 0x7fe474151330 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fe4740ae0c0 tx=0x7fe46c018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:08.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe4677fe700 1 -- 172.21.15.60:0/2604536610 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe46c018610 con 0x7fe4740b5440 2020-10-31T22:43:08.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe4677fe700 1 -- 172.21.15.60:0/2604536610 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c018770 con 0x7fe4740b5440 2020-10-31T22:43:08.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe4677fe700 1 -- 172.21.15.60:0/2604536610 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe46c018ad0 con 0x7fe4740b5440 2020-10-31T22:43:08.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe47c2c8700 1 -- 172.21.15.60:0/2604536610 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe474150e90 con 0x7fe4740b5440 2020-10-31T22:43:08.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe47c2c8700 1 -- 172.21.15.60:0/2604536610 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4741402e0 con 0x7fe4740b5440 2020-10-31T22:43:08.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe47c2c8700 1 -- 172.21.15.60:0/2604536610 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe474151020 con 0x7fe4740b5440 2020-10-31T22:43:08.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.475+0000 7fe4677fe700 1 -- 172.21.15.60:0/2604536610 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe46c028020 con 0x7fe4740b5440 2020-10-31T22:43:08.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.479+0000 7fe4677fe700 1 --2- 172.21.15.60:0/2604536610 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe454054f90 0x7fe454057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.479+0000 7fe4677fe700 1 -- 172.21.15.60:0/2604536610 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe46c06f5b0 con 0x7fe4740b5440 2020-10-31T22:43:08.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.479+0000 7fe47a064700 1 --2- 172.21.15.60:0/2604536610 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe454054f90 0x7fe454057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.479+0000 7fe47a064700 1 --2- 172.21.15.60:0/2604536610 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe454054f90 0x7fe454057450 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fe46800b000 tx=0x7fe468008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:08.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.483+0000 7fe4677fe700 1 -- 172.21.15.60:0/2604536610 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe46c045ad0 con 0x7fe4740b5440 2020-10-31T22:43:08.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.627+0000 7fe47c2c8700 1 -- 172.21.15.60:0/2604536610 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe474057100 con 0x7fe4740b5440 2020-10-31T22:43:08.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.627+0000 7fe4677fe700 1 -- 172.21.15.60:0/2604536610 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fe46c0490f0 con 0x7fe4740b5440 2020-10-31T22:43:08.631 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:08.631 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":43,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:43:08.333257+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:43:06.097368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-10-31T22:43:07.332204+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:43:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.631+0000 7fe47c2c8700 1 -- 172.21.15.60:0/2604536610 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe454054f90 msgr2=0x7fe454057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.631+0000 7fe47c2c8700 1 --2- 172.21.15.60:0/2604536610 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe454054f90 0x7fe454057450 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fe46800b000 tx=0x7fe468008040).stop 2020-10-31T22:43:08.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.631+0000 7fe47c2c8700 1 -- 172.21.15.60:0/2604536610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4740b5440 msgr2=0x7fe474151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.631+0000 7fe47c2c8700 1 --2- 172.21.15.60:0/2604536610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4740b5440 0x7fe474151330 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fe4740ae0c0 tx=0x7fe46c018000).stop 2020-10-31T22:43:08.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.631+0000 7fe47c2c8700 1 -- 172.21.15.60:0/2604536610 shutdown_connections 2020-10-31T22:43:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.631+0000 7fe47c2c8700 1 --2- 172.21.15.60:0/2604536610 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe454054f90 0x7fe454057450 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.631+0000 7fe47c2c8700 1 --2- 172.21.15.60:0/2604536610 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe474141bf0 0x7fe4740a7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.631+0000 7fe47c2c8700 1 --2- 172.21.15.60:0/2604536610 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4740b0db0 0x7fe474066220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.631+0000 7fe47c2c8700 1 --2- 172.21.15.60:0/2604536610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4740b5440 0x7fe474151330 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.631+0000 7fe47c2c8700 1 -- 172.21.15.60:0/2604536610 >> 172.21.15.60:0/2604536610 conn(0x7fe474060c10 msgr2=0x7fe474140e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:08.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.631+0000 7fe47c2c8700 1 -- 172.21.15.60:0/2604536610 shutdown_connections 2020-10-31T22:43:08.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.631+0000 7fe47c2c8700 1 -- 172.21.15.60:0/2604536610 wait complete. 2020-10-31T22:43:08.645 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:43:08.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.755+0000 7fe7e0c5a700 1 Processor -- start 2020-10-31T22:43:08.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.755+0000 7fe7e0c5a700 1 -- start start 2020-10-31T22:43:08.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.755+0000 7fe7e0c5a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7dc0b1bb0 0x7fe7dc05c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.755+0000 7fe7e0c5a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe7dc13f3d0 0x7fe7dc0b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.755+0000 7fe7e0c5a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7dc05c800 con 0x7fe7dc0ae630 2020-10-31T22:43:08.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.755+0000 7fe7e0c5a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7dc05c5e0 con 0x7fe7dc13f3d0 2020-10-31T22:43:08.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.755+0000 7fe7e0c5a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc0adc50 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.755+0000 7fe7dbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe7dc13f3d0 0x7fe7dc0b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.755+0000 7fe7daffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe7dc0ae630 0x7fe7dc13ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47406/0 (socket says 172.21.15.60:47406) 2020-10-31T22:43:08.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.755+0000 7fe7db7fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7dc0b1bb0 0x7fe7dc05c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.755+0000 7fe7daffd700 1 -- 172.21.15.60:0/1868752865 learned_addr learned my addr 172.21.15.60:0/1868752865 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:08.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.755+0000 7fe7da7fc700 1 -- 172.21.15.60:0/1868752865 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 65139324 0 0) 0x7fe7dc05c800 con 0x7fe7dc0ae630 2020-10-31T22:43:08.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.755+0000 7fe7da7fc700 1 -- 172.21.15.60:0/1868752865 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7bc003230 con 0x7fe7dc0ae630 2020-10-31T22:43:08.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7db7fe700 1 -- 172.21.15.60:0/1868752865 >> v2:172.21.15.60:3300/0 conn(0x7fe7dc13f3d0 msgr2=0x7fe7dc0b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:08.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7db7fe700 1 --2- 172.21.15.60:0/1868752865 >> v2:172.21.15.60:3300/0 conn(0x7fe7dc13f3d0 0x7fe7dc0b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7db7fe700 1 -- 172.21.15.60:0/1868752865 >> v1:172.21.15.60:6789/0 conn(0x7fe7dc0ae630 legacy=0x7fe7dc13ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7db7fe700 1 -- 172.21.15.60:0/1868752865 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc0adef0 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7db7fe700 1 --2- 172.21.15.60:0/1868752865 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7dc0b1bb0 0x7fe7dc05c0f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe7cc0032b0 tx=0x7fe7cc0091a0).ready entity=mon.2 client_cookie=5aa649df4be01cb0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:08.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7da7fc700 1 -- 172.21.15.60:0/1868752865 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7cc00b940 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7da7fc700 1 -- 172.21.15.60:0/1868752865 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc00baa0 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7da7fc700 1 -- 172.21.15.60:0/1868752865 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7cc00bc10 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/1868752865 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7dc0b1bb0 msgr2=0x7fe7dc05c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7e0c5a700 1 --2- 172.21.15.60:0/1868752865 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7dc0b1bb0 0x7fe7dc05c0f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fe7cc0032b0 tx=0x7fe7cc0091a0).stop 2020-10-31T22:43:08.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/1868752865 shutdown_connections 2020-10-31T22:43:08.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7e0c5a700 1 --2- 172.21.15.60:0/1868752865 >> v2:172.21.15.60:3300/0 conn(0x7fe7dc13f3d0 0x7fe7dc0b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7e0c5a700 1 --2- 172.21.15.60:0/1868752865 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7dc0b1bb0 0x7fe7dc05c0f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/1868752865 >> 172.21.15.60:0/1868752865 conn(0x7fe7dc0b5300 msgr2=0x7fe7dc0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:08.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/1868752865 shutdown_connections 2020-10-31T22:43:08.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/1868752865 wait complete. 2020-10-31T22:43:08.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7e0c5a700 1 Processor -- start 2020-10-31T22:43:08.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.759+0000 7fe7e0c5a700 1 -- start start 2020-10-31T22:43:08.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7e0c5a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7dc0b1bb0 0x7fe7dc05b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7e0c5a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7dc13f3d0 0x7fe7dc1415e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7e0c5a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7dc0ab790 0x7fe7dc0a8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7e0c5a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc141ad0 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7e0c5a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc141d60 con 0x7fe7dc0ab790 2020-10-31T22:43:08.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7e0c5a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7dc1426c0 con 0x7fe7dc13f3d0 2020-10-31T22:43:08.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7db7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7dc0b1bb0 0x7fe7dc05b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7db7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7dc0b1bb0 0x7fe7dc05b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43274/0 (socket says 172.21.15.60:43274) 2020-10-31T22:43:08.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7db7fe700 1 -- 172.21.15.60:0/177686937 learned_addr learned my addr 172.21.15.60:0/177686937 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:08.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7daffd700 1 --2- 172.21.15.60:0/177686937 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7dc13f3d0 0x7fe7dc1415e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7dbfff700 1 --2- 172.21.15.60:0/177686937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7dc0ab790 0x7fe7dc0a8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7db7fe700 1 -- 172.21.15.60:0/177686937 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7dc13f3d0 msgr2=0x7fe7dc1415e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7db7fe700 1 --2- 172.21.15.60:0/177686937 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7dc13f3d0 0x7fe7dc1415e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7db7fe700 1 -- 172.21.15.60:0/177686937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7dc0ab790 msgr2=0x7fe7dc0a8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7db7fe700 1 --2- 172.21.15.60:0/177686937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7dc0ab790 0x7fe7dc0a8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7db7fe700 1 -- 172.21.15.60:0/177686937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc142960 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7db7fe700 1 --2- 172.21.15.60:0/177686937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7dc0b1bb0 0x7fe7dc05b320 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fe7cc0032b0 tx=0x7fe7cc016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:08.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7d8ff9700 1 -- 172.21.15.60:0/177686937 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7cc011ea0 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/177686937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7dc142e00 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7d8ff9700 1 -- 172.21.15.60:0/177686937 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc01f3f0 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7d8ff9700 1 -- 172.21.15.60:0/177686937 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7cc01f750 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/177686937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7dc0a8c90 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.763+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/177686937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7dc142520 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.767+0000 7fe7d8ff9700 1 -- 172.21.15.60:0/177686937 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe7cc026030 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.767+0000 7fe7d8ff9700 1 --2- 172.21.15.60:0/177686937 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7c0054f90 0x7fe7c0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:08.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.767+0000 7fe7d8ff9700 1 -- 172.21.15.60:0/177686937 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe7cc06e740 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.767+0000 7fe7daffd700 1 --2- 172.21.15.60:0/177686937 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7c0054f90 0x7fe7c0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:08.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.767+0000 7fe7daffd700 1 --2- 172.21.15.60:0/177686937 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7c0054f90 0x7fe7c0057450 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fe7c400d000 tx=0x7fe7c4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:08.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.771+0000 7fe7d8ff9700 1 -- 172.21.15.60:0/177686937 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe7dc142520 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.915+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/177686937 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe7dc142520 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.915+0000 7fe7d8ff9700 1 -- 172.21.15.60:0/177686937 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fe7dc142520 con 0x7fe7dc0b1bb0 2020-10-31T22:43:08.919 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:08.919 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":43,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:43:08.333257+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:43:06.097368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-10-31T22:43:07.332204+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:43:08.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.919+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/177686937 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7c0054f90 msgr2=0x7fe7c0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.919+0000 7fe7e0c5a700 1 --2- 172.21.15.60:0/177686937 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7c0054f90 0x7fe7c0057450 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fe7c400d000 tx=0x7fe7c4009040).stop 2020-10-31T22:43:08.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.919+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/177686937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7dc0b1bb0 msgr2=0x7fe7dc05b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:08.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.919+0000 7fe7e0c5a700 1 --2- 172.21.15.60:0/177686937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7dc0b1bb0 0x7fe7dc05b320 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fe7cc0032b0 tx=0x7fe7cc016000).stop 2020-10-31T22:43:08.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.919+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/177686937 shutdown_connections 2020-10-31T22:43:08.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.919+0000 7fe7e0c5a700 1 --2- 172.21.15.60:0/177686937 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7c0054f90 0x7fe7c0057450 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.919+0000 7fe7e0c5a700 1 --2- 172.21.15.60:0/177686937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7dc0ab790 0x7fe7dc0a8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.919+0000 7fe7e0c5a700 1 --2- 172.21.15.60:0/177686937 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7dc0b1bb0 0x7fe7dc05b320 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.919+0000 7fe7e0c5a700 1 --2- 172.21.15.60:0/177686937 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7dc13f3d0 0x7fe7dc1415e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:08.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.919+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/177686937 >> 172.21.15.60:0/177686937 conn(0x7fe7dc0b5300 msgr2=0x7fe7dc0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:08.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.919+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/177686937 shutdown_connections 2020-10-31T22:43:08.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:08.919+0000 7fe7e0c5a700 1 -- 172.21.15.60:0/177686937 wait complete. 2020-10-31T22:43:08.933 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-10-31T22:43:09.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.047+0000 7fde5a3aa700 1 Processor -- start 2020-10-31T22:43:09.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.047+0000 7fde5a3aa700 1 -- start start 2020-10-31T22:43:09.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.047+0000 7fde5a3aa700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fde540af0e0 0x7fde540af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.047+0000 7fde5a3aa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fde54062e00 0x7fde54145330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.047+0000 7fde5a3aa700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde5413ef60 0x7fde5413f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.047+0000 7fde5a3aa700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde54141cf0 con 0x7fde54062e00 2020-10-31T22:43:09.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.047+0000 7fde5a3aa700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5413f8a0 con 0x7fde540af0e0 2020-10-31T22:43:09.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.047+0000 7fde5a3aa700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde54145af0 con 0x7fde5413ef60 2020-10-31T22:43:09.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde58ba7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fde54062e00 0x7fde54145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde58ba7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fde54062e00 0x7fde54145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43284/0 (socket says 172.21.15.60:43284) 2020-10-31T22:43:09.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde58ba7700 1 -- 172.21.15.60:0/2772211516 learned_addr learned my addr 172.21.15.60:0/2772211516 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:09.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde59ba9700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde5413ef60 0x7fde5413f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde593a8700 1 --2- 172.21.15.60:0/2772211516 >> v2:172.21.15.66:3300/0 conn(0x7fde540af0e0 0x7fde540af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde58ba7700 1 -- 172.21.15.60:0/2772211516 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde5413ef60 msgr2=0x7fde5413f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:09.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde58ba7700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde5413ef60 0x7fde5413f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde58ba7700 1 -- 172.21.15.60:0/2772211516 >> v2:172.21.15.66:3300/0 conn(0x7fde540af0e0 msgr2=0x7fde540af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:09.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde58ba7700 1 --2- 172.21.15.60:0/2772211516 >> v2:172.21.15.66:3300/0 conn(0x7fde540af0e0 0x7fde540af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde58ba7700 1 -- 172.21.15.60:0/2772211516 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde54145d90 con 0x7fde54062e00 2020-10-31T22:43:09.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde59ba9700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde5413ef60 0x7fde5413f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:43:09.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde58ba7700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde54062e00 0x7fde54145330 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fde50002f30 tx=0x7fde50006e80).ready entity=mon.0 client_cookie=ed1efb2b657f1f3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:09.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde43fff700 1 -- 172.21.15.60:0/2772211516 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde500097f0 con 0x7fde54062e00 2020-10-31T22:43:09.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde43fff700 1 -- 172.21.15.60:0/2772211516 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde50009950 con 0x7fde54062e00 2020-10-31T22:43:09.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde43fff700 1 -- 172.21.15.60:0/2772211516 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde50009cb0 con 0x7fde54062e00 2020-10-31T22:43:09.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 -- 172.21.15.60:0/2772211516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde54062e00 msgr2=0x7fde54145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde54062e00 0x7fde54145330 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fde50002f30 tx=0x7fde50006e80).stop 2020-10-31T22:43:09.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 -- 172.21.15.60:0/2772211516 shutdown_connections 2020-10-31T22:43:09.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde5413ef60 0x7fde5413f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 --2- 172.21.15.60:0/2772211516 >> v2:172.21.15.66:3300/0 conn(0x7fde540af0e0 0x7fde540af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 --2- 172.21.15.60:0/2772211516 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde54062e00 0x7fde54145330 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 -- 172.21.15.60:0/2772211516 >> 172.21.15.60:0/2772211516 conn(0x7fde5406a600 msgr2=0x7fde54060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:09.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 -- 172.21.15.60:0/2772211516 shutdown_connections 2020-10-31T22:43:09.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 -- 172.21.15.60:0/2772211516 wait complete. 2020-10-31T22:43:09.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 Processor -- start 2020-10-31T22:43:09.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 -- start start 2020-10-31T22:43:09.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde54062e00 0x7fde540ab7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde540af0e0 0x7fde54148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde5413ef60 0x7fde54147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde540aafa0 con 0x7fde540af0e0 2020-10-31T22:43:09.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde540ab240 con 0x7fde5413ef60 2020-10-31T22:43:09.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.051+0000 7fde5a3aa700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde540ab4e0 con 0x7fde54062e00 2020-10-31T22:43:09.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde58ba7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde540af0e0 0x7fde54148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde58ba7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde540af0e0 0x7fde54148cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43290/0 (socket says 172.21.15.60:43290) 2020-10-31T22:43:09.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde58ba7700 1 -- 172.21.15.60:0/3067257274 learned_addr learned my addr 172.21.15.60:0/3067257274 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:09.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde59ba9700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde5413ef60 0x7fde54147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde593a8700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde54062e00 0x7fde540ab7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde58ba7700 1 -- 172.21.15.60:0/3067257274 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde54062e00 msgr2=0x7fde540ab7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde58ba7700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde54062e00 0x7fde540ab7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde58ba7700 1 -- 172.21.15.60:0/3067257274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde5413ef60 msgr2=0x7fde54147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde58ba7700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde5413ef60 0x7fde54147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde58ba7700 1 -- 172.21.15.60:0/3067257274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde54147600 con 0x7fde540af0e0 2020-10-31T22:43:09.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde593a8700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde54062e00 0x7fde540ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:43:09.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde58ba7700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde540af0e0 0x7fde54148cc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fde50002f30 tx=0x7fde50015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:09.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde427fc700 1 -- 172.21.15.60:0/3067257274 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde50011d30 con 0x7fde540af0e0 2020-10-31T22:43:09.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde427fc700 1 -- 172.21.15.60:0/3067257274 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde50011e90 con 0x7fde540af0e0 2020-10-31T22:43:09.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde5a3aa700 1 -- 172.21.15.60:0/3067257274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde540b4b60 con 0x7fde540af0e0 2020-10-31T22:43:09.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde427fc700 1 -- 172.21.15.60:0/3067257274 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fde5001e650 con 0x7fde540af0e0 2020-10-31T22:43:09.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde5a3aa700 1 -- 172.21.15.60:0/3067257274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde540aad20 con 0x7fde540af0e0 2020-10-31T22:43:09.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde5a3aa700 1 -- 172.21.15.60:0/3067257274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde54057100 con 0x7fde540af0e0 2020-10-31T22:43:09.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.055+0000 7fde427fc700 1 -- 172.21.15.60:0/3067257274 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fde50025030 con 0x7fde540af0e0 2020-10-31T22:43:09.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.059+0000 7fde427fc700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fde34054f10 0x7fde340573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.059+0000 7fde427fc700 1 -- 172.21.15.60:0/3067257274 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fde5006ed80 con 0x7fde540af0e0 2020-10-31T22:43:09.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.059+0000 7fde593a8700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fde34054f10 0x7fde340573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.059+0000 7fde593a8700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fde34054f10 0x7fde340573d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fde44008000 tx=0x7fde44008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:09.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.063+0000 7fde427fc700 1 -- 172.21.15.60:0/3067257274 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fde500452a0 con 0x7fde540af0e0 2020-10-31T22:43:09.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.251+0000 7fde5a3aa700 1 -- 172.21.15.60:0/3067257274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fde540a8960 con 0x7fde540af0e0 2020-10-31T22:43:09.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.347+0000 7fde427fc700 1 -- 172.21.15.60:0/3067257274 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fde50070020 con 0x7fde540af0e0 2020-10-31T22:43:09.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.351+0000 7fde5a3aa700 1 -- 172.21.15.60:0/3067257274 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fde34054f10 msgr2=0x7fde340573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.351+0000 7fde5a3aa700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fde34054f10 0x7fde340573d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fde44008000 tx=0x7fde44008040).stop 2020-10-31T22:43:09.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.351+0000 7fde5a3aa700 1 -- 172.21.15.60:0/3067257274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde540af0e0 msgr2=0x7fde54148cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.351+0000 7fde5a3aa700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde540af0e0 0x7fde54148cc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fde50002f30 tx=0x7fde50015000).stop 2020-10-31T22:43:09.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.351+0000 7fde5a3aa700 1 -- 172.21.15.60:0/3067257274 shutdown_connections 2020-10-31T22:43:09.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.351+0000 7fde5a3aa700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fde34054f10 0x7fde340573d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.351+0000 7fde5a3aa700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde5413ef60 0x7fde54147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.351+0000 7fde5a3aa700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde54062e00 0x7fde540ab7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.351+0000 7fde5a3aa700 1 --2- 172.21.15.60:0/3067257274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde540af0e0 0x7fde54148cc0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.351+0000 7fde5a3aa700 1 -- 172.21.15.60:0/3067257274 >> 172.21.15.60:0/3067257274 conn(0x7fde5406a600 msgr2=0x7fde540adde0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:09.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.351+0000 7fde5a3aa700 1 -- 172.21.15.60:0/3067257274 shutdown_connections 2020-10-31T22:43:09.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.351+0000 7fde5a3aa700 1 -- 172.21.15.60:0/3067257274 wait complete. 2020-10-31T22:43:09.367 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:43:09.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb866636700 1 Processor -- start 2020-10-31T22:43:09.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb866636700 1 -- start start 2020-10-31T22:43:09.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb866636700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8600b24a0 0x7fb8600b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb866636700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb860145180 con 0x7fb8600b5570 2020-10-31T22:43:09.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb866636700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8600b0670 con 0x7fb860141fe0 2020-10-31T22:43:09.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb866636700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600afae0 con 0x7fb8600b24a0 2020-10-31T22:43:09.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb865634700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb8600b5570 0x7fb860145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47432/0 (socket says 172.21.15.60:47432) 2020-10-31T22:43:09.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb865634700 1 -- 172.21.15.60:0/1496459847 learned_addr learned my addr 172.21.15.60:0/1496459847 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:09.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb864e33700 1 --2- 172.21.15.60:0/1496459847 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8600b24a0 0x7fb8600b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 848263717 0 0) 0x7fb860145180 con 0x7fb8600b5570 2020-10-31T22:43:09.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb84c003230 con 0x7fb8600b5570 2020-10-31T22:43:09.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528996887 0 0) 0x7fb8600b0670 con 0x7fb860141fe0 2020-10-31T22:43:09.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb860145180 con 0x7fb860141fe0 2020-10-31T22:43:09.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2229239730 0 0) 0x7fb84c003230 con 0x7fb8600b5570 2020-10-31T22:43:09.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8600b24a0 msgr2=0x7fb8600b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:09.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb85ffff700 1 --2- 172.21.15.60:0/1496459847 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8600b24a0 0x7fb8600b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 >> v1:172.21.15.66:6789/0 conn(0x7fb860141fe0 legacy=0x7fb860142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.487+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8600b0910 con 0x7fb8600b5570 2020-10-31T22:43:09.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fb858001a50 con 0x7fb8600b5570 2020-10-31T22:43:09.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb864e33700 1 --2- 172.21.15.60:0/1496459847 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8600b24a0 0x7fb8600b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:09.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 >> v1:172.21.15.60:6789/0 conn(0x7fb8600b5570 legacy=0x7fb860145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb85ffff700 1 --2- 172.21.15.60:0/1496459847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb84c0038e0 0x7fb84c003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb85ffff700 1 --2- 172.21.15.60:0/1496459847 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8600b24a0 0x7fb84c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb85ffff700 1 --2- 172.21.15.60:0/1496459847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb84c0049c0 0x7fb84c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600afae0 con 0x7fb84c0049c0 2020-10-31T22:43:09.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c005330 con 0x7fb84c0038e0 2020-10-31T22:43:09.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c00b750 con 0x7fb8600b24a0 2020-10-31T22:43:09.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb865634700 1 --2- 172.21.15.60:0/1496459847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb84c0038e0 0x7fb84c003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb865e35700 1 --2- 172.21.15.60:0/1496459847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb84c0049c0 0x7fb84c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb864e33700 1 --2- 172.21.15.60:0/1496459847 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8600b24a0 0x7fb84c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb865e35700 1 -- 172.21.15.60:0/1496459847 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8600b24a0 msgr2=0x7fb84c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:09.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb865e35700 1 --2- 172.21.15.60:0/1496459847 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8600b24a0 0x7fb84c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb865e35700 1 -- 172.21.15.60:0/1496459847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb84c0038e0 msgr2=0x7fb84c003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:09.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb865e35700 1 --2- 172.21.15.60:0/1496459847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb84c0038e0 0x7fb84c003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb865e35700 1 -- 172.21.15.60:0/1496459847 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c003230 con 0x7fb84c0049c0 2020-10-31T22:43:09.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb865634700 1 --2- 172.21.15.60:0/1496459847 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb84c0038e0 0x7fb84c003ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:09.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb865e35700 1 --2- 172.21.15.60:0/1496459847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb84c0049c0 0x7fb84c004e40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fb8500010d0 tx=0x7fb850007b60).ready entity=mon.0 client_cookie=f96aded2c8ee33f8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:09.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb85000c660 con 0x7fb84c0049c0 2020-10-31T22:43:09.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85000c7c0 con 0x7fb84c0049c0 2020-10-31T22:43:09.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb85ffff700 1 -- 172.21.15.60:0/1496459847 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb85000cb20 con 0x7fb84c0049c0 2020-10-31T22:43:09.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb866636700 1 -- 172.21.15.60:0/1496459847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb84c0049c0 msgr2=0x7fb84c004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb866636700 1 --2- 172.21.15.60:0/1496459847 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb84c0049c0 0x7fb84c004e40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fb8500010d0 tx=0x7fb850007b60).stop 2020-10-31T22:43:09.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb865e35700 1 -- 172.21.15.60:0/1496459847 reap_dead start 2020-10-31T22:43:09.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb866636700 1 -- 172.21.15.60:0/1496459847 shutdown_connections 2020-10-31T22:43:09.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb866636700 1 -- 172.21.15.60:0/1496459847 >> 172.21.15.60:0/1496459847 conn(0x7fb8600b8e90 msgr2=0x7fb8600b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:09.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb866636700 1 -- 172.21.15.60:0/1496459847 shutdown_connections 2020-10-31T22:43:09.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb866636700 1 -- 172.21.15.60:0/1496459847 wait complete. 2020-10-31T22:43:09.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.491+0000 7fb866636700 1 Processor -- start 2020-10-31T22:43:09.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb866636700 1 -- start start 2020-10-31T22:43:09.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb866636700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb860141460 0x7fb860153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb866636700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb860148b10 0x7fb860154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb866636700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb86013c840 0x7fb86013ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb866636700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb860145030 con 0x7fb860141460 2020-10-31T22:43:09.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb866636700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb860144180 con 0x7fb860148b10 2020-10-31T22:43:09.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb866636700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb860141840 con 0x7fb86013c840 2020-10-31T22:43:09.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb865634700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb860141460 0x7fb860153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb865634700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb860141460 0x7fb860153f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43308/0 (socket says 172.21.15.60:43308) 2020-10-31T22:43:09.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb865634700 1 -- 172.21.15.60:0/2289944532 learned_addr learned my addr 172.21.15.60:0/2289944532 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:09.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb865e35700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb86013c840 0x7fb86013ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb864e33700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb860148b10 0x7fb860154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb865634700 1 -- 172.21.15.60:0/2289944532 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb86013c840 msgr2=0x7fb86013ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb865634700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb86013c840 0x7fb86013ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb865634700 1 -- 172.21.15.60:0/2289944532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb860148b10 msgr2=0x7fb860154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb865634700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb860148b10 0x7fb860154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb865634700 1 -- 172.21.15.60:0/2289944532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8601443b0 con 0x7fb860141460 2020-10-31T22:43:09.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb864e33700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb860148b10 0x7fb860154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:43:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb865634700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb860141460 0x7fb860153f70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fb860144f10 tx=0x7fb8580021d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb85e7fc700 1 -- 172.21.15.60:0/2289944532 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb858012540 con 0x7fb860141460 2020-10-31T22:43:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb85e7fc700 1 -- 172.21.15.60:0/2289944532 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8580126a0 con 0x7fb860141460 2020-10-31T22:43:09.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb866636700 1 -- 172.21.15.60:0/2289944532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb860144650 con 0x7fb860141460 2020-10-31T22:43:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb85e7fc700 1 -- 172.21.15.60:0/2289944532 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb858012a00 con 0x7fb860141460 2020-10-31T22:43:09.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.495+0000 7fb866636700 1 -- 172.21.15.60:0/2289944532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8601472e0 con 0x7fb860141460 2020-10-31T22:43:09.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.499+0000 7fb866636700 1 -- 172.21.15.60:0/2289944532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb860154af0 con 0x7fb860141460 2020-10-31T22:43:09.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.499+0000 7fb85e7fc700 1 -- 172.21.15.60:0/2289944532 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb85801b030 con 0x7fb860141460 2020-10-31T22:43:09.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.499+0000 7fb85e7fc700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb840055020 0x7fb8400574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.499+0000 7fb85e7fc700 1 -- 172.21.15.60:0/2289944532 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb85806dac0 con 0x7fb860141460 2020-10-31T22:43:09.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.499+0000 7fb864e33700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb840055020 0x7fb8400574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.499+0000 7fb864e33700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb840055020 0x7fb8400574e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fb854008000 tx=0x7fb854008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:09.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.507+0000 7fb85e7fc700 1 -- 172.21.15.60:0/2289944532 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb860154af0 con 0x7fb860141460 2020-10-31T22:43:09.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.691+0000 7fb866636700 1 -- 172.21.15.60:0/2289944532 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb860154af0 con 0x7fb860141460 2020-10-31T22:43:09.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.691+0000 7fb85e7fc700 1 -- 172.21.15.60:0/2289944532 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2491 (secure 0 0 0) 0x7fb860154af0 con 0x7fb860141460 2020-10-31T22:43:09.694 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:09.694 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2666662861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2666662861},{"type":"v1","addr":"172.21.15.60:6835","nonce":2666662861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14},{"gid":5193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3622783561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3622783561},{"type":"v1","addr":"172.21.15.66:6833","nonce":3622783561}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:43:08.333596+0000","modified":"2020-10-31T22:43:09.337195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/1627192275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1627192275},{"type":"v1","addr":"172.21.15.60:6837","nonce":1627192275}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-10-31T22:43:09.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.691+0000 7fb866636700 1 -- 172.21.15.60:0/2289944532 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb840055020 msgr2=0x7fb8400574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.691+0000 7fb866636700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb840055020 0x7fb8400574e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fb854008000 tx=0x7fb854008040).stop 2020-10-31T22:43:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.691+0000 7fb866636700 1 -- 172.21.15.60:0/2289944532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb860141460 msgr2=0x7fb860153f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.691+0000 7fb866636700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb860141460 0x7fb860153f70 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fb860144f10 tx=0x7fb8580021d0).stop 2020-10-31T22:43:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.695+0000 7fb866636700 1 -- 172.21.15.60:0/2289944532 shutdown_connections 2020-10-31T22:43:09.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.695+0000 7fb866636700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb86013c840 0x7fb86013ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.695+0000 7fb866636700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb860141460 0x7fb860153f70 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.695+0000 7fb866636700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb840055020 0x7fb8400574e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.695+0000 7fb866636700 1 --2- 172.21.15.60:0/2289944532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb860148b10 0x7fb860154460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.695+0000 7fb866636700 1 -- 172.21.15.60:0/2289944532 >> 172.21.15.60:0/2289944532 conn(0x7fb8600b8e90 msgr2=0x7fb8600659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:09.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.695+0000 7fb866636700 1 -- 172.21.15.60:0/2289944532 shutdown_connections 2020-10-31T22:43:09.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.695+0000 7fb866636700 1 -- 172.21.15.60:0/2289944532 wait complete. 2020-10-31T22:43:09.698 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2020-10-31T22:43:09.708 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:43:09.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ae93c700 1 Processor -- start 2020-10-31T22:43:09.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ae93c700 1 -- start start 2020-10-31T22:43:09.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ae93c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff1a80b0e20 0x7ff1a80ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ae93c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1a80b5060 0x7ff1a81412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ae93c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a80acc50 con 0x7ff1a80ac870 2020-10-31T22:43:09.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ae93c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a80b5490 con 0x7ff1a80b0e20 2020-10-31T22:43:09.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ae93c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80b14c0 con 0x7ff1a80b5060 2020-10-31T22:43:09.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ad93a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff1a80ac870 0x7ff1a80ae1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47452/0 (socket says 172.21.15.60:47452) 2020-10-31T22:43:09.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ad93a700 1 -- 172.21.15.60:0/3775772153 learned_addr learned my addr 172.21.15.60:0/3775772153 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:09.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ae13b700 1 --2- 172.21.15.60:0/3775772153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1a80b5060 0x7ff1a81412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ad139700 1 --2- 172.21.15.60:0/3775772153 >> v2:172.21.15.66:3300/0 conn(0x7ff1a80b0e20 0x7ff1a80ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 -- 172.21.15.60:0/3775772153 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 653382832 0 0) 0x7ff1a80acc50 con 0x7ff1a80ac870 2020-10-31T22:43:09.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 -- 172.21.15.60:0/3775772153 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff18c003230 con 0x7ff1a80ac870 2020-10-31T22:43:09.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 -- 172.21.15.60:0/3775772153 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3470633376 0 0) 0x7ff18c003230 con 0x7ff1a80ac870 2020-10-31T22:43:09.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 -- 172.21.15.60:0/3775772153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1a80b5060 msgr2=0x7ff1a81412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:09.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 --2- 172.21.15.60:0/3775772153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1a80b5060 0x7ff1a81412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 -- 172.21.15.60:0/3775772153 >> v2:172.21.15.66:3300/0 conn(0x7ff1a80b0e20 msgr2=0x7ff1a80ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:09.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 --2- 172.21.15.60:0/3775772153 >> v2:172.21.15.66:3300/0 conn(0x7ff1a80b0e20 0x7ff1a80ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 -- 172.21.15.60:0/3775772153 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a80b5690 con 0x7ff1a80ac870 2020-10-31T22:43:09.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 -- 172.21.15.60:0/3775772153 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7ff1a4001a50 con 0x7ff1a80ac870 2020-10-31T22:43:09.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 -- 172.21.15.60:0/3775772153 >> v1:172.21.15.60:6789/0 conn(0x7ff1a80ac870 legacy=0x7ff1a80ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 --2- 172.21.15.60:0/3775772153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff18c0037a0 0x7ff18c003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 --2- 172.21.15.60:0/3775772153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1a80b5060 0x7ff18c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 --2- 172.21.15.60:0/3775772153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff18c0049c0 0x7ff18c004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 -- 172.21.15.60:0/3775772153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80b5490 con 0x7ff18c0037a0 2020-10-31T22:43:09.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 -- 172.21.15.60:0/3775772153 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80b14c0 con 0x7ff18c0049c0 2020-10-31T22:43:09.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ac938700 1 -- 172.21.15.60:0/3775772153 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c004290 con 0x7ff1a80b5060 2020-10-31T22:43:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ad93a700 1 --2- 172.21.15.60:0/3775772153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff18c0037a0 0x7ff18c003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ae13b700 1 --2- 172.21.15.60:0/3775772153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff18c0049c0 0x7ff18c004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.819+0000 7ff1ad139700 1 --2- 172.21.15.60:0/3775772153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1a80b5060 0x7ff18c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ad93a700 1 -- 172.21.15.60:0/3775772153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1a80b5060 msgr2=0x7ff18c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ad93a700 1 --2- 172.21.15.60:0/3775772153 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1a80b5060 0x7ff18c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ad93a700 1 -- 172.21.15.60:0/3775772153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff18c0049c0 msgr2=0x7ff18c004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ad93a700 1 --2- 172.21.15.60:0/3775772153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff18c0049c0 0x7ff18c004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ad93a700 1 -- 172.21.15.60:0/3775772153 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c003230 con 0x7ff18c0037a0 2020-10-31T22:43:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ad93a700 1 --2- 172.21.15.60:0/3775772153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff18c0037a0 0x7ff18c003bc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7ff1a4001760 tx=0x7ff1a40021d0).ready entity=mon.0 client_cookie=2f5ee6464145161f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ac938700 1 -- 172.21.15.60:0/3775772153 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1a4005b70 con 0x7ff18c0037a0 2020-10-31T22:43:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ac938700 1 -- 172.21.15.60:0/3775772153 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a4005cd0 con 0x7ff18c0037a0 2020-10-31T22:43:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ac938700 1 -- 172.21.15.60:0/3775772153 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1a40072c0 con 0x7ff18c0037a0 2020-10-31T22:43:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ae93c700 1 -- 172.21.15.60:0/3775772153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff18c0037a0 msgr2=0x7ff18c003bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ae93c700 1 --2- 172.21.15.60:0/3775772153 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff18c0037a0 0x7ff18c003bc0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7ff1a4001760 tx=0x7ff1a40021d0).stop 2020-10-31T22:43:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ae13b700 1 -- 172.21.15.60:0/3775772153 reap_dead start 2020-10-31T22:43:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ae93c700 1 -- 172.21.15.60:0/3775772153 shutdown_connections 2020-10-31T22:43:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ae93c700 1 -- 172.21.15.60:0/3775772153 >> 172.21.15.60:0/3775772153 conn(0x7ff1a806a600 msgr2=0x7ff1a8060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ae93c700 1 -- 172.21.15.60:0/3775772153 shutdown_connections 2020-10-31T22:43:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.823+0000 7ff1ae93c700 1 -- 172.21.15.60:0/3775772153 wait complete. 2020-10-31T22:43:09.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae93c700 1 Processor -- start 2020-10-31T22:43:09.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae93c700 1 -- start start 2020-10-31T22:43:09.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae93c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1a8063ab0 0x7ff1a8151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae93c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1a8066100 0x7ff1a814f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae93c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8067210 0x7ff1a8146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae93c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a814e7c0 con 0x7ff1a8067210 2020-10-31T22:43:09.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae93c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a80668b0 con 0x7ff1a8066100 2020-10-31T22:43:09.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae93c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a8063e90 con 0x7ff1a8063ab0 2020-10-31T22:43:09.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae13b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8067210 0x7ff1a8146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae13b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8067210 0x7ff1a8146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43332/0 (socket says 172.21.15.60:43332) 2020-10-31T22:43:09.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae13b700 1 -- 172.21.15.60:0/2438114272 learned_addr learned my addr 172.21.15.60:0/2438114272 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:09.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ad139700 1 --2- 172.21.15.60:0/2438114272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1a8066100 0x7ff1a814f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ad93a700 1 --2- 172.21.15.60:0/2438114272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1a8063ab0 0x7ff1a8151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae13b700 1 -- 172.21.15.60:0/2438114272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1a8063ab0 msgr2=0x7ff1a8151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae13b700 1 --2- 172.21.15.60:0/2438114272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1a8063ab0 0x7ff1a8151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae13b700 1 -- 172.21.15.60:0/2438114272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1a8066100 msgr2=0x7ff1a814f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae13b700 1 --2- 172.21.15.60:0/2438114272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1a8066100 0x7ff1a814f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae13b700 1 -- 172.21.15.60:0/2438114272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a814e9b0 con 0x7ff1a8067210 2020-10-31T22:43:09.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae13b700 1 --2- 172.21.15.60:0/2438114272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8067210 0x7ff1a8146380 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7ff1a8065ec0 tx=0x7ff1a0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:09.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff19effd700 1 -- 172.21.15.60:0/2438114272 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1a0018070 con 0x7ff1a8067210 2020-10-31T22:43:09.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff19effd700 1 -- 172.21.15.60:0/2438114272 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1a0013750 con 0x7ff1a8067210 2020-10-31T22:43:09.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae93c700 1 -- 172.21.15.60:0/2438114272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a8066610 con 0x7ff1a8067210 2020-10-31T22:43:09.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff19effd700 1 -- 172.21.15.60:0/2438114272 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1a0013ab0 con 0x7ff1a8067210 2020-10-31T22:43:09.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.827+0000 7ff1ae93c700 1 -- 172.21.15.60:0/2438114272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a8144e10 con 0x7ff1a8067210 2020-10-31T22:43:09.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.831+0000 7ff19effd700 1 -- 172.21.15.60:0/2438114272 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff1a0013c10 con 0x7ff1a8067210 2020-10-31T22:43:09.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.831+0000 7ff1ae93c700 1 -- 172.21.15.60:0/2438114272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a8057100 con 0x7ff1a8067210 2020-10-31T22:43:09.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.831+0000 7ff19effd700 1 --2- 172.21.15.60:0/2438114272 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff190055020 0x7ff1900574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:09.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.831+0000 7ff19effd700 1 -- 172.21.15.60:0/2438114272 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff1a006db20 con 0x7ff1a8067210 2020-10-31T22:43:09.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.831+0000 7ff1ad93a700 1 --2- 172.21.15.60:0/2438114272 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff190055020 0x7ff1900574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:09.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.831+0000 7ff1ad93a700 1 --2- 172.21.15.60:0/2438114272 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff190055020 0x7ff1900574e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7ff1a4018000 tx=0x7ff1a4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:09.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.839+0000 7ff19effd700 1 -- 172.21.15.60:0/2438114272 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff1a0044040 con 0x7ff1a8067210 2020-10-31T22:43:09.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.979+0000 7ff1ae93c700 1 -- 172.21.15.60:0/2438114272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1a80b0250 con 0x7ff1a8067210 2020-10-31T22:43:09.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.983+0000 7ff19effd700 1 -- 172.21.15.60:0/2438114272 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16038 (secure 0 0 0) 0x7ff1a0047660 con 0x7ff1a8067210 2020-10-31T22:43:09.985 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:09.985 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":44,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:43:09.336217+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:43:06.097368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-10-31T22:43:07.332204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:43:09.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.983+0000 7ff1ae93c700 1 -- 172.21.15.60:0/2438114272 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff190055020 msgr2=0x7ff1900574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.983+0000 7ff1ae93c700 1 --2- 172.21.15.60:0/2438114272 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff190055020 0x7ff1900574e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7ff1a4018000 tx=0x7ff1a4015000).stop 2020-10-31T22:43:09.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.983+0000 7ff1ae93c700 1 -- 172.21.15.60:0/2438114272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8067210 msgr2=0x7ff1a8146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:09.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.983+0000 7ff1ae93c700 1 --2- 172.21.15.60:0/2438114272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8067210 0x7ff1a8146380 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7ff1a8065ec0 tx=0x7ff1a0008040).stop 2020-10-31T22:43:09.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.983+0000 7ff1ae93c700 1 -- 172.21.15.60:0/2438114272 shutdown_connections 2020-10-31T22:43:09.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.983+0000 7ff1ae93c700 1 --2- 172.21.15.60:0/2438114272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1a8067210 0x7ff1a8146380 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.983+0000 7ff1ae93c700 1 --2- 172.21.15.60:0/2438114272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1a8063ab0 0x7ff1a8151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.983+0000 7ff1ae93c700 1 --2- 172.21.15.60:0/2438114272 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff190055020 0x7ff1900574e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.983+0000 7ff1ae93c700 1 --2- 172.21.15.60:0/2438114272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1a8066100 0x7ff1a814f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.983+0000 7ff1ae93c700 1 -- 172.21.15.60:0/2438114272 >> 172.21.15.60:0/2438114272 conn(0x7ff1a806a600 msgr2=0x7ff1a80b20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.983+0000 7ff1ae93c700 1 -- 172.21.15.60:0/2438114272 shutdown_connections 2020-10-31T22:43:09.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:09.983+0000 7ff1ae93c700 1 -- 172.21.15.60:0/2438114272 wait complete. 2020-10-31T22:43:10.000 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:43:10.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.115+0000 7fa771399700 1 Processor -- start 2020-10-31T22:43:10.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.115+0000 7fa771399700 1 -- start start 2020-10-31T22:43:10.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa76c0b1570 0x7fa76c024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa76c025480 0x7fa76c07fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa76c0801c0 0x7fa76c0afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76c0b1950 con 0x7fa76c025480 2020-10-31T22:43:10.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76c025910 con 0x7fa76c0b1570 2020-10-31T22:43:10.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c062720 con 0x7fa76c0801c0 2020-10-31T22:43:10.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa76bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa76c025480 0x7fa76c07fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa76bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa76c025480 0x7fa76c07fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43336/0 (socket says 172.21.15.60:43336) 2020-10-31T22:43:10.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa76bfff700 1 -- 172.21.15.60:0/369302474 learned_addr learned my addr 172.21.15.60:0/369302474 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:10.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa770b98700 1 --2- 172.21.15.60:0/369302474 >> v2:172.21.15.66:3300/0 conn(0x7fa76c0b1570 0x7fa76c024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa7725fb700 1 --2- 172.21.15.60:0/369302474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa76c0801c0 0x7fa76c0afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa76bfff700 1 -- 172.21.15.60:0/369302474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa76c0801c0 msgr2=0x7fa76c0afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:10.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa76bfff700 1 --2- 172.21.15.60:0/369302474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa76c0801c0 0x7fa76c0afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa76bfff700 1 -- 172.21.15.60:0/369302474 >> v2:172.21.15.66:3300/0 conn(0x7fa76c0b1570 msgr2=0x7fa76c024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:10.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa76bfff700 1 --2- 172.21.15.60:0/369302474 >> v2:172.21.15.66:3300/0 conn(0x7fa76c0b1570 0x7fa76c024f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa76bfff700 1 -- 172.21.15.60:0/369302474 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c066cb0 con 0x7fa76c025480 2020-10-31T22:43:10.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa76bfff700 1 --2- 172.21.15.60:0/369302474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c025480 0x7fa76c07fcd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fa754002f30 tx=0x7fa754006e80).ready entity=mon.0 client_cookie=1f6b1175dee2cffd server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:10.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa76b7fe700 1 -- 172.21.15.60:0/369302474 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7540097f0 con 0x7fa76c025480 2020-10-31T22:43:10.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa76b7fe700 1 -- 172.21.15.60:0/369302474 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa754009950 con 0x7fa76c025480 2020-10-31T22:43:10.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa76b7fe700 1 -- 172.21.15.60:0/369302474 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa754009cb0 con 0x7fa76c025480 2020-10-31T22:43:10.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 -- 172.21.15.60:0/369302474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c025480 msgr2=0x7fa76c07fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 --2- 172.21.15.60:0/369302474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c025480 0x7fa76c07fcd0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fa754002f30 tx=0x7fa754006e80).stop 2020-10-31T22:43:10.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 -- 172.21.15.60:0/369302474 shutdown_connections 2020-10-31T22:43:10.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 --2- 172.21.15.60:0/369302474 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa76c0801c0 0x7fa76c0afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 --2- 172.21.15.60:0/369302474 >> v2:172.21.15.66:3300/0 conn(0x7fa76c0b1570 0x7fa76c024f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 --2- 172.21.15.60:0/369302474 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c025480 0x7fa76c07fcd0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 -- 172.21.15.60:0/369302474 >> 172.21.15.60:0/369302474 conn(0x7fa76c0b5440 msgr2=0x7fa76c0b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:10.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 -- 172.21.15.60:0/369302474 shutdown_connections 2020-10-31T22:43:10.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.119+0000 7fa771399700 1 -- 172.21.15.60:0/369302474 wait complete. 2020-10-31T22:43:10.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa771399700 1 Processor -- start 2020-10-31T22:43:10.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa771399700 1 -- start start 2020-10-31T22:43:10.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa771399700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c025480 0x7fa76c12e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa771399700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa76c0801c0 0x7fa76c07f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa771399700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa76c0b1570 0x7fa76c07dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa771399700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c13cde0 con 0x7fa76c025480 2020-10-31T22:43:10.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa771399700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c13d080 con 0x7fa76c0b1570 2020-10-31T22:43:10.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa771399700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c13d320 con 0x7fa76c0801c0 2020-10-31T22:43:10.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa770b98700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c025480 0x7fa76c12e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa770b98700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c025480 0x7fa76c12e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43342/0 (socket says 172.21.15.60:43342) 2020-10-31T22:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa770b98700 1 -- 172.21.15.60:0/592100703 learned_addr learned my addr 172.21.15.60:0/592100703 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa76bfff700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa76c0801c0 0x7fa76c07f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa7725fb700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa76c0b1570 0x7fa76c07dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa770b98700 1 -- 172.21.15.60:0/592100703 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa76c0801c0 msgr2=0x7fa76c07f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa770b98700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa76c0801c0 0x7fa76c07f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa770b98700 1 -- 172.21.15.60:0/592100703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa76c0b1570 msgr2=0x7fa76c07dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa770b98700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa76c0b1570 0x7fa76c07dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa770b98700 1 -- 172.21.15.60:0/592100703 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c13cb10 con 0x7fa76c025480 2020-10-31T22:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa7725fb700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa76c0b1570 0x7fa76c07dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa770b98700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c025480 0x7fa76c12e910 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fa75c0033f0 tx=0x7fa75c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa7697fa700 1 -- 172.21.15.60:0/592100703 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa75c00bad0 con 0x7fa76c025480 2020-10-31T22:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa7697fa700 1 -- 172.21.15.60:0/592100703 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75c00bc30 con 0x7fa76c025480 2020-10-31T22:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa7697fa700 1 -- 172.21.15.60:0/592100703 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa75c012420 con 0x7fa76c025480 2020-10-31T22:43:10.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa771399700 1 -- 172.21.15.60:0/592100703 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76c12ee00 con 0x7fa76c025480 2020-10-31T22:43:10.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.123+0000 7fa771399700 1 -- 172.21.15.60:0/592100703 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c07fd80 con 0x7fa76c025480 2020-10-31T22:43:10.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.127+0000 7fa7697fa700 1 -- 172.21.15.60:0/592100703 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa75c012580 con 0x7fa76c025480 2020-10-31T22:43:10.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.127+0000 7fa771399700 1 -- 172.21.15.60:0/592100703 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76c13d4e0 con 0x7fa76c025480 2020-10-31T22:43:10.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.127+0000 7fa7697fa700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa750054f00 0x7fa7500573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.127+0000 7fa7697fa700 1 -- 172.21.15.60:0/592100703 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa75c06e0b0 con 0x7fa76c025480 2020-10-31T22:43:10.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.127+0000 7fa76bfff700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa750054f00 0x7fa7500573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.127+0000 7fa76bfff700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa750054f00 0x7fa7500573c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fa75401c000 tx=0x7fa754015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:10.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.139+0000 7fa7697fa700 1 -- 172.21.15.60:0/592100703 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa75c044570 con 0x7fa76c025480 2020-10-31T22:43:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.331+0000 7fa771399700 1 -- 172.21.15.60:0/592100703 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fa76c057100 con 0x7fa76c025480 2020-10-31T22:43:10.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.339+0000 7fa7697fa700 1 -- 172.21.15.60:0/592100703 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7fa75c047b90 con 0x7fa76c025480 2020-10-31T22:43:10.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.343+0000 7fa771399700 1 -- 172.21.15.60:0/592100703 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa750054f00 msgr2=0x7fa7500573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.343+0000 7fa771399700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa750054f00 0x7fa7500573c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fa75401c000 tx=0x7fa754015000).stop 2020-10-31T22:43:10.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.343+0000 7fa771399700 1 -- 172.21.15.60:0/592100703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c025480 msgr2=0x7fa76c12e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.343+0000 7fa771399700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c025480 0x7fa76c12e910 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fa75c0033f0 tx=0x7fa75c008040).stop 2020-10-31T22:43:10.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.343+0000 7fa771399700 1 -- 172.21.15.60:0/592100703 shutdown_connections 2020-10-31T22:43:10.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.343+0000 7fa771399700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa750054f00 0x7fa7500573c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.343+0000 7fa771399700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa76c0b1570 0x7fa76c07dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.343+0000 7fa771399700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa76c025480 0x7fa76c12e910 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.343+0000 7fa771399700 1 --2- 172.21.15.60:0/592100703 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa76c0801c0 0x7fa76c07f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.343+0000 7fa771399700 1 -- 172.21.15.60:0/592100703 >> 172.21.15.60:0/592100703 conn(0x7fa76c0b5440 msgr2=0x7fa76c0ad650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:10.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.343+0000 7fa771399700 1 -- 172.21.15.60:0/592100703 shutdown_connections 2020-10-31T22:43:10.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.343+0000 7fa771399700 1 -- 172.21.15.60:0/592100703 wait complete. 2020-10-31T22:43:10.354 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2020-10-31T22:43:10.367 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:43:10.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.491+0000 7f70e67dd700 1 Processor -- start 2020-10-31T22:43:10.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.491+0000 7f70e67dd700 1 -- start start 2020-10-31T22:43:10.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.491+0000 7f70e67dd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f70e00256a0 0x7f70e007fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.491+0000 7f70e67dd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f70e00801c0 0x7f70e0159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.491+0000 7f70e67dd700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e00b1950 con 0x7f70e00b1570 2020-10-31T22:43:10.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.491+0000 7f70e67dd700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e0062720 con 0x7f70e00801c0 2020-10-31T22:43:10.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.491+0000 7f70e67dd700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e0066cb0 con 0x7f70e00256a0 2020-10-31T22:43:10.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.491+0000 7f70e7a3f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f70e00801c0 0x7f70e0159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.491+0000 7f70e7a3f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f70e00801c0 0x7f70e0159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43354/0 (socket says 172.21.15.60:43354) 2020-10-31T22:43:10.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.491+0000 7f70e7a3f700 1 -- 172.21.15.60:0/1102974254 learned_addr learned my addr 172.21.15.60:0/1102974254 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:10.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.491+0000 7f70e57db700 1 --2- 172.21.15.60:0/1102974254 >> v2:172.21.15.66:3300/0 conn(0x7f70e00256a0 0x7f70e007fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e7a3f700 1 -- 172.21.15.60:0/1102974254 >> v2:172.21.15.66:3300/0 conn(0x7f70e00256a0 msgr2=0x7f70e007fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:10.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e7a3f700 1 --2- 172.21.15.60:0/1102974254 >> v2:172.21.15.66:3300/0 conn(0x7f70e00256a0 0x7f70e007fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e7a3f700 1 -- 172.21.15.60:0/1102974254 >> v1:172.21.15.66:6789/0 conn(0x7f70e00b1570 legacy=0x7f70e0024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e7a3f700 1 -- 172.21.15.60:0/1102974254 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e00aca00 con 0x7f70e00801c0 2020-10-31T22:43:10.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e7a3f700 1 --2- 172.21.15.60:0/1102974254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70e00801c0 0x7f70e0159210 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f70d80032b0 tx=0x7f70d8009270).ready entity=mon.0 client_cookie=5aef14aba0b16198 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:10.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e4fda700 1 -- 172.21.15.60:0/1102974254 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70d8009e60 con 0x7f70e00801c0 2020-10-31T22:43:10.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e4fda700 1 -- 172.21.15.60:0/1102974254 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d800bc00 con 0x7f70e00801c0 2020-10-31T22:43:10.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e4fda700 1 -- 172.21.15.60:0/1102974254 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70d800bd70 con 0x7f70e00801c0 2020-10-31T22:43:10.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e67dd700 1 -- 172.21.15.60:0/1102974254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70e00801c0 msgr2=0x7f70e0159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e67dd700 1 --2- 172.21.15.60:0/1102974254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70e00801c0 0x7f70e0159210 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f70d80032b0 tx=0x7f70d8009270).stop 2020-10-31T22:43:10.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e67dd700 1 -- 172.21.15.60:0/1102974254 shutdown_connections 2020-10-31T22:43:10.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e67dd700 1 --2- 172.21.15.60:0/1102974254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70e00801c0 0x7f70e0159210 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e67dd700 1 --2- 172.21.15.60:0/1102974254 >> v2:172.21.15.66:3300/0 conn(0x7f70e00256a0 0x7f70e007fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e67dd700 1 -- 172.21.15.60:0/1102974254 >> 172.21.15.60:0/1102974254 conn(0x7f70e00b5440 msgr2=0x7f70e00b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:10.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e67dd700 1 -- 172.21.15.60:0/1102974254 shutdown_connections 2020-10-31T22:43:10.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e67dd700 1 -- 172.21.15.60:0/1102974254 wait complete. 2020-10-31T22:43:10.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.495+0000 7f70e67dd700 1 Processor -- start 2020-10-31T22:43:10.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e67dd700 1 -- start start 2020-10-31T22:43:10.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e67dd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e00256a0 0x7f70e013d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e67dd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70e00801c0 0x7f70e00aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e67dd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70e00b1570 0x7f70e009ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e67dd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00a9090 con 0x7f70e00801c0 2020-10-31T22:43:10.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e67dd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e00a7cc0 con 0x7f70e00256a0 2020-10-31T22:43:10.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e67dd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e013cc60 con 0x7f70e00b1570 2020-10-31T22:43:10.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e57db700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70e00801c0 0x7f70e00aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e57db700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70e00801c0 0x7f70e00aa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43356/0 (socket says 172.21.15.60:43356) 2020-10-31T22:43:10.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e57db700 1 -- 172.21.15.60:0/22426594 learned_addr learned my addr 172.21.15.60:0/22426594 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:10.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e7a3f700 1 --2- 172.21.15.60:0/22426594 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70e00b1570 0x7f70e009ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e5fdc700 1 --2- 172.21.15.60:0/22426594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e00256a0 0x7f70e013d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e57db700 1 -- 172.21.15.60:0/22426594 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70e00b1570 msgr2=0x7f70e009ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e57db700 1 --2- 172.21.15.60:0/22426594 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70e00b1570 0x7f70e009ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e57db700 1 -- 172.21.15.60:0/22426594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e00256a0 msgr2=0x7f70e013d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e57db700 1 --2- 172.21.15.60:0/22426594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e00256a0 0x7f70e013d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e57db700 1 -- 172.21.15.60:0/22426594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e013cf00 con 0x7f70e00801c0 2020-10-31T22:43:10.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e57db700 1 --2- 172.21.15.60:0/22426594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70e00801c0 0x7f70e00aa3d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f70d000c000 tx=0x7f70d0006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:10.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70d67fc700 1 -- 172.21.15.60:0/22426594 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70d000cae0 con 0x7f70e00801c0 2020-10-31T22:43:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70d67fc700 1 -- 172.21.15.60:0/22426594 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d000cc40 con 0x7f70e00801c0 2020-10-31T22:43:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70d67fc700 1 -- 172.21.15.60:0/22426594 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f70d00123f0 con 0x7f70e00801c0 2020-10-31T22:43:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e67dd700 1 -- 172.21.15.60:0/22426594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e013d1a0 con 0x7f70e00801c0 2020-10-31T22:43:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e67dd700 1 -- 172.21.15.60:0/22426594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e00aa8c0 con 0x7f70e00801c0 2020-10-31T22:43:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.499+0000 7f70e67dd700 1 -- 172.21.15.60:0/22426594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e013d330 con 0x7f70e00801c0 2020-10-31T22:43:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.503+0000 7f70d67fc700 1 -- 172.21.15.60:0/22426594 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f70d0012550 con 0x7f70e00801c0 2020-10-31T22:43:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.503+0000 7f70d67fc700 1 --2- 172.21.15.60:0/22426594 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f70c8054f00 0x7f70c80573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.503+0000 7f70d67fc700 1 -- 172.21.15.60:0/22426594 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f70d006de70 con 0x7f70e00801c0 2020-10-31T22:43:10.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.503+0000 7f70e5fdc700 1 --2- 172.21.15.60:0/22426594 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f70c8054f00 0x7f70c80573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.503+0000 7f70e5fdc700 1 --2- 172.21.15.60:0/22426594 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f70c8054f00 0x7f70c80573c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f70dc00b000 tx=0x7f70dc009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:10.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.507+0000 7f70d67fc700 1 -- 172.21.15.60:0/22426594 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f70d0044330 con 0x7f70e00801c0 2020-10-31T22:43:10.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.699+0000 7f70e67dd700 1 -- 172.21.15.60:0/22426594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f70e0057100 con 0x7f70e00801c0 2020-10-31T22:43:10.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.707+0000 7f70d67fc700 1 -- 172.21.15.60:0/22426594 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v14) v1 ==== 184+0+0 (secure 0 0 0) 0x7f70d0047950 con 0x7f70e00801c0 2020-10-31T22:43:10.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.711+0000 7f70e67dd700 1 -- 172.21.15.60:0/22426594 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f70c8054f00 msgr2=0x7f70c80573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.711+0000 7f70e67dd700 1 --2- 172.21.15.60:0/22426594 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f70c8054f00 0x7f70c80573c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f70dc00b000 tx=0x7f70dc009040).stop 2020-10-31T22:43:10.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.711+0000 7f70e67dd700 1 -- 172.21.15.60:0/22426594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70e00801c0 msgr2=0x7f70e00aa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.711+0000 7f70e67dd700 1 --2- 172.21.15.60:0/22426594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70e00801c0 0x7f70e00aa3d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f70d000c000 tx=0x7f70d0006dc0).stop 2020-10-31T22:43:10.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.711+0000 7f70e67dd700 1 -- 172.21.15.60:0/22426594 shutdown_connections 2020-10-31T22:43:10.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.711+0000 7f70e67dd700 1 --2- 172.21.15.60:0/22426594 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70e00b1570 0x7f70e009ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.711+0000 7f70e67dd700 1 --2- 172.21.15.60:0/22426594 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f70c8054f00 0x7f70c80573c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.711+0000 7f70e67dd700 1 --2- 172.21.15.60:0/22426594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70e00256a0 0x7f70e013d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.711+0000 7f70e67dd700 1 --2- 172.21.15.60:0/22426594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70e00801c0 0x7f70e00aa3d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.711+0000 7f70e67dd700 1 -- 172.21.15.60:0/22426594 >> 172.21.15.60:0/22426594 conn(0x7f70e00b5440 msgr2=0x7f70e00ad5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.711+0000 7f70e67dd700 1 -- 172.21.15.60:0/22426594 shutdown_connections 2020-10-31T22:43:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.711+0000 7f70e67dd700 1 -- 172.21.15.60:0/22426594 wait complete. 2020-10-31T22:43:10.719 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.1 2020-10-31T22:43:10.730 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:43:10.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 Processor -- start 2020-10-31T22:43:10.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 -- start start 2020-10-31T22:43:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa65c0af520 0x7fa65c0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa65c066c90 0x7fa65c0670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa65c0af900 con 0x7fa65c146060 2020-10-31T22:43:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa65c0afc10 con 0x7fa65c0af520 2020-10-31T22:43:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c05bb70 con 0x7fa65c066c90 2020-10-31T22:43:10.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa661171700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa65c0af520 0x7fa65c0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa661972700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa65c146060 0x7fa65c149620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47504/0 (socket says 172.21.15.60:47504) 2020-10-31T22:43:10.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa661972700 1 -- 172.21.15.60:0/2953555635 learned_addr learned my addr 172.21.15.60:0/2953555635 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:10.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa660970700 1 --2- 172.21.15.60:0/2953555635 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa65c066c90 0x7fa65c0670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa65bfff700 1 -- 172.21.15.60:0/2953555635 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857015640 0 0) 0x7fa65c0af900 con 0x7fa65c146060 2020-10-31T22:43:10.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa661171700 1 -- 172.21.15.60:0/2953555635 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa65c066c90 msgr2=0x7fa65c0670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:10.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa661171700 1 --2- 172.21.15.60:0/2953555635 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa65c066c90 0x7fa65c0670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa661171700 1 -- 172.21.15.60:0/2953555635 >> v1:172.21.15.60:6789/0 conn(0x7fa65c146060 legacy=0x7fa65c149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa661171700 1 -- 172.21.15.60:0/2953555635 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c0ac130 con 0x7fa65c0af520 2020-10-31T22:43:10.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa661171700 1 --2- 172.21.15.60:0/2953555635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c0af520 0x7fa65c0ac870 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fa64c0032b0 tx=0x7fa64c0091a0).ready entity=mon.0 client_cookie=11a079e436c33ba3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:10.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa65bfff700 1 -- 172.21.15.60:0/2953555635 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa64c00b9a0 con 0x7fa65c0af520 2020-10-31T22:43:10.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa65bfff700 1 -- 172.21.15.60:0/2953555635 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c00bb00 con 0x7fa65c0af520 2020-10-31T22:43:10.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa65bfff700 1 -- 172.21.15.60:0/2953555635 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa64c00bc70 con 0x7fa65c0af520 2020-10-31T22:43:10.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 -- 172.21.15.60:0/2953555635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c0af520 msgr2=0x7fa65c0ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 --2- 172.21.15.60:0/2953555635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c0af520 0x7fa65c0ac870 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7fa64c0032b0 tx=0x7fa64c0091a0).stop 2020-10-31T22:43:10.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 -- 172.21.15.60:0/2953555635 shutdown_connections 2020-10-31T22:43:10.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 --2- 172.21.15.60:0/2953555635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c0af520 0x7fa65c0ac870 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 --2- 172.21.15.60:0/2953555635 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa65c066c90 0x7fa65c0670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 -- 172.21.15.60:0/2953555635 >> 172.21.15.60:0/2953555635 conn(0x7fa65c0b3fd0 msgr2=0x7fa65c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:10.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 -- 172.21.15.60:0/2953555635 shutdown_connections 2020-10-31T22:43:10.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.839+0000 7fa662173700 1 -- 172.21.15.60:0/2953555635 wait complete. 2020-10-31T22:43:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.843+0000 7fa662173700 1 Processor -- start 2020-10-31T22:43:10.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.843+0000 7fa662173700 1 -- start start 2020-10-31T22:43:10.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.843+0000 7fa662173700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c066c90 0x7fa65c1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.843+0000 7fa662173700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa65c0af520 0x7fa65c0a9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.843+0000 7fa662173700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa65c146060 0x7fa65c0a9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.843+0000 7fa662173700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c0a8c50 con 0x7fa65c066c90 2020-10-31T22:43:10.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.843+0000 7fa662173700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c1478b0 con 0x7fa65c146060 2020-10-31T22:43:10.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.843+0000 7fa662173700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c147b50 con 0x7fa65c0af520 2020-10-31T22:43:10.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.843+0000 7fa661171700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c066c90 0x7fa65c1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa661171700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c066c90 0x7fa65c1415f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43370/0 (socket says 172.21.15.60:43370) 2020-10-31T22:43:10.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa661171700 1 -- 172.21.15.60:0/1918717405 learned_addr learned my addr 172.21.15.60:0/1918717405 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:10.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa660970700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa65c0af520 0x7fa65c0a9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa661972700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa65c146060 0x7fa65c0a9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa661171700 1 -- 172.21.15.60:0/1918717405 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa65c0af520 msgr2=0x7fa65c0a9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa661171700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa65c0af520 0x7fa65c0a9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa661171700 1 -- 172.21.15.60:0/1918717405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa65c146060 msgr2=0x7fa65c0a9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:10.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa661171700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa65c146060 0x7fa65c0a9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:10.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa661171700 1 -- 172.21.15.60:0/1918717405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c147df0 con 0x7fa65c066c90 2020-10-31T22:43:10.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa660970700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa65c0af520 0x7fa65c0a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:43:10.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa661972700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa65c146060 0x7fa65c0a9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:43:10.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa661171700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c066c90 0x7fa65c1415f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fa64c0032b0 tx=0x7fa64c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:10.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa65a7fc700 1 -- 172.21.15.60:0/1918717405 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa64c00bc70 con 0x7fa65c066c90 2020-10-31T22:43:10.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa65a7fc700 1 -- 172.21.15.60:0/1918717405 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64c01f5e0 con 0x7fa65c066c90 2020-10-31T22:43:10.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa662173700 1 -- 172.21.15.60:0/1918717405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c141ae0 con 0x7fa65c066c90 2020-10-31T22:43:10.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa65a7fc700 1 -- 172.21.15.60:0/1918717405 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa64c01f940 con 0x7fa65c066c90 2020-10-31T22:43:10.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa662173700 1 -- 172.21.15.60:0/1918717405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c147530 con 0x7fa65c066c90 2020-10-31T22:43:10.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa662173700 1 -- 172.21.15.60:0/1918717405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c057100 con 0x7fa65c066c90 2020-10-31T22:43:10.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa65a7fc700 1 -- 172.21.15.60:0/1918717405 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa64c026030 con 0x7fa65c066c90 2020-10-31T22:43:10.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa65a7fc700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa63c054f30 0x7fa63c0573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:10.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa65a7fc700 1 -- 172.21.15.60:0/1918717405 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa64c06e830 con 0x7fa65c066c90 2020-10-31T22:43:10.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa660970700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa63c054f30 0x7fa63c0573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:10.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.847+0000 7fa660970700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa63c054f30 0x7fa63c0573f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fa65000b000 tx=0x7fa650008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:10.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:10.855+0000 7fa65a7fc700 1 -- 172.21.15.60:0/1918717405 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa64c044d50 con 0x7fa65c066c90 2020-10-31T22:43:11.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.043+0000 7fa662173700 1 -- 172.21.15.60:0/1918717405 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa65c0a8a30 con 0x7fa65c066c90 2020-10-31T22:43:11.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.043+0000 7fa65a7fc700 1 -- 172.21.15.60:0/1918717405 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2491 (secure 0 0 0) 0x7fa64c0249d0 con 0x7fa65c066c90 2020-10-31T22:43:11.047 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:11.047 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2666662861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2666662861},{"type":"v1","addr":"172.21.15.60:6835","nonce":2666662861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14},{"gid":5193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3622783561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3622783561},{"type":"v1","addr":"172.21.15.66:6833","nonce":3622783561}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:43:08.333596+0000","modified":"2020-10-31T22:43:09.337195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/1627192275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1627192275},{"type":"v1","addr":"172.21.15.60:6837","nonce":1627192275}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-10-31T22:43:11.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.047+0000 7fa662173700 1 -- 172.21.15.60:0/1918717405 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa63c054f30 msgr2=0x7fa63c0573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:11.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.047+0000 7fa662173700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa63c054f30 0x7fa63c0573f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7fa65000b000 tx=0x7fa650008040).stop 2020-10-31T22:43:11.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.047+0000 7fa662173700 1 -- 172.21.15.60:0/1918717405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c066c90 msgr2=0x7fa65c1415f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:11.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.047+0000 7fa662173700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c066c90 0x7fa65c1415f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fa64c0032b0 tx=0x7fa64c016000).stop 2020-10-31T22:43:11.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.047+0000 7fa662173700 1 -- 172.21.15.60:0/1918717405 shutdown_connections 2020-10-31T22:43:11.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.047+0000 7fa662173700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa63c054f30 0x7fa63c0573f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.047+0000 7fa662173700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa65c146060 0x7fa65c0a9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.047+0000 7fa662173700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa65c066c90 0x7fa65c1415f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.047+0000 7fa662173700 1 --2- 172.21.15.60:0/1918717405 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa65c0af520 0x7fa65c0a9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.047+0000 7fa662173700 1 -- 172.21.15.60:0/1918717405 >> 172.21.15.60:0/1918717405 conn(0x7fa65c0b3fd0 msgr2=0x7fa65c0ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:11.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.047+0000 7fa662173700 1 -- 172.21.15.60:0/1918717405 shutdown_connections 2020-10-31T22:43:11.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.047+0000 7fa662173700 1 -- 172.21.15.60:0/1918717405 wait complete. 2020-10-31T22:43:11.050 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2020-10-31T22:43:11.362 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:43:08.333596+0000', 'modified': '2020-10-31T22:43:09.337195+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5199}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5199': {'gid': 5199, 'name': 'c', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/1627192275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 1627192275}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 1627192275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:43:11.363 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:43:11.364 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:43:11.499 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":5199,"want_state":"up:active","state":"up:active","rank_uptime":3.153665857,"mdsmap_epoch":16,"osdmap_epoch":44,"osdmap_epoch_barrier":44,"uptime":8.3651316510000004} 2020-10-31T22:43:11.500 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 5199, "mdsmap_epoch": 16, "osdmap_epoch": 44, "osdmap_epoch_barrier": 44, "rank_uptime": 3.153665857, "state": "up:active", "uptime": 8.365131651, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:43:11.501 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:43:11.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc694110700 1 Processor -- start 2020-10-31T22:43:11.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc694110700 1 -- start start 2020-10-31T22:43:11.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc694110700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc68c0b30c0 0x7fc68c0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:11.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc694110700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc68c060e70 0x7fc68c0b23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:11.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc694110700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc68c0613f0 con 0x7fc68c067440 2020-10-31T22:43:11.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc694110700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc68c0a9ce0 con 0x7fc68c060e70 2020-10-31T22:43:11.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc694110700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c0b34a0 con 0x7fc68c0b30c0 2020-10-31T22:43:11.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc6926ad700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc68c067440 0x7fc68c05afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47514/0 (socket says 172.21.15.60:47514) 2020-10-31T22:43:11.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc6926ad700 1 -- 172.21.15.60:0/1257819114 learned_addr learned my addr 172.21.15.60:0/1257819114 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:11.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc691eac700 1 --2- 172.21.15.60:0/1257819114 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc68c0b30c0 0x7fc68c0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:11.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc6916ab700 1 --2- 172.21.15.60:0/1257819114 >> v2:172.21.15.66:3300/0 conn(0x7fc68c060e70 0x7fc68c0b23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:11.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc690eaa700 1 -- 172.21.15.60:0/1257819114 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984109810 0 0) 0x7fc68c0613f0 con 0x7fc68c067440 2020-10-31T22:43:11.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc690eaa700 1 -- 172.21.15.60:0/1257819114 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc674003230 con 0x7fc68c067440 2020-10-31T22:43:11.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc690eaa700 1 -- 172.21.15.60:0/1257819114 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2435718173 0 0) 0x7fc674003230 con 0x7fc68c067440 2020-10-31T22:43:11.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc691eac700 1 -- 172.21.15.60:0/1257819114 >> v2:172.21.15.66:3300/0 conn(0x7fc68c060e70 msgr2=0x7fc68c0b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:11.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc691eac700 1 --2- 172.21.15.60:0/1257819114 >> v2:172.21.15.66:3300/0 conn(0x7fc68c060e70 0x7fc68c0b23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc691eac700 1 -- 172.21.15.60:0/1257819114 >> v1:172.21.15.60:6789/0 conn(0x7fc68c067440 legacy=0x7fc68c05afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:11.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc691eac700 1 -- 172.21.15.60:0/1257819114 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0b0d30 con 0x7fc68c0b30c0 2020-10-31T22:43:11.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc691eac700 1 --2- 172.21.15.60:0/1257819114 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc68c0b30c0 0x7fc68c0b1ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc684001870 tx=0x7fc6880091a0).ready entity=mon.2 client_cookie=65bb1cbb27cbafa6 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:11.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc690eaa700 1 -- 172.21.15.60:0/1257819114 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc6840016d0 con 0x7fc68c0b30c0 2020-10-31T22:43:11.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc690eaa700 1 -- 172.21.15.60:0/1257819114 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68800b890 con 0x7fc68c0b30c0 2020-10-31T22:43:11.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc694110700 1 -- 172.21.15.60:0/1257819114 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc68c0b30c0 msgr2=0x7fc68c0b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:11.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc690eaa700 1 -- 172.21.15.60:0/1257819114 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc68800ba00 con 0x7fc68c0b30c0 2020-10-31T22:43:11.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.615+0000 7fc694110700 1 --2- 172.21.15.60:0/1257819114 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc68c0b30c0 0x7fc68c0b1ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc684001870 tx=0x7fc6880091a0).stop 2020-10-31T22:43:11.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc694110700 1 -- 172.21.15.60:0/1257819114 shutdown_connections 2020-10-31T22:43:11.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc694110700 1 --2- 172.21.15.60:0/1257819114 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc68c0b30c0 0x7fc68c0b1ee0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc694110700 1 --2- 172.21.15.60:0/1257819114 >> v2:172.21.15.66:3300/0 conn(0x7fc68c060e70 0x7fc68c0b23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc694110700 1 -- 172.21.15.60:0/1257819114 >> 172.21.15.60:0/1257819114 conn(0x7fc68c06a260 msgr2=0x7fc68c063c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:11.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc694110700 1 -- 172.21.15.60:0/1257819114 shutdown_connections 2020-10-31T22:43:11.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc694110700 1 -- 172.21.15.60:0/1257819114 wait complete. 2020-10-31T22:43:11.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc694110700 1 Processor -- start 2020-10-31T22:43:11.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc694110700 1 -- start start 2020-10-31T22:43:11.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc694110700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc68c060e70 0x7fc68c151ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:11.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc694110700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc68c067440 0x7fc68c0b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:11.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc694110700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc68c0b30c0 0x7fc68c154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:11.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc694110700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c150f00 con 0x7fc68c067440 2020-10-31T22:43:11.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc694110700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c1510f0 con 0x7fc68c060e70 2020-10-31T22:43:11.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc694110700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc68c151390 con 0x7fc68c0b30c0 2020-10-31T22:43:11.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc6916ab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc68c067440 0x7fc68c0b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:11.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc6916ab700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc68c067440 0x7fc68c0b5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43386/0 (socket says 172.21.15.60:43386) 2020-10-31T22:43:11.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc6916ab700 1 -- 172.21.15.60:0/2927899183 learned_addr learned my addr 172.21.15.60:0/2927899183 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:11.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc6926ad700 1 --2- 172.21.15.60:0/2927899183 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc68c0b30c0 0x7fc68c154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:11.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.619+0000 7fc691eac700 1 --2- 172.21.15.60:0/2927899183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc68c060e70 0x7fc68c151ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:11.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc6916ab700 1 -- 172.21.15.60:0/2927899183 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc68c0b30c0 msgr2=0x7fc68c154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:11.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc6916ab700 1 --2- 172.21.15.60:0/2927899183 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc68c0b30c0 0x7fc68c154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc6916ab700 1 -- 172.21.15.60:0/2927899183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc68c060e70 msgr2=0x7fc68c151ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:11.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc6916ab700 1 --2- 172.21.15.60:0/2927899183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc68c060e70 0x7fc68c151ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc6916ab700 1 -- 172.21.15.60:0/2927899183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c151630 con 0x7fc68c067440 2020-10-31T22:43:11.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc6916ab700 1 --2- 172.21.15.60:0/2927899183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc68c067440 0x7fc68c0b5af0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fc67c006a50 tx=0x7fc67c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:11.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc67affd700 1 -- 172.21.15.60:0/2927899183 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc67c00ca10 con 0x7fc68c067440 2020-10-31T22:43:11.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc67affd700 1 -- 172.21.15.60:0/2927899183 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc67c00cb70 con 0x7fc68c067440 2020-10-31T22:43:11.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc694110700 1 -- 172.21.15.60:0/2927899183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc68c0ad430 con 0x7fc68c067440 2020-10-31T22:43:11.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc67affd700 1 -- 172.21.15.60:0/2927899183 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc67c0123f0 con 0x7fc68c067440 2020-10-31T22:43:11.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc694110700 1 -- 172.21.15.60:0/2927899183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc68c154b80 con 0x7fc68c067440 2020-10-31T22:43:11.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc694110700 1 -- 172.21.15.60:0/2927899183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68c1517c0 con 0x7fc68c067440 2020-10-31T22:43:11.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc67affd700 1 -- 172.21.15.60:0/2927899183 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc67c012550 con 0x7fc68c067440 2020-10-31T22:43:11.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc67affd700 1 --2- 172.21.15.60:0/2927899183 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc66c055020 0x7fc66c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:11.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc691eac700 1 --2- 172.21.15.60:0/2927899183 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc66c055020 0x7fc66c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:11.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.623+0000 7fc67affd700 1 -- 172.21.15.60:0/2927899183 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc67c06ea20 con 0x7fc68c067440 2020-10-31T22:43:11.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.627+0000 7fc691eac700 1 --2- 172.21.15.60:0/2927899183 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc66c055020 0x7fc66c0574e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fc68801c000 tx=0x7fc688016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:11.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.631+0000 7fc67affd700 1 -- 172.21.15.60:0/2927899183 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc67c044dd0 con 0x7fc68c067440 2020-10-31T22:43:11.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.775+0000 7fc694110700 1 -- 172.21.15.60:0/2927899183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc68c057100 con 0x7fc68c067440 2020-10-31T22:43:11.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.779+0000 7fc67affd700 1 -- 172.21.15.60:0/2927899183 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16038 (secure 0 0 0) 0x7fc67c0483f0 con 0x7fc68c067440 2020-10-31T22:43:11.780 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:11.780 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":44,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:43:09.336217+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:43:06.097368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-10-31T22:43:07.332204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:43:11.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.779+0000 7fc694110700 1 -- 172.21.15.60:0/2927899183 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc66c055020 msgr2=0x7fc66c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:11.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.779+0000 7fc694110700 1 --2- 172.21.15.60:0/2927899183 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc66c055020 0x7fc66c0574e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fc68801c000 tx=0x7fc688016000).stop 2020-10-31T22:43:11.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.779+0000 7fc694110700 1 -- 172.21.15.60:0/2927899183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc68c067440 msgr2=0x7fc68c0b5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:11.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.779+0000 7fc694110700 1 --2- 172.21.15.60:0/2927899183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc68c067440 0x7fc68c0b5af0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fc67c006a50 tx=0x7fc67c006dc0).stop 2020-10-31T22:43:11.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.779+0000 7fc694110700 1 -- 172.21.15.60:0/2927899183 shutdown_connections 2020-10-31T22:43:11.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.779+0000 7fc694110700 1 --2- 172.21.15.60:0/2927899183 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc68c0b30c0 0x7fc68c154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.779+0000 7fc694110700 1 --2- 172.21.15.60:0/2927899183 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc66c055020 0x7fc66c0574e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.779+0000 7fc694110700 1 --2- 172.21.15.60:0/2927899183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc68c060e70 0x7fc68c151ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.779+0000 7fc694110700 1 --2- 172.21.15.60:0/2927899183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc68c067440 0x7fc68c0b5af0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.779+0000 7fc694110700 1 -- 172.21.15.60:0/2927899183 >> 172.21.15.60:0/2927899183 conn(0x7fc68c06a260 msgr2=0x7fc68c05afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:11.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.779+0000 7fc694110700 1 -- 172.21.15.60:0/2927899183 shutdown_connections 2020-10-31T22:43:11.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.779+0000 7fc694110700 1 -- 172.21.15.60:0/2927899183 wait complete. 2020-10-31T22:43:11.793 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:43:06.097368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:43:07.332204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:43:11.794 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:43:11.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.907+0000 7f7edb3ec700 1 Processor -- start 2020-10-31T22:43:11.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.907+0000 7f7edb3ec700 1 -- start start 2020-10-31T22:43:11.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.907+0000 7f7edb3ec700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ed405c660 0x7f7ed40b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:11.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.907+0000 7f7edb3ec700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7ed4065f70 0x7f7ed413f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:11.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.907+0000 7f7edb3ec700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed4066410 con 0x7f7ed413f880 2020-10-31T22:43:11.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.907+0000 7f7edb3ec700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed4066d60 con 0x7f7ed4065f70 2020-10-31T22:43:11.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.907+0000 7f7edb3ec700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40b5e80 con 0x7f7ed405c660 2020-10-31T22:43:11.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.907+0000 7f7ed8987700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7ed4065f70 0x7f7ed413f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:11.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.907+0000 7f7ed9989700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7ed413f880 0x7f7ed4142610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47530/0 (socket says 172.21.15.60:47530) 2020-10-31T22:43:11.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.907+0000 7f7ed9989700 1 -- 172.21.15.60:0/4213797114 learned_addr learned my addr 172.21.15.60:0/4213797114 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:11.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7ed9188700 1 --2- 172.21.15.60:0/4213797114 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ed405c660 0x7f7ed40b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:11.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7ed8987700 1 -- 172.21.15.60:0/4213797114 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ed405c660 msgr2=0x7f7ed40b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:11.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7ed8987700 1 --2- 172.21.15.60:0/4213797114 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ed405c660 0x7f7ed40b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7ed8987700 1 -- 172.21.15.60:0/4213797114 >> v1:172.21.15.60:6789/0 conn(0x7f7ed413f880 legacy=0x7f7ed4142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:11.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7ed8987700 1 -- 172.21.15.60:0/4213797114 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed40666b0 con 0x7f7ed4065f70 2020-10-31T22:43:11.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7ed8987700 1 --2- 172.21.15.60:0/4213797114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed4065f70 0x7f7ed413f390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f7ed40b5fc0 tx=0x7f7ed0006dc0).ready entity=mon.0 client_cookie=f641e3d666a66e3d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:11.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7ecbfff700 1 -- 172.21.15.60:0/4213797114 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed0009720 con 0x7f7ed4065f70 2020-10-31T22:43:11.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7ecbfff700 1 -- 172.21.15.60:0/4213797114 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed0009880 con 0x7f7ed4065f70 2020-10-31T22:43:11.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7ecbfff700 1 -- 172.21.15.60:0/4213797114 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ed0009be0 con 0x7f7ed4065f70 2020-10-31T22:43:11.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4213797114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed4065f70 msgr2=0x7f7ed413f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:11.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7edb3ec700 1 --2- 172.21.15.60:0/4213797114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed4065f70 0x7f7ed413f390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f7ed40b5fc0 tx=0x7f7ed0006dc0).stop 2020-10-31T22:43:11.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4213797114 shutdown_connections 2020-10-31T22:43:11.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7edb3ec700 1 --2- 172.21.15.60:0/4213797114 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ed405c660 0x7f7ed40b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7edb3ec700 1 --2- 172.21.15.60:0/4213797114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed4065f70 0x7f7ed413f390 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4213797114 >> 172.21.15.60:0/4213797114 conn(0x7f7ed40601e0 msgr2=0x7f7ed405b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:11.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4213797114 shutdown_connections 2020-10-31T22:43:11.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4213797114 wait complete. 2020-10-31T22:43:11.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7edb3ec700 1 Processor -- start 2020-10-31T22:43:11.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.911+0000 7f7edb3ec700 1 -- start start 2020-10-31T22:43:11.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7edb3ec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed405c660 0x7f7ed40ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:11.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7edb3ec700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ed4065f70 0x7f7ed4151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:11.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7edb3ec700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ed413f880 0x7f7ed4145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:11.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7edb3ec700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40b2920 con 0x7f7ed405c660 2020-10-31T22:43:11.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7edb3ec700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40ac490 con 0x7f7ed413f880 2020-10-31T22:43:11.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7edb3ec700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40b2680 con 0x7f7ed4065f70 2020-10-31T22:43:11.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7ed9188700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed405c660 0x7f7ed40ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:11.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7ed9188700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed405c660 0x7f7ed40ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43400/0 (socket says 172.21.15.60:43400) 2020-10-31T22:43:11.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7ed9188700 1 -- 172.21.15.60:0/4222059959 learned_addr learned my addr 172.21.15.60:0/4222059959 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:11.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7ed8987700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ed4065f70 0x7f7ed4151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:11.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7ed9989700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ed413f880 0x7f7ed4145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:11.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7ed9188700 1 -- 172.21.15.60:0/4222059959 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ed4065f70 msgr2=0x7f7ed4151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:11.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7ed9188700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ed4065f70 0x7f7ed4151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7ed9188700 1 -- 172.21.15.60:0/4222059959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ed413f880 msgr2=0x7f7ed4145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:11.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7ed9188700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ed413f880 0x7f7ed4145780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:11.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7ed9188700 1 -- 172.21.15.60:0/4222059959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed40ae510 con 0x7f7ed405c660 2020-10-31T22:43:11.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7ed9989700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ed413f880 0x7f7ed4145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:11.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7ed9188700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed405c660 0x7f7ed40ad690 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f7ec400c000 tx=0x7f7ec4006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:11.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7eca7fc700 1 -- 172.21.15.60:0/4222059959 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ec400ca10 con 0x7f7ed405c660 2020-10-31T22:43:11.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7eca7fc700 1 -- 172.21.15.60:0/4222059959 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec400cb70 con 0x7f7ed405c660 2020-10-31T22:43:11.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7eca7fc700 1 -- 172.21.15.60:0/4222059959 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7ec40123f0 con 0x7f7ed405c660 2020-10-31T22:43:11.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4222059959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed40ae0c0 con 0x7f7ed405c660 2020-10-31T22:43:11.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.915+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4222059959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed40ad2f0 con 0x7f7ed405c660 2020-10-31T22:43:11.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.919+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4222059959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ed4057100 con 0x7f7ed405c660 2020-10-31T22:43:11.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.919+0000 7f7eca7fc700 1 -- 172.21.15.60:0/4222059959 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7ec4012550 con 0x7f7ed405c660 2020-10-31T22:43:11.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.919+0000 7f7eca7fc700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ebc054f10 0x7f7ebc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:11.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.919+0000 7f7ed8987700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ebc054f10 0x7f7ebc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:11.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.919+0000 7f7eca7fc700 1 -- 172.21.15.60:0/4222059959 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7ec406de00 con 0x7f7ed405c660 2020-10-31T22:43:11.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.919+0000 7f7ed8987700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ebc054f10 0x7f7ebc0573d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f7ed001b000 tx=0x7f7ed0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:11.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:11.927+0000 7f7eca7fc700 1 -- 172.21.15.60:0/4222059959 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7ec40442c0 con 0x7f7ed405c660 2020-10-31T22:43:12.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.071+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4222059959 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f7ed40ac600 con 0x7f7ed405c660 2020-10-31T22:43:12.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.071+0000 7f7eca7fc700 1 -- 172.21.15.60:0/4222059959 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v44) v1 ==== 110+0+10 (secure 0 0 0) 0x7f7ec40478e0 con 0x7f7ed405c660 2020-10-31T22:43:12.074 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:43:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.075+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4222059959 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ebc054f10 msgr2=0x7f7ebc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.075+0000 7f7edb3ec700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ebc054f10 0x7f7ebc0573d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f7ed001b000 tx=0x7f7ed0015000).stop 2020-10-31T22:43:12.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.075+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4222059959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed405c660 msgr2=0x7f7ed40ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.075+0000 7f7edb3ec700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed405c660 0x7f7ed40ad690 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f7ec400c000 tx=0x7f7ec4006dc0).stop 2020-10-31T22:43:12.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.075+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4222059959 shutdown_connections 2020-10-31T22:43:12.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.075+0000 7f7edb3ec700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ebc054f10 0x7f7ebc0573d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.075+0000 7f7edb3ec700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7ed413f880 0x7f7ed4145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.075+0000 7f7edb3ec700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ed405c660 0x7f7ed40ad690 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.075+0000 7f7edb3ec700 1 --2- 172.21.15.60:0/4222059959 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7ed4065f70 0x7f7ed4151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.075+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4222059959 >> 172.21.15.60:0/4222059959 conn(0x7f7ed40601e0 msgr2=0x7f7ed40b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:12.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.075+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4222059959 shutdown_connections 2020-10-31T22:43:12.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.075+0000 7f7edb3ec700 1 -- 172.21.15.60:0/4222059959 wait complete. 2020-10-31T22:43:12.088 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:43:12.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.199+0000 7fa1fb59e700 1 Processor -- start 2020-10-31T22:43:12.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.199+0000 7fa1fb59e700 1 -- start start 2020-10-31T22:43:12.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa1fc0a8140 0x7fa1fc0ac020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa1fc13bcc0 0x7fa1fc13c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1fc13f630 con 0x7fa1fc0b1d50 2020-10-31T22:43:12.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1fc0ae220 con 0x7fa1fc13bcc0 2020-10-31T22:43:12.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1fc0b2130 con 0x7fa1fc0a8140 2020-10-31T22:43:12.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa1fc13bcc0 0x7fa1fc13c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa1fc13bcc0 0x7fa1fc13c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43410/0 (socket says 172.21.15.60:43410) 2020-10-31T22:43:12.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fad9d700 1 -- 172.21.15.60:0/3653675762 learned_addr learned my addr 172.21.15.60:0/3653675762 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:12.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fa59c700 1 --1- 172.21.15.60:0/3653675762 >> v1:172.21.15.60:6789/0 conn(0x7fa1fc0b1d50 0x7fa1fc0adb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47542/0 (socket says 172.21.15.60:47542) 2020-10-31T22:43:12.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1f9d9b700 1 --2- 172.21.15.60:0/3653675762 >> v2:172.21.15.66:3300/0 conn(0x7fa1fc0a8140 0x7fa1fc0ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fad9d700 1 -- 172.21.15.60:0/3653675762 >> v2:172.21.15.66:3300/0 conn(0x7fa1fc0a8140 msgr2=0x7fa1fc0ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:12.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fad9d700 1 --2- 172.21.15.60:0/3653675762 >> v2:172.21.15.66:3300/0 conn(0x7fa1fc0a8140 0x7fa1fc0ac020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1f959a700 1 -- 172.21.15.60:0/3653675762 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072055791 0 0) 0x7fa1fc13f630 con 0x7fa1fc0b1d50 2020-10-31T22:43:12.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fad9d700 1 -- 172.21.15.60:0/3653675762 >> v1:172.21.15.60:6789/0 conn(0x7fa1fc0b1d50 legacy=0x7fa1fc0adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fad9d700 1 -- 172.21.15.60:0/3653675762 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc05c0f0 con 0x7fa1fc13bcc0 2020-10-31T22:43:12.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fad9d700 1 --2- 172.21.15.60:0/3653675762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1fc13bcc0 0x7fa1fc13c170 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fa1fc0ada60 tx=0x7fa1f4009270).ready entity=mon.0 client_cookie=4162945c586b4042 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:12.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1f959a700 1 -- 172.21.15.60:0/3653675762 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f400bbc0 con 0x7fa1fc13bcc0 2020-10-31T22:43:12.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1f959a700 1 -- 172.21.15.60:0/3653675762 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f400bd20 con 0x7fa1fc13bcc0 2020-10-31T22:43:12.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1f959a700 1 -- 172.21.15.60:0/3653675762 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1f400be90 con 0x7fa1fc13bcc0 2020-10-31T22:43:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 -- 172.21.15.60:0/3653675762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1fc13bcc0 msgr2=0x7fa1fc13c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 --2- 172.21.15.60:0/3653675762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1fc13bcc0 0x7fa1fc13c170 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fa1fc0ada60 tx=0x7fa1f4009270).stop 2020-10-31T22:43:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 -- 172.21.15.60:0/3653675762 shutdown_connections 2020-10-31T22:43:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 --2- 172.21.15.60:0/3653675762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1fc13bcc0 0x7fa1fc13c170 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 --2- 172.21.15.60:0/3653675762 >> v2:172.21.15.66:3300/0 conn(0x7fa1fc0a8140 0x7fa1fc0ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 -- 172.21.15.60:0/3653675762 >> 172.21.15.60:0/3653675762 conn(0x7fa1fc0b5330 msgr2=0x7fa1fc0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 -- 172.21.15.60:0/3653675762 shutdown_connections 2020-10-31T22:43:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 -- 172.21.15.60:0/3653675762 wait complete. 2020-10-31T22:43:12.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 Processor -- start 2020-10-31T22:43:12.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.203+0000 7fa1fb59e700 1 -- start start 2020-10-31T22:43:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1fc0a8140 0x7fa1fc0b3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fb59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1fc0b1d50 0x7fa1fc0a8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fb59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1fc13bcc0 0x7fa1fc0a8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc0a7df0 con 0x7fa1fc0a8140 2020-10-31T22:43:12.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fb59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc0b3d80 con 0x7fa1fc0b1d50 2020-10-31T22:43:12.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fb59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc0b0c20 con 0x7fa1fc13bcc0 2020-10-31T22:43:12.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fa59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1fc0a8140 0x7fa1fc0b3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fa59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1fc0a8140 0x7fa1fc0b3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43412/0 (socket says 172.21.15.60:43412) 2020-10-31T22:43:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fa59c700 1 -- 172.21.15.60:0/558566252 learned_addr learned my addr 172.21.15.60:0/558566252 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1f9d9b700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1fc0b1d50 0x7fa1fc0a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fad9d700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1fc13bcc0 0x7fa1fc0a8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fa59c700 1 -- 172.21.15.60:0/558566252 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1fc13bcc0 msgr2=0x7fa1fc0a8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fa59c700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1fc13bcc0 0x7fa1fc0a8df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fa59c700 1 -- 172.21.15.60:0/558566252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1fc0b1d50 msgr2=0x7fa1fc0a8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fa59c700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1fc0b1d50 0x7fa1fc0a8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fa59c700 1 -- 172.21.15.60:0/558566252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc0b0ec0 con 0x7fa1fc0a8140 2020-10-31T22:43:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fad9d700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1fc13bcc0 0x7fa1fc0a8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:43:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fa59c700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1fc0a8140 0x7fa1fc0b3730 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fa1ec000e90 tx=0x7fa1ec007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1eb7fe700 1 -- 172.21.15.60:0/558566252 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1ec0062e0 con 0x7fa1fc0a8140 2020-10-31T22:43:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1eb7fe700 1 -- 172.21.15.60:0/558566252 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec0044d0 con 0x7fa1fc0a8140 2020-10-31T22:43:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fb59e700 1 -- 172.21.15.60:0/558566252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1fc0b0370 con 0x7fa1fc0a8140 2020-10-31T22:43:12.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1eb7fe700 1 -- 172.21.15.60:0/558566252 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1ec004830 con 0x7fa1fc0a8140 2020-10-31T22:43:12.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.207+0000 7fa1fb59e700 1 -- 172.21.15.60:0/558566252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1fc0ab6a0 con 0x7fa1fc0a8140 2020-10-31T22:43:12.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.211+0000 7fa1fb59e700 1 -- 172.21.15.60:0/558566252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1fc057100 con 0x7fa1fc0a8140 2020-10-31T22:43:12.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.211+0000 7fa1eb7fe700 1 -- 172.21.15.60:0/558566252 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa1ec010070 con 0x7fa1fc0a8140 2020-10-31T22:43:12.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.211+0000 7fa1eb7fe700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa1d8054f10 0x7fa1d80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.211+0000 7fa1f9d9b700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa1d8054f10 0x7fa1d80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.211+0000 7fa1eb7fe700 1 -- 172.21.15.60:0/558566252 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa1ec06d040 con 0x7fa1fc0a8140 2020-10-31T22:43:12.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.211+0000 7fa1f9d9b700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa1d8054f10 0x7fa1d80573d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fa1f000c000 tx=0x7fa1f0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:12.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.219+0000 7fa1eb7fe700 1 -- 172.21.15.60:0/558566252 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa1ec043500 con 0x7fa1fc0a8140 2020-10-31T22:43:12.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.363+0000 7fa1fb59e700 1 -- 172.21.15.60:0/558566252 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa1fc066fd0 con 0x7fa1fc0a8140 2020-10-31T22:43:12.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.363+0000 7fa1eb7fe700 1 -- 172.21.15.60:0/558566252 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa1ec046b20 con 0x7fa1fc0a8140 2020-10-31T22:43:12.366 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:43:12.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.367+0000 7fa1fb59e700 1 -- 172.21.15.60:0/558566252 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa1d8054f10 msgr2=0x7fa1d80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.367+0000 7fa1fb59e700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa1d8054f10 0x7fa1d80573d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7fa1f000c000 tx=0x7fa1f0008040).stop 2020-10-31T22:43:12.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.367+0000 7fa1fb59e700 1 -- 172.21.15.60:0/558566252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1fc0a8140 msgr2=0x7fa1fc0b3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.367+0000 7fa1fb59e700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1fc0a8140 0x7fa1fc0b3730 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fa1ec000e90 tx=0x7fa1ec007a00).stop 2020-10-31T22:43:12.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.367+0000 7fa1fb59e700 1 -- 172.21.15.60:0/558566252 shutdown_connections 2020-10-31T22:43:12.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.367+0000 7fa1fb59e700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1fc13bcc0 0x7fa1fc0a8df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.367+0000 7fa1fb59e700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1fc0a8140 0x7fa1fc0b3730 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.367+0000 7fa1fb59e700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa1d8054f10 0x7fa1d80573d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.367+0000 7fa1fb59e700 1 --2- 172.21.15.60:0/558566252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1fc0b1d50 0x7fa1fc0a8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.367+0000 7fa1fb59e700 1 -- 172.21.15.60:0/558566252 >> 172.21.15.60:0/558566252 conn(0x7fa1fc0b5330 msgr2=0x7fa1fc0abf40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:12.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.367+0000 7fa1fb59e700 1 -- 172.21.15.60:0/558566252 shutdown_connections 2020-10-31T22:43:12.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.367+0000 7fa1fb59e700 1 -- 172.21.15.60:0/558566252 wait complete. 2020-10-31T22:43:12.380 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:43:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.491+0000 7fb85669f700 1 Processor -- start 2020-10-31T22:43:12.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.491+0000 7fb85669f700 1 -- start start 2020-10-31T22:43:12.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb85669f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8500b52a0 0x7fb8500af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb85669f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8500aff00 con 0x7fb8500aac80 2020-10-31T22:43:12.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb85669f700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8500af9c0 con 0x7fb8500ae040 2020-10-31T22:43:12.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb85669f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500b0320 con 0x7fb8500b52a0 2020-10-31T22:43:12.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb854c3c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb8500aac80 0x7fb8500ab0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47560/0 (socket says 172.21.15.60:47560) 2020-10-31T22:43:12.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb854c3c700 1 -- 172.21.15.60:0/3415113536 learned_addr learned my addr 172.21.15.60:0/3415113536 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:12.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84ffff700 1 --2- 172.21.15.60:0/3415113536 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8500b52a0 0x7fb8500af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 968691183 0 0) 0x7fb8500aff00 con 0x7fb8500aac80 2020-10-31T22:43:12.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb830003230 con 0x7fb8500aac80 2020-10-31T22:43:12.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310395966 0 0) 0x7fb8500af9c0 con 0x7fb8500ae040 2020-10-31T22:43:12.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8500aff00 con 0x7fb8500ae040 2020-10-31T22:43:12.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2108141215 0 0) 0x7fb830003230 con 0x7fb8500aac80 2020-10-31T22:43:12.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8500b52a0 msgr2=0x7fb8500af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 --2- 172.21.15.60:0/3415113536 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8500b52a0 0x7fb8500af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 >> v1:172.21.15.66:6789/0 conn(0x7fb8500ae040 legacy=0x7fb850140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500afc60 con 0x7fb8500aac80 2020-10-31T22:43:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fb848001a50 con 0x7fb8500aac80 2020-10-31T22:43:12.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 >> v1:172.21.15.60:6789/0 conn(0x7fb8500aac80 legacy=0x7fb8500ab0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 --2- 172.21.15.60:0/3415113536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8300038e0 0x7fb830003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 --2- 172.21.15.60:0/3415113536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8300044d0 0x7fb830004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 --2- 172.21.15.60:0/3415113536 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8500b52a0 0x7fb830004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb830005330 con 0x7fb8300044d0 2020-10-31T22:43:12.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83000b720 con 0x7fb8300038e0 2020-10-31T22:43:12.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb83000b860 con 0x7fb8500b52a0 2020-10-31T22:43:12.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb8477fe700 1 --2- 172.21.15.60:0/3415113536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8300044d0 0x7fb830004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84ffff700 1 --2- 172.21.15.60:0/3415113536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8300038e0 0x7fb830003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb854c3c700 1 --2- 172.21.15.60:0/3415113536 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8500b52a0 0x7fb830004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb8477fe700 1 -- 172.21.15.60:0/3415113536 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8500b52a0 msgr2=0x7fb830004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:12.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb8477fe700 1 --2- 172.21.15.60:0/3415113536 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8500b52a0 0x7fb830004e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb8477fe700 1 -- 172.21.15.60:0/3415113536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8300038e0 msgr2=0x7fb830003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:12.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb8477fe700 1 --2- 172.21.15.60:0/3415113536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8300038e0 0x7fb830003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb8477fe700 1 -- 172.21.15.60:0/3415113536 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb830003230 con 0x7fb8300044d0 2020-10-31T22:43:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb8477fe700 1 --2- 172.21.15.60:0/3415113536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8300044d0 0x7fb830004950 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fb8300054a0 tx=0x7fb838007b60).ready entity=mon.0 client_cookie=6e47dec927c8fa77 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb83800c7d0 con 0x7fb8300044d0 2020-10-31T22:43:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83800c930 con 0x7fb8300044d0 2020-10-31T22:43:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb84f7fe700 1 -- 172.21.15.60:0/3415113536 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb83800cc90 con 0x7fb8300044d0 2020-10-31T22:43:12.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb85669f700 1 -- 172.21.15.60:0/3415113536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8300044d0 msgr2=0x7fb830004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb85669f700 1 --2- 172.21.15.60:0/3415113536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8300044d0 0x7fb830004950 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7fb8300054a0 tx=0x7fb838007b60).stop 2020-10-31T22:43:12.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb854c3c700 1 -- 172.21.15.60:0/3415113536 reap_dead start 2020-10-31T22:43:12.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb85669f700 1 -- 172.21.15.60:0/3415113536 shutdown_connections 2020-10-31T22:43:12.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb85669f700 1 -- 172.21.15.60:0/3415113536 >> 172.21.15.60:0/3415113536 conn(0x7fb850060c50 msgr2=0x7fb8500b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:12.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb85669f700 1 -- 172.21.15.60:0/3415113536 shutdown_connections 2020-10-31T22:43:12.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.495+0000 7fb85669f700 1 -- 172.21.15.60:0/3415113536 wait complete. 2020-10-31T22:43:12.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.499+0000 7fb85669f700 1 Processor -- start 2020-10-31T22:43:12.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.499+0000 7fb85669f700 1 -- start start 2020-10-31T22:43:12.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb85669f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8500637e0 0x7fb85009e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb85669f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85009ed50 0x7fb85014e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb85669f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb85014ee30 0x7fb85014f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb85669f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb850063bc0 con 0x7fb8500637e0 2020-10-31T22:43:12.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb85669f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb850064480 con 0x7fb85014ee30 2020-10-31T22:43:12.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb85669f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500a0520 con 0x7fb85009ed50 2020-10-31T22:43:12.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb84ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8500637e0 0x7fb85009e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb84ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8500637e0 0x7fb85009e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43432/0 (socket says 172.21.15.60:43432) 2020-10-31T22:43:12.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb84ffff700 1 -- 172.21.15.60:0/1362869021 learned_addr learned my addr 172.21.15.60:0/1362869021 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:12.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb854c3c700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb85014ee30 0x7fb85014f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb8477fe700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85009ed50 0x7fb85014e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb84ffff700 1 -- 172.21.15.60:0/1362869021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85009ed50 msgr2=0x7fb85014e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb84ffff700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85009ed50 0x7fb85014e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb84ffff700 1 -- 172.21.15.60:0/1362869021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb85014ee30 msgr2=0x7fb85014f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb84ffff700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb85014ee30 0x7fb85014f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb84ffff700 1 -- 172.21.15.60:0/1362869021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500a07c0 con 0x7fb8500637e0 2020-10-31T22:43:12.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb8477fe700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85009ed50 0x7fb85014e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:43:12.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb854c3c700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb85014ee30 0x7fb85014f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:43:12.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb84ffff700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8500637e0 0x7fb85009e860 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fb840003070 tx=0x7fb840008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:12.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb84dffb700 1 -- 172.21.15.60:0/1362869021 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb84000e9e0 con 0x7fb8500637e0 2020-10-31T22:43:12.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb84dffb700 1 -- 172.21.15.60:0/1362869021 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84000eb40 con 0x7fb8500637e0 2020-10-31T22:43:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb85669f700 1 -- 172.21.15.60:0/1362869021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8500a0a60 con 0x7fb8500637e0 2020-10-31T22:43:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb84dffb700 1 -- 172.21.15.60:0/1362869021 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb84000eea0 con 0x7fb8500637e0 2020-10-31T22:43:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb85669f700 1 -- 172.21.15.60:0/1362869021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb850064780 con 0x7fb8500637e0 2020-10-31T22:43:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb85669f700 1 -- 172.21.15.60:0/1362869021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb850057100 con 0x7fb8500637e0 2020-10-31T22:43:12.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.503+0000 7fb84dffb700 1 -- 172.21.15.60:0/1362869021 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb840024070 con 0x7fb8500637e0 2020-10-31T22:43:12.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.507+0000 7fb84dffb700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb8340550c0 0x7fb834057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.507+0000 7fb84dffb700 1 -- 172.21.15.60:0/1362869021 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb84006e500 con 0x7fb8500637e0 2020-10-31T22:43:12.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.507+0000 7fb8477fe700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb8340550c0 0x7fb834057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.507+0000 7fb8477fe700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb8340550c0 0x7fb834057580 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fb838019000 tx=0x7fb838015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:12.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.511+0000 7fb84dffb700 1 -- 172.21.15.60:0/1362869021 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb840044910 con 0x7fb8500637e0 2020-10-31T22:43:12.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.655+0000 7fb85669f700 1 -- 172.21.15.60:0/1362869021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb85005aa30 con 0x7fb8500637e0 2020-10-31T22:43:12.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.655+0000 7fb84dffb700 1 -- 172.21.15.60:0/1362869021 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+10 (secure 0 0 0) 0x7fb840047f30 con 0x7fb8500637e0 2020-10-31T22:43:12.659 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:43:12.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.659+0000 7fb85669f700 1 -- 172.21.15.60:0/1362869021 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb8340550c0 msgr2=0x7fb834057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.659+0000 7fb85669f700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb8340550c0 0x7fb834057580 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fb838019000 tx=0x7fb838015000).stop 2020-10-31T22:43:12.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.659+0000 7fb85669f700 1 -- 172.21.15.60:0/1362869021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8500637e0 msgr2=0x7fb85009e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.659+0000 7fb85669f700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8500637e0 0x7fb85009e860 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7fb840003070 tx=0x7fb840008040).stop 2020-10-31T22:43:12.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.659+0000 7fb85669f700 1 -- 172.21.15.60:0/1362869021 shutdown_connections 2020-10-31T22:43:12.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.659+0000 7fb85669f700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb8340550c0 0x7fb834057580 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.659+0000 7fb85669f700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb85014ee30 0x7fb85014f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.659+0000 7fb85669f700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb8500637e0 0x7fb85009e860 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.659+0000 7fb85669f700 1 --2- 172.21.15.60:0/1362869021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85009ed50 0x7fb85014e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.659+0000 7fb85669f700 1 -- 172.21.15.60:0/1362869021 >> 172.21.15.60:0/1362869021 conn(0x7fb850060c50 msgr2=0x7fb850140fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:12.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.659+0000 7fb85669f700 1 -- 172.21.15.60:0/1362869021 shutdown_connections 2020-10-31T22:43:12.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.659+0000 7fb85669f700 1 -- 172.21.15.60:0/1362869021 wait complete. 2020-10-31T22:43:12.677 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:43:12.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.799+0000 7f90da2da700 1 Processor -- start 2020-10-31T22:43:12.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.799+0000 7f90da2da700 1 -- start start 2020-10-31T22:43:12.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.799+0000 7f90da2da700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f90d40b1d50 0x7f90d4145c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.799+0000 7f90da2da700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90d405c2d0 0x7f90d405bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.799+0000 7f90da2da700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d40aef60 con 0x7f90d40af410 2020-10-31T22:43:12.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.799+0000 7f90da2da700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d40b2130 con 0x7f90d40b1d50 2020-10-31T22:43:12.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.799+0000 7f90da2da700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d405afe0 con 0x7f90d405c2d0 2020-10-31T22:43:12.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.799+0000 7f90d9ad9700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f90d40af410 0x7f90d413f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47580/0 (socket says 172.21.15.60:47580) 2020-10-31T22:43:12.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.799+0000 7f90d9ad9700 1 -- 172.21.15.60:0/3783684172 learned_addr learned my addr 172.21.15.60:0/3783684172 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:12.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.799+0000 7f90d92d8700 1 --2- 172.21.15.60:0/3783684172 >> v2:172.21.15.60:3300/0 conn(0x7f90d40b1d50 0x7f90d4145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.799+0000 7f90d8ad7700 1 --2- 172.21.15.60:0/3783684172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90d405c2d0 0x7f90d405bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90c3fff700 1 -- 172.21.15.60:0/3783684172 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955756025 0 0) 0x7f90cc001450 con 0x7f90d40af410 2020-10-31T22:43:12.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90d92d8700 1 -- 172.21.15.60:0/3783684172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90d405c2d0 msgr2=0x7f90d405bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:12.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90d92d8700 1 --2- 172.21.15.60:0/3783684172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90d405c2d0 0x7f90d405bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90d92d8700 1 -- 172.21.15.60:0/3783684172 >> v1:172.21.15.60:6789/0 conn(0x7f90d40af410 legacy=0x7f90d413f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90d92d8700 1 -- 172.21.15.60:0/3783684172 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d405b280 con 0x7f90d40b1d50 2020-10-31T22:43:12.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90d92d8700 1 --2- 172.21.15.60:0/3783684172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d40b1d50 0x7f90d4145c70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f90d0002f30 tx=0x7f90d0006dc0).ready entity=mon.0 client_cookie=38a60943d6bd3710 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:12.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90c3fff700 1 -- 172.21.15.60:0/3783684172 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90d0009760 con 0x7f90d40b1d50 2020-10-31T22:43:12.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90c3fff700 1 -- 172.21.15.60:0/3783684172 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d00098c0 con 0x7f90d40b1d50 2020-10-31T22:43:12.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90c3fff700 1 -- 172.21.15.60:0/3783684172 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90d0009c20 con 0x7f90d40b1d50 2020-10-31T22:43:12.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 -- 172.21.15.60:0/3783684172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d40b1d50 msgr2=0x7f90d4145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 --2- 172.21.15.60:0/3783684172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d40b1d50 0x7f90d4145c70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f90d0002f30 tx=0x7f90d0006dc0).stop 2020-10-31T22:43:12.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 -- 172.21.15.60:0/3783684172 shutdown_connections 2020-10-31T22:43:12.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 --2- 172.21.15.60:0/3783684172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d40b1d50 0x7f90d4145c70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 --2- 172.21.15.60:0/3783684172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90d405c2d0 0x7f90d405bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 -- 172.21.15.60:0/3783684172 >> 172.21.15.60:0/3783684172 conn(0x7f90d40b5330 msgr2=0x7f90d40b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:12.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 -- 172.21.15.60:0/3783684172 shutdown_connections 2020-10-31T22:43:12.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 -- 172.21.15.60:0/3783684172 wait complete. 2020-10-31T22:43:12.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 Processor -- start 2020-10-31T22:43:12.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 -- start start 2020-10-31T22:43:12.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90d405c2d0 0x7f90d4151920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d40af410 0x7f90d41441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d40b1d50 0x7f90d41426d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40ac9c0 con 0x7f90d40af410 2020-10-31T22:43:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d40ae270 con 0x7f90d40b1d50 2020-10-31T22:43:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90da2da700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d4062f60 con 0x7f90d405c2d0 2020-10-31T22:43:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90d8ad7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d40af410 0x7f90d41441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90d8ad7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d40af410 0x7f90d41441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43448/0 (socket says 172.21.15.60:43448) 2020-10-31T22:43:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.803+0000 7f90d8ad7700 1 -- 172.21.15.60:0/1720228154 learned_addr learned my addr 172.21.15.60:0/1720228154 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:12.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90d9ad9700 1 --2- 172.21.15.60:0/1720228154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d40b1d50 0x7f90d41426d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90d92d8700 1 --2- 172.21.15.60:0/1720228154 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90d405c2d0 0x7f90d4151920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90d8ad7700 1 -- 172.21.15.60:0/1720228154 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90d405c2d0 msgr2=0x7f90d4151920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90d8ad7700 1 --2- 172.21.15.60:0/1720228154 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90d405c2d0 0x7f90d4151920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90d8ad7700 1 -- 172.21.15.60:0/1720228154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d40b1d50 msgr2=0x7f90d41426d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90d8ad7700 1 --2- 172.21.15.60:0/1720228154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d40b1d50 0x7f90d41426d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90d8ad7700 1 -- 172.21.15.60:0/1720228154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d4142bc0 con 0x7f90d40af410 2020-10-31T22:43:12.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90d8ad7700 1 --2- 172.21.15.60:0/1720228154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d40af410 0x7f90d41441c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f90c400c000 tx=0x7f90c4006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:12.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90c27fc700 1 -- 172.21.15.60:0/1720228154 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c400ca10 con 0x7f90d40af410 2020-10-31T22:43:12.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90c27fc700 1 -- 172.21.15.60:0/1720228154 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c400cb70 con 0x7f90d40af410 2020-10-31T22:43:12.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90da2da700 1 -- 172.21.15.60:0/1720228154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d413f9a0 con 0x7f90d40af410 2020-10-31T22:43:12.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90c27fc700 1 -- 172.21.15.60:0/1720228154 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90c40123f0 con 0x7f90d40af410 2020-10-31T22:43:12.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90da2da700 1 -- 172.21.15.60:0/1720228154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d40ade90 con 0x7f90d40af410 2020-10-31T22:43:12.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90c27fc700 1 -- 172.21.15.60:0/1720228154 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f90c4012550 con 0x7f90d40af410 2020-10-31T22:43:12.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90da2da700 1 -- 172.21.15.60:0/1720228154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d413fc80 con 0x7f90d40af410 2020-10-31T22:43:12.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90c27fc700 1 --2- 172.21.15.60:0/1720228154 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f90b4055020 0x7f90b40574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:12.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90c27fc700 1 -- 172.21.15.60:0/1720228154 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f90c406ddc0 con 0x7f90d40af410 2020-10-31T22:43:12.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90d92d8700 1 --2- 172.21.15.60:0/1720228154 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f90b4055020 0x7f90b40574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:12.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.807+0000 7f90d92d8700 1 --2- 172.21.15.60:0/1720228154 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f90b4055020 0x7f90b40574e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f90d001a000 tx=0x7f90d0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:12.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.811+0000 7f90c27fc700 1 -- 172.21.15.60:0/1720228154 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f90c4044280 con 0x7f90d40af410 2020-10-31T22:43:12.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.951+0000 7f90da2da700 1 -- 172.21.15.60:0/1720228154 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90d4057100 con 0x7f90d40af410 2020-10-31T22:43:12.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.951+0000 7f90c27fc700 1 -- 172.21.15.60:0/1720228154 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+10 (secure 0 0 0) 0x7f90c40478a0 con 0x7f90d40af410 2020-10-31T22:43:12.957 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:43:12.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.955+0000 7f90da2da700 1 -- 172.21.15.60:0/1720228154 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f90b4055020 msgr2=0x7f90b40574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.955+0000 7f90da2da700 1 --2- 172.21.15.60:0/1720228154 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f90b4055020 0x7f90b40574e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f90d001a000 tx=0x7f90d0015000).stop 2020-10-31T22:43:12.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.955+0000 7f90da2da700 1 -- 172.21.15.60:0/1720228154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d40af410 msgr2=0x7f90d41441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:12.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.955+0000 7f90da2da700 1 --2- 172.21.15.60:0/1720228154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d40af410 0x7f90d41441c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f90c400c000 tx=0x7f90c4006dc0).stop 2020-10-31T22:43:12.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.955+0000 7f90da2da700 1 -- 172.21.15.60:0/1720228154 shutdown_connections 2020-10-31T22:43:12.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.955+0000 7f90da2da700 1 --2- 172.21.15.60:0/1720228154 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f90b4055020 0x7f90b40574e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.955+0000 7f90da2da700 1 --2- 172.21.15.60:0/1720228154 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d40b1d50 0x7f90d41426d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.955+0000 7f90da2da700 1 --2- 172.21.15.60:0/1720228154 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f90d405c2d0 0x7f90d4151920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.955+0000 7f90da2da700 1 --2- 172.21.15.60:0/1720228154 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90d40af410 0x7f90d41441c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:12.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.955+0000 7f90da2da700 1 -- 172.21.15.60:0/1720228154 >> 172.21.15.60:0/1720228154 conn(0x7f90d40b5330 msgr2=0x7f90d40b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:12.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.955+0000 7f90da2da700 1 -- 172.21.15.60:0/1720228154 shutdown_connections 2020-10-31T22:43:12.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:12.955+0000 7f90da2da700 1 -- 172.21.15.60:0/1720228154 wait complete. 2020-10-31T22:43:12.968 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:43:12.969 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:43:13.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.079+0000 7f298f012700 1 Processor -- start 2020-10-31T22:43:13.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.079+0000 7f298f012700 1 -- start start 2020-10-31T22:43:13.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.079+0000 7f298f012700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f29880ac870 0x7f29880b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:13.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298f012700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29880acc50 con 0x7f29880b0e20 2020-10-31T22:43:13.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298f012700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29880b5690 con 0x7f29880ae8b0 2020-10-31T22:43:13.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298f012700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29880b14c0 con 0x7f29880ac870 2020-10-31T22:43:13.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298e010700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f29880ac870 0x7f29880b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:13.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298e010700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f29880ac870 0x7f29880b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43454/0 (socket says 172.21.15.60:43454) 2020-10-31T22:43:13.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298e010700 1 -- 172.21.15.60:0/3248757905 learned_addr learned my addr 172.21.15.60:0/3248757905 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:13.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298e010700 1 -- 172.21.15.60:0/3248757905 >> v1:172.21.15.66:6789/0 conn(0x7f29880ae8b0 legacy=0x7f29881412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:13.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298e010700 1 -- 172.21.15.60:0/3248757905 >> v1:172.21.15.60:6789/0 conn(0x7f29880b0e20 legacy=0x7f29880ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:13.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298d00e700 1 -- 172.21.15.60:0/3248757905 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1355496450 0 0) 0x7f29880b5690 con 0x7f29880ae8b0 2020-10-31T22:43:13.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298e010700 1 -- 172.21.15.60:0/3248757905 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29880afc10 con 0x7f29880ac870 2020-10-31T22:43:13.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298e010700 1 --2- 172.21.15.60:0/3248757905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29880ac870 0x7f29880b5060 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f2984002f30 tx=0x7f2984006e80).ready entity=mon.0 client_cookie=da235b6225ff4238 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:13.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298d00e700 1 -- 172.21.15.60:0/3248757905 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2984009880 con 0x7f29880ac870 2020-10-31T22:43:13.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298d00e700 1 -- 172.21.15.60:0/3248757905 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29840099e0 con 0x7f29880ac870 2020-10-31T22:43:13.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298d00e700 1 -- 172.21.15.60:0/3248757905 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2984009d40 con 0x7f29880ac870 2020-10-31T22:43:13.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298f012700 1 -- 172.21.15.60:0/3248757905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29880ac870 msgr2=0x7f29880b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:13.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298f012700 1 --2- 172.21.15.60:0/3248757905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29880ac870 0x7f29880b5060 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f2984002f30 tx=0x7f2984006e80).stop 2020-10-31T22:43:13.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298f012700 1 -- 172.21.15.60:0/3248757905 shutdown_connections 2020-10-31T22:43:13.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298f012700 1 --2- 172.21.15.60:0/3248757905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29880ac870 0x7f29880b5060 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:13.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298f012700 1 -- 172.21.15.60:0/3248757905 >> 172.21.15.60:0/3248757905 conn(0x7f298806a600 msgr2=0x7f2988060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:13.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298f012700 1 -- 172.21.15.60:0/3248757905 shutdown_connections 2020-10-31T22:43:13.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.083+0000 7f298f012700 1 -- 172.21.15.60:0/3248757905 wait complete. 2020-10-31T22:43:13.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298f012700 1 Processor -- start 2020-10-31T22:43:13.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298f012700 1 -- start start 2020-10-31T22:43:13.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298f012700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29880ac870 0x7f2988064900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:13.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298f012700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29880ae8b0 0x7f2988064120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:13.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298f012700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29880b0e20 0x7f29880656b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:13.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298f012700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298814d680 con 0x7f29880ac870 2020-10-31T22:43:13.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298f012700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298814d8b0 con 0x7f29880ae8b0 2020-10-31T22:43:13.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298f012700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298814db50 con 0x7f29880b0e20 2020-10-31T22:43:13.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298e010700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29880ac870 0x7f2988064900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:13.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298e010700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29880ac870 0x7f2988064900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43462/0 (socket says 172.21.15.60:43462) 2020-10-31T22:43:13.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298e010700 1 -- 172.21.15.60:0/492906787 learned_addr learned my addr 172.21.15.60:0/492906787 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:13.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298d80f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29880ae8b0 0x7f2988064120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:13.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298e811700 1 --2- 172.21.15.60:0/492906787 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29880b0e20 0x7f29880656b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:13.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298e010700 1 -- 172.21.15.60:0/492906787 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29880b0e20 msgr2=0x7f29880656b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298e010700 1 --2- 172.21.15.60:0/492906787 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29880b0e20 0x7f29880656b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298e010700 1 -- 172.21.15.60:0/492906787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29880ae8b0 msgr2=0x7f2988064120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298e010700 1 --2- 172.21.15.60:0/492906787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29880ae8b0 0x7f2988064120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298e010700 1 -- 172.21.15.60:0/492906787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298814ddf0 con 0x7f29880ac870 2020-10-31T22:43:13.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298e010700 1 --2- 172.21.15.60:0/492906787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29880ac870 0x7f2988064900 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f2984002f30 tx=0x7f2984015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:13.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f29777fe700 1 -- 172.21.15.60:0/492906787 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2984011d90 con 0x7f29880ac870 2020-10-31T22:43:13.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f29777fe700 1 -- 172.21.15.60:0/492906787 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298401e460 con 0x7f29880ac870 2020-10-31T22:43:13.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298f012700 1 -- 172.21.15.60:0/492906787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298814e090 con 0x7f29880ac870 2020-10-31T22:43:13.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f29777fe700 1 -- 172.21.15.60:0/492906787 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f298401e7c0 con 0x7f29880ac870 2020-10-31T22:43:13.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.087+0000 7f298f012700 1 -- 172.21.15.60:0/492906787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298814e530 con 0x7f29880ac870 2020-10-31T22:43:13.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.091+0000 7f298f012700 1 -- 172.21.15.60:0/492906787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298814e220 con 0x7f29880ac870 2020-10-31T22:43:13.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.091+0000 7f29777fe700 1 -- 172.21.15.60:0/492906787 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f298401a040 con 0x7f29880ac870 2020-10-31T22:43:13.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.091+0000 7f29777fe700 1 --2- 172.21.15.60:0/492906787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2968055020 0x7f29680574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:13.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.091+0000 7f29777fe700 1 -- 172.21.15.60:0/492906787 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f298406ecd0 con 0x7f29880ac870 2020-10-31T22:43:13.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.091+0000 7f298d80f700 1 --2- 172.21.15.60:0/492906787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2968055020 0x7f29680574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:13.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.091+0000 7f298d80f700 1 --2- 172.21.15.60:0/492906787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2968055020 0x7f29680574e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f297800d000 tx=0x7f2978000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:13.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.095+0000 7f29777fe700 1 -- 172.21.15.60:0/492906787 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2984045150 con 0x7f29880ac870 2020-10-31T22:43:13.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.287+0000 7f298f012700 1 -- 172.21.15.60:0/492906787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2988057100 con 0x7f29880ac870 2020-10-31T22:43:13.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.287+0000 7f29777fe700 1 -- 172.21.15.60:0/492906787 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f2984023020 con 0x7f29880ac870 2020-10-31T22:43:13.291 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:13.291 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2666662861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2666662861},{"type":"v1","addr":"172.21.15.60:6835","nonce":2666662861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14},{"gid":5193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3622783561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3622783561},{"type":"v1","addr":"172.21.15.66:6833","nonce":3622783561}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:43:08.333596+0000","modified":"2020-10-31T22:43:09.337195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/1627192275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1627192275},{"type":"v1","addr":"172.21.15.60:6837","nonce":1627192275}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-10-31T22:43:13.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.291+0000 7f298f012700 1 -- 172.21.15.60:0/492906787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2968055020 msgr2=0x7f29680574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:13.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.291+0000 7f298f012700 1 --2- 172.21.15.60:0/492906787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2968055020 0x7f29680574e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f297800d000 tx=0x7f2978000b80).stop 2020-10-31T22:43:13.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.291+0000 7f298f012700 1 -- 172.21.15.60:0/492906787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29880ac870 msgr2=0x7f2988064900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.291+0000 7f298f012700 1 --2- 172.21.15.60:0/492906787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29880ac870 0x7f2988064900 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f2984002f30 tx=0x7f2984015000).stop 2020-10-31T22:43:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.291+0000 7f298f012700 1 -- 172.21.15.60:0/492906787 shutdown_connections 2020-10-31T22:43:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.291+0000 7f298f012700 1 --2- 172.21.15.60:0/492906787 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29880b0e20 0x7f29880656b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.291+0000 7f298f012700 1 --2- 172.21.15.60:0/492906787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29880ac870 0x7f2988064900 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.291+0000 7f298f012700 1 --2- 172.21.15.60:0/492906787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2968055020 0x7f29680574e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.291+0000 7f298f012700 1 --2- 172.21.15.60:0/492906787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29880ae8b0 0x7f2988064120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.291+0000 7f298f012700 1 -- 172.21.15.60:0/492906787 >> 172.21.15.60:0/492906787 conn(0x7f298806a600 msgr2=0x7f2988060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.291+0000 7f298f012700 1 -- 172.21.15.60:0/492906787 shutdown_connections 2020-10-31T22:43:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:13.291+0000 7f298f012700 1 -- 172.21.15.60:0/492906787 wait complete. 2020-10-31T22:43:13.295 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2020-10-31T22:43:13.606 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:43:08.333596+0000', 'modified': '2020-10-31T22:43:09.337195+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5199}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5199': {'gid': 5199, 'name': 'c', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/1627192275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 1627192275}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 1627192275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:43:13.607 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:43:13.609 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:43:13.740 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":5199,"want_state":"up:active","state":"up:active","rank_uptime":5.3952601749999998,"mdsmap_epoch":16,"osdmap_epoch":44,"osdmap_epoch_barrier":44,"uptime":10.606717063} 2020-10-31T22:43:13.740 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 5199, "mdsmap_epoch": 16, "osdmap_epoch": 44, "osdmap_epoch_barrier": 44, "rank_uptime": 5.395260175, "state": "up:active", "uptime": 10.606717063, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:43:13.741 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:43:13.741 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:43:13.741 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:43:13.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:13.742 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:43:13.752 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:43:13.812 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:43:13.813 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:43:13.870 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:43:13.870 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:43:13.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:13.871 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:43:13.920 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:43:13.921 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:43:13.965 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:43:13.980 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:43:13.981 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:43:14.038 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:43:14.039 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:43:14.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:14.040 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:43:14.044 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:43:14.040+0000 7f2dae0e70c0 -1 init, newargv = 0x5561aab0e520 newargc=9ceph-fuse[13108]: starting ceph client 2020-10-31T22:43:14.044 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr: 2020-10-31T22:43:14.054 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13108]: starting fuse 2020-10-31T22:43:14.478 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:43:14.481 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:43:14.485 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:43:14.487 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:43:15.149 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:43:15.165 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:43:15.166 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:43:15.219 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:43:15.221 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:43:15.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:15.222 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:43:15.268 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:43:15.269 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:43:15.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:15.270 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:43:15.271 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:43:15.271 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:43:15.271 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:43:15.272 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:43:15.272 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:43:15.272 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:43:15.272 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:43:15.273 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:43:15.273 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:43:15.273 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:43:15.274 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:43:15.274 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:43:15.274 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:43:15.275 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:43:15.275 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:43:15.276 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:43:15.276 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:43:15.276 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:43:15.277 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:43:15.277 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:43:15.277 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:43:15.278 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:43:15.359 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.13108.asok 2020-10-31T22:43:15.362 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13108.asok 2020-10-31T22:43:15.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:15.363 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13108.asok status 2020-10-31T22:43:15.461 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:43:15.461 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:43:15.462 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:43:15.462 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:43:15.462 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:43:15.462 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:43:15.462 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:43:15.462 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "13108", 2020-10-31T22:43:15.463 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:43:15.463 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:43:15.463 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:43:15.463 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:43:15.463 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 5364, 2020-10-31T22:43:15.463 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:43:15.463 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:43:15.464 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:43:15.464 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5364 2020-10-31T22:43:15.464 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:43:15.464 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:43:15.464 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:43:15.464 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:43:15.464 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2186106493 2020-10-31T22:43:15.465 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:43:15.465 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:43:15.465 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:43:15.465 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:43:15.465 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:43:15.465 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2186106493 2020-10-31T22:43:15.466 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:43:15.466 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.5364 172.21.15.152:0/2186106493", 2020-10-31T22:43:15.466 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/2186106493", 2020-10-31T22:43:15.466 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:43:15.466 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 16, 2020-10-31T22:43:15.466 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 44, 2020-10-31T22:43:15.466 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:43:15.467 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:43:15.467 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:43:15.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:15.470 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:43:15.471 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:43:15.478 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:43:15.478 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:43:15.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:15.479 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:43:15.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:15.540 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:43:15.541 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:43:15.594 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:43:15.595 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:43:15.597 INFO:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-10-31T22:43:15.598 INFO:teuthology.orchestra.run.smithi152:> import sys 2020-10-31T22:43:15.599 INFO:teuthology.orchestra.run.smithi152:> import time 2020-10-31T22:43:15.599 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:43:15.600 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:43:15.600 INFO:teuthology.orchestra.run.smithi152:> n = 1000 2020-10-31T22:43:15.601 INFO:teuthology.orchestra.run.smithi152:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2020-10-31T22:43:15.601 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:43:15.602 INFO:teuthology.orchestra.run.smithi152:> if not os.path.exists(os.path.dirname(abs_path)): 2020-10-31T22:43:15.603 INFO:teuthology.orchestra.run.smithi152:> os.makedirs(os.path.dirname(abs_path)) 2020-10-31T22:43:15.603 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:43:15.604 INFO:teuthology.orchestra.run.smithi152:> for i in range(0, n): 2020-10-31T22:43:15.604 INFO:teuthology.orchestra.run.smithi152:> fname = "{0}_{1}".format(abs_path, i) 2020-10-31T22:43:15.605 INFO:teuthology.orchestra.run.smithi152:> with open(fname, '"'"'w'"'"') as f: 2020-10-31T22:43:15.605 INFO:teuthology.orchestra.run.smithi152:> f.write('"'"'content'"'"') 2020-10-31T22:43:15.606 INFO:teuthology.orchestra.run.smithi152:> if True: 2020-10-31T22:43:15.606 INFO:teuthology.orchestra.run.smithi152:> f.flush() 2020-10-31T22:43:15.607 INFO:teuthology.orchestra.run.smithi152:> os.fsync(f.fileno()) 2020-10-31T22:43:15.607 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:43:28.123 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:43:28.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f2952ba4700 1 Processor -- start 2020-10-31T22:43:28.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f2952ba4700 1 -- start start 2020-10-31T22:43:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f2952ba4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f294c0b5570 0x7f294c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f2952ba4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f294c0b24a0 0x7f294c145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f2952ba4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f294c145180 con 0x7f294c145d10 2020-10-31T22:43:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f2952ba4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f294c0afae0 con 0x7f294c0b24a0 2020-10-31T22:43:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f2952ba4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c141bf0 con 0x7f294c0b5570 2020-10-31T22:43:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f29513a1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f294c0b24a0 0x7f294c145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f29523a3700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f294c145d10 0x7f294c141fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47608/0 (socket says 172.21.15.60:47608) 2020-10-31T22:43:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f29523a3700 1 -- 172.21.15.60:0/3716221914 learned_addr learned my addr 172.21.15.60:0/3716221914 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f2951ba2700 1 --2- 172.21.15.60:0/3716221914 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f294c0b5570 0x7f294c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:28.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f29513a1700 1 -- 172.21.15.60:0/3716221914 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f294c0b5570 msgr2=0x7f294c0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:28.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f29513a1700 1 --2- 172.21.15.60:0/3716221914 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f294c0b5570 0x7f294c0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f29513a1700 1 -- 172.21.15.60:0/3716221914 >> v1:172.21.15.60:6789/0 conn(0x7f294c145d10 legacy=0x7f294c141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f2950ba0700 1 -- 172.21.15.60:0/3716221914 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 797710813 0 0) 0x7f294c145180 con 0x7f294c145d10 2020-10-31T22:43:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f29513a1700 1 -- 172.21.15.60:0/3716221914 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c0b0670 con 0x7f294c0b24a0 2020-10-31T22:43:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f29513a1700 1 --2- 172.21.15.60:0/3716221914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f294c0b24a0 0x7f294c145820 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f293c002f30 tx=0x7f293c006dc0).ready entity=mon.0 client_cookie=8a676826ec3269c9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f2950ba0700 1 -- 172.21.15.60:0/3716221914 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f293c009760 con 0x7f294c0b24a0 2020-10-31T22:43:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f2950ba0700 1 -- 172.21.15.60:0/3716221914 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293c0098c0 con 0x7f294c0b24a0 2020-10-31T22:43:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f2950ba0700 1 -- 172.21.15.60:0/3716221914 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f293c009c20 con 0x7f294c0b24a0 2020-10-31T22:43:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f2952ba4700 1 -- 172.21.15.60:0/3716221914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f294c0b24a0 msgr2=0x7f294c145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.235+0000 7f2952ba4700 1 --2- 172.21.15.60:0/3716221914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f294c0b24a0 0x7f294c145820 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7f293c002f30 tx=0x7f293c006dc0).stop 2020-10-31T22:43:28.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 -- 172.21.15.60:0/3716221914 shutdown_connections 2020-10-31T22:43:28.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 --2- 172.21.15.60:0/3716221914 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f294c0b5570 0x7f294c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 --2- 172.21.15.60:0/3716221914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f294c0b24a0 0x7f294c145820 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 -- 172.21.15.60:0/3716221914 >> 172.21.15.60:0/3716221914 conn(0x7f294c0b8e90 msgr2=0x7f294c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:28.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 -- 172.21.15.60:0/3716221914 shutdown_connections 2020-10-31T22:43:28.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 -- 172.21.15.60:0/3716221914 wait complete. 2020-10-31T22:43:28.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 Processor -- start 2020-10-31T22:43:28.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 -- start start 2020-10-31T22:43:28.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f294c0b24a0 0x7f294c1407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:28.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f294c0b5570 0x7f294c1466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:28.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f294c145d10 0x7f294c146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:28.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0b6e50 con 0x7f294c145d10 2020-10-31T22:43:28.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c0b7080 con 0x7f294c0b5570 2020-10-31T22:43:28.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f294c1441d0 con 0x7f294c0b24a0 2020-10-31T22:43:28.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f29523a3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f294c145d10 0x7f294c146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:28.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f29523a3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f294c145d10 0x7f294c146be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43480/0 (socket says 172.21.15.60:43480) 2020-10-31T22:43:28.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2951ba2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f294c0b24a0 0x7f294c1407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:28.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f29523a3700 1 -- 172.21.15.60:0/2930358525 learned_addr learned my addr 172.21.15.60:0/2930358525 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:28.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f29513a1700 1 --2- 172.21.15.60:0/2930358525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f294c0b5570 0x7f294c1466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f29523a3700 1 -- 172.21.15.60:0/2930358525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f294c0b24a0 msgr2=0x7f294c1407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f29523a3700 1 --2- 172.21.15.60:0/2930358525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f294c0b24a0 0x7f294c1407d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f29523a3700 1 -- 172.21.15.60:0/2930358525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f294c0b5570 msgr2=0x7f294c1466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f29523a3700 1 --2- 172.21.15.60:0/2930358525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f294c0b5570 0x7f294c1466f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f29523a3700 1 -- 172.21.15.60:0/2930358525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c144470 con 0x7f294c145d10 2020-10-31T22:43:28.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f29523a3700 1 --2- 172.21.15.60:0/2930358525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f294c145d10 0x7f294c146be0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f2948000b80 tx=0x7f2948007930).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:28.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f293affd700 1 -- 172.21.15.60:0/2930358525 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29480072e0 con 0x7f294c145d10 2020-10-31T22:43:28.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f293affd700 1 -- 172.21.15.60:0/2930358525 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2948007440 con 0x7f294c145d10 2020-10-31T22:43:28.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f293affd700 1 -- 172.21.15.60:0/2930358525 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29480057d0 con 0x7f294c145d10 2020-10-31T22:43:28.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 -- 172.21.15.60:0/2930358525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294c144710 con 0x7f294c145d10 2020-10-31T22:43:28.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.239+0000 7f2952ba4700 1 -- 172.21.15.60:0/2930358525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294c0b5fc0 con 0x7f294c145d10 2020-10-31T22:43:28.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.243+0000 7f2952ba4700 1 -- 172.21.15.60:0/2930358525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f294c057100 con 0x7f294c145d10 2020-10-31T22:43:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.243+0000 7f293affd700 1 -- 172.21.15.60:0/2930358525 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2948010070 con 0x7f294c145d10 2020-10-31T22:43:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.243+0000 7f293affd700 1 --2- 172.21.15.60:0/2930358525 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f292c054f10 0x7f292c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.243+0000 7f293affd700 1 -- 172.21.15.60:0/2930358525 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f294806cfd0 con 0x7f294c145d10 2020-10-31T22:43:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.243+0000 7f2951ba2700 1 --2- 172.21.15.60:0/2930358525 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f292c054f10 0x7f292c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:28.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.243+0000 7f2951ba2700 1 --2- 172.21.15.60:0/2930358525 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f292c054f10 0x7f292c0573d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f294400b000 tx=0x7f29440091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:28.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.251+0000 7f293affd700 1 -- 172.21.15.60:0/2930358525 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f29480434f0 con 0x7f294c145d10 2020-10-31T22:43:28.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.439+0000 7f2952ba4700 1 -- 172.21.15.60:0/2930358525 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f294c05a8e0 con 0x7f294c145d10 2020-10-31T22:43:28.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.439+0000 7f293affd700 1 -- 172.21.15.60:0/2930358525 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f2948046b10 con 0x7f294c145d10 2020-10-31T22:43:28.440 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:28.440 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2666662861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2666662861},{"type":"v1","addr":"172.21.15.60:6835","nonce":2666662861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14},{"gid":5193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3622783561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3622783561},{"type":"v1","addr":"172.21.15.66:6833","nonce":3622783561}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:43:08.333596+0000","modified":"2020-10-31T22:43:09.337195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/1627192275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1627192275},{"type":"v1","addr":"172.21.15.60:6837","nonce":1627192275}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-10-31T22:43:28.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.439+0000 7f2952ba4700 1 -- 172.21.15.60:0/2930358525 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f292c054f10 msgr2=0x7f292c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:28.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.439+0000 7f2952ba4700 1 --2- 172.21.15.60:0/2930358525 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f292c054f10 0x7f292c0573d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f294400b000 tx=0x7f29440091a0).stop 2020-10-31T22:43:28.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.439+0000 7f2952ba4700 1 -- 172.21.15.60:0/2930358525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f294c145d10 msgr2=0x7f294c146be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:28.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.439+0000 7f2952ba4700 1 --2- 172.21.15.60:0/2930358525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f294c145d10 0x7f294c146be0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f2948000b80 tx=0x7f2948007930).stop 2020-10-31T22:43:28.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.439+0000 7f2952ba4700 1 -- 172.21.15.60:0/2930358525 shutdown_connections 2020-10-31T22:43:28.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.439+0000 7f2952ba4700 1 --2- 172.21.15.60:0/2930358525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f294c145d10 0x7f294c146be0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.439+0000 7f2952ba4700 1 --2- 172.21.15.60:0/2930358525 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f294c0b24a0 0x7f294c1407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.439+0000 7f2952ba4700 1 --2- 172.21.15.60:0/2930358525 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f292c054f10 0x7f292c0573d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.439+0000 7f2952ba4700 1 --2- 172.21.15.60:0/2930358525 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f294c0b5570 0x7f294c1466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.439+0000 7f2952ba4700 1 -- 172.21.15.60:0/2930358525 >> 172.21.15.60:0/2930358525 conn(0x7f294c0b8e90 msgr2=0x7f294c0b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:28.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.439+0000 7f2952ba4700 1 -- 172.21.15.60:0/2930358525 shutdown_connections 2020-10-31T22:43:28.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.439+0000 7f2952ba4700 1 -- 172.21.15.60:0/2930358525 wait complete. 2020-10-31T22:43:28.444 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2020-10-31T22:43:28.455 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_caps 20 2020-10-31T22:43:28.571 INFO:teuthology.orchestra.run.smithi060.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2020-10-31T22:43:28.572 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2020-10-31T22:43:28.575 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:43:28.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.687+0000 7fcd8362b700 1 Processor -- start 2020-10-31T22:43:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.687+0000 7fcd8362b700 1 -- start start 2020-10-31T22:43:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd8362b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcd7c13fbe0 0x7fcd7c0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd8362b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcd7c066430 0x7fcd7c1437d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd8362b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd7c13d8a0 con 0x7fcd7c0b0dc0 2020-10-31T22:43:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd8362b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd7c066870 con 0x7fcd7c13fbe0 2020-10-31T22:43:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd8362b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c140bb0 con 0x7fcd7c066430 2020-10-31T22:43:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd813c7700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcd7c0b0dc0 0x7fcd7c13d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47622/0 (socket says 172.21.15.60:47622) 2020-10-31T22:43:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd813c7700 1 -- 172.21.15.60:0/735894344 learned_addr learned my addr 172.21.15.60:0/735894344 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd80bc6700 1 --2- 172.21.15.60:0/735894344 >> v2:172.21.15.66:3300/0 conn(0x7fcd7c13fbe0 0x7fcd7c0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd81bc8700 1 --2- 172.21.15.60:0/735894344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcd7c066430 0x7fcd7c1437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd6ffff700 1 -- 172.21.15.60:0/735894344 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555704182 0 0) 0x7fcd7c13d8a0 con 0x7fcd7c0b0dc0 2020-10-31T22:43:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd80bc6700 1 -- 172.21.15.60:0/735894344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcd7c066430 msgr2=0x7fcd7c1437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:28.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd80bc6700 1 --2- 172.21.15.60:0/735894344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcd7c066430 0x7fcd7c1437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd80bc6700 1 -- 172.21.15.60:0/735894344 >> v1:172.21.15.60:6789/0 conn(0x7fcd7c0b0dc0 legacy=0x7fcd7c13d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:28.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd80bc6700 1 -- 172.21.15.60:0/735894344 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c066a60 con 0x7fcd7c13fbe0 2020-10-31T22:43:28.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd80bc6700 1 --2- 172.21.15.60:0/735894344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd7c13fbe0 0x7fcd7c0b2d50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fcd78002f30 tx=0x7fcd78006dc0).ready entity=mon.1 client_cookie=38176cc733704501 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:28.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd6ffff700 1 -- 172.21.15.60:0/735894344 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd78009760 con 0x7fcd7c13fbe0 2020-10-31T22:43:28.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd6ffff700 1 -- 172.21.15.60:0/735894344 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd780098c0 con 0x7fcd7c13fbe0 2020-10-31T22:43:28.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd8362b700 1 -- 172.21.15.60:0/735894344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd7c13fbe0 msgr2=0x7fcd7c0b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:28.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd6ffff700 1 -- 172.21.15.60:0/735894344 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd78009c20 con 0x7fcd7c13fbe0 2020-10-31T22:43:28.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd8362b700 1 --2- 172.21.15.60:0/735894344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd7c13fbe0 0x7fcd7c0b2d50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fcd78002f30 tx=0x7fcd78006dc0).stop 2020-10-31T22:43:28.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd8362b700 1 -- 172.21.15.60:0/735894344 shutdown_connections 2020-10-31T22:43:28.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd8362b700 1 --2- 172.21.15.60:0/735894344 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcd7c066430 0x7fcd7c1437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd8362b700 1 --2- 172.21.15.60:0/735894344 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd7c13fbe0 0x7fcd7c0b2d50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd8362b700 1 -- 172.21.15.60:0/735894344 >> 172.21.15.60:0/735894344 conn(0x7fcd7c06a260 msgr2=0x7fcd7c063c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:28.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd8362b700 1 -- 172.21.15.60:0/735894344 shutdown_connections 2020-10-31T22:43:28.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.691+0000 7fcd8362b700 1 -- 172.21.15.60:0/735894344 wait complete. 2020-10-31T22:43:28.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd8362b700 1 Processor -- start 2020-10-31T22:43:28.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd8362b700 1 -- start start 2020-10-31T22:43:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd8362b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd7c066430 0x7fcd7c0647d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd8362b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd7c0b0dc0 0x7fcd7c0b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd8362b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcd7c13fbe0 0x7fcd7c0b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd8362b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0b4930 con 0x7fcd7c0b0dc0 2020-10-31T22:43:28.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd8362b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c142de0 con 0x7fcd7c066430 2020-10-31T22:43:28.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd8362b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c0b5830 con 0x7fcd7c13fbe0 2020-10-31T22:43:28.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd80bc6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd7c0b0dc0 0x7fcd7c0b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:28.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd813c7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd7c066430 0x7fcd7c0647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:28.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd80bc6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd7c0b0dc0 0x7fcd7c0b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43490/0 (socket says 172.21.15.60:43490) 2020-10-31T22:43:28.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd80bc6700 1 -- 172.21.15.60:0/2933442661 learned_addr learned my addr 172.21.15.60:0/2933442661 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:28.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd81bc8700 1 --2- 172.21.15.60:0/2933442661 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcd7c13fbe0 0x7fcd7c0b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:28.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd813c7700 1 -- 172.21.15.60:0/2933442661 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcd7c13fbe0 msgr2=0x7fcd7c0b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:28.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd813c7700 1 --2- 172.21.15.60:0/2933442661 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcd7c13fbe0 0x7fcd7c0b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd813c7700 1 -- 172.21.15.60:0/2933442661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd7c0b0dc0 msgr2=0x7fcd7c0b3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:28.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd813c7700 1 --2- 172.21.15.60:0/2933442661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd7c0b0dc0 0x7fcd7c0b3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd813c7700 1 -- 172.21.15.60:0/2933442661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd7c0b5ad0 con 0x7fcd7c066430 2020-10-31T22:43:28.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd80bc6700 1 --2- 172.21.15.60:0/2933442661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd7c0b0dc0 0x7fcd7c0b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:28.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd813c7700 1 --2- 172.21.15.60:0/2933442661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd7c066430 0x7fcd7c0647d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fcd70000b80 tx=0x7fcd70001690).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:28.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd6e7fc700 1 -- 172.21.15.60:0/2933442661 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd700072e0 con 0x7fcd7c066430 2020-10-31T22:43:28.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd6e7fc700 1 -- 172.21.15.60:0/2933442661 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd700054b0 con 0x7fcd7c066430 2020-10-31T22:43:28.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd8362b700 1 -- 172.21.15.60:0/2933442661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c064cc0 con 0x7fcd7c066430 2020-10-31T22:43:28.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd6e7fc700 1 -- 172.21.15.60:0/2933442661 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd70005810 con 0x7fcd7c066430 2020-10-31T22:43:28.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.695+0000 7fcd8362b700 1 -- 172.21.15.60:0/2933442661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c0ac100 con 0x7fcd7c066430 2020-10-31T22:43:28.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.699+0000 7fcd8362b700 1 -- 172.21.15.60:0/2933442661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c142fa0 con 0x7fcd7c066430 2020-10-31T22:43:28.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.699+0000 7fcd6e7fc700 1 -- 172.21.15.60:0/2933442661 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fcd7001a060 con 0x7fcd7c066430 2020-10-31T22:43:28.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.699+0000 7fcd6e7fc700 1 --2- 172.21.15.60:0/2933442661 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcd640550c0 0x7fcd64057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:28.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.699+0000 7fcd80bc6700 1 --2- 172.21.15.60:0/2933442661 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcd640550c0 0x7fcd64057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:28.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.699+0000 7fcd6e7fc700 1 -- 172.21.15.60:0/2933442661 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcd7006d070 con 0x7fcd7c066430 2020-10-31T22:43:28.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.699+0000 7fcd80bc6700 1 --2- 172.21.15.60:0/2933442661 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcd640550c0 0x7fcd64057580 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fcd7801a000 tx=0x7fcd78015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:28.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.711+0000 7fcd6e7fc700 1 -- 172.21.15.60:0/2933442661 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcd70043590 con 0x7fcd7c066430 2020-10-31T22:43:28.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.899+0000 7fcd8362b700 1 -- 172.21.15.60:0/2933442661 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd7c057100 con 0x7fcd7c066430 2020-10-31T22:43:28.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.899+0000 7fcd6e7fc700 1 -- 172.21.15.60:0/2933442661 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2491 (secure 0 0 0) 0x7fcd70018030 con 0x7fcd7c066430 2020-10-31T22:43:28.903 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:28.903 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2666662861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2666662861},{"type":"v1","addr":"172.21.15.60:6835","nonce":2666662861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14},{"gid":5193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3622783561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3622783561},{"type":"v1","addr":"172.21.15.66:6833","nonce":3622783561}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:43:08.333596+0000","modified":"2020-10-31T22:43:09.337195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/1627192275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1627192275},{"type":"v1","addr":"172.21.15.60:6837","nonce":1627192275}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-10-31T22:43:28.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.903+0000 7fcd8362b700 1 -- 172.21.15.60:0/2933442661 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcd640550c0 msgr2=0x7fcd64057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:28.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.903+0000 7fcd8362b700 1 --2- 172.21.15.60:0/2933442661 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcd640550c0 0x7fcd64057580 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7fcd7801a000 tx=0x7fcd78015000).stop 2020-10-31T22:43:28.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.903+0000 7fcd8362b700 1 -- 172.21.15.60:0/2933442661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd7c066430 msgr2=0x7fcd7c0647d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:28.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.903+0000 7fcd8362b700 1 --2- 172.21.15.60:0/2933442661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd7c066430 0x7fcd7c0647d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fcd70000b80 tx=0x7fcd70001690).stop 2020-10-31T22:43:28.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.903+0000 7fcd8362b700 1 -- 172.21.15.60:0/2933442661 shutdown_connections 2020-10-31T22:43:28.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.903+0000 7fcd8362b700 1 --2- 172.21.15.60:0/2933442661 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcd7c13fbe0 0x7fcd7c0b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.903+0000 7fcd8362b700 1 --2- 172.21.15.60:0/2933442661 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcd640550c0 0x7fcd64057580 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.903+0000 7fcd8362b700 1 --2- 172.21.15.60:0/2933442661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcd7c066430 0x7fcd7c0647d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.903+0000 7fcd8362b700 1 --2- 172.21.15.60:0/2933442661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd7c0b0dc0 0x7fcd7c0b3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:28.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.903+0000 7fcd8362b700 1 -- 172.21.15.60:0/2933442661 >> 172.21.15.60:0/2933442661 conn(0x7fcd7c06a260 msgr2=0x7fcd7c13dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:28.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.903+0000 7fcd8362b700 1 -- 172.21.15.60:0/2933442661 shutdown_connections 2020-10-31T22:43:28.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:28.903+0000 7fcd8362b700 1 -- 172.21.15.60:0/2933442661 wait complete. 2020-10-31T22:43:28.907 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2020-10-31T22:43:28.917 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_decay_threshold 400 2020-10-31T22:43:29.037 INFO:teuthology.orchestra.run.smithi060.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2020-10-31T22:43:29.038 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2020-10-31T22:43:29.038 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:43:29.055 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:43:29.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.171+0000 7f11ed433700 1 Processor -- start 2020-10-31T22:43:29.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.171+0000 7f11ed433700 1 -- start start 2020-10-31T22:43:29.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ed433700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11e80b1d50 0x7f11e805c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ed433700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11e8140230 0x7f11e813c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ed433700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e80b2130 con 0x7f11e80b0d60 2020-10-31T22:43:29.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ed433700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e806a9b0 con 0x7f11e80b1d50 2020-10-31T22:43:29.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ed433700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80af380 con 0x7f11e8140230 2020-10-31T22:43:29.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11df7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f11e80b0d60 0x7f11e813fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47634/0 (socket says 172.21.15.60:47634) 2020-10-31T22:43:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11df7fe700 1 -- 172.21.15.60:0/822135044 learned_addr learned my addr 172.21.15.60:0/822135044 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11e7fff700 1 --2- 172.21.15.60:0/822135044 >> v2:172.21.15.60:3300/0 conn(0x7f11e80b1d50 0x7f11e805c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ecc32700 1 --2- 172.21.15.60:0/822135044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11e8140230 0x7f11e813c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11e77fe700 1 -- 172.21.15.60:0/822135044 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541056813 0 0) 0x7f11e80b2130 con 0x7f11e80b0d60 2020-10-31T22:43:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11e77fe700 1 -- 172.21.15.60:0/822135044 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11c8003230 con 0x7f11e80b0d60 2020-10-31T22:43:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11e7fff700 1 -- 172.21.15.60:0/822135044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11e8140230 msgr2=0x7f11e813c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11e7fff700 1 --2- 172.21.15.60:0/822135044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11e8140230 0x7f11e813c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11e7fff700 1 -- 172.21.15.60:0/822135044 >> v1:172.21.15.60:6789/0 conn(0x7f11e80b0d60 legacy=0x7f11e813fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:29.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11e7fff700 1 -- 172.21.15.60:0/822135044 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e805b160 con 0x7f11e80b1d50 2020-10-31T22:43:29.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ecc32700 1 --2- 172.21.15.60:0/822135044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11e8140230 0x7f11e813c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:43:29.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11e7fff700 1 --2- 172.21.15.60:0/822135044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11e80b1d50 0x7f11e805c6a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f11d8002f30 tx=0x7f11d8006dc0).ready entity=mon.0 client_cookie=86d19a57ba93b9a0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:29.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11e77fe700 1 -- 172.21.15.60:0/822135044 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d8009760 con 0x7f11e80b1d50 2020-10-31T22:43:29.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11e77fe700 1 -- 172.21.15.60:0/822135044 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d80098c0 con 0x7f11e80b1d50 2020-10-31T22:43:29.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11e77fe700 1 -- 172.21.15.60:0/822135044 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d8009c20 con 0x7f11e80b1d50 2020-10-31T22:43:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ed433700 1 -- 172.21.15.60:0/822135044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11e80b1d50 msgr2=0x7f11e805c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ed433700 1 --2- 172.21.15.60:0/822135044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11e80b1d50 0x7f11e805c6a0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7f11d8002f30 tx=0x7f11d8006dc0).stop 2020-10-31T22:43:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ed433700 1 -- 172.21.15.60:0/822135044 shutdown_connections 2020-10-31T22:43:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ed433700 1 --2- 172.21.15.60:0/822135044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11e8140230 0x7f11e813c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ed433700 1 --2- 172.21.15.60:0/822135044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11e80b1d50 0x7f11e805c6a0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ed433700 1 -- 172.21.15.60:0/822135044 >> 172.21.15.60:0/822135044 conn(0x7f11e80b5300 msgr2=0x7f11e80b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ed433700 1 -- 172.21.15.60:0/822135044 shutdown_connections 2020-10-31T22:43:29.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.175+0000 7f11ed433700 1 -- 172.21.15.60:0/822135044 wait complete. 2020-10-31T22:43:29.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11ed433700 1 Processor -- start 2020-10-31T22:43:29.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11ed433700 1 -- start start 2020-10-31T22:43:29.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11ed433700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11e80b0d60 0x7f11e81464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11ed433700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11e80b1d50 0x7f11e80a92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11ed433700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11e8140230 0x7f11e809de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11ed433700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80ad810 con 0x7f11e80b0d60 2020-10-31T22:43:29.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11ed433700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e81517d0 con 0x7f11e80b1d50 2020-10-31T22:43:29.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11ed433700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e80ab6d0 con 0x7f11e8140230 2020-10-31T22:43:29.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11e7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11e80b0d60 0x7f11e81464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11e7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11e80b0d60 0x7f11e81464a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43504/0 (socket says 172.21.15.60:43504) 2020-10-31T22:43:29.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11e7fff700 1 -- 172.21.15.60:0/2214960183 learned_addr learned my addr 172.21.15.60:0/2214960183 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:29.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11df7fe700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11e80b1d50 0x7f11e80a92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11ecc32700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11e8140230 0x7f11e809de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11e7fff700 1 -- 172.21.15.60:0/2214960183 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11e8140230 msgr2=0x7f11e809de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:29.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11e7fff700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11e8140230 0x7f11e809de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11e7fff700 1 -- 172.21.15.60:0/2214960183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11e80b1d50 msgr2=0x7f11e80a92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:29.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11e7fff700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11e80b1d50 0x7f11e80a92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11e7fff700 1 -- 172.21.15.60:0/2214960183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e80ad2b0 con 0x7f11e80b0d60 2020-10-31T22:43:29.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11df7fe700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11e80b1d50 0x7f11e80a92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:43:29.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11ecc32700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11e8140230 0x7f11e809de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:43:29.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11e7fff700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11e80b0d60 0x7f11e81464a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f11d8002f30 tx=0x7f11d8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:29.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11e5ffb700 1 -- 172.21.15.60:0/2214960183 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d8011ab0 con 0x7f11e80b0d60 2020-10-31T22:43:29.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11ed433700 1 -- 172.21.15.60:0/2214960183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e809e380 con 0x7f11e80b0d60 2020-10-31T22:43:29.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11e5ffb700 1 -- 172.21.15.60:0/2214960183 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d8011c10 con 0x7f11e80b0d60 2020-10-31T22:43:29.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11e5ffb700 1 -- 172.21.15.60:0/2214960183 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11d801d440 con 0x7f11e80b0d60 2020-10-31T22:43:29.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11ed433700 1 -- 172.21.15.60:0/2214960183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e80a8fe0 con 0x7f11e80b0d60 2020-10-31T22:43:29.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.179+0000 7f11ed433700 1 -- 172.21.15.60:0/2214960183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e8151610 con 0x7f11e80b0d60 2020-10-31T22:43:29.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.183+0000 7f11e5ffb700 1 -- 172.21.15.60:0/2214960183 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f11d8017070 con 0x7f11e80b0d60 2020-10-31T22:43:29.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.183+0000 7f11e5ffb700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f11cc054f10 0x7f11cc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.183+0000 7f11e5ffb700 1 -- 172.21.15.60:0/2214960183 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f11d806e920 con 0x7f11e80b0d60 2020-10-31T22:43:29.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.183+0000 7f11df7fe700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f11cc054f10 0x7f11cc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.183+0000 7f11df7fe700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f11cc054f10 0x7f11cc0573d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f11d000b000 tx=0x7f11d0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:29.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.191+0000 7f11e5ffb700 1 -- 172.21.15.60:0/2214960183 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f11d8044cb0 con 0x7f11e80b0d60 2020-10-31T22:43:29.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.375+0000 7f11ed433700 1 -- 172.21.15.60:0/2214960183 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11e8057100 con 0x7f11e80b0d60 2020-10-31T22:43:29.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.375+0000 7f11e5ffb700 1 -- 172.21.15.60:0/2214960183 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f11d8022070 con 0x7f11e80b0d60 2020-10-31T22:43:29.377 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:29.377 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2666662861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2666662861},{"type":"v1","addr":"172.21.15.60:6835","nonce":2666662861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14},{"gid":5193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3622783561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3622783561},{"type":"v1","addr":"172.21.15.66:6833","nonce":3622783561}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:43:08.333596+0000","modified":"2020-10-31T22:43:09.337195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/1627192275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1627192275},{"type":"v1","addr":"172.21.15.60:6837","nonce":1627192275}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-10-31T22:43:29.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.375+0000 7f11ed433700 1 -- 172.21.15.60:0/2214960183 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f11cc054f10 msgr2=0x7f11cc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:29.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.375+0000 7f11ed433700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f11cc054f10 0x7f11cc0573d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f11d000b000 tx=0x7f11d0009040).stop 2020-10-31T22:43:29.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.375+0000 7f11ed433700 1 -- 172.21.15.60:0/2214960183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11e80b0d60 msgr2=0x7f11e81464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:29.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.379+0000 7f11ed433700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11e80b0d60 0x7f11e81464a0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f11d8002f30 tx=0x7f11d8015000).stop 2020-10-31T22:43:29.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.379+0000 7f11ed433700 1 -- 172.21.15.60:0/2214960183 shutdown_connections 2020-10-31T22:43:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.379+0000 7f11ed433700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11e8140230 0x7f11e809de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.379+0000 7f11ed433700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11e80b0d60 0x7f11e81464a0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.379+0000 7f11ed433700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f11cc054f10 0x7f11cc0573d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.379+0000 7f11ed433700 1 --2- 172.21.15.60:0/2214960183 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11e80b1d50 0x7f11e80a92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.379+0000 7f11ed433700 1 -- 172.21.15.60:0/2214960183 >> 172.21.15.60:0/2214960183 conn(0x7f11e80b5300 msgr2=0x7f11e813f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:29.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.379+0000 7f11ed433700 1 -- 172.21.15.60:0/2214960183 shutdown_connections 2020-10-31T22:43:29.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.379+0000 7f11ed433700 1 -- 172.21.15.60:0/2214960183 wait complete. 2020-10-31T22:43:29.381 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2020-10-31T22:43:29.391 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mds.c cache drop 2020-10-31T22:43:29.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.499+0000 7fa5a3fff700 1 Processor -- start 2020-10-31T22:43:29.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.499+0000 7fa5a3fff700 1 -- start start 2020-10-31T22:43:29.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5a40b24a0 0x7fa5a40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a3fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa5a4141fe0 0x7fa5a4142450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a3fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a4145180 con 0x7fa5a40b5570 2020-10-31T22:43:29.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a3fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a40afae0 con 0x7fa5a4141fe0 2020-10-31T22:43:29.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a3fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4141bf0 con 0x7fa5a40b24a0 2020-10-31T22:43:29.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a2ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa5a40b5570 0x7fa5a4145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47650/0 (socket says 172.21.15.60:47650) 2020-10-31T22:43:29.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a2ffd700 1 -- 172.21.15.60:0/199829302 learned_addr learned my addr 172.21.15.60:0/199829302 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:29.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a37fe700 1 --2- 172.21.15.60:0/199829302 >> v2:172.21.15.66:3300/0 conn(0x7fa5a4141fe0 0x7fa5a4142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a27fc700 1 --2- 172.21.15.60:0/199829302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5a40b24a0 0x7fa5a40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 -- 172.21.15.60:0/199829302 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185670056 0 0) 0x7fa5a4145180 con 0x7fa5a40b5570 2020-10-31T22:43:29.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 -- 172.21.15.60:0/199829302 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa584003230 con 0x7fa5a40b5570 2020-10-31T22:43:29.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 -- 172.21.15.60:0/199829302 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1705573035 0 0) 0x7fa584003230 con 0x7fa5a40b5570 2020-10-31T22:43:29.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 -- 172.21.15.60:0/199829302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5a40b24a0 msgr2=0x7fa5a40b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:29.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 --2- 172.21.15.60:0/199829302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5a40b24a0 0x7fa5a40b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 -- 172.21.15.60:0/199829302 >> v2:172.21.15.66:3300/0 conn(0x7fa5a4141fe0 msgr2=0x7fa5a4142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:29.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 --2- 172.21.15.60:0/199829302 >> v2:172.21.15.66:3300/0 conn(0x7fa5a4141fe0 0x7fa5a4142450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 -- 172.21.15.60:0/199829302 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a40b0670 con 0x7fa5a40b5570 2020-10-31T22:43:29.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 -- 172.21.15.60:0/199829302 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fa5940016d0 con 0x7fa5a40b5570 2020-10-31T22:43:29.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 -- 172.21.15.60:0/199829302 >> v1:172.21.15.60:6789/0 conn(0x7fa5a40b5570 legacy=0x7fa5a4145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:29.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 --2- 172.21.15.60:0/199829302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa584003750 0x7fa584003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 --2- 172.21.15.60:0/199829302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5840044d0 0x7fa584004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 --2- 172.21.15.60:0/199829302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5a40b24a0 0x7fa584004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 -- 172.21.15.60:0/199829302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40afae0 con 0x7fa584003750 2020-10-31T22:43:29.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 -- 172.21.15.60:0/199829302 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa584004290 con 0x7fa5840044d0 2020-10-31T22:43:29.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 -- 172.21.15.60:0/199829302 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa58400b720 con 0x7fa5a40b24a0 2020-10-31T22:43:29.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/199829302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa584003750 0x7fa584003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a27fc700 1 --2- 172.21.15.60:0/199829302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5840044d0 0x7fa584004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a37fe700 1 --2- 172.21.15.60:0/199829302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5a40b24a0 0x7fa584004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a2ffd700 1 -- 172.21.15.60:0/199829302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5a40b24a0 msgr2=0x7fa584004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:29.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/199829302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5a40b24a0 0x7fa584004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a2ffd700 1 -- 172.21.15.60:0/199829302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5840044d0 msgr2=0x7fa584004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:29.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/199829302 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5840044d0 0x7fa584004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a2ffd700 1 -- 172.21.15.60:0/199829302 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa584003230 con 0x7fa584003750 2020-10-31T22:43:29.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/199829302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa584003750 0x7fa584003b70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fa5a4061290 tx=0x7fa5a40b0800).ready entity=mon.0 client_cookie=2caa765c23d7fbb5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:29.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 -- 172.21.15.60:0/199829302 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5940070d0 con 0x7fa584003750 2020-10-31T22:43:29.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 -- 172.21.15.60:0/199829302 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa594007230 con 0x7fa584003750 2020-10-31T22:43:29.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a1ffb700 1 -- 172.21.15.60:0/199829302 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5940055e0 con 0x7fa584003750 2020-10-31T22:43:29.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a3fff700 1 -- 172.21.15.60:0/199829302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa584003750 msgr2=0x7fa584003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:29.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a3fff700 1 --2- 172.21.15.60:0/199829302 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa584003750 0x7fa584003b70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fa5a4061290 tx=0x7fa5a40b0800).stop 2020-10-31T22:43:29.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a37fe700 1 -- 172.21.15.60:0/199829302 reap_dead start 2020-10-31T22:43:29.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a3fff700 1 -- 172.21.15.60:0/199829302 shutdown_connections 2020-10-31T22:43:29.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a3fff700 1 -- 172.21.15.60:0/199829302 >> 172.21.15.60:0/199829302 conn(0x7fa5a40b8e90 msgr2=0x7fa5a40b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:29.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a3fff700 1 -- 172.21.15.60:0/199829302 shutdown_connections 2020-10-31T22:43:29.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.503+0000 7fa5a3fff700 1 -- 172.21.15.60:0/199829302 wait complete. 2020-10-31T22:43:29.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a3fff700 1 Processor -- start 2020-10-31T22:43:29.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a3fff700 1 -- start start 2020-10-31T22:43:29.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5a4145970 0x7fa5a4154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a4148d30 0x7fa5a4154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a3fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5a4150b80 0x7fa5a4151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4145d50 con 0x7fa5a4148d30 2020-10-31T22:43:29.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a3fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4140ed0 con 0x7fa5a4150b80 2020-10-31T22:43:29.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a3fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a4141170 con 0x7fa5a4145970 2020-10-31T22:43:29.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a4148d30 0x7fa5a4154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a4148d30 0x7fa5a4154770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43524/0 (socket says 172.21.15.60:43524) 2020-10-31T22:43:29.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a27fc700 1 -- 172.21.15.60:0/689923576 learned_addr learned my addr 172.21.15.60:0/689923576 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:29.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5a4145970 0x7fa5a4154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a37fe700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5a4150b80 0x7fa5a4151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a27fc700 1 -- 172.21.15.60:0/689923576 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5a4145970 msgr2=0x7fa5a4154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:29.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a27fc700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5a4145970 0x7fa5a4154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a27fc700 1 -- 172.21.15.60:0/689923576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5a4150b80 msgr2=0x7fa5a4151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:29.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a27fc700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5a4150b80 0x7fa5a4151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a27fc700 1 -- 172.21.15.60:0/689923576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a4141410 con 0x7fa5a4148d30 2020-10-31T22:43:29.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a37fe700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5a4150b80 0x7fa5a4151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:43:29.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a27fc700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a4148d30 0x7fa5a4154770 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fa58c006750 tx=0x7fa58c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:29.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa59bfff700 1 -- 172.21.15.60:0/689923576 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa58c00f9e0 con 0x7fa5a4148d30 2020-10-31T22:43:29.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa59bfff700 1 -- 172.21.15.60:0/689923576 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c00fb40 con 0x7fa5a4148d30 2020-10-31T22:43:29.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a3fff700 1 -- 172.21.15.60:0/689923576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a41416b0 con 0x7fa5a4148d30 2020-10-31T22:43:29.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa59bfff700 1 -- 172.21.15.60:0/689923576 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa58c00fcb0 con 0x7fa5a4148d30 2020-10-31T22:43:29.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa5a3fff700 1 -- 172.21.15.60:0/689923576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a413fc00 con 0x7fa5a4148d30 2020-10-31T22:43:29.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.507+0000 7fa59bfff700 1 -- 172.21.15.60:0/689923576 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa58c024070 con 0x7fa5a4148d30 2020-10-31T22:43:29.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.511+0000 7fa59bfff700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa588054f10 0x7fa5880573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.511+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa588054f10 0x7fa5880573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.511+0000 7fa59bfff700 1 -- 172.21.15.60:0/689923576 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa58c06e360 con 0x7fa5a4148d30 2020-10-31T22:43:29.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.511+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa588054f10 0x7fa5880573d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fa594006000 tx=0x7fa594015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:29.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 Processor -- start 2020-10-31T22:43:29.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 -- start start 2020-10-31T22:43:29.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xcf7b10 0xd43640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xb60800 0xd7a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xaf2c00 0xd7a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0xbfd230 con 0xcf7b10 2020-10-31T22:43:29.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0xc6cdd0 con 0xaf2c00 2020-10-31T22:43:29.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0xb79690 con 0xb60800 2020-10-31T22:43:29.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xcf7b10 0xd43640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xcf7b10 0xd43640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43532/0 (socket says 172.21.15.60:43532) 2020-10-31T22:43:29.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a2ffd700 1 -- 172.21.15.60:0/2303658595 learned_addr learned my addr 172.21.15.60:0/2303658595 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:29.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a27fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xb60800 0xd7a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a37fe700 1 --2- 172.21.15.60:0/2303658595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xaf2c00 0xd7a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a2ffd700 1 -- 172.21.15.60:0/2303658595 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xb60800 msgr2=0xd7a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:29.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/2303658595 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xb60800 0xd7a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a2ffd700 1 -- 172.21.15.60:0/2303658595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xaf2c00 msgr2=0xd7a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:29.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/2303658595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xaf2c00 0xd7a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a2ffd700 1 -- 172.21.15.60:0/2303658595 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xc8db90 con 0xcf7b10 2020-10-31T22:43:29.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a37fe700 1 --2- 172.21.15.60:0/2303658595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xaf2c00 0xd7a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:29.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a27fc700 1 --2- 172.21.15.60:0/2303658595 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xb60800 0xd7a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:29.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/2303658595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xcf7b10 0xd43640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fa59401a000 tx=0x7fa59401b000).ready entity=mon.0 client_cookie=d172c3e4c56e3687 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:29.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a3fff700 1 -- 172.21.15.60:0/2303658595 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5940017e0 con 0xcf7b10 2020-10-31T22:43:29.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a3fff700 1 -- 172.21.15.60:0/2303658595 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa594026070 con 0xcf7b10 2020-10-31T22:43:29.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5a3fff700 1 -- 172.21.15.60:0/2303658595 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5940047a0 con 0xcf7b10 2020-10-31T22:43:29.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 -- 172.21.15.60:0/2303658595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xcf7b10 msgr2=0xd43640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:29.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/2303658595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xcf7b10 0xd43640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7fa59401a000 tx=0x7fa59401b000).stop 2020-10-31T22:43:29.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 -- 172.21.15.60:0/2303658595 shutdown_connections 2020-10-31T22:43:29.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/2303658595 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xaf2c00 0xd7a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/2303658595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xcf7b10 0xd43640 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/2303658595 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xb60800 0xd7a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 -- 172.21.15.60:0/2303658595 >> 172.21.15.60:0/2303658595 conn(0xd27710 msgr2=0xd3f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:29.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 -- 172.21.15.60:0/2303658595 shutdown_connections 2020-10-31T22:43:29.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.515+0000 7fa5b7ece740 1 -- 172.21.15.60:0/2303658595 wait complete. 2020-10-31T22:43:29.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 1 -- start start 2020-10-31T22:43:29.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 1 Processor -- start 2020-10-31T22:43:29.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xaf2c00 0xd43740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xb60800 0xd78de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xcf7b10 0xd748f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0xc9c840 con 0xb60800 2020-10-31T22:43:29.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0xc9c980 con 0xaf2c00 2020-10-31T22:43:29.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0xc9df50 con 0xcf7b10 2020-10-31T22:43:29.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 10 client.0 ll_register_callbacks cb 0xc934e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2020-10-31T22:43:29.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5a27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xb60800 0xd78de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5a27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xb60800 0xd78de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43540/0 (socket says 172.21.15.60:43540) 2020-10-31T22:43:29.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5a27fc700 1 -- 172.21.15.60:0/1364761495 learned_addr learned my addr 172.21.15.60:0/1364761495 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:29.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5a37fe700 1 --2- 172.21.15.60:0/1364761495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xcf7b10 0xd748f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/1364761495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xaf2c00 0xd43740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5a27fc700 1 -- 172.21.15.60:0/1364761495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xcf7b10 msgr2=0xd748f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:29.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5a27fc700 1 --2- 172.21.15.60:0/1364761495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xcf7b10 0xd748f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5a27fc700 1 -- 172.21.15.60:0/1364761495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xaf2c00 msgr2=0xd43740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:29.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5a27fc700 1 --2- 172.21.15.60:0/1364761495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xaf2c00 0xd43740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5a27fc700 1 -- 172.21.15.60:0/1364761495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xb10770 con 0xb60800 2020-10-31T22:43:29.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5a27fc700 1 --2- 172.21.15.60:0/1364761495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xb60800 0xd78de0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fa58c01f000 tx=0x7fa58c06e040).ready entity=mon.0 client_cookie=2c151c940bbaaf4c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:29.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa581ffb700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2020-10-31T22:43:29.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa581ffb700 1 -- 172.21.15.60:0/1364761495 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa58c0476b0 con 0xb60800 2020-10-31T22:43:29.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa581ffb700 1 -- 172.21.15.60:0/1364761495 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa58c047810 con 0xb60800 2020-10-31T22:43:29.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 1 -- 172.21.15.60:0/1364761495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xc4d7f0 con 0xb60800 2020-10-31T22:43:29.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa581ffb700 1 -- 172.21.15.60:0/1364761495 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa58c06c9f0 con 0xb60800 2020-10-31T22:43:29.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 10 client.5400 fetch_fsmap learned FSMap version 16 2020-10-31T22:43:29.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 1 -- 172.21.15.60:0/1364761495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0xb1be50 con 0xb60800 2020-10-31T22:43:29.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa581ffb700 1 -- 172.21.15.60:0/1364761495 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xc4d7f0 con 0xb60800 2020-10-31T22:43:29.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa581ffb700 1 -- 172.21.15.60:0/1364761495 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 16) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fa58c01b020 con 0xb60800 2020-10-31T22:43:29.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 10 client.5400 fetch_fsmap finished waiting for FSMap version 16 2020-10-31T22:43:29.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 10 client.5400 resolve_mds: resolved ID 'c' to GID 5199 2020-10-31T22:43:29.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 20 client.5400 populate_metadata read hostname 'smithi060' 2020-10-31T22:43:29.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/1364761495 >> [v2:172.21.15.60:6836/1627192275,v1:172.21.15.60:6837/1627192275] conn(0xd894c0 0xd898a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 4 client.5400 mds_command: new command op to 5199 tid=0[{"prefix": "get_command_descriptions"}] 2020-10-31T22:43:29.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5b7ece740 1 -- 172.21.15.60:0/1364761495 --> [v2:172.21.15.60:6836/1627192275,v1:172.21.15.60:6837/1627192275] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xb858b0 con 0xd894c0 2020-10-31T22:43:29.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/1364761495 >> [v2:172.21.15.60:6836/1627192275,v1:172.21.15.60:6837/1627192275] conn(0xd894c0 0xd898a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/1364761495 >> [v2:172.21.15.60:6836/1627192275,v1:172.21.15.60:6837/1627192275] conn(0xd894c0 0xd898a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=d071e92d8b4315f4 server_cookie=ccd6d59fa56dc135 in_seq=0 out_seq=0 2020-10-31T22:43:29.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.519+0000 7fa581ffb700 10 client.5400 ms_handle_connect on v2:172.21.15.60:6836/1627192275 2020-10-31T22:43:29.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa581ffb700 1 -- 172.21.15.60:0/1364761495 <== mds.0 v2:172.21.15.60:6836/1627192275 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16606 (crc 0 0 0) 0xb858b0 con 0xd894c0 2020-10-31T22:43:29.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa581ffb700 10 client.5400 handle_command_reply: tid=0 2020-10-31T22:43:29.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa5b7ece740 1 client.5400 shutdown 2020-10-31T22:43:29.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa5b7ece740 1 -- 172.21.15.60:0/1364761495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xb60800 msgr2=0xd78de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:29.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/1364761495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xb60800 0xd78de0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fa58c01f000 tx=0x7fa58c06e040).stop 2020-10-31T22:43:29.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa5b7ece740 1 -- 172.21.15.60:0/1364761495 shutdown_connections 2020-10-31T22:43:29.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/1364761495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xcf7b10 0xd748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/1364761495 >> [v2:172.21.15.60:6836/1627192275,v1:172.21.15.60:6837/1627192275] conn(0xd894c0 0xd898a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/1364761495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xaf2c00 0xd43740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa581ffb700 0 client.5400 ms_handle_reset on v2:172.21.15.60:6836/1627192275 2020-10-31T22:43:29.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/1364761495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xb60800 0xd78de0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa5b7ece740 1 -- 172.21.15.60:0/1364761495 >> 172.21.15.60:0/1364761495 conn(0xd27710 msgr2=0xd3f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:29.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa5b7ece740 1 -- 172.21.15.60:0/1364761495 shutdown_connections 2020-10-31T22:43:29.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa5b7ece740 1 -- 172.21.15.60:0/1364761495 wait complete. 2020-10-31T22:43:29.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.523+0000 7fa5b7ece740 20 client.5400 trim_cache size 0 max 16384 2020-10-31T22:43:29.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5b7ece740 1 Processor -- start 2020-10-31T22:43:29.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5b7ece740 1 -- start start 2020-10-31T22:43:29.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5b7ece740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xaf2c00 0xd3e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5b7ece740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xb60800 0xd3f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5b7ece740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xcf7b10 0xd43f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5b7ece740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0xc7f390 con 0xb60800 2020-10-31T22:43:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5b7ece740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0xd77f20 con 0xcf7b10 2020-10-31T22:43:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5b7ece740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0xd47a20 con 0xaf2c00 2020-10-31T22:43:29.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5a27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xb60800 0xd3f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5a27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xb60800 0xd3f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43548/0 (socket says 172.21.15.60:43548) 2020-10-31T22:43:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5a27fc700 1 -- 172.21.15.60:0/4041637809 learned_addr learned my addr 172.21.15.60:0/4041637809 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/4041637809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xaf2c00 0xd3e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5a37fe700 1 --2- 172.21.15.60:0/4041637809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xcf7b10 0xd43f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5a2ffd700 1 -- 172.21.15.60:0/4041637809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xcf7b10 msgr2=0xd43f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/4041637809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xcf7b10 0xd43f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5a2ffd700 1 -- 172.21.15.60:0/4041637809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xb60800 msgr2=0xd3f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/4041637809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xb60800 0xd3f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5a2ffd700 1 -- 172.21.15.60:0/4041637809 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xd26970 con 0xaf2c00 2020-10-31T22:43:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/4041637809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xaf2c00 0xd3e8e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0xd26820 tx=0x7fa594013000).ready entity=mon.2 client_cookie=5a96edefeb63fae5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa583fff700 1 -- 172.21.15.60:0/4041637809 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa594007580 con 0xaf2c00 2020-10-31T22:43:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa583fff700 1 -- 172.21.15.60:0/4041637809 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa594026040 con 0xaf2c00 2020-10-31T22:43:29.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa583fff700 1 -- 172.21.15.60:0/4041637809 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa594001760 con 0xaf2c00 2020-10-31T22:43:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5b7ece740 1 -- 172.21.15.60:0/4041637809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xaf2c00 msgr2=0xd3e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.539+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/4041637809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xaf2c00 0xd3e8e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0xd26820 tx=0x7fa594013000).stop 2020-10-31T22:43:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 -- 172.21.15.60:0/4041637809 shutdown_connections 2020-10-31T22:43:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/4041637809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xcf7b10 0xd43f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/4041637809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xaf2c00 0xd3e8e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/4041637809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xb60800 0xd3f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 -- 172.21.15.60:0/4041637809 >> 172.21.15.60:0/4041637809 conn(0xd27710 msgr2=0xd75300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 -- 172.21.15.60:0/4041637809 shutdown_connections 2020-10-31T22:43:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 -- 172.21.15.60:0/4041637809 wait complete. 2020-10-31T22:43:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 -- start start 2020-10-31T22:43:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 Processor -- start 2020-10-31T22:43:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xaf2c00 0xd442c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xb60800 0xd48c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xcf7b10 0xdd8990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0xd7aff0 con 0xaf2c00 2020-10-31T22:43:29.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0xd78d50 con 0xb60800 2020-10-31T22:43:29.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0xdd8260 con 0xcf7b10 2020-10-31T22:43:29.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 10 client.0 ll_register_callbacks cb 0xd7c2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2020-10-31T22:43:29.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5a2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xaf2c00 0xd442c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5a2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xaf2c00 0xd442c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43552/0 (socket says 172.21.15.60:43552) 2020-10-31T22:43:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5a2ffd700 1 -- 172.21.15.60:0/3908915428 learned_addr learned my addr 172.21.15.60:0/3908915428 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5a37fe700 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xcf7b10 0xdd8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5a27fc700 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xb60800 0xd48c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5a27fc700 1 -- 172.21.15.60:0/3908915428 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xcf7b10 msgr2=0xdd8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5a27fc700 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xcf7b10 0xdd8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5a27fc700 1 -- 172.21.15.60:0/3908915428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xaf2c00 msgr2=0xd442c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5a27fc700 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xaf2c00 0xd442c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5a27fc700 1 -- 172.21.15.60:0/3908915428 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a415b640 con 0xb60800 2020-10-31T22:43:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xaf2c00 0xd442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:29.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5a37fe700 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xcf7b10 0xdd8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:29.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5a27fc700 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xb60800 0xd48c10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0xd48b60 tx=0x7fa58c02b000).ready entity=mon.1 client_cookie=40374d955cb0f489 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:29.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa582ffd700 10 client.0 ms_handle_connect on v2:172.21.15.66:3300/0 2020-10-31T22:43:29.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa582ffd700 1 -- 172.21.15.60:0/3908915428 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa58c0484e0 con 0xb60800 2020-10-31T22:43:29.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa582ffd700 1 -- 172.21.15.60:0/3908915428 <== mon.1 v2:172.21.15.66:3300/0 2 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa58c0468e0 con 0xb60800 2020-10-31T22:43:29.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.543+0000 7fa5b7ece740 1 -- 172.21.15.60:0/3908915428 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xb564b0 con 0xb60800 2020-10-31T22:43:29.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.547+0000 7fa582ffd700 1 -- 172.21.15.60:0/3908915428 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa58c0476b0 con 0xb60800 2020-10-31T22:43:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.547+0000 7fa5b7ece740 10 client.5323 fetch_fsmap learned FSMap version 16 2020-10-31T22:43:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.547+0000 7fa5b7ece740 1 -- 172.21.15.60:0/3908915428 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0xd7af60 con 0xb60800 2020-10-31T22:43:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.547+0000 7fa582ffd700 1 -- 172.21.15.60:0/3908915428 <== mon.1 v2:172.21.15.66:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xb564b0 con 0xb60800 2020-10-31T22:43:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.547+0000 7fa582ffd700 1 -- 172.21.15.60:0/3908915428 <== mon.1 v2:172.21.15.66:3300/0 5 ==== fsmap(e 16) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fa58c01b020 con 0xb60800 2020-10-31T22:43:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.547+0000 7fa5b7ece740 10 client.5323 fetch_fsmap finished waiting for FSMap version 16 2020-10-31T22:43:29.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.547+0000 7fa5b7ece740 10 client.5323 resolve_mds: resolved ID 'c' to GID 5199 2020-10-31T22:43:29.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.547+0000 7fa5b7ece740 20 client.5323 populate_metadata read hostname 'smithi060' 2020-10-31T22:43:29.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.547+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.60:6836/1627192275,v1:172.21.15.60:6837/1627192275] conn(0xd7b7d0 0xdd8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:29.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.547+0000 7fa5b7ece740 4 client.5323 mds_command: new command op to 5199 tid=0[{"prefix": "cache drop"}] 2020-10-31T22:43:29.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.547+0000 7fa5b7ece740 1 -- 172.21.15.60:0/3908915428 --> [v2:172.21.15.60:6836/1627192275,v1:172.21.15.60:6837/1627192275] -- command(tid 0: {"prefix": "cache drop"}) v1 -- 0xba4710 con 0xd7b7d0 2020-10-31T22:43:29.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.547+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.60:6836/1627192275,v1:172.21.15.60:6837/1627192275] conn(0xd7b7d0 0xdd8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:29.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.547+0000 7fa582ffd700 10 client.5323 ms_handle_connect on v2:172.21.15.60:6836/1627192275 2020-10-31T22:43:29.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:29.547+0000 7fa5a2ffd700 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.60:6836/1627192275,v1:172.21.15.60:6837/1627192275] conn(0xd7b7d0 0xdd8e80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=ec0bd6ffca74a89d server_cookie=9b6f466d5f36cf22 in_seq=0 out_seq=0 2020-10-31T22:43:40.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa582ffd700 1 -- 172.21.15.60:0/3908915428 <== mds.0 v2:172.21.15.60:6836/1627192275 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+380 (crc 0 0 0) 0xba4710 con 0xd7b7d0 2020-10-31T22:43:40.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa582ffd700 10 client.5323 handle_command_reply: tid=0 2020-10-31T22:43:40.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5b7ece740 1 client.5323 shutdown 2020-10-31T22:43:40.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5b7ece740 1 -- 172.21.15.60:0/3908915428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xb60800 msgr2=0xd48c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:40.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xb60800 0xd48c10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0xd48b60 tx=0x7fa58c02b000).stop 2020-10-31T22:43:40.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5b7ece740 1 -- 172.21.15.60:0/3908915428 shutdown_connections 2020-10-31T22:43:40.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xcf7b10 0xdd8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:40.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xaf2c00 0xd442c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:40.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.60:6836/1627192275,v1:172.21.15.60:6837/1627192275] conn(0xd7b7d0 0xdd8e80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:40.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5b7ece740 1 --2- 172.21.15.60:0/3908915428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xb60800 0xd48c10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:40.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa582ffd700 0 client.5323 ms_handle_reset on v2:172.21.15.60:6836/1627192275 2020-10-31T22:43:40.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5b7ece740 1 -- 172.21.15.60:0/3908915428 >> 172.21.15.60:0/3908915428 conn(0xd27710 msgr2=0xd3e840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:40.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5b7ece740 1 -- 172.21.15.60:0/3908915428 shutdown_connections 2020-10-31T22:43:40.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5b7ece740 1 -- 172.21.15.60:0/3908915428 wait complete. 2020-10-31T22:43:40.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5b7ece740 20 client.5323 trim_cache size 0 max 16384 2020-10-31T22:43:40.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5a3fff700 1 -- 172.21.15.60:0/689923576 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa588054f10 msgr2=0x7fa5880573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:40.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5a3fff700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa588054f10 0x7fa5880573d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fa594006000 tx=0x7fa594015000).stop 2020-10-31T22:43:40.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5a3fff700 1 -- 172.21.15.60:0/689923576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a4148d30 msgr2=0x7fa5a4154770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:40.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5a3fff700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a4148d30 0x7fa5a4154770 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7fa58c006750 tx=0x7fa58c008040).stop 2020-10-31T22:43:40.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5a3fff700 1 -- 172.21.15.60:0/689923576 shutdown_connections 2020-10-31T22:43:40.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5a3fff700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa588054f10 0x7fa5880573d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:40.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5a3fff700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5a4150b80 0x7fa5a4151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:40.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5a3fff700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5a4145970 0x7fa5a4154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:40.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5a3fff700 1 --2- 172.21.15.60:0/689923576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5a4148d30 0x7fa5a4154770 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:40.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5a3fff700 1 -- 172.21.15.60:0/689923576 >> 172.21.15.60:0/689923576 conn(0x7fa5a40b8e90 msgr2=0x7fa5a40b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:40.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5a3fff700 1 -- 172.21.15.60:0/689923576 shutdown_connections 2020-10-31T22:43:40.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:40.823+0000 7fa5a3fff700 1 -- 172.21.15.60:0/689923576 wait complete. 2020-10-31T22:43:40.830 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:43:40.830 INFO:teuthology.orchestra.run.smithi060.stdout: "client_recall": { 2020-10-31T22:43:40.830 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2020-10-31T22:43:40.830 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "(0) Success", 2020-10-31T22:43:40.830 INFO:teuthology.orchestra.run.smithi060.stdout: "recalled": 220 2020-10-31T22:43:40.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:40.831 INFO:teuthology.orchestra.run.smithi060.stdout: "flush_journal": { 2020-10-31T22:43:40.831 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2020-10-31T22:43:40.831 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "" 2020-10-31T22:43:40.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:40.831 INFO:teuthology.orchestra.run.smithi060.stdout: "trim_cache": { 2020-10-31T22:43:40.831 INFO:teuthology.orchestra.run.smithi060.stdout: "trimmed": 0 2020-10-31T22:43:40.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:40.832 INFO:teuthology.orchestra.run.smithi060.stdout: "cache": { 2020-10-31T22:43:40.832 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": { 2020-10-31T22:43:40.832 INFO:teuthology.orchestra.run.smithi060.stdout: "items": 19991, 2020-10-31T22:43:40.832 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes": 3099744 2020-10-31T22:43:40.832 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:43:40.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:43:40.832 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 11.275867448 2020-10-31T22:43:40.833 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:43:40.838 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2020-10-31T22:43:40.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:40.839 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:43:40.840 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:43:40.847 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2020-10-31T22:43:40.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:43:40.849 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2020-10-31T22:43:40.850 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:43:40.851 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:43:40.851 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:43:40.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:40.927 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:43:40.927 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:43:40.976 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:43:40.977 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:43:40.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:43:40.978 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:43:41.025 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:43:41.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff62668e700 1 Processor -- start 2020-10-31T22:43:41.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff62668e700 1 -- start start 2020-10-31T22:43:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff62668e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff6200b1000 0x7ff6200b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff62668e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6201459c0 con 0x7ff6200b2820 2020-10-31T22:43:41.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff62668e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff620063520 con 0x7ff620063140 2020-10-31T22:43:41.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff62668e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6200b2060 con 0x7ff6200b1000 2020-10-31T22:43:41.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff624e8b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff6200b1000 0x7ff6200b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff625e8d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff6200b2820 0x7ff6200aeda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47702/0 (socket says 172.21.15.60:47702) 2020-10-31T22:43:41.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff625e8d700 1 -- 172.21.15.60:0/1097811409 learned_addr learned my addr 172.21.15.60:0/1097811409 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:41.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff617fff700 1 -- 172.21.15.60:0/1097811409 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1073686059 0 0) 0x7ff6201459c0 con 0x7ff6200b2820 2020-10-31T22:43:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff617fff700 1 -- 172.21.15.60:0/1097811409 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff604003230 con 0x7ff6200b2820 2020-10-31T22:43:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff617fff700 1 -- 172.21.15.60:0/1097811409 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310823435 0 0) 0x7ff620063520 con 0x7ff620063140 2020-10-31T22:43:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff617fff700 1 -- 172.21.15.60:0/1097811409 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6201459c0 con 0x7ff620063140 2020-10-31T22:43:41.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff624e8b700 1 -- 172.21.15.60:0/1097811409 >> v1:172.21.15.66:6789/0 conn(0x7ff620063140 legacy=0x7ff6201452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff624e8b700 1 -- 172.21.15.60:0/1097811409 >> v1:172.21.15.60:6789/0 conn(0x7ff6200b2820 legacy=0x7ff6200aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff624e8b700 1 -- 172.21.15.60:0/1097811409 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6200b02e0 con 0x7ff6200b1000 2020-10-31T22:43:41.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.147+0000 7ff624e8b700 1 --2- 172.21.15.60:0/1097811409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6200b1000 0x7ff6200b09e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7ff610002f30 tx=0x7ff610006dc0).ready entity=mon.0 client_cookie=998eb161e806d562 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:41.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.151+0000 7ff617fff700 1 -- 172.21.15.60:0/1097811409 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6100097d0 con 0x7ff6200b1000 2020-10-31T22:43:41.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.151+0000 7ff617fff700 1 -- 172.21.15.60:0/1097811409 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff610009930 con 0x7ff6200b1000 2020-10-31T22:43:41.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.151+0000 7ff617fff700 1 -- 172.21.15.60:0/1097811409 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff610009c90 con 0x7ff6200b1000 2020-10-31T22:43:41.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.151+0000 7ff62668e700 1 -- 172.21.15.60:0/1097811409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6200b1000 msgr2=0x7ff6200b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.151+0000 7ff62668e700 1 --2- 172.21.15.60:0/1097811409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6200b1000 0x7ff6200b09e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7ff610002f30 tx=0x7ff610006dc0).stop 2020-10-31T22:43:41.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.151+0000 7ff62668e700 1 -- 172.21.15.60:0/1097811409 shutdown_connections 2020-10-31T22:43:41.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.151+0000 7ff62668e700 1 --2- 172.21.15.60:0/1097811409 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6200b1000 0x7ff6200b09e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.151+0000 7ff62668e700 1 -- 172.21.15.60:0/1097811409 >> 172.21.15.60:0/1097811409 conn(0x7ff62006a600 msgr2=0x7ff620060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:41.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.151+0000 7ff62668e700 1 -- 172.21.15.60:0/1097811409 shutdown_connections 2020-10-31T22:43:41.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.151+0000 7ff62668e700 1 -- 172.21.15.60:0/1097811409 wait complete. 2020-10-31T22:43:41.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62668e700 1 Processor -- start 2020-10-31T22:43:41.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62668e700 1 -- start start 2020-10-31T22:43:41.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62668e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620063140 0x7ff6200abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62668e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6200b1000 0x7ff6201405f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62668e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6200b2820 0x7ff620066c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62668e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6200a8510 con 0x7ff620063140 2020-10-31T22:43:41.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62668e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6200a89e0 con 0x7ff6200b1000 2020-10-31T22:43:41.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62668e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff620064460 con 0x7ff6200b2820 2020-10-31T22:43:41.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62568c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620063140 0x7ff6200abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62568c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620063140 0x7ff6200abbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43568/0 (socket says 172.21.15.60:43568) 2020-10-31T22:43:41.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62568c700 1 -- 172.21.15.60:0/3497825218 learned_addr learned my addr 172.21.15.60:0/3497825218 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:41.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff624e8b700 1 --2- 172.21.15.60:0/3497825218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6200b1000 0x7ff6201405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff625e8d700 1 --2- 172.21.15.60:0/3497825218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6200b2820 0x7ff620066c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62568c700 1 -- 172.21.15.60:0/3497825218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6200b2820 msgr2=0x7ff620066c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62568c700 1 --2- 172.21.15.60:0/3497825218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6200b2820 0x7ff620066c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62568c700 1 -- 172.21.15.60:0/3497825218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6200b1000 msgr2=0x7ff6201405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62568c700 1 --2- 172.21.15.60:0/3497825218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6200b1000 0x7ff6201405f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62568c700 1 -- 172.21.15.60:0/3497825218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6200ac1a0 con 0x7ff620063140 2020-10-31T22:43:41.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62568c700 1 --2- 172.21.15.60:0/3497825218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620063140 0x7ff6200abbd0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7ff61c001450 tx=0x7ff61c007da0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:41.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff6167fc700 1 -- 172.21.15.60:0/3497825218 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c002310 con 0x7ff620063140 2020-10-31T22:43:41.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff6167fc700 1 -- 172.21.15.60:0/3497825218 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61c002470 con 0x7ff620063140 2020-10-31T22:43:41.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62668e700 1 -- 172.21.15.60:0/3497825218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6200a8740 con 0x7ff620063140 2020-10-31T22:43:41.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff6167fc700 1 -- 172.21.15.60:0/3497825218 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff61c0017f0 con 0x7ff620063140 2020-10-31T22:43:41.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.155+0000 7ff62668e700 1 -- 172.21.15.60:0/3497825218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6200677c0 con 0x7ff620063140 2020-10-31T22:43:41.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.159+0000 7ff62668e700 1 -- 172.21.15.60:0/3497825218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6200ac330 con 0x7ff620063140 2020-10-31T22:43:41.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.159+0000 7ff6167fc700 1 -- 172.21.15.60:0/3497825218 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff61c019030 con 0x7ff620063140 2020-10-31T22:43:41.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.159+0000 7ff6167fc700 1 --2- 172.21.15.60:0/3497825218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff6080550c0 0x7ff608057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.159+0000 7ff6167fc700 1 -- 172.21.15.60:0/3497825218 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff61c06d160 con 0x7ff620063140 2020-10-31T22:43:41.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.159+0000 7ff624e8b700 1 --2- 172.21.15.60:0/3497825218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff6080550c0 0x7ff608057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.159+0000 7ff624e8b700 1 --2- 172.21.15.60:0/3497825218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff6080550c0 0x7ff608057580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7ff61001b000 tx=0x7ff610015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:41.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.167+0000 7ff6167fc700 1 -- 172.21.15.60:0/3497825218 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff61c043680 con 0x7ff620063140 2020-10-31T22:43:41.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.311+0000 7ff62668e700 1 -- 172.21.15.60:0/3497825218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff620057100 con 0x7ff620063140 2020-10-31T22:43:41.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.315+0000 7ff6167fc700 1 -- 172.21.15.60:0/3497825218 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+16038 (secure 0 0 0) 0x7ff61c046ca0 con 0x7ff620063140 2020-10-31T22:43:41.316 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:41.317 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":44,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:43:09.336217+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:43:06.097368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":8,"pool_name":"cephfs_data","create_time":"2020-10-31T22:43:07.332204+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:43:41.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.315+0000 7ff62668e700 1 -- 172.21.15.60:0/3497825218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff6080550c0 msgr2=0x7ff608057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.315+0000 7ff62668e700 1 --2- 172.21.15.60:0/3497825218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff6080550c0 0x7ff608057580 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7ff61001b000 tx=0x7ff610015000).stop 2020-10-31T22:43:41.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.315+0000 7ff62668e700 1 -- 172.21.15.60:0/3497825218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620063140 msgr2=0x7ff6200abbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.315+0000 7ff62668e700 1 --2- 172.21.15.60:0/3497825218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620063140 0x7ff6200abbd0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7ff61c001450 tx=0x7ff61c007da0).stop 2020-10-31T22:43:41.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.315+0000 7ff62668e700 1 -- 172.21.15.60:0/3497825218 shutdown_connections 2020-10-31T22:43:41.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.315+0000 7ff62668e700 1 --2- 172.21.15.60:0/3497825218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6200b2820 0x7ff620066c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.315+0000 7ff62668e700 1 --2- 172.21.15.60:0/3497825218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff620063140 0x7ff6200abbd0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.315+0000 7ff62668e700 1 --2- 172.21.15.60:0/3497825218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff6080550c0 0x7ff608057580 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.315+0000 7ff62668e700 1 --2- 172.21.15.60:0/3497825218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6200b1000 0x7ff6201405f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.315+0000 7ff62668e700 1 -- 172.21.15.60:0/3497825218 >> 172.21.15.60:0/3497825218 conn(0x7ff62006a600 msgr2=0x7ff6200b4860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:41.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.315+0000 7ff62668e700 1 -- 172.21.15.60:0/3497825218 shutdown_connections 2020-10-31T22:43:41.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.315+0000 7ff62668e700 1 -- 172.21.15.60:0/3497825218 wait complete. 2020-10-31T22:43:41.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 7, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:43:06.097368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 8, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:43:07.332204+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:43:41.330 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:43:41.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 Processor -- start 2020-10-31T22:43:41.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 -- start start 2020-10-31T22:43:41.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb2040b1d50 0x7fb204145c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20405bc60 0x7fb20413f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2040aef60 con 0x7fb20405c2d0 2020-10-31T22:43:41.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2040afb20 con 0x7fb2040b1d50 2020-10-31T22:43:41.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2040b2130 con 0x7fb20405bc60 2020-10-31T22:43:41.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb208f0c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb20405c2d0 0x7fb2040af410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47714/0 (socket says 172.21.15.60:47714) 2020-10-31T22:43:41.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb208f0c700 1 -- 172.21.15.60:0/3010037797 learned_addr learned my addr 172.21.15.60:0/3010037797 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:43:41.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20970d700 1 --2- 172.21.15.60:0/3010037797 >> v2:172.21.15.60:3300/0 conn(0x7fb2040b1d50 0x7fb204145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb209f0e700 1 --2- 172.21.15.60:0/3010037797 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20405bc60 0x7fb20413f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb1fbfff700 1 -- 172.21.15.60:0/3010037797 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904475852 0 0) 0x7fb1f40010d0 con 0x7fb20405c2d0 2020-10-31T22:43:41.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb1fbfff700 1 -- 172.21.15.60:0/3010037797 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1e8003230 con 0x7fb20405c2d0 2020-10-31T22:43:41.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20970d700 1 -- 172.21.15.60:0/3010037797 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20405bc60 msgr2=0x7fb20413f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:41.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20970d700 1 --2- 172.21.15.60:0/3010037797 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20405bc60 0x7fb20413f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20970d700 1 -- 172.21.15.60:0/3010037797 >> v1:172.21.15.60:6789/0 conn(0x7fb20405c2d0 legacy=0x7fb2040af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20970d700 1 -- 172.21.15.60:0/3010037797 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20405c0b0 con 0x7fb2040b1d50 2020-10-31T22:43:41.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20970d700 1 --2- 172.21.15.60:0/3010037797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2040b1d50 0x7fb204145c70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fb200002f30 tx=0x7fb200006dc0).ready entity=mon.0 client_cookie=1dd9acff847320a0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:41.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb1fbfff700 1 -- 172.21.15.60:0/3010037797 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2000096a0 con 0x7fb2040b1d50 2020-10-31T22:43:41.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb1fbfff700 1 -- 172.21.15.60:0/3010037797 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb200009800 con 0x7fb2040b1d50 2020-10-31T22:43:41.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb1fbfff700 1 -- 172.21.15.60:0/3010037797 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb200009b60 con 0x7fb2040b1d50 2020-10-31T22:43:41.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 -- 172.21.15.60:0/3010037797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2040b1d50 msgr2=0x7fb204145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 --2- 172.21.15.60:0/3010037797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2040b1d50 0x7fb204145c70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7fb200002f30 tx=0x7fb200006dc0).stop 2020-10-31T22:43:41.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 -- 172.21.15.60:0/3010037797 shutdown_connections 2020-10-31T22:43:41.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 --2- 172.21.15.60:0/3010037797 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20405bc60 0x7fb20413f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 --2- 172.21.15.60:0/3010037797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2040b1d50 0x7fb204145c70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 -- 172.21.15.60:0/3010037797 >> 172.21.15.60:0/3010037797 conn(0x7fb2040b5330 msgr2=0x7fb2040b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:41.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 -- 172.21.15.60:0/3010037797 shutdown_connections 2020-10-31T22:43:41.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.443+0000 7fb20a70f700 1 -- 172.21.15.60:0/3010037797 wait complete. 2020-10-31T22:43:41.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb20a70f700 1 Processor -- start 2020-10-31T22:43:41.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb20a70f700 1 -- start start 2020-10-31T22:43:41.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb20a70f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20405bc60 0x7fb20413fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb20a70f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20405c2d0 0x7fb204147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb20a70f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2040b1d50 0x7fb20413aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb20a70f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb204148310 con 0x7fb20405c2d0 2020-10-31T22:43:41.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb20a70f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2041487d0 con 0x7fb2040b1d50 2020-10-31T22:43:41.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb20a70f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb204148a70 con 0x7fb20405bc60 2020-10-31T22:43:41.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb208f0c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20405c2d0 0x7fb204147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb208f0c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20405c2d0 0x7fb204147690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43584/0 (socket says 172.21.15.60:43584) 2020-10-31T22:43:41.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb208f0c700 1 -- 172.21.15.60:0/3004311868 learned_addr learned my addr 172.21.15.60:0/3004311868 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:41.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb20970d700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20405bc60 0x7fb20413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb209f0e700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2040b1d50 0x7fb20413aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb208f0c700 1 -- 172.21.15.60:0/3004311868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20405bc60 msgr2=0x7fb20413fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb208f0c700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20405bc60 0x7fb20413fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb208f0c700 1 -- 172.21.15.60:0/3004311868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2040b1d50 msgr2=0x7fb20413aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb208f0c700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2040b1d50 0x7fb20413aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb208f0c700 1 -- 172.21.15.60:0/3004311868 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb204148d10 con 0x7fb20405c2d0 2020-10-31T22:43:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb20970d700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20405bc60 0x7fb20413fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:43:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb208f0c700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20405c2d0 0x7fb204147690 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fb1f4001260 tx=0x7fb1f4007890).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb1fa7fc700 1 -- 172.21.15.60:0/3004311868 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1f40072e0 con 0x7fb20405c2d0 2020-10-31T22:43:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb1fa7fc700 1 -- 172.21.15.60:0/3004311868 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f4007440 con 0x7fb20405c2d0 2020-10-31T22:43:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb20a70f700 1 -- 172.21.15.60:0/3004311868 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2041491b0 con 0x7fb20405c2d0 2020-10-31T22:43:41.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb1fa7fc700 1 -- 172.21.15.60:0/3004311868 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1f40057d0 con 0x7fb20405c2d0 2020-10-31T22:43:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb20a70f700 1 -- 172.21.15.60:0/3004311868 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb204147e00 con 0x7fb20405c2d0 2020-10-31T22:43:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.447+0000 7fb20a70f700 1 -- 172.21.15.60:0/3004311868 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb204057100 con 0x7fb20405c2d0 2020-10-31T22:43:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.451+0000 7fb1fa7fc700 1 -- 172.21.15.60:0/3004311868 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb1f4010070 con 0x7fb20405c2d0 2020-10-31T22:43:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.451+0000 7fb1fa7fc700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb1ec054f10 0x7fb1ec0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.451+0000 7fb1fa7fc700 1 -- 172.21.15.60:0/3004311868 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb1f406cf90 con 0x7fb20405c2d0 2020-10-31T22:43:41.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.451+0000 7fb20970d700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb1ec054f10 0x7fb1ec0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.451+0000 7fb20970d700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb1ec054f10 0x7fb1ec0573d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fb200019000 tx=0x7fb200015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:41.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.455+0000 7fb1fa7fc700 1 -- 172.21.15.60:0/3004311868 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb1f40434b0 con 0x7fb20405c2d0 2020-10-31T22:43:41.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.599+0000 7fb20a70f700 1 -- 172.21.15.60:0/3004311868 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb2040aef60 con 0x7fb20405c2d0 2020-10-31T22:43:41.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.599+0000 7fb1fa7fc700 1 -- 172.21.15.60:0/3004311868 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v44) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb2040aef60 con 0x7fb20405c2d0 2020-10-31T22:43:41.600 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:43:41.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.599+0000 7fb20a70f700 1 -- 172.21.15.60:0/3004311868 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb1ec054f10 msgr2=0x7fb1ec0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.599+0000 7fb20a70f700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb1ec054f10 0x7fb1ec0573d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7fb200019000 tx=0x7fb200015000).stop 2020-10-31T22:43:41.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.599+0000 7fb20a70f700 1 -- 172.21.15.60:0/3004311868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20405c2d0 msgr2=0x7fb204147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.599+0000 7fb20a70f700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20405c2d0 0x7fb204147690 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7fb1f4001260 tx=0x7fb1f4007890).stop 2020-10-31T22:43:41.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.599+0000 7fb20a70f700 1 -- 172.21.15.60:0/3004311868 shutdown_connections 2020-10-31T22:43:41.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.599+0000 7fb20a70f700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb1ec054f10 0x7fb1ec0573d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.599+0000 7fb20a70f700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2040b1d50 0x7fb20413aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.599+0000 7fb20a70f700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20405bc60 0x7fb20413fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.599+0000 7fb20a70f700 1 --2- 172.21.15.60:0/3004311868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb20405c2d0 0x7fb204147690 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.599+0000 7fb20a70f700 1 -- 172.21.15.60:0/3004311868 >> 172.21.15.60:0/3004311868 conn(0x7fb2040b5330 msgr2=0x7fb2040afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:41.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.599+0000 7fb20a70f700 1 -- 172.21.15.60:0/3004311868 shutdown_connections 2020-10-31T22:43:41.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.599+0000 7fb20a70f700 1 -- 172.21.15.60:0/3004311868 wait complete. 2020-10-31T22:43:41.612 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:43:41.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 Processor -- start 2020-10-31T22:43:41.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 -- start start 2020-10-31T22:43:41.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa640b5570 0x7faa640b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faa640b24a0 0x7faa64145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7faa64145e40 0x7faa64141f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa6413f930 con 0x7faa640b24a0 2020-10-31T22:43:41.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa640b4440 con 0x7faa64145e40 2020-10-31T22:43:41.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa640b02f0 con 0x7faa640b5570 2020-10-31T22:43:41.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa5bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faa640b24a0 0x7faa64145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa5bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faa640b24a0 0x7faa64145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43594/0 (socket says 172.21.15.60:43594) 2020-10-31T22:43:41.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa5bfff700 1 -- 172.21.15.60:0/4169088902 learned_addr learned my addr 172.21.15.60:0/4169088902 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:41.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa63fff700 1 --2- 172.21.15.60:0/4169088902 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa640b5570 0x7faa640b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa68873700 1 --2- 172.21.15.60:0/4169088902 >> v2:172.21.15.66:3300/0 conn(0x7faa64145e40 0x7faa64141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa5bfff700 1 -- 172.21.15.60:0/4169088902 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa640b5570 msgr2=0x7faa640b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:41.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa5bfff700 1 --2- 172.21.15.60:0/4169088902 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa640b5570 0x7faa640b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa5bfff700 1 -- 172.21.15.60:0/4169088902 >> v2:172.21.15.66:3300/0 conn(0x7faa64145e40 msgr2=0x7faa64141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:41.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa5bfff700 1 --2- 172.21.15.60:0/4169088902 >> v2:172.21.15.66:3300/0 conn(0x7faa64145e40 0x7faa64141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa5bfff700 1 -- 172.21.15.60:0/4169088902 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa640b0590 con 0x7faa640b24a0 2020-10-31T22:43:41.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa5bfff700 1 --2- 172.21.15.60:0/4169088902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa640b24a0 0x7faa64145950 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7faa64141c20 tx=0x7faa4c006e80).ready entity=mon.0 client_cookie=4feb195b67f07f86 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:41.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa637fe700 1 -- 172.21.15.60:0/4169088902 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa4c009600 con 0x7faa640b24a0 2020-10-31T22:43:41.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa637fe700 1 -- 172.21.15.60:0/4169088902 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c009760 con 0x7faa640b24a0 2020-10-31T22:43:41.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa637fe700 1 -- 172.21.15.60:0/4169088902 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa4c009ac0 con 0x7faa640b24a0 2020-10-31T22:43:41.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 -- 172.21.15.60:0/4169088902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa640b24a0 msgr2=0x7faa64145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 --2- 172.21.15.60:0/4169088902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa640b24a0 0x7faa64145950 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7faa64141c20 tx=0x7faa4c006e80).stop 2020-10-31T22:43:41.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 -- 172.21.15.60:0/4169088902 shutdown_connections 2020-10-31T22:43:41.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 --2- 172.21.15.60:0/4169088902 >> v2:172.21.15.66:3300/0 conn(0x7faa64145e40 0x7faa64141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 --2- 172.21.15.60:0/4169088902 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa640b5570 0x7faa640b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 --2- 172.21.15.60:0/4169088902 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa640b24a0 0x7faa64145950 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 -- 172.21.15.60:0/4169088902 >> 172.21.15.60:0/4169088902 conn(0x7faa640b8e90 msgr2=0x7faa640b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:41.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 -- 172.21.15.60:0/4169088902 shutdown_connections 2020-10-31T22:43:41.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.727+0000 7faa69074700 1 -- 172.21.15.60:0/4169088902 wait complete. 2020-10-31T22:43:41.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa69074700 1 Processor -- start 2020-10-31T22:43:41.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa69074700 1 -- start start 2020-10-31T22:43:41.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa69074700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa640b24a0 0x7faa641444d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa69074700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa640b5570 0x7faa640b7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa69074700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa64145e40 0x7faa64142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa69074700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa640af2c0 con 0x7faa64145e40 2020-10-31T22:43:41.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa69074700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa64145170 con 0x7faa640b5570 2020-10-31T22:43:41.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa69074700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa64144c30 con 0x7faa640b24a0 2020-10-31T22:43:41.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa68873700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa64145e40 0x7faa64142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa68873700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa64145e40 0x7faa64142f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43600/0 (socket says 172.21.15.60:43600) 2020-10-31T22:43:41.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa68873700 1 -- 172.21.15.60:0/4221442082 learned_addr learned my addr 172.21.15.60:0/4221442082 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:41.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa5bfff700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa640b5570 0x7faa640b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa63fff700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa640b24a0 0x7faa641444d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa68873700 1 -- 172.21.15.60:0/4221442082 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa640b24a0 msgr2=0x7faa641444d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa68873700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa640b24a0 0x7faa641444d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa68873700 1 -- 172.21.15.60:0/4221442082 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa640b5570 msgr2=0x7faa640b7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa68873700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa640b5570 0x7faa640b7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa68873700 1 -- 172.21.15.60:0/4221442082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64144ed0 con 0x7faa64145e40 2020-10-31T22:43:41.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa63fff700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa640b24a0 0x7faa641444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:43:41.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa68873700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa64145e40 0x7faa64142f70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7faa5c006dd0 tx=0x7faa5c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:41.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa61ffb700 1 -- 172.21.15.60:0/4221442082 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa5c00ca00 con 0x7faa64145e40 2020-10-31T22:43:41.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa61ffb700 1 -- 172.21.15.60:0/4221442082 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5c00cb60 con 0x7faa64145e40 2020-10-31T22:43:41.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa69074700 1 -- 172.21.15.60:0/4221442082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa641542d0 con 0x7faa64145e40 2020-10-31T22:43:41.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa61ffb700 1 -- 172.21.15.60:0/4221442082 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa5c0123f0 con 0x7faa64145e40 2020-10-31T22:43:41.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.731+0000 7faa69074700 1 -- 172.21.15.60:0/4221442082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa64144110 con 0x7faa64145e40 2020-10-31T22:43:41.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.735+0000 7faa69074700 1 -- 172.21.15.60:0/4221442082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa64057100 con 0x7faa64145e40 2020-10-31T22:43:41.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.735+0000 7faa61ffb700 1 -- 172.21.15.60:0/4221442082 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7faa5c022070 con 0x7faa64145e40 2020-10-31T22:43:41.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.735+0000 7faa61ffb700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa48054f90 0x7faa48057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:41.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.735+0000 7faa61ffb700 1 -- 172.21.15.60:0/4221442082 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faa5c06e0c0 con 0x7faa64145e40 2020-10-31T22:43:41.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.735+0000 7faa63fff700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa48054f90 0x7faa48057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:41.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.735+0000 7faa63fff700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa48054f90 0x7faa48057450 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7faa5400b000 tx=0x7faa54008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:41.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.739+0000 7faa61ffb700 1 -- 172.21.15.60:0/4221442082 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7faa5c0445e0 con 0x7faa64145e40 2020-10-31T22:43:41.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.883+0000 7faa69074700 1 -- 172.21.15.60:0/4221442082 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faa640b3fb0 con 0x7faa64145e40 2020-10-31T22:43:41.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.883+0000 7faa61ffb700 1 -- 172.21.15.60:0/4221442082 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v44) v1 ==== 92+0+10 (secure 0 0 0) 0x7faa5c016030 con 0x7faa64145e40 2020-10-31T22:43:41.886 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:43:41.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.887+0000 7faa69074700 1 -- 172.21.15.60:0/4221442082 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa48054f90 msgr2=0x7faa48057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.887+0000 7faa69074700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa48054f90 0x7faa48057450 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7faa5400b000 tx=0x7faa54008040).stop 2020-10-31T22:43:41.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.887+0000 7faa69074700 1 -- 172.21.15.60:0/4221442082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa64145e40 msgr2=0x7faa64142f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:41.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.887+0000 7faa69074700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa64145e40 0x7faa64142f70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7faa5c006dd0 tx=0x7faa5c0091a0).stop 2020-10-31T22:43:41.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.887+0000 7faa69074700 1 -- 172.21.15.60:0/4221442082 shutdown_connections 2020-10-31T22:43:41.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.887+0000 7faa69074700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa64145e40 0x7faa64142f70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.887+0000 7faa69074700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa640b24a0 0x7faa641444d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.887+0000 7faa69074700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa48054f90 0x7faa48057450 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.887+0000 7faa69074700 1 --2- 172.21.15.60:0/4221442082 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa640b5570 0x7faa640b7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:41.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.887+0000 7faa69074700 1 -- 172.21.15.60:0/4221442082 >> 172.21.15.60:0/4221442082 conn(0x7faa640b8e90 msgr2=0x7faa640b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:41.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.887+0000 7faa69074700 1 -- 172.21.15.60:0/4221442082 shutdown_connections 2020-10-31T22:43:41.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:41.887+0000 7faa69074700 1 -- 172.21.15.60:0/4221442082 wait complete. 2020-10-31T22:43:41.900 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:43:42.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe3217a9700 1 Processor -- start 2020-10-31T22:43:42.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe3217a9700 1 -- start start 2020-10-31T22:43:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe3217a9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31c0acc60 0x7fe31c0b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe3217a9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe31c0ad610 0x7fe31c0ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe3217a9700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31c05b700 con 0x7fe31c05b320 2020-10-31T22:43:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe3217a9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31c140750 con 0x7fe31c0ad610 2020-10-31T22:43:42.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe3217a9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c0b0340 con 0x7fe31c0acc60 2020-10-31T22:43:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe320fa8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe31c0ad610 0x7fe31c0ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe320fa8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe31c0ad610 0x7fe31c0ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43608/0 (socket says 172.21.15.60:43608) 2020-10-31T22:43:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe31bfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe31c05b320 0x7fe31c0b1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47740/0 (socket says 172.21.15.60:47740) 2020-10-31T22:43:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe320fa8700 1 -- 172.21.15.60:0/2987341376 learned_addr learned my addr 172.21.15.60:0/2987341376 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe313fff700 1 --2- 172.21.15.60:0/2987341376 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31c0acc60 0x7fe31c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe320fa8700 1 -- 172.21.15.60:0/2987341376 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31c0acc60 msgr2=0x7fe31c0b24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:42.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe320fa8700 1 --2- 172.21.15.60:0/2987341376 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31c0acc60 0x7fe31c0b24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe320fa8700 1 -- 172.21.15.60:0/2987341376 >> v1:172.21.15.60:6789/0 conn(0x7fe31c05b320 legacy=0x7fe31c0b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe31b7fe700 1 -- 172.21.15.60:0/2987341376 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629468508 0 0) 0x7fe31c05b700 con 0x7fe31c05b320 2020-10-31T22:43:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe320fa8700 1 -- 172.21.15.60:0/2987341376 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c0b05e0 con 0x7fe31c0ad610 2020-10-31T22:43:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.019+0000 7fe320fa8700 1 --2- 172.21.15.60:0/2987341376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe31c0ad610 0x7fe31c0ada70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fe3140032b0 tx=0x7fe314009270).ready entity=mon.0 client_cookie=4b256bf2df0fe0ec server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.023+0000 7fe31b7fe700 1 -- 172.21.15.60:0/2987341376 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe31400bc00 con 0x7fe31c0ad610 2020-10-31T22:43:42.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.023+0000 7fe31b7fe700 1 -- 172.21.15.60:0/2987341376 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31400bd60 con 0x7fe31c0ad610 2020-10-31T22:43:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.023+0000 7fe31b7fe700 1 -- 172.21.15.60:0/2987341376 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe314011400 con 0x7fe31c0ad610 2020-10-31T22:43:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.023+0000 7fe3217a9700 1 -- 172.21.15.60:0/2987341376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe31c0ad610 msgr2=0x7fe31c0ada70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.023+0000 7fe3217a9700 1 --2- 172.21.15.60:0/2987341376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe31c0ad610 0x7fe31c0ada70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7fe3140032b0 tx=0x7fe314009270).stop 2020-10-31T22:43:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.023+0000 7fe3217a9700 1 -- 172.21.15.60:0/2987341376 shutdown_connections 2020-10-31T22:43:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.023+0000 7fe3217a9700 1 --2- 172.21.15.60:0/2987341376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe31c0ad610 0x7fe31c0ada70 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.023+0000 7fe3217a9700 1 --2- 172.21.15.60:0/2987341376 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31c0acc60 0x7fe31c0b24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.023+0000 7fe3217a9700 1 -- 172.21.15.60:0/2987341376 >> 172.21.15.60:0/2987341376 conn(0x7fe31c0b61d0 msgr2=0x7fe31c0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.023+0000 7fe3217a9700 1 -- 172.21.15.60:0/2987341376 shutdown_connections 2020-10-31T22:43:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.023+0000 7fe3217a9700 1 -- 172.21.15.60:0/2987341376 wait complete. 2020-10-31T22:43:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.023+0000 7fe3217a9700 1 Processor -- start 2020-10-31T22:43:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.023+0000 7fe3217a9700 1 -- start start 2020-10-31T22:43:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe3217a9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31c05b320 0x7fe31c0b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe3217a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe31c0acc60 0x7fe31c0645c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe3217a9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe31c0ad610 0x7fe31c064ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe3217a9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c142f50 con 0x7fe31c0acc60 2020-10-31T22:43:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe3217a9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c141140 con 0x7fe31c0ad610 2020-10-31T22:43:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe3217a9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c141830 con 0x7fe31c05b320 2020-10-31T22:43:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe313fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe31c0acc60 0x7fe31c0645c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe313fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe31c0acc60 0x7fe31c0645c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43612/0 (socket says 172.21.15.60:43612) 2020-10-31T22:43:42.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe313fff700 1 -- 172.21.15.60:0/1256179305 learned_addr learned my addr 172.21.15.60:0/1256179305 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:42.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe31bfff700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31c05b320 0x7fe31c0b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe320fa8700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe31c0ad610 0x7fe31c064ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe313fff700 1 -- 172.21.15.60:0/1256179305 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31c05b320 msgr2=0x7fe31c0b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe313fff700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31c05b320 0x7fe31c0b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe313fff700 1 -- 172.21.15.60:0/1256179305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe31c0ad610 msgr2=0x7fe31c064ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe313fff700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe31c0ad610 0x7fe31c064ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe313fff700 1 -- 172.21.15.60:0/1256179305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c141ad0 con 0x7fe31c0acc60 2020-10-31T22:43:42.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe31bfff700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31c05b320 0x7fe31c0b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:43:42.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe320fa8700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe31c0ad610 0x7fe31c064ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:43:42.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe313fff700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe31c0acc60 0x7fe31c0645c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fe30c00a000 tx=0x7fe30c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:42.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe319ffb700 1 -- 172.21.15.60:0/1256179305 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe30c009980 con 0x7fe31c0acc60 2020-10-31T22:43:42.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe319ffb700 1 -- 172.21.15.60:0/1256179305 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c009ae0 con 0x7fe31c0acc60 2020-10-31T22:43:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe3217a9700 1 -- 172.21.15.60:0/1256179305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31c141d70 con 0x7fe31c0acc60 2020-10-31T22:43:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe319ffb700 1 -- 172.21.15.60:0/1256179305 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe30c009e40 con 0x7fe31c0acc60 2020-10-31T22:43:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe3217a9700 1 -- 172.21.15.60:0/1256179305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31c13cfa0 con 0x7fe31c0acc60 2020-10-31T22:43:42.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe3217a9700 1 -- 172.21.15.60:0/1256179305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31c057100 con 0x7fe31c0acc60 2020-10-31T22:43:42.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.027+0000 7fe319ffb700 1 -- 172.21.15.60:0/1256179305 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe30c013480 con 0x7fe31c0acc60 2020-10-31T22:43:42.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.031+0000 7fe319ffb700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe300054f10 0x7fe3000573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.031+0000 7fe319ffb700 1 -- 172.21.15.60:0/1256179305 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe30c06e1d0 con 0x7fe31c0acc60 2020-10-31T22:43:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.031+0000 7fe31bfff700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe300054f10 0x7fe3000573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.031+0000 7fe31bfff700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe300054f10 0x7fe3000573d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fe30400b000 tx=0x7fe3040070d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.035+0000 7fe319ffb700 1 -- 172.21.15.60:0/1256179305 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe30c044690 con 0x7fe31c0acc60 2020-10-31T22:43:42.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.179+0000 7fe3217a9700 1 -- 172.21.15.60:0/1256179305 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe31c0b6aa0 con 0x7fe31c0acc60 2020-10-31T22:43:42.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.179+0000 7fe319ffb700 1 -- 172.21.15.60:0/1256179305 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe30c047cb0 con 0x7fe31c0acc60 2020-10-31T22:43:42.181 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:43:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.183+0000 7fe3217a9700 1 -- 172.21.15.60:0/1256179305 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe300054f10 msgr2=0x7fe3000573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.183+0000 7fe3217a9700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe300054f10 0x7fe3000573d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fe30400b000 tx=0x7fe3040070d0).stop 2020-10-31T22:43:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.183+0000 7fe3217a9700 1 -- 172.21.15.60:0/1256179305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe31c0acc60 msgr2=0x7fe31c0645c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.183+0000 7fe3217a9700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe31c0acc60 0x7fe31c0645c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7fe30c00a000 tx=0x7fe30c008040).stop 2020-10-31T22:43:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.183+0000 7fe3217a9700 1 -- 172.21.15.60:0/1256179305 shutdown_connections 2020-10-31T22:43:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.183+0000 7fe3217a9700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe300054f10 0x7fe3000573d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.183+0000 7fe3217a9700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe31c0ad610 0x7fe31c064ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.183+0000 7fe3217a9700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31c05b320 0x7fe31c0b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.183+0000 7fe3217a9700 1 --2- 172.21.15.60:0/1256179305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe31c0acc60 0x7fe31c0645c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.183+0000 7fe3217a9700 1 -- 172.21.15.60:0/1256179305 >> 172.21.15.60:0/1256179305 conn(0x7fe31c0b61d0 msgr2=0x7fe31c13e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:42.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.183+0000 7fe3217a9700 1 -- 172.21.15.60:0/1256179305 shutdown_connections 2020-10-31T22:43:42.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.183+0000 7fe3217a9700 1 -- 172.21.15.60:0/1256179305 wait complete. 2020-10-31T22:43:42.200 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:43:42.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.315+0000 7f96c0c9a700 1 Processor -- start 2020-10-31T22:43:42.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.315+0000 7f96c0c9a700 1 -- start start 2020-10-31T22:43:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96c0c9a700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f96bc0ac990 0x7f96bc13ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96c0c9a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96bc0ae030 0x7f96bc0a7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96c0c9a700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96bc05bf90 con 0x7f96bc05bbb0 2020-10-31T22:43:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96c0c9a700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96bc0ab410 con 0x7f96bc0ac990 2020-10-31T22:43:42.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96c0c9a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc0ab600 con 0x7f96bc0ae030 2020-10-31T22:43:42.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96bbfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96bc0ae030 0x7f96bc0a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96b2ffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f96bc0ac990 0x7f96bc13ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96bbfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96bc0ae030 0x7f96bc0a7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:56810/0 (socket says 172.21.15.60:56810) 2020-10-31T22:43:42.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96b2ffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f96bc0ac990 0x7f96bc13ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:54554/0 (socket says 172.21.15.60:54554) 2020-10-31T22:43:42.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96bbfff700 1 -- 172.21.15.60:0/1766749252 learned_addr learned my addr 172.21.15.60:0/1766749252 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:42.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96b2ffd700 1 -- 172.21.15.60:0/1766749252 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96bc0ae030 msgr2=0x7f96bc0a7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:42.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96b2ffd700 1 --2- 172.21.15.60:0/1766749252 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96bc0ae030 0x7f96bc0a7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96b2ffd700 1 -- 172.21.15.60:0/1766749252 >> v1:172.21.15.66:6789/0 conn(0x7f96bc05bbb0 legacy=0x7f96bc0ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96b2ffd700 1 -- 172.21.15.60:0/1766749252 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc0ab8a0 con 0x7f96bc0ac990 2020-10-31T22:43:42.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96b2ffd700 1 --2- 172.21.15.60:0/1766749252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96bc0ac990 0x7f96bc13ecf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f96a4002f30 tx=0x7f96a4006dc0).ready entity=mon.1 client_cookie=381500fcf5947cf5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:42.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96baffd700 1 -- 172.21.15.60:0/1766749252 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96a40099e0 con 0x7f96bc0ac990 2020-10-31T22:43:42.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96baffd700 1 -- 172.21.15.60:0/1766749252 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a4009b40 con 0x7f96bc0ac990 2020-10-31T22:43:42.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96baffd700 1 -- 172.21.15.60:0/1766749252 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96a4009ea0 con 0x7f96bc0ac990 2020-10-31T22:43:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96c0c9a700 1 -- 172.21.15.60:0/1766749252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96bc0ac990 msgr2=0x7f96bc13ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96c0c9a700 1 --2- 172.21.15.60:0/1766749252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96bc0ac990 0x7f96bc13ecf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7f96a4002f30 tx=0x7f96a4006dc0).stop 2020-10-31T22:43:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96c0c9a700 1 -- 172.21.15.60:0/1766749252 shutdown_connections 2020-10-31T22:43:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96c0c9a700 1 --2- 172.21.15.60:0/1766749252 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96bc0ae030 0x7f96bc0a7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96c0c9a700 1 --2- 172.21.15.60:0/1766749252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96bc0ac990 0x7f96bc13ecf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96c0c9a700 1 -- 172.21.15.60:0/1766749252 >> 172.21.15.60:0/1766749252 conn(0x7f96bc0b3fd0 msgr2=0x7f96bc0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:42.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96c0c9a700 1 -- 172.21.15.60:0/1766749252 shutdown_connections 2020-10-31T22:43:42.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.319+0000 7f96c0c9a700 1 -- 172.21.15.60:0/1766749252 wait complete. 2020-10-31T22:43:42.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96c0c9a700 1 Processor -- start 2020-10-31T22:43:42.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96c0c9a700 1 -- start start 2020-10-31T22:43:42.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96c0c9a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96bc05bbb0 0x7f96bc065f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96c0c9a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96bc0ac990 0x7f96bc09e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96c0c9a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96bc0ae030 0x7f96bc150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96c0c9a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc140990 con 0x7f96bc05bbb0 2020-10-31T22:43:42.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96c0c9a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc141dc0 con 0x7f96bc0ac990 2020-10-31T22:43:42.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96c0c9a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96bc142060 con 0x7f96bc0ae030 2020-10-31T22:43:42.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96bb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96bc05bbb0 0x7f96bc065f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96bb7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96bc05bbb0 0x7f96bc065f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43626/0 (socket says 172.21.15.60:43626) 2020-10-31T22:43:42.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96bb7fe700 1 -- 172.21.15.60:0/3282381485 learned_addr learned my addr 172.21.15.60:0/3282381485 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:42.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96bbfff700 1 --2- 172.21.15.60:0/3282381485 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96bc0ae030 0x7f96bc150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96b2ffd700 1 --2- 172.21.15.60:0/3282381485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96bc0ac990 0x7f96bc09e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96bb7fe700 1 -- 172.21.15.60:0/3282381485 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96bc0ae030 msgr2=0x7f96bc150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96bb7fe700 1 --2- 172.21.15.60:0/3282381485 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96bc0ae030 0x7f96bc150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96bb7fe700 1 -- 172.21.15.60:0/3282381485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96bc0ac990 msgr2=0x7f96bc09e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96bb7fe700 1 --2- 172.21.15.60:0/3282381485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96bc0ac990 0x7f96bc09e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96bb7fe700 1 -- 172.21.15.60:0/3282381485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc140fc0 con 0x7f96bc05bbb0 2020-10-31T22:43:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96bb7fe700 1 --2- 172.21.15.60:0/3282381485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96bc05bbb0 0x7f96bc065f30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f96bc0ae670 tx=0x7f96ac007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96b97fa700 1 -- 172.21.15.60:0/3282381485 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ac007020 con 0x7f96bc05bbb0 2020-10-31T22:43:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96b97fa700 1 -- 172.21.15.60:0/3282381485 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac007180 con 0x7f96bc05bbb0 2020-10-31T22:43:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96c0c9a700 1 -- 172.21.15.60:0/3282381485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96bc141260 con 0x7f96bc05bbb0 2020-10-31T22:43:42.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96b97fa700 1 -- 172.21.15.60:0/3282381485 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96ac006530 con 0x7f96bc05bbb0 2020-10-31T22:43:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.323+0000 7f96c0c9a700 1 -- 172.21.15.60:0/3282381485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96bc141a40 con 0x7f96bc05bbb0 2020-10-31T22:43:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.327+0000 7f96c0c9a700 1 -- 172.21.15.60:0/3282381485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96bc141620 con 0x7f96bc05bbb0 2020-10-31T22:43:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.327+0000 7f96b97fa700 1 -- 172.21.15.60:0/3282381485 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f96ac010070 con 0x7f96bc05bbb0 2020-10-31T22:43:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.327+0000 7f96b97fa700 1 --2- 172.21.15.60:0/3282381485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f96a0054f90 0x7f96a0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.327+0000 7f96b97fa700 1 -- 172.21.15.60:0/3282381485 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f96ac06ce00 con 0x7f96bc05bbb0 2020-10-31T22:43:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.327+0000 7f96b2ffd700 1 --2- 172.21.15.60:0/3282381485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f96a0054f90 0x7f96a0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.327+0000 7f96b2ffd700 1 --2- 172.21.15.60:0/3282381485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f96a0054f90 0x7f96a0057450 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f96a401a000 tx=0x7f96a4017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:42.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.331+0000 7f96b97fa700 1 -- 172.21.15.60:0/3282381485 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f96ac040df0 con 0x7f96bc05bbb0 2020-10-31T22:43:42.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.479+0000 7f96c0c9a700 1 -- 172.21.15.60:0/3282381485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96bc1413f0 con 0x7f96bc05bbb0 2020-10-31T22:43:42.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.479+0000 7f96b97fa700 1 -- 172.21.15.60:0/3282381485 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+10 (secure 0 0 0) 0x7f96ac043210 con 0x7f96bc05bbb0 2020-10-31T22:43:42.482 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:43:42.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.479+0000 7f96c0c9a700 1 -- 172.21.15.60:0/3282381485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f96a0054f90 msgr2=0x7f96a0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.479+0000 7f96c0c9a700 1 --2- 172.21.15.60:0/3282381485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f96a0054f90 0x7f96a0057450 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f96a401a000 tx=0x7f96a4017000).stop 2020-10-31T22:43:42.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.479+0000 7f96c0c9a700 1 -- 172.21.15.60:0/3282381485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96bc05bbb0 msgr2=0x7f96bc065f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.479+0000 7f96c0c9a700 1 --2- 172.21.15.60:0/3282381485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96bc05bbb0 0x7f96bc065f30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f96bc0ae670 tx=0x7f96ac007b80).stop 2020-10-31T22:43:42.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.479+0000 7f96c0c9a700 1 -- 172.21.15.60:0/3282381485 shutdown_connections 2020-10-31T22:43:42.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.479+0000 7f96c0c9a700 1 --2- 172.21.15.60:0/3282381485 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96bc0ae030 0x7f96bc150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.479+0000 7f96c0c9a700 1 --2- 172.21.15.60:0/3282381485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f96bc05bbb0 0x7f96bc065f30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.479+0000 7f96c0c9a700 1 --2- 172.21.15.60:0/3282381485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f96a0054f90 0x7f96a0057450 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.479+0000 7f96c0c9a700 1 --2- 172.21.15.60:0/3282381485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96bc0ac990 0x7f96bc09e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.479+0000 7f96c0c9a700 1 -- 172.21.15.60:0/3282381485 >> 172.21.15.60:0/3282381485 conn(0x7f96bc0b3fd0 msgr2=0x7f96bc0afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:42.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.483+0000 7f96c0c9a700 1 -- 172.21.15.60:0/3282381485 shutdown_connections 2020-10-31T22:43:42.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.483+0000 7f96c0c9a700 1 -- 172.21.15.60:0/3282381485 wait complete. 2020-10-31T22:43:42.496 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:43:42.498 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:43:42.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 Processor -- start 2020-10-31T22:43:42.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 -- start start 2020-10-31T22:43:42.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f340b24a0 0x7f6f340b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f34141fe0 0x7f6f34142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f34145180 con 0x7f6f340b5570 2020-10-31T22:43:42.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f340afae0 con 0x7f6f340b24a0 2020-10-31T22:43:42.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f34141bf0 con 0x7f6f34141fe0 2020-10-31T22:43:42.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f32ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f340b24a0 0x7f6f340b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f32ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f340b24a0 0x7f6f340b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43632/0 (socket says 172.21.15.60:43632) 2020-10-31T22:43:42.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f32ffd700 1 -- 172.21.15.60:0/2290637472 learned_addr learned my addr 172.21.15.60:0/2290637472 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:42.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f33fff700 1 --2- 172.21.15.60:0/2290637472 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f34141fe0 0x7f6f34142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f32ffd700 1 -- 172.21.15.60:0/2290637472 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f34141fe0 msgr2=0x7f6f34142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:42.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f32ffd700 1 --2- 172.21.15.60:0/2290637472 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f34141fe0 0x7f6f34142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f32ffd700 1 -- 172.21.15.60:0/2290637472 >> v1:172.21.15.66:6789/0 conn(0x7f6f340b5570 legacy=0x7f6f34145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:43:42.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f32ffd700 1 -- 172.21.15.60:0/2290637472 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f340b0670 con 0x7f6f340b24a0 2020-10-31T22:43:42.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f32ffd700 1 --2- 172.21.15.60:0/2290637472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340b24a0 0x7f6f340b5950 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f6f3405c9f0 tx=0x7f6f1c009270).ready entity=mon.0 client_cookie=5d11e78190a5d7a5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:42.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f327fc700 1 -- 172.21.15.60:0/2290637472 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f1c00bb80 con 0x7f6f340b24a0 2020-10-31T22:43:42.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f327fc700 1 -- 172.21.15.60:0/2290637472 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1c00bce0 con 0x7f6f340b24a0 2020-10-31T22:43:42.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 -- 172.21.15.60:0/2290637472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340b24a0 msgr2=0x7f6f340b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 --2- 172.21.15.60:0/2290637472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340b24a0 0x7f6f340b5950 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f6f3405c9f0 tx=0x7f6f1c009270).stop 2020-10-31T22:43:42.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f327fc700 1 -- 172.21.15.60:0/2290637472 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f1c00be90 con 0x7f6f340b24a0 2020-10-31T22:43:42.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 -- 172.21.15.60:0/2290637472 shutdown_connections 2020-10-31T22:43:42.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 --2- 172.21.15.60:0/2290637472 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f34141fe0 0x7f6f34142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 --2- 172.21.15.60:0/2290637472 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340b24a0 0x7f6f340b5950 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 -- 172.21.15.60:0/2290637472 >> 172.21.15.60:0/2290637472 conn(0x7f6f340b8e90 msgr2=0x7f6f340b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:42.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 -- 172.21.15.60:0/2290637472 shutdown_connections 2020-10-31T22:43:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.607+0000 7f6f389f9700 1 -- 172.21.15.60:0/2290637472 wait complete. 2020-10-31T22:43:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f389f9700 1 Processor -- start 2020-10-31T22:43:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f389f9700 1 -- start start 2020-10-31T22:43:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f389f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340b24a0 0x7f6f34066200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f389f9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f340b5570 0x7f6f34139600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f389f9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f34141fe0 0x7f6f34139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f389f9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f34139fe0 con 0x7f6f340b24a0 2020-10-31T22:43:42.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f389f9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f34154840 con 0x7f6f340b5570 2020-10-31T22:43:42.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f389f9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f34154ae0 con 0x7f6f34141fe0 2020-10-31T22:43:42.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340b24a0 0x7f6f34066200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f32ffd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f340b5570 0x7f6f34139600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f337fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340b24a0 0x7f6f34066200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43640/0 (socket says 172.21.15.60:43640) 2020-10-31T22:43:42.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f337fe700 1 -- 172.21.15.60:0/3760067476 learned_addr learned my addr 172.21.15.60:0/3760067476 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:43:42.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f33fff700 1 --2- 172.21.15.60:0/3760067476 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f34141fe0 0x7f6f34139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f337fe700 1 -- 172.21.15.60:0/3760067476 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f34141fe0 msgr2=0x7f6f34139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f337fe700 1 --2- 172.21.15.60:0/3760067476 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f34141fe0 0x7f6f34139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f337fe700 1 -- 172.21.15.60:0/3760067476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f340b5570 msgr2=0x7f6f34139600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f337fe700 1 --2- 172.21.15.60:0/3760067476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f340b5570 0x7f6f34139600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f337fe700 1 -- 172.21.15.60:0/3760067476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f34144bb0 con 0x7f6f340b24a0 2020-10-31T22:43:42.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f32ffd700 1 --2- 172.21.15.60:0/3760067476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f340b5570 0x7f6f34139600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:43:42.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f337fe700 1 --2- 172.21.15.60:0/3760067476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340b24a0 0x7f6f34066200 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f6f24000e90 tx=0x7f6f24007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:42.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f30ff9700 1 -- 172.21.15.60:0/3760067476 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f2400e4a0 con 0x7f6f340b24a0 2020-10-31T22:43:42.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f30ff9700 1 -- 172.21.15.60:0/3760067476 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2400e600 con 0x7f6f340b24a0 2020-10-31T22:43:42.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f389f9700 1 -- 172.21.15.60:0/3760067476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f34144e50 con 0x7f6f340b24a0 2020-10-31T22:43:42.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f30ff9700 1 -- 172.21.15.60:0/3760067476 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f2400e960 con 0x7f6f340b24a0 2020-10-31T22:43:42.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.611+0000 7f6f389f9700 1 -- 172.21.15.60:0/3760067476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f340b74a0 con 0x7f6f340b24a0 2020-10-31T22:43:42.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.615+0000 7f6f389f9700 1 -- 172.21.15.60:0/3760067476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f341444c0 con 0x7f6f340b24a0 2020-10-31T22:43:42.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.615+0000 7f6f30ff9700 1 -- 172.21.15.60:0/3760067476 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6f24010030 con 0x7f6f340b24a0 2020-10-31T22:43:42.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.615+0000 7f6f30ff9700 1 --2- 172.21.15.60:0/3760067476 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f18054f10 0x7f6f180573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:43:42.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.615+0000 7f6f30ff9700 1 -- 172.21.15.60:0/3760067476 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6f24002e40 con 0x7f6f340b24a0 2020-10-31T22:43:42.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.615+0000 7f6f32ffd700 1 --2- 172.21.15.60:0/3760067476 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f18054f10 0x7f6f180573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:43:42.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.615+0000 7f6f32ffd700 1 --2- 172.21.15.60:0/3760067476 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f18054f10 0x7f6f180573d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f6f1c01a000 tx=0x7f6f1c016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:43:42.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.619+0000 7f6f30ff9700 1 -- 172.21.15.60:0/3760067476 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6f341444c0 con 0x7f6f340b24a0 2020-10-31T22:43:42.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.807+0000 7f6f389f9700 1 -- 172.21.15.60:0/3760067476 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f341444c0 con 0x7f6f340b24a0 2020-10-31T22:43:42.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.807+0000 7f6f30ff9700 1 -- 172.21.15.60:0/3760067476 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f6f341444c0 con 0x7f6f340b24a0 2020-10-31T22:43:42.810 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:43:42.810 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2666662861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2666662861},{"type":"v1","addr":"172.21.15.60:6835","nonce":2666662861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14},{"gid":5193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3622783561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3622783561},{"type":"v1","addr":"172.21.15.66:6833","nonce":3622783561}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:43:08.333596+0000","modified":"2020-10-31T22:43:09.337195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/1627192275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1627192275},{"type":"v1","addr":"172.21.15.60:6837","nonce":1627192275}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-10-31T22:43:42.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.811+0000 7f6f389f9700 1 -- 172.21.15.60:0/3760067476 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f18054f10 msgr2=0x7f6f180573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.811+0000 7f6f389f9700 1 --2- 172.21.15.60:0/3760067476 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f18054f10 0x7f6f180573d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f6f1c01a000 tx=0x7f6f1c016000).stop 2020-10-31T22:43:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.811+0000 7f6f389f9700 1 -- 172.21.15.60:0/3760067476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340b24a0 msgr2=0x7f6f34066200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:43:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.811+0000 7f6f389f9700 1 --2- 172.21.15.60:0/3760067476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340b24a0 0x7f6f34066200 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7f6f24000e90 tx=0x7f6f24007b90).stop 2020-10-31T22:43:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.811+0000 7f6f389f9700 1 -- 172.21.15.60:0/3760067476 shutdown_connections 2020-10-31T22:43:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.811+0000 7f6f389f9700 1 --2- 172.21.15.60:0/3760067476 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f34141fe0 0x7f6f34139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.811+0000 7f6f389f9700 1 --2- 172.21.15.60:0/3760067476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f340b24a0 0x7f6f34066200 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.811+0000 7f6f389f9700 1 --2- 172.21.15.60:0/3760067476 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f18054f10 0x7f6f180573d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.811+0000 7f6f389f9700 1 --2- 172.21.15.60:0/3760067476 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f340b5570 0x7f6f34139600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:43:42.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.811+0000 7f6f389f9700 1 -- 172.21.15.60:0/3760067476 >> 172.21.15.60:0/3760067476 conn(0x7f6f340b8e90 msgr2=0x7f6f340b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:43:42.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.811+0000 7f6f389f9700 1 -- 172.21.15.60:0/3760067476 shutdown_connections 2020-10-31T22:43:42.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:43:42.811+0000 7f6f389f9700 1 -- 172.21.15.60:0/3760067476 wait complete. 2020-10-31T22:43:42.814 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2020-10-31T22:43:43.129 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:43:08.333596+0000', 'modified': '2020-10-31T22:43:09.337195+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5199}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5199': {'gid': 5199, 'name': 'c', 'rank': 0, 'incarnation': 15, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/1627192275', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 1627192275}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 1627192275}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:43:43.130 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:43:43.131 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:43:43.261 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":5199,"want_state":"up:active","state":"up:active","rank_uptime":34.915187138,"mdsmap_epoch":16,"osdmap_epoch":44,"osdmap_epoch_barrier":44,"uptime":40.126636589999997} 2020-10-31T22:43:43.262 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 5199, "mdsmap_epoch": 16, "osdmap_epoch": 44, "osdmap_epoch_barrier": 44, "rank_uptime": 34.915187138, "state": "up:active", "uptime": 40.12663659, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:43:43.263 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:43:43.264 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:43:43.264 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:43:43.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:43.266 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:43:43.286 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:43:43.349 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:43:43.350 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:43:43.404 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:43:43.405 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:43:43.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:43.406 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:43:43.453 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:43:43.454 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:43:43.497 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:43:43.514 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:43:43.517 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:43:43.576 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:43:43.577 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:43:43.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:43.578 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:43:43.579 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:43:43.572+0000 7f0a1ca980c0 -1 init, newargv = 0x562c30099a50 newargc=9ceph-fuse[ 2020-10-31T22:43:43.579 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:13189]: starting ceph client 2020-10-31T22:43:43.588 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13189]: starting fuse 2020-10-31T22:43:43.608 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:43:43.609 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:43:43.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:43.611 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:43:43.618 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:43:43.619 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:43:43.619 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:43:43.621 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:43:43.622 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:43:43.622 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:43:43.622 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:43:43.623 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:43:43.625 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:43:43.626 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:43:43.627 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:43:43.627 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:43:43.628 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:43:43.629 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:43:43.629 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:43:43.630 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:43:43.631 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:43:43.631 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:43:43.632 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:43:43.633 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:43:43.633 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:43:43.634 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:43:43.697 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.13189.asok 2020-10-31T22:43:43.703 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13189.asok 2020-10-31T22:43:43.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:43.705 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13189.asok status 2020-10-31T22:43:43.854 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:43:43.855 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:43:43.855 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:43:43.855 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:43:43.855 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:43:43.855 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:43:43.855 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:43:43.856 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "13189", 2020-10-31T22:43:43.856 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:43:43.856 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:43:43.856 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:43:43.856 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:43:43.856 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 5454, 2020-10-31T22:43:43.857 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:43:43.857 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:43:43.857 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:43:43.857 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5454 2020-10-31T22:43:43.857 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:43:43.857 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:43:43.857 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:43:43.858 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:43:43.859 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 3451305669 2020-10-31T22:43:43.859 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:43:43.859 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:43:43.860 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:43:43.860 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:43:43.860 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:43:43.860 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 3451305669 2020-10-31T22:43:43.861 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:43:43.861 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.5454 172.21.15.152:0/3451305669", 2020-10-31T22:43:43.861 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/3451305669", 2020-10-31T22:43:43.861 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:43:43.862 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 16, 2020-10-31T22:43:43.862 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 44, 2020-10-31T22:43:43.862 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:43:43.863 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:43:43.863 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:43:43.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:43.867 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:43:43.867 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:43:43.876 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:43:43.877 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:43:43.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:43:43.878 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:43:44.525 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:43:44.528 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:43:44.531 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:43:44.534 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:44:14.584 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:44:14.587 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:44:14.592 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:44:14.595 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:44:28.129 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:44:28.130 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:44:28.148 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:44:28.170 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:44:28.206 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:44:28.226 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:44:28.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:44:28.227 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:44:28.228 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:44:28.276 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:44:28.278 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:44:28.279 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:44:28.279 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:44:28.280 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:44:28.360 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13189]: fuse finished with error 0 and tester_r 0 2020-10-31T22:44:28.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:44:28.369 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:44:28.369 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:44:28.414 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:44:28.416 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:44:28.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:44:28.433 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:44:28.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:44:28.481 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:44:28.482 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:44:28.489 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:44:28.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:44:28.491 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:44:28.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:44:28.492 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:44:28.545 INFO:teuthology.orchestra.run.smithi085.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:44:28.545 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:44:28.546 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2020-10-31T22:44:28.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.671+0000 7f0828eec700 1 Processor -- start 2020-10-31T22:44:28.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.671+0000 7f0828eec700 1 -- start start 2020-10-31T22:44:28.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f0828eec700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f08240b0210 0x7f08240abad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:28.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f0828eec700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08240b1030 con 0x7f08240b0c50 2020-10-31T22:44:28.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f0828eec700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08240aab00 con 0x7f08240ae020 2020-10-31T22:44:28.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f0828eec700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08240aada0 con 0x7f08240b0210 2020-10-31T22:44:28.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082259c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f08240b0c50 0x7f082413f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47782/0 (socket says 172.21.15.60:47782) 2020-10-31T22:44:28.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082259c700 1 -- 172.21.15.60:0/2731606751 learned_addr learned my addr 172.21.15.60:0/2731606751 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:28.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f0822d9d700 1 --2- 172.21.15.60:0/2731606751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f08240b0210 0x7f08240abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:28.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184042915 0 0) 0x7f08240b1030 con 0x7f08240b0c50 2020-10-31T22:44:28.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0804003230 con 0x7f08240b0c50 2020-10-31T22:44:28.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629729982 0 0) 0x7f08240aab00 con 0x7f08240ae020 2020-10-31T22:44:28.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08240b1030 con 0x7f08240ae020 2020-10-31T22:44:28.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3064290760 0 0) 0x7f0804003230 con 0x7f08240b0c50 2020-10-31T22:44:28.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f08240b0210 msgr2=0x7f08240abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:28.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 --2- 172.21.15.60:0/2731606751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f08240b0210 0x7f08240abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:28.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 >> v1:172.21.15.66:6789/0 conn(0x7f08240ae020 legacy=0x7f08240afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:28.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08240ab040 con 0x7f08240b0c50 2020-10-31T22:44:28.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f080c0016d0 con 0x7f08240b0c50 2020-10-31T22:44:28.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 >> v1:172.21.15.60:6789/0 conn(0x7f08240b0c50 legacy=0x7f082413f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:28.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 --2- 172.21.15.60:0/2731606751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08040038e0 0x7f0804003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:28.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 --2- 172.21.15.60:0/2731606751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08040044d0 0x7f0804004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:28.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 --2- 172.21.15.60:0/2731606751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f08240b0210 0x7f0804004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:28.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08240aada0 con 0x7f08040038e0 2020-10-31T22:44:28.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0804005330 con 0x7f08040044d0 2020-10-31T22:44:28.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080400b720 con 0x7f08240b0210 2020-10-31T22:44:28.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082259c700 1 --2- 172.21.15.60:0/2731606751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08040038e0 0x7f0804003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:28.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f0822d9d700 1 --2- 172.21.15.60:0/2731606751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f08240b0210 0x7f0804004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:28.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f0821d9b700 1 --2- 172.21.15.60:0/2731606751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08040044d0 0x7f0804004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:28.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082259c700 1 -- 172.21.15.60:0/2731606751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f08240b0210 msgr2=0x7f0804004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:28.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082259c700 1 --2- 172.21.15.60:0/2731606751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f08240b0210 0x7f0804004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:28.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082259c700 1 -- 172.21.15.60:0/2731606751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08040044d0 msgr2=0x7f0804004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:28.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082259c700 1 --2- 172.21.15.60:0/2731606751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08040044d0 0x7f0804004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:28.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082259c700 1 -- 172.21.15.60:0/2731606751 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804003230 con 0x7f08040038e0 2020-10-31T22:44:28.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082259c700 1 --2- 172.21.15.60:0/2731606751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08040038e0 0x7f0804003ce0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f080c0014a0 tx=0x7f080c007690).ready entity=mon.0 client_cookie=ec5e12c2f6cef9f5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:28.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c00ce60 con 0x7f08040038e0 2020-10-31T22:44:28.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080c0070d0 con 0x7f08040038e0 2020-10-31T22:44:28.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f082159a700 1 -- 172.21.15.60:0/2731606751 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f080c007430 con 0x7f08040038e0 2020-10-31T22:44:28.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f0828eec700 1 -- 172.21.15.60:0/2731606751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08040038e0 msgr2=0x7f0804003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:28.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f0828eec700 1 --2- 172.21.15.60:0/2731606751 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08040038e0 0x7f0804003ce0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f080c0014a0 tx=0x7f080c007690).stop 2020-10-31T22:44:28.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f0822d9d700 1 -- 172.21.15.60:0/2731606751 reap_dead start 2020-10-31T22:44:28.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f0828eec700 1 -- 172.21.15.60:0/2731606751 shutdown_connections 2020-10-31T22:44:28.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.675+0000 7f0828eec700 1 -- 172.21.15.60:0/2731606751 >> 172.21.15.60:0/2731606751 conn(0x7f082406a260 msgr2=0x7f0824061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:28.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.679+0000 7f0828eec700 1 -- 172.21.15.60:0/2731606751 shutdown_connections 2020-10-31T22:44:28.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.679+0000 7f0828eec700 1 -- 172.21.15.60:0/2731606751 wait complete. 2020-10-31T22:44:28.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.679+0000 7f0828eec700 1 Processor -- start 2020-10-31T22:44:28.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.679+0000 7f0828eec700 1 -- start start 2020-10-31T22:44:28.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0828eec700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0824063bc0 0x7f082405afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:28.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0828eec700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f082414f9a0 0x7f0824062750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:28.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0828eec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f082405b4d0 0x7f0824062c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:28.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0828eec700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082414ed90 con 0x7f082405b4d0 2020-10-31T22:44:28.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0828eec700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0824063fa0 con 0x7f0824063bc0 2020-10-31T22:44:28.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0828eec700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082414efc0 con 0x7f082414f9a0 2020-10-31T22:44:28.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0822d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f082405b4d0 0x7f0824062c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:28.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0822d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f082405b4d0 0x7f0824062c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43662/0 (socket says 172.21.15.60:43662) 2020-10-31T22:44:28.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0822d9d700 1 -- 172.21.15.60:0/4005922594 learned_addr learned my addr 172.21.15.60:0/4005922594 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:28.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0821d9b700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f082414f9a0 0x7f0824062750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:28.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f082259c700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0824063bc0 0x7f082405afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:28.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0822d9d700 1 -- 172.21.15.60:0/4005922594 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f082414f9a0 msgr2=0x7f0824062750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:28.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0822d9d700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f082414f9a0 0x7f0824062750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:28.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0822d9d700 1 -- 172.21.15.60:0/4005922594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0824063bc0 msgr2=0x7f082405afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:28.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0822d9d700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0824063bc0 0x7f082405afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:28.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0822d9d700 1 -- 172.21.15.60:0/4005922594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082414f260 con 0x7f082405b4d0 2020-10-31T22:44:28.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f082259c700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0824063bc0 0x7f082405afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:44:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0822d9d700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f082405b4d0 0x7f0824062c40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f081c00b000 tx=0x7f081c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f081b7fe700 1 -- 172.21.15.60:0/4005922594 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081c00fb10 con 0x7f082405b4d0 2020-10-31T22:44:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f081b7fe700 1 -- 172.21.15.60:0/4005922594 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081c00fc70 con 0x7f082405b4d0 2020-10-31T22:44:28.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f081b7fe700 1 -- 172.21.15.60:0/4005922594 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081c00fde0 con 0x7f082405b4d0 2020-10-31T22:44:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0828eec700 1 -- 172.21.15.60:0/4005922594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082414f500 con 0x7f082405b4d0 2020-10-31T22:44:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.683+0000 7f0828eec700 1 -- 172.21.15.60:0/4005922594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08240655b0 con 0x7f082405b4d0 2020-10-31T22:44:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.687+0000 7f0828eec700 1 -- 172.21.15.60:0/4005922594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0824057100 con 0x7f082405b4d0 2020-10-31T22:44:28.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.687+0000 7f081b7fe700 1 -- 172.21.15.60:0/4005922594 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f081c024070 con 0x7f082405b4d0 2020-10-31T22:44:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.687+0000 7f081b7fe700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0808054f90 0x7f0808057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.687+0000 7f081b7fe700 1 -- 172.21.15.60:0/4005922594 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f081c06e650 con 0x7f082405b4d0 2020-10-31T22:44:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.687+0000 7f082259c700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0808054f90 0x7f0808057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:28.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.687+0000 7f082259c700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0808054f90 0x7f0808057450 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f080c006000 tx=0x7f080c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:28.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.691+0000 7f081b7fe700 1 -- 172.21.15.60:0/4005922594 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f081c044ad0 con 0x7f082405b4d0 2020-10-31T22:44:28.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.835+0000 7f0828eec700 1 -- 172.21.15.60:0/4005922594 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f08240ace00 con 0x7f082405b4d0 2020-10-31T22:44:28.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.843+0000 7f081b7fe700 1 -- 172.21.15.60:0/4005922594 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f081c0180a0 con 0x7f082405b4d0 2020-10-31T22:44:28.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.843+0000 7f0828eec700 1 -- 172.21.15.60:0/4005922594 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0808054f90 msgr2=0x7f0808057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:28.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.843+0000 7f0828eec700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0808054f90 0x7f0808057450 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f080c006000 tx=0x7f080c015000).stop 2020-10-31T22:44:28.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.843+0000 7f0828eec700 1 -- 172.21.15.60:0/4005922594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f082405b4d0 msgr2=0x7f0824062c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:28.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.843+0000 7f0828eec700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f082405b4d0 0x7f0824062c40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f081c00b000 tx=0x7f081c0091a0).stop 2020-10-31T22:44:28.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.843+0000 7f0828eec700 1 -- 172.21.15.60:0/4005922594 shutdown_connections 2020-10-31T22:44:28.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.843+0000 7f0828eec700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f082405b4d0 0x7f0824062c40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:28.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.843+0000 7f0828eec700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0808054f90 0x7f0808057450 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:28.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.843+0000 7f0828eec700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0824063bc0 0x7f082405afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:28.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.843+0000 7f0828eec700 1 --2- 172.21.15.60:0/4005922594 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f082414f9a0 0x7f0824062750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:28.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.843+0000 7f0828eec700 1 -- 172.21.15.60:0/4005922594 >> 172.21.15.60:0/4005922594 conn(0x7f082406a260 msgr2=0x7f082413dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:28.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.843+0000 7f0828eec700 1 -- 172.21.15.60:0/4005922594 shutdown_connections 2020-10-31T22:44:28.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.843+0000 7f0828eec700 1 -- 172.21.15.60:0/4005922594 wait complete. 2020-10-31T22:44:28.857 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead' 2020-10-31T22:44:28.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.971+0000 7f28a9af7700 1 Processor -- start 2020-10-31T22:44:28.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.971+0000 7f28a9af7700 1 -- start start 2020-10-31T22:44:28.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.971+0000 7f28a9af7700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f28a40ac870 0x7f28a40b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:28.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.971+0000 7f28a9af7700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a40acc50 con 0x7f28a40ae8b0 2020-10-31T22:44:28.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.971+0000 7f28a9af7700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a40b5690 con 0x7f28a40b0e20 2020-10-31T22:44:28.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.971+0000 7f28a9af7700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a40b14c0 con 0x7f28a40ac870 2020-10-31T22:44:28.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.971+0000 7f28a92f6700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f28a40ae8b0 0x7f28a41412e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47806/0 (socket says 172.21.15.60:47806) 2020-10-31T22:44:28.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.971+0000 7f28a92f6700 1 -- 172.21.15.60:0/1910471021 learned_addr learned my addr 172.21.15.60:0/1910471021 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:28.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.971+0000 7f28a8af5700 1 --2- 172.21.15.60:0/1910471021 >> v2:172.21.15.66:3300/0 conn(0x7f28a40ac870 0x7f28a40b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:28.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a37fe700 1 -- 172.21.15.60:0/1910471021 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551199101 0 0) 0x7f28a40acc50 con 0x7f28a40ae8b0 2020-10-31T22:44:28.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a8af5700 1 -- 172.21.15.60:0/1910471021 >> v1:172.21.15.66:6789/0 conn(0x7f28a40b0e20 legacy=0x7f28a40ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:28.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a8af5700 1 -- 172.21.15.60:0/1910471021 >> v1:172.21.15.60:6789/0 conn(0x7f28a40ae8b0 legacy=0x7f28a41412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:28.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a8af5700 1 -- 172.21.15.60:0/1910471021 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a40afc10 con 0x7f28a40ac870 2020-10-31T22:44:28.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a8af5700 1 --2- 172.21.15.60:0/1910471021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a40ac870 0x7f28a40b5060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f28940032b0 tx=0x7f28940091a0).ready entity=mon.1 client_cookie=3380d1b5ce8d78bd server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:28.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a37fe700 1 -- 172.21.15.60:0/1910471021 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f289400bae0 con 0x7f28a40ac870 2020-10-31T22:44:28.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a37fe700 1 -- 172.21.15.60:0/1910471021 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289400bc40 con 0x7f28a40ac870 2020-10-31T22:44:28.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a37fe700 1 -- 172.21.15.60:0/1910471021 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f289400bdb0 con 0x7f28a40ac870 2020-10-31T22:44:28.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a9af7700 1 -- 172.21.15.60:0/1910471021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a40ac870 msgr2=0x7f28a40b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:28.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a9af7700 1 --2- 172.21.15.60:0/1910471021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a40ac870 0x7f28a40b5060 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f28940032b0 tx=0x7f28940091a0).stop 2020-10-31T22:44:28.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a9af7700 1 -- 172.21.15.60:0/1910471021 shutdown_connections 2020-10-31T22:44:28.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a9af7700 1 --2- 172.21.15.60:0/1910471021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a40ac870 0x7f28a40b5060 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:28.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a9af7700 1 -- 172.21.15.60:0/1910471021 >> 172.21.15.60:0/1910471021 conn(0x7f28a406a600 msgr2=0x7f28a4060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:28.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a9af7700 1 -- 172.21.15.60:0/1910471021 shutdown_connections 2020-10-31T22:44:28.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.975+0000 7f28a9af7700 1 -- 172.21.15.60:0/1910471021 wait complete. 2020-10-31T22:44:28.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a9af7700 1 Processor -- start 2020-10-31T22:44:28.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a9af7700 1 -- start start 2020-10-31T22:44:28.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a9af7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a40ac870 0x7f28a405b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:28.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a9af7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28a40ae8b0 0x7f28a4065080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:28.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a9af7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a40b0e20 0x7f28a4065570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:28.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a9af7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a40636c0 con 0x7f28a40ac870 2020-10-31T22:44:28.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a9af7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a4063960 con 0x7f28a40b0e20 2020-10-31T22:44:28.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a9af7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a4064be0 con 0x7f28a40ae8b0 2020-10-31T22:44:28.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a8af5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a40ac870 0x7f28a405b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:28.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a8af5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a40ac870 0x7f28a405b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43672/0 (socket says 172.21.15.60:43672) 2020-10-31T22:44:28.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a8af5700 1 -- 172.21.15.60:0/1789599404 learned_addr learned my addr 172.21.15.60:0/1789599404 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:28.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a92f6700 1 --2- 172.21.15.60:0/1789599404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a40b0e20 0x7f28a4065570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:28.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a3fff700 1 --2- 172.21.15.60:0/1789599404 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28a40ae8b0 0x7f28a4065080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:28.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a8af5700 1 -- 172.21.15.60:0/1789599404 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28a40ae8b0 msgr2=0x7f28a4065080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:28.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a8af5700 1 --2- 172.21.15.60:0/1789599404 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28a40ae8b0 0x7f28a4065080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:28.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a8af5700 1 -- 172.21.15.60:0/1789599404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a40b0e20 msgr2=0x7f28a4065570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:28.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a8af5700 1 --2- 172.21.15.60:0/1789599404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a40b0e20 0x7f28a4065570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:28.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a8af5700 1 -- 172.21.15.60:0/1789599404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a405b930 con 0x7f28a40ac870 2020-10-31T22:44:28.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a8af5700 1 --2- 172.21.15.60:0/1789599404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a40ac870 0x7f28a405b320 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f28940032b0 tx=0x7f2894016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:28.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a1ffb700 1 -- 172.21.15.60:0/1789599404 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f28940107e0 con 0x7f28a40ac870 2020-10-31T22:44:28.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a1ffb700 1 -- 172.21.15.60:0/1789599404 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2894010940 con 0x7f28a40ac870 2020-10-31T22:44:28.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a9af7700 1 -- 172.21.15.60:0/1789599404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a4063c00 con 0x7f28a40ac870 2020-10-31T22:44:28.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a1ffb700 1 -- 172.21.15.60:0/1789599404 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2894010ca0 con 0x7f28a40ac870 2020-10-31T22:44:28.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.979+0000 7f28a9af7700 1 -- 172.21.15.60:0/1789599404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a4150b00 con 0x7f28a40ac870 2020-10-31T22:44:28.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.983+0000 7f28a9af7700 1 -- 172.21.15.60:0/1789599404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a4064de0 con 0x7f28a40ac870 2020-10-31T22:44:28.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.983+0000 7f28a1ffb700 1 -- 172.21.15.60:0/1789599404 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2894026030 con 0x7f28a40ac870 2020-10-31T22:44:28.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.983+0000 7f28a1ffb700 1 --2- 172.21.15.60:0/1789599404 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f28880550c0 0x7f2888057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:28.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.983+0000 7f28a1ffb700 1 -- 172.21.15.60:0/1789599404 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f289406eb50 con 0x7f28a40ac870 2020-10-31T22:44:28.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.983+0000 7f28a3fff700 1 --2- 172.21.15.60:0/1789599404 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f28880550c0 0x7f2888057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:28.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.983+0000 7f28a3fff700 1 --2- 172.21.15.60:0/1789599404 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f28880550c0 0x7f2888057580 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f288c00b000 tx=0x7f288c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:28.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:28.987+0000 7f28a1ffb700 1 -- 172.21.15.60:0/1789599404 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f28a4064de0 con 0x7f28a40ac870 2020-10-31T22:44:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:29.183+0000 7f28a9af7700 1 -- 172.21.15.60:0/1789599404 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]} v 0) v1 -- 0x7f28a4064920 con 0x7f28a40ac870 2020-10-31T22:44:29.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:29.923+0000 7f28a1ffb700 1 -- 172.21.15.60:0/1789599404 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead"]}]=0 v152) v1 ==== 144+0+0 (secure 0 0 0) 0x7f28940240d0 con 0x7f28a40ac870 2020-10-31T22:44:29.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:29.927+0000 7f28a9af7700 1 -- 172.21.15.60:0/1789599404 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f28880550c0 msgr2=0x7f2888057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:29.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:29.927+0000 7f28a9af7700 1 --2- 172.21.15.60:0/1789599404 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f28880550c0 0x7f2888057580 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f288c00b000 tx=0x7f288c009040).stop 2020-10-31T22:44:29.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:29.927+0000 7f28a9af7700 1 -- 172.21.15.60:0/1789599404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a40ac870 msgr2=0x7f28a405b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:29.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:29.927+0000 7f28a9af7700 1 --2- 172.21.15.60:0/1789599404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a40ac870 0x7f28a405b320 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f28940032b0 tx=0x7f2894016000).stop 2020-10-31T22:44:29.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:29.927+0000 7f28a9af7700 1 -- 172.21.15.60:0/1789599404 shutdown_connections 2020-10-31T22:44:29.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:29.927+0000 7f28a9af7700 1 --2- 172.21.15.60:0/1789599404 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f28880550c0 0x7f2888057580 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:29.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:29.927+0000 7f28a9af7700 1 --2- 172.21.15.60:0/1789599404 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f28a40b0e20 0x7f28a4065570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:29.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:29.927+0000 7f28a9af7700 1 --2- 172.21.15.60:0/1789599404 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f28a40ac870 0x7f28a405b320 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:29.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:29.927+0000 7f28a9af7700 1 --2- 172.21.15.60:0/1789599404 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f28a40ae8b0 0x7f28a4065080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:29.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:29.927+0000 7f28a9af7700 1 -- 172.21.15.60:0/1789599404 >> 172.21.15.60:0/1789599404 conn(0x7f28a406a600 msgr2=0x7f28a4060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:29.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:29.927+0000 7f28a9af7700 1 -- 172.21.15.60:0/1789599404 shutdown_connections 2020-10-31T22:44:29.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:29.927+0000 7f28a9af7700 1 -- 172.21.15.60:0/1789599404 wait complete. 2020-10-31T22:44:29.945 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2020-10-31T22:44:29.945 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2020-10-31T22:44:29.946 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2020-10-31T22:44:30.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f579d1e3700 1 Processor -- start 2020-10-31T22:44:30.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f579d1e3700 1 -- start start 2020-10-31T22:44:30.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f579d1e3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5798141c90 0x7f579813f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:30.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f579d1e3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f57980b0030 0x7f579813f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:30.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f579d1e3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f579805b6f0 con 0x7f57980ae5b0 2020-10-31T22:44:30.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f579d1e3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5798142210 con 0x7f5798141c90 2020-10-31T22:44:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f579d1e3700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57981424b0 con 0x7f57980b0030 2020-10-31T22:44:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f5797fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f57980ae5b0 0x7f579805afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47816/0 (socket says 172.21.15.60:47816) 2020-10-31T22:44:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f5797fff700 1 -- 172.21.15.60:0/2065299806 learned_addr learned my addr 172.21.15.60:0/2065299806 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f57977fe700 1 --2- 172.21.15.60:0/2065299806 >> v2:172.21.15.60:3300/0 conn(0x7f5798141c90 0x7f579813f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f579c9e2700 1 --2- 172.21.15.60:0/2065299806 >> v2:172.21.15.66:3300/0 conn(0x7f57980b0030 0x7f579813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f5796ffd700 1 -- 172.21.15.60:0/2065299806 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3930824037 0 0) 0x7f579805b6f0 con 0x7f57980ae5b0 2020-10-31T22:44:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f5796ffd700 1 -- 172.21.15.60:0/2065299806 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5778003230 con 0x7f57980ae5b0 2020-10-31T22:44:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f57977fe700 1 -- 172.21.15.60:0/2065299806 >> v2:172.21.15.66:3300/0 conn(0x7f57980b0030 msgr2=0x7f579813f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f57977fe700 1 --2- 172.21.15.60:0/2065299806 >> v2:172.21.15.66:3300/0 conn(0x7f57980b0030 0x7f579813f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f5796ffd700 1 -- 172.21.15.60:0/2065299806 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 99329199 0 0) 0x7f5778003230 con 0x7f57980ae5b0 2020-10-31T22:44:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f57977fe700 1 -- 172.21.15.60:0/2065299806 >> v1:172.21.15.60:6789/0 conn(0x7f57980ae5b0 legacy=0x7f579805afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.063+0000 7f57977fe700 1 -- 172.21.15.60:0/2065299806 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5798142750 con 0x7f5798141c90 2020-10-31T22:44:30.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f57977fe700 1 --2- 172.21.15.60:0/2065299806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5798141c90 0x7f579813f030 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f5788001bf0 tx=0x7f5780006dc0).ready entity=mon.0 client_cookie=98c150f61451b157 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:30.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f5796ffd700 1 -- 172.21.15.60:0/2065299806 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5788001a50 con 0x7f5798141c90 2020-10-31T22:44:30.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f5796ffd700 1 -- 172.21.15.60:0/2065299806 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578000d5c0 con 0x7f5798141c90 2020-10-31T22:44:30.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f5796ffd700 1 -- 172.21.15.60:0/2065299806 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f578000d730 con 0x7f5798141c90 2020-10-31T22:44:30.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 -- 172.21.15.60:0/2065299806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5798141c90 msgr2=0x7f579813f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 --2- 172.21.15.60:0/2065299806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5798141c90 0x7f579813f030 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f5788001bf0 tx=0x7f5780006dc0).stop 2020-10-31T22:44:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 -- 172.21.15.60:0/2065299806 shutdown_connections 2020-10-31T22:44:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 --2- 172.21.15.60:0/2065299806 >> v2:172.21.15.66:3300/0 conn(0x7f57980b0030 0x7f579813f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 --2- 172.21.15.60:0/2065299806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5798141c90 0x7f579813f030 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 -- 172.21.15.60:0/2065299806 >> 172.21.15.60:0/2065299806 conn(0x7f57980b61d0 msgr2=0x7f57980b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 -- 172.21.15.60:0/2065299806 shutdown_connections 2020-10-31T22:44:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 -- 172.21.15.60:0/2065299806 wait complete. 2020-10-31T22:44:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 Processor -- start 2020-10-31T22:44:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 -- start start 2020-10-31T22:44:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57980ae5b0 0x7f57981411f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57980b0030 0x7f57981449d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5798141c90 0x7f5798144ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:30.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5798143f00 con 0x7f57980ae5b0 2020-10-31T22:44:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5798147fc0 con 0x7f57980b0030 2020-10-31T22:44:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579d1e3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57981474d0 con 0x7f5798141c90 2020-10-31T22:44:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f5797fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57980ae5b0 0x7f57981411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f5797fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57980ae5b0 0x7f57981411f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43686/0 (socket says 172.21.15.60:43686) 2020-10-31T22:44:30.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f5797fff700 1 -- 172.21.15.60:0/65092549 learned_addr learned my addr 172.21.15.60:0/65092549 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:30.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f579c9e2700 1 --2- 172.21.15.60:0/65092549 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5798141c90 0x7f5798144ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:30.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f57977fe700 1 --2- 172.21.15.60:0/65092549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57980b0030 0x7f57981449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:30.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f5797fff700 1 -- 172.21.15.60:0/65092549 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5798141c90 msgr2=0x7f5798144ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:30.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f5797fff700 1 --2- 172.21.15.60:0/65092549 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5798141c90 0x7f5798144ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:30.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f5797fff700 1 -- 172.21.15.60:0/65092549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57980b0030 msgr2=0x7f57981449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:30.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f5797fff700 1 --2- 172.21.15.60:0/65092549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57980b0030 0x7f57981449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:30.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f5797fff700 1 -- 172.21.15.60:0/65092549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5798147700 con 0x7f57980ae5b0 2020-10-31T22:44:30.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.067+0000 7f5797fff700 1 --2- 172.21.15.60:0/65092549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57980ae5b0 0x7f57981411f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f5788001cb0 tx=0x7f5788001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:30.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.071+0000 7f57957fa700 1 -- 172.21.15.60:0/65092549 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5788004a80 con 0x7f57980ae5b0 2020-10-31T22:44:30.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.071+0000 7f57957fa700 1 -- 172.21.15.60:0/65092549 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5788004be0 con 0x7f57980ae5b0 2020-10-31T22:44:30.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.071+0000 7f57957fa700 1 -- 172.21.15.60:0/65092549 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5788007170 con 0x7f57980ae5b0 2020-10-31T22:44:30.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.071+0000 7f579d1e3700 1 -- 172.21.15.60:0/65092549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57980b55c0 con 0x7f57980ae5b0 2020-10-31T22:44:30.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.071+0000 7f579d1e3700 1 -- 172.21.15.60:0/65092549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57981416e0 con 0x7f57980ae5b0 2020-10-31T22:44:30.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.071+0000 7f579d1e3700 1 -- 172.21.15.60:0/65092549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57980b5250 con 0x7f57980ae5b0 2020-10-31T22:44:30.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.071+0000 7f57957fa700 1 -- 172.21.15.60:0/65092549 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5788010070 con 0x7f57980ae5b0 2020-10-31T22:44:30.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.071+0000 7f57957fa700 1 --2- 172.21.15.60:0/65092549 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f577c054f90 0x7f577c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:30.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.071+0000 7f57957fa700 1 -- 172.21.15.60:0/65092549 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f578806d730 con 0x7f57980ae5b0 2020-10-31T22:44:30.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.071+0000 7f57977fe700 1 --2- 172.21.15.60:0/65092549 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f577c054f90 0x7f577c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:30.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.071+0000 7f57977fe700 1 --2- 172.21.15.60:0/65092549 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f577c054f90 0x7f577c057450 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f578001a000 tx=0x7f5780015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.079+0000 7f57957fa700 1 -- 172.21.15.60:0/65092549 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5788043b40 con 0x7f57980ae5b0 2020-10-31T22:44:30.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.275+0000 7f579d1e3700 1 -- 172.21.15.60:0/65092549 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f5798057100 con 0x7f57980ae5b0 2020-10-31T22:44:30.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.927+0000 7f57957fa700 1 -- 172.21.15.60:0/65092549 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v153) v1 ==== 155+0+0 (secure 0 0 0) 0x7f5788019030 con 0x7f57980ae5b0 2020-10-31T22:44:30.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.931+0000 7f579d1e3700 1 -- 172.21.15.60:0/65092549 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f577c054f90 msgr2=0x7f577c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:30.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.931+0000 7f579d1e3700 1 --2- 172.21.15.60:0/65092549 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f577c054f90 0x7f577c057450 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f578001a000 tx=0x7f5780015000).stop 2020-10-31T22:44:30.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.931+0000 7f579d1e3700 1 -- 172.21.15.60:0/65092549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57980ae5b0 msgr2=0x7f57981411f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:30.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.931+0000 7f579d1e3700 1 --2- 172.21.15.60:0/65092549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57980ae5b0 0x7f57981411f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f5788001cb0 tx=0x7f5788001570).stop 2020-10-31T22:44:30.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.931+0000 7f579d1e3700 1 -- 172.21.15.60:0/65092549 shutdown_connections 2020-10-31T22:44:30.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.931+0000 7f579d1e3700 1 --2- 172.21.15.60:0/65092549 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5798141c90 0x7f5798144ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:30.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.931+0000 7f579d1e3700 1 --2- 172.21.15.60:0/65092549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57980ae5b0 0x7f57981411f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:30.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.931+0000 7f579d1e3700 1 --2- 172.21.15.60:0/65092549 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f577c054f90 0x7f577c057450 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:30.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.931+0000 7f579d1e3700 1 --2- 172.21.15.60:0/65092549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f57980b0030 0x7f57981449d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:30.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.931+0000 7f579d1e3700 1 -- 172.21.15.60:0/65092549 >> 172.21.15.60:0/65092549 conn(0x7f57980b61d0 msgr2=0x7f57980b33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:30.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.931+0000 7f579d1e3700 1 -- 172.21.15.60:0/65092549 shutdown_connections 2020-10-31T22:44:30.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:30.931+0000 7f579d1e3700 1 -- 172.21.15.60:0/65092549 wait complete. 2020-10-31T22:44:30.951 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2020-10-31T22:44:31.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.067+0000 7f55cce9f700 1 Processor -- start 2020-10-31T22:44:31.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.067+0000 7f55cce9f700 1 -- start start 2020-10-31T22:44:31.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.067+0000 7f55cce9f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55c805b180 0x7f55c805fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:31.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.067+0000 7f55cce9f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55c80b0b70 0x7f55c813f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:31.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.067+0000 7f55cce9f700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f55c8060220 0x7f55c813f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:31.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.067+0000 7f55cce9f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c805f3c0 con 0x7f55c80b0b70 2020-10-31T22:44:31.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.067+0000 7f55cce9f700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c8145f70 con 0x7f55c8060220 2020-10-31T22:44:31.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.067+0000 7f55cce9f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c805f5f0 con 0x7f55c805b180 2020-10-31T22:44:31.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55c6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55c80b0b70 0x7f55c813f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:31.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55c6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55c80b0b70 0x7f55c813f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43694/0 (socket says 172.21.15.60:43694) 2020-10-31T22:44:31.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55c6ffd700 1 -- 172.21.15.60:0/2785039594 learned_addr learned my addr 172.21.15.60:0/2785039594 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:31.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55c77fe700 1 --2- 172.21.15.60:0/2785039594 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55c805b180 0x7f55c805fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:31.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55c7fff700 1 --2- 172.21.15.60:0/2785039594 >> v2:172.21.15.66:3300/0 conn(0x7f55c8060220 0x7f55c813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:31.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55c6ffd700 1 -- 172.21.15.60:0/2785039594 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55c805b180 msgr2=0x7f55c805fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:31.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55c6ffd700 1 --2- 172.21.15.60:0/2785039594 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55c805b180 0x7f55c805fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55c6ffd700 1 -- 172.21.15.60:0/2785039594 >> v2:172.21.15.66:3300/0 conn(0x7f55c8060220 msgr2=0x7f55c813f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:31.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55c6ffd700 1 --2- 172.21.15.60:0/2785039594 >> v2:172.21.15.66:3300/0 conn(0x7f55c8060220 0x7f55c813f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55c6ffd700 1 -- 172.21.15.60:0/2785039594 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c805f890 con 0x7f55c80b0b70 2020-10-31T22:44:31.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55c6ffd700 1 --2- 172.21.15.60:0/2785039594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c80b0b70 0x7f55c813f030 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f55bc002f30 tx=0x7f55bc006e80).ready entity=mon.0 client_cookie=e4811c489ecf02fb server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:31.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55c67fc700 1 -- 172.21.15.60:0/2785039594 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55bc0097f0 con 0x7f55c80b0b70 2020-10-31T22:44:31.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55c67fc700 1 -- 172.21.15.60:0/2785039594 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc009950 con 0x7f55c80b0b70 2020-10-31T22:44:31.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55c67fc700 1 -- 172.21.15.60:0/2785039594 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55bc009cb0 con 0x7f55c80b0b70 2020-10-31T22:44:31.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55cce9f700 1 -- 172.21.15.60:0/2785039594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c80b0b70 msgr2=0x7f55c813f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:31.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55cce9f700 1 --2- 172.21.15.60:0/2785039594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c80b0b70 0x7f55c813f030 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f55bc002f30 tx=0x7f55bc006e80).stop 2020-10-31T22:44:31.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55cce9f700 1 -- 172.21.15.60:0/2785039594 shutdown_connections 2020-10-31T22:44:31.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55cce9f700 1 --2- 172.21.15.60:0/2785039594 >> v2:172.21.15.66:3300/0 conn(0x7f55c8060220 0x7f55c813f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55cce9f700 1 --2- 172.21.15.60:0/2785039594 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55c805b180 0x7f55c805fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55cce9f700 1 --2- 172.21.15.60:0/2785039594 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c80b0b70 0x7f55c813f030 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55cce9f700 1 -- 172.21.15.60:0/2785039594 >> 172.21.15.60:0/2785039594 conn(0x7f55c80b61d0 msgr2=0x7f55c80b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:31.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55cce9f700 1 -- 172.21.15.60:0/2785039594 shutdown_connections 2020-10-31T22:44:31.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55cce9f700 1 -- 172.21.15.60:0/2785039594 wait complete. 2020-10-31T22:44:31.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55cce9f700 1 Processor -- start 2020-10-31T22:44:31.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.071+0000 7f55cce9f700 1 -- start start 2020-10-31T22:44:31.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55cce9f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55c805b180 0x7f55c81449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:31.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55cce9f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c8060220 0x7f55c80abda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:31.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55cce9f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55c80b0b70 0x7f55c8153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:31.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55cce9f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c8140e10 con 0x7f55c8060220 2020-10-31T22:44:31.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55cce9f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80ab940 con 0x7f55c80b0b70 2020-10-31T22:44:31.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55cce9f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80aa130 con 0x7f55c805b180 2020-10-31T22:44:31.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55c6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c8060220 0x7f55c80abda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:31.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55c6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c8060220 0x7f55c80abda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43702/0 (socket says 172.21.15.60:43702) 2020-10-31T22:44:31.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55c6ffd700 1 -- 172.21.15.60:0/2968436486 learned_addr learned my addr 172.21.15.60:0/2968436486 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:31.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55c7fff700 1 --2- 172.21.15.60:0/2968436486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55c80b0b70 0x7f55c8153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:31.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55c77fe700 1 --2- 172.21.15.60:0/2968436486 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55c805b180 0x7f55c81449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:31.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55c6ffd700 1 -- 172.21.15.60:0/2968436486 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55c805b180 msgr2=0x7f55c81449a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:31.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55c6ffd700 1 --2- 172.21.15.60:0/2968436486 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55c805b180 0x7f55c81449a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55c6ffd700 1 -- 172.21.15.60:0/2968436486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55c80b0b70 msgr2=0x7f55c8153f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:31.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55c6ffd700 1 --2- 172.21.15.60:0/2968436486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55c80b0b70 0x7f55c8153f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55c6ffd700 1 -- 172.21.15.60:0/2968436486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c8140b70 con 0x7f55c8060220 2020-10-31T22:44:31.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55c6ffd700 1 --2- 172.21.15.60:0/2968436486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c8060220 0x7f55c80abda0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f55bc002f30 tx=0x7f55bc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:31.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55c4ff9700 1 -- 172.21.15.60:0/2968436486 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55bc011c10 con 0x7f55c8060220 2020-10-31T22:44:31.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55c4ff9700 1 -- 172.21.15.60:0/2968436486 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc011d70 con 0x7f55c8060220 2020-10-31T22:44:31.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55c4ff9700 1 -- 172.21.15.60:0/2968436486 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55bc01e650 con 0x7f55c8060220 2020-10-31T22:44:31.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55cce9f700 1 -- 172.21.15.60:0/2968436486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c80ac290 con 0x7f55c8060220 2020-10-31T22:44:31.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.075+0000 7f55cce9f700 1 -- 172.21.15.60:0/2968436486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c8154410 con 0x7f55c8060220 2020-10-31T22:44:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.079+0000 7f55c4ff9700 1 -- 172.21.15.60:0/2968436486 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f55bc01a040 con 0x7f55c8060220 2020-10-31T22:44:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.079+0000 7f55cce9f700 1 -- 172.21.15.60:0/2968436486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c8057100 con 0x7f55c8060220 2020-10-31T22:44:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.079+0000 7f55c4ff9700 1 --2- 172.21.15.60:0/2968436486 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f55a8054f10 0x7f55a80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.079+0000 7f55c4ff9700 1 -- 172.21.15.60:0/2968436486 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f55bc06ea70 con 0x7f55c8060220 2020-10-31T22:44:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.079+0000 7f55c77fe700 1 --2- 172.21.15.60:0/2968436486 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f55a8054f10 0x7f55a80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:31.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.079+0000 7f55c77fe700 1 --2- 172.21.15.60:0/2968436486 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f55a8054f10 0x7f55a80573d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f55b800c000 tx=0x7f55b8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:31.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.083+0000 7f55c4ff9700 1 -- 172.21.15.60:0/2968436486 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f55bc044f90 con 0x7f55c8060220 2020-10-31T22:44:31.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.227+0000 7f55cce9f700 1 -- 172.21.15.60:0/2968436486 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7f55c8060700 con 0x7f55c8060220 2020-10-31T22:44:31.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.235+0000 7f55c4ff9700 1 -- 172.21.15.60:0/2968436486 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f55bc06ee60 con 0x7f55c8060220 2020-10-31T22:44:31.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.235+0000 7f55cce9f700 1 -- 172.21.15.60:0/2968436486 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f55a8054f10 msgr2=0x7f55a80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.235+0000 7f55cce9f700 1 --2- 172.21.15.60:0/2968436486 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f55a8054f10 0x7f55a80573d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f55b800c000 tx=0x7f55b8008040).stop 2020-10-31T22:44:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.235+0000 7f55cce9f700 1 -- 172.21.15.60:0/2968436486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c8060220 msgr2=0x7f55c80abda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.235+0000 7f55cce9f700 1 --2- 172.21.15.60:0/2968436486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c8060220 0x7f55c80abda0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f55bc002f30 tx=0x7f55bc015000).stop 2020-10-31T22:44:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.239+0000 7f55cce9f700 1 -- 172.21.15.60:0/2968436486 shutdown_connections 2020-10-31T22:44:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.239+0000 7f55cce9f700 1 --2- 172.21.15.60:0/2968436486 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f55a8054f10 0x7f55a80573d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.239+0000 7f55cce9f700 1 --2- 172.21.15.60:0/2968436486 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55c80b0b70 0x7f55c8153f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.239+0000 7f55cce9f700 1 --2- 172.21.15.60:0/2968436486 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55c805b180 0x7f55c81449a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.239+0000 7f55cce9f700 1 --2- 172.21.15.60:0/2968436486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55c8060220 0x7f55c80abda0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.239+0000 7f55cce9f700 1 -- 172.21.15.60:0/2968436486 >> 172.21.15.60:0/2968436486 conn(0x7f55c80b61d0 msgr2=0x7f55c80af010 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.239+0000 7f55cce9f700 1 -- 172.21.15.60:0/2968436486 shutdown_connections 2020-10-31T22:44:31.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.239+0000 7f55cce9f700 1 -- 172.21.15.60:0/2968436486 wait complete. 2020-10-31T22:44:31.253 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:44:31.253 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:44:31.269 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:44:31.286 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:44:31.303 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:44:31.321 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:44:31.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:44:31.322 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:44:31.323 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:44:31.367 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-10-31T22:44:31.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:44:31.369 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2020-10-31T22:44:31.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:44:31.369 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:44:31.370 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:44:31.377 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:44:31.378 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:44:31.378 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:44:31.379 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-10-31T22:44:31.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.499+0000 7fa34b115700 1 Processor -- start 2020-10-31T22:44:31.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.499+0000 7fa34b115700 1 -- start start 2020-10-31T22:44:31.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.499+0000 7fa34b115700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa3440b5570 0x7fa3440b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:31.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.499+0000 7fa34b115700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa344141fe0 0x7fa344142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:31.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.499+0000 7fa34b115700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa344145180 con 0x7fa3440b24a0 2020-10-31T22:44:31.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.499+0000 7fa34b115700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3440afae0 con 0x7fa3440b5570 2020-10-31T22:44:31.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.499+0000 7fa34b115700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa344141bf0 con 0x7fa344141fe0 2020-10-31T22:44:31.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.499+0000 7fa34a113700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa3440b5570 0x7fa3440b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:31.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.499+0000 7fa34a914700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa344141fe0 0x7fa344142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:31.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.499+0000 7fa349912700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa3440b24a0 0x7fa344145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:45714/0 (socket says 172.21.15.60:45714) 2020-10-31T22:44:31.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.499+0000 7fa349912700 1 -- 172.21.15.60:0/397281096 learned_addr learned my addr 172.21.15.60:0/397281096 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:31.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.499+0000 7fa34a113700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa3440b5570 0x7fa3440b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43708/0 (socket says 172.21.15.60:43708) 2020-10-31T22:44:31.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.499+0000 7fa349111700 1 -- 172.21.15.60:0/397281096 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648799929 0 0) 0x7fa344145180 con 0x7fa3440b24a0 2020-10-31T22:44:31.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa349111700 1 -- 172.21.15.60:0/397281096 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa32c003230 con 0x7fa3440b24a0 2020-10-31T22:44:31.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34a113700 1 -- 172.21.15.60:0/397281096 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa344141fe0 msgr2=0x7fa344142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:31.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34a113700 1 --2- 172.21.15.60:0/397281096 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa344141fe0 0x7fa344142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34a113700 1 -- 172.21.15.60:0/397281096 >> v1:172.21.15.66:6789/0 conn(0x7fa3440b24a0 legacy=0x7fa344145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:31.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34a113700 1 -- 172.21.15.60:0/397281096 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3440b0670 con 0x7fa3440b5570 2020-10-31T22:44:31.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34a914700 1 --2- 172.21.15.60:0/397281096 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa344141fe0 0x7fa344142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:44:31.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34a113700 1 --2- 172.21.15.60:0/397281096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3440b5570 0x7fa3440b5950 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fa34405f580 tx=0x7fa334006dc0).ready entity=mon.0 client_cookie=1f58b530745c9353 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:31.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa349111700 1 -- 172.21.15.60:0/397281096 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3340096a0 con 0x7fa3440b5570 2020-10-31T22:44:31.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa349111700 1 -- 172.21.15.60:0/397281096 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa334009800 con 0x7fa3440b5570 2020-10-31T22:44:31.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa349111700 1 -- 172.21.15.60:0/397281096 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa334009b60 con 0x7fa3440b5570 2020-10-31T22:44:31.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34b115700 1 -- 172.21.15.60:0/397281096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3440b5570 msgr2=0x7fa3440b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:31.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34b115700 1 --2- 172.21.15.60:0/397281096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3440b5570 0x7fa3440b5950 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fa34405f580 tx=0x7fa334006dc0).stop 2020-10-31T22:44:31.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34b115700 1 -- 172.21.15.60:0/397281096 shutdown_connections 2020-10-31T22:44:31.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34b115700 1 --2- 172.21.15.60:0/397281096 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa344141fe0 0x7fa344142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34b115700 1 --2- 172.21.15.60:0/397281096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3440b5570 0x7fa3440b5950 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34b115700 1 -- 172.21.15.60:0/397281096 >> 172.21.15.60:0/397281096 conn(0x7fa3440b8e90 msgr2=0x7fa3440b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:31.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34b115700 1 -- 172.21.15.60:0/397281096 shutdown_connections 2020-10-31T22:44:31.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34b115700 1 -- 172.21.15.60:0/397281096 wait complete. 2020-10-31T22:44:31.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34b115700 1 Processor -- start 2020-10-31T22:44:31.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.503+0000 7fa34b115700 1 -- start start 2020-10-31T22:44:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34b115700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3440b24a0 0x7fa344144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34b115700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3440b5570 0x7fa34413cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34b115700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344141fe0 0x7fa3440b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34b115700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3440b7b50 con 0x7fa344141fe0 2020-10-31T22:44:31.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34b115700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa344146be0 con 0x7fa3440b5570 2020-10-31T22:44:31.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34b115700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa344146e80 con 0x7fa3440b24a0 2020-10-31T22:44:31.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34a914700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344141fe0 0x7fa3440b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:31.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34a914700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344141fe0 0x7fa3440b6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43716/0 (socket says 172.21.15.60:43716) 2020-10-31T22:44:31.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34a914700 1 -- 172.21.15.60:0/2172059441 learned_addr learned my addr 172.21.15.60:0/2172059441 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:31.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa349912700 1 --2- 172.21.15.60:0/2172059441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3440b5570 0x7fa34413cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:31.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34a113700 1 --2- 172.21.15.60:0/2172059441 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3440b24a0 0x7fa344144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:31.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34a914700 1 -- 172.21.15.60:0/2172059441 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3440b24a0 msgr2=0x7fa344144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:31.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34a914700 1 --2- 172.21.15.60:0/2172059441 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3440b24a0 0x7fa344144b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34a914700 1 -- 172.21.15.60:0/2172059441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3440b5570 msgr2=0x7fa34413cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:31.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34a914700 1 --2- 172.21.15.60:0/2172059441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3440b5570 0x7fa34413cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34a914700 1 -- 172.21.15.60:0/2172059441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa344147120 con 0x7fa344141fe0 2020-10-31T22:44:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34a914700 1 --2- 172.21.15.60:0/2172059441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344141fe0 0x7fa3440b6ac0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fa33c00c000 tx=0x7fa33c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa3337fe700 1 -- 172.21.15.60:0/2172059441 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa33c00cb00 con 0x7fa344141fe0 2020-10-31T22:44:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa3337fe700 1 -- 172.21.15.60:0/2172059441 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33c00cc60 con 0x7fa344141fe0 2020-10-31T22:44:31.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34b115700 1 -- 172.21.15.60:0/2172059441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3440b6600 con 0x7fa344141fe0 2020-10-31T22:44:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa3337fe700 1 -- 172.21.15.60:0/2172059441 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa33c0123f0 con 0x7fa344141fe0 2020-10-31T22:44:31.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34b115700 1 -- 172.21.15.60:0/2172059441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa344153c10 con 0x7fa344141fe0 2020-10-31T22:44:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.507+0000 7fa34b115700 1 -- 172.21.15.60:0/2172059441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa344057100 con 0x7fa344141fe0 2020-10-31T22:44:31.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.511+0000 7fa3337fe700 1 -- 172.21.15.60:0/2172059441 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa33c022070 con 0x7fa344141fe0 2020-10-31T22:44:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.511+0000 7fa3337fe700 1 --2- 172.21.15.60:0/2172059441 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa324054f10 0x7fa3240573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.511+0000 7fa3337fe700 1 -- 172.21.15.60:0/2172059441 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa33c06e1f0 con 0x7fa344141fe0 2020-10-31T22:44:31.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.511+0000 7fa34a113700 1 --2- 172.21.15.60:0/2172059441 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa324054f10 0x7fa3240573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:31.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.511+0000 7fa34a113700 1 --2- 172.21.15.60:0/2172059441 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa324054f10 0x7fa3240573d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fa33401b000 tx=0x7fa334015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:31.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.515+0000 7fa3337fe700 1 -- 172.21.15.60:0/2172059441 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa33c044710 con 0x7fa344141fe0 2020-10-31T22:44:31.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.663+0000 7fa34b115700 1 -- 172.21.15.60:0/2172059441 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa3440b67f0 con 0x7fa344141fe0 2020-10-31T22:44:31.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.663+0000 7fa3337fe700 1 -- 172.21.15.60:0/2172059441 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v44) v1 ==== 81+0+33645 (secure 0 0 0) 0x7fa33c016020 con 0x7fa344141fe0 2020-10-31T22:44:31.666 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:44:31.666 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:44:31.666 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 44, 2020-10-31T22:44:31.666 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "226f905a-1517-4a8c-8009-08779515965c", 2020-10-31T22:44:31.667 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2020-10-31T22:40:51.928572+0000", 2020-10-31T22:44:31.667 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2020-10-31T22:43:09.336217+0000", 2020-10-31T22:44:31.667 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:44:31.667 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:44:31.668 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-10-31T22:44:31.668 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2020-10-31T22:44:31.668 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2020-10-31T22:44:31.668 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2020-10-31T22:44:31.668 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2020-10-31T22:44:31.669 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2020-10-31T22:44:31.669 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2020-10-31T22:44:31.669 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:44:31.670 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2020-10-31T22:44:31.670 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2020-10-31T22:44:31.670 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-10-31T22:44:31.670 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2020-10-31T22:44:31.671 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2020-10-31T22:44:31.671 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 8, 2020-10-31T22:44:31.671 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2020-10-31T22:44:31.671 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "jewel", 2020-10-31T22:44:31.672 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2020-10-31T22:44:31.672 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "octopus", 2020-10-31T22:44:31.672 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:44:31.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.673 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2020-10-31T22:44:31.673 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "device_health_metrics", 2020-10-31T22:44:31.673 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:40:55.846143+0000", 2020-10-31T22:44:31.674 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:44:31.674 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:44:31.674 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:44:31.674 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:44:31.675 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:44:31.675 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:44:31.675 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:44:31.676 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:44:31.676 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2020-10-31T22:44:31.676 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2020-10-31T22:44:31.676 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2020-10-31T22:44:31.677 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2020-10-31T22:44:31.677 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2020-10-31T22:44:31.677 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:44:31.677 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:44:31.677 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:44:31.678 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:44:31.678 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:44:31.678 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:44:31.679 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:44:31.679 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.679 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "15", 2020-10-31T22:44:31.679 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:44:31.680 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:44:31.680 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:44:31.680 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:44:31.681 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:44:31.681 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:44:31.681 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:44:31.681 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:44:31.682 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:44:31.683 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:44:31.683 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:44:31.683 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:44:31.684 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:44:31.684 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:44:31.684 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:44:31.684 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:44:31.684 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:44:31.684 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:44:31.685 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:44:31.685 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:44:31.685 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:44:31.685 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:44:31.685 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:44:31.685 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:44:31.685 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:44:31.686 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:44:31.686 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.687 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:44:31.687 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:44:31.688 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:44:31.688 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:44:31.688 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:44:31.688 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:44:31.689 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:44:31.689 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:44:31.689 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:44:31.689 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:44:31.690 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:44:31.690 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:44:31.690 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2020-10-31T22:44:31.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.692 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:44:31.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_devicehealth": {} 2020-10-31T22:44:31.693 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.693 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2020-10-31T22:44:31.693 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2020-10-31T22:44:31.694 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:05.358501+0000", 2020-10-31T22:44:31.694 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:44:31.694 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:44:31.694 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:44:31.694 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:44:31.694 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:44:31.695 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:44:31.695 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:44:31.695 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:44:31.695 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:44:31.695 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:44:31.695 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:44:31.695 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:44:31.696 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:44:31.696 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:44:31.696 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:44:31.696 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:44:31.696 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:44:31.696 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:44:31.696 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:44:31.697 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:44:31.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.697 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "18", 2020-10-31T22:44:31.697 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:44:31.697 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:44:31.697 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:44:31.698 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:44:31.698 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:44:31.698 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:44:31.698 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:44:31.699 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:44:31.700 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:44:31.700 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:44:31.700 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:44:31.701 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:44:31.701 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:44:31.702 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:44:31.702 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:44:31.702 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:44:31.702 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:44:31.703 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:44:31.703 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:44:31.703 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:44:31.703 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:44:31.704 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:44:31.704 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:44:31.704 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:44:31.704 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:44:31.704 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:44:31.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.705 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:44:31.705 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:44:31.705 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:44:31.705 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:44:31.706 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:44:31.706 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:44:31.706 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:44:31.706 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:44:31.706 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:44:31.706 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:44:31.707 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:44:31.707 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:44:31.707 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:44:31.707 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2020-10-31T22:44:31.707 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.708 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.708 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 7, 2020-10-31T22:44:31.708 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2020-10-31T22:44:31.708 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:43:06.097368+0000", 2020-10-31T22:44:31.709 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:44:31.709 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:44:31.709 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:44:31.709 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:44:31.710 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:44:31.710 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:44:31.710 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:44:31.710 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:44:31.711 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:44:31.711 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:44:31.711 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:44:31.712 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:44:31.712 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:44:31.712 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:44:31.712 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:44:31.712 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:44:31.713 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:44:31.713 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:44:31.713 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:44:31.713 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:44:31.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.714 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "43", 2020-10-31T22:44:31.714 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:44:31.714 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:44:31.714 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:44:31.714 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:44:31.715 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:44:31.715 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:44:31.715 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:44:31.716 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:44:31.716 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:44:31.716 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:44:31.716 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:44:31.717 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:44:31.717 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:44:31.717 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:44:31.718 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:44:31.718 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:44:31.718 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:44:31.719 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:44:31.719 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:44:31.719 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:44:31.719 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:44:31.720 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:44:31.720 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:44:31.720 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:44:31.721 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:44:31.721 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:44:31.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.722 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:44:31.722 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:44:31.722 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:44:31.722 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:44:31.723 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:44:31.723 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:44:31.723 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:44:31.724 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:44:31.724 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:44:31.724 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:44:31.725 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:44:31.725 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:44:31.725 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2020-10-31T22:44:31.725 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2020-10-31T22:44:31.726 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2020-10-31T22:44:31.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.726 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:44:31.727 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:44:31.727 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2020-10-31T22:44:31.727 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.728 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.729 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 8, 2020-10-31T22:44:31.729 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2020-10-31T22:44:31.729 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:43:07.332204+0000", 2020-10-31T22:44:31.729 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:44:31.730 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:44:31.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:44:31.730 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:44:31.731 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:44:31.731 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:44:31.731 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:44:31.732 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:44:31.732 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:44:31.732 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:44:31.732 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:44:31.733 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:44:31.733 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:44:31.733 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:44:31.734 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:44:31.734 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:44:31.734 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:44:31.735 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:44:31.735 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:44:31.736 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:44:31.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.736 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "44", 2020-10-31T22:44:31.737 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:44:31.737 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:44:31.737 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:44:31.738 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:44:31.738 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:44:31.738 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:44:31.739 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:44:31.739 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:44:31.739 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:44:31.740 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:44:31.740 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:44:31.740 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:44:31.741 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:44:31.741 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:44:31.741 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:44:31.742 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:44:31.742 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:44:31.742 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:44:31.742 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:44:31.743 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:44:31.743 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:44:31.743 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:44:31.744 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:44:31.744 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:44:31.744 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:44:31.745 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:44:31.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.745 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:44:31.745 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:44:31.746 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:44:31.746 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:44:31.746 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:44:31.747 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:44:31.747 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:44:31.747 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:44:31.747 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:44:31.748 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:44:31.748 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:44:31.748 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:44:31.749 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:44:31.749 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:44:31.749 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2020-10-31T22:44:31.749 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.750 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:44:31.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2020-10-31T22:44:31.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.751 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:44:31.752 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", 2020-10-31T22:44:31.752 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:44:31.752 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:44:31.752 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:44:31.753 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:44:31.753 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:44:31.753 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:44:31.754 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:44:31.754 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 42, 2020-10-31T22:44:31.754 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:44:31.754 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:44:31.755 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:44:31.755 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.756 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.756 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2020-10-31T22:44:31.756 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:44:31.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.757 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.757 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.757 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2020-10-31T22:44:31.758 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:44:31.758 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.758 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.759 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:44:31.760 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.760 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.761 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2020-10-31T22:44:31.761 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:44:31.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.762 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.762 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2020-10-31T22:44:31.763 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:44:31.763 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.763 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.764 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:44:31.764 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.765 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.765 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2020-10-31T22:44:31.765 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:44:31.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.766 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.767 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2020-10-31T22:44:31.767 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:44:31.767 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.767 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.768 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:44:31.768 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.769 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.769 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2020-10-31T22:44:31.769 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:44:31.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.770 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.771 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2020-10-31T22:44:31.771 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:44:31.771 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.771 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.772 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6803/14302", 2020-10-31T22:44:31.772 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6805/14302", 2020-10-31T22:44:31.773 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6809/14302", 2020-10-31T22:44:31.773 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6807/14302", 2020-10-31T22:44:31.773 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:44:31.773 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:44:31.774 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:44:31.774 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.775 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:44:31.775 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", 2020-10-31T22:44:31.776 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:44:31.776 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:44:31.776 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:44:31.776 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:44:31.777 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:44:31.777 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:44:31.777 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:44:31.788 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 42, 2020-10-31T22:44:31.788 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:44:31.789 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:44:31.789 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:44:31.789 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2020-10-31T22:44:31.793 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:44:31.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.794 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2020-10-31T22:44:31.795 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:44:31.795 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.795 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.795 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:44:31.795 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.796 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.796 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2020-10-31T22:44:31.796 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:44:31.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.796 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.796 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2020-10-31T22:44:31.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:44:31.798 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.798 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.798 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:44:31.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2020-10-31T22:44:31.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:44:31.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2020-10-31T22:44:31.800 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:44:31.800 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.800 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.800 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:44:31.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.801 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2020-10-31T22:44:31.801 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:44:31.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2020-10-31T22:44:31.802 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:44:31.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.802 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.802 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/14300", 2020-10-31T22:44:31.803 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6813/14300", 2020-10-31T22:44:31.803 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6817/14300", 2020-10-31T22:44:31.803 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6815/14300", 2020-10-31T22:44:31.803 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:44:31.803 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:44:31.803 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:44:31.803 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.804 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:44:31.804 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", 2020-10-31T22:44:31.804 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:44:31.804 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:44:31.804 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:44:31.804 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:44:31.805 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:44:31.805 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:44:31.805 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:44:31.805 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 30, 2020-10-31T22:44:31.805 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:44:31.805 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:44:31.805 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:44:31.806 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.806 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.806 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2020-10-31T22:44:31.806 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:44:31.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.807 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2020-10-31T22:44:31.807 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:44:31.807 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.807 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.807 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:44:31.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.808 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2020-10-31T22:44:31.808 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:44:31.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2020-10-31T22:44:31.809 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:44:31.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.809 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.809 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:44:31.810 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.810 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.810 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6832", 2020-10-31T22:44:31.810 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:44:31.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6833", 2020-10-31T22:44:31.811 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:44:31.811 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.811 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.811 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:44:31.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2020-10-31T22:44:31.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:44:31.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.813 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2020-10-31T22:44:31.813 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:44:31.813 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.813 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.813 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6827/14318", 2020-10-31T22:44:31.813 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6829/14318", 2020-10-31T22:44:31.814 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6833/14318", 2020-10-31T22:44:31.814 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6831/14318", 2020-10-31T22:44:31.814 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:44:31.814 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:44:31.814 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:44:31.814 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.815 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:44:31.815 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", 2020-10-31T22:44:31.815 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:44:31.815 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:44:31.815 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:44:31.815 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:44:31.816 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:44:31.816 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:44:31.816 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:44:31.816 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 42, 2020-10-31T22:44:31.816 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:44:31.816 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:44:31.816 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:44:31.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2020-10-31T22:44:31.817 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:44:31.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2020-10-31T22:44:31.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:44:31.818 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.818 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.818 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:44:31.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2020-10-31T22:44:31.819 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:44:31.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2020-10-31T22:44:31.820 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:44:31.820 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.820 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.820 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:44:31.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2020-10-31T22:44:31.821 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:44:31.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2020-10-31T22:44:31.822 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:44:31.822 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.822 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.822 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:44:31.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2020-10-31T22:44:31.823 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:44:31.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2020-10-31T22:44:31.824 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:44:31.824 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.824 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.824 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6819/14301", 2020-10-31T22:44:31.824 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6821/14301", 2020-10-31T22:44:31.824 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/14301", 2020-10-31T22:44:31.824 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6823/14301", 2020-10-31T22:44:31.825 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:44:31.825 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:44:31.825 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:44:31.825 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.825 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:44:31.826 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", 2020-10-31T22:44:31.826 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:44:31.826 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:44:31.826 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:44:31.826 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:44:31.826 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:44:31.826 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:44:31.827 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:44:31.827 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 42, 2020-10-31T22:44:31.827 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:44:31.827 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:44:31.827 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:44:31.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.828 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.828 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6816", 2020-10-31T22:44:31.828 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:44:31.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.828 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.828 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6817", 2020-10-31T22:44:31.828 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:44:31.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.829 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.829 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:44:31.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.830 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6818", 2020-10-31T22:44:31.830 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:44:31.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.830 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6819", 2020-10-31T22:44:31.830 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:44:31.831 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.831 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.831 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:44:31.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6822", 2020-10-31T22:44:31.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:44:31.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6823", 2020-10-31T22:44:31.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:44:31.832 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.833 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.833 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:44:31.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6820", 2020-10-31T22:44:31.834 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:44:31.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6821", 2020-10-31T22:44:31.834 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:44:31.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.835 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.835 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6817/14002", 2020-10-31T22:44:31.835 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6819/14002", 2020-10-31T22:44:31.835 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6823/14002", 2020-10-31T22:44:31.835 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6821/14002", 2020-10-31T22:44:31.835 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:44:31.836 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:44:31.836 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:44:31.836 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.836 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:44:31.836 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", 2020-10-31T22:44:31.836 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:44:31.837 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:44:31.837 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:44:31.837 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:44:31.837 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:44:31.837 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:44:31.837 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:44:31.837 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 42, 2020-10-31T22:44:31.838 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:44:31.838 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:44:31.838 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:44:31.838 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.838 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.838 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6800", 2020-10-31T22:44:31.839 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:44:31.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.839 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.839 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6801", 2020-10-31T22:44:31.839 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:44:31.839 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.839 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.840 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:44:31.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6802", 2020-10-31T22:44:31.840 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:44:31.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6803", 2020-10-31T22:44:31.841 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:44:31.841 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.841 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.842 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:44:31.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.842 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6806", 2020-10-31T22:44:31.842 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:44:31.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6807", 2020-10-31T22:44:31.843 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:44:31.843 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.843 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.844 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:44:31.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6804", 2020-10-31T22:44:31.844 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:44:31.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6805", 2020-10-31T22:44:31.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:44:31.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.845 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.846 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6801/14001", 2020-10-31T22:44:31.846 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6803/14001", 2020-10-31T22:44:31.846 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6807/14001", 2020-10-31T22:44:31.846 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6805/14001", 2020-10-31T22:44:31.846 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:44:31.846 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:44:31.846 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:44:31.846 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.847 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:44:31.847 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", 2020-10-31T22:44:31.847 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:44:31.847 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:44:31.847 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:44:31.848 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:44:31.848 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:44:31.848 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:44:31.848 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:44:31.848 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 42, 2020-10-31T22:44:31.848 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:44:31.848 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:44:31.849 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:44:31.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6808", 2020-10-31T22:44:31.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:44:31.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6809", 2020-10-31T22:44:31.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:44:31.850 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.850 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.850 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:44:31.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6810", 2020-10-31T22:44:31.851 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:44:31.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6811", 2020-10-31T22:44:31.852 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:44:31.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.852 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.852 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:44:31.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6814", 2020-10-31T22:44:31.853 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:44:31.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6815", 2020-10-31T22:44:31.854 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:44:31.854 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.854 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.854 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:44:31.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6812", 2020-10-31T22:44:31.855 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:44:31.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6813", 2020-10-31T22:44:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:44:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6809/14003", 2020-10-31T22:44:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6811/14003", 2020-10-31T22:44:31.856 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6815/14003", 2020-10-31T22:44:31.857 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6813/14003", 2020-10-31T22:44:31.857 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:44:31.857 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:44:31.857 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:44:31.857 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:44:31.858 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", 2020-10-31T22:44:31.858 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:44:31.858 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:44:31.858 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:44:31.858 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:44:31.858 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:44:31.859 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:44:31.859 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:44:31.859 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 41, 2020-10-31T22:44:31.859 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:44:31.859 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:44:31.859 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:44:31.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.860 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6824", 2020-10-31T22:44:31.860 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:44:31.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.860 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6825", 2020-10-31T22:44:31.861 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:44:31.861 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.861 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.861 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:44:31.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6826", 2020-10-31T22:44:31.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:44:31.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6827", 2020-10-31T22:44:31.863 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:44:31.863 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.863 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.863 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:44:31.863 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6830", 2020-10-31T22:44:31.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:44:31.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6831", 2020-10-31T22:44:31.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:44:31.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.865 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.865 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:44:31.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:44:31.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:44:31.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6828", 2020-10-31T22:44:31.866 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:44:31.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:44:31.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6829", 2020-10-31T22:44:31.866 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:44:31.866 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.867 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.867 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6825/14046", 2020-10-31T22:44:31.867 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6827/14046", 2020-10-31T22:44:31.867 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6831/14046", 2020-10-31T22:44:31.867 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6829/14046", 2020-10-31T22:44:31.867 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:44:31.868 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:44:31.868 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:44:31.868 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:31.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.868 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:44:31.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2020-10-31T22:44:31.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.868 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:44:31.869 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:44:31.869 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:44:31.869 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:44:31.869 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:44:31.869 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:44:31.869 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.314917+0000", 2020-10-31T22:44:31.869 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:44:31.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.870 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:44:31.870 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:44:31.870 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:44:31.870 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:44:31.870 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:44:31.871 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:44:31.871 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.643069+0000", 2020-10-31T22:44:31.871 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:44:31.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.871 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:44:31.871 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:44:31.872 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:44:31.872 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:44:31.872 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:44:31.872 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:44:31.872 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.662572+0000", 2020-10-31T22:44:31.872 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:44:31.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:44:31.873 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:44:31.873 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:44:31.873 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:44:31.873 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:44:31.873 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:44:31.873 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.664868+0000", 2020-10-31T22:44:31.874 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:44:31.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.874 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:44:31.874 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:44:31.874 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:44:31.874 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:44:31.875 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:44:31.875 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:44:31.875 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551107+0000", 2020-10-31T22:44:31.875 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:44:31.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.875 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:44:31.876 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:44:31.876 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:44:31.876 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:44:31.876 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:44:31.876 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:44:31.876 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.400568+0000", 2020-10-31T22:44:31.876 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:44:31.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.877 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:44:31.877 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:44:31.877 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:44:31.877 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:44:31.877 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:44:31.877 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:44:31.878 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551173+0000", 2020-10-31T22:44:31.878 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:44:31.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:31.878 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:44:31.878 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:44:31.878 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:44:31.879 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:44:31.879 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:44:31.879 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:44:31.879 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.604302+0000", 2020-10-31T22:44:31.879 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:44:31.879 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.879 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:44:31.880 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2020-10-31T22:44:31.880 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2020-10-31T22:44:31.880 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2020-10-31T22:44:31.880 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2020-10-31T22:44:31.880 INFO:teuthology.orchestra.run.smithi060.stdout: "blacklist": {}, 2020-10-31T22:44:31.880 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2020-10-31T22:44:31.880 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2020-10-31T22:44:31.880 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2020-10-31T22:44:31.881 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2020-10-31T22:44:31.881 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2020-10-31T22:44:31.881 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2020-10-31T22:44:31.881 INFO:teuthology.orchestra.run.smithi060.stdout: "ruleset-failure-domain": "osd", 2020-10-31T22:44:31.881 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2020-10-31T22:44:31.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:31.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:31.882 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2020-10-31T22:44:31.882 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2020-10-31T22:44:31.882 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2020-10-31T22:44:31.882 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2020-10-31T22:44:31.882 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {} 2020-10-31T22:44:31.882 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:44:31.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.667+0000 7fa34b115700 1 -- 172.21.15.60:0/2172059441 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa324054f10 msgr2=0x7fa3240573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:31.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.667+0000 7fa34b115700 1 --2- 172.21.15.60:0/2172059441 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa324054f10 0x7fa3240573d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7fa33401b000 tx=0x7fa334015000).stop 2020-10-31T22:44:31.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.667+0000 7fa34b115700 1 -- 172.21.15.60:0/2172059441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344141fe0 msgr2=0x7fa3440b6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:31.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.667+0000 7fa34b115700 1 --2- 172.21.15.60:0/2172059441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344141fe0 0x7fa3440b6ac0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fa33c00c000 tx=0x7fa33c0091a0).stop 2020-10-31T22:44:31.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.667+0000 7fa34b115700 1 -- 172.21.15.60:0/2172059441 shutdown_connections 2020-10-31T22:44:31.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.667+0000 7fa34b115700 1 --2- 172.21.15.60:0/2172059441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa344141fe0 0x7fa3440b6ac0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.667+0000 7fa34b115700 1 --2- 172.21.15.60:0/2172059441 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3440b24a0 0x7fa344144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.667+0000 7fa34b115700 1 --2- 172.21.15.60:0/2172059441 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa324054f10 0x7fa3240573d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.667+0000 7fa34b115700 1 --2- 172.21.15.60:0/2172059441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3440b5570 0x7fa34413cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:31.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.667+0000 7fa34b115700 1 -- 172.21.15.60:0/2172059441 >> 172.21.15.60:0/2172059441 conn(0x7fa3440b8e90 msgr2=0x7fa34405fb30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:31.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.667+0000 7fa34b115700 1 -- 172.21.15.60:0/2172059441 shutdown_connections 2020-10-31T22:44:31.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:31.667+0000 7fa34b115700 1 -- 172.21.15.60:0/2172059441 wait complete. 2020-10-31T22:44:31.887 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:44:32.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.007+0000 7f90182bd700 1 Processor -- start 2020-10-31T22:44:32.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f90182bd700 1 -- start start 2020-10-31T22:44:32.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f90182bd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f90100b52a0 0x7f90100abe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:32.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f90182bd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f901005c440 0x7f90100ac320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:32.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f90182bd700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90100ae1e0 con 0x7f90100acab0 2020-10-31T22:44:32.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f90182bd700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90100ae480 con 0x7f901005c440 2020-10-31T22:44:32.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f90182bd700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90100ae720 con 0x7f90100b52a0 2020-10-31T22:44:32.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f901685a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f901005c440 0x7f90100ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:32.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f901685a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f901005c440 0x7f90100ac320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43724/0 (socket says 172.21.15.60:43724) 2020-10-31T22:44:32.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f901685a700 1 -- 172.21.15.60:0/1836240052 learned_addr learned my addr 172.21.15.60:0/1836240052 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:32.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f9016059700 1 --2- 172.21.15.60:0/1836240052 >> v2:172.21.15.66:3300/0 conn(0x7f90100b52a0 0x7f90100abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:32.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f901685a700 1 -- 172.21.15.60:0/1836240052 >> v2:172.21.15.66:3300/0 conn(0x7f90100b52a0 msgr2=0x7f90100abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:32.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f901685a700 1 --2- 172.21.15.60:0/1836240052 >> v2:172.21.15.66:3300/0 conn(0x7f90100b52a0 0x7f90100abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f901685a700 1 -- 172.21.15.60:0/1836240052 >> v1:172.21.15.66:6789/0 conn(0x7f90100acab0 legacy=0x7f901013ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:32.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f901685a700 1 -- 172.21.15.60:0/1836240052 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90100ae9c0 con 0x7f901005c440 2020-10-31T22:44:32.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f901685a700 1 --2- 172.21.15.60:0/1836240052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f901005c440 0x7f90100ac320 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f90080032b0 tx=0x7f9008009270).ready entity=mon.0 client_cookie=a7b7b1acfb079c3c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:32.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f9015057700 1 -- 172.21.15.60:0/1836240052 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f900800bc00 con 0x7f901005c440 2020-10-31T22:44:32.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f9015057700 1 -- 172.21.15.60:0/1836240052 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900800bd60 con 0x7f901005c440 2020-10-31T22:44:32.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f9015057700 1 -- 172.21.15.60:0/1836240052 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9008011400 con 0x7f901005c440 2020-10-31T22:44:32.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f90182bd700 1 -- 172.21.15.60:0/1836240052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f901005c440 msgr2=0x7f90100ac320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:32.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.011+0000 7f90182bd700 1 --2- 172.21.15.60:0/1836240052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f901005c440 0x7f90100ac320 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f90080032b0 tx=0x7f9008009270).stop 2020-10-31T22:44:32.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.015+0000 7f90182bd700 1 -- 172.21.15.60:0/1836240052 shutdown_connections 2020-10-31T22:44:32.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.015+0000 7f90182bd700 1 --2- 172.21.15.60:0/1836240052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f901005c440 0x7f90100ac320 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.015+0000 7f90182bd700 1 --2- 172.21.15.60:0/1836240052 >> v2:172.21.15.66:3300/0 conn(0x7f90100b52a0 0x7f90100abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.015+0000 7f90182bd700 1 -- 172.21.15.60:0/1836240052 >> 172.21.15.60:0/1836240052 conn(0x7f9010060c10 msgr2=0x7f90100b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:32.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.015+0000 7f90182bd700 1 -- 172.21.15.60:0/1836240052 shutdown_connections 2020-10-31T22:44:32.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.015+0000 7f90182bd700 1 -- 172.21.15.60:0/1836240052 wait complete. 2020-10-31T22:44:32.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.015+0000 7f90182bd700 1 Processor -- start 2020-10-31T22:44:32.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.015+0000 7f90182bd700 1 -- start start 2020-10-31T22:44:32.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f90182bd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f901005c440 0x7f90100ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:32.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f90182bd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90100acab0 0x7f901013dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:32.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f90182bd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90100b52a0 0x7f901013e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:32.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f90182bd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9010063780 con 0x7f90100acab0 2020-10-31T22:44:32.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f90182bd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90100aa3c0 con 0x7f90100b52a0 2020-10-31T22:44:32.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f90182bd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9010066a10 con 0x7f901005c440 2020-10-31T22:44:32.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f9015858700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90100acab0 0x7f901013dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:32.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f9015858700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90100acab0 0x7f901013dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43728/0 (socket says 172.21.15.60:43728) 2020-10-31T22:44:32.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f9015858700 1 -- 172.21.15.60:0/1685355342 learned_addr learned my addr 172.21.15.60:0/1685355342 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:32.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f9016059700 1 --2- 172.21.15.60:0/1685355342 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f901005c440 0x7f90100ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:32.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f901685a700 1 --2- 172.21.15.60:0/1685355342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90100b52a0 0x7f901013e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:32.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f9015858700 1 -- 172.21.15.60:0/1685355342 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f901005c440 msgr2=0x7f90100ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:32.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f9015858700 1 --2- 172.21.15.60:0/1685355342 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f901005c440 0x7f90100ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f9015858700 1 -- 172.21.15.60:0/1685355342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90100b52a0 msgr2=0x7f901013e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:32.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f9015858700 1 --2- 172.21.15.60:0/1685355342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90100b52a0 0x7f901013e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f9015858700 1 -- 172.21.15.60:0/1685355342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90100a8630 con 0x7f90100acab0 2020-10-31T22:44:32.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f9015858700 1 --2- 172.21.15.60:0/1685355342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90100acab0 0x7f901013dcb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f9010061ce0 tx=0x7f9000007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:32.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f8fff7fe700 1 -- 172.21.15.60:0/1685355342 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9000007240 con 0x7f90100acab0 2020-10-31T22:44:32.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f8fff7fe700 1 -- 172.21.15.60:0/1685355342 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90000073a0 con 0x7f90100acab0 2020-10-31T22:44:32.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f90182bd700 1 -- 172.21.15.60:0/1685355342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90100632e0 con 0x7f90100acab0 2020-10-31T22:44:32.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f8fff7fe700 1 -- 172.21.15.60:0/1685355342 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f90000064e0 con 0x7f90100acab0 2020-10-31T22:44:32.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f90182bd700 1 -- 172.21.15.60:0/1685355342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90100a8300 con 0x7f90100acab0 2020-10-31T22:44:32.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.019+0000 7f90182bd700 1 -- 172.21.15.60:0/1685355342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9010066bd0 con 0x7f90100acab0 2020-10-31T22:44:32.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.023+0000 7f8fff7fe700 1 -- 172.21.15.60:0/1685355342 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9000010070 con 0x7f90100acab0 2020-10-31T22:44:32.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.023+0000 7f8fff7fe700 1 --2- 172.21.15.60:0/1685355342 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8ff0054f90 0x7f8ff0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:32.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.023+0000 7f9016059700 1 --2- 172.21.15.60:0/1685355342 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8ff0054f90 0x7f8ff0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:32.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.023+0000 7f8fff7fe700 1 -- 172.21.15.60:0/1685355342 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f900006cfe0 con 0x7f90100acab0 2020-10-31T22:44:32.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.023+0000 7f9016059700 1 --2- 172.21.15.60:0/1685355342 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8ff0054f90 0x7f8ff0057450 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f900c00c000 tx=0x7f900c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:32.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.031+0000 7f8fff7fe700 1 -- 172.21.15.60:0/1685355342 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f90000433f0 con 0x7f90100acab0 2020-10-31T22:44:32.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.219+0000 7f90182bd700 1 -- 172.21.15.60:0/1685355342 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9010063470 con 0x7f90100acab0 2020-10-31T22:44:32.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.219+0000 7f8fff7fe700 1 -- 172.21.15.60:0/1685355342 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+2491 (secure 0 0 0) 0x7f9000046a10 con 0x7f90100acab0 2020-10-31T22:44:32.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.223+0000 7f90182bd700 1 -- 172.21.15.60:0/1685355342 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8ff0054f90 msgr2=0x7f8ff0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:32.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.223+0000 7f90182bd700 1 --2- 172.21.15.60:0/1685355342 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8ff0054f90 0x7f8ff0057450 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f900c00c000 tx=0x7f900c008040).stop 2020-10-31T22:44:32.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.223+0000 7f90182bd700 1 -- 172.21.15.60:0/1685355342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90100acab0 msgr2=0x7f901013dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:32.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.223+0000 7f90182bd700 1 --2- 172.21.15.60:0/1685355342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90100acab0 0x7f901013dcb0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f9010061ce0 tx=0x7f9000007be0).stop 2020-10-31T22:44:32.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.223+0000 7f90182bd700 1 -- 172.21.15.60:0/1685355342 shutdown_connections 2020-10-31T22:44:32.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.223+0000 7f90182bd700 1 --2- 172.21.15.60:0/1685355342 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8ff0054f90 0x7f8ff0057450 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.223+0000 7f90182bd700 1 --2- 172.21.15.60:0/1685355342 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90100b52a0 0x7f901013e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.223+0000 7f90182bd700 1 --2- 172.21.15.60:0/1685355342 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f901005c440 0x7f90100ab1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.223+0000 7f90182bd700 1 --2- 172.21.15.60:0/1685355342 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90100acab0 0x7f901013dcb0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.223+0000 7f90182bd700 1 -- 172.21.15.60:0/1685355342 >> 172.21.15.60:0/1685355342 conn(0x7f9010060c10 msgr2=0x7f90100af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:32.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.223+0000 7f90182bd700 1 -- 172.21.15.60:0/1685355342 shutdown_connections 2020-10-31T22:44:32.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.223+0000 7f90182bd700 1 -- 172.21.15.60:0/1685355342 wait complete. 2020-10-31T22:44:32.230 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:44:32.231 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":16,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2666662861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2666662861},{"type":"v1","addr":"172.21.15.60:6835","nonce":2666662861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14},{"gid":5193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3622783561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3622783561},{"type":"v1","addr":"172.21.15.66:6833","nonce":3622783561}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:43:08.333596+0000","modified":"2020-10-31T22:43:09.337195+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":15,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/1627192275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1627192275},{"type":"v1","addr":"172.21.15.60:6837","nonce":1627192275}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-10-31T22:44:32.232 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 16 2020-10-31T22:44:32.236 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-10-31T22:44:32.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510ffff700 1 Processor -- start 2020-10-31T22:44:32.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510ffff700 1 -- start start 2020-10-31T22:44:32.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f51100ac870 0x7f51100b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:32.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510ffff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f51100b0e20 0x7f51100ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:32.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51100ae690 0x7f51101412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:32.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510ffff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51100b14c0 con 0x7f51100ac870 2020-10-31T22:44:32.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510ffff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51100acc50 con 0x7f51100b0e20 2020-10-31T22:44:32.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51100b5690 con 0x7f51100ae690 2020-10-31T22:44:32.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f51100ac870 0x7f51100b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:32.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f51100ac870 0x7f51100b5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43734/0 (socket says 172.21.15.60:43734) 2020-10-31T22:44:32.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510effd700 1 -- 172.21.15.60:0/3651639046 learned_addr learned my addr 172.21.15.60:0/3651639046 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:32.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510e7fc700 1 --2- 172.21.15.60:0/3651639046 >> v2:172.21.15.66:3300/0 conn(0x7f51100b0e20 0x7f51100ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:32.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510f7fe700 1 --2- 172.21.15.60:0/3651639046 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51100ae690 0x7f51101412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:32.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510effd700 1 -- 172.21.15.60:0/3651639046 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51100ae690 msgr2=0x7f51101412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:32.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.351+0000 7f510effd700 1 --2- 172.21.15.60:0/3651639046 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51100ae690 0x7f51101412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510effd700 1 -- 172.21.15.60:0/3651639046 >> v2:172.21.15.66:3300/0 conn(0x7f51100b0e20 msgr2=0x7f51100ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:32.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510effd700 1 --2- 172.21.15.60:0/3651639046 >> v2:172.21.15.66:3300/0 conn(0x7f51100b0e20 0x7f51100ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510effd700 1 -- 172.21.15.60:0/3651639046 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51100afc10 con 0x7f51100ac870 2020-10-31T22:44:32.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510e7fc700 1 --2- 172.21.15.60:0/3651639046 >> v2:172.21.15.66:3300/0 conn(0x7f51100b0e20 0x7f51100ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:44:32.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510f7fe700 1 --2- 172.21.15.60:0/3651639046 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51100ae690 0x7f51101412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:44:32.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510effd700 1 --2- 172.21.15.60:0/3651639046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100ac870 0x7f51100b5060 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f51000032b0 tx=0x7f5100009270).ready entity=mon.0 client_cookie=c898f56941cf099a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:32.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510dffb700 1 -- 172.21.15.60:0/3651639046 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510000bc90 con 0x7f51100ac870 2020-10-31T22:44:32.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510dffb700 1 -- 172.21.15.60:0/3651639046 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510000bdf0 con 0x7f51100ac870 2020-10-31T22:44:32.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510dffb700 1 -- 172.21.15.60:0/3651639046 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5100011400 con 0x7f51100ac870 2020-10-31T22:44:32.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510ffff700 1 -- 172.21.15.60:0/3651639046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100ac870 msgr2=0x7f51100b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:32.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510ffff700 1 --2- 172.21.15.60:0/3651639046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100ac870 0x7f51100b5060 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f51000032b0 tx=0x7f5100009270).stop 2020-10-31T22:44:32.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510ffff700 1 -- 172.21.15.60:0/3651639046 shutdown_connections 2020-10-31T22:44:32.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510ffff700 1 --2- 172.21.15.60:0/3651639046 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51100ae690 0x7f51101412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510ffff700 1 --2- 172.21.15.60:0/3651639046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100ac870 0x7f51100b5060 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510ffff700 1 --2- 172.21.15.60:0/3651639046 >> v2:172.21.15.66:3300/0 conn(0x7f51100b0e20 0x7f51100ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510ffff700 1 -- 172.21.15.60:0/3651639046 >> 172.21.15.60:0/3651639046 conn(0x7f511006a600 msgr2=0x7f5110060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:32.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510ffff700 1 -- 172.21.15.60:0/3651639046 shutdown_connections 2020-10-31T22:44:32.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510ffff700 1 -- 172.21.15.60:0/3651639046 wait complete. 2020-10-31T22:44:32.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.355+0000 7f510ffff700 1 Processor -- start 2020-10-31T22:44:32.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510ffff700 1 -- start start 2020-10-31T22:44:32.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100ac870 0x7f51100aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:32.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51100ae690 0x7f511014df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:32.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510ffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51100b0e20 0x7f5110140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:32.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511009f430 con 0x7f51100ac870 2020-10-31T22:44:32.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510ffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511014e400 con 0x7f51100b0e20 2020-10-31T22:44:32.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511009ec50 con 0x7f51100ae690 2020-10-31T22:44:32.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100ac870 0x7f51100aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:32.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100ac870 0x7f51100aa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43740/0 (socket says 172.21.15.60:43740) 2020-10-31T22:44:32.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510effd700 1 -- 172.21.15.60:0/788611189 learned_addr learned my addr 172.21.15.60:0/788611189 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:32.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510e7fc700 1 --2- 172.21.15.60:0/788611189 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51100ae690 0x7f511014df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:32.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510f7fe700 1 --2- 172.21.15.60:0/788611189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51100b0e20 0x7f5110140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:32.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510effd700 1 -- 172.21.15.60:0/788611189 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51100ae690 msgr2=0x7f511014df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:32.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510effd700 1 --2- 172.21.15.60:0/788611189 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51100ae690 0x7f511014df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510effd700 1 -- 172.21.15.60:0/788611189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51100b0e20 msgr2=0x7f5110140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:32.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510effd700 1 --2- 172.21.15.60:0/788611189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51100b0e20 0x7f5110140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510effd700 1 -- 172.21.15.60:0/788611189 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511009eef0 con 0x7f51100ac870 2020-10-31T22:44:32.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510effd700 1 --2- 172.21.15.60:0/788611189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100ac870 0x7f51100aa1d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f511014e590 tx=0x7f5100016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:32.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f5107fff700 1 -- 172.21.15.60:0/788611189 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510001d640 con 0x7f51100ac870 2020-10-31T22:44:32.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f5107fff700 1 -- 172.21.15.60:0/788611189 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510001d7a0 con 0x7f51100ac870 2020-10-31T22:44:32.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510ffff700 1 -- 172.21.15.60:0/788611189 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f511009f190 con 0x7f51100ac870 2020-10-31T22:44:32.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f5107fff700 1 -- 172.21.15.60:0/788611189 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f510001db00 con 0x7f51100ac870 2020-10-31T22:44:32.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.359+0000 7f510ffff700 1 -- 172.21.15.60:0/788611189 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511009e940 con 0x7f51100ac870 2020-10-31T22:44:32.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.363+0000 7f5107fff700 1 -- 172.21.15.60:0/788611189 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f510000f070 con 0x7f51100ac870 2020-10-31T22:44:32.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.363+0000 7f510ffff700 1 -- 172.21.15.60:0/788611189 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5110057100 con 0x7f51100ac870 2020-10-31T22:44:32.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.363+0000 7f5107fff700 1 --2- 172.21.15.60:0/788611189 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f50f4054f90 0x7f50f4057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:32.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.363+0000 7f5107fff700 1 -- 172.21.15.60:0/788611189 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5100070d90 con 0x7f51100ac870 2020-10-31T22:44:32.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.363+0000 7f510e7fc700 1 --2- 172.21.15.60:0/788611189 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f50f4054f90 0x7f50f4057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:32.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.363+0000 7f510e7fc700 1 --2- 172.21.15.60:0/788611189 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f50f4054f90 0x7f50f4057450 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f50f800c000 tx=0x7f50f8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:32.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.367+0000 7f5107fff700 1 -- 172.21.15.60:0/788611189 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f51000471a0 con 0x7f51100ac870 2020-10-31T22:44:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.555+0000 7f510ffff700 1 -- 172.21.15.60:0/788611189 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f511005ed50 con 0x7f51100ac870 2020-10-31T22:44:32.928 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:44:32.927+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:44:32.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.935+0000 7f5107fff700 1 -- 172.21.15.60:0/788611189 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5100015020 con 0x7f51100ac870 2020-10-31T22:44:32.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.939+0000 7f510ffff700 1 -- 172.21.15.60:0/788611189 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f50f4054f90 msgr2=0x7f50f4057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:32.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.939+0000 7f510ffff700 1 --2- 172.21.15.60:0/788611189 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f50f4054f90 0x7f50f4057450 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f50f800c000 tx=0x7f50f8008040).stop 2020-10-31T22:44:32.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.939+0000 7f510ffff700 1 -- 172.21.15.60:0/788611189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100ac870 msgr2=0x7f51100aa1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:32.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.939+0000 7f510ffff700 1 --2- 172.21.15.60:0/788611189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100ac870 0x7f51100aa1d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f511014e590 tx=0x7f5100016000).stop 2020-10-31T22:44:32.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.939+0000 7f510ffff700 1 -- 172.21.15.60:0/788611189 shutdown_connections 2020-10-31T22:44:32.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.939+0000 7f510ffff700 1 --2- 172.21.15.60:0/788611189 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f50f4054f90 0x7f50f4057450 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.939+0000 7f510ffff700 1 --2- 172.21.15.60:0/788611189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f51100b0e20 0x7f5110140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.939+0000 7f510ffff700 1 --2- 172.21.15.60:0/788611189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f51100ac870 0x7f51100aa1d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.939+0000 7f510ffff700 1 --2- 172.21.15.60:0/788611189 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f51100ae690 0x7f511014df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:32.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.939+0000 7f510ffff700 1 -- 172.21.15.60:0/788611189 >> 172.21.15.60:0/788611189 conn(0x7f511006a600 msgr2=0x7f51100b4830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:32.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.939+0000 7f510ffff700 1 -- 172.21.15.60:0/788611189 shutdown_connections 2020-10-31T22:44:32.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:32.939+0000 7f510ffff700 1 -- 172.21.15.60:0/788611189 wait complete. 2020-10-31T22:44:32.946 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-10-31T22:44:32.962 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:44:32.973 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:44:33.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.071+0000 7fe907fff700 1 Processor -- start 2020-10-31T22:44:33.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.071+0000 7fe907fff700 1 -- start start 2020-10-31T22:44:33.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.071+0000 7fe907fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe9080ac870 0x7fe9080b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.071+0000 7fe907fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9080b0e20 0x7fe9080ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.071+0000 7fe907fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9080acc50 con 0x7fe9080ae690 2020-10-31T22:44:33.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.071+0000 7fe907fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9080b14c0 con 0x7fe9080ac870 2020-10-31T22:44:33.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.071+0000 7fe9077fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe9080ae690 0x7fe9081412e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47900/0 (socket says 172.21.15.60:47900) 2020-10-31T22:44:33.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.071+0000 7fe907fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080b5690 con 0x7fe9080b0e20 2020-10-31T22:44:33.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.071+0000 7fe9077fe700 1 -- 172.21.15.60:0/823819024 learned_addr learned my addr 172.21.15.60:0/823819024 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:33.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.071+0000 7fe906ffd700 1 --2- 172.21.15.60:0/823819024 >> v2:172.21.15.66:3300/0 conn(0x7fe9080ac870 0x7fe9080b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.071+0000 7fe9067fc700 1 --2- 172.21.15.60:0/823819024 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9080b0e20 0x7fe9080ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 -- 172.21.15.60:0/823819024 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2027725528 0 0) 0x7fe9080acc50 con 0x7fe9080ae690 2020-10-31T22:44:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 -- 172.21.15.60:0/823819024 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8e8003230 con 0x7fe9080ae690 2020-10-31T22:44:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 -- 172.21.15.60:0/823819024 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4267032439 0 0) 0x7fe8e8003230 con 0x7fe9080ae690 2020-10-31T22:44:33.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 -- 172.21.15.60:0/823819024 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9080b0e20 msgr2=0x7fe9080ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 --2- 172.21.15.60:0/823819024 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9080b0e20 0x7fe9080ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 -- 172.21.15.60:0/823819024 >> v2:172.21.15.66:3300/0 conn(0x7fe9080ac870 msgr2=0x7fe9080b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 --2- 172.21.15.60:0/823819024 >> v2:172.21.15.66:3300/0 conn(0x7fe9080ac870 0x7fe9080b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 -- 172.21.15.60:0/823819024 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9080afc10 con 0x7fe9080ae690 2020-10-31T22:44:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 -- 172.21.15.60:0/823819024 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fe9000016d0 con 0x7fe9080ae690 2020-10-31T22:44:33.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 -- 172.21.15.60:0/823819024 >> v1:172.21.15.60:6789/0 conn(0x7fe9080ae690 legacy=0x7fe9081412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:33.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 --2- 172.21.15.60:0/823819024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e8003720 0x7fe8e8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 --2- 172.21.15.60:0/823819024 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8e80044d0 0x7fe8e8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 --2- 172.21.15.60:0/823819024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e8004e40 0x7fe8e800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 -- 172.21.15.60:0/823819024 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080b14c0 con 0x7fe8e8003720 2020-10-31T22:44:33.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 -- 172.21.15.60:0/823819024 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9080b5690 con 0x7fe8e8004e40 2020-10-31T22:44:33.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 -- 172.21.15.60:0/823819024 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8e8004290 con 0x7fe8e80044d0 2020-10-31T22:44:33.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe906ffd700 1 --2- 172.21.15.60:0/823819024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e8003720 0x7fe8e8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe9077fe700 1 --2- 172.21.15.60:0/823819024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e8004e40 0x7fe8e800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe9067fc700 1 --2- 172.21.15.60:0/823819024 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8e80044d0 0x7fe8e8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe906ffd700 1 -- 172.21.15.60:0/823819024 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8e80044d0 msgr2=0x7fe8e8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:33.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe906ffd700 1 --2- 172.21.15.60:0/823819024 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8e80044d0 0x7fe8e8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe906ffd700 1 -- 172.21.15.60:0/823819024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e8004e40 msgr2=0x7fe8e800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:33.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe906ffd700 1 --2- 172.21.15.60:0/823819024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8e8004e40 0x7fe8e800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe906ffd700 1 -- 172.21.15.60:0/823819024 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e8003230 con 0x7fe8e8003720 2020-10-31T22:44:33.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe906ffd700 1 --2- 172.21.15.60:0/823819024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e8003720 0x7fe8e8003b40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fe8f800c000 tx=0x7fe8f80091a0).ready entity=mon.0 client_cookie=cd44acbf7a4350e6 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:33.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 -- 172.21.15.60:0/823819024 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8f800ed00 con 0x7fe8e8003720 2020-10-31T22:44:33.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 -- 172.21.15.60:0/823819024 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f800ee60 con 0x7fe8e8003720 2020-10-31T22:44:33.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe905ffb700 1 -- 172.21.15.60:0/823819024 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8f80125e0 con 0x7fe8e8003720 2020-10-31T22:44:33.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe907fff700 1 -- 172.21.15.60:0/823819024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e8003720 msgr2=0x7fe8e8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:33.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe907fff700 1 --2- 172.21.15.60:0/823819024 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8e8003720 0x7fe8e8003b40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7fe8f800c000 tx=0x7fe8f80091a0).stop 2020-10-31T22:44:33.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe9077fe700 1 -- 172.21.15.60:0/823819024 reap_dead start 2020-10-31T22:44:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe907fff700 1 -- 172.21.15.60:0/823819024 shutdown_connections 2020-10-31T22:44:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe907fff700 1 -- 172.21.15.60:0/823819024 >> 172.21.15.60:0/823819024 conn(0x7fe90806a600 msgr2=0x7fe908060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:33.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe907fff700 1 -- 172.21.15.60:0/823819024 shutdown_connections 2020-10-31T22:44:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.075+0000 7fe907fff700 1 -- 172.21.15.60:0/823819024 wait complete. 2020-10-31T22:44:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe907fff700 1 Processor -- start 2020-10-31T22:44:33.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe907fff700 1 -- start start 2020-10-31T22:44:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe907fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe908143750 0x7fe908066260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe907fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe908153d70 0x7fe908066750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe907fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9080a7cc0 0x7fe9080a8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe907fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe908064e40 con 0x7fe908153d70 2020-10-31T22:44:33.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe907fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe908143b30 con 0x7fe908143750 2020-10-31T22:44:33.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe907fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe908065880 con 0x7fe9080a7cc0 2020-10-31T22:44:33.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe9067fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe908153d70 0x7fe908066750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe9067fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe908153d70 0x7fe908066750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43774/0 (socket says 172.21.15.60:43774) 2020-10-31T22:44:33.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe9067fc700 1 -- 172.21.15.60:0/464709374 learned_addr learned my addr 172.21.15.60:0/464709374 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:33.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe906ffd700 1 --2- 172.21.15.60:0/464709374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe908143750 0x7fe908066260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe9077fe700 1 --2- 172.21.15.60:0/464709374 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9080a7cc0 0x7fe9080a8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe9067fc700 1 -- 172.21.15.60:0/464709374 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9080a7cc0 msgr2=0x7fe9080a8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:33.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe9067fc700 1 --2- 172.21.15.60:0/464709374 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9080a7cc0 0x7fe9080a8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe9067fc700 1 -- 172.21.15.60:0/464709374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe908143750 msgr2=0x7fe908066260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:33.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe9067fc700 1 --2- 172.21.15.60:0/464709374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe908143750 0x7fe908066260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe9067fc700 1 -- 172.21.15.60:0/464709374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9080a3810 con 0x7fe908153d70 2020-10-31T22:44:33.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe9067fc700 1 --2- 172.21.15.60:0/464709374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe908153d70 0x7fe908066750 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fe908065a10 tx=0x7fe8f0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:33.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe8fffff700 1 -- 172.21.15.60:0/464709374 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8f0014680 con 0x7fe908153d70 2020-10-31T22:44:33.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe8fffff700 1 -- 172.21.15.60:0/464709374 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f00147e0 con 0x7fe908153d70 2020-10-31T22:44:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe8fffff700 1 -- 172.21.15.60:0/464709374 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8f0014b40 con 0x7fe908153d70 2020-10-31T22:44:33.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe907fff700 1 -- 172.21.15.60:0/464709374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe908065340 con 0x7fe908153d70 2020-10-31T22:44:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.079+0000 7fe907fff700 1 -- 172.21.15.60:0/464709374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9080a8660 con 0x7fe908153d70 2020-10-31T22:44:33.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.083+0000 7fe907fff700 1 -- 172.21.15.60:0/464709374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe908064c60 con 0x7fe908153d70 2020-10-31T22:44:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.083+0000 7fe8fffff700 1 -- 172.21.15.60:0/464709374 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe8f0024070 con 0x7fe908153d70 2020-10-31T22:44:33.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.083+0000 7fe8fffff700 1 --2- 172.21.15.60:0/464709374 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe8ec054f90 0x7fe8ec057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.083+0000 7fe8fffff700 1 -- 172.21.15.60:0/464709374 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fe8f006dfb0 con 0x7fe908153d70 2020-10-31T22:44:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.083+0000 7fe906ffd700 1 --2- 172.21.15.60:0/464709374 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe8ec054f90 0x7fe8ec057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.083+0000 7fe906ffd700 1 --2- 172.21.15.60:0/464709374 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe8ec054f90 0x7fe8ec057450 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fe8f801d000 tx=0x7fe8f801a000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:33.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.087+0000 7fe8fffff700 1 -- 172.21.15.60:0/464709374 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe8f00443e0 con 0x7fe908153d70 2020-10-31T22:44:33.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.271+0000 7fe907fff700 1 -- 172.21.15.60:0/464709374 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe908057100 con 0x7fe908153d70 2020-10-31T22:44:33.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.275+0000 7fe8fffff700 1 -- 172.21.15.60:0/464709374 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+2130 (secure 0 0 0) 0x7fe8f0047a00 con 0x7fe908153d70 2020-10-31T22:44:33.275 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:44:33.275 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":17,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5187,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2666662861","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2666662861},{"type":"v1","addr":"172.21.15.60:6835","nonce":2666662861}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14},{"gid":5193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/3622783561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3622783561},{"type":"v1","addr":"172.21.15.66:6833","nonce":3622783561}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":14}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:43:08.333596+0000","modified":"2020-10-31T22:44:32.931167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":45,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":3}]} 2020-10-31T22:44:33.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.275+0000 7fe907fff700 1 -- 172.21.15.60:0/464709374 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe8ec054f90 msgr2=0x7fe8ec057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:33.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.275+0000 7fe907fff700 1 --2- 172.21.15.60:0/464709374 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe8ec054f90 0x7fe8ec057450 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7fe8f801d000 tx=0x7fe8f801a000).stop 2020-10-31T22:44:33.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.275+0000 7fe907fff700 1 -- 172.21.15.60:0/464709374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe908153d70 msgr2=0x7fe908066750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:33.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.275+0000 7fe907fff700 1 --2- 172.21.15.60:0/464709374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe908153d70 0x7fe908066750 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7fe908065a10 tx=0x7fe8f0008040).stop 2020-10-31T22:44:33.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.275+0000 7fe907fff700 1 -- 172.21.15.60:0/464709374 shutdown_connections 2020-10-31T22:44:33.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.275+0000 7fe907fff700 1 --2- 172.21.15.60:0/464709374 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9080a7cc0 0x7fe9080a8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.275+0000 7fe907fff700 1 --2- 172.21.15.60:0/464709374 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe8ec054f90 0x7fe8ec057450 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.275+0000 7fe907fff700 1 --2- 172.21.15.60:0/464709374 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe908143750 0x7fe908066260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.275+0000 7fe907fff700 1 --2- 172.21.15.60:0/464709374 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe908153d70 0x7fe908066750 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.275+0000 7fe907fff700 1 -- 172.21.15.60:0/464709374 >> 172.21.15.60:0/464709374 conn(0x7fe90806a600 msgr2=0x7fe908060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:33.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.275+0000 7fe907fff700 1 -- 172.21.15.60:0/464709374 shutdown_connections 2020-10-31T22:44:33.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.279+0000 7fe907fff700 1 -- 172.21.15.60:0/464709374 wait complete. 2020-10-31T22:44:33.281 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 17 2020-10-31T22:44:33.294 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:44:33.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc6498700 1 Processor -- start 2020-10-31T22:44:33.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc6498700 1 -- start start 2020-10-31T22:44:33.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc6498700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1fc00ac870 0x7f1fc0146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc6498700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc0146550 0x7f1fc0150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc6498700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc00af900 con 0x7f1fc00af520 2020-10-31T22:44:33.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc6498700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc00afc10 con 0x7f1fc00ac870 2020-10-31T22:44:33.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc6498700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc005bb70 con 0x7f1fc0146550 2020-10-31T22:44:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc4c95700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1fc00ac870 0x7f1fc0146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc5496700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1fc00af520 0x7f1fc0066c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47916/0 (socket says 172.21.15.60:47916) 2020-10-31T22:44:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc4c95700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1fc00ac870 0x7f1fc0146060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43782/0 (socket says 172.21.15.60:43782) 2020-10-31T22:44:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc5496700 1 -- 172.21.15.60:0/2828660775 learned_addr learned my addr 172.21.15.60:0/2828660775 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc5c97700 1 --2- 172.21.15.60:0/2828660775 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc0146550 0x7f1fc0150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc4c95700 1 -- 172.21.15.60:0/2828660775 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc0146550 msgr2=0x7f1fc0150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc4c95700 1 --2- 172.21.15.60:0/2828660775 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc0146550 0x7f1fc0150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc4c95700 1 -- 172.21.15.60:0/2828660775 >> v1:172.21.15.60:6789/0 conn(0x7f1fc00af520 legacy=0x7f1fc0066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fb3fff700 1 -- 172.21.15.60:0/2828660775 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179358242 0 0) 0x7f1fc00af900 con 0x7f1fc00af520 2020-10-31T22:44:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc4c95700 1 -- 172.21.15.60:0/2828660775 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc00ac130 con 0x7f1fc00ac870 2020-10-31T22:44:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.467+0000 7f1fc4c95700 1 --2- 172.21.15.60:0/2828660775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc00ac870 0x7f1fc0146060 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f1fb4002f30 tx=0x7f1fb4006dc0).ready entity=mon.0 client_cookie=d3f9195a3dfe0d95 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fb3fff700 1 -- 172.21.15.60:0/2828660775 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fb4009760 con 0x7f1fc00ac870 2020-10-31T22:44:33.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fb3fff700 1 -- 172.21.15.60:0/2828660775 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb40098c0 con 0x7f1fc00ac870 2020-10-31T22:44:33.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 -- 172.21.15.60:0/2828660775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc00ac870 msgr2=0x7f1fc0146060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:33.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fb3fff700 1 -- 172.21.15.60:0/2828660775 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fb4009c20 con 0x7f1fc00ac870 2020-10-31T22:44:33.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 --2- 172.21.15.60:0/2828660775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc00ac870 0x7f1fc0146060 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f1fb4002f30 tx=0x7f1fb4006dc0).stop 2020-10-31T22:44:33.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 -- 172.21.15.60:0/2828660775 shutdown_connections 2020-10-31T22:44:33.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 --2- 172.21.15.60:0/2828660775 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc0146550 0x7f1fc0150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 --2- 172.21.15.60:0/2828660775 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc00ac870 0x7f1fc0146060 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 -- 172.21.15.60:0/2828660775 >> 172.21.15.60:0/2828660775 conn(0x7f1fc00b3fd0 msgr2=0x7f1fc00b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:33.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 -- 172.21.15.60:0/2828660775 shutdown_connections 2020-10-31T22:44:33.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 -- 172.21.15.60:0/2828660775 wait complete. 2020-10-31T22:44:33.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 Processor -- start 2020-10-31T22:44:33.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 -- start start 2020-10-31T22:44:33.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ac870 0x7f1fc0147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00af520 0x7f1fc0154da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0146550 0x7f1fc0061cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc00618c0 con 0x7f1fc0146550 2020-10-31T22:44:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc01489f0 con 0x7f1fc00ac870 2020-10-31T22:44:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc6498700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc0148c90 con 0x7f1fc00af520 2020-10-31T22:44:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc5c97700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0146550 0x7f1fc0061cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc5c97700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0146550 0x7f1fc0061cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43790/0 (socket says 172.21.15.60:43790) 2020-10-31T22:44:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc5c97700 1 -- 172.21.15.60:0/3738115042 learned_addr learned my addr 172.21.15.60:0/3738115042 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc4c95700 1 --2- 172.21.15.60:0/3738115042 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00af520 0x7f1fc0154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.471+0000 7f1fc5496700 1 --2- 172.21.15.60:0/3738115042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ac870 0x7f1fc0147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fc5c97700 1 -- 172.21.15.60:0/3738115042 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00af520 msgr2=0x7f1fc0154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:33.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fc5c97700 1 --2- 172.21.15.60:0/3738115042 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00af520 0x7f1fc0154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fc5c97700 1 -- 172.21.15.60:0/3738115042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ac870 msgr2=0x7f1fc0147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:33.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fc5c97700 1 --2- 172.21.15.60:0/3738115042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ac870 0x7f1fc0147790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fc5c97700 1 -- 172.21.15.60:0/3738115042 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0148f30 con 0x7f1fc0146550 2020-10-31T22:44:33.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fc5c97700 1 --2- 172.21.15.60:0/3738115042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0146550 0x7f1fc0061cb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f1fb8006dd0 tx=0x7f1fb80091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:33.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fb27fc700 1 -- 172.21.15.60:0/3738115042 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fb800c950 con 0x7f1fc0146550 2020-10-31T22:44:33.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fb27fc700 1 -- 172.21.15.60:0/3738115042 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb800cab0 con 0x7f1fc0146550 2020-10-31T22:44:33.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fc6498700 1 -- 172.21.15.60:0/3738115042 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc0148650 con 0x7f1fc0146550 2020-10-31T22:44:33.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fb27fc700 1 -- 172.21.15.60:0/3738115042 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fb800ce10 con 0x7f1fc0146550 2020-10-31T22:44:33.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fc6498700 1 -- 172.21.15.60:0/3738115042 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc00623c0 con 0x7f1fc0146550 2020-10-31T22:44:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fc6498700 1 -- 172.21.15.60:0/3738115042 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc0148840 con 0x7f1fc0146550 2020-10-31T22:44:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fb27fc700 1 -- 172.21.15.60:0/3738115042 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1fb8022070 con 0x7f1fc0146550 2020-10-31T22:44:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fb27fc700 1 --2- 172.21.15.60:0/3738115042 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa8054f10 0x7f1fa80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fb27fc700 1 -- 172.21.15.60:0/3738115042 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f1fb806e1d0 con 0x7f1fc0146550 2020-10-31T22:44:33.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fc5496700 1 --2- 172.21.15.60:0/3738115042 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa8054f10 0x7f1fa80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:33.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.475+0000 7f1fc5496700 1 --2- 172.21.15.60:0/3738115042 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa8054f10 0x7f1fa80573d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f1fbc00d000 tx=0x7f1fbc007910).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:33.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.483+0000 7f1fb27fc700 1 -- 172.21.15.60:0/3738115042 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1fb8044550 con 0x7f1fc0146550 2020-10-31T22:44:33.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.671+0000 7f1fc6498700 1 -- 172.21.15.60:0/3738115042 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1fc0057100 con 0x7f1fc0146550 2020-10-31T22:44:33.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.951+0000 7f1fb27fc700 1 -- 172.21.15.60:0/3738115042 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1fb8016020 con 0x7f1fc0146550 2020-10-31T22:44:33.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.955+0000 7f1fc6498700 1 -- 172.21.15.60:0/3738115042 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa8054f10 msgr2=0x7f1fa80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:33.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.955+0000 7f1fc6498700 1 --2- 172.21.15.60:0/3738115042 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa8054f10 0x7f1fa80573d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f1fbc00d000 tx=0x7f1fbc007910).stop 2020-10-31T22:44:33.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.955+0000 7f1fc6498700 1 -- 172.21.15.60:0/3738115042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0146550 msgr2=0x7f1fc0061cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:33.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.955+0000 7f1fc6498700 1 --2- 172.21.15.60:0/3738115042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0146550 0x7f1fc0061cb0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f1fb8006dd0 tx=0x7f1fb80091a0).stop 2020-10-31T22:44:33.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.955+0000 7f1fc6498700 1 -- 172.21.15.60:0/3738115042 shutdown_connections 2020-10-31T22:44:33.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.955+0000 7f1fc6498700 1 --2- 172.21.15.60:0/3738115042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0146550 0x7f1fc0061cb0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.955+0000 7f1fc6498700 1 --2- 172.21.15.60:0/3738115042 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa8054f10 0x7f1fa80573d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.955+0000 7f1fc6498700 1 --2- 172.21.15.60:0/3738115042 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ac870 0x7f1fc0147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.955+0000 7f1fc6498700 1 --2- 172.21.15.60:0/3738115042 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00af520 0x7f1fc0154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:33.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.955+0000 7f1fc6498700 1 -- 172.21.15.60:0/3738115042 >> 172.21.15.60:0/3738115042 conn(0x7f1fc00b3fd0 msgr2=0x7f1fc01453c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:33.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.955+0000 7f1fc6498700 1 -- 172.21.15.60:0/3738115042 shutdown_connections 2020-10-31T22:44:33.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:33.955+0000 7f1fc6498700 1 -- 172.21.15.60:0/3738115042 wait complete. 2020-10-31T22:44:33.977 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:44:34.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.099+0000 7f085b3f8700 1 Processor -- start 2020-10-31T22:44:34.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f085b3f8700 1 -- start start 2020-10-31T22:44:34.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f085b3f8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f085405c660 0x7f08540b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:34.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f085b3f8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0854066410 con 0x7f08540b2e20 2020-10-31T22:44:34.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f085b3f8700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08540666b0 con 0x7f0854065f70 2020-10-31T22:44:34.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f085b3f8700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0854066d60 con 0x7f085405c660 2020-10-31T22:44:34.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f0859194700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f085405c660 0x7f08540b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:34.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f0859995700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f08540b2e20 0x7f0854142610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47932/0 (socket says 172.21.15.60:47932) 2020-10-31T22:44:34.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f0859995700 1 -- 172.21.15.60:0/2522839923 learned_addr learned my addr 172.21.15.60:0/2522839923 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:34.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f0847fff700 1 -- 172.21.15.60:0/2522839923 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3470438140 0 0) 0x7f0854066410 con 0x7f08540b2e20 2020-10-31T22:44:34.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f0847fff700 1 -- 172.21.15.60:0/2522839923 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0838003230 con 0x7f08540b2e20 2020-10-31T22:44:34.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f0859194700 1 -- 172.21.15.60:0/2522839923 >> v1:172.21.15.66:6789/0 conn(0x7f0854065f70 legacy=0x7f085413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:34.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f0859194700 1 -- 172.21.15.60:0/2522839923 >> v1:172.21.15.60:6789/0 conn(0x7f08540b2e20 legacy=0x7f0854142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:34.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f0847fff700 1 -- 172.21.15.60:0/2522839923 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2363294453 0 0) 0x7f0838003230 con 0x7f08540b2e20 2020-10-31T22:44:34.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f0859194700 1 -- 172.21.15.60:0/2522839923 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0854142170 con 0x7f085405c660 2020-10-31T22:44:34.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f0859194700 1 --2- 172.21.15.60:0/2522839923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f085405c660 0x7f08540b5990 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f084c001bf0 tx=0x7f0848006dc0).ready entity=mon.0 client_cookie=2bee0b1f828105f7 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:34.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f0847fff700 1 -- 172.21.15.60:0/2522839923 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f084c001a50 con 0x7f085405c660 2020-10-31T22:44:34.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f0847fff700 1 -- 172.21.15.60:0/2522839923 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0848009670 con 0x7f085405c660 2020-10-31T22:44:34.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f0847fff700 1 -- 172.21.15.60:0/2522839923 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08480097e0 con 0x7f085405c660 2020-10-31T22:44:34.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f085b3f8700 1 -- 172.21.15.60:0/2522839923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f085405c660 msgr2=0x7f08540b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:34.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f085b3f8700 1 --2- 172.21.15.60:0/2522839923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f085405c660 0x7f08540b5990 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f084c001bf0 tx=0x7f0848006dc0).stop 2020-10-31T22:44:34.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f085b3f8700 1 -- 172.21.15.60:0/2522839923 shutdown_connections 2020-10-31T22:44:34.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f085b3f8700 1 --2- 172.21.15.60:0/2522839923 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f085405c660 0x7f08540b5990 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:34.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f085b3f8700 1 -- 172.21.15.60:0/2522839923 >> 172.21.15.60:0/2522839923 conn(0x7f08540601e0 msgr2=0x7f085405b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:34.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f085b3f8700 1 -- 172.21.15.60:0/2522839923 shutdown_connections 2020-10-31T22:44:34.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.103+0000 7f085b3f8700 1 -- 172.21.15.60:0/2522839923 wait complete. 2020-10-31T22:44:34.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f085b3f8700 1 Processor -- start 2020-10-31T22:44:34.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f085b3f8700 1 -- start start 2020-10-31T22:44:34.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f085b3f8700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f085405c660 0x7f08540b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:34.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f085b3f8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0854065f70 0x7f085413ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:34.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f085b3f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08540b2e20 0x7f08540aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:34.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f085b3f8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085413d030 con 0x7f08540b2e20 2020-10-31T22:44:34.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f085b3f8700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08540b1dc0 con 0x7f085405c660 2020-10-31T22:44:34.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f085b3f8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08540b2260 con 0x7f0854065f70 2020-10-31T22:44:34.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f0859995700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08540b2e20 0x7f08540aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:34.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f0859995700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08540b2e20 0x7f08540aeb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43804/0 (socket says 172.21.15.60:43804) 2020-10-31T22:44:34.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f0858993700 1 --2- 172.21.15.60:0/3431876127 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0854065f70 0x7f085413ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:34.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f0859995700 1 -- 172.21.15.60:0/3431876127 learned_addr learned my addr 172.21.15.60:0/3431876127 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:34.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f0859194700 1 --2- 172.21.15.60:0/3431876127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f085405c660 0x7f08540b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:34.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f0859995700 1 -- 172.21.15.60:0/3431876127 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0854065f70 msgr2=0x7f085413ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:34.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f0859995700 1 --2- 172.21.15.60:0/3431876127 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0854065f70 0x7f085413ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:34.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f0859995700 1 -- 172.21.15.60:0/3431876127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f085405c660 msgr2=0x7f08540b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:34.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f0859995700 1 --2- 172.21.15.60:0/3431876127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f085405c660 0x7f08540b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:34.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f0859995700 1 -- 172.21.15.60:0/3431876127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085413f170 con 0x7f08540b2e20 2020-10-31T22:44:34.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f0859995700 1 --2- 172.21.15.60:0/3431876127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08540b2e20 0x7f08540aeb30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f084c001cb0 tx=0x7f084c002160).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:34.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f08467fc700 1 -- 172.21.15.60:0/3431876127 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f084c00ce70 con 0x7f08540b2e20 2020-10-31T22:44:34.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f08467fc700 1 -- 172.21.15.60:0/3431876127 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c004a80 con 0x7f08540b2e20 2020-10-31T22:44:34.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f085b3f8700 1 -- 172.21.15.60:0/3431876127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08540ade30 con 0x7f08540b2e20 2020-10-31T22:44:34.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f08467fc700 1 -- 172.21.15.60:0/3431876127 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f084c004de0 con 0x7f08540b2e20 2020-10-31T22:44:34.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.107+0000 7f085b3f8700 1 -- 172.21.15.60:0/3431876127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08540b1630 con 0x7f08540b2e20 2020-10-31T22:44:34.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.111+0000 7f085b3f8700 1 -- 172.21.15.60:0/3431876127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085413ce60 con 0x7f08540b2e20 2020-10-31T22:44:34.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.111+0000 7f08467fc700 1 -- 172.21.15.60:0/3431876127 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f084c010070 con 0x7f08540b2e20 2020-10-31T22:44:34.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.111+0000 7f08467fc700 1 --2- 172.21.15.60:0/3431876127 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f083c054f10 0x7f083c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:34.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.111+0000 7f08467fc700 1 -- 172.21.15.60:0/3431876127 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f084c06d560 con 0x7f08540b2e20 2020-10-31T22:44:34.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.111+0000 7f0859194700 1 --2- 172.21.15.60:0/3431876127 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f083c054f10 0x7f083c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:34.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.111+0000 7f0859194700 1 --2- 172.21.15.60:0/3431876127 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f083c054f10 0x7f083c0573d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f084801b000 tx=0x7f0848015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:34.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.119+0000 7f08467fc700 1 -- 172.21.15.60:0/3431876127 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f084c043990 con 0x7f08540b2e20 2020-10-31T22:44:34.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.263+0000 7f085b3f8700 1 -- 172.21.15.60:0/3431876127 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f08540b1f80 con 0x7f08540b2e20 2020-10-31T22:44:34.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.967+0000 7f08467fc700 1 -- 172.21.15.60:0/3431876127 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v46) v1 ==== 185+0+0 (secure 0 0 0) 0x7f084c0190e0 con 0x7f08540b2e20 2020-10-31T22:44:34.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.971+0000 7f085b3f8700 1 -- 172.21.15.60:0/3431876127 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f083c054f10 msgr2=0x7f083c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.971+0000 7f085b3f8700 1 --2- 172.21.15.60:0/3431876127 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f083c054f10 0x7f083c0573d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f084801b000 tx=0x7f0848015000).stop 2020-10-31T22:44:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.971+0000 7f085b3f8700 1 -- 172.21.15.60:0/3431876127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08540b2e20 msgr2=0x7f08540aeb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:34.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.971+0000 7f085b3f8700 1 --2- 172.21.15.60:0/3431876127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08540b2e20 0x7f08540aeb30 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f084c001cb0 tx=0x7f084c002160).stop 2020-10-31T22:44:34.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.971+0000 7f085b3f8700 1 -- 172.21.15.60:0/3431876127 shutdown_connections 2020-10-31T22:44:34.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.971+0000 7f085b3f8700 1 --2- 172.21.15.60:0/3431876127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08540b2e20 0x7f08540aeb30 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:34.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.971+0000 7f085b3f8700 1 --2- 172.21.15.60:0/3431876127 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f083c054f10 0x7f083c0573d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:34.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.971+0000 7f085b3f8700 1 --2- 172.21.15.60:0/3431876127 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f085405c660 0x7f08540b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:34.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.971+0000 7f085b3f8700 1 --2- 172.21.15.60:0/3431876127 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0854065f70 0x7f085413ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:34.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.971+0000 7f085b3f8700 1 -- 172.21.15.60:0/3431876127 >> 172.21.15.60:0/3431876127 conn(0x7f08540601e0 msgr2=0x7f08540b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:34.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.971+0000 7f085b3f8700 1 -- 172.21.15.60:0/3431876127 shutdown_connections 2020-10-31T22:44:34.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:34.971+0000 7f085b3f8700 1 -- 172.21.15.60:0/3431876127 wait complete. 2020-10-31T22:44:34.975 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:44:34.986 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-10-31T22:44:35.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.099+0000 7fce04c21700 1 Processor -- start 2020-10-31T22:44:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.099+0000 7fce04c21700 1 -- start start 2020-10-31T22:44:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fce04c21700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce000b0b50 0x7fce000b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fce04c21700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce000acd60 con 0x7fce00140f80 2020-10-31T22:44:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fce04c21700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce000b5760 con 0x7fce000b5380 2020-10-31T22:44:35.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fce04c21700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce000ad650 con 0x7fce000b0b50 2020-10-31T22:44:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fce00140f80 0x7fce001413d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:47948/0 (socket says 172.21.15.60:47948) 2020-10-31T22:44:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfffff700 1 -- 172.21.15.60:0/781950918 learned_addr learned my addr 172.21.15.60:0/781950918 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfeffd700 1 --2- 172.21.15.60:0/781950918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce000b0b50 0x7fce000b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/781950918 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2962334109 0 0) 0x7fce000acd60 con 0x7fce00140f80 2020-10-31T22:44:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/781950918 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde8003230 con 0x7fce00140f80 2020-10-31T22:44:35.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/781950918 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4072967964 0 0) 0x7fcde8003230 con 0x7fce00140f80 2020-10-31T22:44:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/781950918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce000b0b50 msgr2=0x7fce000b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 --2- 172.21.15.60:0/781950918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce000b0b50 0x7fce000b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/781950918 >> v1:172.21.15.66:6789/0 conn(0x7fce000b5380 legacy=0x7fce000ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/781950918 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce000b14c0 con 0x7fce00140f80 2020-10-31T22:44:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/781950918 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fcdf8001a50 con 0x7fce00140f80 2020-10-31T22:44:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/781950918 >> v1:172.21.15.60:6789/0 conn(0x7fce00140f80 legacy=0x7fce001413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:35.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 --2- 172.21.15.60:0/781950918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde8003750 0x7fcde8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 --2- 172.21.15.60:0/781950918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce000b0b50 0x7fcde80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 --2- 172.21.15.60:0/781950918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcde80049c0 0x7fcde8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/781950918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce000ad650 con 0x7fcde8003750 2020-10-31T22:44:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/781950918 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde80041b0 con 0x7fcde80049c0 2020-10-31T22:44:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/781950918 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde800d930 con 0x7fce000b0b50 2020-10-31T22:44:35.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdff7fe700 1 --2- 172.21.15.60:0/781950918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde8003750 0x7fcde8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfffff700 1 --2- 172.21.15.60:0/781950918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcde80049c0 0x7fcde8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfeffd700 1 --2- 172.21.15.60:0/781950918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce000b0b50 0x7fcde80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdff7fe700 1 -- 172.21.15.60:0/781950918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce000b0b50 msgr2=0x7fcde80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdff7fe700 1 --2- 172.21.15.60:0/781950918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce000b0b50 0x7fcde80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdff7fe700 1 -- 172.21.15.60:0/781950918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcde80049c0 msgr2=0x7fcde8004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdff7fe700 1 --2- 172.21.15.60:0/781950918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcde80049c0 0x7fcde8004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:35.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdff7fe700 1 -- 172.21.15.60:0/781950918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde8003230 con 0x7fcde8003750 2020-10-31T22:44:35.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfeffd700 1 --2- 172.21.15.60:0/781950918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce000b0b50 0x7fcde80044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:44:35.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdff7fe700 1 --2- 172.21.15.60:0/781950918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde8003750 0x7fcde8003b30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fcdf0000fe0 tx=0x7fcdf0007ab0).ready entity=mon.0 client_cookie=3a58e3c25a3f1cdf server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:35.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/781950918 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdf000c6c0 con 0x7fcde8003750 2020-10-31T22:44:35.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/781950918 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf000c820 con 0x7fcde8003750 2020-10-31T22:44:35.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfe7fc700 1 -- 172.21.15.60:0/781950918 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdf000cb80 con 0x7fcde8003750 2020-10-31T22:44:35.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fce04c21700 1 -- 172.21.15.60:0/781950918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde8003750 msgr2=0x7fcde8003b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:35.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fce04c21700 1 --2- 172.21.15.60:0/781950918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcde8003750 0x7fcde8003b30 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7fcdf0000fe0 tx=0x7fcdf0007ab0).stop 2020-10-31T22:44:35.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.103+0000 7fcdfffff700 1 -- 172.21.15.60:0/781950918 reap_dead start 2020-10-31T22:44:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.107+0000 7fce04c21700 1 -- 172.21.15.60:0/781950918 shutdown_connections 2020-10-31T22:44:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.107+0000 7fce04c21700 1 -- 172.21.15.60:0/781950918 >> 172.21.15.60:0/781950918 conn(0x7fce0006a600 msgr2=0x7fce00060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.107+0000 7fce04c21700 1 -- 172.21.15.60:0/781950918 shutdown_connections 2020-10-31T22:44:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.107+0000 7fce04c21700 1 -- 172.21.15.60:0/781950918 wait complete. 2020-10-31T22:44:35.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.107+0000 7fce04c21700 1 Processor -- start 2020-10-31T22:44:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.107+0000 7fce04c21700 1 -- start start 2020-10-31T22:44:35.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fce04c21700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce00063620 0x7fce001547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fce04c21700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce000641f0 0x7fce00150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fce04c21700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce00151460 0x7fce001402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fce04c21700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce001508b0 con 0x7fce00063620 2020-10-31T22:44:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fce04c21700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce00063a00 con 0x7fce00151460 2020-10-31T22:44:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fce04c21700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce00142560 con 0x7fce000641f0 2020-10-31T22:44:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fcdff7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce00063620 0x7fce001547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:35.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fcdff7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce00063620 0x7fce001547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43820/0 (socket says 172.21.15.60:43820) 2020-10-31T22:44:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fcdff7fe700 1 -- 172.21.15.60:0/100619815 learned_addr learned my addr 172.21.15.60:0/100619815 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fcdfeffd700 1 --2- 172.21.15.60:0/100619815 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce000641f0 0x7fce00150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fcdfffff700 1 --2- 172.21.15.60:0/100619815 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce00151460 0x7fce001402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fcdff7fe700 1 -- 172.21.15.60:0/100619815 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce000641f0 msgr2=0x7fce00150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fcdff7fe700 1 --2- 172.21.15.60:0/100619815 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce000641f0 0x7fce00150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fcdff7fe700 1 -- 172.21.15.60:0/100619815 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce00151460 msgr2=0x7fce001402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:35.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fcdff7fe700 1 --2- 172.21.15.60:0/100619815 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce00151460 0x7fce001402d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fcdff7fe700 1 -- 172.21.15.60:0/100619815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce00142800 con 0x7fce00063620 2020-10-31T22:44:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fcdff7fe700 1 --2- 172.21.15.60:0/100619815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce00063620 0x7fce001547f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fcdf0000fe0 tx=0x7fcdf0017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fcdfcff9700 1 -- 172.21.15.60:0/100619815 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdf0001ea0 con 0x7fce00063620 2020-10-31T22:44:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fcdfcff9700 1 -- 172.21.15.60:0/100619815 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf0007210 con 0x7fce00063620 2020-10-31T22:44:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fce04c21700 1 -- 172.21.15.60:0/100619815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce00154ce0 con 0x7fce00063620 2020-10-31T22:44:35.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fcdfcff9700 1 -- 172.21.15.60:0/100619815 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcdf0012ad0 con 0x7fce00063620 2020-10-31T22:44:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fce04c21700 1 -- 172.21.15.60:0/100619815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce00142220 con 0x7fce00063620 2020-10-31T22:44:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.111+0000 7fce04c21700 1 -- 172.21.15.60:0/100619815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce00057100 con 0x7fce00063620 2020-10-31T22:44:35.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.115+0000 7fcdfcff9700 1 -- 172.21.15.60:0/100619815 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fcdf0010070 con 0x7fce00063620 2020-10-31T22:44:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.115+0000 7fcdfcff9700 1 --2- 172.21.15.60:0/100619815 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcddc054f10 0x7fcddc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.115+0000 7fcdfcff9700 1 -- 172.21.15.60:0/100619815 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fcdf006dd90 con 0x7fce00063620 2020-10-31T22:44:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.115+0000 7fcdfeffd700 1 --2- 172.21.15.60:0/100619815 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcddc054f10 0x7fcddc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:35.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.115+0000 7fcdfeffd700 1 --2- 172.21.15.60:0/100619815 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcddc054f10 0x7fcddc0573d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fcdec008000 tx=0x7fcdec008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:35.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.119+0000 7fcdfcff9700 1 -- 172.21.15.60:0/100619815 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcdf0044410 con 0x7fce00063620 2020-10-31T22:44:35.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.263+0000 7fce04c21700 1 -- 172.21.15.60:0/100619815 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fce00062750 con 0x7fce00063620 2020-10-31T22:44:35.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.975+0000 7fcdfcff9700 1 -- 172.21.15.60:0/100619815 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v47) v1 ==== 173+0+0 (secure 0 0 0) 0x7fcdf0047a30 con 0x7fce00063620 2020-10-31T22:44:35.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.979+0000 7fce04c21700 1 -- 172.21.15.60:0/100619815 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcddc054f10 msgr2=0x7fcddc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:35.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.979+0000 7fce04c21700 1 --2- 172.21.15.60:0/100619815 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcddc054f10 0x7fcddc0573d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fcdec008000 tx=0x7fcdec008040).stop 2020-10-31T22:44:35.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.979+0000 7fce04c21700 1 -- 172.21.15.60:0/100619815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce00063620 msgr2=0x7fce001547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:35.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.979+0000 7fce04c21700 1 --2- 172.21.15.60:0/100619815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce00063620 0x7fce001547f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fcdf0000fe0 tx=0x7fcdf0017000).stop 2020-10-31T22:44:35.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.979+0000 7fce04c21700 1 -- 172.21.15.60:0/100619815 shutdown_connections 2020-10-31T22:44:35.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.979+0000 7fce04c21700 1 --2- 172.21.15.60:0/100619815 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcddc054f10 0x7fcddc0573d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:35.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.979+0000 7fce04c21700 1 --2- 172.21.15.60:0/100619815 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce00151460 0x7fce001402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:35.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.979+0000 7fce04c21700 1 --2- 172.21.15.60:0/100619815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce00063620 0x7fce001547f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:35.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.979+0000 7fce04c21700 1 --2- 172.21.15.60:0/100619815 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce000641f0 0x7fce00150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:35.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.979+0000 7fce04c21700 1 -- 172.21.15.60:0/100619815 >> 172.21.15.60:0/100619815 conn(0x7fce0006a600 msgr2=0x7fce00060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:35.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.979+0000 7fce04c21700 1 -- 172.21.15.60:0/100619815 shutdown_connections 2020-10-31T22:44:35.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:35.979+0000 7fce04c21700 1 -- 172.21.15.60:0/100619815 wait complete. 2020-10-31T22:44:35.984 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2020-10-31T22:44:36.000 INFO:tasks.ceph.mds.a:Restarting daemon 2020-10-31T22:44:36.000 INFO:tasks.ceph.mds.a:Stopping old one... 2020-10-31T22:44:36.000 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-10-31T22:44:36.001 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:44:36.001 INFO:tasks.ceph.mds.c:Restarting daemon 2020-10-31T22:44:36.001 INFO:tasks.ceph.mds.c:Stopping old one... 2020-10-31T22:44:36.001 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-10-31T22:44:36.002 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:44:36.002 INFO:tasks.ceph.mds.b:Restarting daemon 2020-10-31T22:44:36.002 INFO:tasks.ceph.mds.b:Stopping old one... 2020-10-31T22:44:36.003 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-10-31T22:44:36.003 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:44:36.011 INFO:tasks.ceph.mds.a:Stopped 2020-10-31T22:44:36.012 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-10-31T22:44:36.014 INFO:tasks.ceph.mds.c:Stopped 2020-10-31T22:44:36.015 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-10-31T22:44:36.016 INFO:tasks.ceph.mds.b:Stopped 2020-10-31T22:44:36.016 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-10-31T22:44:36.059 INFO:tasks.ceph.mds.a:Started 2020-10-31T22:44:36.060 DEBUG:teuthology.parallel:result is None 2020-10-31T22:44:36.062 INFO:tasks.ceph.mds.c:Started 2020-10-31T22:44:36.062 DEBUG:teuthology.parallel:result is None 2020-10-31T22:44:36.063 INFO:tasks.ceph.mds.b:Started 2020-10-31T22:44:36.063 DEBUG:teuthology.parallel:result is None 2020-10-31T22:44:36.064 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-10-31T22:44:36.130 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:44:36.132 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:44:36.137 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:44:36.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf54ad700 1 Processor -- start 2020-10-31T22:44:36.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf54ad700 1 -- start start 2020-10-31T22:44:36.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf54ad700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bf0067070 0x7f1bf00af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:36.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf54ad700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1bf005b280 0x7f1bf005b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:36.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf54ad700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf0066c20 con 0x7f1bf00af3e0 2020-10-31T22:44:36.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf54ad700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf00afdb0 con 0x7f1bf005b280 2020-10-31T22:44:36.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf54ad700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf0066980 con 0x7f1bf0067070 2020-10-31T22:44:36.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf4cac700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1bf005b280 0x7f1bf005b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:36.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf4cac700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1bf005b280 0x7f1bf005b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43856/0 (socket says 172.21.15.60:43856) 2020-10-31T22:44:36.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf4cac700 1 -- 172.21.15.60:0/2623153319 learned_addr learned my addr 172.21.15.60:0/2623153319 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:36.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bef7fe700 1 --2- 172.21.15.60:0/2623153319 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bf0067070 0x7f1bf00af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:36.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf4cac700 1 -- 172.21.15.60:0/2623153319 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bf0067070 msgr2=0x7f1bf00af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:36.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf4cac700 1 --2- 172.21.15.60:0/2623153319 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bf0067070 0x7f1bf00af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:36.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf4cac700 1 -- 172.21.15.60:0/2623153319 >> v1:172.21.15.66:6789/0 conn(0x7f1bf00af3e0 legacy=0x7f1bf01423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:36.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf4cac700 1 -- 172.21.15.60:0/2623153319 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf00666a0 con 0x7f1bf005b280 2020-10-31T22:44:36.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bef7fe700 1 --2- 172.21.15.60:0/2623153319 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bf0067070 0x7f1bf00af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:44:36.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf4cac700 1 --2- 172.21.15.60:0/2623153319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf005b280 0x7f1bf005b710 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f1be0002f30 tx=0x7f1be0006e80).ready entity=mon.0 client_cookie=dc5455bdd844756a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:36.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1beeffd700 1 -- 172.21.15.60:0/2623153319 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1be00097f0 con 0x7f1bf005b280 2020-10-31T22:44:36.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1beeffd700 1 -- 172.21.15.60:0/2623153319 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be0009950 con 0x7f1bf005b280 2020-10-31T22:44:36.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1beeffd700 1 -- 172.21.15.60:0/2623153319 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1be0009cb0 con 0x7f1bf005b280 2020-10-31T22:44:36.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf54ad700 1 -- 172.21.15.60:0/2623153319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf005b280 msgr2=0x7f1bf005b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:36.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.179+0000 7f1bf54ad700 1 --2- 172.21.15.60:0/2623153319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf005b280 0x7f1bf005b710 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f1be0002f30 tx=0x7f1be0006e80).stop 2020-10-31T22:44:36.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf54ad700 1 -- 172.21.15.60:0/2623153319 shutdown_connections 2020-10-31T22:44:36.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf54ad700 1 --2- 172.21.15.60:0/2623153319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf005b280 0x7f1bf005b710 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:36.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf54ad700 1 --2- 172.21.15.60:0/2623153319 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bf0067070 0x7f1bf00af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:36.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf54ad700 1 -- 172.21.15.60:0/2623153319 >> 172.21.15.60:0/2623153319 conn(0x7f1bf00b3fd0 msgr2=0x7f1bf00b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:36.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf54ad700 1 -- 172.21.15.60:0/2623153319 shutdown_connections 2020-10-31T22:44:36.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf54ad700 1 -- 172.21.15.60:0/2623153319 wait complete. 2020-10-31T22:44:36.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf54ad700 1 Processor -- start 2020-10-31T22:44:36.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf54ad700 1 -- start start 2020-10-31T22:44:36.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf54ad700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bf005b280 0x7f1bf013de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:36.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf54ad700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf0067070 0x7f1bf00aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:36.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf54ad700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bf00af3e0 0x7f1bf013a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:36.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf54ad700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf0143fc0 con 0x7f1bf0067070 2020-10-31T22:44:36.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf54ad700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf0144260 con 0x7f1bf00af3e0 2020-10-31T22:44:36.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf54ad700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf0144500 con 0x7f1bf005b280 2020-10-31T22:44:36.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf0067070 0x7f1bf00aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:36.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf0067070 0x7f1bf00aa450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43860/0 (socket says 172.21.15.60:43860) 2020-10-31T22:44:36.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bef7fe700 1 -- 172.21.15.60:0/1080506000 learned_addr learned my addr 172.21.15.60:0/1080506000 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:36.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bf4cac700 1 --2- 172.21.15.60:0/1080506000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bf00af3e0 0x7f1bf013a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:36.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1beffff700 1 --2- 172.21.15.60:0/1080506000 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bf005b280 0x7f1bf013de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:36.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bef7fe700 1 -- 172.21.15.60:0/1080506000 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bf005b280 msgr2=0x7f1bf013de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:36.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bef7fe700 1 --2- 172.21.15.60:0/1080506000 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bf005b280 0x7f1bf013de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:36.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bef7fe700 1 -- 172.21.15.60:0/1080506000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bf00af3e0 msgr2=0x7f1bf013a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:36.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.183+0000 7f1bef7fe700 1 --2- 172.21.15.60:0/1080506000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bf00af3e0 0x7f1bf013a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:36.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.187+0000 7f1bef7fe700 1 -- 172.21.15.60:0/1080506000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf01447a0 con 0x7f1bf0067070 2020-10-31T22:44:36.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.187+0000 7f1bef7fe700 1 --2- 172.21.15.60:0/1080506000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf0067070 0x7f1bf00aa450 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f1be4006910 tx=0x7f1be4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:36.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.187+0000 7f1bed7fa700 1 -- 172.21.15.60:0/1080506000 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1be4009980 con 0x7f1bf0067070 2020-10-31T22:44:36.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.187+0000 7f1bed7fa700 1 -- 172.21.15.60:0/1080506000 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be4009ae0 con 0x7f1bf0067070 2020-10-31T22:44:36.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.187+0000 7f1bf54ad700 1 -- 172.21.15.60:0/1080506000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf0144a40 con 0x7f1bf0067070 2020-10-31T22:44:36.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.187+0000 7f1bed7fa700 1 -- 172.21.15.60:0/1080506000 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1be4009e40 con 0x7f1bf0067070 2020-10-31T22:44:36.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.187+0000 7f1bf54ad700 1 -- 172.21.15.60:0/1080506000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf0141b40 con 0x7f1bf0067070 2020-10-31T22:44:36.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.187+0000 7f1bf54ad700 1 -- 172.21.15.60:0/1080506000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf0057100 con 0x7f1bf0067070 2020-10-31T22:44:36.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.187+0000 7f1bed7fa700 1 -- 172.21.15.60:0/1080506000 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1be4013480 con 0x7f1bf0067070 2020-10-31T22:44:36.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.187+0000 7f1bed7fa700 1 --2- 172.21.15.60:0/1080506000 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1bd0054f90 0x7f1bd0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:36.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.187+0000 7f1bed7fa700 1 -- 172.21.15.60:0/1080506000 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f1be406dd50 con 0x7f1bf0067070 2020-10-31T22:44:36.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.187+0000 7f1beffff700 1 --2- 172.21.15.60:0/1080506000 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1bd0054f90 0x7f1bd0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:36.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.187+0000 7f1beffff700 1 --2- 172.21.15.60:0/1080506000 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1bd0054f90 0x7f1bd0057450 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f1be800d000 tx=0x7f1be8007f90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:36.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.195+0000 7f1bed7fa700 1 -- 172.21.15.60:0/1080506000 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1be4044360 con 0x7f1bf0067070 2020-10-31T22:44:36.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:36.351+0000 7f1bf54ad700 1 -- 172.21.15.60:0/1080506000 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f1bf0141b40 con 0x7f1bf0067070 2020-10-31T22:44:37.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.155+0000 7f1bed7fa700 1 -- 172.21.15.60:0/1080506000 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v49) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1bf0141b40 con 0x7f1bf0067070 2020-10-31T22:44:37.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.159+0000 7f1bf54ad700 1 -- 172.21.15.60:0/1080506000 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1bd0054f90 msgr2=0x7f1bd0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.159+0000 7f1bf54ad700 1 --2- 172.21.15.60:0/1080506000 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1bd0054f90 0x7f1bd0057450 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f1be800d000 tx=0x7f1be8007f90).stop 2020-10-31T22:44:37.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.159+0000 7f1bf54ad700 1 -- 172.21.15.60:0/1080506000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf0067070 msgr2=0x7f1bf00aa450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.159+0000 7f1bf54ad700 1 --2- 172.21.15.60:0/1080506000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf0067070 0x7f1bf00aa450 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f1be4006910 tx=0x7f1be4008040).stop 2020-10-31T22:44:37.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.159+0000 7f1bf54ad700 1 -- 172.21.15.60:0/1080506000 shutdown_connections 2020-10-31T22:44:37.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.159+0000 7f1bf54ad700 1 --2- 172.21.15.60:0/1080506000 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1bd0054f90 0x7f1bd0057450 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.159+0000 7f1bf54ad700 1 --2- 172.21.15.60:0/1080506000 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1bf00af3e0 0x7f1bf013a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.159+0000 7f1bf54ad700 1 --2- 172.21.15.60:0/1080506000 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1bf005b280 0x7f1bf013de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.159+0000 7f1bf54ad700 1 --2- 172.21.15.60:0/1080506000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1bf0067070 0x7f1bf00aa450 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.159+0000 7f1bf54ad700 1 -- 172.21.15.60:0/1080506000 >> 172.21.15.60:0/1080506000 conn(0x7f1bf00b3fd0 msgr2=0x7f1bf00b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:37.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.159+0000 7f1bf54ad700 1 -- 172.21.15.60:0/1080506000 shutdown_connections 2020-10-31T22:44:37.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.159+0000 7f1bf54ad700 1 -- 172.21.15.60:0/1080506000 wait complete. 2020-10-31T22:44:37.161 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blacklist entries 2020-10-31T22:44:37.176 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2020-10-31T22:44:37.177 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-10-31T22:44:37.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.287+0000 7f22d359e700 1 Processor -- start 2020-10-31T22:44:37.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d359e700 1 -- start start 2020-10-31T22:44:37.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22d40b5570 0x7f22d40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:37.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d359e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d4145180 con 0x7f22d40b24a0 2020-10-31T22:44:37.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d359e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d40b0670 con 0x7f22d4141fe0 2020-10-31T22:44:37.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d40afae0 con 0x7f22d40b5570 2020-10-31T22:44:37.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d1d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f22d40b24a0 0x7f22d4145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48006/0 (socket says 172.21.15.60:48006) 2020-10-31T22:44:37.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d1d9b700 1 -- 172.21.15.60:0/1091002922 learned_addr learned my addr 172.21.15.60:0/1091002922 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:37.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d259c700 1 --2- 172.21.15.60:0/1091002922 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22d40b5570 0x7f22d40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:37.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d159a700 1 -- 172.21.15.60:0/1091002922 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1937120362 0 0) 0x7f22d4145180 con 0x7f22d40b24a0 2020-10-31T22:44:37.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d159a700 1 -- 172.21.15.60:0/1091002922 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22b8003230 con 0x7f22d40b24a0 2020-10-31T22:44:37.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d159a700 1 -- 172.21.15.60:0/1091002922 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967320015 0 0) 0x7f22d40b0670 con 0x7f22d4141fe0 2020-10-31T22:44:37.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d159a700 1 -- 172.21.15.60:0/1091002922 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22d4145180 con 0x7f22d4141fe0 2020-10-31T22:44:37.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d259c700 1 -- 172.21.15.60:0/1091002922 >> v1:172.21.15.66:6789/0 conn(0x7f22d4141fe0 legacy=0x7f22d4142450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d259c700 1 -- 172.21.15.60:0/1091002922 >> v1:172.21.15.60:6789/0 conn(0x7f22d40b24a0 legacy=0x7f22d4145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d259c700 1 -- 172.21.15.60:0/1091002922 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d40b0910 con 0x7f22d40b5570 2020-10-31T22:44:37.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d259c700 1 --2- 172.21.15.60:0/1091002922 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22d40b5570 0x7f22d40b5950 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f22c4002f30 tx=0x7f22c4006dc0).ready entity=mon.2 client_cookie=4ff98a0dcfc86aae server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:37.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d159a700 1 -- 172.21.15.60:0/1091002922 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22c4009730 con 0x7f22d40b5570 2020-10-31T22:44:37.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d159a700 1 -- 172.21.15.60:0/1091002922 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c4009890 con 0x7f22d40b5570 2020-10-31T22:44:37.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d159a700 1 -- 172.21.15.60:0/1091002922 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22c4009bf0 con 0x7f22d40b5570 2020-10-31T22:44:37.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d359e700 1 -- 172.21.15.60:0/1091002922 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22d40b5570 msgr2=0x7f22d40b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.291+0000 7f22d359e700 1 --2- 172.21.15.60:0/1091002922 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22d40b5570 0x7f22d40b5950 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f22c4002f30 tx=0x7f22c4006dc0).stop 2020-10-31T22:44:37.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d359e700 1 -- 172.21.15.60:0/1091002922 shutdown_connections 2020-10-31T22:44:37.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d359e700 1 --2- 172.21.15.60:0/1091002922 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22d40b5570 0x7f22d40b5950 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d359e700 1 -- 172.21.15.60:0/1091002922 >> 172.21.15.60:0/1091002922 conn(0x7f22d40b8e90 msgr2=0x7f22d40b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:37.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d359e700 1 -- 172.21.15.60:0/1091002922 shutdown_connections 2020-10-31T22:44:37.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d359e700 1 -- 172.21.15.60:0/1091002922 wait complete. 2020-10-31T22:44:37.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d359e700 1 Processor -- start 2020-10-31T22:44:37.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d359e700 1 -- start start 2020-10-31T22:44:37.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22d40b24a0 0x7f22d4140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:37.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22d40b5570 0x7f22d40b73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:37.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d4141fe0 0x7f22d40b7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:37.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d4149040 con 0x7f22d4141fe0 2020-10-31T22:44:37.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d4141390 con 0x7f22d40b24a0 2020-10-31T22:44:37.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d4146840 con 0x7f22d40b5570 2020-10-31T22:44:37.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d2d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d4141fe0 0x7f22d40b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:37.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d2d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d4141fe0 0x7f22d40b7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43880/0 (socket says 172.21.15.60:43880) 2020-10-31T22:44:37.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d2d9d700 1 -- 172.21.15.60:0/1321789284 learned_addr learned my addr 172.21.15.60:0/1321789284 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:37.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d259c700 1 --2- 172.21.15.60:0/1321789284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22d40b24a0 0x7f22d4140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:37.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.295+0000 7f22d1d9b700 1 --2- 172.21.15.60:0/1321789284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22d40b5570 0x7f22d40b73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:37.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.299+0000 7f22d2d9d700 1 -- 172.21.15.60:0/1321789284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22d40b5570 msgr2=0x7f22d40b73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.299+0000 7f22d2d9d700 1 --2- 172.21.15.60:0/1321789284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22d40b5570 0x7f22d40b73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.299+0000 7f22d2d9d700 1 -- 172.21.15.60:0/1321789284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22d40b24a0 msgr2=0x7f22d4140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.299+0000 7f22d2d9d700 1 --2- 172.21.15.60:0/1321789284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22d40b24a0 0x7f22d4140d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.299+0000 7f22d2d9d700 1 -- 172.21.15.60:0/1321789284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d4144020 con 0x7f22d4141fe0 2020-10-31T22:44:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.299+0000 7f22d2d9d700 1 --2- 172.21.15.60:0/1321789284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d4141fe0 0x7f22d40b7890 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f22d40b04e0 tx=0x7f22cc007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.299+0000 7f22c37fe700 1 -- 172.21.15.60:0/1321789284 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22cc00ce40 con 0x7f22d4141fe0 2020-10-31T22:44:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.299+0000 7f22c37fe700 1 -- 172.21.15.60:0/1321789284 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22cc00a770 con 0x7f22d4141fe0 2020-10-31T22:44:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.299+0000 7f22d359e700 1 -- 172.21.15.60:0/1321789284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d41415c0 con 0x7f22d4141fe0 2020-10-31T22:44:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.299+0000 7f22c37fe700 1 -- 172.21.15.60:0/1321789284 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22cc00a8e0 con 0x7f22d4141fe0 2020-10-31T22:44:37.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.299+0000 7f22d359e700 1 -- 172.21.15.60:0/1321789284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d4148ca0 con 0x7f22d4141fe0 2020-10-31T22:44:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.299+0000 7f22d359e700 1 -- 172.21.15.60:0/1321789284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d4146e60 con 0x7f22d4141fe0 2020-10-31T22:44:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.299+0000 7f22c37fe700 1 -- 172.21.15.60:0/1321789284 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f22cc010070 con 0x7f22d4141fe0 2020-10-31T22:44:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.303+0000 7f22c37fe700 1 --2- 172.21.15.60:0/1321789284 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f22b0054f30 0x7f22b00573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.303+0000 7f22d259c700 1 --2- 172.21.15.60:0/1321789284 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f22b0054f30 0x7f22b00573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.303+0000 7f22c37fe700 1 -- 172.21.15.60:0/1321789284 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f22cc06d320 con 0x7f22d4141fe0 2020-10-31T22:44:37.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.303+0000 7f22d259c700 1 --2- 172.21.15.60:0/1321789284 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f22b0054f30 0x7f22b00573f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f22c4019000 tx=0x7f22c4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:37.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.307+0000 7f22c37fe700 1 -- 172.21.15.60:0/1321789284 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f22cc043a60 con 0x7f22d4141fe0 2020-10-31T22:44:37.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.495+0000 7f22d359e700 1 -- 172.21.15.60:0/1321789284 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f22d4057100 con 0x7f22d4141fe0 2020-10-31T22:44:37.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.495+0000 7f22c37fe700 1 -- 172.21.15.60:0/1321789284 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f22cc047080 con 0x7f22d4141fe0 2020-10-31T22:44:37.500 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:44:37.501 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:44:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2020-10-31T22:44:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.501 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2020-10-31T22:44:37.502 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f7D/cFRAAHQ9NU7VSs14mi5sC/GwHng==", 2020-10-31T22:44:37.502 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.502 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:44:37.503 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:44:37.503 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:44:37.503 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:44:37.504 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.506 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2020-10-31T22:44:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f5SPjJBAAVjFv2PdBZ7j94etJrAT0tA==", 2020-10-31T22:44:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.507 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:44:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:44:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:44:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:44:37.508 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.509 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.509 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2020-10-31T22:44:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKpdoHhAAhhlaYqOQoI6tTKexjRpbGA==", 2020-10-31T22:44:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.510 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:44:37.513 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:44:37.514 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:44:37.514 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:44:37.516 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.517 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.517 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.517 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2020-10-31T22:44:37.518 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDR551f7MwsMRAACZIQlAKm3BdVbDs2gQAfxg==", 2020-10-31T22:44:37.518 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.518 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:44:37.518 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:44:37.519 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:44:37.519 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.520 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.520 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2020-10-31T22:44:37.521 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDU551f07HQFxAAokMFXwsbgKGtJNpnKerdGg==", 2020-10-31T22:44:37.521 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.522 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:44:37.522 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:44:37.523 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:44:37.523 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.524 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.524 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2020-10-31T22:44:37.524 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDW551fODyjOhAAJ+j8KITJidSpltSiJaQZGw==", 2020-10-31T22:44:37.525 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.525 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:44:37.525 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:44:37.525 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:44:37.526 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.526 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.526 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2020-10-31T22:44:37.527 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDZ551fs+aCIhAAwpbmgGQjU05W3hZofTtHdg==", 2020-10-31T22:44:37.528 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.528 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:44:37.528 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:44:37.529 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:44:37.530 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.531 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.531 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2020-10-31T22:44:37.532 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDe551fI5nIMxAAwwNSHQYDPS6G2achKIpwqg==", 2020-10-31T22:44:37.533 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.533 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:44:37.533 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:44:37.534 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:44:37.534 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.534 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.535 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.535 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2020-10-31T22:44:37.535 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDh551f68p2GhAAhlGpZLPg8RqouzStqN4tFw==", 2020-10-31T22:44:37.535 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:44:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:44:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:44:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.549 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2020-10-31T22:44:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDk551fUi3kARAAsXPU7HEhqax8Go00CqgdNw==", 2020-10-31T22:44:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.550 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:44:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:44:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:44:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.551 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2020-10-31T22:44:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDm551fKh4aJRAAj+whV4kueCu2Og7wZ05tNw==", 2020-10-31T22:44:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:44:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:44:37.552 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:44:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2020-10-31T22:44:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551flXvBJxAAtD4URDL2NV0zyAympufvVA==", 2020-10-31T22:44:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.553 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:44:37.554 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:44:37.554 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:44:37.554 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.554 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.554 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.554 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2020-10-31T22:44:37.555 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fQ/OGKhAA/xGrRlUW52pP6E6SWXYAGA==", 2020-10-31T22:44:37.555 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.555 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:44:37.555 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:44:37.555 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:44:37.556 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.556 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.556 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.556 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2020-10-31T22:44:37.556 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDP551fITgCMxAAQy5CQzqda1YjdUtTRxbsPQ==", 2020-10-31T22:44:37.556 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.557 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:44:37.557 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:44:37.557 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:44:37.557 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:44:37.557 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.557 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.558 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.558 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2020-10-31T22:44:37.558 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551feZUgExAAvGt2fUb5GhkkFQ0dbgP5nw==", 2020-10-31T22:44:37.558 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.558 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:44:37.559 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:44:37.559 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:44:37.559 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.559 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:37.564 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:37.564 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2020-10-31T22:44:37.564 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKiN5EBAAhHtXXE4+yydXWOK7agZ14g==", 2020-10-31T22:44:37.565 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:44:37.565 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:44:37.565 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:44:37.565 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:44:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:37.566 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:44:37.567 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:44:37.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.499+0000 7f22d359e700 1 -- 172.21.15.60:0/1321789284 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f22b0054f30 msgr2=0x7f22b00573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.499+0000 7f22d359e700 1 --2- 172.21.15.60:0/1321789284 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f22b0054f30 0x7f22b00573f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f22c4019000 tx=0x7f22c4015000).stop 2020-10-31T22:44:37.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.499+0000 7f22d359e700 1 -- 172.21.15.60:0/1321789284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d4141fe0 msgr2=0x7f22d40b7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.499+0000 7f22d359e700 1 --2- 172.21.15.60:0/1321789284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d4141fe0 0x7f22d40b7890 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f22d40b04e0 tx=0x7f22cc007d30).stop 2020-10-31T22:44:37.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.499+0000 7f22d359e700 1 -- 172.21.15.60:0/1321789284 shutdown_connections 2020-10-31T22:44:37.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.499+0000 7f22d359e700 1 --2- 172.21.15.60:0/1321789284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22d4141fe0 0x7f22d40b7890 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.499+0000 7f22d359e700 1 --2- 172.21.15.60:0/1321789284 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f22b0054f30 0x7f22b00573f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.499+0000 7f22d359e700 1 --2- 172.21.15.60:0/1321789284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22d40b24a0 0x7f22d4140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.499+0000 7f22d359e700 1 --2- 172.21.15.60:0/1321789284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22d40b5570 0x7f22d40b73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.499+0000 7f22d359e700 1 -- 172.21.15.60:0/1321789284 >> 172.21.15.60:0/1321789284 conn(0x7f22d40b8e90 msgr2=0x7f22d41426f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:37.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.499+0000 7f22d359e700 1 -- 172.21.15.60:0/1321789284 shutdown_connections 2020-10-31T22:44:37.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.499+0000 7f22d359e700 1 -- 172.21.15.60:0/1321789284 wait complete. 2020-10-31T22:44:37.575 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:44:37.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bfd58d700 1 Processor -- start 2020-10-31T22:44:37.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bfd58d700 1 -- start start 2020-10-31T22:44:37.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bfd58d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4bf80b4f80 0x7f4bf80b4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:37.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bfd58d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4bf80b5360 0x7f4bf813f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:37.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bfd58d700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf8066c40 con 0x7f4bf80b2ef0 2020-10-31T22:44:37.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bfd58d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf80b3750 con 0x7f4bf80b5360 2020-10-31T22:44:37.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bfd58d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80b39f0 con 0x7f4bf80b4f80 2020-10-31T22:44:37.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bf6ffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4bf80b4f80 0x7f4bf80b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:37.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bf77fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4bf80b5360 0x7f4bf813f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:37.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bf6ffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4bf80b4f80 0x7f4bf80b4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:57072/0 (socket says 172.21.15.60:57072) 2020-10-31T22:44:37.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bf6ffd700 1 -- 172.21.15.60:0/3362293491 learned_addr learned my addr 172.21.15.60:0/3362293491 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:37.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bf77fe700 1 --2- 172.21.15.60:0/3362293491 >> v2:172.21.15.66:3300/0 conn(0x7f4bf80b5360 0x7f4bf813f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:54820/0 (socket says 172.21.15.60:54820) 2020-10-31T22:44:37.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bf6ffd700 1 -- 172.21.15.60:0/3362293491 >> v2:172.21.15.66:3300/0 conn(0x7f4bf80b5360 msgr2=0x7f4bf813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bf6ffd700 1 --2- 172.21.15.60:0/3362293491 >> v2:172.21.15.66:3300/0 conn(0x7f4bf80b5360 0x7f4bf813f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bf6ffd700 1 -- 172.21.15.60:0/3362293491 >> v1:172.21.15.66:6789/0 conn(0x7f4bf80b2ef0 legacy=0x7f4bf8145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bf6ffd700 1 -- 172.21.15.60:0/3362293491 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf80b3c90 con 0x7f4bf80b4f80 2020-10-31T22:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bf77fe700 1 --2- 172.21.15.60:0/3362293491 >> v2:172.21.15.66:3300/0 conn(0x7f4bf80b5360 0x7f4bf813f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:44:37.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bf6ffd700 1 --2- 172.21.15.60:0/3362293491 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4bf80b4f80 0x7f4bf80b4130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f4bf00032b0 tx=0x7f4bf0009270).ready entity=mon.2 client_cookie=b13e81ae3870494b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bf5ffb700 1 -- 172.21.15.60:0/3362293491 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bf0009e60 con 0x7f4bf80b4f80 2020-10-31T22:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bf5ffb700 1 -- 172.21.15.60:0/3362293491 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf000bc00 con 0x7f4bf80b4f80 2020-10-31T22:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bf5ffb700 1 -- 172.21.15.60:0/3362293491 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bf000bd70 con 0x7f4bf80b4f80 2020-10-31T22:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bfd58d700 1 -- 172.21.15.60:0/3362293491 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4bf80b4f80 msgr2=0x7f4bf80b4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.695+0000 7f4bfd58d700 1 --2- 172.21.15.60:0/3362293491 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4bf80b4f80 0x7f4bf80b4130 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f4bf00032b0 tx=0x7f4bf0009270).stop 2020-10-31T22:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bfd58d700 1 -- 172.21.15.60:0/3362293491 shutdown_connections 2020-10-31T22:44:37.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bfd58d700 1 --2- 172.21.15.60:0/3362293491 >> v2:172.21.15.66:3300/0 conn(0x7f4bf80b5360 0x7f4bf813f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bfd58d700 1 --2- 172.21.15.60:0/3362293491 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4bf80b4f80 0x7f4bf80b4130 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bfd58d700 1 -- 172.21.15.60:0/3362293491 >> 172.21.15.60:0/3362293491 conn(0x7f4bf805b830 msgr2=0x7f4bf805bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:37.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bfd58d700 1 -- 172.21.15.60:0/3362293491 shutdown_connections 2020-10-31T22:44:37.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bfd58d700 1 -- 172.21.15.60:0/3362293491 wait complete. 2020-10-31T22:44:37.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bfd58d700 1 Processor -- start 2020-10-31T22:44:37.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bfd58d700 1 -- start start 2020-10-31T22:44:37.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bfd58d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bf80b2ef0 0x7f4bf80ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:37.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bfd58d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4bf80b4f80 0x7f4bf8141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:37.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bfd58d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4bf80b5360 0x7f4bf81419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:37.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bfd58d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80af470 con 0x7f4bf80b2ef0 2020-10-31T22:44:37.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bfd58d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf8140010 con 0x7f4bf80b4f80 2020-10-31T22:44:37.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bfd58d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf81519e0 con 0x7f4bf80b5360 2020-10-31T22:44:37.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bf6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bf80b2ef0 0x7f4bf80ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:37.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bf6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bf80b2ef0 0x7f4bf80ad110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43890/0 (socket says 172.21.15.60:43890) 2020-10-31T22:44:37.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bf6ffd700 1 -- 172.21.15.60:0/2678423690 learned_addr learned my addr 172.21.15.60:0/2678423690 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:37.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bf77fe700 1 --2- 172.21.15.60:0/2678423690 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4bf80b5360 0x7f4bf81419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:37.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bf67fc700 1 --2- 172.21.15.60:0/2678423690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4bf80b4f80 0x7f4bf8141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:37.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bf6ffd700 1 -- 172.21.15.60:0/2678423690 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4bf80b5360 msgr2=0x7f4bf81419f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bf6ffd700 1 --2- 172.21.15.60:0/2678423690 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4bf80b5360 0x7f4bf81419f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bf6ffd700 1 -- 172.21.15.60:0/2678423690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4bf80b4f80 msgr2=0x7f4bf8141500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bf6ffd700 1 --2- 172.21.15.60:0/2678423690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4bf80b4f80 0x7f4bf8141500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bf6ffd700 1 -- 172.21.15.60:0/2678423690 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf8140240 con 0x7f4bf80b2ef0 2020-10-31T22:44:37.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4bf6ffd700 1 --2- 172.21.15.60:0/2678423690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bf80b2ef0 0x7f4bf80ad110 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f4bf8142c50 tx=0x7f4bf0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:37.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.699+0000 7f4beffff700 1 -- 172.21.15.60:0/2678423690 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bf001f670 con 0x7f4bf80b2ef0 2020-10-31T22:44:37.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.703+0000 7f4beffff700 1 -- 172.21.15.60:0/2678423690 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf001f7d0 con 0x7f4bf80b2ef0 2020-10-31T22:44:37.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.703+0000 7f4bfd58d700 1 -- 172.21.15.60:0/2678423690 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf81404e0 con 0x7f4bf80b2ef0 2020-10-31T22:44:37.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.703+0000 7f4beffff700 1 -- 172.21.15.60:0/2678423690 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4bf001fb30 con 0x7f4bf80b2ef0 2020-10-31T22:44:37.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.703+0000 7f4bfd58d700 1 -- 172.21.15.60:0/2678423690 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf813fdb0 con 0x7f4bf80b2ef0 2020-10-31T22:44:37.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.703+0000 7f4bfd58d700 1 -- 172.21.15.60:0/2678423690 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf8057100 con 0x7f4bf80b2ef0 2020-10-31T22:44:37.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.703+0000 7f4beffff700 1 -- 172.21.15.60:0/2678423690 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4bf0026030 con 0x7f4bf80b2ef0 2020-10-31T22:44:37.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.703+0000 7f4beffff700 1 --2- 172.21.15.60:0/2678423690 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4bd0054f90 0x7f4bd0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:37.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.703+0000 7f4beffff700 1 -- 172.21.15.60:0/2678423690 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4bf006e950 con 0x7f4bf80b2ef0 2020-10-31T22:44:37.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.703+0000 7f4bf67fc700 1 --2- 172.21.15.60:0/2678423690 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4bd0054f90 0x7f4bd0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:37.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.703+0000 7f4bf67fc700 1 --2- 172.21.15.60:0/2678423690 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4bd0054f90 0x7f4bd0057450 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f4be000d000 tx=0x7f4be0007b60).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:37.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.715+0000 7f4beffff700 1 -- 172.21.15.60:0/2678423690 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4bf00451a0 con 0x7f4bf80b2ef0 2020-10-31T22:44:37.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.855+0000 7f4bfd58d700 1 -- 172.21.15.60:0/2678423690 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bf81517c0 con 0x7f4bf80b2ef0 2020-10-31T22:44:37.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.855+0000 7f4beffff700 1 -- 172.21.15.60:0/2678423690 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+13181 (secure 0 0 0) 0x7f4bf0024090 con 0x7f4bf80b2ef0 2020-10-31T22:44:37.859 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:44:37.859 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":49,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:44:37.149559+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:44:37.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.859+0000 7f4bfd58d700 1 -- 172.21.15.60:0/2678423690 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4bd0054f90 msgr2=0x7f4bd0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.859+0000 7f4bfd58d700 1 --2- 172.21.15.60:0/2678423690 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4bd0054f90 0x7f4bd0057450 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f4be000d000 tx=0x7f4be0007b60).stop 2020-10-31T22:44:37.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.859+0000 7f4bfd58d700 1 -- 172.21.15.60:0/2678423690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bf80b2ef0 msgr2=0x7f4bf80ad110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:37.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.859+0000 7f4bfd58d700 1 --2- 172.21.15.60:0/2678423690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bf80b2ef0 0x7f4bf80ad110 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f4bf8142c50 tx=0x7f4bf0016000).stop 2020-10-31T22:44:37.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.859+0000 7f4bfd58d700 1 -- 172.21.15.60:0/2678423690 shutdown_connections 2020-10-31T22:44:37.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.859+0000 7f4bfd58d700 1 --2- 172.21.15.60:0/2678423690 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4bf80b5360 0x7f4bf81419f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.859+0000 7f4bfd58d700 1 --2- 172.21.15.60:0/2678423690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4bf80b2ef0 0x7f4bf80ad110 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.859+0000 7f4bfd58d700 1 --2- 172.21.15.60:0/2678423690 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4bd0054f90 0x7f4bd0057450 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.859+0000 7f4bfd58d700 1 --2- 172.21.15.60:0/2678423690 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4bf80b4f80 0x7f4bf8141500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:37.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.859+0000 7f4bfd58d700 1 -- 172.21.15.60:0/2678423690 >> 172.21.15.60:0/2678423690 conn(0x7f4bf805b830 msgr2=0x7f4bf805f3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:37.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.859+0000 7f4bfd58d700 1 -- 172.21.15.60:0/2678423690 shutdown_connections 2020-10-31T22:44:37.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.859+0000 7f4bfd58d700 1 -- 172.21.15.60:0/2678423690 wait complete. 2020-10-31T22:44:37.872 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-31T22:44:37.874 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:44:38.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 Processor -- start 2020-10-31T22:44:38.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 -- start start 2020-10-31T22:44:38.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc400b1df0 0x7fbc400abe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbc400ac320 0x7fbc4013ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc4013f200 0x7fbc4013f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc400ac970 con 0x7fbc4013f200 2020-10-31T22:44:38.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc4013ca50 con 0x7fbc400ac320 2020-10-31T22:44:38.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400b21d0 con 0x7fbc400b1df0 2020-10-31T22:44:38.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc46b3d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc4013f200 0x7fbc4013f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc46b3d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbc4013f200 0x7fbc4013f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43898/0 (socket says 172.21.15.60:43898) 2020-10-31T22:44:38.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc46b3d700 1 -- 172.21.15.60:0/870419327 learned_addr learned my addr 172.21.15.60:0/870419327 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:38.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc45b3b700 1 --2- 172.21.15.60:0/870419327 >> v2:172.21.15.66:3300/0 conn(0x7fbc400ac320 0x7fbc4013ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc4633c700 1 --2- 172.21.15.60:0/870419327 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc400b1df0 0x7fbc400abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc46b3d700 1 -- 172.21.15.60:0/870419327 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc400b1df0 msgr2=0x7fbc400abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:38.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc46b3d700 1 --2- 172.21.15.60:0/870419327 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc400b1df0 0x7fbc400abe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc46b3d700 1 -- 172.21.15.60:0/870419327 >> v2:172.21.15.66:3300/0 conn(0x7fbc400ac320 msgr2=0x7fbc4013ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:38.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc46b3d700 1 --2- 172.21.15.60:0/870419327 >> v2:172.21.15.66:3300/0 conn(0x7fbc400ac320 0x7fbc4013ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc46b3d700 1 -- 172.21.15.60:0/870419327 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc400adec0 con 0x7fbc4013f200 2020-10-31T22:44:38.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc4633c700 1 --2- 172.21.15.60:0/870419327 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc400b1df0 0x7fbc400abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:44:38.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc46b3d700 1 --2- 172.21.15.60:0/870419327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4013f200 0x7fbc4013f620 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fbc380032b0 tx=0x7fbc3800b510).ready entity=mon.0 client_cookie=4c9061e403d653b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:38.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc4533a700 1 -- 172.21.15.60:0/870419327 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc38010660 con 0x7fbc4013f200 2020-10-31T22:44:38.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc4533a700 1 -- 172.21.15.60:0/870419327 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc380107c0 con 0x7fbc4013f200 2020-10-31T22:44:38.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc4533a700 1 -- 172.21.15.60:0/870419327 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc38010b20 con 0x7fbc4013f200 2020-10-31T22:44:38.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 -- 172.21.15.60:0/870419327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4013f200 msgr2=0x7fbc4013f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 --2- 172.21.15.60:0/870419327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4013f200 0x7fbc4013f620 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fbc380032b0 tx=0x7fbc3800b510).stop 2020-10-31T22:44:38.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 -- 172.21.15.60:0/870419327 shutdown_connections 2020-10-31T22:44:38.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 --2- 172.21.15.60:0/870419327 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4013f200 0x7fbc4013f620 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 --2- 172.21.15.60:0/870419327 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc400b1df0 0x7fbc400abe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 --2- 172.21.15.60:0/870419327 >> v2:172.21.15.66:3300/0 conn(0x7fbc400ac320 0x7fbc4013ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 -- 172.21.15.60:0/870419327 >> 172.21.15.60:0/870419327 conn(0x7fbc40062310 msgr2=0x7fbc400626f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:38.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 -- 172.21.15.60:0/870419327 shutdown_connections 2020-10-31T22:44:38.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.995+0000 7fbc485a0700 1 -- 172.21.15.60:0/870419327 wait complete. 2020-10-31T22:44:38.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc485a0700 1 Processor -- start 2020-10-31T22:44:38.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc485a0700 1 -- start start 2020-10-31T22:44:38.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc485a0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc400ac320 0x7fbc40154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc485a0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc400b1df0 0x7fbc4013ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc485a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4013f200 0x7fbc4013b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc485a0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc40140a40 con 0x7fbc4013f200 2020-10-31T22:44:38.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc485a0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400aabb0 con 0x7fbc400ac320 2020-10-31T22:44:38.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc485a0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc40154c40 con 0x7fbc400b1df0 2020-10-31T22:44:38.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc46b3d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4013f200 0x7fbc4013b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc45b3b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc400b1df0 0x7fbc4013ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc4633c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc400ac320 0x7fbc40154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc46b3d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4013f200 0x7fbc4013b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43906/0 (socket says 172.21.15.60:43906) 2020-10-31T22:44:38.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc46b3d700 1 -- 172.21.15.60:0/1478626582 learned_addr learned my addr 172.21.15.60:0/1478626582 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:38.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc46b3d700 1 -- 172.21.15.60:0/1478626582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc400b1df0 msgr2=0x7fbc4013ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc46b3d700 1 --2- 172.21.15.60:0/1478626582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc400b1df0 0x7fbc4013ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc46b3d700 1 -- 172.21.15.60:0/1478626582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc400ac320 msgr2=0x7fbc40154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc46b3d700 1 --2- 172.21.15.60:0/1478626582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc400ac320 0x7fbc40154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:37.999+0000 7fbc46b3d700 1 -- 172.21.15.60:0/1478626582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40154e70 con 0x7fbc4013f200 2020-10-31T22:44:38.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.003+0000 7fbc46b3d700 1 --2- 172.21.15.60:0/1478626582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4013f200 0x7fbc4013b240 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fbc380032b0 tx=0x7fbc400ad410).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:38.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.003+0000 7fbc2f7fe700 1 -- 172.21.15.60:0/1478626582 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc3801d070 con 0x7fbc4013f200 2020-10-31T22:44:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.003+0000 7fbc2f7fe700 1 -- 172.21.15.60:0/1478626582 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc38018d70 con 0x7fbc4013f200 2020-10-31T22:44:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.003+0000 7fbc485a0700 1 -- 172.21.15.60:0/1478626582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc40155110 con 0x7fbc4013f200 2020-10-31T22:44:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.003+0000 7fbc2f7fe700 1 -- 172.21.15.60:0/1478626582 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc38022600 con 0x7fbc4013f200 2020-10-31T22:44:38.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.003+0000 7fbc485a0700 1 -- 172.21.15.60:0/1478626582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc400a8920 con 0x7fbc4013f200 2020-10-31T22:44:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.003+0000 7fbc485a0700 1 -- 172.21.15.60:0/1478626582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc400ab060 con 0x7fbc4013f200 2020-10-31T22:44:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.003+0000 7fbc2f7fe700 1 -- 172.21.15.60:0/1478626582 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbc38029070 con 0x7fbc4013f200 2020-10-31T22:44:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.003+0000 7fbc2f7fe700 1 --2- 172.21.15.60:0/1478626582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc200550c0 0x7fbc20057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.003+0000 7fbc2f7fe700 1 -- 172.21.15.60:0/1478626582 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbc3806f1e0 con 0x7fbc4013f200 2020-10-31T22:44:38.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.003+0000 7fbc4633c700 1 --2- 172.21.15.60:0/1478626582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc200550c0 0x7fbc20057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.003+0000 7fbc4633c700 1 --2- 172.21.15.60:0/1478626582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc200550c0 0x7fbc20057580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fbc3c00d000 tx=0x7fbc3c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:38.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.011+0000 7fbc2f7fe700 1 -- 172.21.15.60:0/1478626582 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbc38045920 con 0x7fbc4013f200 2020-10-31T22:44:38.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.151+0000 7fbc485a0700 1 -- 172.21.15.60:0/1478626582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbc40140da0 con 0x7fbc4013f200 2020-10-31T22:44:38.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.151+0000 7fbc2f7fe700 1 -- 172.21.15.60:0/1478626582 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v49) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbc38027070 con 0x7fbc4013f200 2020-10-31T22:44:38.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.151+0000 7fbc485a0700 1 -- 172.21.15.60:0/1478626582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc200550c0 msgr2=0x7fbc20057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.151+0000 7fbc485a0700 1 --2- 172.21.15.60:0/1478626582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc200550c0 0x7fbc20057580 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fbc3c00d000 tx=0x7fbc3c008040).stop 2020-10-31T22:44:38.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.151+0000 7fbc485a0700 1 -- 172.21.15.60:0/1478626582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4013f200 msgr2=0x7fbc4013b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.151+0000 7fbc485a0700 1 --2- 172.21.15.60:0/1478626582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4013f200 0x7fbc4013b240 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fbc380032b0 tx=0x7fbc400ad410).stop 2020-10-31T22:44:38.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.151+0000 7fbc485a0700 1 -- 172.21.15.60:0/1478626582 shutdown_connections 2020-10-31T22:44:38.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.151+0000 7fbc485a0700 1 --2- 172.21.15.60:0/1478626582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc4013f200 0x7fbc4013b240 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.151+0000 7fbc485a0700 1 --2- 172.21.15.60:0/1478626582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc200550c0 0x7fbc20057580 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.151+0000 7fbc485a0700 1 --2- 172.21.15.60:0/1478626582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc400ac320 0x7fbc40154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.151+0000 7fbc485a0700 1 --2- 172.21.15.60:0/1478626582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc400b1df0 0x7fbc4013ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.151+0000 7fbc485a0700 1 -- 172.21.15.60:0/1478626582 >> 172.21.15.60:0/1478626582 conn(0x7fbc40062310 msgr2=0x7fbc400b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:38.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.151+0000 7fbc485a0700 1 -- 172.21.15.60:0/1478626582 shutdown_connections 2020-10-31T22:44:38.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.151+0000 7fbc485a0700 1 -- 172.21.15.60:0/1478626582 wait complete. 2020-10-31T22:44:38.163 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:44:38.167 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:44:38.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.299+0000 7fc12e701700 1 Processor -- start 2020-10-31T22:44:38.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.299+0000 7fc12e701700 1 -- start start 2020-10-31T22:44:38.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12e701700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc1280b1d50 0x7fc1281420e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12e701700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1280b2130 con 0x7fc1280afc50 2020-10-31T22:44:38.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12e701700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1280af3f0 con 0x7fc1280ae450 2020-10-31T22:44:38.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12e701700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1280af200 con 0x7fc1280b1d50 2020-10-31T22:44:38.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12d6ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc1280b1d50 0x7fc1281420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12cefe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc1280afc50 0x7fc12813e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48048/0 (socket says 172.21.15.60:48048) 2020-10-31T22:44:38.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12cefe700 1 -- 172.21.15.60:0/3789810194 learned_addr learned my addr 172.21.15.60:0/3789810194 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12d6ff700 1 -- 172.21.15.60:0/3789810194 >> v1:172.21.15.66:6789/0 conn(0x7fc1280ae450 legacy=0x7fc1280ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12d6ff700 1 -- 172.21.15.60:0/3789810194 >> v1:172.21.15.60:6789/0 conn(0x7fc1280afc50 legacy=0x7fc12813e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc11ffff700 1 -- 172.21.15.60:0/3789810194 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412902506 0 0) 0x7fc1280b2130 con 0x7fc1280afc50 2020-10-31T22:44:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12d6ff700 1 -- 172.21.15.60:0/3789810194 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1280af690 con 0x7fc1280b1d50 2020-10-31T22:44:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12d6ff700 1 --2- 172.21.15.60:0/3789810194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1280b1d50 0x7fc1281420e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fc12813e6b0 tx=0x7fc124006e50).ready entity=mon.0 client_cookie=5d30da0fefb69ed0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:38.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc11ffff700 1 -- 172.21.15.60:0/3789810194 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc124014070 con 0x7fc1280b1d50 2020-10-31T22:44:38.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc11ffff700 1 -- 172.21.15.60:0/3789810194 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12400ab30 con 0x7fc1280b1d50 2020-10-31T22:44:38.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc11ffff700 1 -- 172.21.15.60:0/3789810194 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc12400ae90 con 0x7fc1280b1d50 2020-10-31T22:44:38.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12e701700 1 -- 172.21.15.60:0/3789810194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1280b1d50 msgr2=0x7fc1281420e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12e701700 1 --2- 172.21.15.60:0/3789810194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1280b1d50 0x7fc1281420e0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7fc12813e6b0 tx=0x7fc124006e50).stop 2020-10-31T22:44:38.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12e701700 1 -- 172.21.15.60:0/3789810194 shutdown_connections 2020-10-31T22:44:38.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12e701700 1 --2- 172.21.15.60:0/3789810194 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1280b1d50 0x7fc1281420e0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12e701700 1 -- 172.21.15.60:0/3789810194 >> 172.21.15.60:0/3789810194 conn(0x7fc1280b5330 msgr2=0x7fc1280b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:38.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12e701700 1 -- 172.21.15.60:0/3789810194 shutdown_connections 2020-10-31T22:44:38.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.303+0000 7fc12e701700 1 -- 172.21.15.60:0/3789810194 wait complete. 2020-10-31T22:44:38.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12e701700 1 Processor -- start 2020-10-31T22:44:38.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12e701700 1 -- start start 2020-10-31T22:44:38.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12e701700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1280ae450 0x7fc1280ad450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12e701700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1280afc50 0x7fc1280aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12e701700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1280b1d50 0x7fc1280aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12e701700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12813b000 con 0x7fc1280b1d50 2020-10-31T22:44:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12e701700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12813a4c0 con 0x7fc1280ae450 2020-10-31T22:44:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12e701700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1280a9980 con 0x7fc1280afc50 2020-10-31T22:44:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12df00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1280b1d50 0x7fc1280aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12df00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1280b1d50 0x7fc1280aafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43920/0 (socket says 172.21.15.60:43920) 2020-10-31T22:44:38.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12df00700 1 -- 172.21.15.60:0/1445192280 learned_addr learned my addr 172.21.15.60:0/1445192280 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:38.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12cefe700 1 --2- 172.21.15.60:0/1445192280 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1280afc50 0x7fc1280aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12d6ff700 1 --2- 172.21.15.60:0/1445192280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1280ae450 0x7fc1280ad450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12df00700 1 -- 172.21.15.60:0/1445192280 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1280afc50 msgr2=0x7fc1280aaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12df00700 1 --2- 172.21.15.60:0/1445192280 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1280afc50 0x7fc1280aaac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12df00700 1 -- 172.21.15.60:0/1445192280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1280ae450 msgr2=0x7fc1280ad450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12df00700 1 --2- 172.21.15.60:0/1445192280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1280ae450 0x7fc1280ad450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12df00700 1 -- 172.21.15.60:0/1445192280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1280a9c20 con 0x7fc1280b1d50 2020-10-31T22:44:38.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.307+0000 7fc12df00700 1 --2- 172.21.15.60:0/1445192280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1280b1d50 0x7fc1280aafb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fc128061080 tx=0x7fc120007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:38.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.311+0000 7fc11e7fc700 1 -- 172.21.15.60:0/1445192280 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc1200030d0 con 0x7fc1280b1d50 2020-10-31T22:44:38.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.311+0000 7fc11e7fc700 1 -- 172.21.15.60:0/1445192280 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12000a7b0 con 0x7fc1280b1d50 2020-10-31T22:44:38.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.311+0000 7fc11e7fc700 1 -- 172.21.15.60:0/1445192280 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc12000ab10 con 0x7fc1280b1d50 2020-10-31T22:44:38.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.311+0000 7fc12e701700 1 -- 172.21.15.60:0/1445192280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1280a9f20 con 0x7fc1280b1d50 2020-10-31T22:44:38.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.311+0000 7fc12e701700 1 -- 172.21.15.60:0/1445192280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1280ab4a0 con 0x7fc1280b1d50 2020-10-31T22:44:38.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.311+0000 7fc12e701700 1 -- 172.21.15.60:0/1445192280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1280a97a0 con 0x7fc1280b1d50 2020-10-31T22:44:38.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.311+0000 7fc11e7fc700 1 -- 172.21.15.60:0/1445192280 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc120019030 con 0x7fc1280b1d50 2020-10-31T22:44:38.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.311+0000 7fc11e7fc700 1 --2- 172.21.15.60:0/1445192280 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc110054f10 0x7fc1100573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.311+0000 7fc11e7fc700 1 -- 172.21.15.60:0/1445192280 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc12006cd30 con 0x7fc1280b1d50 2020-10-31T22:44:38.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.311+0000 7fc12d6ff700 1 --2- 172.21.15.60:0/1445192280 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc110054f10 0x7fc1100573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.311+0000 7fc12d6ff700 1 --2- 172.21.15.60:0/1445192280 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc110054f10 0x7fc1100573d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fc12401b000 tx=0x7fc1280af580).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:38.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.315+0000 7fc11e7fc700 1 -- 172.21.15.60:0/1445192280 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc120043520 con 0x7fc1280b1d50 2020-10-31T22:44:38.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.459+0000 7fc12e701700 1 -- 172.21.15.60:0/1445192280 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc128057100 con 0x7fc1280b1d50 2020-10-31T22:44:38.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.459+0000 7fc11e7fc700 1 -- 172.21.15.60:0/1445192280 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v49) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc120046b40 con 0x7fc1280b1d50 2020-10-31T22:44:38.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.463+0000 7fc12e701700 1 -- 172.21.15.60:0/1445192280 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc110054f10 msgr2=0x7fc1100573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.463+0000 7fc12e701700 1 --2- 172.21.15.60:0/1445192280 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc110054f10 0x7fc1100573d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fc12401b000 tx=0x7fc1280af580).stop 2020-10-31T22:44:38.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.463+0000 7fc12e701700 1 -- 172.21.15.60:0/1445192280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1280b1d50 msgr2=0x7fc1280aafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.463+0000 7fc12e701700 1 --2- 172.21.15.60:0/1445192280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1280b1d50 0x7fc1280aafb0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7fc128061080 tx=0x7fc120007e40).stop 2020-10-31T22:44:38.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.463+0000 7fc12e701700 1 -- 172.21.15.60:0/1445192280 shutdown_connections 2020-10-31T22:44:38.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.463+0000 7fc12e701700 1 --2- 172.21.15.60:0/1445192280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1280b1d50 0x7fc1280aafb0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.463+0000 7fc12e701700 1 --2- 172.21.15.60:0/1445192280 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc110054f10 0x7fc1100573d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.463+0000 7fc12e701700 1 --2- 172.21.15.60:0/1445192280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1280ae450 0x7fc1280ad450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.463+0000 7fc12e701700 1 --2- 172.21.15.60:0/1445192280 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1280afc50 0x7fc1280aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.463+0000 7fc12e701700 1 -- 172.21.15.60:0/1445192280 >> 172.21.15.60:0/1445192280 conn(0x7fc1280b5330 msgr2=0x7fc1280b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:38.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.463+0000 7fc12e701700 1 -- 172.21.15.60:0/1445192280 shutdown_connections 2020-10-31T22:44:38.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.463+0000 7fc12e701700 1 -- 172.21.15.60:0/1445192280 wait complete. 2020-10-31T22:44:38.477 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:44:38.478 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-10-31T22:44:38.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.587+0000 7f9bd8ec3700 1 Processor -- start 2020-10-31T22:44:38.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.587+0000 7f9bd8ec3700 1 -- start start 2020-10-31T22:44:38.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.587+0000 7f9bd8ec3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9bd405b320 0x7f9bd40b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.587+0000 7f9bd8ec3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9bd4140420 0x7f9bd40b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.587+0000 7f9bd8ec3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd405b700 con 0x7f9bd40acc80 2020-10-31T22:44:38.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.587+0000 7f9bd8ec3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd40b2830 con 0x7f9bd4140420 2020-10-31T22:44:38.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.587+0000 7f9bd8ec3700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd41408a0 con 0x7f9bd405b320 2020-10-31T22:44:38.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd2ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9bd4140420 0x7f9bd40b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd2ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9bd4140420 0x7f9bd40b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43926/0 (socket says 172.21.15.60:43926) 2020-10-31T22:44:38.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd3fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9bd40acc80 0x7f9bd40ad7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48062/0 (socket says 172.21.15.60:48062) 2020-10-31T22:44:38.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd2ffd700 1 -- 172.21.15.60:0/1839667587 learned_addr learned my addr 172.21.15.60:0/1839667587 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:38.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd37fe700 1 --2- 172.21.15.60:0/1839667587 >> v2:172.21.15.66:3300/0 conn(0x7f9bd405b320 0x7f9bd40b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd2ffd700 1 -- 172.21.15.60:0/1839667587 >> v2:172.21.15.66:3300/0 conn(0x7f9bd405b320 msgr2=0x7f9bd40b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:38.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd2ffd700 1 --2- 172.21.15.60:0/1839667587 >> v2:172.21.15.66:3300/0 conn(0x7f9bd405b320 0x7f9bd40b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd2ffd700 1 -- 172.21.15.60:0/1839667587 >> v1:172.21.15.60:6789/0 conn(0x7f9bd40acc80 legacy=0x7f9bd40ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd2ffd700 1 -- 172.21.15.60:0/1839667587 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd40b0220 con 0x7f9bd4140420 2020-10-31T22:44:38.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd27fc700 1 -- 172.21.15.60:0/1839667587 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430164373 0 0) 0x7f9bd405b700 con 0x7f9bd40acc80 2020-10-31T22:44:38.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd2ffd700 1 --2- 172.21.15.60:0/1839667587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd4140420 0x7f9bd40b2340 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f9bc4002f30 tx=0x7f9bc4006e80).ready entity=mon.0 client_cookie=7314f0617b111ef9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:38.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd27fc700 1 -- 172.21.15.60:0/1839667587 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bc40097f0 con 0x7f9bd4140420 2020-10-31T22:44:38.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd27fc700 1 -- 172.21.15.60:0/1839667587 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc4009950 con 0x7f9bd4140420 2020-10-31T22:44:38.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd27fc700 1 -- 172.21.15.60:0/1839667587 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bc4009cb0 con 0x7f9bd4140420 2020-10-31T22:44:38.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1839667587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd4140420 msgr2=0x7f9bd40b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd8ec3700 1 --2- 172.21.15.60:0/1839667587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd4140420 0x7f9bd40b2340 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f9bc4002f30 tx=0x7f9bc4006e80).stop 2020-10-31T22:44:38.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1839667587 shutdown_connections 2020-10-31T22:44:38.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd8ec3700 1 --2- 172.21.15.60:0/1839667587 >> v2:172.21.15.66:3300/0 conn(0x7f9bd405b320 0x7f9bd40b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd8ec3700 1 --2- 172.21.15.60:0/1839667587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd4140420 0x7f9bd40b2340 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1839667587 >> 172.21.15.60:0/1839667587 conn(0x7f9bd40b61d0 msgr2=0x7f9bd40b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:38.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1839667587 shutdown_connections 2020-10-31T22:44:38.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1839667587 wait complete. 2020-10-31T22:44:38.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd8ec3700 1 Processor -- start 2020-10-31T22:44:38.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.591+0000 7f9bd8ec3700 1 -- start start 2020-10-31T22:44:38.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd8ec3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bd405b320 0x7f9bd4146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd8ec3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bd40acc80 0x7f9bd4142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd8ec3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd4140420 0x7f9bd4138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd8ec3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd413d630 con 0x7f9bd4140420 2020-10-31T22:44:38.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd8ec3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd413a010 con 0x7f9bd40acc80 2020-10-31T22:44:38.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd8ec3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd4061000 con 0x7f9bd405b320 2020-10-31T22:44:38.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd4140420 0x7f9bd4138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd4140420 0x7f9bd4138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43932/0 (socket says 172.21.15.60:43932) 2020-10-31T22:44:38.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd3fff700 1 -- 172.21.15.60:0/1015361387 learned_addr learned my addr 172.21.15.60:0/1015361387 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:38.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd2ffd700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bd40acc80 0x7f9bd4142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd37fe700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bd405b320 0x7f9bd4146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd3fff700 1 -- 172.21.15.60:0/1015361387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bd405b320 msgr2=0x7f9bd4146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd3fff700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bd405b320 0x7f9bd4146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd3fff700 1 -- 172.21.15.60:0/1015361387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bd40acc80 msgr2=0x7f9bd4142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd3fff700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bd40acc80 0x7f9bd4142570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd3fff700 1 -- 172.21.15.60:0/1015361387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd413a240 con 0x7f9bd4140420 2020-10-31T22:44:38.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd37fe700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bd405b320 0x7f9bd4146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:44:38.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd3fff700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd4140420 0x7f9bd4138fd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f9bd41469c0 tx=0x7f9bcc007cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:38.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd0ff9700 1 -- 172.21.15.60:0/1015361387 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bcc005ab0 con 0x7f9bd4140420 2020-10-31T22:44:38.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd0ff9700 1 -- 172.21.15.60:0/1015361387 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bcc005c10 con 0x7f9bd4140420 2020-10-31T22:44:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1015361387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd4061360 con 0x7f9bd4140420 2020-10-31T22:44:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd0ff9700 1 -- 172.21.15.60:0/1015361387 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bcc007110 con 0x7f9bd4140420 2020-10-31T22:44:38.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1015361387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd4144480 con 0x7f9bd4140420 2020-10-31T22:44:38.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1015361387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd4146a70 con 0x7f9bd4140420 2020-10-31T22:44:38.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.595+0000 7f9bd0ff9700 1 -- 172.21.15.60:0/1015361387 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9bcc010030 con 0x7f9bd4140420 2020-10-31T22:44:38.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.599+0000 7f9bd0ff9700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bb4054f10 0x7f9bb40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.599+0000 7f9bd0ff9700 1 -- 172.21.15.60:0/1015361387 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9bcc06d750 con 0x7f9bd4140420 2020-10-31T22:44:38.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.599+0000 7f9bd37fe700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bb4054f10 0x7f9bb40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.599+0000 7f9bd37fe700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bb4054f10 0x7f9bb40573d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f9bc800c000 tx=0x7f9bc8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:38.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.603+0000 7f9bd0ff9700 1 -- 172.21.15.60:0/1015361387 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9bcc043fa0 con 0x7f9bd4140420 2020-10-31T22:44:38.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.743+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1015361387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9bd4057100 con 0x7f9bd4140420 2020-10-31T22:44:38.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.743+0000 7f9bd0ff9700 1 -- 172.21.15.60:0/1015361387 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v49) v1 ==== 84+0+143 (secure 0 0 0) 0x7f9bcc0475c0 con 0x7f9bd4140420 2020-10-31T22:44:38.745 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:44:38.745 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2020-10-31T22:44:38.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:38.746 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2020-10-31T22:44:38.746 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "device_health_metrics" 2020-10-31T22:44:38.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:44:38.747 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:44:38.751 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2020-10-31T22:44:38.751 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2020-10-31T22:44:38.751 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:44:38.751 INFO:teuthology.orchestra.run.smithi060.stdout:] 2020-10-31T22:44:38.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.747+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1015361387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bb4054f10 msgr2=0x7f9bb40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.747+0000 7f9bd8ec3700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bb4054f10 0x7f9bb40573d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f9bc800c000 tx=0x7f9bc8008040).stop 2020-10-31T22:44:38.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.747+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1015361387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd4140420 msgr2=0x7f9bd4138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.747+0000 7f9bd8ec3700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd4140420 0x7f9bd4138fd0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f9bd41469c0 tx=0x7f9bcc007cf0).stop 2020-10-31T22:44:38.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.747+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1015361387 shutdown_connections 2020-10-31T22:44:38.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.747+0000 7f9bd8ec3700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9bd4140420 0x7f9bd4138fd0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.747+0000 7f9bd8ec3700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9bd405b320 0x7f9bd4146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.747+0000 7f9bd8ec3700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bb4054f10 0x7f9bb40573d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.747+0000 7f9bd8ec3700 1 --2- 172.21.15.60:0/1015361387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9bd40acc80 0x7f9bd4142570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.747+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1015361387 >> 172.21.15.60:0/1015361387 conn(0x7f9bd40b61d0 msgr2=0x7f9bd40b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:38.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.747+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1015361387 shutdown_connections 2020-10-31T22:44:38.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.747+0000 7f9bd8ec3700 1 -- 172.21.15.60:0/1015361387 wait complete. 2020-10-31T22:44:38.764 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-10-31T22:44:38.765 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:44:38.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.883+0000 7fbbf984e700 1 Processor -- start 2020-10-31T22:44:38.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.883+0000 7fbbf984e700 1 -- start start 2020-10-31T22:44:38.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbbf40b1bb0 0x7fbbf405afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbbf40af580 0x7fbbf413fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbbf40ab150 0x7fbbf40ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf40b1120 con 0x7fbbf40af580 2020-10-31T22:44:38.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf40af9c0 con 0x7fbbf40ab150 2020-10-31T22:44:38.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40a8850 con 0x7fbbf40b1bb0 2020-10-31T22:44:38.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbbf40af580 0x7fbbf413fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbbf40af580 0x7fbbf413fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43940/0 (socket says 172.21.15.60:43940) 2020-10-31T22:44:38.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf3fff700 1 -- 172.21.15.60:0/2367669028 learned_addr learned my addr 172.21.15.60:0/2367669028 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:38.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf904d700 1 --2- 172.21.15.60:0/2367669028 >> v2:172.21.15.66:3300/0 conn(0x7fbbf40ab150 0x7fbbf40ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf884c700 1 --2- 172.21.15.60:0/2367669028 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbbf40b1bb0 0x7fbbf405afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf3fff700 1 -- 172.21.15.60:0/2367669028 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbbf40b1bb0 msgr2=0x7fbbf405afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:38.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf3fff700 1 --2- 172.21.15.60:0/2367669028 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbbf40b1bb0 0x7fbbf405afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf3fff700 1 -- 172.21.15.60:0/2367669028 >> v2:172.21.15.66:3300/0 conn(0x7fbbf40ab150 msgr2=0x7fbbf40ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:38.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf3fff700 1 --2- 172.21.15.60:0/2367669028 >> v2:172.21.15.66:3300/0 conn(0x7fbbf40ab150 0x7fbbf40ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf3fff700 1 -- 172.21.15.60:0/2367669028 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40a8af0 con 0x7fbbf40af580 2020-10-31T22:44:38.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf904d700 1 --2- 172.21.15.60:0/2367669028 >> v2:172.21.15.66:3300/0 conn(0x7fbbf40ab150 0x7fbbf40ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:44:38.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf884c700 1 --2- 172.21.15.60:0/2367669028 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbbf40b1bb0 0x7fbbf405afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:44:38.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf3fff700 1 --2- 172.21.15.60:0/2367669028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbf40af580 0x7fbbf413fb20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fbbe8002f30 tx=0x7fbbe8006e80).ready entity=mon.0 client_cookie=2949bb1c2a1017be server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:38.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf37fe700 1 -- 172.21.15.60:0/2367669028 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbe80097f0 con 0x7fbbf40af580 2020-10-31T22:44:38.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf37fe700 1 -- 172.21.15.60:0/2367669028 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe8009950 con 0x7fbbf40af580 2020-10-31T22:44:38.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf37fe700 1 -- 172.21.15.60:0/2367669028 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbe8009cb0 con 0x7fbbf40af580 2020-10-31T22:44:38.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 -- 172.21.15.60:0/2367669028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbf40af580 msgr2=0x7fbbf413fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 --2- 172.21.15.60:0/2367669028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbf40af580 0x7fbbf413fb20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fbbe8002f30 tx=0x7fbbe8006e80).stop 2020-10-31T22:44:38.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 -- 172.21.15.60:0/2367669028 shutdown_connections 2020-10-31T22:44:38.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 --2- 172.21.15.60:0/2367669028 >> v2:172.21.15.66:3300/0 conn(0x7fbbf40ab150 0x7fbbf40ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 --2- 172.21.15.60:0/2367669028 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbbf40b1bb0 0x7fbbf405afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 --2- 172.21.15.60:0/2367669028 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbf40af580 0x7fbbf413fb20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 -- 172.21.15.60:0/2367669028 >> 172.21.15.60:0/2367669028 conn(0x7fbbf40b5330 msgr2=0x7fbbf40b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:38.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 -- 172.21.15.60:0/2367669028 shutdown_connections 2020-10-31T22:44:38.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.887+0000 7fbbf984e700 1 -- 172.21.15.60:0/2367669028 wait complete. 2020-10-31T22:44:38.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.891+0000 7fbbf984e700 1 Processor -- start 2020-10-31T22:44:38.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.891+0000 7fbbf984e700 1 -- start start 2020-10-31T22:44:38.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.891+0000 7fbbf984e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbf40ab150 0x7fbbf413e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.891+0000 7fbbf984e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbf40af580 0x7fbbf413c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.891+0000 7fbbf984e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbbf40b1bb0 0x7fbbf413cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.891+0000 7fbbf984e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf4063c60 con 0x7fbbf40af580 2020-10-31T22:44:38.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.891+0000 7fbbf984e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf4151d20 con 0x7fbbf40ab150 2020-10-31T22:44:38.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.891+0000 7fbbf984e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf4064600 con 0x7fbbf40b1bb0 2020-10-31T22:44:38.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.891+0000 7fbbf3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbf40af580 0x7fbbf413c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbf40af580 0x7fbbf413c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43946/0 (socket says 172.21.15.60:43946) 2020-10-31T22:44:38.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf3fff700 1 -- 172.21.15.60:0/2777719260 learned_addr learned my addr 172.21.15.60:0/2777719260 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:38.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf884c700 1 --2- 172.21.15.60:0/2777719260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbf40ab150 0x7fbbf413e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf904d700 1 --2- 172.21.15.60:0/2777719260 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbbf40b1bb0 0x7fbbf413cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf3fff700 1 -- 172.21.15.60:0/2777719260 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbbf40b1bb0 msgr2=0x7fbbf413cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf3fff700 1 --2- 172.21.15.60:0/2777719260 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbbf40b1bb0 0x7fbbf413cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf3fff700 1 -- 172.21.15.60:0/2777719260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbf40ab150 msgr2=0x7fbbf413e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:38.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf3fff700 1 --2- 172.21.15.60:0/2777719260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbf40ab150 0x7fbbf413e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:38.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf3fff700 1 -- 172.21.15.60:0/2777719260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf4064fa0 con 0x7fbbf40af580 2020-10-31T22:44:38.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf3fff700 1 --2- 172.21.15.60:0/2777719260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbf40af580 0x7fbbf413c6b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fbbe8002f30 tx=0x7fbbe8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:38.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf1ffb700 1 -- 172.21.15.60:0/2777719260 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbe8009c50 con 0x7fbbf40af580 2020-10-31T22:44:38.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf1ffb700 1 -- 172.21.15.60:0/2777719260 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe801e460 con 0x7fbbf40af580 2020-10-31T22:44:38.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf984e700 1 -- 172.21.15.60:0/2777719260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf413d090 con 0x7fbbf40af580 2020-10-31T22:44:38.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf1ffb700 1 -- 172.21.15.60:0/2777719260 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbe801e7c0 con 0x7fbbf40af580 2020-10-31T22:44:38.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf984e700 1 -- 172.21.15.60:0/2777719260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf413db30 con 0x7fbbf40af580 2020-10-31T22:44:38.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.895+0000 7fbbf984e700 1 -- 172.21.15.60:0/2777719260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf4064770 con 0x7fbbf40af580 2020-10-31T22:44:38.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.899+0000 7fbbf1ffb700 1 -- 172.21.15.60:0/2777719260 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbbe8025030 con 0x7fbbf40af580 2020-10-31T22:44:38.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.899+0000 7fbbf1ffb700 1 --2- 172.21.15.60:0/2777719260 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbbd4054f10 0x7fbbd40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:38.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.899+0000 7fbbf1ffb700 1 -- 172.21.15.60:0/2777719260 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbbe806e890 con 0x7fbbf40af580 2020-10-31T22:44:38.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.899+0000 7fbbf884c700 1 --2- 172.21.15.60:0/2777719260 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbbd4054f10 0x7fbbd40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:38.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.899+0000 7fbbf884c700 1 --2- 172.21.15.60:0/2777719260 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbbd4054f10 0x7fbbd40573d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fbbe400d000 tx=0x7fbbe4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:38.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:38.903+0000 7fbbf1ffb700 1 -- 172.21.15.60:0/2777719260 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbbe80450e0 con 0x7fbbf40af580 2020-10-31T22:44:39.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:39.047+0000 7fbbf984e700 1 -- 172.21.15.60:0/2777719260 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fbbf4057100 con 0x7fbbf40af580 2020-10-31T22:44:40.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.007+0000 7fbbf1ffb700 1 -- 172.21.15.60:0/2777719260 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v50) v1 ==== 133+0+0 (secure 0 0 0) 0x7fbbe8023030 con 0x7fbbf40af580 2020-10-31T22:44:40.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.011+0000 7fbbf984e700 1 -- 172.21.15.60:0/2777719260 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbbd4054f10 msgr2=0x7fbbd40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:40.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.011+0000 7fbbf984e700 1 --2- 172.21.15.60:0/2777719260 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbbd4054f10 0x7fbbd40573d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7fbbe400d000 tx=0x7fbbe4008040).stop 2020-10-31T22:44:40.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.011+0000 7fbbf984e700 1 -- 172.21.15.60:0/2777719260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbf40af580 msgr2=0x7fbbf413c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:40.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.011+0000 7fbbf984e700 1 --2- 172.21.15.60:0/2777719260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbf40af580 0x7fbbf413c6b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7fbbe8002f30 tx=0x7fbbe8015000).stop 2020-10-31T22:44:40.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.011+0000 7fbbf984e700 1 -- 172.21.15.60:0/2777719260 shutdown_connections 2020-10-31T22:44:40.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.011+0000 7fbbf984e700 1 --2- 172.21.15.60:0/2777719260 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbbf40b1bb0 0x7fbbf413cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:40.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.011+0000 7fbbf984e700 1 --2- 172.21.15.60:0/2777719260 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbbd4054f10 0x7fbbd40573d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:40.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.011+0000 7fbbf984e700 1 --2- 172.21.15.60:0/2777719260 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbf40ab150 0x7fbbf413e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:40.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.011+0000 7fbbf984e700 1 --2- 172.21.15.60:0/2777719260 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbbf40af580 0x7fbbf413c6b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:40.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.011+0000 7fbbf984e700 1 -- 172.21.15.60:0/2777719260 >> 172.21.15.60:0/2777719260 conn(0x7fbbf40b5330 msgr2=0x7fbbf40602b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:40.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.011+0000 7fbbf984e700 1 -- 172.21.15.60:0/2777719260 shutdown_connections 2020-10-31T22:44:40.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.011+0000 7fbbf984e700 1 -- 172.21.15.60:0/2777719260 wait complete. 2020-10-31T22:44:40.015 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:44:40.028 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-10-31T22:44:40.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ad0efa700 1 Processor -- start 2020-10-31T22:44:40.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ad0efa700 1 -- start start 2020-10-31T22:44:40.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ad0efa700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1acc0adae0 0x7f1acc0aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:40.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ad0efa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1acc0a9b20 0x7f1acc0a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:40.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ad0efa700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1acc0adec0 con 0x7f1acc13fb60 2020-10-31T22:44:40.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ad0efa700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1acc1434f0 con 0x7f1acc0a9b20 2020-10-31T22:44:40.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ad0efa700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1acc143790 con 0x7f1acc0adae0 2020-10-31T22:44:40.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ac9d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1acc0a9b20 0x7f1acc0a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:40.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ac9d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1acc0a9b20 0x7f1acc0a9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43954/0 (socket says 172.21.15.60:43954) 2020-10-31T22:44:40.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ac9d9b700 1 -- 172.21.15.60:0/2416169667 learned_addr learned my addr 172.21.15.60:0/2416169667 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:40.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1aca59c700 1 --2- 172.21.15.60:0/2416169667 >> v2:172.21.15.66:3300/0 conn(0x7f1acc0adae0 0x7f1acc0aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:40.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ac9d9b700 1 -- 172.21.15.60:0/2416169667 >> v2:172.21.15.66:3300/0 conn(0x7f1acc0adae0 msgr2=0x7f1acc0aaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:40.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ac9d9b700 1 --2- 172.21.15.60:0/2416169667 >> v2:172.21.15.66:3300/0 conn(0x7f1acc0adae0 0x7f1acc0aaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:40.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ac9d9b700 1 -- 172.21.15.60:0/2416169667 >> v1:172.21.15.66:6789/0 conn(0x7f1acc13fb60 legacy=0x7f1acc13ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:40.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ac9d9b700 1 -- 172.21.15.60:0/2416169667 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc143a30 con 0x7f1acc0a9b20 2020-10-31T22:44:40.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1aca59c700 1 --2- 172.21.15.60:0/2416169667 >> v2:172.21.15.66:3300/0 conn(0x7f1acc0adae0 0x7f1acc0aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:44:40.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.143+0000 7f1ac9d9b700 1 --2- 172.21.15.60:0/2416169667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1acc0a9b20 0x7f1acc0a9f90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f1ab4002f30 tx=0x7f1ab4006e80).ready entity=mon.0 client_cookie=a0ab373b0ec3da0d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:40.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.147+0000 7f1ac959a700 1 -- 172.21.15.60:0/2416169667 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab40097f0 con 0x7f1acc0a9b20 2020-10-31T22:44:40.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.147+0000 7f1ac959a700 1 -- 172.21.15.60:0/2416169667 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab4009950 con 0x7f1acc0a9b20 2020-10-31T22:44:40.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.147+0000 7f1ac959a700 1 -- 172.21.15.60:0/2416169667 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab4009cb0 con 0x7f1acc0a9b20 2020-10-31T22:44:40.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.147+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2416169667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1acc0a9b20 msgr2=0x7f1acc0a9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:40.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.147+0000 7f1ad0efa700 1 --2- 172.21.15.60:0/2416169667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1acc0a9b20 0x7f1acc0a9f90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f1ab4002f30 tx=0x7f1ab4006e80).stop 2020-10-31T22:44:40.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.151+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2416169667 shutdown_connections 2020-10-31T22:44:40.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.151+0000 7f1ad0efa700 1 --2- 172.21.15.60:0/2416169667 >> v2:172.21.15.66:3300/0 conn(0x7f1acc0adae0 0x7f1acc0aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:40.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.151+0000 7f1ad0efa700 1 --2- 172.21.15.60:0/2416169667 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1acc0a9b20 0x7f1acc0a9f90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:40.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.151+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2416169667 >> 172.21.15.60:0/2416169667 conn(0x7f1acc06a260 msgr2=0x7f1acc061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:40.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.151+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2416169667 shutdown_connections 2020-10-31T22:44:40.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.151+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2416169667 wait complete. 2020-10-31T22:44:40.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.151+0000 7f1ad0efa700 1 Processor -- start 2020-10-31T22:44:40.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.151+0000 7f1ad0efa700 1 -- start start 2020-10-31T22:44:40.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ad0efa700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1acc0a9b20 0x7f1acc0ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:40.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ad0efa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1acc0adae0 0x7f1acc142490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:40.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ad0efa700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1acc13fb60 0x7f1acc142980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:40.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ad0efa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc13a3f0 con 0x7f1acc0adae0 2020-10-31T22:44:40.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ad0efa700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc13a690 con 0x7f1acc0a9b20 2020-10-31T22:44:40.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ad0efa700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc0b4a10 con 0x7f1acc13fb60 2020-10-31T22:44:40.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ac9d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1acc0adae0 0x7f1acc142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:40.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ac9d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1acc0adae0 0x7f1acc142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43960/0 (socket says 172.21.15.60:43960) 2020-10-31T22:44:40.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ac9d9b700 1 -- 172.21.15.60:0/2432941424 learned_addr learned my addr 172.21.15.60:0/2432941424 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:40.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1acad9d700 1 --2- 172.21.15.60:0/2432941424 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1acc13fb60 0x7f1acc142980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:40.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ac9d9b700 1 -- 172.21.15.60:0/2432941424 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1acc13fb60 msgr2=0x7f1acc142980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:40.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ac9d9b700 1 --2- 172.21.15.60:0/2432941424 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1acc13fb60 0x7f1acc142980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:40.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ac9d9b700 1 -- 172.21.15.60:0/2432941424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1acc0a9b20 msgr2=0x7f1acc0ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:40.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ac9d9b700 1 --2- 172.21.15.60:0/2432941424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1acc0a9b20 0x7f1acc0ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-10-31T22:44:40.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ac9d9b700 1 -- 172.21.15.60:0/2432941424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc0b4cb0 con 0x7f1acc0adae0 2020-10-31T22:44:40.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1acad9d700 1 --2- 172.21.15.60:0/2432941424 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1acc13fb60 0x7f1acc142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:44:40.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.155+0000 7f1ac9d9b700 1 --2- 172.21.15.60:0/2432941424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1acc0adae0 0x7f1acc142490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f1ab4002f30 tx=0x7f1ab4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:40.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.159+0000 7f1ac37fe700 1 -- 172.21.15.60:0/2432941424 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab4011ce0 con 0x7f1acc0adae0 2020-10-31T22:44:40.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.159+0000 7f1ac37fe700 1 -- 172.21.15.60:0/2432941424 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab4011e40 con 0x7f1acc0adae0 2020-10-31T22:44:40.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.159+0000 7f1ac37fe700 1 -- 172.21.15.60:0/2432941424 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab401e650 con 0x7f1acc0adae0 2020-10-31T22:44:40.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.159+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2432941424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1acc0ad020 con 0x7f1acc0adae0 2020-10-31T22:44:40.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.159+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2432941424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1acc0b3300 con 0x7f1acc0adae0 2020-10-31T22:44:40.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.159+0000 7f1ac37fe700 1 -- 172.21.15.60:0/2432941424 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1ab4025030 con 0x7f1acc0adae0 2020-10-31T22:44:40.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.159+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2432941424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1acc057100 con 0x7f1acc0adae0 2020-10-31T22:44:40.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.159+0000 7f1ac37fe700 1 --2- 172.21.15.60:0/2432941424 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ab0054f60 0x7f1ab0057420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:40.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.159+0000 7f1ac37fe700 1 -- 172.21.15.60:0/2432941424 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f1ab406ead0 con 0x7f1acc0adae0 2020-10-31T22:44:40.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.159+0000 7f1aca59c700 1 --2- 172.21.15.60:0/2432941424 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ab0054f60 0x7f1ab0057420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:40.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.159+0000 7f1aca59c700 1 --2- 172.21.15.60:0/2432941424 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ab0054f60 0x7f1ab0057420 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f1abc00c000 tx=0x7f1abc0091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:40.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.163+0000 7f1ac37fe700 1 -- 172.21.15.60:0/2432941424 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1ab40451c0 con 0x7f1acc0adae0 2020-10-31T22:44:40.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:40.299+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2432941424 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f1acc05aa70 con 0x7f1acc0adae0 2020-10-31T22:44:41.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.159+0000 7f1ac37fe700 1 -- 172.21.15.60:0/2432941424 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v52) v1 ==== 125+0+0 (secure 0 0 0) 0x7f1ab40230a0 con 0x7f1acc0adae0 2020-10-31T22:44:41.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.163+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2432941424 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ab0054f60 msgr2=0x7f1ab0057420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.163+0000 7f1ad0efa700 1 --2- 172.21.15.60:0/2432941424 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ab0054f60 0x7f1ab0057420 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f1abc00c000 tx=0x7f1abc0091a0).stop 2020-10-31T22:44:41.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.163+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2432941424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1acc0adae0 msgr2=0x7f1acc142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.163+0000 7f1ad0efa700 1 --2- 172.21.15.60:0/2432941424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1acc0adae0 0x7f1acc142490 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7f1ab4002f30 tx=0x7f1ab4015000).stop 2020-10-31T22:44:41.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.163+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2432941424 shutdown_connections 2020-10-31T22:44:41.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.163+0000 7f1ad0efa700 1 --2- 172.21.15.60:0/2432941424 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1acc13fb60 0x7f1acc142980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.163+0000 7f1ad0efa700 1 --2- 172.21.15.60:0/2432941424 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ab0054f60 0x7f1ab0057420 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.163+0000 7f1ad0efa700 1 --2- 172.21.15.60:0/2432941424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1acc0a9b20 0x7f1acc0ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-10-31T22:44:41.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.163+0000 7f1ad0efa700 1 --2- 172.21.15.60:0/2432941424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1acc0adae0 0x7f1acc142490 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.163+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2432941424 >> 172.21.15.60:0/2432941424 conn(0x7f1acc06a260 msgr2=0x7f1acc13ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:41.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.163+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2432941424 shutdown_connections 2020-10-31T22:44:41.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.163+0000 7f1ad0efa700 1 -- 172.21.15.60:0/2432941424 wait complete. 2020-10-31T22:44:41.173 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2020-10-31T22:44:41.182 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-10-31T22:44:41.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.295+0000 7f34d359e700 1 Processor -- start 2020-10-31T22:44:41.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.295+0000 7f34d359e700 1 -- start start 2020-10-31T22:44:41.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.295+0000 7f34d359e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34d40b5570 0x7f34d40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d359e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d40b4440 con 0x7f34d40b24a0 2020-10-31T22:44:41.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d359e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34d4146060 con 0x7f34d4141f00 2020-10-31T22:44:41.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d359e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34d413f930 con 0x7f34d40b5570 2020-10-31T22:44:41.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34d40b5570 0x7f34d40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d1d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f34d40b24a0 0x7f34d4145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48104/0 (socket says 172.21.15.60:48104) 2020-10-31T22:44:41.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d1d9b700 1 -- 172.21.15.60:0/132371999 learned_addr learned my addr 172.21.15.60:0/132371999 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:41.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d159a700 1 -- 172.21.15.60:0/132371999 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654749690 0 0) 0x7f34d40b4440 con 0x7f34d40b24a0 2020-10-31T22:44:41.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d159a700 1 -- 172.21.15.60:0/132371999 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34b8003230 con 0x7f34d40b24a0 2020-10-31T22:44:41.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d159a700 1 -- 172.21.15.60:0/132371999 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925033532 0 0) 0x7f34d4146060 con 0x7f34d4141f00 2020-10-31T22:44:41.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d259c700 1 -- 172.21.15.60:0/132371999 >> v1:172.21.15.66:6789/0 conn(0x7f34d4141f00 legacy=0x7f34d4142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d259c700 1 -- 172.21.15.60:0/132371999 >> v1:172.21.15.60:6789/0 conn(0x7f34d40b24a0 legacy=0x7f34d4145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d259c700 1 -- 172.21.15.60:0/132371999 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d40b02f0 con 0x7f34d40b5570 2020-10-31T22:44:41.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d259c700 1 --2- 172.21.15.60:0/132371999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d40b5570 0x7f34d40b5950 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f34c8002f30 tx=0x7f34c8006dc0).ready entity=mon.0 client_cookie=edeefada917618db server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:41.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d159a700 1 -- 172.21.15.60:0/132371999 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34c8009800 con 0x7f34d40b5570 2020-10-31T22:44:41.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d159a700 1 -- 172.21.15.60:0/132371999 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c8009960 con 0x7f34d40b5570 2020-10-31T22:44:41.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d159a700 1 -- 172.21.15.60:0/132371999 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34c8009cc0 con 0x7f34d40b5570 2020-10-31T22:44:41.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d359e700 1 -- 172.21.15.60:0/132371999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d40b5570 msgr2=0x7f34d40b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d359e700 1 --2- 172.21.15.60:0/132371999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d40b5570 0x7f34d40b5950 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f34c8002f30 tx=0x7f34c8006dc0).stop 2020-10-31T22:44:41.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d359e700 1 -- 172.21.15.60:0/132371999 shutdown_connections 2020-10-31T22:44:41.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d359e700 1 --2- 172.21.15.60:0/132371999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d40b5570 0x7f34d40b5950 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d359e700 1 -- 172.21.15.60:0/132371999 >> 172.21.15.60:0/132371999 conn(0x7f34d40b8e90 msgr2=0x7f34d40b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:41.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d359e700 1 -- 172.21.15.60:0/132371999 shutdown_connections 2020-10-31T22:44:41.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.299+0000 7f34d359e700 1 -- 172.21.15.60:0/132371999 wait complete. 2020-10-31T22:44:41.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d359e700 1 Processor -- start 2020-10-31T22:44:41.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d359e700 1 -- start start 2020-10-31T22:44:41.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34d40b24a0 0x7f34d41402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d40b5570 0x7f34d4146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34d4141f00 0x7f34d4146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40adf50 con 0x7f34d40b5570 2020-10-31T22:44:41.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40ae1f0 con 0x7f34d40b24a0 2020-10-31T22:44:41.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34d40ae490 con 0x7f34d4141f00 2020-10-31T22:44:41.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d1d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d40b5570 0x7f34d4146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d1d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d40b5570 0x7f34d4146190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43974/0 (socket says 172.21.15.60:43974) 2020-10-31T22:44:41.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d1d9b700 1 -- 172.21.15.60:0/902724141 learned_addr learned my addr 172.21.15.60:0/902724141 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:41.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d259c700 1 --2- 172.21.15.60:0/902724141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34d40b24a0 0x7f34d41402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d2d9d700 1 --2- 172.21.15.60:0/902724141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34d4141f00 0x7f34d4146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d1d9b700 1 -- 172.21.15.60:0/902724141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34d4141f00 msgr2=0x7f34d4146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d1d9b700 1 --2- 172.21.15.60:0/902724141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34d4141f00 0x7f34d4146a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d1d9b700 1 -- 172.21.15.60:0/902724141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34d40b24a0 msgr2=0x7f34d41402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d1d9b700 1 --2- 172.21.15.60:0/902724141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34d40b24a0 0x7f34d41402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d1d9b700 1 -- 172.21.15.60:0/902724141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34d40ad400 con 0x7f34d40b5570 2020-10-31T22:44:41.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d1d9b700 1 --2- 172.21.15.60:0/902724141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d40b5570 0x7f34d4146190 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f34c40010d0 tx=0x7f34c4007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:41.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34c37fe700 1 -- 172.21.15.60:0/902724141 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34c40072e0 con 0x7f34d40b5570 2020-10-31T22:44:41.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34c37fe700 1 -- 172.21.15.60:0/902724141 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34c4007440 con 0x7f34d40b5570 2020-10-31T22:44:41.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d359e700 1 -- 172.21.15.60:0/902724141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34d4154050 con 0x7f34d40b5570 2020-10-31T22:44:41.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34c37fe700 1 -- 172.21.15.60:0/902724141 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34c40057d0 con 0x7f34d40b5570 2020-10-31T22:44:41.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.303+0000 7f34d359e700 1 -- 172.21.15.60:0/902724141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34d40aecb0 con 0x7f34d40b5570 2020-10-31T22:44:41.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.307+0000 7f34d359e700 1 -- 172.21.15.60:0/902724141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34d4057100 con 0x7f34d40b5570 2020-10-31T22:44:41.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.307+0000 7f34c37fe700 1 -- 172.21.15.60:0/902724141 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f34c4010070 con 0x7f34d40b5570 2020-10-31T22:44:41.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.307+0000 7f34c37fe700 1 --2- 172.21.15.60:0/902724141 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f34b0054f10 0x7f34b00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.307+0000 7f34c37fe700 1 -- 172.21.15.60:0/902724141 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f34c406d080 con 0x7f34d40b5570 2020-10-31T22:44:41.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.307+0000 7f34d259c700 1 --2- 172.21.15.60:0/902724141 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f34b0054f10 0x7f34b00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.307+0000 7f34d259c700 1 --2- 172.21.15.60:0/902724141 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f34b0054f10 0x7f34b00573d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f34c801a000 tx=0x7f34c8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:41.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.315+0000 7f34c37fe700 1 -- 172.21.15.60:0/902724141 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f34c4043500 con 0x7f34d40b5570 2020-10-31T22:44:41.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.507+0000 7f34d359e700 1 -- 172.21.15.60:0/902724141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f34d405a8e0 con 0x7f34d40b5570 2020-10-31T22:44:41.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.515+0000 7f34c37fe700 1 -- 172.21.15.60:0/902724141 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 9 and data pool 10 v21) v1 ==== 188+0+0 (secure 0 0 0) 0x7f34c4018020 con 0x7f34d40b5570 2020-10-31T22:44:41.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.519+0000 7f34d359e700 1 -- 172.21.15.60:0/902724141 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f34b0054f10 msgr2=0x7f34b00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.519+0000 7f34d359e700 1 --2- 172.21.15.60:0/902724141 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f34b0054f10 0x7f34b00573d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f34c801a000 tx=0x7f34c8015000).stop 2020-10-31T22:44:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.519+0000 7f34d359e700 1 -- 172.21.15.60:0/902724141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d40b5570 msgr2=0x7f34d4146190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.519+0000 7f34d359e700 1 --2- 172.21.15.60:0/902724141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d40b5570 0x7f34d4146190 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f34c40010d0 tx=0x7f34c4007a70).stop 2020-10-31T22:44:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.523+0000 7f34d359e700 1 -- 172.21.15.60:0/902724141 shutdown_connections 2020-10-31T22:44:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.523+0000 7f34d359e700 1 --2- 172.21.15.60:0/902724141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34d4141f00 0x7f34d4146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.523+0000 7f34d359e700 1 --2- 172.21.15.60:0/902724141 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f34b0054f10 0x7f34b00573d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.523+0000 7f34d359e700 1 --2- 172.21.15.60:0/902724141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34d40b24a0 0x7f34d41402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.523+0000 7f34d359e700 1 --2- 172.21.15.60:0/902724141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34d40b5570 0x7f34d4146190 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.523+0000 7f34d359e700 1 -- 172.21.15.60:0/902724141 >> 172.21.15.60:0/902724141 conn(0x7f34d40b8e90 msgr2=0x7f34d40b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:41.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.523+0000 7f34d359e700 1 -- 172.21.15.60:0/902724141 shutdown_connections 2020-10-31T22:44:41.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.527+0000 7f34d359e700 1 -- 172.21.15.60:0/902724141 wait complete. 2020-10-31T22:44:41.530 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 9 and data pool 10 2020-10-31T22:44:41.544 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:44:41.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 Processor -- start 2020-10-31T22:44:41.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 -- start start 2020-10-31T22:44:41.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcf80af520 0x7fbcf80ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbcf80670f0 0x7fbcf8150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf80af900 con 0x7fbcf8066c90 2020-10-31T22:44:41.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf80afc10 con 0x7fbcf80670f0 2020-10-31T22:44:41.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf805bb70 con 0x7fbcf80af520 2020-10-31T22:44:41.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfcd44700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbcf80670f0 0x7fbcf8150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfcd44700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbcf80670f0 0x7fbcf8150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43994/0 (socket says 172.21.15.60:43994) 2020-10-31T22:44:41.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfcd44700 1 -- 172.21.15.60:0/3098902979 learned_addr learned my addr 172.21.15.60:0/3098902979 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:41.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcf7fff700 1 --2- 172.21.15.60:0/3098902979 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcf80af520 0x7fbcf80ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfcd44700 1 -- 172.21.15.60:0/3098902979 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcf80af520 msgr2=0x7fbcf80ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:41.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfcd44700 1 --2- 172.21.15.60:0/3098902979 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcf80af520 0x7fbcf80ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfcd44700 1 -- 172.21.15.60:0/3098902979 >> v1:172.21.15.60:6789/0 conn(0x7fbcf8066c90 legacy=0x7fbcf8146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfcd44700 1 -- 172.21.15.60:0/3098902979 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf80ac130 con 0x7fbcf80670f0 2020-10-31T22:44:41.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcf7fff700 1 --2- 172.21.15.60:0/3098902979 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcf80af520 0x7fbcf80ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:44:41.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfcd44700 1 --2- 172.21.15.60:0/3098902979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcf80670f0 0x7fbcf8150980 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fbcf0002f30 tx=0x7fbcf0006e80).ready entity=mon.0 client_cookie=b93350bb4b2813dc server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:41.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcf6ffd700 1 -- 172.21.15.60:0/3098902979 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf00097f0 con 0x7fbcf80670f0 2020-10-31T22:44:41.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcf6ffd700 1 -- 172.21.15.60:0/3098902979 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf0009950 con 0x7fbcf80670f0 2020-10-31T22:44:41.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcf6ffd700 1 -- 172.21.15.60:0/3098902979 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcf0009cb0 con 0x7fbcf80670f0 2020-10-31T22:44:41.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 -- 172.21.15.60:0/3098902979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcf80670f0 msgr2=0x7fbcf8150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 --2- 172.21.15.60:0/3098902979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcf80670f0 0x7fbcf8150980 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7fbcf0002f30 tx=0x7fbcf0006e80).stop 2020-10-31T22:44:41.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 -- 172.21.15.60:0/3098902979 shutdown_connections 2020-10-31T22:44:41.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 --2- 172.21.15.60:0/3098902979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcf80670f0 0x7fbcf8150980 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 --2- 172.21.15.60:0/3098902979 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcf80af520 0x7fbcf80ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 -- 172.21.15.60:0/3098902979 >> 172.21.15.60:0/3098902979 conn(0x7fbcf80b3fd0 msgr2=0x7fbcf80b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:41.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 -- 172.21.15.60:0/3098902979 shutdown_connections 2020-10-31T22:44:41.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 -- 172.21.15.60:0/3098902979 wait complete. 2020-10-31T22:44:41.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 Processor -- start 2020-10-31T22:44:41.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.647+0000 7fbcfd545700 1 -- start start 2020-10-31T22:44:41.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcfd545700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcf8066c90 0x7fbcf8149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcfd545700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcf80670f0 0x7fbcf814ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcfd545700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcf80af520 0x7fbcf8154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcfd545700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf814a6a0 con 0x7fbcf8066c90 2020-10-31T22:44:41.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcfd545700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf8061960 con 0x7fbcf80670f0 2020-10-31T22:44:41.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcfd545700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf8148d00 con 0x7fbcf80af520 2020-10-31T22:44:41.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcf7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcf8066c90 0x7fbcf8149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcf7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcf8066c90 0x7fbcf8149e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:43998/0 (socket says 172.21.15.60:43998) 2020-10-31T22:44:41.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcf7fff700 1 -- 172.21.15.60:0/1356409352 learned_addr learned my addr 172.21.15.60:0/1356409352 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:41.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcfcd44700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcf80af520 0x7fbcf8154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcf77fe700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcf80670f0 0x7fbcf814ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcf7fff700 1 -- 172.21.15.60:0/1356409352 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcf80af520 msgr2=0x7fbcf8154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcf7fff700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcf80af520 0x7fbcf8154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcf7fff700 1 -- 172.21.15.60:0/1356409352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcf80670f0 msgr2=0x7fbcf814ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcf7fff700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcf80670f0 0x7fbcf814ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcf7fff700 1 -- 172.21.15.60:0/1356409352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf814a890 con 0x7fbcf8066c90 2020-10-31T22:44:41.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcfcd44700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcf80af520 0x7fbcf8154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:44:41.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcf77fe700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcf80670f0 0x7fbcf814ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:44:41.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcf7fff700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcf8066c90 0x7fbcf8149e90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fbcec007000 tx=0x7fbcec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:41.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcf57fa700 1 -- 172.21.15.60:0/1356409352 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcec007750 con 0x7fbcf8066c90 2020-10-31T22:44:41.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcfd545700 1 -- 172.21.15.60:0/1356409352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf8061620 con 0x7fbcf8066c90 2020-10-31T22:44:41.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcf57fa700 1 -- 172.21.15.60:0/1356409352 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcec0078b0 con 0x7fbcf8066c90 2020-10-31T22:44:41.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcf57fa700 1 -- 172.21.15.60:0/1356409352 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcec007c10 con 0x7fbcf8066c90 2020-10-31T22:44:41.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcfd545700 1 -- 172.21.15.60:0/1356409352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf8149070 con 0x7fbcf8066c90 2020-10-31T22:44:41.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.651+0000 7fbcfd545700 1 -- 172.21.15.60:0/1356409352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf8057100 con 0x7fbcf8066c90 2020-10-31T22:44:41.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.655+0000 7fbcf57fa700 1 -- 172.21.15.60:0/1356409352 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbcec007d70 con 0x7fbcf8066c90 2020-10-31T22:44:41.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.655+0000 7fbcf57fa700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbcd8054f90 0x7fbcd8057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.655+0000 7fbcf57fa700 1 -- 172.21.15.60:0/1356409352 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbcec06dd80 con 0x7fbcf8066c90 2020-10-31T22:44:41.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.655+0000 7fbcf77fe700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbcd8054f90 0x7fbcd8057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.655+0000 7fbcf77fe700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbcd8054f90 0x7fbcd8057450 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fbce800b000 tx=0x7fbce8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:41.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.663+0000 7fbcf57fa700 1 -- 172.21.15.60:0/1356409352 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbcec044110 con 0x7fbcf8066c90 2020-10-31T22:44:41.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.799+0000 7fbcfd545700 1 -- 172.21.15.60:0/1356409352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcf80afe20 con 0x7fbcf8066c90 2020-10-31T22:44:41.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.799+0000 7fbcf57fa700 1 -- 172.21.15.60:0/1356409352 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16053 (secure 0 0 0) 0x7fbcec069e60 con 0x7fbcf8066c90 2020-10-31T22:44:41.802 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:44:41.802 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:44:41.510309+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:44:39.101359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2020-10-31T22:44:40.356100+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:44:41.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.803+0000 7fbcfd545700 1 -- 172.21.15.60:0/1356409352 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbcd8054f90 msgr2=0x7fbcd8057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.803+0000 7fbcfd545700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbcd8054f90 0x7fbcd8057450 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7fbce800b000 tx=0x7fbce8009040).stop 2020-10-31T22:44:41.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.803+0000 7fbcfd545700 1 -- 172.21.15.60:0/1356409352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcf8066c90 msgr2=0x7fbcf8149e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.803+0000 7fbcfd545700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcf8066c90 0x7fbcf8149e90 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fbcec007000 tx=0x7fbcec008040).stop 2020-10-31T22:44:41.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.803+0000 7fbcfd545700 1 -- 172.21.15.60:0/1356409352 shutdown_connections 2020-10-31T22:44:41.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.803+0000 7fbcfd545700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbcf80af520 0x7fbcf8154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.803+0000 7fbcfd545700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbcf8066c90 0x7fbcf8149e90 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.803+0000 7fbcfd545700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbcd8054f90 0x7fbcd8057450 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.803+0000 7fbcfd545700 1 --2- 172.21.15.60:0/1356409352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbcf80670f0 0x7fbcf814ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.803+0000 7fbcfd545700 1 -- 172.21.15.60:0/1356409352 >> 172.21.15.60:0/1356409352 conn(0x7fbcf80b3fd0 msgr2=0x7fbcf80a9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:41.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.803+0000 7fbcfd545700 1 -- 172.21.15.60:0/1356409352 shutdown_connections 2020-10-31T22:44:41.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.803+0000 7fbcfd545700 1 -- 172.21.15.60:0/1356409352 wait complete. 2020-10-31T22:44:41.818 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:44:41.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24e34e700 1 Processor -- start 2020-10-31T22:44:41.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24e34e700 1 -- start start 2020-10-31T22:44:41.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24e34e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa248063140 0x7fa2480b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24e34e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa2480b1000 0x7fa2481452b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24e34e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa248063520 con 0x7fa2480b2820 2020-10-31T22:44:41.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24e34e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2480b2060 con 0x7fa248063140 2020-10-31T22:44:41.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24e34e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2480b02e0 con 0x7fa2480b1000 2020-10-31T22:44:41.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24d34c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa248063140 0x7fa2480b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24d34c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa248063140 0x7fa2480b09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44004/0 (socket says 172.21.15.60:44004) 2020-10-31T22:44:41.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24d34c700 1 -- 172.21.15.60:0/568535206 learned_addr learned my addr 172.21.15.60:0/568535206 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:41.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24cb4b700 1 --2- 172.21.15.60:0/568535206 >> v2:172.21.15.66:3300/0 conn(0x7fa2480b1000 0x7fa2481452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24d34c700 1 -- 172.21.15.60:0/568535206 >> v2:172.21.15.66:3300/0 conn(0x7fa2480b1000 msgr2=0x7fa2481452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:41.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24d34c700 1 --2- 172.21.15.60:0/568535206 >> v2:172.21.15.66:3300/0 conn(0x7fa2480b1000 0x7fa2481452b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24d34c700 1 -- 172.21.15.60:0/568535206 >> v1:172.21.15.66:6789/0 conn(0x7fa2480b2820 legacy=0x7fa2480aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24d34c700 1 -- 172.21.15.60:0/568535206 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2480b1dc0 con 0x7fa248063140 2020-10-31T22:44:41.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24cb4b700 1 --2- 172.21.15.60:0/568535206 >> v2:172.21.15.66:3300/0 conn(0x7fa2480b1000 0x7fa2481452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:44:41.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24d34c700 1 --2- 172.21.15.60:0/568535206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa248063140 0x7fa2480b09e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fa2380032b0 tx=0x7fa238009270).ready entity=mon.0 client_cookie=c11b34493da1ceab server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:41.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa247fff700 1 -- 172.21.15.60:0/568535206 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa23800bc90 con 0x7fa248063140 2020-10-31T22:44:41.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa247fff700 1 -- 172.21.15.60:0/568535206 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23800bdf0 con 0x7fa248063140 2020-10-31T22:44:41.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa247fff700 1 -- 172.21.15.60:0/568535206 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa238011400 con 0x7fa248063140 2020-10-31T22:44:41.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24e34e700 1 -- 172.21.15.60:0/568535206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa248063140 msgr2=0x7fa2480b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.931+0000 7fa24e34e700 1 --2- 172.21.15.60:0/568535206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa248063140 0x7fa2480b09e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7fa2380032b0 tx=0x7fa238009270).stop 2020-10-31T22:44:41.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.935+0000 7fa24e34e700 1 -- 172.21.15.60:0/568535206 shutdown_connections 2020-10-31T22:44:41.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.935+0000 7fa24e34e700 1 --2- 172.21.15.60:0/568535206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa248063140 0x7fa2480b09e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.935+0000 7fa24e34e700 1 --2- 172.21.15.60:0/568535206 >> v2:172.21.15.66:3300/0 conn(0x7fa2480b1000 0x7fa2481452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.935+0000 7fa24e34e700 1 -- 172.21.15.60:0/568535206 >> 172.21.15.60:0/568535206 conn(0x7fa24806a600 msgr2=0x7fa248060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:41.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.935+0000 7fa24e34e700 1 -- 172.21.15.60:0/568535206 shutdown_connections 2020-10-31T22:44:41.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.935+0000 7fa24e34e700 1 -- 172.21.15.60:0/568535206 wait complete. 2020-10-31T22:44:41.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.935+0000 7fa24e34e700 1 Processor -- start 2020-10-31T22:44:41.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.935+0000 7fa24e34e700 1 -- start start 2020-10-31T22:44:41.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.935+0000 7fa24e34e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa248063140 0x7fa2481435d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24e34e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2480b1000 0x7fa248063fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24e34e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2480b2820 0x7fa2480ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24e34e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480abba0 con 0x7fa2480b1000 2020-10-31T22:44:41.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24e34e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480abdc0 con 0x7fa2480b2820 2020-10-31T22:44:41.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24e34e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa248063860 con 0x7fa248063140 2020-10-31T22:44:41.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24cb4b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2480b1000 0x7fa248063fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24d34c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa248063140 0x7fa2481435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24cb4b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2480b1000 0x7fa248063fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44012/0 (socket says 172.21.15.60:44012) 2020-10-31T22:44:41.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24cb4b700 1 -- 172.21.15.60:0/3620615348 learned_addr learned my addr 172.21.15.60:0/3620615348 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:41.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24db4d700 1 --2- 172.21.15.60:0/3620615348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2480b2820 0x7fa2480ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24cb4b700 1 -- 172.21.15.60:0/3620615348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa248063140 msgr2=0x7fa2481435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24cb4b700 1 --2- 172.21.15.60:0/3620615348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa248063140 0x7fa2481435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24cb4b700 1 -- 172.21.15.60:0/3620615348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2480b2820 msgr2=0x7fa2480ab6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:41.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24cb4b700 1 --2- 172.21.15.60:0/3620615348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2480b2820 0x7fa2480ab6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:41.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24cb4b700 1 -- 172.21.15.60:0/3620615348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa248063b00 con 0x7fa2480b1000 2020-10-31T22:44:41.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24cb4b700 1 --2- 172.21.15.60:0/3620615348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2480b1000 0x7fa248063fa0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fa23c006910 tx=0x7fa23c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:41.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa2467fc700 1 -- 172.21.15.60:0/3620615348 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa23c009980 con 0x7fa2480b1000 2020-10-31T22:44:41.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa2467fc700 1 -- 172.21.15.60:0/3620615348 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa23c009ae0 con 0x7fa2480b1000 2020-10-31T22:44:41.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24e34e700 1 -- 172.21.15.60:0/3620615348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2480b42b0 con 0x7fa2480b1000 2020-10-31T22:44:41.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa2467fc700 1 -- 172.21.15.60:0/3620615348 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa23c009e40 con 0x7fa2480b1000 2020-10-31T22:44:41.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24e34e700 1 -- 172.21.15.60:0/3620615348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2480b47b0 con 0x7fa2480b1000 2020-10-31T22:44:41.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa24e34e700 1 -- 172.21.15.60:0/3620615348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa248063c90 con 0x7fa2480b1000 2020-10-31T22:44:41.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.939+0000 7fa2467fc700 1 -- 172.21.15.60:0/3620615348 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa23c013480 con 0x7fa2480b1000 2020-10-31T22:44:41.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.943+0000 7fa2467fc700 1 --2- 172.21.15.60:0/3620615348 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa228055020 0x7fa2280574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:41.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.943+0000 7fa2467fc700 1 -- 172.21.15.60:0/3620615348 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa23c06dfb0 con 0x7fa2480b1000 2020-10-31T22:44:41.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.943+0000 7fa24d34c700 1 --2- 172.21.15.60:0/3620615348 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa228055020 0x7fa2280574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:41.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.943+0000 7fa24d34c700 1 --2- 172.21.15.60:0/3620615348 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa228055020 0x7fa2280574e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fa23801a000 tx=0x7fa238016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:41.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:41.947+0000 7fa2467fc700 1 -- 172.21.15.60:0/3620615348 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa23c044470 con 0x7fa2480b1000 2020-10-31T22:44:42.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.091+0000 7fa24e34e700 1 -- 172.21.15.60:0/3620615348 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2480abf30 con 0x7fa2480b1000 2020-10-31T22:44:42.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.091+0000 7fa2467fc700 1 -- 172.21.15.60:0/3620615348 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16053 (secure 0 0 0) 0x7fa23c047a90 con 0x7fa2480b1000 2020-10-31T22:44:42.094 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:44:42.094 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:44:41.510309+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:44:39.101359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2020-10-31T22:44:40.356100+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:44:42.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.095+0000 7fa24e34e700 1 -- 172.21.15.60:0/3620615348 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa228055020 msgr2=0x7fa2280574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.095+0000 7fa24e34e700 1 --2- 172.21.15.60:0/3620615348 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa228055020 0x7fa2280574e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fa23801a000 tx=0x7fa238016000).stop 2020-10-31T22:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.095+0000 7fa24e34e700 1 -- 172.21.15.60:0/3620615348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2480b1000 msgr2=0x7fa248063fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:42.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.095+0000 7fa24e34e700 1 --2- 172.21.15.60:0/3620615348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2480b1000 0x7fa248063fa0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7fa23c006910 tx=0x7fa23c008040).stop 2020-10-31T22:44:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.095+0000 7fa24e34e700 1 -- 172.21.15.60:0/3620615348 shutdown_connections 2020-10-31T22:44:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.095+0000 7fa24e34e700 1 --2- 172.21.15.60:0/3620615348 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa228055020 0x7fa2280574e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.095+0000 7fa24e34e700 1 --2- 172.21.15.60:0/3620615348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2480b2820 0x7fa2480ab6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:42.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.095+0000 7fa24e34e700 1 --2- 172.21.15.60:0/3620615348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa248063140 0x7fa2481435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:42.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.095+0000 7fa24e34e700 1 --2- 172.21.15.60:0/3620615348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2480b1000 0x7fa248063fa0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:42.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.095+0000 7fa24e34e700 1 -- 172.21.15.60:0/3620615348 >> 172.21.15.60:0/3620615348 conn(0x7fa24806a600 msgr2=0x7fa248144fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:42.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.095+0000 7fa24e34e700 1 -- 172.21.15.60:0/3620615348 shutdown_connections 2020-10-31T22:44:42.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.095+0000 7fa24e34e700 1 -- 172.21.15.60:0/3620615348 wait complete. 2020-10-31T22:44:42.109 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-10-31T22:44:42.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a07fff700 1 Processor -- start 2020-10-31T22:44:42.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a07fff700 1 -- start start 2020-10-31T22:44:42.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a07fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8a0805b320 0x7f8a080b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:42.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a07fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8a080ad610 0x7f8a080ada80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:42.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a07fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0805b700 con 0x7f8a080acc60 2020-10-31T22:44:42.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a07fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a08140750 con 0x7f8a0805b320 2020-10-31T22:44:42.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a07fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a080b0340 con 0x7f8a080ad610 2020-10-31T22:44:42.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a067fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8a080acc60 0x7f8a080b22a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48154/0 (socket says 172.21.15.60:48154) 2020-10-31T22:44:42.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a06ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8a0805b320 0x7f8a080b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:42.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a067fc700 1 -- 172.21.15.60:0/1454489962 learned_addr learned my addr 172.21.15.60:0/1454489962 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:42.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a077fe700 1 --2- 172.21.15.60:0/1454489962 >> v2:172.21.15.66:3300/0 conn(0x7f8a080ad610 0x7f8a080ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:42.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a05ffb700 1 -- 172.21.15.60:0/1454489962 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272816695 0 0) 0x7f8a0805b700 con 0x7f8a080acc60 2020-10-31T22:44:42.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a05ffb700 1 -- 172.21.15.60:0/1454489962 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89ec003230 con 0x7f8a080acc60 2020-10-31T22:44:42.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a06ffd700 1 -- 172.21.15.60:0/1454489962 >> v2:172.21.15.66:3300/0 conn(0x7f8a080ad610 msgr2=0x7f8a080ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:42.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a06ffd700 1 --2- 172.21.15.60:0/1454489962 >> v2:172.21.15.66:3300/0 conn(0x7f8a080ad610 0x7f8a080ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:42.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a06ffd700 1 -- 172.21.15.60:0/1454489962 >> v1:172.21.15.60:6789/0 conn(0x7f8a080acc60 legacy=0x7f8a080b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:42.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a05ffb700 1 -- 172.21.15.60:0/1454489962 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3799695696 0 0) 0x7f89ec003230 con 0x7f8a080acc60 2020-10-31T22:44:42.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.227+0000 7f8a06ffd700 1 -- 172.21.15.60:0/1454489962 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a080b05e0 con 0x7f8a0805b320 2020-10-31T22:44:42.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.231+0000 7f8a06ffd700 1 --2- 172.21.15.60:0/1454489962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a0805b320 0x7f8a080b1db0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f89fc001870 tx=0x7f89f8006dc0).ready entity=mon.0 client_cookie=dc35b2af21f8e79a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:42.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.231+0000 7f8a05ffb700 1 -- 172.21.15.60:0/1454489962 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89fc0016d0 con 0x7f8a0805b320 2020-10-31T22:44:42.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.231+0000 7f8a05ffb700 1 -- 172.21.15.60:0/1454489962 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f800d5c0 con 0x7f8a0805b320 2020-10-31T22:44:42.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.231+0000 7f8a05ffb700 1 -- 172.21.15.60:0/1454489962 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89f800d730 con 0x7f8a0805b320 2020-10-31T22:44:42.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.231+0000 7f8a07fff700 1 -- 172.21.15.60:0/1454489962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a0805b320 msgr2=0x7f8a080b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:42.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.231+0000 7f8a07fff700 1 --2- 172.21.15.60:0/1454489962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a0805b320 0x7f8a080b1db0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f89fc001870 tx=0x7f89f8006dc0).stop 2020-10-31T22:44:42.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.231+0000 7f8a07fff700 1 -- 172.21.15.60:0/1454489962 shutdown_connections 2020-10-31T22:44:42.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.231+0000 7f8a07fff700 1 --2- 172.21.15.60:0/1454489962 >> v2:172.21.15.66:3300/0 conn(0x7f8a080ad610 0x7f8a080ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:42.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.231+0000 7f8a07fff700 1 --2- 172.21.15.60:0/1454489962 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a0805b320 0x7f8a080b1db0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:42.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.231+0000 7f8a07fff700 1 -- 172.21.15.60:0/1454489962 >> 172.21.15.60:0/1454489962 conn(0x7f8a080b61d0 msgr2=0x7f8a080b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:42.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.231+0000 7f8a07fff700 1 -- 172.21.15.60:0/1454489962 shutdown_connections 2020-10-31T22:44:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.231+0000 7f8a07fff700 1 -- 172.21.15.60:0/1454489962 wait complete. 2020-10-31T22:44:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.231+0000 7f8a07fff700 1 Processor -- start 2020-10-31T22:44:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.231+0000 7f8a07fff700 1 -- start start 2020-10-31T22:44:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a07fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a0805b320 0x7f8a0813c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a07fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080acc60 0x7f8a0805f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:42.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a07fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a080ad610 0x7f8a0805f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:42.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a07fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08061230 con 0x7f8a080acc60 2020-10-31T22:44:42.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a07fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0805fda0 con 0x7f8a080ad610 2020-10-31T22:44:42.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a07fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a08146ea0 con 0x7f8a0805b320 2020-10-31T22:44:42.256 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a067fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080acc60 0x7f8a0805f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:42.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a067fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080acc60 0x7f8a0805f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44026/0 (socket says 172.21.15.60:44026) 2020-10-31T22:44:42.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a067fc700 1 -- 172.21.15.60:0/3984099700 learned_addr learned my addr 172.21.15.60:0/3984099700 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:42.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a06ffd700 1 --2- 172.21.15.60:0/3984099700 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a0805b320 0x7f8a0813c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:42.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a077fe700 1 --2- 172.21.15.60:0/3984099700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a080ad610 0x7f8a0805f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a067fc700 1 -- 172.21.15.60:0/3984099700 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a0805b320 msgr2=0x7f8a0813c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a067fc700 1 --2- 172.21.15.60:0/3984099700 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a0805b320 0x7f8a0813c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a067fc700 1 -- 172.21.15.60:0/3984099700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a080ad610 msgr2=0x7f8a0805f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a067fc700 1 --2- 172.21.15.60:0/3984099700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a080ad610 0x7f8a0805f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a067fc700 1 -- 172.21.15.60:0/3984099700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a08153f70 con 0x7f8a080acc60 2020-10-31T22:44:42.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a067fc700 1 --2- 172.21.15.60:0/3984099700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080acc60 0x7f8a0805f3c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f8a0805fee0 tx=0x7f89fc001280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:42.261 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f89f7fff700 1 -- 172.21.15.60:0/3984099700 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89fc007170 con 0x7f8a080acc60 2020-10-31T22:44:42.261 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f89f7fff700 1 -- 172.21.15.60:0/3984099700 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc0072d0 con 0x7f8a080acc60 2020-10-31T22:44:42.261 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a07fff700 1 -- 172.21.15.60:0/3984099700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a08154210 con 0x7f8a080acc60 2020-10-31T22:44:42.261 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f89f7fff700 1 -- 172.21.15.60:0/3984099700 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89fc0048f0 con 0x7f8a080acc60 2020-10-31T22:44:42.261 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a07fff700 1 -- 172.21.15.60:0/3984099700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a08064870 con 0x7f8a080acc60 2020-10-31T22:44:42.261 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.235+0000 7f8a07fff700 1 -- 172.21.15.60:0/3984099700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a081543a0 con 0x7f8a080acc60 2020-10-31T22:44:42.261 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.239+0000 7f89f7fff700 1 -- 172.21.15.60:0/3984099700 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f89fc01b070 con 0x7f8a080acc60 2020-10-31T22:44:42.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.239+0000 7f89f7fff700 1 --2- 172.21.15.60:0/3984099700 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f89e4054f10 0x7f89e40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:42.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.239+0000 7f89f7fff700 1 -- 172.21.15.60:0/3984099700 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f89fc06d770 con 0x7f8a080acc60 2020-10-31T22:44:42.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.239+0000 7f8a06ffd700 1 --2- 172.21.15.60:0/3984099700 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f89e4054f10 0x7f89e40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:42.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.239+0000 7f8a06ffd700 1 --2- 172.21.15.60:0/3984099700 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f89e4054f10 0x7f89e40573d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f89f801a000 tx=0x7f89f8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:42.262 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.243+0000 7f89f7fff700 1 -- 172.21.15.60:0/3984099700 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f89fc042df0 con 0x7f8a080acc60 2020-10-31T22:44:42.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:42.431+0000 7f8a07fff700 1 -- 172.21.15.60:0/3984099700 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8a08057100 con 0x7f8a080acc60 2020-10-31T22:44:43.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.019+0000 7f89f7fff700 1 -- 172.21.15.60:0/3984099700 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f89fc022020 con 0x7f8a080acc60 2020-10-31T22:44:43.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.023+0000 7f8a07fff700 1 -- 172.21.15.60:0/3984099700 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f89e4054f10 msgr2=0x7f89e40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.023+0000 7f8a07fff700 1 --2- 172.21.15.60:0/3984099700 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f89e4054f10 0x7f89e40573d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f89f801a000 tx=0x7f89f8015000).stop 2020-10-31T22:44:43.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.023+0000 7f8a07fff700 1 -- 172.21.15.60:0/3984099700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080acc60 msgr2=0x7f8a0805f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.023+0000 7f8a07fff700 1 --2- 172.21.15.60:0/3984099700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080acc60 0x7f8a0805f3c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f8a0805fee0 tx=0x7f89fc001280).stop 2020-10-31T22:44:43.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.023+0000 7f8a07fff700 1 -- 172.21.15.60:0/3984099700 shutdown_connections 2020-10-31T22:44:43.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.023+0000 7f8a07fff700 1 --2- 172.21.15.60:0/3984099700 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f89e4054f10 0x7f89e40573d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.023+0000 7f8a07fff700 1 --2- 172.21.15.60:0/3984099700 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a080ad610 0x7f8a0805f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.023+0000 7f8a07fff700 1 --2- 172.21.15.60:0/3984099700 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a0805b320 0x7f8a0813c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.023+0000 7f8a07fff700 1 --2- 172.21.15.60:0/3984099700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080acc60 0x7f8a0805f3c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.023+0000 7f8a07fff700 1 -- 172.21.15.60:0/3984099700 >> 172.21.15.60:0/3984099700 conn(0x7f8a080b61d0 msgr2=0x7f8a0813e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:43.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.023+0000 7f8a07fff700 1 -- 172.21.15.60:0/3984099700 shutdown_connections 2020-10-31T22:44:43.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.027+0000 7f8a07fff700 1 -- 172.21.15.60:0/3984099700 wait complete. 2020-10-31T22:44:43.045 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:44:43.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.159+0000 7f35cb59e700 1 Processor -- start 2020-10-31T22:44:43.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.159+0000 7f35cb59e700 1 -- start start 2020-10-31T22:44:43.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35cb59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35cc0b24a0 0x7f35cc0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35cb59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35cc141fe0 0x7f35cc142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35cb59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35cc145180 con 0x7f35cc0b5570 2020-10-31T22:44:43.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35cb59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35cc0afae0 con 0x7f35cc0b24a0 2020-10-31T22:44:43.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35cb59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc141bf0 con 0x7f35cc141fe0 2020-10-31T22:44:43.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35c1d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35cc0b24a0 0x7f35cc0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35c1d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f35cc0b24a0 0x7f35cc0b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44034/0 (socket says 172.21.15.60:44034) 2020-10-31T22:44:43.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35c1d9b700 1 -- 172.21.15.60:0/4228547177 learned_addr learned my addr 172.21.15.60:0/4228547177 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:43.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35cad9d700 1 --2- 172.21.15.60:0/4228547177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35cc141fe0 0x7f35cc142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35c1d9b700 1 -- 172.21.15.60:0/4228547177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35cc141fe0 msgr2=0x7f35cc142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:43.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35c1d9b700 1 --2- 172.21.15.60:0/4228547177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35cc141fe0 0x7f35cc142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35c1d9b700 1 -- 172.21.15.60:0/4228547177 >> v1:172.21.15.66:6789/0 conn(0x7f35cc0b5570 legacy=0x7f35cc145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35c1d9b700 1 -- 172.21.15.60:0/4228547177 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc0b0670 con 0x7f35cc0b24a0 2020-10-31T22:44:43.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35c1d9b700 1 --2- 172.21.15.60:0/4228547177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc0b24a0 0x7f35cc0b5950 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f35cc05f580 tx=0x7f35b4006e80).ready entity=mon.0 client_cookie=9f8c8a0f0948462f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:43.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35c9d9b700 1 -- 172.21.15.60:0/4228547177 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b40097b0 con 0x7f35cc0b24a0 2020-10-31T22:44:43.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35c9d9b700 1 -- 172.21.15.60:0/4228547177 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35b4009910 con 0x7f35cc0b24a0 2020-10-31T22:44:43.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35c9d9b700 1 -- 172.21.15.60:0/4228547177 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35b4009c70 con 0x7f35cc0b24a0 2020-10-31T22:44:43.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35cb59e700 1 -- 172.21.15.60:0/4228547177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc0b24a0 msgr2=0x7f35cc0b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35cb59e700 1 --2- 172.21.15.60:0/4228547177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc0b24a0 0x7f35cc0b5950 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f35cc05f580 tx=0x7f35b4006e80).stop 2020-10-31T22:44:43.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35cb59e700 1 -- 172.21.15.60:0/4228547177 shutdown_connections 2020-10-31T22:44:43.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35cb59e700 1 --2- 172.21.15.60:0/4228547177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35cc141fe0 0x7f35cc142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35cb59e700 1 --2- 172.21.15.60:0/4228547177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc0b24a0 0x7f35cc0b5950 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35cb59e700 1 -- 172.21.15.60:0/4228547177 >> 172.21.15.60:0/4228547177 conn(0x7f35cc0b8e90 msgr2=0x7f35cc0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:43.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35cb59e700 1 -- 172.21.15.60:0/4228547177 shutdown_connections 2020-10-31T22:44:43.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.163+0000 7f35cb59e700 1 -- 172.21.15.60:0/4228547177 wait complete. 2020-10-31T22:44:43.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.167+0000 7f35cb59e700 1 Processor -- start 2020-10-31T22:44:43.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.167+0000 7f35cb59e700 1 -- start start 2020-10-31T22:44:43.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.167+0000 7f35cb59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35cc0b24a0 0x7f35cc13fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.167+0000 7f35cb59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35cc0b5570 0x7f35cc13d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.167+0000 7f35cb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc141fe0 0x7f35cc1447f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.167+0000 7f35cb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc143e50 con 0x7f35cc141fe0 2020-10-31T22:44:43.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.167+0000 7f35cb59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc1440b0 con 0x7f35cc0b5570 2020-10-31T22:44:43.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.167+0000 7f35cb59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35cc144350 con 0x7f35cc0b24a0 2020-10-31T22:44:43.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.167+0000 7f35cad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc141fe0 0x7f35cc1447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.167+0000 7f35cad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc141fe0 0x7f35cc1447f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44042/0 (socket says 172.21.15.60:44042) 2020-10-31T22:44:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.167+0000 7f35cad9d700 1 -- 172.21.15.60:0/9229983 learned_addr learned my addr 172.21.15.60:0/9229983 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.167+0000 7f35ca59c700 1 --2- 172.21.15.60:0/9229983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35cc0b24a0 0x7f35cc13fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.167+0000 7f35c1d9b700 1 --2- 172.21.15.60:0/9229983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35cc0b5570 0x7f35cc13d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.171+0000 7f35cad9d700 1 -- 172.21.15.60:0/9229983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35cc0b24a0 msgr2=0x7f35cc13fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.171+0000 7f35cad9d700 1 --2- 172.21.15.60:0/9229983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35cc0b24a0 0x7f35cc13fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.171+0000 7f35cad9d700 1 -- 172.21.15.60:0/9229983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35cc0b5570 msgr2=0x7f35cc13d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.171+0000 7f35cad9d700 1 --2- 172.21.15.60:0/9229983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35cc0b5570 0x7f35cc13d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.171+0000 7f35cad9d700 1 -- 172.21.15.60:0/9229983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35cc154e90 con 0x7f35cc141fe0 2020-10-31T22:44:43.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.171+0000 7f35cad9d700 1 --2- 172.21.15.60:0/9229983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc141fe0 0x7f35cc1447f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f35c4006dd0 tx=0x7f35c40091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:43.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.171+0000 7f35c3fff700 1 -- 172.21.15.60:0/9229983 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35c400c950 con 0x7f35cc141fe0 2020-10-31T22:44:43.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.171+0000 7f35c3fff700 1 -- 172.21.15.60:0/9229983 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c400cab0 con 0x7f35cc141fe0 2020-10-31T22:44:43.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.171+0000 7f35cb59e700 1 -- 172.21.15.60:0/9229983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35cc13d200 con 0x7f35cc141fe0 2020-10-31T22:44:43.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.171+0000 7f35c3fff700 1 -- 172.21.15.60:0/9229983 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35c400ce10 con 0x7f35cc141fe0 2020-10-31T22:44:43.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.171+0000 7f35cb59e700 1 -- 172.21.15.60:0/9229983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35cc144e80 con 0x7f35cc141fe0 2020-10-31T22:44:43.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.171+0000 7f35cb59e700 1 -- 172.21.15.60:0/9229983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35cc144510 con 0x7f35cc141fe0 2020-10-31T22:44:43.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.171+0000 7f35c3fff700 1 -- 172.21.15.60:0/9229983 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f35c4022070 con 0x7f35cc141fe0 2020-10-31T22:44:43.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.175+0000 7f35c3fff700 1 --2- 172.21.15.60:0/9229983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35b0055020 0x7f35b00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.175+0000 7f35ca59c700 1 --2- 172.21.15.60:0/9229983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35b0055020 0x7f35b00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.175+0000 7f35c3fff700 1 -- 172.21.15.60:0/9229983 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f35c406dff0 con 0x7f35cc141fe0 2020-10-31T22:44:43.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.175+0000 7f35ca59c700 1 --2- 172.21.15.60:0/9229983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35b0055020 0x7f35b00574e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f35bc00d000 tx=0x7f35bc000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:43.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.183+0000 7f35c3fff700 1 -- 172.21.15.60:0/9229983 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f35c4044510 con 0x7f35cc141fe0 2020-10-31T22:44:43.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.371+0000 7f35cb59e700 1 -- 172.21.15.60:0/9229983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35cc057100 con 0x7f35cc141fe0 2020-10-31T22:44:43.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.371+0000 7f35c3fff700 1 -- 172.21.15.60:0/9229983 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f35c4016070 con 0x7f35cc141fe0 2020-10-31T22:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:44:43.372 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5180,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3826848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3826848450},{"type":"v1","addr":"172.21.15.66:6833","nonce":3826848450}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5544,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/821344830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":821344830},{"type":"v1","addr":"172.21.15.60:6835","nonce":821344830}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:44:41.510512+0000","modified":"2020-10-31T22:44:43.018399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/798359639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":798359639},{"type":"v1","addr":"172.21.15.60:6837","nonce":798359639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-10-31T22:44:43.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.371+0000 7f35cb59e700 1 -- 172.21.15.60:0/9229983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35b0055020 msgr2=0x7f35b00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.371+0000 7f35cb59e700 1 --2- 172.21.15.60:0/9229983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35b0055020 0x7f35b00574e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f35bc00d000 tx=0x7f35bc000b80).stop 2020-10-31T22:44:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.371+0000 7f35cb59e700 1 -- 172.21.15.60:0/9229983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc141fe0 msgr2=0x7f35cc1447f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.371+0000 7f35cb59e700 1 --2- 172.21.15.60:0/9229983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc141fe0 0x7f35cc1447f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7f35c4006dd0 tx=0x7f35c40091a0).stop 2020-10-31T22:44:43.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.371+0000 7f35cb59e700 1 -- 172.21.15.60:0/9229983 shutdown_connections 2020-10-31T22:44:43.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.371+0000 7f35cb59e700 1 --2- 172.21.15.60:0/9229983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35cc141fe0 0x7f35cc1447f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.371+0000 7f35cb59e700 1 --2- 172.21.15.60:0/9229983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35cc0b24a0 0x7f35cc13fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.371+0000 7f35cb59e700 1 --2- 172.21.15.60:0/9229983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35b0055020 0x7f35b00574e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.371+0000 7f35cb59e700 1 --2- 172.21.15.60:0/9229983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35cc0b5570 0x7f35cc13d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.371+0000 7f35cb59e700 1 -- 172.21.15.60:0/9229983 >> 172.21.15.60:0/9229983 conn(0x7f35cc0b8e90 msgr2=0x7f35cc0b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.371+0000 7f35cb59e700 1 -- 172.21.15.60:0/9229983 shutdown_connections 2020-10-31T22:44:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.371+0000 7f35cb59e700 1 -- 172.21.15.60:0/9229983 wait complete. 2020-10-31T22:44:43.375 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 23 2020-10-31T22:44:43.385 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:44:43.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.495+0000 7f3c3359e700 1 Processor -- start 2020-10-31T22:44:43.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.495+0000 7f3c3359e700 1 -- start start 2020-10-31T22:44:43.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c3359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c3413ebe0 0x7f3c34142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c3359e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3c340af200 0x7f3c340b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c3359e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c340abea0 con 0x7f3c340b1a10 2020-10-31T22:44:43.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c3359e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c34141870 con 0x7f3c340af200 2020-10-31T22:44:43.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c3359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c34141b10 con 0x7f3c3413ebe0 2020-10-31T22:44:43.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c3259c700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f3c340b1a10 0x7f3c340afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:46050/0 (socket says 172.21.15.60:46050) 2020-10-31T22:44:43.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c3259c700 1 -- 172.21.15.60:0/1136648778 learned_addr learned my addr 172.21.15.60:0/1136648778 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:43.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c32d9d700 1 --2- 172.21.15.60:0/1136648778 >> v2:172.21.15.66:3300/0 conn(0x7f3c340af200 0x7f3c340b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c31d9b700 1 --2- 172.21.15.60:0/1136648778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c3413ebe0 0x7f3c34142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c32d9d700 1 -- 172.21.15.60:0/1136648778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c3413ebe0 msgr2=0x7f3c34142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c32d9d700 1 --2- 172.21.15.60:0/1136648778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c3413ebe0 0x7f3c34142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c32d9d700 1 -- 172.21.15.60:0/1136648778 >> v1:172.21.15.66:6789/0 conn(0x7f3c340b1a10 legacy=0x7f3c340afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c32d9d700 1 -- 172.21.15.60:0/1136648778 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c34141db0 con 0x7f3c340af200 2020-10-31T22:44:43.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c32d9d700 1 --2- 172.21.15.60:0/1136648778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c340af200 0x7f3c340b1df0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f3c2c0032b0 tx=0x7f3c2c0091a0).ready entity=mon.1 client_cookie=e915e835162bff8b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:43.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c3159a700 1 -- 172.21.15.60:0/1136648778 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c2c00b9a0 con 0x7f3c340af200 2020-10-31T22:44:43.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c3159a700 1 -- 172.21.15.60:0/1136648778 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c00bb00 con 0x7f3c340af200 2020-10-31T22:44:43.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c3359e700 1 -- 172.21.15.60:0/1136648778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c340af200 msgr2=0x7f3c340b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c3159a700 1 -- 172.21.15.60:0/1136648778 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c2c00bc70 con 0x7f3c340af200 2020-10-31T22:44:43.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.499+0000 7f3c3359e700 1 --2- 172.21.15.60:0/1136648778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c340af200 0x7f3c340b1df0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f3c2c0032b0 tx=0x7f3c2c0091a0).stop 2020-10-31T22:44:43.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.503+0000 7f3c3359e700 1 -- 172.21.15.60:0/1136648778 shutdown_connections 2020-10-31T22:44:43.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.503+0000 7f3c3359e700 1 --2- 172.21.15.60:0/1136648778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c340af200 0x7f3c340b1df0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.503+0000 7f3c3359e700 1 --2- 172.21.15.60:0/1136648778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c3413ebe0 0x7f3c34142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.503+0000 7f3c3359e700 1 -- 172.21.15.60:0/1136648778 >> 172.21.15.60:0/1136648778 conn(0x7f3c340b5300 msgr2=0x7f3c340b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:43.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.503+0000 7f3c3359e700 1 -- 172.21.15.60:0/1136648778 shutdown_connections 2020-10-31T22:44:43.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.503+0000 7f3c3359e700 1 -- 172.21.15.60:0/1136648778 wait complete. 2020-10-31T22:44:43.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.503+0000 7f3c3359e700 1 Processor -- start 2020-10-31T22:44:43.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.503+0000 7f3c3359e700 1 -- start start 2020-10-31T22:44:43.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.503+0000 7f3c3359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c340af200 0x7f3c34064500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c3359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c340b1a10 0x7f3c3413a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c3359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c3413ebe0 0x7f3c3413aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c3359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c340ada40 con 0x7f3c3413ebe0 2020-10-31T22:44:43.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c3359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c340adce0 con 0x7f3c340b1a10 2020-10-31T22:44:43.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c3359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c340adf80 con 0x7f3c340af200 2020-10-31T22:44:43.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c32d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c3413ebe0 0x7f3c3413aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c32d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c3413ebe0 0x7f3c3413aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44056/0 (socket says 172.21.15.60:44056) 2020-10-31T22:44:43.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c32d9d700 1 -- 172.21.15.60:0/1266261299 learned_addr learned my addr 172.21.15.60:0/1266261299 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:43.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c3259c700 1 --2- 172.21.15.60:0/1266261299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c340af200 0x7f3c34064500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c31d9b700 1 --2- 172.21.15.60:0/1266261299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c340b1a10 0x7f3c3413a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c32d9d700 1 -- 172.21.15.60:0/1266261299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c340af200 msgr2=0x7f3c34064500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c32d9d700 1 --2- 172.21.15.60:0/1266261299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c340af200 0x7f3c34064500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c32d9d700 1 -- 172.21.15.60:0/1266261299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c340b1a10 msgr2=0x7f3c3413a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c32d9d700 1 --2- 172.21.15.60:0/1266261299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c340b1a10 0x7f3c3413a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c32d9d700 1 -- 172.21.15.60:0/1266261299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c340ae930 con 0x7f3c3413ebe0 2020-10-31T22:44:43.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c32d9d700 1 --2- 172.21.15.60:0/1266261299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c3413ebe0 0x7f3c3413aee0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f3c2c0032b0 tx=0x7f3c2c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:43.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c237fe700 1 -- 172.21.15.60:0/1266261299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c2c01f3f0 con 0x7f3c3413ebe0 2020-10-31T22:44:43.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c237fe700 1 -- 172.21.15.60:0/1266261299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c01f550 con 0x7f3c3413ebe0 2020-10-31T22:44:43.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c3359e700 1 -- 172.21.15.60:0/1266261299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3413b3d0 con 0x7f3c3413ebe0 2020-10-31T22:44:43.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c237fe700 1 -- 172.21.15.60:0/1266261299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c2c01f8b0 con 0x7f3c3413ebe0 2020-10-31T22:44:43.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c3359e700 1 -- 172.21.15.60:0/1266261299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3414f3f0 con 0x7f3c3413ebe0 2020-10-31T22:44:43.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c3359e700 1 -- 172.21.15.60:0/1266261299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c340ab200 con 0x7f3c3413ebe0 2020-10-31T22:44:43.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.507+0000 7f3c237fe700 1 -- 172.21.15.60:0/1266261299 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3c2c026030 con 0x7f3c3413ebe0 2020-10-31T22:44:43.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.511+0000 7f3c237fe700 1 --2- 172.21.15.60:0/1266261299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c10054f10 0x7f3c100573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.511+0000 7f3c237fe700 1 -- 172.21.15.60:0/1266261299 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3c2c06e620 con 0x7f3c3413ebe0 2020-10-31T22:44:43.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.511+0000 7f3c3259c700 1 --2- 172.21.15.60:0/1266261299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c10054f10 0x7f3c100573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.511+0000 7f3c3259c700 1 --2- 172.21.15.60:0/1266261299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c10054f10 0x7f3c100573d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f3c2400d000 tx=0x7f3c24009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:43.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.515+0000 7f3c237fe700 1 -- 172.21.15.60:0/1266261299 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3c340ab200 con 0x7f3c3413ebe0 2020-10-31T22:44:43.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.659+0000 7f3c3359e700 1 -- 172.21.15.60:0/1266261299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c340ab200 con 0x7f3c3413ebe0 2020-10-31T22:44:43.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.659+0000 7f3c237fe700 1 -- 172.21.15.60:0/1266261299 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16040 (secure 0 0 0) 0x7f3c340ab200 con 0x7f3c3413ebe0 2020-10-31T22:44:43.662 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:44:43.662 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":54,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:44:42.513291+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:44:39.101359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2020-10-31T22:44:40.356100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:44:43.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.663+0000 7f3c3359e700 1 -- 172.21.15.60:0/1266261299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c10054f10 msgr2=0x7f3c100573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.663+0000 7f3c3359e700 1 --2- 172.21.15.60:0/1266261299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c10054f10 0x7f3c100573d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f3c2400d000 tx=0x7f3c24009040).stop 2020-10-31T22:44:43.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.663+0000 7f3c3359e700 1 -- 172.21.15.60:0/1266261299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c3413ebe0 msgr2=0x7f3c3413aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.663+0000 7f3c3359e700 1 --2- 172.21.15.60:0/1266261299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c3413ebe0 0x7f3c3413aee0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f3c2c0032b0 tx=0x7f3c2c016000).stop 2020-10-31T22:44:43.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.663+0000 7f3c3359e700 1 -- 172.21.15.60:0/1266261299 shutdown_connections 2020-10-31T22:44:43.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.663+0000 7f3c3359e700 1 --2- 172.21.15.60:0/1266261299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c3413ebe0 0x7f3c3413aee0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.663+0000 7f3c3359e700 1 --2- 172.21.15.60:0/1266261299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c340af200 0x7f3c34064500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.663+0000 7f3c3359e700 1 --2- 172.21.15.60:0/1266261299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c10054f10 0x7f3c100573d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.663+0000 7f3c3359e700 1 --2- 172.21.15.60:0/1266261299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c340b1a10 0x7f3c3413a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.663+0000 7f3c3359e700 1 -- 172.21.15.60:0/1266261299 >> 172.21.15.60:0/1266261299 conn(0x7f3c340b5300 msgr2=0x7f3c340b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:43.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.663+0000 7f3c3359e700 1 -- 172.21.15.60:0/1266261299 shutdown_connections 2020-10-31T22:44:43.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.663+0000 7f3c3359e700 1 -- 172.21.15.60:0/1266261299 wait complete. 2020-10-31T22:44:43.677 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:44:43.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1ac02b6700 1 Processor -- start 2020-10-31T22:44:43.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1ac02b6700 1 -- start start 2020-10-31T22:44:43.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1ac02b6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ab805b320 0x7f1ab807ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1ac02b6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab805b700 con 0x7f1ab80ae200 2020-10-31T22:44:43.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1ac02b6700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab80807c0 con 0x7f1ab80ac110 2020-10-31T22:44:43.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1ac02b6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80ab730 con 0x7f1ab805b320 2020-10-31T22:44:43.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abe052700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1ab80ae200 0x7f1ab80a74b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48196/0 (socket says 172.21.15.60:48196) 2020-10-31T22:44:43.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abe052700 1 -- 172.21.15.60:0/3821118906 learned_addr learned my addr 172.21.15.60:0/3821118906 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:43.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abe853700 1 --2- 172.21.15.60:0/3821118906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ab805b320 0x7f1ab807ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 -- 172.21.15.60:0/3821118906 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436543758 0 0) 0x7f1ab805b700 con 0x7f1ab80ae200 2020-10-31T22:44:43.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 -- 172.21.15.60:0/3821118906 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa4003230 con 0x7f1ab80ae200 2020-10-31T22:44:43.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 -- 172.21.15.60:0/3821118906 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2020518563 0 0) 0x7f1aa4003230 con 0x7f1ab80ae200 2020-10-31T22:44:43.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 -- 172.21.15.60:0/3821118906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ab805b320 msgr2=0x7f1ab807ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:43.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 --2- 172.21.15.60:0/3821118906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ab805b320 0x7f1ab807ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 -- 172.21.15.60:0/3821118906 >> v1:172.21.15.66:6789/0 conn(0x7f1ab80ac110 legacy=0x7f1ab80af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 -- 172.21.15.60:0/3821118906 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab80ab9d0 con 0x7f1ab80ae200 2020-10-31T22:44:43.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 -- 172.21.15.60:0/3821118906 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f1ab40016d0 con 0x7f1ab80ae200 2020-10-31T22:44:43.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 -- 172.21.15.60:0/3821118906 >> v1:172.21.15.60:6789/0 conn(0x7f1ab80ae200 legacy=0x7f1ab80a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 --2- 172.21.15.60:0/3821118906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1aa4003750 0x7f1aa4003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 --2- 172.21.15.60:0/3821118906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ab805b320 0x7f1aa40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 --2- 172.21.15.60:0/3821118906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa40049c0 0x7f1aa4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 -- 172.21.15.60:0/3821118906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80ab730 con 0x7f1aa4003750 2020-10-31T22:44:43.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 -- 172.21.15.60:0/3821118906 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa40041f0 con 0x7f1aa40049c0 2020-10-31T22:44:43.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abd851700 1 -- 172.21.15.60:0/3821118906 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa404f730 con 0x7f1ab805b320 2020-10-31T22:44:43.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abe853700 1 --2- 172.21.15.60:0/3821118906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1aa4003750 0x7f1aa4003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abe052700 1 --2- 172.21.15.60:0/3821118906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ab805b320 0x7f1aa40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abf054700 1 --2- 172.21.15.60:0/3821118906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa40049c0 0x7f1aa4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abe853700 1 -- 172.21.15.60:0/3821118906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ab805b320 msgr2=0x7f1aa40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abe853700 1 --2- 172.21.15.60:0/3821118906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ab805b320 0x7f1aa40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abe853700 1 -- 172.21.15.60:0/3821118906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa40049c0 msgr2=0x7f1aa4004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abe853700 1 --2- 172.21.15.60:0/3821118906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa40049c0 0x7f1aa4004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abe853700 1 -- 172.21.15.60:0/3821118906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa4003230 con 0x7f1aa4003750 2020-10-31T22:44:43.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.803+0000 7f1abf054700 1 --2- 172.21.15.60:0/3821118906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa40049c0 0x7f1aa4004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:44:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.807+0000 7f1abe853700 1 --2- 172.21.15.60:0/3821118906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1aa4003750 0x7f1aa4003b70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f1aac00c000 tx=0x7f1aac008040).ready entity=mon.0 client_cookie=ffbecef991159abc server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.807+0000 7f1abd851700 1 -- 172.21.15.60:0/3821118906 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aac00e970 con 0x7f1aa4003750 2020-10-31T22:44:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.807+0000 7f1abd851700 1 -- 172.21.15.60:0/3821118906 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aac00ead0 con 0x7f1aa4003750 2020-10-31T22:44:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.807+0000 7f1abd851700 1 -- 172.21.15.60:0/3821118906 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1aac00ee30 con 0x7f1aa4003750 2020-10-31T22:44:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.807+0000 7f1ac02b6700 1 -- 172.21.15.60:0/3821118906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1aa4003750 msgr2=0x7f1aa4003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.807+0000 7f1ac02b6700 1 --2- 172.21.15.60:0/3821118906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1aa4003750 0x7f1aa4003b70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f1aac00c000 tx=0x7f1aac008040).stop 2020-10-31T22:44:43.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.807+0000 7f1abf054700 1 -- 172.21.15.60:0/3821118906 reap_dead start 2020-10-31T22:44:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.807+0000 7f1ac02b6700 1 -- 172.21.15.60:0/3821118906 shutdown_connections 2020-10-31T22:44:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.807+0000 7f1ac02b6700 1 -- 172.21.15.60:0/3821118906 >> 172.21.15.60:0/3821118906 conn(0x7f1ab80b3fd0 msgr2=0x7f1ab80b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.807+0000 7f1ac02b6700 1 -- 172.21.15.60:0/3821118906 shutdown_connections 2020-10-31T22:44:43.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.807+0000 7f1ac02b6700 1 -- 172.21.15.60:0/3821118906 wait complete. 2020-10-31T22:44:43.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.807+0000 7f1ac02b6700 1 Processor -- start 2020-10-31T22:44:43.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.807+0000 7f1ac02b6700 1 -- start start 2020-10-31T22:44:43.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1ac02b6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ab80a9d40 0x7f1ab813df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1ac02b6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ab813d7e0 0x7f1ab8141360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1ac02b6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ab813e420 0x7f1ab8141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1ac02b6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab8066fa0 con 0x7f1ab813e420 2020-10-31T22:44:43.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1ac02b6700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80aa120 con 0x7f1ab813d7e0 2020-10-31T22:44:43.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1ac02b6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80629e0 con 0x7f1ab80a9d40 2020-10-31T22:44:43.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1abf054700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ab813e420 0x7f1ab8141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1abf054700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ab813e420 0x7f1ab8141850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44076/0 (socket says 172.21.15.60:44076) 2020-10-31T22:44:43.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1abf054700 1 -- 172.21.15.60:0/2385623329 learned_addr learned my addr 172.21.15.60:0/2385623329 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:43.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1abe052700 1 --2- 172.21.15.60:0/2385623329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ab813d7e0 0x7f1ab8141360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1abe853700 1 --2- 172.21.15.60:0/2385623329 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ab80a9d40 0x7f1ab813df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1abf054700 1 -- 172.21.15.60:0/2385623329 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ab80a9d40 msgr2=0x7f1ab813df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1abf054700 1 --2- 172.21.15.60:0/2385623329 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ab80a9d40 0x7f1ab813df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1abf054700 1 -- 172.21.15.60:0/2385623329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ab813d7e0 msgr2=0x7f1ab8141360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:43.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1abf054700 1 --2- 172.21.15.60:0/2385623329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ab813d7e0 0x7f1ab8141360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:43.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1abf054700 1 -- 172.21.15.60:0/2385623329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab8066d00 con 0x7f1ab813e420 2020-10-31T22:44:43.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1abf054700 1 --2- 172.21.15.60:0/2385623329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ab813e420 0x7f1ab8141850 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f1ab00011d0 tx=0x7f1ab0009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:43.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1aab7fe700 1 -- 172.21.15.60:0/2385623329 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab0006c60 con 0x7f1ab813e420 2020-10-31T22:44:43.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1aab7fe700 1 -- 172.21.15.60:0/2385623329 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab0010040 con 0x7f1ab813e420 2020-10-31T22:44:43.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1ac02b6700 1 -- 172.21.15.60:0/2385623329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab8140ec0 con 0x7f1ab813e420 2020-10-31T22:44:43.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1aab7fe700 1 -- 172.21.15.60:0/2385623329 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ab0007030 con 0x7f1ab813e420 2020-10-31T22:44:43.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.811+0000 7f1ac02b6700 1 -- 172.21.15.60:0/2385623329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab8062660 con 0x7f1ab813e420 2020-10-31T22:44:43.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.815+0000 7f1ac02b6700 1 -- 172.21.15.60:0/2385623329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab8141050 con 0x7f1ab813e420 2020-10-31T22:44:43.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.815+0000 7f1aab7fe700 1 -- 172.21.15.60:0/2385623329 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1ab001d060 con 0x7f1ab813e420 2020-10-31T22:44:43.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.815+0000 7f1aab7fe700 1 --2- 172.21.15.60:0/2385623329 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1aa0055020 0x7f1aa00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:43.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.815+0000 7f1aab7fe700 1 -- 172.21.15.60:0/2385623329 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1ab006d490 con 0x7f1ab813e420 2020-10-31T22:44:43.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.815+0000 7f1abe853700 1 --2- 172.21.15.60:0/2385623329 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1aa0055020 0x7f1aa00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:43.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.815+0000 7f1abe853700 1 --2- 172.21.15.60:0/2385623329 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1aa0055020 0x7f1aa00574e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f1aac007000 tx=0x7f1aac01a000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:43.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:43.823+0000 7f1aab7fe700 1 -- 172.21.15.60:0/2385623329 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1ab00438a0 con 0x7f1ab813e420 2020-10-31T22:44:44.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.019+0000 7f1ac02b6700 1 -- 172.21.15.60:0/2385623329 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f1ab8057100 con 0x7f1ab813e420 2020-10-31T22:44:44.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.027+0000 7f1aab7fe700 1 -- 172.21.15.60:0/2385623329 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v15) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1ab001b030 con 0x7f1ab813e420 2020-10-31T22:44:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.031+0000 7f1ac02b6700 1 -- 172.21.15.60:0/2385623329 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1aa0055020 msgr2=0x7f1aa00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.031+0000 7f1ac02b6700 1 --2- 172.21.15.60:0/2385623329 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1aa0055020 0x7f1aa00574e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f1aac007000 tx=0x7f1aac01a000).stop 2020-10-31T22:44:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.031+0000 7f1ac02b6700 1 -- 172.21.15.60:0/2385623329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ab813e420 msgr2=0x7f1ab8141850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:44.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.031+0000 7f1ac02b6700 1 --2- 172.21.15.60:0/2385623329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ab813e420 0x7f1ab8141850 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f1ab00011d0 tx=0x7f1ab0009040).stop 2020-10-31T22:44:44.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.031+0000 7f1ac02b6700 1 -- 172.21.15.60:0/2385623329 shutdown_connections 2020-10-31T22:44:44.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.031+0000 7f1ac02b6700 1 --2- 172.21.15.60:0/2385623329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ab813e420 0x7f1ab8141850 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.031+0000 7f1ac02b6700 1 --2- 172.21.15.60:0/2385623329 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ab80a9d40 0x7f1ab813df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.031+0000 7f1ac02b6700 1 --2- 172.21.15.60:0/2385623329 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1aa0055020 0x7f1aa00574e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.031+0000 7f1ac02b6700 1 --2- 172.21.15.60:0/2385623329 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ab813d7e0 0x7f1ab8141360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.031+0000 7f1ac02b6700 1 -- 172.21.15.60:0/2385623329 >> 172.21.15.60:0/2385623329 conn(0x7f1ab80b3fd0 msgr2=0x7f1ab80a7280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:44.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.031+0000 7f1ac02b6700 1 -- 172.21.15.60:0/2385623329 shutdown_connections 2020-10-31T22:44:44.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.031+0000 7f1ac02b6700 1 -- 172.21.15.60:0/2385623329 wait complete. 2020-10-31T22:44:44.034 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2020-10-31T22:44:44.047 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:44:44.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.171+0000 7fe2a2270700 1 Processor -- start 2020-10-31T22:44:44.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.171+0000 7fe2a2270700 1 -- start start 2020-10-31T22:44:44.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.171+0000 7fe2a2270700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29c0b1570 0x7fe29c024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:44.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.171+0000 7fe2a2270700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe29c0803e0 0x7fe29c159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:44.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.171+0000 7fe2a2270700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe29c0b1950 con 0x7fe29c025480 2020-10-31T22:44:44.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.171+0000 7fe2a2270700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29c080870 con 0x7fe29c0803e0 2020-10-31T22:44:44.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.171+0000 7fe2a2270700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c062720 con 0x7fe29c0b1570 2020-10-31T22:44:44.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.171+0000 7fe2a126e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe29c025480 0x7fe29c07fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48218/0 (socket says 172.21.15.60:48218) 2020-10-31T22:44:44.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.171+0000 7fe2a126e700 1 -- 172.21.15.60:0/3417621430 learned_addr learned my addr 172.21.15.60:0/3417621430 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:44.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.171+0000 7fe2a34d2700 1 --2- 172.21.15.60:0/3417621430 >> v2:172.21.15.60:3300/0 conn(0x7fe29c0803e0 0x7fe29c159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:44.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.171+0000 7fe2a1a6f700 1 --2- 172.21.15.60:0/3417621430 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29c0b1570 0x7fe29c024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:44.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.171+0000 7fe2a0a6d700 1 -- 172.21.15.60:0/3417621430 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3665983996 0 0) 0x7fe29c0b1950 con 0x7fe29c025480 2020-10-31T22:44:44.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.171+0000 7fe2a0a6d700 1 -- 172.21.15.60:0/3417621430 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe288003230 con 0x7fe29c025480 2020-10-31T22:44:44.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.171+0000 7fe2a34d2700 1 -- 172.21.15.60:0/3417621430 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29c0b1570 msgr2=0x7fe29c024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:44.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a34d2700 1 --2- 172.21.15.60:0/3417621430 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29c0b1570 0x7fe29c024f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a34d2700 1 -- 172.21.15.60:0/3417621430 >> v1:172.21.15.60:6789/0 conn(0x7fe29c025480 legacy=0x7fe29c07fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:44.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a34d2700 1 -- 172.21.15.60:0/3417621430 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c066cb0 con 0x7fe29c0803e0 2020-10-31T22:44:44.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a34d2700 1 --2- 172.21.15.60:0/3417621430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c0803e0 0x7fe29c159210 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fe2940032b0 tx=0x7fe2940091a0).ready entity=mon.0 client_cookie=a72cd12b42003019 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:44.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a0a6d700 1 -- 172.21.15.60:0/3417621430 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe29400b940 con 0x7fe29c0803e0 2020-10-31T22:44:44.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a0a6d700 1 -- 172.21.15.60:0/3417621430 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29400baa0 con 0x7fe29c0803e0 2020-10-31T22:44:44.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a0a6d700 1 -- 172.21.15.60:0/3417621430 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe29400bc10 con 0x7fe29c0803e0 2020-10-31T22:44:44.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a2270700 1 -- 172.21.15.60:0/3417621430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c0803e0 msgr2=0x7fe29c159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:44.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a2270700 1 --2- 172.21.15.60:0/3417621430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c0803e0 0x7fe29c159210 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7fe2940032b0 tx=0x7fe2940091a0).stop 2020-10-31T22:44:44.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a2270700 1 -- 172.21.15.60:0/3417621430 shutdown_connections 2020-10-31T22:44:44.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a2270700 1 --2- 172.21.15.60:0/3417621430 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c0803e0 0x7fe29c159210 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a2270700 1 --2- 172.21.15.60:0/3417621430 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29c0b1570 0x7fe29c024f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a2270700 1 -- 172.21.15.60:0/3417621430 >> 172.21.15.60:0/3417621430 conn(0x7fe29c0b5440 msgr2=0x7fe29c0b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:44.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a2270700 1 -- 172.21.15.60:0/3417621430 shutdown_connections 2020-10-31T22:44:44.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.175+0000 7fe2a2270700 1 -- 172.21.15.60:0/3417621430 wait complete. 2020-10-31T22:44:44.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a2270700 1 Processor -- start 2020-10-31T22:44:44.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a2270700 1 -- start start 2020-10-31T22:44:44.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a2270700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe29c025480 0x7fe29c065ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:44.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a2270700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29c0803e0 0x7fe29c0aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:44.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a2270700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c0b1570 0x7fe29c0ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:44.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a2270700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c0a89a0 con 0x7fe29c0b1570 2020-10-31T22:44:44.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a2270700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c0abaa0 con 0x7fe29c025480 2020-10-31T22:44:44.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a2270700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe29c0abd40 con 0x7fe29c0803e0 2020-10-31T22:44:44.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a34d2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c0b1570 0x7fe29c0ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:44.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a34d2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c0b1570 0x7fe29c0ab310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44090/0 (socket says 172.21.15.60:44090) 2020-10-31T22:44:44.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a126e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29c0803e0 0x7fe29c0aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:44.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a34d2700 1 -- 172.21.15.60:0/905637590 learned_addr learned my addr 172.21.15.60:0/905637590 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:44.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a1a6f700 1 --2- 172.21.15.60:0/905637590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe29c025480 0x7fe29c065ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:44.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a34d2700 1 -- 172.21.15.60:0/905637590 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29c0803e0 msgr2=0x7fe29c0aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:44.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a34d2700 1 --2- 172.21.15.60:0/905637590 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29c0803e0 0x7fe29c0aae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a34d2700 1 -- 172.21.15.60:0/905637590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe29c025480 msgr2=0x7fe29c065ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:44.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a34d2700 1 --2- 172.21.15.60:0/905637590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe29c025480 0x7fe29c065ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a34d2700 1 -- 172.21.15.60:0/905637590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c0abfe0 con 0x7fe29c0b1570 2020-10-31T22:44:44.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a34d2700 1 --2- 172.21.15.60:0/905637590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c0b1570 0x7fe29c0ab310 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fe2940032b0 tx=0x7fe294016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:44.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2927fc700 1 -- 172.21.15.60:0/905637590 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe294006ad0 con 0x7fe29c0b1570 2020-10-31T22:44:44.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2927fc700 1 -- 172.21.15.60:0/905637590 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29401f3f0 con 0x7fe29c0b1570 2020-10-31T22:44:44.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a2270700 1 -- 172.21.15.60:0/905637590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe29c0a8620 con 0x7fe29c0b1570 2020-10-31T22:44:44.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2927fc700 1 -- 172.21.15.60:0/905637590 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe29401f750 con 0x7fe29c0b1570 2020-10-31T22:44:44.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.179+0000 7fe2a2270700 1 -- 172.21.15.60:0/905637590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe29c0a5cf0 con 0x7fe29c0b1570 2020-10-31T22:44:44.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.183+0000 7fe2a2270700 1 -- 172.21.15.60:0/905637590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29c0a8360 con 0x7fe29c0b1570 2020-10-31T22:44:44.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.183+0000 7fe2927fc700 1 -- 172.21.15.60:0/905637590 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe294026030 con 0x7fe29c0b1570 2020-10-31T22:44:44.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.183+0000 7fe2927fc700 1 --2- 172.21.15.60:0/905637590 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe284055020 0x7fe2840574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:44.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.183+0000 7fe2927fc700 1 -- 172.21.15.60:0/905637590 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe29406e930 con 0x7fe29c0b1570 2020-10-31T22:44:44.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.183+0000 7fe2a1a6f700 1 --2- 172.21.15.60:0/905637590 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe284055020 0x7fe2840574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:44.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.183+0000 7fe2a1a6f700 1 --2- 172.21.15.60:0/905637590 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe284055020 0x7fe2840574e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fe298008000 tx=0x7fe298008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:44.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.191+0000 7fe2927fc700 1 -- 172.21.15.60:0/905637590 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe294044e50 con 0x7fe29c0b1570 2020-10-31T22:44:44.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.383+0000 7fe2a2270700 1 -- 172.21.15.60:0/905637590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fe29c0a87b0 con 0x7fe29c0b1570 2020-10-31T22:44:44.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.387+0000 7fe2927fc700 1 -- 172.21.15.60:0/905637590 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v16) v1 ==== 184+0+0 (secure 0 0 0) 0x7fe294015020 con 0x7fe29c0b1570 2020-10-31T22:44:44.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.391+0000 7fe2a2270700 1 -- 172.21.15.60:0/905637590 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe284055020 msgr2=0x7fe2840574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:44.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.391+0000 7fe2a2270700 1 --2- 172.21.15.60:0/905637590 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe284055020 0x7fe2840574e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fe298008000 tx=0x7fe298008040).stop 2020-10-31T22:44:44.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.391+0000 7fe2a2270700 1 -- 172.21.15.60:0/905637590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c0b1570 msgr2=0x7fe29c0ab310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:44.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.391+0000 7fe2a2270700 1 --2- 172.21.15.60:0/905637590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c0b1570 0x7fe29c0ab310 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7fe2940032b0 tx=0x7fe294016000).stop 2020-10-31T22:44:44.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.391+0000 7fe2a2270700 1 -- 172.21.15.60:0/905637590 shutdown_connections 2020-10-31T22:44:44.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.391+0000 7fe2a2270700 1 --2- 172.21.15.60:0/905637590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe29c0b1570 0x7fe29c0ab310 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.391+0000 7fe2a2270700 1 --2- 172.21.15.60:0/905637590 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe284055020 0x7fe2840574e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.391+0000 7fe2a2270700 1 --2- 172.21.15.60:0/905637590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe29c025480 0x7fe29c065ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.391+0000 7fe2a2270700 1 --2- 172.21.15.60:0/905637590 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe29c0803e0 0x7fe29c0aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.391+0000 7fe2a2270700 1 -- 172.21.15.60:0/905637590 >> 172.21.15.60:0/905637590 conn(0x7fe29c0b5440 msgr2=0x7fe29c0adcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:44.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.391+0000 7fe2a2270700 1 -- 172.21.15.60:0/905637590 shutdown_connections 2020-10-31T22:44:44.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.391+0000 7fe2a2270700 1 -- 172.21.15.60:0/905637590 wait complete. 2020-10-31T22:44:44.394 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.1 2020-10-31T22:44:44.408 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:44:44.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.515+0000 7f9d7af85700 1 Processor -- start 2020-10-31T22:44:44.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.515+0000 7f9d7af85700 1 -- start start 2020-10-31T22:44:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.515+0000 7f9d7af85700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9d740a7850 0x7f9d7405bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.515+0000 7f9d7af85700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9d74146790 0x7f9d74146c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.515+0000 7f9d7af85700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d740af200 con 0x7f9d7405b960 2020-10-31T22:44:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.515+0000 7f9d7af85700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d740b0f00 con 0x7f9d74146790 2020-10-31T22:44:44.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.515+0000 7f9d7af85700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740b11a0 con 0x7f9d740a7850 2020-10-31T22:44:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d78d21700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9d7405b960 0x7f9d740aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48230/0 (socket says 172.21.15.60:48230) 2020-10-31T22:44:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d78d21700 1 -- 172.21.15.60:0/2443478541 learned_addr learned my addr 172.21.15.60:0/2443478541 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d73fff700 1 --2- 172.21.15.60:0/2443478541 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9d740a7850 0x7f9d7405bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:44.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d79522700 1 --2- 172.21.15.60:0/2443478541 >> v2:172.21.15.66:3300/0 conn(0x7f9d74146790 0x7f9d74146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d737fe700 1 -- 172.21.15.60:0/2443478541 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387538115 0 0) 0x7f9d740af200 con 0x7f9d7405b960 2020-10-31T22:44:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d737fe700 1 -- 172.21.15.60:0/2443478541 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d58003230 con 0x7f9d7405b960 2020-10-31T22:44:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d79522700 1 -- 172.21.15.60:0/2443478541 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9d740a7850 msgr2=0x7f9d7405bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:44.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d79522700 1 --2- 172.21.15.60:0/2443478541 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9d740a7850 0x7f9d7405bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d79522700 1 -- 172.21.15.60:0/2443478541 >> v1:172.21.15.60:6789/0 conn(0x7f9d7405b960 legacy=0x7f9d740aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:44.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d79522700 1 -- 172.21.15.60:0/2443478541 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d740b1440 con 0x7f9d74146790 2020-10-31T22:44:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d79522700 1 --2- 172.21.15.60:0/2443478541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d74146790 0x7f9d74146c00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f9d6c0032b0 tx=0x7f9d6c0091a0).ready entity=mon.1 client_cookie=919058a9f11affff server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d737fe700 1 -- 172.21.15.60:0/2443478541 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d6c00b940 con 0x7f9d74146790 2020-10-31T22:44:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d737fe700 1 -- 172.21.15.60:0/2443478541 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c00baa0 con 0x7f9d74146790 2020-10-31T22:44:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d737fe700 1 -- 172.21.15.60:0/2443478541 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d6c00bc10 con 0x7f9d74146790 2020-10-31T22:44:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d7af85700 1 -- 172.21.15.60:0/2443478541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d74146790 msgr2=0x7f9d74146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:44.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d7af85700 1 --2- 172.21.15.60:0/2443478541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d74146790 0x7f9d74146c00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f9d6c0032b0 tx=0x7f9d6c0091a0).stop 2020-10-31T22:44:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d7af85700 1 -- 172.21.15.60:0/2443478541 shutdown_connections 2020-10-31T22:44:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d7af85700 1 --2- 172.21.15.60:0/2443478541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d74146790 0x7f9d74146c00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d7af85700 1 --2- 172.21.15.60:0/2443478541 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9d740a7850 0x7f9d7405bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d7af85700 1 -- 172.21.15.60:0/2443478541 >> 172.21.15.60:0/2443478541 conn(0x7f9d7406a260 msgr2=0x7f9d74061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d7af85700 1 -- 172.21.15.60:0/2443478541 shutdown_connections 2020-10-31T22:44:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d7af85700 1 -- 172.21.15.60:0/2443478541 wait complete. 2020-10-31T22:44:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d7af85700 1 Processor -- start 2020-10-31T22:44:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.519+0000 7f9d7af85700 1 -- start start 2020-10-31T22:44:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d7af85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7405b960 0x7f9d7414d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:44.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d7af85700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d740a7850 0x7f9d74158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d7af85700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9d74146790 0x7f9d740aa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d7af85700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740a9e30 con 0x7f9d7405b960 2020-10-31T22:44:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d7af85700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740a80e0 con 0x7f9d740a7850 2020-10-31T22:44:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d7af85700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d740a8380 con 0x7f9d74146790 2020-10-31T22:44:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d78d21700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7405b960 0x7f9d7414d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d78d21700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7405b960 0x7f9d7414d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44102/0 (socket says 172.21.15.60:44102) 2020-10-31T22:44:44.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d73fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d740a7850 0x7f9d74158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d78d21700 1 -- 172.21.15.60:0/1930487715 learned_addr learned my addr 172.21.15.60:0/1930487715 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d79522700 1 --2- 172.21.15.60:0/1930487715 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9d74146790 0x7f9d740aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d78d21700 1 -- 172.21.15.60:0/1930487715 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9d74146790 msgr2=0x7f9d740aa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d78d21700 1 --2- 172.21.15.60:0/1930487715 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9d74146790 0x7f9d740aa260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d78d21700 1 -- 172.21.15.60:0/1930487715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d740a7850 msgr2=0x7f9d74158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d78d21700 1 --2- 172.21.15.60:0/1930487715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d740a7850 0x7f9d74158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d78d21700 1 -- 172.21.15.60:0/1930487715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d740a8620 con 0x7f9d7405b960 2020-10-31T22:44:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d73fff700 1 --2- 172.21.15.60:0/1930487715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d740a7850 0x7f9d74158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:44:44.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d78d21700 1 --2- 172.21.15.60:0/1930487715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7405b960 0x7f9d7414d2f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f9d5c0010d0 tx=0x7f9d5c007a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d71ffb700 1 -- 172.21.15.60:0/1930487715 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d5c0072e0 con 0x7f9d7405b960 2020-10-31T22:44:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d71ffb700 1 -- 172.21.15.60:0/1930487715 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5c007440 con 0x7f9d7405b960 2020-10-31T22:44:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d71ffb700 1 -- 172.21.15.60:0/1930487715 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d5c0057d0 con 0x7f9d7405b960 2020-10-31T22:44:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d7af85700 1 -- 172.21.15.60:0/1930487715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d740ad620 con 0x7f9d7405b960 2020-10-31T22:44:44.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.523+0000 7f9d7af85700 1 -- 172.21.15.60:0/1930487715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7414bba0 con 0x7f9d7405b960 2020-10-31T22:44:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.527+0000 7f9d7af85700 1 -- 172.21.15.60:0/1930487715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d74057100 con 0x7f9d7405b960 2020-10-31T22:44:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.527+0000 7f9d71ffb700 1 -- 172.21.15.60:0/1930487715 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9d5c010070 con 0x7f9d7405b960 2020-10-31T22:44:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.527+0000 7f9d71ffb700 1 --2- 172.21.15.60:0/1930487715 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9d4c054f90 0x7f9d4c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.527+0000 7f9d71ffb700 1 -- 172.21.15.60:0/1930487715 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9d5c06d2f0 con 0x7f9d7405b960 2020-10-31T22:44:44.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.527+0000 7f9d73fff700 1 --2- 172.21.15.60:0/1930487715 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9d4c054f90 0x7f9d4c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:44.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.527+0000 7f9d73fff700 1 --2- 172.21.15.60:0/1930487715 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9d4c054f90 0x7f9d4c057450 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f9d64008000 tx=0x7f9d64008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:44.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.535+0000 7f9d71ffb700 1 -- 172.21.15.60:0/1930487715 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9d5c043680 con 0x7f9d7405b960 2020-10-31T22:44:44.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.719+0000 7f9d7af85700 1 -- 172.21.15.60:0/1930487715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d7405aa70 con 0x7f9d7405b960 2020-10-31T22:44:44.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.719+0000 7f9d71ffb700 1 -- 172.21.15.60:0/1930487715 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f9d5c046ca0 con 0x7f9d7405b960 2020-10-31T22:44:44.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.723+0000 7f9d7af85700 1 -- 172.21.15.60:0/1930487715 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9d4c054f90 msgr2=0x7f9d4c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:44.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.723+0000 7f9d7af85700 1 --2- 172.21.15.60:0/1930487715 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9d4c054f90 0x7f9d4c057450 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f9d64008000 tx=0x7f9d64008040).stop 2020-10-31T22:44:44.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.723+0000 7f9d7af85700 1 -- 172.21.15.60:0/1930487715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7405b960 msgr2=0x7f9d7414d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:44.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.723+0000 7f9d7af85700 1 --2- 172.21.15.60:0/1930487715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7405b960 0x7f9d7414d2f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f9d5c0010d0 tx=0x7f9d5c007a10).stop 2020-10-31T22:44:44.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.723+0000 7f9d7af85700 1 -- 172.21.15.60:0/1930487715 shutdown_connections 2020-10-31T22:44:44.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.723+0000 7f9d7af85700 1 --2- 172.21.15.60:0/1930487715 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9d74146790 0x7f9d740aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.723+0000 7f9d7af85700 1 --2- 172.21.15.60:0/1930487715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d7405b960 0x7f9d7414d2f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.723+0000 7f9d7af85700 1 --2- 172.21.15.60:0/1930487715 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9d4c054f90 0x7f9d4c057450 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.723+0000 7f9d7af85700 1 --2- 172.21.15.60:0/1930487715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d740a7850 0x7f9d74158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:44.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.723+0000 7f9d7af85700 1 -- 172.21.15.60:0/1930487715 >> 172.21.15.60:0/1930487715 conn(0x7f9d7406a260 msgr2=0x7f9d740b3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:44.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.723+0000 7f9d7af85700 1 -- 172.21.15.60:0/1930487715 shutdown_connections 2020-10-31T22:44:44.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:44.723+0000 7f9d7af85700 1 -- 172.21.15.60:0/1930487715 wait complete. 2020-10-31T22:44:44.727 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:44:44.727 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5180,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3826848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3826848450},{"type":"v1","addr":"172.21.15.66:6833","nonce":3826848450}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5544,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/821344830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":821344830},{"type":"v1","addr":"172.21.15.60:6835","nonce":821344830}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:44:41.510512+0000","modified":"2020-10-31T22:44:43.018399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/798359639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":798359639},{"type":"v1","addr":"172.21.15.60:6837","nonce":798359639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-10-31T22:44:44.728 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:44:44.728 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 23 2020-10-31T22:44:44.731 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:44:44.739 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:44:44.769 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:44:45.040 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:44:41.510512+0000', 'modified': '2020-10-31T22:44:43.018399+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5553}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5553': {'gid': 5553, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/798359639', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 798359639}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 798359639}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:44:45.041 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:44:45.042 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:44:45.171 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":5553,"want_state":"up:active","state":"up:active","rank_uptime":3.649608137,"mdsmap_epoch":23,"osdmap_epoch":54,"osdmap_epoch_barrier":54,"uptime":9.0202585309999996} 2020-10-31T22:44:45.171 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 5553, "mdsmap_epoch": 23, "osdmap_epoch": 54, "osdmap_epoch_barrier": 54, "rank_uptime": 3.649608137, "state": "up:active", "uptime": 9.020258531, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:44:45.172 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:44:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.283+0000 7fbe81744700 1 Processor -- start 2020-10-31T22:44:45.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.283+0000 7fbe81744700 1 -- start start 2020-10-31T22:44:45.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.283+0000 7fbe81744700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe7c0b5570 0x7fbe7c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.283+0000 7fbe81744700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbe7c0b24a0 0x7fbe7c145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.283+0000 7fbe81744700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7c145180 con 0x7fbe7c145d10 2020-10-31T22:44:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.283+0000 7fbe81744700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7c0afae0 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.283+0000 7fbe81744700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c141bf0 con 0x7fbe7c0b5570 2020-10-31T22:44:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.283+0000 7fbe7bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe7c0b5570 0x7fbe7c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.283+0000 7fbe7b7fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbe7c0b24a0 0x7fbe7c145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.283+0000 7fbe7bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe7c0b5570 0x7fbe7c0b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:57296/0 (socket says 172.21.15.60:57296) 2020-10-31T22:44:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.283+0000 7fbe7bfff700 1 -- 172.21.15.60:0/1362865341 learned_addr learned my addr 172.21.15.60:0/1362865341 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe7b7fe700 1 -- 172.21.15.60:0/1362865341 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe7c0b5570 msgr2=0x7fbe7c0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe7b7fe700 1 --2- 172.21.15.60:0/1362865341 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe7c0b5570 0x7fbe7c0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe7b7fe700 1 -- 172.21.15.60:0/1362865341 >> v1:172.21.15.66:6789/0 conn(0x7fbe7c145d10 legacy=0x7fbe7c141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe7b7fe700 1 -- 172.21.15.60:0/1362865341 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c0b0670 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe7bfff700 1 --2- 172.21.15.60:0/1362865341 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe7c0b5570 0x7fbe7c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:44:45.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe7b7fe700 1 --2- 172.21.15.60:0/1362865341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe7c0b24a0 0x7fbe7c145820 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fbe6c002f30 tx=0x7fbe6c006dc0).ready entity=mon.1 client_cookie=2bec8aaabd560523 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe7affd700 1 -- 172.21.15.60:0/1362865341 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe6c009760 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe7affd700 1 -- 172.21.15.60:0/1362865341 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c0098c0 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe81744700 1 -- 172.21.15.60:0/1362865341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe7c0b24a0 msgr2=0x7fbe7c145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe7affd700 1 -- 172.21.15.60:0/1362865341 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe6c009c20 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe81744700 1 --2- 172.21.15.60:0/1362865341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe7c0b24a0 0x7fbe7c145820 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fbe6c002f30 tx=0x7fbe6c006dc0).stop 2020-10-31T22:44:45.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe81744700 1 -- 172.21.15.60:0/1362865341 shutdown_connections 2020-10-31T22:44:45.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe81744700 1 --2- 172.21.15.60:0/1362865341 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe7c0b5570 0x7fbe7c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe81744700 1 --2- 172.21.15.60:0/1362865341 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe7c0b24a0 0x7fbe7c145820 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe81744700 1 -- 172.21.15.60:0/1362865341 >> 172.21.15.60:0/1362865341 conn(0x7fbe7c0b8e90 msgr2=0x7fbe7c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:45.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe81744700 1 -- 172.21.15.60:0/1362865341 shutdown_connections 2020-10-31T22:44:45.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe81744700 1 -- 172.21.15.60:0/1362865341 wait complete. 2020-10-31T22:44:45.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe81744700 1 Processor -- start 2020-10-31T22:44:45.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.287+0000 7fbe81744700 1 -- start start 2020-10-31T22:44:45.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe81744700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0b24a0 0x7fbe7c141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe81744700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe7c0b5570 0x7fbe7c1396e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe81744700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe7c145d10 0x7fbe7c1408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe81744700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c13fd30 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe81744700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c148530 con 0x7fbe7c145d10 2020-10-31T22:44:45.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe81744700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c148790 con 0x7fbe7c0b5570 2020-10-31T22:44:45.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe7bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0b24a0 0x7fbe7c141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe7bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0b24a0 0x7fbe7c141580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44114/0 (socket says 172.21.15.60:44114) 2020-10-31T22:44:45.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe7bfff700 1 -- 172.21.15.60:0/195554707 learned_addr learned my addr 172.21.15.60:0/195554707 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:45.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe7b7fe700 1 --2- 172.21.15.60:0/195554707 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe7c0b5570 0x7fbe7c1396e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe80f43700 1 --2- 172.21.15.60:0/195554707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe7c145d10 0x7fbe7c1408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe7bfff700 1 -- 172.21.15.60:0/195554707 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe7c0b5570 msgr2=0x7fbe7c1396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe7bfff700 1 --2- 172.21.15.60:0/195554707 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe7c0b5570 0x7fbe7c1396e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe7bfff700 1 -- 172.21.15.60:0/195554707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe7c145d10 msgr2=0x7fbe7c1408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe7bfff700 1 --2- 172.21.15.60:0/195554707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe7c145d10 0x7fbe7c1408c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe7bfff700 1 -- 172.21.15.60:0/195554707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c148a30 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe7bfff700 1 --2- 172.21.15.60:0/195554707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0b24a0 0x7fbe7c141580 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fbe6800c000 tx=0x7fbe68008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:45.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe797fa700 1 -- 172.21.15.60:0/195554707 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe6800c8f0 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe81744700 1 -- 172.21.15.60:0/195554707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c1491e0 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe797fa700 1 -- 172.21.15.60:0/195554707 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6800ca50 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe797fa700 1 -- 172.21.15.60:0/195554707 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe6800cdb0 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe81744700 1 -- 172.21.15.60:0/195554707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c13be40 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.291+0000 7fbe81744700 1 -- 172.21.15.60:0/195554707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c057100 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.295+0000 7fbe797fa700 1 -- 172.21.15.60:0/195554707 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbe68022070 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.295+0000 7fbe797fa700 1 --2- 172.21.15.60:0/195554707 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbe58054f10 0x7fbe580573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.295+0000 7fbe797fa700 1 -- 172.21.15.60:0/195554707 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbe6806e010 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.295+0000 7fbe7b7fe700 1 --2- 172.21.15.60:0/195554707 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbe58054f10 0x7fbe580573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.295+0000 7fbe7b7fe700 1 --2- 172.21.15.60:0/195554707 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbe58054f10 0x7fbe580573d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fbe6c01a000 tx=0x7fbe6c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:45.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.299+0000 7fbe797fa700 1 -- 172.21.15.60:0/195554707 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbe68044490 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.443+0000 7fbe81744700 1 -- 172.21.15.60:0/195554707 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe7c148bc0 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.443+0000 7fbe797fa700 1 -- 172.21.15.60:0/195554707 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16040 (secure 0 0 0) 0x7fbe68047ab0 con 0x7fbe7c0b24a0 2020-10-31T22:44:45.444 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:44:45.444 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":54,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:44:42.513291+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:44:39.101359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2020-10-31T22:44:40.356100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:44:45.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.447+0000 7fbe81744700 1 -- 172.21.15.60:0/195554707 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbe58054f10 msgr2=0x7fbe580573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.447+0000 7fbe81744700 1 --2- 172.21.15.60:0/195554707 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbe58054f10 0x7fbe580573d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fbe6c01a000 tx=0x7fbe6c015000).stop 2020-10-31T22:44:45.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.447+0000 7fbe81744700 1 -- 172.21.15.60:0/195554707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0b24a0 msgr2=0x7fbe7c141580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.447+0000 7fbe81744700 1 --2- 172.21.15.60:0/195554707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0b24a0 0x7fbe7c141580 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fbe6800c000 tx=0x7fbe68008040).stop 2020-10-31T22:44:45.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.447+0000 7fbe81744700 1 -- 172.21.15.60:0/195554707 shutdown_connections 2020-10-31T22:44:45.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.447+0000 7fbe81744700 1 --2- 172.21.15.60:0/195554707 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbe58054f10 0x7fbe580573d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.447+0000 7fbe81744700 1 --2- 172.21.15.60:0/195554707 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe7c145d10 0x7fbe7c1408c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.447+0000 7fbe81744700 1 --2- 172.21.15.60:0/195554707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe7c0b24a0 0x7fbe7c141580 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.447+0000 7fbe81744700 1 --2- 172.21.15.60:0/195554707 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe7c0b5570 0x7fbe7c1396e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.447+0000 7fbe81744700 1 -- 172.21.15.60:0/195554707 >> 172.21.15.60:0/195554707 conn(0x7fbe7c0b8e90 msgr2=0x7fbe7c05f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.447+0000 7fbe81744700 1 -- 172.21.15.60:0/195554707 shutdown_connections 2020-10-31T22:44:45.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.447+0000 7fbe81744700 1 -- 172.21.15.60:0/195554707 wait complete. 2020-10-31T22:44:45.464 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:44:39.101359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:44:40.356100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:44:45.466 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:44:45.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.579+0000 7f00b4bdd700 1 Processor -- start 2020-10-31T22:44:45.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.579+0000 7f00b4bdd700 1 -- start start 2020-10-31T22:44:45.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00b4bdd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00b0065f70 0x7f00b00b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00b4bdd700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b0066410 con 0x7f00b005c660 2020-10-31T22:44:45.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00b4bdd700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b00666b0 con 0x7f00b00b2e20 2020-10-31T22:44:45.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00b4bdd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b0066d60 con 0x7f00b0065f70 2020-10-31T22:44:45.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00ae59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f00b005c660 0x7f00b013f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48258/0 (socket says 172.21.15.60:48258) 2020-10-31T22:44:45.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00ae59c700 1 -- 172.21.15.60:0/2947315369 learned_addr learned my addr 172.21.15.60:0/2947315369 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:45.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00add9b700 1 --2- 172.21.15.60:0/2947315369 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00b0065f70 0x7f00b00b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00ad59a700 1 -- 172.21.15.60:0/2947315369 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469757109 0 0) 0x7f00b0066410 con 0x7f00b005c660 2020-10-31T22:44:45.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00ad59a700 1 -- 172.21.15.60:0/2947315369 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0094003230 con 0x7f00b005c660 2020-10-31T22:44:45.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00ad59a700 1 -- 172.21.15.60:0/2947315369 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742064688 0 0) 0x7f00b00666b0 con 0x7f00b00b2e20 2020-10-31T22:44:45.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00ad59a700 1 -- 172.21.15.60:0/2947315369 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00b0066410 con 0x7f00b00b2e20 2020-10-31T22:44:45.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00add9b700 1 -- 172.21.15.60:0/2947315369 >> v1:172.21.15.66:6789/0 conn(0x7f00b00b2e20 legacy=0x7f00b0142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00add9b700 1 -- 172.21.15.60:0/2947315369 >> v1:172.21.15.60:6789/0 conn(0x7f00b005c660 legacy=0x7f00b013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00add9b700 1 -- 172.21.15.60:0/2947315369 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b0142170 con 0x7f00b0065f70 2020-10-31T22:44:45.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00add9b700 1 --2- 172.21.15.60:0/2947315369 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00b0065f70 0x7f00b00b5990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f00980032b0 tx=0x7f00980091a0).ready entity=mon.2 client_cookie=f198cff28898fd8d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:45.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00ad59a700 1 -- 172.21.15.60:0/2947315369 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f009800b940 con 0x7f00b0065f70 2020-10-31T22:44:45.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00ad59a700 1 -- 172.21.15.60:0/2947315369 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009800baa0 con 0x7f00b0065f70 2020-10-31T22:44:45.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00ad59a700 1 -- 172.21.15.60:0/2947315369 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f009800bc10 con 0x7f00b0065f70 2020-10-31T22:44:45.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00b4bdd700 1 -- 172.21.15.60:0/2947315369 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00b0065f70 msgr2=0x7f00b00b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00b4bdd700 1 --2- 172.21.15.60:0/2947315369 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00b0065f70 0x7f00b00b5990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f00980032b0 tx=0x7f00980091a0).stop 2020-10-31T22:44:45.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00b4bdd700 1 -- 172.21.15.60:0/2947315369 shutdown_connections 2020-10-31T22:44:45.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00b4bdd700 1 --2- 172.21.15.60:0/2947315369 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00b0065f70 0x7f00b00b5990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00b4bdd700 1 -- 172.21.15.60:0/2947315369 >> 172.21.15.60:0/2947315369 conn(0x7f00b00601e0 msgr2=0x7f00b005b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:45.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00b4bdd700 1 -- 172.21.15.60:0/2947315369 shutdown_connections 2020-10-31T22:44:45.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00b4bdd700 1 -- 172.21.15.60:0/2947315369 wait complete. 2020-10-31T22:44:45.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00b4bdd700 1 Processor -- start 2020-10-31T22:44:45.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.583+0000 7f00b4bdd700 1 -- start start 2020-10-31T22:44:45.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00b4bdd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00b005c660 0x7f00b00b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00b4bdd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00b0065f70 0x7f00b00acff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00b4bdd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b00b2e20 0x7f00b00ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00b4bdd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00ad4e0 con 0x7f00b00b2e20 2020-10-31T22:44:45.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00b4bdd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00b1c20 con 0x7f00b0065f70 2020-10-31T22:44:45.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00b4bdd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b00b1ec0 con 0x7f00b005c660 2020-10-31T22:44:45.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00aed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b00b2e20 0x7f00b00ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00aed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b00b2e20 0x7f00b00ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44132/0 (socket says 172.21.15.60:44132) 2020-10-31T22:44:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00aed9d700 1 -- 172.21.15.60:0/1057437286 learned_addr learned my addr 172.21.15.60:0/1057437286 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00ae59c700 1 --2- 172.21.15.60:0/1057437286 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00b005c660 0x7f00b00b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00add9b700 1 --2- 172.21.15.60:0/1057437286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00b0065f70 0x7f00b00acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00aed9d700 1 -- 172.21.15.60:0/1057437286 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00b005c660 msgr2=0x7f00b00b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00aed9d700 1 --2- 172.21.15.60:0/1057437286 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00b005c660 0x7f00b00b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00aed9d700 1 -- 172.21.15.60:0/1057437286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00b0065f70 msgr2=0x7f00b00acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00aed9d700 1 --2- 172.21.15.60:0/1057437286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00b0065f70 0x7f00b00acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00aed9d700 1 -- 172.21.15.60:0/1057437286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b00aed70 con 0x7f00b00b2e20 2020-10-31T22:44:45.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00aed9d700 1 --2- 172.21.15.60:0/1057437286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b00b2e20 0x7f00b00ac590 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f00a80010d0 tx=0x7f00a8007920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:45.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00a77fe700 1 -- 172.21.15.60:0/1057437286 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00a800f470 con 0x7f00b00b2e20 2020-10-31T22:44:45.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00a77fe700 1 -- 172.21.15.60:0/1057437286 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a800f5d0 con 0x7f00b00b2e20 2020-10-31T22:44:45.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00a77fe700 1 -- 172.21.15.60:0/1057437286 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00a800f930 con 0x7f00b00b2e20 2020-10-31T22:44:45.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00b4bdd700 1 -- 172.21.15.60:0/1057437286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b00af010 con 0x7f00b00b2e20 2020-10-31T22:44:45.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00b4bdd700 1 -- 172.21.15.60:0/1057437286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b00aca80 con 0x7f00b00b2e20 2020-10-31T22:44:45.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.587+0000 7f00b4bdd700 1 -- 172.21.15.60:0/1057437286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b00af1a0 con 0x7f00b00b2e20 2020-10-31T22:44:45.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.591+0000 7f00a77fe700 1 -- 172.21.15.60:0/1057437286 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f00a8010070 con 0x7f00b00b2e20 2020-10-31T22:44:45.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.591+0000 7f00a77fe700 1 --2- 172.21.15.60:0/1057437286 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0088054f10 0x7f00880573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.591+0000 7f00a77fe700 1 -- 172.21.15.60:0/1057437286 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f00a806cd20 con 0x7f00b00b2e20 2020-10-31T22:44:45.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.591+0000 7f00ae59c700 1 --2- 172.21.15.60:0/1057437286 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0088054f10 0x7f00880573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.591+0000 7f00ae59c700 1 --2- 172.21.15.60:0/1057437286 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0088054f10 0x7f00880573d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f00a000d000 tx=0x7f00a0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:45.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.595+0000 7f00a77fe700 1 -- 172.21.15.60:0/1057437286 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f00a8043050 con 0x7f00b00b2e20 2020-10-31T22:44:45.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.739+0000 7f00b4bdd700 1 -- 172.21.15.60:0/1057437286 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f00b0057100 con 0x7f00b00b2e20 2020-10-31T22:44:45.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.739+0000 7f00a77fe700 1 -- 172.21.15.60:0/1057437286 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v54) v1 ==== 110+0+10 (secure 0 0 0) 0x7f00a8046670 con 0x7f00b00b2e20 2020-10-31T22:44:45.740 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:44:45.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.739+0000 7f00b4bdd700 1 -- 172.21.15.60:0/1057437286 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0088054f10 msgr2=0x7f00880573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.739+0000 7f00b4bdd700 1 --2- 172.21.15.60:0/1057437286 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0088054f10 0x7f00880573d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f00a000d000 tx=0x7f00a0009040).stop 2020-10-31T22:44:45.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.739+0000 7f00b4bdd700 1 -- 172.21.15.60:0/1057437286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b00b2e20 msgr2=0x7f00b00ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.739+0000 7f00b4bdd700 1 --2- 172.21.15.60:0/1057437286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b00b2e20 0x7f00b00ac590 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f00a80010d0 tx=0x7f00a8007920).stop 2020-10-31T22:44:45.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.739+0000 7f00b4bdd700 1 -- 172.21.15.60:0/1057437286 shutdown_connections 2020-10-31T22:44:45.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.739+0000 7f00b4bdd700 1 --2- 172.21.15.60:0/1057437286 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f00b00b2e20 0x7f00b00ac590 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.739+0000 7f00b4bdd700 1 --2- 172.21.15.60:0/1057437286 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00b005c660 0x7f00b00b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.739+0000 7f00b4bdd700 1 --2- 172.21.15.60:0/1057437286 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0088054f10 0x7f00880573d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.739+0000 7f00b4bdd700 1 --2- 172.21.15.60:0/1057437286 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00b0065f70 0x7f00b00acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.739+0000 7f00b4bdd700 1 -- 172.21.15.60:0/1057437286 >> 172.21.15.60:0/1057437286 conn(0x7f00b00601e0 msgr2=0x7f00b013d450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:45.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.739+0000 7f00b4bdd700 1 -- 172.21.15.60:0/1057437286 shutdown_connections 2020-10-31T22:44:45.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.739+0000 7f00b4bdd700 1 -- 172.21.15.60:0/1057437286 wait complete. 2020-10-31T22:44:45.753 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:44:45.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6359e700 1 Processor -- start 2020-10-31T22:44:45.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6359e700 1 -- start start 2020-10-31T22:44:45.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb64063140 0x7fdb640add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6359e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdb640b2820 0x7fdb640b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6359e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb64063520 con 0x7fdb640b1bd0 2020-10-31T22:44:45.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6359e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb640ae260 con 0x7fdb640b2820 2020-10-31T22:44:45.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb640b23f0 con 0x7fdb64063140 2020-10-31T22:44:45.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb62d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdb640b1bd0 0x7fdb64149af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48276/0 (socket says 172.21.15.60:48276) 2020-10-31T22:44:45.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb62d9d700 1 -- 172.21.15.60:0/2708708190 learned_addr learned my addr 172.21.15.60:0/2708708190 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb61d9b700 1 --2- 172.21.15.60:0/2708708190 >> v2:172.21.15.66:3300/0 conn(0x7fdb640b2820 0x7fdb640b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6259c700 1 --2- 172.21.15.60:0/2708708190 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb64063140 0x7fdb640add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6159a700 1 -- 172.21.15.60:0/2708708190 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281988790 0 0) 0x7fdb64063520 con 0x7fdb640b1bd0 2020-10-31T22:44:45.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6159a700 1 -- 172.21.15.60:0/2708708190 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb44003230 con 0x7fdb640b1bd0 2020-10-31T22:44:45.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6259c700 1 -- 172.21.15.60:0/2708708190 >> v2:172.21.15.66:3300/0 conn(0x7fdb640b2820 msgr2=0x7fdb640b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:45.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6259c700 1 --2- 172.21.15.60:0/2708708190 >> v2:172.21.15.66:3300/0 conn(0x7fdb640b2820 0x7fdb640b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6259c700 1 -- 172.21.15.60:0/2708708190 >> v1:172.21.15.60:6789/0 conn(0x7fdb640b1bd0 legacy=0x7fdb64149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6159a700 1 -- 172.21.15.60:0/2708708190 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 486000527 0 0) 0x7fdb44003230 con 0x7fdb640b1bd0 2020-10-31T22:44:45.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6259c700 1 -- 172.21.15.60:0/2708708190 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb640b2150 con 0x7fdb64063140 2020-10-31T22:44:45.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6259c700 1 --2- 172.21.15.60:0/2708708190 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb64063140 0x7fdb640add70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fdb54001870 tx=0x7fdb5c0091a0).ready entity=mon.2 client_cookie=3ce9773a938069d6 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:45.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6159a700 1 -- 172.21.15.60:0/2708708190 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb540016d0 con 0x7fdb64063140 2020-10-31T22:44:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6159a700 1 -- 172.21.15.60:0/2708708190 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c00b800 con 0x7fdb64063140 2020-10-31T22:44:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6159a700 1 -- 172.21.15.60:0/2708708190 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb5c00b970 con 0x7fdb64063140 2020-10-31T22:44:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6359e700 1 -- 172.21.15.60:0/2708708190 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb64063140 msgr2=0x7fdb640add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.871+0000 7fdb6359e700 1 --2- 172.21.15.60:0/2708708190 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb64063140 0x7fdb640add70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fdb54001870 tx=0x7fdb5c0091a0).stop 2020-10-31T22:44:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 -- 172.21.15.60:0/2708708190 shutdown_connections 2020-10-31T22:44:45.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 --2- 172.21.15.60:0/2708708190 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb64063140 0x7fdb640add70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 --2- 172.21.15.60:0/2708708190 >> v2:172.21.15.66:3300/0 conn(0x7fdb640b2820 0x7fdb640b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 -- 172.21.15.60:0/2708708190 >> 172.21.15.60:0/2708708190 conn(0x7fdb6406a600 msgr2=0x7fdb64060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 -- 172.21.15.60:0/2708708190 shutdown_connections 2020-10-31T22:44:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 -- 172.21.15.60:0/2708708190 wait complete. 2020-10-31T22:44:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 Processor -- start 2020-10-31T22:44:45.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 -- start start 2020-10-31T22:44:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb64063140 0x7fdb6405c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb640b1bd0 0x7fdb64158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb640b2820 0x7fdb64158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb641581a0 con 0x7fdb640b1bd0 2020-10-31T22:44:45.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6409e820 con 0x7fdb64063140 2020-10-31T22:44:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6409ea50 con 0x7fdb640b2820 2020-10-31T22:44:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb61d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb640b1bd0 0x7fdb64158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb62d9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb640b2820 0x7fdb64158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb61d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb640b1bd0 0x7fdb64158830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44142/0 (socket says 172.21.15.60:44142) 2020-10-31T22:44:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb61d9b700 1 -- 172.21.15.60:0/30805228 learned_addr learned my addr 172.21.15.60:0/30805228 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:45.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6259c700 1 --2- 172.21.15.60:0/30805228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb64063140 0x7fdb6405c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb61d9b700 1 -- 172.21.15.60:0/30805228 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb640b2820 msgr2=0x7fdb64158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb61d9b700 1 --2- 172.21.15.60:0/30805228 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb640b2820 0x7fdb64158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb61d9b700 1 -- 172.21.15.60:0/30805228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb64063140 msgr2=0x7fdb6405c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb61d9b700 1 --2- 172.21.15.60:0/30805228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb64063140 0x7fdb6405c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:45.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb61d9b700 1 -- 172.21.15.60:0/30805228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6409ecf0 con 0x7fdb640b1bd0 2020-10-31T22:44:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb61d9b700 1 --2- 172.21.15.60:0/30805228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb640b1bd0 0x7fdb64158830 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fdb4c00c000 tx=0x7fdb4c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb5b7fe700 1 -- 172.21.15.60:0/30805228 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb4c00c8b0 con 0x7fdb640b1bd0 2020-10-31T22:44:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 -- 172.21.15.60:0/30805228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb64158390 con 0x7fdb640b1bd0 2020-10-31T22:44:45.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb5b7fe700 1 -- 172.21.15.60:0/30805228 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4c00ca10 con 0x7fdb640b1bd0 2020-10-31T22:44:45.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb6359e700 1 -- 172.21.15.60:0/30805228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb64066aa0 con 0x7fdb640b1bd0 2020-10-31T22:44:45.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.875+0000 7fdb5b7fe700 1 -- 172.21.15.60:0/30805228 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb4c00cd70 con 0x7fdb640b1bd0 2020-10-31T22:44:45.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.879+0000 7fdb6359e700 1 -- 172.21.15.60:0/30805228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6409ee80 con 0x7fdb640b1bd0 2020-10-31T22:44:45.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.879+0000 7fdb5b7fe700 1 -- 172.21.15.60:0/30805228 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fdb4c022070 con 0x7fdb640b1bd0 2020-10-31T22:44:45.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.879+0000 7fdb5b7fe700 1 --2- 172.21.15.60:0/30805228 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdb48054f90 0x7fdb48057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:45.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.879+0000 7fdb5b7fe700 1 -- 172.21.15.60:0/30805228 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdb4c06df30 con 0x7fdb640b1bd0 2020-10-31T22:44:45.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.879+0000 7fdb6259c700 1 --2- 172.21.15.60:0/30805228 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdb48054f90 0x7fdb48057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:45.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.879+0000 7fdb6259c700 1 --2- 172.21.15.60:0/30805228 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdb48054f90 0x7fdb48057450 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fdb5c01b000 tx=0x7fdb5c016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:45.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:45.887+0000 7fdb5b7fe700 1 -- 172.21.15.60:0/30805228 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdb4c0443b0 con 0x7fdb640b1bd0 2020-10-31T22:44:46.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.027+0000 7fdb6359e700 1 -- 172.21.15.60:0/30805228 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdb64158520 con 0x7fdb640b1bd0 2020-10-31T22:44:46.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.027+0000 7fdb5b7fe700 1 -- 172.21.15.60:0/30805228 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v54) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdb4c0479d0 con 0x7fdb640b1bd0 2020-10-31T22:44:46.029 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:44:46.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.031+0000 7fdb6359e700 1 -- 172.21.15.60:0/30805228 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdb48054f90 msgr2=0x7fdb48057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.031+0000 7fdb6359e700 1 --2- 172.21.15.60:0/30805228 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdb48054f90 0x7fdb48057450 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7fdb5c01b000 tx=0x7fdb5c016000).stop 2020-10-31T22:44:46.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.031+0000 7fdb6359e700 1 -- 172.21.15.60:0/30805228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb640b1bd0 msgr2=0x7fdb64158830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.031+0000 7fdb6359e700 1 --2- 172.21.15.60:0/30805228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb640b1bd0 0x7fdb64158830 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7fdb4c00c000 tx=0x7fdb4c008040).stop 2020-10-31T22:44:46.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.031+0000 7fdb6359e700 1 -- 172.21.15.60:0/30805228 shutdown_connections 2020-10-31T22:44:46.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.031+0000 7fdb6359e700 1 --2- 172.21.15.60:0/30805228 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb640b2820 0x7fdb64158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.031+0000 7fdb6359e700 1 --2- 172.21.15.60:0/30805228 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdb48054f90 0x7fdb48057450 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.031+0000 7fdb6359e700 1 --2- 172.21.15.60:0/30805228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb64063140 0x7fdb6405c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.031+0000 7fdb6359e700 1 --2- 172.21.15.60:0/30805228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb640b1bd0 0x7fdb64158830 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.031+0000 7fdb6359e700 1 -- 172.21.15.60:0/30805228 >> 172.21.15.60:0/30805228 conn(0x7fdb6406a600 msgr2=0x7fdb640b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:46.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.031+0000 7fdb6359e700 1 -- 172.21.15.60:0/30805228 shutdown_connections 2020-10-31T22:44:46.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.031+0000 7fdb6359e700 1 -- 172.21.15.60:0/30805228 wait complete. 2020-10-31T22:44:46.042 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:44:46.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.147+0000 7fd3adc77700 1 Processor -- start 2020-10-31T22:44:46.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.147+0000 7fd3adc77700 1 -- start start 2020-10-31T22:44:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3adc77700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd3a80b1d50 0x7fd3a81420e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3adc77700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd3a80afc50 0x7fd3a813e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3adc77700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3a813ecc0 0x7fd3a80ae450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3adc77700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a80af200 con 0x7fd3a80b1d50 2020-10-31T22:44:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3adc77700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3a813e140 con 0x7fd3a80afc50 2020-10-31T22:44:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3adc77700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80b2130 con 0x7fd3a813ecc0 2020-10-31T22:44:46.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3acc75700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd3a80b1d50 0x7fd3a81420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3ad476700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3a813ecc0 0x7fd3a80ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3a7fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd3a80afc50 0x7fd3a813e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3acc75700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd3a80b1d50 0x7fd3a81420e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44152/0 (socket says 172.21.15.60:44152) 2020-10-31T22:44:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3ad476700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3a813ecc0 0x7fd3a80ae450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:57338/0 (socket says 172.21.15.60:57338) 2020-10-31T22:44:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3ad476700 1 -- 172.21.15.60:0/1440746747 learned_addr learned my addr 172.21.15.60:0/1440746747 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:46.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3ad476700 1 -- 172.21.15.60:0/1440746747 >> v2:172.21.15.66:3300/0 conn(0x7fd3a80afc50 msgr2=0x7fd3a813e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:46.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3ad476700 1 --2- 172.21.15.60:0/1440746747 >> v2:172.21.15.66:3300/0 conn(0x7fd3a80afc50 0x7fd3a813e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3ad476700 1 -- 172.21.15.60:0/1440746747 >> v2:172.21.15.60:3300/0 conn(0x7fd3a80b1d50 msgr2=0x7fd3a81420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:46.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3ad476700 1 --2- 172.21.15.60:0/1440746747 >> v2:172.21.15.60:3300/0 conn(0x7fd3a80b1d50 0x7fd3a81420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3ad476700 1 -- 172.21.15.60:0/1440746747 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a80af3f0 con 0x7fd3a813ecc0 2020-10-31T22:44:46.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3acc75700 1 --2- 172.21.15.60:0/1440746747 >> v2:172.21.15.60:3300/0 conn(0x7fd3a80b1d50 0x7fd3a81420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:44:46.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3ad476700 1 --2- 172.21.15.60:0/1440746747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3a813ecc0 0x7fd3a80ae450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd3a813e6b0 tx=0x7fd3a000a410).ready entity=mon.2 client_cookie=b7e31418daef640a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:46.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3a77fe700 1 -- 172.21.15.60:0/1440746747 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3a000ce10 con 0x7fd3a813ecc0 2020-10-31T22:44:46.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3a77fe700 1 -- 172.21.15.60:0/1440746747 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a0010410 con 0x7fd3a813ecc0 2020-10-31T22:44:46.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3adc77700 1 -- 172.21.15.60:0/1440746747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3a813ecc0 msgr2=0x7fd3a80ae450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3a77fe700 1 -- 172.21.15.60:0/1440746747 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3a0010770 con 0x7fd3a813ecc0 2020-10-31T22:44:46.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.151+0000 7fd3adc77700 1 --2- 172.21.15.60:0/1440746747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3a813ecc0 0x7fd3a80ae450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fd3a813e6b0 tx=0x7fd3a000a410).stop 2020-10-31T22:44:46.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 -- 172.21.15.60:0/1440746747 shutdown_connections 2020-10-31T22:44:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 --2- 172.21.15.60:0/1440746747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3a813ecc0 0x7fd3a80ae450 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 --2- 172.21.15.60:0/1440746747 >> v2:172.21.15.60:3300/0 conn(0x7fd3a80b1d50 0x7fd3a81420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 --2- 172.21.15.60:0/1440746747 >> v2:172.21.15.66:3300/0 conn(0x7fd3a80afc50 0x7fd3a813e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 -- 172.21.15.60:0/1440746747 >> 172.21.15.60:0/1440746747 conn(0x7fd3a80b5330 msgr2=0x7fd3a80b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:46.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 -- 172.21.15.60:0/1440746747 shutdown_connections 2020-10-31T22:44:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 -- 172.21.15.60:0/1440746747 wait complete. 2020-10-31T22:44:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 Processor -- start 2020-10-31T22:44:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 -- start start 2020-10-31T22:44:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3a80afc50 0x7fd3a80aae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3a80b1d50 0x7fd3a814c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3a813ecc0 0x7fd3a814cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a8150580 con 0x7fd3a80afc50 2020-10-31T22:44:46.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a8063390 con 0x7fd3a813ecc0 2020-10-31T22:44:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3adc77700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a80ab7b0 con 0x7fd3a80b1d50 2020-10-31T22:44:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3acc75700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3a80afc50 0x7fd3a80aae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3acc75700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3a80afc50 0x7fd3a80aae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44158/0 (socket says 172.21.15.60:44158) 2020-10-31T22:44:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3acc75700 1 -- 172.21.15.60:0/837317870 learned_addr learned my addr 172.21.15.60:0/837317870 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3a7fff700 1 --2- 172.21.15.60:0/837317870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3a80b1d50 0x7fd3a814c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3ad476700 1 --2- 172.21.15.60:0/837317870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3a813ecc0 0x7fd3a814cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3acc75700 1 -- 172.21.15.60:0/837317870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3a80b1d50 msgr2=0x7fd3a814c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3acc75700 1 --2- 172.21.15.60:0/837317870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3a80b1d50 0x7fd3a814c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3acc75700 1 -- 172.21.15.60:0/837317870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3a813ecc0 msgr2=0x7fd3a814cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3acc75700 1 --2- 172.21.15.60:0/837317870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3a813ecc0 0x7fd3a814cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3acc75700 1 -- 172.21.15.60:0/837317870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a8150770 con 0x7fd3a80afc50 2020-10-31T22:44:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.155+0000 7fd3acc75700 1 --2- 172.21.15.60:0/837317870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3a80afc50 0x7fd3a80aae60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fd39c00c000 tx=0x7fd39c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:46.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.159+0000 7fd3a5ffb700 1 -- 172.21.15.60:0/837317870 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd39c00cb90 con 0x7fd3a80afc50 2020-10-31T22:44:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.159+0000 7fd3a5ffb700 1 -- 172.21.15.60:0/837317870 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39c00ccf0 con 0x7fd3a80afc50 2020-10-31T22:44:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.159+0000 7fd3adc77700 1 -- 172.21.15.60:0/837317870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a8150a10 con 0x7fd3a80afc50 2020-10-31T22:44:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.159+0000 7fd3a5ffb700 1 -- 172.21.15.60:0/837317870 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd39c0125e0 con 0x7fd3a80afc50 2020-10-31T22:44:46.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.159+0000 7fd3adc77700 1 -- 172.21.15.60:0/837317870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a80ab3d0 con 0x7fd3a80afc50 2020-10-31T22:44:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.159+0000 7fd3adc77700 1 -- 172.21.15.60:0/837317870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a8062d10 con 0x7fd3a80afc50 2020-10-31T22:44:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.159+0000 7fd3a5ffb700 1 -- 172.21.15.60:0/837317870 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd39c012740 con 0x7fd3a80afc50 2020-10-31T22:44:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.159+0000 7fd3a5ffb700 1 --2- 172.21.15.60:0/837317870 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd390057120 0x7fd3900595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.159+0000 7fd3a5ffb700 1 -- 172.21.15.60:0/837317870 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd39c06e170 con 0x7fd3a80afc50 2020-10-31T22:44:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.159+0000 7fd3a7fff700 1 --2- 172.21.15.60:0/837317870 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd390057120 0x7fd3900595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.163+0000 7fd3a7fff700 1 --2- 172.21.15.60:0/837317870 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd390057120 0x7fd3900595e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fd39400b000 tx=0x7fd394006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:46.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.167+0000 7fd3a5ffb700 1 -- 172.21.15.60:0/837317870 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd39c0445f0 con 0x7fd3a80afc50 2020-10-31T22:44:46.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.311+0000 7fd3adc77700 1 -- 172.21.15.60:0/837317870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3a80630c0 con 0x7fd3a80afc50 2020-10-31T22:44:46.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.311+0000 7fd3a5ffb700 1 -- 172.21.15.60:0/837317870 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd39c00ce60 con 0x7fd3a80afc50 2020-10-31T22:44:46.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.315+0000 7fd3adc77700 1 -- 172.21.15.60:0/837317870 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd390057120 msgr2=0x7fd3900595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.315+0000 7fd3adc77700 1 --2- 172.21.15.60:0/837317870 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd390057120 0x7fd3900595e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fd39400b000 tx=0x7fd394006dc0).stop 2020-10-31T22:44:46.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.315+0000 7fd3adc77700 1 -- 172.21.15.60:0/837317870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3a80afc50 msgr2=0x7fd3a80aae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.315+0000 7fd3adc77700 1 --2- 172.21.15.60:0/837317870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3a80afc50 0x7fd3a80aae60 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7fd39c00c000 tx=0x7fd39c006dc0).stop 2020-10-31T22:44:46.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.315+0000 7fd3adc77700 1 -- 172.21.15.60:0/837317870 shutdown_connections 2020-10-31T22:44:46.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.315+0000 7fd3adc77700 1 --2- 172.21.15.60:0/837317870 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd390057120 0x7fd3900595e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.315+0000 7fd3adc77700 1 --2- 172.21.15.60:0/837317870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3a813ecc0 0x7fd3a814cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.315+0000 7fd3adc77700 1 --2- 172.21.15.60:0/837317870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3a80afc50 0x7fd3a80aae60 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.315+0000 7fd3adc77700 1 --2- 172.21.15.60:0/837317870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3a80b1d50 0x7fd3a814c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.315+0000 7fd3adc77700 1 -- 172.21.15.60:0/837317870 >> 172.21.15.60:0/837317870 conn(0x7fd3a80b5330 msgr2=0x7fd3a805afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.315+0000 7fd3adc77700 1 -- 172.21.15.60:0/837317870 shutdown_connections 2020-10-31T22:44:46.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.315+0000 7fd3adc77700 1 -- 172.21.15.60:0/837317870 wait complete. 2020-10-31T22:44:46.319 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:44:46.332 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:44:46.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.447+0000 7fb6fbed0700 1 Processor -- start 2020-10-31T22:44:46.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.447+0000 7fb6fbed0700 1 -- start start 2020-10-31T22:44:46.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.447+0000 7fb6fbed0700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb6f40af1e0 0x7fb6f414d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.447+0000 7fb6fbed0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f40631f0 con 0x7fb6f405afe0 2020-10-31T22:44:46.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.447+0000 7fb6fbed0700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f41454d0 con 0x7fb6f4062e10 2020-10-31T22:44:46.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.447+0000 7fb6fbed0700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f40b1840 con 0x7fb6f40af1e0 2020-10-31T22:44:46.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6f946b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb6f405afe0 0x7fb6f40aead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48300/0 (socket says 172.21.15.60:48300) 2020-10-31T22:44:46.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6f946b700 1 -- 172.21.15.60:0/609717100 learned_addr learned my addr 172.21.15.60:0/609717100 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:46.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6fa46d700 1 --2- 172.21.15.60:0/609717100 >> v2:172.21.15.66:3300/0 conn(0x7fb6f40af1e0 0x7fb6f414d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6f8c6a700 1 -- 172.21.15.60:0/609717100 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186893188 0 0) 0x7fb6f40631f0 con 0x7fb6f405afe0 2020-10-31T22:44:46.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6f8c6a700 1 -- 172.21.15.60:0/609717100 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6e0003230 con 0x7fb6f405afe0 2020-10-31T22:44:46.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6fa46d700 1 -- 172.21.15.60:0/609717100 >> v1:172.21.15.66:6789/0 conn(0x7fb6f4062e10 legacy=0x7fb6f40afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6fa46d700 1 -- 172.21.15.60:0/609717100 >> v1:172.21.15.60:6789/0 conn(0x7fb6f405afe0 legacy=0x7fb6f40aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6fa46d700 1 -- 172.21.15.60:0/609717100 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f4145770 con 0x7fb6f40af1e0 2020-10-31T22:44:46.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6fa46d700 1 --2- 172.21.15.60:0/609717100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6f40af1e0 0x7fb6f414d820 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fb6ec002f30 tx=0x7fb6ec006dc0).ready entity=mon.1 client_cookie=eef11b94f2d2ff4d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:46.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6f8c6a700 1 -- 172.21.15.60:0/609717100 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6ec009800 con 0x7fb6f40af1e0 2020-10-31T22:44:46.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6f8c6a700 1 -- 172.21.15.60:0/609717100 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec009960 con 0x7fb6f40af1e0 2020-10-31T22:44:46.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6f8c6a700 1 -- 172.21.15.60:0/609717100 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6ec009cc0 con 0x7fb6f40af1e0 2020-10-31T22:44:46.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6fbed0700 1 -- 172.21.15.60:0/609717100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6f40af1e0 msgr2=0x7fb6f414d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6fbed0700 1 --2- 172.21.15.60:0/609717100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6f40af1e0 0x7fb6f414d820 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7fb6ec002f30 tx=0x7fb6ec006dc0).stop 2020-10-31T22:44:46.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6fbed0700 1 -- 172.21.15.60:0/609717100 shutdown_connections 2020-10-31T22:44:46.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6fbed0700 1 --2- 172.21.15.60:0/609717100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6f40af1e0 0x7fb6f414d820 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6fbed0700 1 -- 172.21.15.60:0/609717100 >> 172.21.15.60:0/609717100 conn(0x7fb6f405fae0 msgr2=0x7fb6f405fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:46.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6fbed0700 1 -- 172.21.15.60:0/609717100 shutdown_connections 2020-10-31T22:44:46.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.451+0000 7fb6fbed0700 1 -- 172.21.15.60:0/609717100 wait complete. 2020-10-31T22:44:46.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6fbed0700 1 Processor -- start 2020-10-31T22:44:46.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6fbed0700 1 -- start start 2020-10-31T22:44:46.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6fbed0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6f405afe0 0x7fb6f4067420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6fbed0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb6f4062e10 0x7fb6f40ab760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6fbed0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6f40af1e0 0x7fb6f4148760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6fbed0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f4065930 con 0x7fb6f405afe0 2020-10-31T22:44:46.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6fbed0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f40a88c0 con 0x7fb6f40af1e0 2020-10-31T22:44:46.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6fbed0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f4064d20 con 0x7fb6f4062e10 2020-10-31T22:44:46.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6f9c6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6f405afe0 0x7fb6f4067420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6f9c6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6f405afe0 0x7fb6f4067420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44168/0 (socket says 172.21.15.60:44168) 2020-10-31T22:44:46.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6f9c6c700 1 -- 172.21.15.60:0/4231513684 learned_addr learned my addr 172.21.15.60:0/4231513684 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:46.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6f946b700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb6f4062e10 0x7fb6f40ab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6fa46d700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6f40af1e0 0x7fb6f4148760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6f9c6c700 1 -- 172.21.15.60:0/4231513684 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb6f4062e10 msgr2=0x7fb6f40ab760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6f9c6c700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb6f4062e10 0x7fb6f40ab760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6f9c6c700 1 -- 172.21.15.60:0/4231513684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6f40af1e0 msgr2=0x7fb6f4148760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6f9c6c700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6f40af1e0 0x7fb6f4148760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.455+0000 7fb6f9c6c700 1 -- 172.21.15.60:0/4231513684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f4066fc0 con 0x7fb6f405afe0 2020-10-31T22:44:46.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.459+0000 7fb6f946b700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb6f4062e10 0x7fb6f40ab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:44:46.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.459+0000 7fb6f9c6c700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6f405afe0 0x7fb6f4067420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fb6f40635a0 tx=0x7fb6e4007ed0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:46.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.459+0000 7fb6f2ffd700 1 -- 172.21.15.60:0/4231513684 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e400ce40 con 0x7fb6f405afe0 2020-10-31T22:44:46.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.459+0000 7fb6f2ffd700 1 -- 172.21.15.60:0/4231513684 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e4006a70 con 0x7fb6f405afe0 2020-10-31T22:44:46.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.459+0000 7fb6fbed0700 1 -- 172.21.15.60:0/4231513684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f40a8680 con 0x7fb6f405afe0 2020-10-31T22:44:46.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.459+0000 7fb6f2ffd700 1 -- 172.21.15.60:0/4231513684 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb6e4006dd0 con 0x7fb6f405afe0 2020-10-31T22:44:46.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.459+0000 7fb6fbed0700 1 -- 172.21.15.60:0/4231513684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f4149310 con 0x7fb6f405afe0 2020-10-31T22:44:46.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.459+0000 7fb6fbed0700 1 -- 172.21.15.60:0/4231513684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f4067180 con 0x7fb6f405afe0 2020-10-31T22:44:46.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.459+0000 7fb6f2ffd700 1 -- 172.21.15.60:0/4231513684 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb6e4010030 con 0x7fb6f405afe0 2020-10-31T22:44:46.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.459+0000 7fb6f2ffd700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb6d4054f10 0x7fb6d40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.459+0000 7fb6f2ffd700 1 -- 172.21.15.60:0/4231513684 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb6e406d770 con 0x7fb6f405afe0 2020-10-31T22:44:46.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.459+0000 7fb6f946b700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb6d4054f10 0x7fb6d40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.459+0000 7fb6f946b700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb6d4054f10 0x7fb6d40573d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fb6e800d000 tx=0x7fb6e8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:46.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.463+0000 7fb6f2ffd700 1 -- 172.21.15.60:0/4231513684 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb6f4067180 con 0x7fb6f405afe0 2020-10-31T22:44:46.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.607+0000 7fb6fbed0700 1 -- 172.21.15.60:0/4231513684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb6f4067150 con 0x7fb6f405afe0 2020-10-31T22:44:46.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.607+0000 7fb6f2ffd700 1 -- 172.21.15.60:0/4231513684 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb6e4043b80 con 0x7fb6f405afe0 2020-10-31T22:44:46.611 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:44:46.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.611+0000 7fb6fbed0700 1 -- 172.21.15.60:0/4231513684 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb6d4054f10 msgr2=0x7fb6d40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.611+0000 7fb6fbed0700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb6d4054f10 0x7fb6d40573d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fb6e800d000 tx=0x7fb6e8009040).stop 2020-10-31T22:44:46.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.611+0000 7fb6fbed0700 1 -- 172.21.15.60:0/4231513684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6f405afe0 msgr2=0x7fb6f4067420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.611+0000 7fb6fbed0700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6f405afe0 0x7fb6f4067420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7fb6f40635a0 tx=0x7fb6e4007ed0).stop 2020-10-31T22:44:46.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.611+0000 7fb6fbed0700 1 -- 172.21.15.60:0/4231513684 shutdown_connections 2020-10-31T22:44:46.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.611+0000 7fb6fbed0700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb6d4054f10 0x7fb6d40573d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.611+0000 7fb6fbed0700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb6f40af1e0 0x7fb6f4148760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.611+0000 7fb6fbed0700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb6f405afe0 0x7fb6f4067420 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.611+0000 7fb6fbed0700 1 --2- 172.21.15.60:0/4231513684 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb6f4062e10 0x7fb6f40ab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.611+0000 7fb6fbed0700 1 -- 172.21.15.60:0/4231513684 >> 172.21.15.60:0/4231513684 conn(0x7fb6f405fae0 msgr2=0x7fb6f4144d00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:46.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.611+0000 7fb6fbed0700 1 -- 172.21.15.60:0/4231513684 shutdown_connections 2020-10-31T22:44:46.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.611+0000 7fb6fbed0700 1 -- 172.21.15.60:0/4231513684 wait complete. 2020-10-31T22:44:46.626 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:44:46.626 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:44:46.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.735+0000 7ff21e042700 1 Processor -- start 2020-10-31T22:44:46.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.735+0000 7ff21e042700 1 -- start start 2020-10-31T22:44:46.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff21e042700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff21805c0f0 0x7ff2180b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff21e042700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff21813eca0 0x7ff21813f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff21e042700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2180b21b0 con 0x7ff2180b1dd0 2020-10-31T22:44:46.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff21e042700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2180ac6b0 con 0x7ff21813eca0 2020-10-31T22:44:46.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff21e042700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21813c9e0 con 0x7ff21805c0f0 2020-10-31T22:44:46.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff2177fe700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff2180b1dd0 0x7ff2180b0640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:46180/0 (socket says 172.21.15.60:46180) 2020-10-31T22:44:46.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff2177fe700 1 -- 172.21.15.60:0/1035359929 learned_addr learned my addr 172.21.15.60:0/1035359929 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:44:46.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff217fff700 1 --2- 172.21.15.60:0/1035359929 >> v2:172.21.15.66:3300/0 conn(0x7ff21813eca0 0x7ff21813f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff216ffd700 1 --2- 172.21.15.60:0/1035359929 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff21805c0f0 0x7ff2180b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff217fff700 1 -- 172.21.15.60:0/1035359929 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff21805c0f0 msgr2=0x7ff2180b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:44:46.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff217fff700 1 --2- 172.21.15.60:0/1035359929 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff21805c0f0 0x7ff2180b0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff217fff700 1 -- 172.21.15.60:0/1035359929 >> v1:172.21.15.66:6789/0 conn(0x7ff2180b1dd0 legacy=0x7ff2180b0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff217fff700 1 -- 172.21.15.60:0/1035359929 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff218061e40 con 0x7ff21813eca0 2020-10-31T22:44:46.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff217fff700 1 --2- 172.21.15.60:0/1035359929 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff21813eca0 0x7ff21813f100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7ff2100032b0 tx=0x7ff2100091a0).ready entity=mon.1 client_cookie=3941136dd9c1a5d3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:46.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff2167fc700 1 -- 172.21.15.60:0/1035359929 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff21000ba30 con 0x7ff21813eca0 2020-10-31T22:44:46.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff2167fc700 1 -- 172.21.15.60:0/1035359929 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21000bb90 con 0x7ff21813eca0 2020-10-31T22:44:46.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff2167fc700 1 -- 172.21.15.60:0/1035359929 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff21000bd00 con 0x7ff21813eca0 2020-10-31T22:44:46.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff21e042700 1 -- 172.21.15.60:0/1035359929 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff21813eca0 msgr2=0x7ff21813f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff21e042700 1 --2- 172.21.15.60:0/1035359929 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff21813eca0 0x7ff21813f100 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7ff2100032b0 tx=0x7ff2100091a0).stop 2020-10-31T22:44:46.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff21e042700 1 -- 172.21.15.60:0/1035359929 shutdown_connections 2020-10-31T22:44:46.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff21e042700 1 --2- 172.21.15.60:0/1035359929 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff21813eca0 0x7ff21813f100 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff21e042700 1 --2- 172.21.15.60:0/1035359929 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff21805c0f0 0x7ff2180b0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff21e042700 1 -- 172.21.15.60:0/1035359929 >> 172.21.15.60:0/1035359929 conn(0x7ff218062310 msgr2=0x7ff218062720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:46.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff21e042700 1 -- 172.21.15.60:0/1035359929 shutdown_connections 2020-10-31T22:44:46.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.739+0000 7ff21e042700 1 -- 172.21.15.60:0/1035359929 wait complete. 2020-10-31T22:44:46.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.743+0000 7ff21e042700 1 Processor -- start 2020-10-31T22:44:46.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.743+0000 7ff21e042700 1 -- start start 2020-10-31T22:44:46.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff21e042700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff21805c0f0 0x7ff2181386a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff21e042700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2180b1dd0 0x7ff2180653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff21e042700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff21813eca0 0x7ff2180658d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff21e042700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff218065dc0 con 0x7ff2180b1dd0 2020-10-31T22:44:46.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff21e042700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff218066d10 con 0x7ff21805c0f0 2020-10-31T22:44:46.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff21e042700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff218066f40 con 0x7ff21813eca0 2020-10-31T22:44:46.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff216ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2180b1dd0 0x7ff2180653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff216ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2180b1dd0 0x7ff2180653e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44184/0 (socket says 172.21.15.60:44184) 2020-10-31T22:44:46.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff216ffd700 1 -- 172.21.15.60:0/2065546671 learned_addr learned my addr 172.21.15.60:0/2065546671 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:44:46.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff217fff700 1 --2- 172.21.15.60:0/2065546671 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff21813eca0 0x7ff2180658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff2177fe700 1 --2- 172.21.15.60:0/2065546671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff21805c0f0 0x7ff2181386a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff216ffd700 1 -- 172.21.15.60:0/2065546671 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff21813eca0 msgr2=0x7ff2180658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff216ffd700 1 --2- 172.21.15.60:0/2065546671 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff21813eca0 0x7ff2180658d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff216ffd700 1 -- 172.21.15.60:0/2065546671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff21805c0f0 msgr2=0x7ff2181386a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff216ffd700 1 --2- 172.21.15.60:0/2065546671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff21805c0f0 0x7ff2181386a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff216ffd700 1 -- 172.21.15.60:0/2065546671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2180630b0 con 0x7ff2180b1dd0 2020-10-31T22:44:46.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff216ffd700 1 --2- 172.21.15.60:0/2065546671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2180b1dd0 0x7ff2180653e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7ff20c00c000 tx=0x7ff20c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:46.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff214ff9700 1 -- 172.21.15.60:0/2065546671 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff20c00ca10 con 0x7ff2180b1dd0 2020-10-31T22:44:46.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff214ff9700 1 -- 172.21.15.60:0/2065546671 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c00cb70 con 0x7ff2180b1dd0 2020-10-31T22:44:46.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff21e042700 1 -- 172.21.15.60:0/2065546671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff218063350 con 0x7ff2180b1dd0 2020-10-31T22:44:46.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff214ff9700 1 -- 172.21.15.60:0/2065546671 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff20c0123f0 con 0x7ff2180b1dd0 2020-10-31T22:44:46.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff21e042700 1 -- 172.21.15.60:0/2065546671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff218138b90 con 0x7ff2180b1dd0 2020-10-31T22:44:46.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.747+0000 7ff21e042700 1 -- 172.21.15.60:0/2065546671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2180634e0 con 0x7ff2180b1dd0 2020-10-31T22:44:46.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.751+0000 7ff214ff9700 1 -- 172.21.15.60:0/2065546671 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff20c012550 con 0x7ff2180b1dd0 2020-10-31T22:44:46.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.751+0000 7ff214ff9700 1 --2- 172.21.15.60:0/2065546671 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff1f8054f10 0x7ff1f80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:44:46.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.751+0000 7ff214ff9700 1 -- 172.21.15.60:0/2065546671 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff20c06def0 con 0x7ff2180b1dd0 2020-10-31T22:44:46.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.751+0000 7ff2177fe700 1 --2- 172.21.15.60:0/2065546671 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff1f8054f10 0x7ff1f80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:44:46.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.751+0000 7ff2177fe700 1 --2- 172.21.15.60:0/2065546671 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff1f8054f10 0x7ff1f80573d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7ff20800d000 tx=0x7ff208009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:44:46.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.755+0000 7ff214ff9700 1 -- 172.21.15.60:0/2065546671 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff20c0442a0 con 0x7ff2180b1dd0 2020-10-31T22:44:46.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.947+0000 7ff21e042700 1 -- 172.21.15.60:0/2065546671 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff218057100 con 0x7ff2180b1dd0 2020-10-31T22:44:46.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.947+0000 7ff214ff9700 1 -- 172.21.15.60:0/2065546671 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+2486 (secure 0 0 0) 0x7ff20c0478c0 con 0x7ff2180b1dd0 2020-10-31T22:44:46.949 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:44:46.949 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5180,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3826848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3826848450},{"type":"v1","addr":"172.21.15.66:6833","nonce":3826848450}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5544,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/821344830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":821344830},{"type":"v1","addr":"172.21.15.60:6835","nonce":821344830}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:44:41.510512+0000","modified":"2020-10-31T22:44:43.018399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/798359639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":798359639},{"type":"v1","addr":"172.21.15.60:6837","nonce":798359639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-10-31T22:44:46.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.947+0000 7ff21e042700 1 -- 172.21.15.60:0/2065546671 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff1f8054f10 msgr2=0x7ff1f80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.947+0000 7ff21e042700 1 --2- 172.21.15.60:0/2065546671 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff1f8054f10 0x7ff1f80573d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7ff20800d000 tx=0x7ff208009040).stop 2020-10-31T22:44:46.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.947+0000 7ff21e042700 1 -- 172.21.15.60:0/2065546671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2180b1dd0 msgr2=0x7ff2180653e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:44:46.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.947+0000 7ff21e042700 1 --2- 172.21.15.60:0/2065546671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2180b1dd0 0x7ff2180653e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7ff20c00c000 tx=0x7ff20c006dc0).stop 2020-10-31T22:44:46.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.947+0000 7ff21e042700 1 -- 172.21.15.60:0/2065546671 shutdown_connections 2020-10-31T22:44:46.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.947+0000 7ff21e042700 1 --2- 172.21.15.60:0/2065546671 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff21813eca0 0x7ff2180658d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.947+0000 7ff21e042700 1 --2- 172.21.15.60:0/2065546671 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff1f8054f10 0x7ff1f80573d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.947+0000 7ff21e042700 1 --2- 172.21.15.60:0/2065546671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff21805c0f0 0x7ff2181386a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.947+0000 7ff21e042700 1 --2- 172.21.15.60:0/2065546671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff2180b1dd0 0x7ff2180653e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:44:46.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.947+0000 7ff21e042700 1 -- 172.21.15.60:0/2065546671 >> 172.21.15.60:0/2065546671 conn(0x7ff218062310 msgr2=0x7ff2180b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:44:46.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.947+0000 7ff21e042700 1 -- 172.21.15.60:0/2065546671 shutdown_connections 2020-10-31T22:44:46.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:44:46.947+0000 7ff21e042700 1 -- 172.21.15.60:0/2065546671 wait complete. 2020-10-31T22:44:46.954 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 23 2020-10-31T22:44:47.270 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:44:41.510512+0000', 'modified': '2020-10-31T22:44:43.018399+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5553}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5553': {'gid': 5553, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/798359639', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 798359639}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 798359639}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:44:47.271 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:44:47.272 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:44:47.404 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":5553,"want_state":"up:active","state":"up:active","rank_uptime":5.8817128609999996,"mdsmap_epoch":23,"osdmap_epoch":54,"osdmap_epoch_barrier":54,"uptime":11.252364299} 2020-10-31T22:44:47.405 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 5553, "mdsmap_epoch": 23, "osdmap_epoch": 54, "osdmap_epoch_barrier": 54, "rank_uptime": 5.881712861, "state": "up:active", "uptime": 11.252364299, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:44:47.405 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:44:47.406 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:44:47.407 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:44:47.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:44:47.408 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:44:47.418 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:44:47.476 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:44:47.477 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:44:47.532 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:44:47.533 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:44:47.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:44:47.534 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:44:47.583 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:44:47.584 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:44:47.627 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:44:47.645 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:44:47.646 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:44:47.703 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:44:47.704 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:44:47.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:44:47.705 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:44:47.706 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:44:47.704+0000 7f2e50e0a0c0 -1 init, newargv = 0x564debe6bf20 newargc=9ceph-fuse[13276]: starting ceph client 2020-10-31T22:44:47.706 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr: 2020-10-31T22:44:47.716 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13276]: starting fuse 2020-10-31T22:44:48.813 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:44:48.828 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:44:48.829 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:44:48.881 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:44:48.882 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:44:48.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:44:48.883 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:44:48.935 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:44:48.936 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:44:48.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:44:48.937 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:44:48.937 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:44:48.937 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:44:48.938 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:44:48.938 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:44:48.939 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:44:48.939 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:44:48.939 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:44:48.940 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:44:48.940 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:44:48.940 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:44:48.941 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:44:48.941 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:44:48.941 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:44:48.941 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:44:48.942 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:44:48.942 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:44:48.942 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:44:48.943 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:44:48.943 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:44:48.943 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:44:48.944 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:44:48.944 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:44:49.024 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.13276.asok 2020-10-31T22:44:49.029 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13276.asok 2020-10-31T22:44:49.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:44:49.031 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13276.asok status 2020-10-31T22:44:49.129 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:44:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:44:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:44:49.130 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:44:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:44:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:44:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:44:49.131 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "13276", 2020-10-31T22:44:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:44:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:44:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:44:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:44:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 5599, 2020-10-31T22:44:49.132 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:44:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:44:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:44:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5599 2020-10-31T22:44:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:44:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:44:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:44:49.133 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:44:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 1776747274 2020-10-31T22:44:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:44:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:44:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:44:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:44:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:44:49.134 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 1776747274 2020-10-31T22:44:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:44:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.5599 172.21.15.152:0/1776747274", 2020-10-31T22:44:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/1776747274", 2020-10-31T22:44:49.135 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:44:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 23, 2020-10-31T22:44:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 54, 2020-10-31T22:44:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:44:49.136 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:44:49.136 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:44:49.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:44:49.139 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:44:49.140 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:44:49.146 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:44:49.147 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:44:49.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:44:49.148 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:44:49.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:44:49.210 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:44:49.211 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:44:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:44:49.260 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:44:49.261 INFO:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-10-31T22:44:49.261 INFO:teuthology.orchestra.run.smithi152:> import sys 2020-10-31T22:44:49.262 INFO:teuthology.orchestra.run.smithi152:> import time 2020-10-31T22:44:49.262 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:44:49.262 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:44:49.263 INFO:teuthology.orchestra.run.smithi152:> n = 1000 2020-10-31T22:44:49.263 INFO:teuthology.orchestra.run.smithi152:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2020-10-31T22:44:49.263 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:44:49.263 INFO:teuthology.orchestra.run.smithi152:> if not os.path.exists(os.path.dirname(abs_path)): 2020-10-31T22:44:49.264 INFO:teuthology.orchestra.run.smithi152:> os.makedirs(os.path.dirname(abs_path)) 2020-10-31T22:44:49.264 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:44:49.264 INFO:teuthology.orchestra.run.smithi152:> for i in range(0, n): 2020-10-31T22:44:49.265 INFO:teuthology.orchestra.run.smithi152:> fname = "{0}_{1}".format(abs_path, i) 2020-10-31T22:44:49.265 INFO:teuthology.orchestra.run.smithi152:> with open(fname, '"'"'w'"'"') as f: 2020-10-31T22:44:49.265 INFO:teuthology.orchestra.run.smithi152:> f.write('"'"'content'"'"') 2020-10-31T22:44:49.265 INFO:teuthology.orchestra.run.smithi152:> if True: 2020-10-31T22:44:49.266 INFO:teuthology.orchestra.run.smithi152:> f.flush() 2020-10-31T22:44:49.266 INFO:teuthology.orchestra.run.smithi152:> os.fsync(f.fileno()) 2020-10-31T22:44:49.267 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:45:01.988 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:45:02.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f54291ef700 1 Processor -- start 2020-10-31T22:45:02.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f54291ef700 1 -- start start 2020-10-31T22:45:02.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f54291ef700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f542405b960 0x7f542405bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:02.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f54291ef700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f54240a7850 0x7f54240aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:02.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f54291ef700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54240aefe0 0x7f5424146790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:02.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f54291ef700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54240b0f00 con 0x7f54240a7850 2020-10-31T22:45:02.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f54291ef700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54240b11a0 con 0x7f542405b960 2020-10-31T22:45:02.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f54291ef700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54240b1440 con 0x7f54240aefe0 2020-10-31T22:45:02.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f542259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f54240a7850 0x7f54240aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:02.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f542259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f54240a7850 0x7f54240aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44190/0 (socket says 172.21.15.60:44190) 2020-10-31T22:45:02.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f542259c700 1 -- 172.21.15.60:0/2069897701 learned_addr learned my addr 172.21.15.60:0/2069897701 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:02.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f542359e700 1 --2- 172.21.15.60:0/2069897701 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54240aefe0 0x7f5424146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:02.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f5422d9d700 1 --2- 172.21.15.60:0/2069897701 >> v2:172.21.15.66:3300/0 conn(0x7f542405b960 0x7f542405bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:02.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f542259c700 1 -- 172.21.15.60:0/2069897701 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54240aefe0 msgr2=0x7f5424146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:02.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f542259c700 1 --2- 172.21.15.60:0/2069897701 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54240aefe0 0x7f5424146790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f542259c700 1 -- 172.21.15.60:0/2069897701 >> v2:172.21.15.66:3300/0 conn(0x7f542405b960 msgr2=0x7f542405bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:02.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f542259c700 1 --2- 172.21.15.60:0/2069897701 >> v2:172.21.15.66:3300/0 conn(0x7f542405b960 0x7f542405bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f542259c700 1 -- 172.21.15.60:0/2069897701 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54241462f0 con 0x7f54240a7850 2020-10-31T22:45:02.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f542259c700 1 --2- 172.21.15.60:0/2069897701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54240a7850 0x7f54240aeaf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f54140032b0 tx=0x7f5414009270).ready entity=mon.0 client_cookie=4952843b6b85fd82 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:02.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f5421d9b700 1 -- 172.21.15.60:0/2069897701 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5414009e60 con 0x7f54240a7850 2020-10-31T22:45:02.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f5421d9b700 1 -- 172.21.15.60:0/2069897701 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541400bb50 con 0x7f54240a7850 2020-10-31T22:45:02.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f5421d9b700 1 -- 172.21.15.60:0/2069897701 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f541400bcc0 con 0x7f54240a7850 2020-10-31T22:45:02.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f54291ef700 1 -- 172.21.15.60:0/2069897701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54240a7850 msgr2=0x7f54240aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:02.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.107+0000 7f54291ef700 1 --2- 172.21.15.60:0/2069897701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54240a7850 0x7f54240aeaf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7f54140032b0 tx=0x7f5414009270).stop 2020-10-31T22:45:02.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 -- 172.21.15.60:0/2069897701 shutdown_connections 2020-10-31T22:45:02.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 --2- 172.21.15.60:0/2069897701 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54240aefe0 0x7f5424146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 --2- 172.21.15.60:0/2069897701 >> v2:172.21.15.66:3300/0 conn(0x7f542405b960 0x7f542405bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 --2- 172.21.15.60:0/2069897701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54240a7850 0x7f54240aeaf0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 -- 172.21.15.60:0/2069897701 >> 172.21.15.60:0/2069897701 conn(0x7f542406a260 msgr2=0x7f5424061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:02.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 -- 172.21.15.60:0/2069897701 shutdown_connections 2020-10-31T22:45:02.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 -- 172.21.15.60:0/2069897701 wait complete. 2020-10-31T22:45:02.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 Processor -- start 2020-10-31T22:45:02.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 -- start start 2020-10-31T22:45:02.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f542405b960 0x7f542414d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:02.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54240a7850 0x7f5424155130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:02.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54240aae00 0x7f5424155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:02.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54240aa1f0 con 0x7f542405b960 2020-10-31T22:45:02.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54240aa420 con 0x7f54240aae00 2020-10-31T22:45:02.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f54291ef700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54240aa6c0 con 0x7f54240a7850 2020-10-31T22:45:02.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f5422d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f542405b960 0x7f542414d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:02.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f5422d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f542405b960 0x7f542414d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44196/0 (socket says 172.21.15.60:44196) 2020-10-31T22:45:02.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f5422d9d700 1 -- 172.21.15.60:0/1591782780 learned_addr learned my addr 172.21.15.60:0/1591782780 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:02.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f542259c700 1 --2- 172.21.15.60:0/1591782780 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54240a7850 0x7f5424155130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:02.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.111+0000 7f542359e700 1 --2- 172.21.15.60:0/1591782780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54240aae00 0x7f5424155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:02.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.115+0000 7f5422d9d700 1 -- 172.21.15.60:0/1591782780 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54240a7850 msgr2=0x7f5424155130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:02.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.115+0000 7f5422d9d700 1 --2- 172.21.15.60:0/1591782780 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54240a7850 0x7f5424155130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.115+0000 7f5422d9d700 1 -- 172.21.15.60:0/1591782780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54240aae00 msgr2=0x7f5424155620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:02.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.115+0000 7f5422d9d700 1 --2- 172.21.15.60:0/1591782780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54240aae00 0x7f5424155620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.115+0000 7f5422d9d700 1 -- 172.21.15.60:0/1591782780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54240aa960 con 0x7f542405b960 2020-10-31T22:45:02.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.115+0000 7f5422d9d700 1 --2- 172.21.15.60:0/1591782780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f542405b960 0x7f542414d0b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f540c00c000 tx=0x7f540c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:02.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.115+0000 7f541bfff700 1 -- 172.21.15.60:0/1591782780 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c00ca10 con 0x7f542405b960 2020-10-31T22:45:02.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.115+0000 7f54291ef700 1 -- 172.21.15.60:0/1591782780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54240a9810 con 0x7f542405b960 2020-10-31T22:45:02.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.115+0000 7f541bfff700 1 -- 172.21.15.60:0/1591782780 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c00cb70 con 0x7f542405b960 2020-10-31T22:45:02.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.115+0000 7f541bfff700 1 -- 172.21.15.60:0/1591782780 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f540c0123f0 con 0x7f542405b960 2020-10-31T22:45:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.115+0000 7f54291ef700 1 -- 172.21.15.60:0/1591782780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54240a9250 con 0x7f542405b960 2020-10-31T22:45:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.115+0000 7f54291ef700 1 -- 172.21.15.60:0/1591782780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5424057100 con 0x7f542405b960 2020-10-31T22:45:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.115+0000 7f541bfff700 1 -- 172.21.15.60:0/1591782780 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f540c012550 con 0x7f542405b960 2020-10-31T22:45:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.115+0000 7f541bfff700 1 --2- 172.21.15.60:0/1591782780 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5408054f10 0x7f54080573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.119+0000 7f541bfff700 1 -- 172.21.15.60:0/1591782780 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f540c06ebd0 con 0x7f542405b960 2020-10-31T22:45:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.119+0000 7f542259c700 1 --2- 172.21.15.60:0/1591782780 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5408054f10 0x7f54080573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.119+0000 7f542259c700 1 --2- 172.21.15.60:0/1591782780 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5408054f10 0x7f54080573d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f541401a000 tx=0x7f5414016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.123+0000 7f541bfff700 1 -- 172.21.15.60:0/1591782780 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f540c045090 con 0x7f542405b960 2020-10-31T22:45:02.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.307+0000 7f54291ef700 1 -- 172.21.15.60:0/1591782780 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f54240aaaf0 con 0x7f542405b960 2020-10-31T22:45:02.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.311+0000 7f541bfff700 1 -- 172.21.15.60:0/1591782780 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f540c0486b0 con 0x7f542405b960 2020-10-31T22:45:02.310 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:45:02.311 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5180,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3826848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3826848450},{"type":"v1","addr":"172.21.15.66:6833","nonce":3826848450}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5544,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/821344830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":821344830},{"type":"v1","addr":"172.21.15.60:6835","nonce":821344830}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:44:41.510512+0000","modified":"2020-10-31T22:44:43.018399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/798359639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":798359639},{"type":"v1","addr":"172.21.15.60:6837","nonce":798359639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-10-31T22:45:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.311+0000 7f54291ef700 1 -- 172.21.15.60:0/1591782780 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5408054f10 msgr2=0x7f54080573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:02.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.311+0000 7f54291ef700 1 --2- 172.21.15.60:0/1591782780 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5408054f10 0x7f54080573d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7f541401a000 tx=0x7f5414016000).stop 2020-10-31T22:45:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.311+0000 7f54291ef700 1 -- 172.21.15.60:0/1591782780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f542405b960 msgr2=0x7f542414d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.311+0000 7f54291ef700 1 --2- 172.21.15.60:0/1591782780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f542405b960 0x7f542414d0b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7f540c00c000 tx=0x7f540c006dc0).stop 2020-10-31T22:45:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.311+0000 7f54291ef700 1 -- 172.21.15.60:0/1591782780 shutdown_connections 2020-10-31T22:45:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.311+0000 7f54291ef700 1 --2- 172.21.15.60:0/1591782780 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5408054f10 0x7f54080573d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.311+0000 7f54291ef700 1 --2- 172.21.15.60:0/1591782780 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54240aae00 0x7f5424155620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.311+0000 7f54291ef700 1 --2- 172.21.15.60:0/1591782780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f542405b960 0x7f542414d0b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.311+0000 7f54291ef700 1 --2- 172.21.15.60:0/1591782780 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54240a7850 0x7f5424155130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.311+0000 7f54291ef700 1 -- 172.21.15.60:0/1591782780 >> 172.21.15.60:0/1591782780 conn(0x7f542406a260 msgr2=0x7f54241466b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:02.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.311+0000 7f54291ef700 1 -- 172.21.15.60:0/1591782780 shutdown_connections 2020-10-31T22:45:02.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.311+0000 7f54291ef700 1 -- 172.21.15.60:0/1591782780 wait complete. 2020-10-31T22:45:02.315 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 23 2020-10-31T22:45:02.325 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_caps 20 2020-10-31T22:45:02.441 INFO:teuthology.orchestra.run.smithi060.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2020-10-31T22:45:02.442 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2020-10-31T22:45:02.442 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:45:02.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 Processor -- start 2020-10-31T22:45:02.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 -- start start 2020-10-31T22:45:02.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff82405b960 0x7ff82405bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:02.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8240a7850 0x7ff8240aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:02.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8240b0f00 con 0x7ff8240aefe0 2020-10-31T22:45:02.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8240b11a0 con 0x7ff82405b960 2020-10-31T22:45:02.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240b1440 con 0x7ff8240a7850 2020-10-31T22:45:02.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff82259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff82405b960 0x7ff82405bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:02.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff82259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff82405b960 0x7ff82405bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44204/0 (socket says 172.21.15.60:44204) 2020-10-31T22:45:02.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff82259c700 1 -- 172.21.15.60:0/3472364960 learned_addr learned my addr 172.21.15.60:0/3472364960 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:02.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff82259c700 1 -- 172.21.15.60:0/3472364960 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8240a7850 msgr2=0x7ff8240aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:02.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff821d9b700 1 --2- 172.21.15.60:0/3472364960 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8240a7850 0x7ff8240aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:02.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff82259c700 1 --2- 172.21.15.60:0/3472364960 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8240a7850 0x7ff8240aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff82259c700 1 -- 172.21.15.60:0/3472364960 >> v1:172.21.15.66:6789/0 conn(0x7ff8240aefe0 legacy=0x7ff824146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:02.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff82259c700 1 -- 172.21.15.60:0/3472364960 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8241462f0 con 0x7ff82405b960 2020-10-31T22:45:02.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff821d9b700 1 --2- 172.21.15.60:0/3472364960 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8240a7850 0x7ff8240aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:45:02.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff82259c700 1 --2- 172.21.15.60:0/3472364960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff82405b960 0x7ff82405bd40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7ff814002f30 tx=0x7ff814006e80).ready entity=mon.0 client_cookie=7f99e69b23800695 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:02.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff82159a700 1 -- 172.21.15.60:0/3472364960 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8140097f0 con 0x7ff82405b960 2020-10-31T22:45:02.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff82159a700 1 -- 172.21.15.60:0/3472364960 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff814009950 con 0x7ff82405b960 2020-10-31T22:45:02.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff82159a700 1 -- 172.21.15.60:0/3472364960 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff814009cb0 con 0x7ff82405b960 2020-10-31T22:45:02.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 -- 172.21.15.60:0/3472364960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff82405b960 msgr2=0x7ff82405bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:02.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 --2- 172.21.15.60:0/3472364960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff82405b960 0x7ff82405bd40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7ff814002f30 tx=0x7ff814006e80).stop 2020-10-31T22:45:02.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 -- 172.21.15.60:0/3472364960 shutdown_connections 2020-10-31T22:45:02.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 --2- 172.21.15.60:0/3472364960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff82405b960 0x7ff82405bd40 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 --2- 172.21.15.60:0/3472364960 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8240a7850 0x7ff8240aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 -- 172.21.15.60:0/3472364960 >> 172.21.15.60:0/3472364960 conn(0x7ff82406a260 msgr2=0x7ff824061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:02.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 -- 172.21.15.60:0/3472364960 shutdown_connections 2020-10-31T22:45:02.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.555+0000 7ff828cdb700 1 -- 172.21.15.60:0/3472364960 wait complete. 2020-10-31T22:45:02.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff828cdb700 1 Processor -- start 2020-10-31T22:45:02.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff828cdb700 1 -- start start 2020-10-31T22:45:02.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff828cdb700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff82405b960 0x7ff8240a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:02.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff828cdb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8240a7850 0x7ff8240ad5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:02.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff828cdb700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8240b3d90 0x7ff8240aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:02.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff828cdb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240b42a0 con 0x7ff8240a7850 2020-10-31T22:45:02.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff828cdb700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240b4540 con 0x7ff8240b3d90 2020-10-31T22:45:02.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff828cdb700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8240a9730 con 0x7ff82405b960 2020-10-31T22:45:02.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff821d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8240a7850 0x7ff8240ad5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:02.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff821d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8240a7850 0x7ff8240ad5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44212/0 (socket says 172.21.15.60:44212) 2020-10-31T22:45:02.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff821d9b700 1 -- 172.21.15.60:0/2389564548 learned_addr learned my addr 172.21.15.60:0/2389564548 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:02.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff82259c700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff82405b960 0x7ff8240a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:02.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff822d9d700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8240b3d90 0x7ff8240aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:02.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff821d9b700 1 -- 172.21.15.60:0/2389564548 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff82405b960 msgr2=0x7ff8240a9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:02.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff821d9b700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff82405b960 0x7ff8240a9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff821d9b700 1 -- 172.21.15.60:0/2389564548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8240b3d90 msgr2=0x7ff8240aa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:02.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff821d9b700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8240b3d90 0x7ff8240aa390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff821d9b700 1 -- 172.21.15.60:0/2389564548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8240a99d0 con 0x7ff8240a7850 2020-10-31T22:45:02.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff82259c700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff82405b960 0x7ff8240a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:45:02.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff822d9d700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8240b3d90 0x7ff8240aa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:45:02.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff821d9b700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8240a7850 0x7ff8240ad5e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7ff818007000 tx=0x7ff818008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:02.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff8137fe700 1 -- 172.21.15.60:0/2389564548 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff818010580 con 0x7ff8240a7850 2020-10-31T22:45:02.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff8137fe700 1 -- 172.21.15.60:0/2389564548 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8180106e0 con 0x7ff8240a7850 2020-10-31T22:45:02.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff828cdb700 1 -- 172.21.15.60:0/2389564548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82414ce10 con 0x7ff8240a7850 2020-10-31T22:45:02.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff8137fe700 1 -- 172.21.15.60:0/2389564548 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff818010a40 con 0x7ff8240a7850 2020-10-31T22:45:02.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.559+0000 7ff828cdb700 1 -- 172.21.15.60:0/2389564548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8240aaaa0 con 0x7ff8240a7850 2020-10-31T22:45:02.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.563+0000 7ff828cdb700 1 -- 172.21.15.60:0/2389564548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff824057100 con 0x7ff8240a7850 2020-10-31T22:45:02.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.563+0000 7ff8137fe700 1 -- 172.21.15.60:0/2389564548 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff818010ba0 con 0x7ff8240a7850 2020-10-31T22:45:02.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.563+0000 7ff8137fe700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff800054f90 0x7ff800057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:02.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.563+0000 7ff8137fe700 1 -- 172.21.15.60:0/2389564548 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff81806dc30 con 0x7ff8240a7850 2020-10-31T22:45:02.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.563+0000 7ff82259c700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff800054f90 0x7ff800057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:02.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.563+0000 7ff82259c700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff800054f90 0x7ff800057450 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7ff81401c000 tx=0x7ff814015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:02.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.575+0000 7ff8137fe700 1 -- 172.21.15.60:0/2389564548 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff818043fc0 con 0x7ff8240a7850 2020-10-31T22:45:02.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.795+0000 7ff828cdb700 1 -- 172.21.15.60:0/2389564548 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff82405b210 con 0x7ff8240a7850 2020-10-31T22:45:02.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.799+0000 7ff8137fe700 1 -- 172.21.15.60:0/2389564548 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+2486 (secure 0 0 0) 0x7ff8180475e0 con 0x7ff8240a7850 2020-10-31T22:45:02.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.799+0000 7ff828cdb700 1 -- 172.21.15.60:0/2389564548 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff800054f90 msgr2=0x7ff800057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:02.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.799+0000 7ff828cdb700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff800054f90 0x7ff800057450 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7ff81401c000 tx=0x7ff814015000).stop 2020-10-31T22:45:02.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.799+0000 7ff828cdb700 1 -- 172.21.15.60:0/2389564548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8240a7850 msgr2=0x7ff8240ad5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:02.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.799+0000 7ff828cdb700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8240a7850 0x7ff8240ad5e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7ff818007000 tx=0x7ff818008040).stop 2020-10-31T22:45:02.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.799+0000 7ff828cdb700 1 -- 172.21.15.60:0/2389564548 shutdown_connections 2020-10-31T22:45:02.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.799+0000 7ff828cdb700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff800054f90 0x7ff800057450 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.799+0000 7ff828cdb700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8240b3d90 0x7ff8240aa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.799+0000 7ff828cdb700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff82405b960 0x7ff8240a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.799+0000 7ff828cdb700 1 --2- 172.21.15.60:0/2389564548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8240a7850 0x7ff8240ad5e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.799+0000 7ff828cdb700 1 -- 172.21.15.60:0/2389564548 >> 172.21.15.60:0/2389564548 conn(0x7ff82406a260 msgr2=0x7ff82414a040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.799+0000 7ff828cdb700 1 -- 172.21.15.60:0/2389564548 shutdown_connections 2020-10-31T22:45:02.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:02.799+0000 7ff828cdb700 1 -- 172.21.15.60:0/2389564548 wait complete. 2020-10-31T22:45:02.807 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:45:02.808 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5180,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3826848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3826848450},{"type":"v1","addr":"172.21.15.66:6833","nonce":3826848450}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5544,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/821344830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":821344830},{"type":"v1","addr":"172.21.15.60:6835","nonce":821344830}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:44:41.510512+0000","modified":"2020-10-31T22:44:43.018399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/798359639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":798359639},{"type":"v1","addr":"172.21.15.60:6837","nonce":798359639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-10-31T22:45:02.808 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 23 2020-10-31T22:45:02.812 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_decay_threshold 400 2020-10-31T22:45:02.928 INFO:teuthology.orchestra.run.smithi060.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2020-10-31T22:45:02.928 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2020-10-31T22:45:02.929 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:45:02.947 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:45:03.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f3355fd3700 1 Processor -- start 2020-10-31T22:45:03.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f3355fd3700 1 -- start start 2020-10-31T22:45:03.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f3355fd3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f33500b0d60 0x7f3350140230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f3355fd3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f335005c6a0 0x7f335013c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f3355fd3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33500b2130 con 0x7f33500b1d50 2020-10-31T22:45:03.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f3355fd3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335006a9b0 con 0x7f33500b0d60 2020-10-31T22:45:03.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f3355fd3700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335005cad0 con 0x7f335005c6a0 2020-10-31T22:45:03.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f334ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f33500b0d60 0x7f3350140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f334ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f33500b0d60 0x7f3350140230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44218/0 (socket says 172.21.15.60:44218) 2020-10-31T22:45:03.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f3354fd1700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f33500b1d50 0x7f335013fb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48356/0 (socket says 172.21.15.60:48356) 2020-10-31T22:45:03.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f334ffff700 1 -- 172.21.15.60:0/2555663370 learned_addr learned my addr 172.21.15.60:0/2555663370 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:03.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f33557d2700 1 --2- 172.21.15.60:0/2555663370 >> v2:172.21.15.66:3300/0 conn(0x7f335005c6a0 0x7f335013c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f334ffff700 1 -- 172.21.15.60:0/2555663370 >> v2:172.21.15.66:3300/0 conn(0x7f335005c6a0 msgr2=0x7f335013c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:03.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f334ffff700 1 --2- 172.21.15.60:0/2555663370 >> v2:172.21.15.66:3300/0 conn(0x7f335005c6a0 0x7f335013c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f334ffff700 1 -- 172.21.15.60:0/2555663370 >> v1:172.21.15.60:6789/0 conn(0x7f33500b1d50 legacy=0x7f335013fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:03.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f334ffff700 1 -- 172.21.15.60:0/2555663370 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33500af380 con 0x7f33500b0d60 2020-10-31T22:45:03.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f334f7fe700 1 -- 172.21.15.60:0/2555663370 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149527255 0 0) 0x7f33500b2130 con 0x7f33500b1d50 2020-10-31T22:45:03.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f334ffff700 1 --2- 172.21.15.60:0/2555663370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33500b0d60 0x7f3350140230 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f3338002f30 tx=0x7f3338006e80).ready entity=mon.0 client_cookie=85a267d53c165730 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:03.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f334f7fe700 1 -- 172.21.15.60:0/2555663370 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33380097f0 con 0x7f33500b0d60 2020-10-31T22:45:03.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f334f7fe700 1 -- 172.21.15.60:0/2555663370 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3338009950 con 0x7f33500b0d60 2020-10-31T22:45:03.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f334f7fe700 1 -- 172.21.15.60:0/2555663370 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3338009cb0 con 0x7f33500b0d60 2020-10-31T22:45:03.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f3355fd3700 1 -- 172.21.15.60:0/2555663370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33500b0d60 msgr2=0x7f3350140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:03.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.063+0000 7f3355fd3700 1 --2- 172.21.15.60:0/2555663370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33500b0d60 0x7f3350140230 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7f3338002f30 tx=0x7f3338006e80).stop 2020-10-31T22:45:03.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 -- 172.21.15.60:0/2555663370 shutdown_connections 2020-10-31T22:45:03.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 --2- 172.21.15.60:0/2555663370 >> v2:172.21.15.66:3300/0 conn(0x7f335005c6a0 0x7f335013c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 --2- 172.21.15.60:0/2555663370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33500b0d60 0x7f3350140230 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 -- 172.21.15.60:0/2555663370 >> 172.21.15.60:0/2555663370 conn(0x7f33500b5300 msgr2=0x7f33500b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:03.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 -- 172.21.15.60:0/2555663370 shutdown_connections 2020-10-31T22:45:03.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 -- 172.21.15.60:0/2555663370 wait complete. 2020-10-31T22:45:03.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 Processor -- start 2020-10-31T22:45:03.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 -- start start 2020-10-31T22:45:03.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f335005c6a0 0x7f335014e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33500b0d60 0x7f33501460e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33500b1d50 0x7f33500a8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33500a9ef0 con 0x7f33500b0d60 2020-10-31T22:45:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33500aa190 con 0x7f335005c6a0 2020-10-31T22:45:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33500aa430 con 0x7f33500b1d50 2020-10-31T22:45:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f334ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33500b0d60 0x7f33501460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f334ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33500b0d60 0x7f33501460e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44226/0 (socket says 172.21.15.60:44226) 2020-10-31T22:45:03.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f334ffff700 1 -- 172.21.15.60:0/93695903 learned_addr learned my addr 172.21.15.60:0/93695903 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:03.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f33557d2700 1 --2- 172.21.15.60:0/93695903 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33500b1d50 0x7f33500a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3354fd1700 1 --2- 172.21.15.60:0/93695903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f335005c6a0 0x7f335014e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f334ffff700 1 -- 172.21.15.60:0/93695903 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33500b1d50 msgr2=0x7f33500a8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:03.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f334ffff700 1 --2- 172.21.15.60:0/93695903 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33500b1d50 0x7f33500a8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f334ffff700 1 -- 172.21.15.60:0/93695903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f335005c6a0 msgr2=0x7f335014e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:03.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f334ffff700 1 --2- 172.21.15.60:0/93695903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f335005c6a0 0x7f335014e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f334ffff700 1 -- 172.21.15.60:0/93695903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33500aa6d0 con 0x7f33500b0d60 2020-10-31T22:45:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f334ffff700 1 --2- 172.21.15.60:0/93695903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33500b0d60 0x7f33501460e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f3338002f30 tx=0x7f3338015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f334dffb700 1 -- 172.21.15.60:0/93695903 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3338011c30 con 0x7f33500b0d60 2020-10-31T22:45:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 -- 172.21.15.60:0/93695903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33500aa970 con 0x7f33500b0d60 2020-10-31T22:45:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f334dffb700 1 -- 172.21.15.60:0/93695903 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3338011d90 con 0x7f33500b0d60 2020-10-31T22:45:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f334dffb700 1 -- 172.21.15.60:0/93695903 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f333801e650 con 0x7f33500b0d60 2020-10-31T22:45:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.067+0000 7f3355fd3700 1 -- 172.21.15.60:0/93695903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33500ab030 con 0x7f33500b0d60 2020-10-31T22:45:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.071+0000 7f3355fd3700 1 -- 172.21.15.60:0/93695903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33500ab780 con 0x7f33500b0d60 2020-10-31T22:45:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.071+0000 7f334dffb700 1 -- 172.21.15.60:0/93695903 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f333801a040 con 0x7f33500b0d60 2020-10-31T22:45:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.071+0000 7f334dffb700 1 --2- 172.21.15.60:0/93695903 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3334054f30 0x7f33340573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.071+0000 7f334dffb700 1 -- 172.21.15.60:0/93695903 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f333806ea90 con 0x7f33500b0d60 2020-10-31T22:45:03.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.071+0000 7f3354fd1700 1 --2- 172.21.15.60:0/93695903 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3334054f30 0x7f33340573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.071+0000 7f3354fd1700 1 --2- 172.21.15.60:0/93695903 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3334054f30 0x7f33340573f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f334000d000 tx=0x7f3340007c90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:03.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.083+0000 7f334dffb700 1 -- 172.21.15.60:0/93695903 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3338044f10 con 0x7f33500b0d60 2020-10-31T22:45:03.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.267+0000 7f3355fd3700 1 -- 172.21.15.60:0/93695903 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3350057100 con 0x7f33500b0d60 2020-10-31T22:45:03.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.271+0000 7f334dffb700 1 -- 172.21.15.60:0/93695903 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f3338023020 con 0x7f33500b0d60 2020-10-31T22:45:03.271 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:45:03.271 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5180,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3826848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3826848450},{"type":"v1","addr":"172.21.15.66:6833","nonce":3826848450}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5544,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/821344830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":821344830},{"type":"v1","addr":"172.21.15.60:6835","nonce":821344830}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:44:41.510512+0000","modified":"2020-10-31T22:44:43.018399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/798359639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":798359639},{"type":"v1","addr":"172.21.15.60:6837","nonce":798359639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-10-31T22:45:03.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.271+0000 7f3355fd3700 1 -- 172.21.15.60:0/93695903 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3334054f30 msgr2=0x7f33340573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:03.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.271+0000 7f3355fd3700 1 --2- 172.21.15.60:0/93695903 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3334054f30 0x7f33340573f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f334000d000 tx=0x7f3340007c90).stop 2020-10-31T22:45:03.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.271+0000 7f3355fd3700 1 -- 172.21.15.60:0/93695903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33500b0d60 msgr2=0x7f33501460e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.271+0000 7f3355fd3700 1 --2- 172.21.15.60:0/93695903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33500b0d60 0x7f33501460e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f3338002f30 tx=0x7f3338015000).stop 2020-10-31T22:45:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.271+0000 7f3355fd3700 1 -- 172.21.15.60:0/93695903 shutdown_connections 2020-10-31T22:45:03.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.271+0000 7f3355fd3700 1 --2- 172.21.15.60:0/93695903 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33500b1d50 0x7f33500a8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.271+0000 7f3355fd3700 1 --2- 172.21.15.60:0/93695903 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3334054f30 0x7f33340573f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.271+0000 7f3355fd3700 1 --2- 172.21.15.60:0/93695903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f335005c6a0 0x7f335014e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.271+0000 7f3355fd3700 1 --2- 172.21.15.60:0/93695903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33500b0d60 0x7f33501460e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.271+0000 7f3355fd3700 1 -- 172.21.15.60:0/93695903 >> 172.21.15.60:0/93695903 conn(0x7f33500b5300 msgr2=0x7f3350060040 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:03.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.271+0000 7f3355fd3700 1 -- 172.21.15.60:0/93695903 shutdown_connections 2020-10-31T22:45:03.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.271+0000 7f3355fd3700 1 -- 172.21.15.60:0/93695903 wait complete. 2020-10-31T22:45:03.277 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 23 2020-10-31T22:45:03.285 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mds.c cache drop 5 2020-10-31T22:45:03.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.403+0000 7fd3437c6700 1 Processor -- start 2020-10-31T22:45:03.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.403+0000 7fd3437c6700 1 -- start start 2020-10-31T22:45:03.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.403+0000 7fd3437c6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd33c0b0dc0 0x7fd33c0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.403+0000 7fd3437c6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd33c13fd20 0x7fd33c0664e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.403+0000 7fd3437c6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0653c0 con 0x7fd33c13d190 2020-10-31T22:45:03.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.403+0000 7fd3437c6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33c066b10 con 0x7fd33c13fd20 2020-10-31T22:45:03.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.403+0000 7fd3437c6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c066db0 con 0x7fd33c0b0dc0 2020-10-31T22:45:03.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.403+0000 7fd340d61700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd33c13fd20 0x7fd33c0664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.403+0000 7fd340d61700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd33c13fd20 0x7fd33c0664e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44232/0 (socket says 172.21.15.60:44232) 2020-10-31T22:45:03.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.403+0000 7fd340d61700 1 -- 172.21.15.60:0/2665082691 learned_addr learned my addr 172.21.15.60:0/2665082691 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:03.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.403+0000 7fd341d63700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd33c13d190 0x7fd33c143890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48370/0 (socket says 172.21.15.60:48370) 2020-10-31T22:45:03.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.403+0000 7fd341562700 1 --2- 172.21.15.60:0/2665082691 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd33c0b0dc0 0x7fd33c0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd340d61700 1 -- 172.21.15.60:0/2665082691 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd33c0b0dc0 msgr2=0x7fd33c0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:03.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd340d61700 1 --2- 172.21.15.60:0/2665082691 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd33c0b0dc0 0x7fd33c0b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd340d61700 1 -- 172.21.15.60:0/2665082691 >> v1:172.21.15.60:6789/0 conn(0x7fd33c13d190 legacy=0x7fd33c143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:03.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd340d61700 1 -- 172.21.15.60:0/2665082691 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c1433f0 con 0x7fd33c13fd20 2020-10-31T22:45:03.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd333fff700 1 -- 172.21.15.60:0/2665082691 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589233409 0 0) 0x7fd33c0653c0 con 0x7fd33c13d190 2020-10-31T22:45:03.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd340d61700 1 --2- 172.21.15.60:0/2665082691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c13fd20 0x7fd33c0664e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fd338002f30 tx=0x7fd338006e80).ready entity=mon.0 client_cookie=67bb9cdc7d81dfe3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:03.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd333fff700 1 -- 172.21.15.60:0/2665082691 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd3380097f0 con 0x7fd33c13fd20 2020-10-31T22:45:03.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd333fff700 1 -- 172.21.15.60:0/2665082691 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd338009950 con 0x7fd33c13fd20 2020-10-31T22:45:03.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd333fff700 1 -- 172.21.15.60:0/2665082691 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd338009cb0 con 0x7fd33c13fd20 2020-10-31T22:45:03.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd3437c6700 1 -- 172.21.15.60:0/2665082691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c13fd20 msgr2=0x7fd33c0664e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:03.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd3437c6700 1 --2- 172.21.15.60:0/2665082691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c13fd20 0x7fd33c0664e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7fd338002f30 tx=0x7fd338006e80).stop 2020-10-31T22:45:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd3437c6700 1 -- 172.21.15.60:0/2665082691 shutdown_connections 2020-10-31T22:45:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd3437c6700 1 --2- 172.21.15.60:0/2665082691 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd33c0b0dc0 0x7fd33c0b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd3437c6700 1 --2- 172.21.15.60:0/2665082691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c13fd20 0x7fd33c0664e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd3437c6700 1 -- 172.21.15.60:0/2665082691 >> 172.21.15.60:0/2665082691 conn(0x7fd33c06a260 msgr2=0x7fd33c063c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:03.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd3437c6700 1 -- 172.21.15.60:0/2665082691 shutdown_connections 2020-10-31T22:45:03.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd3437c6700 1 -- 172.21.15.60:0/2665082691 wait complete. 2020-10-31T22:45:03.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.407+0000 7fd3437c6700 1 Processor -- start 2020-10-31T22:45:03.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd3437c6700 1 -- start start 2020-10-31T22:45:03.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd3437c6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd33c0b0dc0 0x7fd33c146e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd3437c6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c13d190 0x7fd33c13c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd3437c6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd33c13fd20 0x7fd33c13c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd3437c6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c1522b0 con 0x7fd33c13d190 2020-10-31T22:45:03.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd3437c6700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c152550 con 0x7fd33c0b0dc0 2020-10-31T22:45:03.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd3437c6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c1527f0 con 0x7fd33c13fd20 2020-10-31T22:45:03.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd340d61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c13d190 0x7fd33c13c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd340d61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c13d190 0x7fd33c13c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44238/0 (socket says 172.21.15.60:44238) 2020-10-31T22:45:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd340d61700 1 -- 172.21.15.60:0/205508222 learned_addr learned my addr 172.21.15.60:0/205508222 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd341562700 1 --2- 172.21.15.60:0/205508222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd33c0b0dc0 0x7fd33c146e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd341d63700 1 --2- 172.21.15.60:0/205508222 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd33c13fd20 0x7fd33c13c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd340d61700 1 -- 172.21.15.60:0/205508222 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd33c13fd20 msgr2=0x7fd33c13c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd340d61700 1 --2- 172.21.15.60:0/205508222 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd33c13fd20 0x7fd33c13c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd340d61700 1 -- 172.21.15.60:0/205508222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd33c0b0dc0 msgr2=0x7fd33c146e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd340d61700 1 --2- 172.21.15.60:0/205508222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd33c0b0dc0 0x7fd33c146e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd340d61700 1 -- 172.21.15.60:0/205508222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c152a90 con 0x7fd33c13d190 2020-10-31T22:45:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd340d61700 1 --2- 172.21.15.60:0/205508222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c13d190 0x7fd33c13c450 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fd338002f30 tx=0x7fd338015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd3327fc700 1 -- 172.21.15.60:0/205508222 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd338011bf0 con 0x7fd33c13d190 2020-10-31T22:45:03.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd3327fc700 1 -- 172.21.15.60:0/205508222 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd338011d50 con 0x7fd33c13d190 2020-10-31T22:45:03.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd3437c6700 1 -- 172.21.15.60:0/205508222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c151f30 con 0x7fd33c13d190 2020-10-31T22:45:03.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd3327fc700 1 -- 172.21.15.60:0/205508222 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd33801e650 con 0x7fd33c13d190 2020-10-31T22:45:03.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.411+0000 7fd3437c6700 1 -- 172.21.15.60:0/205508222 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c142ce0 con 0x7fd33c13d190 2020-10-31T22:45:03.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.415+0000 7fd3327fc700 1 -- 172.21.15.60:0/205508222 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd338025030 con 0x7fd33c13d190 2020-10-31T22:45:03.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.415+0000 7fd3327fc700 1 --2- 172.21.15.60:0/205508222 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd324054f10 0x7fd3240573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.415+0000 7fd3327fc700 1 -- 172.21.15.60:0/205508222 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd33806ed70 con 0x7fd33c13d190 2020-10-31T22:45:03.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.415+0000 7fd341562700 1 --2- 172.21.15.60:0/205508222 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd324054f10 0x7fd3240573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.415+0000 7fd341562700 1 --2- 172.21.15.60:0/205508222 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd324054f10 0x7fd3240573d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fd32c00b000 tx=0x7fd32c006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:03.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd35215e740 1 Processor -- start 2020-10-31T22:45:03.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd35215e740 1 -- start start 2020-10-31T22:45:03.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd35215e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x18ddb30 0x1929090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd35215e740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1746820 0x1928150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd35215e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x1928640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd35215e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x17e3250 con 0x16d8c20 2020-10-31T22:45:03.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd35215e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x1852df0 con 0x18ddb30 2020-10-31T22:45:03.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd35215e740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x175f6b0 con 0x1746820 2020-10-31T22:45:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd341d63700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x1928640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd341d63700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x1928640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44248/0 (socket says 172.21.15.60:44248) 2020-10-31T22:45:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd341d63700 1 -- 172.21.15.60:0/730424146 learned_addr learned my addr 172.21.15.60:0/730424146 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd340d61700 1 --2- 172.21.15.60:0/730424146 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1746820 0x1928150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd341562700 1 --2- 172.21.15.60:0/730424146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x18ddb30 0x1929090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd341d63700 1 -- 172.21.15.60:0/730424146 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1746820 msgr2=0x1928150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:03.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd341d63700 1 --2- 172.21.15.60:0/730424146 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1746820 0x1928150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd341d63700 1 -- 172.21.15.60:0/730424146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x18ddb30 msgr2=0x1929090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:03.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd341d63700 1 --2- 172.21.15.60:0/730424146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x18ddb30 0x1929090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd341d63700 1 -- 172.21.15.60:0/730424146 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1873bb0 con 0x16d8c20 2020-10-31T22:45:03.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd341d63700 1 --2- 172.21.15.60:0/730424146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x1928640 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x195f8e0 tx=0x7fd334007c10).ready entity=mon.0 client_cookie=8a948b8b125ad0df server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:03.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd3437c6700 1 -- 172.21.15.60:0/730424146 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd334001f30 con 0x16d8c20 2020-10-31T22:45:03.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.419+0000 7fd3437c6700 1 -- 172.21.15.60:0/730424146 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd334002090 con 0x16d8c20 2020-10-31T22:45:03.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd3437c6700 1 -- 172.21.15.60:0/730424146 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd334012540 con 0x16d8c20 2020-10-31T22:45:03.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 -- 172.21.15.60:0/730424146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 msgr2=0x1928640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:03.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 --2- 172.21.15.60:0/730424146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x1928640 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x195f8e0 tx=0x7fd334007c10).stop 2020-10-31T22:45:03.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 -- 172.21.15.60:0/730424146 shutdown_connections 2020-10-31T22:45:03.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 --2- 172.21.15.60:0/730424146 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x1928640 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 --2- 172.21.15.60:0/730424146 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x18ddb30 0x1929090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 --2- 172.21.15.60:0/730424146 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1746820 0x1928150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 -- 172.21.15.60:0/730424146 >> 172.21.15.60:0/730424146 conn(0x190d590 msgr2=0x190c620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 -- 172.21.15.60:0/730424146 shutdown_connections 2020-10-31T22:45:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 -- 172.21.15.60:0/730424146 wait complete. 2020-10-31T22:45:03.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 -- start start 2020-10-31T22:45:03.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 Processor -- start 2020-10-31T22:45:03.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x19292b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1746820 0x196ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x18ddb30 0x192c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x1882860 con 0x16d8c20 2020-10-31T22:45:03.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x18829a0 con 0x18ddb30 2020-10-31T22:45:03.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x1883f70 con 0x1746820 2020-10-31T22:45:03.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd35215e740 10 client.0 ll_register_callbacks cb 0x1879500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2020-10-31T22:45:03.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd341562700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x19292b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd341562700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x19292b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44250/0 (socket says 172.21.15.60:44250) 2020-10-31T22:45:03.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd341562700 1 -- 172.21.15.60:0/3053199198 learned_addr learned my addr 172.21.15.60:0/3053199198 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:03.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd340d61700 1 --2- 172.21.15.60:0/3053199198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1746820 0x196ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd341d63700 1 --2- 172.21.15.60:0/3053199198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x18ddb30 0x192c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd341562700 1 -- 172.21.15.60:0/3053199198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1746820 msgr2=0x196ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:03.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd341562700 1 --2- 172.21.15.60:0/3053199198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1746820 0x196ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd341562700 1 -- 172.21.15.60:0/3053199198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x18ddb30 msgr2=0x192c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:03.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd341562700 1 --2- 172.21.15.60:0/3053199198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x18ddb30 0x192c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd341562700 1 -- 172.21.15.60:0/3053199198 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x16f6790 con 0x16d8c20 2020-10-31T22:45:03.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd341562700 1 --2- 172.21.15.60:0/3053199198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x19292b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x192c5b0 tx=0x7fd32c014000).ready entity=mon.0 client_cookie=1c4599e949e158a6 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:03.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd317fff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2020-10-31T22:45:03.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.423+0000 7fd317fff700 1 -- 172.21.15.60:0/3053199198 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd32c0115b0 con 0x16d8c20 2020-10-31T22:45:03.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 -- 172.21.15.60:0/3053199198 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1833810 con 0x16d8c20 2020-10-31T22:45:03.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd317fff700 1 -- 172.21.15.60:0/3053199198 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd32c011710 con 0x16d8c20 2020-10-31T22:45:03.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd317fff700 1 -- 172.21.15.60:0/3053199198 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd32c0118d0 con 0x16d8c20 2020-10-31T22:45:03.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 10 client.5742 fetch_fsmap learned FSMap version 23 2020-10-31T22:45:03.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 -- 172.21.15.60:0/3053199198 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x1701e70 con 0x16d8c20 2020-10-31T22:45:03.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd317fff700 1 -- 172.21.15.60:0/3053199198 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1833810 con 0x16d8c20 2020-10-31T22:45:03.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd317fff700 1 -- 172.21.15.60:0/3053199198 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 23) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fd32c020a90 con 0x16d8c20 2020-10-31T22:45:03.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 10 client.5742 fetch_fsmap finished waiting for FSMap version 23 2020-10-31T22:45:03.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 10 client.5742 resolve_mds: resolved ID 'c' to GID 5553 2020-10-31T22:45:03.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 20 client.5742 populate_metadata read hostname 'smithi060' 2020-10-31T22:45:03.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 --2- 172.21.15.60:0/3053199198 >> [v2:172.21.15.60:6836/798359639,v1:172.21.15.60:6837/798359639] conn(0x192ced0 0x195fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 4 client.5742 mds_command: new command op to 5553 tid=0[{"prefix": "get_command_descriptions"}] 2020-10-31T22:45:03.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 -- 172.21.15.60:0/3053199198 --> [v2:172.21.15.60:6836/798359639,v1:172.21.15.60:6837/798359639] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x176b8d0 con 0x192ced0 2020-10-31T22:45:03.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd340d61700 1 --2- 172.21.15.60:0/3053199198 >> [v2:172.21.15.60:6836/798359639,v1:172.21.15.60:6837/798359639] conn(0x192ced0 0x195fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd317fff700 10 client.5742 ms_handle_connect on v2:172.21.15.60:6836/798359639 2020-10-31T22:45:03.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd340d61700 1 --2- 172.21.15.60:0/3053199198 >> [v2:172.21.15.60:6836/798359639,v1:172.21.15.60:6837/798359639] conn(0x192ced0 0x195fa00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=59f4c59041db7024 server_cookie=191434499699151f in_seq=0 out_seq=0 2020-10-31T22:45:03.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd317fff700 1 -- 172.21.15.60:0/3053199198 <== mds.0 v2:172.21.15.60:6836/798359639 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16606 (crc 0 0 0) 0x176b8d0 con 0x192ced0 2020-10-31T22:45:03.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd317fff700 10 client.5742 handle_command_reply: tid=0 2020-10-31T22:45:03.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 client.5742 shutdown 2020-10-31T22:45:03.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 -- 172.21.15.60:0/3053199198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 msgr2=0x19292b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:03.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 --2- 172.21.15.60:0/3053199198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x19292b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x192c5b0 tx=0x7fd32c014000).stop 2020-10-31T22:45:03.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 -- 172.21.15.60:0/3053199198 shutdown_connections 2020-10-31T22:45:03.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 --2- 172.21.15.60:0/3053199198 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x18ddb30 0x192c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 --2- 172.21.15.60:0/3053199198 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x19292b0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 --2- 172.21.15.60:0/3053199198 >> [v2:172.21.15.60:6836/798359639,v1:172.21.15.60:6837/798359639] conn(0x192ced0 0x195fa00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 --2- 172.21.15.60:0/3053199198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x1746820 0x196ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 -- 172.21.15.60:0/3053199198 >> 172.21.15.60:0/3053199198 conn(0x190d590 msgr2=0x1928150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:03.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd317fff700 0 client.5742 ms_handle_reset on v2:172.21.15.60:6836/798359639 2020-10-31T22:45:03.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 -- 172.21.15.60:0/3053199198 shutdown_connections 2020-10-31T22:45:03.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 1 -- 172.21.15.60:0/3053199198 wait complete. 2020-10-31T22:45:03.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.427+0000 7fd35215e740 20 client.5742 trim_cache size 0 max 16384 2020-10-31T22:45:03.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 Processor -- start 2020-10-31T22:45:03.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 -- start start 2020-10-31T22:45:03.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x192c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1746820 0x190c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x18ddb30 0x1959af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x18653b0 con 0x16d8c20 2020-10-31T22:45:03.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x1833810 con 0x1746820 2020-10-31T22:45:03.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x1929470 con 0x18ddb30 2020-10-31T22:45:03.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd341562700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x192c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd341562700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x192c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44258/0 (socket says 172.21.15.60:44258) 2020-10-31T22:45:03.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd341562700 1 -- 172.21.15.60:0/995554281 learned_addr learned my addr 172.21.15.60:0/995554281 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:03.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd340d61700 1 --2- 172.21.15.60:0/995554281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1746820 0x190c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd341d63700 1 --2- 172.21.15.60:0/995554281 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x18ddb30 0x1959af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd341562700 1 -- 172.21.15.60:0/995554281 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x18ddb30 msgr2=0x1959af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:03.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd341562700 1 --2- 172.21.15.60:0/995554281 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x18ddb30 0x1959af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd341562700 1 -- 172.21.15.60:0/995554281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1746820 msgr2=0x190c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:03.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd341562700 1 --2- 172.21.15.60:0/995554281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1746820 0x190c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd341562700 1 -- 172.21.15.60:0/995554281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c0b2070 con 0x16d8c20 2020-10-31T22:45:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd340d61700 1 --2- 172.21.15.60:0/995554281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1746820 0x190c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:45:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd341562700 1 --2- 172.21.15.60:0/995554281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x192c9e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x185e100 tx=0x7fd32c022000).ready entity=mon.0 client_cookie=151e401095874d95 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd31e7fc700 1 -- 172.21.15.60:0/995554281 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd32c0117a0 con 0x16d8c20 2020-10-31T22:45:03.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd31e7fc700 1 -- 172.21.15.60:0/995554281 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd32c011900 con 0x16d8c20 2020-10-31T22:45:03.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 -- 172.21.15.60:0/995554281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 msgr2=0x192c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:03.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 --2- 172.21.15.60:0/995554281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x192c9e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x185e100 tx=0x7fd32c022000).stop 2020-10-31T22:45:03.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd31e7fc700 1 -- 172.21.15.60:0/995554281 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd32c020670 con 0x16d8c20 2020-10-31T22:45:03.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 -- 172.21.15.60:0/995554281 shutdown_connections 2020-10-31T22:45:03.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 --2- 172.21.15.60:0/995554281 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x18ddb30 0x1959af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 --2- 172.21.15.60:0/995554281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x16d8c20 0x192c9e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 --2- 172.21.15.60:0/995554281 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1746820 0x190c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 -- 172.21.15.60:0/995554281 >> 172.21.15.60:0/995554281 conn(0x190d590 msgr2=0x1927210 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:03.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 -- 172.21.15.60:0/995554281 shutdown_connections 2020-10-31T22:45:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.447+0000 7fd35215e740 1 -- 172.21.15.60:0/995554281 wait complete. 2020-10-31T22:45:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 1 -- start start 2020-10-31T22:45:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 1 Processor -- start 2020-10-31T22:45:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x16d8c20 0x18520e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1746820 0x19c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x18ddb30 0x19c5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x1855660 con 0x18ddb30 2020-10-31T22:45:03.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x195a9b0 con 0x1746820 2020-10-31T22:45:03.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x195ece0 con 0x16d8c20 2020-10-31T22:45:03.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 10 client.0 ll_register_callbacks cb 0x192c120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2020-10-31T22:45:03.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd341d63700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x18ddb30 0x19c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd341562700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x16d8c20 0x18520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd341d63700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x18ddb30 0x19c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44268/0 (socket says 172.21.15.60:44268) 2020-10-31T22:45:03.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd341562700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x16d8c20 0x18520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:57452/0 (socket says 172.21.15.60:57452) 2020-10-31T22:45:03.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd341d63700 1 -- 172.21.15.60:0/933683928 learned_addr learned my addr 172.21.15.60:0/933683928 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:03.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd340d61700 1 --2- 172.21.15.60:0/933683928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1746820 0x19c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd341d63700 1 -- 172.21.15.60:0/933683928 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x16d8c20 msgr2=0x18520e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:03.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd341d63700 1 --2- 172.21.15.60:0/933683928 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x16d8c20 0x18520e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd341d63700 1 -- 172.21.15.60:0/933683928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1746820 msgr2=0x19c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:03.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd341d63700 1 --2- 172.21.15.60:0/933683928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1746820 0x19c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:03.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd341d63700 1 -- 172.21.15.60:0/933683928 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1926c40 con 0x18ddb30 2020-10-31T22:45:03.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd341d63700 1 --2- 172.21.15.60:0/933683928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x18ddb30 0x19c5790 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x1972930 tx=0x7fd334017000).ready entity=mon.0 client_cookie=3fe646ba4ec2a641 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:03.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd31d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2020-10-31T22:45:03.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd31d7fa700 1 -- 172.21.15.60:0/933683928 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd334007180 con 0x18ddb30 2020-10-31T22:45:03.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd31d7fa700 1 -- 172.21.15.60:0/933683928 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd334013d00 con 0x18ddb30 2020-10-31T22:45:03.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 1 -- 172.21.15.60:0/933683928 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x173c4d0 con 0x18ddb30 2020-10-31T22:45:03.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd31d7fa700 1 -- 172.21.15.60:0/933683928 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3340013d0 con 0x18ddb30 2020-10-31T22:45:03.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 10 client.5748 fetch_fsmap learned FSMap version 23 2020-10-31T22:45:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 1 -- 172.21.15.60:0/933683928 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=2+}) v3 -- 0x195a780 con 0x18ddb30 2020-10-31T22:45:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd31d7fa700 1 -- 172.21.15.60:0/933683928 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x173c4d0 con 0x18ddb30 2020-10-31T22:45:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd31d7fa700 1 -- 172.21.15.60:0/933683928 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 23) v1 ==== 1434+0+0 (secure 0 0 0) 0x7fd334021a20 con 0x18ddb30 2020-10-31T22:45:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 10 client.5748 fetch_fsmap finished waiting for FSMap version 23 2020-10-31T22:45:03.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 10 client.5748 resolve_mds: resolved ID 'c' to GID 5553 2020-10-31T22:45:03.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 20 client.5748 populate_metadata read hostname 'smithi060' 2020-10-31T22:45:03.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 1 --2- 172.21.15.60:0/933683928 >> [v2:172.21.15.60:6836/798359639,v1:172.21.15.60:6837/798359639] conn(0x1924400 0x19c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:03.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 4 client.5748 mds_command: new command op to 5553 tid=0[{"prefix": "cache drop", "timeout": 5}] 2020-10-31T22:45:03.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd35215e740 1 -- 172.21.15.60:0/933683928 --> [v2:172.21.15.60:6836/798359639,v1:172.21.15.60:6837/798359639] -- command(tid 0: {"prefix": "cache drop", "timeout": 5}) v1 -- 0x178a730 con 0x1924400 2020-10-31T22:45:03.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.451+0000 7fd341562700 1 --2- 172.21.15.60:0/933683928 >> [v2:172.21.15.60:6836/798359639,v1:172.21.15.60:6837/798359639] conn(0x1924400 0x19c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:03.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.455+0000 7fd31d7fa700 10 client.5748 ms_handle_connect on v2:172.21.15.60:6836/798359639 2020-10-31T22:45:03.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:03.455+0000 7fd341562700 1 --2- 172.21.15.60:0/933683928 >> [v2:172.21.15.60:6836/798359639,v1:172.21.15.60:6837/798359639] conn(0x1924400 0x19c5c80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=e33646c7f3ec8903 server_cookie=91b2eb18ac09ecd in_seq=0 out_seq=0 2020-10-31T22:45:08.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.707+0000 7fd31d7fa700 1 -- 172.21.15.60:0/933683928 <== mds.0 v2:172.21.15.60:6836/798359639 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+397 (crc 0 0 0) 0x178a730 con 0x1924400 2020-10-31T22:45:08.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.707+0000 7fd31d7fa700 10 client.5748 handle_command_reply: tid=0 2020-10-31T22:45:08.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.707+0000 7fd35215e740 1 client.5748 shutdown 2020-10-31T22:45:08.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.707+0000 7fd35215e740 1 -- 172.21.15.60:0/933683928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x18ddb30 msgr2=0x19c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:08.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.707+0000 7fd35215e740 1 --2- 172.21.15.60:0/933683928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x18ddb30 0x19c5790 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x1972930 tx=0x7fd334017000).stop 2020-10-31T22:45:08.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.707+0000 7fd35215e740 1 -- 172.21.15.60:0/933683928 shutdown_connections 2020-10-31T22:45:08.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.707+0000 7fd35215e740 1 --2- 172.21.15.60:0/933683928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x18ddb30 0x19c5790 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:08.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.707+0000 7fd35215e740 1 --2- 172.21.15.60:0/933683928 >> [v2:172.21.15.60:6836/798359639,v1:172.21.15.60:6837/798359639] conn(0x1924400 0x19c5c80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:08.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.707+0000 7fd35215e740 1 --2- 172.21.15.60:0/933683928 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x16d8c20 0x18520e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:08.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.707+0000 7fd35215e740 1 --2- 172.21.15.60:0/933683928 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x1746820 0x19c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:08.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.707+0000 7fd35215e740 1 -- 172.21.15.60:0/933683928 >> 172.21.15.60:0/933683928 conn(0x190d590 msgr2=0x192af00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:08.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.707+0000 7fd31d7fa700 0 client.5748 ms_handle_reset on v2:172.21.15.60:6836/798359639 2020-10-31T22:45:08.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.707+0000 7fd35215e740 1 -- 172.21.15.60:0/933683928 shutdown_connections 2020-10-31T22:45:08.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.711+0000 7fd35215e740 1 -- 172.21.15.60:0/933683928 wait complete. 2020-10-31T22:45:08.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.711+0000 7fd35215e740 20 client.5748 trim_cache size 0 max 16384 2020-10-31T22:45:08.713 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:45:08.713 INFO:teuthology.orchestra.run.smithi060.stdout: "client_recall": { 2020-10-31T22:45:08.713 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": -110, 2020-10-31T22:45:08.713 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "(110) Connection timed out", 2020-10-31T22:45:08.713 INFO:teuthology.orchestra.run.smithi060.stdout: "recalled": 120 2020-10-31T22:45:08.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:45:08.713 INFO:teuthology.orchestra.run.smithi060.stdout: "flush_journal": { 2020-10-31T22:45:08.714 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2020-10-31T22:45:08.714 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "" 2020-10-31T22:45:08.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:45:08.714 INFO:teuthology.orchestra.run.smithi060.stdout: "trim_cache": { 2020-10-31T22:45:08.714 INFO:teuthology.orchestra.run.smithi060.stdout: "trimmed": 0 2020-10-31T22:45:08.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:45:08.715 INFO:teuthology.orchestra.run.smithi060.stdout: "cache": { 2020-10-31T22:45:08.715 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": { 2020-10-31T22:45:08.715 INFO:teuthology.orchestra.run.smithi060.stdout: "items": 19913, 2020-10-31T22:45:08.715 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes": 3094752 2020-10-31T22:45:08.715 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:45:08.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:45:08.715 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 5.255091105 2020-10-31T22:45:08.716 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:45:08.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.711+0000 7fd3437c6700 1 -- 172.21.15.60:0/205508222 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd324054f10 msgr2=0x7fd3240573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:08.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.711+0000 7fd3437c6700 1 --2- 172.21.15.60:0/205508222 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd324054f10 0x7fd3240573d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7fd32c00b000 tx=0x7fd32c006dc0).stop 2020-10-31T22:45:08.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.711+0000 7fd3437c6700 1 -- 172.21.15.60:0/205508222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c13d190 msgr2=0x7fd33c13c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:08.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.711+0000 7fd3437c6700 1 --2- 172.21.15.60:0/205508222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c13d190 0x7fd33c13c450 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7fd338002f30 tx=0x7fd338015000).stop 2020-10-31T22:45:08.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.711+0000 7fd3437c6700 1 -- 172.21.15.60:0/205508222 shutdown_connections 2020-10-31T22:45:08.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.711+0000 7fd3437c6700 1 --2- 172.21.15.60:0/205508222 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd33c13fd20 0x7fd33c13c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:08.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.711+0000 7fd3437c6700 1 --2- 172.21.15.60:0/205508222 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd324054f10 0x7fd3240573d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:08.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.711+0000 7fd3437c6700 1 --2- 172.21.15.60:0/205508222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd33c0b0dc0 0x7fd33c146e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:08.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.711+0000 7fd3437c6700 1 --2- 172.21.15.60:0/205508222 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd33c13d190 0x7fd33c13c450 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:08.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.711+0000 7fd3437c6700 1 -- 172.21.15.60:0/205508222 >> 172.21.15.60:0/205508222 conn(0x7fd33c06a260 msgr2=0x7fd33c13e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:08.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.711+0000 7fd3437c6700 1 -- 172.21.15.60:0/205508222 shutdown_connections 2020-10-31T22:45:08.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:08.711+0000 7fd3437c6700 1 -- 172.21.15.60:0/205508222 wait complete. 2020-10-31T22:45:08.723 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2020-10-31T22:45:08.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:45:08.725 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:45:08.726 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:45:08.734 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2020-10-31T22:45:08.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:45:08.736 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2020-10-31T22:45:08.736 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:45:08.736 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:45:08.737 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:45:08.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:45:08.810 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:45:08.811 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:45:08.859 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:45:08.860 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:45:08.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:45:08.861 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:45:08.907 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:45:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.023+0000 7f557759e700 1 Processor -- start 2020-10-31T22:45:09.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.023+0000 7f557759e700 1 -- start start 2020-10-31T22:45:09.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55780b5570 0x7f55780b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5578145180 con 0x7f55780b24a0 2020-10-31T22:45:09.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557759e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55780b0670 con 0x7f5578141fe0 2020-10-31T22:45:09.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55780afae0 con 0x7f55780b5570 2020-10-31T22:45:09.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55780b5570 0x7f55780b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f5575d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f55780b24a0 0x7f5578145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48414/0 (socket says 172.21.15.60:48414) 2020-10-31T22:45:09.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f5575d9b700 1 -- 172.21.15.60:0/3486679551 learned_addr learned my addr 172.21.15.60:0/3486679551 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:45:09.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557559a700 1 -- 172.21.15.60:0/3486679551 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754959611 0 0) 0x7f5578145180 con 0x7f55780b24a0 2020-10-31T22:45:09.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557559a700 1 -- 172.21.15.60:0/3486679551 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5558003230 con 0x7f55780b24a0 2020-10-31T22:45:09.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557659c700 1 -- 172.21.15.60:0/3486679551 >> v1:172.21.15.66:6789/0 conn(0x7f5578141fe0 legacy=0x7f5578142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557659c700 1 -- 172.21.15.60:0/3486679551 >> v1:172.21.15.60:6789/0 conn(0x7f55780b24a0 legacy=0x7f5578145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557659c700 1 -- 172.21.15.60:0/3486679551 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55780b0910 con 0x7f55780b5570 2020-10-31T22:45:09.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557659c700 1 --2- 172.21.15.60:0/3486679551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55780b5570 0x7f55780b5950 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f557805f580 tx=0x7f5560006dc0).ready entity=mon.0 client_cookie=85bb2f93f176d180 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:09.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557559a700 1 -- 172.21.15.60:0/3486679551 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f55600097c0 con 0x7f55780b5570 2020-10-31T22:45:09.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557559a700 1 -- 172.21.15.60:0/3486679551 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5560009920 con 0x7f55780b5570 2020-10-31T22:45:09.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557559a700 1 -- 172.21.15.60:0/3486679551 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5560009c80 con 0x7f55780b5570 2020-10-31T22:45:09.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557759e700 1 -- 172.21.15.60:0/3486679551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55780b5570 msgr2=0x7f55780b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557759e700 1 --2- 172.21.15.60:0/3486679551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55780b5570 0x7f55780b5950 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f557805f580 tx=0x7f5560006dc0).stop 2020-10-31T22:45:09.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557759e700 1 -- 172.21.15.60:0/3486679551 shutdown_connections 2020-10-31T22:45:09.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557759e700 1 --2- 172.21.15.60:0/3486679551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55780b5570 0x7f55780b5950 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557759e700 1 -- 172.21.15.60:0/3486679551 >> 172.21.15.60:0/3486679551 conn(0x7f55780b8e90 msgr2=0x7f55780b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:09.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557759e700 1 -- 172.21.15.60:0/3486679551 shutdown_connections 2020-10-31T22:45:09.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.027+0000 7f557759e700 1 -- 172.21.15.60:0/3486679551 wait complete. 2020-10-31T22:45:09.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.031+0000 7f557759e700 1 Processor -- start 2020-10-31T22:45:09.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.031+0000 7f557759e700 1 -- start start 2020-10-31T22:45:09.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.031+0000 7f557759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55780b24a0 0x7f5578148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.031+0000 7f557759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55780b5570 0x7f55780aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.031+0000 7f557759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5578141fe0 0x7f55780af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.031+0000 7f557759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5578148cb0 con 0x7f5578141fe0 2020-10-31T22:45:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.031+0000 7f557759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55781430c0 con 0x7f55780b5570 2020-10-31T22:45:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.031+0000 7f557759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5578143360 con 0x7f55780b24a0 2020-10-31T22:45:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.031+0000 7f5576d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5578141fe0 0x7f55780af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.031+0000 7f5576d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5578141fe0 0x7f55780af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44288/0 (socket says 172.21.15.60:44288) 2020-10-31T22:45:09.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.031+0000 7f5576d9d700 1 -- 172.21.15.60:0/2270800982 learned_addr learned my addr 172.21.15.60:0/2270800982 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.031+0000 7f5575d9b700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55780b5570 0x7f55780aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.031+0000 7f557659c700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55780b24a0 0x7f5578148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f5576d9d700 1 -- 172.21.15.60:0/2270800982 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55780b24a0 msgr2=0x7f5578148150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f5576d9d700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55780b24a0 0x7f5578148150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f5576d9d700 1 -- 172.21.15.60:0/2270800982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55780b5570 msgr2=0x7f55780aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f5576d9d700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55780b5570 0x7f55780aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f5576d9d700 1 -- 172.21.15.60:0/2270800982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5578148930 con 0x7f5578141fe0 2020-10-31T22:45:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f557659c700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55780b24a0 0x7f5578148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:45:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f5576d9d700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5578141fe0 0x7f55780af030 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f557805c9f0 tx=0x7f5570007e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f556f7fe700 1 -- 172.21.15.60:0/2270800982 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f557000ce20 con 0x7f5578141fe0 2020-10-31T22:45:09.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f556f7fe700 1 -- 172.21.15.60:0/2270800982 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557000a7b0 con 0x7f5578141fe0 2020-10-31T22:45:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f557759e700 1 -- 172.21.15.60:0/2270800982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5578153de0 con 0x7f5578141fe0 2020-10-31T22:45:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f556f7fe700 1 -- 172.21.15.60:0/2270800982 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f557000ab10 con 0x7f5578141fe0 2020-10-31T22:45:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f557759e700 1 -- 172.21.15.60:0/2270800982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55780ad500 con 0x7f5578141fe0 2020-10-31T22:45:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f557759e700 1 -- 172.21.15.60:0/2270800982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55781491a0 con 0x7f5578141fe0 2020-10-31T22:45:09.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f556f7fe700 1 -- 172.21.15.60:0/2270800982 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5570019030 con 0x7f5578141fe0 2020-10-31T22:45:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.035+0000 7f556f7fe700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f555c054f10 0x7f555c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.039+0000 7f557659c700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f555c054f10 0x7f555c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.039+0000 7f556f7fe700 1 -- 172.21.15.60:0/2270800982 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f557006d350 con 0x7f5578141fe0 2020-10-31T22:45:09.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.039+0000 7f557659c700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f555c054f10 0x7f555c0573d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f5560019000 tx=0x7f5560015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:09.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.043+0000 7f556f7fe700 1 -- 172.21.15.60:0/2270800982 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5570043870 con 0x7f5578141fe0 2020-10-31T22:45:09.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.183+0000 7f557759e700 1 -- 172.21.15.60:0/2270800982 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5578148ac0 con 0x7f5578141fe0 2020-10-31T22:45:09.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.183+0000 7f556f7fe700 1 -- 172.21.15.60:0/2270800982 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) v1 ==== 74+0+16040 (secure 0 0 0) 0x7f5570046e90 con 0x7f5578141fe0 2020-10-31T22:45:09.185 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:45:09.185 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":54,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:44:42.513291+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":9,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:44:39.101359+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":10,"pool_name":"cephfs_data","create_time":"2020-10-31T22:44:40.356100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:45:09.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.187+0000 7f557759e700 1 -- 172.21.15.60:0/2270800982 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f555c054f10 msgr2=0x7f555c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.187+0000 7f557759e700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f555c054f10 0x7f555c0573d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f5560019000 tx=0x7f5560015000).stop 2020-10-31T22:45:09.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.187+0000 7f557759e700 1 -- 172.21.15.60:0/2270800982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5578141fe0 msgr2=0x7f55780af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.187+0000 7f557759e700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5578141fe0 0x7f55780af030 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f557805c9f0 tx=0x7f5570007e80).stop 2020-10-31T22:45:09.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.187+0000 7f557759e700 1 -- 172.21.15.60:0/2270800982 shutdown_connections 2020-10-31T22:45:09.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.187+0000 7f557759e700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5578141fe0 0x7f55780af030 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.187+0000 7f557759e700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55780b24a0 0x7f5578148150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.187+0000 7f557759e700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f555c054f10 0x7f555c0573d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.187+0000 7f557759e700 1 --2- 172.21.15.60:0/2270800982 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55780b5570 0x7f55780aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.187+0000 7f557759e700 1 -- 172.21.15.60:0/2270800982 >> 172.21.15.60:0/2270800982 conn(0x7f55780b8e90 msgr2=0x7f55780661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:09.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.187+0000 7f557759e700 1 -- 172.21.15.60:0/2270800982 shutdown_connections 2020-10-31T22:45:09.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.187+0000 7f557759e700 1 -- 172.21.15.60:0/2270800982 wait complete. 2020-10-31T22:45:09.204 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 9, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:44:39.101359+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 10, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:44:40.356100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:45:09.205 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:45:09.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.323+0000 7fe084907700 1 Processor -- start 2020-10-31T22:45:09.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.323+0000 7fe084907700 1 -- start start 2020-10-31T22:45:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.323+0000 7fe084907700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe080065f70 0x7fe0800b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.323+0000 7fe084907700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0800b2e20 0x7fe080142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.323+0000 7fe084907700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe080066410 con 0x7fe08005c660 2020-10-31T22:45:09.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.323+0000 7fe084907700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe080066d60 con 0x7fe080065f70 2020-10-31T22:45:09.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.323+0000 7fe084907700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800b5e80 con 0x7fe0800b2e20 2020-10-31T22:45:09.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.323+0000 7fe07e59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe08005c660 0x7fe08013f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48428/0 (socket says 172.21.15.60:48428) 2020-10-31T22:45:09.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.323+0000 7fe07e59c700 1 -- 172.21.15.60:0/501411464 learned_addr learned my addr 172.21.15.60:0/501411464 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:45:09.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.323+0000 7fe07ed9d700 1 --2- 172.21.15.60:0/501411464 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0800b2e20 0x7fe080142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.323+0000 7fe07dd9b700 1 --2- 172.21.15.60:0/501411464 >> v2:172.21.15.66:3300/0 conn(0x7fe080065f70 0x7fe0800b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.323+0000 7fe07d59a700 1 -- 172.21.15.60:0/501411464 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3928347934 0 0) 0x7fe080066410 con 0x7fe08005c660 2020-10-31T22:45:09.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 -- 172.21.15.60:0/501411464 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe060003230 con 0x7fe08005c660 2020-10-31T22:45:09.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 -- 172.21.15.60:0/501411464 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1019729241 0 0) 0x7fe060003230 con 0x7fe08005c660 2020-10-31T22:45:09.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 -- 172.21.15.60:0/501411464 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0800b2e20 msgr2=0x7fe080142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:09.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 --2- 172.21.15.60:0/501411464 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0800b2e20 0x7fe080142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 -- 172.21.15.60:0/501411464 >> v2:172.21.15.66:3300/0 conn(0x7fe080065f70 msgr2=0x7fe0800b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:09.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 --2- 172.21.15.60:0/501411464 >> v2:172.21.15.66:3300/0 conn(0x7fe080065f70 0x7fe0800b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 -- 172.21.15.60:0/501411464 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800666b0 con 0x7fe08005c660 2020-10-31T22:45:09.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 -- 172.21.15.60:0/501411464 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fe0700016d0 con 0x7fe08005c660 2020-10-31T22:45:09.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07dd9b700 1 --2- 172.21.15.60:0/501411464 >> v2:172.21.15.66:3300/0 conn(0x7fe080065f70 0x7fe0800b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:45:09.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 -- 172.21.15.60:0/501411464 >> v1:172.21.15.60:6789/0 conn(0x7fe08005c660 legacy=0x7fe08013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 --2- 172.21.15.60:0/501411464 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0800b2e20 0x7fe060003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 --2- 172.21.15.60:0/501411464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe060003c30 0x7fe0600044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 --2- 172.21.15.60:0/501411464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0600049c0 0x7fe060004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 -- 172.21.15.60:0/501411464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800b5e80 con 0x7fe0600049c0 2020-10-31T22:45:09.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 -- 172.21.15.60:0/501411464 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0600041c0 con 0x7fe060003c30 2020-10-31T22:45:09.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 -- 172.21.15.60:0/501411464 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06000b720 con 0x7fe0800b2e20 2020-10-31T22:45:09.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07ed9d700 1 --2- 172.21.15.60:0/501411464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0600049c0 0x7fe060004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07dd9b700 1 --2- 172.21.15.60:0/501411464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe060003c30 0x7fe0600044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07e59c700 1 --2- 172.21.15.60:0/501411464 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0800b2e20 0x7fe060003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07ed9d700 1 -- 172.21.15.60:0/501411464 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0800b2e20 msgr2=0x7fe060003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:09.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07ed9d700 1 --2- 172.21.15.60:0/501411464 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0800b2e20 0x7fe060003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07ed9d700 1 -- 172.21.15.60:0/501411464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe060003c30 msgr2=0x7fe0600044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:09.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07ed9d700 1 --2- 172.21.15.60:0/501411464 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe060003c30 0x7fe0600044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07ed9d700 1 -- 172.21.15.60:0/501411464 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe060003230 con 0x7fe0600049c0 2020-10-31T22:45:09.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07e59c700 1 --2- 172.21.15.60:0/501411464 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0800b2e20 0x7fe060003720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:45:09.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07ed9d700 1 --2- 172.21.15.60:0/501411464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0600049c0 0x7fe060004e40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fe07800c000 tx=0x7fe0780091a0).ready entity=mon.0 client_cookie=d461a710dcbb6841 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:09.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 -- 172.21.15.60:0/501411464 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe07800ebd0 con 0x7fe0600049c0 2020-10-31T22:45:09.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 -- 172.21.15.60:0/501411464 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07800ed30 con 0x7fe0600049c0 2020-10-31T22:45:09.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07d59a700 1 -- 172.21.15.60:0/501411464 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe07800eea0 con 0x7fe0600049c0 2020-10-31T22:45:09.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe084907700 1 -- 172.21.15.60:0/501411464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0600049c0 msgr2=0x7fe060004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe084907700 1 --2- 172.21.15.60:0/501411464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0600049c0 0x7fe060004e40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7fe07800c000 tx=0x7fe0780091a0).stop 2020-10-31T22:45:09.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe07ed9d700 1 -- 172.21.15.60:0/501411464 reap_dead start 2020-10-31T22:45:09.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe084907700 1 -- 172.21.15.60:0/501411464 shutdown_connections 2020-10-31T22:45:09.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe084907700 1 -- 172.21.15.60:0/501411464 >> 172.21.15.60:0/501411464 conn(0x7fe0800601e0 msgr2=0x7fe08005b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:09.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe084907700 1 -- 172.21.15.60:0/501411464 shutdown_connections 2020-10-31T22:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.327+0000 7fe084907700 1 -- 172.21.15.60:0/501411464 wait complete. 2020-10-31T22:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe084907700 1 Processor -- start 2020-10-31T22:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe084907700 1 -- start start 2020-10-31T22:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe084907700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0801453d0 0x7fe080151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe084907700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe080145bb0 0x7fe080151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe084907700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0800ac6f0 0x7fe0800acb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe084907700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800b4410 con 0x7fe0800ac6f0 2020-10-31T22:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe084907700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0801457b0 con 0x7fe0801453d0 2020-10-31T22:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe084907700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe080151a30 con 0x7fe080145bb0 2020-10-31T22:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe07ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0800ac6f0 0x7fe0800acb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe07ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0800ac6f0 0x7fe0800acb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44308/0 (socket says 172.21.15.60:44308) 2020-10-31T22:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe07ed9d700 1 -- 172.21.15.60:0/2260007459 learned_addr learned my addr 172.21.15.60:0/2260007459 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe07dd9b700 1 --2- 172.21.15.60:0/2260007459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe080145bb0 0x7fe080151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe07e59c700 1 --2- 172.21.15.60:0/2260007459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0801453d0 0x7fe080151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe07ed9d700 1 -- 172.21.15.60:0/2260007459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe080145bb0 msgr2=0x7fe080151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe07ed9d700 1 --2- 172.21.15.60:0/2260007459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe080145bb0 0x7fe080151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe07ed9d700 1 -- 172.21.15.60:0/2260007459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0801453d0 msgr2=0x7fe080151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe07ed9d700 1 --2- 172.21.15.60:0/2260007459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0801453d0 0x7fe080151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe07ed9d700 1 -- 172.21.15.60:0/2260007459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0800af0d0 con 0x7fe0800ac6f0 2020-10-31T22:45:09.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe07ed9d700 1 --2- 172.21.15.60:0/2260007459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0800ac6f0 0x7fe0800acb10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fe08005afe0 tx=0x7fe07801a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe0777fe700 1 -- 172.21.15.60:0/2260007459 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe078012e60 con 0x7fe0800ac6f0 2020-10-31T22:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe0777fe700 1 -- 172.21.15.60:0/2260007459 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07801b630 con 0x7fe0800ac6f0 2020-10-31T22:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe0777fe700 1 -- 172.21.15.60:0/2260007459 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe07801b990 con 0x7fe0800ac6f0 2020-10-31T22:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe084907700 1 -- 172.21.15.60:0/2260007459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe080154bb0 con 0x7fe0800ac6f0 2020-10-31T22:45:09.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.331+0000 7fe084907700 1 -- 172.21.15.60:0/2260007459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0800aedc0 con 0x7fe0800ac6f0 2020-10-31T22:45:09.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.335+0000 7fe0777fe700 1 -- 172.21.15.60:0/2260007459 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe07801baf0 con 0x7fe0800ac6f0 2020-10-31T22:45:09.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.335+0000 7fe084907700 1 -- 172.21.15.60:0/2260007459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe080057100 con 0x7fe0800ac6f0 2020-10-31T22:45:09.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.335+0000 7fe0777fe700 1 --2- 172.21.15.60:0/2260007459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe064054f30 0x7fe0640573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.335+0000 7fe0777fe700 1 -- 172.21.15.60:0/2260007459 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe078002020 con 0x7fe0800ac6f0 2020-10-31T22:45:09.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.335+0000 7fe07e59c700 1 --2- 172.21.15.60:0/2260007459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe064054f30 0x7fe0640573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.335+0000 7fe07e59c700 1 --2- 172.21.15.60:0/2260007459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe064054f30 0x7fe0640573f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fe07000d000 tx=0x7fe070007040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:09.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.343+0000 7fe0777fe700 1 -- 172.21.15.60:0/2260007459 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe078045470 con 0x7fe0800ac6f0 2020-10-31T22:45:09.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.479+0000 7fe084907700 1 -- 172.21.15.60:0/2260007459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe08005aa70 con 0x7fe0800ac6f0 2020-10-31T22:45:09.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.483+0000 7fe0777fe700 1 -- 172.21.15.60:0/2260007459 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v54) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe078048a90 con 0x7fe0800ac6f0 2020-10-31T22:45:09.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.483+0000 7fe084907700 1 -- 172.21.15.60:0/2260007459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe064054f30 msgr2=0x7fe0640573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.483+0000 7fe084907700 1 --2- 172.21.15.60:0/2260007459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe064054f30 0x7fe0640573f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fe07000d000 tx=0x7fe070007040).stop 2020-10-31T22:45:09.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.483+0000 7fe084907700 1 -- 172.21.15.60:0/2260007459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0800ac6f0 msgr2=0x7fe0800acb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.483+0000 7fe084907700 1 --2- 172.21.15.60:0/2260007459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0800ac6f0 0x7fe0800acb10 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fe08005afe0 tx=0x7fe07801a000).stop 2020-10-31T22:45:09.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.483+0000 7fe084907700 1 -- 172.21.15.60:0/2260007459 shutdown_connections 2020-10-31T22:45:09.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.483+0000 7fe084907700 1 --2- 172.21.15.60:0/2260007459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0800ac6f0 0x7fe0800acb10 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.483+0000 7fe084907700 1 --2- 172.21.15.60:0/2260007459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe064054f30 0x7fe0640573f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.483+0000 7fe084907700 1 --2- 172.21.15.60:0/2260007459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0801453d0 0x7fe080151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.483+0000 7fe084907700 1 --2- 172.21.15.60:0/2260007459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe080145bb0 0x7fe080151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.483+0000 7fe084907700 1 -- 172.21.15.60:0/2260007459 >> 172.21.15.60:0/2260007459 conn(0x7fe0800601e0 msgr2=0x7fe08013e000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.483+0000 7fe084907700 1 -- 172.21.15.60:0/2260007459 shutdown_connections 2020-10-31T22:45:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.483+0000 7fe084907700 1 -- 172.21.15.60:0/2260007459 wait complete. 2020-10-31T22:45:09.488 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:45:09.503 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:45:09.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.619+0000 7fb25d88b700 1 Processor -- start 2020-10-31T22:45:09.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.619+0000 7fb25d88b700 1 -- start start 2020-10-31T22:45:09.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb25d88b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb2580b5040 0x7fb2580b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb25d88b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2580b13c0 0x7fb258141f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb25d88b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb258063520 con 0x7fb258063140 2020-10-31T22:45:09.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb25d88b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2580b5550 con 0x7fb2580b5040 2020-10-31T22:45:09.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb25d88b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2580b57f0 con 0x7fb2580b13c0 2020-10-31T22:45:09.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb257fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb2580b5040 0x7fb2580b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb257fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb2580b5040 0x7fb2580b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44314/0 (socket says 172.21.15.60:44314) 2020-10-31T22:45:09.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb257fff700 1 -- 172.21.15.60:0/3614744654 learned_addr learned my addr 172.21.15.60:0/3614744654 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:09.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb25d08a700 1 --2- 172.21.15.60:0/3614744654 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2580b13c0 0x7fb258141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb257fff700 1 -- 172.21.15.60:0/3614744654 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2580b13c0 msgr2=0x7fb258141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:09.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb257fff700 1 --2- 172.21.15.60:0/3614744654 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2580b13c0 0x7fb258141f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb257fff700 1 -- 172.21.15.60:0/3614744654 >> v1:172.21.15.60:6789/0 conn(0x7fb258063140 legacy=0x7fb2580b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb2577fe700 1 -- 172.21.15.60:0/3614744654 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3290330599 0 0) 0x7fb258063520 con 0x7fb258063140 2020-10-31T22:45:09.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb257fff700 1 -- 172.21.15.60:0/3614744654 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2580b5a90 con 0x7fb2580b5040 2020-10-31T22:45:09.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb257fff700 1 --2- 172.21.15.60:0/3614744654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2580b5040 0x7fb2580b2310 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fb24c002f30 tx=0x7fb24c006e80).ready entity=mon.0 client_cookie=129a5f235f4eff7f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:09.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb2577fe700 1 -- 172.21.15.60:0/3614744654 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb24c0097f0 con 0x7fb2580b5040 2020-10-31T22:45:09.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb2577fe700 1 -- 172.21.15.60:0/3614744654 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c009950 con 0x7fb2580b5040 2020-10-31T22:45:09.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb2577fe700 1 -- 172.21.15.60:0/3614744654 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb24c009cb0 con 0x7fb2580b5040 2020-10-31T22:45:09.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb25d88b700 1 -- 172.21.15.60:0/3614744654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2580b5040 msgr2=0x7fb2580b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb25d88b700 1 --2- 172.21.15.60:0/3614744654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2580b5040 0x7fb2580b2310 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7fb24c002f30 tx=0x7fb24c006e80).stop 2020-10-31T22:45:09.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb25d88b700 1 -- 172.21.15.60:0/3614744654 shutdown_connections 2020-10-31T22:45:09.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb25d88b700 1 --2- 172.21.15.60:0/3614744654 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2580b13c0 0x7fb258141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb25d88b700 1 --2- 172.21.15.60:0/3614744654 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2580b5040 0x7fb2580b2310 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb25d88b700 1 -- 172.21.15.60:0/3614744654 >> 172.21.15.60:0/3614744654 conn(0x7fb25806a600 msgr2=0x7fb258060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:09.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb25d88b700 1 -- 172.21.15.60:0/3614744654 shutdown_connections 2020-10-31T22:45:09.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.623+0000 7fb25d88b700 1 -- 172.21.15.60:0/3614744654 wait complete. 2020-10-31T22:45:09.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d88b700 1 Processor -- start 2020-10-31T22:45:09.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d88b700 1 -- start start 2020-10-31T22:45:09.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d88b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb258063140 0x7fb2580a1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d88b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2580b13c0 0x7fb258143370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d88b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2580b5040 0x7fb258143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d88b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2580a0c10 con 0x7fb2580b5040 2020-10-31T22:45:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d88b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2581524f0 con 0x7fb258063140 2020-10-31T22:45:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d88b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb258152790 con 0x7fb2580b13c0 2020-10-31T22:45:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d08a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2580b5040 0x7fb258143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d08a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2580b5040 0x7fb258143860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44322/0 (socket says 172.21.15.60:44322) 2020-10-31T22:45:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d08a700 1 -- 172.21.15.60:0/1584223789 learned_addr learned my addr 172.21.15.60:0/1584223789 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:09.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb257fff700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2580b13c0 0x7fb258143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25c889700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb258063140 0x7fb2580a1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d08a700 1 -- 172.21.15.60:0/1584223789 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2580b13c0 msgr2=0x7fb258143370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d08a700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2580b13c0 0x7fb258143370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d08a700 1 -- 172.21.15.60:0/1584223789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb258063140 msgr2=0x7fb2580a1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d08a700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb258063140 0x7fb2580a1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d08a700 1 -- 172.21.15.60:0/1584223789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25809e010 con 0x7fb2580b5040 2020-10-31T22:45:09.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb257fff700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2580b13c0 0x7fb258143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:45:09.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25c889700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb258063140 0x7fb2580a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:45:09.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d08a700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2580b5040 0x7fb258143860 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fb250006dd0 tx=0x7fb2500091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:09.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb255ffb700 1 -- 172.21.15.60:0/1584223789 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb25000eee0 con 0x7fb2580b5040 2020-10-31T22:45:09.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb255ffb700 1 -- 172.21.15.60:0/1584223789 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25000cc40 con 0x7fb2580b5040 2020-10-31T22:45:09.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d88b700 1 -- 172.21.15.60:0/1584223789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb258143d50 con 0x7fb2580b5040 2020-10-31T22:45:09.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb255ffb700 1 -- 172.21.15.60:0/1584223789 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb2500123f0 con 0x7fb2580b5040 2020-10-31T22:45:09.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.627+0000 7fb25d88b700 1 -- 172.21.15.60:0/1584223789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25809e7f0 con 0x7fb2580b5040 2020-10-31T22:45:09.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.631+0000 7fb255ffb700 1 -- 172.21.15.60:0/1584223789 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb250022070 con 0x7fb2580b5040 2020-10-31T22:45:09.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.631+0000 7fb25d88b700 1 -- 172.21.15.60:0/1584223789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25809e3d0 con 0x7fb2580b5040 2020-10-31T22:45:09.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.631+0000 7fb255ffb700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb238054f30 0x7fb2380573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.631+0000 7fb255ffb700 1 -- 172.21.15.60:0/1584223789 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb25006e2d0 con 0x7fb2580b5040 2020-10-31T22:45:09.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.631+0000 7fb25c889700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb238054f30 0x7fb2380573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.631+0000 7fb25c889700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb238054f30 0x7fb2380573f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fb24800b000 tx=0x7fb248009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:09.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.639+0000 7fb255ffb700 1 -- 172.21.15.60:0/1584223789 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb250044750 con 0x7fb2580b5040 2020-10-31T22:45:09.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.783+0000 7fb25d88b700 1 -- 172.21.15.60:0/1584223789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb25809e1a0 con 0x7fb2580b5040 2020-10-31T22:45:09.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.783+0000 7fb255ffb700 1 -- 172.21.15.60:0/1584223789 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v54) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb250016020 con 0x7fb2580b5040 2020-10-31T22:45:09.787 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:45:09.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.787+0000 7fb25d88b700 1 -- 172.21.15.60:0/1584223789 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb238054f30 msgr2=0x7fb2380573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.787+0000 7fb25d88b700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb238054f30 0x7fb2380573f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7fb24800b000 tx=0x7fb248009040).stop 2020-10-31T22:45:09.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.787+0000 7fb25d88b700 1 -- 172.21.15.60:0/1584223789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2580b5040 msgr2=0x7fb258143860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.787+0000 7fb25d88b700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2580b5040 0x7fb258143860 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fb250006dd0 tx=0x7fb2500091a0).stop 2020-10-31T22:45:09.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.787+0000 7fb25d88b700 1 -- 172.21.15.60:0/1584223789 shutdown_connections 2020-10-31T22:45:09.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.787+0000 7fb25d88b700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb2580b5040 0x7fb258143860 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.787+0000 7fb25d88b700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb238054f30 0x7fb2380573f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.787+0000 7fb25d88b700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb258063140 0x7fb2580a1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.787+0000 7fb25d88b700 1 --2- 172.21.15.60:0/1584223789 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb2580b13c0 0x7fb258143370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.787+0000 7fb25d88b700 1 -- 172.21.15.60:0/1584223789 >> 172.21.15.60:0/1584223789 conn(0x7fb25806a600 msgr2=0x7fb2580a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:09.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.787+0000 7fb25d88b700 1 -- 172.21.15.60:0/1584223789 shutdown_connections 2020-10-31T22:45:09.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.787+0000 7fb25d88b700 1 -- 172.21.15.60:0/1584223789 wait complete. 2020-10-31T22:45:09.797 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:45:09.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17f317700 1 Processor -- start 2020-10-31T22:45:09.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17f317700 1 -- start start 2020-10-31T22:45:09.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17f317700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe1780b5570 0x7fe1780b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17f317700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe178141f00 0x7fe178142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17f317700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1780b4440 con 0x7fe1780b24a0 2020-10-31T22:45:09.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17f317700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17813f930 con 0x7fe1780b5570 2020-10-31T22:45:09.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17f317700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe178146060 con 0x7fe178141f00 2020-10-31T22:45:09.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17e315700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe1780b5570 0x7fe1780b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17eb16700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe178141f00 0x7fe178142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17e315700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe1780b5570 0x7fe1780b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44328/0 (socket says 172.21.15.60:44328) 2020-10-31T22:45:09.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17e315700 1 -- 172.21.15.60:0/3998991846 learned_addr learned my addr 172.21.15.60:0/3998991846 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:09.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17e315700 1 -- 172.21.15.60:0/3998991846 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe178141f00 msgr2=0x7fe178142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:09.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17e315700 1 --2- 172.21.15.60:0/3998991846 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe178141f00 0x7fe178142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17e315700 1 -- 172.21.15.60:0/3998991846 >> v1:172.21.15.66:6789/0 conn(0x7fe1780b24a0 legacy=0x7fe178145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.919+0000 7fe17e315700 1 -- 172.21.15.60:0/3998991846 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1780b02f0 con 0x7fe1780b5570 2020-10-31T22:45:09.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.923+0000 7fe17e315700 1 --2- 172.21.15.60:0/3998991846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780b5570 0x7fe1780b5950 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fe168002f30 tx=0x7fe168006e80).ready entity=mon.0 client_cookie=9263f2caf6247162 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:09.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.927+0000 7fe17d313700 1 -- 172.21.15.60:0/3998991846 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1680097f0 con 0x7fe1780b5570 2020-10-31T22:45:09.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.927+0000 7fe17d313700 1 -- 172.21.15.60:0/3998991846 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe168009950 con 0x7fe1780b5570 2020-10-31T22:45:09.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.927+0000 7fe17d313700 1 -- 172.21.15.60:0/3998991846 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe168009cb0 con 0x7fe1780b5570 2020-10-31T22:45:09.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.927+0000 7fe17f317700 1 -- 172.21.15.60:0/3998991846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780b5570 msgr2=0x7fe1780b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.927+0000 7fe17f317700 1 --2- 172.21.15.60:0/3998991846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780b5570 0x7fe1780b5950 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fe168002f30 tx=0x7fe168006e80).stop 2020-10-31T22:45:09.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.927+0000 7fe17f317700 1 -- 172.21.15.60:0/3998991846 shutdown_connections 2020-10-31T22:45:09.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.927+0000 7fe17f317700 1 --2- 172.21.15.60:0/3998991846 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe178141f00 0x7fe178142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.927+0000 7fe17f317700 1 --2- 172.21.15.60:0/3998991846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780b5570 0x7fe1780b5950 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.927+0000 7fe17f317700 1 -- 172.21.15.60:0/3998991846 >> 172.21.15.60:0/3998991846 conn(0x7fe1780b8e90 msgr2=0x7fe1780b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:09.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.927+0000 7fe17f317700 1 -- 172.21.15.60:0/3998991846 shutdown_connections 2020-10-31T22:45:09.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.927+0000 7fe17f317700 1 -- 172.21.15.60:0/3998991846 wait complete. 2020-10-31T22:45:09.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17f317700 1 Processor -- start 2020-10-31T22:45:09.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17f317700 1 -- start start 2020-10-31T22:45:09.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17f317700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1780b24a0 0x7fe178144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17f317700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780b5570 0x7fe1780ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17f317700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe178141f00 0x7fe17813c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17f317700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780adc20 con 0x7fe1780b5570 2020-10-31T22:45:09.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17f317700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780adec0 con 0x7fe1780b24a0 2020-10-31T22:45:09.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17f317700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780ae160 con 0x7fe178141f00 2020-10-31T22:45:09.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17db14700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780b5570 0x7fe1780ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17e315700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1780b24a0 0x7fe178144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17db14700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780b5570 0x7fe1780ac250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44334/0 (socket says 172.21.15.60:44334) 2020-10-31T22:45:09.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17eb16700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe178141f00 0x7fe17813c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17db14700 1 -- 172.21.15.60:0/4219962044 learned_addr learned my addr 172.21.15.60:0/4219962044 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:09.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17db14700 1 -- 172.21.15.60:0/4219962044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe178141f00 msgr2=0x7fe17813c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17db14700 1 --2- 172.21.15.60:0/4219962044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe178141f00 0x7fe17813c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17db14700 1 -- 172.21.15.60:0/4219962044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1780b24a0 msgr2=0x7fe178144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:09.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17db14700 1 --2- 172.21.15.60:0/4219962044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1780b24a0 0x7fe178144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:09.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17db14700 1 -- 172.21.15.60:0/4219962044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1780ae400 con 0x7fe1780b5570 2020-10-31T22:45:09.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17db14700 1 --2- 172.21.15.60:0/4219962044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780b5570 0x7fe1780ac250 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fe1780610d0 tx=0x7fe174007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:09.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe16f7fe700 1 -- 172.21.15.60:0/4219962044 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe174007240 con 0x7fe1780b5570 2020-10-31T22:45:09.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe16f7fe700 1 -- 172.21.15.60:0/4219962044 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1740073a0 con 0x7fe1780b5570 2020-10-31T22:45:09.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17f317700 1 -- 172.21.15.60:0/4219962044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1780b7ac0 con 0x7fe1780b5570 2020-10-31T22:45:09.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe16f7fe700 1 -- 172.21.15.60:0/4219962044 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe1740064e0 con 0x7fe1780b5570 2020-10-31T22:45:09.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.931+0000 7fe17f317700 1 -- 172.21.15.60:0/4219962044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1780ac8e0 con 0x7fe1780b5570 2020-10-31T22:45:09.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.935+0000 7fe17f317700 1 -- 172.21.15.60:0/4219962044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1780ae590 con 0x7fe1780b5570 2020-10-31T22:45:09.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.935+0000 7fe16f7fe700 1 -- 172.21.15.60:0/4219962044 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe174010070 con 0x7fe1780b5570 2020-10-31T22:45:09.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.935+0000 7fe16f7fe700 1 --2- 172.21.15.60:0/4219962044 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe158054f10 0x7fe1580573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:09.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.935+0000 7fe16f7fe700 1 -- 172.21.15.60:0/4219962044 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe17406ced0 con 0x7fe1780b5570 2020-10-31T22:45:09.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.935+0000 7fe17e315700 1 --2- 172.21.15.60:0/4219962044 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe158054f10 0x7fe1580573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:09.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.935+0000 7fe17e315700 1 --2- 172.21.15.60:0/4219962044 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe158054f10 0x7fe1580573d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fe16801c000 tx=0x7fe168015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:09.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:09.939+0000 7fe16f7fe700 1 -- 172.21.15.60:0/4219962044 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe1740433f0 con 0x7fe1780b5570 2020-10-31T22:45:10.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.079+0000 7fe17f317700 1 -- 172.21.15.60:0/4219962044 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe178057100 con 0x7fe1780b5570 2020-10-31T22:45:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.079+0000 7fe16f7fe700 1 -- 172.21.15.60:0/4219962044 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v54) v1 ==== 104+0+10 (secure 0 0 0) 0x7fe174018070 con 0x7fe1780b5570 2020-10-31T22:45:10.082 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:45:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.083+0000 7fe17f317700 1 -- 172.21.15.60:0/4219962044 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe158054f10 msgr2=0x7fe1580573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.083+0000 7fe17f317700 1 --2- 172.21.15.60:0/4219962044 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe158054f10 0x7fe1580573d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7fe16801c000 tx=0x7fe168015000).stop 2020-10-31T22:45:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.083+0000 7fe17f317700 1 -- 172.21.15.60:0/4219962044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780b5570 msgr2=0x7fe1780ac250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.083+0000 7fe17f317700 1 --2- 172.21.15.60:0/4219962044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780b5570 0x7fe1780ac250 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fe1780610d0 tx=0x7fe174007be0).stop 2020-10-31T22:45:10.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.083+0000 7fe17f317700 1 -- 172.21.15.60:0/4219962044 shutdown_connections 2020-10-31T22:45:10.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.083+0000 7fe17f317700 1 --2- 172.21.15.60:0/4219962044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe178141f00 0x7fe17813c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.083+0000 7fe17f317700 1 --2- 172.21.15.60:0/4219962044 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe158054f10 0x7fe1580573d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.083+0000 7fe17f317700 1 --2- 172.21.15.60:0/4219962044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1780b24a0 0x7fe178144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.083+0000 7fe17f317700 1 --2- 172.21.15.60:0/4219962044 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe1780b5570 0x7fe1780ac250 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.083+0000 7fe17f317700 1 -- 172.21.15.60:0/4219962044 >> 172.21.15.60:0/4219962044 conn(0x7fe1780b8e90 msgr2=0x7fe17806ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.083+0000 7fe17f317700 1 -- 172.21.15.60:0/4219962044 shutdown_connections 2020-10-31T22:45:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.083+0000 7fe17f317700 1 -- 172.21.15.60:0/4219962044 wait complete. 2020-10-31T22:45:10.095 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:45:10.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.219+0000 7fd874fe3700 1 Processor -- start 2020-10-31T22:45:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.219+0000 7fd874fe3700 1 -- start start 2020-10-31T22:45:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.219+0000 7fd874fe3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8700b5570 0x7fd8700b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.219+0000 7fd874fe3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8700b24a0 0x7fd870145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.219+0000 7fd874fe3700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8700b4440 con 0x7fd870145e40 2020-10-31T22:45:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd874fe3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87013f930 con 0x7fd8700b24a0 2020-10-31T22:45:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd874fe3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700b02f0 con 0x7fd8700b5570 2020-10-31T22:45:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd86effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8700b24a0 0x7fd870145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd86effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8700b24a0 0x7fd870145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44340/0 (socket says 172.21.15.60:44340) 2020-10-31T22:45:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd86effd700 1 -- 172.21.15.60:0/2601321330 learned_addr learned my addr 172.21.15.60:0/2601321330 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd86f7fe700 1 --2- 172.21.15.60:0/2601321330 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8700b5570 0x7fd8700b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd86effd700 1 -- 172.21.15.60:0/2601321330 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8700b5570 msgr2=0x7fd8700b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd86effd700 1 --2- 172.21.15.60:0/2601321330 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8700b5570 0x7fd8700b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd86effd700 1 -- 172.21.15.60:0/2601321330 >> v1:172.21.15.66:6789/0 conn(0x7fd870145e40 legacy=0x7fd870141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd86effd700 1 -- 172.21.15.60:0/2601321330 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8700b0590 con 0x7fd8700b24a0 2020-10-31T22:45:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd86effd700 1 --2- 172.21.15.60:0/2601321330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8700b24a0 0x7fd870145950 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fd870141c20 tx=0x7fd858006e80).ready entity=mon.0 client_cookie=40c3eff97c711201 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd86e7fc700 1 -- 172.21.15.60:0/2601321330 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8580097b0 con 0x7fd8700b24a0 2020-10-31T22:45:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd86e7fc700 1 -- 172.21.15.60:0/2601321330 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd858009910 con 0x7fd8700b24a0 2020-10-31T22:45:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd86e7fc700 1 -- 172.21.15.60:0/2601321330 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd858009c70 con 0x7fd8700b24a0 2020-10-31T22:45:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd874fe3700 1 -- 172.21.15.60:0/2601321330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8700b24a0 msgr2=0x7fd870145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd874fe3700 1 --2- 172.21.15.60:0/2601321330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8700b24a0 0x7fd870145950 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fd870141c20 tx=0x7fd858006e80).stop 2020-10-31T22:45:10.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd874fe3700 1 -- 172.21.15.60:0/2601321330 shutdown_connections 2020-10-31T22:45:10.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd874fe3700 1 --2- 172.21.15.60:0/2601321330 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8700b5570 0x7fd8700b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd874fe3700 1 --2- 172.21.15.60:0/2601321330 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8700b24a0 0x7fd870145950 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd874fe3700 1 -- 172.21.15.60:0/2601321330 >> 172.21.15.60:0/2601321330 conn(0x7fd8700b8e90 msgr2=0x7fd8700b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:10.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd874fe3700 1 -- 172.21.15.60:0/2601321330 shutdown_connections 2020-10-31T22:45:10.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.223+0000 7fd874fe3700 1 -- 172.21.15.60:0/2601321330 wait complete. 2020-10-31T22:45:10.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.227+0000 7fd874fe3700 1 Processor -- start 2020-10-31T22:45:10.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.227+0000 7fd874fe3700 1 -- start start 2020-10-31T22:45:10.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.227+0000 7fd874fe3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8700b24a0 0x7fd870144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:10.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.227+0000 7fd874fe3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8700b5570 0x7fd87013e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:10.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.227+0000 7fd874fe3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd870145e40 0x7fd87013e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:10.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.227+0000 7fd874fe3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700ae400 con 0x7fd8700b24a0 2020-10-31T22:45:10.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.227+0000 7fd874fe3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700ae6a0 con 0x7fd870145e40 2020-10-31T22:45:10.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.227+0000 7fd874fe3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700ae940 con 0x7fd8700b5570 2020-10-31T22:45:10.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.227+0000 7fd86f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8700b24a0 0x7fd870144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:10.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.227+0000 7fd86f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8700b24a0 0x7fd870144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44348/0 (socket says 172.21.15.60:44348) 2020-10-31T22:45:10.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.227+0000 7fd86f7fe700 1 -- 172.21.15.60:0/3050814896 learned_addr learned my addr 172.21.15.60:0/3050814896 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:10.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd86effd700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8700b5570 0x7fd87013e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:10.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd86ffff700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd870145e40 0x7fd87013e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:10.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd86f7fe700 1 -- 172.21.15.60:0/3050814896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8700b5570 msgr2=0x7fd87013e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:10.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd86f7fe700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8700b5570 0x7fd87013e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd86f7fe700 1 -- 172.21.15.60:0/3050814896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd870145e40 msgr2=0x7fd87013e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:10.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd86f7fe700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd870145e40 0x7fd87013e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd86f7fe700 1 -- 172.21.15.60:0/3050814896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8700aebe0 con 0x7fd8700b24a0 2020-10-31T22:45:10.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd86ffff700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd870145e40 0x7fd87013e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:45:10.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd86f7fe700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8700b24a0 0x7fd870144260 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fd86000c000 tx=0x7fd860006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:10.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd86cff9700 1 -- 172.21.15.60:0/3050814896 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd86000ca10 con 0x7fd8700b24a0 2020-10-31T22:45:10.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd86cff9700 1 -- 172.21.15.60:0/3050814896 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86000cb70 con 0x7fd8700b24a0 2020-10-31T22:45:10.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd874fe3700 1 -- 172.21.15.60:0/3050814896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd87013eeb0 con 0x7fd8700b24a0 2020-10-31T22:45:10.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd86cff9700 1 -- 172.21.15.60:0/3050814896 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8600123f0 con 0x7fd8700b24a0 2020-10-31T22:45:10.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd874fe3700 1 -- 172.21.15.60:0/3050814896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8700af060 con 0x7fd8700b24a0 2020-10-31T22:45:10.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd874fe3700 1 -- 172.21.15.60:0/3050814896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd870149120 con 0x7fd8700b24a0 2020-10-31T22:45:10.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd86cff9700 1 -- 172.21.15.60:0/3050814896 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd860012550 con 0x7fd8700b24a0 2020-10-31T22:45:10.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.231+0000 7fd86cff9700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd854055020 0x7fd8540574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:10.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.235+0000 7fd86effd700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd854055020 0x7fd8540574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:10.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.235+0000 7fd86cff9700 1 -- 172.21.15.60:0/3050814896 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd86006dec0 con 0x7fd8700b24a0 2020-10-31T22:45:10.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.235+0000 7fd86effd700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd854055020 0x7fd8540574e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fd85801c000 tx=0x7fd858015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:10.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.239+0000 7fd86cff9700 1 -- 172.21.15.60:0/3050814896 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd870149120 con 0x7fd8700b24a0 2020-10-31T22:45:10.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.383+0000 7fd874fe3700 1 -- 172.21.15.60:0/3050814896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd870149120 con 0x7fd8700b24a0 2020-10-31T22:45:10.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.383+0000 7fd86cff9700 1 -- 172.21.15.60:0/3050814896 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v54) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd870149120 con 0x7fd8700b24a0 2020-10-31T22:45:10.383 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:45:10.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.387+0000 7fd874fe3700 1 -- 172.21.15.60:0/3050814896 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd854055020 msgr2=0x7fd8540574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:10.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.387+0000 7fd874fe3700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd854055020 0x7fd8540574e0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7fd85801c000 tx=0x7fd858015000).stop 2020-10-31T22:45:10.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.387+0000 7fd874fe3700 1 -- 172.21.15.60:0/3050814896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8700b24a0 msgr2=0x7fd870144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:10.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.387+0000 7fd874fe3700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8700b24a0 0x7fd870144260 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fd86000c000 tx=0x7fd860006dc0).stop 2020-10-31T22:45:10.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.387+0000 7fd874fe3700 1 -- 172.21.15.60:0/3050814896 shutdown_connections 2020-10-31T22:45:10.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.387+0000 7fd874fe3700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd854055020 0x7fd8540574e0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.387+0000 7fd874fe3700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd870145e40 0x7fd87013e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.387+0000 7fd874fe3700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8700b24a0 0x7fd870144260 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.387+0000 7fd874fe3700 1 --2- 172.21.15.60:0/3050814896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8700b5570 0x7fd87013e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.387+0000 7fd874fe3700 1 -- 172.21.15.60:0/3050814896 >> 172.21.15.60:0/3050814896 conn(0x7fd8700b8e90 msgr2=0x7fd8700b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:10.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.387+0000 7fd874fe3700 1 -- 172.21.15.60:0/3050814896 shutdown_connections 2020-10-31T22:45:10.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.387+0000 7fd874fe3700 1 -- 172.21.15.60:0/3050814896 wait complete. 2020-10-31T22:45:10.404 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:45:10.405 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:45:10.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42ab268700 1 Processor -- start 2020-10-31T22:45:10.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42ab268700 1 -- start start 2020-10-31T22:45:10.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42ab268700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42a40b1d50 0x7f42a405bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:10.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42ab268700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42a405c2d0 0x7f42a4146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:10.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42ab268700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a405b080 con 0x7f42a4149740 2020-10-31T22:45:10.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42ab268700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a4147130 con 0x7f42a40b1d50 2020-10-31T22:45:10.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42ab268700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40b2130 con 0x7f42a405c2d0 2020-10-31T22:45:10.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42aa266700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42a40b1d50 0x7f42a405bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:10.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42aa266700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42a40b1d50 0x7f42a405bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44354/0 (socket says 172.21.15.60:44354) 2020-10-31T22:45:10.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42aa266700 1 -- 172.21.15.60:0/604509898 learned_addr learned my addr 172.21.15.60:0/604509898 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:10.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42a9a65700 1 --2- 172.21.15.60:0/604509898 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42a405c2d0 0x7f42a4146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:10.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42aa266700 1 -- 172.21.15.60:0/604509898 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42a405c2d0 msgr2=0x7f42a4146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:45:10.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42aa266700 1 --2- 172.21.15.60:0/604509898 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42a405c2d0 0x7f42a4146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42aa266700 1 -- 172.21.15.60:0/604509898 >> v1:172.21.15.66:6789/0 conn(0x7f42a4149740 legacy=0x7f42a4149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:10.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42aa266700 1 -- 172.21.15.60:0/604509898 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a405b2b0 con 0x7f42a40b1d50 2020-10-31T22:45:10.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42aa266700 1 --2- 172.21.15.60:0/604509898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a40b1d50 0x7f42a405bc90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f42a0002f30 tx=0x7f42a0006e80).ready entity=mon.0 client_cookie=43eee7a8639b3ad7 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:10.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42a9264700 1 -- 172.21.15.60:0/604509898 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42a00097f0 con 0x7f42a40b1d50 2020-10-31T22:45:10.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42a9264700 1 -- 172.21.15.60:0/604509898 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a0009950 con 0x7f42a40b1d50 2020-10-31T22:45:10.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42a9264700 1 -- 172.21.15.60:0/604509898 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42a0009cb0 con 0x7f42a40b1d50 2020-10-31T22:45:10.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42ab268700 1 -- 172.21.15.60:0/604509898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a40b1d50 msgr2=0x7f42a405bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:10.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.519+0000 7f42ab268700 1 --2- 172.21.15.60:0/604509898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a40b1d50 0x7f42a405bc90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7f42a0002f30 tx=0x7f42a0006e80).stop 2020-10-31T22:45:10.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42ab268700 1 -- 172.21.15.60:0/604509898 shutdown_connections 2020-10-31T22:45:10.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42ab268700 1 --2- 172.21.15.60:0/604509898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a40b1d50 0x7f42a405bc90 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42ab268700 1 --2- 172.21.15.60:0/604509898 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42a405c2d0 0x7f42a4146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42ab268700 1 -- 172.21.15.60:0/604509898 >> 172.21.15.60:0/604509898 conn(0x7f42a40b5300 msgr2=0x7f42a40b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:10.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42ab268700 1 -- 172.21.15.60:0/604509898 shutdown_connections 2020-10-31T22:45:10.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42ab268700 1 -- 172.21.15.60:0/604509898 wait complete. 2020-10-31T22:45:10.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42ab268700 1 Processor -- start 2020-10-31T22:45:10.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42ab268700 1 -- start start 2020-10-31T22:45:10.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42ab268700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42a405c2d0 0x7f42a4145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:10.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42ab268700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a40b1d50 0x7f42a4154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:10.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42ab268700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42a4149740 0x7f42a40aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:10.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42ab268700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a41552b0 con 0x7f42a40b1d50 2020-10-31T22:45:10.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42ab268700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40ad3d0 con 0x7f42a4149740 2020-10-31T22:45:10.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42ab268700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a40ad670 con 0x7f42a405c2d0 2020-10-31T22:45:10.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42a9a65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a40b1d50 0x7f42a4154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:10.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42aa266700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42a405c2d0 0x7f42a4145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:10.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42a9a65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a40b1d50 0x7f42a4154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44362/0 (socket says 172.21.15.60:44362) 2020-10-31T22:45:10.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42a9a65700 1 -- 172.21.15.60:0/3730535641 learned_addr learned my addr 172.21.15.60:0/3730535641 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:45:10.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42aaa67700 1 --2- 172.21.15.60:0/3730535641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42a4149740 0x7f42a40aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:10.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42a9a65700 1 -- 172.21.15.60:0/3730535641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42a405c2d0 msgr2=0x7f42a4145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:10.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42a9a65700 1 --2- 172.21.15.60:0/3730535641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42a405c2d0 0x7f42a4145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42a9a65700 1 -- 172.21.15.60:0/3730535641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42a4149740 msgr2=0x7f42a40aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:10.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42a9a65700 1 --2- 172.21.15.60:0/3730535641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42a4149740 0x7f42a40aaff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42a9a65700 1 -- 172.21.15.60:0/3730535641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a40aeb20 con 0x7f42a40b1d50 2020-10-31T22:45:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42aaa67700 1 --2- 172.21.15.60:0/3730535641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42a4149740 0x7f42a40aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:45:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.523+0000 7f42a9a65700 1 --2- 172.21.15.60:0/3730535641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a40b1d50 0x7f42a4154dc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f4294003070 tx=0x7f4294008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.527+0000 7f42937fe700 1 -- 172.21.15.60:0/3730535641 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4294009980 con 0x7f42a40b1d50 2020-10-31T22:45:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.527+0000 7f42937fe700 1 -- 172.21.15.60:0/3730535641 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4294009ae0 con 0x7f42a40b1d50 2020-10-31T22:45:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.527+0000 7f42ab268700 1 -- 172.21.15.60:0/3730535641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a40ab4e0 con 0x7f42a40b1d50 2020-10-31T22:45:10.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.527+0000 7f42937fe700 1 -- 172.21.15.60:0/3730535641 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4294009e40 con 0x7f42a40b1d50 2020-10-31T22:45:10.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.527+0000 7f42ab268700 1 -- 172.21.15.60:0/3730535641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a40ae230 con 0x7f42a40b1d50 2020-10-31T22:45:10.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.527+0000 7f42ab268700 1 -- 172.21.15.60:0/3730535641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a40ad870 con 0x7f42a40b1d50 2020-10-31T22:45:10.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.527+0000 7f42937fe700 1 -- 172.21.15.60:0/3730535641 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4294013480 con 0x7f42a40b1d50 2020-10-31T22:45:10.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.527+0000 7f42937fe700 1 --2- 172.21.15.60:0/3730535641 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4284054f10 0x7f42840573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:45:10.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.527+0000 7f42937fe700 1 -- 172.21.15.60:0/3730535641 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f429406e060 con 0x7f42a40b1d50 2020-10-31T22:45:10.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.527+0000 7f42aa266700 1 --2- 172.21.15.60:0/3730535641 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4284054f10 0x7f42840573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:45:10.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.527+0000 7f42aa266700 1 --2- 172.21.15.60:0/3730535641 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4284054f10 0x7f42840573d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f42a001c000 tx=0x7f42a0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:45:10.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.535+0000 7f42937fe700 1 -- 172.21.15.60:0/3730535641 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4294044520 con 0x7f42a40b1d50 2020-10-31T22:45:10.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.719+0000 7f42ab268700 1 -- 172.21.15.60:0/3730535641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42a4057100 con 0x7f42a40b1d50 2020-10-31T22:45:10.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.719+0000 7f42937fe700 1 -- 172.21.15.60:0/3730535641 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f4294047b40 con 0x7f42a40b1d50 2020-10-31T22:45:10.719 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:45:10.719 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5180,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3826848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3826848450},{"type":"v1","addr":"172.21.15.66:6833","nonce":3826848450}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5544,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/821344830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":821344830},{"type":"v1","addr":"172.21.15.60:6835","nonce":821344830}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:44:41.510512+0000","modified":"2020-10-31T22:44:43.018399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/798359639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":798359639},{"type":"v1","addr":"172.21.15.60:6837","nonce":798359639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-10-31T22:45:10.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.723+0000 7f42ab268700 1 -- 172.21.15.60:0/3730535641 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4284054f10 msgr2=0x7f42840573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:10.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.723+0000 7f42ab268700 1 --2- 172.21.15.60:0/3730535641 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4284054f10 0x7f42840573d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f42a001c000 tx=0x7f42a0015000).stop 2020-10-31T22:45:10.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.723+0000 7f42ab268700 1 -- 172.21.15.60:0/3730535641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a40b1d50 msgr2=0x7f42a4154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:45:10.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.723+0000 7f42ab268700 1 --2- 172.21.15.60:0/3730535641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a40b1d50 0x7f42a4154dc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f4294003070 tx=0x7f4294008040).stop 2020-10-31T22:45:10.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.723+0000 7f42ab268700 1 -- 172.21.15.60:0/3730535641 shutdown_connections 2020-10-31T22:45:10.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.723+0000 7f42ab268700 1 --2- 172.21.15.60:0/3730535641 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4284054f10 0x7f42840573d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.723+0000 7f42ab268700 1 --2- 172.21.15.60:0/3730535641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42a4149740 0x7f42a40aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.723+0000 7f42ab268700 1 --2- 172.21.15.60:0/3730535641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42a405c2d0 0x7f42a4145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.723+0000 7f42ab268700 1 --2- 172.21.15.60:0/3730535641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42a40b1d50 0x7f42a4154dc0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:45:10.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.723+0000 7f42ab268700 1 -- 172.21.15.60:0/3730535641 >> 172.21.15.60:0/3730535641 conn(0x7f42a40b5300 msgr2=0x7f42a4148ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:45:10.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.723+0000 7f42ab268700 1 -- 172.21.15.60:0/3730535641 shutdown_connections 2020-10-31T22:45:10.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:45:10.723+0000 7f42ab268700 1 -- 172.21.15.60:0/3730535641 wait complete. 2020-10-31T22:45:10.726 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 23 2020-10-31T22:45:11.053 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:44:41.510512+0000', 'modified': '2020-10-31T22:44:43.018399+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5553}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5553': {'gid': 5553, 'name': 'c', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/798359639', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 798359639}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 798359639}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [10], 'metadata_pool': 9, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:45:11.054 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:45:11.055 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:45:11.185 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":5553,"want_state":"up:active","state":"up:active","rank_uptime":29.663429388000001,"mdsmap_epoch":23,"osdmap_epoch":54,"osdmap_epoch_barrier":54,"uptime":35.034079282} 2020-10-31T22:45:11.186 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 5553, "mdsmap_epoch": 23, "osdmap_epoch": 54, "osdmap_epoch_barrier": 54, "rank_uptime": 29.663429388, "state": "up:active", "uptime": 35.034079282, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:45:11.187 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:45:11.187 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:45:11.188 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:45:11.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:45:11.189 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:45:11.198 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:45:11.255 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:45:11.256 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:45:11.318 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:45:11.319 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:45:11.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:45:11.320 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:45:11.367 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:45:11.368 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:45:11.411 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:45:11.425 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:45:11.426 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:45:11.483 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:45:11.484 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:45:11.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:45:11.485 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:45:11.490 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:45:11.488+0000 7f6f24d5b0c0 -1 init, newargv = 0x563cc9667030 newargc=9 2020-10-31T22:45:11.490 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13358]: starting ceph client 2020-10-31T22:45:11.501 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13358]: starting fuse 2020-10-31T22:45:12.599 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:45:12.617 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:45:12.617 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:45:12.676 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:45:12.677 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:45:12.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:45:12.679 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:45:12.730 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:45:12.731 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:45:12.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:45:12.732 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:45:12.733 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:45:12.734 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:45:12.734 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:45:12.735 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:45:12.735 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:45:12.736 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:45:12.736 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:45:12.736 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:45:12.737 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:45:12.737 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:45:12.737 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:45:12.737 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:45:12.738 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:45:12.738 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:45:12.738 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:45:12.739 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:45:12.739 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:45:12.740 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:45:12.740 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:45:12.740 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:45:12.740 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:45:12.741 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:45:12.826 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.13358.asok 2020-10-31T22:45:12.827 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13358.asok 2020-10-31T22:45:12.828 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:45:12.829 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13358.asok status 2020-10-31T22:45:12.928 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:45:12.928 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:45:12.928 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:45:12.928 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:45:12.929 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:45:12.929 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:45:12.929 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:45:12.929 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "13358", 2020-10-31T22:45:12.929 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:45:12.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:45:12.930 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:45:12.930 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:45:12.930 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 5665, 2020-10-31T22:45:12.930 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:45:12.930 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:45:12.930 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:45:12.930 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5665 2020-10-31T22:45:12.931 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:45:12.931 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:45:12.931 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:45:12.931 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:45:12.931 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 336477758 2020-10-31T22:45:12.931 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:45:12.931 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:45:12.932 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:45:12.932 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:45:12.932 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:45:12.932 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 336477758 2020-10-31T22:45:12.933 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:45:12.933 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.5665 172.21.15.152:0/336477758", 2020-10-31T22:45:12.933 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/336477758", 2020-10-31T22:45:12.933 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:45:12.933 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 23, 2020-10-31T22:45:12.933 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 54, 2020-10-31T22:45:12.934 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:45:12.934 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:45:12.934 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:45:12.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:45:12.938 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:45:12.938 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:45:12.950 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:45:12.964 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:45:12.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:45:12.965 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:45:14.807 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:45:14.810 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:45:14.813 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:45:14.816 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:45:44.858 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:45:44.861 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:45:44.864 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:45:44.866 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:46:06.151 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:46:06.152 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:06.169 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:06.187 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:06.203 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:06.222 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:46:06.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:06.223 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:46:06.223 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:06.271 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:46:06.272 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:46:06.273 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:46:06.273 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:46:06.273 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:06.356 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13358]: fuse finished with error 0 and tester_r 0 2020-10-31T22:46:06.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:06.359 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:46:06.359 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:06.406 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:46:06.407 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:46:06.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:46:06.524 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:06.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:06.572 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:46:06.572 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:46:06.580 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:46:06.581 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:46:06.582 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:46:06.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:46:06.583 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:46:06.627 INFO:teuthology.orchestra.run.smithi085.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:46:06.628 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:46:06.629 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2020-10-31T22:46:06.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.759+0000 7ffa3359e700 1 Processor -- start 2020-10-31T22:46:06.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.759+0000 7ffa3359e700 1 -- start start 2020-10-31T22:46:06.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3359e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ffa3405bbb0 0x7ffa3413ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:06.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3359e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffa340ae030 0x7ffa340ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:06.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3359e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa340acbe0 con 0x7ffa340ac770 2020-10-31T22:46:06.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3359e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa340ab410 con 0x7ffa340ae030 2020-10-31T22:46:06.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3359e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3405bf90 con 0x7ffa3405bbb0 2020-10-31T22:46:06.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa31d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffa340ae030 0x7ffa340ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:06.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3259c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ffa3405bbb0 0x7ffa3413ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:06.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa31d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffa340ae030 0x7ffa340ac280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44370/0 (socket says 172.21.15.60:44370) 2020-10-31T22:46:06.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa31d9b700 1 -- 172.21.15.60:0/2175106153 learned_addr learned my addr 172.21.15.60:0/2175106153 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:06.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa32d9d700 1 --1- 172.21.15.60:0/2175106153 >> v1:172.21.15.66:6789/0 conn(0x7ffa340ac770 0x7ffa340a7150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:46376/0 (socket says 172.21.15.60:46376) 2020-10-31T22:46:06.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3259c700 1 -- 172.21.15.60:0/2175106153 >> v2:172.21.15.60:3300/0 conn(0x7ffa340ae030 msgr2=0x7ffa340ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:06.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3259c700 1 --2- 172.21.15.60:0/2175106153 >> v2:172.21.15.60:3300/0 conn(0x7ffa340ae030 0x7ffa340ac280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:06.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3259c700 1 -- 172.21.15.60:0/2175106153 >> v1:172.21.15.66:6789/0 conn(0x7ffa340ac770 legacy=0x7ffa340a7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:06.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3259c700 1 -- 172.21.15.60:0/2175106153 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa340ab600 con 0x7ffa3405bbb0 2020-10-31T22:46:06.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3259c700 1 --2- 172.21.15.60:0/2175106153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3405bbb0 0x7ffa3413ecf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7ffa24002f30 tx=0x7ffa24006dc0).ready entity=mon.1 client_cookie=656358a8251748ce server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:06.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3159a700 1 -- 172.21.15.60:0/2175106153 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa24009840 con 0x7ffa3405bbb0 2020-10-31T22:46:06.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3159a700 1 -- 172.21.15.60:0/2175106153 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa240099a0 con 0x7ffa3405bbb0 2020-10-31T22:46:06.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3159a700 1 -- 172.21.15.60:0/2175106153 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa24009d00 con 0x7ffa3405bbb0 2020-10-31T22:46:06.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3359e700 1 -- 172.21.15.60:0/2175106153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3405bbb0 msgr2=0x7ffa3413ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:06.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3359e700 1 --2- 172.21.15.60:0/2175106153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3405bbb0 0x7ffa3413ecf0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7ffa24002f30 tx=0x7ffa24006dc0).stop 2020-10-31T22:46:06.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3359e700 1 -- 172.21.15.60:0/2175106153 shutdown_connections 2020-10-31T22:46:06.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3359e700 1 --2- 172.21.15.60:0/2175106153 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3405bbb0 0x7ffa3413ecf0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:06.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3359e700 1 --2- 172.21.15.60:0/2175106153 >> v2:172.21.15.60:3300/0 conn(0x7ffa340ae030 0x7ffa340ac280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:06.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3359e700 1 -- 172.21.15.60:0/2175106153 >> 172.21.15.60:0/2175106153 conn(0x7ffa340b3fd0 msgr2=0x7ffa340b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:06.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3359e700 1 -- 172.21.15.60:0/2175106153 shutdown_connections 2020-10-31T22:46:06.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.763+0000 7ffa3359e700 1 -- 172.21.15.60:0/2175106153 wait complete. 2020-10-31T22:46:06.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa3359e700 1 Processor -- start 2020-10-31T22:46:06.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa3359e700 1 -- start start 2020-10-31T22:46:06.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa3359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3405bbb0 0x7ffa340a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:06.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa3359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa340ac770 0x7ffa340a80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:06.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa3359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa340ae030 0x7ffa340a6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:06.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa3359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa340a8eb0 con 0x7ffa340ac770 2020-10-31T22:46:06.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa3359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa341541d0 con 0x7ffa3405bbb0 2020-10-31T22:46:06.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa3359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa34154470 con 0x7ffa340ae030 2020-10-31T22:46:06.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa31d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa340ac770 0x7ffa340a80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:06.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa31d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa340ac770 0x7ffa340a80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44378/0 (socket says 172.21.15.60:44378) 2020-10-31T22:46:06.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa31d9b700 1 -- 172.21.15.60:0/2698800648 learned_addr learned my addr 172.21.15.60:0/2698800648 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:06.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa3259c700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3405bbb0 0x7ffa340a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:06.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa32d9d700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa340ae030 0x7ffa340a6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:06.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa31d9b700 1 -- 172.21.15.60:0/2698800648 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa340ae030 msgr2=0x7ffa340a6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:06.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa31d9b700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa340ae030 0x7ffa340a6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:06.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa31d9b700 1 -- 172.21.15.60:0/2698800648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3405bbb0 msgr2=0x7ffa340a9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:06.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa31d9b700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3405bbb0 0x7ffa340a9b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:06.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa31d9b700 1 -- 172.21.15.60:0/2698800648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa34154710 con 0x7ffa340ac770 2020-10-31T22:46:06.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa3259c700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3405bbb0 0x7ffa340a9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:46:06.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa31d9b700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa340ac770 0x7ffa340a80e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7ffa2800c000 tx=0x7ffa28008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:06.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa237fe700 1 -- 172.21.15.60:0/2698800648 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa2800ee80 con 0x7ffa340ac770 2020-10-31T22:46:06.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa237fe700 1 -- 172.21.15.60:0/2698800648 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa2800c820 con 0x7ffa340ac770 2020-10-31T22:46:06.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa3359e700 1 -- 172.21.15.60:0/2698800648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa341549b0 con 0x7ffa340ac770 2020-10-31T22:46:06.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa237fe700 1 -- 172.21.15.60:0/2698800648 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa2800cb80 con 0x7ffa340ac770 2020-10-31T22:46:06.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.767+0000 7ffa3359e700 1 -- 172.21.15.60:0/2698800648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa340a40a0 con 0x7ffa340ac770 2020-10-31T22:46:06.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.771+0000 7ffa3359e700 1 -- 172.21.15.60:0/2698800648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa34057100 con 0x7ffa340ac770 2020-10-31T22:46:06.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.771+0000 7ffa237fe700 1 -- 172.21.15.60:0/2698800648 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ffa28022070 con 0x7ffa340ac770 2020-10-31T22:46:06.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.771+0000 7ffa237fe700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ffa10055050 0x7ffa10057510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:06.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.771+0000 7ffa237fe700 1 -- 172.21.15.60:0/2698800648 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffa2806de00 con 0x7ffa340ac770 2020-10-31T22:46:06.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.771+0000 7ffa3259c700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ffa10055050 0x7ffa10057510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:06.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.771+0000 7ffa3259c700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ffa10055050 0x7ffa10057510 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7ffa2401a000 tx=0x7ffa24015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:06.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.775+0000 7ffa237fe700 1 -- 172.21.15.60:0/2698800648 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ffa28044210 con 0x7ffa340ac770 2020-10-31T22:46:06.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.919+0000 7ffa3359e700 1 -- 172.21.15.60:0/2698800648 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ffa3405a8e0 con 0x7ffa340ac770 2020-10-31T22:46:06.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.927+0000 7ffa237fe700 1 -- 172.21.15.60:0/2698800648 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7ffa28047830 con 0x7ffa340ac770 2020-10-31T22:46:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.931+0000 7ffa3359e700 1 -- 172.21.15.60:0/2698800648 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ffa10055050 msgr2=0x7ffa10057510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.931+0000 7ffa3359e700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ffa10055050 0x7ffa10057510 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7ffa2401a000 tx=0x7ffa24015000).stop 2020-10-31T22:46:06.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.931+0000 7ffa3359e700 1 -- 172.21.15.60:0/2698800648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa340ac770 msgr2=0x7ffa340a80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:06.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.931+0000 7ffa3359e700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa340ac770 0x7ffa340a80e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7ffa2800c000 tx=0x7ffa28008040).stop 2020-10-31T22:46:06.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.931+0000 7ffa3359e700 1 -- 172.21.15.60:0/2698800648 shutdown_connections 2020-10-31T22:46:06.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.931+0000 7ffa3359e700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa340ae030 0x7ffa340a6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:06.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.931+0000 7ffa3359e700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ffa10055050 0x7ffa10057510 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:06.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.931+0000 7ffa3359e700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa3405bbb0 0x7ffa340a9b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:06.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.931+0000 7ffa3359e700 1 --2- 172.21.15.60:0/2698800648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa340ac770 0x7ffa340a80e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:06.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.931+0000 7ffa3359e700 1 -- 172.21.15.60:0/2698800648 >> 172.21.15.60:0/2698800648 conn(0x7ffa340b3fd0 msgr2=0x7ffa340af730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:06.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.931+0000 7ffa3359e700 1 -- 172.21.15.60:0/2698800648 shutdown_connections 2020-10-31T22:46:06.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:06.931+0000 7ffa3359e700 1 -- 172.21.15.60:0/2698800648 wait complete. 2020-10-31T22:46:06.949 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout' 2020-10-31T22:46:07.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.059+0000 7f0227fff700 1 Processor -- start 2020-10-31T22:46:07.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.059+0000 7f0227fff700 1 -- start start 2020-10-31T22:46:07.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.059+0000 7f0227fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02280add70 0x7f02280b1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:07.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.059+0000 7f0227fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f02280b1df0 0x7f0228149790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:07.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.059+0000 7f0227fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0228063520 con 0x7f0228063140 2020-10-31T22:46:07.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.059+0000 7f0227fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02280adbd0 con 0x7f02280b1df0 2020-10-31T22:46:07.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.059+0000 7f0227fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02280ae1f0 con 0x7f02280add70 2020-10-31T22:46:07.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f021ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02280add70 0x7f02280b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:07.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f02277fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f02280b1df0 0x7f0228149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:07.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f021ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02280add70 0x7f02280b1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:57572/0 (socket says 172.21.15.60:57572) 2020-10-31T22:46:07.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f021ffff700 1 -- 172.21.15.60:0/3995144046 learned_addr learned my addr 172.21.15.60:0/3995144046 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:07.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f021ffff700 1 -- 172.21.15.60:0/3995144046 >> v2:172.21.15.66:3300/0 conn(0x7f02280b1df0 msgr2=0x7f0228149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:07.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f021ffff700 1 --2- 172.21.15.60:0/3995144046 >> v2:172.21.15.66:3300/0 conn(0x7f02280b1df0 0x7f0228149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:07.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f021ffff700 1 -- 172.21.15.60:0/3995144046 >> v1:172.21.15.66:6789/0 conn(0x7f0228063140 legacy=0x7f02280b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:07.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f021ffff700 1 -- 172.21.15.60:0/3995144046 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02280afed0 con 0x7f02280add70 2020-10-31T22:46:07.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f021ffff700 1 --2- 172.21.15.60:0/3995144046 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02280add70 0x7f02280b1900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0210002f30 tx=0x7f0210006e80).ready entity=mon.2 client_cookie=d006047eb60d6def server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:07.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f02267fc700 1 -- 172.21.15.60:0/3995144046 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f02100097f0 con 0x7f02280add70 2020-10-31T22:46:07.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f02267fc700 1 -- 172.21.15.60:0/3995144046 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0210009950 con 0x7f02280add70 2020-10-31T22:46:07.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f0227fff700 1 -- 172.21.15.60:0/3995144046 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02280add70 msgr2=0x7f02280b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:07.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f02267fc700 1 -- 172.21.15.60:0/3995144046 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0210009cb0 con 0x7f02280add70 2020-10-31T22:46:07.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f0227fff700 1 --2- 172.21.15.60:0/3995144046 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02280add70 0x7f02280b1900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f0210002f30 tx=0x7f0210006e80).stop 2020-10-31T22:46:07.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f0227fff700 1 -- 172.21.15.60:0/3995144046 shutdown_connections 2020-10-31T22:46:07.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f0227fff700 1 --2- 172.21.15.60:0/3995144046 >> v2:172.21.15.66:3300/0 conn(0x7f02280b1df0 0x7f0228149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:07.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f0227fff700 1 --2- 172.21.15.60:0/3995144046 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02280add70 0x7f02280b1900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:07.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f0227fff700 1 -- 172.21.15.60:0/3995144046 >> 172.21.15.60:0/3995144046 conn(0x7f022806a600 msgr2=0x7f0228060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:07.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f0227fff700 1 -- 172.21.15.60:0/3995144046 shutdown_connections 2020-10-31T22:46:07.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.063+0000 7f0227fff700 1 -- 172.21.15.60:0/3995144046 wait complete. 2020-10-31T22:46:07.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0227fff700 1 Processor -- start 2020-10-31T22:46:07.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0227fff700 1 -- start start 2020-10-31T22:46:07.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0227fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0228063140 0x7f022809f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:07.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0227fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02280add70 0x7f02280a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:07.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0227fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02280b1df0 0x7f02280a3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:07.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0227fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0228066c80 con 0x7f0228063140 2020-10-31T22:46:07.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0227fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02280a35f0 con 0x7f02280b1df0 2020-10-31T22:46:07.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0227fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f022809fc10 con 0x7f02280add70 2020-10-31T22:46:07.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0226ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0228063140 0x7f022809f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:07.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0226ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0228063140 0x7f022809f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44388/0 (socket says 172.21.15.60:44388) 2020-10-31T22:46:07.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f021ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02280add70 0x7f02280a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:07.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0226ffd700 1 -- 172.21.15.60:0/1105791172 learned_addr learned my addr 172.21.15.60:0/1105791172 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:07.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f02277fe700 1 --2- 172.21.15.60:0/1105791172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02280b1df0 0x7f02280a3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:07.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0226ffd700 1 -- 172.21.15.60:0/1105791172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02280add70 msgr2=0x7f02280a2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:07.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0226ffd700 1 --2- 172.21.15.60:0/1105791172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02280add70 0x7f02280a2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:07.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0226ffd700 1 -- 172.21.15.60:0/1105791172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02280b1df0 msgr2=0x7f02280a3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:07.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0226ffd700 1 --2- 172.21.15.60:0/1105791172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02280b1df0 0x7f02280a3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:07.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0226ffd700 1 -- 172.21.15.60:0/1105791172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02280a0b50 con 0x7f0228063140 2020-10-31T22:46:07.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0226ffd700 1 --2- 172.21.15.60:0/1105791172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0228063140 0x7f022809f290 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f02280b0a30 tx=0x7f0218007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:07.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0224ff9700 1 -- 172.21.15.60:0/1105791172 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f021800e4a0 con 0x7f0228063140 2020-10-31T22:46:07.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0224ff9700 1 -- 172.21.15.60:0/1105791172 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021800e600 con 0x7f0228063140 2020-10-31T22:46:07.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0227fff700 1 -- 172.21.15.60:0/1105791172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02280a0df0 con 0x7f0228063140 2020-10-31T22:46:07.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0224ff9700 1 -- 172.21.15.60:0/1105791172 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f021800e960 con 0x7f0228063140 2020-10-31T22:46:07.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.067+0000 7f0227fff700 1 -- 172.21.15.60:0/1105791172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02280a0060 con 0x7f0228063140 2020-10-31T22:46:07.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.071+0000 7f0227fff700 1 -- 172.21.15.60:0/1105791172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022809fd50 con 0x7f0228063140 2020-10-31T22:46:07.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.071+0000 7f0224ff9700 1 -- 172.21.15.60:0/1105791172 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0218019030 con 0x7f0228063140 2020-10-31T22:46:07.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.071+0000 7f0224ff9700 1 --2- 172.21.15.60:0/1105791172 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f020c054f90 0x7f020c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:07.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.071+0000 7f0224ff9700 1 -- 172.21.15.60:0/1105791172 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f021806ce40 con 0x7f0228063140 2020-10-31T22:46:07.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.071+0000 7f021ffff700 1 --2- 172.21.15.60:0/1105791172 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f020c054f90 0x7f020c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:07.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.071+0000 7f021ffff700 1 --2- 172.21.15.60:0/1105791172 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f020c054f90 0x7f020c057450 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f021001c000 tx=0x7f0210015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:07.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.079+0000 7f0224ff9700 1 -- 172.21.15.60:0/1105791172 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0218043300 con 0x7f0228063140 2020-10-31T22:46:07.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.271+0000 7f0227fff700 1 -- 172.21.15.60:0/1105791172 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]} v 0) v1 -- 0x7f02280a0f80 con 0x7f0228063140 2020-10-31T22:46:07.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.955+0000 7f0224ff9700 1 -- 172.21.15.60:0/1105791172 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_dead_timeout"]}]=0 v212) v1 ==== 152+0+0 (secure 0 0 0) 0x7f0218017020 con 0x7f0228063140 2020-10-31T22:46:07.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.959+0000 7f0227fff700 1 -- 172.21.15.60:0/1105791172 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f020c054f90 msgr2=0x7f020c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:07.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.959+0000 7f0227fff700 1 --2- 172.21.15.60:0/1105791172 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f020c054f90 0x7f020c057450 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f021001c000 tx=0x7f0210015000).stop 2020-10-31T22:46:07.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.959+0000 7f0227fff700 1 -- 172.21.15.60:0/1105791172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0228063140 msgr2=0x7f022809f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:07.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.959+0000 7f0227fff700 1 --2- 172.21.15.60:0/1105791172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0228063140 0x7f022809f290 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f02280b0a30 tx=0x7f0218007b90).stop 2020-10-31T22:46:07.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.959+0000 7f0227fff700 1 -- 172.21.15.60:0/1105791172 shutdown_connections 2020-10-31T22:46:07.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.959+0000 7f0227fff700 1 --2- 172.21.15.60:0/1105791172 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f020c054f90 0x7f020c057450 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:07.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.959+0000 7f0227fff700 1 --2- 172.21.15.60:0/1105791172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02280b1df0 0x7f02280a3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:07.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.959+0000 7f0227fff700 1 --2- 172.21.15.60:0/1105791172 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0228063140 0x7f022809f290 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:07.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.959+0000 7f0227fff700 1 --2- 172.21.15.60:0/1105791172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02280add70 0x7f02280a2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:07.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.959+0000 7f0227fff700 1 -- 172.21.15.60:0/1105791172 >> 172.21.15.60:0/1105791172 conn(0x7f022806a600 msgr2=0x7f0228060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:07.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.959+0000 7f0227fff700 1 -- 172.21.15.60:0/1105791172 shutdown_connections 2020-10-31T22:46:07.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:07.959+0000 7f0227fff700 1 -- 172.21.15.60:0/1105791172 wait complete. 2020-10-31T22:46:07.974 INFO:tasks.cephfs_test_runner:test_drop_cache_command_dead_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2020-10-31T22:46:07.975 INFO:tasks.cephfs_test_runner:Starting test: test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) 2020-10-31T22:46:07.976 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2020-10-31T22:46:08.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.095+0000 7efc2b59e700 1 Processor -- start 2020-10-31T22:46:08.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.095+0000 7efc2b59e700 1 -- start start 2020-10-31T22:46:08.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc2b59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efc2c0b1000 0x7efc2c0b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:08.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc2b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc2c0b2820 0x7efc2c0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:08.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc2b59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc2c1459c0 con 0x7efc2c063140 2020-10-31T22:46:08.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc2b59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc2c0b2060 con 0x7efc2c0b1000 2020-10-31T22:46:08.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc2b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c063520 con 0x7efc2c0b2820 2020-10-31T22:46:08.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc23fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efc2c0b1000 0x7efc2c0b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:08.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc23fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efc2c0b1000 0x7efc2c0b09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44396/0 (socket says 172.21.15.60:44396) 2020-10-31T22:46:08.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc23fff700 1 -- 172.21.15.60:0/1045865651 learned_addr learned my addr 172.21.15.60:0/1045865651 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:08.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc2ad9d700 1 --2- 172.21.15.60:0/1045865651 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc2c0b2820 0x7efc2c0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:08.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc23fff700 1 -- 172.21.15.60:0/1045865651 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc2c0b2820 msgr2=0x7efc2c0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:08.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc23fff700 1 --2- 172.21.15.60:0/1045865651 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc2c0b2820 0x7efc2c0aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:08.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc23fff700 1 -- 172.21.15.60:0/1045865651 >> v1:172.21.15.66:6789/0 conn(0x7efc2c063140 legacy=0x7efc2c1452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:08.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc23fff700 1 -- 172.21.15.60:0/1045865651 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0b02e0 con 0x7efc2c0b1000 2020-10-31T22:46:08.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc23fff700 1 --2- 172.21.15.60:0/1045865651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc2c0b1000 0x7efc2c0b09e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7efc14002f30 tx=0x7efc14006e80).ready entity=mon.0 client_cookie=e3d1b42f29d5de68 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:08.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc29d9b700 1 -- 172.21.15.60:0/1045865651 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc140097f0 con 0x7efc2c0b1000 2020-10-31T22:46:08.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc29d9b700 1 -- 172.21.15.60:0/1045865651 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc14009950 con 0x7efc2c0b1000 2020-10-31T22:46:08.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc29d9b700 1 -- 172.21.15.60:0/1045865651 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc14009cb0 con 0x7efc2c0b1000 2020-10-31T22:46:08.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc2b59e700 1 -- 172.21.15.60:0/1045865651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc2c0b1000 msgr2=0x7efc2c0b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:08.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc2b59e700 1 --2- 172.21.15.60:0/1045865651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc2c0b1000 0x7efc2c0b09e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7efc14002f30 tx=0x7efc14006e80).stop 2020-10-31T22:46:08.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc2b59e700 1 -- 172.21.15.60:0/1045865651 shutdown_connections 2020-10-31T22:46:08.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc2b59e700 1 --2- 172.21.15.60:0/1045865651 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc2c0b2820 0x7efc2c0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:08.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc2b59e700 1 --2- 172.21.15.60:0/1045865651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc2c0b1000 0x7efc2c0b09e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:08.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc2b59e700 1 -- 172.21.15.60:0/1045865651 >> 172.21.15.60:0/1045865651 conn(0x7efc2c06a600 msgr2=0x7efc2c060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:08.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc2b59e700 1 -- 172.21.15.60:0/1045865651 shutdown_connections 2020-10-31T22:46:08.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.099+0000 7efc2b59e700 1 -- 172.21.15.60:0/1045865651 wait complete. 2020-10-31T22:46:08.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2b59e700 1 Processor -- start 2020-10-31T22:46:08.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2b59e700 1 -- start start 2020-10-31T22:46:08.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc2c063140 0x7efc2c0639f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:08.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc2c0b1000 0x7efc2c140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:08.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2b59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc2c0b2820 0x7efc2c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:08.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c1428f0 con 0x7efc2c063140 2020-10-31T22:46:08.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2b59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c143060 con 0x7efc2c0b2820 2020-10-31T22:46:08.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2c142b20 con 0x7efc2c0b1000 2020-10-31T22:46:08.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc2c063140 0x7efc2c0639f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:08.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc2c063140 0x7efc2c0639f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44402/0 (socket says 172.21.15.60:44402) 2020-10-31T22:46:08.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2ad9d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc2c0b2820 0x7efc2c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:08.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2a59c700 1 -- 172.21.15.60:0/3619288477 learned_addr learned my addr 172.21.15.60:0/3619288477 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:08.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc23fff700 1 --2- 172.21.15.60:0/3619288477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc2c0b1000 0x7efc2c140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:08.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2a59c700 1 -- 172.21.15.60:0/3619288477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc2c0b1000 msgr2=0x7efc2c140680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:08.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2a59c700 1 --2- 172.21.15.60:0/3619288477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc2c0b1000 0x7efc2c140680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:08.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2a59c700 1 -- 172.21.15.60:0/3619288477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc2c0b2820 msgr2=0x7efc2c150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:08.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2a59c700 1 --2- 172.21.15.60:0/3619288477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc2c0b2820 0x7efc2c150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:08.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2a59c700 1 -- 172.21.15.60:0/3619288477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c142dc0 con 0x7efc2c063140 2020-10-31T22:46:08.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2a59c700 1 --2- 172.21.15.60:0/3619288477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc2c063140 0x7efc2c0639f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7efc2c05b180 tx=0x7efc1c007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:08.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc237fe700 1 -- 172.21.15.60:0/3619288477 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc1c007030 con 0x7efc2c063140 2020-10-31T22:46:08.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc237fe700 1 -- 172.21.15.60:0/3619288477 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1c007190 con 0x7efc2c063140 2020-10-31T22:46:08.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2b59e700 1 -- 172.21.15.60:0/3619288477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2c0ac3e0 con 0x7efc2c063140 2020-10-31T22:46:08.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc237fe700 1 -- 172.21.15.60:0/3619288477 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc1c0064e0 con 0x7efc2c063140 2020-10-31T22:46:08.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.103+0000 7efc2b59e700 1 -- 172.21.15.60:0/3619288477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc2c0aac20 con 0x7efc2c063140 2020-10-31T22:46:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.107+0000 7efc2b59e700 1 -- 172.21.15.60:0/3619288477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc2c0636e0 con 0x7efc2c063140 2020-10-31T22:46:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.107+0000 7efc237fe700 1 -- 172.21.15.60:0/3619288477 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7efc1c010070 con 0x7efc2c063140 2020-10-31T22:46:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.107+0000 7efc237fe700 1 --2- 172.21.15.60:0/3619288477 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efc10054f30 0x7efc100573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:08.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.107+0000 7efc237fe700 1 -- 172.21.15.60:0/3619288477 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efc1c06cf30 con 0x7efc2c063140 2020-10-31T22:46:08.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.107+0000 7efc23fff700 1 --2- 172.21.15.60:0/3619288477 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efc10054f30 0x7efc100573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:08.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.107+0000 7efc23fff700 1 --2- 172.21.15.60:0/3619288477 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efc10054f30 0x7efc100573f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7efc1401c000 tx=0x7efc14015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:08.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.115+0000 7efc237fe700 1 -- 172.21.15.60:0/3619288477 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7efc1c043450 con 0x7efc2c063140 2020-10-31T22:46:08.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.307+0000 7efc2b59e700 1 -- 172.21.15.60:0/3619288477 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7efc2c057100 con 0x7efc2c063140 2020-10-31T22:46:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.959+0000 7efc237fe700 1 -- 172.21.15.60:0/3619288477 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v213) v1 ==== 150+0+0 (secure 0 0 0) 0x7efc1c018020 con 0x7efc2c063140 2020-10-31T22:46:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.963+0000 7efc2b59e700 1 -- 172.21.15.60:0/3619288477 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efc10054f30 msgr2=0x7efc100573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.963+0000 7efc2b59e700 1 --2- 172.21.15.60:0/3619288477 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efc10054f30 0x7efc100573f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7efc1401c000 tx=0x7efc14015000).stop 2020-10-31T22:46:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.963+0000 7efc2b59e700 1 -- 172.21.15.60:0/3619288477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc2c063140 msgr2=0x7efc2c0639f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:08.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.963+0000 7efc2b59e700 1 --2- 172.21.15.60:0/3619288477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc2c063140 0x7efc2c0639f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7efc2c05b180 tx=0x7efc1c007b50).stop 2020-10-31T22:46:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.963+0000 7efc2b59e700 1 -- 172.21.15.60:0/3619288477 shutdown_connections 2020-10-31T22:46:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.963+0000 7efc2b59e700 1 --2- 172.21.15.60:0/3619288477 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efc10054f30 0x7efc100573f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.963+0000 7efc2b59e700 1 --2- 172.21.15.60:0/3619288477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc2c0b2820 0x7efc2c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.963+0000 7efc2b59e700 1 --2- 172.21.15.60:0/3619288477 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc2c063140 0x7efc2c0639f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.963+0000 7efc2b59e700 1 --2- 172.21.15.60:0/3619288477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc2c0b1000 0x7efc2c140680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.963+0000 7efc2b59e700 1 -- 172.21.15.60:0/3619288477 >> 172.21.15.60:0/3619288477 conn(0x7efc2c06a600 msgr2=0x7efc2c1446f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:08.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.963+0000 7efc2b59e700 1 -- 172.21.15.60:0/3619288477 shutdown_connections 2020-10-31T22:46:08.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:08.963+0000 7efc2b59e700 1 -- 172.21.15.60:0/3619288477 wait complete. 2020-10-31T22:46:08.982 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2020-10-31T22:46:09.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.111+0000 7fbde6b42700 1 Processor -- start 2020-10-31T22:46:09.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.111+0000 7fbde6b42700 1 -- start start 2020-10-31T22:46:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde6b42700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbde00b0b50 0x7fbde00b1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde6b42700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbde0140f80 0x7fbde01413d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde6b42700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbde00acd60 con 0x7fbde00b5380 2020-10-31T22:46:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde6b42700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbde00ad650 con 0x7fbde00b0b50 2020-10-31T22:46:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde6b42700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde00b5760 con 0x7fbde0140f80 2020-10-31T22:46:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde5b40700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbde00b5380 0x7fbde00ac530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48546/0 (socket says 172.21.15.60:48546) 2020-10-31T22:46:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde533f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbde00b0b50 0x7fbde00b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde5b40700 1 -- 172.21.15.60:0/366202809 learned_addr learned my addr 172.21.15.60:0/366202809 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:09.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde6341700 1 --2- 172.21.15.60:0/366202809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbde0140f80 0x7fbde01413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:09.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde533f700 1 -- 172.21.15.60:0/366202809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbde0140f80 msgr2=0x7fbde01413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:09.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde533f700 1 --2- 172.21.15.60:0/366202809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbde0140f80 0x7fbde01413d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde533f700 1 -- 172.21.15.60:0/366202809 >> v1:172.21.15.60:6789/0 conn(0x7fbde00b5380 legacy=0x7fbde00ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:09.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde4b3e700 1 -- 172.21.15.60:0/366202809 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317798428 0 0) 0x7fbde00acd60 con 0x7fbde00b5380 2020-10-31T22:46:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde533f700 1 -- 172.21.15.60:0/366202809 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde00b14f0 con 0x7fbde00b0b50 2020-10-31T22:46:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde533f700 1 --2- 172.21.15.60:0/366202809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde00b0b50 0x7fbde00b1000 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fbdd0002f30 tx=0x7fbdd0006dc0).ready entity=mon.0 client_cookie=956a9d1d3f39e7d6 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde4b3e700 1 -- 172.21.15.60:0/366202809 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdd0009760 con 0x7fbde00b0b50 2020-10-31T22:46:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde4b3e700 1 -- 172.21.15.60:0/366202809 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd00098c0 con 0x7fbde00b0b50 2020-10-31T22:46:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde4b3e700 1 -- 172.21.15.60:0/366202809 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbdd0009c20 con 0x7fbde00b0b50 2020-10-31T22:46:09.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde6b42700 1 -- 172.21.15.60:0/366202809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde00b0b50 msgr2=0x7fbde00b1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde6b42700 1 --2- 172.21.15.60:0/366202809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde00b0b50 0x7fbde00b1000 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7fbdd0002f30 tx=0x7fbdd0006dc0).stop 2020-10-31T22:46:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde6b42700 1 -- 172.21.15.60:0/366202809 shutdown_connections 2020-10-31T22:46:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde6b42700 1 --2- 172.21.15.60:0/366202809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbde0140f80 0x7fbde01413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde6b42700 1 --2- 172.21.15.60:0/366202809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde00b0b50 0x7fbde00b1000 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde6b42700 1 -- 172.21.15.60:0/366202809 >> 172.21.15.60:0/366202809 conn(0x7fbde006a600 msgr2=0x7fbde0060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde6b42700 1 -- 172.21.15.60:0/366202809 shutdown_connections 2020-10-31T22:46:09.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.115+0000 7fbde6b42700 1 -- 172.21.15.60:0/366202809 wait complete. 2020-10-31T22:46:09.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.119+0000 7fbde6b42700 1 Processor -- start 2020-10-31T22:46:09.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.119+0000 7fbde6b42700 1 -- start start 2020-10-31T22:46:09.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.119+0000 7fbde6b42700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde00b0b50 0x7fbde00ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:09.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.119+0000 7fbde6b42700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbde00b5380 0x7fbde0154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:09.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.119+0000 7fbde6b42700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde0140f80 0x7fbde00670c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:09.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.119+0000 7fbde6b42700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde0063de0 con 0x7fbde00b0b50 2020-10-31T22:46:09.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.119+0000 7fbde6b42700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde0150ab0 con 0x7fbde0140f80 2020-10-31T22:46:09.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.119+0000 7fbde6b42700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbde01544f0 con 0x7fbde00b5380 2020-10-31T22:46:09.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbde5b40700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde00b0b50 0x7fbde00ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:09.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbde5b40700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde00b0b50 0x7fbde00ab250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44416/0 (socket says 172.21.15.60:44416) 2020-10-31T22:46:09.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbde5b40700 1 -- 172.21.15.60:0/3613620814 learned_addr learned my addr 172.21.15.60:0/3613620814 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:09.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbde6341700 1 --2- 172.21.15.60:0/3613620814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde0140f80 0x7fbde00670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:09.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbde533f700 1 --2- 172.21.15.60:0/3613620814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbde00b5380 0x7fbde0154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:09.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbde5b40700 1 -- 172.21.15.60:0/3613620814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbde00b5380 msgr2=0x7fbde0154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbde5b40700 1 --2- 172.21.15.60:0/3613620814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbde00b5380 0x7fbde0154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbde5b40700 1 -- 172.21.15.60:0/3613620814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde0140f80 msgr2=0x7fbde00670c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbde5b40700 1 --2- 172.21.15.60:0/3613620814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde0140f80 0x7fbde00670c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbde5b40700 1 -- 172.21.15.60:0/3613620814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde0145c10 con 0x7fbde00b0b50 2020-10-31T22:46:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbde5b40700 1 --2- 172.21.15.60:0/3613620814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde00b0b50 0x7fbde00ab250 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fbddc000b80 tx=0x7fbddc0079d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbdceffd700 1 -- 172.21.15.60:0/3613620814 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbddc0072e0 con 0x7fbde00b0b50 2020-10-31T22:46:09.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbdceffd700 1 -- 172.21.15.60:0/3613620814 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbddc007440 con 0x7fbde00b0b50 2020-10-31T22:46:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbde6b42700 1 -- 172.21.15.60:0/3613620814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde0150ca0 con 0x7fbde00b0b50 2020-10-31T22:46:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbdceffd700 1 -- 172.21.15.60:0/3613620814 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbddc0057d0 con 0x7fbde00b0b50 2020-10-31T22:46:09.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbde6b42700 1 -- 172.21.15.60:0/3613620814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde00675b0 con 0x7fbde00b0b50 2020-10-31T22:46:09.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbde6b42700 1 -- 172.21.15.60:0/3613620814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbde0151140 con 0x7fbde00b0b50 2020-10-31T22:46:09.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbdceffd700 1 -- 172.21.15.60:0/3613620814 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbddc01a060 con 0x7fbde00b0b50 2020-10-31T22:46:09.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbdceffd700 1 --2- 172.21.15.60:0/3613620814 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbdc0055020 0x7fbdc00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:09.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.123+0000 7fbdceffd700 1 -- 172.21.15.60:0/3613620814 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbddc06d210 con 0x7fbde00b0b50 2020-10-31T22:46:09.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.127+0000 7fbde533f700 1 --2- 172.21.15.60:0/3613620814 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbdc0055020 0x7fbdc00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:09.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.127+0000 7fbde533f700 1 --2- 172.21.15.60:0/3613620814 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbdc0055020 0x7fbdc00574e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fbdd001a000 tx=0x7fbdd0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:09.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.131+0000 7fbdceffd700 1 -- 172.21.15.60:0/3613620814 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbde0151140 con 0x7fbde00b0b50 2020-10-31T22:46:09.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.275+0000 7fbde6b42700 1 -- 172.21.15.60:0/3613620814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7fbde0151140 con 0x7fbde00b0b50 2020-10-31T22:46:09.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.279+0000 7fbdceffd700 1 -- 172.21.15.60:0/3613620814 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbde0151140 con 0x7fbde00b0b50 2020-10-31T22:46:09.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.283+0000 7fbde6b42700 1 -- 172.21.15.60:0/3613620814 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbdc0055020 msgr2=0x7fbdc00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:09.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.283+0000 7fbde6b42700 1 --2- 172.21.15.60:0/3613620814 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbdc0055020 0x7fbdc00574e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7fbdd001a000 tx=0x7fbdd0015000).stop 2020-10-31T22:46:09.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.283+0000 7fbde6b42700 1 -- 172.21.15.60:0/3613620814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde00b0b50 msgr2=0x7fbde00ab250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:09.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.283+0000 7fbde6b42700 1 --2- 172.21.15.60:0/3613620814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde00b0b50 0x7fbde00ab250 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fbddc000b80 tx=0x7fbddc0079d0).stop 2020-10-31T22:46:09.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.283+0000 7fbde6b42700 1 -- 172.21.15.60:0/3613620814 shutdown_connections 2020-10-31T22:46:09.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.283+0000 7fbde6b42700 1 --2- 172.21.15.60:0/3613620814 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbdc0055020 0x7fbdc00574e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.283+0000 7fbde6b42700 1 --2- 172.21.15.60:0/3613620814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbde0140f80 0x7fbde00670c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.283+0000 7fbde6b42700 1 --2- 172.21.15.60:0/3613620814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbde00b0b50 0x7fbde00ab250 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.283+0000 7fbde6b42700 1 --2- 172.21.15.60:0/3613620814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbde00b5380 0x7fbde0154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.283+0000 7fbde6b42700 1 -- 172.21.15.60:0/3613620814 >> 172.21.15.60:0/3613620814 conn(0x7fbde006a600 msgr2=0x7fbde00ae180 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:09.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.283+0000 7fbde6b42700 1 -- 172.21.15.60:0/3613620814 shutdown_connections 2020-10-31T22:46:09.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.283+0000 7fbde6b42700 1 -- 172.21.15.60:0/3613620814 wait complete. 2020-10-31T22:46:09.302 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:46:09.303 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:09.318 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:09.336 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:09.353 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:09.371 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:46:09.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:09.372 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:46:09.372 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:09.418 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-10-31T22:46:09.419 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:46:09.420 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2020-10-31T22:46:09.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:09.421 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:46:09.421 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:46:09.428 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:46:09.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:46:09.429 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:46:09.430 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-10-31T22:46:09.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.547+0000 7fce42d5e700 1 Processor -- start 2020-10-31T22:46:09.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.547+0000 7fce42d5e700 1 -- start start 2020-10-31T22:46:09.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce42d5e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce3c0b1bb0 0x7fce3c05c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:09.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce42d5e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fce3c0ae630 0x7fce3c13ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:09.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce42d5e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3c05c800 con 0x7fce3c13f1b0 2020-10-31T22:46:09.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce42d5e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3c05c5e0 con 0x7fce3c0ae630 2020-10-31T22:46:09.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce42d5e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c13f630 con 0x7fce3c0b1bb0 2020-10-31T22:46:09.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce4155b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fce3c0ae630 0x7fce3c13ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:09.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce4255d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fce3c13f1b0 0x7fce3c0b0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48564/0 (socket says 172.21.15.60:48564) 2020-10-31T22:46:09.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce4255d700 1 -- 172.21.15.60:0/968246660 learned_addr learned my addr 172.21.15.60:0/968246660 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:09.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce41d5c700 1 --2- 172.21.15.60:0/968246660 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce3c0b1bb0 0x7fce3c05c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:09.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce4155b700 1 -- 172.21.15.60:0/968246660 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce3c0b1bb0 msgr2=0x7fce3c05c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:09.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce4155b700 1 --2- 172.21.15.60:0/968246660 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce3c0b1bb0 0x7fce3c05c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce4155b700 1 -- 172.21.15.60:0/968246660 >> v1:172.21.15.60:6789/0 conn(0x7fce3c13f1b0 legacy=0x7fce3c0b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:09.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce40d5a700 1 -- 172.21.15.60:0/968246660 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3813073712 0 0) 0x7fce3c05c800 con 0x7fce3c13f1b0 2020-10-31T22:46:09.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce4155b700 1 -- 172.21.15.60:0/968246660 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c0adc50 con 0x7fce3c0ae630 2020-10-31T22:46:09.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce4155b700 1 --2- 172.21.15.60:0/968246660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce3c0ae630 0x7fce3c13ecc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fce2c002f30 tx=0x7fce2c006dc0).ready entity=mon.0 client_cookie=abdc99fb1092b108 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:09.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce40d5a700 1 -- 172.21.15.60:0/968246660 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce2c009760 con 0x7fce3c0ae630 2020-10-31T22:46:09.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce40d5a700 1 -- 172.21.15.60:0/968246660 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c0098c0 con 0x7fce3c0ae630 2020-10-31T22:46:09.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce40d5a700 1 -- 172.21.15.60:0/968246660 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce2c009c20 con 0x7fce3c0ae630 2020-10-31T22:46:09.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce42d5e700 1 -- 172.21.15.60:0/968246660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce3c0ae630 msgr2=0x7fce3c13ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:09.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce42d5e700 1 --2- 172.21.15.60:0/968246660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce3c0ae630 0x7fce3c13ecc0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7fce2c002f30 tx=0x7fce2c006dc0).stop 2020-10-31T22:46:09.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce42d5e700 1 -- 172.21.15.60:0/968246660 shutdown_connections 2020-10-31T22:46:09.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce42d5e700 1 --2- 172.21.15.60:0/968246660 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce3c0b1bb0 0x7fce3c05c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce42d5e700 1 --2- 172.21.15.60:0/968246660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce3c0ae630 0x7fce3c13ecc0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce42d5e700 1 -- 172.21.15.60:0/968246660 >> 172.21.15.60:0/968246660 conn(0x7fce3c0b5300 msgr2=0x7fce3c0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:09.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce42d5e700 1 -- 172.21.15.60:0/968246660 shutdown_connections 2020-10-31T22:46:09.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.551+0000 7fce42d5e700 1 -- 172.21.15.60:0/968246660 wait complete. 2020-10-31T22:46:09.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce42d5e700 1 Processor -- start 2020-10-31T22:46:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce42d5e700 1 -- start start 2020-10-31T22:46:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce42d5e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce3c0b1bb0 0x7fce3c139090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce42d5e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce3c13f1b0 0x7fce3c14d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce42d5e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce3c136f70 0x7fce3c1373f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce42d5e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c14d6f0 con 0x7fce3c0b1bb0 2020-10-31T22:46:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce42d5e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c142450 con 0x7fce3c136f70 2020-10-31T22:46:09.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce42d5e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c1426f0 con 0x7fce3c13f1b0 2020-10-31T22:46:09.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce41d5c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce3c0b1bb0 0x7fce3c139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:09.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce41d5c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce3c0b1bb0 0x7fce3c139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44430/0 (socket says 172.21.15.60:44430) 2020-10-31T22:46:09.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce41d5c700 1 -- 172.21.15.60:0/342491340 learned_addr learned my addr 172.21.15.60:0/342491340 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:09.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce4155b700 1 --2- 172.21.15.60:0/342491340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce3c13f1b0 0x7fce3c14d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:09.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce4255d700 1 --2- 172.21.15.60:0/342491340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce3c136f70 0x7fce3c1373f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:09.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce41d5c700 1 -- 172.21.15.60:0/342491340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce3c13f1b0 msgr2=0x7fce3c14d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:09.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce41d5c700 1 --2- 172.21.15.60:0/342491340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce3c13f1b0 0x7fce3c14d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce41d5c700 1 -- 172.21.15.60:0/342491340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce3c136f70 msgr2=0x7fce3c1373f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:09.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce41d5c700 1 --2- 172.21.15.60:0/342491340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce3c136f70 0x7fce3c1373f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce41d5c700 1 -- 172.21.15.60:0/342491340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c142990 con 0x7fce3c0b1bb0 2020-10-31T22:46:09.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce41d5c700 1 --2- 172.21.15.60:0/342491340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce3c0b1bb0 0x7fce3c139090 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fce3800c000 tx=0x7fce38006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:09.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce2affd700 1 -- 172.21.15.60:0/342491340 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce3800ca80 con 0x7fce3c0b1bb0 2020-10-31T22:46:09.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce2affd700 1 -- 172.21.15.60:0/342491340 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3800cbe0 con 0x7fce3c0b1bb0 2020-10-31T22:46:09.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce42d5e700 1 -- 172.21.15.60:0/342491340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3c142c30 con 0x7fce3c0b1bb0 2020-10-31T22:46:09.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce2affd700 1 -- 172.21.15.60:0/342491340 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce380123f0 con 0x7fce3c0b1bb0 2020-10-31T22:46:09.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.555+0000 7fce42d5e700 1 -- 172.21.15.60:0/342491340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3c139bd0 con 0x7fce3c0b1bb0 2020-10-31T22:46:09.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.559+0000 7fce42d5e700 1 -- 172.21.15.60:0/342491340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3c057100 con 0x7fce3c0b1bb0 2020-10-31T22:46:09.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.559+0000 7fce2affd700 1 -- 172.21.15.60:0/342491340 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fce38012550 con 0x7fce3c0b1bb0 2020-10-31T22:46:09.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.559+0000 7fce2affd700 1 --2- 172.21.15.60:0/342491340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce1c054f10 0x7fce1c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:09.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.559+0000 7fce4155b700 1 --2- 172.21.15.60:0/342491340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce1c054f10 0x7fce1c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:09.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.559+0000 7fce2affd700 1 -- 172.21.15.60:0/342491340 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fce3806e090 con 0x7fce3c0b1bb0 2020-10-31T22:46:09.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.559+0000 7fce4155b700 1 --2- 172.21.15.60:0/342491340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce1c054f10 0x7fce1c0573d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fce2c018000 tx=0x7fce2c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:09.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.567+0000 7fce2affd700 1 -- 172.21.15.60:0/342491340 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fce38044440 con 0x7fce3c0b1bb0 2020-10-31T22:46:09.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.711+0000 7fce42d5e700 1 -- 172.21.15.60:0/342491340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fce3c0b10e0 con 0x7fce3c0b1bb0 2020-10-31T22:46:09.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.711+0000 7fce2affd700 1 -- 172.21.15.60:0/342491340 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) v1 ==== 81+0+33647 (secure 0 0 0) 0x7fce38047a60 con 0x7fce3c0b1bb0 2020-10-31T22:46:09.713 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:09.713 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:46:09.714 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 54, 2020-10-31T22:46:09.714 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "226f905a-1517-4a8c-8009-08779515965c", 2020-10-31T22:46:09.714 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2020-10-31T22:40:51.928572+0000", 2020-10-31T22:46:09.714 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2020-10-31T22:44:42.513291+0000", 2020-10-31T22:46:09.714 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:46:09.714 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:46:09.715 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-10-31T22:46:09.715 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2020-10-31T22:46:09.715 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2020-10-31T22:46:09.715 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2020-10-31T22:46:09.715 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2020-10-31T22:46:09.715 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2020-10-31T22:46:09.715 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2020-10-31T22:46:09.716 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:46:09.716 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2020-10-31T22:46:09.716 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2020-10-31T22:46:09.716 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-10-31T22:46:09.716 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2020-10-31T22:46:09.716 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2020-10-31T22:46:09.717 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 10, 2020-10-31T22:46:09.717 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2020-10-31T22:46:09.717 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "jewel", 2020-10-31T22:46:09.717 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2020-10-31T22:46:09.717 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "octopus", 2020-10-31T22:46:09.717 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:46:09.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.718 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2020-10-31T22:46:09.718 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "device_health_metrics", 2020-10-31T22:46:09.718 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:40:55.846143+0000", 2020-10-31T22:46:09.718 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:46:09.718 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:46:09.718 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:46:09.719 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:46:09.719 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:46:09.719 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:46:09.719 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:46:09.719 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:46:09.719 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2020-10-31T22:46:09.719 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2020-10-31T22:46:09.720 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2020-10-31T22:46:09.720 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2020-10-31T22:46:09.720 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2020-10-31T22:46:09.720 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:46:09.720 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:46:09.720 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:46:09.721 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:46:09.721 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:46:09.721 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:46:09.721 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:46:09.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.721 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "15", 2020-10-31T22:46:09.722 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:46:09.722 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:46:09.722 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:46:09.722 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:46:09.722 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:46:09.722 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:46:09.723 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:46:09.723 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:46:09.723 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:46:09.723 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:46:09.723 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:46:09.723 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:46:09.723 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:46:09.724 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:46:09.724 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:46:09.724 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:46:09.724 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:46:09.724 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:46:09.724 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:46:09.725 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:46:09.725 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:46:09.725 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:46:09.725 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:46:09.725 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:46:09.725 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:46:09.726 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:46:09.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.726 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:46:09.726 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:46:09.726 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:46:09.726 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:46:09.726 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:46:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:46:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:46:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:46:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:46:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:46:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:46:09.727 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:46:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2020-10-31T22:46:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:46:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_devicehealth": {} 2020-10-31T22:46:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2020-10-31T22:46:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2020-10-31T22:46:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:05.358501+0000", 2020-10-31T22:46:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:46:09.729 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:46:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:46:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:46:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:46:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:46:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:46:09.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:46:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:46:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:46:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:46:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:46:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:46:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:46:09.731 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:46:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:46:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:46:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:46:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:46:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:46:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.732 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "18", 2020-10-31T22:46:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:46:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:46:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:46:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:46:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:46:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:46:09.733 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:46:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:46:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:46:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:46:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:46:09.734 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:46:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:46:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:46:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:46:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:46:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:46:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:46:09.735 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:46:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:46:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:46:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:46:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:46:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:46:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:46:09.736 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:46:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:46:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:46:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:46:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:46:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:46:09.737 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:46:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:46:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:46:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:46:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:46:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:46:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:46:09.738 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:46:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2020-10-31T22:46:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 9, 2020-10-31T22:46:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2020-10-31T22:46:09.739 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:44:39.101359+0000", 2020-10-31T22:46:09.740 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:46:09.740 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:46:09.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:46:09.740 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:46:09.740 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:46:09.740 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:46:09.741 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:46:09.741 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:46:09.741 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:46:09.741 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:46:09.741 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:46:09.741 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:46:09.741 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:46:09.742 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:46:09.742 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:46:09.742 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:46:09.742 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:46:09.742 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:46:09.742 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:46:09.743 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:46:09.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.743 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "53", 2020-10-31T22:46:09.743 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:46:09.743 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:46:09.743 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:46:09.743 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:46:09.744 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:46:09.744 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:46:09.744 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:46:09.744 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:46:09.744 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:46:09.744 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:46:09.744 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:46:09.744 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:46:09.745 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:46:09.745 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:46:09.745 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:46:09.745 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:46:09.745 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:46:09.745 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:46:09.745 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:46:09.746 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:46:09.746 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:46:09.746 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:46:09.746 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:46:09.746 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:46:09.746 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:46:09.746 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:46:09.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.747 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:46:09.747 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:46:09.747 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:46:09.747 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:46:09.747 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:46:09.747 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:46:09.748 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:46:09.748 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:46:09.748 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:46:09.748 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:46:09.748 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:46:09.748 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:46:09.748 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2020-10-31T22:46:09.749 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2020-10-31T22:46:09.749 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2020-10-31T22:46:09.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.749 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:46:09.749 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:46:09.749 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2020-10-31T22:46:09.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.750 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 10, 2020-10-31T22:46:09.750 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2020-10-31T22:46:09.751 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:44:40.356100+0000", 2020-10-31T22:46:09.751 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:46:09.751 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:46:09.751 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:46:09.751 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:46:09.751 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:46:09.752 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:46:09.752 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:46:09.752 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:46:09.752 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:46:09.752 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:46:09.752 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:46:09.752 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:46:09.753 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:46:09.753 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:46:09.753 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:46:09.753 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:46:09.753 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:46:09.753 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:46:09.753 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:46:09.754 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:46:09.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.754 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "54", 2020-10-31T22:46:09.754 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:46:09.754 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:46:09.754 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:46:09.755 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:46:09.755 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:46:09.755 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:46:09.755 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:46:09.755 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:46:09.755 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:46:09.755 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:46:09.756 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:46:09.756 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:46:09.756 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:46:09.756 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:46:09.756 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:46:09.756 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:46:09.756 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:46:09.757 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:46:09.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:46:09.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:46:09.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:46:09.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:46:09.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:46:09.758 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:46:09.758 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:46:09.758 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:46:09.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.758 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:46:09.758 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:46:09.758 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:46:09.759 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:46:09.759 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:46:09.759 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:46:09.759 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:46:09.759 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:46:09.759 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:46:09.759 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:46:09.760 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:46:09.760 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:46:09.760 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:46:09.760 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:46:09.760 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2020-10-31T22:46:09.760 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.760 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.761 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.761 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:46:09.761 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2020-10-31T22:46:09.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.761 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:46:09.761 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", 2020-10-31T22:46:09.761 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:09.762 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:09.762 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:09.762 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:09.762 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:09.762 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:09.762 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:09.763 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 52, 2020-10-31T22:46:09.763 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:09.763 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:09.763 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:09.763 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.763 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.764 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2020-10-31T22:46:09.764 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:09.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.764 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.764 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2020-10-31T22:46:09.765 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:09.765 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.765 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.765 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:09.765 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.766 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.766 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2020-10-31T22:46:09.766 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:09.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.766 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.766 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.766 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2020-10-31T22:46:09.767 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:09.767 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.767 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.767 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:09.767 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.768 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.768 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2020-10-31T22:46:09.768 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:09.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.768 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.769 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2020-10-31T22:46:09.769 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:09.769 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.769 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.769 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:09.769 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.770 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.770 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2020-10-31T22:46:09.770 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:09.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.770 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.771 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2020-10-31T22:46:09.771 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:09.771 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.771 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.771 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6803/14302", 2020-10-31T22:46:09.772 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6805/14302", 2020-10-31T22:46:09.772 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6809/14302", 2020-10-31T22:46:09.772 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6807/14302", 2020-10-31T22:46:09.772 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:09.772 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:09.772 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:09.772 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.773 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:46:09.773 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", 2020-10-31T22:46:09.773 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:09.773 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:09.773 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:09.773 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:09.774 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:09.774 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:09.774 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:09.774 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 52, 2020-10-31T22:46:09.774 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:09.774 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:09.774 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:09.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2020-10-31T22:46:09.775 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:09.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.776 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.776 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2020-10-31T22:46:09.776 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:09.776 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.776 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.776 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:09.777 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.777 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.777 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2020-10-31T22:46:09.777 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:09.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.777 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2020-10-31T22:46:09.778 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:09.778 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.778 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.778 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:09.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.779 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.779 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2020-10-31T22:46:09.779 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:09.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.779 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.780 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2020-10-31T22:46:09.780 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:09.780 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.780 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.780 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:09.780 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.781 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2020-10-31T22:46:09.781 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:09.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.782 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.782 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2020-10-31T22:46:09.782 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:09.782 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.782 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.782 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/14300", 2020-10-31T22:46:09.783 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6813/14300", 2020-10-31T22:46:09.783 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6817/14300", 2020-10-31T22:46:09.783 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6815/14300", 2020-10-31T22:46:09.783 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:09.783 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:09.783 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:09.783 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.784 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:46:09.784 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", 2020-10-31T22:46:09.784 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:09.784 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:09.784 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:09.784 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:09.785 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:09.785 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:09.785 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:09.785 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 52, 2020-10-31T22:46:09.785 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:09.785 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:09.785 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:09.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2020-10-31T22:46:09.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:09.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2020-10-31T22:46:09.787 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:09.787 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.787 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.787 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:09.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2020-10-31T22:46:09.788 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:09.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.789 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.789 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2020-10-31T22:46:09.789 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:09.789 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.789 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.789 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:09.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.790 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6832", 2020-10-31T22:46:09.790 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:09.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.790 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6833", 2020-10-31T22:46:09.791 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:09.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.791 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.791 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:09.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2020-10-31T22:46:09.792 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:09.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2020-10-31T22:46:09.793 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:09.793 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.793 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.793 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6827/14318", 2020-10-31T22:46:09.793 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6829/14318", 2020-10-31T22:46:09.793 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6833/14318", 2020-10-31T22:46:09.794 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6831/14318", 2020-10-31T22:46:09.794 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:09.794 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:09.794 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:09.794 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.795 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:46:09.795 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", 2020-10-31T22:46:09.795 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:09.795 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:09.795 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:09.795 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:09.796 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:09.796 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:09.796 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:09.796 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 50, 2020-10-31T22:46:09.796 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:09.796 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:09.796 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:09.796 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2020-10-31T22:46:09.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:09.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2020-10-31T22:46:09.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:09.798 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.798 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.798 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:09.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2020-10-31T22:46:09.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:09.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2020-10-31T22:46:09.800 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:09.800 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.800 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.800 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:09.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.801 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2020-10-31T22:46:09.801 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:09.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.801 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2020-10-31T22:46:09.802 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:09.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.802 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.802 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:09.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.803 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2020-10-31T22:46:09.803 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:09.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2020-10-31T22:46:09.804 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:09.804 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.804 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.805 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6819/14301", 2020-10-31T22:46:09.805 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6821/14301", 2020-10-31T22:46:09.805 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/14301", 2020-10-31T22:46:09.805 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6823/14301", 2020-10-31T22:46:09.805 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:09.805 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:09.805 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:09.806 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.806 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:46:09.806 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", 2020-10-31T22:46:09.806 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:09.806 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:09.807 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:09.807 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:09.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:09.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:09.807 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:09.807 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 52, 2020-10-31T22:46:09.807 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:09.808 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:09.808 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:09.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.808 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6816", 2020-10-31T22:46:09.808 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:09.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6817", 2020-10-31T22:46:09.809 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:09.810 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.810 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.810 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:09.810 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6818", 2020-10-31T22:46:09.811 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:09.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6819", 2020-10-31T22:46:09.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:09.812 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.812 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.813 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:09.813 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.813 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.813 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6822", 2020-10-31T22:46:09.813 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:09.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.814 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.814 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6823", 2020-10-31T22:46:09.814 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:09.814 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.814 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.815 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:09.815 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.815 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6820", 2020-10-31T22:46:09.815 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:09.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.816 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6821", 2020-10-31T22:46:09.816 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:09.816 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.816 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.817 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6817/14002", 2020-10-31T22:46:09.817 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6819/14002", 2020-10-31T22:46:09.817 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6823/14002", 2020-10-31T22:46:09.817 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6821/14002", 2020-10-31T22:46:09.817 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:09.817 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:09.818 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:09.818 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.818 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:46:09.818 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", 2020-10-31T22:46:09.818 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:09.819 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:09.819 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:09.819 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:09.819 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:09.819 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:09.819 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:09.819 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 52, 2020-10-31T22:46:09.820 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:09.820 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:09.820 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:09.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6800", 2020-10-31T22:46:09.821 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:09.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6801", 2020-10-31T22:46:09.821 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:09.821 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.822 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.822 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:09.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.822 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6802", 2020-10-31T22:46:09.823 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:09.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6803", 2020-10-31T22:46:09.823 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:09.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.824 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.824 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:09.824 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.824 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.824 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6806", 2020-10-31T22:46:09.825 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:09.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.825 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.825 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6807", 2020-10-31T22:46:09.825 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:09.825 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.826 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.826 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:09.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6804", 2020-10-31T22:46:09.826 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:09.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6805", 2020-10-31T22:46:09.827 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:09.827 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.828 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.828 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6801/14001", 2020-10-31T22:46:09.828 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6803/14001", 2020-10-31T22:46:09.828 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6807/14001", 2020-10-31T22:46:09.828 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6805/14001", 2020-10-31T22:46:09.828 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:09.829 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:09.829 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:09.829 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.829 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:46:09.829 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", 2020-10-31T22:46:09.829 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:09.830 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:09.830 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:09.830 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:09.830 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:09.830 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:09.830 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:09.830 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 52, 2020-10-31T22:46:09.831 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:09.831 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:09.831 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:09.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6808", 2020-10-31T22:46:09.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:09.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6809", 2020-10-31T22:46:09.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:09.832 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.833 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.833 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:09.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6810", 2020-10-31T22:46:09.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:09.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6811", 2020-10-31T22:46:09.834 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:09.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.834 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.835 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:09.835 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.835 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6814", 2020-10-31T22:46:09.835 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:09.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.836 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.836 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6815", 2020-10-31T22:46:09.836 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:09.836 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.837 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.837 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:09.837 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.837 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.837 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6812", 2020-10-31T22:46:09.837 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:09.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.838 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.838 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6813", 2020-10-31T22:46:09.838 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:09.838 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.838 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.839 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6809/14003", 2020-10-31T22:46:09.839 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6811/14003", 2020-10-31T22:46:09.839 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6815/14003", 2020-10-31T22:46:09.839 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6813/14003", 2020-10-31T22:46:09.839 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:09.839 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:09.840 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:09.840 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.840 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:46:09.840 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", 2020-10-31T22:46:09.840 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:09.841 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:09.841 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:09.841 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:09.841 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:09.841 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:09.841 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:09.841 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 50, 2020-10-31T22:46:09.842 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:09.842 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:09.842 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:09.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.842 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6824", 2020-10-31T22:46:09.843 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:09.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6825", 2020-10-31T22:46:09.843 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:09.844 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.844 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.844 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:09.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6826", 2020-10-31T22:46:09.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:09.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6827", 2020-10-31T22:46:09.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:09.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.846 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.846 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:09.846 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.846 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6830", 2020-10-31T22:46:09.847 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:09.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6831", 2020-10-31T22:46:09.847 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:09.848 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.848 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.848 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:09.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:09.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:09.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6828", 2020-10-31T22:46:09.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:09.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:09.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6829", 2020-10-31T22:46:09.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:09.850 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.850 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.850 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6825/14046", 2020-10-31T22:46:09.850 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6827/14046", 2020-10-31T22:46:09.850 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6831/14046", 2020-10-31T22:46:09.850 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6829/14046", 2020-10-31T22:46:09.851 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:09.851 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:09.851 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:09.851 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:09.851 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.851 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:46:09.852 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2020-10-31T22:46:09.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.852 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:46:09.852 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:09.852 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:09.852 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:09.852 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:09.852 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:09.853 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.314917+0000", 2020-10-31T22:46:09.853 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:09.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.853 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:46:09.853 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:09.853 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:09.854 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:09.854 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:09.854 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:09.854 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.643069+0000", 2020-10-31T22:46:09.854 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:09.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.855 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:46:09.855 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:09.855 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:09.855 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:09.855 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:09.855 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:09.855 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.662572+0000", 2020-10-31T22:46:09.856 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:09.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.856 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:46:09.856 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:09.856 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:09.856 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:09.856 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:09.857 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:09.857 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.664868+0000", 2020-10-31T22:46:09.857 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:09.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.857 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:46:09.857 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:09.858 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:09.858 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:09.858 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:09.858 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:09.858 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551107+0000", 2020-10-31T22:46:09.858 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:09.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:46:09.859 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:09.859 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:09.859 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:09.859 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:09.859 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:09.859 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.400568+0000", 2020-10-31T22:46:09.860 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:09.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.860 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:46:09.860 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:09.860 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:09.860 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:09.861 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:09.861 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:09.861 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551173+0000", 2020-10-31T22:46:09.861 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:09.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:09.862 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:46:09.862 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:09.862 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:09.862 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:09.862 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:09.862 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:09.862 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.604302+0000", 2020-10-31T22:46:09.862 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:09.863 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.863 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:46:09.863 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2020-10-31T22:46:09.863 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2020-10-31T22:46:09.863 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2020-10-31T22:46:09.863 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2020-10-31T22:46:09.863 INFO:teuthology.orchestra.run.smithi060.stdout: "blacklist": {}, 2020-10-31T22:46:09.864 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2020-10-31T22:46:09.864 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2020-10-31T22:46:09.864 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2020-10-31T22:46:09.864 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2020-10-31T22:46:09.864 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2020-10-31T22:46:09.864 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2020-10-31T22:46:09.864 INFO:teuthology.orchestra.run.smithi060.stdout: "ruleset-failure-domain": "osd", 2020-10-31T22:46:09.864 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2020-10-31T22:46:09.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:09.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:09.865 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2020-10-31T22:46:09.865 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2020-10-31T22:46:09.865 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2020-10-31T22:46:09.865 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2020-10-31T22:46:09.865 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {} 2020-10-31T22:46:09.866 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:46:09.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.715+0000 7fce42d5e700 1 -- 172.21.15.60:0/342491340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce1c054f10 msgr2=0x7fce1c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:09.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.715+0000 7fce42d5e700 1 --2- 172.21.15.60:0/342491340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce1c054f10 0x7fce1c0573d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7fce2c018000 tx=0x7fce2c015000).stop 2020-10-31T22:46:09.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.715+0000 7fce42d5e700 1 -- 172.21.15.60:0/342491340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce3c0b1bb0 msgr2=0x7fce3c139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:09.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.715+0000 7fce42d5e700 1 --2- 172.21.15.60:0/342491340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce3c0b1bb0 0x7fce3c139090 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7fce3800c000 tx=0x7fce38006dc0).stop 2020-10-31T22:46:09.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.715+0000 7fce42d5e700 1 -- 172.21.15.60:0/342491340 shutdown_connections 2020-10-31T22:46:09.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.715+0000 7fce42d5e700 1 --2- 172.21.15.60:0/342491340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce1c054f10 0x7fce1c0573d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.715+0000 7fce42d5e700 1 --2- 172.21.15.60:0/342491340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce3c136f70 0x7fce3c1373f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.715+0000 7fce42d5e700 1 --2- 172.21.15.60:0/342491340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce3c0b1bb0 0x7fce3c139090 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.715+0000 7fce42d5e700 1 --2- 172.21.15.60:0/342491340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce3c13f1b0 0x7fce3c14d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.715+0000 7fce42d5e700 1 -- 172.21.15.60:0/342491340 >> 172.21.15.60:0/342491340 conn(0x7fce3c0b5300 msgr2=0x7fce3c13b320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.715+0000 7fce42d5e700 1 -- 172.21.15.60:0/342491340 shutdown_connections 2020-10-31T22:46:09.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.715+0000 7fce42d5e700 1 -- 172.21.15.60:0/342491340 wait complete. 2020-10-31T22:46:09.870 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:46:09.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b66647700 1 Processor -- start 2020-10-31T22:46:09.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b66647700 1 -- start start 2020-10-31T22:46:09.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b66647700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b6005b960 0x7f8b6005bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:09.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b66647700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8b600a7850 0x7f8b600aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:09.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b66647700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b600b0f00 con 0x7f8b600aefe0 2020-10-31T22:46:09.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b66647700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b600b11a0 con 0x7f8b600a7850 2020-10-31T22:46:09.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b66647700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600b1440 con 0x7f8b6005b960 2020-10-31T22:46:09.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b5ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b6005b960 0x7f8b6005bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:09.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b5f7fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8b600a7850 0x7f8b600aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:09.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b5ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b6005b960 0x7f8b6005bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:57626/0 (socket says 172.21.15.60:57626) 2020-10-31T22:46:09.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b5ffff700 1 -- 172.21.15.60:0/1053468753 learned_addr learned my addr 172.21.15.60:0/1053468753 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:09.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b5f7fe700 1 -- 172.21.15.60:0/1053468753 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b6005b960 msgr2=0x7f8b6005bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:09.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b5f7fe700 1 --2- 172.21.15.60:0/1053468753 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b6005b960 0x7f8b6005bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:09.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b5f7fe700 1 -- 172.21.15.60:0/1053468753 >> v1:172.21.15.66:6789/0 conn(0x7f8b600aefe0 legacy=0x7f8b60146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:09.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b5f7fe700 1 -- 172.21.15.60:0/1053468753 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b601462f0 con 0x7f8b600a7850 2020-10-31T22:46:09.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b5ffff700 1 --2- 172.21.15.60:0/1053468753 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b6005b960 0x7f8b6005bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:46:09.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b5f7fe700 1 --2- 172.21.15.60:0/1053468753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b600a7850 0x7f8b600aeaf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f8b48002f30 tx=0x7f8b48006dc0).ready entity=mon.1 client_cookie=8abaee16c1e0afd9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:09.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b5effd700 1 -- 172.21.15.60:0/1053468753 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b48009760 con 0x7f8b600a7850 2020-10-31T22:46:09.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b5effd700 1 -- 172.21.15.60:0/1053468753 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b480098c0 con 0x7f8b600a7850 2020-10-31T22:46:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b5effd700 1 -- 172.21.15.60:0/1053468753 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b48009c20 con 0x7f8b600a7850 2020-10-31T22:46:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b66647700 1 -- 172.21.15.60:0/1053468753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b600a7850 msgr2=0x7f8b600aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.991+0000 7f8b66647700 1 --2- 172.21.15.60:0/1053468753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b600a7850 0x7f8b600aeaf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f8b48002f30 tx=0x7f8b48006dc0).stop 2020-10-31T22:46:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 -- 172.21.15.60:0/1053468753 shutdown_connections 2020-10-31T22:46:09.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 --2- 172.21.15.60:0/1053468753 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b6005b960 0x7f8b6005bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:10.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 --2- 172.21.15.60:0/1053468753 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b600a7850 0x7f8b600aeaf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:10.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 -- 172.21.15.60:0/1053468753 >> 172.21.15.60:0/1053468753 conn(0x7f8b6006a260 msgr2=0x7f8b60061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:10.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 -- 172.21.15.60:0/1053468753 shutdown_connections 2020-10-31T22:46:10.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 -- 172.21.15.60:0/1053468753 wait complete. 2020-10-31T22:46:10.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 Processor -- start 2020-10-31T22:46:10.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 -- start start 2020-10-31T22:46:10.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b6005b960 0x7f8b600b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:10.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b600a7850 0x7f8b600aa2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:10.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b600a9db0 0x7f8b6014d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:10.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600b3140 con 0x7f8b6005b960 2020-10-31T22:46:10.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600b4a10 con 0x7f8b600a9db0 2020-10-31T22:46:10.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600a9410 con 0x7f8b600a7850 2020-10-31T22:46:10.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b5ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b6005b960 0x7f8b600b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:10.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b5ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b6005b960 0x7f8b600b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44444/0 (socket says 172.21.15.60:44444) 2020-10-31T22:46:10.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b5ffff700 1 -- 172.21.15.60:0/427102385 learned_addr learned my addr 172.21.15.60:0/427102385 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:10.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b64be4700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b600a9db0 0x7f8b6014d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:10.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b5f7fe700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b600a7850 0x7f8b600aa2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:10.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b5ffff700 1 -- 172.21.15.60:0/427102385 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b600a7850 msgr2=0x7f8b600aa2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b5ffff700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b600a7850 0x7f8b600aa2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b5ffff700 1 -- 172.21.15.60:0/427102385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b600a9db0 msgr2=0x7f8b6014d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b5ffff700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b600a9db0 0x7f8b6014d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b5ffff700 1 -- 172.21.15.60:0/427102385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b600a96b0 con 0x7f8b6005b960 2020-10-31T22:46:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b64be4700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b600a9db0 0x7f8b6014d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:46:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b5f7fe700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b600a7850 0x7f8b600aa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b5ffff700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b6005b960 0x7f8b600b4350 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f8b5800c000 tx=0x7f8b58009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:10.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b5d7fa700 1 -- 172.21.15.60:0/427102385 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b5800cc80 con 0x7f8b6005b960 2020-10-31T22:46:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b5d7fa700 1 -- 172.21.15.60:0/427102385 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5800cde0 con 0x7f8b6005b960 2020-10-31T22:46:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.995+0000 7f8b66647700 1 -- 172.21.15.60:0/427102385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b600b1c70 con 0x7f8b6005b960 2020-10-31T22:46:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.999+0000 7f8b5d7fa700 1 -- 172.21.15.60:0/427102385 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b580125e0 con 0x7f8b6005b960 2020-10-31T22:46:10.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.999+0000 7f8b66647700 1 -- 172.21.15.60:0/427102385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b600b2110 con 0x7f8b6005b960 2020-10-31T22:46:10.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.999+0000 7f8b66647700 1 -- 172.21.15.60:0/427102385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b60057100 con 0x7f8b6005b960 2020-10-31T22:46:10.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.999+0000 7f8b5d7fa700 1 -- 172.21.15.60:0/427102385 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8b58012740 con 0x7f8b6005b960 2020-10-31T22:46:10.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.999+0000 7f8b5d7fa700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b44054f30 0x7f8b440573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:10.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.999+0000 7f8b5d7fa700 1 -- 172.21.15.60:0/427102385 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8b5806e580 con 0x7f8b6005b960 2020-10-31T22:46:10.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.999+0000 7f8b5f7fe700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b44054f30 0x7f8b440573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:10.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:09.999+0000 7f8b5f7fe700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b44054f30 0x7f8b440573f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f8b48018000 tx=0x7f8b48015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:10.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.007+0000 7f8b5d7fa700 1 -- 172.21.15.60:0/427102385 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8b58044aa0 con 0x7f8b6005b960 2020-10-31T22:46:10.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.195+0000 7f8b66647700 1 -- 172.21.15.60:0/427102385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b600a9840 con 0x7f8b6005b960 2020-10-31T22:46:10.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.195+0000 7f8b5d7fa700 1 -- 172.21.15.60:0/427102385 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f8b580480c0 con 0x7f8b6005b960 2020-10-31T22:46:10.196 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:10.196 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":23,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5180,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3826848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3826848450},{"type":"v1","addr":"172.21.15.66:6833","nonce":3826848450}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5544,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/821344830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":821344830},{"type":"v1","addr":"172.21.15.60:6835","nonce":821344830}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:44:41.510512+0000","modified":"2020-10-31T22:44:43.018399+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5553},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5553":{"gid":5553,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/798359639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":798359639},{"type":"v1","addr":"172.21.15.60:6837","nonce":798359639}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-10-31T22:46:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.199+0000 7f8b66647700 1 -- 172.21.15.60:0/427102385 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b44054f30 msgr2=0x7f8b440573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.199+0000 7f8b66647700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b44054f30 0x7f8b440573f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f8b48018000 tx=0x7f8b48015000).stop 2020-10-31T22:46:10.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.199+0000 7f8b66647700 1 -- 172.21.15.60:0/427102385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b6005b960 msgr2=0x7f8b600b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.199+0000 7f8b66647700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b6005b960 0x7f8b600b4350 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f8b5800c000 tx=0x7f8b58009270).stop 2020-10-31T22:46:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.199+0000 7f8b66647700 1 -- 172.21.15.60:0/427102385 shutdown_connections 2020-10-31T22:46:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.199+0000 7f8b66647700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b44054f30 0x7f8b440573f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.199+0000 7f8b66647700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b600a9db0 0x7f8b6014d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.199+0000 7f8b66647700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b6005b960 0x7f8b600b4350 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.199+0000 7f8b66647700 1 --2- 172.21.15.60:0/427102385 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b600a7850 0x7f8b600aa2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.199+0000 7f8b66647700 1 -- 172.21.15.60:0/427102385 >> 172.21.15.60:0/427102385 conn(0x7f8b6006a260 msgr2=0x7f8b60149fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:10.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.199+0000 7f8b66647700 1 -- 172.21.15.60:0/427102385 shutdown_connections 2020-10-31T22:46:10.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.199+0000 7f8b66647700 1 -- 172.21.15.60:0/427102385 wait complete. 2020-10-31T22:46:10.200 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 23 2020-10-31T22:46:10.211 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-10-31T22:46:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa997fff700 1 Processor -- start 2020-10-31T22:46:10.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa997fff700 1 -- start start 2020-10-31T22:46:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa997fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa99814f980 0x7fa998151d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa997fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9980af900 con 0x7fa9980af520 2020-10-31T22:46:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa997fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9980afc10 con 0x7fa9980ac870 2020-10-31T22:46:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa997fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99805bb70 con 0x7fa99814f980 2020-10-31T22:46:10.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa9977fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa99814f980 0x7fa998151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa996ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa9980af520 0x7fa998066c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48588/0 (socket says 172.21.15.60:48588) 2020-10-31T22:46:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa996ffd700 1 -- 172.21.15.60:0/1528956545 learned_addr learned my addr 172.21.15.60:0/1528956545 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa9977fe700 1 -- 172.21.15.60:0/1528956545 >> v1:172.21.15.66:6789/0 conn(0x7fa9980ac870 legacy=0x7fa998146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa9977fe700 1 -- 172.21.15.60:0/1528956545 >> v1:172.21.15.60:6789/0 conn(0x7fa9980af520 legacy=0x7fa998066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa9967fc700 1 -- 172.21.15.60:0/1528956545 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1032195160 0 0) 0x7fa9980af900 con 0x7fa9980af520 2020-10-31T22:46:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa9977fe700 1 -- 172.21.15.60:0/1528956545 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9980ac130 con 0x7fa99814f980 2020-10-31T22:46:10.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa9977fe700 1 --2- 172.21.15.60:0/1528956545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99814f980 0x7fa998151d70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fa9900032b0 tx=0x7fa9900091a0).ready entity=mon.0 client_cookie=febcb27731e2947a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:10.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa9967fc700 1 -- 172.21.15.60:0/1528956545 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa99000ba50 con 0x7fa99814f980 2020-10-31T22:46:10.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa9967fc700 1 -- 172.21.15.60:0/1528956545 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99000bbb0 con 0x7fa99814f980 2020-10-31T22:46:10.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa9967fc700 1 -- 172.21.15.60:0/1528956545 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa99000bd20 con 0x7fa99814f980 2020-10-31T22:46:10.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa997fff700 1 -- 172.21.15.60:0/1528956545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99814f980 msgr2=0x7fa998151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:10.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa997fff700 1 --2- 172.21.15.60:0/1528956545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99814f980 0x7fa998151d70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7fa9900032b0 tx=0x7fa9900091a0).stop 2020-10-31T22:46:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa997fff700 1 -- 172.21.15.60:0/1528956545 shutdown_connections 2020-10-31T22:46:10.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa997fff700 1 --2- 172.21.15.60:0/1528956545 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99814f980 0x7fa998151d70 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:10.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa997fff700 1 -- 172.21.15.60:0/1528956545 >> 172.21.15.60:0/1528956545 conn(0x7fa9980b3fd0 msgr2=0x7fa9980b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:10.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa997fff700 1 -- 172.21.15.60:0/1528956545 shutdown_connections 2020-10-31T22:46:10.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.327+0000 7fa997fff700 1 -- 172.21.15.60:0/1528956545 wait complete. 2020-10-31T22:46:10.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa997fff700 1 Processor -- start 2020-10-31T22:46:10.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa997fff700 1 -- start start 2020-10-31T22:46:10.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa997fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9980ac870 0x7fa9981452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:10.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa997fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9980af520 0x7fa9981440c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:10.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa997fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99814f980 0x7fa998149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:10.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa997fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99814a0d0 con 0x7fa99814f980 2020-10-31T22:46:10.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa997fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9981445b0 con 0x7fa9980af520 2020-10-31T22:46:10.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa997fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980aded0 con 0x7fa9980ac870 2020-10-31T22:46:10.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa9977fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99814f980 0x7fa998149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:10.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa9977fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99814f980 0x7fa998149050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44462/0 (socket says 172.21.15.60:44462) 2020-10-31T22:46:10.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa9977fe700 1 -- 172.21.15.60:0/2782535743 learned_addr learned my addr 172.21.15.60:0/2782535743 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:10.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa996ffd700 1 --2- 172.21.15.60:0/2782535743 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9980ac870 0x7fa9981452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:10.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa98ffff700 1 --2- 172.21.15.60:0/2782535743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9980af520 0x7fa9981440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:10.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa9977fe700 1 -- 172.21.15.60:0/2782535743 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9980ac870 msgr2=0x7fa9981452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:10.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa9977fe700 1 --2- 172.21.15.60:0/2782535743 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9980ac870 0x7fa9981452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:10.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa9977fe700 1 -- 172.21.15.60:0/2782535743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9980af520 msgr2=0x7fa9981440c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:10.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa9977fe700 1 --2- 172.21.15.60:0/2782535743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9980af520 0x7fa9981440c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:10.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa9977fe700 1 -- 172.21.15.60:0/2782535743 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9980ae170 con 0x7fa99814f980 2020-10-31T22:46:10.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa9977fe700 1 --2- 172.21.15.60:0/2782535743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99814f980 0x7fa998149050 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fa9900032b0 tx=0x7fa990016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:10.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa994ff9700 1 -- 172.21.15.60:0/2782535743 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa99001f5e0 con 0x7fa99814f980 2020-10-31T22:46:10.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa994ff9700 1 -- 172.21.15.60:0/2782535743 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa99001f740 con 0x7fa99814f980 2020-10-31T22:46:10.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa997fff700 1 -- 172.21.15.60:0/2782535743 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9980ae410 con 0x7fa99814f980 2020-10-31T22:46:10.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa994ff9700 1 -- 172.21.15.60:0/2782535743 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa99001faa0 con 0x7fa99814f980 2020-10-31T22:46:10.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.331+0000 7fa997fff700 1 -- 172.21.15.60:0/2782535743 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa998149d30 con 0x7fa99814f980 2020-10-31T22:46:10.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.335+0000 7fa997fff700 1 -- 172.21.15.60:0/2782535743 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa998057100 con 0x7fa99814f980 2020-10-31T22:46:10.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.335+0000 7fa994ff9700 1 -- 172.21.15.60:0/2782535743 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa990026030 con 0x7fa99814f980 2020-10-31T22:46:10.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.335+0000 7fa994ff9700 1 --2- 172.21.15.60:0/2782535743 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa97c054f90 0x7fa97c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:10.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.335+0000 7fa994ff9700 1 -- 172.21.15.60:0/2782535743 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa99006ef00 con 0x7fa99814f980 2020-10-31T22:46:10.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.335+0000 7fa996ffd700 1 --2- 172.21.15.60:0/2782535743 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa97c054f90 0x7fa97c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:10.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.335+0000 7fa996ffd700 1 --2- 172.21.15.60:0/2782535743 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa97c054f90 0x7fa97c057450 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fa98800d000 tx=0x7fa988007910).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:10.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.339+0000 7fa994ff9700 1 -- 172.21.15.60:0/2782535743 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa990045290 con 0x7fa99814f980 2020-10-31T22:46:10.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:10.523+0000 7fa997fff700 1 -- 172.21.15.60:0/2782535743 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa99805bf40 con 0x7fa99814f980 2020-10-31T22:46:11.278 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:46:11.279+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:46:11.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.287+0000 7fa994ff9700 1 -- 172.21.15.60:0/2782535743 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa990024090 con 0x7fa99814f980 2020-10-31T22:46:11.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.291+0000 7fa997fff700 1 -- 172.21.15.60:0/2782535743 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa97c054f90 msgr2=0x7fa97c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:11.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.291+0000 7fa997fff700 1 --2- 172.21.15.60:0/2782535743 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa97c054f90 0x7fa97c057450 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fa98800d000 tx=0x7fa988007910).stop 2020-10-31T22:46:11.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.291+0000 7fa997fff700 1 -- 172.21.15.60:0/2782535743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99814f980 msgr2=0x7fa998149050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:11.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.291+0000 7fa997fff700 1 --2- 172.21.15.60:0/2782535743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99814f980 0x7fa998149050 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7fa9900032b0 tx=0x7fa990016000).stop 2020-10-31T22:46:11.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.291+0000 7fa997fff700 1 -- 172.21.15.60:0/2782535743 shutdown_connections 2020-10-31T22:46:11.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.291+0000 7fa997fff700 1 --2- 172.21.15.60:0/2782535743 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa99814f980 0x7fa998149050 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.291+0000 7fa997fff700 1 --2- 172.21.15.60:0/2782535743 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9980ac870 0x7fa9981452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.291+0000 7fa997fff700 1 --2- 172.21.15.60:0/2782535743 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa97c054f90 0x7fa97c057450 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.291+0000 7fa997fff700 1 --2- 172.21.15.60:0/2782535743 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9980af520 0x7fa9981440c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.291+0000 7fa997fff700 1 -- 172.21.15.60:0/2782535743 >> 172.21.15.60:0/2782535743 conn(0x7fa9980b3fd0 msgr2=0x7fa998146060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:11.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.291+0000 7fa997fff700 1 -- 172.21.15.60:0/2782535743 shutdown_connections 2020-10-31T22:46:11.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.291+0000 7fa997fff700 1 -- 172.21.15.60:0/2782535743 wait complete. 2020-10-31T22:46:11.292 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-10-31T22:46:11.304 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:46:11.322 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:46:11.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab25f72700 1 Processor -- start 2020-10-31T22:46:11.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab25f72700 1 -- start start 2020-10-31T22:46:11.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab25f72700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab200ac870 0x7fab20146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:11.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab25f72700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fab20146550 0x7fab20150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:11.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab25f72700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab200af900 con 0x7fab200af520 2020-10-31T22:46:11.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab25f72700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab200afc10 con 0x7fab20146550 2020-10-31T22:46:11.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab25f72700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2005bb70 con 0x7fab200ac870 2020-10-31T22:46:11.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab25771700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fab20146550 0x7fab20150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:11.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab1ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab200ac870 0x7fab20146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:11.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab24f70700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fab200af520 0x7fab20066c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:46482/0 (socket says 172.21.15.60:46482) 2020-10-31T22:46:11.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab24f70700 1 -- 172.21.15.60:0/24327803 learned_addr learned my addr 172.21.15.60:0/24327803 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:11.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab1f7fe700 1 -- 172.21.15.60:0/24327803 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219857164 0 0) 0x7fab200af900 con 0x7fab200af520 2020-10-31T22:46:11.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab1f7fe700 1 -- 172.21.15.60:0/24327803 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab0c003230 con 0x7fab200af520 2020-10-31T22:46:11.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab25771700 1 -- 172.21.15.60:0/24327803 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab200ac870 msgr2=0x7fab20146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:11.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab25771700 1 --2- 172.21.15.60:0/24327803 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab200ac870 0x7fab20146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab25771700 1 -- 172.21.15.60:0/24327803 >> v1:172.21.15.66:6789/0 conn(0x7fab200af520 legacy=0x7fab20066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:11.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.411+0000 7fab25771700 1 -- 172.21.15.60:0/24327803 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab200ac130 con 0x7fab20146550 2020-10-31T22:46:11.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.415+0000 7fab25771700 1 --2- 172.21.15.60:0/24327803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab20146550 0x7fab20150980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fab10002f30 tx=0x7fab10006dc0).ready entity=mon.1 client_cookie=efc4ea0012ad6c14 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:11.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.415+0000 7fab1f7fe700 1 -- 172.21.15.60:0/24327803 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab100096a0 con 0x7fab20146550 2020-10-31T22:46:11.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.415+0000 7fab1f7fe700 1 -- 172.21.15.60:0/24327803 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab10009800 con 0x7fab20146550 2020-10-31T22:46:11.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.415+0000 7fab1f7fe700 1 -- 172.21.15.60:0/24327803 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab10009b60 con 0x7fab20146550 2020-10-31T22:46:11.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.415+0000 7fab25f72700 1 -- 172.21.15.60:0/24327803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab20146550 msgr2=0x7fab20150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:11.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.415+0000 7fab25f72700 1 --2- 172.21.15.60:0/24327803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab20146550 0x7fab20150980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7fab10002f30 tx=0x7fab10006dc0).stop 2020-10-31T22:46:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.415+0000 7fab25f72700 1 -- 172.21.15.60:0/24327803 shutdown_connections 2020-10-31T22:46:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.415+0000 7fab25f72700 1 --2- 172.21.15.60:0/24327803 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab20146550 0x7fab20150980 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.415+0000 7fab25f72700 1 --2- 172.21.15.60:0/24327803 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab200ac870 0x7fab20146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.415+0000 7fab25f72700 1 -- 172.21.15.60:0/24327803 >> 172.21.15.60:0/24327803 conn(0x7fab200b3fd0 msgr2=0x7fab200b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.415+0000 7fab25f72700 1 -- 172.21.15.60:0/24327803 shutdown_connections 2020-10-31T22:46:11.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.415+0000 7fab25f72700 1 -- 172.21.15.60:0/24327803 wait complete. 2020-10-31T22:46:11.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab25f72700 1 Processor -- start 2020-10-31T22:46:11.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab25f72700 1 -- start start 2020-10-31T22:46:11.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab25f72700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab200ac870 0x7fab20147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:11.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab25f72700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab200af520 0x7fab20149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:11.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab25f72700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab20146550 0x7fab20149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:11.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab25f72700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab20155da0 con 0x7fab200af520 2020-10-31T22:46:11.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab25f72700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab20155120 con 0x7fab200ac870 2020-10-31T22:46:11.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab25f72700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab20148760 con 0x7fab20146550 2020-10-31T22:46:11.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab200af520 0x7fab20149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:11.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab200af520 0x7fab20149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44486/0 (socket says 172.21.15.60:44486) 2020-10-31T22:46:11.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab1ffff700 1 -- 172.21.15.60:0/4107925026 learned_addr learned my addr 172.21.15.60:0/4107925026 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab24f70700 1 --2- 172.21.15.60:0/4107925026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab200ac870 0x7fab20147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:11.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab25771700 1 --2- 172.21.15.60:0/4107925026 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab20146550 0x7fab20149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab1ffff700 1 -- 172.21.15.60:0/4107925026 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab20146550 msgr2=0x7fab20149630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab1ffff700 1 --2- 172.21.15.60:0/4107925026 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab20146550 0x7fab20149630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab1ffff700 1 -- 172.21.15.60:0/4107925026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab200ac870 msgr2=0x7fab20147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab1ffff700 1 --2- 172.21.15.60:0/4107925026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab200ac870 0x7fab20147cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab1ffff700 1 -- 172.21.15.60:0/4107925026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab20148a00 con 0x7fab200af520 2020-10-31T22:46:11.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab1ffff700 1 --2- 172.21.15.60:0/4107925026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab200af520 0x7fab20149140 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fab1400c000 tx=0x7fab14006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab1dffb700 1 -- 172.21.15.60:0/4107925026 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab1400ca10 con 0x7fab200af520 2020-10-31T22:46:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab1dffb700 1 -- 172.21.15.60:0/4107925026 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1400cb70 con 0x7fab200af520 2020-10-31T22:46:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab25f72700 1 -- 172.21.15.60:0/4107925026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab20148ca0 con 0x7fab200af520 2020-10-31T22:46:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab1dffb700 1 -- 172.21.15.60:0/4107925026 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab140123f0 con 0x7fab200af520 2020-10-31T22:46:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.419+0000 7fab25f72700 1 -- 172.21.15.60:0/4107925026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab20149f30 con 0x7fab200af520 2020-10-31T22:46:11.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.423+0000 7fab25f72700 1 -- 172.21.15.60:0/4107925026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab20148e30 con 0x7fab200af520 2020-10-31T22:46:11.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.423+0000 7fab1dffb700 1 -- 172.21.15.60:0/4107925026 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fab14012550 con 0x7fab200af520 2020-10-31T22:46:11.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.423+0000 7fab1dffb700 1 --2- 172.21.15.60:0/4107925026 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab00054f90 0x7fab00057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:11.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.423+0000 7fab1dffb700 1 -- 172.21.15.60:0/4107925026 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fab1406ddc0 con 0x7fab200af520 2020-10-31T22:46:11.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.423+0000 7fab24f70700 1 --2- 172.21.15.60:0/4107925026 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab00054f90 0x7fab00057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:11.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.423+0000 7fab24f70700 1 --2- 172.21.15.60:0/4107925026 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab00054f90 0x7fab00057450 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fab1800d000 tx=0x7fab18007cf0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.431+0000 7fab1dffb700 1 -- 172.21.15.60:0/4107925026 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fab14044230 con 0x7fab200af520 2020-10-31T22:46:11.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.623+0000 7fab25f72700 1 -- 172.21.15.60:0/4107925026 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab20057100 con 0x7fab200af520 2020-10-31T22:46:11.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.623+0000 7fab1dffb700 1 -- 172.21.15.60:0/4107925026 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+2128 (secure 0 0 0) 0x7fab14047850 con 0x7fab200af520 2020-10-31T22:46:11.624 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:11.624 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":24,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5180,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3826848450","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3826848450},{"type":"v1","addr":"172.21.15.66:6833","nonce":3826848450}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":20},{"gid":5544,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/821344830","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":821344830},{"type":"v1","addr":"172.21.15.60:6835","nonce":821344830}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:44:41.510512+0000","modified":"2020-10-31T22:46:11.282302+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":55,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[10],"metadata_pool":9,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2020-10-31T22:46:11.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.627+0000 7fab25f72700 1 -- 172.21.15.60:0/4107925026 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab00054f90 msgr2=0x7fab00057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:11.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.627+0000 7fab25f72700 1 --2- 172.21.15.60:0/4107925026 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab00054f90 0x7fab00057450 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fab1800d000 tx=0x7fab18007cf0).stop 2020-10-31T22:46:11.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.627+0000 7fab25f72700 1 -- 172.21.15.60:0/4107925026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab200af520 msgr2=0x7fab20149140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:11.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.627+0000 7fab25f72700 1 --2- 172.21.15.60:0/4107925026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab200af520 0x7fab20149140 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7fab1400c000 tx=0x7fab14006dc0).stop 2020-10-31T22:46:11.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.627+0000 7fab25f72700 1 -- 172.21.15.60:0/4107925026 shutdown_connections 2020-10-31T22:46:11.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.627+0000 7fab25f72700 1 --2- 172.21.15.60:0/4107925026 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab20146550 0x7fab20149630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.627+0000 7fab25f72700 1 --2- 172.21.15.60:0/4107925026 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab00054f90 0x7fab00057450 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.627+0000 7fab25f72700 1 --2- 172.21.15.60:0/4107925026 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab200ac870 0x7fab20147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.627+0000 7fab25f72700 1 --2- 172.21.15.60:0/4107925026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab200af520 0x7fab20149140 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.627+0000 7fab25f72700 1 -- 172.21.15.60:0/4107925026 >> 172.21.15.60:0/4107925026 conn(0x7fab200b3fd0 msgr2=0x7fab200b3130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:11.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.627+0000 7fab25f72700 1 -- 172.21.15.60:0/4107925026 shutdown_connections 2020-10-31T22:46:11.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.627+0000 7fab25f72700 1 -- 172.21.15.60:0/4107925026 wait complete. 2020-10-31T22:46:11.630 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 24 2020-10-31T22:46:11.644 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:46:11.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175d746700 1 Processor -- start 2020-10-31T22:46:11.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175d746700 1 -- start start 2020-10-31T22:46:11.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175d746700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f17580a7580 0x7f17581423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:11.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175d746700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f17580ae970 0x7f17581428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:11.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175d746700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17580ac3f0 con 0x7f17580ac010 2020-10-31T22:46:11.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175d746700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1758145e50 con 0x7f17580ae970 2020-10-31T22:46:11.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175d746700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1758065e50 con 0x7f17580a7580 2020-10-31T22:46:11.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175cf45700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f17580ae970 0x7f17581428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:11.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175cf45700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f17580ae970 0x7f17581428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44494/0 (socket says 172.21.15.60:44494) 2020-10-31T22:46:11.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175cf45700 1 -- 172.21.15.60:0/464107745 learned_addr learned my addr 172.21.15.60:0/464107745 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:11.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f17577fe700 1 --2- 172.21.15.60:0/464107745 >> v2:172.21.15.66:3300/0 conn(0x7f17580a7580 0x7f17581423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:11.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175cf45700 1 -- 172.21.15.60:0/464107745 >> v2:172.21.15.66:3300/0 conn(0x7f17580a7580 msgr2=0x7f17581423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:11.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175cf45700 1 --2- 172.21.15.60:0/464107745 >> v2:172.21.15.66:3300/0 conn(0x7f17580a7580 0x7f17581423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175cf45700 1 -- 172.21.15.60:0/464107745 >> v1:172.21.15.66:6789/0 conn(0x7f17580ac010 legacy=0x7f17580662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:11.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175cf45700 1 -- 172.21.15.60:0/464107745 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758145b50 con 0x7f17580ae970 2020-10-31T22:46:11.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175cf45700 1 --2- 172.21.15.60:0/464107745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17580ae970 0x7f17581428a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f1750002f30 tx=0x7f1750006e80).ready entity=mon.0 client_cookie=17afaab23d21090c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:11.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f1756ffd700 1 -- 172.21.15.60:0/464107745 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17500097f0 con 0x7f17580ae970 2020-10-31T22:46:11.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f1756ffd700 1 -- 172.21.15.60:0/464107745 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1750009950 con 0x7f17580ae970 2020-10-31T22:46:11.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f1756ffd700 1 -- 172.21.15.60:0/464107745 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1750009cb0 con 0x7f17580ae970 2020-10-31T22:46:11.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175d746700 1 -- 172.21.15.60:0/464107745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17580ae970 msgr2=0x7f17581428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:11.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.811+0000 7f175d746700 1 --2- 172.21.15.60:0/464107745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17580ae970 0x7f17581428a0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f1750002f30 tx=0x7f1750006e80).stop 2020-10-31T22:46:11.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 -- 172.21.15.60:0/464107745 shutdown_connections 2020-10-31T22:46:11.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 --2- 172.21.15.60:0/464107745 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17580ae970 0x7f17581428a0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 --2- 172.21.15.60:0/464107745 >> v2:172.21.15.66:3300/0 conn(0x7f17580a7580 0x7f17581423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 -- 172.21.15.60:0/464107745 >> 172.21.15.60:0/464107745 conn(0x7f17580b3fd0 msgr2=0x7f17580b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:11.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 -- 172.21.15.60:0/464107745 shutdown_connections 2020-10-31T22:46:11.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 -- 172.21.15.60:0/464107745 wait complete. 2020-10-31T22:46:11.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 Processor -- start 2020-10-31T22:46:11.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 -- start start 2020-10-31T22:46:11.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17580a7580 0x7f1758141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:11.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17580ac010 0x7f17581426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:11.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17580ae970 0x7f17581541c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:11.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17580b3970 con 0x7f17580ac010 2020-10-31T22:46:11.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17580b2500 con 0x7f17580ae970 2020-10-31T22:46:11.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17580b3ba0 con 0x7f17580a7580 2020-10-31T22:46:11.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f17577fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17580ac010 0x7f17581426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:11.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f17577fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17580ac010 0x7f17581426e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44500/0 (socket says 172.21.15.60:44500) 2020-10-31T22:46:11.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f17577fe700 1 -- 172.21.15.60:0/3469175679 learned_addr learned my addr 172.21.15.60:0/3469175679 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:11.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f1757fff700 1 --2- 172.21.15.60:0/3469175679 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17580a7580 0x7f1758141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:11.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175cf45700 1 --2- 172.21.15.60:0/3469175679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17580ae970 0x7f17581541c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:11.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f17577fe700 1 -- 172.21.15.60:0/3469175679 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17580a7580 msgr2=0x7f1758141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:11.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f17577fe700 1 --2- 172.21.15.60:0/3469175679 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17580a7580 0x7f1758141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f17577fe700 1 -- 172.21.15.60:0/3469175679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17580ae970 msgr2=0x7f17581541c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:11.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f17577fe700 1 --2- 172.21.15.60:0/3469175679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17580ae970 0x7f17581541c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:11.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f17577fe700 1 -- 172.21.15.60:0/3469175679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1758144920 con 0x7f17580ac010 2020-10-31T22:46:11.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f17577fe700 1 --2- 172.21.15.60:0/3469175679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17580ac010 0x7f17581426e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f174000c000 tx=0x7f1740006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:11.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f17557fa700 1 -- 172.21.15.60:0/3469175679 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f174000ca10 con 0x7f17580ac010 2020-10-31T22:46:11.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f17557fa700 1 -- 172.21.15.60:0/3469175679 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174000cb70 con 0x7f17580ac010 2020-10-31T22:46:11.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 -- 172.21.15.60:0/3469175679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f175813d690 con 0x7f17580ac010 2020-10-31T22:46:11.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f17557fa700 1 -- 172.21.15.60:0/3469175679 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17400123f0 con 0x7f17580ac010 2020-10-31T22:46:11.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.815+0000 7f175d746700 1 -- 172.21.15.60:0/3469175679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1758142180 con 0x7f17580ac010 2020-10-31T22:46:11.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.819+0000 7f175d746700 1 -- 172.21.15.60:0/3469175679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17580b2670 con 0x7f17580ac010 2020-10-31T22:46:11.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.819+0000 7f17557fa700 1 -- 172.21.15.60:0/3469175679 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1740012550 con 0x7f17580ac010 2020-10-31T22:46:11.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.819+0000 7f17557fa700 1 --2- 172.21.15.60:0/3469175679 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f173c055020 0x7f173c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:11.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.819+0000 7f1757fff700 1 --2- 172.21.15.60:0/3469175679 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f173c055020 0x7f173c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:11.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.819+0000 7f17557fa700 1 -- 172.21.15.60:0/3469175679 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f174006dfe0 con 0x7f17580ac010 2020-10-31T22:46:11.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.819+0000 7f1757fff700 1 --2- 172.21.15.60:0/3469175679 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f173c055020 0x7f173c0574e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f174800b000 tx=0x7f1748009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:11.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:11.827+0000 7f17557fa700 1 -- 172.21.15.60:0/3469175679 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f17580b2670 con 0x7f17580ac010 2020-10-31T22:46:12.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.019+0000 7f175d746700 1 -- 172.21.15.60:0/3469175679 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f17580b2670 con 0x7f17580ac010 2020-10-31T22:46:12.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.287+0000 7f17557fa700 1 -- 172.21.15.60:0/3469175679 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f17580b2670 con 0x7f17580ac010 2020-10-31T22:46:12.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.291+0000 7f175d746700 1 -- 172.21.15.60:0/3469175679 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f173c055020 msgr2=0x7f173c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:12.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.291+0000 7f175d746700 1 --2- 172.21.15.60:0/3469175679 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f173c055020 0x7f173c0574e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f174800b000 tx=0x7f1748009040).stop 2020-10-31T22:46:12.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.291+0000 7f175d746700 1 -- 172.21.15.60:0/3469175679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17580ac010 msgr2=0x7f17581426e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:12.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.291+0000 7f175d746700 1 --2- 172.21.15.60:0/3469175679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17580ac010 0x7f17581426e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7f174000c000 tx=0x7f1740006dc0).stop 2020-10-31T22:46:12.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.291+0000 7f175d746700 1 -- 172.21.15.60:0/3469175679 shutdown_connections 2020-10-31T22:46:12.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.291+0000 7f175d746700 1 --2- 172.21.15.60:0/3469175679 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f173c055020 0x7f173c0574e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:12.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.291+0000 7f175d746700 1 --2- 172.21.15.60:0/3469175679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17580ae970 0x7f17581541c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:12.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.291+0000 7f175d746700 1 --2- 172.21.15.60:0/3469175679 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17580a7580 0x7f1758141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:12.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.291+0000 7f175d746700 1 --2- 172.21.15.60:0/3469175679 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f17580ac010 0x7f17581426e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:12.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.291+0000 7f175d746700 1 -- 172.21.15.60:0/3469175679 >> 172.21.15.60:0/3469175679 conn(0x7f17580b3fd0 msgr2=0x7f17581400c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:12.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.291+0000 7f175d746700 1 -- 172.21.15.60:0/3469175679 shutdown_connections 2020-10-31T22:46:12.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.291+0000 7f175d746700 1 -- 172.21.15.60:0/3469175679 wait complete. 2020-10-31T22:46:12.310 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:46:12.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.439+0000 7f3cbab78700 1 Processor -- start 2020-10-31T22:46:12.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.439+0000 7f3cbab78700 1 -- start start 2020-10-31T22:46:12.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cbab78700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3cb40b0b50 0x7f3cb40b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:12.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cbab78700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3cb4140f80 0x7f3cb41413d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:12.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cbab78700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cb40acd60 con 0x7f3cb40b5380 2020-10-31T22:46:12.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cbab78700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cb40ad650 con 0x7f3cb4140f80 2020-10-31T22:46:12.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cbab78700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40b5760 con 0x7f3cb40b0b50 2020-10-31T22:46:12.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cba377700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3cb4140f80 0x7f3cb41413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:12.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cb9375700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3cb40b0b50 0x7f3cb40b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:12.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cba377700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3cb4140f80 0x7f3cb41413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:55448/0 (socket says 172.21.15.60:55448) 2020-10-31T22:46:12.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cba377700 1 -- 172.21.15.60:0/2397852590 learned_addr learned my addr 172.21.15.60:0/2397852590 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:12.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cba377700 1 -- 172.21.15.60:0/2397852590 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3cb40b0b50 msgr2=0x7f3cb40b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:12.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cba377700 1 --2- 172.21.15.60:0/2397852590 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3cb40b0b50 0x7f3cb40b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:12.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cba377700 1 -- 172.21.15.60:0/2397852590 >> v1:172.21.15.66:6789/0 conn(0x7f3cb40b5380 legacy=0x7f3cb40ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:12.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cb8b74700 1 -- 172.21.15.60:0/2397852590 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388789753 0 0) 0x7f3cb40acd60 con 0x7f3cb40b5380 2020-10-31T22:46:12.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cba377700 1 -- 172.21.15.60:0/2397852590 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb40b14c0 con 0x7f3cb4140f80 2020-10-31T22:46:12.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cba377700 1 --2- 172.21.15.60:0/2397852590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb4140f80 0x7f3cb41413d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f3cac0032b0 tx=0x7f3cac00b510).ready entity=mon.1 client_cookie=e2c09c3e9ba4e04b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:12.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cb8b74700 1 -- 172.21.15.60:0/2397852590 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cac010660 con 0x7f3cb4140f80 2020-10-31T22:46:12.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cb8b74700 1 -- 172.21.15.60:0/2397852590 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac0107c0 con 0x7f3cb4140f80 2020-10-31T22:46:12.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cb8b74700 1 -- 172.21.15.60:0/2397852590 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3cac010b20 con 0x7f3cb4140f80 2020-10-31T22:46:12.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cbab78700 1 -- 172.21.15.60:0/2397852590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb4140f80 msgr2=0x7f3cb41413d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:12.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cbab78700 1 --2- 172.21.15.60:0/2397852590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb4140f80 0x7f3cb41413d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f3cac0032b0 tx=0x7f3cac00b510).stop 2020-10-31T22:46:12.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.443+0000 7f3cbab78700 1 -- 172.21.15.60:0/2397852590 shutdown_connections 2020-10-31T22:46:12.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cbab78700 1 --2- 172.21.15.60:0/2397852590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb4140f80 0x7f3cb41413d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:12.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cbab78700 1 --2- 172.21.15.60:0/2397852590 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3cb40b0b50 0x7f3cb40b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:12.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cbab78700 1 -- 172.21.15.60:0/2397852590 >> 172.21.15.60:0/2397852590 conn(0x7f3cb406a600 msgr2=0x7f3cb4060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:12.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cbab78700 1 -- 172.21.15.60:0/2397852590 shutdown_connections 2020-10-31T22:46:12.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cbab78700 1 -- 172.21.15.60:0/2397852590 wait complete. 2020-10-31T22:46:12.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cbab78700 1 Processor -- start 2020-10-31T22:46:12.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cbab78700 1 -- start start 2020-10-31T22:46:12.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cbab78700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3cb40b0b50 0x7f3cb405c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:12.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cbab78700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb40b5380 0x7f3cb4145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:12.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cbab78700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb4140f80 0x7f3cb4154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:12.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cbab78700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4143e70 con 0x7f3cb40b5380 2020-10-31T22:46:12.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cbab78700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb4145a20 con 0x7f3cb4140f80 2020-10-31T22:46:12.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cbab78700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40672e0 con 0x7f3cb40b0b50 2020-10-31T22:46:12.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cb9375700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb40b5380 0x7f3cb4145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:12.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cb9375700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb40b5380 0x7f3cb4145530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44516/0 (socket says 172.21.15.60:44516) 2020-10-31T22:46:12.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cb9375700 1 -- 172.21.15.60:0/664674055 learned_addr learned my addr 172.21.15.60:0/664674055 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:12.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cba377700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb4140f80 0x7f3cb4154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.447+0000 7f3cb9b76700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3cb40b0b50 0x7f3cb405c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3cb9375700 1 -- 172.21.15.60:0/664674055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3cb40b0b50 msgr2=0x7f3cb405c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3cb9375700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3cb40b0b50 0x7f3cb405c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3cb9375700 1 -- 172.21.15.60:0/664674055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb4140f80 msgr2=0x7f3cb4154380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:12.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3cb9375700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb4140f80 0x7f3cb4154380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3cb9375700 1 -- 172.21.15.60:0/664674055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb4145090 con 0x7f3cb40b5380 2020-10-31T22:46:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3cb9b76700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3cb40b0b50 0x7f3cb405c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3cba377700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb4140f80 0x7f3cb4154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3cb9375700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb40b5380 0x7f3cb4145530 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f3cb4145bb0 tx=0x7f3ca4006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3ca2ffd700 1 -- 172.21.15.60:0/664674055 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ca400cae0 con 0x7f3cb40b5380 2020-10-31T22:46:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3ca2ffd700 1 -- 172.21.15.60:0/664674055 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca400cc40 con 0x7f3cb40b5380 2020-10-31T22:46:12.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3ca2ffd700 1 -- 172.21.15.60:0/664674055 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ca40123f0 con 0x7f3cb40b5380 2020-10-31T22:46:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3cbab78700 1 -- 172.21.15.60:0/664674055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb40a8510 con 0x7f3cb40b5380 2020-10-31T22:46:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3cbab78700 1 -- 172.21.15.60:0/664674055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb4065750 con 0x7f3cb40b5380 2020-10-31T22:46:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3cbab78700 1 -- 172.21.15.60:0/664674055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb4067140 con 0x7f3cb40b5380 2020-10-31T22:46:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3ca2ffd700 1 -- 172.21.15.60:0/664674055 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3ca4012550 con 0x7f3cb40b5380 2020-10-31T22:46:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3ca2ffd700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c94054f90 0x7f3c94057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:12.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3cb9b76700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c94054f90 0x7f3c94057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:12.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.451+0000 7f3ca2ffd700 1 -- 172.21.15.60:0/664674055 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f3ca406e070 con 0x7f3cb40b5380 2020-10-31T22:46:12.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.455+0000 7f3cb9b76700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c94054f90 0x7f3c94057450 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f3cb000b000 tx=0x7f3cb0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:12.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.459+0000 7f3ca2ffd700 1 -- 172.21.15.60:0/664674055 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3cb4067140 con 0x7f3cb40b5380 2020-10-31T22:46:12.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:12.599+0000 7f3cbab78700 1 -- 172.21.15.60:0/664674055 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3cb4067140 con 0x7f3cb40b5380 2020-10-31T22:46:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.291+0000 7f3ca2ffd700 1 -- 172.21.15.60:0/664674055 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v56) v1 ==== 185+0+0 (secure 0 0 0) 0x7f3cb4067140 con 0x7f3cb40b5380 2020-10-31T22:46:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.299+0000 7f3cbab78700 1 -- 172.21.15.60:0/664674055 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c94054f90 msgr2=0x7f3c94057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.299+0000 7f3cbab78700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c94054f90 0x7f3c94057450 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f3cb000b000 tx=0x7f3cb0009040).stop 2020-10-31T22:46:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.299+0000 7f3cbab78700 1 -- 172.21.15.60:0/664674055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb40b5380 msgr2=0x7f3cb4145530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.299+0000 7f3cbab78700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb40b5380 0x7f3cb4145530 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7f3cb4145bb0 tx=0x7f3ca4006dc0).stop 2020-10-31T22:46:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.299+0000 7f3cbab78700 1 -- 172.21.15.60:0/664674055 shutdown_connections 2020-10-31T22:46:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.299+0000 7f3cbab78700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c94054f90 0x7f3c94057450 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.299+0000 7f3cbab78700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3cb4140f80 0x7f3cb4154380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.299+0000 7f3cbab78700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3cb40b0b50 0x7f3cb405c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.299+0000 7f3cbab78700 1 --2- 172.21.15.60:0/664674055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb40b5380 0x7f3cb4145530 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.299+0000 7f3cbab78700 1 -- 172.21.15.60:0/664674055 >> 172.21.15.60:0/664674055 conn(0x7f3cb406a600 msgr2=0x7f3cb4148440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:13.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.299+0000 7f3cbab78700 1 -- 172.21.15.60:0/664674055 shutdown_connections 2020-10-31T22:46:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.299+0000 7f3cbab78700 1 -- 172.21.15.60:0/664674055 wait complete. 2020-10-31T22:46:13.300 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:46:13.313 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-10-31T22:46:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.427+0000 7ff704e78700 1 Processor -- start 2020-10-31T22:46:13.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.427+0000 7ff704e78700 1 -- start start 2020-10-31T22:46:13.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.427+0000 7ff704e78700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7000b0880 0x7ff70013c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:13.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.427+0000 7ff704e78700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7000afbe0 con 0x7ff7000ae750 2020-10-31T22:46:13.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.427+0000 7ff704e78700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7000631f0 con 0x7ff700062e10 2020-10-31T22:46:13.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.427+0000 7ff704e78700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000afe10 con 0x7ff7000b0880 2020-10-31T22:46:13.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.427+0000 7ff6fdd9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff7000ae750 0x7ff70013b9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48660/0 (socket says 172.21.15.60:48660) 2020-10-31T22:46:13.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.427+0000 7ff6fdd9b700 1 -- 172.21.15.60:0/543568625 learned_addr learned my addr 172.21.15.60:0/543568625 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:13.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.427+0000 7ff6fed9d700 1 --2- 172.21.15.60:0/543568625 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7000b0880 0x7ff70013c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:13.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff6fd59a700 1 -- 172.21.15.60:0/543568625 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329179863 0 0) 0x7ff7000631f0 con 0x7ff700062e10 2020-10-31T22:46:13.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff6fd59a700 1 -- 172.21.15.60:0/543568625 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6e4003230 con 0x7ff700062e10 2020-10-31T22:46:13.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff6fd59a700 1 -- 172.21.15.60:0/543568625 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2101879985 0 0) 0x7ff7000afbe0 con 0x7ff7000ae750 2020-10-31T22:46:13.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff6fd59a700 1 -- 172.21.15.60:0/543568625 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7000631f0 con 0x7ff7000ae750 2020-10-31T22:46:13.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff6fed9d700 1 -- 172.21.15.60:0/543568625 >> v1:172.21.15.66:6789/0 conn(0x7ff700062e10 legacy=0x7ff7000b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:13.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff6fed9d700 1 -- 172.21.15.60:0/543568625 >> v1:172.21.15.60:6789/0 conn(0x7ff7000ae750 legacy=0x7ff70013b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:13.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff6fed9d700 1 -- 172.21.15.60:0/543568625 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7000ae010 con 0x7ff7000b0880 2020-10-31T22:46:13.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff6fed9d700 1 --2- 172.21.15.60:0/543568625 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7000b0880 0x7ff70013c0d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff6f8002f30 tx=0x7ff6f8006dc0).ready entity=mon.2 client_cookie=43749020257668e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:13.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff6fd59a700 1 -- 172.21.15.60:0/543568625 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f8009730 con 0x7ff7000b0880 2020-10-31T22:46:13.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff6fd59a700 1 -- 172.21.15.60:0/543568625 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f8009890 con 0x7ff7000b0880 2020-10-31T22:46:13.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff6fd59a700 1 -- 172.21.15.60:0/543568625 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f8009bf0 con 0x7ff7000b0880 2020-10-31T22:46:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff704e78700 1 -- 172.21.15.60:0/543568625 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7000b0880 msgr2=0x7ff70013c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff704e78700 1 --2- 172.21.15.60:0/543568625 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7000b0880 0x7ff70013c0d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff6f8002f30 tx=0x7ff6f8006dc0).stop 2020-10-31T22:46:13.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff704e78700 1 -- 172.21.15.60:0/543568625 shutdown_connections 2020-10-31T22:46:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff704e78700 1 --2- 172.21.15.60:0/543568625 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7000b0880 0x7ff70013c0d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff704e78700 1 -- 172.21.15.60:0/543568625 >> 172.21.15.60:0/543568625 conn(0x7ff70005fae0 msgr2=0x7ff70005fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:13.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff704e78700 1 -- 172.21.15.60:0/543568625 shutdown_connections 2020-10-31T22:46:13.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.431+0000 7ff704e78700 1 -- 172.21.15.60:0/543568625 wait complete. 2020-10-31T22:46:13.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff704e78700 1 Processor -- start 2020-10-31T22:46:13.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff704e78700 1 -- start start 2020-10-31T22:46:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff704e78700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff700062e10 0x7ff700151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff704e78700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7000ae750 0x7ff7001543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff704e78700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7000b0880 0x7ff7000a3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff704e78700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff70012b0a0 con 0x7ff7000b0880 2020-10-31T22:46:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff704e78700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000a3cd0 con 0x7ff7000ae750 2020-10-31T22:46:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff704e78700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7000ad0c0 con 0x7ff700062e10 2020-10-31T22:46:13.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6fed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7000b0880 0x7ff7000a3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6fed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7000b0880 0x7ff7000a3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44532/0 (socket says 172.21.15.60:44532) 2020-10-31T22:46:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6fed9d700 1 -- 172.21.15.60:0/1110303918 learned_addr learned my addr 172.21.15.60:0/1110303918 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6fe59c700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff700062e10 0x7ff700151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6fdd9b700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7000ae750 0x7ff7001543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6fed9d700 1 -- 172.21.15.60:0/1110303918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff700062e10 msgr2=0x7ff700151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:13.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6fed9d700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff700062e10 0x7ff700151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6fed9d700 1 -- 172.21.15.60:0/1110303918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7000ae750 msgr2=0x7ff7001543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6fed9d700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7000ae750 0x7ff7001543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6fed9d700 1 -- 172.21.15.60:0/1110303918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff700154b80 con 0x7ff7000b0880 2020-10-31T22:46:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6fdd9b700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7000ae750 0x7ff7001543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6fed9d700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7000b0880 0x7ff7000a3310 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7ff6f8002f30 tx=0x7ff6f8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6ef7fe700 1 -- 172.21.15.60:0/1110303918 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f8011bb0 con 0x7ff7000b0880 2020-10-31T22:46:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6ef7fe700 1 -- 172.21.15.60:0/1110303918 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f8011d10 con 0x7ff7000b0880 2020-10-31T22:46:13.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff704e78700 1 -- 172.21.15.60:0/1110303918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff700154e20 con 0x7ff7000b0880 2020-10-31T22:46:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff6ef7fe700 1 -- 172.21.15.60:0/1110303918 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6f801d640 con 0x7ff7000b0880 2020-10-31T22:46:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.435+0000 7ff704e78700 1 -- 172.21.15.60:0/1110303918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7001548a0 con 0x7ff7000b0880 2020-10-31T22:46:13.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.439+0000 7ff704e78700 1 -- 172.21.15.60:0/1110303918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7000a3030 con 0x7ff7000b0880 2020-10-31T22:46:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.439+0000 7ff6ef7fe700 1 -- 172.21.15.60:0/1110303918 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff6f8024030 con 0x7ff7000b0880 2020-10-31T22:46:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.439+0000 7ff6ef7fe700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff6dc0550c0 0x7ff6dc057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.439+0000 7ff6ef7fe700 1 -- 172.21.15.60:0/1110303918 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 5721+0+0 (secure 0 0 0) 0x7ff6f806ea40 con 0x7ff7000b0880 2020-10-31T22:46:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.439+0000 7ff6fe59c700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff6dc0550c0 0x7ff6dc057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:13.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.439+0000 7ff6fe59c700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff6dc0550c0 0x7ff6dc057580 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7ff6f000d000 tx=0x7ff6f0000f00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:13.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.451+0000 7ff6ef7fe700 1 -- 172.21.15.60:0/1110303918 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff6f8045020 con 0x7ff7000b0880 2020-10-31T22:46:13.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:13.591+0000 7ff704e78700 1 -- 172.21.15.60:0/1110303918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff700057100 con 0x7ff7000b0880 2020-10-31T22:46:14.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.303+0000 7ff6ef7fe700 1 -- 172.21.15.60:0/1110303918 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v57) v1 ==== 173+0+0 (secure 0 0 0) 0x7ff6f8022070 con 0x7ff7000b0880 2020-10-31T22:46:14.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.315+0000 7ff704e78700 1 -- 172.21.15.60:0/1110303918 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff6dc0550c0 msgr2=0x7ff6dc057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:14.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.315+0000 7ff704e78700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff6dc0550c0 0x7ff6dc057580 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7ff6f000d000 tx=0x7ff6f0000f00).stop 2020-10-31T22:46:14.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.315+0000 7ff704e78700 1 -- 172.21.15.60:0/1110303918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7000b0880 msgr2=0x7ff7000a3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:14.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.315+0000 7ff704e78700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7000b0880 0x7ff7000a3310 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7ff6f8002f30 tx=0x7ff6f8015000).stop 2020-10-31T22:46:14.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.315+0000 7ff704e78700 1 -- 172.21.15.60:0/1110303918 shutdown_connections 2020-10-31T22:46:14.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.315+0000 7ff704e78700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7000b0880 0x7ff7000a3310 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:14.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.315+0000 7ff704e78700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff700062e10 0x7ff700151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:14.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.315+0000 7ff704e78700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff6dc0550c0 0x7ff6dc057580 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:14.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.315+0000 7ff704e78700 1 --2- 172.21.15.60:0/1110303918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7000ae750 0x7ff7001543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:14.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.315+0000 7ff704e78700 1 -- 172.21.15.60:0/1110303918 >> 172.21.15.60:0/1110303918 conn(0x7ff70005fae0 msgr2=0x7ff700139810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:14.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.315+0000 7ff704e78700 1 -- 172.21.15.60:0/1110303918 shutdown_connections 2020-10-31T22:46:14.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.315+0000 7ff704e78700 1 -- 172.21.15.60:0/1110303918 wait complete. 2020-10-31T22:46:14.316 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2020-10-31T22:46:14.331 INFO:tasks.ceph.mds.a:Restarting daemon 2020-10-31T22:46:14.331 INFO:tasks.ceph.mds.a:Stopping old one... 2020-10-31T22:46:14.331 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-10-31T22:46:14.331 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:46:14.332 INFO:tasks.ceph.mds.c:Restarting daemon 2020-10-31T22:46:14.332 INFO:tasks.ceph.mds.c:Stopping old one... 2020-10-31T22:46:14.332 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-10-31T22:46:14.332 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:46:14.333 INFO:tasks.ceph.mds.b:Restarting daemon 2020-10-31T22:46:14.333 INFO:tasks.ceph.mds.b:Stopping old one... 2020-10-31T22:46:14.333 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-10-31T22:46:14.333 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:46:14.340 INFO:tasks.ceph.mds.a:Stopped 2020-10-31T22:46:14.340 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-10-31T22:46:14.342 INFO:tasks.ceph.mds.c:Stopped 2020-10-31T22:46:14.342 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-10-31T22:46:14.345 INFO:tasks.ceph.mds.b:Stopped 2020-10-31T22:46:14.345 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-10-31T22:46:14.386 INFO:tasks.ceph.mds.a:Started 2020-10-31T22:46:14.387 DEBUG:teuthology.parallel:result is None 2020-10-31T22:46:14.388 INFO:tasks.ceph.mds.c:Started 2020-10-31T22:46:14.388 DEBUG:teuthology.parallel:result is None 2020-10-31T22:46:14.390 INFO:tasks.ceph.mds.b:Started 2020-10-31T22:46:14.391 DEBUG:teuthology.parallel:result is None 2020-10-31T22:46:14.391 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-10-31T22:46:14.463 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:46:14.463 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:46:14.475 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:46:14.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.503+0000 7f29774e3700 1 Processor -- start 2020-10-31T22:46:14.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.503+0000 7f29774e3700 1 -- start start 2020-10-31T22:46:14.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.507+0000 7f29774e3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29700631c0 0x7f29700b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:14.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.507+0000 7f29774e3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f29700ae740 0x7f29700ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:14.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.507+0000 7f29774e3700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29700b15e0 con 0x7f29700a9130 2020-10-31T22:46:14.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.507+0000 7f29774e3700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29700635a0 con 0x7f29700ae740 2020-10-31T22:46:14.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.507+0000 7f29774e3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29700af2c0 con 0x7f29700631c0 2020-10-31T22:46:14.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.507+0000 7f2976ce2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f29700ae740 0x7f29700ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:14.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.507+0000 7f2976ce2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f29700ae740 0x7f29700ab860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:55506/0 (socket says 172.21.15.60:55506) 2020-10-31T22:46:14.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.507+0000 7f2976ce2700 1 -- 172.21.15.60:0/1313964874 learned_addr learned my addr 172.21.15.60:0/1313964874 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:14.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.507+0000 7f29764e1700 1 --2- 172.21.15.60:0/1313964874 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29700631c0 0x7f29700b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:14.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.507+0000 7f2976ce2700 1 -- 172.21.15.60:0/1313964874 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29700631c0 msgr2=0x7f29700b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:14.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.507+0000 7f2976ce2700 1 --2- 172.21.15.60:0/1313964874 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29700631c0 0x7f29700b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:14.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.507+0000 7f2976ce2700 1 -- 172.21.15.60:0/1313964874 >> v1:172.21.15.66:6789/0 conn(0x7f29700a9130 legacy=0x7f2970143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:14.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.507+0000 7f2976ce2700 1 -- 172.21.15.60:0/1313964874 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29700af560 con 0x7f29700ae740 2020-10-31T22:46:14.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.507+0000 7f2976ce2700 1 --2- 172.21.15.60:0/1313964874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29700ae740 0x7f29700ab860 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f29680032b0 tx=0x7f2968009270).ready entity=mon.1 client_cookie=342956103afe0b13 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:14.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.511+0000 7f29754df700 1 -- 172.21.15.60:0/1313964874 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2968009e60 con 0x7f29700ae740 2020-10-31T22:46:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.511+0000 7f29754df700 1 -- 172.21.15.60:0/1313964874 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296800bc00 con 0x7f29700ae740 2020-10-31T22:46:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.511+0000 7f29754df700 1 -- 172.21.15.60:0/1313964874 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f296800bd70 con 0x7f29700ae740 2020-10-31T22:46:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.515+0000 7f29774e3700 1 -- 172.21.15.60:0/1313964874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29700ae740 msgr2=0x7f29700ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:14.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.515+0000 7f29774e3700 1 --2- 172.21.15.60:0/1313964874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29700ae740 0x7f29700ab860 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f29680032b0 tx=0x7f2968009270).stop 2020-10-31T22:46:14.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.515+0000 7f29774e3700 1 -- 172.21.15.60:0/1313964874 shutdown_connections 2020-10-31T22:46:14.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.515+0000 7f29774e3700 1 --2- 172.21.15.60:0/1313964874 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29700ae740 0x7f29700ab860 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:14.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.515+0000 7f29774e3700 1 --2- 172.21.15.60:0/1313964874 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29700631c0 0x7f29700b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:14.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.515+0000 7f29774e3700 1 -- 172.21.15.60:0/1313964874 >> 172.21.15.60:0/1313964874 conn(0x7f297006a600 msgr2=0x7f2970060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:14.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.515+0000 7f29774e3700 1 -- 172.21.15.60:0/1313964874 shutdown_connections 2020-10-31T22:46:14.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.515+0000 7f29774e3700 1 -- 172.21.15.60:0/1313964874 wait complete. 2020-10-31T22:46:14.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.515+0000 7f29774e3700 1 Processor -- start 2020-10-31T22:46:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.515+0000 7f29774e3700 1 -- start start 2020-10-31T22:46:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29774e3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29700631c0 0x7f29701467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:14.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29774e3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29700a9130 0x7f2970152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:14.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29774e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29700ae740 0x7f2970152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:14.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29774e3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2970066370 con 0x7f29700ae740 2020-10-31T22:46:14.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29774e3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2970152df0 con 0x7f29700a9130 2020-10-31T22:46:14.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29774e3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2970066920 con 0x7f29700631c0 2020-10-31T22:46:14.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29764e1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29700631c0 0x7f29701467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:14.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29764e1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29700631c0 0x7f29701467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:57760/0 (socket says 172.21.15.60:57760) 2020-10-31T22:46:14.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29764e1700 1 -- 172.21.15.60:0/940800360 learned_addr learned my addr 172.21.15.60:0/940800360 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:14.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f2975ce0700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29700a9130 0x7f2970152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:14.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29764e1700 1 -- 172.21.15.60:0/940800360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29700a9130 msgr2=0x7f2970152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:14.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f2976ce2700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29700ae740 0x7f2970152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:14.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29764e1700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29700a9130 0x7f2970152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:14.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29764e1700 1 -- 172.21.15.60:0/940800360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29700ae740 msgr2=0x7f2970152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:14.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29764e1700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29700ae740 0x7f2970152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:14.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29764e1700 1 -- 172.21.15.60:0/940800360 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2970151eb0 con 0x7f29700631c0 2020-10-31T22:46:14.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f2975ce0700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29700a9130 0x7f2970152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:46:14.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f2976ce2700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29700ae740 0x7f2970152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:46:14.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29764e1700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29700631c0 0x7f29701467f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f296c00c000 tx=0x7f296c006dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:14.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f295f7fe700 1 -- 172.21.15.60:0/940800360 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f296c00ca10 con 0x7f29700631c0 2020-10-31T22:46:14.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f295f7fe700 1 -- 172.21.15.60:0/940800360 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f296c00cb70 con 0x7f29700631c0 2020-10-31T22:46:14.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29774e3700 1 -- 172.21.15.60:0/940800360 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29700660d0 con 0x7f29700631c0 2020-10-31T22:46:14.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f295f7fe700 1 -- 172.21.15.60:0/940800360 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f296c0123f0 con 0x7f29700631c0 2020-10-31T22:46:14.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29774e3700 1 -- 172.21.15.60:0/940800360 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2970067440 con 0x7f29700631c0 2020-10-31T22:46:14.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.519+0000 7f29774e3700 1 -- 172.21.15.60:0/940800360 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2970057100 con 0x7f29700631c0 2020-10-31T22:46:14.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.523+0000 7f295f7fe700 1 -- 172.21.15.60:0/940800360 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f296c012550 con 0x7f29700631c0 2020-10-31T22:46:14.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.523+0000 7f295f7fe700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2950054f10 0x7f29500573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:14.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.523+0000 7f295f7fe700 1 -- 172.21.15.60:0/940800360 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f296c06dbf0 con 0x7f29700631c0 2020-10-31T22:46:14.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.523+0000 7f2975ce0700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2950054f10 0x7f29500573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:14.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.523+0000 7f2975ce0700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2950054f10 0x7f29500573d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f296000d000 tx=0x7f2960009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.531+0000 7f295f7fe700 1 -- 172.21.15.60:0/940800360 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f296c0442f0 con 0x7f29700631c0 2020-10-31T22:46:14.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:14.683+0000 7f29774e3700 1 -- 172.21.15.60:0/940800360 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f297005ed50 con 0x7f29700631c0 2020-10-31T22:46:14.911 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:46:14.913 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:46:14.916 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:46:14.918 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:46:15.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.519+0000 7f295f7fe700 1 -- 172.21.15.60:0/940800360 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v60) v1 ==== 97+0+0 (secure 0 0 0) 0x7f296c047910 con 0x7f29700631c0 2020-10-31T22:46:15.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.523+0000 7f29774e3700 1 -- 172.21.15.60:0/940800360 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2950054f10 msgr2=0x7f29500573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:15.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.523+0000 7f29774e3700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2950054f10 0x7f29500573d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f296000d000 tx=0x7f2960009040).stop 2020-10-31T22:46:15.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.523+0000 7f29774e3700 1 -- 172.21.15.60:0/940800360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29700631c0 msgr2=0x7f29701467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:15.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.523+0000 7f29774e3700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29700631c0 0x7f29701467f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f296c00c000 tx=0x7f296c006dc0).stop 2020-10-31T22:46:15.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.523+0000 7f29774e3700 1 -- 172.21.15.60:0/940800360 shutdown_connections 2020-10-31T22:46:15.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.523+0000 7f29774e3700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29700ae740 0x7f2970152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:15.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.523+0000 7f29774e3700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29700631c0 0x7f29701467f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:15.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.523+0000 7f29774e3700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2950054f10 0x7f29500573d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:15.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.523+0000 7f29774e3700 1 --2- 172.21.15.60:0/940800360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29700a9130 0x7f2970152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:15.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.523+0000 7f29774e3700 1 -- 172.21.15.60:0/940800360 >> 172.21.15.60:0/940800360 conn(0x7f297006a600 msgr2=0x7f29700b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:15.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.523+0000 7f29774e3700 1 -- 172.21.15.60:0/940800360 shutdown_connections 2020-10-31T22:46:15.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.523+0000 7f29774e3700 1 -- 172.21.15.60:0/940800360 wait complete. 2020-10-31T22:46:15.527 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blacklist entries 2020-10-31T22:46:15.542 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2020-10-31T22:46:15.543 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-10-31T22:46:15.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f8417fff700 1 Processor -- start 2020-10-31T22:46:15.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f8417fff700 1 -- start start 2020-10-31T22:46:15.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f8417fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84180a95e0 0x7f84180a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f8417fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f841805b440 0x7f841805b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f8417fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84180a75d0 con 0x7f8418066830 2020-10-31T22:46:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f8417fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841805afe0 con 0x7f841805b440 2020-10-31T22:46:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f8417fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84180a8e00 con 0x7f84180a95e0 2020-10-31T22:46:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f84167fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f841805b440 0x7f841805b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f84177fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8418066830 0x7f8418066c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48718/0 (socket says 172.21.15.60:48718) 2020-10-31T22:46:15.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f84177fe700 1 -- 172.21.15.60:0/2474601736 learned_addr learned my addr 172.21.15.60:0/2474601736 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:15.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f8416ffd700 1 --2- 172.21.15.60:0/2474601736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84180a95e0 0x7f84180a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:15.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f84167fc700 1 -- 172.21.15.60:0/2474601736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84180a95e0 msgr2=0x7f84180a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:15.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f84167fc700 1 --2- 172.21.15.60:0/2474601736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84180a95e0 0x7f84180a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:15.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f84167fc700 1 -- 172.21.15.60:0/2474601736 >> v1:172.21.15.60:6789/0 conn(0x7f8418066830 legacy=0x7f8418066c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:15.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f84167fc700 1 -- 172.21.15.60:0/2474601736 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84180aeaf0 con 0x7f841805b440 2020-10-31T22:46:15.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f84167fc700 1 --2- 172.21.15.60:0/2474601736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841805b440 0x7f841805b8a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f8408002f30 tx=0x7f8408006dc0).ready entity=mon.0 client_cookie=2e5b52722196ddcd server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f8415ffb700 1 -- 172.21.15.60:0/2474601736 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f84080097f0 con 0x7f841805b440 2020-10-31T22:46:15.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f8415ffb700 1 -- 172.21.15.60:0/2474601736 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8408009950 con 0x7f841805b440 2020-10-31T22:46:15.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f8415ffb700 1 -- 172.21.15.60:0/2474601736 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8408009cb0 con 0x7f841805b440 2020-10-31T22:46:15.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f8417fff700 1 -- 172.21.15.60:0/2474601736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841805b440 msgr2=0x7f841805b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:15.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.663+0000 7f8417fff700 1 --2- 172.21.15.60:0/2474601736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841805b440 0x7f841805b8a0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f8408002f30 tx=0x7f8408006dc0).stop 2020-10-31T22:46:15.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8417fff700 1 -- 172.21.15.60:0/2474601736 shutdown_connections 2020-10-31T22:46:15.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8417fff700 1 --2- 172.21.15.60:0/2474601736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84180a95e0 0x7f84180a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:15.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8417fff700 1 --2- 172.21.15.60:0/2474601736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f841805b440 0x7f841805b8a0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:15.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8417fff700 1 -- 172.21.15.60:0/2474601736 >> 172.21.15.60:0/2474601736 conn(0x7f84180b3fd0 msgr2=0x7f84180b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:15.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8417fff700 1 -- 172.21.15.60:0/2474601736 shutdown_connections 2020-10-31T22:46:15.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8417fff700 1 -- 172.21.15.60:0/2474601736 wait complete. 2020-10-31T22:46:15.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8417fff700 1 Processor -- start 2020-10-31T22:46:15.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8417fff700 1 -- start start 2020-10-31T22:46:15.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8417fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f841805b440 0x7f8418142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:15.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8417fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8418066830 0x7f841813ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:15.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8417fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84180a95e0 0x7f8418144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:15.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8417fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8418061bd0 con 0x7f8418066830 2020-10-31T22:46:15.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8417fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8418061e70 con 0x7f841805b440 2020-10-31T22:46:15.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8417fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8418062110 con 0x7f84180a95e0 2020-10-31T22:46:15.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f84167fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8418066830 0x7f841813ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:15.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f84167fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8418066830 0x7f841813ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44588/0 (socket says 172.21.15.60:44588) 2020-10-31T22:46:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f84167fc700 1 -- 172.21.15.60:0/3271600953 learned_addr learned my addr 172.21.15.60:0/3271600953 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f84177fe700 1 --2- 172.21.15.60:0/3271600953 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84180a95e0 0x7f8418144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.667+0000 7f8416ffd700 1 --2- 172.21.15.60:0/3271600953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f841805b440 0x7f8418142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f84167fc700 1 -- 172.21.15.60:0/3271600953 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84180a95e0 msgr2=0x7f8418144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f84167fc700 1 --2- 172.21.15.60:0/3271600953 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84180a95e0 0x7f8418144780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f84167fc700 1 -- 172.21.15.60:0/3271600953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f841805b440 msgr2=0x7f8418142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:15.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f84167fc700 1 --2- 172.21.15.60:0/3271600953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f841805b440 0x7f8418142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:15.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f84167fc700 1 -- 172.21.15.60:0/3271600953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84181442e0 con 0x7f8418066830 2020-10-31T22:46:15.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f84167fc700 1 --2- 172.21.15.60:0/3271600953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8418066830 0x7f841813ce30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f8408002f30 tx=0x7f8408015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:15.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f840ffff700 1 -- 172.21.15.60:0/3271600953 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8408011b40 con 0x7f8418066830 2020-10-31T22:46:15.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f840ffff700 1 -- 172.21.15.60:0/3271600953 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8408011ca0 con 0x7f8418066830 2020-10-31T22:46:15.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f8417fff700 1 -- 172.21.15.60:0/3271600953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8418063f70 con 0x7f8418066830 2020-10-31T22:46:15.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f840ffff700 1 -- 172.21.15.60:0/3271600953 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f840801d450 con 0x7f8418066830 2020-10-31T22:46:15.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f8417fff700 1 -- 172.21.15.60:0/3271600953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84180617a0 con 0x7f8418066830 2020-10-31T22:46:15.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f8417fff700 1 -- 172.21.15.60:0/3271600953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8418144470 con 0x7f8418066830 2020-10-31T22:46:15.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f840ffff700 1 -- 172.21.15.60:0/3271600953 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8408024030 con 0x7f8418066830 2020-10-31T22:46:15.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f840ffff700 1 --2- 172.21.15.60:0/3271600953 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f83fc054f10 0x7f83fc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:15.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f840ffff700 1 -- 172.21.15.60:0/3271600953 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f840806e780 con 0x7f8418066830 2020-10-31T22:46:15.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.671+0000 7f8416ffd700 1 --2- 172.21.15.60:0/3271600953 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f83fc054f10 0x7f83fc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:15.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.675+0000 7f8416ffd700 1 --2- 172.21.15.60:0/3271600953 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f83fc054f10 0x7f83fc0573d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f840000c000 tx=0x7f8400008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:15.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.679+0000 7f840ffff700 1 -- 172.21.15.60:0/3271600953 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8408044fd0 con 0x7f8418066830 2020-10-31T22:46:15.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.867+0000 7f8417fff700 1 -- 172.21.15.60:0/3271600953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8418057100 con 0x7f8418066830 2020-10-31T22:46:15.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.871+0000 7f840ffff700 1 -- 172.21.15.60:0/3271600953 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f8408022070 con 0x7f8418066830 2020-10-31T22:46:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:15.870 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:46:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2020-10-31T22:46:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2020-10-31T22:46:15.870 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f7D/cFRAAHQ9NU7VSs14mi5sC/GwHng==", 2020-10-31T22:46:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:46:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:46:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:46:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:46:15.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2020-10-31T22:46:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f5SPjJBAAVjFv2PdBZ7j94etJrAT0tA==", 2020-10-31T22:46:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:46:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:46:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:46:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:46:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2020-10-31T22:46:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKpdoHhAAhhlaYqOQoI6tTKexjRpbGA==", 2020-10-31T22:46:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:46:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:46:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:46:15.874 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:46:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2020-10-31T22:46:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDR551f7MwsMRAACZIQlAKm3BdVbDs2gQAfxg==", 2020-10-31T22:46:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:46:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:46:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:46:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2020-10-31T22:46:15.876 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDU551f07HQFxAAokMFXwsbgKGtJNpnKerdGg==", 2020-10-31T22:46:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:46:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:46:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:46:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2020-10-31T22:46:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDW551fODyjOhAAJ+j8KITJidSpltSiJaQZGw==", 2020-10-31T22:46:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:46:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:46:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:46:15.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2020-10-31T22:46:15.879 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDZ551fs+aCIhAAwpbmgGQjU05W3hZofTtHdg==", 2020-10-31T22:46:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:46:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:46:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:46:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2020-10-31T22:46:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDe551fI5nIMxAAwwNSHQYDPS6G2achKIpwqg==", 2020-10-31T22:46:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:46:15.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:46:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:46:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2020-10-31T22:46:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDh551f68p2GhAAhlGpZLPg8RqouzStqN4tFw==", 2020-10-31T22:46:15.882 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:46:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:46:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:46:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.883 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2020-10-31T22:46:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDk551fUi3kARAAsXPU7HEhqax8Go00CqgdNw==", 2020-10-31T22:46:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:46:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:46:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:46:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2020-10-31T22:46:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDm551fKh4aJRAAj+whV4kueCu2Og7wZ05tNw==", 2020-10-31T22:46:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:46:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:46:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:46:15.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2020-10-31T22:46:15.886 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551flXvBJxAAtD4URDL2NV0zyAympufvVA==", 2020-10-31T22:46:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:46:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:46:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:46:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.887 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2020-10-31T22:46:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fQ/OGKhAA/xGrRlUW52pP6E6SWXYAGA==", 2020-10-31T22:46:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:46:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:46:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:46:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2020-10-31T22:46:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDP551fITgCMxAAQy5CQzqda1YjdUtTRxbsPQ==", 2020-10-31T22:46:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:46:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:46:15.889 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:46:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:46:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2020-10-31T22:46:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551feZUgExAAvGt2fUb5GhkkFQ0dbgP5nw==", 2020-10-31T22:46:15.890 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:46:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:46:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:46:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2020-10-31T22:46:15.891 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKiN5EBAAhHtXXE4+yydXWOK7agZ14g==", 2020-10-31T22:46:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:46:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:46:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:46:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:46:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:15.892 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:15.893 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:46:15.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.871+0000 7f8417fff700 1 -- 172.21.15.60:0/3271600953 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f83fc054f10 msgr2=0x7f83fc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:15.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.871+0000 7f8417fff700 1 --2- 172.21.15.60:0/3271600953 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f83fc054f10 0x7f83fc0573d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f840000c000 tx=0x7f8400008040).stop 2020-10-31T22:46:15.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.871+0000 7f8417fff700 1 -- 172.21.15.60:0/3271600953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8418066830 msgr2=0x7f841813ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:15.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.871+0000 7f8417fff700 1 --2- 172.21.15.60:0/3271600953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8418066830 0x7f841813ce30 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f8408002f30 tx=0x7f8408015000).stop 2020-10-31T22:46:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.871+0000 7f8417fff700 1 -- 172.21.15.60:0/3271600953 shutdown_connections 2020-10-31T22:46:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.871+0000 7f8417fff700 1 --2- 172.21.15.60:0/3271600953 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84180a95e0 0x7f8418144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.871+0000 7f8417fff700 1 --2- 172.21.15.60:0/3271600953 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f83fc054f10 0x7f83fc0573d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.871+0000 7f8417fff700 1 --2- 172.21.15.60:0/3271600953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f841805b440 0x7f8418142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.871+0000 7f8417fff700 1 --2- 172.21.15.60:0/3271600953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8418066830 0x7f841813ce30 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.871+0000 7f8417fff700 1 -- 172.21.15.60:0/3271600953 >> 172.21.15.60:0/3271600953 conn(0x7f84180b3fd0 msgr2=0x7f84180af990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:15.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.871+0000 7f8417fff700 1 -- 172.21.15.60:0/3271600953 shutdown_connections 2020-10-31T22:46:15.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:15.871+0000 7f8417fff700 1 -- 172.21.15.60:0/3271600953 wait complete. 2020-10-31T22:46:15.896 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:46:16.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.011+0000 7f16539d8700 1 Processor -- start 2020-10-31T22:46:16.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.011+0000 7f16539d8700 1 -- start start 2020-10-31T22:46:16.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.011+0000 7f16539d8700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f164c062e10 0x7f164c0afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.011+0000 7f16539d8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f164c0b00d0 0x7f164c0af1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.011+0000 7f16539d8700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f164c0b04f0 con 0x7f164c05afe0 2020-10-31T22:46:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.011+0000 7f16539d8700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f164c0b1840 con 0x7f164c062e10 2020-10-31T22:46:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.011+0000 7f16539d8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0af6d0 con 0x7f164c0b00d0 2020-10-31T22:46:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.011+0000 7f1651774700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f164c062e10 0x7f164c0afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.011+0000 7f1651f75700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f164c0b00d0 0x7f164c0af1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.011+0000 7f1651774700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f164c062e10 0x7f164c0afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:55530/0 (socket says 172.21.15.60:55530) 2020-10-31T22:46:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.011+0000 7f1651f75700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f164c0b00d0 0x7f164c0af1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:57786/0 (socket says 172.21.15.60:57786) 2020-10-31T22:46:16.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.011+0000 7f1651774700 1 -- 172.21.15.60:0/3437112110 learned_addr learned my addr 172.21.15.60:0/3437112110 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:16.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.011+0000 7f1650f73700 1 --1- 172.21.15.60:0/3437112110 >> v1:172.21.15.66:6789/0 conn(0x7f164c05afe0 0x7f164c0aead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:46600/0 (socket says 172.21.15.60:46600) 2020-10-31T22:46:16.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f1651774700 1 -- 172.21.15.60:0/3437112110 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f164c0b00d0 msgr2=0x7f164c0af1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:16.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f1651774700 1 --2- 172.21.15.60:0/3437112110 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f164c0b00d0 0x7f164c0af1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f1651774700 1 -- 172.21.15.60:0/3437112110 >> v1:172.21.15.66:6789/0 conn(0x7f164c05afe0 legacy=0x7f164c0aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f1651774700 1 -- 172.21.15.60:0/3437112110 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c0631f0 con 0x7f164c062e10 2020-10-31T22:46:16.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f1651774700 1 --2- 172.21.15.60:0/3437112110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f164c062e10 0x7f164c0afbe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f1644002f30 tx=0x7f1644006e80).ready entity=mon.1 client_cookie=40d6567d6c38403c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:16.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f1643fff700 1 -- 172.21.15.60:0/3437112110 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f16440097f0 con 0x7f164c062e10 2020-10-31T22:46:16.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f1643fff700 1 -- 172.21.15.60:0/3437112110 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1644009950 con 0x7f164c062e10 2020-10-31T22:46:16.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f1643fff700 1 -- 172.21.15.60:0/3437112110 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1644009cb0 con 0x7f164c062e10 2020-10-31T22:46:16.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 -- 172.21.15.60:0/3437112110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f164c062e10 msgr2=0x7f164c0afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 --2- 172.21.15.60:0/3437112110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f164c062e10 0x7f164c0afbe0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f1644002f30 tx=0x7f1644006e80).stop 2020-10-31T22:46:16.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 -- 172.21.15.60:0/3437112110 shutdown_connections 2020-10-31T22:46:16.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 --2- 172.21.15.60:0/3437112110 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f164c0b00d0 0x7f164c0af1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 --2- 172.21.15.60:0/3437112110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f164c062e10 0x7f164c0afbe0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 -- 172.21.15.60:0/3437112110 >> 172.21.15.60:0/3437112110 conn(0x7f164c05fae0 msgr2=0x7f164c05fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:16.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 -- 172.21.15.60:0/3437112110 shutdown_connections 2020-10-31T22:46:16.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 -- 172.21.15.60:0/3437112110 wait complete. 2020-10-31T22:46:16.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 Processor -- start 2020-10-31T22:46:16.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 -- start start 2020-10-31T22:46:16.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f164c05afe0 0x7f164c148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f164c062e10 0x7f164c142310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0b00d0 0x7f164c142800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0b5630 con 0x7f164c0b00d0 2020-10-31T22:46:16.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164c0b5e50 con 0x7f164c05afe0 2020-10-31T22:46:16.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f16539d8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f164c151990 con 0x7f164c062e10 2020-10-31T22:46:16.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f1651f75700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0b00d0 0x7f164c142800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f1651f75700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0b00d0 0x7f164c142800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44602/0 (socket says 172.21.15.60:44602) 2020-10-31T22:46:16.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f1651f75700 1 -- 172.21.15.60:0/493355650 learned_addr learned my addr 172.21.15.60:0/493355650 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:16.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.015+0000 7f1651774700 1 --2- 172.21.15.60:0/493355650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f164c05afe0 0x7f164c148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f1650f73700 1 --2- 172.21.15.60:0/493355650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f164c062e10 0x7f164c142310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f1651f75700 1 -- 172.21.15.60:0/493355650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f164c062e10 msgr2=0x7f164c142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f1651f75700 1 --2- 172.21.15.60:0/493355650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f164c062e10 0x7f164c142310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f1651f75700 1 -- 172.21.15.60:0/493355650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f164c05afe0 msgr2=0x7f164c148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f1651f75700 1 --2- 172.21.15.60:0/493355650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f164c05afe0 0x7f164c148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f1651f75700 1 -- 172.21.15.60:0/493355650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c0b5390 con 0x7f164c0b00d0 2020-10-31T22:46:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f1651f75700 1 --2- 172.21.15.60:0/493355650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0b00d0 0x7f164c142800 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f163c006a50 tx=0x7f163c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f16427fc700 1 -- 172.21.15.60:0/493355650 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f163c00caa0 con 0x7f164c0b00d0 2020-10-31T22:46:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f16427fc700 1 -- 172.21.15.60:0/493355650 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c00cc00 con 0x7f164c0b00d0 2020-10-31T22:46:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f16427fc700 1 -- 172.21.15.60:0/493355650 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f163c0123f0 con 0x7f164c0b00d0 2020-10-31T22:46:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f16539d8700 1 -- 172.21.15.60:0/493355650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164c149430 con 0x7f164c0b00d0 2020-10-31T22:46:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f16539d8700 1 -- 172.21.15.60:0/493355650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164c142cf0 con 0x7f164c0b00d0 2020-10-31T22:46:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f16539d8700 1 -- 172.21.15.60:0/493355650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f164c1517d0 con 0x7f164c0b00d0 2020-10-31T22:46:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f16427fc700 1 -- 172.21.15.60:0/493355650 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f163c012550 con 0x7f164c0b00d0 2020-10-31T22:46:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f16427fc700 1 --2- 172.21.15.60:0/493355650 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f162c054f90 0x7f162c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f16427fc700 1 -- 172.21.15.60:0/493355650 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f163c06db90 con 0x7f164c0b00d0 2020-10-31T22:46:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f1651774700 1 --2- 172.21.15.60:0/493355650 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f162c054f90 0x7f162c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.019+0000 7f1651774700 1 --2- 172.21.15.60:0/493355650 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f162c054f90 0x7f162c057450 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f164401c000 tx=0x7f1644015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.027+0000 7f16427fc700 1 -- 172.21.15.60:0/493355650 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f163c044380 con 0x7f164c0b00d0 2020-10-31T22:46:16.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.175+0000 7f16539d8700 1 -- 172.21.15.60:0/493355650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f164c057100 con 0x7f164c0b00d0 2020-10-31T22:46:16.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.179+0000 7f16427fc700 1 -- 172.21.15.60:0/493355650 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+13182 (secure 0 0 0) 0x7f163c0479a0 con 0x7f164c0b00d0 2020-10-31T22:46:16.180 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:16.181 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":60,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:46:15.514824+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:46:16.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.179+0000 7f16539d8700 1 -- 172.21.15.60:0/493355650 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f162c054f90 msgr2=0x7f162c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.179+0000 7f16539d8700 1 --2- 172.21.15.60:0/493355650 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f162c054f90 0x7f162c057450 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f164401c000 tx=0x7f1644015000).stop 2020-10-31T22:46:16.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.179+0000 7f16539d8700 1 -- 172.21.15.60:0/493355650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0b00d0 msgr2=0x7f164c142800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.179+0000 7f16539d8700 1 --2- 172.21.15.60:0/493355650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0b00d0 0x7f164c142800 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f163c006a50 tx=0x7f163c006dc0).stop 2020-10-31T22:46:16.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.179+0000 7f16539d8700 1 -- 172.21.15.60:0/493355650 shutdown_connections 2020-10-31T22:46:16.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.179+0000 7f16539d8700 1 --2- 172.21.15.60:0/493355650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f164c0b00d0 0x7f164c142800 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.179+0000 7f16539d8700 1 --2- 172.21.15.60:0/493355650 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f162c054f90 0x7f162c057450 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.179+0000 7f16539d8700 1 --2- 172.21.15.60:0/493355650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f164c05afe0 0x7f164c148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.179+0000 7f16539d8700 1 --2- 172.21.15.60:0/493355650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f164c062e10 0x7f164c142310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.179+0000 7f16539d8700 1 -- 172.21.15.60:0/493355650 >> 172.21.15.60:0/493355650 conn(0x7f164c05fae0 msgr2=0x7f164c143f40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:16.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.179+0000 7f16539d8700 1 -- 172.21.15.60:0/493355650 shutdown_connections 2020-10-31T22:46:16.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.179+0000 7f16539d8700 1 -- 172.21.15.60:0/493355650 wait complete. 2020-10-31T22:46:16.192 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-31T22:46:16.194 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:46:16.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.311+0000 7f14cdc66700 1 Processor -- start 2020-10-31T22:46:16.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.311+0000 7f14cdc66700 1 -- start start 2020-10-31T22:46:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cdc66700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f14c80b5570 0x7f14c80b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cdc66700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14c80b24a0 0x7f14c8145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cdc66700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14c80b4440 con 0x7f14c8145e40 2020-10-31T22:46:16.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cdc66700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c813f930 con 0x7f14c80b5570 2020-10-31T22:46:16.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cdc66700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80b02f0 con 0x7f14c80b24a0 2020-10-31T22:46:16.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14ccc64700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f14c80b5570 0x7f14c80b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cd465700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f14c8145e40 0x7f14c8141f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48748/0 (socket says 172.21.15.60:48748) 2020-10-31T22:46:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cd465700 1 -- 172.21.15.60:0/898161973 learned_addr learned my addr 172.21.15.60:0/898161973 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:16.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14c7fff700 1 --2- 172.21.15.60:0/898161973 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14c80b24a0 0x7f14c8145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14ccc64700 1 -- 172.21.15.60:0/898161973 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14c80b24a0 msgr2=0x7f14c8145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:16.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14ccc64700 1 --2- 172.21.15.60:0/898161973 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14c80b24a0 0x7f14c8145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14ccc64700 1 -- 172.21.15.60:0/898161973 >> v1:172.21.15.60:6789/0 conn(0x7f14c8145e40 legacy=0x7f14c8141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14ccc64700 1 -- 172.21.15.60:0/898161973 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80b0590 con 0x7f14c80b5570 2020-10-31T22:46:16.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14ccc64700 1 --2- 172.21.15.60:0/898161973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c80b5570 0x7f14c80b5950 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f14c8141c20 tx=0x7f14b4006dc0).ready entity=mon.0 client_cookie=cc54793a4a771ad8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:16.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14c77fe700 1 -- 172.21.15.60:0/898161973 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14b4009720 con 0x7f14c80b5570 2020-10-31T22:46:16.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14c77fe700 1 -- 172.21.15.60:0/898161973 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b4009880 con 0x7f14c80b5570 2020-10-31T22:46:16.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14c77fe700 1 -- 172.21.15.60:0/898161973 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14b4009be0 con 0x7f14c80b5570 2020-10-31T22:46:16.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cdc66700 1 -- 172.21.15.60:0/898161973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c80b5570 msgr2=0x7f14c80b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cdc66700 1 --2- 172.21.15.60:0/898161973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c80b5570 0x7f14c80b5950 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f14c8141c20 tx=0x7f14b4006dc0).stop 2020-10-31T22:46:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cdc66700 1 -- 172.21.15.60:0/898161973 shutdown_connections 2020-10-31T22:46:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cdc66700 1 --2- 172.21.15.60:0/898161973 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c80b5570 0x7f14c80b5950 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cdc66700 1 --2- 172.21.15.60:0/898161973 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14c80b24a0 0x7f14c8145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cdc66700 1 -- 172.21.15.60:0/898161973 >> 172.21.15.60:0/898161973 conn(0x7f14c80b8e90 msgr2=0x7f14c80b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cdc66700 1 -- 172.21.15.60:0/898161973 shutdown_connections 2020-10-31T22:46:16.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.315+0000 7f14cdc66700 1 -- 172.21.15.60:0/898161973 wait complete. 2020-10-31T22:46:16.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14cdc66700 1 Processor -- start 2020-10-31T22:46:16.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14cdc66700 1 -- start start 2020-10-31T22:46:16.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14cdc66700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c80b24a0 0x7f14c8140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14cdc66700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14c80b5570 0x7f14c8150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14cdc66700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14c8145e40 0x7f14c8150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14cdc66700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c81514b0 con 0x7f14c80b24a0 2020-10-31T22:46:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14ccc64700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c80b24a0 0x7f14c8140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14cdc66700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8145200 con 0x7f14c8145e40 2020-10-31T22:46:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14cdc66700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80ae6f0 con 0x7f14c80b5570 2020-10-31T22:46:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14ccc64700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c80b24a0 0x7f14c8140d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44614/0 (socket says 172.21.15.60:44614) 2020-10-31T22:46:16.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14ccc64700 1 -- 172.21.15.60:0/3083654483 learned_addr learned my addr 172.21.15.60:0/3083654483 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:16.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14c7fff700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14c80b5570 0x7f14c8150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14cd465700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14c8145e40 0x7f14c8150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14ccc64700 1 -- 172.21.15.60:0/3083654483 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14c80b5570 msgr2=0x7f14c8150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14ccc64700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14c80b5570 0x7f14c8150ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14ccc64700 1 -- 172.21.15.60:0/3083654483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14c8145e40 msgr2=0x7f14c8150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14ccc64700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14c8145e40 0x7f14c8150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14ccc64700 1 -- 172.21.15.60:0/3083654483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80ae990 con 0x7f14c80b24a0 2020-10-31T22:46:16.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14cd465700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14c8145e40 0x7f14c8150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:16.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.319+0000 7f14c7fff700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14c80b5570 0x7f14c8150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:16.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.323+0000 7f14ccc64700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c80b24a0 0x7f14c8140d60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f14c8141c20 tx=0x7f14b4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:16.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.323+0000 7f14c5ffb700 1 -- 172.21.15.60:0/3083654483 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14b4011ce0 con 0x7f14c80b24a0 2020-10-31T22:46:16.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.323+0000 7f14c5ffb700 1 -- 172.21.15.60:0/3083654483 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b4011e40 con 0x7f14c80b24a0 2020-10-31T22:46:16.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.323+0000 7f14c5ffb700 1 -- 172.21.15.60:0/3083654483 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f14b401d640 con 0x7f14c80b24a0 2020-10-31T22:46:16.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.323+0000 7f14cdc66700 1 -- 172.21.15.60:0/3083654483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c80aec30 con 0x7f14c80b24a0 2020-10-31T22:46:16.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.323+0000 7f14cdc66700 1 -- 172.21.15.60:0/3083654483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c80af0d0 con 0x7f14c80b24a0 2020-10-31T22:46:16.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.323+0000 7f14cdc66700 1 -- 172.21.15.60:0/3083654483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c80aedc0 con 0x7f14c80b24a0 2020-10-31T22:46:16.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.323+0000 7f14c5ffb700 1 -- 172.21.15.60:0/3083654483 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f14b4024030 con 0x7f14c80b24a0 2020-10-31T22:46:16.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.323+0000 7f14c5ffb700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f14b0054f30 0x7f14b00573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.323+0000 7f14c5ffb700 1 -- 172.21.15.60:0/3083654483 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f14b406e8c0 con 0x7f14c80b24a0 2020-10-31T22:46:16.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.323+0000 7f14c7fff700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f14b0054f30 0x7f14b00573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.323+0000 7f14c7fff700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f14b0054f30 0x7f14b00573f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f14bc00b000 tx=0x7f14bc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:16.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.331+0000 7f14c5ffb700 1 -- 172.21.15.60:0/3083654483 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f14b4045110 con 0x7f14c80b24a0 2020-10-31T22:46:16.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.479+0000 7f14cdc66700 1 -- 172.21.15.60:0/3083654483 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f14c8057100 con 0x7f14c80b24a0 2020-10-31T22:46:16.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.479+0000 7f14c5ffb700 1 -- 172.21.15.60:0/3083654483 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v60) v1 ==== 110+0+10 (secure 0 0 0) 0x7f14b4022070 con 0x7f14c80b24a0 2020-10-31T22:46:16.479 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:46:16.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.479+0000 7f14cdc66700 1 -- 172.21.15.60:0/3083654483 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f14b0054f30 msgr2=0x7f14b00573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.479+0000 7f14cdc66700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f14b0054f30 0x7f14b00573f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7f14bc00b000 tx=0x7f14bc008040).stop 2020-10-31T22:46:16.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.479+0000 7f14cdc66700 1 -- 172.21.15.60:0/3083654483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c80b24a0 msgr2=0x7f14c8140d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.479+0000 7f14cdc66700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c80b24a0 0x7f14c8140d60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f14c8141c20 tx=0x7f14b4015000).stop 2020-10-31T22:46:16.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.479+0000 7f14cdc66700 1 -- 172.21.15.60:0/3083654483 shutdown_connections 2020-10-31T22:46:16.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.479+0000 7f14cdc66700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f14b0054f30 0x7f14b00573f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.479+0000 7f14cdc66700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14c8145e40 0x7f14c8150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.479+0000 7f14cdc66700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14c80b24a0 0x7f14c8140d60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.479+0000 7f14cdc66700 1 --2- 172.21.15.60:0/3083654483 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14c80b5570 0x7f14c8150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.479+0000 7f14cdc66700 1 -- 172.21.15.60:0/3083654483 >> 172.21.15.60:0/3083654483 conn(0x7f14c80b8e90 msgr2=0x7f14c8141e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:16.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.479+0000 7f14cdc66700 1 -- 172.21.15.60:0/3083654483 shutdown_connections 2020-10-31T22:46:16.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.479+0000 7f14cdc66700 1 -- 172.21.15.60:0/3083654483 wait complete. 2020-10-31T22:46:16.494 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:46:16.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.623+0000 7f433ffff700 1 Processor -- start 2020-10-31T22:46:16.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.623+0000 7f433ffff700 1 -- start start 2020-10-31T22:46:16.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43400a8140 0x7f43400ac020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433ffff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434013f630 con 0x7f43400b1d50 2020-10-31T22:46:16.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433ffff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43400b2130 con 0x7f434013bcc0 2020-10-31T22:46:16.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43400ae220 con 0x7f43400a8140 2020-10-31T22:46:16.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f43400b1d50 0x7f43400adb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48758/0 (socket says 172.21.15.60:48758) 2020-10-31T22:46:16.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433effd700 1 -- 172.21.15.60:0/363689417 learned_addr learned my addr 172.21.15.60:0/363689417 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:16.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433e7fc700 1 --2- 172.21.15.60:0/363689417 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43400a8140 0x7f43400ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433dffb700 1 -- 172.21.15.60:0/363689417 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 141173421 0 0) 0x7f434013f630 con 0x7f43400b1d50 2020-10-31T22:46:16.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433dffb700 1 -- 172.21.15.60:0/363689417 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4320003230 con 0x7f43400b1d50 2020-10-31T22:46:16.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433dffb700 1 -- 172.21.15.60:0/363689417 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888306304 0 0) 0x7f43400b2130 con 0x7f434013bcc0 2020-10-31T22:46:16.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433dffb700 1 -- 172.21.15.60:0/363689417 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f434013f630 con 0x7f434013bcc0 2020-10-31T22:46:16.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433e7fc700 1 -- 172.21.15.60:0/363689417 >> v1:172.21.15.66:6789/0 conn(0x7f434013bcc0 legacy=0x7f434013c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433e7fc700 1 -- 172.21.15.60:0/363689417 >> v1:172.21.15.60:6789/0 conn(0x7f43400b1d50 legacy=0x7f43400adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433e7fc700 1 -- 172.21.15.60:0/363689417 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434005c0f0 con 0x7f43400a8140 2020-10-31T22:46:16.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433e7fc700 1 --2- 172.21.15.60:0/363689417 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43400a8140 0x7f43400ac020 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4330002f30 tx=0x7f4330006dc0).ready entity=mon.2 client_cookie=b9f418cfa944680f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:16.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433dffb700 1 -- 172.21.15.60:0/363689417 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4330009730 con 0x7f43400a8140 2020-10-31T22:46:16.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433dffb700 1 -- 172.21.15.60:0/363689417 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4330009890 con 0x7f43400a8140 2020-10-31T22:46:16.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433dffb700 1 -- 172.21.15.60:0/363689417 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4330009bf0 con 0x7f43400a8140 2020-10-31T22:46:16.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433ffff700 1 -- 172.21.15.60:0/363689417 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43400a8140 msgr2=0x7f43400ac020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433ffff700 1 --2- 172.21.15.60:0/363689417 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43400a8140 0x7f43400ac020 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f4330002f30 tx=0x7f4330006dc0).stop 2020-10-31T22:46:16.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433ffff700 1 -- 172.21.15.60:0/363689417 shutdown_connections 2020-10-31T22:46:16.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433ffff700 1 --2- 172.21.15.60:0/363689417 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43400a8140 0x7f43400ac020 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433ffff700 1 -- 172.21.15.60:0/363689417 >> 172.21.15.60:0/363689417 conn(0x7f43400b5330 msgr2=0x7f43400b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:16.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433ffff700 1 -- 172.21.15.60:0/363689417 shutdown_connections 2020-10-31T22:46:16.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.627+0000 7f433ffff700 1 -- 172.21.15.60:0/363689417 wait complete. 2020-10-31T22:46:16.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433ffff700 1 Processor -- start 2020-10-31T22:46:16.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433ffff700 1 -- start start 2020-10-31T22:46:16.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43400a8140 0x7f43400af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43400b1d50 0x7f43400a9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433ffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f434013bcc0 0x7f43400aa180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43400a9280 con 0x7f43400a8140 2020-10-31T22:46:16.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433ffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f434005b160 con 0x7f434013bcc0 2020-10-31T22:46:16.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f434005b400 con 0x7f43400b1d50 2020-10-31T22:46:16.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43400a8140 0x7f43400af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43400a8140 0x7f43400af4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44628/0 (socket says 172.21.15.60:44628) 2020-10-31T22:46:16.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433effd700 1 -- 172.21.15.60:0/2039993459 learned_addr learned my addr 172.21.15.60:0/2039993459 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:16.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433f7fe700 1 --2- 172.21.15.60:0/2039993459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f434013bcc0 0x7f43400aa180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433e7fc700 1 --2- 172.21.15.60:0/2039993459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43400b1d50 0x7f43400a9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433effd700 1 -- 172.21.15.60:0/2039993459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43400b1d50 msgr2=0x7f43400a9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433effd700 1 --2- 172.21.15.60:0/2039993459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43400b1d50 0x7f43400a9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433effd700 1 -- 172.21.15.60:0/2039993459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f434013bcc0 msgr2=0x7f43400aa180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433effd700 1 --2- 172.21.15.60:0/2039993459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f434013bcc0 0x7f43400aa180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433effd700 1 -- 172.21.15.60:0/2039993459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434005b6a0 con 0x7f43400a8140 2020-10-31T22:46:16.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433effd700 1 --2- 172.21.15.60:0/2039993459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43400a8140 0x7f43400af4b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f4328001190 tx=0x7f4328007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:16.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f4337fff700 1 -- 172.21.15.60:0/2039993459 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43280072e0 con 0x7f43400a8140 2020-10-31T22:46:16.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f4337fff700 1 -- 172.21.15.60:0/2039993459 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4328007440 con 0x7f43400a8140 2020-10-31T22:46:16.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433ffff700 1 -- 172.21.15.60:0/2039993459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f434013ec80 con 0x7f43400a8140 2020-10-31T22:46:16.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f4337fff700 1 -- 172.21.15.60:0/2039993459 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43280057d0 con 0x7f43400a8140 2020-10-31T22:46:16.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.631+0000 7f433ffff700 1 -- 172.21.15.60:0/2039993459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43400b0680 con 0x7f43400a8140 2020-10-31T22:46:16.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.635+0000 7f433ffff700 1 -- 172.21.15.60:0/2039993459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43400b0960 con 0x7f43400a8140 2020-10-31T22:46:16.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.635+0000 7f4337fff700 1 -- 172.21.15.60:0/2039993459 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4328010070 con 0x7f43400a8140 2020-10-31T22:46:16.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.635+0000 7f4337fff700 1 --2- 172.21.15.60:0/2039993459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4324054f10 0x7f43240573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.635+0000 7f4337fff700 1 -- 172.21.15.60:0/2039993459 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f432806cc90 con 0x7f43400a8140 2020-10-31T22:46:16.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.635+0000 7f433e7fc700 1 --2- 172.21.15.60:0/2039993459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4324054f10 0x7f43240573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.635+0000 7f433e7fc700 1 --2- 172.21.15.60:0/2039993459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4324054f10 0x7f43240573d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f433001b000 tx=0x7f4330015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:16.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.639+0000 7f4337fff700 1 -- 172.21.15.60:0/2039993459 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f43280434e0 con 0x7f43400a8140 2020-10-31T22:46:16.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.783+0000 7f433ffff700 1 -- 172.21.15.60:0/2039993459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f43400a9a90 con 0x7f43400a8140 2020-10-31T22:46:16.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.787+0000 7f4337fff700 1 -- 172.21.15.60:0/2039993459 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v60) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4328018030 con 0x7f43400a8140 2020-10-31T22:46:16.786 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:46:16.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.787+0000 7f433ffff700 1 -- 172.21.15.60:0/2039993459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4324054f10 msgr2=0x7f43240573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.787+0000 7f433ffff700 1 --2- 172.21.15.60:0/2039993459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4324054f10 0x7f43240573d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f433001b000 tx=0x7f4330015000).stop 2020-10-31T22:46:16.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.787+0000 7f433ffff700 1 -- 172.21.15.60:0/2039993459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43400a8140 msgr2=0x7f43400af4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.787+0000 7f433ffff700 1 --2- 172.21.15.60:0/2039993459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43400a8140 0x7f43400af4b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f4328001190 tx=0x7f4328007a90).stop 2020-10-31T22:46:16.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.787+0000 7f433ffff700 1 -- 172.21.15.60:0/2039993459 shutdown_connections 2020-10-31T22:46:16.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.787+0000 7f433ffff700 1 --2- 172.21.15.60:0/2039993459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4324054f10 0x7f43240573d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.787+0000 7f433ffff700 1 --2- 172.21.15.60:0/2039993459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f434013bcc0 0x7f43400aa180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.787+0000 7f433ffff700 1 --2- 172.21.15.60:0/2039993459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43400a8140 0x7f43400af4b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.787+0000 7f433ffff700 1 --2- 172.21.15.60:0/2039993459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43400b1d50 0x7f43400a9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.787+0000 7f433ffff700 1 -- 172.21.15.60:0/2039993459 >> 172.21.15.60:0/2039993459 conn(0x7f43400b5330 msgr2=0x7f4340141e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:16.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.787+0000 7f433ffff700 1 -- 172.21.15.60:0/2039993459 shutdown_connections 2020-10-31T22:46:16.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.787+0000 7f433ffff700 1 -- 172.21.15.60:0/2039993459 wait complete. 2020-10-31T22:46:16.800 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-10-31T22:46:16.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6b33b700 1 Processor -- start 2020-10-31T22:46:16.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6b33b700 1 -- start start 2020-10-31T22:46:16.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6b33b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a640b1a10 0x7f1a64142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6b33b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1a6413ebe0 0x7f1a640b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6b33b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1a640af200 0x7f1a640afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6b33b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a640abea0 con 0x7f1a640af200 2020-10-31T22:46:16.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6b33b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a64141870 con 0x7f1a6413ebe0 2020-10-31T22:46:16.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6b33b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64141b10 con 0x7f1a640b1a10 2020-10-31T22:46:16.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6ab3a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1a640af200 0x7f1a640afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6ab3a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1a640af200 0x7f1a640afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44638/0 (socket says 172.21.15.60:44638) 2020-10-31T22:46:16.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6ab3a700 1 -- 172.21.15.60:0/710642641 learned_addr learned my addr 172.21.15.60:0/710642641 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:16.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a69b38700 1 --2- 172.21.15.60:0/710642641 >> v2:172.21.15.66:3300/0 conn(0x7f1a6413ebe0 0x7f1a640b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6a339700 1 --2- 172.21.15.60:0/710642641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a640b1a10 0x7f1a64142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6ab3a700 1 -- 172.21.15.60:0/710642641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a640b1a10 msgr2=0x7f1a64142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6ab3a700 1 --2- 172.21.15.60:0/710642641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a640b1a10 0x7f1a64142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6ab3a700 1 -- 172.21.15.60:0/710642641 >> v2:172.21.15.66:3300/0 conn(0x7f1a6413ebe0 msgr2=0x7f1a640b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:16.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6ab3a700 1 --2- 172.21.15.60:0/710642641 >> v2:172.21.15.66:3300/0 conn(0x7f1a6413ebe0 0x7f1a640b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6ab3a700 1 -- 172.21.15.60:0/710642641 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a64141db0 con 0x7f1a640af200 2020-10-31T22:46:16.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a69b38700 1 --2- 172.21.15.60:0/710642641 >> v2:172.21.15.66:3300/0 conn(0x7f1a6413ebe0 0x7f1a640b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:46:16.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6ab3a700 1 --2- 172.21.15.60:0/710642641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a640af200 0x7f1a640afc20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c009270).ready entity=mon.0 client_cookie=d771aa34f0f7bfcd server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:16.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a69337700 1 -- 172.21.15.60:0/710642641 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a5c009e60 con 0x7f1a640af200 2020-10-31T22:46:16.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a69337700 1 -- 172.21.15.60:0/710642641 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c00bb50 con 0x7f1a640af200 2020-10-31T22:46:16.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a69337700 1 -- 172.21.15.60:0/710642641 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a5c00bcc0 con 0x7f1a640af200 2020-10-31T22:46:16.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6b33b700 1 -- 172.21.15.60:0/710642641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a640af200 msgr2=0x7f1a640afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.911+0000 7f1a6b33b700 1 --2- 172.21.15.60:0/710642641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a640af200 0x7f1a640afc20 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c009270).stop 2020-10-31T22:46:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 -- 172.21.15.60:0/710642641 shutdown_connections 2020-10-31T22:46:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 --2- 172.21.15.60:0/710642641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a640af200 0x7f1a640afc20 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 --2- 172.21.15.60:0/710642641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a640b1a10 0x7f1a64142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 --2- 172.21.15.60:0/710642641 >> v2:172.21.15.66:3300/0 conn(0x7f1a6413ebe0 0x7f1a640b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 -- 172.21.15.60:0/710642641 >> 172.21.15.60:0/710642641 conn(0x7f1a640b5300 msgr2=0x7f1a640b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:16.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 -- 172.21.15.60:0/710642641 shutdown_connections 2020-10-31T22:46:16.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 -- 172.21.15.60:0/710642641 wait complete. 2020-10-31T22:46:16.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 Processor -- start 2020-10-31T22:46:16.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 -- start start 2020-10-31T22:46:16.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a640af200 0x7f1a640aabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a640b1a10 0x7f1a64065480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6413ebe0 0x7f1a64065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64065e60 con 0x7f1a6413ebe0 2020-10-31T22:46:16.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6414ea40 con 0x7f1a640b1a10 2020-10-31T22:46:16.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6414ece0 con 0x7f1a640af200 2020-10-31T22:46:16.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6ab3a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6413ebe0 0x7f1a64065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6ab3a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6413ebe0 0x7f1a64065970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44646/0 (socket says 172.21.15.60:44646) 2020-10-31T22:46:16.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6ab3a700 1 -- 172.21.15.60:0/2067444814 learned_addr learned my addr 172.21.15.60:0/2067444814 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:16.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a69b38700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a640b1a10 0x7f1a64065480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6a339700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a640af200 0x7f1a640aabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6ab3a700 1 -- 172.21.15.60:0/2067444814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a640af200 msgr2=0x7f1a640aabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6ab3a700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a640af200 0x7f1a640aabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6ab3a700 1 -- 172.21.15.60:0/2067444814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a640b1a10 msgr2=0x7f1a64065480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:16.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6ab3a700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a640b1a10 0x7f1a64065480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:16.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6ab3a700 1 -- 172.21.15.60:0/2067444814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6414ef80 con 0x7f1a6413ebe0 2020-10-31T22:46:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6a339700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a640af200 0x7f1a640aabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:46:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6ab3a700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6413ebe0 0x7f1a64065970 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a537fe700 1 -- 172.21.15.60:0/2067444814 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a5c01f670 con 0x7f1a6413ebe0 2020-10-31T22:46:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a537fe700 1 -- 172.21.15.60:0/2067444814 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c01f7d0 con 0x7f1a6413ebe0 2020-10-31T22:46:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a537fe700 1 -- 172.21.15.60:0/2067444814 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a5c01fb30 con 0x7f1a6413ebe0 2020-10-31T22:46:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 -- 172.21.15.60:0/2067444814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6414f220 con 0x7f1a6413ebe0 2020-10-31T22:46:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.915+0000 7f1a6b33b700 1 -- 172.21.15.60:0/2067444814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6414f6c0 con 0x7f1a6413ebe0 2020-10-31T22:46:16.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.919+0000 7f1a6b33b700 1 -- 172.21.15.60:0/2067444814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6414f3b0 con 0x7f1a6413ebe0 2020-10-31T22:46:16.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.919+0000 7f1a537fe700 1 -- 172.21.15.60:0/2067444814 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1a5c026030 con 0x7f1a6413ebe0 2020-10-31T22:46:16.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.919+0000 7f1a537fe700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1a44054f30 0x7f1a440573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:16.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.919+0000 7f1a6a339700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1a44054f30 0x7f1a440573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:16.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.919+0000 7f1a537fe700 1 -- 172.21.15.60:0/2067444814 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1a5c06e8d0 con 0x7f1a6413ebe0 2020-10-31T22:46:16.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.919+0000 7f1a6a339700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1a44054f30 0x7f1a440573f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f1a6000b000 tx=0x7f1a60008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:16.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:16.927+0000 7f1a537fe700 1 -- 172.21.15.60:0/2067444814 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1a5c045120 con 0x7f1a6413ebe0 2020-10-31T22:46:17.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.071+0000 7f1a6b33b700 1 -- 172.21.15.60:0/2067444814 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1a64057100 con 0x7f1a6413ebe0 2020-10-31T22:46:17.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.071+0000 7f1a537fe700 1 -- 172.21.15.60:0/2067444814 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v60) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1a5c024020 con 0x7f1a6413ebe0 2020-10-31T22:46:17.072 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:17.072 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2020-10-31T22:46:17.072 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:17.072 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2020-10-31T22:46:17.072 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "device_health_metrics" 2020-10-31T22:46:17.073 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:17.073 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:17.073 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2020-10-31T22:46:17.073 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2020-10-31T22:46:17.073 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:17.073 INFO:teuthology.orchestra.run.smithi060.stdout:] 2020-10-31T22:46:17.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.071+0000 7f1a6b33b700 1 -- 172.21.15.60:0/2067444814 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1a44054f30 msgr2=0x7f1a440573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:17.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.071+0000 7f1a6b33b700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1a44054f30 0x7f1a440573f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f1a6000b000 tx=0x7f1a60008040).stop 2020-10-31T22:46:17.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.071+0000 7f1a6b33b700 1 -- 172.21.15.60:0/2067444814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6413ebe0 msgr2=0x7f1a64065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:17.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.071+0000 7f1a6b33b700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6413ebe0 0x7f1a64065970 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7f1a5c0032b0 tx=0x7f1a5c016000).stop 2020-10-31T22:46:17.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.071+0000 7f1a6b33b700 1 -- 172.21.15.60:0/2067444814 shutdown_connections 2020-10-31T22:46:17.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.071+0000 7f1a6b33b700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a6413ebe0 0x7f1a64065970 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:17.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.071+0000 7f1a6b33b700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a640af200 0x7f1a640aabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:17.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.071+0000 7f1a6b33b700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1a44054f30 0x7f1a440573f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:17.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.071+0000 7f1a6b33b700 1 --2- 172.21.15.60:0/2067444814 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a640b1a10 0x7f1a64065480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:17.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.071+0000 7f1a6b33b700 1 -- 172.21.15.60:0/2067444814 >> 172.21.15.60:0/2067444814 conn(0x7f1a640b5300 msgr2=0x7f1a6413d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:17.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.071+0000 7f1a6b33b700 1 -- 172.21.15.60:0/2067444814 shutdown_connections 2020-10-31T22:46:17.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.071+0000 7f1a6b33b700 1 -- 172.21.15.60:0/2067444814 wait complete. 2020-10-31T22:46:17.085 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-10-31T22:46:17.086 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:46:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.219+0000 7f71c3fff700 1 Processor -- start 2020-10-31T22:46:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.219+0000 7f71c3fff700 1 -- start start 2020-10-31T22:46:17.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.219+0000 7f71c3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f71c40b1bb0 0x7f71c405afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:17.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.219+0000 7f71c3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71c40af580 0x7f71c413fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:17.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c3fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40b1120 con 0x7f71c40ab150 2020-10-31T22:46:17.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c3fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c40af9c0 con 0x7f71c40b1bb0 2020-10-31T22:46:17.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c3fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40a8850 con 0x7f71c40af580 2020-10-31T22:46:17.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c2ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f71c40b1bb0 0x7f71c405afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:17.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c2ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f71c40b1bb0 0x7f71c405afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44650/0 (socket says 172.21.15.60:44650) 2020-10-31T22:46:17.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c37fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f71c40ab150 0x7f71c40adeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48790/0 (socket says 172.21.15.60:48790) 2020-10-31T22:46:17.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c2ffd700 1 -- 172.21.15.60:0/3371343757 learned_addr learned my addr 172.21.15.60:0/3371343757 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:17.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c27fc700 1 --2- 172.21.15.60:0/3371343757 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71c40af580 0x7f71c413fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:17.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c2ffd700 1 -- 172.21.15.60:0/3371343757 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71c40af580 msgr2=0x7f71c413fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:17.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c2ffd700 1 --2- 172.21.15.60:0/3371343757 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71c40af580 0x7f71c413fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:17.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c2ffd700 1 -- 172.21.15.60:0/3371343757 >> v1:172.21.15.60:6789/0 conn(0x7f71c40ab150 legacy=0x7f71c40adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:17.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c2ffd700 1 -- 172.21.15.60:0/3371343757 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c40a8af0 con 0x7f71c40b1bb0 2020-10-31T22:46:17.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c27fc700 1 --2- 172.21.15.60:0/3371343757 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71c40af580 0x7f71c413fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:17.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c2ffd700 1 --2- 172.21.15.60:0/3371343757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40b1bb0 0x7f71c405afe0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f71b4002f30 tx=0x7f71b4006e80).ready entity=mon.0 client_cookie=9600e86a533413b2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:17.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c1ffb700 1 -- 172.21.15.60:0/3371343757 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b40097f0 con 0x7f71c40b1bb0 2020-10-31T22:46:17.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c1ffb700 1 -- 172.21.15.60:0/3371343757 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b4009950 con 0x7f71c40b1bb0 2020-10-31T22:46:17.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c1ffb700 1 -- 172.21.15.60:0/3371343757 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b4009cb0 con 0x7f71c40b1bb0 2020-10-31T22:46:17.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c3fff700 1 -- 172.21.15.60:0/3371343757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40b1bb0 msgr2=0x7f71c405afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:17.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c3fff700 1 --2- 172.21.15.60:0/3371343757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40b1bb0 0x7f71c405afe0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f71b4002f30 tx=0x7f71b4006e80).stop 2020-10-31T22:46:17.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c3fff700 1 -- 172.21.15.60:0/3371343757 shutdown_connections 2020-10-31T22:46:17.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c3fff700 1 --2- 172.21.15.60:0/3371343757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40b1bb0 0x7f71c405afe0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:17.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c3fff700 1 --2- 172.21.15.60:0/3371343757 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71c40af580 0x7f71c413fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:17.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c3fff700 1 -- 172.21.15.60:0/3371343757 >> 172.21.15.60:0/3371343757 conn(0x7f71c40b5330 msgr2=0x7f71c40b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:17.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c3fff700 1 -- 172.21.15.60:0/3371343757 shutdown_connections 2020-10-31T22:46:17.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.223+0000 7f71c3fff700 1 -- 172.21.15.60:0/3371343757 wait complete. 2020-10-31T22:46:17.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c3fff700 1 Processor -- start 2020-10-31T22:46:17.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c3fff700 1 -- start start 2020-10-31T22:46:17.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40ab150 0x7f71c4143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:17.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c3fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71c40af580 0x7f71c413fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:17.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71c40b1bb0 0x7f71c4150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:17.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4143540 con 0x7f71c40ab150 2020-10-31T22:46:17.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c3fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4141fd0 con 0x7f71c40af580 2020-10-31T22:46:17.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c3fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c4143770 con 0x7f71c40b1bb0 2020-10-31T22:46:17.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40ab150 0x7f71c4143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:17.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40ab150 0x7f71c4143c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44656/0 (socket says 172.21.15.60:44656) 2020-10-31T22:46:17.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c2ffd700 1 -- 172.21.15.60:0/398040021 learned_addr learned my addr 172.21.15.60:0/398040021 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:17.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c27fc700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71c40af580 0x7f71c413fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:17.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c37fe700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71c40b1bb0 0x7f71c4150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:17.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c2ffd700 1 -- 172.21.15.60:0/398040021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71c40b1bb0 msgr2=0x7f71c4150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:17.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c2ffd700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71c40b1bb0 0x7f71c4150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:17.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c2ffd700 1 -- 172.21.15.60:0/398040021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71c40af580 msgr2=0x7f71c413fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:17.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c2ffd700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71c40af580 0x7f71c413fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:17.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c2ffd700 1 -- 172.21.15.60:0/398040021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c4141cf0 con 0x7f71c40ab150 2020-10-31T22:46:17.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c27fc700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71c40af580 0x7f71c413fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:46:17.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c37fe700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71c40b1bb0 0x7f71c4150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:46:17.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c2ffd700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40ab150 0x7f71c4143c10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f71b4002f30 tx=0x7f71b4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:17.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71b3fff700 1 -- 172.21.15.60:0/398040021 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b4009c50 con 0x7f71c40ab150 2020-10-31T22:46:17.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71b3fff700 1 -- 172.21.15.60:0/398040021 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b401e460 con 0x7f71c40ab150 2020-10-31T22:46:17.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c3fff700 1 -- 172.21.15.60:0/398040021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c4147200 con 0x7f71c40ab150 2020-10-31T22:46:17.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71b3fff700 1 -- 172.21.15.60:0/398040021 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f71b401e7c0 con 0x7f71c40ab150 2020-10-31T22:46:17.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c3fff700 1 -- 172.21.15.60:0/398040021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c40ad690 con 0x7f71c40ab150 2020-10-31T22:46:17.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.227+0000 7f71c3fff700 1 -- 172.21.15.60:0/398040021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c41421a0 con 0x7f71c40ab150 2020-10-31T22:46:17.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.231+0000 7f71b3fff700 1 -- 172.21.15.60:0/398040021 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f71b4025030 con 0x7f71c40ab150 2020-10-31T22:46:17.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.231+0000 7f71b3fff700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f71a0054f30 0x7f71a00573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:17.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.231+0000 7f71b3fff700 1 -- 172.21.15.60:0/398040021 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f71b406ed70 con 0x7f71c40ab150 2020-10-31T22:46:17.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.231+0000 7f71c27fc700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f71a0054f30 0x7f71a00573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:17.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.231+0000 7f71c27fc700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f71a0054f30 0x7f71a00573f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f71b8008000 tx=0x7f71b8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:17.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.239+0000 7f71b3fff700 1 -- 172.21.15.60:0/398040021 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f71b4045600 con 0x7f71c40ab150 2020-10-31T22:46:17.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:17.383+0000 7f71c3fff700 1 -- 172.21.15.60:0/398040021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f71c4057100 con 0x7f71c40ab150 2020-10-31T22:46:18.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.331+0000 7f71b3fff700 1 -- 172.21.15.60:0/398040021 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v61) v1 ==== 133+0+0 (secure 0 0 0) 0x7f71b4023020 con 0x7f71c40ab150 2020-10-31T22:46:18.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.335+0000 7f71c3fff700 1 -- 172.21.15.60:0/398040021 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f71a0054f30 msgr2=0x7f71a00573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.335+0000 7f71c3fff700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f71a0054f30 0x7f71a00573f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f71b8008000 tx=0x7f71b8008040).stop 2020-10-31T22:46:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.335+0000 7f71c3fff700 1 -- 172.21.15.60:0/398040021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40ab150 msgr2=0x7f71c4143c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.335+0000 7f71c3fff700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40ab150 0x7f71c4143c10 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f71b4002f30 tx=0x7f71b4015000).stop 2020-10-31T22:46:18.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.335+0000 7f71c3fff700 1 -- 172.21.15.60:0/398040021 shutdown_connections 2020-10-31T22:46:18.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.335+0000 7f71c3fff700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71c40b1bb0 0x7f71c4150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:18.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.335+0000 7f71c3fff700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f71c40ab150 0x7f71c4143c10 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:18.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.335+0000 7f71c3fff700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f71a0054f30 0x7f71a00573f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:18.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.335+0000 7f71c3fff700 1 --2- 172.21.15.60:0/398040021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71c40af580 0x7f71c413fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:18.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.335+0000 7f71c3fff700 1 -- 172.21.15.60:0/398040021 >> 172.21.15.60:0/398040021 conn(0x7f71c40b5330 msgr2=0x7f71c405afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:18.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.335+0000 7f71c3fff700 1 -- 172.21.15.60:0/398040021 shutdown_connections 2020-10-31T22:46:18.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.335+0000 7f71c3fff700 1 -- 172.21.15.60:0/398040021 wait complete. 2020-10-31T22:46:18.341 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:46:18.353 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-10-31T22:46:18.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.479+0000 7fe6d5a1a700 1 Processor -- start 2020-10-31T22:46:18.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.479+0000 7fe6d5a1a700 1 -- start start 2020-10-31T22:46:18.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.479+0000 7fe6d5a1a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d00b24a0 0x7fe6d00b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:18.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.479+0000 7fe6d5a1a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d00b4440 con 0x7fe6d0141f00 2020-10-31T22:46:18.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.479+0000 7fe6d5a1a700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d0146060 con 0x7fe6d00b5570 2020-10-31T22:46:18.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.479+0000 7fe6d5a1a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d013f930 con 0x7fe6d00b24a0 2020-10-31T22:46:18.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.479+0000 7fe6d5219700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe6d0141f00 0x7fe6d0142390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48804/0 (socket says 172.21.15.60:48804) 2020-10-31T22:46:18.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.479+0000 7fe6d5219700 1 -- 172.21.15.60:0/2868979791 learned_addr learned my addr 172.21.15.60:0/2868979791 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:18.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cffff700 1 --2- 172.21.15.60:0/2868979791 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d00b24a0 0x7fe6d00b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:18.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2136740415 0 0) 0x7fe6d00b4440 con 0x7fe6d0141f00 2020-10-31T22:46:18.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6bc003230 con 0x7fe6d0141f00 2020-10-31T22:46:18.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427101502 0 0) 0x7fe6d0146060 con 0x7fe6d00b5570 2020-10-31T22:46:18.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6d00b4440 con 0x7fe6d00b5570 2020-10-31T22:46:18.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1430821472 0 0) 0x7fe6bc003230 con 0x7fe6d0141f00 2020-10-31T22:46:18.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d00b24a0 msgr2=0x7fe6d00b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:18.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 --2- 172.21.15.60:0/2868979791 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d00b24a0 0x7fe6d00b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:18.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 >> v1:172.21.15.66:6789/0 conn(0x7fe6d00b5570 legacy=0x7fe6d0145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:18.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d0142aa0 con 0x7fe6d0141f00 2020-10-31T22:46:18.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fe6c8001a50 con 0x7fe6d0141f00 2020-10-31T22:46:18.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 >> v1:172.21.15.60:6789/0 conn(0x7fe6d0141f00 legacy=0x7fe6d0142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:18.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 --2- 172.21.15.60:0/2868979791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6bc0038e0 0x7fe6bc003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:18.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 --2- 172.21.15.60:0/2868979791 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d00b24a0 0x7fe6bc0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:18.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 --2- 172.21.15.60:0/2868979791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6bc0049c0 0x7fe6bc004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:18.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d013f930 con 0x7fe6bc0038e0 2020-10-31T22:46:18.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc005330 con 0x7fe6bc0049c0 2020-10-31T22:46:18.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6bc00b720 con 0x7fe6d00b24a0 2020-10-31T22:46:18.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d4a18700 1 --2- 172.21.15.60:0/2868979791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6bc0038e0 0x7fe6bc003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:18.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cffff700 1 --2- 172.21.15.60:0/2868979791 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d00b24a0 0x7fe6bc0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:18.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d5219700 1 --2- 172.21.15.60:0/2868979791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6bc0049c0 0x7fe6bc004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:18.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d4a18700 1 -- 172.21.15.60:0/2868979791 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d00b24a0 msgr2=0x7fe6bc0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:18.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d4a18700 1 --2- 172.21.15.60:0/2868979791 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d00b24a0 0x7fe6bc0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:18.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d4a18700 1 -- 172.21.15.60:0/2868979791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6bc0049c0 msgr2=0x7fe6bc004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:18.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d4a18700 1 --2- 172.21.15.60:0/2868979791 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6bc0049c0 0x7fe6bc004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:18.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d4a18700 1 -- 172.21.15.60:0/2868979791 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6bc003230 con 0x7fe6bc0038e0 2020-10-31T22:46:18.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cffff700 1 --2- 172.21.15.60:0/2868979791 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d00b24a0 0x7fe6bc0044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:46:18.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d4a18700 1 --2- 172.21.15.60:0/2868979791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6bc0038e0 0x7fe6bc003ce0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fe6c40010d0 tx=0x7fe6c4007ad0).ready entity=mon.0 client_cookie=d6af55b7c78f5be4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:18.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6c400c870 con 0x7fe6bc0038e0 2020-10-31T22:46:18.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c400c9d0 con 0x7fe6bc0038e0 2020-10-31T22:46:18.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6cf7fe700 1 -- 172.21.15.60:0/2868979791 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6c400cd30 con 0x7fe6bc0038e0 2020-10-31T22:46:18.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/2868979791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6bc0038e0 msgr2=0x7fe6bc003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d5a1a700 1 --2- 172.21.15.60:0/2868979791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6bc0038e0 0x7fe6bc003ce0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7fe6c40010d0 tx=0x7fe6c4007ad0).stop 2020-10-31T22:46:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d5219700 1 -- 172.21.15.60:0/2868979791 reap_dead start 2020-10-31T22:46:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/2868979791 shutdown_connections 2020-10-31T22:46:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/2868979791 >> 172.21.15.60:0/2868979791 conn(0x7fe6d00b8e90 msgr2=0x7fe6d00b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:18.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/2868979791 shutdown_connections 2020-10-31T22:46:18.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.483+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/2868979791 wait complete. 2020-10-31T22:46:18.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5a1a700 1 Processor -- start 2020-10-31T22:46:18.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5a1a700 1 -- start start 2020-10-31T22:46:18.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5a1a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d0140870 0x7fe6d0150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:18.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5a1a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6d0148540 0x7fe6d01510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:18.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5a1a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6d0146240 0x7fe6d01466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5a1a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d01515c0 con 0x7fe6d0146240 2020-10-31T22:46:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5a1a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d0140c50 con 0x7fe6d0148540 2020-10-31T22:46:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5a1a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d0154250 con 0x7fe6d0140870 2020-10-31T22:46:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5219700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6d0146240 0x7fe6d01466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5219700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6d0146240 0x7fe6d01466c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44680/0 (socket says 172.21.15.60:44680) 2020-10-31T22:46:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5219700 1 -- 172.21.15.60:0/3197694150 learned_addr learned my addr 172.21.15.60:0/3197694150 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:18.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6cffff700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6d0148540 0x7fe6d01510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d4a18700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d0140870 0x7fe6d0150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5219700 1 -- 172.21.15.60:0/3197694150 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d0140870 msgr2=0x7fe6d0150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5219700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d0140870 0x7fe6d0150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5219700 1 -- 172.21.15.60:0/3197694150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6d0148540 msgr2=0x7fe6d01510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5219700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6d0148540 0x7fe6d01510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:18.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d5219700 1 -- 172.21.15.60:0/3197694150 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d01544f0 con 0x7fe6d0146240 2020-10-31T22:46:18.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6cffff700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6d0148540 0x7fe6d01510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:18.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.487+0000 7fe6d4a18700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d0140870 0x7fe6d0150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:18.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.491+0000 7fe6d5219700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6d0146240 0x7fe6d01466c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fe6c8000b20 tx=0x7fe6d0141bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:18.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.491+0000 7fe6cdffb700 1 -- 172.21.15.60:0/3197694150 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6c800fe20 con 0x7fe6d0146240 2020-10-31T22:46:18.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.491+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/3197694150 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d0154790 con 0x7fe6d0146240 2020-10-31T22:46:18.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.491+0000 7fe6cdffb700 1 -- 172.21.15.60:0/3197694150 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c80077e0 con 0x7fe6d0146240 2020-10-31T22:46:18.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.491+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/3197694150 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d0147610 con 0x7fe6d0146240 2020-10-31T22:46:18.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.491+0000 7fe6cdffb700 1 -- 172.21.15.60:0/3197694150 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6c8012540 con 0x7fe6d0146240 2020-10-31T22:46:18.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.491+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/3197694150 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d0057100 con 0x7fe6d0146240 2020-10-31T22:46:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.491+0000 7fe6cdffb700 1 -- 172.21.15.60:0/3197694150 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe6c80126a0 con 0x7fe6d0146240 2020-10-31T22:46:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.491+0000 7fe6cdffb700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6b0054f90 0x7fe6b0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.495+0000 7fe6d4a18700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6b0054f90 0x7fe6b0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.495+0000 7fe6cdffb700 1 -- 172.21.15.60:0/3197694150 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fe6c806d9d0 con 0x7fe6d0146240 2020-10-31T22:46:18.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.495+0000 7fe6d4a18700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6b0054f90 0x7fe6b0057450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fe6c4019000 tx=0x7fe6c4017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:18.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.503+0000 7fe6cdffb700 1 -- 172.21.15.60:0/3197694150 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe6c8043f50 con 0x7fe6d0146240 2020-10-31T22:46:18.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:18.650+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/3197694150 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fe6d00b5c90 con 0x7fe6d0146240 2020-10-31T22:46:19.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.526+0000 7fe6cdffb700 1 -- 172.21.15.60:0/3197694150 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v63) v1 ==== 125+0+0 (secure 0 0 0) 0x7fe6c8019020 con 0x7fe6d0146240 2020-10-31T22:46:19.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.530+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/3197694150 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6b0054f90 msgr2=0x7fe6b0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:19.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.530+0000 7fe6d5a1a700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6b0054f90 0x7fe6b0057450 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fe6c4019000 tx=0x7fe6c4017000).stop 2020-10-31T22:46:19.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.530+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/3197694150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6d0146240 msgr2=0x7fe6d01466c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:19.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.530+0000 7fe6d5a1a700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6d0146240 0x7fe6d01466c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7fe6c8000b20 tx=0x7fe6d0141bf0).stop 2020-10-31T22:46:19.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.530+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/3197694150 shutdown_connections 2020-10-31T22:46:19.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.530+0000 7fe6d5a1a700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6d0146240 0x7fe6d01466c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:19.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.530+0000 7fe6d5a1a700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6d0140870 0x7fe6d0150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:19.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.530+0000 7fe6d5a1a700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6b0054f90 0x7fe6b0057450 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:19.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.530+0000 7fe6d5a1a700 1 --2- 172.21.15.60:0/3197694150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6d0148540 0x7fe6d01510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:19.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.530+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/3197694150 >> 172.21.15.60:0/3197694150 conn(0x7fe6d00b8e90 msgr2=0x7fe6d00b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:19.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.534+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/3197694150 shutdown_connections 2020-10-31T22:46:19.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.534+0000 7fe6d5a1a700 1 -- 172.21.15.60:0/3197694150 wait complete. 2020-10-31T22:46:19.536 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2020-10-31T22:46:19.550 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-10-31T22:46:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.666+0000 7fe3ec911700 1 Processor -- start 2020-10-31T22:46:19.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.666+0000 7fe3ec911700 1 -- start start 2020-10-31T22:46:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3ec911700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe3e80af0e0 0x7fe3e80af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3ec911700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e8141cf0 con 0x7fe3e8062e00 2020-10-31T22:46:19.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3ec911700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e8145af0 con 0x7fe3e813ef60 2020-10-31T22:46:19.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3ec911700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e8145d90 con 0x7fe3e80af0e0 2020-10-31T22:46:19.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e6ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe3e8062e00 0x7fe3e8145330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48822/0 (socket says 172.21.15.60:48822) 2020-10-31T22:46:19.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e6ffd700 1 -- 172.21.15.60:0/750991064 learned_addr learned my addr 172.21.15.60:0/750991064 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:19.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e77fe700 1 --2- 172.21.15.60:0/750991064 >> v2:172.21.15.66:3300/0 conn(0x7fe3e80af0e0 0x7fe3e80af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:19.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 -- 172.21.15.60:0/750991064 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 345096205 0 0) 0x7fe3e8141cf0 con 0x7fe3e8062e00 2020-10-31T22:46:19.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 -- 172.21.15.60:0/750991064 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3c8003230 con 0x7fe3e8062e00 2020-10-31T22:46:19.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 -- 172.21.15.60:0/750991064 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1783193325 0 0) 0x7fe3c8003230 con 0x7fe3e8062e00 2020-10-31T22:46:19.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 -- 172.21.15.60:0/750991064 >> v2:172.21.15.66:3300/0 conn(0x7fe3e80af0e0 msgr2=0x7fe3e80af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:19.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 --2- 172.21.15.60:0/750991064 >> v2:172.21.15.66:3300/0 conn(0x7fe3e80af0e0 0x7fe3e80af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:19.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 -- 172.21.15.60:0/750991064 >> v1:172.21.15.66:6789/0 conn(0x7fe3e813ef60 legacy=0x7fe3e8142150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:19.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 -- 172.21.15.60:0/750991064 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e8146030 con 0x7fe3e8062e00 2020-10-31T22:46:19.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 -- 172.21.15.60:0/750991064 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fe3d80016d0 con 0x7fe3e8062e00 2020-10-31T22:46:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 -- 172.21.15.60:0/750991064 >> v1:172.21.15.60:6789/0 conn(0x7fe3e8062e00 legacy=0x7fe3e8145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 --2- 172.21.15.60:0/750991064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3c8003720 0x7fe3c8003b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 --2- 172.21.15.60:0/750991064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c80044d0 0x7fe3c8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 --2- 172.21.15.60:0/750991064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3c8004e40 0x7fe3c800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:19.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 -- 172.21.15.60:0/750991064 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e8145d90 con 0x7fe3c80044d0 2020-10-31T22:46:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 -- 172.21.15.60:0/750991064 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c80042b0 con 0x7fe3c8004e40 2020-10-31T22:46:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 -- 172.21.15.60:0/750991064 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c800bc10 con 0x7fe3c8003720 2020-10-31T22:46:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e6ffd700 1 --2- 172.21.15.60:0/750991064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c80044d0 0x7fe3c8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e77fe700 1 --2- 172.21.15.60:0/750991064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3c8003720 0x7fe3c8003b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e7fff700 1 --2- 172.21.15.60:0/750991064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3c8004e40 0x7fe3c800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e6ffd700 1 -- 172.21.15.60:0/750991064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3c8003720 msgr2=0x7fe3c8003b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:19.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e6ffd700 1 --2- 172.21.15.60:0/750991064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3c8003720 0x7fe3c8003b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e6ffd700 1 -- 172.21.15.60:0/750991064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3c8004e40 msgr2=0x7fe3c800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e6ffd700 1 --2- 172.21.15.60:0/750991064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3c8004e40 0x7fe3c800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e6ffd700 1 -- 172.21.15.60:0/750991064 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8003230 con 0x7fe3c80044d0 2020-10-31T22:46:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e7fff700 1 --2- 172.21.15.60:0/750991064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3c8004e40 0x7fe3c800b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e7fff700 1 -- 172.21.15.60:0/750991064 reap_dead start 2020-10-31T22:46:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e6ffd700 1 --2- 172.21.15.60:0/750991064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c80044d0 0x7fe3c8004950 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fe3c8004440 tx=0x7fe3e80acf70).ready entity=mon.0 client_cookie=843dda07e0752fdb server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 -- 172.21.15.60:0/750991064 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d800ce90 con 0x7fe3c80044d0 2020-10-31T22:46:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 -- 172.21.15.60:0/750991064 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d80070d0 con 0x7fe3c80044d0 2020-10-31T22:46:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3e67fc700 1 -- 172.21.15.60:0/750991064 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d8007430 con 0x7fe3c80044d0 2020-10-31T22:46:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3ec911700 1 -- 172.21.15.60:0/750991064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c80044d0 msgr2=0x7fe3c8004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3ec911700 1 --2- 172.21.15.60:0/750991064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c80044d0 0x7fe3c8004950 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7fe3c8004440 tx=0x7fe3e80acf70).stop 2020-10-31T22:46:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3ec911700 1 -- 172.21.15.60:0/750991064 shutdown_connections 2020-10-31T22:46:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3ec911700 1 --2- 172.21.15.60:0/750991064 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c80044d0 0x7fe3c8004950 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3ec911700 1 -- 172.21.15.60:0/750991064 >> 172.21.15.60:0/750991064 conn(0x7fe3e806a600 msgr2=0x7fe3e8060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3ec911700 1 -- 172.21.15.60:0/750991064 shutdown_connections 2020-10-31T22:46:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.670+0000 7fe3ec911700 1 -- 172.21.15.60:0/750991064 wait complete. 2020-10-31T22:46:19.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3ec911700 1 Processor -- start 2020-10-31T22:46:19.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3ec911700 1 -- start start 2020-10-31T22:46:19.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3ec911700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c80044d0 0x7fe3e80abfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:19.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3ec911700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e80aac00 0x7fe3e8150ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:19.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3ec911700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3e80ab770 0x7fe3e8150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:19.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3ec911700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e81514c0 con 0x7fe3c80044d0 2020-10-31T22:46:19.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3ec911700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e80aa420 con 0x7fe3e80ab770 2020-10-31T22:46:19.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3ec911700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e80aa6c0 con 0x7fe3e80aac00 2020-10-31T22:46:19.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c80044d0 0x7fe3e80abfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:19.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c80044d0 0x7fe3e80abfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44698/0 (socket says 172.21.15.60:44698) 2020-10-31T22:46:19.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e77fe700 1 -- 172.21.15.60:0/2316840482 learned_addr learned my addr 172.21.15.60:0/2316840482 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:19.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e6ffd700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e80aac00 0x7fe3e8150ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:19.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e7fff700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3e80ab770 0x7fe3e8150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:19.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e77fe700 1 -- 172.21.15.60:0/2316840482 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e80aac00 msgr2=0x7fe3e8150ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:19.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e77fe700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e80aac00 0x7fe3e8150ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e77fe700 1 -- 172.21.15.60:0/2316840482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3e80ab770 msgr2=0x7fe3e8150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e77fe700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3e80ab770 0x7fe3e8150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e77fe700 1 -- 172.21.15.60:0/2316840482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e80aa960 con 0x7fe3c80044d0 2020-10-31T22:46:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e6ffd700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e80aac00 0x7fe3e8150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e7fff700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3e80ab770 0x7fe3e8150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e77fe700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c80044d0 0x7fe3e80abfe0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fe3d0006750 tx=0x7fe3d0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:19.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e4ff9700 1 -- 172.21.15.60:0/2316840482 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d000fa90 con 0x7fe3c80044d0 2020-10-31T22:46:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e4ff9700 1 -- 172.21.15.60:0/2316840482 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d000fbf0 con 0x7fe3c80044d0 2020-10-31T22:46:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3ec911700 1 -- 172.21.15.60:0/2316840482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e8150610 con 0x7fe3c80044d0 2020-10-31T22:46:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3e4ff9700 1 -- 172.21.15.60:0/2316840482 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3d000fd60 con 0x7fe3c80044d0 2020-10-31T22:46:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.674+0000 7fe3ec911700 1 -- 172.21.15.60:0/2316840482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e8063800 con 0x7fe3c80044d0 2020-10-31T22:46:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.678+0000 7fe3ec911700 1 -- 172.21.15.60:0/2316840482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e8057100 con 0x7fe3c80044d0 2020-10-31T22:46:19.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.678+0000 7fe3e4ff9700 1 -- 172.21.15.60:0/2316840482 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe3d0024070 con 0x7fe3c80044d0 2020-10-31T22:46:19.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.678+0000 7fe3e4ff9700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe3cc054f10 0x7fe3cc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:19.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.678+0000 7fe3e6ffd700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe3cc054f10 0x7fe3cc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:19.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.678+0000 7fe3e4ff9700 1 -- 172.21.15.60:0/2316840482 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fe3d006e8a0 con 0x7fe3c80044d0 2020-10-31T22:46:19.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.678+0000 7fe3e6ffd700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe3cc054f10 0x7fe3cc0573d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fe3d8019000 tx=0x7fe3d8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:19.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.682+0000 7fe3e4ff9700 1 -- 172.21.15.60:0/2316840482 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe3d0044dd0 con 0x7fe3c80044d0 2020-10-31T22:46:19.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.870+0000 7fe3ec911700 1 -- 172.21.15.60:0/2316840482 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fe3e805ed50 con 0x7fe3c80044d0 2020-10-31T22:46:19.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.882+0000 7fe3e4ff9700 1 -- 172.21.15.60:0/2316840482 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 11 and data pool 12 v28) v1 ==== 189+0+0 (secure 0 0 0) 0x7fe3d002b0d0 con 0x7fe3c80044d0 2020-10-31T22:46:19.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.886+0000 7fe3ec911700 1 -- 172.21.15.60:0/2316840482 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe3cc054f10 msgr2=0x7fe3cc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:19.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.886+0000 7fe3ec911700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe3cc054f10 0x7fe3cc0573d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7fe3d8019000 tx=0x7fe3d8015000).stop 2020-10-31T22:46:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.886+0000 7fe3ec911700 1 -- 172.21.15.60:0/2316840482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c80044d0 msgr2=0x7fe3e80abfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.886+0000 7fe3ec911700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c80044d0 0x7fe3e80abfe0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7fe3d0006750 tx=0x7fe3d0008040).stop 2020-10-31T22:46:19.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.890+0000 7fe3ec911700 1 -- 172.21.15.60:0/2316840482 shutdown_connections 2020-10-31T22:46:19.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.890+0000 7fe3ec911700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe3cc054f10 0x7fe3cc0573d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:19.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.890+0000 7fe3ec911700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3e80ab770 0x7fe3e8150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:19.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.890+0000 7fe3ec911700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3c80044d0 0x7fe3e80abfe0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:19.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.890+0000 7fe3ec911700 1 --2- 172.21.15.60:0/2316840482 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3e80aac00 0x7fe3e8150ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:19.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.890+0000 7fe3ec911700 1 -- 172.21.15.60:0/2316840482 >> 172.21.15.60:0/2316840482 conn(0x7fe3e806a600 msgr2=0x7fe3e80ae480 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:19.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.890+0000 7fe3ec911700 1 -- 172.21.15.60:0/2316840482 shutdown_connections 2020-10-31T22:46:19.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:19.890+0000 7fe3ec911700 1 -- 172.21.15.60:0/2316840482 wait complete. 2020-10-31T22:46:19.895 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 11 and data pool 12 2020-10-31T22:46:19.907 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:46:20.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 Processor -- start 2020-10-31T22:46:20.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 -- start start 2020-10-31T22:46:20.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c05c4c0 0x7fef7c05c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fef7c0b2e20 0x7fef7c146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7c065e90 con 0x7fef7c0b4410 2020-10-31T22:46:20.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7c141ef0 con 0x7fef7c0b2e20 2020-10-31T22:46:20.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c066130 con 0x7fef7c05c4c0 2020-10-31T22:46:20.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef7bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fef7c0b2e20 0x7fef7c146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef8149d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fef7c0b4410 0x7fef7c13f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48858/0 (socket says 172.21.15.60:48858) 2020-10-31T22:46:20.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef8149d700 1 -- 172.21.15.60:0/2143663394 learned_addr learned my addr 172.21.15.60:0/2143663394 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:20.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef80c9c700 1 --2- 172.21.15.60:0/2143663394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c05c4c0 0x7fef7c05c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef7bfff700 1 -- 172.21.15.60:0/2143663394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c05c4c0 msgr2=0x7fef7c05c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:20.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef7bfff700 1 --2- 172.21.15.60:0/2143663394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c05c4c0 0x7fef7c05c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef7bfff700 1 -- 172.21.15.60:0/2143663394 >> v1:172.21.15.60:6789/0 conn(0x7fef7c0b4410 legacy=0x7fef7c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef7bfff700 1 -- 172.21.15.60:0/2143663394 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c0663d0 con 0x7fef7c0b2e20 2020-10-31T22:46:20.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef7bfff700 1 --2- 172.21.15.60:0/2143663394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c0b2e20 0x7fef7c146020 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fef64002f30 tx=0x7fef64006dc0).ready entity=mon.0 client_cookie=eb44a7e0a3c42bdb server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:20.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef7b7fe700 1 -- 172.21.15.60:0/2143663394 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef64009760 con 0x7fef7c0b2e20 2020-10-31T22:46:20.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef7b7fe700 1 -- 172.21.15.60:0/2143663394 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef640098c0 con 0x7fef7c0b2e20 2020-10-31T22:46:20.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 -- 172.21.15.60:0/2143663394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c0b2e20 msgr2=0x7fef7c146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 --2- 172.21.15.60:0/2143663394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c0b2e20 0x7fef7c146020 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7fef64002f30 tx=0x7fef64006dc0).stop 2020-10-31T22:46:20.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef7b7fe700 1 -- 172.21.15.60:0/2143663394 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef64009c20 con 0x7fef7c0b2e20 2020-10-31T22:46:20.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 -- 172.21.15.60:0/2143663394 shutdown_connections 2020-10-31T22:46:20.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 --2- 172.21.15.60:0/2143663394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c05c4c0 0x7fef7c05c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 --2- 172.21.15.60:0/2143663394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c0b2e20 0x7fef7c146020 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 -- 172.21.15.60:0/2143663394 >> 172.21.15.60:0/2143663394 conn(0x7fef7c0601e0 msgr2=0x7fef7c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:20.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 -- 172.21.15.60:0/2143663394 shutdown_connections 2020-10-31T22:46:20.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.010+0000 7fef82f00700 1 -- 172.21.15.60:0/2143663394 wait complete. 2020-10-31T22:46:20.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef82f00700 1 Processor -- start 2020-10-31T22:46:20.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef82f00700 1 -- start start 2020-10-31T22:46:20.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef82f00700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c05c4c0 0x7fef7c0ab730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef82f00700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c0b4410 0x7fef7c0b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef82f00700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef7c0aab80 0x7fef7c0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef82f00700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0aa1e0 con 0x7fef7c05c4c0 2020-10-31T22:46:20.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef82f00700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0aa480 con 0x7fef7c0aab80 2020-10-31T22:46:20.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef82f00700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0aa720 con 0x7fef7c0b4410 2020-10-31T22:46:20.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef80c9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c05c4c0 0x7fef7c0ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef80c9c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c05c4c0 0x7fef7c0ab730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44724/0 (socket says 172.21.15.60:44724) 2020-10-31T22:46:20.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef80c9c700 1 -- 172.21.15.60:0/454904056 learned_addr learned my addr 172.21.15.60:0/454904056 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:20.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef7bfff700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c0b4410 0x7fef7c0b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef8149d700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef7c0aab80 0x7fef7c0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef80c9c700 1 -- 172.21.15.60:0/454904056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c0b4410 msgr2=0x7fef7c0b6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef80c9c700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c0b4410 0x7fef7c0b6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef80c9c700 1 -- 172.21.15.60:0/454904056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef7c0aab80 msgr2=0x7fef7c0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef80c9c700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef7c0aab80 0x7fef7c0aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef80c9c700 1 -- 172.21.15.60:0/454904056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c0aea50 con 0x7fef7c05c4c0 2020-10-31T22:46:20.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef7bfff700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c0b4410 0x7fef7c0b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:46:20.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef80c9c700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c05c4c0 0x7fef7c0ab730 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fef6c00c000 tx=0x7fef6c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:20.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef79ffb700 1 -- 172.21.15.60:0/454904056 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef6c00cb00 con 0x7fef7c05c4c0 2020-10-31T22:46:20.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef79ffb700 1 -- 172.21.15.60:0/454904056 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c00cc60 con 0x7fef7c05c4c0 2020-10-31T22:46:20.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef82f00700 1 -- 172.21.15.60:0/454904056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7c0ae730 con 0x7fef7c05c4c0 2020-10-31T22:46:20.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef79ffb700 1 -- 172.21.15.60:0/454904056 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef6c0123f0 con 0x7fef7c05c4c0 2020-10-31T22:46:20.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.014+0000 7fef82f00700 1 -- 172.21.15.60:0/454904056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c0ac860 con 0x7fef7c05c4c0 2020-10-31T22:46:20.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.018+0000 7fef82f00700 1 -- 172.21.15.60:0/454904056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c0aebe0 con 0x7fef7c05c4c0 2020-10-31T22:46:20.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.018+0000 7fef79ffb700 1 -- 172.21.15.60:0/454904056 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fef6c022070 con 0x7fef7c05c4c0 2020-10-31T22:46:20.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.018+0000 7fef79ffb700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fef60054f10 0x7fef600573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.018+0000 7fef79ffb700 1 -- 172.21.15.60:0/454904056 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fef6c06dfe0 con 0x7fef7c05c4c0 2020-10-31T22:46:20.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.018+0000 7fef7bfff700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fef60054f10 0x7fef600573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.018+0000 7fef7bfff700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fef60054f10 0x7fef600573d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fef6401a000 tx=0x7fef64015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:20.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.026+0000 7fef79ffb700 1 -- 172.21.15.60:0/454904056 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fef6c044460 con 0x7fef7c05c4c0 2020-10-31T22:46:20.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.162+0000 7fef82f00700 1 -- 172.21.15.60:0/454904056 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef7c0ac860 con 0x7fef7c05c4c0 2020-10-31T22:46:20.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.166+0000 7fef79ffb700 1 -- 172.21.15.60:0/454904056 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16054 (secure 0 0 0) 0x7fef7c0ac860 con 0x7fef7c05c4c0 2020-10-31T22:46:20.167 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:20.167 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":64,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:46:19.876649+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:46:17.441669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2020-10-31T22:46:18.708444+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:46:20.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.166+0000 7fef82f00700 1 -- 172.21.15.60:0/454904056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fef60054f10 msgr2=0x7fef600573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.166+0000 7fef82f00700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fef60054f10 0x7fef600573d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fef6401a000 tx=0x7fef64015000).stop 2020-10-31T22:46:20.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.166+0000 7fef82f00700 1 -- 172.21.15.60:0/454904056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c05c4c0 msgr2=0x7fef7c0ab730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.166+0000 7fef82f00700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c05c4c0 0x7fef7c0ab730 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7fef6c00c000 tx=0x7fef6c0091a0).stop 2020-10-31T22:46:20.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.166+0000 7fef82f00700 1 -- 172.21.15.60:0/454904056 shutdown_connections 2020-10-31T22:46:20.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.166+0000 7fef82f00700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fef60054f10 0x7fef600573d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.166+0000 7fef82f00700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef7c0aab80 0x7fef7c0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.166+0000 7fef82f00700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef7c05c4c0 0x7fef7c0ab730 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.166+0000 7fef82f00700 1 --2- 172.21.15.60:0/454904056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c0b4410 0x7fef7c0b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.166+0000 7fef82f00700 1 -- 172.21.15.60:0/454904056 >> 172.21.15.60:0/454904056 conn(0x7fef7c0601e0 msgr2=0x7fef7c0b7990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.166+0000 7fef82f00700 1 -- 172.21.15.60:0/454904056 shutdown_connections 2020-10-31T22:46:20.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.166+0000 7fef82f00700 1 -- 172.21.15.60:0/454904056 wait complete. 2020-10-31T22:46:20.181 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:46:20.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 Processor -- start 2020-10-31T22:46:20.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 -- start start 2020-10-31T22:46:20.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f83e805b960 0x7f83e805bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f83e80a7850 0x7f83e80aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e80b0f00 con 0x7f83e80aefe0 2020-10-31T22:46:20.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e80b11a0 con 0x7f83e80a7850 2020-10-31T22:46:20.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80b1440 con 0x7f83e805b960 2020-10-31T22:46:20.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83ed510700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f83e80a7850 0x7f83e80aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83ed510700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f83e80a7850 0x7f83e80aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44732/0 (socket says 172.21.15.60:44732) 2020-10-31T22:46:20.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83ed510700 1 -- 172.21.15.60:0/3687372437 learned_addr learned my addr 172.21.15.60:0/3687372437 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83ee512700 1 --1- 172.21.15.60:0/3687372437 >> v1:172.21.15.60:6789/0 conn(0x7f83e80aefe0 0x7f83e8146790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48872/0 (socket says 172.21.15.60:48872) 2020-10-31T22:46:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83edd11700 1 --2- 172.21.15.60:0/3687372437 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f83e805b960 0x7f83e805bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83ed510700 1 -- 172.21.15.60:0/3687372437 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f83e805b960 msgr2=0x7f83e805bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83ed510700 1 --2- 172.21.15.60:0/3687372437 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f83e805b960 0x7f83e805bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83ed510700 1 -- 172.21.15.60:0/3687372437 >> v1:172.21.15.60:6789/0 conn(0x7f83e80aefe0 legacy=0x7f83e8146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83ed510700 1 -- 172.21.15.60:0/3687372437 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e81462f0 con 0x7f83e80a7850 2020-10-31T22:46:20.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83ed510700 1 --2- 172.21.15.60:0/3687372437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e80a7850 0x7f83e80aeaf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f83dc002f30 tx=0x7f83dc006e80).ready entity=mon.0 client_cookie=e9a91dcf15274ca6 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:20.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83ecd0f700 1 -- 172.21.15.60:0/3687372437 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83dc009910 con 0x7f83e80a7850 2020-10-31T22:46:20.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83ecd0f700 1 -- 172.21.15.60:0/3687372437 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc009a70 con 0x7f83e80a7850 2020-10-31T22:46:20.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83ecd0f700 1 -- 172.21.15.60:0/3687372437 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83dc009dd0 con 0x7f83e80a7850 2020-10-31T22:46:20.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 -- 172.21.15.60:0/3687372437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e80a7850 msgr2=0x7f83e80aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 --2- 172.21.15.60:0/3687372437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e80a7850 0x7f83e80aeaf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f83dc002f30 tx=0x7f83dc006e80).stop 2020-10-31T22:46:20.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 -- 172.21.15.60:0/3687372437 shutdown_connections 2020-10-31T22:46:20.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 --2- 172.21.15.60:0/3687372437 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f83e805b960 0x7f83e805bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 --2- 172.21.15.60:0/3687372437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e80a7850 0x7f83e80aeaf0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 -- 172.21.15.60:0/3687372437 >> 172.21.15.60:0/3687372437 conn(0x7f83e806a260 msgr2=0x7f83e8061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:20.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 -- 172.21.15.60:0/3687372437 shutdown_connections 2020-10-31T22:46:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.294+0000 7f83eff75700 1 -- 172.21.15.60:0/3687372437 wait complete. 2020-10-31T22:46:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83eff75700 1 Processor -- start 2020-10-31T22:46:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83eff75700 1 -- start start 2020-10-31T22:46:20.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83eff75700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e805b960 0x7f83e80ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83eff75700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e80a7850 0x7f83e8143550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83eff75700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f83e8141170 0x7f83e8142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83eff75700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e80ae110 con 0x7f83e80a7850 2020-10-31T22:46:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83eff75700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e8140820 con 0x7f83e805b960 2020-10-31T22:46:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83eff75700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e8140ac0 con 0x7f83e8141170 2020-10-31T22:46:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83ed510700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e80a7850 0x7f83e8143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83ed510700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e80a7850 0x7f83e8143550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44740/0 (socket says 172.21.15.60:44740) 2020-10-31T22:46:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83ed510700 1 -- 172.21.15.60:0/2722208875 learned_addr learned my addr 172.21.15.60:0/2722208875 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83ee512700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f83e8141170 0x7f83e8142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83edd11700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e805b960 0x7f83e80ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83ed510700 1 -- 172.21.15.60:0/2722208875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f83e8141170 msgr2=0x7f83e8142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83ed510700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f83e8141170 0x7f83e8142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83ed510700 1 -- 172.21.15.60:0/2722208875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e805b960 msgr2=0x7f83e80ad810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83ed510700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e805b960 0x7f83e80ad810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83ed510700 1 -- 172.21.15.60:0/2722208875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e8140d60 con 0x7f83e80a7850 2020-10-31T22:46:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83edd11700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e805b960 0x7f83e80ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83ed510700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e80a7850 0x7f83e8143550 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f83dc002f30 tx=0x7f83dc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:20.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83e6ffd700 1 -- 172.21.15.60:0/2722208875 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83dc011e00 con 0x7f83e80a7850 2020-10-31T22:46:20.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83e6ffd700 1 -- 172.21.15.60:0/2722208875 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83dc01d450 con 0x7f83e80a7850 2020-10-31T22:46:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83e6ffd700 1 -- 172.21.15.60:0/2722208875 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83dc01d7b0 con 0x7f83e80a7850 2020-10-31T22:46:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83eff75700 1 -- 172.21.15.60:0/2722208875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e80a9990 con 0x7f83e80a7850 2020-10-31T22:46:20.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.298+0000 7f83eff75700 1 -- 172.21.15.60:0/2722208875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e81430e0 con 0x7f83e80a7850 2020-10-31T22:46:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.302+0000 7f83eff75700 1 -- 172.21.15.60:0/2722208875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e8057100 con 0x7f83e80a7850 2020-10-31T22:46:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.302+0000 7f83e6ffd700 1 -- 172.21.15.60:0/2722208875 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f83dc00f070 con 0x7f83e80a7850 2020-10-31T22:46:20.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.302+0000 7f83e6ffd700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f83c8054f10 0x7f83c80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.302+0000 7f83e6ffd700 1 -- 172.21.15.60:0/2722208875 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f83dc06f5e0 con 0x7f83e80a7850 2020-10-31T22:46:20.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.302+0000 7f83edd11700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f83c8054f10 0x7f83c80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.302+0000 7f83edd11700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f83c8054f10 0x7f83c80573d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f83e000c000 tx=0x7f83e0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:20.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.310+0000 7f83e6ffd700 1 -- 172.21.15.60:0/2722208875 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f83dc045b00 con 0x7f83e80a7850 2020-10-31T22:46:20.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.454+0000 7f83eff75700 1 -- 172.21.15.60:0/2722208875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f83e805aa70 con 0x7f83e80a7850 2020-10-31T22:46:20.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.454+0000 7f83e6ffd700 1 -- 172.21.15.60:0/2722208875 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f83dc049120 con 0x7f83e80a7850 2020-10-31T22:46:20.457 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:20.458 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":64,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:46:19.876649+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:46:17.441669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2020-10-31T22:46:18.708444+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:46:20.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.458+0000 7f83eff75700 1 -- 172.21.15.60:0/2722208875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f83c8054f10 msgr2=0x7f83c80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.458+0000 7f83eff75700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f83c8054f10 0x7f83c80573d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f83e000c000 tx=0x7f83e0008040).stop 2020-10-31T22:46:20.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.458+0000 7f83eff75700 1 -- 172.21.15.60:0/2722208875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e80a7850 msgr2=0x7f83e8143550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.458+0000 7f83eff75700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e80a7850 0x7f83e8143550 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f83dc002f30 tx=0x7f83dc015000).stop 2020-10-31T22:46:20.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.458+0000 7f83eff75700 1 -- 172.21.15.60:0/2722208875 shutdown_connections 2020-10-31T22:46:20.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.458+0000 7f83eff75700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f83e8141170 0x7f83e8142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.458+0000 7f83eff75700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f83c8054f10 0x7f83c80573d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.458+0000 7f83eff75700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f83e805b960 0x7f83e80ad810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.458+0000 7f83eff75700 1 --2- 172.21.15.60:0/2722208875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f83e80a7850 0x7f83e8143550 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.458+0000 7f83eff75700 1 -- 172.21.15.60:0/2722208875 >> 172.21.15.60:0/2722208875 conn(0x7f83e806a260 msgr2=0x7f83e8149fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:20.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.458+0000 7f83eff75700 1 -- 172.21.15.60:0/2722208875 shutdown_connections 2020-10-31T22:46:20.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.458+0000 7f83eff75700 1 -- 172.21.15.60:0/2722208875 wait complete. 2020-10-31T22:46:20.472 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-10-31T22:46:20.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.594+0000 7f8a29cbf700 1 Processor -- start 2020-10-31T22:46:20.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.594+0000 7f8a29cbf700 1 -- start start 2020-10-31T22:46:20.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.594+0000 7f8a29cbf700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8a240b1d50 0x7f8a24145c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.594+0000 7f8a29cbf700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a240aef60 con 0x7f8a2405bc60 2020-10-31T22:46:20.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.594+0000 7f8a29cbf700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a240b2130 con 0x7f8a2405c2d0 2020-10-31T22:46:20.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.594+0000 7f8a29cbf700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a240afb20 con 0x7f8a240b1d50 2020-10-31T22:46:20.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a294be700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8a2405bc60 0x7f8a2413f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48886/0 (socket says 172.21.15.60:48886) 2020-10-31T22:46:20.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a294be700 1 -- 172.21.15.60:0/1874953380 learned_addr learned my addr 172.21.15.60:0/1874953380 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:20.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a28cbd700 1 --2- 172.21.15.60:0/1874953380 >> v2:172.21.15.66:3300/0 conn(0x7f8a240b1d50 0x7f8a24145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a237fe700 1 -- 172.21.15.60:0/1874953380 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883408154 0 0) 0x7f8a1c001450 con 0x7f8a2405bc60 2020-10-31T22:46:20.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a237fe700 1 -- 172.21.15.60:0/1874953380 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a10003230 con 0x7f8a2405bc60 2020-10-31T22:46:20.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a237fe700 1 -- 172.21.15.60:0/1874953380 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2940359607 0 0) 0x7f8a240b2130 con 0x7f8a2405c2d0 2020-10-31T22:46:20.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a237fe700 1 -- 172.21.15.60:0/1874953380 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a1c001450 con 0x7f8a2405c2d0 2020-10-31T22:46:20.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a28cbd700 1 -- 172.21.15.60:0/1874953380 >> v1:172.21.15.66:6789/0 conn(0x7f8a2405c2d0 legacy=0x7f8a240af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a28cbd700 1 -- 172.21.15.60:0/1874953380 >> v1:172.21.15.60:6789/0 conn(0x7f8a2405bc60 legacy=0x7f8a2413f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a237fe700 1 -- 172.21.15.60:0/1874953380 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3208717556 0 0) 0x7f8a10003230 con 0x7f8a2405bc60 2020-10-31T22:46:20.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a28cbd700 1 -- 172.21.15.60:0/1874953380 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2405afe0 con 0x7f8a240b1d50 2020-10-31T22:46:20.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a28cbd700 1 --2- 172.21.15.60:0/1874953380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a240b1d50 0x7f8a24145c70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f8a1c001d80 tx=0x7f8a14006dc0).ready entity=mon.1 client_cookie=fd5a4e7072421408 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:20.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a237fe700 1 -- 172.21.15.60:0/1874953380 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a1c001be0 con 0x7f8a240b1d50 2020-10-31T22:46:20.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a237fe700 1 -- 172.21.15.60:0/1874953380 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1400d610 con 0x7f8a240b1d50 2020-10-31T22:46:20.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a237fe700 1 -- 172.21.15.60:0/1874953380 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a1400d780 con 0x7f8a240b1d50 2020-10-31T22:46:20.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a29cbf700 1 -- 172.21.15.60:0/1874953380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a240b1d50 msgr2=0x7f8a24145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a29cbf700 1 --2- 172.21.15.60:0/1874953380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a240b1d50 0x7f8a24145c70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f8a1c001d80 tx=0x7f8a14006dc0).stop 2020-10-31T22:46:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a29cbf700 1 -- 172.21.15.60:0/1874953380 shutdown_connections 2020-10-31T22:46:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a29cbf700 1 --2- 172.21.15.60:0/1874953380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a240b1d50 0x7f8a24145c70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a29cbf700 1 -- 172.21.15.60:0/1874953380 >> 172.21.15.60:0/1874953380 conn(0x7f8a240b5330 msgr2=0x7f8a240b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a29cbf700 1 -- 172.21.15.60:0/1874953380 shutdown_connections 2020-10-31T22:46:20.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a29cbf700 1 -- 172.21.15.60:0/1874953380 wait complete. 2020-10-31T22:46:20.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a29cbf700 1 Processor -- start 2020-10-31T22:46:20.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.598+0000 7f8a29cbf700 1 -- start start 2020-10-31T22:46:20.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a29cbf700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a2405bc60 0x7f8a2413ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a29cbf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a2405c2d0 0x7f8a24147b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a29cbf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a240b1d50 0x7f8a24146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a29cbf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a24154170 con 0x7f8a2405c2d0 2020-10-31T22:46:20.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a29cbf700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a24154410 con 0x7f8a2405bc60 2020-10-31T22:46:20.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a29cbf700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a241546b0 con 0x7f8a240b1d50 2020-10-31T22:46:20.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a23fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a2405c2d0 0x7f8a24147b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a23fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a2405c2d0 0x7f8a24147b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44754/0 (socket says 172.21.15.60:44754) 2020-10-31T22:46:20.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a23fff700 1 -- 172.21.15.60:0/735740159 learned_addr learned my addr 172.21.15.60:0/735740159 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:20.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a28cbd700 1 --2- 172.21.15.60:0/735740159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a2405bc60 0x7f8a2413ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a294be700 1 --2- 172.21.15.60:0/735740159 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a240b1d50 0x7f8a24146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a23fff700 1 -- 172.21.15.60:0/735740159 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a240b1d50 msgr2=0x7f8a24146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a23fff700 1 --2- 172.21.15.60:0/735740159 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a240b1d50 0x7f8a24146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a23fff700 1 -- 172.21.15.60:0/735740159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a2405bc60 msgr2=0x7f8a2413ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a23fff700 1 --2- 172.21.15.60:0/735740159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a2405bc60 0x7f8a2413ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a23fff700 1 -- 172.21.15.60:0/735740159 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a24154950 con 0x7f8a2405c2d0 2020-10-31T22:46:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a23fff700 1 --2- 172.21.15.60:0/735740159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a2405c2d0 0x7f8a24147b20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f8a180010d0 tx=0x7f8a18007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a21ffb700 1 -- 172.21.15.60:0/735740159 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a1800f470 con 0x7f8a2405c2d0 2020-10-31T22:46:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a29cbf700 1 -- 172.21.15.60:0/735740159 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2413b230 con 0x7f8a2405c2d0 2020-10-31T22:46:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a21ffb700 1 -- 172.21.15.60:0/735740159 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1800f5d0 con 0x7f8a2405c2d0 2020-10-31T22:46:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a21ffb700 1 -- 172.21.15.60:0/735740159 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a1800f930 con 0x7f8a2405c2d0 2020-10-31T22:46:20.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a29cbf700 1 -- 172.21.15.60:0/735740159 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a24154df0 con 0x7f8a2405c2d0 2020-10-31T22:46:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.602+0000 7f8a29cbf700 1 -- 172.21.15.60:0/735740159 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a24057100 con 0x7f8a2405c2d0 2020-10-31T22:46:20.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.606+0000 7f8a21ffb700 1 -- 172.21.15.60:0/735740159 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8a18019030 con 0x7f8a2405c2d0 2020-10-31T22:46:20.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.606+0000 7f8a21ffb700 1 --2- 172.21.15.60:0/735740159 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8a04054f30 0x7f8a040573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:20.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.606+0000 7f8a21ffb700 1 -- 172.21.15.60:0/735740159 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8a1806ce70 con 0x7f8a2405c2d0 2020-10-31T22:46:20.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.606+0000 7f8a28cbd700 1 --2- 172.21.15.60:0/735740159 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8a04054f30 0x7f8a040573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:20.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.606+0000 7f8a28cbd700 1 --2- 172.21.15.60:0/735740159 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8a04054f30 0x7f8a040573f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f8a1401a000 tx=0x7f8a14015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:20.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.610+0000 7f8a21ffb700 1 -- 172.21.15.60:0/735740159 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8a180432f0 con 0x7f8a2405c2d0 2020-10-31T22:46:20.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.794+0000 7f8a29cbf700 1 -- 172.21.15.60:0/735740159 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8a24154ae0 con 0x7f8a2405c2d0 2020-10-31T22:46:20.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.882+0000 7f8a21ffb700 1 -- 172.21.15.60:0/735740159 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8a18046910 con 0x7f8a2405c2d0 2020-10-31T22:46:20.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.886+0000 7f8a29cbf700 1 -- 172.21.15.60:0/735740159 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8a04054f30 msgr2=0x7f8a040573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.886+0000 7f8a29cbf700 1 --2- 172.21.15.60:0/735740159 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8a04054f30 0x7f8a040573f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f8a1401a000 tx=0x7f8a14015000).stop 2020-10-31T22:46:20.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.886+0000 7f8a29cbf700 1 -- 172.21.15.60:0/735740159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a2405c2d0 msgr2=0x7f8a24147b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:20.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.886+0000 7f8a29cbf700 1 --2- 172.21.15.60:0/735740159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a2405c2d0 0x7f8a24147b20 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f8a180010d0 tx=0x7f8a18007a20).stop 2020-10-31T22:46:20.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.886+0000 7f8a29cbf700 1 -- 172.21.15.60:0/735740159 shutdown_connections 2020-10-31T22:46:20.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.886+0000 7f8a29cbf700 1 --2- 172.21.15.60:0/735740159 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a240b1d50 0x7f8a24146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.886+0000 7f8a29cbf700 1 --2- 172.21.15.60:0/735740159 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8a04054f30 0x7f8a040573f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.886+0000 7f8a29cbf700 1 --2- 172.21.15.60:0/735740159 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a2405bc60 0x7f8a2413ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.886+0000 7f8a29cbf700 1 --2- 172.21.15.60:0/735740159 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a2405c2d0 0x7f8a24147b20 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:20.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.886+0000 7f8a29cbf700 1 -- 172.21.15.60:0/735740159 >> 172.21.15.60:0/735740159 conn(0x7f8a240b5330 msgr2=0x7f8a240b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:20.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.886+0000 7f8a29cbf700 1 -- 172.21.15.60:0/735740159 shutdown_connections 2020-10-31T22:46:20.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:20.886+0000 7f8a29cbf700 1 -- 172.21.15.60:0/735740159 wait complete. 2020-10-31T22:46:20.903 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:46:21.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.010+0000 7f95eaa80700 1 Processor -- start 2020-10-31T22:46:21.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.010+0000 7f95eaa80700 1 -- start start 2020-10-31T22:46:21.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.010+0000 7f95eaa80700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f95e40b24a0 0x7f95e40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.010+0000 7f95eaa80700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95e4141fe0 0x7f95e4142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.010+0000 7f95eaa80700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95e4145180 con 0x7f95e40b5570 2020-10-31T22:46:21.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.010+0000 7f95eaa80700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95e40afae0 con 0x7f95e40b24a0 2020-10-31T22:46:21.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.010+0000 7f95eaa80700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e4141bf0 con 0x7f95e4141fe0 2020-10-31T22:46:21.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.010+0000 7f95e927d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f95e40b24a0 0x7f95e40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.010+0000 7f95e927d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f95e40b24a0 0x7f95e40b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44760/0 (socket says 172.21.15.60:44760) 2020-10-31T22:46:21.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.010+0000 7f95e9a7e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f95e40b5570 0x7f95e4145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48898/0 (socket says 172.21.15.60:48898) 2020-10-31T22:46:21.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.010+0000 7f95e927d700 1 -- 172.21.15.60:0/500973265 learned_addr learned my addr 172.21.15.60:0/500973265 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:21.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95ea27f700 1 --2- 172.21.15.60:0/500973265 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95e4141fe0 0x7f95e4142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95e927d700 1 -- 172.21.15.60:0/500973265 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95e4141fe0 msgr2=0x7f95e4142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95e927d700 1 --2- 172.21.15.60:0/500973265 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95e4141fe0 0x7f95e4142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95e927d700 1 -- 172.21.15.60:0/500973265 >> v1:172.21.15.60:6789/0 conn(0x7f95e40b5570 legacy=0x7f95e4145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95e8a7c700 1 -- 172.21.15.60:0/500973265 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2821243742 0 0) 0x7f95e4145180 con 0x7f95e40b5570 2020-10-31T22:46:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95e927d700 1 -- 172.21.15.60:0/500973265 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e40b0670 con 0x7f95e40b24a0 2020-10-31T22:46:21.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95e927d700 1 --2- 172.21.15.60:0/500973265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40b24a0 0x7f95e40b5950 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f95e405f580 tx=0x7f95e0006e80).ready entity=mon.0 client_cookie=bcebeaec556bbcd7 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:21.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95e8a7c700 1 -- 172.21.15.60:0/500973265 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e00097b0 con 0x7f95e40b24a0 2020-10-31T22:46:21.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95e8a7c700 1 -- 172.21.15.60:0/500973265 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e0009910 con 0x7f95e40b24a0 2020-10-31T22:46:21.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95e8a7c700 1 -- 172.21.15.60:0/500973265 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95e0009c70 con 0x7f95e40b24a0 2020-10-31T22:46:21.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95eaa80700 1 -- 172.21.15.60:0/500973265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40b24a0 msgr2=0x7f95e40b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95eaa80700 1 --2- 172.21.15.60:0/500973265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40b24a0 0x7f95e40b5950 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f95e405f580 tx=0x7f95e0006e80).stop 2020-10-31T22:46:21.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95eaa80700 1 -- 172.21.15.60:0/500973265 shutdown_connections 2020-10-31T22:46:21.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95eaa80700 1 --2- 172.21.15.60:0/500973265 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95e4141fe0 0x7f95e4142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95eaa80700 1 --2- 172.21.15.60:0/500973265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40b24a0 0x7f95e40b5950 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95eaa80700 1 -- 172.21.15.60:0/500973265 >> 172.21.15.60:0/500973265 conn(0x7f95e40b8e90 msgr2=0x7f95e40b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95eaa80700 1 -- 172.21.15.60:0/500973265 shutdown_connections 2020-10-31T22:46:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.014+0000 7f95eaa80700 1 -- 172.21.15.60:0/500973265 wait complete. 2020-10-31T22:46:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95eaa80700 1 Processor -- start 2020-10-31T22:46:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95eaa80700 1 -- start start 2020-10-31T22:46:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95eaa80700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40b24a0 0x7f95e4138870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95eaa80700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95e40b5570 0x7f95e41507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95eaa80700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95e4141fe0 0x7f95e4150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95eaa80700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e4153d60 con 0x7f95e40b24a0 2020-10-31T22:46:21.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95eaa80700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e4154000 con 0x7f95e4141fe0 2020-10-31T22:46:21.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95eaa80700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e41542a0 con 0x7f95e40b5570 2020-10-31T22:46:21.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95e9a7e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40b24a0 0x7f95e4138870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95e9a7e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40b24a0 0x7f95e4138870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44766/0 (socket says 172.21.15.60:44766) 2020-10-31T22:46:21.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95e9a7e700 1 -- 172.21.15.60:0/461281944 learned_addr learned my addr 172.21.15.60:0/461281944 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:21.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95e927d700 1 --2- 172.21.15.60:0/461281944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95e40b5570 0x7f95e41507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95ea27f700 1 --2- 172.21.15.60:0/461281944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95e4141fe0 0x7f95e4150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95e9a7e700 1 -- 172.21.15.60:0/461281944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95e40b5570 msgr2=0x7f95e41507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95e9a7e700 1 --2- 172.21.15.60:0/461281944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95e40b5570 0x7f95e41507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95e9a7e700 1 -- 172.21.15.60:0/461281944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95e4141fe0 msgr2=0x7f95e4150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95e9a7e700 1 --2- 172.21.15.60:0/461281944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95e4141fe0 0x7f95e4150c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95e9a7e700 1 -- 172.21.15.60:0/461281944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4154540 con 0x7f95e40b24a0 2020-10-31T22:46:21.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95e9a7e700 1 --2- 172.21.15.60:0/461281944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40b24a0 0x7f95e4138870 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f95d8000e90 tx=0x7f95d8007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:21.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95d6ffd700 1 -- 172.21.15.60:0/461281944 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95d80072e0 con 0x7f95e40b24a0 2020-10-31T22:46:21.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95d6ffd700 1 -- 172.21.15.60:0/461281944 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d8005520 con 0x7f95e40b24a0 2020-10-31T22:46:21.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95d6ffd700 1 -- 172.21.15.60:0/461281944 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f95d8005880 con 0x7f95e40b24a0 2020-10-31T22:46:21.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95eaa80700 1 -- 172.21.15.60:0/461281944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95e4144ea0 con 0x7f95e40b24a0 2020-10-31T22:46:21.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95eaa80700 1 -- 172.21.15.60:0/461281944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95e4138f30 con 0x7f95e40b24a0 2020-10-31T22:46:21.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.018+0000 7f95eaa80700 1 -- 172.21.15.60:0/461281944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95e4057100 con 0x7f95e40b24a0 2020-10-31T22:46:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.022+0000 7f95d6ffd700 1 -- 172.21.15.60:0/461281944 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f95d8010070 con 0x7f95e40b24a0 2020-10-31T22:46:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.022+0000 7f95d6ffd700 1 --2- 172.21.15.60:0/461281944 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f95c4054f10 0x7f95c40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.022+0000 7f95d6ffd700 1 -- 172.21.15.60:0/461281944 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f95d806d230 con 0x7f95e40b24a0 2020-10-31T22:46:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.022+0000 7f95e927d700 1 --2- 172.21.15.60:0/461281944 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f95c4054f10 0x7f95c40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.022+0000 7f95e927d700 1 --2- 172.21.15.60:0/461281944 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f95c4054f10 0x7f95c40573d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f95e001c000 tx=0x7f95e0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:21.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.026+0000 7f95d6ffd700 1 -- 172.21.15.60:0/461281944 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f95d8043640 con 0x7f95e40b24a0 2020-10-31T22:46:21.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.214+0000 7f95eaa80700 1 -- 172.21.15.60:0/461281944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95e405a8e0 con 0x7f95e40b24a0 2020-10-31T22:46:21.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.214+0000 7f95d6ffd700 1 -- 172.21.15.60:0/461281944 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f95d8046c60 con 0x7f95e40b24a0 2020-10-31T22:46:21.216 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:21.216 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2411188619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2411188619},{"type":"v1","addr":"172.21.15.60:6835","nonce":2411188619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26},{"gid":5880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/507121609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":507121609},{"type":"v1","addr":"172.21.15.66:6833","nonce":507121609}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:46:19.877041+0000","modified":"2020-10-31T22:46:20.880233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2545916146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2545916146},{"type":"v1","addr":"172.21.15.60:6837","nonce":2545916146}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-10-31T22:46:21.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.218+0000 7f95eaa80700 1 -- 172.21.15.60:0/461281944 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f95c4054f10 msgr2=0x7f95c40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.218+0000 7f95eaa80700 1 --2- 172.21.15.60:0/461281944 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f95c4054f10 0x7f95c40573d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f95e001c000 tx=0x7f95e0015000).stop 2020-10-31T22:46:21.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.218+0000 7f95eaa80700 1 -- 172.21.15.60:0/461281944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40b24a0 msgr2=0x7f95e4138870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.218+0000 7f95eaa80700 1 --2- 172.21.15.60:0/461281944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40b24a0 0x7f95e4138870 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f95d8000e90 tx=0x7f95d8007a00).stop 2020-10-31T22:46:21.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.218+0000 7f95eaa80700 1 -- 172.21.15.60:0/461281944 shutdown_connections 2020-10-31T22:46:21.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.218+0000 7f95eaa80700 1 --2- 172.21.15.60:0/461281944 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f95c4054f10 0x7f95c40573d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.218+0000 7f95eaa80700 1 --2- 172.21.15.60:0/461281944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95e4141fe0 0x7f95e4150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.218+0000 7f95eaa80700 1 --2- 172.21.15.60:0/461281944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95e40b24a0 0x7f95e4138870 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.218+0000 7f95eaa80700 1 --2- 172.21.15.60:0/461281944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95e40b5570 0x7f95e41507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.218+0000 7f95eaa80700 1 -- 172.21.15.60:0/461281944 >> 172.21.15.60:0/461281944 conn(0x7f95e40b8e90 msgr2=0x7f95e40b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:21.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.218+0000 7f95eaa80700 1 -- 172.21.15.60:0/461281944 shutdown_connections 2020-10-31T22:46:21.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.218+0000 7f95eaa80700 1 -- 172.21.15.60:0/461281944 wait complete. 2020-10-31T22:46:21.220 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2020-10-31T22:46:21.230 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:46:21.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.338+0000 7fed28e64700 1 Processor -- start 2020-10-31T22:46:21.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.338+0000 7fed28e64700 1 -- start start 2020-10-31T22:46:21.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.338+0000 7fed28e64700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fed240b5570 0x7fed240b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.338+0000 7fed28e64700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed240b24a0 0x7fed24145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.338+0000 7fed28e64700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed24145180 con 0x7fed24145d10 2020-10-31T22:46:21.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.338+0000 7fed28e64700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed240afae0 con 0x7fed240b5570 2020-10-31T22:46:21.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.338+0000 7fed28e64700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed24141bf0 con 0x7fed240b24a0 2020-10-31T22:46:21.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.338+0000 7fed237fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fed240b5570 0x7fed240b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.338+0000 7fed23fff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fed24145d10 0x7fed24141fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:46782/0 (socket says 172.21.15.60:46782) 2020-10-31T22:46:21.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.338+0000 7fed22ffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed240b24a0 0x7fed24145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.338+0000 7fed23fff700 1 -- 172.21.15.60:0/185422323 learned_addr learned my addr 172.21.15.60:0/185422323 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:21.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.342+0000 7fed22ffd700 1 -- 172.21.15.60:0/185422323 >> v2:172.21.15.60:3300/0 conn(0x7fed240b5570 msgr2=0x7fed240b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:21.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.342+0000 7fed22ffd700 1 --2- 172.21.15.60:0/185422323 >> v2:172.21.15.60:3300/0 conn(0x7fed240b5570 0x7fed240b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.342+0000 7fed22ffd700 1 -- 172.21.15.60:0/185422323 >> v1:172.21.15.66:6789/0 conn(0x7fed24145d10 legacy=0x7fed24141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.342+0000 7fed22ffd700 1 -- 172.21.15.60:0/185422323 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed240b0670 con 0x7fed240b24a0 2020-10-31T22:46:21.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.342+0000 7fed22ffd700 1 --2- 172.21.15.60:0/185422323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed240b24a0 0x7fed24145820 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fed14002f30 tx=0x7fed14006dc0).ready entity=mon.2 client_cookie=806c7c8523165cb8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:21.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.342+0000 7fed227fc700 1 -- 172.21.15.60:0/185422323 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed14009760 con 0x7fed240b24a0 2020-10-31T22:46:21.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.346+0000 7fed227fc700 1 -- 172.21.15.60:0/185422323 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed140098c0 con 0x7fed240b24a0 2020-10-31T22:46:21.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.346+0000 7fed227fc700 1 -- 172.21.15.60:0/185422323 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed14009c20 con 0x7fed240b24a0 2020-10-31T22:46:21.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.346+0000 7fed28e64700 1 -- 172.21.15.60:0/185422323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed240b24a0 msgr2=0x7fed24145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.346+0000 7fed28e64700 1 --2- 172.21.15.60:0/185422323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed240b24a0 0x7fed24145820 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fed14002f30 tx=0x7fed14006dc0).stop 2020-10-31T22:46:21.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.346+0000 7fed28e64700 1 -- 172.21.15.60:0/185422323 shutdown_connections 2020-10-31T22:46:21.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.346+0000 7fed28e64700 1 --2- 172.21.15.60:0/185422323 >> v2:172.21.15.60:3300/0 conn(0x7fed240b5570 0x7fed240b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.346+0000 7fed28e64700 1 --2- 172.21.15.60:0/185422323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed240b24a0 0x7fed24145820 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.346+0000 7fed28e64700 1 -- 172.21.15.60:0/185422323 >> 172.21.15.60:0/185422323 conn(0x7fed240b8e90 msgr2=0x7fed240b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:21.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.346+0000 7fed28e64700 1 -- 172.21.15.60:0/185422323 shutdown_connections 2020-10-31T22:46:21.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.346+0000 7fed28e64700 1 -- 172.21.15.60:0/185422323 wait complete. 2020-10-31T22:46:21.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed28e64700 1 Processor -- start 2020-10-31T22:46:21.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed28e64700 1 -- start start 2020-10-31T22:46:21.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed28e64700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed240b24a0 0x7fed24139590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed28e64700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed240b5570 0x7fed24141380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed28e64700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed24145d10 0x7fed24151320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed28e64700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed241411f0 con 0x7fed240b24a0 2020-10-31T22:46:21.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed28e64700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed2413a1f0 con 0x7fed240b5570 2020-10-31T22:46:21.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed28e64700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed24154d30 con 0x7fed24145d10 2020-10-31T22:46:21.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed237fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed240b24a0 0x7fed24139590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed237fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed240b24a0 0x7fed24139590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44784/0 (socket says 172.21.15.60:44784) 2020-10-31T22:46:21.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed237fe700 1 -- 172.21.15.60:0/3680190950 learned_addr learned my addr 172.21.15.60:0/3680190950 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:21.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed23fff700 1 --2- 172.21.15.60:0/3680190950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed24145d10 0x7fed24151320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed22ffd700 1 --2- 172.21.15.60:0/3680190950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed240b5570 0x7fed24141380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed237fe700 1 -- 172.21.15.60:0/3680190950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed24145d10 msgr2=0x7fed24151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed237fe700 1 --2- 172.21.15.60:0/3680190950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed24145d10 0x7fed24151320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed237fe700 1 -- 172.21.15.60:0/3680190950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed240b5570 msgr2=0x7fed24141380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed237fe700 1 --2- 172.21.15.60:0/3680190950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed240b5570 0x7fed24141380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed237fe700 1 -- 172.21.15.60:0/3680190950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed24154fd0 con 0x7fed240b24a0 2020-10-31T22:46:21.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed237fe700 1 --2- 172.21.15.60:0/3680190950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed240b24a0 0x7fed24139590 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fed1800c000 tx=0x7fed18006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:21.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed20ff9700 1 -- 172.21.15.60:0/3680190950 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed1800ca10 con 0x7fed240b24a0 2020-10-31T22:46:21.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed20ff9700 1 -- 172.21.15.60:0/3680190950 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1800cb70 con 0x7fed240b24a0 2020-10-31T22:46:21.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed28e64700 1 -- 172.21.15.60:0/3680190950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed24139d50 con 0x7fed240b24a0 2020-10-31T22:46:21.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed20ff9700 1 -- 172.21.15.60:0/3680190950 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed180123f0 con 0x7fed240b24a0 2020-10-31T22:46:21.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.350+0000 7fed28e64700 1 -- 172.21.15.60:0/3680190950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2413bcc0 con 0x7fed240b24a0 2020-10-31T22:46:21.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.354+0000 7fed28e64700 1 -- 172.21.15.60:0/3680190950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed24057100 con 0x7fed240b24a0 2020-10-31T22:46:21.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.354+0000 7fed20ff9700 1 -- 172.21.15.60:0/3680190950 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fed18012550 con 0x7fed240b24a0 2020-10-31T22:46:21.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.354+0000 7fed20ff9700 1 --2- 172.21.15.60:0/3680190950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fed04054f10 0x7fed040573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.354+0000 7fed20ff9700 1 -- 172.21.15.60:0/3680190950 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fed1806dd70 con 0x7fed240b24a0 2020-10-31T22:46:21.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.354+0000 7fed22ffd700 1 --2- 172.21.15.60:0/3680190950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fed04054f10 0x7fed040573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.354+0000 7fed22ffd700 1 --2- 172.21.15.60:0/3680190950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fed04054f10 0x7fed040573d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fed1401a000 tx=0x7fed14015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:21.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.362+0000 7fed20ff9700 1 -- 172.21.15.60:0/3680190950 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fed18044230 con 0x7fed240b24a0 2020-10-31T22:46:21.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.506+0000 7fed28e64700 1 -- 172.21.15.60:0/3680190950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed24139370 con 0x7fed240b24a0 2020-10-31T22:46:21.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.506+0000 7fed20ff9700 1 -- 172.21.15.60:0/3680190950 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fed18047850 con 0x7fed240b24a0 2020-10-31T22:46:21.510 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:21.510 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":65,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:46:20.880954+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:46:17.441669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2020-10-31T22:46:18.708444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:46:21.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.510+0000 7fed28e64700 1 -- 172.21.15.60:0/3680190950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fed04054f10 msgr2=0x7fed040573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.510+0000 7fed28e64700 1 --2- 172.21.15.60:0/3680190950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fed04054f10 0x7fed040573d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fed1401a000 tx=0x7fed14015000).stop 2020-10-31T22:46:21.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.510+0000 7fed28e64700 1 -- 172.21.15.60:0/3680190950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed240b24a0 msgr2=0x7fed24139590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.510+0000 7fed28e64700 1 --2- 172.21.15.60:0/3680190950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed240b24a0 0x7fed24139590 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fed1800c000 tx=0x7fed18006dc0).stop 2020-10-31T22:46:21.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.510+0000 7fed28e64700 1 -- 172.21.15.60:0/3680190950 shutdown_connections 2020-10-31T22:46:21.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.510+0000 7fed28e64700 1 --2- 172.21.15.60:0/3680190950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed24145d10 0x7fed24151320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.510+0000 7fed28e64700 1 --2- 172.21.15.60:0/3680190950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed240b24a0 0x7fed24139590 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.510+0000 7fed28e64700 1 --2- 172.21.15.60:0/3680190950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fed04054f10 0x7fed040573d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.510+0000 7fed28e64700 1 --2- 172.21.15.60:0/3680190950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed240b5570 0x7fed24141380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.510+0000 7fed28e64700 1 -- 172.21.15.60:0/3680190950 >> 172.21.15.60:0/3680190950 conn(0x7fed240b8e90 msgr2=0x7fed240b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:21.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.510+0000 7fed28e64700 1 -- 172.21.15.60:0/3680190950 shutdown_connections 2020-10-31T22:46:21.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.510+0000 7fed28e64700 1 -- 172.21.15.60:0/3680190950 wait complete. 2020-10-31T22:46:21.524 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:46:21.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f7471bb8700 1 Processor -- start 2020-10-31T22:46:21.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f7471bb8700 1 -- start start 2020-10-31T22:46:21.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f7471bb8700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f746c05b320 0x7f746c07ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f7471bb8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746c05b700 con 0x7f746c0ae200 2020-10-31T22:46:21.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f7471bb8700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746c0807c0 con 0x7f746c0ac110 2020-10-31T22:46:21.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f7471bb8700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746c0ab730 con 0x7f746c05b320 2020-10-31T22:46:21.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f746b7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f746c0ae200 0x7f746c0a74b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48926/0 (socket says 172.21.15.60:48926) 2020-10-31T22:46:21.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f746b7fe700 1 -- 172.21.15.60:0/4215127856 learned_addr learned my addr 172.21.15.60:0/4215127856 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:21.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f746bfff700 1 --2- 172.21.15.60:0/4215127856 >> v2:172.21.15.66:3300/0 conn(0x7f746c05b320 0x7f746c07ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f746affd700 1 -- 172.21.15.60:0/4215127856 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2824042266 0 0) 0x7f746c05b700 con 0x7f746c0ae200 2020-10-31T22:46:21.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f746affd700 1 -- 172.21.15.60:0/4215127856 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7458003230 con 0x7f746c0ae200 2020-10-31T22:46:21.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f746bfff700 1 -- 172.21.15.60:0/4215127856 >> v1:172.21.15.66:6789/0 conn(0x7f746c0ac110 legacy=0x7f746c0af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f746bfff700 1 -- 172.21.15.60:0/4215127856 >> v1:172.21.15.60:6789/0 conn(0x7f746c0ae200 legacy=0x7f746c0a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f746bfff700 1 -- 172.21.15.60:0/4215127856 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c0ab9d0 con 0x7f746c05b320 2020-10-31T22:46:21.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f746bfff700 1 --2- 172.21.15.60:0/4215127856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c05b320 0x7f746c07ff20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f74640032b0 tx=0x7f74640091a0).ready entity=mon.1 client_cookie=b62c359d4839e015 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:21.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f746affd700 1 -- 172.21.15.60:0/4215127856 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f746400b9a0 con 0x7f746c05b320 2020-10-31T22:46:21.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f746affd700 1 -- 172.21.15.60:0/4215127856 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746400bb00 con 0x7f746c05b320 2020-10-31T22:46:21.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f7471bb8700 1 -- 172.21.15.60:0/4215127856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c05b320 msgr2=0x7f746c07ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f7471bb8700 1 --2- 172.21.15.60:0/4215127856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c05b320 0x7f746c07ff20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f74640032b0 tx=0x7f74640091a0).stop 2020-10-31T22:46:21.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.650+0000 7f746affd700 1 -- 172.21.15.60:0/4215127856 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f746400bc70 con 0x7f746c05b320 2020-10-31T22:46:21.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7471bb8700 1 -- 172.21.15.60:0/4215127856 shutdown_connections 2020-10-31T22:46:21.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7471bb8700 1 --2- 172.21.15.60:0/4215127856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c05b320 0x7f746c07ff20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7471bb8700 1 -- 172.21.15.60:0/4215127856 >> 172.21.15.60:0/4215127856 conn(0x7f746c0b3fd0 msgr2=0x7f746c0b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:21.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7471bb8700 1 -- 172.21.15.60:0/4215127856 shutdown_connections 2020-10-31T22:46:21.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7471bb8700 1 -- 172.21.15.60:0/4215127856 wait complete. 2020-10-31T22:46:21.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7471bb8700 1 Processor -- start 2020-10-31T22:46:21.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7471bb8700 1 -- start start 2020-10-31T22:46:21.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7471bb8700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c05b320 0x7f746c062100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7471bb8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f746c0ac110 0x7f746c13df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7471bb8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f746c0ae200 0x7f746c13e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7471bb8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c13d830 con 0x7f746c0ae200 2020-10-31T22:46:21.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7471bb8700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746c0a7280 con 0x7f746c05b320 2020-10-31T22:46:21.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7471bb8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746c0a7520 con 0x7f746c0ac110 2020-10-31T22:46:21.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7470956700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f746c0ae200 0x7f746c13e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7470956700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f746c0ae200 0x7f746c13e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44796/0 (socket says 172.21.15.60:44796) 2020-10-31T22:46:21.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7470956700 1 -- 172.21.15.60:0/1414924918 learned_addr learned my addr 172.21.15.60:0/1414924918 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:21.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f746bfff700 1 --2- 172.21.15.60:0/1414924918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c05b320 0x7f746c062100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f746b7fe700 1 --2- 172.21.15.60:0/1414924918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f746c0ac110 0x7f746c13df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7470956700 1 -- 172.21.15.60:0/1414924918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f746c0ac110 msgr2=0x7f746c13df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7470956700 1 --2- 172.21.15.60:0/1414924918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f746c0ac110 0x7f746c13df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7470956700 1 -- 172.21.15.60:0/1414924918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c05b320 msgr2=0x7f746c062100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.654+0000 7f7470956700 1 --2- 172.21.15.60:0/1414924918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c05b320 0x7f746c062100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.658+0000 7f7470956700 1 -- 172.21.15.60:0/1414924918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746c0a77c0 con 0x7f746c0ae200 2020-10-31T22:46:21.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.658+0000 7f7470956700 1 --2- 172.21.15.60:0/1414924918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f746c0ae200 0x7f746c13e460 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f746c0b3ee0 tx=0x7f745c007b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:21.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.658+0000 7f7468ff9700 1 -- 172.21.15.60:0/1414924918 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f745c013450 con 0x7f746c0ae200 2020-10-31T22:46:21.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.658+0000 7f7468ff9700 1 -- 172.21.15.60:0/1414924918 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c0135b0 con 0x7f746c0ae200 2020-10-31T22:46:21.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.658+0000 7f7471bb8700 1 -- 172.21.15.60:0/1414924918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746c0ab110 con 0x7f746c0ae200 2020-10-31T22:46:21.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.658+0000 7f7468ff9700 1 -- 172.21.15.60:0/1414924918 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f745c013910 con 0x7f746c0ae200 2020-10-31T22:46:21.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.658+0000 7f7471bb8700 1 -- 172.21.15.60:0/1414924918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f746c066740 con 0x7f746c0ae200 2020-10-31T22:46:21.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.658+0000 7f7471bb8700 1 -- 172.21.15.60:0/1414924918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7444003340 con 0x7f746c0ae200 2020-10-31T22:46:21.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.658+0000 7f7468ff9700 1 -- 172.21.15.60:0/1414924918 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f745c010070 con 0x7f746c0ae200 2020-10-31T22:46:21.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.658+0000 7f7468ff9700 1 --2- 172.21.15.60:0/1414924918 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7450055050 0x7f7450057510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:21.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.658+0000 7f7468ff9700 1 -- 172.21.15.60:0/1414924918 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f745c06d100 con 0x7f746c0ae200 2020-10-31T22:46:21.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.662+0000 7f746bfff700 1 --2- 172.21.15.60:0/1414924918 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7450055050 0x7f7450057510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:21.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.662+0000 7f746bfff700 1 --2- 172.21.15.60:0/1414924918 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7450055050 0x7f7450057510 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f746401b000 tx=0x7f7464016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:21.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.666+0000 7f7468ff9700 1 -- 172.21.15.60:0/1414924918 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f745c043580 con 0x7f746c0ae200 2020-10-31T22:46:21.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.862+0000 7f7471bb8700 1 -- 172.21.15.60:0/1414924918 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7444002280 con 0x7f746c0ae200 2020-10-31T22:46:21.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.870+0000 7f7468ff9700 1 -- 172.21.15.60:0/1414924918 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v17) v1 ==== 184+0+0 (secure 0 0 0) 0x7f745c046ba0 con 0x7f746c0ae200 2020-10-31T22:46:21.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.870+0000 7f7471bb8700 1 -- 172.21.15.60:0/1414924918 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7450055050 msgr2=0x7f7450057510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.870+0000 7f7471bb8700 1 --2- 172.21.15.60:0/1414924918 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7450055050 0x7f7450057510 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7f746401b000 tx=0x7f7464016000).stop 2020-10-31T22:46:21.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.870+0000 7f7471bb8700 1 -- 172.21.15.60:0/1414924918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f746c0ae200 msgr2=0x7f746c13e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:21.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.870+0000 7f7471bb8700 1 --2- 172.21.15.60:0/1414924918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f746c0ae200 0x7f746c13e460 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f746c0b3ee0 tx=0x7f745c007b00).stop 2020-10-31T22:46:21.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.870+0000 7f7471bb8700 1 -- 172.21.15.60:0/1414924918 shutdown_connections 2020-10-31T22:46:21.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.870+0000 7f7471bb8700 1 --2- 172.21.15.60:0/1414924918 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f746c0ae200 0x7f746c13e460 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.870+0000 7f7471bb8700 1 --2- 172.21.15.60:0/1414924918 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7450055050 0x7f7450057510 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.870+0000 7f7471bb8700 1 --2- 172.21.15.60:0/1414924918 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f746c05b320 0x7f746c062100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.870+0000 7f7471bb8700 1 --2- 172.21.15.60:0/1414924918 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f746c0ac110 0x7f746c13df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:21.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.870+0000 7f7471bb8700 1 -- 172.21.15.60:0/1414924918 >> 172.21.15.60:0/1414924918 conn(0x7f746c0b3fd0 msgr2=0x7f746c1342d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.874+0000 7f7471bb8700 1 -- 172.21.15.60:0/1414924918 shutdown_connections 2020-10-31T22:46:21.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:21.874+0000 7f7471bb8700 1 -- 172.21.15.60:0/1414924918 wait complete. 2020-10-31T22:46:21.879 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2020-10-31T22:46:21.887 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:46:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8ffff700 1 Processor -- start 2020-10-31T22:46:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8ffff700 1 -- start start 2020-10-31T22:46:22.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feb900b1570 0x7feb90024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:22.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8ffff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb900b1950 con 0x7feb900803e0 2020-10-31T22:46:22.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8ffff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb90025910 con 0x7feb90025480 2020-10-31T22:46:22.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8ffff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb90080850 con 0x7feb900b1570 2020-10-31T22:46:22.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feb900b1570 0x7feb90024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:22.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feb900b1570 0x7feb90024f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44802/0 (socket says 172.21.15.60:44802) 2020-10-31T22:46:22.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8f7fe700 1 -- 172.21.15.60:0/411272065 learned_addr learned my addr 172.21.15.60:0/411272065 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:22.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb95551700 1 --1- 172.21.15.60:0/411272065 >> v1:172.21.15.60:6789/0 conn(0x7feb900803e0 0x7feb90159210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48942/0 (socket says 172.21.15.60:48942) 2020-10-31T22:46:22.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8f7fe700 1 -- 172.21.15.60:0/411272065 >> v1:172.21.15.66:6789/0 conn(0x7feb90025480 legacy=0x7feb9007fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:22.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8f7fe700 1 -- 172.21.15.60:0/411272065 >> v1:172.21.15.60:6789/0 conn(0x7feb900803e0 legacy=0x7feb90159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:22.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8f7fe700 1 -- 172.21.15.60:0/411272065 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90062720 con 0x7feb900b1570 2020-10-31T22:46:22.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8f7fe700 1 --2- 172.21.15.60:0/411272065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb900b1570 0x7feb90024f90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7feb800032b0 tx=0x7feb80009270).ready entity=mon.0 client_cookie=62e543e4e8053b3c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:22.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8e7fc700 1 -- 172.21.15.60:0/411272065 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb8000bc00 con 0x7feb900b1570 2020-10-31T22:46:22.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8e7fc700 1 -- 172.21.15.60:0/411272065 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8000bd60 con 0x7feb900b1570 2020-10-31T22:46:22.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8e7fc700 1 -- 172.21.15.60:0/411272065 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb80011400 con 0x7feb900b1570 2020-10-31T22:46:22.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8ffff700 1 -- 172.21.15.60:0/411272065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb900b1570 msgr2=0x7feb90024f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:22.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.006+0000 7feb8ffff700 1 --2- 172.21.15.60:0/411272065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb900b1570 0x7feb90024f90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7feb800032b0 tx=0x7feb80009270).stop 2020-10-31T22:46:22.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8ffff700 1 -- 172.21.15.60:0/411272065 shutdown_connections 2020-10-31T22:46:22.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8ffff700 1 --2- 172.21.15.60:0/411272065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb900b1570 0x7feb90024f90 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:22.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8ffff700 1 -- 172.21.15.60:0/411272065 >> 172.21.15.60:0/411272065 conn(0x7feb900b5440 msgr2=0x7feb900b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:22.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8ffff700 1 -- 172.21.15.60:0/411272065 shutdown_connections 2020-10-31T22:46:22.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8ffff700 1 -- 172.21.15.60:0/411272065 wait complete. 2020-10-31T22:46:22.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8ffff700 1 Processor -- start 2020-10-31T22:46:22.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8ffff700 1 -- start start 2020-10-31T22:46:22.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb90025480 0x7feb90133d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:22.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feb900803e0 0x7feb900a7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:22.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8ffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb900b1570 0x7feb900642e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:22.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb900a8390 con 0x7feb90025480 2020-10-31T22:46:22.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8ffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb90064b30 con 0x7feb900b1570 2020-10-31T22:46:22.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb90064dd0 con 0x7feb900803e0 2020-10-31T22:46:22.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb90025480 0x7feb90133d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:22.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb90025480 0x7feb90133d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44808/0 (socket says 172.21.15.60:44808) 2020-10-31T22:46:22.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8f7fe700 1 -- 172.21.15.60:0/823976065 learned_addr learned my addr 172.21.15.60:0/823976065 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:22.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8effd700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feb900803e0 0x7feb900a7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:22.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb95551700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb900b1570 0x7feb900642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:22.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8f7fe700 1 -- 172.21.15.60:0/823976065 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feb900803e0 msgr2=0x7feb900a7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:22.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8f7fe700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feb900803e0 0x7feb900a7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:22.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8f7fe700 1 -- 172.21.15.60:0/823976065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb900b1570 msgr2=0x7feb900642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:22.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8f7fe700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb900b1570 0x7feb900642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:22.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb8f7fe700 1 -- 172.21.15.60:0/823976065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90065070 con 0x7feb90025480 2020-10-31T22:46:22.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.010+0000 7feb95551700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb900b1570 0x7feb900642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:46:22.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.014+0000 7feb8f7fe700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb90025480 0x7feb90133d20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7feb800032b0 tx=0x7feb80016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:22.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.014+0000 7feb87fff700 1 -- 172.21.15.60:0/823976065 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb800106e0 con 0x7feb90025480 2020-10-31T22:46:22.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.014+0000 7feb87fff700 1 -- 172.21.15.60:0/823976065 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80010840 con 0x7feb90025480 2020-10-31T22:46:22.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.014+0000 7feb8ffff700 1 -- 172.21.15.60:0/823976065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb900a79b0 con 0x7feb90025480 2020-10-31T22:46:22.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.014+0000 7feb87fff700 1 -- 172.21.15.60:0/823976065 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb80010ba0 con 0x7feb90025480 2020-10-31T22:46:22.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.014+0000 7feb8ffff700 1 -- 172.21.15.60:0/823976065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb90065410 con 0x7feb90025480 2020-10-31T22:46:22.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.014+0000 7feb8ffff700 1 -- 172.21.15.60:0/823976065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb90064990 con 0x7feb90025480 2020-10-31T22:46:22.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.014+0000 7feb87fff700 1 -- 172.21.15.60:0/823976065 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7feb80026030 con 0x7feb90025480 2020-10-31T22:46:22.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.014+0000 7feb87fff700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7feb74054f00 0x7feb740573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:22.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.014+0000 7feb87fff700 1 -- 172.21.15.60:0/823976065 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feb8006e8d0 con 0x7feb90025480 2020-10-31T22:46:22.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.014+0000 7feb8effd700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7feb74054f00 0x7feb740573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:22.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.018+0000 7feb8effd700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7feb74054f00 0x7feb740573c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7feb7800b000 tx=0x7feb78009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:22.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.022+0000 7feb87fff700 1 -- 172.21.15.60:0/823976065 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7feb90064990 con 0x7feb90025480 2020-10-31T22:46:22.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.210+0000 7feb8ffff700 1 -- 172.21.15.60:0/823976065 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7feb90064990 con 0x7feb90025480 2020-10-31T22:46:22.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.218+0000 7feb87fff700 1 -- 172.21.15.60:0/823976065 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v18) v1 ==== 184+0+0 (secure 0 0 0) 0x7feb90064990 con 0x7feb90025480 2020-10-31T22:46:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.218+0000 7feb8ffff700 1 -- 172.21.15.60:0/823976065 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7feb74054f00 msgr2=0x7feb740573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.218+0000 7feb8ffff700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7feb74054f00 0x7feb740573c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7feb7800b000 tx=0x7feb78009040).stop 2020-10-31T22:46:22.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.218+0000 7feb8ffff700 1 -- 172.21.15.60:0/823976065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb90025480 msgr2=0x7feb90133d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.218+0000 7feb8ffff700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb90025480 0x7feb90133d20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7feb800032b0 tx=0x7feb80016000).stop 2020-10-31T22:46:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.222+0000 7feb8ffff700 1 -- 172.21.15.60:0/823976065 shutdown_connections 2020-10-31T22:46:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.222+0000 7feb8ffff700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7feb74054f00 0x7feb740573c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.222+0000 7feb8ffff700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feb900b1570 0x7feb900642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.222+0000 7feb8ffff700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feb90025480 0x7feb90133d20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:22.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.222+0000 7feb8ffff700 1 --2- 172.21.15.60:0/823976065 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feb900803e0 0x7feb900a7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:22.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.222+0000 7feb8ffff700 1 -- 172.21.15.60:0/823976065 >> 172.21.15.60:0/823976065 conn(0x7feb900b5440 msgr2=0x7feb900ae080 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:22.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.222+0000 7feb8ffff700 1 -- 172.21.15.60:0/823976065 shutdown_connections 2020-10-31T22:46:22.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.222+0000 7feb8ffff700 1 -- 172.21.15.60:0/823976065 wait complete. 2020-10-31T22:46:22.224 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.1 2020-10-31T22:46:22.236 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:46:22.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.354+0000 7f4c1a8bf700 1 Processor -- start 2020-10-31T22:46:22.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.354+0000 7f4c1a8bf700 1 -- start start 2020-10-31T22:46:22.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.354+0000 7f4c1a8bf700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4c1405b320 0x7f4c140b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:22.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.354+0000 7f4c1a8bf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c140acc80 0x7f4c140b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:22.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.354+0000 7f4c1a8bf700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1405b700 con 0x7f4c14140420 2020-10-31T22:46:22.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.354+0000 7f4c1a8bf700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c140b2830 con 0x7f4c140acc80 2020-10-31T22:46:22.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.354+0000 7f4c1a8bf700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c141408a0 con 0x7f4c1405b320 2020-10-31T22:46:22.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c190bc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4c14140420 0x7f4c140ad7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:48952/0 (socket says 172.21.15.60:48952) 2020-10-31T22:46:22.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c190bc700 1 -- 172.21.15.60:0/3357597538 learned_addr learned my addr 172.21.15.60:0/3357597538 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:22.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a0be700 1 --2- 172.21.15.60:0/3357597538 >> v2:172.21.15.60:3300/0 conn(0x7f4c140acc80 0x7f4c140b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:22.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c198bd700 1 --2- 172.21.15.60:0/3357597538 >> v2:172.21.15.66:3300/0 conn(0x7f4c1405b320 0x7f4c140b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:22.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c188bb700 1 -- 172.21.15.60:0/3357597538 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698598230 0 0) 0x7f4c1405b700 con 0x7f4c14140420 2020-10-31T22:46:22.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c188bb700 1 -- 172.21.15.60:0/3357597538 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4bfc003230 con 0x7f4c14140420 2020-10-31T22:46:22.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a0be700 1 -- 172.21.15.60:0/3357597538 >> v2:172.21.15.66:3300/0 conn(0x7f4c1405b320 msgr2=0x7f4c140b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:22.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a0be700 1 --2- 172.21.15.60:0/3357597538 >> v2:172.21.15.66:3300/0 conn(0x7f4c1405b320 0x7f4c140b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a0be700 1 -- 172.21.15.60:0/3357597538 >> v1:172.21.15.60:6789/0 conn(0x7f4c14140420 legacy=0x7f4c140ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a0be700 1 -- 172.21.15.60:0/3357597538 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c140b0220 con 0x7f4c140acc80 2020-10-31T22:46:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a0be700 1 --2- 172.21.15.60:0/3357597538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c140acc80 0x7f4c140b2340 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f4c0c0032b0 tx=0x7f4c0c0091a0).ready entity=mon.0 client_cookie=b849dea6924c59da server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:22.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c188bb700 1 -- 172.21.15.60:0/3357597538 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c0c00b940 con 0x7f4c140acc80 2020-10-31T22:46:22.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c188bb700 1 -- 172.21.15.60:0/3357597538 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c00baa0 con 0x7f4c140acc80 2020-10-31T22:46:22.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c188bb700 1 -- 172.21.15.60:0/3357597538 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c0c00bc10 con 0x7f4c140acc80 2020-10-31T22:46:22.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/3357597538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c140acc80 msgr2=0x7f4c140b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a8bf700 1 --2- 172.21.15.60:0/3357597538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c140acc80 0x7f4c140b2340 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7f4c0c0032b0 tx=0x7f4c0c0091a0).stop 2020-10-31T22:46:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/3357597538 shutdown_connections 2020-10-31T22:46:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a8bf700 1 --2- 172.21.15.60:0/3357597538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c140acc80 0x7f4c140b2340 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a8bf700 1 --2- 172.21.15.60:0/3357597538 >> v2:172.21.15.66:3300/0 conn(0x7f4c1405b320 0x7f4c140b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/3357597538 >> 172.21.15.60:0/3357597538 conn(0x7f4c140b61d0 msgr2=0x7f4c140b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:22.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/3357597538 shutdown_connections 2020-10-31T22:46:22.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/3357597538 wait complete. 2020-10-31T22:46:22.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a8bf700 1 Processor -- start 2020-10-31T22:46:22.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.358+0000 7f4c1a8bf700 1 -- start start 2020-10-31T22:46:22.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a8bf700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c1405b320 0x7f4c1413ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:22.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a8bf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c140acc80 0x7f4c140b4530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:22.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a8bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c14140420 0x7f4c14150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a8bf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1413b0f0 con 0x7f4c14140420 2020-10-31T22:46:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a8bf700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140b5e80 con 0x7f4c1405b320 2020-10-31T22:46:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a8bf700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c140611f0 con 0x7f4c140acc80 2020-10-31T22:46:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a0be700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c14140420 0x7f4c14150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a0be700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c14140420 0x7f4c14150cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44824/0 (socket says 172.21.15.60:44824) 2020-10-31T22:46:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a0be700 1 -- 172.21.15.60:0/981180434 learned_addr learned my addr 172.21.15.60:0/981180434 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:22.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c198bd700 1 --2- 172.21.15.60:0/981180434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c1405b320 0x7f4c1413ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c190bc700 1 --2- 172.21.15.60:0/981180434 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c140acc80 0x7f4c140b4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a0be700 1 -- 172.21.15.60:0/981180434 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c140acc80 msgr2=0x7f4c140b4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a0be700 1 --2- 172.21.15.60:0/981180434 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c140acc80 0x7f4c140b4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a0be700 1 -- 172.21.15.60:0/981180434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c1405b320 msgr2=0x7f4c1413ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a0be700 1 --2- 172.21.15.60:0/981180434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c1405b320 0x7f4c1413ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a0be700 1 -- 172.21.15.60:0/981180434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1413b320 con 0x7f4c14140420 2020-10-31T22:46:22.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a0be700 1 --2- 172.21.15.60:0/981180434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c14140420 0x7f4c14150cd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f4c0c0032b0 tx=0x7f4c0c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c06ffd700 1 -- 172.21.15.60:0/981180434 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c0c011d60 con 0x7f4c14140420 2020-10-31T22:46:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/981180434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1413c850 con 0x7f4c14140420 2020-10-31T22:46:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c06ffd700 1 -- 172.21.15.60:0/981180434 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c01f3f0 con 0x7f4c14140420 2020-10-31T22:46:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c06ffd700 1 -- 172.21.15.60:0/981180434 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c0c01f750 con 0x7f4c14140420 2020-10-31T22:46:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/981180434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c14140b20 con 0x7f4c14140420 2020-10-31T22:46:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.362+0000 7f4c06ffd700 1 -- 172.21.15.60:0/981180434 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4c0c026030 con 0x7f4c14140420 2020-10-31T22:46:22.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.366+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/981180434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1413c9e0 con 0x7f4c14140420 2020-10-31T22:46:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.366+0000 7f4c06ffd700 1 --2- 172.21.15.60:0/981180434 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4bf4054f10 0x7f4bf40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.366+0000 7f4c198bd700 1 --2- 172.21.15.60:0/981180434 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4bf4054f10 0x7f4bf40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.366+0000 7f4c06ffd700 1 -- 172.21.15.60:0/981180434 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4c0c06e510 con 0x7f4c14140420 2020-10-31T22:46:22.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.366+0000 7f4c198bd700 1 --2- 172.21.15.60:0/981180434 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4bf4054f10 0x7f4bf40573d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f4c1000b000 tx=0x7f4c10006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:22.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.370+0000 7f4c06ffd700 1 -- 172.21.15.60:0/981180434 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4c0c044990 con 0x7f4c14140420 2020-10-31T22:46:22.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.558+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/981180434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c14057100 con 0x7f4c14140420 2020-10-31T22:46:23.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.562+0000 7f4c06ffd700 1 -- 172.21.15.60:0/981180434 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f4c0c0249d0 con 0x7f4c14140420 2020-10-31T22:46:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.562+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/981180434 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4bf4054f10 msgr2=0x7f4bf40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.562+0000 7f4c1a8bf700 1 --2- 172.21.15.60:0/981180434 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4bf4054f10 0x7f4bf40573d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f4c1000b000 tx=0x7f4c10006dc0).stop 2020-10-31T22:46:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.562+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/981180434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c14140420 msgr2=0x7f4c14150cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:23.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.562+0000 7f4c1a8bf700 1 --2- 172.21.15.60:0/981180434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c14140420 0x7f4c14150cd0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f4c0c0032b0 tx=0x7f4c0c016000).stop 2020-10-31T22:46:23.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.562+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/981180434 shutdown_connections 2020-10-31T22:46:23.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.562+0000 7f4c1a8bf700 1 --2- 172.21.15.60:0/981180434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c14140420 0x7f4c14150cd0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:23.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.562+0000 7f4c1a8bf700 1 --2- 172.21.15.60:0/981180434 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4bf4054f10 0x7f4bf40573d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:23.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.562+0000 7f4c1a8bf700 1 --2- 172.21.15.60:0/981180434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c1405b320 0x7f4c1413ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:23.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.562+0000 7f4c1a8bf700 1 --2- 172.21.15.60:0/981180434 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c140acc80 0x7f4c140b4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:23.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.562+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/981180434 >> 172.21.15.60:0/981180434 conn(0x7f4c140b61d0 msgr2=0x7f4c140ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:23.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.562+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/981180434 shutdown_connections 2020-10-31T22:46:23.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:22.562+0000 7f4c1a8bf700 1 -- 172.21.15.60:0/981180434 wait complete. 2020-10-31T22:46:23.634 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2020-10-31T22:46:23.634 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:23.634 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2411188619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2411188619},{"type":"v1","addr":"172.21.15.60:6835","nonce":2411188619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26},{"gid":5880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/507121609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":507121609},{"type":"v1","addr":"172.21.15.66:6833","nonce":507121609}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:46:19.877041+0000","modified":"2020-10-31T22:46:20.880233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2545916146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2545916146},{"type":"v1","addr":"172.21.15.60:6837","nonce":2545916146}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-10-31T22:46:23.937 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:46:19.877041+0000', 'modified': '2020-10-31T22:46:20.880233+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5889}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5889': {'gid': 5889, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/2545916146', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 2545916146}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 2545916146}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:46:23.938 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:46:23.938 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:46:24.074 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":5889,"want_state":"up:active","state":"up:active","rank_uptime":4.1861667000000002,"mdsmap_epoch":29,"osdmap_epoch":65,"osdmap_epoch_barrier":64,"uptime":9.5861267889999997} 2020-10-31T22:46:24.075 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 5889, "mdsmap_epoch": 29, "osdmap_epoch": 65, "osdmap_epoch_barrier": 64, "rank_uptime": 4.1861667, "state": "up:active", "uptime": 9.586126789, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:46:24.076 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:46:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.190+0000 7fe3a03d3700 1 Processor -- start 2020-10-31T22:46:24.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.190+0000 7fe3a03d3700 1 -- start start 2020-10-31T22:46:24.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe3a03d3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe39805b960 0x7fe39805bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe3a03d3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3980a7850 0x7fe3980aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe3a03d3700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3980b0f00 con 0x7fe3980aefe0 2020-10-31T22:46:24.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe3a03d3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3980b11a0 con 0x7fe3980a7850 2020-10-31T22:46:24.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe3a03d3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980b1440 con 0x7fe39805b960 2020-10-31T22:46:24.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe39d96e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3980a7850 0x7fe3980aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe39d96e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3980a7850 0x7fe3980aeaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44828/0 (socket says 172.21.15.60:44828) 2020-10-31T22:46:24.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe39d96e700 1 -- 172.21.15.60:0/3015138905 learned_addr learned my addr 172.21.15.60:0/3015138905 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:24.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe39e16f700 1 --2- 172.21.15.60:0/3015138905 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe39805b960 0x7fe39805bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe39d96e700 1 -- 172.21.15.60:0/3015138905 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe39805b960 msgr2=0x7fe39805bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe39d96e700 1 --2- 172.21.15.60:0/3015138905 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe39805b960 0x7fe39805bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe39d96e700 1 -- 172.21.15.60:0/3015138905 >> v1:172.21.15.66:6789/0 conn(0x7fe3980aefe0 legacy=0x7fe398146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe39d96e700 1 -- 172.21.15.60:0/3015138905 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3981462f0 con 0x7fe3980a7850 2020-10-31T22:46:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe39d96e700 1 --2- 172.21.15.60:0/3015138905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980a7850 0x7fe3980aeaf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fe3940032b0 tx=0x7fe394009270).ready entity=mon.0 client_cookie=7632ba65a00d9353 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe39d16d700 1 -- 172.21.15.60:0/3015138905 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe39400bc00 con 0x7fe3980a7850 2020-10-31T22:46:24.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe39d16d700 1 -- 172.21.15.60:0/3015138905 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39400bd60 con 0x7fe3980a7850 2020-10-31T22:46:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe39d16d700 1 -- 172.21.15.60:0/3015138905 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe394011400 con 0x7fe3980a7850 2020-10-31T22:46:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3015138905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980a7850 msgr2=0x7fe3980aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe3a03d3700 1 --2- 172.21.15.60:0/3015138905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980a7850 0x7fe3980aeaf0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7fe3940032b0 tx=0x7fe394009270).stop 2020-10-31T22:46:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3015138905 shutdown_connections 2020-10-31T22:46:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe3a03d3700 1 --2- 172.21.15.60:0/3015138905 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe39805b960 0x7fe39805bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe3a03d3700 1 --2- 172.21.15.60:0/3015138905 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980a7850 0x7fe3980aeaf0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3015138905 >> 172.21.15.60:0/3015138905 conn(0x7fe39806a260 msgr2=0x7fe398061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:24.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3015138905 shutdown_connections 2020-10-31T22:46:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.194+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3015138905 wait complete. 2020-10-31T22:46:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.198+0000 7fe3a03d3700 1 Processor -- start 2020-10-31T22:46:24.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.198+0000 7fe3a03d3700 1 -- start start 2020-10-31T22:46:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.198+0000 7fe3a03d3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe39805b960 0x7fe39813bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.198+0000 7fe3a03d3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980a7850 0x7fe3980aba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.198+0000 7fe3a03d3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3980add20 0x7fe3980ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.198+0000 7fe3a03d3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980b1eb0 con 0x7fe3980a7850 2020-10-31T22:46:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.198+0000 7fe3a03d3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39813da80 con 0x7fe3980add20 2020-10-31T22:46:24.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.198+0000 7fe3a03d3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe398149bd0 con 0x7fe39805b960 2020-10-31T22:46:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.198+0000 7fe39d96e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980a7850 0x7fe3980aba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.198+0000 7fe39d96e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980a7850 0x7fe3980aba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44836/0 (socket says 172.21.15.60:44836) 2020-10-31T22:46:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.198+0000 7fe39d96e700 1 -- 172.21.15.60:0/3650150950 learned_addr learned my addr 172.21.15.60:0/3650150950 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.198+0000 7fe39e16f700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe39805b960 0x7fe39813bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.198+0000 7fe39e970700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3980add20 0x7fe3980ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe39d96e700 1 -- 172.21.15.60:0/3650150950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe39805b960 msgr2=0x7fe39813bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe39d96e700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe39805b960 0x7fe39813bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe39d96e700 1 -- 172.21.15.60:0/3650150950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3980add20 msgr2=0x7fe3980ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe39d96e700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3980add20 0x7fe3980ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe39d96e700 1 -- 172.21.15.60:0/3650150950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39813d540 con 0x7fe3980a7850 2020-10-31T22:46:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe39e970700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3980add20 0x7fe3980ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe39d96e700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980a7850 0x7fe3980aba70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fe3940032b0 tx=0x7fe394016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe3877fe700 1 -- 172.21.15.60:0/3650150950 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe3940107a0 con 0x7fe3980a7850 2020-10-31T22:46:24.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe3877fe700 1 -- 172.21.15.60:0/3650150950 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe394010900 con 0x7fe3980a7850 2020-10-31T22:46:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe3877fe700 1 -- 172.21.15.60:0/3650150950 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe394010c60 con 0x7fe3980a7850 2020-10-31T22:46:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3650150950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39813d7e0 con 0x7fe3980a7850 2020-10-31T22:46:24.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3650150950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3980ab770 con 0x7fe3980a7850 2020-10-31T22:46:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3650150950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3980ad2b0 con 0x7fe3980a7850 2020-10-31T22:46:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe3877fe700 1 -- 172.21.15.60:0/3650150950 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe39400f070 con 0x7fe3980a7850 2020-10-31T22:46:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.202+0000 7fe3877fe700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe378054f10 0x7fe3780573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.206+0000 7fe3877fe700 1 -- 172.21.15.60:0/3650150950 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe39406f2d0 con 0x7fe3980a7850 2020-10-31T22:46:24.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.206+0000 7fe39e16f700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe378054f10 0x7fe3780573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.206+0000 7fe39e16f700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe378054f10 0x7fe3780573d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fe38800c000 tx=0x7fe388008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:24.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.210+0000 7fe3877fe700 1 -- 172.21.15.60:0/3650150950 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe394045750 con 0x7fe3980a7850 2020-10-31T22:46:24.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.350+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3650150950 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe398057100 con 0x7fe3980a7850 2020-10-31T22:46:24.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.354+0000 7fe3877fe700 1 -- 172.21.15.60:0/3650150950 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fe394015090 con 0x7fe3980a7850 2020-10-31T22:46:24.357 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:24.357 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":65,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:46:20.880954+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:46:17.441669+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":12,"pool_name":"cephfs_data","create_time":"2020-10-31T22:46:18.708444+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:46:24.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.358+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3650150950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe378054f10 msgr2=0x7fe3780573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.358+0000 7fe3a03d3700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe378054f10 0x7fe3780573d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fe38800c000 tx=0x7fe388008040).stop 2020-10-31T22:46:24.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.358+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3650150950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980a7850 msgr2=0x7fe3980aba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.358+0000 7fe3a03d3700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980a7850 0x7fe3980aba70 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7fe3940032b0 tx=0x7fe394016000).stop 2020-10-31T22:46:24.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.358+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3650150950 shutdown_connections 2020-10-31T22:46:24.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.358+0000 7fe3a03d3700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe378054f10 0x7fe3780573d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.358+0000 7fe3a03d3700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3980add20 0x7fe3980ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.358+0000 7fe3a03d3700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe39805b960 0x7fe39813bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.358+0000 7fe3a03d3700 1 --2- 172.21.15.60:0/3650150950 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3980a7850 0x7fe3980aba70 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.358+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3650150950 >> 172.21.15.60:0/3650150950 conn(0x7fe39806a260 msgr2=0x7fe39813f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:24.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.358+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3650150950 shutdown_connections 2020-10-31T22:46:24.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.358+0000 7fe3a03d3700 1 -- 172.21.15.60:0/3650150950 wait complete. 2020-10-31T22:46:24.373 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:46:17.441669+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '64', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:46:18.708444+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '65', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:46:24.374 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:46:24.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.494+0000 7f081eb8c700 1 Processor -- start 2020-10-31T22:46:24.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.494+0000 7f081eb8c700 1 -- start start 2020-10-31T22:46:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.494+0000 7f081eb8c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f08180af0e0 0x7f08180af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.494+0000 7f081eb8c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f081813ef60 0x7f081813f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.494+0000 7f081eb8c700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0818141cf0 con 0x7f0818062e00 2020-10-31T22:46:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.494+0000 7f081eb8c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081813f8a0 con 0x7f081813ef60 2020-10-31T22:46:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081eb8c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0818145af0 con 0x7f08180af0e0 2020-10-31T22:46:24.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081e38b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f081813ef60 0x7f081813f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081e38b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f081813ef60 0x7f081813f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44844/0 (socket says 172.21.15.60:44844) 2020-10-31T22:46:24.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081e38b700 1 -- 172.21.15.60:0/3400117240 learned_addr learned my addr 172.21.15.60:0/3400117240 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:24.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081db8a700 1 --2- 172.21.15.60:0/3400117240 >> v2:172.21.15.66:3300/0 conn(0x7f08180af0e0 0x7f08180af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081e38b700 1 -- 172.21.15.60:0/3400117240 >> v2:172.21.15.66:3300/0 conn(0x7f08180af0e0 msgr2=0x7f08180af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:24.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081e38b700 1 --2- 172.21.15.60:0/3400117240 >> v2:172.21.15.66:3300/0 conn(0x7f08180af0e0 0x7f08180af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081e38b700 1 -- 172.21.15.60:0/3400117240 >> v1:172.21.15.66:6789/0 conn(0x7f0818062e00 legacy=0x7f0818145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:24.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081e38b700 1 -- 172.21.15.60:0/3400117240 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0818145d90 con 0x7f081813ef60 2020-10-31T22:46:24.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081db8a700 1 --2- 172.21.15.60:0/3400117240 >> v2:172.21.15.66:3300/0 conn(0x7f08180af0e0 0x7f08180af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:46:24.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081e38b700 1 --2- 172.21.15.60:0/3400117240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f081813ef60 0x7f081813f3b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f08100032b0 tx=0x7f0810009270).ready entity=mon.0 client_cookie=8f1171e2c85472ea server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:24.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081cb88700 1 -- 172.21.15.60:0/3400117240 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f081000bc00 con 0x7f081813ef60 2020-10-31T22:46:24.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081cb88700 1 -- 172.21.15.60:0/3400117240 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f081000bd60 con 0x7f081813ef60 2020-10-31T22:46:24.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081cb88700 1 -- 172.21.15.60:0/3400117240 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0810011400 con 0x7f081813ef60 2020-10-31T22:46:24.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081eb8c700 1 -- 172.21.15.60:0/3400117240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f081813ef60 msgr2=0x7f081813f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081eb8c700 1 --2- 172.21.15.60:0/3400117240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f081813ef60 0x7f081813f3b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f08100032b0 tx=0x7f0810009270).stop 2020-10-31T22:46:24.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081eb8c700 1 -- 172.21.15.60:0/3400117240 shutdown_connections 2020-10-31T22:46:24.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081eb8c700 1 --2- 172.21.15.60:0/3400117240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f081813ef60 0x7f081813f3b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081eb8c700 1 --2- 172.21.15.60:0/3400117240 >> v2:172.21.15.66:3300/0 conn(0x7f08180af0e0 0x7f08180af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081eb8c700 1 -- 172.21.15.60:0/3400117240 >> 172.21.15.60:0/3400117240 conn(0x7f081806a600 msgr2=0x7f0818060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081eb8c700 1 -- 172.21.15.60:0/3400117240 shutdown_connections 2020-10-31T22:46:24.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081eb8c700 1 -- 172.21.15.60:0/3400117240 wait complete. 2020-10-31T22:46:24.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081eb8c700 1 Processor -- start 2020-10-31T22:46:24.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.498+0000 7f081eb8c700 1 -- start start 2020-10-31T22:46:24.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081eb8c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0818062e00 0x7f0818143750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081eb8c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08180af0e0 0x7f08180aafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081eb8c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f081813ef60 0x7f08180b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081eb8c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08180aa9f0 con 0x7f08180af0e0 2020-10-31T22:46:24.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081eb8c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08180aac50 con 0x7f081813ef60 2020-10-31T22:46:24.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081eb8c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08180b4f60 con 0x7f0818062e00 2020-10-31T22:46:24.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081d389700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08180af0e0 0x7f08180aafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081d389700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08180af0e0 0x7f08180aafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44850/0 (socket says 172.21.15.60:44850) 2020-10-31T22:46:24.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081db8a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0818062e00 0x7f0818143750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081d389700 1 -- 172.21.15.60:0/782266351 learned_addr learned my addr 172.21.15.60:0/782266351 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:24.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081e38b700 1 --2- 172.21.15.60:0/782266351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f081813ef60 0x7f08180b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081d389700 1 -- 172.21.15.60:0/782266351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0818062e00 msgr2=0x7f0818143750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081d389700 1 --2- 172.21.15.60:0/782266351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0818062e00 0x7f0818143750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081d389700 1 -- 172.21.15.60:0/782266351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f081813ef60 msgr2=0x7f08180b56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081d389700 1 --2- 172.21.15.60:0/782266351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f081813ef60 0x7f08180b56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081d389700 1 -- 172.21.15.60:0/782266351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08180b5200 con 0x7f08180af0e0 2020-10-31T22:46:24.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081d389700 1 --2- 172.21.15.60:0/782266351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08180af0e0 0x7f08180aafb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f081806ab00 tx=0x7f0814007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:24.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f080affd700 1 -- 172.21.15.60:0/782266351 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0814013410 con 0x7f08180af0e0 2020-10-31T22:46:24.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f080affd700 1 -- 172.21.15.60:0/782266351 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0814013570 con 0x7f08180af0e0 2020-10-31T22:46:24.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081eb8c700 1 -- 172.21.15.60:0/782266351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08180ab4a0 con 0x7f08180af0e0 2020-10-31T22:46:24.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f080affd700 1 -- 172.21.15.60:0/782266351 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08140138d0 con 0x7f08180af0e0 2020-10-31T22:46:24.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f081eb8c700 1 -- 172.21.15.60:0/782266351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08180b4c40 con 0x7f08180af0e0 2020-10-31T22:46:24.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.502+0000 7f080affd700 1 -- 172.21.15.60:0/782266351 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0814010030 con 0x7f08180af0e0 2020-10-31T22:46:24.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.506+0000 7f081eb8c700 1 -- 172.21.15.60:0/782266351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08180b5390 con 0x7f08180af0e0 2020-10-31T22:46:24.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.506+0000 7f080affd700 1 --2- 172.21.15.60:0/782266351 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f07f8054f10 0x7f07f80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.506+0000 7f080affd700 1 -- 172.21.15.60:0/782266351 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f081406d620 con 0x7f08180af0e0 2020-10-31T22:46:24.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.506+0000 7f081db8a700 1 --2- 172.21.15.60:0/782266351 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f07f8054f10 0x7f07f80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.506+0000 7f081db8a700 1 --2- 172.21.15.60:0/782266351 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f07f8054f10 0x7f07f80573d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f080c00d000 tx=0x7f080c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:24.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.510+0000 7f080affd700 1 -- 172.21.15.60:0/782266351 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0814043aa0 con 0x7f08180af0e0 2020-10-31T22:46:24.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.650+0000 7f081eb8c700 1 -- 172.21.15.60:0/782266351 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0818057100 con 0x7f08180af0e0 2020-10-31T22:46:24.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.654+0000 7f080affd700 1 -- 172.21.15.60:0/782266351 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v65) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0814001e60 con 0x7f08180af0e0 2020-10-31T22:46:24.655 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:46:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.654+0000 7f081eb8c700 1 -- 172.21.15.60:0/782266351 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f07f8054f10 msgr2=0x7f07f80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.654+0000 7f081eb8c700 1 --2- 172.21.15.60:0/782266351 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f07f8054f10 0x7f07f80573d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f080c00d000 tx=0x7f080c008040).stop 2020-10-31T22:46:24.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.654+0000 7f081eb8c700 1 -- 172.21.15.60:0/782266351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08180af0e0 msgr2=0x7f08180aafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.654+0000 7f081eb8c700 1 --2- 172.21.15.60:0/782266351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08180af0e0 0x7f08180aafb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f081806ab00 tx=0x7f0814007bf0).stop 2020-10-31T22:46:24.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.654+0000 7f081eb8c700 1 -- 172.21.15.60:0/782266351 shutdown_connections 2020-10-31T22:46:24.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.654+0000 7f081eb8c700 1 --2- 172.21.15.60:0/782266351 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f07f8054f10 0x7f07f80573d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.654+0000 7f081eb8c700 1 --2- 172.21.15.60:0/782266351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f081813ef60 0x7f08180b56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.654+0000 7f081eb8c700 1 --2- 172.21.15.60:0/782266351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0818062e00 0x7f0818143750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.654+0000 7f081eb8c700 1 --2- 172.21.15.60:0/782266351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f08180af0e0 0x7f08180aafb0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.654+0000 7f081eb8c700 1 -- 172.21.15.60:0/782266351 >> 172.21.15.60:0/782266351 conn(0x7f081806a600 msgr2=0x7f08180add30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:24.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.654+0000 7f081eb8c700 1 -- 172.21.15.60:0/782266351 shutdown_connections 2020-10-31T22:46:24.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.654+0000 7f081eb8c700 1 -- 172.21.15.60:0/782266351 wait complete. 2020-10-31T22:46:24.675 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:46:24.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f45b49700 1 Processor -- start 2020-10-31T22:46:24.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f45b49700 1 -- start start 2020-10-31T22:46:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f45b49700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1f400af0e0 0x7f1f400af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f45b49700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f4013ef60 0x7f1f4013f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f45b49700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f40141cf0 con 0x7f1f40062e00 2020-10-31T22:46:24.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f45b49700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f4013f8a0 con 0x7f1f400af0e0 2020-10-31T22:46:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f45b49700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f40145af0 con 0x7f1f4013ef60 2020-10-31T22:46:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f44b47700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1f400af0e0 0x7f1f400af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f44b47700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1f400af0e0 0x7f1f400af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44858/0 (socket says 172.21.15.60:44858) 2020-10-31T22:46:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f44b47700 1 -- 172.21.15.60:0/130215440 learned_addr learned my addr 172.21.15.60:0/130215440 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f45348700 1 --2- 172.21.15.60:0/130215440 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f4013ef60 0x7f1f4013f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f44b47700 1 -- 172.21.15.60:0/130215440 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f4013ef60 msgr2=0x7f1f4013f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:24.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f44b47700 1 --2- 172.21.15.60:0/130215440 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f4013ef60 0x7f1f4013f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f44b47700 1 -- 172.21.15.60:0/130215440 >> v1:172.21.15.66:6789/0 conn(0x7f1f40062e00 legacy=0x7f1f40145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f3f7fe700 1 -- 172.21.15.60:0/130215440 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1463367797 0 0) 0x7f1f40141cf0 con 0x7f1f40062e00 2020-10-31T22:46:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f44b47700 1 -- 172.21.15.60:0/130215440 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f40145d90 con 0x7f1f400af0e0 2020-10-31T22:46:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f44b47700 1 --2- 172.21.15.60:0/130215440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f400af0e0 0x7f1f400af4c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f1f34002f30 tx=0x7f1f34006e80).ready entity=mon.0 client_cookie=251accc4708867a9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f3f7fe700 1 -- 172.21.15.60:0/130215440 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f340097f0 con 0x7f1f400af0e0 2020-10-31T22:46:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f3f7fe700 1 -- 172.21.15.60:0/130215440 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f34009950 con 0x7f1f400af0e0 2020-10-31T22:46:24.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f3f7fe700 1 -- 172.21.15.60:0/130215440 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f34009cb0 con 0x7f1f400af0e0 2020-10-31T22:46:24.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f45b49700 1 -- 172.21.15.60:0/130215440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f400af0e0 msgr2=0x7f1f400af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.794+0000 7f1f45b49700 1 --2- 172.21.15.60:0/130215440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f400af0e0 0x7f1f400af4c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f1f34002f30 tx=0x7f1f34006e80).stop 2020-10-31T22:46:24.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45b49700 1 -- 172.21.15.60:0/130215440 shutdown_connections 2020-10-31T22:46:24.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45b49700 1 --2- 172.21.15.60:0/130215440 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f4013ef60 0x7f1f4013f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45b49700 1 --2- 172.21.15.60:0/130215440 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f400af0e0 0x7f1f400af4c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45b49700 1 -- 172.21.15.60:0/130215440 >> 172.21.15.60:0/130215440 conn(0x7f1f4006a600 msgr2=0x7f1f40060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:24.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45b49700 1 -- 172.21.15.60:0/130215440 shutdown_connections 2020-10-31T22:46:24.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45b49700 1 -- 172.21.15.60:0/130215440 wait complete. 2020-10-31T22:46:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45b49700 1 Processor -- start 2020-10-31T22:46:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45b49700 1 -- start start 2020-10-31T22:46:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45b49700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f40062e00 0x7f1f40147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45b49700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f400af0e0 0x7f1f400b5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45b49700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f4013ef60 0x7f1f400b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45b49700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f400a91b0 con 0x7f1f40062e00 2020-10-31T22:46:24.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45b49700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f400b4500 con 0x7f1f4013ef60 2020-10-31T22:46:24.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45b49700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f400a93e0 con 0x7f1f400af0e0 2020-10-31T22:46:24.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f44b47700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f40062e00 0x7f1f40147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f44b47700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f40062e00 0x7f1f40147f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44864/0 (socket says 172.21.15.60:44864) 2020-10-31T22:46:24.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f44b47700 1 -- 172.21.15.60:0/4214084662 learned_addr learned my addr 172.21.15.60:0/4214084662 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:24.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f3ffff700 1 --2- 172.21.15.60:0/4214084662 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f400af0e0 0x7f1f400b5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f45348700 1 --2- 172.21.15.60:0/4214084662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f4013ef60 0x7f1f400b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f44b47700 1 -- 172.21.15.60:0/4214084662 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f400af0e0 msgr2=0x7f1f400b5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f44b47700 1 --2- 172.21.15.60:0/4214084662 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f400af0e0 0x7f1f400b5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f44b47700 1 -- 172.21.15.60:0/4214084662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f4013ef60 msgr2=0x7f1f400b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f44b47700 1 --2- 172.21.15.60:0/4214084662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f4013ef60 0x7f1f400b5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.798+0000 7f1f44b47700 1 -- 172.21.15.60:0/4214084662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f400a9680 con 0x7f1f40062e00 2020-10-31T22:46:24.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.802+0000 7f1f44b47700 1 --2- 172.21.15.60:0/4214084662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f40062e00 0x7f1f40147f90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f1f34002f30 tx=0x7f1f34015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:24.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.802+0000 7f1f3dffb700 1 -- 172.21.15.60:0/4214084662 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f34011b40 con 0x7f1f40062e00 2020-10-31T22:46:24.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.802+0000 7f1f3dffb700 1 -- 172.21.15.60:0/4214084662 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f34011ca0 con 0x7f1f40062e00 2020-10-31T22:46:24.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.802+0000 7f1f45b49700 1 -- 172.21.15.60:0/4214084662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f400b47a0 con 0x7f1f40062e00 2020-10-31T22:46:24.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.802+0000 7f1f3dffb700 1 -- 172.21.15.60:0/4214084662 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f3401e460 con 0x7f1f40062e00 2020-10-31T22:46:24.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.802+0000 7f1f45b49700 1 -- 172.21.15.60:0/4214084662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f400ab8f0 con 0x7f1f40062e00 2020-10-31T22:46:24.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.802+0000 7f1f45b49700 1 -- 172.21.15.60:0/4214084662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f400b4fb0 con 0x7f1f40062e00 2020-10-31T22:46:24.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.802+0000 7f1f3dffb700 1 -- 172.21.15.60:0/4214084662 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1f34025030 con 0x7f1f40062e00 2020-10-31T22:46:24.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.802+0000 7f1f3dffb700 1 --2- 172.21.15.60:0/4214084662 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1f20054f90 0x7f1f20057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:24.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.802+0000 7f1f3dffb700 1 -- 172.21.15.60:0/4214084662 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1f3406ed40 con 0x7f1f40062e00 2020-10-31T22:46:24.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.802+0000 7f1f3ffff700 1 --2- 172.21.15.60:0/4214084662 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1f20054f90 0x7f1f20057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:24.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.802+0000 7f1f3ffff700 1 --2- 172.21.15.60:0/4214084662 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1f20054f90 0x7f1f20057450 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f1f3000d000 tx=0x7f1f30007980).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:24.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.806+0000 7f1f3dffb700 1 -- 172.21.15.60:0/4214084662 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1f34045260 con 0x7f1f40062e00 2020-10-31T22:46:24.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.950+0000 7f1f45b49700 1 -- 172.21.15.60:0/4214084662 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1f40057100 con 0x7f1f40062e00 2020-10-31T22:46:24.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.950+0000 7f1f3dffb700 1 -- 172.21.15.60:0/4214084662 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v65) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1f34023070 con 0x7f1f40062e00 2020-10-31T22:46:24.954 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:46:24.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.954+0000 7f1f45b49700 1 -- 172.21.15.60:0/4214084662 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1f20054f90 msgr2=0x7f1f20057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.954+0000 7f1f45b49700 1 --2- 172.21.15.60:0/4214084662 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1f20054f90 0x7f1f20057450 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f1f3000d000 tx=0x7f1f30007980).stop 2020-10-31T22:46:24.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.954+0000 7f1f45b49700 1 -- 172.21.15.60:0/4214084662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f40062e00 msgr2=0x7f1f40147f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:24.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.954+0000 7f1f45b49700 1 --2- 172.21.15.60:0/4214084662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f40062e00 0x7f1f40147f90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f1f34002f30 tx=0x7f1f34015000).stop 2020-10-31T22:46:24.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.954+0000 7f1f45b49700 1 -- 172.21.15.60:0/4214084662 shutdown_connections 2020-10-31T22:46:24.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.954+0000 7f1f45b49700 1 --2- 172.21.15.60:0/4214084662 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1f20054f90 0x7f1f20057450 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.954+0000 7f1f45b49700 1 --2- 172.21.15.60:0/4214084662 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f4013ef60 0x7f1f400b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.954+0000 7f1f45b49700 1 --2- 172.21.15.60:0/4214084662 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f40062e00 0x7f1f40147f90 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.954+0000 7f1f45b49700 1 --2- 172.21.15.60:0/4214084662 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f400af0e0 0x7f1f400b5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:24.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.954+0000 7f1f45b49700 1 -- 172.21.15.60:0/4214084662 >> 172.21.15.60:0/4214084662 conn(0x7f1f4006a600 msgr2=0x7f1f400ad8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:24.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.954+0000 7f1f45b49700 1 -- 172.21.15.60:0/4214084662 shutdown_connections 2020-10-31T22:46:24.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:24.954+0000 7f1f45b49700 1 -- 172.21.15.60:0/4214084662 wait complete. 2020-10-31T22:46:24.967 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:46:25.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b85bdf700 1 Processor -- start 2020-10-31T22:46:25.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b85bdf700 1 -- start start 2020-10-31T22:46:25.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b85bdf700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1b800afc50 0x7f1b801420e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b85bdf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b800ae450 0x7f1b800ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b85bdf700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b800b2130 con 0x7f1b800b1d50 2020-10-31T22:46:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b85bdf700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b800af200 con 0x7f1b800afc50 2020-10-31T22:46:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b85bdf700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8013e140 con 0x7f1b800ae450 2020-10-31T22:46:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b853de700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b800ae450 0x7f1b800ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b7ffff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1b800afc50 0x7f1b801420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b84bdd700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f1b800b1d50 0x7f1b8013e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:46874/0 (socket says 172.21.15.60:46874) 2020-10-31T22:46:25.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b84bdd700 1 -- 172.21.15.60:0/1688043086 learned_addr learned my addr 172.21.15.60:0/1688043086 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:25.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b7ffff700 1 --2- 172.21.15.60:0/1688043086 >> v2:172.21.15.66:3300/0 conn(0x7f1b800afc50 0x7f1b801420e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:55808/0 (socket says 172.21.15.60:55808) 2020-10-31T22:46:25.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b853de700 1 -- 172.21.15.60:0/1688043086 >> v2:172.21.15.66:3300/0 conn(0x7f1b800afc50 msgr2=0x7f1b801420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:25.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b853de700 1 --2- 172.21.15.60:0/1688043086 >> v2:172.21.15.66:3300/0 conn(0x7f1b800afc50 0x7f1b801420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b853de700 1 -- 172.21.15.60:0/1688043086 >> v1:172.21.15.66:6789/0 conn(0x7f1b800b1d50 legacy=0x7f1b8013e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b853de700 1 -- 172.21.15.60:0/1688043086 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b800af3f0 con 0x7f1b800ae450 2020-10-31T22:46:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.082+0000 7f1b853de700 1 --2- 172.21.15.60:0/1688043086 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b800ae450 0x7f1b800ae8c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1b8013e6b0 tx=0x7f1b780091a0).ready entity=mon.2 client_cookie=9be387227def299 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.086+0000 7f1b7f7fe700 1 -- 172.21.15.60:0/1688043086 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b7800b9b0 con 0x7f1b800ae450 2020-10-31T22:46:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.086+0000 7f1b7f7fe700 1 -- 172.21.15.60:0/1688043086 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7800bb10 con 0x7f1b800ae450 2020-10-31T22:46:25.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.086+0000 7f1b7f7fe700 1 -- 172.21.15.60:0/1688043086 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b7800bc80 con 0x7f1b800ae450 2020-10-31T22:46:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.086+0000 7f1b85bdf700 1 -- 172.21.15.60:0/1688043086 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b800ae450 msgr2=0x7f1b800ae8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.086+0000 7f1b85bdf700 1 --2- 172.21.15.60:0/1688043086 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b800ae450 0x7f1b800ae8c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f1b8013e6b0 tx=0x7f1b780091a0).stop 2020-10-31T22:46:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.086+0000 7f1b85bdf700 1 -- 172.21.15.60:0/1688043086 shutdown_connections 2020-10-31T22:46:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.086+0000 7f1b85bdf700 1 --2- 172.21.15.60:0/1688043086 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b800ae450 0x7f1b800ae8c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.086+0000 7f1b85bdf700 1 --2- 172.21.15.60:0/1688043086 >> v2:172.21.15.66:3300/0 conn(0x7f1b800afc50 0x7f1b801420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.086+0000 7f1b85bdf700 1 -- 172.21.15.60:0/1688043086 >> 172.21.15.60:0/1688043086 conn(0x7f1b800b5330 msgr2=0x7f1b800b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:25.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.086+0000 7f1b85bdf700 1 -- 172.21.15.60:0/1688043086 shutdown_connections 2020-10-31T22:46:25.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.086+0000 7f1b85bdf700 1 -- 172.21.15.60:0/1688043086 wait complete. 2020-10-31T22:46:25.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.086+0000 7f1b85bdf700 1 Processor -- start 2020-10-31T22:46:25.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.086+0000 7f1b85bdf700 1 -- start start 2020-10-31T22:46:25.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b85bdf700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b800ae450 0x7f1b8013b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b85bdf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b800afc50 0x7f1b800aaa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b85bdf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b800b1d50 0x7f1b80064a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b85bdf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b80139b40 con 0x7f1b800afc50 2020-10-31T22:46:25.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b85bdf700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b80062e10 con 0x7f1b800ae450 2020-10-31T22:46:25.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b85bdf700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b800630b0 con 0x7f1b800b1d50 2020-10-31T22:46:25.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b7ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b800afc50 0x7f1b800aaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b7ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b800afc50 0x7f1b800aaa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44878/0 (socket says 172.21.15.60:44878) 2020-10-31T22:46:25.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b7ffff700 1 -- 172.21.15.60:0/3139767963 learned_addr learned my addr 172.21.15.60:0/3139767963 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:25.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b84bdd700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b800ae450 0x7f1b8013b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b853de700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b800b1d50 0x7f1b80064a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b84bdd700 1 -- 172.21.15.60:0/3139767963 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b800b1d50 msgr2=0x7f1b80064a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b84bdd700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b800b1d50 0x7f1b80064a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b84bdd700 1 -- 172.21.15.60:0/3139767963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b800afc50 msgr2=0x7f1b800aaa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b84bdd700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b800afc50 0x7f1b800aaa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b84bdd700 1 -- 172.21.15.60:0/3139767963 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b80063350 con 0x7f1b800ae450 2020-10-31T22:46:25.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b853de700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b800b1d50 0x7f1b80064a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:46:25.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b7ffff700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b800afc50 0x7f1b800aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:46:25.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b84bdd700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b800ae450 0x7f1b8013b3d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f1b80061080 tx=0x7f1b6c007ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:25.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b7dffb700 1 -- 172.21.15.60:0/3139767963 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b6c0072e0 con 0x7f1b800ae450 2020-10-31T22:46:25.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b7dffb700 1 -- 172.21.15.60:0/3139767963 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c007440 con 0x7f1b800ae450 2020-10-31T22:46:25.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b7dffb700 1 -- 172.21.15.60:0/3139767963 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1b6c0057d0 con 0x7f1b800ae450 2020-10-31T22:46:25.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b85bdf700 1 -- 172.21.15.60:0/3139767963 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b800635f0 con 0x7f1b800ae450 2020-10-31T22:46:25.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b85bdf700 1 -- 172.21.15.60:0/3139767963 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b80139df0 con 0x7f1b800ae450 2020-10-31T22:46:25.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.090+0000 7f1b85bdf700 1 -- 172.21.15.60:0/3139767963 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b80057100 con 0x7f1b800ae450 2020-10-31T22:46:25.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.094+0000 7f1b7dffb700 1 -- 172.21.15.60:0/3139767963 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1b6c010070 con 0x7f1b800ae450 2020-10-31T22:46:25.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.094+0000 7f1b7dffb700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1b68054f10 0x7f1b680573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.094+0000 7f1b7ffff700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1b68054f10 0x7f1b680573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.094+0000 7f1b7dffb700 1 -- 172.21.15.60:0/3139767963 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1b6c06d220 con 0x7f1b800ae450 2020-10-31T22:46:25.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.094+0000 7f1b7ffff700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1b68054f10 0x7f1b680573d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f1b7400b000 tx=0x7f1b74006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:25.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.102+0000 7f1b7dffb700 1 -- 172.21.15.60:0/3139767963 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1b6c0436c0 con 0x7f1b800ae450 2020-10-31T22:46:25.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.242+0000 7f1b85bdf700 1 -- 172.21.15.60:0/3139767963 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b800ac880 con 0x7f1b800ae450 2020-10-31T22:46:25.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.246+0000 7f1b7dffb700 1 -- 172.21.15.60:0/3139767963 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+10 (secure 0 0 0) 0x7f1b6c0330a0 con 0x7f1b800ae450 2020-10-31T22:46:25.247 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:46:25.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.246+0000 7f1b85bdf700 1 -- 172.21.15.60:0/3139767963 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1b68054f10 msgr2=0x7f1b680573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.246+0000 7f1b85bdf700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1b68054f10 0x7f1b680573d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f1b7400b000 tx=0x7f1b74006dc0).stop 2020-10-31T22:46:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.246+0000 7f1b85bdf700 1 -- 172.21.15.60:0/3139767963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b800ae450 msgr2=0x7f1b8013b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.246+0000 7f1b85bdf700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b800ae450 0x7f1b8013b3d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f1b80061080 tx=0x7f1b6c007ac0).stop 2020-10-31T22:46:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.246+0000 7f1b85bdf700 1 -- 172.21.15.60:0/3139767963 shutdown_connections 2020-10-31T22:46:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.246+0000 7f1b85bdf700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1b800b1d50 0x7f1b80064a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.246+0000 7f1b85bdf700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1b68054f10 0x7f1b680573d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.246+0000 7f1b85bdf700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1b800ae450 0x7f1b8013b3d0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.246+0000 7f1b85bdf700 1 --2- 172.21.15.60:0/3139767963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1b800afc50 0x7f1b800aaa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.246+0000 7f1b85bdf700 1 -- 172.21.15.60:0/3139767963 >> 172.21.15.60:0/3139767963 conn(0x7f1b800b5330 msgr2=0x7f1b800ad720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:25.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.246+0000 7f1b85bdf700 1 -- 172.21.15.60:0/3139767963 shutdown_connections 2020-10-31T22:46:25.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.246+0000 7f1b85bdf700 1 -- 172.21.15.60:0/3139767963 wait complete. 2020-10-31T22:46:25.261 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:46:25.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.378+0000 7f84934a7700 1 Processor -- start 2020-10-31T22:46:25.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.378+0000 7f84934a7700 1 -- start start 2020-10-31T22:46:25.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.378+0000 7f84934a7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f848c05c660 0x7f848c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.378+0000 7f84934a7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f848c0b2e20 0x7f848c142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.378+0000 7f84934a7700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848c066410 con 0x7f848c065f70 2020-10-31T22:46:25.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.378+0000 7f84934a7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c066d60 con 0x7f848c0b2e20 2020-10-31T22:46:25.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.378+0000 7f84934a7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c0b5e80 con 0x7f848c05c660 2020-10-31T22:46:25.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.378+0000 7f8491a44700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f848c0b2e20 0x7f848c142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f8491a44700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f848c0b2e20 0x7f848c142610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44888/0 (socket says 172.21.15.60:44888) 2020-10-31T22:46:25.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f8491a44700 1 -- 172.21.15.60:0/3767748323 learned_addr learned my addr 172.21.15.60:0/3767748323 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:25.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f8491243700 1 --2- 172.21.15.60:0/3767748323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f848c05c660 0x7f848c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f8491a44700 1 -- 172.21.15.60:0/3767748323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f848c05c660 msgr2=0x7f848c0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:25.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f8491a44700 1 --2- 172.21.15.60:0/3767748323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f848c05c660 0x7f848c0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f8491a44700 1 -- 172.21.15.60:0/3767748323 >> v1:172.21.15.66:6789/0 conn(0x7f848c065f70 legacy=0x7f848c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f8491a44700 1 -- 172.21.15.60:0/3767748323 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c0666b0 con 0x7f848c0b2e20 2020-10-31T22:46:25.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f847ffff700 1 -- 172.21.15.60:0/3767748323 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72361554 0 0) 0x7f848c066410 con 0x7f848c065f70 2020-10-31T22:46:25.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f8491a44700 1 --2- 172.21.15.60:0/3767748323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f848c0b2e20 0x7f848c142610 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f848c0afe90 tx=0x7f8484009270).ready entity=mon.0 client_cookie=14bde7972c678d93 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:25.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f847ffff700 1 -- 172.21.15.60:0/3767748323 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8484009e90 con 0x7f848c0b2e20 2020-10-31T22:46:25.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f847ffff700 1 -- 172.21.15.60:0/3767748323 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848400bbc0 con 0x7f848c0b2e20 2020-10-31T22:46:25.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f847ffff700 1 -- 172.21.15.60:0/3767748323 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f848400bd30 con 0x7f848c0b2e20 2020-10-31T22:46:25.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f84934a7700 1 -- 172.21.15.60:0/3767748323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f848c0b2e20 msgr2=0x7f848c142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f84934a7700 1 --2- 172.21.15.60:0/3767748323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f848c0b2e20 0x7f848c142610 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f848c0afe90 tx=0x7f8484009270).stop 2020-10-31T22:46:25.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f84934a7700 1 -- 172.21.15.60:0/3767748323 shutdown_connections 2020-10-31T22:46:25.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f84934a7700 1 --2- 172.21.15.60:0/3767748323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f848c0b2e20 0x7f848c142610 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f84934a7700 1 --2- 172.21.15.60:0/3767748323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f848c05c660 0x7f848c0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f84934a7700 1 -- 172.21.15.60:0/3767748323 >> 172.21.15.60:0/3767748323 conn(0x7f848c0601e0 msgr2=0x7f848c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:25.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f84934a7700 1 -- 172.21.15.60:0/3767748323 shutdown_connections 2020-10-31T22:46:25.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f84934a7700 1 -- 172.21.15.60:0/3767748323 wait complete. 2020-10-31T22:46:25.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f84934a7700 1 Processor -- start 2020-10-31T22:46:25.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.382+0000 7f84934a7700 1 -- start start 2020-10-31T22:46:25.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f84934a7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848c05c660 0x7f848c151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f84934a7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f848c065f70 0x7f848c0aaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f84934a7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f848c0b2e20 0x7f848c147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f84934a7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c146ae0 con 0x7f848c0b2e20 2020-10-31T22:46:25.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f84934a7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c0aa4b0 con 0x7f848c05c660 2020-10-31T22:46:25.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f84934a7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c150b40 con 0x7f848c065f70 2020-10-31T22:46:25.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f8491a44700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f848c0b2e20 0x7f848c147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f8491a44700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f848c0b2e20 0x7f848c147650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44894/0 (socket says 172.21.15.60:44894) 2020-10-31T22:46:25.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f8491a44700 1 -- 172.21.15.60:0/2611622067 learned_addr learned my addr 172.21.15.60:0/2611622067 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:25.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f8491243700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848c05c660 0x7f848c151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f8490a42700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f848c065f70 0x7f848c0aaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f8491a44700 1 -- 172.21.15.60:0/2611622067 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f848c065f70 msgr2=0x7f848c0aaa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f8491a44700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f848c065f70 0x7f848c0aaa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f8491a44700 1 -- 172.21.15.60:0/2611622067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848c05c660 msgr2=0x7f848c151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f8491a44700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848c05c660 0x7f848c151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f8491a44700 1 -- 172.21.15.60:0/2611622067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c150de0 con 0x7f848c0b2e20 2020-10-31T22:46:25.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f8490a42700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f848c065f70 0x7f848c0aaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:25.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f8491a44700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f848c0b2e20 0x7f848c147650 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f848c0afe90 tx=0x7f8484016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:25.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f847e7fc700 1 -- 172.21.15.60:0/2611622067 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f848401f5e0 con 0x7f848c0b2e20 2020-10-31T22:46:25.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f847e7fc700 1 -- 172.21.15.60:0/2611622067 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848401f740 con 0x7f848c0b2e20 2020-10-31T22:46:25.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f84934a7700 1 -- 172.21.15.60:0/2611622067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848c151080 con 0x7f848c0b2e20 2020-10-31T22:46:25.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f847e7fc700 1 -- 172.21.15.60:0/2611622067 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f848401faa0 con 0x7f848c0b2e20 2020-10-31T22:46:25.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f84934a7700 1 -- 172.21.15.60:0/2611622067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848c0aaf20 con 0x7f848c0b2e20 2020-10-31T22:46:25.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f84934a7700 1 -- 172.21.15.60:0/2611622067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848c151210 con 0x7f848c0b2e20 2020-10-31T22:46:25.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.386+0000 7f847e7fc700 1 -- 172.21.15.60:0/2611622067 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8484026030 con 0x7f848c0b2e20 2020-10-31T22:46:25.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.390+0000 7f847e7fc700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8474054fd0 0x7f8474057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.390+0000 7f8491243700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8474054fd0 0x7f8474057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.390+0000 7f847e7fc700 1 -- 172.21.15.60:0/2611622067 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f848406e9d0 con 0x7f848c0b2e20 2020-10-31T22:46:25.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.390+0000 7f8491243700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8474054fd0 0x7f8474057490 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f848800b000 tx=0x7f8488006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:25.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.398+0000 7f847e7fc700 1 -- 172.21.15.60:0/2611622067 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8484044de0 con 0x7f848c0b2e20 2020-10-31T22:46:25.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.538+0000 7f84934a7700 1 -- 172.21.15.60:0/2611622067 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f848c057100 con 0x7f848c0b2e20 2020-10-31T22:46:25.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.538+0000 7f847e7fc700 1 -- 172.21.15.60:0/2611622067 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+10 (secure 0 0 0) 0x7f84840240a0 con 0x7f848c0b2e20 2020-10-31T22:46:25.541 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:46:25.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.542+0000 7f84934a7700 1 -- 172.21.15.60:0/2611622067 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8474054fd0 msgr2=0x7f8474057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.542+0000 7f84934a7700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8474054fd0 0x7f8474057490 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f848800b000 tx=0x7f8488006dc0).stop 2020-10-31T22:46:25.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.542+0000 7f84934a7700 1 -- 172.21.15.60:0/2611622067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f848c0b2e20 msgr2=0x7f848c147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.542+0000 7f84934a7700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f848c0b2e20 0x7f848c147650 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7f848c0afe90 tx=0x7f8484016000).stop 2020-10-31T22:46:25.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.542+0000 7f84934a7700 1 -- 172.21.15.60:0/2611622067 shutdown_connections 2020-10-31T22:46:25.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.542+0000 7f84934a7700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f848c0b2e20 0x7f848c147650 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.542+0000 7f84934a7700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8474054fd0 0x7f8474057490 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.542+0000 7f84934a7700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f848c05c660 0x7f848c151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.542+0000 7f84934a7700 1 --2- 172.21.15.60:0/2611622067 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f848c065f70 0x7f848c0aaa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.542+0000 7f84934a7700 1 -- 172.21.15.60:0/2611622067 >> 172.21.15.60:0/2611622067 conn(0x7f848c0601e0 msgr2=0x7f848c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:25.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.542+0000 7f84934a7700 1 -- 172.21.15.60:0/2611622067 shutdown_connections 2020-10-31T22:46:25.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.542+0000 7f84934a7700 1 -- 172.21.15.60:0/2611622067 wait complete. 2020-10-31T22:46:25.559 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:46:25.559 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:46:25.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0ded5c700 1 Processor -- start 2020-10-31T22:46:25.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0ded5c700 1 -- start start 2020-10-31T22:46:25.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0ded5c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc0d80ac870 0x7fc0d8146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0ded5c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d80af900 con 0x7fc0d80af520 2020-10-31T22:46:25.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0ded5c700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0d80afc10 con 0x7fc0d8146550 2020-10-31T22:46:25.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0ded5c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0d805bb70 con 0x7fc0d80ac870 2020-10-31T22:46:25.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0ddd5a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc0d80af520 0x7fc0d8066c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49034/0 (socket says 172.21.15.60:49034) 2020-10-31T22:46:25.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0ddd5a700 1 -- 172.21.15.60:0/1265526853 learned_addr learned my addr 172.21.15.60:0/1265526853 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:25.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0dd559700 1 --2- 172.21.15.60:0/1265526853 >> v2:172.21.15.60:3300/0 conn(0x7fc0d80ac870 0x7fc0d8146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0dcd58700 1 -- 172.21.15.60:0/1265526853 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069305674 0 0) 0x7fc0d80af900 con 0x7fc0d80af520 2020-10-31T22:46:25.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0dcd58700 1 -- 172.21.15.60:0/1265526853 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0c0003230 con 0x7fc0d80af520 2020-10-31T22:46:25.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0dcd58700 1 -- 172.21.15.60:0/1265526853 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669142474 0 0) 0x7fc0d80afc10 con 0x7fc0d8146550 2020-10-31T22:46:25.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0dd559700 1 -- 172.21.15.60:0/1265526853 >> v1:172.21.15.66:6789/0 conn(0x7fc0d8146550 legacy=0x7fc0d8150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0dd559700 1 -- 172.21.15.60:0/1265526853 >> v1:172.21.15.60:6789/0 conn(0x7fc0d80af520 legacy=0x7fc0d8066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0dd559700 1 -- 172.21.15.60:0/1265526853 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d80ac130 con 0x7fc0d80ac870 2020-10-31T22:46:25.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0dd559700 1 --2- 172.21.15.60:0/1265526853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d80ac870 0x7fc0d8146060 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fc0c8002f30 tx=0x7fc0c8006dc0).ready entity=mon.0 client_cookie=fb3773cefe4e3aa8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:25.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0dcd58700 1 -- 172.21.15.60:0/1265526853 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0c8009800 con 0x7fc0d80ac870 2020-10-31T22:46:25.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0dcd58700 1 -- 172.21.15.60:0/1265526853 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c8009960 con 0x7fc0d80ac870 2020-10-31T22:46:25.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0dcd58700 1 -- 172.21.15.60:0/1265526853 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0c8009cc0 con 0x7fc0d80ac870 2020-10-31T22:46:25.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0ded5c700 1 -- 172.21.15.60:0/1265526853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d80ac870 msgr2=0x7fc0d8146060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.674+0000 7fc0ded5c700 1 --2- 172.21.15.60:0/1265526853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d80ac870 0x7fc0d8146060 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7fc0c8002f30 tx=0x7fc0c8006dc0).stop 2020-10-31T22:46:25.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 -- 172.21.15.60:0/1265526853 shutdown_connections 2020-10-31T22:46:25.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 --2- 172.21.15.60:0/1265526853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d80ac870 0x7fc0d8146060 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 -- 172.21.15.60:0/1265526853 >> 172.21.15.60:0/1265526853 conn(0x7fc0d80b3fd0 msgr2=0x7fc0d80b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:25.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 -- 172.21.15.60:0/1265526853 shutdown_connections 2020-10-31T22:46:25.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 -- 172.21.15.60:0/1265526853 wait complete. 2020-10-31T22:46:25.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 Processor -- start 2020-10-31T22:46:25.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 -- start start 2020-10-31T22:46:25.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0d80ac870 0x7fc0d8062d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0d80af520 0x7fc0d8155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d8146550 0x7fc0d8155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d80a8cb0 con 0x7fc0d8146550 2020-10-31T22:46:25.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d81590c0 con 0x7fc0d80af520 2020-10-31T22:46:25.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0d8159360 con 0x7fc0d80ac870 2020-10-31T22:46:25.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0de55b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d8146550 0x7fc0d8155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0de55b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d8146550 0x7fc0d8155540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44908/0 (socket says 172.21.15.60:44908) 2020-10-31T22:46:25.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0de55b700 1 -- 172.21.15.60:0/2091433301 learned_addr learned my addr 172.21.15.60:0/2091433301 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:25.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0dd559700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0d80af520 0x7fc0d8155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ddd5a700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0d80ac870 0x7fc0d8062d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0de55b700 1 -- 172.21.15.60:0/2091433301 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0d80ac870 msgr2=0x7fc0d8062d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0de55b700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0d80ac870 0x7fc0d8062d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0de55b700 1 -- 172.21.15.60:0/2091433301 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0d80af520 msgr2=0x7fc0d8155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0de55b700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0d80af520 0x7fc0d8155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0de55b700 1 -- 172.21.15.60:0/2091433301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d80a8570 con 0x7fc0d8146550 2020-10-31T22:46:25.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ddd5a700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0d80ac870 0x7fc0d8062d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:25.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0de55b700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d8146550 0x7fc0d8155540 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fc0d0000e90 tx=0x7fc0d0007980).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:25.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0c6ffd700 1 -- 172.21.15.60:0/2091433301 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d000e4a0 con 0x7fc0d8146550 2020-10-31T22:46:25.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0c6ffd700 1 -- 172.21.15.60:0/2091433301 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d000e600 con 0x7fc0d8146550 2020-10-31T22:46:25.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 -- 172.21.15.60:0/2091433301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0d80a8810 con 0x7fc0d8146550 2020-10-31T22:46:25.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0c6ffd700 1 -- 172.21.15.60:0/2091433301 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0d000e960 con 0x7fc0d8146550 2020-10-31T22:46:25.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.678+0000 7fc0ded5c700 1 -- 172.21.15.60:0/2091433301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0d8155c50 con 0x7fc0d8146550 2020-10-31T22:46:25.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.682+0000 7fc0ded5c700 1 -- 172.21.15.60:0/2091433301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0d8063540 con 0x7fc0d8146550 2020-10-31T22:46:25.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.682+0000 7fc0c6ffd700 1 -- 172.21.15.60:0/2091433301 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc0d0019030 con 0x7fc0d8146550 2020-10-31T22:46:25.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.682+0000 7fc0c6ffd700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc0b8054f10 0x7fc0b80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:25.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.682+0000 7fc0c6ffd700 1 -- 172.21.15.60:0/2091433301 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc0d006cd30 con 0x7fc0d8146550 2020-10-31T22:46:25.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.682+0000 7fc0ddd5a700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc0b8054f10 0x7fc0b80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:25.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.682+0000 7fc0ddd5a700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc0b8054f10 0x7fc0b80573d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fc0d400b000 tx=0x7fc0d4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:25.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.690+0000 7fc0c6ffd700 1 -- 172.21.15.60:0/2091433301 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc0d0041df0 con 0x7fc0d8146550 2020-10-31T22:46:25.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.878+0000 7fc0ded5c700 1 -- 172.21.15.60:0/2091433301 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0d80a89a0 con 0x7fc0d8146550 2020-10-31T22:46:25.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.878+0000 7fc0c6ffd700 1 -- 172.21.15.60:0/2091433301 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2490 (secure 0 0 0) 0x7fc0d0043300 con 0x7fc0d8146550 2020-10-31T22:46:25.880 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:25.880 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2411188619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2411188619},{"type":"v1","addr":"172.21.15.60:6835","nonce":2411188619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26},{"gid":5880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/507121609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":507121609},{"type":"v1","addr":"172.21.15.66:6833","nonce":507121609}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:46:19.877041+0000","modified":"2020-10-31T22:46:20.880233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2545916146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2545916146},{"type":"v1","addr":"172.21.15.60:6837","nonce":2545916146}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-10-31T22:46:25.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.878+0000 7fc0ded5c700 1 -- 172.21.15.60:0/2091433301 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc0b8054f10 msgr2=0x7fc0b80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.878+0000 7fc0ded5c700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc0b8054f10 0x7fc0b80573d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7fc0d400b000 tx=0x7fc0d4009040).stop 2020-10-31T22:46:25.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.878+0000 7fc0ded5c700 1 -- 172.21.15.60:0/2091433301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d8146550 msgr2=0x7fc0d8155540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:25.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.878+0000 7fc0ded5c700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d8146550 0x7fc0d8155540 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fc0d0000e90 tx=0x7fc0d0007980).stop 2020-10-31T22:46:25.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.878+0000 7fc0ded5c700 1 -- 172.21.15.60:0/2091433301 shutdown_connections 2020-10-31T22:46:25.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.878+0000 7fc0ded5c700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0d8146550 0x7fc0d8155540 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.878+0000 7fc0ded5c700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0d80ac870 0x7fc0d8062d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.878+0000 7fc0ded5c700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc0b8054f10 0x7fc0b80573d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.878+0000 7fc0ded5c700 1 --2- 172.21.15.60:0/2091433301 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0d80af520 0x7fc0d8155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:25.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.878+0000 7fc0ded5c700 1 -- 172.21.15.60:0/2091433301 >> 172.21.15.60:0/2091433301 conn(0x7fc0d80b3fd0 msgr2=0x7fc0d80a6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:25.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.878+0000 7fc0ded5c700 1 -- 172.21.15.60:0/2091433301 shutdown_connections 2020-10-31T22:46:25.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:25.878+0000 7fc0ded5c700 1 -- 172.21.15.60:0/2091433301 wait complete. 2020-10-31T22:46:25.884 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2020-10-31T22:46:26.197 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:46:19.877041+0000', 'modified': '2020-10-31T22:46:20.880233+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5889}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5889': {'gid': 5889, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/2545916146', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 2545916146}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 2545916146}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:46:26.197 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:46:26.198 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:46:26.331 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":5889,"want_state":"up:active","state":"up:active","rank_uptime":6.4423502709999996,"mdsmap_epoch":29,"osdmap_epoch":65,"osdmap_epoch_barrier":64,"uptime":11.842309803999999} 2020-10-31T22:46:26.331 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 5889, "mdsmap_epoch": 29, "osdmap_epoch": 65, "osdmap_epoch_barrier": 64, "rank_uptime": 6.442350271, "state": "up:active", "uptime": 11.842309804, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:46:26.332 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:46:26.332 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:46:26.332 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:46:26.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:26.333 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:26.341 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:46:26.398 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:46:26.399 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:46:26.452 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:46:26.453 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:46:26.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:26.454 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:46:26.501 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:46:26.502 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:26.546 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:46:26.561 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:46:26.561 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:46:26.616 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:46:26.617 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:46:26.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:26.618 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:46:26.626 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:46:26.624+0000 7fb97d6630c0 -1 init, newargv = 0x55cbe1dd9540 newargc=9ceph-fuse[13448]: starting ceph client 2020-10-31T22:46:26.627 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr: 2020-10-31T22:46:26.637 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13448]: starting fuse 2020-10-31T22:46:27.732 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:46:27.748 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:46:27.749 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:46:27.806 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:46:27.807 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:46:27.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:27.808 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:46:27.858 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:46:27.858 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:46:27.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:27.859 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:46:27.860 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:46:27.860 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:46:27.860 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:46:27.861 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:46:27.861 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:46:27.861 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:46:27.861 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:46:27.862 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:46:27.862 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:46:27.862 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:46:27.863 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:46:27.863 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:46:27.863 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:46:27.864 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:46:27.864 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:46:27.864 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:46:27.865 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:46:27.865 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:46:27.865 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:46:27.866 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:46:27.866 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:46:27.866 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:46:27.949 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.13448.asok 2020-10-31T22:46:27.954 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13448.asok 2020-10-31T22:46:27.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:27.955 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13448.asok status 2020-10-31T22:46:28.052 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:46:28.053 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:46:28.053 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:46:28.053 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:46:28.053 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:46:28.053 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:46:28.053 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:46:28.053 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "13448", 2020-10-31T22:46:28.054 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:46:28.054 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:46:28.054 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:46:28.054 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:46:28.054 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 5905, 2020-10-31T22:46:28.054 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:46:28.054 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:46:28.055 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:46:28.055 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 5905 2020-10-31T22:46:28.055 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:46:28.055 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:46:28.055 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:46:28.055 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:46:28.055 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 4005829679 2020-10-31T22:46:28.056 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:46:28.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:46:28.056 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:46:28.056 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:46:28.056 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:46:28.056 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 4005829679 2020-10-31T22:46:28.056 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:46:28.057 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.5905 172.21.15.152:0/4005829679", 2020-10-31T22:46:28.057 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/4005829679", 2020-10-31T22:46:28.057 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:46:28.057 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 29, 2020-10-31T22:46:28.057 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 65, 2020-10-31T22:46:28.057 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:46:28.057 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:46:28.057 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:46:28.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:28.062 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:46:28.062 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:28.069 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:46:28.070 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:46:28.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:28.071 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:28.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:28.132 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:46:28.133 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:28.182 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:46:28.183 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:46:28.184 INFO:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-10-31T22:46:28.184 INFO:teuthology.orchestra.run.smithi152:> import sys 2020-10-31T22:46:28.184 INFO:teuthology.orchestra.run.smithi152:> import time 2020-10-31T22:46:28.185 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:46:28.185 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:46:28.185 INFO:teuthology.orchestra.run.smithi152:> n = 1000 2020-10-31T22:46:28.185 INFO:teuthology.orchestra.run.smithi152:> abs_path = "/home/ubuntu/cephtest/mnt.0/dc-dir/dc-file" 2020-10-31T22:46:28.186 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:46:28.186 INFO:teuthology.orchestra.run.smithi152:> if not os.path.exists(os.path.dirname(abs_path)): 2020-10-31T22:46:28.186 INFO:teuthology.orchestra.run.smithi152:> os.makedirs(os.path.dirname(abs_path)) 2020-10-31T22:46:28.187 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:46:28.187 INFO:teuthology.orchestra.run.smithi152:> for i in range(0, n): 2020-10-31T22:46:28.187 INFO:teuthology.orchestra.run.smithi152:> fname = "{0}_{1}".format(abs_path, i) 2020-10-31T22:46:28.187 INFO:teuthology.orchestra.run.smithi152:> with open(fname, '"'"'w'"'"') as f: 2020-10-31T22:46:28.188 INFO:teuthology.orchestra.run.smithi152:> f.write('"'"'content'"'"') 2020-10-31T22:46:28.188 INFO:teuthology.orchestra.run.smithi152:> if True: 2020-10-31T22:46:28.188 INFO:teuthology.orchestra.run.smithi152:> f.flush() 2020-10-31T22:46:28.188 INFO:teuthology.orchestra.run.smithi152:> os.fsync(f.fileno()) 2020-10-31T22:46:28.189 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:46:41.511 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:46:41.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9bece06700 1 Processor -- start 2020-10-31T22:46:41.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9bece06700 1 -- start start 2020-10-31T22:46:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9bece06700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9be805b320 0x7f9be80b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9bece06700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be8140420 0x7f9be80b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:41.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9bece06700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be805b700 con 0x7f9be80acc80 2020-10-31T22:46:41.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9bece06700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be80b2830 con 0x7f9be805b320 2020-10-31T22:46:41.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9bece06700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be81408a0 con 0x7f9be8140420 2020-10-31T22:46:41.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9be77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9be805b320 0x7f9be80b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:41.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9be77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9be805b320 0x7f9be80b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44912/0 (socket says 172.21.15.60:44912) 2020-10-31T22:46:41.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9be77fe700 1 -- 172.21.15.60:0/1853562892 learned_addr learned my addr 172.21.15.60:0/1853562892 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:41.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9be6ffd700 1 --2- 172.21.15.60:0/1853562892 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be8140420 0x7f9be80b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:41.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9be77fe700 1 -- 172.21.15.60:0/1853562892 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be8140420 msgr2=0x7f9be80b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:41.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9be77fe700 1 --2- 172.21.15.60:0/1853562892 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be8140420 0x7f9be80b2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:41.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9be77fe700 1 -- 172.21.15.60:0/1853562892 >> v1:172.21.15.66:6789/0 conn(0x7f9be80acc80 legacy=0x7f9be80ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:41.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9be77fe700 1 -- 172.21.15.60:0/1853562892 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be80b0220 con 0x7f9be805b320 2020-10-31T22:46:41.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9be6ffd700 1 --2- 172.21.15.60:0/1853562892 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be8140420 0x7f9be80b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:46:41.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9be77fe700 1 --2- 172.21.15.60:0/1853562892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805b320 0x7f9be80b1e50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f9be00032b0 tx=0x7f9be0009270).ready entity=mon.0 client_cookie=5da70ba78d44d11 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:41.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9be67fc700 1 -- 172.21.15.60:0/1853562892 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9be000bc00 con 0x7f9be805b320 2020-10-31T22:46:41.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9be67fc700 1 -- 172.21.15.60:0/1853562892 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be000bd60 con 0x7f9be805b320 2020-10-31T22:46:41.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9be67fc700 1 -- 172.21.15.60:0/1853562892 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9be0011400 con 0x7f9be805b320 2020-10-31T22:46:41.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9bece06700 1 -- 172.21.15.60:0/1853562892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805b320 msgr2=0x7f9be80b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:41.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.625+0000 7f9bece06700 1 --2- 172.21.15.60:0/1853562892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805b320 0x7f9be80b1e50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f9be00032b0 tx=0x7f9be0009270).stop 2020-10-31T22:46:41.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9bece06700 1 -- 172.21.15.60:0/1853562892 shutdown_connections 2020-10-31T22:46:41.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9bece06700 1 --2- 172.21.15.60:0/1853562892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805b320 0x7f9be80b1e50 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:41.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9bece06700 1 --2- 172.21.15.60:0/1853562892 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be8140420 0x7f9be80b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:41.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9bece06700 1 -- 172.21.15.60:0/1853562892 >> 172.21.15.60:0/1853562892 conn(0x7f9be80b61d0 msgr2=0x7f9be80b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:41.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9bece06700 1 -- 172.21.15.60:0/1853562892 shutdown_connections 2020-10-31T22:46:41.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9bece06700 1 -- 172.21.15.60:0/1853562892 wait complete. 2020-10-31T22:46:41.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9bece06700 1 Processor -- start 2020-10-31T22:46:41.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9bece06700 1 -- start start 2020-10-31T22:46:41.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9bece06700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805b320 0x7f9be8141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:41.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9bece06700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9be80acc80 0x7f9be8141130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:41.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9bece06700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be8140420 0x7f9be813e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:41.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9bece06700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be8143a10 con 0x7f9be805b320 2020-10-31T22:46:41.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9bece06700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be813fd40 con 0x7f9be80acc80 2020-10-31T22:46:41.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9bece06700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be813da10 con 0x7f9be8140420 2020-10-31T22:46:41.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.629+0000 7f9be77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805b320 0x7f9be8141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:41.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9be77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805b320 0x7f9be8141f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44918/0 (socket says 172.21.15.60:44918) 2020-10-31T22:46:41.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9be77fe700 1 -- 172.21.15.60:0/4094733852 learned_addr learned my addr 172.21.15.60:0/4094733852 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:41.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9be6ffd700 1 --2- 172.21.15.60:0/4094733852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9be80acc80 0x7f9be8141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:41.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9be7fff700 1 --2- 172.21.15.60:0/4094733852 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be8140420 0x7f9be813e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:41.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9be77fe700 1 -- 172.21.15.60:0/4094733852 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be8140420 msgr2=0x7f9be813e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:41.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9be77fe700 1 --2- 172.21.15.60:0/4094733852 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be8140420 0x7f9be813e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:41.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9be77fe700 1 -- 172.21.15.60:0/4094733852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9be80acc80 msgr2=0x7f9be8141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:41.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9be77fe700 1 --2- 172.21.15.60:0/4094733852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9be80acc80 0x7f9be8141130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:41.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9be77fe700 1 -- 172.21.15.60:0/4094733852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be813dcb0 con 0x7f9be805b320 2020-10-31T22:46:41.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9be77fe700 1 --2- 172.21.15.60:0/4094733852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805b320 0x7f9be8141f70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f9be00032b0 tx=0x7f9be0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:41.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9be4ff9700 1 -- 172.21.15.60:0/4094733852 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9be00107a0 con 0x7f9be805b320 2020-10-31T22:46:41.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9be4ff9700 1 -- 172.21.15.60:0/4094733852 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be000bed0 con 0x7f9be805b320 2020-10-31T22:46:41.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9be4ff9700 1 -- 172.21.15.60:0/4094733852 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9be0010af0 con 0x7f9be805b320 2020-10-31T22:46:41.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9bece06700 1 -- 172.21.15.60:0/4094733852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be813df50 con 0x7f9be805b320 2020-10-31T22:46:41.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9bece06700 1 -- 172.21.15.60:0/4094733852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be8143250 con 0x7f9be805b320 2020-10-31T22:46:41.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.633+0000 7f9be4ff9700 1 -- 172.21.15.60:0/4094733852 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9be000f070 con 0x7f9be805b320 2020-10-31T22:46:41.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.637+0000 7f9bece06700 1 -- 172.21.15.60:0/4094733852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be8057100 con 0x7f9be805b320 2020-10-31T22:46:41.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.637+0000 7f9be4ff9700 1 --2- 172.21.15.60:0/4094733852 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bcc054f10 0x7f9bcc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:41.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.637+0000 7f9be4ff9700 1 -- 172.21.15.60:0/4094733852 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9be006f2f0 con 0x7f9be805b320 2020-10-31T22:46:41.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.637+0000 7f9be6ffd700 1 --2- 172.21.15.60:0/4094733852 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bcc054f10 0x7f9bcc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:41.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.637+0000 7f9be6ffd700 1 --2- 172.21.15.60:0/4094733852 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bcc054f10 0x7f9bcc0573d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f9bd000d000 tx=0x7f9bd0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:41.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.641+0000 7f9be4ff9700 1 -- 172.21.15.60:0/4094733852 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9be0049130 con 0x7f9be805b320 2020-10-31T22:46:41.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.825+0000 7f9bece06700 1 -- 172.21.15.60:0/4094733852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9be80ad320 con 0x7f9be805b320 2020-10-31T22:46:41.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.825+0000 7f9be4ff9700 1 -- 172.21.15.60:0/4094733852 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f9be0015090 con 0x7f9be805b320 2020-10-31T22:46:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:41.830 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2411188619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2411188619},{"type":"v1","addr":"172.21.15.60:6835","nonce":2411188619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26},{"gid":5880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/507121609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":507121609},{"type":"v1","addr":"172.21.15.66:6833","nonce":507121609}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:46:19.877041+0000","modified":"2020-10-31T22:46:20.880233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2545916146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2545916146},{"type":"v1","addr":"172.21.15.60:6837","nonce":2545916146}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-10-31T22:46:41.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.825+0000 7f9bece06700 1 -- 172.21.15.60:0/4094733852 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bcc054f10 msgr2=0x7f9bcc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:41.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.825+0000 7f9bece06700 1 --2- 172.21.15.60:0/4094733852 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bcc054f10 0x7f9bcc0573d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f9bd000d000 tx=0x7f9bd0008040).stop 2020-10-31T22:46:41.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.825+0000 7f9bece06700 1 -- 172.21.15.60:0/4094733852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805b320 msgr2=0x7f9be8141f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:41.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.825+0000 7f9bece06700 1 --2- 172.21.15.60:0/4094733852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805b320 0x7f9be8141f70 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f9be00032b0 tx=0x7f9be0016000).stop 2020-10-31T22:46:41.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.825+0000 7f9bece06700 1 -- 172.21.15.60:0/4094733852 shutdown_connections 2020-10-31T22:46:41.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.825+0000 7f9bece06700 1 --2- 172.21.15.60:0/4094733852 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be8140420 0x7f9be813e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:41.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.825+0000 7f9bece06700 1 --2- 172.21.15.60:0/4094733852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805b320 0x7f9be8141f70 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:41.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.825+0000 7f9bece06700 1 --2- 172.21.15.60:0/4094733852 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bcc054f10 0x7f9bcc0573d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:41.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.825+0000 7f9bece06700 1 --2- 172.21.15.60:0/4094733852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9be80acc80 0x7f9be8141130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:41.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.825+0000 7f9bece06700 1 -- 172.21.15.60:0/4094733852 >> 172.21.15.60:0/4094733852 conn(0x7f9be80b61d0 msgr2=0x7f9be80aa700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:41.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.825+0000 7f9bece06700 1 -- 172.21.15.60:0/4094733852 shutdown_connections 2020-10-31T22:46:41.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:41.825+0000 7f9bece06700 1 -- 172.21.15.60:0/4094733852 wait complete. 2020-10-31T22:46:41.833 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2020-10-31T22:46:41.844 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_caps 20 2020-10-31T22:46:41.961 INFO:teuthology.orchestra.run.smithi060.stdout:{"success":"mds_recall_max_caps = '20' (not observed, change may require restart) "} 2020-10-31T22:46:41.962 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_caps = '20' (not observed, change may require restart) " } 2020-10-31T22:46:41.962 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:46:42.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.069+0000 7f77ab43a700 1 Processor -- start 2020-10-31T22:46:42.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.069+0000 7f77ab43a700 1 -- start start 2020-10-31T22:46:42.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.069+0000 7f77ab43a700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f77a4062c70 0x7f77a41431a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.069+0000 7f77ab43a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77a40a9120 0x7f77a40b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.069+0000 7f77ab43a700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a40b1c40 con 0x7f77a40afbe0 2020-10-31T22:46:42.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.069+0000 7f77ab43a700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a413d620 con 0x7f77a4062c70 2020-10-31T22:46:42.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.069+0000 7f77ab43a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a40b27d0 con 0x7f77a40a9120 2020-10-31T22:46:42.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77a89d5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77a40a9120 0x7f77a40b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77a99d7700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f77a40afbe0 0x7f77a405b760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:46934/0 (socket says 172.21.15.60:46934) 2020-10-31T22:46:42.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77a91d6700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f77a4062c70 0x7f77a41431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77a99d7700 1 -- 172.21.15.60:0/2057432150 learned_addr learned my addr 172.21.15.60:0/2057432150 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:42.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f779bfff700 1 -- 172.21.15.60:0/2057432150 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634413515 0 0) 0x7f77a40b1c40 con 0x7f77a40afbe0 2020-10-31T22:46:42.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f779bfff700 1 -- 172.21.15.60:0/2057432150 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7788003230 con 0x7f77a40afbe0 2020-10-31T22:46:42.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77a89d5700 1 -- 172.21.15.60:0/2057432150 >> v2:172.21.15.66:3300/0 conn(0x7f77a4062c70 msgr2=0x7f77a41431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:42.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77a89d5700 1 --2- 172.21.15.60:0/2057432150 >> v2:172.21.15.66:3300/0 conn(0x7f77a4062c70 0x7f77a41431a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77a89d5700 1 -- 172.21.15.60:0/2057432150 >> v1:172.21.15.66:6789/0 conn(0x7f77a40afbe0 legacy=0x7f77a405b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77a89d5700 1 -- 172.21.15.60:0/2057432150 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a40b2a70 con 0x7f77a40a9120 2020-10-31T22:46:42.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77a89d5700 1 --2- 172.21.15.60:0/2057432150 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77a40a9120 0x7f77a40b1460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f77a40b1340 tx=0x7f7794006dc0).ready entity=mon.2 client_cookie=b382e3f25e7dc0ec server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:42.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f779bfff700 1 -- 172.21.15.60:0/2057432150 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f77940096a0 con 0x7f77a40a9120 2020-10-31T22:46:42.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f779bfff700 1 -- 172.21.15.60:0/2057432150 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7794009800 con 0x7f77a40a9120 2020-10-31T22:46:42.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f779bfff700 1 -- 172.21.15.60:0/2057432150 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7794009b60 con 0x7f77a40a9120 2020-10-31T22:46:42.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77ab43a700 1 -- 172.21.15.60:0/2057432150 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77a40a9120 msgr2=0x7f77a40b1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77ab43a700 1 --2- 172.21.15.60:0/2057432150 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77a40a9120 0x7f77a40b1460 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f77a40b1340 tx=0x7f7794006dc0).stop 2020-10-31T22:46:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77ab43a700 1 -- 172.21.15.60:0/2057432150 shutdown_connections 2020-10-31T22:46:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77ab43a700 1 --2- 172.21.15.60:0/2057432150 >> v2:172.21.15.66:3300/0 conn(0x7f77a4062c70 0x7f77a41431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77ab43a700 1 --2- 172.21.15.60:0/2057432150 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77a40a9120 0x7f77a40b1460 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77ab43a700 1 -- 172.21.15.60:0/2057432150 >> 172.21.15.60:0/2057432150 conn(0x7f77a405fae0 msgr2=0x7f77a405fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77ab43a700 1 -- 172.21.15.60:0/2057432150 shutdown_connections 2020-10-31T22:46:42.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.073+0000 7f77ab43a700 1 -- 172.21.15.60:0/2057432150 wait complete. 2020-10-31T22:46:42.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77ab43a700 1 Processor -- start 2020-10-31T22:46:42.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77ab43a700 1 -- start start 2020-10-31T22:46:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77ab43a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77a4062c70 0x7f77a40a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77ab43a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a40a9120 0x7f77a40a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77ab43a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a40afbe0 0x7f77a4154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77ab43a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a405cc90 con 0x7f77a40afbe0 2020-10-31T22:46:42.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77ab43a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a4144260 con 0x7f77a40a9120 2020-10-31T22:46:42.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77ab43a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a4145760 con 0x7f77a4062c70 2020-10-31T22:46:42.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77a99d7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a40afbe0 0x7f77a4154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77a99d7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a40afbe0 0x7f77a4154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44936/0 (socket says 172.21.15.60:44936) 2020-10-31T22:46:42.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77a99d7700 1 -- 172.21.15.60:0/2708170368 learned_addr learned my addr 172.21.15.60:0/2708170368 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:42.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77a91d6700 1 --2- 172.21.15.60:0/2708170368 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77a4062c70 0x7f77a40a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77a89d5700 1 --2- 172.21.15.60:0/2708170368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a40a9120 0x7f77a40a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77a99d7700 1 -- 172.21.15.60:0/2708170368 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77a4062c70 msgr2=0x7f77a40a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77a99d7700 1 --2- 172.21.15.60:0/2708170368 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77a4062c70 0x7f77a40a9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77a99d7700 1 -- 172.21.15.60:0/2708170368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a40a9120 msgr2=0x7f77a40a9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77a99d7700 1 --2- 172.21.15.60:0/2708170368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a40a9120 0x7f77a40a9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77a99d7700 1 -- 172.21.15.60:0/2708170368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a4145e90 con 0x7f77a40afbe0 2020-10-31T22:46:42.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77a99d7700 1 --2- 172.21.15.60:0/2708170368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a40afbe0 0x7f77a4154670 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f779c001450 tx=0x7f779c007cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:42.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f779a7fc700 1 -- 172.21.15.60:0/2708170368 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f779c005960 con 0x7f77a40afbe0 2020-10-31T22:46:42.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f779a7fc700 1 -- 172.21.15.60:0/2708170368 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779c005ac0 con 0x7f77a40afbe0 2020-10-31T22:46:42.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77ab43a700 1 -- 172.21.15.60:0/2708170368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a40b2e40 con 0x7f77a40afbe0 2020-10-31T22:46:42.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f779a7fc700 1 -- 172.21.15.60:0/2708170368 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f779c005e60 con 0x7f77a40afbe0 2020-10-31T22:46:42.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.077+0000 7f77ab43a700 1 -- 172.21.15.60:0/2708170368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a4154b60 con 0x7f77a40afbe0 2020-10-31T22:46:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.081+0000 7f779a7fc700 1 -- 172.21.15.60:0/2708170368 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f779c010030 con 0x7f77a40afbe0 2020-10-31T22:46:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.081+0000 7f77ab43a700 1 -- 172.21.15.60:0/2708170368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77a4145920 con 0x7f77a40afbe0 2020-10-31T22:46:42.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.081+0000 7f779a7fc700 1 --2- 172.21.15.60:0/2708170368 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f778c055020 0x7f778c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.081+0000 7f779a7fc700 1 -- 172.21.15.60:0/2708170368 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f779c06d9b0 con 0x7f77a40afbe0 2020-10-31T22:46:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.081+0000 7f77a91d6700 1 --2- 172.21.15.60:0/2708170368 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f778c055020 0x7f778c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.081+0000 7f77a91d6700 1 --2- 172.21.15.60:0/2708170368 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f778c055020 0x7f778c0574e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f77a000b000 tx=0x7f77a0006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:42.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.089+0000 7f779a7fc700 1 -- 172.21.15.60:0/2708170368 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f779c043ee0 con 0x7f77a40afbe0 2020-10-31T22:46:42.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.277+0000 7f77ab43a700 1 -- 172.21.15.60:0/2708170368 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77a4146020 con 0x7f77a40afbe0 2020-10-31T22:46:42.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.281+0000 7f779a7fc700 1 -- 172.21.15.60:0/2708170368 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f779c047500 con 0x7f77a40afbe0 2020-10-31T22:46:42.284 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:42.284 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2411188619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2411188619},{"type":"v1","addr":"172.21.15.60:6835","nonce":2411188619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26},{"gid":5880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/507121609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":507121609},{"type":"v1","addr":"172.21.15.66:6833","nonce":507121609}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:46:19.877041+0000","modified":"2020-10-31T22:46:20.880233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2545916146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2545916146},{"type":"v1","addr":"172.21.15.60:6837","nonce":2545916146}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-10-31T22:46:42.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.281+0000 7f77ab43a700 1 -- 172.21.15.60:0/2708170368 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f778c055020 msgr2=0x7f778c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.281+0000 7f77ab43a700 1 --2- 172.21.15.60:0/2708170368 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f778c055020 0x7f778c0574e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7f77a000b000 tx=0x7f77a0006dc0).stop 2020-10-31T22:46:42.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.281+0000 7f77ab43a700 1 -- 172.21.15.60:0/2708170368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a40afbe0 msgr2=0x7f77a4154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.281+0000 7f77ab43a700 1 --2- 172.21.15.60:0/2708170368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a40afbe0 0x7f77a4154670 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f779c001450 tx=0x7f779c007cb0).stop 2020-10-31T22:46:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.281+0000 7f77ab43a700 1 -- 172.21.15.60:0/2708170368 shutdown_connections 2020-10-31T22:46:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.281+0000 7f77ab43a700 1 --2- 172.21.15.60:0/2708170368 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f77a40afbe0 0x7f77a4154670 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.281+0000 7f77ab43a700 1 --2- 172.21.15.60:0/2708170368 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77a4062c70 0x7f77a40a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.281+0000 7f77ab43a700 1 --2- 172.21.15.60:0/2708170368 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f778c055020 0x7f778c0574e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.281+0000 7f77ab43a700 1 --2- 172.21.15.60:0/2708170368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77a40a9120 0x7f77a40a9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.281+0000 7f77ab43a700 1 -- 172.21.15.60:0/2708170368 >> 172.21.15.60:0/2708170368 conn(0x7f77a405fae0 msgr2=0x7f77a413da70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:42.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.281+0000 7f77ab43a700 1 -- 172.21.15.60:0/2708170368 shutdown_connections 2020-10-31T22:46:42.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.281+0000 7f77ab43a700 1 -- 172.21.15.60:0/2708170368 wait complete. 2020-10-31T22:46:42.290 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2020-10-31T22:46:42.297 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json config set mds_recall_max_decay_threshold 400 2020-10-31T22:46:42.415 INFO:teuthology.orchestra.run.smithi060.stdout:{"success":"mds_recall_max_decay_threshold = '400' (not observed, change may require restart) "} 2020-10-31T22:46:42.416 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_recall_max_decay_threshold = '400' (not observed, change may require restart) " } 2020-10-31T22:46:42.416 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:46:42.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f2064f61700 1 Processor -- start 2020-10-31T22:46:42.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f2064f61700 1 -- start start 2020-10-31T22:46:42.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f2064f61700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20600b5950 0x7f20601426f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f2064f61700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2060145180 con 0x7f20600b24a0 2020-10-31T22:46:42.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f2064f61700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20600b0670 con 0x7f20600b5570 2020-10-31T22:46:42.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f2064f61700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20600afae0 con 0x7f20600b5950 2020-10-31T22:46:42.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f20600b24a0 0x7f2060141fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49078/0 (socket says 172.21.15.60:49078) 2020-10-31T22:46:42.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205effd700 1 -- 172.21.15.60:0/1857571452 learned_addr learned my addr 172.21.15.60:0/1857571452 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:42.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205ffff700 1 --2- 172.21.15.60:0/1857571452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20600b5950 0x7f20601426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3060735832 0 0) 0x7f2060145180 con 0x7f20600b24a0 2020-10-31T22:46:42.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2040003230 con 0x7f20600b24a0 2020-10-31T22:46:42.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888814057 0 0) 0x7f20600b0670 con 0x7f20600b5570 2020-10-31T22:46:42.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2060145180 con 0x7f20600b5570 2020-10-31T22:46:42.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 253534358 0 0) 0x7f2040003230 con 0x7f20600b24a0 2020-10-31T22:46:42.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20600b5950 msgr2=0x7f20601426f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:42.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 --2- 172.21.15.60:0/1857571452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20600b5950 0x7f20601426f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 >> v1:172.21.15.66:6789/0 conn(0x7f20600b5570 legacy=0x7f2060145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20600b0910 con 0x7f20600b24a0 2020-10-31T22:46:42.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f20480016d0 con 0x7f20600b24a0 2020-10-31T22:46:42.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 >> v1:172.21.15.60:6789/0 conn(0x7f20600b24a0 legacy=0x7f2060141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 --2- 172.21.15.60:0/1857571452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20400038e0 0x7f2040003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 --2- 172.21.15.60:0/1857571452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20400044d0 0x7f2040004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 --2- 172.21.15.60:0/1857571452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20600b5950 0x7f2040004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20600afae0 con 0x7f20400038e0 2020-10-31T22:46:42.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2040005360 con 0x7f20400044d0 2020-10-31T22:46:42.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204000b770 con 0x7f20600b5950 2020-10-31T22:46:42.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205f7fe700 1 --2- 172.21.15.60:0/1857571452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20400038e0 0x7f2040003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205effd700 1 --2- 172.21.15.60:0/1857571452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20400044d0 0x7f2040004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205ffff700 1 --2- 172.21.15.60:0/1857571452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20600b5950 0x7f2040004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205f7fe700 1 -- 172.21.15.60:0/1857571452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20600b5950 msgr2=0x7f2040004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:42.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205f7fe700 1 --2- 172.21.15.60:0/1857571452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20600b5950 0x7f2040004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205f7fe700 1 -- 172.21.15.60:0/1857571452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20400044d0 msgr2=0x7f2040004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:42.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205f7fe700 1 --2- 172.21.15.60:0/1857571452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20400044d0 0x7f2040004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205f7fe700 1 -- 172.21.15.60:0/1857571452 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2040003230 con 0x7f20400038e0 2020-10-31T22:46:42.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205effd700 1 --2- 172.21.15.60:0/1857571452 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20400044d0 0x7f2040004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:42.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205f7fe700 1 --2- 172.21.15.60:0/1857571452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20400038e0 0x7f2040003ce0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f20400054a0 tx=0x7f2058007e50).ready entity=mon.0 client_cookie=7512671342128678 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:42.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f205800cbc0 con 0x7f20400038e0 2020-10-31T22:46:42.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205800cd20 con 0x7f20400038e0 2020-10-31T22:46:42.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205e7fc700 1 -- 172.21.15.60:0/1857571452 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20580125f0 con 0x7f20400038e0 2020-10-31T22:46:42.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f2064f61700 1 -- 172.21.15.60:0/1857571452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20400038e0 msgr2=0x7f2040003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f2064f61700 1 --2- 172.21.15.60:0/1857571452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20400038e0 0x7f2040003ce0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f20400054a0 tx=0x7f2058007e50).stop 2020-10-31T22:46:42.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.529+0000 7f205ffff700 1 -- 172.21.15.60:0/1857571452 reap_dead start 2020-10-31T22:46:42.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.533+0000 7f2064f61700 1 -- 172.21.15.60:0/1857571452 shutdown_connections 2020-10-31T22:46:42.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.533+0000 7f2064f61700 1 -- 172.21.15.60:0/1857571452 >> 172.21.15.60:0/1857571452 conn(0x7f20600b8e90 msgr2=0x7f20600b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:42.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.533+0000 7f2064f61700 1 -- 172.21.15.60:0/1857571452 shutdown_connections 2020-10-31T22:46:42.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.533+0000 7f2064f61700 1 -- 172.21.15.60:0/1857571452 wait complete. 2020-10-31T22:46:42.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.533+0000 7f2064f61700 1 Processor -- start 2020-10-31T22:46:42.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.533+0000 7f2064f61700 1 -- start start 2020-10-31T22:46:42.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.533+0000 7f2064f61700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2060140c30 0x7f206013df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.533+0000 7f2064f61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2060141990 0x7f206013b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.533+0000 7f2064f61700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f206013ba10 0x7f2060150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.533+0000 7f2064f61700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206013e680 con 0x7f2060141990 2020-10-31T22:46:42.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.533+0000 7f2064f61700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2060141010 con 0x7f2060140c30 2020-10-31T22:46:42.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.533+0000 7f2064f61700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206013e3f0 con 0x7f206013ba10 2020-10-31T22:46:42.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.533+0000 7f205effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2060141990 0x7f206013b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f205effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2060141990 0x7f206013b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44954/0 (socket says 172.21.15.60:44954) 2020-10-31T22:46:42.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f205effd700 1 -- 172.21.15.60:0/2002963328 learned_addr learned my addr 172.21.15.60:0/2002963328 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:42.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f205f7fe700 1 --2- 172.21.15.60:0/2002963328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2060140c30 0x7f206013df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f205ffff700 1 --2- 172.21.15.60:0/2002963328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f206013ba10 0x7f2060150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f205effd700 1 -- 172.21.15.60:0/2002963328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f206013ba10 msgr2=0x7f2060150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f205effd700 1 --2- 172.21.15.60:0/2002963328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f206013ba10 0x7f2060150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f205effd700 1 -- 172.21.15.60:0/2002963328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2060140c30 msgr2=0x7f206013df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f205effd700 1 --2- 172.21.15.60:0/2002963328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2060140c30 0x7f206013df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f205effd700 1 -- 172.21.15.60:0/2002963328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2060148ae0 con 0x7f2060141990 2020-10-31T22:46:42.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f205effd700 1 --2- 172.21.15.60:0/2002963328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2060141990 0x7f206013b520 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f20480010d0 tx=0x7f20600b0800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:42.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f205cff9700 1 -- 172.21.15.60:0/2002963328 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2048005500 con 0x7f2060141990 2020-10-31T22:46:42.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f205cff9700 1 -- 172.21.15.60:0/2002963328 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2048010040 con 0x7f2060141990 2020-10-31T22:46:42.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f2064f61700 1 -- 172.21.15.60:0/2002963328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2060148d80 con 0x7f2060141990 2020-10-31T22:46:42.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f205cff9700 1 -- 172.21.15.60:0/2002963328 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f20480047a0 con 0x7f2060141990 2020-10-31T22:46:42.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f2064f61700 1 -- 172.21.15.60:0/2002963328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206013be90 con 0x7f2060141990 2020-10-31T22:46:42.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f2064f61700 1 -- 172.21.15.60:0/2002963328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2060057100 con 0x7f2060141990 2020-10-31T22:46:42.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.537+0000 7f205cff9700 1 -- 172.21.15.60:0/2002963328 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2048004900 con 0x7f2060141990 2020-10-31T22:46:42.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.541+0000 7f205cff9700 1 --2- 172.21.15.60:0/2002963328 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f20440550c0 0x7f2044057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.541+0000 7f205f7fe700 1 --2- 172.21.15.60:0/2002963328 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f20440550c0 0x7f2044057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.541+0000 7f205cff9700 1 -- 172.21.15.60:0/2002963328 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f204806d710 con 0x7f2060141990 2020-10-31T22:46:42.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.541+0000 7f205f7fe700 1 --2- 172.21.15.60:0/2002963328 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f20440550c0 0x7f2044057580 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f205801c000 tx=0x7f2058015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:42.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.541+0000 7f205cff9700 1 -- 172.21.15.60:0/2002963328 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2048043c30 con 0x7f2060141990 2020-10-31T22:46:42.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.729+0000 7f2064f61700 1 -- 172.21.15.60:0/2002963328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f206005a8e0 con 0x7f2060141990 2020-10-31T22:46:42.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.729+0000 7f205cff9700 1 -- 172.21.15.60:0/2002963328 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f204801b020 con 0x7f2060141990 2020-10-31T22:46:42.735 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:42.735 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2411188619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2411188619},{"type":"v1","addr":"172.21.15.60:6835","nonce":2411188619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26},{"gid":5880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/507121609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":507121609},{"type":"v1","addr":"172.21.15.66:6833","nonce":507121609}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:46:19.877041+0000","modified":"2020-10-31T22:46:20.880233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2545916146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2545916146},{"type":"v1","addr":"172.21.15.60:6837","nonce":2545916146}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-10-31T22:46:42.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.733+0000 7f2064f61700 1 -- 172.21.15.60:0/2002963328 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f20440550c0 msgr2=0x7f2044057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.733+0000 7f2064f61700 1 --2- 172.21.15.60:0/2002963328 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f20440550c0 0x7f2044057580 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f205801c000 tx=0x7f2058015000).stop 2020-10-31T22:46:42.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.733+0000 7f2064f61700 1 -- 172.21.15.60:0/2002963328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2060141990 msgr2=0x7f206013b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.733+0000 7f2064f61700 1 --2- 172.21.15.60:0/2002963328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2060141990 0x7f206013b520 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f20480010d0 tx=0x7f20600b0800).stop 2020-10-31T22:46:42.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.733+0000 7f2064f61700 1 -- 172.21.15.60:0/2002963328 shutdown_connections 2020-10-31T22:46:42.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.733+0000 7f2064f61700 1 --2- 172.21.15.60:0/2002963328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f206013ba10 0x7f2060150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.733+0000 7f2064f61700 1 --2- 172.21.15.60:0/2002963328 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f20440550c0 0x7f2044057580 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.733+0000 7f2064f61700 1 --2- 172.21.15.60:0/2002963328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2060140c30 0x7f206013df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.733+0000 7f2064f61700 1 --2- 172.21.15.60:0/2002963328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2060141990 0x7f206013b520 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.733+0000 7f2064f61700 1 -- 172.21.15.60:0/2002963328 >> 172.21.15.60:0/2002963328 conn(0x7f20600b8e90 msgr2=0x7f20600b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:42.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.733+0000 7f2064f61700 1 -- 172.21.15.60:0/2002963328 shutdown_connections 2020-10-31T22:46:42.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.733+0000 7f2064f61700 1 -- 172.21.15.60:0/2002963328 wait complete. 2020-10-31T22:46:42.739 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2020-10-31T22:46:42.748 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell mds.c cache drop 10 2020-10-31T22:46:42.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 Processor -- start 2020-10-31T22:46:42.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 -- start start 2020-10-31T22:46:42.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f298c05c660 0x7f298c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f298c0b2e20 0x7f298c142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f298c066410 con 0x7f298c065f70 2020-10-31T22:46:42.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298c066d60 con 0x7f298c05c660 2020-10-31T22:46:42.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f298c0b5e80 con 0x7f298c0b2e20 2020-10-31T22:46:42.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f298bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f298c05c660 0x7f298c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f298bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f298c05c660 0x7f298c0b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44960/0 (socket says 172.21.15.60:44960) 2020-10-31T22:46:42.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f2990ecb700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f298c0b2e20 0x7f298c142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f298bfff700 1 -- 172.21.15.60:0/811998026 learned_addr learned my addr 172.21.15.60:0/811998026 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:42.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f298bfff700 1 -- 172.21.15.60:0/811998026 >> v2:172.21.15.66:3300/0 conn(0x7f298c0b2e20 msgr2=0x7f298c142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:42.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f298bfff700 1 --2- 172.21.15.60:0/811998026 >> v2:172.21.15.66:3300/0 conn(0x7f298c0b2e20 0x7f298c142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f298bfff700 1 -- 172.21.15.60:0/811998026 >> v1:172.21.15.66:6789/0 conn(0x7f298c065f70 legacy=0x7f298c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f298bfff700 1 -- 172.21.15.60:0/811998026 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c0666b0 con 0x7f298c05c660 2020-10-31T22:46:42.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f298bfff700 1 --2- 172.21.15.60:0/811998026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f298c05c660 0x7f298c0b5990 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f2974002f30 tx=0x7f2974006e80).ready entity=mon.0 client_cookie=728a29d6cf5adae2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:42.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f298affd700 1 -- 172.21.15.60:0/811998026 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29740097f0 con 0x7f298c05c660 2020-10-31T22:46:42.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f298affd700 1 -- 172.21.15.60:0/811998026 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2974009950 con 0x7f298c05c660 2020-10-31T22:46:42.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f298affd700 1 -- 172.21.15.60:0/811998026 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2974009cb0 con 0x7f298c05c660 2020-10-31T22:46:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 -- 172.21.15.60:0/811998026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f298c05c660 msgr2=0x7f298c0b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 --2- 172.21.15.60:0/811998026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f298c05c660 0x7f298c0b5990 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f2974002f30 tx=0x7f2974006e80).stop 2020-10-31T22:46:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 -- 172.21.15.60:0/811998026 shutdown_connections 2020-10-31T22:46:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 --2- 172.21.15.60:0/811998026 >> v2:172.21.15.66:3300/0 conn(0x7f298c0b2e20 0x7f298c142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 --2- 172.21.15.60:0/811998026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f298c05c660 0x7f298c0b5990 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 -- 172.21.15.60:0/811998026 >> 172.21.15.60:0/811998026 conn(0x7f298c0601e0 msgr2=0x7f298c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:42.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 -- 172.21.15.60:0/811998026 shutdown_connections 2020-10-31T22:46:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.869+0000 7f299292e700 1 -- 172.21.15.60:0/811998026 wait complete. 2020-10-31T22:46:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f299292e700 1 Processor -- start 2020-10-31T22:46:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f299292e700 1 -- start start 2020-10-31T22:46:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f299292e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f298c05c660 0x7f298c0b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f299292e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f298c065f70 0x7f298c151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f299292e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f298c0b2e20 0x7f298c0ac6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.892 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f299292e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0a8480 con 0x7f298c05c660 2020-10-31T22:46:42.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f299292e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298c0a81e0 con 0x7f298c0b2e20 2020-10-31T22:46:42.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f299292e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298c150ec0 con 0x7f298c065f70 2020-10-31T22:46:42.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f298bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f298c05c660 0x7f298c0b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f298bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f298c05c660 0x7f298c0b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44964/0 (socket says 172.21.15.60:44964) 2020-10-31T22:46:42.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f298bfff700 1 -- 172.21.15.60:0/2795713716 learned_addr learned my addr 172.21.15.60:0/2795713716 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:42.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f2990ecb700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f298c0b2e20 0x7f298c0ac6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f298b7fe700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f298c065f70 0x7f298c151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f298bfff700 1 -- 172.21.15.60:0/2795713716 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f298c065f70 msgr2=0x7f298c151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f298bfff700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f298c065f70 0x7f298c151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f298bfff700 1 -- 172.21.15.60:0/2795713716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f298c0b2e20 msgr2=0x7f298c0ac6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f298bfff700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f298c0b2e20 0x7f298c0ac6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f298bfff700 1 -- 172.21.15.60:0/2795713716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c151160 con 0x7f298c05c660 2020-10-31T22:46:42.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f2990ecb700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f298c0b2e20 0x7f298c0ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:42.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f298bfff700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f298c05c660 0x7f298c0b1130 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f2974002f30 tx=0x7f2974015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:42.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f29897fa700 1 -- 172.21.15.60:0/2795713716 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2974011ce0 con 0x7f298c05c660 2020-10-31T22:46:42.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f299292e700 1 -- 172.21.15.60:0/2795713716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f298c0aeca0 con 0x7f298c05c660 2020-10-31T22:46:42.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f29897fa700 1 -- 172.21.15.60:0/2795713716 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2974011e40 con 0x7f298c05c660 2020-10-31T22:46:42.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f29897fa700 1 -- 172.21.15.60:0/2795713716 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f297401e650 con 0x7f298c05c660 2020-10-31T22:46:42.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.873+0000 7f299292e700 1 -- 172.21.15.60:0/2795713716 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f298c151af0 con 0x7f298c05c660 2020-10-31T22:46:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.877+0000 7f29897fa700 1 -- 172.21.15.60:0/2795713716 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f297401a040 con 0x7f298c05c660 2020-10-31T22:46:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.877+0000 7f29897fa700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2970054f10 0x7f29700573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.877+0000 7f29897fa700 1 -- 172.21.15.60:0/2795713716 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f297406eb70 con 0x7f298c05c660 2020-10-31T22:46:42.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.877+0000 7f298b7fe700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2970054f10 0x7f29700573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.877+0000 7f298b7fe700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2970054f10 0x7f29700573d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f297c00b000 tx=0x7f297c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.877+0000 7f29a12c6740 1 Processor -- start 2020-10-31T22:46:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.877+0000 7f29a12c6740 1 -- start start 2020-10-31T22:46:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf8bb30 0xfd7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xdf4820 0xfd6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd86c20 0xfd6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0xe91250 con 0xdf4820 2020-10-31T22:46:42.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0xf00df0 con 0xd86c20 2020-10-31T22:46:42.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0xe0d6b0 con 0xf8bb30 2020-10-31T22:46:42.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f298b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xdf4820 0xfd6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f298b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xdf4820 0xfd6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44974/0 (socket says 172.21.15.60:44974) 2020-10-31T22:46:42.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f298b7fe700 1 -- 172.21.15.60:0/3613883294 learned_addr learned my addr 172.21.15.60:0/3613883294 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:42.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f298bfff700 1 --2- 172.21.15.60:0/3613883294 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf8bb30 0xfd7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f2990ecb700 1 --2- 172.21.15.60:0/3613883294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd86c20 0xfd6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f298b7fe700 1 -- 172.21.15.60:0/3613883294 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf8bb30 msgr2=0xfd7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:42.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f298b7fe700 1 --2- 172.21.15.60:0/3613883294 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf8bb30 0xfd7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f298b7fe700 1 -- 172.21.15.60:0/3613883294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd86c20 msgr2=0xfd6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:42.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f298b7fe700 1 --2- 172.21.15.60:0/3613883294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd86c20 0xfd6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f298b7fe700 1 -- 172.21.15.60:0/3613883294 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xf21bb0 con 0xdf4820 2020-10-31T22:46:42.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f298b7fe700 1 --2- 172.21.15.60:0/3613883294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xdf4820 0xfd6150 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x100d8e0 tx=0x7f297c010000).ready entity=mon.0 client_cookie=3357e2eed0889e0d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:42.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f299292e700 1 -- 172.21.15.60:0/3613883294 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f297c015810 con 0xdf4820 2020-10-31T22:46:42.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f299292e700 1 -- 172.21.15.60:0/3613883294 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297c015970 con 0xdf4820 2020-10-31T22:46:42.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f299292e700 1 -- 172.21.15.60:0/3613883294 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f297c015cd0 con 0xdf4820 2020-10-31T22:46:42.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 -- 172.21.15.60:0/3613883294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xdf4820 msgr2=0xfd6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 --2- 172.21.15.60:0/3613883294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xdf4820 0xfd6150 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x100d8e0 tx=0x7f297c010000).stop 2020-10-31T22:46:42.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 -- 172.21.15.60:0/3613883294 shutdown_connections 2020-10-31T22:46:42.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 --2- 172.21.15.60:0/3613883294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd86c20 0xfd6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 --2- 172.21.15.60:0/3613883294 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf8bb30 0xfd7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 --2- 172.21.15.60:0/3613883294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xdf4820 0xfd6150 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 -- 172.21.15.60:0/3613883294 >> 172.21.15.60:0/3613883294 conn(0xfbb590 msgr2=0xfba620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:42.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 -- 172.21.15.60:0/3613883294 shutdown_connections 2020-10-31T22:46:42.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 -- 172.21.15.60:0/3613883294 wait complete. 2020-10-31T22:46:42.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 -- start start 2020-10-31T22:46:42.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.881+0000 7f29a12c6740 1 Processor -- start 2020-10-31T22:46:42.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd86c20 0x1006840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xdf4820 0xfd7a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xf8bb30 0x10206b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0xf30860 con 0xf8bb30 2020-10-31T22:46:42.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0xf309a0 con 0xd86c20 2020-10-31T22:46:42.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0xf31f70 con 0xdf4820 2020-10-31T22:46:42.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 10 client.0 ll_register_callbacks cb 0xf27500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2020-10-31T22:46:42.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f2990ecb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xf8bb30 0x10206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f2990ecb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xf8bb30 0x10206b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44980/0 (socket says 172.21.15.60:44980) 2020-10-31T22:46:42.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f2990ecb700 1 -- 172.21.15.60:0/1392498915 learned_addr learned my addr 172.21.15.60:0/1392498915 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:42.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f298b7fe700 1 --2- 172.21.15.60:0/1392498915 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xdf4820 0xfd7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f298bfff700 1 --2- 172.21.15.60:0/1392498915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd86c20 0x1006840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f2990ecb700 1 -- 172.21.15.60:0/1392498915 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xdf4820 msgr2=0xfd7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:42.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f2990ecb700 1 --2- 172.21.15.60:0/1392498915 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xdf4820 0xfd7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f2990ecb700 1 -- 172.21.15.60:0/1392498915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd86c20 msgr2=0x1006840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:42.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f2990ecb700 1 --2- 172.21.15.60:0/1392498915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd86c20 0x1006840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f2990ecb700 1 -- 172.21.15.60:0/1392498915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xda4790 con 0xf8bb30 2020-10-31T22:46:42.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f2990ecb700 1 --2- 172.21.15.60:0/1392498915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xf8bb30 0x10206b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x100f010 tx=0x7f2984008040).ready entity=mon.0 client_cookie=bd48ec978828b9a4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f296affd700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2020-10-31T22:46:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f296affd700 1 -- 172.21.15.60:0/1392498915 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2984012a70 con 0xf8bb30 2020-10-31T22:46:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f296affd700 1 -- 172.21.15.60:0/1392498915 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2984012bd0 con 0xf8bb30 2020-10-31T22:46:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 -- 172.21.15.60:0/1392498915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xee1810 con 0xf8bb30 2020-10-31T22:46:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f296affd700 1 -- 172.21.15.60:0/1392498915 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2984012d90 con 0xf8bb30 2020-10-31T22:46:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 10 client.6075 fetch_fsmap learned FSMap version 29 2020-10-31T22:46:42.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 -- 172.21.15.60:0/1392498915 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0xdafe70 con 0xf8bb30 2020-10-31T22:46:42.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f296affd700 1 -- 172.21.15.60:0/1392498915 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xee1810 con 0xf8bb30 2020-10-31T22:46:42.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f296affd700 1 -- 172.21.15.60:0/1392498915 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f2984016a40 con 0xf8bb30 2020-10-31T22:46:42.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 10 client.6075 fetch_fsmap finished waiting for FSMap version 29 2020-10-31T22:46:42.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 10 client.6075 resolve_mds: resolved ID 'c' to GID 5889 2020-10-31T22:46:42.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 20 client.6075 populate_metadata read hostname 'smithi060' 2020-10-31T22:46:42.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 --2- 172.21.15.60:0/1392498915 >> [v2:172.21.15.60:6836/2545916146,v1:172.21.15.60:6837/2545916146] conn(0xfd7f80 0x1020ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 4 client.6075 mds_command: new command op to 5889 tid=0[{"prefix": "get_command_descriptions"}] 2020-10-31T22:46:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 -- 172.21.15.60:0/1392498915 --> [v2:172.21.15.60:6836/2545916146,v1:172.21.15.60:6837/2545916146] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xe198d0 con 0xfd7f80 2020-10-31T22:46:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f298bfff700 1 --2- 172.21.15.60:0/1392498915 >> [v2:172.21.15.60:6836/2545916146,v1:172.21.15.60:6837/2545916146] conn(0xfd7f80 0x1020ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f296affd700 10 client.6075 ms_handle_connect on v2:172.21.15.60:6836/2545916146 2020-10-31T22:46:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f298bfff700 1 --2- 172.21.15.60:0/1392498915 >> [v2:172.21.15.60:6836/2545916146,v1:172.21.15.60:6837/2545916146] conn(0xfd7f80 0x1020ba0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=860d7d6da7179f33 server_cookie=78ee5f8c6fce4867 in_seq=0 out_seq=0 2020-10-31T22:46:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f296affd700 1 -- 172.21.15.60:0/1392498915 <== mds.0 v2:172.21.15.60:6836/2545916146 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16606 (crc 0 0 0) 0xe198d0 con 0xfd7f80 2020-10-31T22:46:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f296affd700 10 client.6075 handle_command_reply: tid=0 2020-10-31T22:46:42.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 client.6075 shutdown 2020-10-31T22:46:42.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 -- 172.21.15.60:0/1392498915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xf8bb30 msgr2=0x10206b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 --2- 172.21.15.60:0/1392498915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xf8bb30 0x10206b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x100f010 tx=0x7f2984008040).stop 2020-10-31T22:46:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 -- 172.21.15.60:0/1392498915 shutdown_connections 2020-10-31T22:46:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 --2- 172.21.15.60:0/1392498915 >> [v2:172.21.15.60:6836/2545916146,v1:172.21.15.60:6837/2545916146] conn(0xfd7f80 0x1020ba0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 --2- 172.21.15.60:0/1392498915 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xf8bb30 0x10206b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f296affd700 0 client.6075 ms_handle_reset on v2:172.21.15.60:6836/2545916146 2020-10-31T22:46:42.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 --2- 172.21.15.60:0/1392498915 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xd86c20 0x1006840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.885+0000 7f29a12c6740 1 --2- 172.21.15.60:0/1392498915 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xdf4820 0xfd7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.889+0000 7f29a12c6740 1 -- 172.21.15.60:0/1392498915 >> 172.21.15.60:0/1392498915 conn(0xfbb590 msgr2=0x1008f40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:42.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.889+0000 7f29a12c6740 1 -- 172.21.15.60:0/1392498915 shutdown_connections 2020-10-31T22:46:42.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.889+0000 7f29a12c6740 1 -- 172.21.15.60:0/1392498915 wait complete. 2020-10-31T22:46:42.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.889+0000 7f29a12c6740 20 client.6075 trim_cache size 0 max 16384 2020-10-31T22:46:42.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 Processor -- start 2020-10-31T22:46:42.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 -- start start 2020-10-31T22:46:42.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd86c20 0x101caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xdf4820 0xfd9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xf8bb30 0xfd6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0xf133b0 con 0xd86c20 2020-10-31T22:46:42.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x10106d0 con 0xf8bb30 2020-10-31T22:46:42.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x1010470 con 0xdf4820 2020-10-31T22:46:42.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd86c20 0x101caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd86c20 0x101caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44986/0 (socket says 172.21.15.60:44986) 2020-10-31T22:46:42.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 -- 172.21.15.60:0/2223873800 learned_addr learned my addr 172.21.15.60:0/2223873800 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:42.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f2990ecb700 1 --2- 172.21.15.60:0/2223873800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xf8bb30 0xfd6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298b7fe700 1 --2- 172.21.15.60:0/2223873800 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xdf4820 0xfd9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 -- 172.21.15.60:0/2223873800 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xdf4820 msgr2=0xfd9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:42.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 --2- 172.21.15.60:0/2223873800 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xdf4820 0xfd9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 -- 172.21.15.60:0/2223873800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xf8bb30 msgr2=0xfd6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:42.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 --2- 172.21.15.60:0/2223873800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xf8bb30 0xfd6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 -- 172.21.15.60:0/2223873800 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f298c140bb0 con 0xd86c20 2020-10-31T22:46:42.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298b7fe700 1 --2- 172.21.15.60:0/2223873800 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xdf4820 0xfd9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:42.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 --2- 172.21.15.60:0/2223873800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd86c20 0x101caf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0xfb0750 tx=0x7f2974000b80).ready entity=mon.0 client_cookie=e8b4cf5fca6590f0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:42.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29817fa700 1 -- 172.21.15.60:0/2223873800 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2974047050 con 0xd86c20 2020-10-31T22:46:42.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29817fa700 1 -- 172.21.15.60:0/2223873800 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2974044aa0 con 0xd86c20 2020-10-31T22:46:42.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29817fa700 1 -- 172.21.15.60:0/2223873800 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2974044e00 con 0xd86c20 2020-10-31T22:46:42.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 -- 172.21.15.60:0/2223873800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd86c20 msgr2=0x101caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:42.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 --2- 172.21.15.60:0/2223873800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd86c20 0x101caf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0xfb0750 tx=0x7f2974000b80).stop 2020-10-31T22:46:42.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 -- 172.21.15.60:0/2223873800 shutdown_connections 2020-10-31T22:46:42.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 --2- 172.21.15.60:0/2223873800 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xf8bb30 0xfd6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 --2- 172.21.15.60:0/2223873800 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd86c20 0x101caf0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 --2- 172.21.15.60:0/2223873800 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xdf4820 0xfd9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 -- 172.21.15.60:0/2223873800 >> 172.21.15.60:0/2223873800 conn(0xfbb590 msgr2=0xfd1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:42.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 -- 172.21.15.60:0/2223873800 shutdown_connections 2020-10-31T22:46:42.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 -- 172.21.15.60:0/2223873800 wait complete. 2020-10-31T22:46:42.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 -- start start 2020-10-31T22:46:42.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 Processor -- start 2020-10-31T22:46:42.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd86c20 0xfda1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xdf4820 0x100f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf8bb30 0x106fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0xf008e0 con 0xd86c20 2020-10-31T22:46:42.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0xfd4c40 con 0xdf4820 2020-10-31T22:46:42.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x100cf30 con 0xf8bb30 2020-10-31T22:46:42.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f29a12c6740 10 client.0 ll_register_callbacks cb 0xfd9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2020-10-31T22:46:42.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd86c20 0xfda1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd86c20 0xfda1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:44992/0 (socket says 172.21.15.60:44992) 2020-10-31T22:46:42.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 -- 172.21.15.60:0/1843473709 learned_addr learned my addr 172.21.15.60:0/1843473709 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:42.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298b7fe700 1 --2- 172.21.15.60:0/1843473709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xdf4820 0x100f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f2990ecb700 1 --2- 172.21.15.60:0/1843473709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf8bb30 0x106fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 -- 172.21.15.60:0/1843473709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf8bb30 msgr2=0x106fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:42.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 --2- 172.21.15.60:0/1843473709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf8bb30 0x106fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 -- 172.21.15.60:0/1843473709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xdf4820 msgr2=0x100f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:42.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 --2- 172.21.15.60:0/1843473709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xdf4820 0x100f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:42.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 -- 172.21.15.60:0/1843473709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x101a030 con 0xd86c20 2020-10-31T22:46:42.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f298bfff700 1 --2- 172.21.15.60:0/1843473709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd86c20 0xfda1c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0xfb0750 tx=0x7f2974036000).ready entity=mon.0 client_cookie=e1300c78ae48fd74 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:42.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.909+0000 7f296bfff700 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2020-10-31T22:46:42.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f296bfff700 1 -- 172.21.15.60:0/1843473709 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2974044ff0 con 0xd86c20 2020-10-31T22:46:42.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f29a12c6740 1 -- 172.21.15.60:0/1843473709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xfd3650 con 0xd86c20 2020-10-31T22:46:42.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f296bfff700 1 -- 172.21.15.60:0/1843473709 <== mon.0 v2:172.21.15.60:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2974040c90 con 0xd86c20 2020-10-31T22:46:42.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f296bfff700 1 -- 172.21.15.60:0/1843473709 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2974048610 con 0xd86c20 2020-10-31T22:46:42.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f29a12c6740 10 client.6081 fetch_fsmap learned FSMap version 29 2020-10-31T22:46:42.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f29a12c6740 1 -- 172.21.15.60:0/1843473709 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0xfba380 con 0xd86c20 2020-10-31T22:46:42.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f296bfff700 1 -- 172.21.15.60:0/1843473709 <== mon.0 v2:172.21.15.60:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xfd3650 con 0xd86c20 2020-10-31T22:46:42.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f296bfff700 1 -- 172.21.15.60:0/1843473709 <== mon.0 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) v1 ==== 1434+0+0 (secure 0 0 0) 0x7f297406e3b0 con 0xd86c20 2020-10-31T22:46:42.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f29a12c6740 10 client.6081 fetch_fsmap finished waiting for FSMap version 29 2020-10-31T22:46:42.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f29a12c6740 10 client.6081 resolve_mds: resolved ID 'c' to GID 5889 2020-10-31T22:46:42.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f29a12c6740 20 client.6081 populate_metadata read hostname 'smithi060' 2020-10-31T22:46:42.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f29a12c6740 1 --2- 172.21.15.60:0/1843473709 >> [v2:172.21.15.60:6836/2545916146,v1:172.21.15.60:6837/2545916146] conn(0x1070350 0x100b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:42.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f29a12c6740 4 client.6081 mds_command: new command op to 5889 tid=0[{"prefix": "cache drop", "timeout": 10}] 2020-10-31T22:46:42.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f29a12c6740 1 -- 172.21.15.60:0/1843473709 --> [v2:172.21.15.60:6836/2545916146,v1:172.21.15.60:6837/2545916146] -- command(tid 0: {"prefix": "cache drop", "timeout": 10}) v1 -- 0xdea4d0 con 0x1070350 2020-10-31T22:46:42.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f298b7fe700 1 --2- 172.21.15.60:0/1843473709 >> [v2:172.21.15.60:6836/2545916146,v1:172.21.15.60:6837/2545916146] conn(0x1070350 0x100b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:42.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f296bfff700 10 client.6081 ms_handle_connect on v2:172.21.15.60:6836/2545916146 2020-10-31T22:46:42.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:42.913+0000 7f298b7fe700 1 --2- 172.21.15.60:0/1843473709 >> [v2:172.21.15.60:6836/2545916146,v1:172.21.15.60:6837/2545916146] conn(0x1070350 0x100b8e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).ready entity=mds.0 client_cookie=cc49c004ca9730d6 server_cookie=d6285afc0e3cad01 in_seq=0 out_seq=0 2020-10-31T22:46:44.966 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:46:44.968 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:46:44.970 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:46:44.972 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:46:53.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f296bfff700 1 -- 172.21.15.60:0/1843473709 <== mds.0 v2:172.21.15.60:6836/2545916146 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+406 (crc 0 0 0) 0xdea4d0 con 0x1070350 2020-10-31T22:46:53.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f296bfff700 10 client.6081 handle_command_reply: tid=0 2020-10-31T22:46:53.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f29a12c6740 1 client.6081 shutdown 2020-10-31T22:46:53.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f29a12c6740 1 -- 172.21.15.60:0/1843473709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd86c20 msgr2=0xfda1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:53.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f29a12c6740 1 --2- 172.21.15.60:0/1843473709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd86c20 0xfda1c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0xfb0750 tx=0x7f2974036000).stop 2020-10-31T22:46:53.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f29a12c6740 1 -- 172.21.15.60:0/1843473709 shutdown_connections 2020-10-31T22:46:53.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f29a12c6740 1 --2- 172.21.15.60:0/1843473709 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0xf8bb30 0x106fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:53.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f29a12c6740 1 --2- 172.21.15.60:0/1843473709 >> [v2:172.21.15.60:6836/2545916146,v1:172.21.15.60:6837/2545916146] conn(0x1070350 0x100b8e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:53.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f29a12c6740 1 --2- 172.21.15.60:0/1843473709 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0xd86c20 0xfda1c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:53.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f296bfff700 0 client.6081 ms_handle_reset on v2:172.21.15.60:6836/2545916146 2020-10-31T22:46:53.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f29a12c6740 1 --2- 172.21.15.60:0/1843473709 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0xdf4820 0x100f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:53.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f29a12c6740 1 -- 172.21.15.60:0/1843473709 >> 172.21.15.60:0/1843473709 conn(0xfbb590 msgr2=0xfd6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:53.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f29a12c6740 1 -- 172.21.15.60:0/1843473709 shutdown_connections 2020-10-31T22:46:53.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f29a12c6740 1 -- 172.21.15.60:0/1843473709 wait complete. 2020-10-31T22:46:53.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f29a12c6740 20 client.6081 trim_cache size 0 max 16384 2020-10-31T22:46:53.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f299292e700 1 -- 172.21.15.60:0/2795713716 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2970054f10 msgr2=0x7f29700573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:53.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f299292e700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2970054f10 0x7f29700573d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f297c00b000 tx=0x7f297c009040).stop 2020-10-31T22:46:53.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f299292e700 1 -- 172.21.15.60:0/2795713716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f298c05c660 msgr2=0x7f298c0b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:53.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f299292e700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f298c05c660 0x7f298c0b1130 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f2974002f30 tx=0x7f2974015000).stop 2020-10-31T22:46:53.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f299292e700 1 -- 172.21.15.60:0/2795713716 shutdown_connections 2020-10-31T22:46:53.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f299292e700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2970054f10 0x7f29700573d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:53.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f299292e700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f298c0b2e20 0x7f298c0ac6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:53.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f299292e700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f298c05c660 0x7f298c0b1130 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:53.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f299292e700 1 --2- 172.21.15.60:0/2795713716 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f298c065f70 0x7f298c151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:53.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f299292e700 1 -- 172.21.15.60:0/2795713716 >> 172.21.15.60:0/2795713716 conn(0x7f298c0601e0 msgr2=0x7f298c0b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:53.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f299292e700 1 -- 172.21.15.60:0/2795713716 shutdown_connections 2020-10-31T22:46:53.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:53.272+0000 7f299292e700 1 -- 172.21.15.60:0/2795713716 wait complete. 2020-10-31T22:46:53.283 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:46:53.283 INFO:teuthology.orchestra.run.smithi060.stdout: "client_recall": { 2020-10-31T22:46:53.283 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": -110, 2020-10-31T22:46:53.283 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "(110) Connection timed out", 2020-10-31T22:46:53.284 INFO:teuthology.orchestra.run.smithi060.stdout: "recalled": 240 2020-10-31T22:46:53.284 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:53.284 INFO:teuthology.orchestra.run.smithi060.stdout: "flush_journal": { 2020-10-31T22:46:53.284 INFO:teuthology.orchestra.run.smithi060.stdout: "return_code": 0, 2020-10-31T22:46:53.284 INFO:teuthology.orchestra.run.smithi060.stdout: "message": "" 2020-10-31T22:46:53.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:53.285 INFO:teuthology.orchestra.run.smithi060.stdout: "trim_cache": { 2020-10-31T22:46:53.285 INFO:teuthology.orchestra.run.smithi060.stdout: "trimmed": 220 2020-10-31T22:46:53.285 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:53.285 INFO:teuthology.orchestra.run.smithi060.stdout: "cache": { 2020-10-31T22:46:53.285 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": { 2020-10-31T22:46:53.285 INFO:teuthology.orchestra.run.smithi060.stdout: "items": 15432, 2020-10-31T22:46:53.286 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes": 2428336 2020-10-31T22:46:53.286 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:53.286 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:53.286 INFO:teuthology.orchestra.run.smithi060.stdout: "duration": 10.354915074000001 2020-10-31T22:46:53.287 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:46:53.289 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:46:53.290 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:53.304 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:53.325 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:53.344 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:53.363 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:46:53.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:53.364 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:46:53.364 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:53.413 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:46:53.414 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:46:53.414 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:46:53.414 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:46:53.415 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:53.494 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13448]: fuse finished with error 0 and tester_r 0 2020-10-31T22:46:53.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:53.496 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:46:53.497 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:53.545 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:46:53.779 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:46:53.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:46:53.782 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:53.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:53.802 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:46:53.804 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:46:53.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:46:53.843 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:46:53.844 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:46:53.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:46:53.848 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:46:53.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:46:53.919 INFO:teuthology.orchestra.run.smithi085.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:46:53.922 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2020-10-31T22:46:54.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.048+0000 7fe62e213700 1 Processor -- start 2020-10-31T22:46:54.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.048+0000 7fe62e213700 1 -- start start 2020-10-31T22:46:54.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6280a95e0 0x7fe6280a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:54.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe628066830 0x7fe628066c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:54.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6280a75d0 con 0x7fe62805b440 2020-10-31T22:46:54.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe62805afe0 con 0x7fe628066830 2020-10-31T22:46:54.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6280a8e00 con 0x7fe6280a95e0 2020-10-31T22:46:54.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62da12700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe628066830 0x7fe628066c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:54.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62ca10700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe62805b440 0x7fe62805b8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49140/0 (socket says 172.21.15.60:49140) 2020-10-31T22:46:54.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62da12700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe628066830 0x7fe628066c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45004/0 (socket says 172.21.15.60:45004) 2020-10-31T22:46:54.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62ca10700 1 -- 172.21.15.60:0/4012999294 learned_addr learned my addr 172.21.15.60:0/4012999294 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:54.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62d211700 1 --2- 172.21.15.60:0/4012999294 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6280a95e0 0x7fe6280a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:54.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62da12700 1 -- 172.21.15.60:0/4012999294 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6280a95e0 msgr2=0x7fe6280a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:54.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62da12700 1 --2- 172.21.15.60:0/4012999294 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6280a95e0 0x7fe6280a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62da12700 1 -- 172.21.15.60:0/4012999294 >> v1:172.21.15.60:6789/0 conn(0x7fe62805b440 legacy=0x7fe62805b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:54.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe61ffff700 1 -- 172.21.15.60:0/4012999294 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980794532 0 0) 0x7fe6280a75d0 con 0x7fe62805b440 2020-10-31T22:46:54.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62da12700 1 -- 172.21.15.60:0/4012999294 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6280aeaf0 con 0x7fe628066830 2020-10-31T22:46:54.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62d211700 1 --2- 172.21.15.60:0/4012999294 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6280a95e0 0x7fe6280a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:46:54.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62da12700 1 --2- 172.21.15.60:0/4012999294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe628066830 0x7fe628066c50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fe6200032b0 tx=0x7fe6200091a0).ready entity=mon.0 client_cookie=5a143548611ce374 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:54.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe61ffff700 1 -- 172.21.15.60:0/4012999294 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe62000ba50 con 0x7fe628066830 2020-10-31T22:46:54.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe61ffff700 1 -- 172.21.15.60:0/4012999294 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62000bbb0 con 0x7fe628066830 2020-10-31T22:46:54.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 -- 172.21.15.60:0/4012999294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe628066830 msgr2=0x7fe628066c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:54.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe61ffff700 1 -- 172.21.15.60:0/4012999294 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe62000bd20 con 0x7fe628066830 2020-10-31T22:46:54.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 --2- 172.21.15.60:0/4012999294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe628066830 0x7fe628066c50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fe6200032b0 tx=0x7fe6200091a0).stop 2020-10-31T22:46:54.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 -- 172.21.15.60:0/4012999294 shutdown_connections 2020-10-31T22:46:54.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 --2- 172.21.15.60:0/4012999294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe628066830 0x7fe628066c50 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 --2- 172.21.15.60:0/4012999294 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6280a95e0 0x7fe6280a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 -- 172.21.15.60:0/4012999294 >> 172.21.15.60:0/4012999294 conn(0x7fe6280b3fd0 msgr2=0x7fe6280b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:54.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 -- 172.21.15.60:0/4012999294 shutdown_connections 2020-10-31T22:46:54.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 -- 172.21.15.60:0/4012999294 wait complete. 2020-10-31T22:46:54.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 Processor -- start 2020-10-31T22:46:54.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.052+0000 7fe62e213700 1 -- start start 2020-10-31T22:46:54.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62e213700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62805b440 0x7fe628151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:54.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62e213700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe628066830 0x7fe6280af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:54.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62e213700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6280a95e0 0x7fe6281468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:54.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62e213700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe628144f10 con 0x7fe62805b440 2020-10-31T22:46:54.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62e213700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6281451b0 con 0x7fe628066830 2020-10-31T22:46:54.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62e213700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe628145450 con 0x7fe6280a95e0 2020-10-31T22:46:54.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62d211700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62805b440 0x7fe628151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:54.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62d211700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62805b440 0x7fe628151c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45010/0 (socket says 172.21.15.60:45010) 2020-10-31T22:46:54.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62d211700 1 -- 172.21.15.60:0/215236 learned_addr learned my addr 172.21.15.60:0/215236 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:54.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62ca10700 1 --2- 172.21.15.60:0/215236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe628066830 0x7fe6280af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:54.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62da12700 1 --2- 172.21.15.60:0/215236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6280a95e0 0x7fe6281468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:54.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62d211700 1 -- 172.21.15.60:0/215236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6280a95e0 msgr2=0x7fe6281468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:54.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62d211700 1 --2- 172.21.15.60:0/215236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6280a95e0 0x7fe6281468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62d211700 1 -- 172.21.15.60:0/215236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe628066830 msgr2=0x7fe6280af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:54.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62d211700 1 --2- 172.21.15.60:0/215236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe628066830 0x7fe6280af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62d211700 1 -- 172.21.15.60:0/215236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe628146420 con 0x7fe62805b440 2020-10-31T22:46:54.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62d211700 1 --2- 172.21.15.60:0/215236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62805b440 0x7fe628151c50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fe618007000 tx=0x7fe618008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:54.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe61e7fc700 1 -- 172.21.15.60:0/215236 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe618010580 con 0x7fe62805b440 2020-10-31T22:46:54.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe61e7fc700 1 -- 172.21.15.60:0/215236 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6180106e0 con 0x7fe62805b440 2020-10-31T22:46:54.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62e213700 1 -- 172.21.15.60:0/215236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe628063a30 con 0x7fe62805b440 2020-10-31T22:46:54.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe61e7fc700 1 -- 172.21.15.60:0/215236 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe618010a40 con 0x7fe62805b440 2020-10-31T22:46:54.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.056+0000 7fe62e213700 1 -- 172.21.15.60:0/215236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6281458b0 con 0x7fe62805b440 2020-10-31T22:46:54.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.060+0000 7fe62e213700 1 -- 172.21.15.60:0/215236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6281465b0 con 0x7fe62805b440 2020-10-31T22:46:54.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.060+0000 7fe61e7fc700 1 -- 172.21.15.60:0/215236 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe618010ba0 con 0x7fe62805b440 2020-10-31T22:46:54.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.060+0000 7fe61e7fc700 1 --2- 172.21.15.60:0/215236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe608054fd0 0x7fe608057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:54.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.060+0000 7fe61e7fc700 1 -- 172.21.15.60:0/215236 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe61806dbb0 con 0x7fe62805b440 2020-10-31T22:46:54.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.060+0000 7fe62ca10700 1 --2- 172.21.15.60:0/215236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe608054fd0 0x7fe608057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:54.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.060+0000 7fe62ca10700 1 --2- 172.21.15.60:0/215236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe608054fd0 0x7fe608057490 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fe62400d000 tx=0x7fe624001160).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:54.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.068+0000 7fe61e7fc700 1 -- 172.21.15.60:0/215236 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe618043fc0 con 0x7fe62805b440 2020-10-31T22:46:54.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.204+0000 7fe62e213700 1 -- 172.21.15.60:0/215236 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe628057100 con 0x7fe62805b440 2020-10-31T22:46:54.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.208+0000 7fe61e7fc700 1 -- 172.21.15.60:0/215236 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe6180475e0 con 0x7fe62805b440 2020-10-31T22:46:54.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.212+0000 7fe62e213700 1 -- 172.21.15.60:0/215236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe608054fd0 msgr2=0x7fe608057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:54.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.212+0000 7fe62e213700 1 --2- 172.21.15.60:0/215236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe608054fd0 0x7fe608057490 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fe62400d000 tx=0x7fe624001160).stop 2020-10-31T22:46:54.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.212+0000 7fe62e213700 1 -- 172.21.15.60:0/215236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62805b440 msgr2=0x7fe628151c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:54.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.212+0000 7fe62e213700 1 --2- 172.21.15.60:0/215236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62805b440 0x7fe628151c50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fe618007000 tx=0x7fe618008040).stop 2020-10-31T22:46:54.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.212+0000 7fe62e213700 1 -- 172.21.15.60:0/215236 shutdown_connections 2020-10-31T22:46:54.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.212+0000 7fe62e213700 1 --2- 172.21.15.60:0/215236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6280a95e0 0x7fe6281468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.212+0000 7fe62e213700 1 --2- 172.21.15.60:0/215236 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62805b440 0x7fe628151c50 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.212+0000 7fe62e213700 1 --2- 172.21.15.60:0/215236 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe608054fd0 0x7fe608057490 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.212+0000 7fe62e213700 1 --2- 172.21.15.60:0/215236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe628066830 0x7fe6280af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.212+0000 7fe62e213700 1 -- 172.21.15.60:0/215236 >> 172.21.15.60:0/215236 conn(0x7fe6280b3fd0 msgr2=0x7fe6280aa280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:54.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.212+0000 7fe62e213700 1 -- 172.21.15.60:0/215236 shutdown_connections 2020-10-31T22:46:54.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.212+0000 7fe62e213700 1 -- 172.21.15.60:0/215236 wait complete. 2020-10-31T22:46:54.226 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout' 2020-10-31T22:46:54.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f1255652700 1 Processor -- start 2020-10-31T22:46:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f1255652700 1 -- start start 2020-10-31T22:46:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f1255652700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f12500b58b0 0x7f12500b3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f1255652700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12500b5c90 con 0x7f1250066830 2020-10-31T22:46:54.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f1255652700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12500b4860 con 0x7f1250146270 2020-10-31T22:46:54.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f1255652700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12500607c0 con 0x7f12500b58b0 2020-10-31T22:46:54.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f1247fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1250066830 0x7f12500af800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49152/0 (socket says 172.21.15.60:49152) 2020-10-31T22:46:54.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f1247fff700 1 -- 172.21.15.60:0/1836854963 learned_addr learned my addr 172.21.15.60:0/1836854963 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:54.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f124ffff700 1 --2- 172.21.15.60:0/1836854963 >> v2:172.21.15.66:3300/0 conn(0x7f12500b58b0 0x7f12500b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:54.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f124f7fe700 1 -- 172.21.15.60:0/1836854963 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854901887 0 0) 0x7f12500b5c90 con 0x7f1250066830 2020-10-31T22:46:54.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f124f7fe700 1 -- 172.21.15.60:0/1836854963 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1234003230 con 0x7f1250066830 2020-10-31T22:46:54.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f124f7fe700 1 -- 172.21.15.60:0/1836854963 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529282112 0 0) 0x7f12500b4860 con 0x7f1250146270 2020-10-31T22:46:54.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f124f7fe700 1 -- 172.21.15.60:0/1836854963 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12500b5c90 con 0x7f1250146270 2020-10-31T22:46:54.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f124ffff700 1 -- 172.21.15.60:0/1836854963 >> v1:172.21.15.66:6789/0 conn(0x7f1250146270 legacy=0x7f1250146700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:54.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f124ffff700 1 -- 172.21.15.60:0/1836854963 >> v1:172.21.15.60:6789/0 conn(0x7f1250066830 legacy=0x7f12500af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:54.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.340+0000 7f124ffff700 1 -- 172.21.15.60:0/1836854963 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12500b44d0 con 0x7f12500b58b0 2020-10-31T22:46:54.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.344+0000 7f124ffff700 1 --2- 172.21.15.60:0/1836854963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12500b58b0 0x7f12500b3660 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f1238002f30 tx=0x7f1238006dc0).ready entity=mon.1 client_cookie=f06a08b9c1217c82 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:54.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.344+0000 7f124f7fe700 1 -- 172.21.15.60:0/1836854963 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1238009740 con 0x7f12500b58b0 2020-10-31T22:46:54.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.344+0000 7f124f7fe700 1 -- 172.21.15.60:0/1836854963 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12380098a0 con 0x7f12500b58b0 2020-10-31T22:46:54.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.344+0000 7f124f7fe700 1 -- 172.21.15.60:0/1836854963 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1238009c00 con 0x7f12500b58b0 2020-10-31T22:46:54.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.344+0000 7f1255652700 1 -- 172.21.15.60:0/1836854963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12500b58b0 msgr2=0x7f12500b3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:54.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.344+0000 7f1255652700 1 --2- 172.21.15.60:0/1836854963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12500b58b0 0x7f12500b3660 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f1238002f30 tx=0x7f1238006dc0).stop 2020-10-31T22:46:54.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.344+0000 7f1255652700 1 -- 172.21.15.60:0/1836854963 shutdown_connections 2020-10-31T22:46:54.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.344+0000 7f1255652700 1 --2- 172.21.15.60:0/1836854963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12500b58b0 0x7f12500b3660 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.344+0000 7f1255652700 1 -- 172.21.15.60:0/1836854963 >> 172.21.15.60:0/1836854963 conn(0x7f12500b8e90 msgr2=0x7f12500b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:54.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.344+0000 7f1255652700 1 -- 172.21.15.60:0/1836854963 shutdown_connections 2020-10-31T22:46:54.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.344+0000 7f1255652700 1 -- 172.21.15.60:0/1836854963 wait complete. 2020-10-31T22:46:54.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.344+0000 7f1255652700 1 Processor -- start 2020-10-31T22:46:54.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.344+0000 7f1255652700 1 -- start start 2020-10-31T22:46:54.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f1255652700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1250066830 0x7f125014cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:54.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f1255652700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12500b58b0 0x7f12500a89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:54.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f1255652700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1250146270 0x7f12500a8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:54.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f1255652700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12500a93c0 con 0x7f1250066830 2020-10-31T22:46:54.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f1255652700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12500ae4f0 con 0x7f12500b58b0 2020-10-31T22:46:54.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f1255652700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12500ae790 con 0x7f1250146270 2020-10-31T22:46:54.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f124ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1250066830 0x7f125014cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:54.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f124ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1250066830 0x7f125014cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45022/0 (socket says 172.21.15.60:45022) 2020-10-31T22:46:54.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f124ffff700 1 -- 172.21.15.60:0/1357102711 learned_addr learned my addr 172.21.15.60:0/1357102711 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:54.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f1247fff700 1 --2- 172.21.15.60:0/1357102711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12500b58b0 0x7f12500a89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:54.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f1254e51700 1 --2- 172.21.15.60:0/1357102711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1250146270 0x7f12500a8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:54.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f124ffff700 1 -- 172.21.15.60:0/1357102711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1250146270 msgr2=0x7f12500a8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:54.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f124ffff700 1 --2- 172.21.15.60:0/1357102711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1250146270 0x7f12500a8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f124ffff700 1 -- 172.21.15.60:0/1357102711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12500b58b0 msgr2=0x7f12500a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:54.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f124ffff700 1 --2- 172.21.15.60:0/1357102711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12500b58b0 0x7f12500a89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f124ffff700 1 -- 172.21.15.60:0/1357102711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12500ada70 con 0x7f1250066830 2020-10-31T22:46:54.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f124ffff700 1 --2- 172.21.15.60:0/1357102711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1250066830 0x7f125014cca0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f1238002f30 tx=0x7f1238015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:54.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f124dffb700 1 -- 172.21.15.60:0/1357102711 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1238009ba0 con 0x7f1250066830 2020-10-31T22:46:54.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f124dffb700 1 -- 172.21.15.60:0/1357102711 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1238011ac0 con 0x7f1250066830 2020-10-31T22:46:54.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f1255652700 1 -- 172.21.15.60:0/1357102711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12500add10 con 0x7f1250066830 2020-10-31T22:46:54.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f124dffb700 1 -- 172.21.15.60:0/1357102711 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1238011e20 con 0x7f1250066830 2020-10-31T22:46:54.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f1255652700 1 -- 172.21.15.60:0/1357102711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12500aea40 con 0x7f1250066830 2020-10-31T22:46:54.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f1255652700 1 -- 172.21.15.60:0/1357102711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1250057100 con 0x7f1250066830 2020-10-31T22:46:54.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.348+0000 7f124dffb700 1 -- 172.21.15.60:0/1357102711 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f123800f070 con 0x7f1250066830 2020-10-31T22:46:54.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.352+0000 7f124dffb700 1 --2- 172.21.15.60:0/1357102711 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1228054f10 0x7f12280573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:54.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.352+0000 7f124dffb700 1 -- 172.21.15.60:0/1357102711 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f123806f250 con 0x7f1250066830 2020-10-31T22:46:54.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.352+0000 7f1247fff700 1 --2- 172.21.15.60:0/1357102711 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1228054f10 0x7f12280573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:54.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.352+0000 7f1247fff700 1 --2- 172.21.15.60:0/1357102711 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1228054f10 0x7f12280573d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f124000d000 tx=0x7f1240009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:54.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.356+0000 7f124dffb700 1 -- 172.21.15.60:0/1357102711 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1238045710 con 0x7f1250066830 2020-10-31T22:46:54.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.552+0000 7f1255652700 1 -- 172.21.15.60:0/1357102711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]} v 0) v1 -- 0x7f125005a8e0 con 0x7f1250066830 2020-10-31T22:46:54.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.956+0000 7f124dffb700 1 -- 172.21.15.60:0/1357102711 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestCacheDrop.test_drop_cache_command_timeout"]}]=0 v244) v1 ==== 147+0+0 (secure 0 0 0) 0x7f1238048cf0 con 0x7f1250066830 2020-10-31T22:46:54.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.960+0000 7f1255652700 1 -- 172.21.15.60:0/1357102711 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1228054f10 msgr2=0x7f12280573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:54.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.960+0000 7f1255652700 1 --2- 172.21.15.60:0/1357102711 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1228054f10 0x7f12280573d0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f124000d000 tx=0x7f1240009040).stop 2020-10-31T22:46:54.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.960+0000 7f1255652700 1 -- 172.21.15.60:0/1357102711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1250066830 msgr2=0x7f125014cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:54.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.960+0000 7f1255652700 1 --2- 172.21.15.60:0/1357102711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1250066830 0x7f125014cca0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f1238002f30 tx=0x7f1238015000).stop 2020-10-31T22:46:54.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.960+0000 7f1255652700 1 -- 172.21.15.60:0/1357102711 shutdown_connections 2020-10-31T22:46:54.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.960+0000 7f1255652700 1 --2- 172.21.15.60:0/1357102711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1250146270 0x7f12500a8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.960+0000 7f1255652700 1 --2- 172.21.15.60:0/1357102711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1250066830 0x7f125014cca0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.960+0000 7f1255652700 1 --2- 172.21.15.60:0/1357102711 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1228054f10 0x7f12280573d0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.960+0000 7f1255652700 1 --2- 172.21.15.60:0/1357102711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12500b58b0 0x7f12500a89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:54.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.960+0000 7f1255652700 1 -- 172.21.15.60:0/1357102711 >> 172.21.15.60:0/1357102711 conn(0x7f12500b8e90 msgr2=0x7f12500ab900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:54.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.960+0000 7f1255652700 1 -- 172.21.15.60:0/1357102711 shutdown_connections 2020-10-31T22:46:54.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:54.960+0000 7f1255652700 1 -- 172.21.15.60:0/1357102711 wait complete. 2020-10-31T22:46:54.978 INFO:tasks.cephfs_test_runner:test_drop_cache_command_timeout (tasks.cephfs.test_misc.TestCacheDrop) ... ok 2020-10-31T22:46:54.979 INFO:tasks.cephfs_test_runner:Starting test: test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) 2020-10-31T22:46:54.979 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2020-10-31T22:46:55.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.104+0000 7f65ab1fa700 1 Processor -- start 2020-10-31T22:46:55.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.104+0000 7f65ab1fa700 1 -- start start 2020-10-31T22:46:55.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65ab1fa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f65a40afef0 0x7f65a413f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:55.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65ab1fa700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a4142a70 0x7f65a405f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:55.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65ab1fa700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a40acfa0 con 0x7f65a40b2790 2020-10-31T22:46:55.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65ab1fa700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a40b2b70 con 0x7f65a40afef0 2020-10-31T22:46:55.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65ab1fa700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40ac800 con 0x7f65a4142a70 2020-10-31T22:46:55.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65a3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f65a40afef0 0x7f65a413f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:55.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65a3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f65a40afef0 0x7f65a413f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45032/0 (socket says 172.21.15.60:45032) 2020-10-31T22:46:55.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65a3fff700 1 -- 172.21.15.60:0/3079779966 learned_addr learned my addr 172.21.15.60:0/3079779966 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:55.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65a9797700 1 --2- 172.21.15.60:0/3079779966 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a4142a70 0x7f65a405f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:55.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65a3fff700 1 -- 172.21.15.60:0/3079779966 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a4142a70 msgr2=0x7f65a405f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:55.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65a3fff700 1 --2- 172.21.15.60:0/3079779966 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a4142a70 0x7f65a405f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:55.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65a3fff700 1 -- 172.21.15.60:0/3079779966 >> v1:172.21.15.66:6789/0 conn(0x7f65a40b2790 legacy=0x7f65a413ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:55.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65a3fff700 1 -- 172.21.15.60:0/3079779966 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a413fa70 con 0x7f65a40afef0 2020-10-31T22:46:55.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65a3fff700 1 --2- 172.21.15.60:0/3079779966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65a40afef0 0x7f65a413f580 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f6590002f30 tx=0x7f6590006e80).ready entity=mon.0 client_cookie=83176e7b62513290 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:55.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65a37fe700 1 -- 172.21.15.60:0/3079779966 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6590009880 con 0x7f65a40afef0 2020-10-31T22:46:55.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65a37fe700 1 -- 172.21.15.60:0/3079779966 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65900099e0 con 0x7f65a40afef0 2020-10-31T22:46:55.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65a37fe700 1 -- 172.21.15.60:0/3079779966 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6590009d40 con 0x7f65a40afef0 2020-10-31T22:46:55.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65ab1fa700 1 -- 172.21.15.60:0/3079779966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65a40afef0 msgr2=0x7f65a413f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:55.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65ab1fa700 1 --2- 172.21.15.60:0/3079779966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65a40afef0 0x7f65a413f580 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f6590002f30 tx=0x7f6590006e80).stop 2020-10-31T22:46:55.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65ab1fa700 1 -- 172.21.15.60:0/3079779966 shutdown_connections 2020-10-31T22:46:55.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65ab1fa700 1 --2- 172.21.15.60:0/3079779966 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a4142a70 0x7f65a405f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:55.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65ab1fa700 1 --2- 172.21.15.60:0/3079779966 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65a40afef0 0x7f65a413f580 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:55.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65ab1fa700 1 -- 172.21.15.60:0/3079779966 >> 172.21.15.60:0/3079779966 conn(0x7f65a40b5d30 msgr2=0x7f65a40b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:55.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65ab1fa700 1 -- 172.21.15.60:0/3079779966 shutdown_connections 2020-10-31T22:46:55.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.108+0000 7f65ab1fa700 1 -- 172.21.15.60:0/3079779966 wait complete. 2020-10-31T22:46:55.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.112+0000 7f65ab1fa700 1 Processor -- start 2020-10-31T22:46:55.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.112+0000 7f65ab1fa700 1 -- start start 2020-10-31T22:46:55.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.112+0000 7f65ab1fa700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a40afef0 0x7f65a40b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:55.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.112+0000 7f65ab1fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65a40b2790 0x7f65a40aa690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:55.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.112+0000 7f65ab1fa700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a4142a70 0x7f65a413c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:55.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.112+0000 7f65ab1fa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a413e3d0 con 0x7f65a40b2790 2020-10-31T22:46:55.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.112+0000 7f65ab1fa700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a413e670 con 0x7f65a40afef0 2020-10-31T22:46:55.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.112+0000 7f65ab1fa700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a413e910 con 0x7f65a4142a70 2020-10-31T22:46:55.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.112+0000 7f65a3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65a40b2790 0x7f65a40aa690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:55.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.112+0000 7f65a3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65a40b2790 0x7f65a40aa690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45038/0 (socket says 172.21.15.60:45038) 2020-10-31T22:46:55.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.112+0000 7f65a3fff700 1 -- 172.21.15.60:0/2121773630 learned_addr learned my addr 172.21.15.60:0/2121773630 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:55.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.112+0000 7f65a9797700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a4142a70 0x7f65a413c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:55.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.112+0000 7f65a8f96700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a40afef0 0x7f65a40b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:55.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65a3fff700 1 -- 172.21.15.60:0/2121773630 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a4142a70 msgr2=0x7f65a413c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:55.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65a3fff700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a4142a70 0x7f65a413c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:55.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65a3fff700 1 -- 172.21.15.60:0/2121773630 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a40afef0 msgr2=0x7f65a40b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:55.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65a3fff700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a40afef0 0x7f65a40b4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:55.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65a3fff700 1 -- 172.21.15.60:0/2121773630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a40a91b0 con 0x7f65a40b2790 2020-10-31T22:46:55.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65a9797700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a4142a70 0x7f65a413c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:46:55.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65a3fff700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65a40b2790 0x7f65a40aa690 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f6590002f30 tx=0x7f6590015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:55.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65a1ffb700 1 -- 172.21.15.60:0/2121773630 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6590011bd0 con 0x7f65a40b2790 2020-10-31T22:46:55.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65a1ffb700 1 -- 172.21.15.60:0/2121773630 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6590011d30 con 0x7f65a40b2790 2020-10-31T22:46:55.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65ab1fa700 1 -- 172.21.15.60:0/2121773630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a40b4d50 con 0x7f65a40b2790 2020-10-31T22:46:55.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65a1ffb700 1 -- 172.21.15.60:0/2121773630 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6590011ea0 con 0x7f65a40b2790 2020-10-31T22:46:55.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65ab1fa700 1 -- 172.21.15.60:0/2121773630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a40ac340 con 0x7f65a40b2790 2020-10-31T22:46:55.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65ab1fa700 1 -- 172.21.15.60:0/2121773630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a413ead0 con 0x7f65a40b2790 2020-10-31T22:46:55.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65a1ffb700 1 -- 172.21.15.60:0/2121773630 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6590025030 con 0x7f65a40b2790 2020-10-31T22:46:55.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65a1ffb700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f658c054f10 0x7f658c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:55.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65a1ffb700 1 -- 172.21.15.60:0/2121773630 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f659006ee20 con 0x7f65a40b2790 2020-10-31T22:46:55.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.116+0000 7f65a8f96700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f658c054f10 0x7f658c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:55.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.120+0000 7f65a8f96700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f658c054f10 0x7f658c0573d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f659800d000 tx=0x7f6598007ad0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:55.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.124+0000 7f65a1ffb700 1 -- 172.21.15.60:0/2121773630 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6590045340 con 0x7f65a40b2790 2020-10-31T22:46:55.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.320+0000 7f65ab1fa700 1 -- 172.21.15.60:0/2121773630 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7f65a4057100 con 0x7f65a40b2790 2020-10-31T22:46:55.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.964+0000 7f65a1ffb700 1 -- 172.21.15.60:0/2121773630 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v245) v1 ==== 142+0+0 (secure 0 0 0) 0x7f6590023020 con 0x7f65a40b2790 2020-10-31T22:46:55.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.968+0000 7f65ab1fa700 1 -- 172.21.15.60:0/2121773630 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f658c054f10 msgr2=0x7f658c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:55.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.968+0000 7f65ab1fa700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f658c054f10 0x7f658c0573d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f659800d000 tx=0x7f6598007ad0).stop 2020-10-31T22:46:55.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.968+0000 7f65ab1fa700 1 -- 172.21.15.60:0/2121773630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65a40b2790 msgr2=0x7f65a40aa690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:55.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.968+0000 7f65ab1fa700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65a40b2790 0x7f65a40aa690 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f6590002f30 tx=0x7f6590015000).stop 2020-10-31T22:46:55.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.968+0000 7f65ab1fa700 1 -- 172.21.15.60:0/2121773630 shutdown_connections 2020-10-31T22:46:55.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.968+0000 7f65ab1fa700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a4142a70 0x7f65a413c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.968+0000 7f65ab1fa700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f658c054f10 0x7f658c0573d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.968+0000 7f65ab1fa700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a40afef0 0x7f65a40b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.968+0000 7f65ab1fa700 1 --2- 172.21.15.60:0/2121773630 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65a40b2790 0x7f65a40aa690 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.968+0000 7f65ab1fa700 1 -- 172.21.15.60:0/2121773630 >> 172.21.15.60:0/2121773630 conn(0x7f65a40b5d30 msgr2=0x7f65a40aeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:55.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.968+0000 7f65ab1fa700 1 -- 172.21.15.60:0/2121773630 shutdown_connections 2020-10-31T22:46:55.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:55.968+0000 7f65ab1fa700 1 -- 172.21.15.60:0/2121773630 wait complete. 2020-10-31T22:46:55.985 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2020-10-31T22:46:56.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.112+0000 7f22c2b65700 1 Processor -- start 2020-10-31T22:46:56.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.112+0000 7f22c2b65700 1 -- start start 2020-10-31T22:46:56.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.112+0000 7f22c2b65700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f22bc0b5570 0x7f22bc0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:56.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.112+0000 7f22c2b65700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22bc0b24a0 0x7f22bc145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:56.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.112+0000 7f22c2b65700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22bc0b4440 con 0x7f22bc145e40 2020-10-31T22:46:56.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.112+0000 7f22c2b65700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc13f930 con 0x7f22bc0b24a0 2020-10-31T22:46:56.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.112+0000 7f22c2b65700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22bc0b02f0 con 0x7f22bc0b5570 2020-10-31T22:46:56.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.112+0000 7f22c1362700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22bc0b24a0 0x7f22bc145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:56.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.112+0000 7f22c1362700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22bc0b24a0 0x7f22bc145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45046/0 (socket says 172.21.15.60:45046) 2020-10-31T22:46:56.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.112+0000 7f22c1362700 1 -- 172.21.15.60:0/2313073481 learned_addr learned my addr 172.21.15.60:0/2313073481 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:56.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.112+0000 7f22c1b63700 1 --2- 172.21.15.60:0/2313073481 >> v2:172.21.15.66:3300/0 conn(0x7f22bc0b5570 0x7f22bc0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:56.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c0b61700 1 -- 172.21.15.60:0/2313073481 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873734439 0 0) 0x7f22bc0b4440 con 0x7f22bc145e40 2020-10-31T22:46:56.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c1362700 1 -- 172.21.15.60:0/2313073481 >> v2:172.21.15.66:3300/0 conn(0x7f22bc0b5570 msgr2=0x7f22bc0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:56.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c1362700 1 --2- 172.21.15.60:0/2313073481 >> v2:172.21.15.66:3300/0 conn(0x7f22bc0b5570 0x7f22bc0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c1362700 1 -- 172.21.15.60:0/2313073481 >> v1:172.21.15.66:6789/0 conn(0x7f22bc145e40 legacy=0x7f22bc141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:56.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c1362700 1 -- 172.21.15.60:0/2313073481 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0b0590 con 0x7f22bc0b24a0 2020-10-31T22:46:56.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c1362700 1 --2- 172.21.15.60:0/2313073481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22bc0b24a0 0x7f22bc145950 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f22b8002f30 tx=0x7f22b8006e80).ready entity=mon.0 client_cookie=18f959a5d0f43741 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:56.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c0b61700 1 -- 172.21.15.60:0/2313073481 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22b80097f0 con 0x7f22bc0b24a0 2020-10-31T22:46:56.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c0b61700 1 -- 172.21.15.60:0/2313073481 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b8009950 con 0x7f22bc0b24a0 2020-10-31T22:46:56.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c0b61700 1 -- 172.21.15.60:0/2313073481 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22b8009cb0 con 0x7f22bc0b24a0 2020-10-31T22:46:56.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c2b65700 1 -- 172.21.15.60:0/2313073481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22bc0b24a0 msgr2=0x7f22bc145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:56.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c2b65700 1 --2- 172.21.15.60:0/2313073481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22bc0b24a0 0x7f22bc145950 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f22b8002f30 tx=0x7f22b8006e80).stop 2020-10-31T22:46:56.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c2b65700 1 -- 172.21.15.60:0/2313073481 shutdown_connections 2020-10-31T22:46:56.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c2b65700 1 --2- 172.21.15.60:0/2313073481 >> v2:172.21.15.66:3300/0 conn(0x7f22bc0b5570 0x7f22bc0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c2b65700 1 --2- 172.21.15.60:0/2313073481 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22bc0b24a0 0x7f22bc145950 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c2b65700 1 -- 172.21.15.60:0/2313073481 >> 172.21.15.60:0/2313073481 conn(0x7f22bc0b8e90 msgr2=0x7f22bc0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:56.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c2b65700 1 -- 172.21.15.60:0/2313073481 shutdown_connections 2020-10-31T22:46:56.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.116+0000 7f22c2b65700 1 -- 172.21.15.60:0/2313073481 wait complete. 2020-10-31T22:46:56.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c2b65700 1 Processor -- start 2020-10-31T22:46:56.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c2b65700 1 -- start start 2020-10-31T22:46:56.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c2b65700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22bc0b24a0 0x7f22bc144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:56.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c2b65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22bc0b5570 0x7f22bc13e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:56.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c2b65700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22bc145e40 0x7f22bc13e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:56.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c2b65700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0adaa0 con 0x7f22bc0b5570 2020-10-31T22:46:56.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c2b65700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0af050 con 0x7f22bc145e40 2020-10-31T22:46:56.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c2b65700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22bc0ae3c0 con 0x7f22bc0b24a0 2020-10-31T22:46:56.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c1362700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22bc0b5570 0x7f22bc13e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:56.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c1362700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22bc0b5570 0x7f22bc13e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45050/0 (socket says 172.21.15.60:45050) 2020-10-31T22:46:56.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c1362700 1 -- 172.21.15.60:0/3446659934 learned_addr learned my addr 172.21.15.60:0/3446659934 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:56.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c2364700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22bc145e40 0x7f22bc13e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:56.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c1b63700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22bc0b24a0 0x7f22bc144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:56.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c1362700 1 -- 172.21.15.60:0/3446659934 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22bc0b24a0 msgr2=0x7f22bc144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:56.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c1362700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22bc0b24a0 0x7f22bc144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c1362700 1 -- 172.21.15.60:0/3446659934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22bc145e40 msgr2=0x7f22bc13e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:56.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c1362700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22bc145e40 0x7f22bc13e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c1362700 1 -- 172.21.15.60:0/3446659934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc0ae660 con 0x7f22bc0b5570 2020-10-31T22:46:56.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c2364700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22bc145e40 0x7f22bc13e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:46:56.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c1362700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22bc0b5570 0x7f22bc13e420 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f22b8002f30 tx=0x7f22b8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:56.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22aeffd700 1 -- 172.21.15.60:0/3446659934 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22b8011c30 con 0x7f22bc0b5570 2020-10-31T22:46:56.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22aeffd700 1 -- 172.21.15.60:0/3446659934 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22b8011d90 con 0x7f22bc0b5570 2020-10-31T22:46:56.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c2b65700 1 -- 172.21.15.60:0/3446659934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22bc13ee00 con 0x7f22bc0b5570 2020-10-31T22:46:56.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22aeffd700 1 -- 172.21.15.60:0/3446659934 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22b801e650 con 0x7f22bc0b5570 2020-10-31T22:46:56.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.120+0000 7f22c2b65700 1 -- 172.21.15.60:0/3446659934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22bc143b10 con 0x7f22bc0b5570 2020-10-31T22:46:56.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.124+0000 7f22c2b65700 1 -- 172.21.15.60:0/3446659934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22bc057100 con 0x7f22bc0b5570 2020-10-31T22:46:56.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.124+0000 7f22aeffd700 1 -- 172.21.15.60:0/3446659934 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f22b801a040 con 0x7f22bc0b5570 2020-10-31T22:46:56.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.124+0000 7f22aeffd700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f229c054f90 0x7f229c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:56.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.124+0000 7f22aeffd700 1 -- 172.21.15.60:0/3446659934 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f22b806ebc0 con 0x7f22bc0b5570 2020-10-31T22:46:56.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.124+0000 7f22c1b63700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f229c054f90 0x7f229c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:56.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.124+0000 7f22c1b63700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f229c054f90 0x7f229c057450 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f22b000b000 tx=0x7f22b0006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:56.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.136+0000 7f22aeffd700 1 -- 172.21.15.60:0/3446659934 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f22b8044fd0 con 0x7f22bc0b5570 2020-10-31T22:46:56.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.280+0000 7f22c2b65700 1 -- 172.21.15.60:0/3446659934 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7f22bc05a8e0 con 0x7f22bc0b5570 2020-10-31T22:46:56.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.292+0000 7f22aeffd700 1 -- 172.21.15.60:0/3446659934 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f22b8023070 con 0x7f22bc0b5570 2020-10-31T22:46:56.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.292+0000 7f22c2b65700 1 -- 172.21.15.60:0/3446659934 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f229c054f90 msgr2=0x7f229c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:56.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.292+0000 7f22c2b65700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f229c054f90 0x7f229c057450 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f22b000b000 tx=0x7f22b0006dc0).stop 2020-10-31T22:46:56.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.292+0000 7f22c2b65700 1 -- 172.21.15.60:0/3446659934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22bc0b5570 msgr2=0x7f22bc13e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:56.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.292+0000 7f22c2b65700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22bc0b5570 0x7f22bc13e420 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f22b8002f30 tx=0x7f22b8015000).stop 2020-10-31T22:46:56.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.292+0000 7f22c2b65700 1 -- 172.21.15.60:0/3446659934 shutdown_connections 2020-10-31T22:46:56.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.292+0000 7f22c2b65700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f229c054f90 0x7f229c057450 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.292+0000 7f22c2b65700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22bc145e40 0x7f22bc13e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.292+0000 7f22c2b65700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22bc0b24a0 0x7f22bc144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.292+0000 7f22c2b65700 1 --2- 172.21.15.60:0/3446659934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22bc0b5570 0x7f22bc13e420 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.292+0000 7f22c2b65700 1 -- 172.21.15.60:0/3446659934 >> 172.21.15.60:0/3446659934 conn(0x7f22bc0b8e90 msgr2=0x7f22bc0b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:56.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.292+0000 7f22c2b65700 1 -- 172.21.15.60:0/3446659934 shutdown_connections 2020-10-31T22:46:56.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.292+0000 7f22c2b65700 1 -- 172.21.15.60:0/3446659934 wait complete. 2020-10-31T22:46:56.308 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:46:56.308 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:56.323 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:56.341 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:56.358 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:46:56.374 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:46:56.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:56.375 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:46:56.376 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:46:56.423 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-10-31T22:46:56.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:46:56.425 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2020-10-31T22:46:56.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:46:56.426 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:46:56.426 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:46:56.433 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:46:56.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:46:56.435 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:46:56.435 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-10-31T22:46:56.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.556+0000 7fbf4759e700 1 Processor -- start 2020-10-31T22:46:56.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.556+0000 7fbf4759e700 1 -- start start 2020-10-31T22:46:56.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf4759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbf480b5570 0x7fbf480b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:56.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf4759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf48141fe0 0x7fbf48142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:56.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf4759e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf48145180 con 0x7fbf480b24a0 2020-10-31T22:46:56.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf4759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf480afae0 con 0x7fbf480b5570 2020-10-31T22:46:56.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf4759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf48141bf0 con 0x7fbf48141fe0 2020-10-31T22:46:56.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf46d9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf48141fe0 0x7fbf48142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:56.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf4659c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbf480b5570 0x7fbf480b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:56.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf46d9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf48141fe0 0x7fbf48142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:58250/0 (socket says 172.21.15.60:58250) 2020-10-31T22:46:56.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf46d9d700 1 -- 172.21.15.60:0/2049393430 learned_addr learned my addr 172.21.15.60:0/2049393430 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:56.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf3ffff700 1 --1- 172.21.15.60:0/2049393430 >> v1:172.21.15.66:6789/0 conn(0x7fbf480b24a0 0x7fbf48145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:47062/0 (socket says 172.21.15.60:47062) 2020-10-31T22:46:56.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf45d9b700 1 -- 172.21.15.60:0/2049393430 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500229710 0 0) 0x7fbf48145180 con 0x7fbf480b24a0 2020-10-31T22:46:56.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf45d9b700 1 -- 172.21.15.60:0/2049393430 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf28003230 con 0x7fbf480b24a0 2020-10-31T22:46:56.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf46d9d700 1 -- 172.21.15.60:0/2049393430 >> v2:172.21.15.66:3300/0 conn(0x7fbf480b5570 msgr2=0x7fbf480b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:56.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf46d9d700 1 --2- 172.21.15.60:0/2049393430 >> v2:172.21.15.66:3300/0 conn(0x7fbf480b5570 0x7fbf480b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf46d9d700 1 -- 172.21.15.60:0/2049393430 >> v1:172.21.15.66:6789/0 conn(0x7fbf480b24a0 legacy=0x7fbf48145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:56.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf46d9d700 1 -- 172.21.15.60:0/2049393430 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480b0670 con 0x7fbf48141fe0 2020-10-31T22:46:56.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf46d9d700 1 --2- 172.21.15.60:0/2049393430 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf48141fe0 0x7fbf48142490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fbf4805f580 tx=0x7fbf40009270).ready entity=mon.2 client_cookie=1bf3997a3bf46b3c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:56.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf45d9b700 1 -- 172.21.15.60:0/2049393430 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf40009e90 con 0x7fbf48141fe0 2020-10-31T22:46:56.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf45d9b700 1 -- 172.21.15.60:0/2049393430 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4000bb10 con 0x7fbf48141fe0 2020-10-31T22:46:56.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf45d9b700 1 -- 172.21.15.60:0/2049393430 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf4000bc80 con 0x7fbf48141fe0 2020-10-31T22:46:56.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf4759e700 1 -- 172.21.15.60:0/2049393430 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf48141fe0 msgr2=0x7fbf48142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:56.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf4759e700 1 --2- 172.21.15.60:0/2049393430 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf48141fe0 0x7fbf48142490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fbf4805f580 tx=0x7fbf40009270).stop 2020-10-31T22:46:56.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf4759e700 1 -- 172.21.15.60:0/2049393430 shutdown_connections 2020-10-31T22:46:56.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf4759e700 1 --2- 172.21.15.60:0/2049393430 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf48141fe0 0x7fbf48142490 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf4759e700 1 --2- 172.21.15.60:0/2049393430 >> v2:172.21.15.66:3300/0 conn(0x7fbf480b5570 0x7fbf480b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf4759e700 1 -- 172.21.15.60:0/2049393430 >> 172.21.15.60:0/2049393430 conn(0x7fbf480b8e90 msgr2=0x7fbf480b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:56.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf4759e700 1 -- 172.21.15.60:0/2049393430 shutdown_connections 2020-10-31T22:46:56.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.560+0000 7fbf4759e700 1 -- 172.21.15.60:0/2049393430 wait complete. 2020-10-31T22:46:56.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf4759e700 1 Processor -- start 2020-10-31T22:46:56.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf4759e700 1 -- start start 2020-10-31T22:46:56.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf4759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf480b24a0 0x7fbf4813dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:56.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf4759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf480b5570 0x7fbf48154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:56.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf4759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf48141fe0 0x7fbf48154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:56.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf4759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf480af230 con 0x7fbf480b5570 2020-10-31T22:46:56.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf4759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf481516c0 con 0x7fbf48141fe0 2020-10-31T22:46:56.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf4759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf48153ce0 con 0x7fbf480b24a0 2020-10-31T22:46:56.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf3ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf480b5570 0x7fbf48154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:56.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf3ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf480b5570 0x7fbf48154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45064/0 (socket says 172.21.15.60:45064) 2020-10-31T22:46:56.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf3ffff700 1 -- 172.21.15.60:0/3629885211 learned_addr learned my addr 172.21.15.60:0/3629885211 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:56.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf4659c700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf480b24a0 0x7fbf4813dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:56.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf46d9d700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf48141fe0 0x7fbf48154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:56.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf3ffff700 1 -- 172.21.15.60:0/3629885211 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf480b24a0 msgr2=0x7fbf4813dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:56.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf3ffff700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf480b24a0 0x7fbf4813dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf3ffff700 1 -- 172.21.15.60:0/3629885211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf48141fe0 msgr2=0x7fbf48154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:56.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf3ffff700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf48141fe0 0x7fbf48154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf3ffff700 1 -- 172.21.15.60:0/3629885211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf48144860 con 0x7fbf480b5570 2020-10-31T22:46:56.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf46d9d700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf48141fe0 0x7fbf48154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:56.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf4659c700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf480b24a0 0x7fbf4813dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:56.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf3ffff700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf480b5570 0x7fbf48154110 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7fbf300010d0 tx=0x7fbf30007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:56.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf3f7fe700 1 -- 172.21.15.60:0/3629885211 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf30007320 con 0x7fbf480b5570 2020-10-31T22:46:56.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf3f7fe700 1 -- 172.21.15.60:0/3629885211 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf30005520 con 0x7fbf480b5570 2020-10-31T22:46:56.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf4759e700 1 -- 172.21.15.60:0/3629885211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf480b5fc0 con 0x7fbf480b5570 2020-10-31T22:46:56.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf3f7fe700 1 -- 172.21.15.60:0/3629885211 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf30005880 con 0x7fbf480b5570 2020-10-31T22:46:56.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.564+0000 7fbf4759e700 1 -- 172.21.15.60:0/3629885211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf48143bf0 con 0x7fbf480b5570 2020-10-31T22:46:56.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.568+0000 7fbf4759e700 1 -- 172.21.15.60:0/3629885211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf481514f0 con 0x7fbf480b5570 2020-10-31T22:46:56.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.568+0000 7fbf3f7fe700 1 -- 172.21.15.60:0/3629885211 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbf30010030 con 0x7fbf480b5570 2020-10-31T22:46:56.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.568+0000 7fbf3f7fe700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbf2c054f10 0x7fbf2c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:56.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.568+0000 7fbf3f7fe700 1 -- 172.21.15.60:0/3629885211 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbf3006d6c0 con 0x7fbf480b5570 2020-10-31T22:46:56.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.568+0000 7fbf4659c700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbf2c054f10 0x7fbf2c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:56.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.568+0000 7fbf4659c700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbf2c054f10 0x7fbf2c0573d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fbf3800b000 tx=0x7fbf38008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:56.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.576+0000 7fbf3f7fe700 1 -- 172.21.15.60:0/3629885211 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbf30043be0 con 0x7fbf480b5570 2020-10-31T22:46:56.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.720+0000 7fbf4759e700 1 -- 172.21.15.60:0/3629885211 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fbf48153e20 con 0x7fbf480b5570 2020-10-31T22:46:56.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.720+0000 7fbf3f7fe700 1 -- 172.21.15.60:0/3629885211 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v65) v1 ==== 81+0+33648 (secure 0 0 0) 0x7fbf30047200 con 0x7fbf480b5570 2020-10-31T22:46:56.723 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:56.724 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:46:56.724 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 65, 2020-10-31T22:46:56.724 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "226f905a-1517-4a8c-8009-08779515965c", 2020-10-31T22:46:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2020-10-31T22:40:51.928572+0000", 2020-10-31T22:46:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2020-10-31T22:46:20.880954+0000", 2020-10-31T22:46:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:46:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:46:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-10-31T22:46:56.725 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2020-10-31T22:46:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2020-10-31T22:46:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2020-10-31T22:46:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2020-10-31T22:46:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2020-10-31T22:46:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2020-10-31T22:46:56.726 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:46:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2020-10-31T22:46:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2020-10-31T22:46:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-10-31T22:46:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2020-10-31T22:46:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2020-10-31T22:46:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 12, 2020-10-31T22:46:56.727 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2020-10-31T22:46:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "jewel", 2020-10-31T22:46:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2020-10-31T22:46:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "octopus", 2020-10-31T22:46:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:46:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2020-10-31T22:46:56.728 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "device_health_metrics", 2020-10-31T22:46:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:40:55.846143+0000", 2020-10-31T22:46:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:46:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:46:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:46:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:46:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:46:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:46:56.729 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:46:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:46:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2020-10-31T22:46:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2020-10-31T22:46:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2020-10-31T22:46:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2020-10-31T22:46:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2020-10-31T22:46:56.730 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:46:56.731 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:46:56.732 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:46:56.732 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:46:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:46:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:46:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:46:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "15", 2020-10-31T22:46:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:46:56.733 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:46:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:46:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:46:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:46:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:46:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:46:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:46:56.734 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:46:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:46:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:46:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:46:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:46:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:46:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:46:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:46:56.735 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:46:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:46:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:46:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:46:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:46:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:46:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:46:56.736 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:46:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:46:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:46:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:46:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:46:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:46:56.737 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:46:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:46:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:46:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:46:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:46:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:46:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:46:56.738 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:46:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:46:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2020-10-31T22:46:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:46:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_devicehealth": {} 2020-10-31T22:46:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2020-10-31T22:46:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2020-10-31T22:46:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:05.358501+0000", 2020-10-31T22:46:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:46:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:46:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:46:56.740 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:46:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:46:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:46:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:46:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:46:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:46:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:46:56.741 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:46:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:46:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:46:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:46:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:46:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:46:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:46:56.742 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:46:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:46:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:46:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "18", 2020-10-31T22:46:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:46:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:46:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:46:56.743 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:46:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:46:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:46:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:46:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:46:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:46:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:46:56.744 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:46:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:46:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:46:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:46:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:46:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:46:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:46:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:46:56.745 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:46:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:46:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:46:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:46:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:46:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:46:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:46:56.746 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:46:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:46:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:46:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:46:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:46:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:46:56.747 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:46:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:46:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:46:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:46:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:46:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:46:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:46:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:46:56.748 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2020-10-31T22:46:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 11, 2020-10-31T22:46:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2020-10-31T22:46:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:46:17.441669+0000", 2020-10-31T22:46:56.749 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:46:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:46:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:46:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:46:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:46:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:46:56.750 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:46:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:46:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:46:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:46:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:46:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:46:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:46:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:46:56.751 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:46:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:46:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:46:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:46:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:46:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:46:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.752 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "64", 2020-10-31T22:46:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:46:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:46:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:46:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:46:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:46:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:46:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:46:56.753 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:46:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:46:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:46:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:46:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:46:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:46:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:46:56.754 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:46:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:46:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:46:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:46:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:46:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:46:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:46:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:46:56.755 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:46:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:46:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:46:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:46:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:46:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:46:56.756 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:46:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:46:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:46:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:46:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:46:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:46:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:46:56.757 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:46:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:46:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:46:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2020-10-31T22:46:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2020-10-31T22:46:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2020-10-31T22:46:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:46:56.758 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:46:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2020-10-31T22:46:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 12, 2020-10-31T22:46:56.759 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2020-10-31T22:46:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:46:18.708444+0000", 2020-10-31T22:46:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:46:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:46:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:46:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:46:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:46:56.760 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:46:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:46:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:46:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:46:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:46:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:46:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:46:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:46:56.761 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:46:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:46:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:46:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:46:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:46:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:46:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:46:56.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "65", 2020-10-31T22:46:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:46:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:46:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:46:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:46:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:46:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:46:56.763 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:46:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:46:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:46:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:46:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:46:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:46:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:46:56.764 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:46:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:46:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:46:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:46:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:46:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:46:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:46:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:46:56.765 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:46:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:46:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:46:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:46:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:46:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:46:56.766 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:46:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:46:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:46:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:46:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:46:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:46:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:46:56.767 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:46:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:46:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:46:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:46:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:46:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:46:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2020-10-31T22:46:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.768 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:46:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2020-10-31T22:46:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:46:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", 2020-10-31T22:46:56.769 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 63, 2020-10-31T22:46:56.770 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2020-10-31T22:46:56.771 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2020-10-31T22:46:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2020-10-31T22:46:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:56.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2020-10-31T22:46:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2020-10-31T22:46:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2020-10-31T22:46:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2020-10-31T22:46:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:56.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2020-10-31T22:46:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:46:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.778 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6803/14302", 2020-10-31T22:46:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6805/14302", 2020-10-31T22:46:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6809/14302", 2020-10-31T22:46:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6807/14302", 2020-10-31T22:46:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:56.779 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:46:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", 2020-10-31T22:46:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:56.780 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 63, 2020-10-31T22:46:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:56.781 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2020-10-31T22:46:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2020-10-31T22:46:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:56.783 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2020-10-31T22:46:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2020-10-31T22:46:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2020-10-31T22:46:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2020-10-31T22:46:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:56.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2020-10-31T22:46:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2020-10-31T22:46:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:46:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/14300", 2020-10-31T22:46:56.789 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6813/14300", 2020-10-31T22:46:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6817/14300", 2020-10-31T22:46:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6815/14300", 2020-10-31T22:46:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:46:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", 2020-10-31T22:46:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:56.791 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 61, 2020-10-31T22:46:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2020-10-31T22:46:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2020-10-31T22:46:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2020-10-31T22:46:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2020-10-31T22:46:56.795 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6832", 2020-10-31T22:46:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6833", 2020-10-31T22:46:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2020-10-31T22:46:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2020-10-31T22:46:56.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:46:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6827/14318", 2020-10-31T22:46:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6829/14318", 2020-10-31T22:46:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6833/14318", 2020-10-31T22:46:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6831/14318", 2020-10-31T22:46:56.800 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:46:56.801 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", 2020-10-31T22:46:56.802 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:56.802 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:56.802 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:56.802 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:56.802 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:56.802 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:56.802 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:56.802 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 50, 2020-10-31T22:46:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.803 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2020-10-31T22:46:56.804 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:56.804 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.805 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2020-10-31T22:46:56.805 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:56.805 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.806 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.806 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:56.807 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.807 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2020-10-31T22:46:56.808 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:56.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2020-10-31T22:46:56.809 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.810 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:56.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2020-10-31T22:46:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2020-10-31T22:46:56.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2020-10-31T22:46:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2020-10-31T22:46:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:46:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.815 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6819/14301", 2020-10-31T22:46:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6821/14301", 2020-10-31T22:46:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/14301", 2020-10-31T22:46:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6823/14301", 2020-10-31T22:46:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:56.816 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:46:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", 2020-10-31T22:46:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:56.817 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:56.818 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 63, 2020-10-31T22:46:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6816", 2020-10-31T22:46:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6817", 2020-10-31T22:46:56.820 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6818", 2020-10-31T22:46:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6819", 2020-10-31T22:46:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6822", 2020-10-31T22:46:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.824 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6823", 2020-10-31T22:46:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:56.825 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6820", 2020-10-31T22:46:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6821", 2020-10-31T22:46:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:46:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.827 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6817/14002", 2020-10-31T22:46:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6819/14002", 2020-10-31T22:46:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6823/14002", 2020-10-31T22:46:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6821/14002", 2020-10-31T22:46:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:56.828 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:46:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", 2020-10-31T22:46:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:56.829 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 62, 2020-10-31T22:46:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:56.830 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6800", 2020-10-31T22:46:56.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6801", 2020-10-31T22:46:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:56.833 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6802", 2020-10-31T22:46:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.836 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6803", 2020-10-31T22:46:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:56.837 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.838 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.838 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6806", 2020-10-31T22:46:56.838 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:56.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6807", 2020-10-31T22:46:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6804", 2020-10-31T22:46:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:56.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6805", 2020-10-31T22:46:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:46:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6801/14001", 2020-10-31T22:46:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6803/14001", 2020-10-31T22:46:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6807/14001", 2020-10-31T22:46:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6805/14001", 2020-10-31T22:46:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:56.842 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:46:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", 2020-10-31T22:46:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:56.843 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 63, 2020-10-31T22:46:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:56.844 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6808", 2020-10-31T22:46:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:56.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6809", 2020-10-31T22:46:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6810", 2020-10-31T22:46:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:56.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6811", 2020-10-31T22:46:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6814", 2020-10-31T22:46:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6815", 2020-10-31T22:46:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.850 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6812", 2020-10-31T22:46:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6813", 2020-10-31T22:46:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:46:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6809/14003", 2020-10-31T22:46:56.852 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6811/14003", 2020-10-31T22:46:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6815/14003", 2020-10-31T22:46:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6813/14003", 2020-10-31T22:46:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:46:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", 2020-10-31T22:46:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:46:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:46:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:46:56.854 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:46:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:46:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:46:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:46:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 62, 2020-10-31T22:46:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:46:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:46:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:46:56.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6824", 2020-10-31T22:46:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6825", 2020-10-31T22:46:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:46:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6826", 2020-10-31T22:46:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6827", 2020-10-31T22:46:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:46:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6830", 2020-10-31T22:46:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6831", 2020-10-31T22:46:56.860 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:46:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:46:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:46:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6828", 2020-10-31T22:46:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:46:56.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6829", 2020-10-31T22:46:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:46:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6825/14046", 2020-10-31T22:46:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6827/14046", 2020-10-31T22:46:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6831/14046", 2020-10-31T22:46:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6829/14046", 2020-10-31T22:46:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:46:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:46:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:46:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:46:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:46:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2020-10-31T22:46:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:46:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.314917+0000", 2020-10-31T22:46:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:46:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.643069+0000", 2020-10-31T22:46:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:46:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.662572+0000", 2020-10-31T22:46:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:46:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.664868+0000", 2020-10-31T22:46:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:46:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551107+0000", 2020-10-31T22:46:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:46:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.400568+0000", 2020-10-31T22:46:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:46:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551173+0000", 2020-10-31T22:46:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:46:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:46:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:46:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:46:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:46:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:46:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:46:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.604302+0000", 2020-10-31T22:46:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:46:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:46:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2020-10-31T22:46:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2020-10-31T22:46:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2020-10-31T22:46:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2020-10-31T22:46:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "blacklist": {}, 2020-10-31T22:46:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2020-10-31T22:46:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2020-10-31T22:46:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2020-10-31T22:46:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2020-10-31T22:46:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2020-10-31T22:46:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2020-10-31T22:46:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "ruleset-failure-domain": "osd", 2020-10-31T22:46:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2020-10-31T22:46:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:46:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:46:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2020-10-31T22:46:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2020-10-31T22:46:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2020-10-31T22:46:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2020-10-31T22:46:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {} 2020-10-31T22:46:56.882 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:46:56.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.724+0000 7fbf4759e700 1 -- 172.21.15.60:0/3629885211 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbf2c054f10 msgr2=0x7fbf2c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:56.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.724+0000 7fbf4759e700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbf2c054f10 0x7fbf2c0573d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7fbf3800b000 tx=0x7fbf38008040).stop 2020-10-31T22:46:56.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.724+0000 7fbf4759e700 1 -- 172.21.15.60:0/3629885211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf480b5570 msgr2=0x7fbf48154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:56.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.724+0000 7fbf4759e700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf480b5570 0x7fbf48154110 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 rx=0x7fbf300010d0 tx=0x7fbf30007aa0).stop 2020-10-31T22:46:56.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.724+0000 7fbf4759e700 1 -- 172.21.15.60:0/3629885211 shutdown_connections 2020-10-31T22:46:56.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.724+0000 7fbf4759e700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbf2c054f10 0x7fbf2c0573d0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.724+0000 7fbf4759e700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf48141fe0 0x7fbf48154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.724+0000 7fbf4759e700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf480b24a0 0x7fbf4813dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.724+0000 7fbf4759e700 1 --2- 172.21.15.60:0/3629885211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf480b5570 0x7fbf48154110 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:56.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.724+0000 7fbf4759e700 1 -- 172.21.15.60:0/3629885211 >> 172.21.15.60:0/3629885211 conn(0x7fbf480b8e90 msgr2=0x7fbf480b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:56.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.724+0000 7fbf4759e700 1 -- 172.21.15.60:0/3629885211 shutdown_connections 2020-10-31T22:46:56.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:56.724+0000 7fbf4759e700 1 -- 172.21.15.60:0/3629885211 wait complete. 2020-10-31T22:46:56.886 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:46:57.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d618fa700 1 Processor -- start 2020-10-31T22:46:57.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d618fa700 1 -- start start 2020-10-31T22:46:57.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d618fa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4d5c0b5570 0x7f4d5c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:57.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d618fa700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d5c141fe0 0x7f4d5c142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:57.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d618fa700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5c145180 con 0x7f4d5c0b24a0 2020-10-31T22:46:57.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d618fa700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5c0afae0 con 0x7f4d5c0b5570 2020-10-31T22:46:57.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d618fa700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c141bf0 con 0x7f4d5c141fe0 2020-10-31T22:46:57.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d608f8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4d5c0b5570 0x7f4d5c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:57.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d608f8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4d5c0b5570 0x7f4d5c0b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45072/0 (socket says 172.21.15.60:45072) 2020-10-31T22:46:57.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d608f8700 1 -- 172.21.15.60:0/2497982610 learned_addr learned my addr 172.21.15.60:0/2497982610 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:57.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d610f9700 1 --2- 172.21.15.60:0/2497982610 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d5c141fe0 0x7f4d5c142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:57.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d608f8700 1 -- 172.21.15.60:0/2497982610 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d5c141fe0 msgr2=0x7f4d5c142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:57.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d608f8700 1 --2- 172.21.15.60:0/2497982610 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d5c141fe0 0x7f4d5c142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d608f8700 1 -- 172.21.15.60:0/2497982610 >> v1:172.21.15.66:6789/0 conn(0x7f4d5c0b24a0 legacy=0x7f4d5c145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:57.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d608f8700 1 -- 172.21.15.60:0/2497982610 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c0b0670 con 0x7f4d5c0b5570 2020-10-31T22:46:57.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d610f9700 1 --2- 172.21.15.60:0/2497982610 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d5c141fe0 0x7f4d5c142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:57.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d608f8700 1 --2- 172.21.15.60:0/2497982610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5c0b5570 0x7f4d5c0b5950 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f4d5c05f580 tx=0x7f4d4c009270).ready entity=mon.0 client_cookie=fa4474595f682f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:57.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d5b7fe700 1 -- 172.21.15.60:0/2497982610 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d4c00bbc0 con 0x7f4d5c0b5570 2020-10-31T22:46:57.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d5b7fe700 1 -- 172.21.15.60:0/2497982610 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c00bd20 con 0x7f4d5c0b5570 2020-10-31T22:46:57.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d5b7fe700 1 -- 172.21.15.60:0/2497982610 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d4c00be90 con 0x7f4d5c0b5570 2020-10-31T22:46:57.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d618fa700 1 -- 172.21.15.60:0/2497982610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5c0b5570 msgr2=0x7f4d5c0b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:57.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.008+0000 7f4d618fa700 1 --2- 172.21.15.60:0/2497982610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5c0b5570 0x7f4d5c0b5950 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 rx=0x7f4d5c05f580 tx=0x7f4d4c009270).stop 2020-10-31T22:46:57.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d618fa700 1 -- 172.21.15.60:0/2497982610 shutdown_connections 2020-10-31T22:46:57.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d618fa700 1 --2- 172.21.15.60:0/2497982610 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d5c141fe0 0x7f4d5c142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d618fa700 1 --2- 172.21.15.60:0/2497982610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5c0b5570 0x7f4d5c0b5950 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d618fa700 1 -- 172.21.15.60:0/2497982610 >> 172.21.15.60:0/2497982610 conn(0x7f4d5c0b8e90 msgr2=0x7f4d5c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:57.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d618fa700 1 -- 172.21.15.60:0/2497982610 shutdown_connections 2020-10-31T22:46:57.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d618fa700 1 -- 172.21.15.60:0/2497982610 wait complete. 2020-10-31T22:46:57.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d618fa700 1 Processor -- start 2020-10-31T22:46:57.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d618fa700 1 -- start start 2020-10-31T22:46:57.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d618fa700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d5c0b24a0 0x7f4d5c13cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:57.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d618fa700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d5c0b5570 0x7f4d5c154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:57.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d618fa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5c141fe0 0x7f4d5c0b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:57.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d618fa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c154620 con 0x7f4d5c141fe0 2020-10-31T22:46:57.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d618fa700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c144ce0 con 0x7f4d5c0b24a0 2020-10-31T22:46:57.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d618fa700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c144f80 con 0x7f4d5c0b5570 2020-10-31T22:46:57.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d610f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5c141fe0 0x7f4d5c0b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:57.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d610f9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5c141fe0 0x7f4d5c0b74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45080/0 (socket says 172.21.15.60:45080) 2020-10-31T22:46:57.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d610f9700 1 -- 172.21.15.60:0/3339297319 learned_addr learned my addr 172.21.15.60:0/3339297319 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:57.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d608f8700 1 --2- 172.21.15.60:0/3339297319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d5c0b24a0 0x7f4d5c13cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:57.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.012+0000 7f4d5bfff700 1 --2- 172.21.15.60:0/3339297319 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d5c0b5570 0x7f4d5c154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:57.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d610f9700 1 -- 172.21.15.60:0/3339297319 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d5c0b5570 msgr2=0x7f4d5c154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:57.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d610f9700 1 --2- 172.21.15.60:0/3339297319 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d5c0b5570 0x7f4d5c154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d610f9700 1 -- 172.21.15.60:0/3339297319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d5c0b24a0 msgr2=0x7f4d5c13cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:57.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d610f9700 1 --2- 172.21.15.60:0/3339297319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d5c0b24a0 0x7f4d5c13cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d610f9700 1 -- 172.21.15.60:0/3339297319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c0b6d80 con 0x7f4d5c141fe0 2020-10-31T22:46:57.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d610f9700 1 --2- 172.21.15.60:0/3339297319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5c141fe0 0x7f4d5c0b74c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f4d54006910 tx=0x7f4d54008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:57.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d59ffb700 1 -- 172.21.15.60:0/3339297319 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d540127e0 con 0x7f4d5c141fe0 2020-10-31T22:46:57.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d59ffb700 1 -- 172.21.15.60:0/3339297319 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d54012940 con 0x7f4d5c141fe0 2020-10-31T22:46:57.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d618fa700 1 -- 172.21.15.60:0/3339297319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5c0b7020 con 0x7f4d5c141fe0 2020-10-31T22:46:57.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d59ffb700 1 -- 172.21.15.60:0/3339297319 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d54012ca0 con 0x7f4d5c141fe0 2020-10-31T22:46:57.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d618fa700 1 -- 172.21.15.60:0/3339297319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5c0b79b0 con 0x7f4d5c141fe0 2020-10-31T22:46:57.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d618fa700 1 -- 172.21.15.60:0/3339297319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5c144b10 con 0x7f4d5c141fe0 2020-10-31T22:46:57.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d59ffb700 1 -- 172.21.15.60:0/3339297319 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4d54013480 con 0x7f4d5c141fe0 2020-10-31T22:46:57.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d59ffb700 1 --2- 172.21.15.60:0/3339297319 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d40054f10 0x7f4d400573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:57.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d59ffb700 1 -- 172.21.15.60:0/3339297319 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4d5406e080 con 0x7f4d5c141fe0 2020-10-31T22:46:57.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.016+0000 7f4d608f8700 1 --2- 172.21.15.60:0/3339297319 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d40054f10 0x7f4d400573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:57.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.020+0000 7f4d608f8700 1 --2- 172.21.15.60:0/3339297319 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d40054f10 0x7f4d400573d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f4d4c01a000 tx=0x7f4d4c016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:57.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.024+0000 7f4d59ffb700 1 -- 172.21.15.60:0/3339297319 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4d54044540 con 0x7f4d5c141fe0 2020-10-31T22:46:57.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.212+0000 7f4d618fa700 1 -- 172.21.15.60:0/3339297319 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d5c0b71b0 con 0x7f4d5c141fe0 2020-10-31T22:46:57.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.212+0000 7f4d59ffb700 1 -- 172.21.15.60:0/3339297319 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+2490 (secure 0 0 0) 0x7f4d54047b60 con 0x7f4d5c141fe0 2020-10-31T22:46:57.215 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:57.216 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":29,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2411188619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2411188619},{"type":"v1","addr":"172.21.15.60:6835","nonce":2411188619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26},{"gid":5880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/507121609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":507121609},{"type":"v1","addr":"172.21.15.66:6833","nonce":507121609}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:46:19.877041+0000","modified":"2020-10-31T22:46:20.880233+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5889},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5889":{"gid":5889,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2545916146","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2545916146},{"type":"v1","addr":"172.21.15.60:6837","nonce":2545916146}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-10-31T22:46:57.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.216+0000 7f4d618fa700 1 -- 172.21.15.60:0/3339297319 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d40054f10 msgr2=0x7f4d400573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:57.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.216+0000 7f4d618fa700 1 --2- 172.21.15.60:0/3339297319 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d40054f10 0x7f4d400573d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f4d4c01a000 tx=0x7f4d4c016000).stop 2020-10-31T22:46:57.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.216+0000 7f4d618fa700 1 -- 172.21.15.60:0/3339297319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5c141fe0 msgr2=0x7f4d5c0b74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:57.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.216+0000 7f4d618fa700 1 --2- 172.21.15.60:0/3339297319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5c141fe0 0x7f4d5c0b74c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 rx=0x7f4d54006910 tx=0x7f4d54008040).stop 2020-10-31T22:46:57.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.216+0000 7f4d618fa700 1 -- 172.21.15.60:0/3339297319 shutdown_connections 2020-10-31T22:46:57.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.216+0000 7f4d618fa700 1 --2- 172.21.15.60:0/3339297319 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d5c141fe0 0x7f4d5c0b74c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.216+0000 7f4d618fa700 1 --2- 172.21.15.60:0/3339297319 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d40054f10 0x7f4d400573d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.216+0000 7f4d618fa700 1 --2- 172.21.15.60:0/3339297319 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d5c0b24a0 0x7f4d5c13cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.216+0000 7f4d618fa700 1 --2- 172.21.15.60:0/3339297319 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d5c0b5570 0x7f4d5c154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.216+0000 7f4d618fa700 1 -- 172.21.15.60:0/3339297319 >> 172.21.15.60:0/3339297319 conn(0x7f4d5c0b8e90 msgr2=0x7f4d5c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:57.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.216+0000 7f4d618fa700 1 -- 172.21.15.60:0/3339297319 shutdown_connections 2020-10-31T22:46:57.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.216+0000 7f4d618fa700 1 -- 172.21.15.60:0/3339297319 wait complete. 2020-10-31T22:46:57.219 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 29 2020-10-31T22:46:57.229 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-10-31T22:46:57.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.340+0000 7f4fdf3cf700 1 Processor -- start 2020-10-31T22:46:57.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.340+0000 7f4fdf3cf700 1 -- start start 2020-10-31T22:46:57.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4fd80b5570 0x7f4fd80b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:57.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4fd8141fe0 0x7f4fd8142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:57.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fd8145180 con 0x7f4fd80b24a0 2020-10-31T22:46:57.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd80afae0 con 0x7f4fd8141fe0 2020-10-31T22:46:57.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd8141bf0 con 0x7f4fd80b5570 2020-10-31T22:46:57.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdebce700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4fd8141fe0 0x7f4fd8142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:57.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdebce700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4fd8141fe0 0x7f4fd8142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45088/0 (socket says 172.21.15.60:45088) 2020-10-31T22:46:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fddbcc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4fd80b24a0 0x7f4fd8145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49222/0 (socket says 172.21.15.60:49222) 2020-10-31T22:46:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdebce700 1 -- 172.21.15.60:0/2043985051 learned_addr learned my addr 172.21.15.60:0/2043985051 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fde3cd700 1 --2- 172.21.15.60:0/2043985051 >> v2:172.21.15.66:3300/0 conn(0x7f4fd80b5570 0x7f4fd80b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdebce700 1 -- 172.21.15.60:0/2043985051 >> v2:172.21.15.66:3300/0 conn(0x7f4fd80b5570 msgr2=0x7f4fd80b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:57.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdebce700 1 --2- 172.21.15.60:0/2043985051 >> v2:172.21.15.66:3300/0 conn(0x7f4fd80b5570 0x7f4fd80b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdebce700 1 -- 172.21.15.60:0/2043985051 >> v1:172.21.15.60:6789/0 conn(0x7f4fd80b24a0 legacy=0x7f4fd8145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdebce700 1 -- 172.21.15.60:0/2043985051 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd80b0670 con 0x7f4fd8141fe0 2020-10-31T22:46:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdebce700 1 --2- 172.21.15.60:0/2043985051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd8141fe0 0x7f4fd8142490 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f4fd805f580 tx=0x7f4fd0009270).ready entity=mon.0 client_cookie=3bb4cbed469e3bb2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdd3cb700 1 -- 172.21.15.60:0/2043985051 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fd000bbc0 con 0x7f4fd8141fe0 2020-10-31T22:46:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdd3cb700 1 -- 172.21.15.60:0/2043985051 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd000bd20 con 0x7f4fd8141fe0 2020-10-31T22:46:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdd3cb700 1 -- 172.21.15.60:0/2043985051 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fd000be90 con 0x7f4fd8141fe0 2020-10-31T22:46:57.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/2043985051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd8141fe0 msgr2=0x7f4fd8142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:57.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 --2- 172.21.15.60:0/2043985051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd8141fe0 0x7f4fd8142490 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f4fd805f580 tx=0x7f4fd0009270).stop 2020-10-31T22:46:57.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/2043985051 shutdown_connections 2020-10-31T22:46:57.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 --2- 172.21.15.60:0/2043985051 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd8141fe0 0x7f4fd8142490 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 --2- 172.21.15.60:0/2043985051 >> v2:172.21.15.66:3300/0 conn(0x7f4fd80b5570 0x7f4fd80b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/2043985051 >> 172.21.15.60:0/2043985051 conn(0x7f4fd80b8e90 msgr2=0x7f4fd80b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:57.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/2043985051 shutdown_connections 2020-10-31T22:46:57.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/2043985051 wait complete. 2020-10-31T22:46:57.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 Processor -- start 2020-10-31T22:46:57.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.344+0000 7f4fdf3cf700 1 -- start start 2020-10-31T22:46:57.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdf3cf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd80b24a0 0x7f4fd80b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:57.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdf3cf700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fd80b5570 0x7f4fd8150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:57.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdf3cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd8141fe0 0x7f4fd81510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:57.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdf3cf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8144700 con 0x7f4fd8141fe0 2020-10-31T22:46:57.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdf3cf700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd81449a0 con 0x7f4fd80b5570 2020-10-31T22:46:57.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdf3cf700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd8144c40 con 0x7f4fd80b24a0 2020-10-31T22:46:57.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdebce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd8141fe0 0x7f4fd81510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:57.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdebce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd8141fe0 0x7f4fd81510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45096/0 (socket says 172.21.15.60:45096) 2020-10-31T22:46:57.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdebce700 1 -- 172.21.15.60:0/3197720173 learned_addr learned my addr 172.21.15.60:0/3197720173 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:57.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fddbcc700 1 --2- 172.21.15.60:0/3197720173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fd80b5570 0x7f4fd8150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:57.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fde3cd700 1 --2- 172.21.15.60:0/3197720173 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd80b24a0 0x7f4fd80b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:57.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdebce700 1 -- 172.21.15.60:0/3197720173 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd80b24a0 msgr2=0x7f4fd80b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:57.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdebce700 1 --2- 172.21.15.60:0/3197720173 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd80b24a0 0x7f4fd80b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdebce700 1 -- 172.21.15.60:0/3197720173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fd80b5570 msgr2=0x7f4fd8150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:57.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdebce700 1 --2- 172.21.15.60:0/3197720173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fd80b5570 0x7f4fd8150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdebce700 1 -- 172.21.15.60:0/3197720173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd8144ee0 con 0x7f4fd8141fe0 2020-10-31T22:46:57.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdebce700 1 --2- 172.21.15.60:0/3197720173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd8141fe0 0x7f4fd81510a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f4fd805f580 tx=0x7f4fd0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:57.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fc77fe700 1 -- 172.21.15.60:0/3197720173 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fd001e610 con 0x7f4fd8141fe0 2020-10-31T22:46:57.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fc77fe700 1 -- 172.21.15.60:0/3197720173 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd001e770 con 0x7f4fd8141fe0 2020-10-31T22:46:57.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/3197720173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd8143fc0 con 0x7f4fd8141fe0 2020-10-31T22:46:57.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fc77fe700 1 -- 172.21.15.60:0/3197720173 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fd001ead0 con 0x7f4fd8141fe0 2020-10-31T22:46:57.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/3197720173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd8144450 con 0x7f4fd8141fe0 2020-10-31T22:46:57.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/3197720173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd8057100 con 0x7f4fd8141fe0 2020-10-31T22:46:57.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fc77fe700 1 -- 172.21.15.60:0/3197720173 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4fd000f070 con 0x7f4fd8141fe0 2020-10-31T22:46:57.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.348+0000 7f4fc77fe700 1 --2- 172.21.15.60:0/3197720173 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4fb8054f10 0x7f4fb80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:57.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.352+0000 7f4fde3cd700 1 --2- 172.21.15.60:0/3197720173 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4fb8054f10 0x7f4fb80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:57.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.352+0000 7f4fc77fe700 1 -- 172.21.15.60:0/3197720173 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4fd006f0f0 con 0x7f4fd8141fe0 2020-10-31T22:46:57.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.352+0000 7f4fde3cd700 1 --2- 172.21.15.60:0/3197720173 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4fb8054f10 0x7f4fb80573d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f4fc800c000 tx=0x7f4fc8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:57.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.356+0000 7f4fc77fe700 1 -- 172.21.15.60:0/3197720173 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4fd0049040 con 0x7f4fd8141fe0 2020-10-31T22:46:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.548+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/3197720173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4fd8150990 con 0x7f4fd8141fe0 2020-10-31T22:46:57.965 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:46:57.964+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:46:57.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.968+0000 7f4fc77fe700 1 -- 172.21.15.60:0/3197720173 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4fd0015090 con 0x7f4fd8141fe0 2020-10-31T22:46:57.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.972+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/3197720173 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4fb8054f10 msgr2=0x7f4fb80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:57.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.972+0000 7f4fdf3cf700 1 --2- 172.21.15.60:0/3197720173 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4fb8054f10 0x7f4fb80573d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f4fc800c000 tx=0x7f4fc8008040).stop 2020-10-31T22:46:57.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.972+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/3197720173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd8141fe0 msgr2=0x7f4fd81510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:57.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.972+0000 7f4fdf3cf700 1 --2- 172.21.15.60:0/3197720173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd8141fe0 0x7f4fd81510a0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f4fd805f580 tx=0x7f4fd0016000).stop 2020-10-31T22:46:57.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.972+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/3197720173 shutdown_connections 2020-10-31T22:46:57.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.972+0000 7f4fdf3cf700 1 --2- 172.21.15.60:0/3197720173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd8141fe0 0x7f4fd81510a0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.972+0000 7f4fdf3cf700 1 --2- 172.21.15.60:0/3197720173 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd80b24a0 0x7f4fd80b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.972+0000 7f4fdf3cf700 1 --2- 172.21.15.60:0/3197720173 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4fb8054f10 0x7f4fb80573d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.972+0000 7f4fdf3cf700 1 --2- 172.21.15.60:0/3197720173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fd80b5570 0x7f4fd8150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.972+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/3197720173 >> 172.21.15.60:0/3197720173 conn(0x7f4fd80b8e90 msgr2=0x7f4fd80b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.972+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/3197720173 shutdown_connections 2020-10-31T22:46:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:57.972+0000 7f4fdf3cf700 1 -- 172.21.15.60:0/3197720173 wait complete. 2020-10-31T22:46:57.978 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-10-31T22:46:57.995 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:46:58.010 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:46:58.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b759e700 1 Processor -- start 2020-10-31T22:46:58.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b759e700 1 -- start start 2020-10-31T22:46:58.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f42b8063140 0x7f42b80add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:58.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42b80b0b50 0x7f42b80b1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:58.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42b8063520 con 0x7f42b80b1df0 2020-10-31T22:46:58.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42b80adbd0 con 0x7f42b8063140 2020-10-31T22:46:58.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b80afed0 con 0x7f42b80b0b50 2020-10-31T22:46:58.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b6d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f42b80b1df0 0x7f42b80b5080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49258/0 (socket says 172.21.15.60:49258) 2020-10-31T22:46:58.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b6d9d700 1 -- 172.21.15.60:0/2443314306 learned_addr learned my addr 172.21.15.60:0/2443314306 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:58.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42add9b700 1 --2- 172.21.15.60:0/2443314306 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42b80b0b50 0x7f42b80b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:58.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b659c700 1 --2- 172.21.15.60:0/2443314306 >> v2:172.21.15.66:3300/0 conn(0x7f42b8063140 0x7f42b80add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:58.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b5d9b700 1 -- 172.21.15.60:0/2443314306 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4082522249 0 0) 0x7f42b8063520 con 0x7f42b80b1df0 2020-10-31T22:46:58.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b5d9b700 1 -- 172.21.15.60:0/2443314306 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4298003230 con 0x7f42b80b1df0 2020-10-31T22:46:58.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42add9b700 1 -- 172.21.15.60:0/2443314306 >> v2:172.21.15.66:3300/0 conn(0x7f42b8063140 msgr2=0x7f42b80add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:58.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42add9b700 1 --2- 172.21.15.60:0/2443314306 >> v2:172.21.15.66:3300/0 conn(0x7f42b8063140 0x7f42b80add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42add9b700 1 -- 172.21.15.60:0/2443314306 >> v1:172.21.15.60:6789/0 conn(0x7f42b80b1df0 legacy=0x7f42b80b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:58.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42add9b700 1 -- 172.21.15.60:0/2443314306 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b80b0170 con 0x7f42b80b0b50 2020-10-31T22:46:58.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42add9b700 1 --2- 172.21.15.60:0/2443314306 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42b80b0b50 0x7f42b80b1900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f42a0002f30 tx=0x7f42a0006dc0).ready entity=mon.2 client_cookie=cc3979caf1f377a7 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:58.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b5d9b700 1 -- 172.21.15.60:0/2443314306 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42a00096a0 con 0x7f42b80b0b50 2020-10-31T22:46:58.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b5d9b700 1 -- 172.21.15.60:0/2443314306 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a0009800 con 0x7f42b80b0b50 2020-10-31T22:46:58.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b5d9b700 1 -- 172.21.15.60:0/2443314306 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42a0009b60 con 0x7f42b80b0b50 2020-10-31T22:46:58.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b759e700 1 -- 172.21.15.60:0/2443314306 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42b80b0b50 msgr2=0x7f42b80b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:58.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.104+0000 7f42b759e700 1 --2- 172.21.15.60:0/2443314306 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42b80b0b50 0x7f42b80b1900 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f42a0002f30 tx=0x7f42a0006dc0).stop 2020-10-31T22:46:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b759e700 1 -- 172.21.15.60:0/2443314306 shutdown_connections 2020-10-31T22:46:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b759e700 1 --2- 172.21.15.60:0/2443314306 >> v2:172.21.15.66:3300/0 conn(0x7f42b8063140 0x7f42b80add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b759e700 1 --2- 172.21.15.60:0/2443314306 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42b80b0b50 0x7f42b80b1900 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b759e700 1 -- 172.21.15.60:0/2443314306 >> 172.21.15.60:0/2443314306 conn(0x7f42b806a600 msgr2=0x7f42b8060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b759e700 1 -- 172.21.15.60:0/2443314306 shutdown_connections 2020-10-31T22:46:58.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b759e700 1 -- 172.21.15.60:0/2443314306 wait complete. 2020-10-31T22:46:58.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b759e700 1 Processor -- start 2020-10-31T22:46:58.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b759e700 1 -- start start 2020-10-31T22:46:58.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42b8063140 0x7f42b80a2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:58.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b80b0b50 0x7f42b8154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:58.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b80b1df0 0x7f42b8155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:58.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b80a2140 con 0x7f42b80b1df0 2020-10-31T22:46:58.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42b81555f0 con 0x7f42b80b0b50 2020-10-31T22:46:58.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42b8152950 con 0x7f42b8063140 2020-10-31T22:46:58.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b80b1df0 0x7f42b8155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:58.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b80b1df0 0x7f42b8155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45128/0 (socket says 172.21.15.60:45128) 2020-10-31T22:46:58.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b6d9d700 1 -- 172.21.15.60:0/3296099253 learned_addr learned my addr 172.21.15.60:0/3296099253 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:58.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42add9b700 1 --2- 172.21.15.60:0/3296099253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b80b0b50 0x7f42b8154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:58.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b659c700 1 --2- 172.21.15.60:0/3296099253 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42b8063140 0x7f42b80a2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:58.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b6d9d700 1 -- 172.21.15.60:0/3296099253 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42b8063140 msgr2=0x7f42b80a2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:58.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b6d9d700 1 --2- 172.21.15.60:0/3296099253 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42b8063140 0x7f42b80a2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b6d9d700 1 -- 172.21.15.60:0/3296099253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b80b0b50 msgr2=0x7f42b8154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:58.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b6d9d700 1 --2- 172.21.15.60:0/3296099253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b80b0b50 0x7f42b8154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b6d9d700 1 -- 172.21.15.60:0/3296099253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b80a0900 con 0x7f42b80b1df0 2020-10-31T22:46:58.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42b6d9d700 1 --2- 172.21.15.60:0/3296099253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b80b1df0 0x7f42b8155100 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f42b0001450 tx=0x7f42b0007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:58.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.108+0000 7f42affff700 1 -- 172.21.15.60:0/3296099253 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42b000ce70 con 0x7f42b80b1df0 2020-10-31T22:46:58.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.112+0000 7f42affff700 1 -- 172.21.15.60:0/3296099253 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b0005b70 con 0x7f42b80b1df0 2020-10-31T22:46:58.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.112+0000 7f42b759e700 1 -- 172.21.15.60:0/3296099253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b80a0e40 con 0x7f42b80b1df0 2020-10-31T22:46:58.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.112+0000 7f42affff700 1 -- 172.21.15.60:0/3296099253 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42b0007110 con 0x7f42b80b1df0 2020-10-31T22:46:58.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.112+0000 7f42b759e700 1 -- 172.21.15.60:0/3296099253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b80a01e0 con 0x7f42b80b1df0 2020-10-31T22:46:58.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.112+0000 7f42b759e700 1 -- 172.21.15.60:0/3296099253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42b8057100 con 0x7f42b80b1df0 2020-10-31T22:46:58.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.112+0000 7f42affff700 1 -- 172.21.15.60:0/3296099253 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f42b0010030 con 0x7f42b80b1df0 2020-10-31T22:46:58.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.112+0000 7f42affff700 1 --2- 172.21.15.60:0/3296099253 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f429c054f30 0x7f429c0573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:58.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.112+0000 7f42affff700 1 -- 172.21.15.60:0/3296099253 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f42b006d9f0 con 0x7f42b80b1df0 2020-10-31T22:46:58.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.112+0000 7f42b659c700 1 --2- 172.21.15.60:0/3296099253 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f429c054f30 0x7f429c0573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:58.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.112+0000 7f42b659c700 1 --2- 172.21.15.60:0/3296099253 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f429c054f30 0x7f429c0573f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f42a800b000 tx=0x7f42a8006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:58.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.120+0000 7f42affff700 1 -- 172.21.15.60:0/3296099253 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f42b006fe60 con 0x7f42b80b1df0 2020-10-31T22:46:58.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.308+0000 7f42b759e700 1 -- 172.21.15.60:0/3296099253 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42b805ed50 con 0x7f42b80b1df0 2020-10-31T22:46:58.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.312+0000 7f42affff700 1 -- 172.21.15.60:0/3296099253 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+2129 (secure 0 0 0) 0x7f42b0043ec0 con 0x7f42b80b1df0 2020-10-31T22:46:58.312 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:46:58.313 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":30,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":5877,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2411188619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2411188619},{"type":"v1","addr":"172.21.15.60:6835","nonce":2411188619}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26},{"gid":5880,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/507121609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":507121609},{"type":"v1","addr":"172.21.15.66:6833","nonce":507121609}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:46:19.877041+0000","modified":"2020-10-31T22:46:57.965776+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":66,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2020-10-31T22:46:58.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.312+0000 7f42b759e700 1 -- 172.21.15.60:0/3296099253 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f429c054f30 msgr2=0x7f429c0573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:58.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.312+0000 7f42b759e700 1 --2- 172.21.15.60:0/3296099253 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f429c054f30 0x7f429c0573f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f42a800b000 tx=0x7f42a8006dc0).stop 2020-10-31T22:46:58.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.312+0000 7f42b759e700 1 -- 172.21.15.60:0/3296099253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b80b1df0 msgr2=0x7f42b8155100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:58.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.312+0000 7f42b759e700 1 --2- 172.21.15.60:0/3296099253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b80b1df0 0x7f42b8155100 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f42b0001450 tx=0x7f42b0007d30).stop 2020-10-31T22:46:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.312+0000 7f42b759e700 1 -- 172.21.15.60:0/3296099253 shutdown_connections 2020-10-31T22:46:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.312+0000 7f42b759e700 1 --2- 172.21.15.60:0/3296099253 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42b80b1df0 0x7f42b8155100 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.312+0000 7f42b759e700 1 --2- 172.21.15.60:0/3296099253 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42b8063140 0x7f42b80a2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.312+0000 7f42b759e700 1 --2- 172.21.15.60:0/3296099253 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f429c054f30 0x7f429c0573f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.312+0000 7f42b759e700 1 --2- 172.21.15.60:0/3296099253 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42b80b0b50 0x7f42b8154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.312+0000 7f42b759e700 1 -- 172.21.15.60:0/3296099253 >> 172.21.15.60:0/3296099253 conn(0x7f42b806a600 msgr2=0x7f42b80acfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:58.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.312+0000 7f42b759e700 1 -- 172.21.15.60:0/3296099253 shutdown_connections 2020-10-31T22:46:58.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.312+0000 7f42b759e700 1 -- 172.21.15.60:0/3296099253 wait complete. 2020-10-31T22:46:58.316 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 30 2020-10-31T22:46:58.326 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:46:58.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.484+0000 7ff08ffff700 1 Processor -- start 2020-10-31T22:46:58.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.484+0000 7ff08ffff700 1 -- start start 2020-10-31T22:46:58.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff0900608a0 0x7ff09005b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:58.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08ffff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff090146a40 0x7ff0900b0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:58.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08ffff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0900b0520 con 0x7ff09005afe0 2020-10-31T22:46:58.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08ffff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0900b07b0 con 0x7ff090146a40 2020-10-31T22:46:58.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff090146300 con 0x7ff0900608a0 2020-10-31T22:46:58.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08e7fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff0900608a0 0x7ff09005b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:58.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08effd700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff09005afe0 0x7ff0900aec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:47136/0 (socket says 172.21.15.60:47136) 2020-10-31T22:46:58.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08e7fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff0900608a0 0x7ff09005b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:58322/0 (socket says 172.21.15.60:58322) 2020-10-31T22:46:58.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08effd700 1 -- 172.21.15.60:0/2003303638 learned_addr learned my addr 172.21.15.60:0/2003303638 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:46:58.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08f7fe700 1 --2- 172.21.15.60:0/2003303638 >> v2:172.21.15.66:3300/0 conn(0x7ff090146a40 0x7ff0900b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:58.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08dffb700 1 -- 172.21.15.60:0/2003303638 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880278712 0 0) 0x7ff0900b0520 con 0x7ff09005afe0 2020-10-31T22:46:58.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08e7fc700 1 -- 172.21.15.60:0/2003303638 >> v2:172.21.15.66:3300/0 conn(0x7ff090146a40 msgr2=0x7ff0900b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:58.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08e7fc700 1 --2- 172.21.15.60:0/2003303638 >> v2:172.21.15.66:3300/0 conn(0x7ff090146a40 0x7ff0900b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08e7fc700 1 -- 172.21.15.60:0/2003303638 >> v1:172.21.15.66:6789/0 conn(0x7ff09005afe0 legacy=0x7ff0900aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:58.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08e7fc700 1 -- 172.21.15.60:0/2003303638 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0901465a0 con 0x7ff0900608a0 2020-10-31T22:46:58.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08e7fc700 1 --2- 172.21.15.60:0/2003303638 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff0900608a0 0x7ff09005b3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ff080002f30 tx=0x7ff080006dc0).ready entity=mon.2 client_cookie=a63c30dcda69acf1 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:58.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08dffb700 1 -- 172.21.15.60:0/2003303638 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff080009760 con 0x7ff0900608a0 2020-10-31T22:46:58.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08dffb700 1 -- 172.21.15.60:0/2003303638 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0800098c0 con 0x7ff0900608a0 2020-10-31T22:46:58.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08dffb700 1 -- 172.21.15.60:0/2003303638 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff080009c20 con 0x7ff0900608a0 2020-10-31T22:46:58.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08ffff700 1 -- 172.21.15.60:0/2003303638 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff0900608a0 msgr2=0x7ff09005b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:58.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08ffff700 1 --2- 172.21.15.60:0/2003303638 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff0900608a0 0x7ff09005b3c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7ff080002f30 tx=0x7ff080006dc0).stop 2020-10-31T22:46:58.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08ffff700 1 -- 172.21.15.60:0/2003303638 shutdown_connections 2020-10-31T22:46:58.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08ffff700 1 --2- 172.21.15.60:0/2003303638 >> v2:172.21.15.66:3300/0 conn(0x7ff090146a40 0x7ff0900b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08ffff700 1 --2- 172.21.15.60:0/2003303638 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff0900608a0 0x7ff09005b3c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08ffff700 1 -- 172.21.15.60:0/2003303638 >> 172.21.15.60:0/2003303638 conn(0x7ff0900b61d0 msgr2=0x7ff0900b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:58.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08ffff700 1 -- 172.21.15.60:0/2003303638 shutdown_connections 2020-10-31T22:46:58.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.488+0000 7ff08ffff700 1 -- 172.21.15.60:0/2003303638 wait complete. 2020-10-31T22:46:58.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08ffff700 1 Processor -- start 2020-10-31T22:46:58.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08ffff700 1 -- start start 2020-10-31T22:46:58.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff09005afe0 0x7ff0901558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:58.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08ffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0900608a0 0x7ff09013d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:58.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff090146a40 0x7ff09013dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:58.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff090155db0 con 0x7ff090146a40 2020-10-31T22:46:58.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08ffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff090148570 con 0x7ff0900608a0 2020-10-31T22:46:58.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff090144d90 con 0x7ff09005afe0 2020-10-31T22:46:58.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff090146a40 0x7ff09013dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:58.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff090146a40 0x7ff09013dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45142/0 (socket says 172.21.15.60:45142) 2020-10-31T22:46:58.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08f7fe700 1 -- 172.21.15.60:0/2865304898 learned_addr learned my addr 172.21.15.60:0/2865304898 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:58.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08e7fc700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0900608a0 0x7ff09013d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:58.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08effd700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff09005afe0 0x7ff0901558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:58.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08f7fe700 1 -- 172.21.15.60:0/2865304898 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff09005afe0 msgr2=0x7ff0901558c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:58.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08f7fe700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff09005afe0 0x7ff0901558c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08f7fe700 1 -- 172.21.15.60:0/2865304898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0900608a0 msgr2=0x7ff09013d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08f7fe700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0900608a0 0x7ff09013d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08f7fe700 1 -- 172.21.15.60:0/2865304898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0901487a0 con 0x7ff090146a40 2020-10-31T22:46:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.492+0000 7ff08e7fc700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0900608a0 0x7ff09013d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:46:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.496+0000 7ff08f7fe700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff090146a40 0x7ff09013dc90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7ff088006dd0 tx=0x7ff0880091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.496+0000 7ff07ffff700 1 -- 172.21.15.60:0/2865304898 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff08800cbb0 con 0x7ff090146a40 2020-10-31T22:46:58.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.496+0000 7ff07ffff700 1 -- 172.21.15.60:0/2865304898 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08800cd10 con 0x7ff090146a40 2020-10-31T22:46:58.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.496+0000 7ff08ffff700 1 -- 172.21.15.60:0/2865304898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff090148a40 con 0x7ff090146a40 2020-10-31T22:46:58.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.496+0000 7ff07ffff700 1 -- 172.21.15.60:0/2865304898 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0880125e0 con 0x7ff090146a40 2020-10-31T22:46:58.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.496+0000 7ff08ffff700 1 -- 172.21.15.60:0/2865304898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff090144030 con 0x7ff090146a40 2020-10-31T22:46:58.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.496+0000 7ff08ffff700 1 -- 172.21.15.60:0/2865304898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff090057100 con 0x7ff090146a40 2020-10-31T22:46:58.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.496+0000 7ff07ffff700 1 -- 172.21.15.60:0/2865304898 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff088022070 con 0x7ff090146a40 2020-10-31T22:46:58.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.496+0000 7ff07ffff700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff06c054f30 0x7ff06c0573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:58.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.496+0000 7ff08effd700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff06c054f30 0x7ff06c0573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:58.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.496+0000 7ff07ffff700 1 -- 172.21.15.60:0/2865304898 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7ff08806e310 con 0x7ff090146a40 2020-10-31T22:46:58.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.500+0000 7ff08effd700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff06c054f30 0x7ff06c0573f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7ff08400b000 tx=0x7ff084009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:58.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.504+0000 7ff07ffff700 1 -- 172.21.15.60:0/2865304898 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff0880446d0 con 0x7ff090146a40 2020-10-31T22:46:58.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.696+0000 7ff08ffff700 1 -- 172.21.15.60:0/2865304898 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff0900af8c0 con 0x7ff090146a40 2020-10-31T22:46:58.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.980+0000 7ff07ffff700 1 -- 172.21.15.60:0/2865304898 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff088016020 con 0x7ff090146a40 2020-10-31T22:46:58.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.984+0000 7ff08ffff700 1 -- 172.21.15.60:0/2865304898 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff06c054f30 msgr2=0x7ff06c0573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:58.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.984+0000 7ff08ffff700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff06c054f30 0x7ff06c0573f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7ff08400b000 tx=0x7ff084009040).stop 2020-10-31T22:46:58.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.984+0000 7ff08ffff700 1 -- 172.21.15.60:0/2865304898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff090146a40 msgr2=0x7ff09013dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:58.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.984+0000 7ff08ffff700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff090146a40 0x7ff09013dc90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7ff088006dd0 tx=0x7ff0880091a0).stop 2020-10-31T22:46:58.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.984+0000 7ff08ffff700 1 -- 172.21.15.60:0/2865304898 shutdown_connections 2020-10-31T22:46:58.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.984+0000 7ff08ffff700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff090146a40 0x7ff09013dc90 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.984+0000 7ff08ffff700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff09005afe0 0x7ff0901558c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.984+0000 7ff08ffff700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff06c054f30 0x7ff06c0573f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.984+0000 7ff08ffff700 1 --2- 172.21.15.60:0/2865304898 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0900608a0 0x7ff09013d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:58.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.984+0000 7ff08ffff700 1 -- 172.21.15.60:0/2865304898 >> 172.21.15.60:0/2865304898 conn(0x7ff0900b61d0 msgr2=0x7ff090142c10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:58.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.984+0000 7ff08ffff700 1 -- 172.21.15.60:0/2865304898 shutdown_connections 2020-10-31T22:46:58.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:58.984+0000 7ff08ffff700 1 -- 172.21.15.60:0/2865304898 wait complete. 2020-10-31T22:46:59.005 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:46:59.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.124+0000 7f06f8e17700 1 Processor -- start 2020-10-31T22:46:59.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.124+0000 7f06f8e17700 1 -- start start 2020-10-31T22:46:59.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f8e17700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f06f40b1d50 0x7f06f40ac020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:59.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f8e17700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f06f40a8140 0x7f06f40adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:59.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f8e17700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f413f630 con 0x7f06f413bcc0 2020-10-31T22:46:59.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f8e17700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f40b2130 con 0x7f06f40a8140 2020-10-31T22:46:59.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f8e17700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f405c0f0 con 0x7f06f40b1d50 2020-10-31T22:46:59.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06eaffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f06f40a8140 0x7f06f40adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:59.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06eaffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f06f40a8140 0x7f06f40adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45150/0 (socket says 172.21.15.60:45150) 2020-10-31T22:46:59.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06eaffd700 1 -- 172.21.15.60:0/2945705309 learned_addr learned my addr 172.21.15.60:0/2945705309 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:59.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f37fe700 1 --2- 172.21.15.60:0/2945705309 >> v2:172.21.15.66:3300/0 conn(0x7f06f40b1d50 0x7f06f40ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:59.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06eaffd700 1 -- 172.21.15.60:0/2945705309 >> v2:172.21.15.66:3300/0 conn(0x7f06f40b1d50 msgr2=0x7f06f40ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:46:59.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06eaffd700 1 --2- 172.21.15.60:0/2945705309 >> v2:172.21.15.66:3300/0 conn(0x7f06f40b1d50 0x7f06f40ac020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:59.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06eaffd700 1 -- 172.21.15.60:0/2945705309 >> v1:172.21.15.66:6789/0 conn(0x7f06f413bcc0 legacy=0x7f06f413c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:59.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06eaffd700 1 -- 172.21.15.60:0/2945705309 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f413f860 con 0x7f06f40a8140 2020-10-31T22:46:59.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06eaffd700 1 --2- 172.21.15.60:0/2945705309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f40a8140 0x7f06f40adb10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f06f40ada60 tx=0x7f06dc006e80).ready entity=mon.0 client_cookie=1fe13d69f98960fe server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:59.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f2ffd700 1 -- 172.21.15.60:0/2945705309 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06dc0099a0 con 0x7f06f40a8140 2020-10-31T22:46:59.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f2ffd700 1 -- 172.21.15.60:0/2945705309 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc009b00 con 0x7f06f40a8140 2020-10-31T22:46:59.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f2ffd700 1 -- 172.21.15.60:0/2945705309 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06dc009e60 con 0x7f06f40a8140 2020-10-31T22:46:59.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f8e17700 1 -- 172.21.15.60:0/2945705309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f40a8140 msgr2=0x7f06f40adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:59.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f8e17700 1 --2- 172.21.15.60:0/2945705309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f40a8140 0x7f06f40adb10 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7f06f40ada60 tx=0x7f06dc006e80).stop 2020-10-31T22:46:59.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f8e17700 1 -- 172.21.15.60:0/2945705309 shutdown_connections 2020-10-31T22:46:59.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f8e17700 1 --2- 172.21.15.60:0/2945705309 >> v2:172.21.15.66:3300/0 conn(0x7f06f40b1d50 0x7f06f40ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:59.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f8e17700 1 --2- 172.21.15.60:0/2945705309 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f40a8140 0x7f06f40adb10 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:59.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f8e17700 1 -- 172.21.15.60:0/2945705309 >> 172.21.15.60:0/2945705309 conn(0x7f06f40b5330 msgr2=0x7f06f40b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:46:59.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f8e17700 1 -- 172.21.15.60:0/2945705309 shutdown_connections 2020-10-31T22:46:59.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.128+0000 7f06f8e17700 1 -- 172.21.15.60:0/2945705309 wait complete. 2020-10-31T22:46:59.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f8e17700 1 Processor -- start 2020-10-31T22:46:59.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f8e17700 1 -- start start 2020-10-31T22:46:59.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f8e17700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06f40a8140 0x7f06f4141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:59.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f8e17700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06f40b1d50 0x7f06f40b02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:59.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f8e17700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f413bcc0 0x7f06f41505e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:59.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f8e17700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f414ff10 con 0x7f06f413bcc0 2020-10-31T22:46:59.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f8e17700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40b0f00 con 0x7f06f40a8140 2020-10-31T22:46:59.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f8e17700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40b11a0 con 0x7f06f40b1d50 2020-10-31T22:46:59.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f413bcc0 0x7f06f41505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f413bcc0 0x7f06f41505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45158/0 (socket says 172.21.15.60:45158) 2020-10-31T22:46:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f37fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06f40a8140 0x7f06f4141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06eaffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06f40b1d50 0x7f06f40b02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:59.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f3fff700 1 -- 172.21.15.60:0/2262851493 learned_addr learned my addr 172.21.15.60:0/2262851493 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:46:59.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f3fff700 1 -- 172.21.15.60:0/2262851493 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06f40b1d50 msgr2=0x7f06f40b02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:59.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f3fff700 1 --2- 172.21.15.60:0/2262851493 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06f40b1d50 0x7f06f40b02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:59.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f3fff700 1 -- 172.21.15.60:0/2262851493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06f40a8140 msgr2=0x7f06f4141eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:46:59.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f3fff700 1 --2- 172.21.15.60:0/2262851493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06f40a8140 0x7f06f4141eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:46:59.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f3fff700 1 -- 172.21.15.60:0/2262851493 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f4150140 con 0x7f06f413bcc0 2020-10-31T22:46:59.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f3fff700 1 --2- 172.21.15.60:0/2262851493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f413bcc0 0x7f06f41505e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f06f4060ee0 tx=0x7f06ec007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.132+0000 7f06f17fa700 1 -- 172.21.15.60:0/2262851493 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ec00ce20 con 0x7f06f413bcc0 2020-10-31T22:46:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.136+0000 7f06f17fa700 1 -- 172.21.15.60:0/2262851493 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec00a840 con 0x7f06f413bcc0 2020-10-31T22:46:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.136+0000 7f06f8e17700 1 -- 172.21.15.60:0/2262851493 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f4142750 con 0x7f06f413bcc0 2020-10-31T22:46:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.136+0000 7f06f17fa700 1 -- 172.21.15.60:0/2262851493 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ec00aba0 con 0x7f06f413bcc0 2020-10-31T22:46:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.136+0000 7f06f8e17700 1 -- 172.21.15.60:0/2262851493 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f40b0960 con 0x7f06f413bcc0 2020-10-31T22:46:59.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.136+0000 7f06f8e17700 1 -- 172.21.15.60:0/2262851493 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f41502d0 con 0x7f06f413bcc0 2020-10-31T22:46:59.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.136+0000 7f06f17fa700 1 -- 172.21.15.60:0/2262851493 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f06ec019030 con 0x7f06f413bcc0 2020-10-31T22:46:59.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.136+0000 7f06f17fa700 1 --2- 172.21.15.60:0/2262851493 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f06d8054f10 0x7f06d80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:46:59.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.136+0000 7f06f17fa700 1 -- 172.21.15.60:0/2262851493 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f06ec06d310 con 0x7f06f413bcc0 2020-10-31T22:46:59.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.136+0000 7f06f37fe700 1 --2- 172.21.15.60:0/2262851493 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f06d8054f10 0x7f06d80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:46:59.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.136+0000 7f06f37fe700 1 --2- 172.21.15.60:0/2262851493 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f06d8054f10 0x7f06d80573d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f06e400b000 tx=0x7f06e4006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:46:59.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.144+0000 7f06f17fa700 1 -- 172.21.15.60:0/2262851493 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f06ec0437e0 con 0x7f06f413bcc0 2020-10-31T22:46:59.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:46:59.288+0000 7f06f8e17700 1 -- 172.21.15.60:0/2262851493 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f06f4057100 con 0x7f06f413bcc0 2020-10-31T22:47:00.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.004+0000 7f06f17fa700 1 -- 172.21.15.60:0/2262851493 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v67) v1 ==== 185+0+0 (secure 0 0 0) 0x7f06ec046e00 con 0x7f06f413bcc0 2020-10-31T22:47:00.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.008+0000 7f06f8e17700 1 -- 172.21.15.60:0/2262851493 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f06d8054f10 msgr2=0x7f06d80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:00.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.008+0000 7f06f8e17700 1 --2- 172.21.15.60:0/2262851493 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f06d8054f10 0x7f06d80573d0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f06e400b000 tx=0x7f06e4006dc0).stop 2020-10-31T22:47:00.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.008+0000 7f06f8e17700 1 -- 172.21.15.60:0/2262851493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f413bcc0 msgr2=0x7f06f41505e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:00.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.008+0000 7f06f8e17700 1 --2- 172.21.15.60:0/2262851493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f413bcc0 0x7f06f41505e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f06f4060ee0 tx=0x7f06ec007e50).stop 2020-10-31T22:47:00.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.012+0000 7f06f8e17700 1 -- 172.21.15.60:0/2262851493 shutdown_connections 2020-10-31T22:47:00.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.012+0000 7f06f8e17700 1 --2- 172.21.15.60:0/2262851493 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06f413bcc0 0x7f06f41505e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:00.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.012+0000 7f06f8e17700 1 --2- 172.21.15.60:0/2262851493 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f06d8054f10 0x7f06d80573d0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:00.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.012+0000 7f06f8e17700 1 --2- 172.21.15.60:0/2262851493 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06f40a8140 0x7f06f4141eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:00.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.012+0000 7f06f8e17700 1 --2- 172.21.15.60:0/2262851493 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06f40b1d50 0x7f06f40b02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:00.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.012+0000 7f06f8e17700 1 -- 172.21.15.60:0/2262851493 >> 172.21.15.60:0/2262851493 conn(0x7f06f40b5330 msgr2=0x7f06f40ae490 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:00.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.012+0000 7f06f8e17700 1 -- 172.21.15.60:0/2262851493 shutdown_connections 2020-10-31T22:47:00.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.012+0000 7f06f8e17700 1 -- 172.21.15.60:0/2262851493 wait complete. 2020-10-31T22:47:00.013 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:47:00.027 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-10-31T22:47:00.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.136+0000 7fc31da16700 1 Processor -- start 2020-10-31T22:47:00.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.136+0000 7fc31da16700 1 -- start start 2020-10-31T22:47:00.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31da16700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc3180af520 0x7fc3180ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:00.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31da16700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc318066c90 0x7fc3180670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:00.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31da16700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3180af900 con 0x7fc318146060 2020-10-31T22:47:00.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31da16700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3180afc10 con 0x7fc318066c90 2020-10-31T22:47:00.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31da16700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31805bb70 con 0x7fc3180af520 2020-10-31T22:47:00.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc317fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc318066c90 0x7fc3180670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:00.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31d215700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc318146060 0x7fc318149620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49302/0 (socket says 172.21.15.60:49302) 2020-10-31T22:47:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31d215700 1 -- 172.21.15.60:0/309835273 learned_addr learned my addr 172.21.15.60:0/309835273 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31ca14700 1 --2- 172.21.15.60:0/309835273 >> v2:172.21.15.66:3300/0 conn(0x7fc3180af520 0x7fc3180ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:00.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc3177fe700 1 -- 172.21.15.60:0/309835273 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1663904482 0 0) 0x7fc3180af900 con 0x7fc318146060 2020-10-31T22:47:00.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc3177fe700 1 -- 172.21.15.60:0/309835273 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2f8003230 con 0x7fc318146060 2020-10-31T22:47:00.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc317fff700 1 -- 172.21.15.60:0/309835273 >> v2:172.21.15.66:3300/0 conn(0x7fc3180af520 msgr2=0x7fc3180ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:00.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc317fff700 1 --2- 172.21.15.60:0/309835273 >> v2:172.21.15.66:3300/0 conn(0x7fc3180af520 0x7fc3180ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:00.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc317fff700 1 -- 172.21.15.60:0/309835273 >> v1:172.21.15.60:6789/0 conn(0x7fc318146060 legacy=0x7fc318149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:00.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc317fff700 1 -- 172.21.15.60:0/309835273 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3180ac130 con 0x7fc318066c90 2020-10-31T22:47:00.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc317fff700 1 --2- 172.21.15.60:0/309835273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc318066c90 0x7fc3180670f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fc300002f30 tx=0x7fc300006dc0).ready entity=mon.0 client_cookie=19c51cc3d0b2f8be server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:00.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc3177fe700 1 -- 172.21.15.60:0/309835273 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc3000096f0 con 0x7fc318066c90 2020-10-31T22:47:00.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc3177fe700 1 -- 172.21.15.60:0/309835273 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc300009850 con 0x7fc318066c90 2020-10-31T22:47:00.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc3177fe700 1 -- 172.21.15.60:0/309835273 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc300009bb0 con 0x7fc318066c90 2020-10-31T22:47:00.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31da16700 1 -- 172.21.15.60:0/309835273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc318066c90 msgr2=0x7fc3180670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:00.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31da16700 1 --2- 172.21.15.60:0/309835273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc318066c90 0x7fc3180670f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7fc300002f30 tx=0x7fc300006dc0).stop 2020-10-31T22:47:00.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31da16700 1 -- 172.21.15.60:0/309835273 shutdown_connections 2020-10-31T22:47:00.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31da16700 1 --2- 172.21.15.60:0/309835273 >> v2:172.21.15.66:3300/0 conn(0x7fc3180af520 0x7fc3180ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:00.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31da16700 1 --2- 172.21.15.60:0/309835273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc318066c90 0x7fc3180670f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:00.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31da16700 1 -- 172.21.15.60:0/309835273 >> 172.21.15.60:0/309835273 conn(0x7fc3180b3fd0 msgr2=0x7fc3180b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:00.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31da16700 1 -- 172.21.15.60:0/309835273 shutdown_connections 2020-10-31T22:47:00.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.140+0000 7fc31da16700 1 -- 172.21.15.60:0/309835273 wait complete. 2020-10-31T22:47:00.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31da16700 1 Processor -- start 2020-10-31T22:47:00.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31da16700 1 -- start start 2020-10-31T22:47:00.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31da16700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc318066c90 0x7fc3181434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:00.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31da16700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3180af520 0x7fc318141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:00.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31da16700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc318146060 0x7fc318141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:00.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31da16700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc318141f10 con 0x7fc318146060 2020-10-31T22:47:00.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31da16700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3180a7de0 con 0x7fc318066c90 2020-10-31T22:47:00.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31da16700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3180aa540 con 0x7fc3180af520 2020-10-31T22:47:00.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31d215700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc318146060 0x7fc318141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:00.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31d215700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc318146060 0x7fc318141a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45174/0 (socket says 172.21.15.60:45174) 2020-10-31T22:47:00.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31d215700 1 -- 172.21.15.60:0/1131607411 learned_addr learned my addr 172.21.15.60:0/1131607411 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:00.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc317fff700 1 --2- 172.21.15.60:0/1131607411 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3180af520 0x7fc318141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:00.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31ca14700 1 --2- 172.21.15.60:0/1131607411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc318066c90 0x7fc3181434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:00.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31d215700 1 -- 172.21.15.60:0/1131607411 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3180af520 msgr2=0x7fc318141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31d215700 1 --2- 172.21.15.60:0/1131607411 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3180af520 0x7fc318141530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31d215700 1 -- 172.21.15.60:0/1131607411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc318066c90 msgr2=0x7fc3181434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31d215700 1 --2- 172.21.15.60:0/1131607411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc318066c90 0x7fc3181434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:00.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31d215700 1 -- 172.21.15.60:0/1131607411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318140c80 con 0x7fc318146060 2020-10-31T22:47:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31d215700 1 --2- 172.21.15.60:0/1131607411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc318146060 0x7fc318141a20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fc318142050 tx=0x7fc310007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc315ffb700 1 -- 172.21.15.60:0/1131607411 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc31000ce40 con 0x7fc318146060 2020-10-31T22:47:00.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc315ffb700 1 -- 172.21.15.60:0/1131607411 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc310005b70 con 0x7fc318146060 2020-10-31T22:47:00.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31da16700 1 -- 172.21.15.60:0/1131607411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc318140f20 con 0x7fc318146060 2020-10-31T22:47:00.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc315ffb700 1 -- 172.21.15.60:0/1131607411 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc310007110 con 0x7fc318146060 2020-10-31T22:47:00.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.144+0000 7fc31da16700 1 -- 172.21.15.60:0/1131607411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc318140970 con 0x7fc318146060 2020-10-31T22:47:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.148+0000 7fc31da16700 1 -- 172.21.15.60:0/1131607411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3180aae50 con 0x7fc318146060 2020-10-31T22:47:00.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.148+0000 7fc315ffb700 1 -- 172.21.15.60:0/1131607411 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc310010030 con 0x7fc318146060 2020-10-31T22:47:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.148+0000 7fc315ffb700 1 --2- 172.21.15.60:0/1131607411 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc2fc054f90 0x7fc2fc057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.148+0000 7fc315ffb700 1 -- 172.21.15.60:0/1131607411 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fc31006d760 con 0x7fc318146060 2020-10-31T22:47:00.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.148+0000 7fc31ca14700 1 --2- 172.21.15.60:0/1131607411 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc2fc054f90 0x7fc2fc057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.148+0000 7fc31ca14700 1 --2- 172.21.15.60:0/1131607411 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc2fc054f90 0x7fc2fc057450 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fc308006000 tx=0x7fc308006d60).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:00.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.156+0000 7fc315ffb700 1 -- 172.21.15.60:0/1131607411 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc310043de0 con 0x7fc318146060 2020-10-31T22:47:00.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:00.296+0000 7fc31da16700 1 -- 172.21.15.60:0/1131607411 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc318057100 con 0x7fc318146060 2020-10-31T22:47:01.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.008+0000 7fc315ffb700 1 -- 172.21.15.60:0/1131607411 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v68) v1 ==== 173+0+0 (secure 0 0 0) 0x7fc310047400 con 0x7fc318146060 2020-10-31T22:47:01.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.012+0000 7fc31da16700 1 -- 172.21.15.60:0/1131607411 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc2fc054f90 msgr2=0x7fc2fc057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:01.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.012+0000 7fc31da16700 1 --2- 172.21.15.60:0/1131607411 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc2fc054f90 0x7fc2fc057450 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7fc308006000 tx=0x7fc308006d60).stop 2020-10-31T22:47:01.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.012+0000 7fc31da16700 1 -- 172.21.15.60:0/1131607411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc318146060 msgr2=0x7fc318141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:01.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.012+0000 7fc31da16700 1 --2- 172.21.15.60:0/1131607411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc318146060 0x7fc318141a20 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7fc318142050 tx=0x7fc310007d30).stop 2020-10-31T22:47:01.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.012+0000 7fc31da16700 1 -- 172.21.15.60:0/1131607411 shutdown_connections 2020-10-31T22:47:01.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.012+0000 7fc31da16700 1 --2- 172.21.15.60:0/1131607411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc318146060 0x7fc318141a20 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:01.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.012+0000 7fc31da16700 1 --2- 172.21.15.60:0/1131607411 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc2fc054f90 0x7fc2fc057450 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:01.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.012+0000 7fc31da16700 1 --2- 172.21.15.60:0/1131607411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc318066c90 0x7fc3181434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:01.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.012+0000 7fc31da16700 1 --2- 172.21.15.60:0/1131607411 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc3180af520 0x7fc318141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:01.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.012+0000 7fc31da16700 1 -- 172.21.15.60:0/1131607411 >> 172.21.15.60:0/1131607411 conn(0x7fc3180b3fd0 msgr2=0x7fc3180ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:01.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.012+0000 7fc31da16700 1 -- 172.21.15.60:0/1131607411 shutdown_connections 2020-10-31T22:47:01.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.012+0000 7fc31da16700 1 -- 172.21.15.60:0/1131607411 wait complete. 2020-10-31T22:47:01.017 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2020-10-31T22:47:01.033 INFO:tasks.ceph.mds.a:Restarting daemon 2020-10-31T22:47:01.033 INFO:tasks.ceph.mds.a:Stopping old one... 2020-10-31T22:47:01.033 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-10-31T22:47:01.034 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:47:01.034 INFO:tasks.ceph.mds.c:Restarting daemon 2020-10-31T22:47:01.034 INFO:tasks.ceph.mds.c:Stopping old one... 2020-10-31T22:47:01.035 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-10-31T22:47:01.035 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:47:01.035 INFO:tasks.ceph.mds.b:Restarting daemon 2020-10-31T22:47:01.035 INFO:tasks.ceph.mds.b:Stopping old one... 2020-10-31T22:47:01.036 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-10-31T22:47:01.036 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:47:01.044 INFO:tasks.ceph.mds.a:Stopped 2020-10-31T22:47:01.044 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-10-31T22:47:01.047 INFO:tasks.ceph.mds.b:Stopped 2020-10-31T22:47:01.048 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-10-31T22:47:01.049 INFO:tasks.ceph.mds.c:Stopped 2020-10-31T22:47:01.049 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-10-31T22:47:01.090 INFO:tasks.ceph.mds.b:Started 2020-10-31T22:47:01.091 DEBUG:teuthology.parallel:result is None 2020-10-31T22:47:01.096 INFO:tasks.ceph.mds.a:Started 2020-10-31T22:47:01.097 DEBUG:teuthology.parallel:result is None 2020-10-31T22:47:01.098 INFO:tasks.ceph.mds.c:Started 2020-10-31T22:47:01.099 DEBUG:teuthology.parallel:result is None 2020-10-31T22:47:01.100 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-10-31T22:47:01.165 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:47:01.168 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:47:01.173 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:47:01.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.220+0000 7fa231dc4700 1 Processor -- start 2020-10-31T22:47:01.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.220+0000 7fa231dc4700 1 -- start start 2020-10-31T22:47:01.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa231dc4700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa22c0ab590 0x7fa22c13ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:01.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa231dc4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c137f60 0x7fa22c138370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:01.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa231dc4700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22c0ae550 con 0x7fa22c0aeaf0 2020-10-31T22:47:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa231dc4700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22c13e360 con 0x7fa22c0ab590 2020-10-31T22:47:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa231dc4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c13e600 con 0x7fa22c137f60 2020-10-31T22:47:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa22affd700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa22c0aeaf0 0x7fa22c0ab970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:47206/0 (socket says 172.21.15.60:47206) 2020-10-31T22:47:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa22affd700 1 -- 172.21.15.60:0/755514198 learned_addr learned my addr 172.21.15.60:0/755514198 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa22bfff700 1 --2- 172.21.15.60:0/755514198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c137f60 0x7fa22c138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa22a7fc700 1 -- 172.21.15.60:0/755514198 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1009383274 0 0) 0x7fa22c0ae550 con 0x7fa22c0aeaf0 2020-10-31T22:47:01.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa22a7fc700 1 -- 172.21.15.60:0/755514198 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa218003230 con 0x7fa22c0aeaf0 2020-10-31T22:47:01.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa22bfff700 1 -- 172.21.15.60:0/755514198 >> v2:172.21.15.66:3300/0 conn(0x7fa22c0ab590 msgr2=0x7fa22c13ed40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-10-31T22:47:01.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa22bfff700 1 --2- 172.21.15.60:0/755514198 >> v2:172.21.15.66:3300/0 conn(0x7fa22c0ab590 0x7fa22c13ed40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-10-31T22:47:01.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa22bfff700 1 -- 172.21.15.60:0/755514198 >> v1:172.21.15.66:6789/0 conn(0x7fa22c0aeaf0 legacy=0x7fa22c0ab970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:01.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa22bfff700 1 -- 172.21.15.60:0/755514198 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c13e8a0 con 0x7fa22c137f60 2020-10-31T22:47:01.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa22bfff700 1 --2- 172.21.15.60:0/755514198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c137f60 0x7fa22c138370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa2240032b0 tx=0x7fa2240091a0).ready entity=mon.2 client_cookie=45d3fc12a945a312 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:01.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa22a7fc700 1 -- 172.21.15.60:0/755514198 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa22400b9a0 con 0x7fa22c137f60 2020-10-31T22:47:01.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa22a7fc700 1 -- 172.21.15.60:0/755514198 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22400bb00 con 0x7fa22c137f60 2020-10-31T22:47:01.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa22a7fc700 1 -- 172.21.15.60:0/755514198 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa22400bcb0 con 0x7fa22c137f60 2020-10-31T22:47:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa231dc4700 1 -- 172.21.15.60:0/755514198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c137f60 msgr2=0x7fa22c138370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa231dc4700 1 --2- 172.21.15.60:0/755514198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c137f60 0x7fa22c138370 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fa2240032b0 tx=0x7fa2240091a0).stop 2020-10-31T22:47:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa231dc4700 1 -- 172.21.15.60:0/755514198 shutdown_connections 2020-10-31T22:47:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa231dc4700 1 --2- 172.21.15.60:0/755514198 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c137f60 0x7fa22c138370 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa231dc4700 1 --2- 172.21.15.60:0/755514198 >> v2:172.21.15.66:3300/0 conn(0x7fa22c0ab590 0x7fa22c13ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-10-31T22:47:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.224+0000 7fa231dc4700 1 -- 172.21.15.60:0/755514198 >> 172.21.15.60:0/755514198 conn(0x7fa22c06a260 msgr2=0x7fa22c061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa231dc4700 1 -- 172.21.15.60:0/755514198 shutdown_connections 2020-10-31T22:47:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa231dc4700 1 -- 172.21.15.60:0/755514198 wait complete. 2020-10-31T22:47:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa231dc4700 1 Processor -- start 2020-10-31T22:47:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa231dc4700 1 -- start start 2020-10-31T22:47:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa231dc4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa22c0ab590 0x7fa22c0b3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa231dc4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c0aeaf0 0x7fa22c13f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa231dc4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c137f60 0x7fa22c141cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa231dc4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0a9730 con 0x7fa22c0aeaf0 2020-10-31T22:47:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa231dc4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c141870 con 0x7fa22c0ab590 2020-10-31T22:47:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa231dc4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0a9cb0 con 0x7fa22c137f60 2020-10-31T22:47:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa22affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c0aeaf0 0x7fa22c13f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa22affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c0aeaf0 0x7fa22c13f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45208/0 (socket says 172.21.15.60:45208) 2020-10-31T22:47:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa22affd700 1 -- 172.21.15.60:0/2208893416 learned_addr learned my addr 172.21.15.60:0/2208893416 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa22bfff700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c137f60 0x7fa22c141cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:01.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa22b7fe700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa22c0ab590 0x7fa22c0b3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:01.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa22b7fe700 1 -- 172.21.15.60:0/2208893416 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c137f60 msgr2=0x7fa22c141cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:01.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa22b7fe700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c137f60 0x7fa22c141cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:01.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa22b7fe700 1 -- 172.21.15.60:0/2208893416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c0aeaf0 msgr2=0x7fa22c13f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:01.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa22b7fe700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c0aeaf0 0x7fa22c13f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:01.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa22b7fe700 1 -- 172.21.15.60:0/2208893416 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c142650 con 0x7fa22c0ab590 2020-10-31T22:47:01.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa22bfff700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c137f60 0x7fa22c141cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:47:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa22b7fe700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa22c0ab590 0x7fa22c0b3210 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fa22c140560 tx=0x7fa21c006c60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa228ff9700 1 -- 172.21.15.60:0/2208893416 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa21c012410 con 0x7fa22c0ab590 2020-10-31T22:47:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa228ff9700 1 -- 172.21.15.60:0/2208893416 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c012570 con 0x7fa22c0ab590 2020-10-31T22:47:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.228+0000 7fa228ff9700 1 -- 172.21.15.60:0/2208893416 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa21c0128d0 con 0x7fa22c0ab590 2020-10-31T22:47:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.232+0000 7fa231dc4700 1 -- 172.21.15.60:0/2208893416 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22c0a9a10 con 0x7fa22c0ab590 2020-10-31T22:47:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.232+0000 7fa231dc4700 1 -- 172.21.15.60:0/2208893416 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c0aae40 con 0x7fa22c0ab590 2020-10-31T22:47:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.232+0000 7fa231dc4700 1 -- 172.21.15.60:0/2208893416 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22c14cd00 con 0x7fa22c0ab590 2020-10-31T22:47:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.232+0000 7fa228ff9700 1 -- 172.21.15.60:0/2208893416 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa21c00f030 con 0x7fa22c0ab590 2020-10-31T22:47:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.232+0000 7fa228ff9700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa20c054f10 0x7fa20c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.232+0000 7fa228ff9700 1 -- 172.21.15.60:0/2208893416 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fa21c06d230 con 0x7fa22c0ab590 2020-10-31T22:47:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.232+0000 7fa22affd700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa20c054f10 0x7fa20c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.232+0000 7fa22affd700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa20c054f10 0x7fa20c0573d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fa22000d000 tx=0x7fa220009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:01.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.240+0000 7fa228ff9700 1 -- 172.21.15.60:0/2208893416 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa21c043a30 con 0x7fa22c0ab590 2020-10-31T22:47:01.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:01.392+0000 7fa231dc4700 1 -- 172.21.15.60:0/2208893416 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fa22c1419b0 con 0x7fa22c0ab590 2020-10-31T22:47:02.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.220+0000 7fa228ff9700 1 -- 172.21.15.60:0/2208893416 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v72) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa21c047050 con 0x7fa22c0ab590 2020-10-31T22:47:02.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.224+0000 7fa231dc4700 1 -- 172.21.15.60:0/2208893416 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa20c054f10 msgr2=0x7fa20c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:02.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.224+0000 7fa231dc4700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa20c054f10 0x7fa20c0573d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fa22000d000 tx=0x7fa220009040).stop 2020-10-31T22:47:02.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.224+0000 7fa231dc4700 1 -- 172.21.15.60:0/2208893416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa22c0ab590 msgr2=0x7fa22c0b3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:02.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.224+0000 7fa231dc4700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa22c0ab590 0x7fa22c0b3210 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fa22c140560 tx=0x7fa21c006c60).stop 2020-10-31T22:47:02.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.224+0000 7fa231dc4700 1 -- 172.21.15.60:0/2208893416 shutdown_connections 2020-10-31T22:47:02.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.224+0000 7fa231dc4700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c137f60 0x7fa22c141cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.224+0000 7fa231dc4700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa20c054f10 0x7fa20c0573d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.224+0000 7fa231dc4700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa22c0ab590 0x7fa22c0b3210 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.224+0000 7fa231dc4700 1 --2- 172.21.15.60:0/2208893416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c0aeaf0 0x7fa22c13f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.224+0000 7fa231dc4700 1 -- 172.21.15.60:0/2208893416 >> 172.21.15.60:0/2208893416 conn(0x7fa22c06a260 msgr2=0x7fa22c137710 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:02.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.224+0000 7fa231dc4700 1 -- 172.21.15.60:0/2208893416 shutdown_connections 2020-10-31T22:47:02.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.224+0000 7fa231dc4700 1 -- 172.21.15.60:0/2208893416 wait complete. 2020-10-31T22:47:02.227 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blacklist entries 2020-10-31T22:47:02.240 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2020-10-31T22:47:02.241 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-10-31T22:47:02.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f797359e700 1 Processor -- start 2020-10-31T22:47:02.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f797359e700 1 -- start start 2020-10-31T22:47:02.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f797359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79740b1bb0 0x7f797405c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:02.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f797359e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f79740ae630 0x7f797413ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:02.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f797359e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797405c800 con 0x7f797413f1b0 2020-10-31T22:47:02.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f797359e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797405c5e0 con 0x7f79740ae630 2020-10-31T22:47:02.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f797359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797413f630 con 0x7f79740b1bb0 2020-10-31T22:47:02.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f7971d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f79740ae630 0x7f797413ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:02.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f7971d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f79740ae630 0x7f797413ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45222/0 (socket says 172.21.15.60:45222) 2020-10-31T22:47:02.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f7971d9b700 1 -- 172.21.15.60:0/339414080 learned_addr learned my addr 172.21.15.60:0/339414080 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:02.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f797259c700 1 --2- 172.21.15.60:0/339414080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79740b1bb0 0x7f797405c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:02.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f7971d9b700 1 -- 172.21.15.60:0/339414080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79740b1bb0 msgr2=0x7f797405c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:02.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f7971d9b700 1 --2- 172.21.15.60:0/339414080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79740b1bb0 0x7f797405c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f7971d9b700 1 -- 172.21.15.60:0/339414080 >> v1:172.21.15.66:6789/0 conn(0x7f797413f1b0 legacy=0x7f79740b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:02.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f797159a700 1 -- 172.21.15.60:0/339414080 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695902109 0 0) 0x7f797405c800 con 0x7f797413f1b0 2020-10-31T22:47:02.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f7971d9b700 1 -- 172.21.15.60:0/339414080 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79740adc50 con 0x7f79740ae630 2020-10-31T22:47:02.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.356+0000 7f7971d9b700 1 --2- 172.21.15.60:0/339414080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79740ae630 0x7f797413ecc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f7968002f30 tx=0x7f7968006e80).ready entity=mon.0 client_cookie=ba35477796fb9b3c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:02.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797159a700 1 -- 172.21.15.60:0/339414080 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79680097f0 con 0x7f79740ae630 2020-10-31T22:47:02.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797159a700 1 -- 172.21.15.60:0/339414080 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7968009950 con 0x7f79740ae630 2020-10-31T22:47:02.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797159a700 1 -- 172.21.15.60:0/339414080 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7968009cb0 con 0x7f79740ae630 2020-10-31T22:47:02.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 -- 172.21.15.60:0/339414080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79740ae630 msgr2=0x7f797413ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:02.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 --2- 172.21.15.60:0/339414080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79740ae630 0x7f797413ecc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7f7968002f30 tx=0x7f7968006e80).stop 2020-10-31T22:47:02.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 -- 172.21.15.60:0/339414080 shutdown_connections 2020-10-31T22:47:02.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 --2- 172.21.15.60:0/339414080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79740b1bb0 0x7f797405c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 --2- 172.21.15.60:0/339414080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79740ae630 0x7f797413ecc0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 -- 172.21.15.60:0/339414080 >> 172.21.15.60:0/339414080 conn(0x7f79740b5300 msgr2=0x7f79740b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:02.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 -- 172.21.15.60:0/339414080 shutdown_connections 2020-10-31T22:47:02.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 -- 172.21.15.60:0/339414080 wait complete. 2020-10-31T22:47:02.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 Processor -- start 2020-10-31T22:47:02.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 -- start start 2020-10-31T22:47:02.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79740b1bb0 0x7f797405b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:02.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797413f1b0 0x7f7974151ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:02.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79740640f0 0x7f79741523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:02.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79740635d0 con 0x7f797413f1b0 2020-10-31T22:47:02.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7974065a20 con 0x7f79740640f0 2020-10-31T22:47:02.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.360+0000 7f797359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7974065cc0 con 0x7f79740b1bb0 2020-10-31T22:47:02.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f7971d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797413f1b0 0x7f7974151ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:02.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f7971d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797413f1b0 0x7f7974151ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45224/0 (socket says 172.21.15.60:45224) 2020-10-31T22:47:02.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f7971d9b700 1 -- 172.21.15.60:0/3789707650 learned_addr learned my addr 172.21.15.60:0/3789707650 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:02.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f7972d9d700 1 --2- 172.21.15.60:0/3789707650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79740640f0 0x7f79741523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:02.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f797259c700 1 --2- 172.21.15.60:0/3789707650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79740b1bb0 0x7f797405b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:02.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f7971d9b700 1 -- 172.21.15.60:0/3789707650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79740b1bb0 msgr2=0x7f797405b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:02.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f7971d9b700 1 --2- 172.21.15.60:0/3789707650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79740b1bb0 0x7f797405b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f7971d9b700 1 -- 172.21.15.60:0/3789707650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79740640f0 msgr2=0x7f79741523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:02.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f7971d9b700 1 --2- 172.21.15.60:0/3789707650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79740640f0 0x7f79741523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f7971d9b700 1 -- 172.21.15.60:0/3789707650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7974063800 con 0x7f797413f1b0 2020-10-31T22:47:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f7971d9b700 1 --2- 172.21.15.60:0/3789707650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797413f1b0 0x7f7974151ee0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f7968002f30 tx=0x7f7968015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f79637fe700 1 -- 172.21.15.60:0/3789707650 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7968011c30 con 0x7f797413f1b0 2020-10-31T22:47:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f79637fe700 1 -- 172.21.15.60:0/3789707650 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7968011d90 con 0x7f797413f1b0 2020-10-31T22:47:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f797359e700 1 -- 172.21.15.60:0/3789707650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7974064d60 con 0x7f797413f1b0 2020-10-31T22:47:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f79637fe700 1 -- 172.21.15.60:0/3789707650 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f796801e650 con 0x7f797413f1b0 2020-10-31T22:47:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f797359e700 1 -- 172.21.15.60:0/3789707650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79741528c0 con 0x7f797413f1b0 2020-10-31T22:47:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f797359e700 1 -- 172.21.15.60:0/3789707650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7974057100 con 0x7f797413f1b0 2020-10-31T22:47:02.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f79637fe700 1 -- 172.21.15.60:0/3789707650 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7968025030 con 0x7f797413f1b0 2020-10-31T22:47:02.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.364+0000 7f79637fe700 1 --2- 172.21.15.60:0/3789707650 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7950054f10 0x7f79500573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:02.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.368+0000 7f79637fe700 1 -- 172.21.15.60:0/3789707650 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f796806ea90 con 0x7f797413f1b0 2020-10-31T22:47:02.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.368+0000 7f797259c700 1 --2- 172.21.15.60:0/3789707650 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7950054f10 0x7f79500573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:02.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.368+0000 7f797259c700 1 --2- 172.21.15.60:0/3789707650 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7950054f10 0x7f79500573d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f796400b000 tx=0x7f7964006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:02.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.372+0000 7f79637fe700 1 -- 172.21.15.60:0/3789707650 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f79680452e0 con 0x7f797413f1b0 2020-10-31T22:47:02.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.560+0000 7f797359e700 1 -- 172.21.15.60:0/3789707650 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f79740b10e0 con 0x7f797413f1b0 2020-10-31T22:47:02.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.564+0000 7f79637fe700 1 -- 172.21.15.60:0/3789707650 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f7968048900 con 0x7f797413f1b0 2020-10-31T22:47:02.564 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:02.564 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:47:02.564 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2020-10-31T22:47:02.565 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.565 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2020-10-31T22:47:02.565 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f7D/cFRAAHQ9NU7VSs14mi5sC/GwHng==", 2020-10-31T22:47:02.565 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.565 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:47:02.565 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:47:02.565 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:47:02.566 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:47:02.566 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.566 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.566 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.566 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2020-10-31T22:47:02.566 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f5SPjJBAAVjFv2PdBZ7j94etJrAT0tA==", 2020-10-31T22:47:02.566 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.567 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:47:02.567 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:47:02.567 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:47:02.567 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:47:02.567 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.567 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.567 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.567 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2020-10-31T22:47:02.568 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKpdoHhAAhhlaYqOQoI6tTKexjRpbGA==", 2020-10-31T22:47:02.568 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.568 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:47:02.568 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:47:02.568 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:47:02.568 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:47:02.568 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.569 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.569 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.569 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2020-10-31T22:47:02.569 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDR551f7MwsMRAACZIQlAKm3BdVbDs2gQAfxg==", 2020-10-31T22:47:02.569 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.569 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:47:02.569 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:47:02.570 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:47:02.570 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.570 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.570 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.570 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2020-10-31T22:47:02.570 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDU551f07HQFxAAokMFXwsbgKGtJNpnKerdGg==", 2020-10-31T22:47:02.570 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.571 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:47:02.571 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:47:02.571 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:47:02.571 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.571 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.571 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.571 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2020-10-31T22:47:02.571 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDW551fODyjOhAAJ+j8KITJidSpltSiJaQZGw==", 2020-10-31T22:47:02.572 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.572 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:47:02.572 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:47:02.572 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:47:02.572 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.572 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.572 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.573 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2020-10-31T22:47:02.573 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDZ551fs+aCIhAAwpbmgGQjU05W3hZofTtHdg==", 2020-10-31T22:47:02.573 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.573 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:47:02.573 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:47:02.573 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:47:02.573 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.573 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.574 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.574 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2020-10-31T22:47:02.574 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDe551fI5nIMxAAwwNSHQYDPS6G2achKIpwqg==", 2020-10-31T22:47:02.574 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.574 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:47:02.574 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:47:02.574 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:47:02.575 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.575 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.575 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.575 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2020-10-31T22:47:02.575 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDh551f68p2GhAAhlGpZLPg8RqouzStqN4tFw==", 2020-10-31T22:47:02.575 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.575 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:47:02.576 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:47:02.576 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:47:02.576 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.576 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.576 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.576 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2020-10-31T22:47:02.576 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDk551fUi3kARAAsXPU7HEhqax8Go00CqgdNw==", 2020-10-31T22:47:02.576 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.577 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:47:02.577 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:47:02.577 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:47:02.577 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.577 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.577 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.577 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2020-10-31T22:47:02.578 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDm551fKh4aJRAAj+whV4kueCu2Og7wZ05tNw==", 2020-10-31T22:47:02.578 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.578 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:47:02.578 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:47:02.578 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:47:02.578 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.579 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.579 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2020-10-31T22:47:02.579 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551flXvBJxAAtD4URDL2NV0zyAympufvVA==", 2020-10-31T22:47:02.579 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.579 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:47:02.579 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:47:02.579 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:47:02.579 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.580 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.580 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2020-10-31T22:47:02.580 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fQ/OGKhAA/xGrRlUW52pP6E6SWXYAGA==", 2020-10-31T22:47:02.580 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.580 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:47:02.580 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:47:02.581 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:47:02.581 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.581 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.581 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2020-10-31T22:47:02.581 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDP551fITgCMxAAQy5CQzqda1YjdUtTRxbsPQ==", 2020-10-31T22:47:02.581 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.582 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:47:02.582 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:47:02.582 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:47:02.582 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:47:02.582 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.582 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.582 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2020-10-31T22:47:02.583 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551feZUgExAAvGt2fUb5GhkkFQ0dbgP5nw==", 2020-10-31T22:47:02.583 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.583 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:47:02.583 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:47:02.583 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:47:02.584 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:02.584 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:02.584 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2020-10-31T22:47:02.584 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKiN5EBAAhHtXXE4+yydXWOK7agZ14g==", 2020-10-31T22:47:02.584 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:47:02.584 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:47:02.584 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:47:02.585 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:47:02.585 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.585 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:02.585 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:47:02.585 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:47:02.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.564+0000 7f797359e700 1 -- 172.21.15.60:0/3789707650 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7950054f10 msgr2=0x7f79500573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.564+0000 7f797359e700 1 --2- 172.21.15.60:0/3789707650 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7950054f10 0x7f79500573d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f796400b000 tx=0x7f7964006dc0).stop 2020-10-31T22:47:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.564+0000 7f797359e700 1 -- 172.21.15.60:0/3789707650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797413f1b0 msgr2=0x7f7974151ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.564+0000 7f797359e700 1 --2- 172.21.15.60:0/3789707650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797413f1b0 0x7f7974151ee0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f7968002f30 tx=0x7f7968015000).stop 2020-10-31T22:47:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.564+0000 7f797359e700 1 -- 172.21.15.60:0/3789707650 shutdown_connections 2020-10-31T22:47:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.564+0000 7f797359e700 1 --2- 172.21.15.60:0/3789707650 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7950054f10 0x7f79500573d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.564+0000 7f797359e700 1 --2- 172.21.15.60:0/3789707650 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79740640f0 0x7f79741523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.564+0000 7f797359e700 1 --2- 172.21.15.60:0/3789707650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79740b1bb0 0x7f797405b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.564+0000 7f797359e700 1 --2- 172.21.15.60:0/3789707650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f797413f1b0 0x7f7974151ee0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.564+0000 7f797359e700 1 -- 172.21.15.60:0/3789707650 >> 172.21.15.60:0/3789707650 conn(0x7f79740b5300 msgr2=0x7f797413ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.564+0000 7f797359e700 1 -- 172.21.15.60:0/3789707650 shutdown_connections 2020-10-31T22:47:02.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.564+0000 7f797359e700 1 -- 172.21.15.60:0/3789707650 wait complete. 2020-10-31T22:47:02.589 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:47:02.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.700+0000 7fc9d495c700 1 Processor -- start 2020-10-31T22:47:02.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.700+0000 7fc9d495c700 1 -- start start 2020-10-31T22:47:02.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.700+0000 7fc9d495c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc9d0141c90 0x7fc9d013f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:02.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.700+0000 7fc9d495c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc9d00b0030 0x7fc9d013f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:02.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.700+0000 7fc9d495c700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d005b6f0 con 0x7fc9d00ae5b0 2020-10-31T22:47:02.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.700+0000 7fc9d495c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d0142210 con 0x7fc9d00b0030 2020-10-31T22:47:02.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.700+0000 7fc9d495c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d01424b0 con 0x7fc9d0141c90 2020-10-31T22:47:02.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9cf59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc9d00b0030 0x7fc9d013f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:02.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9cf59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc9d00b0030 0x7fc9d013f520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45236/0 (socket says 172.21.15.60:45236) 2020-10-31T22:47:02.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9cf59e700 1 -- 172.21.15.60:0/3238383158 learned_addr learned my addr 172.21.15.60:0/3238383158 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:02.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9ce59c700 1 --2- 172.21.15.60:0/3238383158 >> v2:172.21.15.66:3300/0 conn(0x7fc9d0141c90 0x7fc9d013f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:02.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9cf59e700 1 -- 172.21.15.60:0/3238383158 >> v2:172.21.15.66:3300/0 conn(0x7fc9d0141c90 msgr2=0x7fc9d013f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:02.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9cf59e700 1 --2- 172.21.15.60:0/3238383158 >> v2:172.21.15.66:3300/0 conn(0x7fc9d0141c90 0x7fc9d013f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9cf59e700 1 -- 172.21.15.60:0/3238383158 >> v1:172.21.15.66:6789/0 conn(0x7fc9d00ae5b0 legacy=0x7fc9d005afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:02.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9cf59e700 1 -- 172.21.15.60:0/3238383158 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d0142750 con 0x7fc9d00b0030 2020-10-31T22:47:02.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9ce59c700 1 --2- 172.21.15.60:0/3238383158 >> v2:172.21.15.66:3300/0 conn(0x7fc9d0141c90 0x7fc9d013f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:47:02.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9cf59e700 1 --2- 172.21.15.60:0/3238383158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d00b0030 0x7fc9d013f520 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fc9c80032b0 tx=0x7fc9c8009270).ready entity=mon.0 client_cookie=1bdea25efb71eab3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:02.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9cdd9b700 1 -- 172.21.15.60:0/3238383158 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c800bc00 con 0x7fc9d00b0030 2020-10-31T22:47:02.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9cdd9b700 1 -- 172.21.15.60:0/3238383158 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c800bd60 con 0x7fc9d00b0030 2020-10-31T22:47:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9cdd9b700 1 -- 172.21.15.60:0/3238383158 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c8011400 con 0x7fc9d00b0030 2020-10-31T22:47:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9d495c700 1 -- 172.21.15.60:0/3238383158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d00b0030 msgr2=0x7fc9d013f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9d495c700 1 --2- 172.21.15.60:0/3238383158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d00b0030 0x7fc9d013f520 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7fc9c80032b0 tx=0x7fc9c8009270).stop 2020-10-31T22:47:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9d495c700 1 -- 172.21.15.60:0/3238383158 shutdown_connections 2020-10-31T22:47:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9d495c700 1 --2- 172.21.15.60:0/3238383158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d00b0030 0x7fc9d013f520 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9d495c700 1 --2- 172.21.15.60:0/3238383158 >> v2:172.21.15.66:3300/0 conn(0x7fc9d0141c90 0x7fc9d013f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9d495c700 1 -- 172.21.15.60:0/3238383158 >> 172.21.15.60:0/3238383158 conn(0x7fc9d00b61d0 msgr2=0x7fc9d00b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:02.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9d495c700 1 -- 172.21.15.60:0/3238383158 shutdown_connections 2020-10-31T22:47:02.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9d495c700 1 -- 172.21.15.60:0/3238383158 wait complete. 2020-10-31T22:47:02.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9d495c700 1 Processor -- start 2020-10-31T22:47:02.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.704+0000 7fc9d495c700 1 -- start start 2020-10-31T22:47:02.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9d495c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9d00ae5b0 0x7fc9d00b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:02.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9d495c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc9d00b0030 0x7fc9d0145150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:02.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9d495c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0141c90 0x7fc9d0145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:02.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9d495c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d0144940 con 0x7fc9d0141c90 2020-10-31T22:47:02.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9d495c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d01480b0 con 0x7fc9d00ae5b0 2020-10-31T22:47:02.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9d495c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d0148350 con 0x7fc9d00b0030 2020-10-31T22:47:02.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9cf59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0141c90 0x7fc9d0145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9ce59c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc9d00b0030 0x7fc9d0145150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9ced9d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9d00ae5b0 0x7fc9d00b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9cf59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0141c90 0x7fc9d0145640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45242/0 (socket says 172.21.15.60:45242) 2020-10-31T22:47:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9cf59e700 1 -- 172.21.15.60:0/4108318081 learned_addr learned my addr 172.21.15.60:0/4108318081 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9cf59e700 1 -- 172.21.15.60:0/4108318081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc9d00b0030 msgr2=0x7fc9d0145150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:02.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9cf59e700 1 --2- 172.21.15.60:0/4108318081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc9d00b0030 0x7fc9d0145150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9cf59e700 1 -- 172.21.15.60:0/4108318081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9d00ae5b0 msgr2=0x7fc9d00b52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:02.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9cf59e700 1 --2- 172.21.15.60:0/4108318081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9d00ae5b0 0x7fc9d00b52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9cf59e700 1 -- 172.21.15.60:0/4108318081 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d01485f0 con 0x7fc9d0141c90 2020-10-31T22:47:02.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9cf59e700 1 --2- 172.21.15.60:0/4108318081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0141c90 0x7fc9d0145640 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fc9c80032b0 tx=0x7fc9c8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:02.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9bffff700 1 -- 172.21.15.60:0/4108318081 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c801f3f0 con 0x7fc9d0141c90 2020-10-31T22:47:02.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9bffff700 1 -- 172.21.15.60:0/4108318081 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c801f550 con 0x7fc9d0141c90 2020-10-31T22:47:02.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9bffff700 1 -- 172.21.15.60:0/4108318081 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc9c801f8b0 con 0x7fc9d0141c90 2020-10-31T22:47:02.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9d495c700 1 -- 172.21.15.60:0/4108318081 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d0148aa0 con 0x7fc9d0141c90 2020-10-31T22:47:02.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.708+0000 7fc9d495c700 1 -- 172.21.15.60:0/4108318081 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d0146060 con 0x7fc9d0141c90 2020-10-31T22:47:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.712+0000 7fc9d495c700 1 -- 172.21.15.60:0/4108318081 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d0148c30 con 0x7fc9d0141c90 2020-10-31T22:47:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.712+0000 7fc9bffff700 1 -- 172.21.15.60:0/4108318081 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc9c8026030 con 0x7fc9d0141c90 2020-10-31T22:47:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.712+0000 7fc9bffff700 1 --2- 172.21.15.60:0/4108318081 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc9ac055050 0x7fc9ac057510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.712+0000 7fc9bffff700 1 -- 172.21.15.60:0/4108318081 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc9c806e680 con 0x7fc9d0141c90 2020-10-31T22:47:02.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.712+0000 7fc9ced9d700 1 --2- 172.21.15.60:0/4108318081 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc9ac055050 0x7fc9ac057510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:02.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.716+0000 7fc9ced9d700 1 --2- 172.21.15.60:0/4108318081 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc9ac055050 0x7fc9ac057510 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fc9c400d000 tx=0x7fc9c4000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:02.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.720+0000 7fc9bffff700 1 -- 172.21.15.60:0/4108318081 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc9c8044ed0 con 0x7fc9d0141c90 2020-10-31T22:47:02.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.860+0000 7fc9d495c700 1 -- 172.21.15.60:0/4108318081 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9d01490e0 con 0x7fc9d0141c90 2020-10-31T22:47:02.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.864+0000 7fc9bffff700 1 -- 172.21.15.60:0/4108318081 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+13182 (secure 0 0 0) 0x7fc9c8024020 con 0x7fc9d0141c90 2020-10-31T22:47:02.865 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:02.865 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":72,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:47:02.211446+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":62,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:47:02.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.864+0000 7fc9d495c700 1 -- 172.21.15.60:0/4108318081 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc9ac055050 msgr2=0x7fc9ac057510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:02.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.864+0000 7fc9d495c700 1 --2- 172.21.15.60:0/4108318081 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc9ac055050 0x7fc9ac057510 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7fc9c400d000 tx=0x7fc9c4000b80).stop 2020-10-31T22:47:02.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.864+0000 7fc9d495c700 1 -- 172.21.15.60:0/4108318081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0141c90 msgr2=0x7fc9d0145640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:02.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.864+0000 7fc9d495c700 1 --2- 172.21.15.60:0/4108318081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0141c90 0x7fc9d0145640 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fc9c80032b0 tx=0x7fc9c8016000).stop 2020-10-31T22:47:02.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.864+0000 7fc9d495c700 1 -- 172.21.15.60:0/4108318081 shutdown_connections 2020-10-31T22:47:02.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.864+0000 7fc9d495c700 1 --2- 172.21.15.60:0/4108318081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc9d0141c90 0x7fc9d0145640 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.864+0000 7fc9d495c700 1 --2- 172.21.15.60:0/4108318081 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc9ac055050 0x7fc9ac057510 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.864+0000 7fc9d495c700 1 --2- 172.21.15.60:0/4108318081 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc9d00ae5b0 0x7fc9d00b52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.864+0000 7fc9d495c700 1 --2- 172.21.15.60:0/4108318081 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc9d00b0030 0x7fc9d0145150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:02.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.864+0000 7fc9d495c700 1 -- 172.21.15.60:0/4108318081 >> 172.21.15.60:0/4108318081 conn(0x7fc9d00b61d0 msgr2=0x7fc9d00b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:02.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.864+0000 7fc9d495c700 1 -- 172.21.15.60:0/4108318081 shutdown_connections 2020-10-31T22:47:02.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:02.864+0000 7fc9d495c700 1 -- 172.21.15.60:0/4108318081 wait complete. 2020-10-31T22:47:02.879 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-31T22:47:02.880 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:47:03.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb8612a700 1 Processor -- start 2020-10-31T22:47:03.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb8612a700 1 -- start start 2020-10-31T22:47:03.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb8612a700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbb80065f70 0x7fbb800b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb8612a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb800b2e20 0x7fbb80142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb8612a700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb80066410 con 0x7fbb8005c660 2020-10-31T22:47:03.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb8612a700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb80066d60 con 0x7fbb80065f70 2020-10-31T22:47:03.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb8612a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800b5e80 con 0x7fbb800b2e20 2020-10-31T22:47:03.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb7effd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbb80065f70 0x7fbb800b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb7ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb800b2e20 0x7fbb80142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb7f7fe700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fbb8005c660 0x7fbb8013f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:47250/0 (socket says 172.21.15.60:47250) 2020-10-31T22:47:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb7effd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbb80065f70 0x7fbb800b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:56184/0 (socket says 172.21.15.60:56184) 2020-10-31T22:47:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb7ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb800b2e20 0x7fbb80142610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:58438/0 (socket says 172.21.15.60:58438) 2020-10-31T22:47:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb7f7fe700 1 -- 172.21.15.60:0/1438247399 learned_addr learned my addr 172.21.15.60:0/1438247399 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb7effd700 1 -- 172.21.15.60:0/1438247399 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb800b2e20 msgr2=0x7fbb80142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.000+0000 7fbb7effd700 1 --2- 172.21.15.60:0/1438247399 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb800b2e20 0x7fbb80142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb7effd700 1 -- 172.21.15.60:0/1438247399 >> v1:172.21.15.66:6789/0 conn(0x7fbb8005c660 legacy=0x7fbb8013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb7effd700 1 -- 172.21.15.60:0/1438247399 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb800666b0 con 0x7fbb80065f70 2020-10-31T22:47:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb7e7fc700 1 -- 172.21.15.60:0/1438247399 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667106909 0 0) 0x7fbb80066410 con 0x7fbb8005c660 2020-10-31T22:47:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb7ffff700 1 --2- 172.21.15.60:0/1438247399 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb800b2e20 0x7fbb80142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:47:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb7effd700 1 --2- 172.21.15.60:0/1438247399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb80065f70 0x7fbb800b5990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fbb68002f30 tx=0x7fbb68006dc0).ready entity=mon.1 client_cookie=48944eabdf2212c4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb7e7fc700 1 -- 172.21.15.60:0/1438247399 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb68009760 con 0x7fbb80065f70 2020-10-31T22:47:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb7e7fc700 1 -- 172.21.15.60:0/1438247399 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb680098c0 con 0x7fbb80065f70 2020-10-31T22:47:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb7e7fc700 1 -- 172.21.15.60:0/1438247399 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb68009c20 con 0x7fbb80065f70 2020-10-31T22:47:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb8612a700 1 -- 172.21.15.60:0/1438247399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb80065f70 msgr2=0x7fbb800b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb8612a700 1 --2- 172.21.15.60:0/1438247399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb80065f70 0x7fbb800b5990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fbb68002f30 tx=0x7fbb68006dc0).stop 2020-10-31T22:47:03.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb8612a700 1 -- 172.21.15.60:0/1438247399 shutdown_connections 2020-10-31T22:47:03.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb8612a700 1 --2- 172.21.15.60:0/1438247399 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb800b2e20 0x7fbb80142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb8612a700 1 --2- 172.21.15.60:0/1438247399 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb80065f70 0x7fbb800b5990 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb8612a700 1 -- 172.21.15.60:0/1438247399 >> 172.21.15.60:0/1438247399 conn(0x7fbb800601e0 msgr2=0x7fbb8005b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:03.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb8612a700 1 -- 172.21.15.60:0/1438247399 shutdown_connections 2020-10-31T22:47:03.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb8612a700 1 -- 172.21.15.60:0/1438247399 wait complete. 2020-10-31T22:47:03.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb8612a700 1 Processor -- start 2020-10-31T22:47:03.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.004+0000 7fbb8612a700 1 -- start start 2020-10-31T22:47:03.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb8612a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb8005c660 0x7fbb80141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb8612a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb80065f70 0x7fbb8013d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb8612a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb800b2e20 0x7fbb8013dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb8612a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800ac500 con 0x7fbb80065f70 2020-10-31T22:47:03.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb8612a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800ac7a0 con 0x7fbb800b2e20 2020-10-31T22:47:03.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb8612a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800aca40 con 0x7fbb8005c660 2020-10-31T22:47:03.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb80065f70 0x7fbb8013d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb80065f70 0x7fbb8013d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45256/0 (socket says 172.21.15.60:45256) 2020-10-31T22:47:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7effd700 1 -- 172.21.15.60:0/3197515787 learned_addr learned my addr 172.21.15.60:0/3197515787 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7ffff700 1 --2- 172.21.15.60:0/3197515787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb800b2e20 0x7fbb8013dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7f7fe700 1 --2- 172.21.15.60:0/3197515787 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb8005c660 0x7fbb80141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7effd700 1 -- 172.21.15.60:0/3197515787 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb8005c660 msgr2=0x7fbb80141840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7effd700 1 --2- 172.21.15.60:0/3197515787 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb8005c660 0x7fbb80141840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7effd700 1 -- 172.21.15.60:0/3197515787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb800b2e20 msgr2=0x7fbb8013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7effd700 1 --2- 172.21.15.60:0/3197515787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb800b2e20 0x7fbb8013dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7effd700 1 -- 172.21.15.60:0/3197515787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8013e120 con 0x7fbb80065f70 2020-10-31T22:47:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7effd700 1 --2- 172.21.15.60:0/3197515787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb80065f70 0x7fbb8013d740 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fbb68002f30 tx=0x7fbb68015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7cff9700 1 -- 172.21.15.60:0/3197515787 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb68011a30 con 0x7fbb80065f70 2020-10-31T22:47:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7cff9700 1 -- 172.21.15.60:0/3197515787 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb68011b90 con 0x7fbb80065f70 2020-10-31T22:47:03.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb8612a700 1 -- 172.21.15.60:0/3197515787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb800b2660 con 0x7fbb80065f70 2020-10-31T22:47:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7cff9700 1 -- 172.21.15.60:0/3197515787 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb6801d440 con 0x7fbb80065f70 2020-10-31T22:47:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb8612a700 1 -- 172.21.15.60:0/3197515787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb800ae8f0 con 0x7fbb80065f70 2020-10-31T22:47:03.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7cff9700 1 -- 172.21.15.60:0/3197515787 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbb68024030 con 0x7fbb80065f70 2020-10-31T22:47:03.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb8612a700 1 -- 172.21.15.60:0/3197515787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb800ac360 con 0x7fbb80065f70 2020-10-31T22:47:03.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.008+0000 7fbb7cff9700 1 --2- 172.21.15.60:0/3197515787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb64054f10 0x7fbb640573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.012+0000 7fbb7f7fe700 1 --2- 172.21.15.60:0/3197515787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb64054f10 0x7fbb640573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.012+0000 7fbb7cff9700 1 -- 172.21.15.60:0/3197515787 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbb6806e4f0 con 0x7fbb80065f70 2020-10-31T22:47:03.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.012+0000 7fbb7f7fe700 1 --2- 172.21.15.60:0/3197515787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb64054f10 0x7fbb640573d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fbb7000d000 tx=0x7fbb70007930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:03.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.016+0000 7fbb7cff9700 1 -- 172.21.15.60:0/3197515787 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbb800ac360 con 0x7fbb80065f70 2020-10-31T22:47:03.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.160+0000 7fbb8612a700 1 -- 172.21.15.60:0/3197515787 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fbb800ac360 con 0x7fbb80065f70 2020-10-31T22:47:03.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.160+0000 7fbb7cff9700 1 -- 172.21.15.60:0/3197515787 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v72) v1 ==== 110+0+10 (secure 0 0 0) 0x7fbb800ac360 con 0x7fbb80065f70 2020-10-31T22:47:03.163 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:47:03.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.164+0000 7fbb8612a700 1 -- 172.21.15.60:0/3197515787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb64054f10 msgr2=0x7fbb640573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.164+0000 7fbb8612a700 1 --2- 172.21.15.60:0/3197515787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb64054f10 0x7fbb640573d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fbb7000d000 tx=0x7fbb70007930).stop 2020-10-31T22:47:03.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.164+0000 7fbb8612a700 1 -- 172.21.15.60:0/3197515787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb80065f70 msgr2=0x7fbb8013d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.164+0000 7fbb8612a700 1 --2- 172.21.15.60:0/3197515787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb80065f70 0x7fbb8013d740 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fbb68002f30 tx=0x7fbb68015000).stop 2020-10-31T22:47:03.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.164+0000 7fbb8612a700 1 -- 172.21.15.60:0/3197515787 shutdown_connections 2020-10-31T22:47:03.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.164+0000 7fbb8612a700 1 --2- 172.21.15.60:0/3197515787 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb64054f10 0x7fbb640573d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.164+0000 7fbb8612a700 1 --2- 172.21.15.60:0/3197515787 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb800b2e20 0x7fbb8013dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.164+0000 7fbb8612a700 1 --2- 172.21.15.60:0/3197515787 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb8005c660 0x7fbb80141840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.164+0000 7fbb8612a700 1 --2- 172.21.15.60:0/3197515787 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb80065f70 0x7fbb8013d740 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.164+0000 7fbb8612a700 1 -- 172.21.15.60:0/3197515787 >> 172.21.15.60:0/3197515787 conn(0x7fbb800601e0 msgr2=0x7fbb800b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:03.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.164+0000 7fbb8612a700 1 -- 172.21.15.60:0/3197515787 shutdown_connections 2020-10-31T22:47:03.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.164+0000 7fbb8612a700 1 -- 172.21.15.60:0/3197515787 wait complete. 2020-10-31T22:47:03.178 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:47:03.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.300+0000 7feea1d71700 1 Processor -- start 2020-10-31T22:47:03.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.300+0000 7feea1d71700 1 -- start start 2020-10-31T22:47:03.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fee9c0b1d50 0x7fee9c145c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee9c05c2d0 0x7fee9c05bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee9c0af410 0x7fee9c13f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9c0aef60 con 0x7fee9c05c2d0 2020-10-31T22:47:03.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9c0b2130 con 0x7fee9c0b1d50 2020-10-31T22:47:03.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c05afe0 con 0x7fee9c0af410 2020-10-31T22:47:03.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7fee93fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee9c05c2d0 0x7fee9c05bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7fee93fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee9c05c2d0 0x7fee9c05bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45262/0 (socket says 172.21.15.60:45262) 2020-10-31T22:47:03.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7fee93fff700 1 -- 172.21.15.60:0/405443070 learned_addr learned my addr 172.21.15.60:0/405443070 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:03.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea0d6f700 1 --2- 172.21.15.60:0/405443070 >> v2:172.21.15.66:3300/0 conn(0x7fee9c0b1d50 0x7fee9c145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1570700 1 --2- 172.21.15.60:0/405443070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee9c0af410 0x7fee9c13f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7fee93fff700 1 -- 172.21.15.60:0/405443070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee9c0af410 msgr2=0x7fee9c13f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:03.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7fee93fff700 1 --2- 172.21.15.60:0/405443070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee9c0af410 0x7fee9c13f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7fee93fff700 1 -- 172.21.15.60:0/405443070 >> v2:172.21.15.66:3300/0 conn(0x7fee9c0b1d50 msgr2=0x7fee9c145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:03.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7fee93fff700 1 --2- 172.21.15.60:0/405443070 >> v2:172.21.15.66:3300/0 conn(0x7fee9c0b1d50 0x7fee9c145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7fee93fff700 1 -- 172.21.15.60:0/405443070 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c05b280 con 0x7fee9c05c2d0 2020-10-31T22:47:03.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7fee93fff700 1 --2- 172.21.15.60:0/405443070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee9c05c2d0 0x7fee9c05bc60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fee8c002f30 tx=0x7fee8c006e80).ready entity=mon.0 client_cookie=53c4deb174de9055 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:03.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7fee937fe700 1 -- 172.21.15.60:0/405443070 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee8c009640 con 0x7fee9c05c2d0 2020-10-31T22:47:03.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7fee937fe700 1 -- 172.21.15.60:0/405443070 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c0097a0 con 0x7fee9c05c2d0 2020-10-31T22:47:03.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7fee937fe700 1 -- 172.21.15.60:0/405443070 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee8c009b00 con 0x7fee9c05c2d0 2020-10-31T22:47:03.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 -- 172.21.15.60:0/405443070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee9c05c2d0 msgr2=0x7fee9c05bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 --2- 172.21.15.60:0/405443070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee9c05c2d0 0x7fee9c05bc60 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7fee8c002f30 tx=0x7fee8c006e80).stop 2020-10-31T22:47:03.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 -- 172.21.15.60:0/405443070 shutdown_connections 2020-10-31T22:47:03.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 --2- 172.21.15.60:0/405443070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee9c0af410 0x7fee9c13f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 --2- 172.21.15.60:0/405443070 >> v2:172.21.15.66:3300/0 conn(0x7fee9c0b1d50 0x7fee9c145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 --2- 172.21.15.60:0/405443070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee9c05c2d0 0x7fee9c05bc60 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 -- 172.21.15.60:0/405443070 >> 172.21.15.60:0/405443070 conn(0x7fee9c0b5330 msgr2=0x7fee9c0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:03.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 -- 172.21.15.60:0/405443070 shutdown_connections 2020-10-31T22:47:03.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.304+0000 7feea1d71700 1 -- 172.21.15.60:0/405443070 wait complete. 2020-10-31T22:47:03.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1d71700 1 Processor -- start 2020-10-31T22:47:03.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1d71700 1 -- start start 2020-10-31T22:47:03.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1d71700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee9c05c2d0 0x7fee9c0ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1d71700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee9c0af410 0x7fee9c142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1d71700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee9c0b1d50 0x7fee9c1542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1d71700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c144db0 con 0x7fee9c0b1d50 2020-10-31T22:47:03.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1d71700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c140ab0 con 0x7fee9c05c2d0 2020-10-31T22:47:03.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1d71700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c144b10 con 0x7fee9c0af410 2020-10-31T22:47:03.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1570700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee9c0b1d50 0x7fee9c1542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1570700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee9c0b1d50 0x7fee9c1542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45270/0 (socket says 172.21.15.60:45270) 2020-10-31T22:47:03.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7fee93fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee9c0af410 0x7fee9c142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1570700 1 -- 172.21.15.60:0/11728443 learned_addr learned my addr 172.21.15.60:0/11728443 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:03.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea0d6f700 1 --2- 172.21.15.60:0/11728443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee9c05c2d0 0x7fee9c0ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1570700 1 -- 172.21.15.60:0/11728443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee9c0af410 msgr2=0x7fee9c142840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1570700 1 --2- 172.21.15.60:0/11728443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee9c0af410 0x7fee9c142840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1570700 1 -- 172.21.15.60:0/11728443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee9c05c2d0 msgr2=0x7fee9c0ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1570700 1 --2- 172.21.15.60:0/11728443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee9c05c2d0 0x7fee9c0ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1570700 1 -- 172.21.15.60:0/11728443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c140720 con 0x7fee9c0b1d50 2020-10-31T22:47:03.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1570700 1 --2- 172.21.15.60:0/11728443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee9c0b1d50 0x7fee9c1542e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fee94006a50 tx=0x7fee94006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:03.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7fee91ffb700 1 -- 172.21.15.60:0/11728443 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee9400ca10 con 0x7fee9c0b1d50 2020-10-31T22:47:03.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7fee91ffb700 1 -- 172.21.15.60:0/11728443 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9400cb70 con 0x7fee9c0b1d50 2020-10-31T22:47:03.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7fee91ffb700 1 -- 172.21.15.60:0/11728443 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee9400eeb0 con 0x7fee9c0b1d50 2020-10-31T22:47:03.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.308+0000 7feea1d71700 1 -- 172.21.15.60:0/11728443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9c0a84a0 con 0x7fee9c0b1d50 2020-10-31T22:47:03.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.312+0000 7feea1d71700 1 -- 172.21.15.60:0/11728443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9c1410c0 con 0x7fee9c0b1d50 2020-10-31T22:47:03.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.312+0000 7feea1d71700 1 -- 172.21.15.60:0/11728443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9c140910 con 0x7fee9c0b1d50 2020-10-31T22:47:03.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.312+0000 7fee91ffb700 1 -- 172.21.15.60:0/11728443 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fee9401c460 con 0x7fee9c0b1d50 2020-10-31T22:47:03.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.312+0000 7fee91ffb700 1 --2- 172.21.15.60:0/11728443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee7c054f10 0x7fee7c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.312+0000 7fee91ffb700 1 -- 172.21.15.60:0/11728443 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fee9406dbf0 con 0x7fee9c0b1d50 2020-10-31T22:47:03.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.312+0000 7feea0d6f700 1 --2- 172.21.15.60:0/11728443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee7c054f10 0x7fee7c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.312+0000 7feea0d6f700 1 --2- 172.21.15.60:0/11728443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee7c054f10 0x7fee7c0573d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fee9800b000 tx=0x7fee980091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:03.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.320+0000 7fee91ffb700 1 -- 172.21.15.60:0/11728443 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fee9c140910 con 0x7fee9c0b1d50 2020-10-31T22:47:03.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.464+0000 7feea1d71700 1 -- 172.21.15.60:0/11728443 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fee9c140910 con 0x7fee9c0b1d50 2020-10-31T22:47:03.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.464+0000 7fee91ffb700 1 -- 172.21.15.60:0/11728443 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v72) v1 ==== 92+0+10 (secure 0 0 0) 0x7fee9c140910 con 0x7fee9c0b1d50 2020-10-31T22:47:03.465 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:47:03.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.464+0000 7feea1d71700 1 -- 172.21.15.60:0/11728443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee7c054f10 msgr2=0x7fee7c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.464+0000 7feea1d71700 1 --2- 172.21.15.60:0/11728443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee7c054f10 0x7fee7c0573d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fee9800b000 tx=0x7fee980091a0).stop 2020-10-31T22:47:03.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.464+0000 7feea1d71700 1 -- 172.21.15.60:0/11728443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee9c0b1d50 msgr2=0x7fee9c1542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.464+0000 7feea1d71700 1 --2- 172.21.15.60:0/11728443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee9c0b1d50 0x7fee9c1542e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7fee94006a50 tx=0x7fee94006dc0).stop 2020-10-31T22:47:03.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.464+0000 7feea1d71700 1 -- 172.21.15.60:0/11728443 shutdown_connections 2020-10-31T22:47:03.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.464+0000 7feea1d71700 1 --2- 172.21.15.60:0/11728443 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee9c0b1d50 0x7fee9c1542e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.464+0000 7feea1d71700 1 --2- 172.21.15.60:0/11728443 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee7c054f10 0x7fee7c0573d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.464+0000 7feea1d71700 1 --2- 172.21.15.60:0/11728443 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee9c05c2d0 0x7fee9c0ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.464+0000 7feea1d71700 1 --2- 172.21.15.60:0/11728443 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee9c0af410 0x7fee9c142840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.464+0000 7feea1d71700 1 -- 172.21.15.60:0/11728443 >> 172.21.15.60:0/11728443 conn(0x7fee9c0b5330 msgr2=0x7fee9c0b3a60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:03.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.464+0000 7feea1d71700 1 -- 172.21.15.60:0/11728443 shutdown_connections 2020-10-31T22:47:03.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.464+0000 7feea1d71700 1 -- 172.21.15.60:0/11728443 wait complete. 2020-10-31T22:47:03.479 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-10-31T22:47:03.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.592+0000 7f113f59e700 1 Processor -- start 2020-10-31T22:47:03.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.592+0000 7f113f59e700 1 -- start start 2020-10-31T22:47:03.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.592+0000 7f113f59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11400ac870 0x7f11400b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.592+0000 7f113f59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400acc50 con 0x7f11400ae8b0 2020-10-31T22:47:03.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.592+0000 7f113f59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11400b5690 con 0x7f11400b0e20 2020-10-31T22:47:03.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.592+0000 7f113f59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11400b14c0 con 0x7f11400ac870 2020-10-31T22:47:03.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.592+0000 7f113ed9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f11400ae8b0 0x7f11401412e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49414/0 (socket says 172.21.15.60:49414) 2020-10-31T22:47:03.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.592+0000 7f113ed9d700 1 -- 172.21.15.60:0/3143721685 learned_addr learned my addr 172.21.15.60:0/3143721685 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:03.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.592+0000 7f113e59c700 1 --2- 172.21.15.60:0/3143721685 >> v2:172.21.15.60:3300/0 conn(0x7f11400ac870 0x7f11400b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113d59a700 1 -- 172.21.15.60:0/3143721685 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906051296 0 0) 0x7f11400acc50 con 0x7f11400ae8b0 2020-10-31T22:47:03.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113e59c700 1 -- 172.21.15.60:0/3143721685 >> v1:172.21.15.66:6789/0 conn(0x7f11400b0e20 legacy=0x7f11400ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113e59c700 1 -- 172.21.15.60:0/3143721685 >> v1:172.21.15.60:6789/0 conn(0x7f11400ae8b0 legacy=0x7f11401412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113e59c700 1 -- 172.21.15.60:0/3143721685 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11400afc10 con 0x7f11400ac870 2020-10-31T22:47:03.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113e59c700 1 --2- 172.21.15.60:0/3143721685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11400ac870 0x7f11400b5060 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f1130002f30 tx=0x7f1130006dc0).ready entity=mon.0 client_cookie=a6a4493a3cf890e3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:03.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113d59a700 1 -- 172.21.15.60:0/3143721685 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1130009880 con 0x7f11400ac870 2020-10-31T22:47:03.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113d59a700 1 -- 172.21.15.60:0/3143721685 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11300099e0 con 0x7f11400ac870 2020-10-31T22:47:03.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113d59a700 1 -- 172.21.15.60:0/3143721685 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1130009d40 con 0x7f11400ac870 2020-10-31T22:47:03.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113f59e700 1 -- 172.21.15.60:0/3143721685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11400ac870 msgr2=0x7f11400b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113f59e700 1 --2- 172.21.15.60:0/3143721685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11400ac870 0x7f11400b5060 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7f1130002f30 tx=0x7f1130006dc0).stop 2020-10-31T22:47:03.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113f59e700 1 -- 172.21.15.60:0/3143721685 shutdown_connections 2020-10-31T22:47:03.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113f59e700 1 --2- 172.21.15.60:0/3143721685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11400ac870 0x7f11400b5060 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113f59e700 1 -- 172.21.15.60:0/3143721685 >> 172.21.15.60:0/3143721685 conn(0x7f114006a600 msgr2=0x7f1140060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:03.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113f59e700 1 -- 172.21.15.60:0/3143721685 shutdown_connections 2020-10-31T22:47:03.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.596+0000 7f113f59e700 1 -- 172.21.15.60:0/3143721685 wait complete. 2020-10-31T22:47:03.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113f59e700 1 Processor -- start 2020-10-31T22:47:03.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113f59e700 1 -- start start 2020-10-31T22:47:03.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113f59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11400ac870 0x7f114009e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11400ae8b0 0x7f114005b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113f59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11400b0e20 0x7f114009fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114014f6f0 con 0x7f11400ae8b0 2020-10-31T22:47:03.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113f59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1140145560 con 0x7f11400ac870 2020-10-31T22:47:03.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113f59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1140145800 con 0x7f11400b0e20 2020-10-31T22:47:03.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11400ae8b0 0x7f114005b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11400ae8b0 0x7f114005b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45282/0 (socket says 172.21.15.60:45282) 2020-10-31T22:47:03.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113dd9b700 1 -- 172.21.15.60:0/3476075711 learned_addr learned my addr 172.21.15.60:0/3476075711 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:03.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113e59c700 1 --2- 172.21.15.60:0/3476075711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11400ac870 0x7f114009e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113ed9d700 1 --2- 172.21.15.60:0/3476075711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11400b0e20 0x7f114009fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113dd9b700 1 -- 172.21.15.60:0/3476075711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11400b0e20 msgr2=0x7f114009fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113dd9b700 1 --2- 172.21.15.60:0/3476075711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11400b0e20 0x7f114009fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113dd9b700 1 -- 172.21.15.60:0/3476075711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11400ac870 msgr2=0x7f114009e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.600+0000 7f113dd9b700 1 --2- 172.21.15.60:0/3476075711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11400ac870 0x7f114009e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.604+0000 7f113dd9b700 1 -- 172.21.15.60:0/3476075711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1140145aa0 con 0x7f11400ae8b0 2020-10-31T22:47:03.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.604+0000 7f113dd9b700 1 --2- 172.21.15.60:0/3476075711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11400ae8b0 0x7f114005b320 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f1140062fc0 tx=0x7f1128007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:03.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.604+0000 7f11377fe700 1 -- 172.21.15.60:0/3476075711 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1128007240 con 0x7f11400ae8b0 2020-10-31T22:47:03.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.604+0000 7f11377fe700 1 -- 172.21.15.60:0/3476075711 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11280073a0 con 0x7f11400ae8b0 2020-10-31T22:47:03.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.604+0000 7f11377fe700 1 -- 172.21.15.60:0/3476075711 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11280064e0 con 0x7f11400ae8b0 2020-10-31T22:47:03.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.604+0000 7f113f59e700 1 -- 172.21.15.60:0/3476075711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1140145d40 con 0x7f11400ae8b0 2020-10-31T22:47:03.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.604+0000 7f113f59e700 1 -- 172.21.15.60:0/3476075711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f114014e9b0 con 0x7f11400ae8b0 2020-10-31T22:47:03.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.604+0000 7f113f59e700 1 -- 172.21.15.60:0/3476075711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1140057100 con 0x7f11400ae8b0 2020-10-31T22:47:03.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.604+0000 7f11377fe700 1 -- 172.21.15.60:0/3476075711 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1128010070 con 0x7f11400ae8b0 2020-10-31T22:47:03.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.604+0000 7f11377fe700 1 --2- 172.21.15.60:0/3476075711 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1124054f10 0x7f11240573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.604+0000 7f11377fe700 1 -- 172.21.15.60:0/3476075711 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f112806ccb0 con 0x7f11400ae8b0 2020-10-31T22:47:03.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.604+0000 7f113e59c700 1 --2- 172.21.15.60:0/3476075711 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1124054f10 0x7f11240573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.604+0000 7f113e59c700 1 --2- 172.21.15.60:0/3476075711 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1124054f10 0x7f11240573d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f113001b000 tx=0x7f1130015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:03.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.612+0000 7f11377fe700 1 -- 172.21.15.60:0/3476075711 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f11280433f0 con 0x7f11400ae8b0 2020-10-31T22:47:03.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.760+0000 7f113f59e700 1 -- 172.21.15.60:0/3476075711 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f114005ed50 con 0x7f11400ae8b0 2020-10-31T22:47:03.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.760+0000 7f11377fe700 1 -- 172.21.15.60:0/3476075711 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) v1 ==== 84+0+143 (secure 0 0 0) 0x7f1128018020 con 0x7f11400ae8b0 2020-10-31T22:47:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:03.763 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2020-10-31T22:47:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2020-10-31T22:47:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "device_health_metrics" 2020-10-31T22:47:03.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:47:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:47:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2020-10-31T22:47:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2020-10-31T22:47:03.764 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:47:03.764 INFO:teuthology.orchestra.run.smithi060.stdout:] 2020-10-31T22:47:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.764+0000 7f113f59e700 1 -- 172.21.15.60:0/3476075711 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1124054f10 msgr2=0x7f11240573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.764+0000 7f113f59e700 1 --2- 172.21.15.60:0/3476075711 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1124054f10 0x7f11240573d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f113001b000 tx=0x7f1130015000).stop 2020-10-31T22:47:03.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.764+0000 7f113f59e700 1 -- 172.21.15.60:0/3476075711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11400ae8b0 msgr2=0x7f114005b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.764+0000 7f113f59e700 1 --2- 172.21.15.60:0/3476075711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11400ae8b0 0x7f114005b320 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f1140062fc0 tx=0x7f1128007be0).stop 2020-10-31T22:47:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.764+0000 7f113f59e700 1 -- 172.21.15.60:0/3476075711 shutdown_connections 2020-10-31T22:47:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.764+0000 7f113f59e700 1 --2- 172.21.15.60:0/3476075711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11400b0e20 0x7f114009fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.764+0000 7f113f59e700 1 --2- 172.21.15.60:0/3476075711 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1124054f10 0x7f11240573d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.764+0000 7f113f59e700 1 --2- 172.21.15.60:0/3476075711 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11400ac870 0x7f114009e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.764+0000 7f113f59e700 1 --2- 172.21.15.60:0/3476075711 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11400ae8b0 0x7f114005b320 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.764+0000 7f113f59e700 1 -- 172.21.15.60:0/3476075711 >> 172.21.15.60:0/3476075711 conn(0x7f114006a600 msgr2=0x7f1140060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.764+0000 7f113f59e700 1 -- 172.21.15.60:0/3476075711 shutdown_connections 2020-10-31T22:47:03.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.764+0000 7f113f59e700 1 -- 172.21.15.60:0/3476075711 wait complete. 2020-10-31T22:47:03.782 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-10-31T22:47:03.783 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:47:03.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a62dd700 1 Processor -- start 2020-10-31T22:47:03.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a62dd700 1 -- start start 2020-10-31T22:47:03.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a62dd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35a00b24a0 0x7f35a00b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a62dd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f35a0141f00 0x7f35a0142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a62dd700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a00b4440 con 0x7f35a00b5570 2020-10-31T22:47:03.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a62dd700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a013f930 con 0x7f35a0141f00 2020-10-31T22:47:03.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a62dd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0146060 con 0x7f35a00b24a0 2020-10-31T22:47:03.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a5adc700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f35a0141f00 0x7f35a0142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a52db700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f35a00b5570 0x7f35a0145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:47292/0 (socket says 172.21.15.60:47292) 2020-10-31T22:47:03.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a5adc700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f35a0141f00 0x7f35a0142390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:56226/0 (socket says 172.21.15.60:56226) 2020-10-31T22:47:03.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a4ada700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35a00b24a0 0x7f35a00b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a52db700 1 -- 172.21.15.60:0/1435417428 learned_addr learned my addr 172.21.15.60:0/1435417428 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:03.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a5adc700 1 -- 172.21.15.60:0/1435417428 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35a00b24a0 msgr2=0x7f35a00b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:03.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a5adc700 1 --2- 172.21.15.60:0/1435417428 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35a00b24a0 0x7f35a00b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a5adc700 1 -- 172.21.15.60:0/1435417428 >> v1:172.21.15.66:6789/0 conn(0x7f35a00b5570 legacy=0x7f35a0145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a5adc700 1 -- 172.21.15.60:0/1435417428 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a00b02f0 con 0x7f35a0141f00 2020-10-31T22:47:03.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a5adc700 1 --2- 172.21.15.60:0/1435417428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35a0141f00 0x7f35a0142390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f35980032b0 tx=0x7f35980091a0).ready entity=mon.1 client_cookie=62331a0c091b5871 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:03.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f3597fff700 1 -- 172.21.15.60:0/1435417428 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f359800b9a0 con 0x7f35a0141f00 2020-10-31T22:47:03.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f3597fff700 1 -- 172.21.15.60:0/1435417428 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359800bb00 con 0x7f35a0141f00 2020-10-31T22:47:03.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a62dd700 1 -- 172.21.15.60:0/1435417428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35a0141f00 msgr2=0x7f35a0142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f3597fff700 1 -- 172.21.15.60:0/1435417428 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f359800bc70 con 0x7f35a0141f00 2020-10-31T22:47:03.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a62dd700 1 --2- 172.21.15.60:0/1435417428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35a0141f00 0x7f35a0142390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f35980032b0 tx=0x7f35980091a0).stop 2020-10-31T22:47:03.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a62dd700 1 -- 172.21.15.60:0/1435417428 shutdown_connections 2020-10-31T22:47:03.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a62dd700 1 --2- 172.21.15.60:0/1435417428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35a0141f00 0x7f35a0142390 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a62dd700 1 --2- 172.21.15.60:0/1435417428 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35a00b24a0 0x7f35a00b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.900+0000 7f35a62dd700 1 -- 172.21.15.60:0/1435417428 >> 172.21.15.60:0/1435417428 conn(0x7f35a00b8e90 msgr2=0x7f35a00b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:03.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a62dd700 1 -- 172.21.15.60:0/1435417428 shutdown_connections 2020-10-31T22:47:03.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a62dd700 1 -- 172.21.15.60:0/1435417428 wait complete. 2020-10-31T22:47:03.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a62dd700 1 Processor -- start 2020-10-31T22:47:03.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a62dd700 1 -- start start 2020-10-31T22:47:03.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a62dd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35a00b24a0 0x7f35a00adac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a62dd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a00b5570 0x7f35a01540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a62dd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35a0141f00 0x7f35a01545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a62dd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0141bc0 con 0x7f35a00b5570 2020-10-31T22:47:03.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a62dd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0143420 con 0x7f35a00b24a0 2020-10-31T22:47:03.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a62dd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a0143b40 con 0x7f35a0141f00 2020-10-31T22:47:03.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a4ada700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a00b5570 0x7f35a01540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a5adc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35a0141f00 0x7f35a01545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a4ada700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a00b5570 0x7f35a01540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45296/0 (socket says 172.21.15.60:45296) 2020-10-31T22:47:03.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a4ada700 1 -- 172.21.15.60:0/3414136942 learned_addr learned my addr 172.21.15.60:0/3414136942 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:03.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a52db700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35a00b24a0 0x7f35a00adac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a5adc700 1 -- 172.21.15.60:0/3414136942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35a00b24a0 msgr2=0x7f35a00adac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a5adc700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35a00b24a0 0x7f35a00adac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a5adc700 1 -- 172.21.15.60:0/3414136942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a00b5570 msgr2=0x7f35a01540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:03.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a5adc700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a00b5570 0x7f35a01540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:03.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a5adc700 1 -- 172.21.15.60:0/3414136942 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a0143da0 con 0x7f35a0141f00 2020-10-31T22:47:03.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a52db700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35a00b24a0 0x7f35a00adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:47:03.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.904+0000 7f35a4ada700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a00b5570 0x7f35a01540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:47:03.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.908+0000 7f35a5adc700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35a0141f00 0x7f35a01545b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f35a00ac820 tx=0x7f3598016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:03.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.908+0000 7f35967fc700 1 -- 172.21.15.60:0/3414136942 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3598020400 con 0x7f35a0141f00 2020-10-31T22:47:03.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.908+0000 7f35967fc700 1 -- 172.21.15.60:0/3414136942 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3598020560 con 0x7f35a0141f00 2020-10-31T22:47:03.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.908+0000 7f35a62dd700 1 -- 172.21.15.60:0/3414136942 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a0143650 con 0x7f35a0141f00 2020-10-31T22:47:03.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.908+0000 7f35967fc700 1 -- 172.21.15.60:0/3414136942 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35980208c0 con 0x7f35a0141f00 2020-10-31T22:47:03.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.908+0000 7f35a62dd700 1 -- 172.21.15.60:0/3414136942 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a0145360 con 0x7f35a0141f00 2020-10-31T22:47:03.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.908+0000 7f35a62dd700 1 -- 172.21.15.60:0/3414136942 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a0057100 con 0x7f35a0141f00 2020-10-31T22:47:03.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.908+0000 7f35967fc700 1 -- 172.21.15.60:0/3414136942 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3598027030 con 0x7f35a0141f00 2020-10-31T22:47:03.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.908+0000 7f35967fc700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3588054f90 0x7f3588057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:03.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.908+0000 7f35967fc700 1 -- 172.21.15.60:0/3414136942 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f359806e730 con 0x7f35a0141f00 2020-10-31T22:47:03.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.908+0000 7f35a52db700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3588054f90 0x7f3588057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:03.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.908+0000 7f35a52db700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3588054f90 0x7f3588057450 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f359c00d000 tx=0x7f359c007ac0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:03.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:03.920+0000 7f35967fc700 1 -- 172.21.15.60:0/3414136942 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3598044f80 con 0x7f35a0141f00 2020-10-31T22:47:04.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:04.064+0000 7f35a62dd700 1 -- 172.21.15.60:0/3414136942 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f35a0143f30 con 0x7f35a0141f00 2020-10-31T22:47:05.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.060+0000 7f35967fc700 1 -- 172.21.15.60:0/3414136942 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v73) v1 ==== 133+0+0 (secure 0 0 0) 0x7f3598025020 con 0x7f35a0141f00 2020-10-31T22:47:05.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.060+0000 7f35a62dd700 1 -- 172.21.15.60:0/3414136942 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3588054f90 msgr2=0x7f3588057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:05.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.060+0000 7f35a62dd700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3588054f90 0x7f3588057450 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f359c00d000 tx=0x7f359c007ac0).stop 2020-10-31T22:47:05.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.060+0000 7f35a62dd700 1 -- 172.21.15.60:0/3414136942 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35a0141f00 msgr2=0x7f35a01545b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:05.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.060+0000 7f35a62dd700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35a0141f00 0x7f35a01545b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f35a00ac820 tx=0x7f3598016000).stop 2020-10-31T22:47:05.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.060+0000 7f35a62dd700 1 -- 172.21.15.60:0/3414136942 shutdown_connections 2020-10-31T22:47:05.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.064+0000 7f35a62dd700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f35a0141f00 0x7f35a01545b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:05.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.064+0000 7f35a62dd700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3588054f90 0x7f3588057450 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:05.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.064+0000 7f35a62dd700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35a00b24a0 0x7f35a00adac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:05.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.064+0000 7f35a62dd700 1 --2- 172.21.15.60:0/3414136942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35a00b5570 0x7f35a01540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:05.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.064+0000 7f35a62dd700 1 -- 172.21.15.60:0/3414136942 >> 172.21.15.60:0/3414136942 conn(0x7f35a00b8e90 msgr2=0x7f35a00b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:05.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.064+0000 7f35a62dd700 1 -- 172.21.15.60:0/3414136942 shutdown_connections 2020-10-31T22:47:05.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.064+0000 7f35a62dd700 1 -- 172.21.15.60:0/3414136942 wait complete. 2020-10-31T22:47:05.067 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:47:05.079 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-10-31T22:47:05.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.200+0000 7fd7f2da6700 1 Processor -- start 2020-10-31T22:47:05.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.200+0000 7fd7f2da6700 1 -- start start 2020-10-31T22:47:05.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f2da6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0aeb60 0x7fd7ec1420e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:05.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f2da6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec0b2130 con 0x7fd7ec0b1d50 2020-10-31T22:47:05.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f2da6700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7ec0af3f0 con 0x7fd7ec0afc50 2020-10-31T22:47:05.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f2da6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec0af200 con 0x7fd7ec0aeb60 2020-10-31T22:47:05.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f1da4700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd7ec0b1d50 0x7fd7ec13e7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49438/0 (socket says 172.21.15.60:49438) 2020-10-31T22:47:05.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f1da4700 1 -- 172.21.15.60:0/2922738141 learned_addr learned my addr 172.21.15.60:0/2922738141 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:05.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f25a5700 1 --2- 172.21.15.60:0/2922738141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0aeb60 0x7fd7ec1420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:05.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 799469879 0 0) 0x7fd7ec0b2130 con 0x7fd7ec0b1d50 2020-10-31T22:47:05.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7d4003230 con 0x7fd7ec0b1d50 2020-10-31T22:47:05.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770111947 0 0) 0x7fd7ec0af3f0 con 0x7fd7ec0afc50 2020-10-31T22:47:05.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ec0b2130 con 0x7fd7ec0afc50 2020-10-31T22:47:05.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2369193752 0 0) 0x7fd7d4003230 con 0x7fd7ec0b1d50 2020-10-31T22:47:05.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0aeb60 msgr2=0x7fd7ec1420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:05.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 --2- 172.21.15.60:0/2922738141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0aeb60 0x7fd7ec1420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:05.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 >> v1:172.21.15.66:6789/0 conn(0x7fd7ec0afc50 legacy=0x7fd7ec0ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:05.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec0af690 con 0x7fd7ec0b1d50 2020-10-31T22:47:05.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fd7e8001a50 con 0x7fd7ec0b1d50 2020-10-31T22:47:05.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f25a5700 1 --2- 172.21.15.60:0/2922738141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0aeb60 0x7fd7ec1420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:47:05.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 >> v1:172.21.15.60:6789/0 conn(0x7fd7ec0b1d50 legacy=0x7fd7ec13e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:05.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 --2- 172.21.15.60:0/2922738141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7d40038e0 0x7fd7d4003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:05.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 --2- 172.21.15.60:0/2922738141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0aeb60 0x7fd7d40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:05.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 --2- 172.21.15.60:0/2922738141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7d40049c0 0x7fd7d4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:05.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d4005330 con 0x7fd7d40049c0 2020-10-31T22:47:05.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d400b720 con 0x7fd7d40038e0 2020-10-31T22:47:05.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d400b8b0 con 0x7fd7ec0aeb60 2020-10-31T22:47:05.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f25a5700 1 --2- 172.21.15.60:0/2922738141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7d40049c0 0x7fd7d4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:05.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f1da4700 1 --2- 172.21.15.60:0/2922738141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7d40038e0 0x7fd7d4003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:05.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f15a3700 1 --2- 172.21.15.60:0/2922738141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0aeb60 0x7fd7d40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:05.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f25a5700 1 -- 172.21.15.60:0/2922738141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0aeb60 msgr2=0x7fd7d40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:05.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f25a5700 1 --2- 172.21.15.60:0/2922738141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0aeb60 0x7fd7d40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f25a5700 1 -- 172.21.15.60:0/2922738141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7d40038e0 msgr2=0x7fd7d4003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f25a5700 1 --2- 172.21.15.60:0/2922738141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7d40038e0 0x7fd7d4003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f25a5700 1 -- 172.21.15.60:0/2922738141 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d4003230 con 0x7fd7d40049c0 2020-10-31T22:47:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f15a3700 1 --2- 172.21.15.60:0/2922738141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0aeb60 0x7fd7d40044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:47:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f25a5700 1 --2- 172.21.15.60:0/2922738141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7d40049c0 0x7fd7d4004e40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fd7d40054a0 tx=0x7fd7e4008040).ready entity=mon.0 client_cookie=fac08cf603ce7474 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e400ee20 con 0x7fd7d40049c0 2020-10-31T22:47:05.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e400b4c0 con 0x7fd7d40049c0 2020-10-31T22:47:05.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f0da2700 1 -- 172.21.15.60:0/2922738141 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7e4012650 con 0x7fd7d40049c0 2020-10-31T22:47:05.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f2da6700 1 -- 172.21.15.60:0/2922738141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7d40049c0 msgr2=0x7fd7d4004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:05.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f2da6700 1 --2- 172.21.15.60:0/2922738141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7d40049c0 0x7fd7d4004e40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7fd7d40054a0 tx=0x7fd7e4008040).stop 2020-10-31T22:47:05.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f25a5700 1 -- 172.21.15.60:0/2922738141 reap_dead start 2020-10-31T22:47:05.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f2da6700 1 -- 172.21.15.60:0/2922738141 shutdown_connections 2020-10-31T22:47:05.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f2da6700 1 -- 172.21.15.60:0/2922738141 >> 172.21.15.60:0/2922738141 conn(0x7fd7ec0b5330 msgr2=0x7fd7ec0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:05.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f2da6700 1 -- 172.21.15.60:0/2922738141 shutdown_connections 2020-10-31T22:47:05.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.204+0000 7fd7f2da6700 1 -- 172.21.15.60:0/2922738141 wait complete. 2020-10-31T22:47:05.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f2da6700 1 Processor -- start 2020-10-31T22:47:05.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f2da6700 1 -- start start 2020-10-31T22:47:05.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f2da6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7ec13cdc0 0x7fd7ec0aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:05.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f2da6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec138850 0x7fd7ec0aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:05.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f2da6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0a8670 0x7fd7ec0a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:05.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f2da6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec138ec0 con 0x7fd7ec138850 2020-10-31T22:47:05.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f2da6700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec13d1a0 con 0x7fd7ec13cdc0 2020-10-31T22:47:05.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f2da6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ec1390f0 con 0x7fd7ec0a8670 2020-10-31T22:47:05.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f15a3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec138850 0x7fd7ec0aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:05.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f15a3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec138850 0x7fd7ec0aafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45316/0 (socket says 172.21.15.60:45316) 2020-10-31T22:47:05.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f15a3700 1 -- 172.21.15.60:0/977537763 learned_addr learned my addr 172.21.15.60:0/977537763 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:05.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f1da4700 1 --2- 172.21.15.60:0/977537763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7ec13cdc0 0x7fd7ec0aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:05.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f25a5700 1 --2- 172.21.15.60:0/977537763 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0a8670 0x7fd7ec0a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:05.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f15a3700 1 -- 172.21.15.60:0/977537763 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0a8670 msgr2=0x7fd7ec0a8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:05.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f15a3700 1 --2- 172.21.15.60:0/977537763 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0a8670 0x7fd7ec0a8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:05.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f15a3700 1 -- 172.21.15.60:0/977537763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7ec13cdc0 msgr2=0x7fd7ec0aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:05.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f15a3700 1 --2- 172.21.15.60:0/977537763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7ec13cdc0 0x7fd7ec0aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:05.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f15a3700 1 -- 172.21.15.60:0/977537763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec139390 con 0x7fd7ec138850 2020-10-31T22:47:05.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f15a3700 1 --2- 172.21.15.60:0/977537763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec138850 0x7fd7ec0aafa0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fd7dc007550 tx=0x7fd7dc009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:05.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7daffd700 1 -- 172.21.15.60:0/977537763 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7dc001710 con 0x7fd7ec138850 2020-10-31T22:47:05.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7daffd700 1 -- 172.21.15.60:0/977537763 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc010040 con 0x7fd7ec138850 2020-10-31T22:47:05.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f2da6700 1 -- 172.21.15.60:0/977537763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7ec139630 con 0x7fd7ec138850 2020-10-31T22:47:05.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7daffd700 1 -- 172.21.15.60:0/977537763 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd7dc001a60 con 0x7fd7ec138850 2020-10-31T22:47:05.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.208+0000 7fd7f2da6700 1 -- 172.21.15.60:0/977537763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7ec13bb80 con 0x7fd7ec138850 2020-10-31T22:47:05.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.212+0000 7fd7f2da6700 1 -- 172.21.15.60:0/977537763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7ec0ab630 con 0x7fd7ec138850 2020-10-31T22:47:05.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.212+0000 7fd7daffd700 1 -- 172.21.15.60:0/977537763 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd7dc001bc0 con 0x7fd7ec138850 2020-10-31T22:47:05.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.212+0000 7fd7daffd700 1 --2- 172.21.15.60:0/977537763 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd7cc054fd0 0x7fd7cc057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:05.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.212+0000 7fd7daffd700 1 -- 172.21.15.60:0/977537763 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fd7dc06da30 con 0x7fd7ec138850 2020-10-31T22:47:05.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.212+0000 7fd7f1da4700 1 --2- 172.21.15.60:0/977537763 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd7cc054fd0 0x7fd7cc057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:05.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.212+0000 7fd7f1da4700 1 --2- 172.21.15.60:0/977537763 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd7cc054fd0 0x7fd7cc057490 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fd7e8005000 tx=0x7fd7ec0af580).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:05.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.220+0000 7fd7daffd700 1 -- 172.21.15.60:0/977537763 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd7dc044120 con 0x7fd7ec138850 2020-10-31T22:47:05.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:05.364+0000 7fd7f2da6700 1 -- 172.21.15.60:0/977537763 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fd7ec139c90 con 0x7fd7ec138850 2020-10-31T22:47:06.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.068+0000 7fd7daffd700 1 -- 172.21.15.60:0/977537763 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v74) v1 ==== 125+0+0 (secure 0 0 0) 0x7fd7dc047740 con 0x7fd7ec138850 2020-10-31T22:47:06.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.080+0000 7fd7f2da6700 1 -- 172.21.15.60:0/977537763 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd7cc054fd0 msgr2=0x7fd7cc057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.080+0000 7fd7f2da6700 1 --2- 172.21.15.60:0/977537763 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd7cc054fd0 0x7fd7cc057490 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fd7e8005000 tx=0x7fd7ec0af580).stop 2020-10-31T22:47:06.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.080+0000 7fd7f2da6700 1 -- 172.21.15.60:0/977537763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec138850 msgr2=0x7fd7ec0aafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.080+0000 7fd7f2da6700 1 --2- 172.21.15.60:0/977537763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec138850 0x7fd7ec0aafa0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fd7dc007550 tx=0x7fd7dc009040).stop 2020-10-31T22:47:06.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.080+0000 7fd7f2da6700 1 -- 172.21.15.60:0/977537763 shutdown_connections 2020-10-31T22:47:06.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.080+0000 7fd7f2da6700 1 --2- 172.21.15.60:0/977537763 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7ec0a8670 0x7fd7ec0a8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.080+0000 7fd7f2da6700 1 --2- 172.21.15.60:0/977537763 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd7cc054fd0 0x7fd7cc057490 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.080+0000 7fd7f2da6700 1 --2- 172.21.15.60:0/977537763 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7ec13cdc0 0x7fd7ec0aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.080+0000 7fd7f2da6700 1 --2- 172.21.15.60:0/977537763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd7ec138850 0x7fd7ec0aafa0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.080+0000 7fd7f2da6700 1 -- 172.21.15.60:0/977537763 >> 172.21.15.60:0/977537763 conn(0x7fd7ec0b5330 msgr2=0x7fd7ec13d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:06.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.080+0000 7fd7f2da6700 1 -- 172.21.15.60:0/977537763 shutdown_connections 2020-10-31T22:47:06.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.080+0000 7fd7f2da6700 1 -- 172.21.15.60:0/977537763 wait complete. 2020-10-31T22:47:06.088 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2020-10-31T22:47:06.094 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-10-31T22:47:06.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.208+0000 7fd375ab6700 1 Processor -- start 2020-10-31T22:47:06.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.208+0000 7fd375ab6700 1 -- start start 2020-10-31T22:47:06.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.208+0000 7fd375ab6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd3700af520 0x7fd3700ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.208+0000 7fd375ab6700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd370066c90 0x7fd3700670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.208+0000 7fd375ab6700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3700af900 con 0x7fd370146060 2020-10-31T22:47:06.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.208+0000 7fd375ab6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3700afc10 con 0x7fd3700af520 2020-10-31T22:47:06.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.208+0000 7fd375ab6700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37005bb70 con 0x7fd370066c90 2020-10-31T22:47:06.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd374ab4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd3700af520 0x7fd3700ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd374ab4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd3700af520 0x7fd3700ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45322/0 (socket says 172.21.15.60:45322) 2020-10-31T22:47:06.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd374ab4700 1 -- 172.21.15.60:0/2793699219 learned_addr learned my addr 172.21.15.60:0/2793699219 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:06.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd36ffff700 1 --2- 172.21.15.60:0/2793699219 >> v2:172.21.15.66:3300/0 conn(0x7fd370066c90 0x7fd3700670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd374ab4700 1 -- 172.21.15.60:0/2793699219 >> v2:172.21.15.66:3300/0 conn(0x7fd370066c90 msgr2=0x7fd3700670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:06.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd374ab4700 1 --2- 172.21.15.60:0/2793699219 >> v2:172.21.15.66:3300/0 conn(0x7fd370066c90 0x7fd3700670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd374ab4700 1 -- 172.21.15.60:0/2793699219 >> v1:172.21.15.66:6789/0 conn(0x7fd370146060 legacy=0x7fd370149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd374ab4700 1 -- 172.21.15.60:0/2793699219 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3700ac130 con 0x7fd3700af520 2020-10-31T22:47:06.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd374ab4700 1 --2- 172.21.15.60:0/2793699219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3700af520 0x7fd3700ac870 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fd364002f30 tx=0x7fd364006e20).ready entity=mon.0 client_cookie=1a8065bf5d2ec4b1 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd36f7fe700 1 -- 172.21.15.60:0/2793699219 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd364009960 con 0x7fd3700af520 2020-10-31T22:47:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd36f7fe700 1 -- 172.21.15.60:0/2793699219 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd364009ac0 con 0x7fd3700af520 2020-10-31T22:47:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd36f7fe700 1 -- 172.21.15.60:0/2793699219 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd364009e20 con 0x7fd3700af520 2020-10-31T22:47:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd375ab6700 1 -- 172.21.15.60:0/2793699219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3700af520 msgr2=0x7fd3700ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd375ab6700 1 --2- 172.21.15.60:0/2793699219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3700af520 0x7fd3700ac870 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fd364002f30 tx=0x7fd364006e20).stop 2020-10-31T22:47:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd375ab6700 1 -- 172.21.15.60:0/2793699219 shutdown_connections 2020-10-31T22:47:06.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd375ab6700 1 --2- 172.21.15.60:0/2793699219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3700af520 0x7fd3700ac870 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd375ab6700 1 --2- 172.21.15.60:0/2793699219 >> v2:172.21.15.66:3300/0 conn(0x7fd370066c90 0x7fd3700670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd375ab6700 1 -- 172.21.15.60:0/2793699219 >> 172.21.15.60:0/2793699219 conn(0x7fd3700b3fd0 msgr2=0x7fd3700b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:06.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd375ab6700 1 -- 172.21.15.60:0/2793699219 shutdown_connections 2020-10-31T22:47:06.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd375ab6700 1 -- 172.21.15.60:0/2793699219 wait complete. 2020-10-31T22:47:06.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd375ab6700 1 Processor -- start 2020-10-31T22:47:06.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.212+0000 7fd375ab6700 1 -- start start 2020-10-31T22:47:06.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd375ab6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd370066c90 0x7fd3700a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd375ab6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3700af520 0x7fd3700ad170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd375ab6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd370146060 0x7fd370064c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd375ab6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd370063f60 con 0x7fd3700af520 2020-10-31T22:47:06.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd375ab6700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700aa900 con 0x7fd370146060 2020-10-31T22:47:06.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd375ab6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3700641c0 con 0x7fd370066c90 2020-10-31T22:47:06.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd36ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3700af520 0x7fd3700ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd36ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3700af520 0x7fd3700ad170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45328/0 (socket says 172.21.15.60:45328) 2020-10-31T22:47:06.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd36ffff700 1 -- 172.21.15.60:0/1503615736 learned_addr learned my addr 172.21.15.60:0/1503615736 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:06.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd3752b5700 1 --2- 172.21.15.60:0/1503615736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd370146060 0x7fd370064c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd374ab4700 1 --2- 172.21.15.60:0/1503615736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd370066c90 0x7fd3700a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd36ffff700 1 -- 172.21.15.60:0/1503615736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd370066c90 msgr2=0x7fd3700a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd36ffff700 1 --2- 172.21.15.60:0/1503615736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd370066c90 0x7fd3700a9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd36ffff700 1 -- 172.21.15.60:0/1503615736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd370146060 msgr2=0x7fd370064c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd36ffff700 1 --2- 172.21.15.60:0/1503615736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd370146060 0x7fd370064c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd36ffff700 1 -- 172.21.15.60:0/1503615736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd370064460 con 0x7fd3700af520 2020-10-31T22:47:06.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd36ffff700 1 --2- 172.21.15.60:0/1503615736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3700af520 0x7fd3700ad170 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fd3600033f0 tx=0x7fd360008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:06.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd36dffb700 1 -- 172.21.15.60:0/1503615736 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd36000bb20 con 0x7fd3700af520 2020-10-31T22:47:06.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd375ab6700 1 -- 172.21.15.60:0/1503615736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd370064900 con 0x7fd3700af520 2020-10-31T22:47:06.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd36dffb700 1 -- 172.21.15.60:0/1503615736 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36000bc80 con 0x7fd3700af520 2020-10-31T22:47:06.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd36dffb700 1 -- 172.21.15.60:0/1503615736 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd360012420 con 0x7fd3700af520 2020-10-31T22:47:06.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd375ab6700 1 -- 172.21.15.60:0/1503615736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3700aa600 con 0x7fd3700af520 2020-10-31T22:47:06.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.216+0000 7fd375ab6700 1 -- 172.21.15.60:0/1503615736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd370057100 con 0x7fd3700af520 2020-10-31T22:47:06.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.220+0000 7fd36dffb700 1 -- 172.21.15.60:0/1503615736 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd360012580 con 0x7fd3700af520 2020-10-31T22:47:06.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.220+0000 7fd36dffb700 1 --2- 172.21.15.60:0/1503615736 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd350054f90 0x7fd350057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.220+0000 7fd36dffb700 1 -- 172.21.15.60:0/1503615736 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fd36006eb30 con 0x7fd3700af520 2020-10-31T22:47:06.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.220+0000 7fd374ab4700 1 --2- 172.21.15.60:0/1503615736 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd350054f90 0x7fd350057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.220+0000 7fd374ab4700 1 --2- 172.21.15.60:0/1503615736 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd350054f90 0x7fd350057450 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fd364019000 tx=0x7fd364015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:06.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.228+0000 7fd36dffb700 1 -- 172.21.15.60:0/1503615736 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd360045060 con 0x7fd3700af520 2020-10-31T22:47:06.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.416+0000 7fd375ab6700 1 -- 172.21.15.60:0/1503615736 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fd3700ab540 con 0x7fd3700af520 2020-10-31T22:47:06.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.428+0000 7fd36dffb700 1 -- 172.21.15.60:0/1503615736 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 13 and data pool 14 v33) v1 ==== 189+0+0 (secure 0 0 0) 0x7fd3600290d0 con 0x7fd3700af520 2020-10-31T22:47:06.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.432+0000 7fd375ab6700 1 -- 172.21.15.60:0/1503615736 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd350054f90 msgr2=0x7fd350057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.432+0000 7fd375ab6700 1 --2- 172.21.15.60:0/1503615736 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd350054f90 0x7fd350057450 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fd364019000 tx=0x7fd364015000).stop 2020-10-31T22:47:06.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.432+0000 7fd375ab6700 1 -- 172.21.15.60:0/1503615736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3700af520 msgr2=0x7fd3700ad170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.432+0000 7fd375ab6700 1 --2- 172.21.15.60:0/1503615736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3700af520 0x7fd3700ad170 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7fd3600033f0 tx=0x7fd360008040).stop 2020-10-31T22:47:06.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.432+0000 7fd375ab6700 1 -- 172.21.15.60:0/1503615736 shutdown_connections 2020-10-31T22:47:06.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.432+0000 7fd375ab6700 1 --2- 172.21.15.60:0/1503615736 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd350054f90 0x7fd350057450 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.432+0000 7fd375ab6700 1 --2- 172.21.15.60:0/1503615736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd370146060 0x7fd370064c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.432+0000 7fd375ab6700 1 --2- 172.21.15.60:0/1503615736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd370066c90 0x7fd3700a9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.432+0000 7fd375ab6700 1 --2- 172.21.15.60:0/1503615736 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3700af520 0x7fd3700ad170 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.432+0000 7fd375ab6700 1 -- 172.21.15.60:0/1503615736 >> 172.21.15.60:0/1503615736 conn(0x7fd3700b3fd0 msgr2=0x7fd3700a6e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:06.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.432+0000 7fd375ab6700 1 -- 172.21.15.60:0/1503615736 shutdown_connections 2020-10-31T22:47:06.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.432+0000 7fd375ab6700 1 -- 172.21.15.60:0/1503615736 wait complete. 2020-10-31T22:47:06.442 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 13 and data pool 14 2020-10-31T22:47:06.452 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:47:06.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa576fd1700 1 Processor -- start 2020-10-31T22:47:06.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa576fd1700 1 -- start start 2020-10-31T22:47:06.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa576fd1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700ac870 0x7fa5700b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa576fd1700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa5700ae8b0 0x7fa5701412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa576fd1700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5700acc50 con 0x7fa5700b0e20 2020-10-31T22:47:06.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa576fd1700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5700b14c0 con 0x7fa5700ae8b0 2020-10-31T22:47:06.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa576fd1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5700b5690 con 0x7fa5700ac870 2020-10-31T22:47:06.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa5757ce700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa5700b0e20 0x7fa5700ae1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49486/0 (socket says 172.21.15.60:49486) 2020-10-31T22:47:06.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa5757ce700 1 -- 172.21.15.60:0/2805296131 learned_addr learned my addr 172.21.15.60:0/2805296131 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:06.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa575fcf700 1 --2- 172.21.15.60:0/2805296131 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700ac870 0x7fa5700b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa5767d0700 1 --2- 172.21.15.60:0/2805296131 >> v2:172.21.15.66:3300/0 conn(0x7fa5700ae8b0 0x7fa5701412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa574fcd700 1 -- 172.21.15.60:0/2805296131 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4069517957 0 0) 0x7fa5700acc50 con 0x7fa5700b0e20 2020-10-31T22:47:06.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa574fcd700 1 -- 172.21.15.60:0/2805296131 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa554003230 con 0x7fa5700b0e20 2020-10-31T22:47:06.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa575fcf700 1 -- 172.21.15.60:0/2805296131 >> v2:172.21.15.66:3300/0 conn(0x7fa5700ae8b0 msgr2=0x7fa5701412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:06.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa575fcf700 1 --2- 172.21.15.60:0/2805296131 >> v2:172.21.15.66:3300/0 conn(0x7fa5700ae8b0 0x7fa5701412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa574fcd700 1 -- 172.21.15.60:0/2805296131 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3605048930 0 0) 0x7fa554003230 con 0x7fa5700b0e20 2020-10-31T22:47:06.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa575fcf700 1 -- 172.21.15.60:0/2805296131 >> v1:172.21.15.60:6789/0 conn(0x7fa5700b0e20 legacy=0x7fa5700ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa575fcf700 1 -- 172.21.15.60:0/2805296131 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5700afc10 con 0x7fa5700ac870 2020-10-31T22:47:06.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa5767d0700 1 --2- 172.21.15.60:0/2805296131 >> v2:172.21.15.66:3300/0 conn(0x7fa5700ae8b0 0x7fa5701412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:47:06.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa575fcf700 1 --2- 172.21.15.60:0/2805296131 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700ac870 0x7fa5700b5060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa560001870 tx=0x7fa56c006dc0).ready entity=mon.2 client_cookie=37b9045bc8b7130d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:06.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa574fcd700 1 -- 172.21.15.60:0/2805296131 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5600016d0 con 0x7fa5700ac870 2020-10-31T22:47:06.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa574fcd700 1 -- 172.21.15.60:0/2805296131 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c009580 con 0x7fa5700ac870 2020-10-31T22:47:06.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa574fcd700 1 -- 172.21.15.60:0/2805296131 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa56c0096f0 con 0x7fa5700ac870 2020-10-31T22:47:06.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa576fd1700 1 -- 172.21.15.60:0/2805296131 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700ac870 msgr2=0x7fa5700b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.552+0000 7fa576fd1700 1 --2- 172.21.15.60:0/2805296131 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700ac870 0x7fa5700b5060 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fa560001870 tx=0x7fa56c006dc0).stop 2020-10-31T22:47:06.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 -- 172.21.15.60:0/2805296131 shutdown_connections 2020-10-31T22:47:06.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 --2- 172.21.15.60:0/2805296131 >> v2:172.21.15.66:3300/0 conn(0x7fa5700ae8b0 0x7fa5701412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 --2- 172.21.15.60:0/2805296131 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700ac870 0x7fa5700b5060 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 -- 172.21.15.60:0/2805296131 >> 172.21.15.60:0/2805296131 conn(0x7fa57006a600 msgr2=0x7fa570060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:06.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 -- 172.21.15.60:0/2805296131 shutdown_connections 2020-10-31T22:47:06.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 -- 172.21.15.60:0/2805296131 wait complete. 2020-10-31T22:47:06.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 Processor -- start 2020-10-31T22:47:06.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 -- start start 2020-10-31T22:47:06.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5700ac870 0x7fa570063a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5700ae8b0 0x7fa5701346b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700b0e20 0x7fa570134ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa570064080 con 0x7fa5700ac870 2020-10-31T22:47:06.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5700a9280 con 0x7fa5700ae8b0 2020-10-31T22:47:06.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5700a9520 con 0x7fa5700b0e20 2020-10-31T22:47:06.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa575fcf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5700ac870 0x7fa570063a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa575fcf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5700ac870 0x7fa570063a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45352/0 (socket says 172.21.15.60:45352) 2020-10-31T22:47:06.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa575fcf700 1 -- 172.21.15.60:0/3495025095 learned_addr learned my addr 172.21.15.60:0/3495025095 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:06.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa5757ce700 1 --2- 172.21.15.60:0/3495025095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5700ae8b0 0x7fa5701346b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa5767d0700 1 --2- 172.21.15.60:0/3495025095 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700b0e20 0x7fa570134ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa575fcf700 1 -- 172.21.15.60:0/3495025095 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700b0e20 msgr2=0x7fa570134ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa575fcf700 1 --2- 172.21.15.60:0/3495025095 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700b0e20 0x7fa570134ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa575fcf700 1 -- 172.21.15.60:0/3495025095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5700ae8b0 msgr2=0x7fa5701346b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa575fcf700 1 --2- 172.21.15.60:0/3495025095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5700ae8b0 0x7fa5701346b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa575fcf700 1 -- 172.21.15.60:0/3495025095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5700a97c0 con 0x7fa5700ac870 2020-10-31T22:47:06.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa575fcf700 1 --2- 172.21.15.60:0/3495025095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5700ac870 0x7fa570063a00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fa560001870 tx=0x7fa56c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:06.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa566ffd700 1 -- 172.21.15.60:0/3495025095 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa56c011b00 con 0x7fa5700ac870 2020-10-31T22:47:06.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa566ffd700 1 -- 172.21.15.60:0/3495025095 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56c011c60 con 0x7fa5700ac870 2020-10-31T22:47:06.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 -- 172.21.15.60:0/3495025095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5700a9a60 con 0x7fa5700ac870 2020-10-31T22:47:06.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa566ffd700 1 -- 172.21.15.60:0/3495025095 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa56c01d450 con 0x7fa5700ac870 2020-10-31T22:47:06.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.556+0000 7fa576fd1700 1 -- 172.21.15.60:0/3495025095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5700a8f00 con 0x7fa5700ac870 2020-10-31T22:47:06.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.560+0000 7fa576fd1700 1 -- 172.21.15.60:0/3495025095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa570057100 con 0x7fa5700ac870 2020-10-31T22:47:06.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.560+0000 7fa566ffd700 1 -- 172.21.15.60:0/3495025095 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa56c024030 con 0x7fa5700ac870 2020-10-31T22:47:06.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.560+0000 7fa566ffd700 1 --2- 172.21.15.60:0/3495025095 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa558054f10 0x7fa5580573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.560+0000 7fa566ffd700 1 -- 172.21.15.60:0/3495025095 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa56c06e9f0 con 0x7fa5700ac870 2020-10-31T22:47:06.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.560+0000 7fa5757ce700 1 --2- 172.21.15.60:0/3495025095 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa558054f10 0x7fa5580573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.560+0000 7fa5757ce700 1 --2- 172.21.15.60:0/3495025095 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa558054f10 0x7fa5580573d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fa56000b000 tx=0x7fa560000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:06.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.568+0000 7fa566ffd700 1 -- 172.21.15.60:0/3495025095 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa56c044e80 con 0x7fa5700ac870 2020-10-31T22:47:06.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.708+0000 7fa576fd1700 1 -- 172.21.15.60:0/3495025095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa57005ed50 con 0x7fa5700ac870 2020-10-31T22:47:06.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.712+0000 7fa566ffd700 1 -- 172.21.15.60:0/3495025095 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16054 (secure 0 0 0) 0x7fa56c022070 con 0x7fa5700ac870 2020-10-31T22:47:06.714 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:06.715 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":75,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:47:06.421840+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:47:04.119666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-10-31T22:47:05.419686+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:47:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.712+0000 7fa576fd1700 1 -- 172.21.15.60:0/3495025095 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa558054f10 msgr2=0x7fa5580573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.712+0000 7fa576fd1700 1 --2- 172.21.15.60:0/3495025095 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa558054f10 0x7fa5580573d0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fa56000b000 tx=0x7fa560000b80).stop 2020-10-31T22:47:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.712+0000 7fa576fd1700 1 -- 172.21.15.60:0/3495025095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5700ac870 msgr2=0x7fa570063a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.712+0000 7fa576fd1700 1 --2- 172.21.15.60:0/3495025095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5700ac870 0x7fa570063a00 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fa560001870 tx=0x7fa56c015000).stop 2020-10-31T22:47:06.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.716+0000 7fa576fd1700 1 -- 172.21.15.60:0/3495025095 shutdown_connections 2020-10-31T22:47:06.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.716+0000 7fa576fd1700 1 --2- 172.21.15.60:0/3495025095 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa5700b0e20 0x7fa570134ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.716+0000 7fa576fd1700 1 --2- 172.21.15.60:0/3495025095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5700ac870 0x7fa570063a00 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.716+0000 7fa576fd1700 1 --2- 172.21.15.60:0/3495025095 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa558054f10 0x7fa5580573d0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.716+0000 7fa576fd1700 1 --2- 172.21.15.60:0/3495025095 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa5700ae8b0 0x7fa5701346b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.716+0000 7fa576fd1700 1 -- 172.21.15.60:0/3495025095 >> 172.21.15.60:0/3495025095 conn(0x7fa57006a600 msgr2=0x7fa5700b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:06.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.716+0000 7fa576fd1700 1 -- 172.21.15.60:0/3495025095 shutdown_connections 2020-10-31T22:47:06.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.716+0000 7fa576fd1700 1 -- 172.21.15.60:0/3495025095 wait complete. 2020-10-31T22:47:06.729 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:47:06.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.844+0000 7fa273fff700 1 Processor -- start 2020-10-31T22:47:06.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.844+0000 7fa273fff700 1 -- start start 2020-10-31T22:47:06.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.844+0000 7fa273fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa2740b1a10 0x7fa274142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.844+0000 7fa273fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa27413ebe0 0x7fa2740b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.844+0000 7fa273fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2740abea0 con 0x7fa2740af200 2020-10-31T22:47:06.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.844+0000 7fa273fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa274141870 con 0x7fa27413ebe0 2020-10-31T22:47:06.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.844+0000 7fa273fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa274141b10 con 0x7fa2740b1a10 2020-10-31T22:47:06.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa272ffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa2740b1a10 0x7fa274142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa272ffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa2740b1a10 0x7fa274142250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:58548/0 (socket says 172.21.15.60:58548) 2020-10-31T22:47:06.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa272ffd700 1 -- 172.21.15.60:0/3757261136 learned_addr learned my addr 172.21.15.60:0/3757261136 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:06.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa2727fc700 1 --2- 172.21.15.60:0/3757261136 >> v2:172.21.15.66:3300/0 conn(0x7fa27413ebe0 0x7fa2740b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa272ffd700 1 -- 172.21.15.60:0/3757261136 >> v2:172.21.15.66:3300/0 conn(0x7fa27413ebe0 msgr2=0x7fa2740b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:06.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa272ffd700 1 --2- 172.21.15.60:0/3757261136 >> v2:172.21.15.66:3300/0 conn(0x7fa27413ebe0 0x7fa2740b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa272ffd700 1 -- 172.21.15.60:0/3757261136 >> v1:172.21.15.66:6789/0 conn(0x7fa2740af200 legacy=0x7fa2740afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa272ffd700 1 -- 172.21.15.60:0/3757261136 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa274141db0 con 0x7fa2740b1a10 2020-10-31T22:47:06.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa272ffd700 1 --2- 172.21.15.60:0/3757261136 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa2740b1a10 0x7fa274142250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa2640032b0 tx=0x7fa264009270).ready entity=mon.2 client_cookie=d1738158a697146a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:06.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa271ffb700 1 -- 172.21.15.60:0/3757261136 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa264009e60 con 0x7fa2740b1a10 2020-10-31T22:47:06.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa271ffb700 1 -- 172.21.15.60:0/3757261136 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26400bc00 con 0x7fa2740b1a10 2020-10-31T22:47:06.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa271ffb700 1 -- 172.21.15.60:0/3757261136 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa26400bd70 con 0x7fa2740b1a10 2020-10-31T22:47:06.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa273fff700 1 -- 172.21.15.60:0/3757261136 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa2740b1a10 msgr2=0x7fa274142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa273fff700 1 --2- 172.21.15.60:0/3757261136 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa2740b1a10 0x7fa274142250 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa2640032b0 tx=0x7fa264009270).stop 2020-10-31T22:47:06.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa273fff700 1 -- 172.21.15.60:0/3757261136 shutdown_connections 2020-10-31T22:47:06.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa273fff700 1 --2- 172.21.15.60:0/3757261136 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa2740b1a10 0x7fa274142250 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa273fff700 1 --2- 172.21.15.60:0/3757261136 >> v2:172.21.15.66:3300/0 conn(0x7fa27413ebe0 0x7fa2740b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa273fff700 1 -- 172.21.15.60:0/3757261136 >> 172.21.15.60:0/3757261136 conn(0x7fa2740b5300 msgr2=0x7fa2740b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa273fff700 1 -- 172.21.15.60:0/3757261136 shutdown_connections 2020-10-31T22:47:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.848+0000 7fa273fff700 1 -- 172.21.15.60:0/3757261136 wait complete. 2020-10-31T22:47:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa273fff700 1 Processor -- start 2020-10-31T22:47:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa273fff700 1 -- start start 2020-10-31T22:47:06.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa273fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2740af200 0x7fa2740b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa273fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2740b1a10 0x7fa274150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa273fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa27413ebe0 0x7fa274150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa273fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27413b860 con 0x7fa2740af200 2020-10-31T22:47:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa273fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2740b0070 con 0x7fa2740b1a10 2020-10-31T22:47:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa273fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2740a87f0 con 0x7fa27413ebe0 2020-10-31T22:47:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa272ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2740af200 0x7fa2740b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa272ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2740af200 0x7fa2740b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45366/0 (socket says 172.21.15.60:45366) 2020-10-31T22:47:06.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa272ffd700 1 -- 172.21.15.60:0/2037788685 learned_addr learned my addr 172.21.15.60:0/2037788685 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:06.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa2727fc700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2740b1a10 0x7fa274150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa2737fe700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa27413ebe0 0x7fa274150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa272ffd700 1 -- 172.21.15.60:0/2037788685 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa27413ebe0 msgr2=0x7fa274150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa272ffd700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa27413ebe0 0x7fa274150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa272ffd700 1 -- 172.21.15.60:0/2037788685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2740b1a10 msgr2=0x7fa274150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:06.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa272ffd700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2740b1a10 0x7fa274150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:06.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa272ffd700 1 -- 172.21.15.60:0/2037788685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2740a8a90 con 0x7fa2740af200 2020-10-31T22:47:06.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa2727fc700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2740b1a10 0x7fa274150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:47:06.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa2737fe700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa27413ebe0 0x7fa274150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:47:06.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.852+0000 7fa272ffd700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2740af200 0x7fa2740b39f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fa2640032b0 tx=0x7fa264016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:06.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.856+0000 7fa26bfff700 1 -- 172.21.15.60:0/2037788685 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa26401f5e0 con 0x7fa2740af200 2020-10-31T22:47:06.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.856+0000 7fa26bfff700 1 -- 172.21.15.60:0/2037788685 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa26401f740 con 0x7fa2740af200 2020-10-31T22:47:06.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.856+0000 7fa273fff700 1 -- 172.21.15.60:0/2037788685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2740a8d30 con 0x7fa2740af200 2020-10-31T22:47:06.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.856+0000 7fa26bfff700 1 -- 172.21.15.60:0/2037788685 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa26401faa0 con 0x7fa2740af200 2020-10-31T22:47:06.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.856+0000 7fa273fff700 1 -- 172.21.15.60:0/2037788685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2740a94f0 con 0x7fa2740af200 2020-10-31T22:47:06.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.856+0000 7fa273fff700 1 -- 172.21.15.60:0/2037788685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa274057100 con 0x7fa2740af200 2020-10-31T22:47:06.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.856+0000 7fa26bfff700 1 -- 172.21.15.60:0/2037788685 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa264026030 con 0x7fa2740af200 2020-10-31T22:47:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.856+0000 7fa26bfff700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa258054f10 0x7fa2580573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.856+0000 7fa26bfff700 1 -- 172.21.15.60:0/2037788685 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa26406eca0 con 0x7fa2740af200 2020-10-31T22:47:06.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.856+0000 7fa2727fc700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa258054f10 0x7fa2580573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:06.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.856+0000 7fa2727fc700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa258054f10 0x7fa2580573d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fa25c00b000 tx=0x7fa25c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:06.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:06.864+0000 7fa26bfff700 1 -- 172.21.15.60:0/2037788685 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa2640450b0 con 0x7fa2740af200 2020-10-31T22:47:07.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.000+0000 7fa273fff700 1 -- 172.21.15.60:0/2037788685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa27405ee00 con 0x7fa2740af200 2020-10-31T22:47:07.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.000+0000 7fa26bfff700 1 -- 172.21.15.60:0/2037788685 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16054 (secure 0 0 0) 0x7fa264024090 con 0x7fa2740af200 2020-10-31T22:47:07.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.004+0000 7fa273fff700 1 -- 172.21.15.60:0/2037788685 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa258054f10 msgr2=0x7fa2580573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:07.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.004+0000 7fa273fff700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa258054f10 0x7fa2580573d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7fa25c00b000 tx=0x7fa25c008040).stop 2020-10-31T22:47:07.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.004+0000 7fa273fff700 1 -- 172.21.15.60:0/2037788685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2740af200 msgr2=0x7fa2740b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:07.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.004+0000 7fa273fff700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2740af200 0x7fa2740b39f0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 rx=0x7fa2640032b0 tx=0x7fa264016000).stop 2020-10-31T22:47:07.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.004+0000 7fa273fff700 1 -- 172.21.15.60:0/2037788685 shutdown_connections 2020-10-31T22:47:07.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.004+0000 7fa273fff700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa27413ebe0 0x7fa274150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:07.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.004+0000 7fa273fff700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa2740af200 0x7fa2740b39f0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:07.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.004+0000 7fa273fff700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa258054f10 0x7fa2580573d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:07.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.004+0000 7fa273fff700 1 --2- 172.21.15.60:0/2037788685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa2740b1a10 0x7fa274150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:07.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.004+0000 7fa273fff700 1 -- 172.21.15.60:0/2037788685 >> 172.21.15.60:0/2037788685 conn(0x7fa2740b5300 msgr2=0x7fa2740b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:07.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.004+0000 7fa273fff700 1 -- 172.21.15.60:0/2037788685 shutdown_connections 2020-10-31T22:47:07.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.004+0000 7fa273fff700 1 -- 172.21.15.60:0/2037788685 wait complete. 2020-10-31T22:47:07.013 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:07.013 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":75,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:47:06.421840+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:47:04.119666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-10-31T22:47:05.419686+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:47:07.019 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-10-31T22:47:07.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4c8a3700 1 Processor -- start 2020-10-31T22:47:07.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4c8a3700 1 -- start start 2020-10-31T22:47:07.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4c8a3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6e480b0ec0 0x7f6e48138580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:07.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4c8a3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6e480aab20 0x7f6e48138a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:07.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4c8a3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e480b12a0 con 0x7f6e480ac7b0 2020-10-31T22:47:07.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4c8a3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e480aafc0 con 0x7f6e480b0ec0 2020-10-31T22:47:07.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4c8a3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e480adf40 con 0x7f6e480aab20 2020-10-31T22:47:07.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e46d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f6e480ac7b0 0x7f6e480aec40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49514/0 (socket says 172.21.15.60:49514) 2020-10-31T22:47:07.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6e480b0ec0 0x7f6e48138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:07.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e46d9d700 1 -- 172.21.15.60:0/3408110053 learned_addr learned my addr 172.21.15.60:0/3408110053 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:07.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e45d9b700 1 --2- 172.21.15.60:0/3408110053 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6e480aab20 0x7f6e48138a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:07.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4559a700 1 -- 172.21.15.60:0/3408110053 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785114476 0 0) 0x7f6e480b12a0 con 0x7f6e480ac7b0 2020-10-31T22:47:07.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4559a700 1 -- 172.21.15.60:0/3408110053 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e2c003230 con 0x7f6e480ac7b0 2020-10-31T22:47:07.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4559a700 1 -- 172.21.15.60:0/3408110053 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1041111516 0 0) 0x7f6e2c003230 con 0x7f6e480ac7b0 2020-10-31T22:47:07.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4659c700 1 -- 172.21.15.60:0/3408110053 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6e480aab20 msgr2=0x7f6e48138a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:07.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4659c700 1 --2- 172.21.15.60:0/3408110053 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6e480aab20 0x7f6e48138a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:07.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4659c700 1 -- 172.21.15.60:0/3408110053 >> v1:172.21.15.60:6789/0 conn(0x7f6e480ac7b0 legacy=0x7f6e480aec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:07.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4659c700 1 -- 172.21.15.60:0/3408110053 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e480ae1e0 con 0x7f6e480b0ec0 2020-10-31T22:47:07.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4659c700 1 --2- 172.21.15.60:0/3408110053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e480b0ec0 0x7f6e48138580 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f6e40001bf0 tx=0x7f6e38006dc0).ready entity=mon.0 client_cookie=8da54c1f87be7c71 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:07.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4559a700 1 -- 172.21.15.60:0/3408110053 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e40001a50 con 0x7f6e480b0ec0 2020-10-31T22:47:07.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4559a700 1 -- 172.21.15.60:0/3408110053 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3800d570 con 0x7f6e480b0ec0 2020-10-31T22:47:07.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4559a700 1 -- 172.21.15.60:0/3408110053 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e3800d6e0 con 0x7f6e480b0ec0 2020-10-31T22:47:07.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/3408110053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e480b0ec0 msgr2=0x7f6e48138580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:07.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.136+0000 7f6e4c8a3700 1 --2- 172.21.15.60:0/3408110053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e480b0ec0 0x7f6e48138580 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 rx=0x7f6e40001bf0 tx=0x7f6e38006dc0).stop 2020-10-31T22:47:07.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.140+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/3408110053 shutdown_connections 2020-10-31T22:47:07.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.140+0000 7f6e4c8a3700 1 --2- 172.21.15.60:0/3408110053 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e480b0ec0 0x7f6e48138580 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:07.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.140+0000 7f6e4c8a3700 1 --2- 172.21.15.60:0/3408110053 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6e480aab20 0x7f6e48138a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:07.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.140+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/3408110053 >> 172.21.15.60:0/3408110053 conn(0x7f6e4806a260 msgr2=0x7f6e48061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:07.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.140+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/3408110053 shutdown_connections 2020-10-31T22:47:07.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.140+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/3408110053 wait complete. 2020-10-31T22:47:07.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.140+0000 7f6e4c8a3700 1 Processor -- start 2020-10-31T22:47:07.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.140+0000 7f6e4c8a3700 1 -- start start 2020-10-31T22:47:07.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.140+0000 7f6e4c8a3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e480aab20 0x7f6e4813ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:07.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.140+0000 7f6e4c8a3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e480ac7b0 0x7f6e4814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:07.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.140+0000 7f6e4c8a3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6e480b0ec0 0x7f6e4814f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:07.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.140+0000 7f6e4c8a3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e48065990 con 0x7f6e480aab20 2020-10-31T22:47:07.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.140+0000 7f6e4c8a3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e480ae7f0 con 0x7f6e480ac7b0 2020-10-31T22:47:07.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.140+0000 7f6e4c8a3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e480673c0 con 0x7f6e480b0ec0 2020-10-31T22:47:07.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e4659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e480aab20 0x7f6e4813ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:07.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e4659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e480aab20 0x7f6e4813ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45380/0 (socket says 172.21.15.60:45380) 2020-10-31T22:47:07.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e4659c700 1 -- 172.21.15.60:0/251563863 learned_addr learned my addr 172.21.15.60:0/251563863 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:07.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e45d9b700 1 --2- 172.21.15.60:0/251563863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e480ac7b0 0x7f6e4814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:07.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e46d9d700 1 --2- 172.21.15.60:0/251563863 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6e480b0ec0 0x7f6e4814f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:07.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e4659c700 1 -- 172.21.15.60:0/251563863 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6e480b0ec0 msgr2=0x7f6e4814f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:07.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e4659c700 1 --2- 172.21.15.60:0/251563863 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6e480b0ec0 0x7f6e4814f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:07.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e4659c700 1 -- 172.21.15.60:0/251563863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e480ac7b0 msgr2=0x7f6e4814eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:07.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e4659c700 1 --2- 172.21.15.60:0/251563863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e480ac7b0 0x7f6e4814eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:07.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e4659c700 1 -- 172.21.15.60:0/251563863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4814e900 con 0x7f6e480aab20 2020-10-31T22:47:07.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e4659c700 1 --2- 172.21.15.60:0/251563863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e480aab20 0x7f6e4813ade0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f6e40001bf0 tx=0x7f6e38015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:07.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e377fe700 1 -- 172.21.15.60:0/251563863 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e38011990 con 0x7f6e480aab20 2020-10-31T22:47:07.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e377fe700 1 -- 172.21.15.60:0/251563863 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e38011af0 con 0x7f6e480aab20 2020-10-31T22:47:07.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/251563863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e48137c30 con 0x7f6e480aab20 2020-10-31T22:47:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e377fe700 1 -- 172.21.15.60:0/251563863 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e38011e50 con 0x7f6e480aab20 2020-10-31T22:47:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/251563863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4814c6f0 con 0x7f6e480aab20 2020-10-31T22:47:07.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/251563863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e48137ea0 con 0x7f6e480aab20 2020-10-31T22:47:07.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e377fe700 1 -- 172.21.15.60:0/251563863 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6e38024030 con 0x7f6e480aab20 2020-10-31T22:47:07.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.144+0000 7f6e377fe700 1 --2- 172.21.15.60:0/251563863 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6e24054f10 0x7f6e240573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:07.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.148+0000 7f6e377fe700 1 -- 172.21.15.60:0/251563863 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6e3806ea20 con 0x7f6e480aab20 2020-10-31T22:47:07.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.148+0000 7f6e45d9b700 1 --2- 172.21.15.60:0/251563863 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6e24054f10 0x7f6e240573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:07.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.148+0000 7f6e45d9b700 1 --2- 172.21.15.60:0/251563863 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6e24054f10 0x7f6e240573d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f6e3c00b000 tx=0x7f6e3c006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:07.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.152+0000 7f6e377fe700 1 -- 172.21.15.60:0/251563863 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6e38044e30 con 0x7f6e480aab20 2020-10-31T22:47:07.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:07.344+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/251563863 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6e48067580 con 0x7f6e480aab20 2020-10-31T22:47:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.084+0000 7f6e377fe700 1 -- 172.21.15.60:0/251563863 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6e38022020 con 0x7f6e480aab20 2020-10-31T22:47:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.084+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/251563863 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6e24054f10 msgr2=0x7f6e240573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.084+0000 7f6e4c8a3700 1 --2- 172.21.15.60:0/251563863 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6e24054f10 0x7f6e240573d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f6e3c00b000 tx=0x7f6e3c006dc0).stop 2020-10-31T22:47:08.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.084+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/251563863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e480aab20 msgr2=0x7f6e4813ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.084+0000 7f6e4c8a3700 1 --2- 172.21.15.60:0/251563863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e480aab20 0x7f6e4813ade0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 rx=0x7f6e40001bf0 tx=0x7f6e38015000).stop 2020-10-31T22:47:08.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.084+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/251563863 shutdown_connections 2020-10-31T22:47:08.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.084+0000 7f6e4c8a3700 1 --2- 172.21.15.60:0/251563863 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6e480b0ec0 0x7f6e4814f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.084+0000 7f6e4c8a3700 1 --2- 172.21.15.60:0/251563863 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6e480aab20 0x7f6e4813ade0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.084+0000 7f6e4c8a3700 1 --2- 172.21.15.60:0/251563863 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6e24054f10 0x7f6e240573d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.088+0000 7f6e4c8a3700 1 --2- 172.21.15.60:0/251563863 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6e480ac7b0 0x7f6e4814eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.088+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/251563863 >> 172.21.15.60:0/251563863 conn(0x7f6e4806a260 msgr2=0x7f6e480b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.088+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/251563863 shutdown_connections 2020-10-31T22:47:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.088+0000 7f6e4c8a3700 1 -- 172.21.15.60:0/251563863 wait complete. 2020-10-31T22:47:08.107 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:47:08.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f8291da1700 1 Processor -- start 2020-10-31T22:47:08.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f8291da1700 1 -- start start 2020-10-31T22:47:08.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f8291da1700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f828c0b5950 0x7f828c1426f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f8291da1700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c145180 con 0x7f828c0b5570 2020-10-31T22:47:08.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f8291da1700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c0b0670 con 0x7f828c0b24a0 2020-10-31T22:47:08.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f8291da1700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c0afae0 con 0x7f828c0b5950 2020-10-31T22:47:08.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f8290d9f700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f828c0b5570 0x7f828c145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49524/0 (socket says 172.21.15.60:49524) 2020-10-31T22:47:08.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f8290d9f700 1 -- 172.21.15.60:0/2171080477 learned_addr learned my addr 172.21.15.60:0/2171080477 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:08.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f82915a0700 1 --2- 172.21.15.60:0/2171080477 >> v2:172.21.15.66:3300/0 conn(0x7f828c0b5950 0x7f828c1426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f828b7fe700 1 -- 172.21.15.60:0/2171080477 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293701342 0 0) 0x7f828c145180 con 0x7f828c0b5570 2020-10-31T22:47:08.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f828b7fe700 1 -- 172.21.15.60:0/2171080477 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f826c003230 con 0x7f828c0b5570 2020-10-31T22:47:08.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f828b7fe700 1 -- 172.21.15.60:0/2171080477 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792687725 0 0) 0x7f828c0b0670 con 0x7f828c0b24a0 2020-10-31T22:47:08.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f828b7fe700 1 -- 172.21.15.60:0/2171080477 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f828c145180 con 0x7f828c0b24a0 2020-10-31T22:47:08.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f82915a0700 1 -- 172.21.15.60:0/2171080477 >> v1:172.21.15.66:6789/0 conn(0x7f828c0b24a0 legacy=0x7f828c141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f82915a0700 1 -- 172.21.15.60:0/2171080477 >> v1:172.21.15.60:6789/0 conn(0x7f828c0b5570 legacy=0x7f828c145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f82915a0700 1 -- 172.21.15.60:0/2171080477 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c0b0910 con 0x7f828c0b5950 2020-10-31T22:47:08.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f82915a0700 1 --2- 172.21.15.60:0/2171080477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c0b5950 0x7f828c1426f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f828c05f580 tx=0x7f8284006dc0).ready entity=mon.1 client_cookie=de6f4be14003c856 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:08.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f828b7fe700 1 -- 172.21.15.60:0/2171080477 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8284009740 con 0x7f828c0b5950 2020-10-31T22:47:08.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f828b7fe700 1 -- 172.21.15.60:0/2171080477 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82840098a0 con 0x7f828c0b5950 2020-10-31T22:47:08.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f828b7fe700 1 -- 172.21.15.60:0/2171080477 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8284009c00 con 0x7f828c0b5950 2020-10-31T22:47:08.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f8291da1700 1 -- 172.21.15.60:0/2171080477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c0b5950 msgr2=0x7f828c1426f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.224+0000 7f8291da1700 1 --2- 172.21.15.60:0/2171080477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c0b5950 0x7f828c1426f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f828c05f580 tx=0x7f8284006dc0).stop 2020-10-31T22:47:08.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.228+0000 7f8291da1700 1 -- 172.21.15.60:0/2171080477 shutdown_connections 2020-10-31T22:47:08.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.228+0000 7f8291da1700 1 --2- 172.21.15.60:0/2171080477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c0b5950 0x7f828c1426f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.228+0000 7f8291da1700 1 -- 172.21.15.60:0/2171080477 >> 172.21.15.60:0/2171080477 conn(0x7f828c0b8e90 msgr2=0x7f828c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:08.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.228+0000 7f8291da1700 1 -- 172.21.15.60:0/2171080477 shutdown_connections 2020-10-31T22:47:08.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.228+0000 7f8291da1700 1 -- 172.21.15.60:0/2171080477 wait complete. 2020-10-31T22:47:08.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.228+0000 7f8291da1700 1 Processor -- start 2020-10-31T22:47:08.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.228+0000 7f8291da1700 1 -- start start 2020-10-31T22:47:08.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.228+0000 7f8291da1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f828c0b24a0 0x7f828c0ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.228+0000 7f8291da1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c0b5570 0x7f828c154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.228+0000 7f8291da1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f828c0b5950 0x7f828c13a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.228+0000 7f8291da1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0ae940 con 0x7f828c0b5950 2020-10-31T22:47:08.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.228+0000 7f8291da1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c13fdb0 con 0x7f828c0b5570 2020-10-31T22:47:08.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.228+0000 7f8291da1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c153e90 con 0x7f828c0b24a0 2020-10-31T22:47:08.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f82915a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f828c0b5950 0x7f828c13a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f828bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c0b5570 0x7f828c154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f8290d9f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f828c0b24a0 0x7f828c0ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f82915a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f828c0b5950 0x7f828c13a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45398/0 (socket says 172.21.15.60:45398) 2020-10-31T22:47:08.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f82915a0700 1 -- 172.21.15.60:0/1624478869 learned_addr learned my addr 172.21.15.60:0/1624478869 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:08.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f82915a0700 1 -- 172.21.15.60:0/1624478869 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f828c0b24a0 msgr2=0x7f828c0ac590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f82915a0700 1 --2- 172.21.15.60:0/1624478869 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f828c0b24a0 0x7f828c0ac590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f82915a0700 1 -- 172.21.15.60:0/1624478869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c0b5570 msgr2=0x7f828c154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f82915a0700 1 --2- 172.21.15.60:0/1624478869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c0b5570 0x7f828c154560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f82915a0700 1 -- 172.21.15.60:0/1624478869 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c13ffe0 con 0x7f828c0b5950 2020-10-31T22:47:08.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f82915a0700 1 --2- 172.21.15.60:0/1624478869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f828c0b5950 0x7f828c13a840 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f828c05f580 tx=0x7f8284015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:08.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f8289ffb700 1 -- 172.21.15.60:0/1624478869 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8284011ac0 con 0x7f828c0b5950 2020-10-31T22:47:08.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f8289ffb700 1 -- 172.21.15.60:0/1624478869 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284011c20 con 0x7f828c0b5950 2020-10-31T22:47:08.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f8289ffb700 1 -- 172.21.15.60:0/1624478869 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f828401d450 con 0x7f828c0b5950 2020-10-31T22:47:08.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f8291da1700 1 -- 172.21.15.60:0/1624478869 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c140280 con 0x7f828c0b5950 2020-10-31T22:47:08.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f8291da1700 1 -- 172.21.15.60:0/1624478869 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c0aeac0 con 0x7f828c0b5950 2020-10-31T22:47:08.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f8291da1700 1 -- 172.21.15.60:0/1624478869 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c057100 con 0x7f828c0b5950 2020-10-31T22:47:08.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.232+0000 7f8289ffb700 1 -- 172.21.15.60:0/1624478869 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f828400f070 con 0x7f828c0b5950 2020-10-31T22:47:08.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.236+0000 7f8289ffb700 1 --2- 172.21.15.60:0/1624478869 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8270054f90 0x7f8270057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.236+0000 7f8289ffb700 1 -- 172.21.15.60:0/1624478869 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f828406e7f0 con 0x7f828c0b5950 2020-10-31T22:47:08.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.236+0000 7f8290d9f700 1 --2- 172.21.15.60:0/1624478869 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8270054f90 0x7f8270057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.236+0000 7f8290d9f700 1 --2- 172.21.15.60:0/1624478869 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8270054f90 0x7f8270057450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f827c00d000 tx=0x7f827c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:08.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.240+0000 7f8289ffb700 1 -- 172.21.15.60:0/1624478869 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8284044c70 con 0x7f828c0b5950 2020-10-31T22:47:08.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.432+0000 7f8291da1700 1 -- 172.21.15.60:0/1624478869 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f828c05a8e0 con 0x7f828c0b5950 2020-10-31T22:47:08.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.432+0000 7f8289ffb700 1 -- 172.21.15.60:0/1624478869 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+2487 (secure 0 0 0) 0x7f8284022020 con 0x7f828c0b5950 2020-10-31T22:47:08.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.432+0000 7f8291da1700 1 -- 172.21.15.60:0/1624478869 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8270054f90 msgr2=0x7f8270057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.432+0000 7f8291da1700 1 --2- 172.21.15.60:0/1624478869 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8270054f90 0x7f8270057450 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f827c00d000 tx=0x7f827c009040).stop 2020-10-31T22:47:08.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.432+0000 7f8291da1700 1 -- 172.21.15.60:0/1624478869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f828c0b5950 msgr2=0x7f828c13a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.432+0000 7f8291da1700 1 --2- 172.21.15.60:0/1624478869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f828c0b5950 0x7f828c13a840 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 rx=0x7f828c05f580 tx=0x7f8284015000).stop 2020-10-31T22:47:08.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.432+0000 7f8291da1700 1 -- 172.21.15.60:0/1624478869 shutdown_connections 2020-10-31T22:47:08.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.432+0000 7f8291da1700 1 --2- 172.21.15.60:0/1624478869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f828c0b5950 0x7f828c13a840 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.432+0000 7f8291da1700 1 --2- 172.21.15.60:0/1624478869 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f828c0b24a0 0x7f828c0ac590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.432+0000 7f8291da1700 1 --2- 172.21.15.60:0/1624478869 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8270054f90 0x7f8270057450 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.432+0000 7f8291da1700 1 --2- 172.21.15.60:0/1624478869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f828c0b5570 0x7f828c154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.432+0000 7f8291da1700 1 -- 172.21.15.60:0/1624478869 >> 172.21.15.60:0/1624478869 conn(0x7f828c0b8e90 msgr2=0x7f828c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:08.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.432+0000 7f8291da1700 1 -- 172.21.15.60:0/1624478869 shutdown_connections 2020-10-31T22:47:08.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.432+0000 7f8291da1700 1 -- 172.21.15.60:0/1624478869 wait complete. 2020-10-31T22:47:08.446 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2020-10-31T22:47:08.446 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:08.449 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":35,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/290520151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":290520151},{"type":"v1","addr":"172.21.15.66:6833","nonce":290520151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1731313860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1731313860},{"type":"v1","addr":"172.21.15.60:6835","nonce":1731313860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:47:06.422241+0000","modified":"2020-10-31T22:47:08.068754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/265867667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":265867667},{"type":"v1","addr":"172.21.15.60:6837","nonce":265867667}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-10-31T22:47:08.451 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:47:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.564+0000 7effbda8b700 1 Processor -- start 2020-10-31T22:47:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.564+0000 7effbda8b700 1 -- start start 2020-10-31T22:47:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.564+0000 7effbda8b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7effb80b1d50 0x7effb80b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.564+0000 7effbda8b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effb80b0950 0x7effb805bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.564+0000 7effbda8b700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effb80b2130 con 0x7effb8141d80 2020-10-31T22:47:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.564+0000 7effbda8b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effb813fab0 con 0x7effb80b1d50 2020-10-31T22:47:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.564+0000 7effbda8b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb80af380 con 0x7effb80b0950 2020-10-31T22:47:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbd28a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effb80b0950 0x7effb805bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbca89700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7effb80b1d50 0x7effb80b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbd28a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effb80b0950 0x7effb805bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:58592/0 (socket says 172.21.15.60:58592) 2020-10-31T22:47:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effb7fff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7effb8141d80 0x7effb805afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:47408/0 (socket says 172.21.15.60:47408) 2020-10-31T22:47:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbd28a700 1 -- 172.21.15.60:0/2441989044 learned_addr learned my addr 172.21.15.60:0/2441989044 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbca89700 1 -- 172.21.15.60:0/2441989044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effb80b0950 msgr2=0x7effb805bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbca89700 1 --2- 172.21.15.60:0/2441989044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effb80b0950 0x7effb805bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbca89700 1 -- 172.21.15.60:0/2441989044 >> v1:172.21.15.66:6789/0 conn(0x7effb8141d80 legacy=0x7effb805afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbca89700 1 -- 172.21.15.60:0/2441989044 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb80af620 con 0x7effb80b1d50 2020-10-31T22:47:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effb77fe700 1 -- 172.21.15.60:0/2441989044 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3272015348 0 0) 0x7effb80b2130 con 0x7effb8141d80 2020-10-31T22:47:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbca89700 1 --2- 172.21.15.60:0/2441989044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effb80b1d50 0x7effb80b0000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7effa0002f30 tx=0x7effa0006dc0).ready entity=mon.1 client_cookie=2fc7de059663b266 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:08.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effb77fe700 1 -- 172.21.15.60:0/2441989044 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effa0009760 con 0x7effb80b1d50 2020-10-31T22:47:08.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effb77fe700 1 -- 172.21.15.60:0/2441989044 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa00098c0 con 0x7effb80b1d50 2020-10-31T22:47:08.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effb77fe700 1 -- 172.21.15.60:0/2441989044 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effa0009c20 con 0x7effb80b1d50 2020-10-31T22:47:08.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbda8b700 1 -- 172.21.15.60:0/2441989044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effb80b1d50 msgr2=0x7effb80b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbda8b700 1 --2- 172.21.15.60:0/2441989044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effb80b1d50 0x7effb80b0000 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7effa0002f30 tx=0x7effa0006dc0).stop 2020-10-31T22:47:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbda8b700 1 -- 172.21.15.60:0/2441989044 shutdown_connections 2020-10-31T22:47:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbda8b700 1 --2- 172.21.15.60:0/2441989044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effb80b0950 0x7effb805bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbda8b700 1 --2- 172.21.15.60:0/2441989044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effb80b1d50 0x7effb80b0000 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbda8b700 1 -- 172.21.15.60:0/2441989044 >> 172.21.15.60:0/2441989044 conn(0x7effb80b5300 msgr2=0x7effb80b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:08.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbda8b700 1 -- 172.21.15.60:0/2441989044 shutdown_connections 2020-10-31T22:47:08.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbda8b700 1 -- 172.21.15.60:0/2441989044 wait complete. 2020-10-31T22:47:08.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.568+0000 7effbda8b700 1 Processor -- start 2020-10-31T22:47:08.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbda8b700 1 -- start start 2020-10-31T22:47:08.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbda8b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb80b0950 0x7effb80addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbda8b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effb80b1d50 0x7effb80aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbda8b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effb8141d80 0x7effb8154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbda8b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb80639c0 con 0x7effb80b0950 2020-10-31T22:47:08.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbda8b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effb8062fe0 con 0x7effb8141d80 2020-10-31T22:47:08.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbda8b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effb8063280 con 0x7effb80b1d50 2020-10-31T22:47:08.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbca89700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb80b0950 0x7effb80addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbca89700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb80b0950 0x7effb80addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45408/0 (socket says 172.21.15.60:45408) 2020-10-31T22:47:08.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbca89700 1 -- 172.21.15.60:0/2408499990 learned_addr learned my addr 172.21.15.60:0/2408499990 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:08.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effb7fff700 1 --2- 172.21.15.60:0/2408499990 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effb80b1d50 0x7effb80aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbca89700 1 -- 172.21.15.60:0/2408499990 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effb80b1d50 msgr2=0x7effb80aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbca89700 1 --2- 172.21.15.60:0/2408499990 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effb80b1d50 0x7effb80aabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbca89700 1 -- 172.21.15.60:0/2408499990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effb8141d80 msgr2=0x7effb8154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbca89700 1 --2- 172.21.15.60:0/2408499990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effb8141d80 0x7effb8154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-10-31T22:47:08.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbca89700 1 -- 172.21.15.60:0/2408499990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb8063520 con 0x7effb80b0950 2020-10-31T22:47:08.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbca89700 1 --2- 172.21.15.60:0/2408499990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb80b0950 0x7effb80addc0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7effa0002f30 tx=0x7effa0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:08.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effb5ffb700 1 -- 172.21.15.60:0/2408499990 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effa00119c0 con 0x7effb80b0950 2020-10-31T22:47:08.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effb5ffb700 1 -- 172.21.15.60:0/2408499990 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa0011b20 con 0x7effb80b0950 2020-10-31T22:47:08.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbda8b700 1 -- 172.21.15.60:0/2408499990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb80ae2b0 con 0x7effb80b0950 2020-10-31T22:47:08.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effb5ffb700 1 -- 172.21.15.60:0/2408499990 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7effa0011e80 con 0x7effb80b0950 2020-10-31T22:47:08.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.572+0000 7effbda8b700 1 -- 172.21.15.60:0/2408499990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effb80ab0c0 con 0x7effb80b0950 2020-10-31T22:47:08.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.576+0000 7effb5ffb700 1 -- 172.21.15.60:0/2408499990 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7effa0024030 con 0x7effb80b0950 2020-10-31T22:47:08.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.576+0000 7effbda8b700 1 -- 172.21.15.60:0/2408499990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effb80636b0 con 0x7effb80b0950 2020-10-31T22:47:08.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.576+0000 7effb5ffb700 1 --2- 172.21.15.60:0/2408499990 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7eff9c054f90 0x7eff9c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.576+0000 7effb5ffb700 1 -- 172.21.15.60:0/2408499990 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7effa006e920 con 0x7effb80b0950 2020-10-31T22:47:08.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.576+0000 7effb7fff700 1 --2- 172.21.15.60:0/2408499990 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7eff9c054f90 0x7eff9c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.576+0000 7effb7fff700 1 --2- 172.21.15.60:0/2408499990 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7eff9c054f90 0x7eff9c057450 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7effa800d000 tx=0x7effa8007d30).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:08.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.580+0000 7effb5ffb700 1 -- 172.21.15.60:0/2408499990 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7effa0044e40 con 0x7effb80b0950 2020-10-31T22:47:08.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.720+0000 7effbda8b700 1 -- 172.21.15.60:0/2408499990 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effb8057100 con 0x7effb80b0950 2020-10-31T22:47:08.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.724+0000 7effb5ffb700 1 -- 172.21.15.60:0/2408499990 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16041 (secure 0 0 0) 0x7effa0022090 con 0x7effb80b0950 2020-10-31T22:47:08.726 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:08.727 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":76,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:47:07.425088+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:47:04.119666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-10-31T22:47:05.419686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:47:08.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.724+0000 7effbda8b700 1 -- 172.21.15.60:0/2408499990 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7eff9c054f90 msgr2=0x7eff9c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.724+0000 7effbda8b700 1 --2- 172.21.15.60:0/2408499990 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7eff9c054f90 0x7eff9c057450 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7effa800d000 tx=0x7effa8007d30).stop 2020-10-31T22:47:08.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.724+0000 7effbda8b700 1 -- 172.21.15.60:0/2408499990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb80b0950 msgr2=0x7effb80addc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.724+0000 7effbda8b700 1 --2- 172.21.15.60:0/2408499990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb80b0950 0x7effb80addc0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 rx=0x7effa0002f30 tx=0x7effa0015000).stop 2020-10-31T22:47:08.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.724+0000 7effbda8b700 1 -- 172.21.15.60:0/2408499990 shutdown_connections 2020-10-31T22:47:08.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.724+0000 7effbda8b700 1 --2- 172.21.15.60:0/2408499990 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7eff9c054f90 0x7eff9c057450 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.724+0000 7effbda8b700 1 --2- 172.21.15.60:0/2408499990 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effb8141d80 0x7effb8154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-10-31T22:47:08.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.724+0000 7effbda8b700 1 --2- 172.21.15.60:0/2408499990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7effb80b0950 0x7effb80addc0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.724+0000 7effbda8b700 1 --2- 172.21.15.60:0/2408499990 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effb80b1d50 0x7effb80aabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.724+0000 7effbda8b700 1 -- 172.21.15.60:0/2408499990 >> 172.21.15.60:0/2408499990 conn(0x7effb80b5300 msgr2=0x7effb80b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:08.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.724+0000 7effbda8b700 1 -- 172.21.15.60:0/2408499990 shutdown_connections 2020-10-31T22:47:08.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.724+0000 7effbda8b700 1 -- 172.21.15.60:0/2408499990 wait complete. 2020-10-31T22:47:08.741 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:47:08.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f310adb5700 1 Processor -- start 2020-10-31T22:47:08.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f310adb5700 1 -- start start 2020-10-31T22:47:08.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f310adb5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f31040256a0 0x7f310407fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f310adb5700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f31040801c0 0x7f3104159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f310adb5700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31040b1950 con 0x7f31040b1570 2020-10-31T22:47:08.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f310adb5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3104062720 con 0x7f31040256a0 2020-10-31T22:47:08.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f310adb5700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3104066cb0 con 0x7f31040801c0 2020-10-31T22:47:08.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f3109db3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f31040256a0 0x7f310407fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f3109db3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f31040256a0 0x7f310407fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45418/0 (socket says 172.21.15.60:45418) 2020-10-31T22:47:08.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f3109db3700 1 -- 172.21.15.60:0/4109328061 learned_addr learned my addr 172.21.15.60:0/4109328061 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:08.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f310c017700 1 --2- 172.21.15.60:0/4109328061 >> v2:172.21.15.66:3300/0 conn(0x7f31040801c0 0x7f3104159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f3109db3700 1 -- 172.21.15.60:0/4109328061 >> v2:172.21.15.66:3300/0 conn(0x7f31040801c0 msgr2=0x7f3104159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:08.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f3109db3700 1 --2- 172.21.15.60:0/4109328061 >> v2:172.21.15.66:3300/0 conn(0x7f31040801c0 0x7f3104159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f3109db3700 1 -- 172.21.15.60:0/4109328061 >> v1:172.21.15.66:6789/0 conn(0x7f31040b1570 legacy=0x7f3104024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f3109db3700 1 -- 172.21.15.60:0/4109328061 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31040aca00 con 0x7f31040256a0 2020-10-31T22:47:08.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f3109db3700 1 --2- 172.21.15.60:0/4109328061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31040256a0 0x7f310407fcd0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f30f4002f30 tx=0x7f30f4006e80).ready entity=mon.0 client_cookie=898cfd26684e3944 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:08.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f31095b2700 1 -- 172.21.15.60:0/4109328061 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f40097f0 con 0x7f31040256a0 2020-10-31T22:47:08.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f31095b2700 1 -- 172.21.15.60:0/4109328061 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f4009950 con 0x7f31040256a0 2020-10-31T22:47:08.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f31095b2700 1 -- 172.21.15.60:0/4109328061 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f4009cb0 con 0x7f31040256a0 2020-10-31T22:47:08.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f310adb5700 1 -- 172.21.15.60:0/4109328061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31040256a0 msgr2=0x7f310407fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.868+0000 7f310adb5700 1 --2- 172.21.15.60:0/4109328061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31040256a0 0x7f310407fcd0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 rx=0x7f30f4002f30 tx=0x7f30f4006e80).stop 2020-10-31T22:47:08.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.872+0000 7f310adb5700 1 -- 172.21.15.60:0/4109328061 shutdown_connections 2020-10-31T22:47:08.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.872+0000 7f310adb5700 1 --2- 172.21.15.60:0/4109328061 >> v2:172.21.15.66:3300/0 conn(0x7f31040801c0 0x7f3104159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.872+0000 7f310adb5700 1 --2- 172.21.15.60:0/4109328061 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31040256a0 0x7f310407fcd0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.872+0000 7f310adb5700 1 -- 172.21.15.60:0/4109328061 >> 172.21.15.60:0/4109328061 conn(0x7f31040b5440 msgr2=0x7f31040b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:08.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.872+0000 7f310adb5700 1 -- 172.21.15.60:0/4109328061 shutdown_connections 2020-10-31T22:47:08.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.872+0000 7f310adb5700 1 -- 172.21.15.60:0/4109328061 wait complete. 2020-10-31T22:47:08.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.872+0000 7f310adb5700 1 Processor -- start 2020-10-31T22:47:08.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.872+0000 7f310adb5700 1 -- start start 2020-10-31T22:47:08.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f310adb5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31040256a0 0x7f310412e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f310adb5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31040801c0 0x7f310407d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f310adb5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31040b1570 0x7f3104131ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f310adb5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3104143610 con 0x7f31040801c0 2020-10-31T22:47:08.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f310adb5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31041326e0 con 0x7f31040b1570 2020-10-31T22:47:08.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f310adb5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3104132980 con 0x7f31040256a0 2020-10-31T22:47:08.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f3109db3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31040801c0 0x7f310407d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f3109db3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31040801c0 0x7f310407d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45424/0 (socket says 172.21.15.60:45424) 2020-10-31T22:47:08.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f3109db3700 1 -- 172.21.15.60:0/960593059 learned_addr learned my addr 172.21.15.60:0/960593059 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:08.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f310c017700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31040b1570 0x7f3104131ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f310a5b4700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31040256a0 0x7f310412e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f3109db3700 1 -- 172.21.15.60:0/960593059 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31040256a0 msgr2=0x7f310412e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f3109db3700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31040256a0 0x7f310412e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f3109db3700 1 -- 172.21.15.60:0/960593059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31040b1570 msgr2=0x7f3104131ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:08.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f3109db3700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31040b1570 0x7f3104131ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:08.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f3109db3700 1 -- 172.21.15.60:0/960593059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3104143840 con 0x7f31040801c0 2020-10-31T22:47:08.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f310c017700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31040b1570 0x7f3104131ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:47:08.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f3109db3700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31040801c0 0x7f310407d720 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f30f4002f30 tx=0x7f30f4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:08.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f30faffd700 1 -- 172.21.15.60:0/960593059 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f4011b40 con 0x7f31040801c0 2020-10-31T22:47:08.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f30faffd700 1 -- 172.21.15.60:0/960593059 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30f4011ca0 con 0x7f31040801c0 2020-10-31T22:47:08.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f310adb5700 1 -- 172.21.15.60:0/960593059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3104132390 con 0x7f31040801c0 2020-10-31T22:47:08.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f30faffd700 1 -- 172.21.15.60:0/960593059 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30f401e460 con 0x7f31040801c0 2020-10-31T22:47:08.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f310adb5700 1 -- 172.21.15.60:0/960593059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3104143e80 con 0x7f31040801c0 2020-10-31T22:47:08.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.876+0000 7f310adb5700 1 -- 172.21.15.60:0/960593059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31041439d0 con 0x7f31040801c0 2020-10-31T22:47:08.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.880+0000 7f30faffd700 1 -- 172.21.15.60:0/960593059 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f30f4025030 con 0x7f31040801c0 2020-10-31T22:47:08.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.880+0000 7f30faffd700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30ec055020 0x7f30ec0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:08.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.880+0000 7f30faffd700 1 -- 172.21.15.60:0/960593059 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f30f406ed20 con 0x7f31040801c0 2020-10-31T22:47:08.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.880+0000 7f310a5b4700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30ec055020 0x7f30ec0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:08.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.880+0000 7f310a5b4700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30ec055020 0x7f30ec0574e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f310000d000 tx=0x7f3100000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:08.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:08.888+0000 7f30faffd700 1 -- 172.21.15.60:0/960593059 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f30f4045130 con 0x7f31040801c0 2020-10-31T22:47:09.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.080+0000 7f310adb5700 1 -- 172.21.15.60:0/960593059 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f31041444a0 con 0x7f31040801c0 2020-10-31T22:47:09.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.092+0000 7f30faffd700 1 -- 172.21.15.60:0/960593059 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v19) v1 ==== 184+0+0 (secure 0 0 0) 0x7f30f4023020 con 0x7f31040801c0 2020-10-31T22:47:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.096+0000 7f310adb5700 1 -- 172.21.15.60:0/960593059 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30ec055020 msgr2=0x7f30ec0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.096+0000 7f310adb5700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30ec055020 0x7f30ec0574e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f310000d000 tx=0x7f3100000b80).stop 2020-10-31T22:47:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.096+0000 7f310adb5700 1 -- 172.21.15.60:0/960593059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31040801c0 msgr2=0x7f310407d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.096+0000 7f310adb5700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31040801c0 0x7f310407d720 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 rx=0x7f30f4002f30 tx=0x7f30f4015000).stop 2020-10-31T22:47:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.096+0000 7f310adb5700 1 -- 172.21.15.60:0/960593059 shutdown_connections 2020-10-31T22:47:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.096+0000 7f310adb5700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30ec055020 0x7f30ec0574e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.096+0000 7f310adb5700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31040b1570 0x7f3104131ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.096+0000 7f310adb5700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31040256a0 0x7f310412e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.096+0000 7f310adb5700 1 --2- 172.21.15.60:0/960593059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31040801c0 0x7f310407d720 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.096+0000 7f310adb5700 1 -- 172.21.15.60:0/960593059 >> 172.21.15.60:0/960593059 conn(0x7f31040b5440 msgr2=0x7f310407f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.096+0000 7f310adb5700 1 -- 172.21.15.60:0/960593059 shutdown_connections 2020-10-31T22:47:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.096+0000 7f310adb5700 1 -- 172.21.15.60:0/960593059 wait complete. 2020-10-31T22:47:09.100 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2020-10-31T22:47:09.113 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:47:09.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.236+0000 7fcacb59e700 1 Processor -- start 2020-10-31T22:47:09.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.236+0000 7fcacb59e700 1 -- start start 2020-10-31T22:47:09.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.236+0000 7fcacb59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcacc0b1570 0x7fcacc024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:09.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.236+0000 7fcacb59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcacc025480 0x7fcacc07fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:09.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacb59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcacc0b1950 con 0x7fcacc0801c0 2020-10-31T22:47:09.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacb59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc025910 con 0x7fcacc0b1570 2020-10-31T22:47:09.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacb59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc062720 con 0x7fcacc025480 2020-10-31T22:47:09.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcacc0b1570 0x7fcacc024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:09.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcacc0b1570 0x7fcacc024f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45430/0 (socket says 172.21.15.60:45430) 2020-10-31T22:47:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacad9d700 1 -- 172.21.15.60:0/1744009779 learned_addr learned my addr 172.21.15.60:0/1744009779 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcad0bb8700 1 --1- 172.21.15.60:0/1744009779 >> v1:172.21.15.60:6789/0 conn(0x7fcacc0801c0 0x7fcacc0afcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49570/0 (socket says 172.21.15.60:49570) 2020-10-31T22:47:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcaca59c700 1 --2- 172.21.15.60:0/1744009779 >> v2:172.21.15.66:3300/0 conn(0x7fcacc025480 0x7fcacc07fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacad9d700 1 -- 172.21.15.60:0/1744009779 >> v2:172.21.15.66:3300/0 conn(0x7fcacc025480 msgr2=0x7fcacc07fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacad9d700 1 --2- 172.21.15.60:0/1744009779 >> v2:172.21.15.66:3300/0 conn(0x7fcacc025480 0x7fcacc07fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacad9d700 1 -- 172.21.15.60:0/1744009779 >> v1:172.21.15.60:6789/0 conn(0x7fcacc0801c0 legacy=0x7fcacc0afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:09.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacad9d700 1 -- 172.21.15.60:0/1744009779 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc066cb0 con 0x7fcacc0b1570 2020-10-31T22:47:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacad9d700 1 --2- 172.21.15.60:0/1744009779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcacc0b1570 0x7fcacc024f90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fcabc002f30 tx=0x7fcabc006e80).ready entity=mon.0 client_cookie=a4740b446b51c388 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcac9d9b700 1 -- 172.21.15.60:0/1744009779 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcabc0097f0 con 0x7fcacc0b1570 2020-10-31T22:47:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcac9d9b700 1 -- 172.21.15.60:0/1744009779 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc009950 con 0x7fcacc0b1570 2020-10-31T22:47:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcac9d9b700 1 -- 172.21.15.60:0/1744009779 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcabc009cb0 con 0x7fcacc0b1570 2020-10-31T22:47:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacb59e700 1 -- 172.21.15.60:0/1744009779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcacc0b1570 msgr2=0x7fcacc024f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacb59e700 1 --2- 172.21.15.60:0/1744009779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcacc0b1570 0x7fcacc024f90 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 rx=0x7fcabc002f30 tx=0x7fcabc006e80).stop 2020-10-31T22:47:09.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacb59e700 1 -- 172.21.15.60:0/1744009779 shutdown_connections 2020-10-31T22:47:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacb59e700 1 --2- 172.21.15.60:0/1744009779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcacc0b1570 0x7fcacc024f90 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacb59e700 1 --2- 172.21.15.60:0/1744009779 >> v2:172.21.15.66:3300/0 conn(0x7fcacc025480 0x7fcacc07fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacb59e700 1 -- 172.21.15.60:0/1744009779 >> 172.21.15.60:0/1744009779 conn(0x7fcacc0b5440 msgr2=0x7fcacc0b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacb59e700 1 -- 172.21.15.60:0/1744009779 shutdown_connections 2020-10-31T22:47:09.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.240+0000 7fcacb59e700 1 -- 172.21.15.60:0/1744009779 wait complete. 2020-10-31T22:47:09.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacb59e700 1 Processor -- start 2020-10-31T22:47:09.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacb59e700 1 -- start start 2020-10-31T22:47:09.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcacc025480 0x7fcacc1300c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:09.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacb59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcacc0801c0 0x7fcacc13cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:09.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacb59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcacc0b1570 0x7fcacc13d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:09.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc13c870 con 0x7fcacc025480 2020-10-31T22:47:09.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacb59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc132610 con 0x7fcacc0801c0 2020-10-31T22:47:09.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacb59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc13ca60 con 0x7fcacc0b1570 2020-10-31T22:47:09.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcacc025480 0x7fcacc1300c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:09.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcacc025480 0x7fcacc1300c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45436/0 (socket says 172.21.15.60:45436) 2020-10-31T22:47:09.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacad9d700 1 -- 172.21.15.60:0/990791091 learned_addr learned my addr 172.21.15.60:0/990791091 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:09.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcaca59c700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcacc0801c0 0x7fcacc13cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:09.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcad0bb8700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcacc0b1570 0x7fcacc13d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:09.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacad9d700 1 -- 172.21.15.60:0/990791091 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcacc0b1570 msgr2=0x7fcacc13d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:09.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacad9d700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcacc0b1570 0x7fcacc13d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacad9d700 1 -- 172.21.15.60:0/990791091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcacc0801c0 msgr2=0x7fcacc13cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:09.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacad9d700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcacc0801c0 0x7fcacc13cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacad9d700 1 -- 172.21.15.60:0/990791091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc0b4e40 con 0x7fcacc025480 2020-10-31T22:47:09.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcaca59c700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcacc0801c0 0x7fcacc13cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:47:09.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.244+0000 7fcacad9d700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcacc025480 0x7fcacc1300c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fcabc002f30 tx=0x7fcabc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:09.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.248+0000 7fcabb7fe700 1 -- 172.21.15.60:0/990791091 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcabc011ce0 con 0x7fcacc025480 2020-10-31T22:47:09.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.248+0000 7fcabb7fe700 1 -- 172.21.15.60:0/990791091 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc011e40 con 0x7fcacc025480 2020-10-31T22:47:09.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.248+0000 7fcacb59e700 1 -- 172.21.15.60:0/990791091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcacc12d770 con 0x7fcacc025480 2020-10-31T22:47:09.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.248+0000 7fcabb7fe700 1 -- 172.21.15.60:0/990791091 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcabc01e650 con 0x7fcacc025480 2020-10-31T22:47:09.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.248+0000 7fcacb59e700 1 -- 172.21.15.60:0/990791091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcacc130b80 con 0x7fcacc025480 2020-10-31T22:47:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.248+0000 7fcacb59e700 1 -- 172.21.15.60:0/990791091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcacc132780 con 0x7fcacc025480 2020-10-31T22:47:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.248+0000 7fcabb7fe700 1 -- 172.21.15.60:0/990791091 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fcabc025030 con 0x7fcacc025480 2020-10-31T22:47:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.248+0000 7fcabb7fe700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcab0055020 0x7fcab00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:09.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.248+0000 7fcabb7fe700 1 -- 172.21.15.60:0/990791091 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcabc06ed80 con 0x7fcacc025480 2020-10-31T22:47:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.248+0000 7fcaca59c700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcab0055020 0x7fcab00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.248+0000 7fcaca59c700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcab0055020 0x7fcab00574e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fcac000b000 tx=0x7fcac0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:09.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.252+0000 7fcabb7fe700 1 -- 172.21.15.60:0/990791091 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcacc132780 con 0x7fcacc025480 2020-10-31T22:47:09.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.444+0000 7fcacb59e700 1 -- 172.21.15.60:0/990791091 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fcacc132780 con 0x7fcacc025480 2020-10-31T22:47:09.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.452+0000 7fcabb7fe700 1 -- 172.21.15.60:0/990791091 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v20) v1 ==== 184+0+0 (secure 0 0 0) 0x7fcacc132780 con 0x7fcacc025480 2020-10-31T22:47:09.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.456+0000 7fcacb59e700 1 -- 172.21.15.60:0/990791091 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcab0055020 msgr2=0x7fcab00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:09.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.456+0000 7fcacb59e700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcab0055020 0x7fcab00574e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fcac000b000 tx=0x7fcac0008040).stop 2020-10-31T22:47:09.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.456+0000 7fcacb59e700 1 -- 172.21.15.60:0/990791091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcacc025480 msgr2=0x7fcacc1300c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:09.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.456+0000 7fcacb59e700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcacc025480 0x7fcacc1300c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 rx=0x7fcabc002f30 tx=0x7fcabc015000).stop 2020-10-31T22:47:09.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.456+0000 7fcacb59e700 1 -- 172.21.15.60:0/990791091 shutdown_connections 2020-10-31T22:47:09.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.456+0000 7fcacb59e700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcacc0b1570 0x7fcacc13d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.456+0000 7fcacb59e700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcacc025480 0x7fcacc1300c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.456+0000 7fcacb59e700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcab0055020 0x7fcab00574e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.456+0000 7fcacb59e700 1 --2- 172.21.15.60:0/990791091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcacc0801c0 0x7fcacc13cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.456+0000 7fcacb59e700 1 -- 172.21.15.60:0/990791091 >> 172.21.15.60:0/990791091 conn(0x7fcacc0b5440 msgr2=0x7fcacc07f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:09.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.456+0000 7fcacb59e700 1 -- 172.21.15.60:0/990791091 shutdown_connections 2020-10-31T22:47:09.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.456+0000 7fcacb59e700 1 -- 172.21.15.60:0/990791091 wait complete. 2020-10-31T22:47:09.459 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.1 2020-10-31T22:47:09.470 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:47:09.582 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.580+0000 7ff407fff700 1 Processor -- start 2020-10-31T22:47:09.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.580+0000 7ff407fff700 1 -- start start 2020-10-31T22:47:09.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.580+0000 7ff407fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40805f3c0 0x7ff40805f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:09.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.580+0000 7ff407fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff4080b2cc0 0x7ff408141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:09.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.580+0000 7ff407fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4080b31d0 con 0x7ff40813f230 2020-10-31T22:47:09.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.580+0000 7ff407fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4080b3e50 con 0x7ff4080b2cc0 2020-10-31T22:47:09.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.580+0000 7ff407fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4080b3470 con 0x7ff40805f3c0 2020-10-31T22:47:09.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff4077fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff40813f230 0x7ff4080659e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49584/0 (socket says 172.21.15.60:49584) 2020-10-31T22:47:09.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff4077fe700 1 -- 172.21.15.60:0/3033539613 learned_addr learned my addr 172.21.15.60:0/3033539613 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:09.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff4067fc700 1 --2- 172.21.15.60:0/3033539613 >> v2:172.21.15.66:3300/0 conn(0x7ff4080b2cc0 0x7ff408141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:09.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff406ffd700 1 --2- 172.21.15.60:0/3033539613 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40805f3c0 0x7ff40805f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:09.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff405ffb700 1 -- 172.21.15.60:0/3033539613 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410755364 0 0) 0x7ff4080b31d0 con 0x7ff40813f230 2020-10-31T22:47:09.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff405ffb700 1 -- 172.21.15.60:0/3033539613 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3f0003230 con 0x7ff40813f230 2020-10-31T22:47:09.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff405ffb700 1 -- 172.21.15.60:0/3033539613 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4181183993 0 0) 0x7ff3f0003230 con 0x7ff40813f230 2020-10-31T22:47:09.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff4067fc700 1 -- 172.21.15.60:0/3033539613 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40805f3c0 msgr2=0x7ff40805f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:09.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff4067fc700 1 --2- 172.21.15.60:0/3033539613 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40805f3c0 0x7ff40805f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff4067fc700 1 -- 172.21.15.60:0/3033539613 >> v1:172.21.15.60:6789/0 conn(0x7ff40813f230 legacy=0x7ff4080659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:09.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff4067fc700 1 -- 172.21.15.60:0/3033539613 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080b3710 con 0x7ff4080b2cc0 2020-10-31T22:47:09.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff4067fc700 1 --2- 172.21.15.60:0/3033539613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4080b2cc0 0x7ff408141d50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7ff400001c40 tx=0x7ff3f8006dc0).ready entity=mon.1 client_cookie=36f59b38116d41dc server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:09.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff405ffb700 1 -- 172.21.15.60:0/3033539613 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff400001aa0 con 0x7ff4080b2cc0 2020-10-31T22:47:09.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff405ffb700 1 -- 172.21.15.60:0/3033539613 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f800d570 con 0x7ff4080b2cc0 2020-10-31T22:47:09.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff405ffb700 1 -- 172.21.15.60:0/3033539613 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3f800d6e0 con 0x7ff4080b2cc0 2020-10-31T22:47:09.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff407fff700 1 -- 172.21.15.60:0/3033539613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4080b2cc0 msgr2=0x7ff408141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:09.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff407fff700 1 --2- 172.21.15.60:0/3033539613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4080b2cc0 0x7ff408141d50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7ff400001c40 tx=0x7ff3f8006dc0).stop 2020-10-31T22:47:09.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff407fff700 1 -- 172.21.15.60:0/3033539613 shutdown_connections 2020-10-31T22:47:09.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff407fff700 1 --2- 172.21.15.60:0/3033539613 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40805f3c0 0x7ff40805f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff407fff700 1 --2- 172.21.15.60:0/3033539613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4080b2cc0 0x7ff408141d50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff407fff700 1 -- 172.21.15.60:0/3033539613 >> 172.21.15.60:0/3033539613 conn(0x7ff4080b83f0 msgr2=0x7ff4080b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:09.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff407fff700 1 -- 172.21.15.60:0/3033539613 shutdown_connections 2020-10-31T22:47:09.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.584+0000 7ff407fff700 1 -- 172.21.15.60:0/3033539613 wait complete. 2020-10-31T22:47:09.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff407fff700 1 Processor -- start 2020-10-31T22:47:09.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff407fff700 1 -- start start 2020-10-31T22:47:09.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff407fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40805f3c0 0x7ff408145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:09.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff407fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4080b2cc0 0x7ff40813e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:09.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff407fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff40813f230 0x7ff40813ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:09.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff407fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4081432d0 con 0x7ff40813f230 2020-10-31T22:47:09.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff407fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff408143570 con 0x7ff4080b2cc0 2020-10-31T22:47:09.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff407fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff408145800 con 0x7ff40805f3c0 2020-10-31T22:47:09.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff4077fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff40813f230 0x7ff40813ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:09.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff4077fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff40813f230 0x7ff40813ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45454/0 (socket says 172.21.15.60:45454) 2020-10-31T22:47:09.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff4077fe700 1 -- 172.21.15.60:0/2397038834 learned_addr learned my addr 172.21.15.60:0/2397038834 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:09.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff4067fc700 1 --2- 172.21.15.60:0/2397038834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4080b2cc0 0x7ff40813e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:09.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff406ffd700 1 --2- 172.21.15.60:0/2397038834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40805f3c0 0x7ff408145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:09.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff4077fe700 1 -- 172.21.15.60:0/2397038834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40805f3c0 msgr2=0x7ff408145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:09.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff4077fe700 1 --2- 172.21.15.60:0/2397038834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40805f3c0 0x7ff408145dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff4077fe700 1 -- 172.21.15.60:0/2397038834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4080b2cc0 msgr2=0x7ff40813e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:09.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff4077fe700 1 --2- 172.21.15.60:0/2397038834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4080b2cc0 0x7ff40813e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff4077fe700 1 -- 172.21.15.60:0/2397038834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4080ac660 con 0x7ff40813f230 2020-10-31T22:47:09.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff4077fe700 1 --2- 172.21.15.60:0/2397038834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff40813f230 0x7ff40813ed10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7ff400001d00 tx=0x7ff400002200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:09.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff3fffff700 1 -- 172.21.15.60:0/2397038834 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff400004ad0 con 0x7ff40813f230 2020-10-31T22:47:09.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff3fffff700 1 -- 172.21.15.60:0/2397038834 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff400004c30 con 0x7ff40813f230 2020-10-31T22:47:09.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff407fff700 1 -- 172.21.15.60:0/2397038834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4080aeaf0 con 0x7ff40813f230 2020-10-31T22:47:09.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff3fffff700 1 -- 172.21.15.60:0/2397038834 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff400007170 con 0x7ff40813f230 2020-10-31T22:47:09.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.588+0000 7ff407fff700 1 -- 172.21.15.60:0/2397038834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4080ad8a0 con 0x7ff40813f230 2020-10-31T22:47:09.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.592+0000 7ff407fff700 1 -- 172.21.15.60:0/2397038834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff408057100 con 0x7ff40813f230 2020-10-31T22:47:09.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.592+0000 7ff3fffff700 1 -- 172.21.15.60:0/2397038834 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff400010070 con 0x7ff40813f230 2020-10-31T22:47:09.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.592+0000 7ff3fffff700 1 --2- 172.21.15.60:0/2397038834 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff3e4054f10 0x7ff3e40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:09.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.592+0000 7ff3fffff700 1 -- 172.21.15.60:0/2397038834 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff40006d680 con 0x7ff40813f230 2020-10-31T22:47:09.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.592+0000 7ff406ffd700 1 --2- 172.21.15.60:0/2397038834 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff3e4054f10 0x7ff3e40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:09.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.592+0000 7ff406ffd700 1 --2- 172.21.15.60:0/2397038834 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff3e4054f10 0x7ff3e40573d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7ff3f400b000 tx=0x7ff3f4006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:09.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.600+0000 7ff3fffff700 1 -- 172.21.15.60:0/2397038834 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff400043b00 con 0x7ff40813f230 2020-10-31T22:47:09.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.788+0000 7ff407fff700 1 -- 172.21.15.60:0/2397038834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff40805a870 con 0x7ff40813f230 2020-10-31T22:47:09.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.788+0000 7ff3fffff700 1 -- 172.21.15.60:0/2397038834 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+2487 (secure 0 0 0) 0x7ff400047120 con 0x7ff40813f230 2020-10-31T22:47:09.790 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:09.790 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":35,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/290520151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":290520151},{"type":"v1","addr":"172.21.15.66:6833","nonce":290520151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1731313860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1731313860},{"type":"v1","addr":"172.21.15.60:6835","nonce":1731313860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:47:06.422241+0000","modified":"2020-10-31T22:47:08.068754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/265867667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":265867667},{"type":"v1","addr":"172.21.15.60:6837","nonce":265867667}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-10-31T22:47:09.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.788+0000 7ff407fff700 1 -- 172.21.15.60:0/2397038834 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff3e4054f10 msgr2=0x7ff3e40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:09.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.788+0000 7ff407fff700 1 --2- 172.21.15.60:0/2397038834 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff3e4054f10 0x7ff3e40573d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7ff3f400b000 tx=0x7ff3f4006dc0).stop 2020-10-31T22:47:09.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.788+0000 7ff407fff700 1 -- 172.21.15.60:0/2397038834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff40813f230 msgr2=0x7ff40813ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:09.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.788+0000 7ff407fff700 1 --2- 172.21.15.60:0/2397038834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff40813f230 0x7ff40813ed10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 rx=0x7ff400001d00 tx=0x7ff400002200).stop 2020-10-31T22:47:09.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.788+0000 7ff407fff700 1 -- 172.21.15.60:0/2397038834 shutdown_connections 2020-10-31T22:47:09.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.788+0000 7ff407fff700 1 --2- 172.21.15.60:0/2397038834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff40813f230 0x7ff40813ed10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.788+0000 7ff407fff700 1 --2- 172.21.15.60:0/2397038834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff40805f3c0 0x7ff408145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.788+0000 7ff407fff700 1 --2- 172.21.15.60:0/2397038834 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff3e4054f10 0x7ff3e40573d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.788+0000 7ff407fff700 1 --2- 172.21.15.60:0/2397038834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4080b2cc0 0x7ff40813e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:09.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.788+0000 7ff407fff700 1 -- 172.21.15.60:0/2397038834 >> 172.21.15.60:0/2397038834 conn(0x7ff4080b83f0 msgr2=0x7ff40813fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:09.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.788+0000 7ff407fff700 1 -- 172.21.15.60:0/2397038834 shutdown_connections 2020-10-31T22:47:09.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:09.788+0000 7ff407fff700 1 -- 172.21.15.60:0/2397038834 wait complete. 2020-10-31T22:47:09.793 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2020-10-31T22:47:10.108 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:47:06.422241+0000', 'modified': '2020-10-31T22:47:08.068754+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6174}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6174': {'gid': 6174, 'name': 'a', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/265867667', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 265867667}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 265867667}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:47:10.109 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:47:10.109 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-10-31T22:47:10.244 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":6174,"want_state":"up:active","state":"up:active","rank_uptime":3.8094078599999999,"mdsmap_epoch":35,"osdmap_epoch":76,"osdmap_epoch_barrier":76,"uptime":9.0593604560000003} 2020-10-31T22:47:10.248 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 6174, "mdsmap_epoch": 35, "osdmap_epoch": 76, "osdmap_epoch_barrier": 76, "rank_uptime": 3.80940786, "state": "up:active", "uptime": 9.059360456, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:47:10.249 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:47:10.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec64805700 1 Processor -- start 2020-10-31T22:47:10.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec64805700 1 -- start start 2020-10-31T22:47:10.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec64805700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec600af520 0x7fec600ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec64805700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fec60066c90 0x7fec600670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec64805700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec600af900 con 0x7fec60146060 2020-10-31T22:47:10.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec64805700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec600afc10 con 0x7fec60066c90 2020-10-31T22:47:10.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec64805700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec6005bb70 con 0x7fec600af520 2020-10-31T22:47:10.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec5ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fec60146060 0x7fec60149620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49598/0 (socket says 172.21.15.60:49598) 2020-10-31T22:47:10.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec5ffff700 1 -- 172.21.15.60:0/526694581 learned_addr learned my addr 172.21.15.60:0/526694581 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:10.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec5f7fe700 1 --2- 172.21.15.60:0/526694581 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec600af520 0x7fec600ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec56ffd700 1 --2- 172.21.15.60:0/526694581 >> v2:172.21.15.66:3300/0 conn(0x7fec60066c90 0x7fec600670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec5effd700 1 -- 172.21.15.60:0/526694581 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971670259 0 0) 0x7fec600af900 con 0x7fec60146060 2020-10-31T22:47:10.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec5effd700 1 -- 172.21.15.60:0/526694581 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec40003230 con 0x7fec60146060 2020-10-31T22:47:10.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec5f7fe700 1 -- 172.21.15.60:0/526694581 >> v2:172.21.15.66:3300/0 conn(0x7fec60066c90 msgr2=0x7fec600670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:10.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec5f7fe700 1 --2- 172.21.15.60:0/526694581 >> v2:172.21.15.66:3300/0 conn(0x7fec60066c90 0x7fec600670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec5f7fe700 1 -- 172.21.15.60:0/526694581 >> v1:172.21.15.60:6789/0 conn(0x7fec60146060 legacy=0x7fec60149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec5f7fe700 1 -- 172.21.15.60:0/526694581 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec600ac130 con 0x7fec600af520 2020-10-31T22:47:10.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec5f7fe700 1 --2- 172.21.15.60:0/526694581 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec600af520 0x7fec600ac870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fec50002f30 tx=0x7fec50006dc0).ready entity=mon.2 client_cookie=dd52d963df34766b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:10.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec5effd700 1 -- 172.21.15.60:0/526694581 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec500096a0 con 0x7fec600af520 2020-10-31T22:47:10.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec5effd700 1 -- 172.21.15.60:0/526694581 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec50009800 con 0x7fec600af520 2020-10-31T22:47:10.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec5effd700 1 -- 172.21.15.60:0/526694581 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec50009b60 con 0x7fec600af520 2020-10-31T22:47:10.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec64805700 1 -- 172.21.15.60:0/526694581 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec600af520 msgr2=0x7fec600ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec64805700 1 --2- 172.21.15.60:0/526694581 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec600af520 0x7fec600ac870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fec50002f30 tx=0x7fec50006dc0).stop 2020-10-31T22:47:10.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec64805700 1 -- 172.21.15.60:0/526694581 shutdown_connections 2020-10-31T22:47:10.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec64805700 1 --2- 172.21.15.60:0/526694581 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec600af520 0x7fec600ac870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec64805700 1 --2- 172.21.15.60:0/526694581 >> v2:172.21.15.66:3300/0 conn(0x7fec60066c90 0x7fec600670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec64805700 1 -- 172.21.15.60:0/526694581 >> 172.21.15.60:0/526694581 conn(0x7fec600b3fd0 msgr2=0x7fec600b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:10.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.360+0000 7fec64805700 1 -- 172.21.15.60:0/526694581 shutdown_connections 2020-10-31T22:47:10.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec64805700 1 -- 172.21.15.60:0/526694581 wait complete. 2020-10-31T22:47:10.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec64805700 1 Processor -- start 2020-10-31T22:47:10.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec64805700 1 -- start start 2020-10-31T22:47:10.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec64805700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec60066c90 0x7fec60149810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec64805700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec600af520 0x7fec60148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec64805700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec60146060 0x7fec601584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec64805700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec60154f70 con 0x7fec60066c90 2020-10-31T22:47:10.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec64805700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec600aa850 con 0x7fec60146060 2020-10-31T22:47:10.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec64805700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec60155160 con 0x7fec600af520 2020-10-31T22:47:10.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec5f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec60066c90 0x7fec60149810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec5f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec60066c90 0x7fec60149810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45464/0 (socket says 172.21.15.60:45464) 2020-10-31T22:47:10.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec5f7fe700 1 -- 172.21.15.60:0/2139771002 learned_addr learned my addr 172.21.15.60:0/2139771002 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:10.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec56ffd700 1 --2- 172.21.15.60:0/2139771002 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec600af520 0x7fec60148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec5ffff700 1 --2- 172.21.15.60:0/2139771002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec60146060 0x7fec601584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec5f7fe700 1 -- 172.21.15.60:0/2139771002 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec600af520 msgr2=0x7fec60148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec5f7fe700 1 --2- 172.21.15.60:0/2139771002 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec600af520 0x7fec60148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec5f7fe700 1 -- 172.21.15.60:0/2139771002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec60146060 msgr2=0x7fec601584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec5f7fe700 1 --2- 172.21.15.60:0/2139771002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec60146060 0x7fec601584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec5f7fe700 1 -- 172.21.15.60:0/2139771002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec601490d0 con 0x7fec60066c90 2020-10-31T22:47:10.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec5f7fe700 1 --2- 172.21.15.60:0/2139771002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec60066c90 0x7fec60149810 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fec50002f30 tx=0x7fec50015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:10.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec5d7fa700 1 -- 172.21.15.60:0/2139771002 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec50011c30 con 0x7fec60066c90 2020-10-31T22:47:10.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec64805700 1 -- 172.21.15.60:0/2139771002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec60149370 con 0x7fec60066c90 2020-10-31T22:47:10.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec5d7fa700 1 -- 172.21.15.60:0/2139771002 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec50011d90 con 0x7fec60066c90 2020-10-31T22:47:10.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec64805700 1 -- 172.21.15.60:0/2139771002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec6014a9c0 con 0x7fec60066c90 2020-10-31T22:47:10.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.364+0000 7fec5d7fa700 1 -- 172.21.15.60:0/2139771002 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec5001d640 con 0x7fec60066c90 2020-10-31T22:47:10.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.368+0000 7fec64805700 1 -- 172.21.15.60:0/2139771002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec60155320 con 0x7fec60066c90 2020-10-31T22:47:10.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.368+0000 7fec5d7fa700 1 -- 172.21.15.60:0/2139771002 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fec50024030 con 0x7fec60066c90 2020-10-31T22:47:10.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.368+0000 7fec5d7fa700 1 --2- 172.21.15.60:0/2139771002 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fec44055020 0x7fec440574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.368+0000 7fec5d7fa700 1 -- 172.21.15.60:0/2139771002 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fec5006eab0 con 0x7fec60066c90 2020-10-31T22:47:10.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.368+0000 7fec56ffd700 1 --2- 172.21.15.60:0/2139771002 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fec44055020 0x7fec440574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.368+0000 7fec56ffd700 1 --2- 172.21.15.60:0/2139771002 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fec44055020 0x7fec440574e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fec4800b000 tx=0x7fec48006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:10.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.376+0000 7fec5d7fa700 1 -- 172.21.15.60:0/2139771002 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fec50044fe0 con 0x7fec60066c90 2020-10-31T22:47:10.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.520+0000 7fec64805700 1 -- 172.21.15.60:0/2139771002 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec60057100 con 0x7fec60066c90 2020-10-31T22:47:10.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.524+0000 7fec5d7fa700 1 -- 172.21.15.60:0/2139771002 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16041 (secure 0 0 0) 0x7fec5002fec0 con 0x7fec60066c90 2020-10-31T22:47:10.525 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:10.525 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":76,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:47:07.425088+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:47:04.119666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-10-31T22:47:05.419686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:47:10.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.524+0000 7fec64805700 1 -- 172.21.15.60:0/2139771002 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fec44055020 msgr2=0x7fec440574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.524+0000 7fec64805700 1 --2- 172.21.15.60:0/2139771002 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fec44055020 0x7fec440574e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fec4800b000 tx=0x7fec48006dc0).stop 2020-10-31T22:47:10.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.524+0000 7fec64805700 1 -- 172.21.15.60:0/2139771002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec60066c90 msgr2=0x7fec60149810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.524+0000 7fec64805700 1 --2- 172.21.15.60:0/2139771002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec60066c90 0x7fec60149810 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 rx=0x7fec50002f30 tx=0x7fec50015000).stop 2020-10-31T22:47:10.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.524+0000 7fec64805700 1 -- 172.21.15.60:0/2139771002 shutdown_connections 2020-10-31T22:47:10.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.524+0000 7fec64805700 1 --2- 172.21.15.60:0/2139771002 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fec44055020 0x7fec440574e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.524+0000 7fec64805700 1 --2- 172.21.15.60:0/2139771002 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec60146060 0x7fec601584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.524+0000 7fec64805700 1 --2- 172.21.15.60:0/2139771002 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec60066c90 0x7fec60149810 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.524+0000 7fec64805700 1 --2- 172.21.15.60:0/2139771002 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec600af520 0x7fec60148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.524+0000 7fec64805700 1 -- 172.21.15.60:0/2139771002 >> 172.21.15.60:0/2139771002 conn(0x7fec600b3fd0 msgr2=0x7fec600ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:10.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.524+0000 7fec64805700 1 -- 172.21.15.60:0/2139771002 shutdown_connections 2020-10-31T22:47:10.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.524+0000 7fec64805700 1 -- 172.21.15.60:0/2139771002 wait complete. 2020-10-31T22:47:10.543 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:47:04.119666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:47:05.419686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:47:10.544 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:47:10.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.664+0000 7f8a0f063700 1 Processor -- start 2020-10-31T22:47:10.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0f063700 1 -- start start 2020-10-31T22:47:10.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0f063700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a080b5570 0x7f8a080b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0f063700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a080b4440 con 0x7f8a08141f00 2020-10-31T22:47:10.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0f063700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a08146060 con 0x7f8a080b24a0 2020-10-31T22:47:10.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0f063700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0813f930 con 0x7f8a080b5570 2020-10-31T22:47:10.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0e862700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8a08141f00 0x7f8a08142390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49612/0 (socket says 172.21.15.60:49612) 2020-10-31T22:47:10.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0e862700 1 -- 172.21.15.60:0/2918459629 learned_addr learned my addr 172.21.15.60:0/2918459629 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:10.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0e061700 1 --2- 172.21.15.60:0/2918459629 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a080b5570 0x7f8a080b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0d05f700 1 -- 172.21.15.60:0/2918459629 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153365253 0 0) 0x7f8a080b4440 con 0x7f8a08141f00 2020-10-31T22:47:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0d05f700 1 -- 172.21.15.60:0/2918459629 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89f0003230 con 0x7f8a08141f00 2020-10-31T22:47:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0d05f700 1 -- 172.21.15.60:0/2918459629 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775816468 0 0) 0x7f8a08146060 con 0x7f8a080b24a0 2020-10-31T22:47:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0d05f700 1 -- 172.21.15.60:0/2918459629 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a080b4440 con 0x7f8a080b24a0 2020-10-31T22:47:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0e061700 1 -- 172.21.15.60:0/2918459629 >> v1:172.21.15.66:6789/0 conn(0x7f8a080b24a0 legacy=0x7f8a08145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0e061700 1 -- 172.21.15.60:0/2918459629 >> v1:172.21.15.60:6789/0 conn(0x7f8a08141f00 legacy=0x7f8a08142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0e061700 1 -- 172.21.15.60:0/2918459629 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a08142aa0 con 0x7f8a080b5570 2020-10-31T22:47:10.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0e061700 1 --2- 172.21.15.60:0/2918459629 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a080b5570 0x7f8a080b5950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f89fc002f30 tx=0x7f89fc006dc0).ready entity=mon.2 client_cookie=6ea85fc925b144da server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0d05f700 1 -- 172.21.15.60:0/2918459629 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89fc009730 con 0x7f8a080b5570 2020-10-31T22:47:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0d05f700 1 -- 172.21.15.60:0/2918459629 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc009890 con 0x7f8a080b5570 2020-10-31T22:47:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0d05f700 1 -- 172.21.15.60:0/2918459629 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89fc009bf0 con 0x7f8a080b5570 2020-10-31T22:47:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0f063700 1 -- 172.21.15.60:0/2918459629 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a080b5570 msgr2=0x7f8a080b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.668+0000 7f8a0f063700 1 --2- 172.21.15.60:0/2918459629 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a080b5570 0x7f8a080b5950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f89fc002f30 tx=0x7f89fc006dc0).stop 2020-10-31T22:47:10.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 -- 172.21.15.60:0/2918459629 shutdown_connections 2020-10-31T22:47:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 --2- 172.21.15.60:0/2918459629 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a080b5570 0x7f8a080b5950 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 -- 172.21.15.60:0/2918459629 >> 172.21.15.60:0/2918459629 conn(0x7f8a080b8e90 msgr2=0x7f8a080b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 -- 172.21.15.60:0/2918459629 shutdown_connections 2020-10-31T22:47:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 -- 172.21.15.60:0/2918459629 wait complete. 2020-10-31T22:47:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 Processor -- start 2020-10-31T22:47:10.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 -- start start 2020-10-31T22:47:10.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080b24a0 0x7f8a081445b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a080b5570 0x7f8a08144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a08141f00 0x7f8a080aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a081542c0 con 0x7f8a080b24a0 2020-10-31T22:47:10.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080b70d0 con 0x7f8a080b5570 2020-10-31T22:47:10.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080b7370 con 0x7f8a08141f00 2020-10-31T22:47:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0e061700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080b24a0 0x7f8a081445b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0e061700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080b24a0 0x7f8a081445b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45478/0 (socket says 172.21.15.60:45478) 2020-10-31T22:47:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0e061700 1 -- 172.21.15.60:0/4186867924 learned_addr learned my addr 172.21.15.60:0/4186867924 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0d860700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a080b5570 0x7f8a08144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0e862700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a08141f00 0x7f8a080aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0e061700 1 -- 172.21.15.60:0/4186867924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a08141f00 msgr2=0x7f8a080aca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0e061700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a08141f00 0x7f8a080aca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0e061700 1 -- 172.21.15.60:0/4186867924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a080b5570 msgr2=0x7f8a08144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0e061700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a080b5570 0x7f8a08144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0e061700 1 -- 172.21.15.60:0/4186867924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a080b7610 con 0x7f8a080b24a0 2020-10-31T22:47:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0e862700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a08141f00 0x7f8a080aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:47:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0e061700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080b24a0 0x7f8a081445b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f89fc002f30 tx=0x7f89fc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:10.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f89fb7fe700 1 -- 172.21.15.60:0/4186867924 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89fc011c20 con 0x7f8a080b24a0 2020-10-31T22:47:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f89fb7fe700 1 -- 172.21.15.60:0/4186867924 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc011d80 con 0x7f8a080b24a0 2020-10-31T22:47:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f89fb7fe700 1 -- 172.21.15.60:0/4186867924 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89fc01d640 con 0x7f8a080b24a0 2020-10-31T22:47:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 -- 172.21.15.60:0/4186867924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a080ac670 con 0x7f8a080b24a0 2020-10-31T22:47:10.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.672+0000 7f8a0f063700 1 -- 172.21.15.60:0/4186867924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a080acf00 con 0x7f8a080b24a0 2020-10-31T22:47:10.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.676+0000 7f89fb7fe700 1 -- 172.21.15.60:0/4186867924 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f89fc024030 con 0x7f8a080b24a0 2020-10-31T22:47:10.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.676+0000 7f8a0f063700 1 -- 172.21.15.60:0/4186867924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a08057100 con 0x7f8a080b24a0 2020-10-31T22:47:10.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.676+0000 7f89fb7fe700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f89e8054f10 0x7f89e80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.676+0000 7f8a0d860700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f89e8054f10 0x7f89e80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.676+0000 7f89fb7fe700 1 -- 172.21.15.60:0/4186867924 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f89fc06ed90 con 0x7f8a080b24a0 2020-10-31T22:47:10.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.676+0000 7f8a0d860700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f89e8054f10 0x7f89e80573d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f8a0400b000 tx=0x7f8a04009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:10.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.684+0000 7f89fb7fe700 1 -- 172.21.15.60:0/4186867924 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f89fc0451a0 con 0x7f8a080b24a0 2020-10-31T22:47:10.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.828+0000 7f8a0f063700 1 -- 172.21.15.60:0/4186867924 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8a080af4b0 con 0x7f8a080b24a0 2020-10-31T22:47:10.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.828+0000 7f89fb7fe700 1 -- 172.21.15.60:0/4186867924 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v76) v1 ==== 110+0+10 (secure 0 0 0) 0x7f89fc022070 con 0x7f8a080b24a0 2020-10-31T22:47:10.831 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:47:10.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.828+0000 7f8a0f063700 1 -- 172.21.15.60:0/4186867924 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f89e8054f10 msgr2=0x7f89e80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.828+0000 7f8a0f063700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f89e8054f10 0x7f89e80573d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f8a0400b000 tx=0x7f8a04009040).stop 2020-10-31T22:47:10.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.828+0000 7f8a0f063700 1 -- 172.21.15.60:0/4186867924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080b24a0 msgr2=0x7f8a081445b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.828+0000 7f8a0f063700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080b24a0 0x7f8a081445b0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 rx=0x7f89fc002f30 tx=0x7f89fc015000).stop 2020-10-31T22:47:10.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.832+0000 7f8a0f063700 1 -- 172.21.15.60:0/4186867924 shutdown_connections 2020-10-31T22:47:10.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.832+0000 7f8a0f063700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a08141f00 0x7f8a080aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.832+0000 7f8a0f063700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a080b24a0 0x7f8a081445b0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.832+0000 7f8a0f063700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f89e8054f10 0x7f89e80573d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.832+0000 7f8a0f063700 1 --2- 172.21.15.60:0/4186867924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a080b5570 0x7f8a08144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.832+0000 7f8a0f063700 1 -- 172.21.15.60:0/4186867924 >> 172.21.15.60:0/4186867924 conn(0x7f8a080b8e90 msgr2=0x7f8a08142390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:10.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.832+0000 7f8a0f063700 1 -- 172.21.15.60:0/4186867924 shutdown_connections 2020-10-31T22:47:10.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.832+0000 7f8a0f063700 1 -- 172.21.15.60:0/4186867924 wait complete. 2020-10-31T22:47:10.844 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:47:10.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa6ab2700 1 Processor -- start 2020-10-31T22:47:10.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa6ab2700 1 -- start start 2020-10-31T22:47:10.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa6ab2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fafa0063140 0x7fafa00b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa6ab2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafa00b13c0 0x7fafa0141f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa6ab2700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa0063520 con 0x7fafa00b5040 2020-10-31T22:47:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa6ab2700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa00b5550 con 0x7fafa0063140 2020-10-31T22:47:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa6ab2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa00b57f0 con 0x7fafa00b13c0 2020-10-31T22:47:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa5ab0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fafa0063140 0x7fafa00b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa5ab0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fafa0063140 0x7fafa00b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45486/0 (socket says 172.21.15.60:45486) 2020-10-31T22:47:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa5ab0700 1 -- 172.21.15.60:0/2019462868 learned_addr learned my addr 172.21.15.60:0/2019462868 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa62b1700 1 --2- 172.21.15.60:0/2019462868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafa00b13c0 0x7fafa0141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa5ab0700 1 -- 172.21.15.60:0/2019462868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafa00b13c0 msgr2=0x7fafa0141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa5ab0700 1 --2- 172.21.15.60:0/2019462868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafa00b13c0 0x7fafa0141f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa5ab0700 1 -- 172.21.15.60:0/2019462868 >> v1:172.21.15.66:6789/0 conn(0x7fafa00b5040 legacy=0x7fafa00b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa5ab0700 1 -- 172.21.15.60:0/2019462868 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa00b5a90 con 0x7fafa0063140 2020-10-31T22:47:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa5ab0700 1 --2- 172.21.15.60:0/2019462868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa0063140 0x7fafa00b1c00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7faf980032b0 tx=0x7faf98009270).ready entity=mon.0 client_cookie=2e4f8a9216e77701 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa4aae700 1 -- 172.21.15.60:0/2019462868 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf9800bc00 con 0x7fafa0063140 2020-10-31T22:47:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa4aae700 1 -- 172.21.15.60:0/2019462868 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9800bd60 con 0x7fafa0063140 2020-10-31T22:47:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa4aae700 1 -- 172.21.15.60:0/2019462868 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf98011400 con 0x7fafa0063140 2020-10-31T22:47:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa6ab2700 1 -- 172.21.15.60:0/2019462868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa0063140 msgr2=0x7fafa00b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.964+0000 7fafa6ab2700 1 --2- 172.21.15.60:0/2019462868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa0063140 0x7fafa00b1c00 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 rx=0x7faf980032b0 tx=0x7faf98009270).stop 2020-10-31T22:47:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.968+0000 7fafa6ab2700 1 -- 172.21.15.60:0/2019462868 shutdown_connections 2020-10-31T22:47:10.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.968+0000 7fafa6ab2700 1 --2- 172.21.15.60:0/2019462868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafa00b13c0 0x7fafa0141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.968+0000 7fafa6ab2700 1 --2- 172.21.15.60:0/2019462868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa0063140 0x7fafa00b1c00 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.968+0000 7fafa6ab2700 1 -- 172.21.15.60:0/2019462868 >> 172.21.15.60:0/2019462868 conn(0x7fafa006a600 msgr2=0x7fafa0060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:10.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.968+0000 7fafa6ab2700 1 -- 172.21.15.60:0/2019462868 shutdown_connections 2020-10-31T22:47:10.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.968+0000 7fafa6ab2700 1 -- 172.21.15.60:0/2019462868 wait complete. 2020-10-31T22:47:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.968+0000 7fafa6ab2700 1 Processor -- start 2020-10-31T22:47:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.968+0000 7fafa6ab2700 1 -- start start 2020-10-31T22:47:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.968+0000 7fafa6ab2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafa0063140 0x7fafa00b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa6ab2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafa00b13c0 0x7fafa013ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa6ab2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa00b5040 0x7fafa0142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa6ab2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa0066a20 con 0x7fafa00b5040 2020-10-31T22:47:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa6ab2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa0063720 con 0x7fafa00b13c0 2020-10-31T22:47:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa6ab2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa014f390 con 0x7fafa0063140 2020-10-31T22:47:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa62b1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa00b5040 0x7fafa0142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa62b1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa00b5040 0x7fafa0142a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45496/0 (socket says 172.21.15.60:45496) 2020-10-31T22:47:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa62b1700 1 -- 172.21.15.60:0/3226409333 learned_addr learned my addr 172.21.15.60:0/3226409333 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa5ab0700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafa0063140 0x7fafa00b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa52af700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafa00b13c0 0x7fafa013ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa62b1700 1 -- 172.21.15.60:0/3226409333 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafa0063140 msgr2=0x7fafa00b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa62b1700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafa0063140 0x7fafa00b3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa62b1700 1 -- 172.21.15.60:0/3226409333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafa00b13c0 msgr2=0x7fafa013ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa62b1700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafa00b13c0 0x7fafa013ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa62b1700 1 -- 172.21.15.60:0/3226409333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa014f630 con 0x7fafa00b5040 2020-10-31T22:47:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa52af700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafa00b13c0 0x7fafa013ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:47:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa62b1700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa00b5040 0x7fafa0142a40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7faf9c00a000 tx=0x7faf9c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7faf8effd700 1 -- 172.21.15.60:0/3226409333 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf9c011850 con 0x7fafa00b5040 2020-10-31T22:47:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7faf8effd700 1 -- 172.21.15.60:0/3226409333 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c0119b0 con 0x7fafa00b5040 2020-10-31T22:47:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa6ab2700 1 -- 172.21.15.60:0/3226409333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa0063950 con 0x7fafa00b5040 2020-10-31T22:47:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7faf8effd700 1 -- 172.21.15.60:0/3226409333 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf9c011d10 con 0x7fafa00b5040 2020-10-31T22:47:10.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa6ab2700 1 -- 172.21.15.60:0/3226409333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa00640f0 con 0x7fafa00b5040 2020-10-31T22:47:10.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7fafa6ab2700 1 -- 172.21.15.60:0/3226409333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa0063ae0 con 0x7fafa00b5040 2020-10-31T22:47:10.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.972+0000 7faf8effd700 1 -- 172.21.15.60:0/3226409333 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7faf9c01c460 con 0x7fafa00b5040 2020-10-31T22:47:10.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.976+0000 7faf8effd700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf80054f90 0x7faf80057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:10.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.976+0000 7faf8effd700 1 -- 172.21.15.60:0/3226409333 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf9c06df50 con 0x7fafa00b5040 2020-10-31T22:47:10.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.976+0000 7fafa5ab0700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf80054f90 0x7faf80057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:10.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.976+0000 7fafa5ab0700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf80054f90 0x7faf80057450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7faf9801a000 tx=0x7faf98016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:10.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:10.980+0000 7faf8effd700 1 -- 172.21.15.60:0/3226409333 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7faf9c044340 con 0x7fafa00b5040 2020-10-31T22:47:11.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.124+0000 7fafa6ab2700 1 -- 172.21.15.60:0/3226409333 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fafa0057100 con 0x7fafa00b5040 2020-10-31T22:47:11.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.124+0000 7faf8effd700 1 -- 172.21.15.60:0/3226409333 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v76) v1 ==== 92+0+10 (secure 0 0 0) 0x7faf9c047960 con 0x7fafa00b5040 2020-10-31T22:47:11.128 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:47:11.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.128+0000 7fafa6ab2700 1 -- 172.21.15.60:0/3226409333 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf80054f90 msgr2=0x7faf80057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.128+0000 7fafa6ab2700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf80054f90 0x7faf80057450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7faf9801a000 tx=0x7faf98016000).stop 2020-10-31T22:47:11.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.128+0000 7fafa6ab2700 1 -- 172.21.15.60:0/3226409333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa00b5040 msgr2=0x7fafa0142a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.128+0000 7fafa6ab2700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa00b5040 0x7fafa0142a40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 rx=0x7faf9c00a000 tx=0x7faf9c008040).stop 2020-10-31T22:47:11.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.128+0000 7fafa6ab2700 1 -- 172.21.15.60:0/3226409333 shutdown_connections 2020-10-31T22:47:11.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.128+0000 7fafa6ab2700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafa00b5040 0x7fafa0142a40 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.128+0000 7fafa6ab2700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafa0063140 0x7fafa00b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.128+0000 7fafa6ab2700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf80054f90 0x7faf80057450 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.128+0000 7fafa6ab2700 1 --2- 172.21.15.60:0/3226409333 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafa00b13c0 0x7fafa013ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.128+0000 7fafa6ab2700 1 -- 172.21.15.60:0/3226409333 >> 172.21.15.60:0/3226409333 conn(0x7fafa006a600 msgr2=0x7fafa00aaa10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:11.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.128+0000 7fafa6ab2700 1 -- 172.21.15.60:0/3226409333 shutdown_connections 2020-10-31T22:47:11.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.128+0000 7fafa6ab2700 1 -- 172.21.15.60:0/3226409333 wait complete. 2020-10-31T22:47:11.142 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:47:11.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.264+0000 7f6449847700 1 Processor -- start 2020-10-31T22:47:11.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.264+0000 7f6449847700 1 -- start start 2020-10-31T22:47:11.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.264+0000 7f6449847700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64440b5380 0x7f64440ac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.264+0000 7f6449847700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f64440b0b50 0x7f64440b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.264+0000 7f6449847700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64440acd60 con 0x7f64440b1b20 2020-10-31T22:47:11.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.264+0000 7f6449847700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64440ad650 con 0x7f64440b0b50 2020-10-31T22:47:11.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.264+0000 7f6449847700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64440b5760 con 0x7f64440b5380 2020-10-31T22:47:11.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.264+0000 7f6448845700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64440b5380 0x7f64440ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.264+0000 7f6443fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f64440b0b50 0x7f64440b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.264+0000 7f6443fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f64440b0b50 0x7f64440b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:56438/0 (socket says 172.21.15.60:56438) 2020-10-31T22:47:11.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.264+0000 7f6443fff700 1 -- 172.21.15.60:0/1069107165 learned_addr learned my addr 172.21.15.60:0/1069107165 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:11.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f6443fff700 1 -- 172.21.15.60:0/1069107165 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64440b5380 msgr2=0x7f64440ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:11.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f6443fff700 1 --2- 172.21.15.60:0/1069107165 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64440b5380 0x7f64440ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f6443fff700 1 -- 172.21.15.60:0/1069107165 >> v1:172.21.15.66:6789/0 conn(0x7f64440b1b20 legacy=0x7f64440b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f6443fff700 1 -- 172.21.15.60:0/1069107165 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64440b14c0 con 0x7f64440b0b50 2020-10-31T22:47:11.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f6443fff700 1 --2- 172.21.15.60:0/1069107165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64440b0b50 0x7f64440b0fd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f642c002f30 tx=0x7f642c006e80).ready entity=mon.1 client_cookie=507bc7a49af23c34 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:11.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f64437fe700 1 -- 172.21.15.60:0/1069107165 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f642c0097f0 con 0x7f64440b0b50 2020-10-31T22:47:11.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f64437fe700 1 -- 172.21.15.60:0/1069107165 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c009950 con 0x7f64440b0b50 2020-10-31T22:47:11.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f64437fe700 1 -- 172.21.15.60:0/1069107165 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f642c009cb0 con 0x7f64440b0b50 2020-10-31T22:47:11.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f6449847700 1 -- 172.21.15.60:0/1069107165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64440b0b50 msgr2=0x7f64440b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f6449847700 1 --2- 172.21.15.60:0/1069107165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64440b0b50 0x7f64440b0fd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f642c002f30 tx=0x7f642c006e80).stop 2020-10-31T22:47:11.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f6449847700 1 -- 172.21.15.60:0/1069107165 shutdown_connections 2020-10-31T22:47:11.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f6449847700 1 --2- 172.21.15.60:0/1069107165 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64440b5380 0x7f64440ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f6449847700 1 --2- 172.21.15.60:0/1069107165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64440b0b50 0x7f64440b0fd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f6449847700 1 -- 172.21.15.60:0/1069107165 >> 172.21.15.60:0/1069107165 conn(0x7f644406a600 msgr2=0x7f6444060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:11.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f6449847700 1 -- 172.21.15.60:0/1069107165 shutdown_connections 2020-10-31T22:47:11.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.268+0000 7f6449847700 1 -- 172.21.15.60:0/1069107165 wait complete. 2020-10-31T22:47:11.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6449847700 1 Processor -- start 2020-10-31T22:47:11.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6449847700 1 -- start start 2020-10-31T22:47:11.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6449847700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64440b0b50 0x7f64440669e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6449847700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64440b1b20 0x7f64440ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6449847700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64440b5380 0x7f64440a4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6449847700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6444067580 con 0x7f64440b1b20 2020-10-31T22:47:11.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6449847700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64440a22a0 con 0x7f64440b0b50 2020-10-31T22:47:11.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6449847700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64440a24d0 con 0x7f64440b5380 2020-10-31T22:47:11.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6443fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64440b1b20 0x7f64440ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6448845700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64440b0b50 0x7f64440669e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6443fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64440b1b20 0x7f64440ab190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45508/0 (socket says 172.21.15.60:45508) 2020-10-31T22:47:11.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6443fff700 1 -- 172.21.15.60:0/2775341389 learned_addr learned my addr 172.21.15.60:0/2775341389 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:11.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6449046700 1 --2- 172.21.15.60:0/2775341389 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64440b5380 0x7f64440a4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6443fff700 1 -- 172.21.15.60:0/2775341389 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64440b5380 msgr2=0x7f64440a4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6443fff700 1 --2- 172.21.15.60:0/2775341389 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64440b5380 0x7f64440a4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6443fff700 1 -- 172.21.15.60:0/2775341389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64440b0b50 msgr2=0x7f64440669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6443fff700 1 --2- 172.21.15.60:0/2775341389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64440b0b50 0x7f64440669e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6443fff700 1 -- 172.21.15.60:0/2775341389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64440a2770 con 0x7f64440b1b20 2020-10-31T22:47:11.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6448845700 1 --2- 172.21.15.60:0/2775341389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64440b0b50 0x7f64440669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:47:11.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.272+0000 7f6443fff700 1 --2- 172.21.15.60:0/2775341389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64440b1b20 0x7f64440ab190 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f642c002f30 tx=0x7f642c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:11.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.276+0000 7f6441ffb700 1 -- 172.21.15.60:0/2775341389 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f642c011bb0 con 0x7f64440b1b20 2020-10-31T22:47:11.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.276+0000 7f6441ffb700 1 -- 172.21.15.60:0/2775341389 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c011d10 con 0x7f64440b1b20 2020-10-31T22:47:11.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.276+0000 7f6449847700 1 -- 172.21.15.60:0/2775341389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64440a2a10 con 0x7f64440b1b20 2020-10-31T22:47:11.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.276+0000 7f6441ffb700 1 -- 172.21.15.60:0/2775341389 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f642c01e650 con 0x7f64440b1b20 2020-10-31T22:47:11.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.276+0000 7f6449847700 1 -- 172.21.15.60:0/2775341389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64441541e0 con 0x7f64440b1b20 2020-10-31T22:47:11.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.276+0000 7f6449847700 1 -- 172.21.15.60:0/2775341389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64441544f0 con 0x7f64440b1b20 2020-10-31T22:47:11.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.276+0000 7f6441ffb700 1 -- 172.21.15.60:0/2775341389 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f642c025030 con 0x7f64440b1b20 2020-10-31T22:47:11.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.276+0000 7f6441ffb700 1 --2- 172.21.15.60:0/2775341389 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6428054f90 0x7f6428057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.276+0000 7f6441ffb700 1 -- 172.21.15.60:0/2775341389 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f642c06ee30 con 0x7f64440b1b20 2020-10-31T22:47:11.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.276+0000 7f6448845700 1 --2- 172.21.15.60:0/2775341389 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6428054f90 0x7f6428057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.280+0000 7f6448845700 1 --2- 172.21.15.60:0/2775341389 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6428054f90 0x7f6428057450 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f643c008000 tx=0x7f643c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:11.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.280+0000 7f6441ffb700 1 -- 172.21.15.60:0/2775341389 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f642c045350 con 0x7f64440b1b20 2020-10-31T22:47:11.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.424+0000 7f6449847700 1 -- 172.21.15.60:0/2775341389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64440a4940 con 0x7f64440b1b20 2020-10-31T22:47:11.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.424+0000 7f6441ffb700 1 -- 172.21.15.60:0/2775341389 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+10 (secure 0 0 0) 0x7f64440a4940 con 0x7f64440b1b20 2020-10-31T22:47:11.426 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:47:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.424+0000 7f6449847700 1 -- 172.21.15.60:0/2775341389 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6428054f90 msgr2=0x7f6428057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.424+0000 7f6449847700 1 --2- 172.21.15.60:0/2775341389 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6428054f90 0x7f6428057450 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f643c008000 tx=0x7f643c008040).stop 2020-10-31T22:47:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.424+0000 7f6449847700 1 -- 172.21.15.60:0/2775341389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64440b1b20 msgr2=0x7f64440ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.424+0000 7f6449847700 1 --2- 172.21.15.60:0/2775341389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64440b1b20 0x7f64440ab190 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 rx=0x7f642c002f30 tx=0x7f642c015000).stop 2020-10-31T22:47:11.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.424+0000 7f6449847700 1 -- 172.21.15.60:0/2775341389 shutdown_connections 2020-10-31T22:47:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.424+0000 7f6449847700 1 --2- 172.21.15.60:0/2775341389 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64440b5380 0x7f64440a4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.424+0000 7f6449847700 1 --2- 172.21.15.60:0/2775341389 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6428054f90 0x7f6428057450 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.424+0000 7f6449847700 1 --2- 172.21.15.60:0/2775341389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f64440b0b50 0x7f64440669e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.424+0000 7f6449847700 1 --2- 172.21.15.60:0/2775341389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64440b1b20 0x7f64440ab190 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.424+0000 7f6449847700 1 -- 172.21.15.60:0/2775341389 >> 172.21.15.60:0/2775341389 conn(0x7f644406a600 msgr2=0x7f64440ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:11.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.424+0000 7f6449847700 1 -- 172.21.15.60:0/2775341389 shutdown_connections 2020-10-31T22:47:11.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.428+0000 7f6449847700 1 -- 172.21.15.60:0/2775341389 wait complete. 2020-10-31T22:47:11.441 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:47:11.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.560+0000 7f79a55b6700 1 Processor -- start 2020-10-31T22:47:11.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.560+0000 7f79a55b6700 1 -- start start 2020-10-31T22:47:11.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f79a00af520 0x7f79a00ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a00670f0 0x7f79a0150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a00af900 con 0x7f79a0066c90 2020-10-31T22:47:11.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a00afc10 con 0x7f79a00af520 2020-10-31T22:47:11.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a005bb70 con 0x7f79a00670f0 2020-10-31T22:47:11.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f799ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f79a00af520 0x7f79a00ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f799f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f79a0066c90 0x7f79a0146060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49650/0 (socket says 172.21.15.60:49650) 2020-10-31T22:47:11.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f799f7fe700 1 -- 172.21.15.60:0/233742868 learned_addr learned my addr 172.21.15.60:0/233742868 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:11.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a4db5700 1 --2- 172.21.15.60:0/233742868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a00670f0 0x7f79a0150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f799ffff700 1 -- 172.21.15.60:0/233742868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a00670f0 msgr2=0x7f79a0150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:11.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f799ffff700 1 --2- 172.21.15.60:0/233742868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a00670f0 0x7f79a0150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f799ffff700 1 -- 172.21.15.60:0/233742868 >> v1:172.21.15.60:6789/0 conn(0x7f79a0066c90 legacy=0x7f79a0146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f799effd700 1 -- 172.21.15.60:0/233742868 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533046257 0 0) 0x7f79a00af900 con 0x7f79a0066c90 2020-10-31T22:47:11.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f799ffff700 1 -- 172.21.15.60:0/233742868 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a00ac130 con 0x7f79a00af520 2020-10-31T22:47:11.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f799ffff700 1 --2- 172.21.15.60:0/233742868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79a00af520 0x7f79a00ac870 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f79900032b0 tx=0x7f79900091a0).ready entity=mon.0 client_cookie=3d4cdd3a0d6da497 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:11.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f799effd700 1 -- 172.21.15.60:0/233742868 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f799000b9a0 con 0x7f79a00af520 2020-10-31T22:47:11.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f799effd700 1 -- 172.21.15.60:0/233742868 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799000bb00 con 0x7f79a00af520 2020-10-31T22:47:11.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f799effd700 1 -- 172.21.15.60:0/233742868 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f799000bc70 con 0x7f79a00af520 2020-10-31T22:47:11.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 -- 172.21.15.60:0/233742868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79a00af520 msgr2=0x7f79a00ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 --2- 172.21.15.60:0/233742868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79a00af520 0x7f79a00ac870 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 rx=0x7f79900032b0 tx=0x7f79900091a0).stop 2020-10-31T22:47:11.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 -- 172.21.15.60:0/233742868 shutdown_connections 2020-10-31T22:47:11.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 --2- 172.21.15.60:0/233742868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a00670f0 0x7f79a0150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 --2- 172.21.15.60:0/233742868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79a00af520 0x7f79a00ac870 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 -- 172.21.15.60:0/233742868 >> 172.21.15.60:0/233742868 conn(0x7f79a00b3fd0 msgr2=0x7f79a00b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:11.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 -- 172.21.15.60:0/233742868 shutdown_connections 2020-10-31T22:47:11.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 -- 172.21.15.60:0/233742868 wait complete. 2020-10-31T22:47:11.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 Processor -- start 2020-10-31T22:47:11.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.564+0000 7f79a55b6700 1 -- start start 2020-10-31T22:47:11.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a55b6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79a0066c90 0x7f79a0147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a55b6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a00670f0 0x7f79a00adc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a55b6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79a00af520 0x7f79a0145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a55b6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a0158330 con 0x7f79a00af520 2020-10-31T22:47:11.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a55b6700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a01585d0 con 0x7f79a0066c90 2020-10-31T22:47:11.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a55b6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a0158870 con 0x7f79a00670f0 2020-10-31T22:47:11.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a4db5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79a00af520 0x7f79a0145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a4db5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79a00af520 0x7f79a0145220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45522/0 (socket says 172.21.15.60:45522) 2020-10-31T22:47:11.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a4db5700 1 -- 172.21.15.60:0/709369255 learned_addr learned my addr 172.21.15.60:0/709369255 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:11.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f799f7fe700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a00670f0 0x7f79a00adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f799ffff700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79a0066c90 0x7f79a0147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a4db5700 1 -- 172.21.15.60:0/709369255 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a00670f0 msgr2=0x7f79a00adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a4db5700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a00670f0 0x7f79a00adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a4db5700 1 -- 172.21.15.60:0/709369255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79a0066c90 msgr2=0x7f79a0147e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a4db5700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79a0066c90 0x7f79a0147e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a4db5700 1 -- 172.21.15.60:0/709369255 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a0158b10 con 0x7f79a00af520 2020-10-31T22:47:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f799ffff700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79a0066c90 0x7f79a0147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:47:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a4db5700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79a00af520 0x7f79a0145220 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f7998006a50 tx=0x7f7998006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f799d7fa700 1 -- 172.21.15.60:0/709369255 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f799800ca10 con 0x7f79a00af520 2020-10-31T22:47:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f799d7fa700 1 -- 172.21.15.60:0/709369255 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799800cb70 con 0x7f79a00af520 2020-10-31T22:47:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a55b6700 1 -- 172.21.15.60:0/709369255 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a0158fb0 con 0x7f79a00af520 2020-10-31T22:47:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f799d7fa700 1 -- 172.21.15.60:0/709369255 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79980123f0 con 0x7f79a00af520 2020-10-31T22:47:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a55b6700 1 -- 172.21.15.60:0/709369255 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a00ae150 con 0x7f79a00af520 2020-10-31T22:47:11.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f79a55b6700 1 -- 172.21.15.60:0/709369255 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a0158ca0 con 0x7f79a00af520 2020-10-31T22:47:11.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.568+0000 7f799d7fa700 1 -- 172.21.15.60:0/709369255 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7998012550 con 0x7f79a00af520 2020-10-31T22:47:11.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.572+0000 7f799d7fa700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7978055020 0x7f79780574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.572+0000 7f799d7fa700 1 -- 172.21.15.60:0/709369255 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f799806ded0 con 0x7f79a00af520 2020-10-31T22:47:11.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.572+0000 7f799ffff700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7978055020 0x7f79780574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.572+0000 7f799ffff700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7978055020 0x7f79780574e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f7990017000 tx=0x7f7990016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:11.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.576+0000 7f799d7fa700 1 -- 172.21.15.60:0/709369255 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7998044390 con 0x7f79a00af520 2020-10-31T22:47:11.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.716+0000 7f79a55b6700 1 -- 172.21.15.60:0/709369255 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f79a0057100 con 0x7f79a00af520 2020-10-31T22:47:11.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.716+0000 7f799d7fa700 1 -- 172.21.15.60:0/709369255 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+10 (secure 0 0 0) 0x7f79980479b0 con 0x7f79a00af520 2020-10-31T22:47:11.717 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:47:11.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.716+0000 7f79a55b6700 1 -- 172.21.15.60:0/709369255 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7978055020 msgr2=0x7f79780574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.716+0000 7f79a55b6700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7978055020 0x7f79780574e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f7990017000 tx=0x7f7990016000).stop 2020-10-31T22:47:11.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.716+0000 7f79a55b6700 1 -- 172.21.15.60:0/709369255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79a00af520 msgr2=0x7f79a0145220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.716+0000 7f79a55b6700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79a00af520 0x7f79a0145220 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 rx=0x7f7998006a50 tx=0x7f7998006dc0).stop 2020-10-31T22:47:11.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.716+0000 7f79a55b6700 1 -- 172.21.15.60:0/709369255 shutdown_connections 2020-10-31T22:47:11.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.716+0000 7f79a55b6700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79a00af520 0x7f79a0145220 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.716+0000 7f79a55b6700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7978055020 0x7f79780574e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.716+0000 7f79a55b6700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79a0066c90 0x7f79a0147e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.716+0000 7f79a55b6700 1 --2- 172.21.15.60:0/709369255 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79a00670f0 0x7f79a00adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.716+0000 7f79a55b6700 1 -- 172.21.15.60:0/709369255 >> 172.21.15.60:0/709369255 conn(0x7f79a00b3fd0 msgr2=0x7f79a00b0980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:11.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.716+0000 7f79a55b6700 1 -- 172.21.15.60:0/709369255 shutdown_connections 2020-10-31T22:47:11.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.716+0000 7f79a55b6700 1 -- 172.21.15.60:0/709369255 wait complete. 2020-10-31T22:47:11.731 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:47:11.732 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:47:11.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f88430fe700 1 Processor -- start 2020-10-31T22:47:11.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f88430fe700 1 -- start start 2020-10-31T22:47:11.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f88430fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f883c05c4c0 0x7f883c05c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f88430fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f883c0b4410 0x7f883c146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f88430fe700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883c065e90 con 0x7f883c0b2e20 2020-10-31T22:47:11.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f88430fe700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883c141ef0 con 0x7f883c0b4410 2020-10-31T22:47:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f88430fe700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c066130 con 0x7f883c05c4c0 2020-10-31T22:47:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f8840e9a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f883c05c4c0 0x7f883c05c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f884169b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f883c0b4410 0x7f883c146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f8840e9a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f883c05c4c0 0x7f883c05c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:58716/0 (socket says 172.21.15.60:58716) 2020-10-31T22:47:11.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f883bfff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f883c0b2e20 0x7f883c13f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:47534/0 (socket says 172.21.15.60:47534) 2020-10-31T22:47:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f884169b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f883c0b4410 0x7f883c146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:56468/0 (socket says 172.21.15.60:56468) 2020-10-31T22:47:11.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f883bfff700 1 -- 172.21.15.60:0/2633114361 learned_addr learned my addr 172.21.15.60:0/2633114361 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f884169b700 1 -- 172.21.15.60:0/2633114361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f883c05c4c0 msgr2=0x7f883c05c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:11.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f884169b700 1 --2- 172.21.15.60:0/2633114361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f883c05c4c0 0x7f883c05c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f884169b700 1 -- 172.21.15.60:0/2633114361 >> v1:172.21.15.66:6789/0 conn(0x7f883c0b2e20 legacy=0x7f883c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f884169b700 1 -- 172.21.15.60:0/2633114361 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c0663d0 con 0x7f883c0b4410 2020-10-31T22:47:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f884169b700 1 --2- 172.21.15.60:0/2633114361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f883c0b4410 0x7f883c146020 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f8824001450 tx=0x7f8834006dc0).ready entity=mon.1 client_cookie=df6e0aede56cf90 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.844+0000 7f883b7fe700 1 -- 172.21.15.60:0/2633114361 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88340095d0 con 0x7f883c0b4410 2020-10-31T22:47:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.848+0000 7f883b7fe700 1 -- 172.21.15.60:0/2633114361 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8834009730 con 0x7f883c0b4410 2020-10-31T22:47:11.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.848+0000 7f883b7fe700 1 -- 172.21.15.60:0/2633114361 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8834009a90 con 0x7f883c0b4410 2020-10-31T22:47:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.848+0000 7f88430fe700 1 -- 172.21.15.60:0/2633114361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f883c0b4410 msgr2=0x7f883c146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.848+0000 7f88430fe700 1 --2- 172.21.15.60:0/2633114361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f883c0b4410 0x7f883c146020 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f8824001450 tx=0x7f8834006dc0).stop 2020-10-31T22:47:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.848+0000 7f88430fe700 1 -- 172.21.15.60:0/2633114361 shutdown_connections 2020-10-31T22:47:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.848+0000 7f88430fe700 1 --2- 172.21.15.60:0/2633114361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f883c0b4410 0x7f883c146020 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.848+0000 7f88430fe700 1 --2- 172.21.15.60:0/2633114361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f883c05c4c0 0x7f883c05c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.848+0000 7f88430fe700 1 -- 172.21.15.60:0/2633114361 >> 172.21.15.60:0/2633114361 conn(0x7f883c0601e0 msgr2=0x7f883c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:11.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.848+0000 7f88430fe700 1 -- 172.21.15.60:0/2633114361 shutdown_connections 2020-10-31T22:47:11.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.848+0000 7f88430fe700 1 -- 172.21.15.60:0/2633114361 wait complete. 2020-10-31T22:47:11.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.848+0000 7f88430fe700 1 Processor -- start 2020-10-31T22:47:11.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.848+0000 7f88430fe700 1 -- start start 2020-10-31T22:47:11.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f88430fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f883c05c4c0 0x7f883c0b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f88430fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f883c0b4410 0x7f883c0aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f88430fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f883c0aa260 0x7f883c150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f88430fe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0adfe0 con 0x7f883c0b4410 2020-10-31T22:47:11.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f88430fe700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0ae280 con 0x7f883c05c4c0 2020-10-31T22:47:11.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f88430fe700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883c0ae520 con 0x7f883c0aa260 2020-10-31T22:47:11.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f883bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f883c0b4410 0x7f883c0aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f883bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f883c0b4410 0x7f883c0aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45536/0 (socket says 172.21.15.60:45536) 2020-10-31T22:47:11.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f883bfff700 1 -- 172.21.15.60:0/3454363588 learned_addr learned my addr 172.21.15.60:0/3454363588 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:11.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f8840e9a700 1 --2- 172.21.15.60:0/3454363588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f883c05c4c0 0x7f883c0b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f884169b700 1 --2- 172.21.15.60:0/3454363588 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f883c0aa260 0x7f883c150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f883bfff700 1 -- 172.21.15.60:0/3454363588 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f883c0aa260 msgr2=0x7f883c150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f883bfff700 1 --2- 172.21.15.60:0/3454363588 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f883c0aa260 0x7f883c150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f883bfff700 1 -- 172.21.15.60:0/3454363588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f883c05c4c0 msgr2=0x7f883c0b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:11.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f883bfff700 1 --2- 172.21.15.60:0/3454363588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f883c05c4c0 0x7f883c0b6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:11.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f883bfff700 1 -- 172.21.15.60:0/3454363588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883c0ae7c0 con 0x7f883c0b4410 2020-10-31T22:47:11.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f883bfff700 1 --2- 172.21.15.60:0/3454363588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f883c0b4410 0x7f883c0aa890 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f8824001510 tx=0x7f8824007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:11.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f8839ffb700 1 -- 172.21.15.60:0/3454363588 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8824005b70 con 0x7f883c0b4410 2020-10-31T22:47:11.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f8839ffb700 1 -- 172.21.15.60:0/3454363588 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8824005cd0 con 0x7f883c0b4410 2020-10-31T22:47:11.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f8839ffb700 1 -- 172.21.15.60:0/3454363588 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8824007300 con 0x7f883c0b4410 2020-10-31T22:47:11.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f88430fe700 1 -- 172.21.15.60:0/3454363588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f883c151450 con 0x7f883c0b4410 2020-10-31T22:47:11.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f88430fe700 1 -- 172.21.15.60:0/3454363588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883c151980 con 0x7f883c0b4410 2020-10-31T22:47:11.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.852+0000 7f88430fe700 1 -- 172.21.15.60:0/3454363588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883c0ae950 con 0x7f883c0b4410 2020-10-31T22:47:11.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.856+0000 7f8839ffb700 1 -- 172.21.15.60:0/3454363588 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8824010030 con 0x7f883c0b4410 2020-10-31T22:47:11.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.856+0000 7f8839ffb700 1 --2- 172.21.15.60:0/3454363588 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8814054f90 0x7f8814057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.856+0000 7f8839ffb700 1 -- 172.21.15.60:0/3454363588 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f882406db70 con 0x7f883c0b4410 2020-10-31T22:47:11.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.856+0000 7f8840e9a700 1 --2- 172.21.15.60:0/3454363588 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8814054f90 0x7f8814057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.856+0000 7f8840e9a700 1 --2- 172.21.15.60:0/3454363588 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8814054f90 0x7f8814057450 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f882c00b000 tx=0x7f882c006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:11.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:11.864+0000 7f8839ffb700 1 -- 172.21.15.60:0/3454363588 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8824044090 con 0x7f883c0b4410 2020-10-31T22:47:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:12.048+0000 7f88430fe700 1 -- 172.21.15.60:0/3454363588 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f883c057100 con 0x7f883c0b4410 2020-10-31T22:47:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:12.052+0000 7f8839ffb700 1 -- 172.21.15.60:0/3454363588 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+2487 (secure 0 0 0) 0x7f88240476b0 con 0x7f883c0b4410 2020-10-31T22:47:12.052 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:12.053 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":35,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/290520151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":290520151},{"type":"v1","addr":"172.21.15.66:6833","nonce":290520151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1731313860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1731313860},{"type":"v1","addr":"172.21.15.60:6835","nonce":1731313860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:47:06.422241+0000","modified":"2020-10-31T22:47:08.068754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/265867667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":265867667},{"type":"v1","addr":"172.21.15.60:6837","nonce":265867667}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-10-31T22:47:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:12.052+0000 7f88430fe700 1 -- 172.21.15.60:0/3454363588 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8814054f90 msgr2=0x7f8814057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:12.052+0000 7f88430fe700 1 --2- 172.21.15.60:0/3454363588 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8814054f90 0x7f8814057450 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f882c00b000 tx=0x7f882c006dc0).stop 2020-10-31T22:47:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:12.052+0000 7f88430fe700 1 -- 172.21.15.60:0/3454363588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f883c0b4410 msgr2=0x7f883c0aa890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:12.052+0000 7f88430fe700 1 --2- 172.21.15.60:0/3454363588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f883c0b4410 0x7f883c0aa890 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 rx=0x7f8824001510 tx=0x7f8824007f50).stop 2020-10-31T22:47:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:12.052+0000 7f88430fe700 1 -- 172.21.15.60:0/3454363588 shutdown_connections 2020-10-31T22:47:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:12.052+0000 7f88430fe700 1 --2- 172.21.15.60:0/3454363588 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f883c0aa260 0x7f883c150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:12.052+0000 7f88430fe700 1 --2- 172.21.15.60:0/3454363588 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8814054f90 0x7f8814057450 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:12.052+0000 7f88430fe700 1 --2- 172.21.15.60:0/3454363588 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f883c05c4c0 0x7f883c0b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:12.052+0000 7f88430fe700 1 --2- 172.21.15.60:0/3454363588 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f883c0b4410 0x7f883c0aa890 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:12.052+0000 7f88430fe700 1 -- 172.21.15.60:0/3454363588 >> 172.21.15.60:0/3454363588 conn(0x7f883c0601e0 msgr2=0x7f883c1424a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:12.052+0000 7f88430fe700 1 -- 172.21.15.60:0/3454363588 shutdown_connections 2020-10-31T22:47:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:12.052+0000 7f88430fe700 1 -- 172.21.15.60:0/3454363588 wait complete. 2020-10-31T22:47:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2020-10-31T22:47:12.369 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:47:06.422241+0000', 'modified': '2020-10-31T22:47:08.068754+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6174}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6174': {'gid': 6174, 'name': 'a', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/265867667', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 265867667}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 265867667}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:47:12.370 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:47:12.370 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-10-31T22:47:12.504 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":6174,"want_state":"up:active","state":"up:active","rank_uptime":6.0688408789999997,"mdsmap_epoch":35,"osdmap_epoch":76,"osdmap_epoch_barrier":76,"uptime":11.318780393999999} 2020-10-31T22:47:12.504 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 6174, "mdsmap_epoch": 35, "osdmap_epoch": 76, "osdmap_epoch_barrier": 76, "rank_uptime": 6.068840879, "state": "up:active", "uptime": 11.318780394, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:47:12.505 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:47:12.505 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:47:12.505 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:47:12.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:12.506 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:47:12.514 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:47:12.572 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:47:12.573 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:47:12.629 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:47:12.629 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:47:12.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:12.631 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:47:12.679 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:47:12.680 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:47:12.723 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:47:12.738 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:47:12.739 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:47:12.798 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:47:12.799 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:47:12.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:12.801 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:47:12.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:47:12.798+0000 7fe80c9e30c0 -1 init, newargv = 0x561e334ad650 newargc=9ceph-fuse[13546]: starting ceph client 2020-10-31T22:47:12.803 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr: 2020-10-31T22:47:12.810 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13546]: starting fuse 2020-10-31T22:47:13.908 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:47:13.925 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:47:13.926 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:47:13.980 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:47:13.981 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:47:13.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:13.983 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:47:14.035 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:47:14.036 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:47:14.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:14.037 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:47:14.037 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:47:14.038 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:47:14.038 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:47:14.038 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:47:14.039 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:47:14.039 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:47:14.040 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:47:14.040 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:47:14.040 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:47:14.040 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:47:14.041 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:47:14.041 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:47:14.041 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:47:14.043 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:47:14.044 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:47:14.049 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:47:14.049 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:47:14.049 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:47:14.050 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:47:14.050 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:47:14.050 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:47:14.051 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:47:14.129 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.13546.asok 2020-10-31T22:47:14.133 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13546.asok 2020-10-31T22:47:14.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:14.134 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13546.asok status 2020-10-31T22:47:14.235 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:47:14.235 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:47:14.235 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:47:14.235 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:47:14.236 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:47:14.236 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:47:14.236 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:47:14.236 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "13546", 2020-10-31T22:47:14.236 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:47:14.236 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:47:14.237 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:47:14.237 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:47:14.237 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 6214, 2020-10-31T22:47:14.237 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:47:14.237 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:47:14.237 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:47:14.238 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 6214 2020-10-31T22:47:14.238 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:47:14.238 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:47:14.238 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:47:14.238 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:47:14.239 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2872377370 2020-10-31T22:47:14.239 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:47:14.239 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:47:14.239 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:47:14.239 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:47:14.239 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:47:14.240 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2872377370 2020-10-31T22:47:14.240 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:47:14.240 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.6214 172.21.15.152:0/2872377370", 2020-10-31T22:47:14.240 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/2872377370", 2020-10-31T22:47:14.240 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:47:14.240 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 35, 2020-10-31T22:47:14.240 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 76, 2020-10-31T22:47:14.241 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:47:14.241 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:47:14.241 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:47:14.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:14.246 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:47:14.246 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:47:14.254 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:47:14.255 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:47:14.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:14.256 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:47:14.314 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:47:14.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.436+0000 7f1fc4b82700 1 Processor -- start 2020-10-31T22:47:14.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.436+0000 7f1fc4b82700 1 -- start start 2020-10-31T22:47:14.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.436+0000 7f1fc4b82700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1fc00b5570 0x7f1fc00b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:14.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fc4b82700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1fc0141fe0 0x7f1fc0142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:14.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fc4b82700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc0145180 con 0x7f1fc00b24a0 2020-10-31T22:47:14.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fc4b82700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc00afae0 con 0x7f1fc0141fe0 2020-10-31T22:47:14.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fc4b82700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc0141bf0 con 0x7f1fc00b5570 2020-10-31T22:47:14.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fbffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1fc0141fe0 0x7f1fc0142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:14.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fbffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1fc0141fe0 0x7f1fc0142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45546/0 (socket says 172.21.15.60:45546) 2020-10-31T22:47:14.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fbffff700 1 -- 172.21.15.60:0/2292359447 learned_addr learned my addr 172.21.15.60:0/2292359447 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:14.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fb7fff700 1 --1- 172.21.15.60:0/2292359447 >> v1:172.21.15.60:6789/0 conn(0x7f1fc00b24a0 0x7f1fc0145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49680/0 (socket says 172.21.15.60:49680) 2020-10-31T22:47:14.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fbf7fe700 1 --2- 172.21.15.60:0/2292359447 >> v2:172.21.15.66:3300/0 conn(0x7f1fc00b5570 0x7f1fc00b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:14.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fbffff700 1 -- 172.21.15.60:0/2292359447 >> v2:172.21.15.66:3300/0 conn(0x7f1fc00b5570 msgr2=0x7f1fc00b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:14.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fbffff700 1 --2- 172.21.15.60:0/2292359447 >> v2:172.21.15.66:3300/0 conn(0x7f1fc00b5570 0x7f1fc00b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fbffff700 1 -- 172.21.15.60:0/2292359447 >> v1:172.21.15.60:6789/0 conn(0x7f1fc00b24a0 legacy=0x7f1fc0145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fbffff700 1 -- 172.21.15.60:0/2292359447 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc00b0670 con 0x7f1fc0141fe0 2020-10-31T22:47:14.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fbffff700 1 --2- 172.21.15.60:0/2292359447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0141fe0 0x7f1fc0142490 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f1fc005f580 tx=0x7f1fb8009270).ready entity=mon.0 client_cookie=bc6e26a2559f20f2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:14.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fbeffd700 1 -- 172.21.15.60:0/2292359447 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fb800bbc0 con 0x7f1fc0141fe0 2020-10-31T22:47:14.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fbeffd700 1 -- 172.21.15.60:0/2292359447 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb800bd20 con 0x7f1fc0141fe0 2020-10-31T22:47:14.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fbeffd700 1 -- 172.21.15.60:0/2292359447 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fb800be90 con 0x7f1fc0141fe0 2020-10-31T22:47:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fc4b82700 1 -- 172.21.15.60:0/2292359447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0141fe0 msgr2=0x7f1fc0142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fc4b82700 1 --2- 172.21.15.60:0/2292359447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0141fe0 0x7f1fc0142490 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 rx=0x7f1fc005f580 tx=0x7f1fb8009270).stop 2020-10-31T22:47:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fc4b82700 1 -- 172.21.15.60:0/2292359447 shutdown_connections 2020-10-31T22:47:14.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fc4b82700 1 --2- 172.21.15.60:0/2292359447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0141fe0 0x7f1fc0142490 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fc4b82700 1 --2- 172.21.15.60:0/2292359447 >> v2:172.21.15.66:3300/0 conn(0x7f1fc00b5570 0x7f1fc00b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fc4b82700 1 -- 172.21.15.60:0/2292359447 >> 172.21.15.60:0/2292359447 conn(0x7f1fc00b8e90 msgr2=0x7f1fc00b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:14.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fc4b82700 1 -- 172.21.15.60:0/2292359447 shutdown_connections 2020-10-31T22:47:14.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.440+0000 7f1fc4b82700 1 -- 172.21.15.60:0/2292359447 wait complete. 2020-10-31T22:47:14.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fc4b82700 1 Processor -- start 2020-10-31T22:47:14.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fc4b82700 1 -- start start 2020-10-31T22:47:14.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fc4b82700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00b24a0 0x7f1fc00b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:14.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fc4b82700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00b5570 0x7f1fc0150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:14.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fc4b82700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0141fe0 0x7f1fc01510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:14.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fc4b82700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc0144700 con 0x7f1fc0141fe0 2020-10-31T22:47:14.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fc4b82700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc01449a0 con 0x7f1fc00b24a0 2020-10-31T22:47:14.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fc4b82700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc0144c40 con 0x7f1fc00b5570 2020-10-31T22:47:14.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fbffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0141fe0 0x7f1fc01510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:14.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fbffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0141fe0 0x7f1fc01510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45550/0 (socket says 172.21.15.60:45550) 2020-10-31T22:47:14.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fbffff700 1 -- 172.21.15.60:0/484482311 learned_addr learned my addr 172.21.15.60:0/484482311 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:14.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fbf7fe700 1 --2- 172.21.15.60:0/484482311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00b24a0 0x7f1fc00b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:14.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fb7fff700 1 --2- 172.21.15.60:0/484482311 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00b5570 0x7f1fc0150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:14.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fbffff700 1 -- 172.21.15.60:0/484482311 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00b5570 msgr2=0x7f1fc0150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:14.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fbffff700 1 --2- 172.21.15.60:0/484482311 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00b5570 0x7f1fc0150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fbffff700 1 -- 172.21.15.60:0/484482311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00b24a0 msgr2=0x7f1fc00b1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:14.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fbffff700 1 --2- 172.21.15.60:0/484482311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00b24a0 0x7f1fc00b1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fbffff700 1 -- 172.21.15.60:0/484482311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0144ee0 con 0x7f1fc0141fe0 2020-10-31T22:47:14.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fbffff700 1 --2- 172.21.15.60:0/484482311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0141fe0 0x7f1fc01510a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f1fc005f580 tx=0x7f1fb8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:14.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fbd7fa700 1 -- 172.21.15.60:0/484482311 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fb801e610 con 0x7f1fc0141fe0 2020-10-31T22:47:14.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fbd7fa700 1 -- 172.21.15.60:0/484482311 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb801e770 con 0x7f1fc0141fe0 2020-10-31T22:47:14.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fc4b82700 1 -- 172.21.15.60:0/484482311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc0143fc0 con 0x7f1fc0141fe0 2020-10-31T22:47:14.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fbd7fa700 1 -- 172.21.15.60:0/484482311 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fb801ead0 con 0x7f1fc0141fe0 2020-10-31T22:47:14.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.444+0000 7f1fc4b82700 1 -- 172.21.15.60:0/484482311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc0144450 con 0x7f1fc0141fe0 2020-10-31T22:47:14.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.448+0000 7f1fbd7fa700 1 -- 172.21.15.60:0/484482311 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1fb800f070 con 0x7f1fc0141fe0 2020-10-31T22:47:14.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.448+0000 7f1fc4b82700 1 -- 172.21.15.60:0/484482311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc0057100 con 0x7f1fc0141fe0 2020-10-31T22:47:14.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.448+0000 7f1fbd7fa700 1 --2- 172.21.15.60:0/484482311 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa4054f10 0x7f1fa40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:14.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.448+0000 7f1fbd7fa700 1 -- 172.21.15.60:0/484482311 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1fb806f1f0 con 0x7f1fc0141fe0 2020-10-31T22:47:14.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.448+0000 7f1fbf7fe700 1 --2- 172.21.15.60:0/484482311 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa4054f10 0x7f1fa40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:14.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.448+0000 7f1fbf7fe700 1 --2- 172.21.15.60:0/484482311 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa4054f10 0x7f1fa40573d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f1fb000c000 tx=0x7f1fb0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:14.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.456+0000 7f1fbd7fa700 1 -- 172.21.15.60:0/484482311 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1fb8045750 con 0x7f1fc0141fe0 2020-10-31T22:47:14.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.600+0000 7f1fc4b82700 1 -- 172.21.15.60:0/484482311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1fc0150990 con 0x7f1fc0141fe0 2020-10-31T22:47:14.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.600+0000 7f1fbd7fa700 1 -- 172.21.15.60:0/484482311 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f1fb8015090 con 0x7f1fc0141fe0 2020-10-31T22:47:14.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.600+0000 7f1fc4b82700 1 -- 172.21.15.60:0/484482311 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa4054f10 msgr2=0x7f1fa40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:14.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.600+0000 7f1fc4b82700 1 --2- 172.21.15.60:0/484482311 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa4054f10 0x7f1fa40573d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f1fb000c000 tx=0x7f1fb0008040).stop 2020-10-31T22:47:14.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.600+0000 7f1fc4b82700 1 -- 172.21.15.60:0/484482311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0141fe0 msgr2=0x7f1fc01510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:14.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.600+0000 7f1fc4b82700 1 --2- 172.21.15.60:0/484482311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0141fe0 0x7f1fc01510a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 rx=0x7f1fc005f580 tx=0x7f1fb8016000).stop 2020-10-31T22:47:14.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.600+0000 7f1fc4b82700 1 -- 172.21.15.60:0/484482311 shutdown_connections 2020-10-31T22:47:14.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.600+0000 7f1fc4b82700 1 --2- 172.21.15.60:0/484482311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc0141fe0 0x7f1fc01510a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.600+0000 7f1fc4b82700 1 --2- 172.21.15.60:0/484482311 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa4054f10 0x7f1fa40573d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.600+0000 7f1fc4b82700 1 --2- 172.21.15.60:0/484482311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00b24a0 0x7f1fc00b1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.600+0000 7f1fc4b82700 1 --2- 172.21.15.60:0/484482311 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00b5570 0x7f1fc0150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.600+0000 7f1fc4b82700 1 -- 172.21.15.60:0/484482311 >> 172.21.15.60:0/484482311 conn(0x7f1fc00b8e90 msgr2=0x7f1fc00b36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.600+0000 7f1fc4b82700 1 -- 172.21.15.60:0/484482311 shutdown_connections 2020-10-31T22:47:14.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.600+0000 7f1fc4b82700 1 -- 172.21.15.60:0/484482311 wait complete. 2020-10-31T22:47:14.618 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:14.618 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":76,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:47:07.425088+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:47:04.119666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-10-31T22:47:05.419686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:47:14.635 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:47:04.119666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:47:05.419686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:47:14.637 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:47:14.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.764+0000 7fd8a759e700 1 Processor -- start 2020-10-31T22:47:14.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.764+0000 7fd8a759e700 1 -- start start 2020-10-31T22:47:14.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.764+0000 7fd8a759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd8a80b5570 0x7fd8a80b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:14.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.764+0000 7fd8a759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8a80b24a0 0x7fd8a8145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:14.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.764+0000 7fd8a759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a8145e40 0x7fd8a8141f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:14.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.764+0000 7fd8a759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a813f930 con 0x7fd8a80b24a0 2020-10-31T22:47:14.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.764+0000 7fd8a759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a80b4440 con 0x7fd8a80b5570 2020-10-31T22:47:14.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.764+0000 7fd8a759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a80b02f0 con 0x7fd8a8145e40 2020-10-31T22:47:14.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.764+0000 7fd8a5d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8a80b24a0 0x7fd8a8145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:14.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a5d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8a80b24a0 0x7fd8a8145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45556/0 (socket says 172.21.15.60:45556) 2020-10-31T22:47:14.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a5d9b700 1 -- 172.21.15.60:0/1715002819 learned_addr learned my addr 172.21.15.60:0/1715002819 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:14.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a659c700 1 --2- 172.21.15.60:0/1715002819 >> v2:172.21.15.66:3300/0 conn(0x7fd8a80b5570 0x7fd8a80b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:14.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a6d9d700 1 --2- 172.21.15.60:0/1715002819 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a8145e40 0x7fd8a8141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:14.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a5d9b700 1 -- 172.21.15.60:0/1715002819 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a8145e40 msgr2=0x7fd8a8141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:14.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a5d9b700 1 --2- 172.21.15.60:0/1715002819 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a8145e40 0x7fd8a8141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a5d9b700 1 -- 172.21.15.60:0/1715002819 >> v2:172.21.15.66:3300/0 conn(0x7fd8a80b5570 msgr2=0x7fd8a80b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:14.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a5d9b700 1 --2- 172.21.15.60:0/1715002819 >> v2:172.21.15.66:3300/0 conn(0x7fd8a80b5570 0x7fd8a80b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a5d9b700 1 -- 172.21.15.60:0/1715002819 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a80b0590 con 0x7fd8a80b24a0 2020-10-31T22:47:14.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a659c700 1 --2- 172.21.15.60:0/1715002819 >> v2:172.21.15.66:3300/0 conn(0x7fd8a80b5570 0x7fd8a80b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:47:14.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a5d9b700 1 --2- 172.21.15.60:0/1715002819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a80b24a0 0x7fd8a8145950 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fd890002f30 tx=0x7fd890006e80).ready entity=mon.0 client_cookie=9f46327ef626d6d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:14.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a559a700 1 -- 172.21.15.60:0/1715002819 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8900097f0 con 0x7fd8a80b24a0 2020-10-31T22:47:14.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a559a700 1 -- 172.21.15.60:0/1715002819 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd890009950 con 0x7fd8a80b24a0 2020-10-31T22:47:14.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a559a700 1 -- 172.21.15.60:0/1715002819 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd890009cb0 con 0x7fd8a80b24a0 2020-10-31T22:47:14.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a759e700 1 -- 172.21.15.60:0/1715002819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a80b24a0 msgr2=0x7fd8a8145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:14.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a759e700 1 --2- 172.21.15.60:0/1715002819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a80b24a0 0x7fd8a8145950 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 rx=0x7fd890002f30 tx=0x7fd890006e80).stop 2020-10-31T22:47:14.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a759e700 1 -- 172.21.15.60:0/1715002819 shutdown_connections 2020-10-31T22:47:14.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a759e700 1 --2- 172.21.15.60:0/1715002819 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a8145e40 0x7fd8a8141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a759e700 1 --2- 172.21.15.60:0/1715002819 >> v2:172.21.15.66:3300/0 conn(0x7fd8a80b5570 0x7fd8a80b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a759e700 1 --2- 172.21.15.60:0/1715002819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a80b24a0 0x7fd8a8145950 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a759e700 1 -- 172.21.15.60:0/1715002819 >> 172.21.15.60:0/1715002819 conn(0x7fd8a80b8e90 msgr2=0x7fd8a80b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:14.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a759e700 1 -- 172.21.15.60:0/1715002819 shutdown_connections 2020-10-31T22:47:14.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.768+0000 7fd8a759e700 1 -- 172.21.15.60:0/1715002819 wait complete. 2020-10-31T22:47:14.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a759e700 1 Processor -- start 2020-10-31T22:47:14.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a759e700 1 -- start start 2020-10-31T22:47:14.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a80b24a0 0x7fd8a8150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:14.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a80b5570 0x7fd8a8148640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:14.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a8145e40 0x7fd8a813b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:14.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8147990 con 0x7fd8a8145e40 2020-10-31T22:47:14.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a81518a0 con 0x7fd8a80b5570 2020-10-31T22:47:14.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8150e30 con 0x7fd8a80b24a0 2020-10-31T22:47:14.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a8145e40 0x7fd8a813b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:14.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a8145e40 0x7fd8a813b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45566/0 (socket says 172.21.15.60:45566) 2020-10-31T22:47:14.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a6d9d700 1 -- 172.21.15.60:0/749620590 learned_addr learned my addr 172.21.15.60:0/749620590 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:14.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a659c700 1 --2- 172.21.15.60:0/749620590 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a80b24a0 0x7fd8a8150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:14.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a5d9b700 1 --2- 172.21.15.60:0/749620590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a80b5570 0x7fd8a8148640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:14.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a6d9d700 1 -- 172.21.15.60:0/749620590 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a80b24a0 msgr2=0x7fd8a8150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:14.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a6d9d700 1 --2- 172.21.15.60:0/749620590 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a80b24a0 0x7fd8a8150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a6d9d700 1 -- 172.21.15.60:0/749620590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a80b5570 msgr2=0x7fd8a8148640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:14.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a6d9d700 1 --2- 172.21.15.60:0/749620590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a80b5570 0x7fd8a8148640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a6d9d700 1 -- 172.21.15.60:0/749620590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a80b8140 con 0x7fd8a8145e40 2020-10-31T22:47:14.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a6d9d700 1 --2- 172.21.15.60:0/749620590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a8145e40 0x7fd8a813b1c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fd8a0006dd0 tx=0x7fd8a00091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:14.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd89f7fe700 1 -- 172.21.15.60:0/749620590 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a000c950 con 0x7fd8a8145e40 2020-10-31T22:47:14.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd89f7fe700 1 -- 172.21.15.60:0/749620590 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a000cab0 con 0x7fd8a8145e40 2020-10-31T22:47:14.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a759e700 1 -- 172.21.15.60:0/749620590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a81446f0 con 0x7fd8a8145e40 2020-10-31T22:47:14.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd89f7fe700 1 -- 172.21.15.60:0/749620590 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd8a000ce10 con 0x7fd8a8145e40 2020-10-31T22:47:14.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.772+0000 7fd8a759e700 1 -- 172.21.15.60:0/749620590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a8144420 con 0x7fd8a8145e40 2020-10-31T22:47:14.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.776+0000 7fd8a759e700 1 -- 172.21.15.60:0/749620590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a8057100 con 0x7fd8a8145e40 2020-10-31T22:47:14.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.776+0000 7fd89f7fe700 1 -- 172.21.15.60:0/749620590 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd8a0022070 con 0x7fd8a8145e40 2020-10-31T22:47:14.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.776+0000 7fd89f7fe700 1 --2- 172.21.15.60:0/749620590 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd88c055020 0x7fd88c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:14.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.776+0000 7fd89f7fe700 1 -- 172.21.15.60:0/749620590 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd8a006e100 con 0x7fd8a8145e40 2020-10-31T22:47:14.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.776+0000 7fd8a659c700 1 --2- 172.21.15.60:0/749620590 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd88c055020 0x7fd88c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:14.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.776+0000 7fd8a659c700 1 --2- 172.21.15.60:0/749620590 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd88c055020 0x7fd88c0574e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fd89800c000 tx=0x7fd898008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:14.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.784+0000 7fd89f7fe700 1 -- 172.21.15.60:0/749620590 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd8a0044510 con 0x7fd8a8145e40 2020-10-31T22:47:14.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.932+0000 7fd8a759e700 1 -- 172.21.15.60:0/749620590 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd8a805a8e0 con 0x7fd8a8145e40 2020-10-31T22:47:14.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.932+0000 7fd89f7fe700 1 -- 172.21.15.60:0/749620590 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v76) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd8a0016020 con 0x7fd8a8145e40 2020-10-31T22:47:14.935 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:47:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.936+0000 7fd8a759e700 1 -- 172.21.15.60:0/749620590 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd88c055020 msgr2=0x7fd88c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:14.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.936+0000 7fd8a759e700 1 --2- 172.21.15.60:0/749620590 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd88c055020 0x7fd88c0574e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7fd89800c000 tx=0x7fd898008040).stop 2020-10-31T22:47:14.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.936+0000 7fd8a759e700 1 -- 172.21.15.60:0/749620590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a8145e40 msgr2=0x7fd8a813b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:14.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.936+0000 7fd8a759e700 1 --2- 172.21.15.60:0/749620590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a8145e40 0x7fd8a813b1c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 rx=0x7fd8a0006dd0 tx=0x7fd8a00091a0).stop 2020-10-31T22:47:14.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.936+0000 7fd8a759e700 1 -- 172.21.15.60:0/749620590 shutdown_connections 2020-10-31T22:47:14.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.936+0000 7fd8a759e700 1 --2- 172.21.15.60:0/749620590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8a8145e40 0x7fd8a813b1c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.936+0000 7fd8a759e700 1 --2- 172.21.15.60:0/749620590 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8a80b24a0 0x7fd8a8150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.936+0000 7fd8a759e700 1 --2- 172.21.15.60:0/749620590 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd88c055020 0x7fd88c0574e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.936+0000 7fd8a759e700 1 --2- 172.21.15.60:0/749620590 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8a80b5570 0x7fd8a8148640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:14.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.936+0000 7fd8a759e700 1 -- 172.21.15.60:0/749620590 >> 172.21.15.60:0/749620590 conn(0x7fd8a80b8e90 msgr2=0x7fd8a80b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:14.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.936+0000 7fd8a759e700 1 -- 172.21.15.60:0/749620590 shutdown_connections 2020-10-31T22:47:14.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:14.936+0000 7fd8a759e700 1 -- 172.21.15.60:0/749620590 wait complete. 2020-10-31T22:47:14.949 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:47:15.018 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:47:15.022 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:47:15.025 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:47:15.028 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:47:15.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 Processor -- start 2020-10-31T22:47:15.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 -- start start 2020-10-31T22:47:15.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe0c40af0e0 0x7fe0c40af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe0c413ef60 0x7fe0c413f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c4141cf0 con 0x7fe0c4062e00 2020-10-31T22:47:15.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c413f8a0 con 0x7fe0c413ef60 2020-10-31T22:47:15.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c4145af0 con 0x7fe0c40af0e0 2020-10-31T22:47:15.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0c9f70700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe0c413ef60 0x7fe0c413f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0c9f70700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe0c413ef60 0x7fe0c413f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45574/0 (socket says 172.21.15.60:45574) 2020-10-31T22:47:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0c9f70700 1 -- 172.21.15.60:0/604545672 learned_addr learned my addr 172.21.15.60:0/604545672 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0c976f700 1 --2- 172.21.15.60:0/604545672 >> v2:172.21.15.66:3300/0 conn(0x7fe0c40af0e0 0x7fe0c40af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0c9f70700 1 -- 172.21.15.60:0/604545672 >> v2:172.21.15.66:3300/0 conn(0x7fe0c40af0e0 msgr2=0x7fe0c40af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0c9f70700 1 --2- 172.21.15.60:0/604545672 >> v2:172.21.15.66:3300/0 conn(0x7fe0c40af0e0 0x7fe0c40af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0c9f70700 1 -- 172.21.15.60:0/604545672 >> v1:172.21.15.66:6789/0 conn(0x7fe0c4062e00 legacy=0x7fe0c4145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0c9f70700 1 -- 172.21.15.60:0/604545672 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c4145d90 con 0x7fe0c413ef60 2020-10-31T22:47:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0c9f70700 1 --2- 172.21.15.60:0/604545672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c413ef60 0x7fe0c413f3b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fe0bc0032b0 tx=0x7fe0bc009270).ready entity=mon.0 client_cookie=5756a697164cccd5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0b3fff700 1 -- 172.21.15.60:0/604545672 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0bc009e60 con 0x7fe0c413ef60 2020-10-31T22:47:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0b3fff700 1 -- 172.21.15.60:0/604545672 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc00bc00 con 0x7fe0c413ef60 2020-10-31T22:47:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0b3fff700 1 -- 172.21.15.60:0/604545672 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0bc00bd70 con 0x7fe0c413ef60 2020-10-31T22:47:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 -- 172.21.15.60:0/604545672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c413ef60 msgr2=0x7fe0c413f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 --2- 172.21.15.60:0/604545672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c413ef60 0x7fe0c413f3b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 rx=0x7fe0bc0032b0 tx=0x7fe0bc009270).stop 2020-10-31T22:47:15.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 -- 172.21.15.60:0/604545672 shutdown_connections 2020-10-31T22:47:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 --2- 172.21.15.60:0/604545672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c413ef60 0x7fe0c413f3b0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 --2- 172.21.15.60:0/604545672 >> v2:172.21.15.66:3300/0 conn(0x7fe0c40af0e0 0x7fe0c40af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 -- 172.21.15.60:0/604545672 >> 172.21.15.60:0/604545672 conn(0x7fe0c406a600 msgr2=0x7fe0c4060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 -- 172.21.15.60:0/604545672 shutdown_connections 2020-10-31T22:47:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.060+0000 7fe0ca771700 1 -- 172.21.15.60:0/604545672 wait complete. 2020-10-31T22:47:15.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0ca771700 1 Processor -- start 2020-10-31T22:47:15.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0ca771700 1 -- start start 2020-10-31T22:47:15.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0ca771700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0c4062e00 0x7fe0c4147ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0ca771700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c40af0e0 0x7fe0c40aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0ca771700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0c413ef60 0x7fe0c40aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0ca771700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40ab470 con 0x7fe0c40af0e0 2020-10-31T22:47:15.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0ca771700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40b5be0 con 0x7fe0c413ef60 2020-10-31T22:47:15.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0ca771700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40b4280 con 0x7fe0c4062e00 2020-10-31T22:47:15.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0c8f6e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c40af0e0 0x7fe0c40aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0c8f6e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c40af0e0 0x7fe0c40aaa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45578/0 (socket says 172.21.15.60:45578) 2020-10-31T22:47:15.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0c8f6e700 1 -- 172.21.15.60:0/1111467868 learned_addr learned my addr 172.21.15.60:0/1111467868 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:15.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0c9f70700 1 --2- 172.21.15.60:0/1111467868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0c413ef60 0x7fe0c40aaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0c976f700 1 --2- 172.21.15.60:0/1111467868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0c4062e00 0x7fe0c4147ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0c8f6e700 1 -- 172.21.15.60:0/1111467868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0c4062e00 msgr2=0x7fe0c4147ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0c8f6e700 1 --2- 172.21.15.60:0/1111467868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0c4062e00 0x7fe0c4147ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0c8f6e700 1 -- 172.21.15.60:0/1111467868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0c413ef60 msgr2=0x7fe0c40aaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0c8f6e700 1 --2- 172.21.15.60:0/1111467868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0c413ef60 0x7fe0c40aaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0c8f6e700 1 -- 172.21.15.60:0/1111467868 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c40b4520 con 0x7fe0c40af0e0 2020-10-31T22:47:15.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0c8f6e700 1 --2- 172.21.15.60:0/1111467868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c40af0e0 0x7fe0c40aaa90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fe0c406ab00 tx=0x7fe0c0007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:15.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0b27fc700 1 -- 172.21.15.60:0/1111467868 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0c0007240 con 0x7fe0c40af0e0 2020-10-31T22:47:15.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0b27fc700 1 -- 172.21.15.60:0/1111467868 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c00073a0 con 0x7fe0c40af0e0 2020-10-31T22:47:15.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0b27fc700 1 -- 172.21.15.60:0/1111467868 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0c00066d0 con 0x7fe0c40af0e0 2020-10-31T22:47:15.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0ca771700 1 -- 172.21.15.60:0/1111467868 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c40b47c0 con 0x7fe0c40af0e0 2020-10-31T22:47:15.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.064+0000 7fe0ca771700 1 -- 172.21.15.60:0/1111467868 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c40ab690 con 0x7fe0c40af0e0 2020-10-31T22:47:15.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.068+0000 7fe0ca771700 1 -- 172.21.15.60:0/1111467868 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c40b5de0 con 0x7fe0c40af0e0 2020-10-31T22:47:15.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.068+0000 7fe0b27fc700 1 -- 172.21.15.60:0/1111467868 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe0c0010070 con 0x7fe0c40af0e0 2020-10-31T22:47:15.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.068+0000 7fe0b27fc700 1 --2- 172.21.15.60:0/1111467868 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0a40550c0 0x7fe0a4057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.068+0000 7fe0b27fc700 1 -- 172.21.15.60:0/1111467868 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe0c006d200 con 0x7fe0c40af0e0 2020-10-31T22:47:15.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.068+0000 7fe0c976f700 1 --2- 172.21.15.60:0/1111467868 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0a40550c0 0x7fe0a4057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.068+0000 7fe0c976f700 1 --2- 172.21.15.60:0/1111467868 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0a40550c0 0x7fe0a4057580 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fe0b400b000 tx=0x7fe0b4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:15.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.072+0000 7fe0b27fc700 1 -- 172.21.15.60:0/1111467868 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe0c0043640 con 0x7fe0c40af0e0 2020-10-31T22:47:15.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.212+0000 7fe0ca771700 1 -- 172.21.15.60:0/1111467868 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe0c40b4950 con 0x7fe0c40af0e0 2020-10-31T22:47:15.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.212+0000 7fe0b27fc700 1 -- 172.21.15.60:0/1111467868 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v76) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe0c0018030 con 0x7fe0c40af0e0 2020-10-31T22:47:15.216 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:47:15.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.216+0000 7fe0ca771700 1 -- 172.21.15.60:0/1111467868 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0a40550c0 msgr2=0x7fe0a4057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.216+0000 7fe0ca771700 1 --2- 172.21.15.60:0/1111467868 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0a40550c0 0x7fe0a4057580 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7fe0b400b000 tx=0x7fe0b4008040).stop 2020-10-31T22:47:15.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.216+0000 7fe0ca771700 1 -- 172.21.15.60:0/1111467868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c40af0e0 msgr2=0x7fe0c40aaa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.216+0000 7fe0ca771700 1 --2- 172.21.15.60:0/1111467868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c40af0e0 0x7fe0c40aaa90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 rx=0x7fe0c406ab00 tx=0x7fe0c0007bb0).stop 2020-10-31T22:47:15.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.216+0000 7fe0ca771700 1 -- 172.21.15.60:0/1111467868 shutdown_connections 2020-10-31T22:47:15.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.216+0000 7fe0ca771700 1 --2- 172.21.15.60:0/1111467868 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0a40550c0 0x7fe0a4057580 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.216+0000 7fe0ca771700 1 --2- 172.21.15.60:0/1111467868 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0c413ef60 0x7fe0c40aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.216+0000 7fe0ca771700 1 --2- 172.21.15.60:0/1111467868 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0c4062e00 0x7fe0c4147ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.216+0000 7fe0ca771700 1 --2- 172.21.15.60:0/1111467868 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c40af0e0 0x7fe0c40aaa90 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.216+0000 7fe0ca771700 1 -- 172.21.15.60:0/1111467868 >> 172.21.15.60:0/1111467868 conn(0x7fe0c406a600 msgr2=0x7fe0c413fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:15.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.216+0000 7fe0ca771700 1 -- 172.21.15.60:0/1111467868 shutdown_connections 2020-10-31T22:47:15.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.216+0000 7fe0ca771700 1 -- 172.21.15.60:0/1111467868 wait complete. 2020-10-31T22:47:15.236 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:47:15.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.404+0000 7fc06e65c700 1 Processor -- start 2020-10-31T22:47:15.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.404+0000 7fc06e65c700 1 -- start start 2020-10-31T22:47:15.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.404+0000 7fc06e65c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc0680b5950 0x7fc068142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.404+0000 7fc06e65c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc068142b00 con 0x7fc0680b5570 2020-10-31T22:47:15.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.404+0000 7fc06e65c700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0680b4440 con 0x7fc0680b24a0 2020-10-31T22:47:15.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.404+0000 7fc06e65c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06813f930 con 0x7fc0680b5950 2020-10-31T22:47:15.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.404+0000 7fc06d65a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc0680b5570 0x7fc068145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49720/0 (socket says 172.21.15.60:49720) 2020-10-31T22:47:15.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.404+0000 7fc06d65a700 1 -- 172.21.15.60:0/1256877828 learned_addr learned my addr 172.21.15.60:0/1256877828 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:15.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.404+0000 7fc06de5b700 1 --2- 172.21.15.60:0/1256877828 >> v2:172.21.15.66:3300/0 conn(0x7fc0680b5950 0x7fc068142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.404+0000 7fc05ffff700 1 -- 172.21.15.60:0/1256877828 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083258495 0 0) 0x7fc068142b00 con 0x7fc0680b5570 2020-10-31T22:47:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.404+0000 7fc05ffff700 1 -- 172.21.15.60:0/1256877828 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc04c003230 con 0x7fc0680b5570 2020-10-31T22:47:15.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc06de5b700 1 -- 172.21.15.60:0/1256877828 >> v1:172.21.15.66:6789/0 conn(0x7fc0680b24a0 legacy=0x7fc068141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc06de5b700 1 -- 172.21.15.60:0/1256877828 >> v1:172.21.15.60:6789/0 conn(0x7fc0680b5570 legacy=0x7fc068145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc06de5b700 1 -- 172.21.15.60:0/1256877828 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc068146060 con 0x7fc0680b5950 2020-10-31T22:47:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc06de5b700 1 --2- 172.21.15.60:0/1256877828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0680b5950 0x7fc068142610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fc0600032b0 tx=0x7fc0600091a0).ready entity=mon.1 client_cookie=c5c259089dc0714c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:15.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc05ffff700 1 -- 172.21.15.60:0/1256877828 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc06000b9a0 con 0x7fc0680b5950 2020-10-31T22:47:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc05ffff700 1 -- 172.21.15.60:0/1256877828 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06000bb00 con 0x7fc0680b5950 2020-10-31T22:47:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc05ffff700 1 -- 172.21.15.60:0/1256877828 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc06000bc70 con 0x7fc0680b5950 2020-10-31T22:47:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc06e65c700 1 -- 172.21.15.60:0/1256877828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0680b5950 msgr2=0x7fc068142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc06e65c700 1 --2- 172.21.15.60:0/1256877828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0680b5950 0x7fc068142610 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7fc0600032b0 tx=0x7fc0600091a0).stop 2020-10-31T22:47:15.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc06e65c700 1 -- 172.21.15.60:0/1256877828 shutdown_connections 2020-10-31T22:47:15.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc06e65c700 1 --2- 172.21.15.60:0/1256877828 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0680b5950 0x7fc068142610 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc06e65c700 1 -- 172.21.15.60:0/1256877828 >> 172.21.15.60:0/1256877828 conn(0x7fc0680b8e90 msgr2=0x7fc0680b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc06e65c700 1 -- 172.21.15.60:0/1256877828 shutdown_connections 2020-10-31T22:47:15.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc06e65c700 1 -- 172.21.15.60:0/1256877828 wait complete. 2020-10-31T22:47:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc06e65c700 1 Processor -- start 2020-10-31T22:47:15.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.408+0000 7fc06e65c700 1 -- start start 2020-10-31T22:47:15.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06e65c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0680b24a0 0x7fc0680ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06e65c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0680b5570 0x7fc0680adf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06e65c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0680b5950 0x7fc06813c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06e65c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0681509b0 con 0x7fc0680b5950 2020-10-31T22:47:15.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06e65c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0680af3d0 con 0x7fc0680b24a0 2020-10-31T22:47:15.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06e65c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0680ae420 con 0x7fc0680b5570 2020-10-31T22:47:15.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06de5b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0680b5950 0x7fc06813c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06de5b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0680b5950 0x7fc06813c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45594/0 (socket says 172.21.15.60:45594) 2020-10-31T22:47:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06de5b700 1 -- 172.21.15.60:0/2926728951 learned_addr learned my addr 172.21.15.60:0/2926728951 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06d65a700 1 --2- 172.21.15.60:0/2926728951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0680b24a0 0x7fc0680ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06ce59700 1 --2- 172.21.15.60:0/2926728951 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0680b5570 0x7fc0680adf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06de5b700 1 -- 172.21.15.60:0/2926728951 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0680b5570 msgr2=0x7fc0680adf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06de5b700 1 --2- 172.21.15.60:0/2926728951 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0680b5570 0x7fc0680adf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06de5b700 1 -- 172.21.15.60:0/2926728951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0680b24a0 msgr2=0x7fc0680ada40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06de5b700 1 --2- 172.21.15.60:0/2926728951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0680b24a0 0x7fc0680ada40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06de5b700 1 -- 172.21.15.60:0/2926728951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc068142e60 con 0x7fc0680b5950 2020-10-31T22:47:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06de5b700 1 --2- 172.21.15.60:0/2926728951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0680b5950 0x7fc06813c530 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fc0680ae560 tx=0x7fc060016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc05e7fc700 1 -- 172.21.15.60:0/2926728951 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc0600205f0 con 0x7fc0680b5950 2020-10-31T22:47:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc05e7fc700 1 -- 172.21.15.60:0/2926728951 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc060020750 con 0x7fc0680b5950 2020-10-31T22:47:15.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06e65c700 1 -- 172.21.15.60:0/2926728951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0680af130 con 0x7fc0680b5950 2020-10-31T22:47:15.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc05e7fc700 1 -- 172.21.15.60:0/2926728951 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc060020ab0 con 0x7fc0680b5950 2020-10-31T22:47:15.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.412+0000 7fc06e65c700 1 -- 172.21.15.60:0/2926728951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0680ac250 con 0x7fc0680b5950 2020-10-31T22:47:15.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.416+0000 7fc06e65c700 1 -- 172.21.15.60:0/2926728951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc068057100 con 0x7fc0680b5950 2020-10-31T22:47:15.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.416+0000 7fc05e7fc700 1 -- 172.21.15.60:0/2926728951 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc060027030 con 0x7fc0680b5950 2020-10-31T22:47:15.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.416+0000 7fc05e7fc700 1 --2- 172.21.15.60:0/2926728951 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc050055020 0x7fc0500574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.416+0000 7fc06d65a700 1 --2- 172.21.15.60:0/2926728951 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc050055020 0x7fc0500574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.416+0000 7fc05e7fc700 1 -- 172.21.15.60:0/2926728951 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc06006efb0 con 0x7fc0680b5950 2020-10-31T22:47:15.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.416+0000 7fc06d65a700 1 --2- 172.21.15.60:0/2926728951 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc050055020 0x7fc0500574e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fc06400d000 tx=0x7fc064009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:15.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.424+0000 7fc05e7fc700 1 -- 172.21.15.60:0/2926728951 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc060045440 con 0x7fc0680b5950 2020-10-31T22:47:15.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.568+0000 7fc06e65c700 1 -- 172.21.15.60:0/2926728951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc06805a8e0 con 0x7fc0680b5950 2020-10-31T22:47:15.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.568+0000 7fc05e7fc700 1 -- 172.21.15.60:0/2926728951 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc0600489e0 con 0x7fc0680b5950 2020-10-31T22:47:15.569 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:47:15.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.568+0000 7fc06e65c700 1 -- 172.21.15.60:0/2926728951 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc050055020 msgr2=0x7fc0500574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.568+0000 7fc06e65c700 1 --2- 172.21.15.60:0/2926728951 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc050055020 0x7fc0500574e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fc06400d000 tx=0x7fc064009040).stop 2020-10-31T22:47:15.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.568+0000 7fc06e65c700 1 -- 172.21.15.60:0/2926728951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0680b5950 msgr2=0x7fc06813c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.568+0000 7fc06e65c700 1 --2- 172.21.15.60:0/2926728951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0680b5950 0x7fc06813c530 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 rx=0x7fc0680ae560 tx=0x7fc060016000).stop 2020-10-31T22:47:15.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.568+0000 7fc06e65c700 1 -- 172.21.15.60:0/2926728951 shutdown_connections 2020-10-31T22:47:15.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.568+0000 7fc06e65c700 1 --2- 172.21.15.60:0/2926728951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc0680b5950 0x7fc06813c530 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.568+0000 7fc06e65c700 1 --2- 172.21.15.60:0/2926728951 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc050055020 0x7fc0500574e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.568+0000 7fc06e65c700 1 --2- 172.21.15.60:0/2926728951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0680b24a0 0x7fc0680ada40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.568+0000 7fc06e65c700 1 --2- 172.21.15.60:0/2926728951 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0680b5570 0x7fc0680adf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.568+0000 7fc06e65c700 1 -- 172.21.15.60:0/2926728951 >> 172.21.15.60:0/2926728951 conn(0x7fc0680b8e90 msgr2=0x7fc0680b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:15.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.568+0000 7fc06e65c700 1 -- 172.21.15.60:0/2926728951 shutdown_connections 2020-10-31T22:47:15.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.568+0000 7fc06e65c700 1 -- 172.21.15.60:0/2926728951 wait complete. 2020-10-31T22:47:15.583 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:47:15.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.696+0000 7f9c197b5700 1 Processor -- start 2020-10-31T22:47:15.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.696+0000 7f9c197b5700 1 -- start start 2020-10-31T22:47:15.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c197b5700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9c140b5570 0x7f9c140b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c197b5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c14141f00 0x7f9c14142360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c197b5700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c140b4440 con 0x7f9c140b24a0 2020-10-31T22:47:15.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c197b5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1413f930 con 0x7f9c14141f00 2020-10-31T22:47:15.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c197b5700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c14146060 con 0x7f9c140b5570 2020-10-31T22:47:15.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c18fb4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c14141f00 0x7f9c14142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c18fb4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9c14141f00 0x7f9c14142360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45602/0 (socket says 172.21.15.60:45602) 2020-10-31T22:47:15.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c18fb4700 1 -- 172.21.15.60:0/3024552814 learned_addr learned my addr 172.21.15.60:0/3024552814 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:15.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c13fff700 1 --2- 172.21.15.60:0/3024552814 >> v2:172.21.15.66:3300/0 conn(0x7f9c140b5570 0x7f9c140b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c18fb4700 1 -- 172.21.15.60:0/3024552814 >> v2:172.21.15.66:3300/0 conn(0x7f9c140b5570 msgr2=0x7f9c140b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:15.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c18fb4700 1 --2- 172.21.15.60:0/3024552814 >> v2:172.21.15.66:3300/0 conn(0x7f9c140b5570 0x7f9c140b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c18fb4700 1 -- 172.21.15.60:0/3024552814 >> v1:172.21.15.66:6789/0 conn(0x7f9c140b24a0 legacy=0x7f9c14145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c18fb4700 1 -- 172.21.15.60:0/3024552814 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c140b02f0 con 0x7f9c14141f00 2020-10-31T22:47:15.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c18fb4700 1 --2- 172.21.15.60:0/3024552814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14141f00 0x7f9c14142360 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f9c0c0032b0 tx=0x7f9c0c009270).ready entity=mon.0 client_cookie=14bfb5cf9974136a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:15.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c12ffd700 1 -- 172.21.15.60:0/3024552814 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c0c009e60 con 0x7f9c14141f00 2020-10-31T22:47:15.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c12ffd700 1 -- 172.21.15.60:0/3024552814 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0c00bc00 con 0x7f9c14141f00 2020-10-31T22:47:15.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c12ffd700 1 -- 172.21.15.60:0/3024552814 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c0c00bd70 con 0x7f9c14141f00 2020-10-31T22:47:15.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c197b5700 1 -- 172.21.15.60:0/3024552814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14141f00 msgr2=0x7f9c14142360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c197b5700 1 --2- 172.21.15.60:0/3024552814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14141f00 0x7f9c14142360 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 rx=0x7f9c0c0032b0 tx=0x7f9c0c009270).stop 2020-10-31T22:47:15.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c197b5700 1 -- 172.21.15.60:0/3024552814 shutdown_connections 2020-10-31T22:47:15.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c197b5700 1 --2- 172.21.15.60:0/3024552814 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c14141f00 0x7f9c14142360 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c197b5700 1 --2- 172.21.15.60:0/3024552814 >> v2:172.21.15.66:3300/0 conn(0x7f9c140b5570 0x7f9c140b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c197b5700 1 -- 172.21.15.60:0/3024552814 >> 172.21.15.60:0/3024552814 conn(0x7f9c140b8e90 msgr2=0x7f9c140b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:15.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c197b5700 1 -- 172.21.15.60:0/3024552814 shutdown_connections 2020-10-31T22:47:15.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.700+0000 7f9c197b5700 1 -- 172.21.15.60:0/3024552814 wait complete. 2020-10-31T22:47:15.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c197b5700 1 Processor -- start 2020-10-31T22:47:15.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c197b5700 1 -- start start 2020-10-31T22:47:15.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c197b5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c140b24a0 0x7f9c140b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c197b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c140b5570 0x7f9c140b73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c197b5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c14141f00 0x7f9c140adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c197b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c140aeed0 con 0x7f9c140b5570 2020-10-31T22:47:15.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c197b5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c140af100 con 0x7f9c14141f00 2020-10-31T22:47:15.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c197b5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c140b7df0 con 0x7f9c140b24a0 2020-10-31T22:47:15.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c137fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c140b5570 0x7f9c140b73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c137fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c140b5570 0x7f9c140b73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45606/0 (socket says 172.21.15.60:45606) 2020-10-31T22:47:15.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c137fe700 1 -- 172.21.15.60:0/15362587 learned_addr learned my addr 172.21.15.60:0/15362587 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:15.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c13fff700 1 --2- 172.21.15.60:0/15362587 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c140b24a0 0x7f9c140b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c18fb4700 1 --2- 172.21.15.60:0/15362587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c14141f00 0x7f9c140adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c137fe700 1 -- 172.21.15.60:0/15362587 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c140b24a0 msgr2=0x7f9c140b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c137fe700 1 --2- 172.21.15.60:0/15362587 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c140b24a0 0x7f9c140b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c137fe700 1 -- 172.21.15.60:0/15362587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c14141f00 msgr2=0x7f9c140adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c137fe700 1 --2- 172.21.15.60:0/15362587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c14141f00 0x7f9c140adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c137fe700 1 -- 172.21.15.60:0/15362587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c140b6bd0 con 0x7f9c140b5570 2020-10-31T22:47:15.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c137fe700 1 --2- 172.21.15.60:0/15362587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c140b5570 0x7f9c140b73f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f9c14141de0 tx=0x7f9bfc007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:15.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c117fa700 1 -- 172.21.15.60:0/15362587 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bfc00e4a0 con 0x7f9c140b5570 2020-10-31T22:47:15.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c117fa700 1 -- 172.21.15.60:0/15362587 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc00e600 con 0x7f9c140b5570 2020-10-31T22:47:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c197b5700 1 -- 172.21.15.60:0/15362587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c140b78e0 con 0x7f9c140b5570 2020-10-31T22:47:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c117fa700 1 -- 172.21.15.60:0/15362587 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9bfc00e960 con 0x7f9c140b5570 2020-10-31T22:47:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c197b5700 1 -- 172.21.15.60:0/15362587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c14141920 con 0x7f9c140b5570 2020-10-31T22:47:15.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.704+0000 7f9c197b5700 1 -- 172.21.15.60:0/15362587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c140b6330 con 0x7f9c140b5570 2020-10-31T22:47:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.708+0000 7f9c117fa700 1 -- 172.21.15.60:0/15362587 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9bfc010030 con 0x7f9c140b5570 2020-10-31T22:47:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.708+0000 7f9c117fa700 1 --2- 172.21.15.60:0/15362587 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bf8054f90 0x7f9bf8057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.708+0000 7f9c117fa700 1 -- 172.21.15.60:0/15362587 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9bfc06d810 con 0x7f9c140b5570 2020-10-31T22:47:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.708+0000 7f9c13fff700 1 --2- 172.21.15.60:0/15362587 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bf8054f90 0x7f9bf8057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.708+0000 7f9c13fff700 1 --2- 172.21.15.60:0/15362587 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bf8054f90 0x7f9bf8057450 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f9c0400b000 tx=0x7f9c04006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.716+0000 7f9c117fa700 1 -- 172.21.15.60:0/15362587 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9c140b6330 con 0x7f9c140b5570 2020-10-31T22:47:15.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.860+0000 7f9c197b5700 1 -- 172.21.15.60:0/15362587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c140b6330 con 0x7f9c140b5570 2020-10-31T22:47:15.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.860+0000 7f9c117fa700 1 -- 172.21.15.60:0/15362587 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9c140b6330 con 0x7f9c140b5570 2020-10-31T22:47:15.863 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:47:15.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.860+0000 7f9c197b5700 1 -- 172.21.15.60:0/15362587 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bf8054f90 msgr2=0x7f9bf8057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.860+0000 7f9c197b5700 1 --2- 172.21.15.60:0/15362587 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bf8054f90 0x7f9bf8057450 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f9c0400b000 tx=0x7f9c04006dc0).stop 2020-10-31T22:47:15.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.860+0000 7f9c197b5700 1 -- 172.21.15.60:0/15362587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c140b5570 msgr2=0x7f9c140b73f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.860+0000 7f9c197b5700 1 --2- 172.21.15.60:0/15362587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c140b5570 0x7f9c140b73f0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 rx=0x7f9c14141de0 tx=0x7f9bfc007c20).stop 2020-10-31T22:47:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.860+0000 7f9c197b5700 1 -- 172.21.15.60:0/15362587 shutdown_connections 2020-10-31T22:47:15.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.860+0000 7f9c197b5700 1 --2- 172.21.15.60:0/15362587 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bf8054f90 0x7f9bf8057450 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.860+0000 7f9c197b5700 1 --2- 172.21.15.60:0/15362587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c14141f00 0x7f9c140adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.860+0000 7f9c197b5700 1 --2- 172.21.15.60:0/15362587 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c140b24a0 0x7f9c140b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.860+0000 7f9c197b5700 1 --2- 172.21.15.60:0/15362587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c140b5570 0x7f9c140b73f0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:15.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.860+0000 7f9c197b5700 1 -- 172.21.15.60:0/15362587 >> 172.21.15.60:0/15362587 conn(0x7f9c140b8e90 msgr2=0x7f9c140b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:15.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.860+0000 7f9c197b5700 1 -- 172.21.15.60:0/15362587 shutdown_connections 2020-10-31T22:47:15.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.860+0000 7f9c197b5700 1 -- 172.21.15.60:0/15362587 wait complete. 2020-10-31T22:47:15.882 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:47:15.883 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:47:16.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f356bfff700 1 Processor -- start 2020-10-31T22:47:16.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f356bfff700 1 -- start start 2020-10-31T22:47:16.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f356bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f356c0ae8b0 0x7f356c0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:16.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f356bfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c0acc50 con 0x7f356c0ac870 2020-10-31T22:47:16.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f356bfff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f356c0b5690 con 0x7f356c0b0e20 2020-10-31T22:47:16.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f356bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c0b14c0 con 0x7f356c0ae8b0 2020-10-31T22:47:16.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f356affd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f356c0ac870 0x7f356c0ae1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49748/0 (socket says 172.21.15.60:49748) 2020-10-31T22:47:16.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f356affd700 1 -- 172.21.15.60:0/2414477586 learned_addr learned my addr 172.21.15.60:0/2414477586 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:16.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f356b7fe700 1 --2- 172.21.15.60:0/2414477586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f356c0ae8b0 0x7f356c0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:16.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55218268 0 0) 0x7f356c0acc50 con 0x7f356c0ac870 2020-10-31T22:47:16.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3550003230 con 0x7f356c0ac870 2020-10-31T22:47:16.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277073819 0 0) 0x7f356c0b5690 con 0x7f356c0b0e20 2020-10-31T22:47:16.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f356c0acc50 con 0x7f356c0b0e20 2020-10-31T22:47:16.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2501689366 0 0) 0x7f3550003230 con 0x7f356c0ac870 2020-10-31T22:47:16.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f356c0ae8b0 msgr2=0x7f356c0b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:16.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 --2- 172.21.15.60:0/2414477586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f356c0ae8b0 0x7f356c0b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:16.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 >> v1:172.21.15.66:6789/0 conn(0x7f356c0b0e20 legacy=0x7f356c1412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:16.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c0afc10 con 0x7f356c0ac870 2020-10-31T22:47:16.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f35600016d0 con 0x7f356c0ac870 2020-10-31T22:47:16.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 >> v1:172.21.15.60:6789/0 conn(0x7f356c0ac870 legacy=0x7f356c0ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:16.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 --2- 172.21.15.60:0/2414477586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35500038e0 0x7f3550003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:16.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 --2- 172.21.15.60:0/2414477586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f356c0ae8b0 0x7f35500044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:16.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 --2- 172.21.15.60:0/2414477586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35500049c0 0x7f3550004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:16.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c0b14c0 con 0x7f35500049c0 2020-10-31T22:47:16.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3550005330 con 0x7f35500038e0 2020-10-31T22:47:16.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355000b720 con 0x7f356c0ae8b0 2020-10-31T22:47:16.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.992+0000 7f356affd700 1 --2- 172.21.15.60:0/2414477586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35500038e0 0x7f3550003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:16.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356a7fc700 1 --2- 172.21.15.60:0/2414477586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f356c0ae8b0 0x7f35500044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:16.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356b7fe700 1 --2- 172.21.15.60:0/2414477586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35500049c0 0x7f3550004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:16.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356affd700 1 -- 172.21.15.60:0/2414477586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f356c0ae8b0 msgr2=0x7f35500044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:16.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356affd700 1 --2- 172.21.15.60:0/2414477586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f356c0ae8b0 0x7f35500044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:16.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356affd700 1 -- 172.21.15.60:0/2414477586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35500049c0 msgr2=0x7f3550004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:16.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356affd700 1 --2- 172.21.15.60:0/2414477586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35500049c0 0x7f3550004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:16.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356affd700 1 -- 172.21.15.60:0/2414477586 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3550003230 con 0x7f35500038e0 2020-10-31T22:47:16.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356b7fe700 1 --2- 172.21.15.60:0/2414477586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f35500049c0 0x7f3550004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:47:16.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356affd700 1 --2- 172.21.15.60:0/2414477586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35500038e0 0x7f3550003ce0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f35600014a0 tx=0x7f3560007690).ready entity=mon.1 client_cookie=2837eb3cbd8aa18a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f356000ce60 con 0x7f35500038e0 2020-10-31T22:47:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35600070d0 con 0x7f35500038e0 2020-10-31T22:47:16.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f3569ffb700 1 -- 172.21.15.60:0/2414477586 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3560007430 con 0x7f35500038e0 2020-10-31T22:47:16.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356bfff700 1 -- 172.21.15.60:0/2414477586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35500038e0 msgr2=0x7f3550003ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:16.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356bfff700 1 --2- 172.21.15.60:0/2414477586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35500038e0 0x7f3550003ce0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f35600014a0 tx=0x7f3560007690).stop 2020-10-31T22:47:16.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356b7fe700 1 -- 172.21.15.60:0/2414477586 reap_dead start 2020-10-31T22:47:16.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356bfff700 1 -- 172.21.15.60:0/2414477586 shutdown_connections 2020-10-31T22:47:16.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356bfff700 1 -- 172.21.15.60:0/2414477586 >> 172.21.15.60:0/2414477586 conn(0x7f356c06a600 msgr2=0x7f356c060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:16.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356bfff700 1 -- 172.21.15.60:0/2414477586 shutdown_connections 2020-10-31T22:47:16.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356bfff700 1 -- 172.21.15.60:0/2414477586 wait complete. 2020-10-31T22:47:16.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356bfff700 1 Processor -- start 2020-10-31T22:47:16.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:15.996+0000 7f356bfff700 1 -- start start 2020-10-31T22:47:16.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f356c0a0e60 0x7f356c14e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:16.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f356c0a00a0 0x7f356c1521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:16.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f356c1526e0 0x7f356c0a7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:16.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c0a1240 con 0x7f356c1526e0 2020-10-31T22:47:16.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356bfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356c05b410 con 0x7f356c0a00a0 2020-10-31T22:47:16.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f356c05b6b0 con 0x7f356c0a0e60 2020-10-31T22:47:16.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f356c1526e0 0x7f356c0a7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:16.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f356c1526e0 0x7f356c0a7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45626/0 (socket says 172.21.15.60:45626) 2020-10-31T22:47:16.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356b7fe700 1 -- 172.21.15.60:0/2287452251 learned_addr learned my addr 172.21.15.60:0/2287452251 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:16.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356a7fc700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f356c0a00a0 0x7f356c1521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:16.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356affd700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f356c0a0e60 0x7f356c14e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:16.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356b7fe700 1 -- 172.21.15.60:0/2287452251 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f356c0a0e60 msgr2=0x7f356c14e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:16.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356b7fe700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f356c0a0e60 0x7f356c14e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:16.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356b7fe700 1 -- 172.21.15.60:0/2287452251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f356c0a00a0 msgr2=0x7f356c1521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:16.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356b7fe700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f356c0a00a0 0x7f356c1521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:16.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356b7fe700 1 -- 172.21.15.60:0/2287452251 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f356c151ab0 con 0x7f356c1526e0 2020-10-31T22:47:16.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356a7fc700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f356c0a00a0 0x7f356c1521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:47:16.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356affd700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f356c0a0e60 0x7f356c14e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:47:16.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356b7fe700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f356c1526e0 0x7f356c0a7be0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f356400b000 tx=0x7f35640091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:16.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f355bfff700 1 -- 172.21.15.60:0/2287452251 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f356400fd70 con 0x7f356c1526e0 2020-10-31T22:47:16.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f355bfff700 1 -- 172.21.15.60:0/2287452251 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3564014440 con 0x7f356c1526e0 2020-10-31T22:47:16.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f355bfff700 1 -- 172.21.15.60:0/2287452251 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f35640147a0 con 0x7f356c1526e0 2020-10-31T22:47:16.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356bfff700 1 -- 172.21.15.60:0/2287452251 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f356c151d50 con 0x7f356c1526e0 2020-10-31T22:47:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356bfff700 1 -- 172.21.15.60:0/2287452251 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f356c05afe0 con 0x7f356c1526e0 2020-10-31T22:47:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356bfff700 1 -- 172.21.15.60:0/2287452251 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356c151ee0 con 0x7f356c1526e0 2020-10-31T22:47:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f355bfff700 1 -- 172.21.15.60:0/2287452251 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3564023070 con 0x7f356c1526e0 2020-10-31T22:47:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f355bfff700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35480550c0 0x7f3548057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f355bfff700 1 -- 172.21.15.60:0/2287452251 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f356406e410 con 0x7f356c1526e0 2020-10-31T22:47:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356affd700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35480550c0 0x7f3548057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.000+0000 7f356affd700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35480550c0 0x7f3548057580 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f3560005000 tx=0x7f3560015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:16.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.004+0000 7f355bfff700 1 -- 172.21.15.60:0/2287452251 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3564044930 con 0x7f356c1526e0 2020-10-31T22:47:16.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.192+0000 7f356bfff700 1 -- 172.21.15.60:0/2287452251 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f356c057100 con 0x7f356c1526e0 2020-10-31T22:47:16.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.192+0000 7f355bfff700 1 -- 172.21.15.60:0/2287452251 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+2487 (secure 0 0 0) 0x7f3564021020 con 0x7f356c1526e0 2020-10-31T22:47:16.194 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:16.194 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":35,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/290520151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":290520151},{"type":"v1","addr":"172.21.15.66:6833","nonce":290520151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1731313860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1731313860},{"type":"v1","addr":"172.21.15.60:6835","nonce":1731313860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:47:06.422241+0000","modified":"2020-10-31T22:47:08.068754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/265867667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":265867667},{"type":"v1","addr":"172.21.15.60:6837","nonce":265867667}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-10-31T22:47:16.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.192+0000 7f356bfff700 1 -- 172.21.15.60:0/2287452251 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35480550c0 msgr2=0x7f3548057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:16.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.192+0000 7f356bfff700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35480550c0 0x7f3548057580 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f3560005000 tx=0x7f3560015000).stop 2020-10-31T22:47:16.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.192+0000 7f356bfff700 1 -- 172.21.15.60:0/2287452251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f356c1526e0 msgr2=0x7f356c0a7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:16.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.192+0000 7f356bfff700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f356c1526e0 0x7f356c0a7be0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 rx=0x7f356400b000 tx=0x7f35640091a0).stop 2020-10-31T22:47:16.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.192+0000 7f356bfff700 1 -- 172.21.15.60:0/2287452251 shutdown_connections 2020-10-31T22:47:16.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.192+0000 7f356bfff700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f356c1526e0 0x7f356c0a7be0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:16.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.192+0000 7f356bfff700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f356c0a0e60 0x7f356c14e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:16.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.192+0000 7f356bfff700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f35480550c0 0x7f3548057580 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:16.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.192+0000 7f356bfff700 1 --2- 172.21.15.60:0/2287452251 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f356c0a00a0 0x7f356c1521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:16.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.192+0000 7f356bfff700 1 -- 172.21.15.60:0/2287452251 >> 172.21.15.60:0/2287452251 conn(0x7f356c06a600 msgr2=0x7f356c0ad280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:16.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.192+0000 7f356bfff700 1 -- 172.21.15.60:0/2287452251 shutdown_connections 2020-10-31T22:47:16.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:16.192+0000 7f356bfff700 1 -- 172.21.15.60:0/2287452251 wait complete. 2020-10-31T22:47:16.203 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2020-10-31T22:47:16.519 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:47:06.422241+0000', 'modified': '2020-10-31T22:47:08.068754+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6174}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6174': {'gid': 6174, 'name': 'a', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/265867667', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 265867667}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 265867667}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:47:16.521 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:47:16.522 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-10-31T22:47:16.652 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":6174,"want_state":"up:active","state":"up:active","rank_uptime":10.216755414,"mdsmap_epoch":35,"osdmap_epoch":76,"osdmap_epoch_barrier":76,"uptime":15.46668891} 2020-10-31T22:47:16.653 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 6174, "mdsmap_epoch": 35, "osdmap_epoch": 76, "osdmap_epoch_barrier": 76, "rank_uptime": 10.216755414, "state": "up:active", "uptime": 15.46668891, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:47:16.654 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:47:16.654 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-10-31T22:47:16.655 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi085.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-10-31T22:47:16.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:16.656 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:47:16.665 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:47:16.723 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:47:16.724 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:47:16.777 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:47:16.779 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:47:16.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:16.780 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:47:16.830 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:47:16.830 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:47:16.874 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:47:16.891 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:47:16.891 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:47:16.957 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:47:16.957 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:47:16.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:16.959 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:47:16.960 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:2020-10-31T22:47:16.950+0000 7f42f14750c0 -1 init, newargv = 0x55aaa5a492d0 newargc=9 2020-10-31T22:47:16.960 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13102]: starting ceph client 2020-10-31T22:47:16.966 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13102]: starting fuse 2020-10-31T22:47:16.972 INFO:teuthology.orchestra.run.smithi085.stdout:50 2020-10-31T22:47:16.972 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-10-31T22:47:16.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:16.974 INFO:teuthology.orchestra.run.smithi085:> sudo python3 -c ' 2020-10-31T22:47:16.974 INFO:teuthology.orchestra.run.smithi085:> import glob 2020-10-31T22:47:16.975 INFO:teuthology.orchestra.run.smithi085:> import re 2020-10-31T22:47:16.976 INFO:teuthology.orchestra.run.smithi085:> import os 2020-10-31T22:47:16.976 INFO:teuthology.orchestra.run.smithi085:> import subprocess 2020-10-31T22:47:16.977 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:47:16.978 INFO:teuthology.orchestra.run.smithi085:> def find_socket(client_name): 2020-10-31T22:47:16.978 INFO:teuthology.orchestra.run.smithi085:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-10-31T22:47:16.979 INFO:teuthology.orchestra.run.smithi085:> files = glob.glob(asok_path) 2020-10-31T22:47:16.980 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:47:16.980 INFO:teuthology.orchestra.run.smithi085:> # Given a non-glob path, it better be there 2020-10-31T22:47:16.981 INFO:teuthology.orchestra.run.smithi085:> if "*" not in asok_path: 2020-10-31T22:47:16.981 INFO:teuthology.orchestra.run.smithi085:> assert(len(files) == 1) 2020-10-31T22:47:16.982 INFO:teuthology.orchestra.run.smithi085:> return files[0] 2020-10-31T22:47:16.983 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:47:16.984 INFO:teuthology.orchestra.run.smithi085:> for f in files: 2020-10-31T22:47:16.984 INFO:teuthology.orchestra.run.smithi085:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:47:16.985 INFO:teuthology.orchestra.run.smithi085:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:47:16.986 INFO:teuthology.orchestra.run.smithi085:> return f 2020-10-31T22:47:16.986 INFO:teuthology.orchestra.run.smithi085:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:47:16.987 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:47:16.988 INFO:teuthology.orchestra.run.smithi085:> print(find_socket("client.1")) 2020-10-31T22:47:16.988 INFO:teuthology.orchestra.run.smithi085:> ' 2020-10-31T22:47:17.059 INFO:teuthology.orchestra.run.smithi085.stdout:/var/run/ceph/ceph-client.1.13102.asok 2020-10-31T22:47:17.080 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13102.asok 2020-10-31T22:47:17.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:17.081 INFO:teuthology.orchestra.run.smithi085:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13102.asok status 2020-10-31T22:47:17.222 INFO:teuthology.orchestra.run.smithi085.stdout:{ 2020-10-31T22:47:17.223 INFO:teuthology.orchestra.run.smithi085.stdout: "metadata": { 2020-10-31T22:47:17.223 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:47:17.223 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:47:17.223 INFO:teuthology.orchestra.run.smithi085.stdout: "entity_id": "1", 2020-10-31T22:47:17.223 INFO:teuthology.orchestra.run.smithi085.stdout: "hostname": "smithi085", 2020-10-31T22:47:17.224 INFO:teuthology.orchestra.run.smithi085.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-10-31T22:47:17.224 INFO:teuthology.orchestra.run.smithi085.stdout: "pid": "13102", 2020-10-31T22:47:17.224 INFO:teuthology.orchestra.run.smithi085.stdout: "root": "/" 2020-10-31T22:47:17.224 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:47:17.225 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_count": 0, 2020-10-31T22:47:17.225 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_pinned_count": 0, 2020-10-31T22:47:17.225 INFO:teuthology.orchestra.run.smithi085.stdout: "id": 5795, 2020-10-31T22:47:17.225 INFO:teuthology.orchestra.run.smithi085.stdout: "inst": { 2020-10-31T22:47:17.226 INFO:teuthology.orchestra.run.smithi085.stdout: "name": { 2020-10-31T22:47:17.226 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "client", 2020-10-31T22:47:17.226 INFO:teuthology.orchestra.run.smithi085.stdout: "num": 5795 2020-10-31T22:47:17.226 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:47:17.227 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:47:17.227 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:47:17.227 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:47:17.227 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 3591806489 2020-10-31T22:47:17.228 INFO:teuthology.orchestra.run.smithi085.stdout: } 2020-10-31T22:47:17.228 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:47:17.228 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:47:17.229 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:47:17.229 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:47:17.229 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 3591806489 2020-10-31T22:47:17.229 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:47:17.229 INFO:teuthology.orchestra.run.smithi085.stdout: "inst_str": "client.5795 172.21.15.85:0/3591806489", 2020-10-31T22:47:17.230 INFO:teuthology.orchestra.run.smithi085.stdout: "addr_str": "172.21.15.85:0/3591806489", 2020-10-31T22:47:17.230 INFO:teuthology.orchestra.run.smithi085.stdout: "inode_count": 1, 2020-10-31T22:47:17.230 INFO:teuthology.orchestra.run.smithi085.stdout: "mds_epoch": 35, 2020-10-31T22:47:17.231 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch": 76, 2020-10-31T22:47:17.231 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:47:17.231 INFO:teuthology.orchestra.run.smithi085.stdout: "blacklisted": false 2020-10-31T22:47:17.231 INFO:teuthology.orchestra.run.smithi085.stdout:} 2020-10-31T22:47:17.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:17.234 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:47:17.235 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:47:17.243 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:47:17.244 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:47:17.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:17.248 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:47:17.303 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:47:17.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.428+0000 7fd3b14e7700 1 Processor -- start 2020-10-31T22:47:17.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.428+0000 7fd3b14e7700 1 -- start start 2020-10-31T22:47:17.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3b14e7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3ac0b2e20 0x7fd3ac05c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:17.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3b14e7700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ac065e90 con 0x7fd3ac0b4410 2020-10-31T22:47:17.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3b14e7700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ac066130 con 0x7fd3ac05c4c0 2020-10-31T22:47:17.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3b14e7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac141ef0 con 0x7fd3ac0b2e20 2020-10-31T22:47:17.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3ab7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd3ac0b4410 0x7fd3ac142580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49772/0 (socket says 172.21.15.60:49772) 2020-10-31T22:47:17.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3ab7fe700 1 -- 172.21.15.60:0/4054779776 learned_addr learned my addr 172.21.15.60:0/4054779776 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:17.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3aa7fc700 1 --2- 172.21.15.60:0/4054779776 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3ac0b2e20 0x7fd3ac05c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:17.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3a9ffb700 1 -- 172.21.15.60:0/4054779776 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192945627 0 0) 0x7fd3ac065e90 con 0x7fd3ac0b4410 2020-10-31T22:47:17.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3a9ffb700 1 -- 172.21.15.60:0/4054779776 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd38c003230 con 0x7fd3ac0b4410 2020-10-31T22:47:17.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3a9ffb700 1 -- 172.21.15.60:0/4054779776 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989691338 0 0) 0x7fd3ac066130 con 0x7fd3ac05c4c0 2020-10-31T22:47:17.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3a9ffb700 1 -- 172.21.15.60:0/4054779776 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3ac065e90 con 0x7fd3ac05c4c0 2020-10-31T22:47:17.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3aa7fc700 1 -- 172.21.15.60:0/4054779776 >> v1:172.21.15.66:6789/0 conn(0x7fd3ac05c4c0 legacy=0x7fd3ac13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:17.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3aa7fc700 1 -- 172.21.15.60:0/4054779776 >> v1:172.21.15.60:6789/0 conn(0x7fd3ac0b4410 legacy=0x7fd3ac142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:17.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3aa7fc700 1 -- 172.21.15.60:0/4054779776 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac0663d0 con 0x7fd3ac0b2e20 2020-10-31T22:47:17.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3aa7fc700 1 --2- 172.21.15.60:0/4054779776 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3ac0b2e20 0x7fd3ac05c8a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd394002f30 tx=0x7fd394006dc0).ready entity=mon.2 client_cookie=99769cbd8e80b03c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:17.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3a9ffb700 1 -- 172.21.15.60:0/4054779776 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd394009730 con 0x7fd3ac0b2e20 2020-10-31T22:47:17.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3a9ffb700 1 -- 172.21.15.60:0/4054779776 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd394009890 con 0x7fd3ac0b2e20 2020-10-31T22:47:17.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3b14e7700 1 -- 172.21.15.60:0/4054779776 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3ac0b2e20 msgr2=0x7fd3ac05c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:17.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3b14e7700 1 --2- 172.21.15.60:0/4054779776 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3ac0b2e20 0x7fd3ac05c8a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd394002f30 tx=0x7fd394006dc0).stop 2020-10-31T22:47:17.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3b14e7700 1 -- 172.21.15.60:0/4054779776 shutdown_connections 2020-10-31T22:47:17.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3b14e7700 1 --2- 172.21.15.60:0/4054779776 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3ac0b2e20 0x7fd3ac05c8a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3b14e7700 1 -- 172.21.15.60:0/4054779776 >> 172.21.15.60:0/4054779776 conn(0x7fd3ac0601e0 msgr2=0x7fd3ac05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:17.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3b14e7700 1 -- 172.21.15.60:0/4054779776 shutdown_connections 2020-10-31T22:47:17.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3b14e7700 1 -- 172.21.15.60:0/4054779776 wait complete. 2020-10-31T22:47:17.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3b14e7700 1 Processor -- start 2020-10-31T22:47:17.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.432+0000 7fd3b14e7700 1 -- start start 2020-10-31T22:47:17.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3b14e7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3ac05c4c0 0x7fd3ac0ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:17.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3b14e7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3ac0b4410 0x7fd3ac1447b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:17.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3b14e7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3ac0a9240 0x7fd3ac0a96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:17.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3b14e7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0aa590 con 0x7fd3ac0b4410 2020-10-31T22:47:17.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3b14e7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0aa830 con 0x7fd3ac0a9240 2020-10-31T22:47:17.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3b14e7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac1518d0 con 0x7fd3ac05c4c0 2020-10-31T22:47:17.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3aa7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3ac0b4410 0x7fd3ac1447b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:17.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3aa7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3ac0b4410 0x7fd3ac1447b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45638/0 (socket says 172.21.15.60:45638) 2020-10-31T22:47:17.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3aa7fc700 1 -- 172.21.15.60:0/2210924795 learned_addr learned my addr 172.21.15.60:0/2210924795 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:17.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3ab7fe700 1 --2- 172.21.15.60:0/2210924795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3ac0a9240 0x7fd3ac0a96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:17.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3aaffd700 1 --2- 172.21.15.60:0/2210924795 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3ac05c4c0 0x7fd3ac0ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:17.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3aa7fc700 1 -- 172.21.15.60:0/2210924795 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3ac05c4c0 msgr2=0x7fd3ac0ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:17.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3aa7fc700 1 --2- 172.21.15.60:0/2210924795 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3ac05c4c0 0x7fd3ac0ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3aa7fc700 1 -- 172.21.15.60:0/2210924795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3ac0a9240 msgr2=0x7fd3ac0a96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:17.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3aa7fc700 1 --2- 172.21.15.60:0/2210924795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3ac0a9240 0x7fd3ac0a96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3aa7fc700 1 -- 172.21.15.60:0/2210924795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac145250 con 0x7fd3ac0b4410 2020-10-31T22:47:17.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3aa7fc700 1 --2- 172.21.15.60:0/2210924795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3ac0b4410 0x7fd3ac1447b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fd394002f30 tx=0x7fd394015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:17.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3a3fff700 1 -- 172.21.15.60:0/2210924795 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd394011ae0 con 0x7fd3ac0b4410 2020-10-31T22:47:17.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3a3fff700 1 -- 172.21.15.60:0/2210924795 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd394011c40 con 0x7fd3ac0b4410 2020-10-31T22:47:17.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3b14e7700 1 -- 172.21.15.60:0/2210924795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ac1515f0 con 0x7fd3ac0b4410 2020-10-31T22:47:17.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3a3fff700 1 -- 172.21.15.60:0/2210924795 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd39401e460 con 0x7fd3ac0b4410 2020-10-31T22:47:17.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3b14e7700 1 -- 172.21.15.60:0/2210924795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ac0a9be0 con 0x7fd3ac0b4410 2020-10-31T22:47:17.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3b14e7700 1 -- 172.21.15.60:0/2210924795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ac151ad0 con 0x7fd3ac0b4410 2020-10-31T22:47:17.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.436+0000 7fd3a3fff700 1 -- 172.21.15.60:0/2210924795 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd394025030 con 0x7fd3ac0b4410 2020-10-31T22:47:17.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.440+0000 7fd3a3fff700 1 --2- 172.21.15.60:0/2210924795 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd390055020 0x7fd3900574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:17.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.440+0000 7fd3a3fff700 1 -- 172.21.15.60:0/2210924795 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd39406f110 con 0x7fd3ac0b4410 2020-10-31T22:47:17.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.440+0000 7fd3aaffd700 1 --2- 172.21.15.60:0/2210924795 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd390055020 0x7fd3900574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:17.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.440+0000 7fd3aaffd700 1 --2- 172.21.15.60:0/2210924795 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd390055020 0x7fd3900574e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fd39c00d000 tx=0x7fd39c007960).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:17.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.444+0000 7fd3a3fff700 1 -- 172.21.15.60:0/2210924795 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd394045630 con 0x7fd3ac0b4410 2020-10-31T22:47:17.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.628+0000 7fd3b14e7700 1 -- 172.21.15.60:0/2210924795 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd3ac057100 con 0x7fd3ac0b4410 2020-10-31T22:47:17.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.628+0000 7fd3a3fff700 1 -- 172.21.15.60:0/2210924795 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+2487 (secure 0 0 0) 0x7fd394023030 con 0x7fd3ac0b4410 2020-10-31T22:47:17.632 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:17.632 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":35,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/290520151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":290520151},{"type":"v1","addr":"172.21.15.66:6833","nonce":290520151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1731313860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1731313860},{"type":"v1","addr":"172.21.15.60:6835","nonce":1731313860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:47:06.422241+0000","modified":"2020-10-31T22:47:08.068754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/265867667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":265867667},{"type":"v1","addr":"172.21.15.60:6837","nonce":265867667}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-10-31T22:47:17.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.632+0000 7fd3b14e7700 1 -- 172.21.15.60:0/2210924795 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd390055020 msgr2=0x7fd3900574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:17.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.632+0000 7fd3b14e7700 1 --2- 172.21.15.60:0/2210924795 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd390055020 0x7fd3900574e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fd39c00d000 tx=0x7fd39c007960).stop 2020-10-31T22:47:17.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.632+0000 7fd3b14e7700 1 -- 172.21.15.60:0/2210924795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3ac0b4410 msgr2=0x7fd3ac1447b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:17.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.632+0000 7fd3b14e7700 1 --2- 172.21.15.60:0/2210924795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3ac0b4410 0x7fd3ac1447b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 rx=0x7fd394002f30 tx=0x7fd394015000).stop 2020-10-31T22:47:17.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.632+0000 7fd3b14e7700 1 -- 172.21.15.60:0/2210924795 shutdown_connections 2020-10-31T22:47:17.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.632+0000 7fd3b14e7700 1 --2- 172.21.15.60:0/2210924795 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd390055020 0x7fd3900574e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.632+0000 7fd3b14e7700 1 --2- 172.21.15.60:0/2210924795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd3ac0a9240 0x7fd3ac0a96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.632+0000 7fd3b14e7700 1 --2- 172.21.15.60:0/2210924795 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd3ac05c4c0 0x7fd3ac0ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.632+0000 7fd3b14e7700 1 --2- 172.21.15.60:0/2210924795 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3ac0b4410 0x7fd3ac1447b0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.632+0000 7fd3b14e7700 1 -- 172.21.15.60:0/2210924795 >> 172.21.15.60:0/2210924795 conn(0x7fd3ac0601e0 msgr2=0x7fd3ac0b7900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:17.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.632+0000 7fd3b14e7700 1 -- 172.21.15.60:0/2210924795 shutdown_connections 2020-10-31T22:47:17.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.632+0000 7fd3b14e7700 1 -- 172.21.15.60:0/2210924795 wait complete. 2020-10-31T22:47:17.636 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2020-10-31T22:47:17.646 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:47:17.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.756+0000 7fc82f59e700 1 Processor -- start 2020-10-31T22:47:17.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82f59e700 1 -- start start 2020-10-31T22:47:17.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82f59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc83013ebe0 0x7fc830142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:17.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82f59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8300af200 0x7fc8300b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:17.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82f59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8300abea0 con 0x7fc8300b1a10 2020-10-31T22:47:17.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82f59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc830141870 con 0x7fc83013ebe0 2020-10-31T22:47:17.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82f59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc830141b10 con 0x7fc8300af200 2020-10-31T22:47:17.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82ed9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8300af200 0x7fc8300b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:17.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82e59c700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc8300b1a10 0x7fc8300afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:47650/0 (socket says 172.21.15.60:47650) 2020-10-31T22:47:17.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82e59c700 1 -- 172.21.15.60:0/670178711 learned_addr learned my addr 172.21.15.60:0/670178711 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:17.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82dd9b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc83013ebe0 0x7fc830142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:17.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82ed9d700 1 -- 172.21.15.60:0/670178711 >> v2:172.21.15.66:3300/0 conn(0x7fc83013ebe0 msgr2=0x7fc830142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:17.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82ed9d700 1 --2- 172.21.15.60:0/670178711 >> v2:172.21.15.66:3300/0 conn(0x7fc83013ebe0 0x7fc830142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82d59a700 1 -- 172.21.15.60:0/670178711 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1523467693 0 0) 0x7fc8300abea0 con 0x7fc8300b1a10 2020-10-31T22:47:17.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82ed9d700 1 -- 172.21.15.60:0/670178711 >> v1:172.21.15.66:6789/0 conn(0x7fc8300b1a10 legacy=0x7fc8300afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:17.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82ed9d700 1 -- 172.21.15.60:0/670178711 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc830141db0 con 0x7fc8300af200 2020-10-31T22:47:17.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82ed9d700 1 --2- 172.21.15.60:0/670178711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8300af200 0x7fc8300b1df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fc8280032b0 tx=0x7fc8280091a0).ready entity=mon.2 client_cookie=dcee88a76ce4aa07 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:17.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82d59a700 1 -- 172.21.15.60:0/670178711 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc82800b9a0 con 0x7fc8300af200 2020-10-31T22:47:17.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82d59a700 1 -- 172.21.15.60:0/670178711 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82800bb00 con 0x7fc8300af200 2020-10-31T22:47:17.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82d59a700 1 -- 172.21.15.60:0/670178711 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc82800bc70 con 0x7fc8300af200 2020-10-31T22:47:17.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82f59e700 1 -- 172.21.15.60:0/670178711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8300af200 msgr2=0x7fc8300b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:17.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82f59e700 1 --2- 172.21.15.60:0/670178711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8300af200 0x7fc8300b1df0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fc8280032b0 tx=0x7fc8280091a0).stop 2020-10-31T22:47:17.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82f59e700 1 -- 172.21.15.60:0/670178711 shutdown_connections 2020-10-31T22:47:17.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82f59e700 1 --2- 172.21.15.60:0/670178711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8300af200 0x7fc8300b1df0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82f59e700 1 --2- 172.21.15.60:0/670178711 >> v2:172.21.15.66:3300/0 conn(0x7fc83013ebe0 0x7fc830142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82f59e700 1 -- 172.21.15.60:0/670178711 >> 172.21.15.60:0/670178711 conn(0x7fc8300b5300 msgr2=0x7fc8300b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:17.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82f59e700 1 -- 172.21.15.60:0/670178711 shutdown_connections 2020-10-31T22:47:17.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.760+0000 7fc82f59e700 1 -- 172.21.15.60:0/670178711 wait complete. 2020-10-31T22:47:17.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82f59e700 1 Processor -- start 2020-10-31T22:47:17.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82f59e700 1 -- start start 2020-10-31T22:47:17.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82f59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8300af200 0x7fc8300ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:17.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8300b1a10 0x7fc83013d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:17.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82f59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc83013ebe0 0x7fc8300aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:17.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83014aea0 con 0x7fc8300b1a10 2020-10-31T22:47:17.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82f59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83014b0d0 con 0x7fc83013ebe0 2020-10-31T22:47:17.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82f59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83014b370 con 0x7fc8300af200 2020-10-31T22:47:17.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8300b1a10 0x7fc83013d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:17.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8300b1a10 0x7fc83013d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45656/0 (socket says 172.21.15.60:45656) 2020-10-31T22:47:17.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82dd9b700 1 -- 172.21.15.60:0/1259694789 learned_addr learned my addr 172.21.15.60:0/1259694789 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:17.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82e59c700 1 --2- 172.21.15.60:0/1259694789 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8300af200 0x7fc8300ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:17.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82ed9d700 1 --2- 172.21.15.60:0/1259694789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc83013ebe0 0x7fc8300aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:17.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82dd9b700 1 -- 172.21.15.60:0/1259694789 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8300af200 msgr2=0x7fc8300ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:17.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82dd9b700 1 --2- 172.21.15.60:0/1259694789 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8300af200 0x7fc8300ab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82dd9b700 1 -- 172.21.15.60:0/1259694789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc83013ebe0 msgr2=0x7fc8300aa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:17.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82dd9b700 1 --2- 172.21.15.60:0/1259694789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc83013ebe0 0x7fc8300aa1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82dd9b700 1 -- 172.21.15.60:0/1259694789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300666d0 con 0x7fc8300b1a10 2020-10-31T22:47:17.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82dd9b700 1 --2- 172.21.15.60:0/1259694789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8300b1a10 0x7fc83013d990 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fc82400c000 tx=0x7fc824006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:17.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc81f7fe700 1 -- 172.21.15.60:0/1259694789 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc82400ca10 con 0x7fc8300b1a10 2020-10-31T22:47:17.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc81f7fe700 1 -- 172.21.15.60:0/1259694789 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82400cb70 con 0x7fc8300b1a10 2020-10-31T22:47:17.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82f59e700 1 -- 172.21.15.60:0/1259694789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc830066970 con 0x7fc8300b1a10 2020-10-31T22:47:17.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc81f7fe700 1 -- 172.21.15.60:0/1259694789 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8240123f0 con 0x7fc8300b1a10 2020-10-31T22:47:17.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.764+0000 7fc82f59e700 1 -- 172.21.15.60:0/1259694789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8300ab580 con 0x7fc8300b1a10 2020-10-31T22:47:17.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.768+0000 7fc82f59e700 1 -- 172.21.15.60:0/1259694789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc830057100 con 0x7fc8300b1a10 2020-10-31T22:47:17.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.768+0000 7fc81f7fe700 1 -- 172.21.15.60:0/1259694789 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc824012550 con 0x7fc8300b1a10 2020-10-31T22:47:17.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.768+0000 7fc81f7fe700 1 --2- 172.21.15.60:0/1259694789 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc80c054f10 0x7fc80c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:17.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.768+0000 7fc82e59c700 1 --2- 172.21.15.60:0/1259694789 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc80c054f10 0x7fc80c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:17.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.768+0000 7fc81f7fe700 1 -- 172.21.15.60:0/1259694789 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc82406de80 con 0x7fc8300b1a10 2020-10-31T22:47:17.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.768+0000 7fc82e59c700 1 --2- 172.21.15.60:0/1259694789 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc80c054f10 0x7fc80c0573d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fc82000d000 tx=0x7fc820007930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:17.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.776+0000 7fc81f7fe700 1 -- 172.21.15.60:0/1259694789 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc824044230 con 0x7fc8300b1a10 2020-10-31T22:47:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.964+0000 7fc82f59e700 1 -- 172.21.15.60:0/1259694789 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8300b4640 con 0x7fc8300b1a10 2020-10-31T22:47:17.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.964+0000 7fc81f7fe700 1 -- 172.21.15.60:0/1259694789 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+2487 (secure 0 0 0) 0x7fc824047850 con 0x7fc8300b1a10 2020-10-31T22:47:17.967 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:17.967 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":35,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/290520151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":290520151},{"type":"v1","addr":"172.21.15.66:6833","nonce":290520151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1731313860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1731313860},{"type":"v1","addr":"172.21.15.60:6835","nonce":1731313860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:47:06.422241+0000","modified":"2020-10-31T22:47:08.068754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/265867667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":265867667},{"type":"v1","addr":"172.21.15.60:6837","nonce":265867667}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-10-31T22:47:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.964+0000 7fc82f59e700 1 -- 172.21.15.60:0/1259694789 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc80c054f10 msgr2=0x7fc80c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.964+0000 7fc82f59e700 1 --2- 172.21.15.60:0/1259694789 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc80c054f10 0x7fc80c0573d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fc82000d000 tx=0x7fc820007930).stop 2020-10-31T22:47:17.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.964+0000 7fc82f59e700 1 -- 172.21.15.60:0/1259694789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8300b1a10 msgr2=0x7fc83013d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.964+0000 7fc82f59e700 1 --2- 172.21.15.60:0/1259694789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8300b1a10 0x7fc83013d990 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 rx=0x7fc82400c000 tx=0x7fc824006dc0).stop 2020-10-31T22:47:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.964+0000 7fc82f59e700 1 -- 172.21.15.60:0/1259694789 shutdown_connections 2020-10-31T22:47:17.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.964+0000 7fc82f59e700 1 --2- 172.21.15.60:0/1259694789 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc80c054f10 0x7fc80c0573d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.964+0000 7fc82f59e700 1 --2- 172.21.15.60:0/1259694789 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc83013ebe0 0x7fc8300aa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.964+0000 7fc82f59e700 1 --2- 172.21.15.60:0/1259694789 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8300af200 0x7fc8300ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.964+0000 7fc82f59e700 1 --2- 172.21.15.60:0/1259694789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8300b1a10 0x7fc83013d990 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.964+0000 7fc82f59e700 1 -- 172.21.15.60:0/1259694789 >> 172.21.15.60:0/1259694789 conn(0x7fc8300b5300 msgr2=0x7fc8300ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.964+0000 7fc82f59e700 1 -- 172.21.15.60:0/1259694789 shutdown_connections 2020-10-31T22:47:17.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:17.964+0000 7fc82f59e700 1 -- 172.21.15.60:0/1259694789 wait complete. 2020-10-31T22:47:17.971 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2020-10-31T22:47:17.996 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json config set mds_cap_revoke_eviction_timeout 30.0 2020-10-31T22:47:18.122 INFO:teuthology.orchestra.run.smithi060.stdout:{"success":"mds_cap_revoke_eviction_timeout = '30.000000' "} 2020-10-31T22:47:18.122 DEBUG:tasks.cephfs.filesystem:_json_asok output { "success": "mds_cap_revoke_eviction_timeout = '30.000000' " } 2020-10-31T22:47:18.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:18.123 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:47:18.124 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:47:18.133 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:47:18.133 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:47:18.135 INFO:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-10-31T22:47:18.135 INFO:teuthology.orchestra.run.smithi152:> import time 2020-10-31T22:47:18.136 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:47:18.136 INFO:teuthology.orchestra.run.smithi152:> with open("/home/ubuntu/cephtest/mnt.0/background_file", '"'"'w'"'"') as f: 2020-10-31T22:47:18.136 INFO:teuthology.orchestra.run.smithi152:> f.write('"'"'content'"'"') 2020-10-31T22:47:18.137 INFO:teuthology.orchestra.run.smithi152:> f.flush() 2020-10-31T22:47:18.137 INFO:teuthology.orchestra.run.smithi152:> f.write('"'"'content2'"'"') 2020-10-31T22:47:18.137 INFO:teuthology.orchestra.run.smithi152:> while True: 2020-10-31T22:47:18.138 INFO:teuthology.orchestra.run.smithi152:> time.sleep(1) 2020-10-31T22:47:18.138 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:47:18.175 INFO:teuthology.orchestra.run.smithi152:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2020-10-31T22:47:18.197 INFO:teuthology.orchestra.run.smithi152.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/background_file': No such file or directory 2020-10-31T22:47:18.198 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-10-31T22:47:19.199 INFO:teuthology.orchestra.run.smithi152:> sudo ls /home/ubuntu/cephtest/mnt.0/background_file 2020-10-31T22:47:19.217 INFO:teuthology.orchestra.run.smithi152.stdout:/home/ubuntu/cephtest/mnt.0/background_file 2020-10-31T22:47:19.225 DEBUG:tasks.cephfs.mount:File background_file became visible from 0 after 1s 2020-10-31T22:47:19.226 INFO:teuthology.orchestra.run.smithi085:> sudo ls /home/ubuntu/cephtest/mnt.1/background_file 2020-10-31T22:47:19.272 INFO:teuthology.orchestra.run.smithi085.stdout:/home/ubuntu/cephtest/mnt.1/background_file 2020-10-31T22:47:19.273 DEBUG:tasks.cephfs.mount:File background_file became visible from 1 after 0s 2020-10-31T22:47:19.274 INFO:tasks.cephfs.fuse_mount:Killing ceph-fuse connection on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:47:19.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:19.290 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:47:19.291 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:47:19.328 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:47:19.332 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:47:19.333 INFO:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-10-31T22:47:19.334 INFO:teuthology.orchestra.run.smithi085:> import os 2020-10-31T22:47:19.341 INFO:teuthology.orchestra.run.smithi085:> import time 2020-10-31T22:47:19.341 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:47:19.342 INFO:teuthology.orchestra.run.smithi085:> fd = os.open("/home/ubuntu/cephtest/mnt.1/background_file", os.O_RDWR | os.O_CREAT, 0o644) 2020-10-31T22:47:19.342 INFO:teuthology.orchestra.run.smithi085:> try: 2020-10-31T22:47:19.342 INFO:teuthology.orchestra.run.smithi085:> while True: 2020-10-31T22:47:19.342 INFO:teuthology.orchestra.run.smithi085:> os.write(fd, b'"'"'content'"'"') 2020-10-31T22:47:19.343 INFO:teuthology.orchestra.run.smithi085:> time.sleep(1) 2020-10-31T22:47:19.343 INFO:teuthology.orchestra.run.smithi085:> if not False: 2020-10-31T22:47:19.343 INFO:teuthology.orchestra.run.smithi085:> break 2020-10-31T22:47:19.344 INFO:teuthology.orchestra.run.smithi085:> except IOError as e: 2020-10-31T22:47:19.344 INFO:teuthology.orchestra.run.smithi085:> pass 2020-10-31T22:47:19.344 INFO:teuthology.orchestra.run.smithi085:> os.close(fd) 2020-10-31T22:47:19.344 INFO:teuthology.orchestra.run.smithi085:> ' 2020-10-31T22:47:45.097 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:47:45.100 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:47:45.104 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:47:45.107 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:47:57.300 INFO:tasks.cephfs.test_misc:cap_waiter waited 37.926291704177856s 2020-10-31T22:47:57.330 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist ls --format=json 2020-10-31T22:47:57.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.454+0000 7f9334eb9700 1 Processor -- start 2020-10-31T22:47:57.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.454+0000 7f9334eb9700 1 -- start start 2020-10-31T22:47:57.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.454+0000 7f9334eb9700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f93300b5570 0x7f93300b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:57.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.454+0000 7f9334eb9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9330141fe0 0x7f9330142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:57.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.454+0000 7f9334eb9700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9330145180 con 0x7f93300b24a0 2020-10-31T22:47:57.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.454+0000 7f9334eb9700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93300afae0 con 0x7f93300b5570 2020-10-31T22:47:57.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.454+0000 7f9334eb9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9330141bf0 con 0x7f9330141fe0 2020-10-31T22:47:57.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.454+0000 7f932ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9330141fe0 0x7f9330142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:57.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.454+0000 7f932f7fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f93300b5570 0x7f93300b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:57.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.454+0000 7f932ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9330141fe0 0x7f9330142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:58854/0 (socket says 172.21.15.60:58854) 2020-10-31T22:47:57.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.454+0000 7f932f7fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f93300b5570 0x7f93300b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:56598/0 (socket says 172.21.15.60:56598) 2020-10-31T22:47:57.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.454+0000 7f932effd700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f93300b24a0 0x7f9330145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:47668/0 (socket says 172.21.15.60:47668) 2020-10-31T22:47:57.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.454+0000 7f932ffff700 1 -- 172.21.15.60:0/2308981248 learned_addr learned my addr 172.21.15.60:0/2308981248 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:57.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f932ffff700 1 -- 172.21.15.60:0/2308981248 >> v2:172.21.15.66:3300/0 conn(0x7f93300b5570 msgr2=0x7f93300b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:57.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f932ffff700 1 --2- 172.21.15.60:0/2308981248 >> v2:172.21.15.66:3300/0 conn(0x7f93300b5570 0x7f93300b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:57.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f932ffff700 1 -- 172.21.15.60:0/2308981248 >> v1:172.21.15.66:6789/0 conn(0x7f93300b24a0 legacy=0x7f9330145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:57.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f932ffff700 1 -- 172.21.15.60:0/2308981248 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93300b0670 con 0x7f9330141fe0 2020-10-31T22:47:57.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f932f7fe700 1 --2- 172.21.15.60:0/2308981248 >> v2:172.21.15.66:3300/0 conn(0x7f93300b5570 0x7f93300b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:47:57.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f932ffff700 1 --2- 172.21.15.60:0/2308981248 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9330141fe0 0x7f9330142490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f933005f580 tx=0x7f9328009270).ready entity=mon.2 client_cookie=84309d7d96a711ea server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:57.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f932e7fc700 1 -- 172.21.15.60:0/2308981248 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9328009e90 con 0x7f9330141fe0 2020-10-31T22:47:57.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f932e7fc700 1 -- 172.21.15.60:0/2308981248 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932800bbc0 con 0x7f9330141fe0 2020-10-31T22:47:57.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f932e7fc700 1 -- 172.21.15.60:0/2308981248 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f932800bd30 con 0x7f9330141fe0 2020-10-31T22:47:57.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f9334eb9700 1 -- 172.21.15.60:0/2308981248 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9330141fe0 msgr2=0x7f9330142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:57.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f9334eb9700 1 --2- 172.21.15.60:0/2308981248 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9330141fe0 0x7f9330142490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f933005f580 tx=0x7f9328009270).stop 2020-10-31T22:47:57.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f9334eb9700 1 -- 172.21.15.60:0/2308981248 shutdown_connections 2020-10-31T22:47:57.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f9334eb9700 1 --2- 172.21.15.60:0/2308981248 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9330141fe0 0x7f9330142490 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:57.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f9334eb9700 1 --2- 172.21.15.60:0/2308981248 >> v2:172.21.15.66:3300/0 conn(0x7f93300b5570 0x7f93300b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:57.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f9334eb9700 1 -- 172.21.15.60:0/2308981248 >> 172.21.15.60:0/2308981248 conn(0x7f93300b8e90 msgr2=0x7f93300b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:57.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f9334eb9700 1 -- 172.21.15.60:0/2308981248 shutdown_connections 2020-10-31T22:47:57.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f9334eb9700 1 -- 172.21.15.60:0/2308981248 wait complete. 2020-10-31T22:47:57.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f9334eb9700 1 Processor -- start 2020-10-31T22:47:57.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.458+0000 7f9334eb9700 1 -- start start 2020-10-31T22:47:57.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f9334eb9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93300b24a0 0x7f93300b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:57.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f9334eb9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93300b5570 0x7f93300ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:57.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f9334eb9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9330141fe0 0x7f93300acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:57.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f9334eb9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93300ac250 con 0x7f93300b5570 2020-10-31T22:47:57.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f9334eb9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93300ad060 con 0x7f93300b24a0 2020-10-31T22:47:57.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f9334eb9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93301484c0 con 0x7f9330141fe0 2020-10-31T22:47:57.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f932effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93300b5570 0x7f93300ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:57.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f932effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93300b5570 0x7f93300ac680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45670/0 (socket says 172.21.15.60:45670) 2020-10-31T22:47:57.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f932effd700 1 -- 172.21.15.60:0/1128870697 learned_addr learned my addr 172.21.15.60:0/1128870697 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:57.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f932f7fe700 1 --2- 172.21.15.60:0/1128870697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93300b24a0 0x7f93300b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:57.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f932ffff700 1 --2- 172.21.15.60:0/1128870697 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9330141fe0 0x7f93300acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:57.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f932effd700 1 -- 172.21.15.60:0/1128870697 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9330141fe0 msgr2=0x7f93300acb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:57.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f932effd700 1 --2- 172.21.15.60:0/1128870697 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9330141fe0 0x7f93300acb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:57.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f932effd700 1 -- 172.21.15.60:0/1128870697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93300b24a0 msgr2=0x7f93300b6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:57.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f932effd700 1 --2- 172.21.15.60:0/1128870697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93300b24a0 0x7f93300b6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:57.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f932effd700 1 -- 172.21.15.60:0/1128870697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9330148760 con 0x7f93300b5570 2020-10-31T22:47:57.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f932effd700 1 --2- 172.21.15.60:0/1128870697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93300b5570 0x7f93300ac680 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f933005c9f0 tx=0x7f9320007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:57.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f932cff9700 1 -- 172.21.15.60:0/1128870697 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93200072e0 con 0x7f93300b5570 2020-10-31T22:47:57.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f932cff9700 1 -- 172.21.15.60:0/1128870697 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9320005520 con 0x7f93300b5570 2020-10-31T22:47:57.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f932cff9700 1 -- 172.21.15.60:0/1128870697 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9320005880 con 0x7f93300b5570 2020-10-31T22:47:57.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f9334eb9700 1 -- 172.21.15.60:0/1128870697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9330148a00 con 0x7f93300b5570 2020-10-31T22:47:57.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f9334eb9700 1 -- 172.21.15.60:0/1128870697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93300b7820 con 0x7f93300b5570 2020-10-31T22:47:57.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.462+0000 7f9334eb9700 1 -- 172.21.15.60:0/1128870697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93300ac3c0 con 0x7f93300b5570 2020-10-31T22:47:57.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.466+0000 7f932cff9700 1 -- 172.21.15.60:0/1128870697 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9320010070 con 0x7f93300b5570 2020-10-31T22:47:57.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.466+0000 7f932cff9700 1 --2- 172.21.15.60:0/1128870697 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9310054f90 0x7f9310057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:57.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.466+0000 7f932cff9700 1 -- 172.21.15.60:0/1128870697 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f932006cf70 con 0x7f93300b5570 2020-10-31T22:47:57.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.466+0000 7f932f7fe700 1 --2- 172.21.15.60:0/1128870697 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9310054f90 0x7f9310057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:57.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.466+0000 7f932f7fe700 1 --2- 172.21.15.60:0/1128870697 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9310054f90 0x7f9310057450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f932400b000 tx=0x7f9324006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:57.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.470+0000 7f932cff9700 1 -- 172.21.15.60:0/1128870697 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f93300ac3c0 con 0x7f93300b5570 2020-10-31T22:47:57.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.626+0000 7f9334eb9700 1 -- 172.21.15.60:0/1128870697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blacklist ls", "format": "json"} v 0) v1 -- 0x7f93300ac390 con 0x7f93300b5570 2020-10-31T22:47:57.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.626+0000 7f932cff9700 1 -- 172.21.15.60:0/1128870697 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist ls", "format": "json"}]=0 listed 1 entries v77) v1 ==== 98+0+81 (secure 0 0 0) 0x7f9320018030 con 0x7f93300b5570 2020-10-31T22:47:57.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.630+0000 7f9334eb9700 1 -- 172.21.15.60:0/1128870697 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9310054f90 msgr2=0x7f9310057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:57.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.630+0000 7f9334eb9700 1 --2- 172.21.15.60:0/1128870697 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9310054f90 0x7f9310057450 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7f932400b000 tx=0x7f9324006dc0).stop 2020-10-31T22:47:57.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.630+0000 7f9334eb9700 1 -- 172.21.15.60:0/1128870697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93300b5570 msgr2=0x7f93300ac680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:57.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.630+0000 7f9334eb9700 1 --2- 172.21.15.60:0/1128870697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93300b5570 0x7f93300ac680 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 rx=0x7f933005c9f0 tx=0x7f9320007c10).stop 2020-10-31T22:47:57.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.630+0000 7f9334eb9700 1 -- 172.21.15.60:0/1128870697 shutdown_connections 2020-10-31T22:47:57.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.630+0000 7f9334eb9700 1 --2- 172.21.15.60:0/1128870697 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9330141fe0 0x7f93300acb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:57.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.630+0000 7f9334eb9700 1 --2- 172.21.15.60:0/1128870697 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9310054f90 0x7f9310057450 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:57.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.630+0000 7f9334eb9700 1 --2- 172.21.15.60:0/1128870697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93300b24a0 0x7f93300b6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:57.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.630+0000 7f9334eb9700 1 --2- 172.21.15.60:0/1128870697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93300b5570 0x7f93300ac680 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:57.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.630+0000 7f9334eb9700 1 -- 172.21.15.60:0/1128870697 >> 172.21.15.60:0/1128870697 conn(0x7f93300b8e90 msgr2=0x7f93300b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:57.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.630+0000 7f9334eb9700 1 -- 172.21.15.60:0/1128870697 shutdown_connections 2020-10-31T22:47:57.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:57.630+0000 7f9334eb9700 1 -- 172.21.15.60:0/1128870697 wait complete. 2020-10-31T22:47:57.651 INFO:teuthology.orchestra.run.smithi060.stderr:listed 1 entries 2020-10-31T22:47:57.651 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:57.653 INFO:teuthology.orchestra.run.smithi060.stdout:[{"addr":"172.21.15.152:0/2872377370","until":"2020-10-31T23:47:51.180113+0000"}] 2020-10-31T22:47:57.670 INFO:tasks.cephfs.fuse_mount:Cleaning up killed ceph-fuse connection 2020-10-31T22:47:57.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:57.672 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:47:57.673 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:47:57.725 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': Transport endpoint is not connected 2020-10-31T22:47:57.728 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:47:57.728 WARNING:tasks.cephfs.fuse_mount:Found stale moutn point at /home/ubuntu/cephtest/mnt.0 2020-10-31T22:47:57.729 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:47:57.729 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:47:57.729 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:47:57.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:47:57.818 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:47:57.818 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:47:57.873 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:47:57.874 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:47:57.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:47:57.877 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:47:57.936 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:47:58.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.058+0000 7fa611055700 1 Processor -- start 2020-10-31T22:47:58.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.058+0000 7fa611055700 1 -- start start 2020-10-31T22:47:58.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.058+0000 7fa611055700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa60c063140 0x7fa60c0b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.058+0000 7fa611055700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa60c0b1000 0x7fa60c1452b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.058+0000 7fa611055700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa60c0b2820 0x7fa60c0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.058+0000 7fa611055700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c0b2060 con 0x7fa60c0b1000 2020-10-31T22:47:58.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.058+0000 7fa611055700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60c063520 con 0x7fa60c063140 2020-10-31T22:47:58.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.058+0000 7fa611055700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0b02e0 con 0x7fa60c0b2820 2020-10-31T22:47:58.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa6037fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa60c0b1000 0x7fa60c1452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa6037fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa60c0b1000 0x7fa60c1452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45678/0 (socket says 172.21.15.60:45678) 2020-10-31T22:47:58.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa6037fe700 1 -- 172.21.15.60:0/4112700381 learned_addr learned my addr 172.21.15.60:0/4112700381 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:58.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa610854700 1 --2- 172.21.15.60:0/4112700381 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa60c0b2820 0x7fa60c0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa60bfff700 1 --2- 172.21.15.60:0/4112700381 >> v2:172.21.15.66:3300/0 conn(0x7fa60c063140 0x7fa60c0b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa6037fe700 1 -- 172.21.15.60:0/4112700381 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa60c0b2820 msgr2=0x7fa60c0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:58.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa6037fe700 1 --2- 172.21.15.60:0/4112700381 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa60c0b2820 0x7fa60c0aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa6037fe700 1 -- 172.21.15.60:0/4112700381 >> v2:172.21.15.66:3300/0 conn(0x7fa60c063140 msgr2=0x7fa60c0b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:58.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa6037fe700 1 --2- 172.21.15.60:0/4112700381 >> v2:172.21.15.66:3300/0 conn(0x7fa60c063140 0x7fa60c0b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa6037fe700 1 -- 172.21.15.60:0/4112700381 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c0b1dc0 con 0x7fa60c0b1000 2020-10-31T22:47:58.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa6037fe700 1 --2- 172.21.15.60:0/4112700381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0b1000 0x7fa60c1452b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7fa5f4002f30 tx=0x7fa5f4006e80).ready entity=mon.0 client_cookie=f6f4844582619c0a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:58.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa60b7fe700 1 -- 172.21.15.60:0/4112700381 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f4009640 con 0x7fa60c0b1000 2020-10-31T22:47:58.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa60b7fe700 1 -- 172.21.15.60:0/4112700381 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f40097a0 con 0x7fa60c0b1000 2020-10-31T22:47:58.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa60b7fe700 1 -- 172.21.15.60:0/4112700381 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f4009b00 con 0x7fa60c0b1000 2020-10-31T22:47:58.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa611055700 1 -- 172.21.15.60:0/4112700381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0b1000 msgr2=0x7fa60c1452b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa611055700 1 --2- 172.21.15.60:0/4112700381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0b1000 0x7fa60c1452b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 rx=0x7fa5f4002f30 tx=0x7fa5f4006e80).stop 2020-10-31T22:47:58.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa611055700 1 -- 172.21.15.60:0/4112700381 shutdown_connections 2020-10-31T22:47:58.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa611055700 1 --2- 172.21.15.60:0/4112700381 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa60c0b2820 0x7fa60c0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa611055700 1 --2- 172.21.15.60:0/4112700381 >> v2:172.21.15.66:3300/0 conn(0x7fa60c063140 0x7fa60c0b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa611055700 1 --2- 172.21.15.60:0/4112700381 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0b1000 0x7fa60c1452b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa611055700 1 -- 172.21.15.60:0/4112700381 >> 172.21.15.60:0/4112700381 conn(0x7fa60c06a600 msgr2=0x7fa60c060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:58.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa611055700 1 -- 172.21.15.60:0/4112700381 shutdown_connections 2020-10-31T22:47:58.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.062+0000 7fa611055700 1 -- 172.21.15.60:0/4112700381 wait complete. 2020-10-31T22:47:58.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa611055700 1 Processor -- start 2020-10-31T22:47:58.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa611055700 1 -- start start 2020-10-31T22:47:58.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa611055700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa60c063140 0x7fa60c0b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa611055700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa60c0b1000 0x7fa60c064d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa611055700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0b2820 0x7fa60c154b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa611055700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c150c50 con 0x7fa60c0b2820 2020-10-31T22:47:58.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa611055700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c065260 con 0x7fa60c0b1000 2020-10-31T22:47:58.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa611055700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa60c0642a0 con 0x7fa60c063140 2020-10-31T22:47:58.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa610854700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0b2820 0x7fa60c154b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa6037fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa60c0b1000 0x7fa60c064d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa60bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa60c063140 0x7fa60c0b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa610854700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0b2820 0x7fa60c154b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45686/0 (socket says 172.21.15.60:45686) 2020-10-31T22:47:58.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa610854700 1 -- 172.21.15.60:0/2028531624 learned_addr learned my addr 172.21.15.60:0/2028531624 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:58.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa610854700 1 -- 172.21.15.60:0/2028531624 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa60c063140 msgr2=0x7fa60c0b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa610854700 1 --2- 172.21.15.60:0/2028531624 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa60c063140 0x7fa60c0b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa610854700 1 -- 172.21.15.60:0/2028531624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa60c0b1000 msgr2=0x7fa60c064d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa610854700 1 --2- 172.21.15.60:0/2028531624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa60c0b1000 0x7fa60c064d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa610854700 1 -- 172.21.15.60:0/2028531624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c150e40 con 0x7fa60c0b2820 2020-10-31T22:47:58.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa610854700 1 --2- 172.21.15.60:0/2028531624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0b2820 0x7fa60c154b10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fa60c0678f0 tx=0x7fa6040091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:58.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa609ffb700 1 -- 172.21.15.60:0/2028531624 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa60400ca00 con 0x7fa60c0b2820 2020-10-31T22:47:58.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa609ffb700 1 -- 172.21.15.60:0/2028531624 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60400cb60 con 0x7fa60c0b2820 2020-10-31T22:47:58.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa611055700 1 -- 172.21.15.60:0/2028531624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa60c1510e0 con 0x7fa60c0b2820 2020-10-31T22:47:58.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa609ffb700 1 -- 172.21.15.60:0/2028531624 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa60400cec0 con 0x7fa60c0b2820 2020-10-31T22:47:58.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.066+0000 7fa611055700 1 -- 172.21.15.60:0/2028531624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa60c063d20 con 0x7fa60c0b2820 2020-10-31T22:47:58.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.070+0000 7fa611055700 1 -- 172.21.15.60:0/2028531624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60c057100 con 0x7fa60c0b2820 2020-10-31T22:47:58.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.070+0000 7fa609ffb700 1 -- 172.21.15.60:0/2028531624 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa604022070 con 0x7fa60c0b2820 2020-10-31T22:47:58.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.070+0000 7fa609ffb700 1 --2- 172.21.15.60:0/2028531624 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5f0054fd0 0x7fa5f0057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.070+0000 7fa609ffb700 1 -- 172.21.15.60:0/2028531624 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fa60406e0d0 con 0x7fa60c0b2820 2020-10-31T22:47:58.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.070+0000 7fa60bfff700 1 --2- 172.21.15.60:0/2028531624 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5f0054fd0 0x7fa5f0057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.070+0000 7fa60bfff700 1 --2- 172.21.15.60:0/2028531624 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5f0054fd0 0x7fa5f0057490 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fa5fc00b000 tx=0x7fa5fc006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:58.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.078+0000 7fa609ffb700 1 -- 172.21.15.60:0/2028531624 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa6040445c0 con 0x7fa60c0b2820 2020-10-31T22:47:58.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.222+0000 7fa611055700 1 -- 172.21.15.60:0/2028531624 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa60c05ed50 con 0x7fa60c0b2820 2020-10-31T22:47:58.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.222+0000 7fa609ffb700 1 -- 172.21.15.60:0/2028531624 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16103 (secure 0 0 0) 0x7fa604016070 con 0x7fa60c0b2820 2020-10-31T22:47:58.229 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:58.229 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":77,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:47:51.986567+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":13,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:47:04.119666+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":14,"pool_name":"cephfs_data","create_time":"2020-10-31T22:47:05.419686+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.152:0/2872377370":"2020-10-31T23:47:51.180113+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:47:58.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.222+0000 7fa611055700 1 -- 172.21.15.60:0/2028531624 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5f0054fd0 msgr2=0x7fa5f0057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.222+0000 7fa611055700 1 --2- 172.21.15.60:0/2028531624 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5f0054fd0 0x7fa5f0057490 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fa5fc00b000 tx=0x7fa5fc006dc0).stop 2020-10-31T22:47:58.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.222+0000 7fa611055700 1 -- 172.21.15.60:0/2028531624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0b2820 msgr2=0x7fa60c154b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.222+0000 7fa611055700 1 --2- 172.21.15.60:0/2028531624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0b2820 0x7fa60c154b10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 rx=0x7fa60c0678f0 tx=0x7fa6040091a0).stop 2020-10-31T22:47:58.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.226+0000 7fa611055700 1 -- 172.21.15.60:0/2028531624 shutdown_connections 2020-10-31T22:47:58.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.226+0000 7fa611055700 1 --2- 172.21.15.60:0/2028531624 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa60c0b2820 0x7fa60c154b10 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.226+0000 7fa611055700 1 --2- 172.21.15.60:0/2028531624 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa60c063140 0x7fa60c0b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.226+0000 7fa611055700 1 --2- 172.21.15.60:0/2028531624 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5f0054fd0 0x7fa5f0057490 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.226+0000 7fa611055700 1 --2- 172.21.15.60:0/2028531624 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa60c0b1000 0x7fa60c064d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.226+0000 7fa611055700 1 -- 172.21.15.60:0/2028531624 >> 172.21.15.60:0/2028531624 conn(0x7fa60c06a600 msgr2=0x7fa60c0ae810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:58.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.226+0000 7fa611055700 1 -- 172.21.15.60:0/2028531624 shutdown_connections 2020-10-31T22:47:58.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.226+0000 7fa611055700 1 -- 172.21.15.60:0/2028531624 wait complete. 2020-10-31T22:47:58.244 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 13, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:47:04.119666+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 14, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:47:05.419686+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:47:58.248 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:47:58.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.366+0000 7f22ad486700 1 Processor -- start 2020-10-31T22:47:58.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22ad486700 1 -- start start 2020-10-31T22:47:58.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22ad486700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f22a805c660 0x7f22a80b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22ad486700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22a80b2e20 0x7f22a8142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22ad486700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22a8066410 con 0x7f22a8065f70 2020-10-31T22:47:58.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22ad486700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a8066d60 con 0x7f22a80b2e20 2020-10-31T22:47:58.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22ad486700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22a80b5e80 con 0x7f22a805c660 2020-10-31T22:47:58.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22a77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22a80b2e20 0x7f22a8142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22a77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22a80b2e20 0x7f22a8142610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45692/0 (socket says 172.21.15.60:45692) 2020-10-31T22:47:58.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22a77fe700 1 -- 172.21.15.60:0/1527687598 learned_addr learned my addr 172.21.15.60:0/1527687598 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:58.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22a6ffd700 1 --2- 172.21.15.60:0/1527687598 >> v2:172.21.15.66:3300/0 conn(0x7f22a805c660 0x7f22a80b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22a77fe700 1 -- 172.21.15.60:0/1527687598 >> v2:172.21.15.66:3300/0 conn(0x7f22a805c660 msgr2=0x7f22a80b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:58.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22a77fe700 1 --2- 172.21.15.60:0/1527687598 >> v2:172.21.15.66:3300/0 conn(0x7f22a805c660 0x7f22a80b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22a77fe700 1 -- 172.21.15.60:0/1527687598 >> v1:172.21.15.66:6789/0 conn(0x7f22a8065f70 legacy=0x7f22a813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22a77fe700 1 -- 172.21.15.60:0/1527687598 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a80666b0 con 0x7f22a80b2e20 2020-10-31T22:47:58.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22a77fe700 1 --2- 172.21.15.60:0/1527687598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a80b2e20 0x7f22a8142610 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f22a0002f30 tx=0x7f22a0006e80).ready entity=mon.0 client_cookie=55f6d96c2a9ebda4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:58.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22a5ffb700 1 -- 172.21.15.60:0/1527687598 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22a00097f0 con 0x7f22a80b2e20 2020-10-31T22:47:58.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22a5ffb700 1 -- 172.21.15.60:0/1527687598 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a0009950 con 0x7f22a80b2e20 2020-10-31T22:47:58.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22a5ffb700 1 -- 172.21.15.60:0/1527687598 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f22a0009cb0 con 0x7f22a80b2e20 2020-10-31T22:47:58.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22ad486700 1 -- 172.21.15.60:0/1527687598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a80b2e20 msgr2=0x7f22a8142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22ad486700 1 --2- 172.21.15.60:0/1527687598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a80b2e20 0x7f22a8142610 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 rx=0x7f22a0002f30 tx=0x7f22a0006e80).stop 2020-10-31T22:47:58.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22ad486700 1 -- 172.21.15.60:0/1527687598 shutdown_connections 2020-10-31T22:47:58.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22ad486700 1 --2- 172.21.15.60:0/1527687598 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a80b2e20 0x7f22a8142610 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22ad486700 1 --2- 172.21.15.60:0/1527687598 >> v2:172.21.15.66:3300/0 conn(0x7f22a805c660 0x7f22a80b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22ad486700 1 -- 172.21.15.60:0/1527687598 >> 172.21.15.60:0/1527687598 conn(0x7f22a80601e0 msgr2=0x7f22a805b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:58.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22ad486700 1 -- 172.21.15.60:0/1527687598 shutdown_connections 2020-10-31T22:47:58.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.370+0000 7f22ad486700 1 -- 172.21.15.60:0/1527687598 wait complete. 2020-10-31T22:47:58.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22ad486700 1 Processor -- start 2020-10-31T22:47:58.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22ad486700 1 -- start start 2020-10-31T22:47:58.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22ad486700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a805c660 0x7f22a80a9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22ad486700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22a8065f70 0x7f22a80b1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22ad486700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22a80b2e20 0x7f22a80b2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22ad486700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a80b2860 con 0x7f22a805c660 2020-10-31T22:47:58.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22ad486700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22a81517b0 con 0x7f22a80b2e20 2020-10-31T22:47:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22ad486700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22a8151a30 con 0x7f22a8065f70 2020-10-31T22:47:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22a6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a805c660 0x7f22a80a9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22a6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a805c660 0x7f22a80a9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45696/0 (socket says 172.21.15.60:45696) 2020-10-31T22:47:58.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22a6ffd700 1 -- 172.21.15.60:0/834271328 learned_addr learned my addr 172.21.15.60:0/834271328 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:58.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22a77fe700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22a80b2e20 0x7f22a80b2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22a67fc700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22a8065f70 0x7f22a80b1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22a6ffd700 1 -- 172.21.15.60:0/834271328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22a8065f70 msgr2=0x7f22a80b1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22a6ffd700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22a8065f70 0x7f22a80b1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22a6ffd700 1 -- 172.21.15.60:0/834271328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22a80b2e20 msgr2=0x7f22a80b2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22a6ffd700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22a80b2e20 0x7f22a80b2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22a6ffd700 1 -- 172.21.15.60:0/834271328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a80b19e0 con 0x7f22a805c660 2020-10-31T22:47:58.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22a67fc700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22a8065f70 0x7f22a80b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:47:58.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22a6ffd700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a805c660 0x7f22a80a9060 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f22a80b29d0 tx=0x7f2290008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:58.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f229ffff700 1 -- 172.21.15.60:0/834271328 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f229000bb20 con 0x7f22a805c660 2020-10-31T22:47:58.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f229ffff700 1 -- 172.21.15.60:0/834271328 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229000bc80 con 0x7f22a805c660 2020-10-31T22:47:58.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22ad486700 1 -- 172.21.15.60:0/834271328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a80a9550 con 0x7f22a805c660 2020-10-31T22:47:58.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f229ffff700 1 -- 172.21.15.60:0/834271328 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2290012420 con 0x7f22a805c660 2020-10-31T22:47:58.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.374+0000 7f22ad486700 1 -- 172.21.15.60:0/834271328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22a80aa970 con 0x7f22a805c660 2020-10-31T22:47:58.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.378+0000 7f22ad486700 1 -- 172.21.15.60:0/834271328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22a80b1040 con 0x7f22a805c660 2020-10-31T22:47:58.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.378+0000 7f229ffff700 1 -- 172.21.15.60:0/834271328 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2290012580 con 0x7f22a805c660 2020-10-31T22:47:58.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.378+0000 7f229ffff700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f228c055020 0x7f228c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.378+0000 7f229ffff700 1 -- 172.21.15.60:0/834271328 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f229006e0c0 con 0x7f22a805c660 2020-10-31T22:47:58.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.378+0000 7f22a67fc700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f228c055020 0x7f228c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.378+0000 7f22a67fc700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f228c055020 0x7f228c0574e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f229800b000 tx=0x7f2298009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:58.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.382+0000 7f229ffff700 1 -- 172.21.15.60:0/834271328 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f22900444b0 con 0x7f22a805c660 2020-10-31T22:47:58.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.530+0000 7f22ad486700 1 -- 172.21.15.60:0/834271328 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f22a80b1ba0 con 0x7f22a805c660 2020-10-31T22:47:58.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.530+0000 7f229ffff700 1 -- 172.21.15.60:0/834271328 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v77) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2290047ad0 con 0x7f22a805c660 2020-10-31T22:47:58.535 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:47:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.530+0000 7f22ad486700 1 -- 172.21.15.60:0/834271328 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f228c055020 msgr2=0x7f228c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.530+0000 7f22ad486700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f228c055020 0x7f228c0574e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f229800b000 tx=0x7f2298009040).stop 2020-10-31T22:47:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.530+0000 7f22ad486700 1 -- 172.21.15.60:0/834271328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a805c660 msgr2=0x7f22a80a9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.530+0000 7f22ad486700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a805c660 0x7f22a80a9060 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 rx=0x7f22a80b29d0 tx=0x7f2290008040).stop 2020-10-31T22:47:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.530+0000 7f22ad486700 1 -- 172.21.15.60:0/834271328 shutdown_connections 2020-10-31T22:47:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.530+0000 7f22ad486700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f228c055020 0x7f228c0574e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.530+0000 7f22ad486700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22a80b2e20 0x7f22a80b2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.530+0000 7f22ad486700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22a805c660 0x7f22a80a9060 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.530+0000 7f22ad486700 1 --2- 172.21.15.60:0/834271328 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f22a8065f70 0x7f22a80b1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.530+0000 7f22ad486700 1 -- 172.21.15.60:0/834271328 >> 172.21.15.60:0/834271328 conn(0x7f22a80601e0 msgr2=0x7f22a80b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:58.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.530+0000 7f22ad486700 1 -- 172.21.15.60:0/834271328 shutdown_connections 2020-10-31T22:47:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.530+0000 7f22ad486700 1 -- 172.21.15.60:0/834271328 wait complete. 2020-10-31T22:47:58.549 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:47:58.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.658+0000 7fb1c8927700 1 Processor -- start 2020-10-31T22:47:58.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.658+0000 7fb1c8927700 1 -- start start 2020-10-31T22:47:58.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c8927700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb1c40acc60 0x7fb1c40b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c8927700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c405b700 con 0x7fb1c40ad610 2020-10-31T22:47:58.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c8927700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c4140750 con 0x7fb1c405b320 2020-10-31T22:47:58.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c8927700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c40b0340 con 0x7fb1c40acc60 2020-10-31T22:47:58.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c2ffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb1c40acc60 0x7fb1c40b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c2ffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb1c40acc60 0x7fb1c40b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:56642/0 (socket says 172.21.15.60:56642) 2020-10-31T22:47:58.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c2ffd700 1 -- 172.21.15.60:0/704494532 learned_addr learned my addr 172.21.15.60:0/704494532 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:58.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c27fc700 1 -- 172.21.15.60:0/704494532 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150598780 0 0) 0x7fb1c405b700 con 0x7fb1c40ad610 2020-10-31T22:47:58.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c2ffd700 1 -- 172.21.15.60:0/704494532 >> v1:172.21.15.66:6789/0 conn(0x7fb1c405b320 legacy=0x7fb1c40b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c2ffd700 1 -- 172.21.15.60:0/704494532 >> v1:172.21.15.60:6789/0 conn(0x7fb1c40ad610 legacy=0x7fb1c40ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c2ffd700 1 -- 172.21.15.60:0/704494532 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c40b05e0 con 0x7fb1c40acc60 2020-10-31T22:47:58.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c2ffd700 1 --2- 172.21.15.60:0/704494532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1c40acc60 0x7fb1c40b24c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fb1b8002f30 tx=0x7fb1b8006e80).ready entity=mon.1 client_cookie=d893bea63547be46 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:58.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c27fc700 1 -- 172.21.15.60:0/704494532 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1b80097f0 con 0x7fb1c40acc60 2020-10-31T22:47:58.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c27fc700 1 -- 172.21.15.60:0/704494532 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b8009950 con 0x7fb1c40acc60 2020-10-31T22:47:58.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c27fc700 1 -- 172.21.15.60:0/704494532 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1b8009cb0 con 0x7fb1c40acc60 2020-10-31T22:47:58.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c8927700 1 -- 172.21.15.60:0/704494532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1c40acc60 msgr2=0x7fb1c40b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c8927700 1 --2- 172.21.15.60:0/704494532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1c40acc60 0x7fb1c40b24c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fb1b8002f30 tx=0x7fb1b8006e80).stop 2020-10-31T22:47:58.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c8927700 1 -- 172.21.15.60:0/704494532 shutdown_connections 2020-10-31T22:47:58.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c8927700 1 --2- 172.21.15.60:0/704494532 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1c40acc60 0x7fb1c40b24c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c8927700 1 -- 172.21.15.60:0/704494532 >> 172.21.15.60:0/704494532 conn(0x7fb1c40b61d0 msgr2=0x7fb1c40b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:58.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c8927700 1 -- 172.21.15.60:0/704494532 shutdown_connections 2020-10-31T22:47:58.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.662+0000 7fb1c8927700 1 -- 172.21.15.60:0/704494532 wait complete. 2020-10-31T22:47:58.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c8927700 1 Processor -- start 2020-10-31T22:47:58.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c8927700 1 -- start start 2020-10-31T22:47:58.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c8927700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb1c405b320 0x7fb1c4141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c8927700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1c40acc60 0x7fb1c40aaf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c8927700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1c40ad610 0x7fb1c4152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c8927700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c414e860 con 0x7fb1c40acc60 2020-10-31T22:47:58.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c8927700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c40ab430 con 0x7fb1c40ad610 2020-10-31T22:47:58.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c8927700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c414ea50 con 0x7fb1c405b320 2020-10-31T22:47:58.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1c40acc60 0x7fb1c40aaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1c40acc60 0x7fb1c40aaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45712/0 (socket says 172.21.15.60:45712) 2020-10-31T22:47:58.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c2ffd700 1 -- 172.21.15.60:0/125568818 learned_addr learned my addr 172.21.15.60:0/125568818 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:58.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c3fff700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1c40ad610 0x7fb1c4152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c37fe700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb1c405b320 0x7fb1c4141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c2ffd700 1 -- 172.21.15.60:0/125568818 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb1c405b320 msgr2=0x7fb1c4141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c2ffd700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb1c405b320 0x7fb1c4141c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c2ffd700 1 -- 172.21.15.60:0/125568818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1c40ad610 msgr2=0x7fb1c4152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c2ffd700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1c40ad610 0x7fb1c4152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c2ffd700 1 -- 172.21.15.60:0/125568818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4151f30 con 0x7fb1c40acc60 2020-10-31T22:47:58.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c37fe700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb1c405b320 0x7fb1c4141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:47:58.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c2ffd700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1c40acc60 0x7fb1c40aaf40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fb1b8002f30 tx=0x7fb1b8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:58.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c0ff9700 1 -- 172.21.15.60:0/125568818 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1b8009c50 con 0x7fb1c40acc60 2020-10-31T22:47:58.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c0ff9700 1 -- 172.21.15.60:0/125568818 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b8011e10 con 0x7fb1c40acc60 2020-10-31T22:47:58.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c8927700 1 -- 172.21.15.60:0/125568818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c41521d0 con 0x7fb1c40acc60 2020-10-31T22:47:58.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c0ff9700 1 -- 172.21.15.60:0/125568818 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1b801d7c0 con 0x7fb1c40acc60 2020-10-31T22:47:58.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.666+0000 7fb1c8927700 1 -- 172.21.15.60:0/125568818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c4152b60 con 0x7fb1c40acc60 2020-10-31T22:47:58.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.670+0000 7fb1c8927700 1 -- 172.21.15.60:0/125568818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c4152360 con 0x7fb1c40acc60 2020-10-31T22:47:58.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.670+0000 7fb1c0ff9700 1 -- 172.21.15.60:0/125568818 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb1b801a040 con 0x7fb1c40acc60 2020-10-31T22:47:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.670+0000 7fb1c0ff9700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb1a4054f30 0x7fb1a40573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.670+0000 7fb1c37fe700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb1a4054f30 0x7fb1a40573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.670+0000 7fb1c0ff9700 1 -- 172.21.15.60:0/125568818 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb1b806ebe0 con 0x7fb1c40acc60 2020-10-31T22:47:58.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.670+0000 7fb1c37fe700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb1a4054f30 0x7fb1a40573f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fb1b4008000 tx=0x7fb1b4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:58.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.678+0000 7fb1c0ff9700 1 -- 172.21.15.60:0/125568818 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb1b8044fc0 con 0x7fb1c40acc60 2020-10-31T22:47:58.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.830+0000 7fb1c8927700 1 -- 172.21.15.60:0/125568818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb1c4057100 con 0x7fb1c40acc60 2020-10-31T22:47:58.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.830+0000 7fb1c0ff9700 1 -- 172.21.15.60:0/125568818 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v77) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb1b8023030 con 0x7fb1c40acc60 2020-10-31T22:47:58.835 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:47:58.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.830+0000 7fb1c8927700 1 -- 172.21.15.60:0/125568818 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb1a4054f30 msgr2=0x7fb1a40573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.830+0000 7fb1c8927700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb1a4054f30 0x7fb1a40573f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fb1b4008000 tx=0x7fb1b4009040).stop 2020-10-31T22:47:58.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.830+0000 7fb1c8927700 1 -- 172.21.15.60:0/125568818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1c40acc60 msgr2=0x7fb1c40aaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.830+0000 7fb1c8927700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1c40acc60 0x7fb1c40aaf40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 rx=0x7fb1b8002f30 tx=0x7fb1b8015000).stop 2020-10-31T22:47:58.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.830+0000 7fb1c8927700 1 -- 172.21.15.60:0/125568818 shutdown_connections 2020-10-31T22:47:58.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.830+0000 7fb1c8927700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb1a4054f30 0x7fb1a40573f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.830+0000 7fb1c8927700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1c40ad610 0x7fb1c4152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.830+0000 7fb1c8927700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb1c405b320 0x7fb1c4141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.830+0000 7fb1c8927700 1 --2- 172.21.15.60:0/125568818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb1c40acc60 0x7fb1c40aaf40 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.830+0000 7fb1c8927700 1 -- 172.21.15.60:0/125568818 >> 172.21.15.60:0/125568818 conn(0x7fb1c40b61d0 msgr2=0x7fb1c413e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.830+0000 7fb1c8927700 1 -- 172.21.15.60:0/125568818 shutdown_connections 2020-10-31T22:47:58.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.830+0000 7fb1c8927700 1 -- 172.21.15.60:0/125568818 wait complete. 2020-10-31T22:47:58.849 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:47:58.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752759e700 1 Processor -- start 2020-10-31T22:47:58.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752759e700 1 -- start start 2020-10-31T22:47:58.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f752805bb50 0x7f75280a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75280a75d0 con 0x7f7528066830 2020-10-31T22:47:58.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752759e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752805afe0 con 0x7f75280a95e0 2020-10-31T22:47:58.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75280a8e00 con 0x7f752805bb50 2020-10-31T22:47:58.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f7526d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7528066830 0x7f7528066ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49856/0 (socket says 172.21.15.60:49856) 2020-10-31T22:47:58.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f7526d9d700 1 -- 172.21.15.60:0/1519398414 learned_addr learned my addr 172.21.15.60:0/1519398414 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:58.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f7525d9b700 1 --2- 172.21.15.60:0/1519398414 >> v2:172.21.15.66:3300/0 conn(0x7f752805bb50 0x7f75280a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752559a700 1 -- 172.21.15.60:0/1519398414 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850999626 0 0) 0x7f75280a75d0 con 0x7f7528066830 2020-10-31T22:47:58.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752559a700 1 -- 172.21.15.60:0/1519398414 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7508003230 con 0x7f7528066830 2020-10-31T22:47:58.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752559a700 1 -- 172.21.15.60:0/1519398414 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3797295690 0 0) 0x7f7508003230 con 0x7f7528066830 2020-10-31T22:47:58.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752559a700 1 -- 172.21.15.60:0/1519398414 >> v2:172.21.15.66:3300/0 conn(0x7f752805bb50 msgr2=0x7f75280a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:58.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752559a700 1 --2- 172.21.15.60:0/1519398414 >> v2:172.21.15.66:3300/0 conn(0x7f752805bb50 0x7f75280a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752559a700 1 -- 172.21.15.60:0/1519398414 >> v1:172.21.15.66:6789/0 conn(0x7f75280a95e0 legacy=0x7f752805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752559a700 1 -- 172.21.15.60:0/1519398414 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75280aeaf0 con 0x7f7528066830 2020-10-31T22:47:58.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752559a700 1 -- 172.21.15.60:0/1519398414 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f7520001a50 con 0x7f7528066830 2020-10-31T22:47:58.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752559a700 1 -- 172.21.15.60:0/1519398414 >> v1:172.21.15.60:6789/0 conn(0x7f7528066830 legacy=0x7f7528066ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.966+0000 7f752559a700 1 --2- 172.21.15.60:0/1519398414 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7508003720 0x7f7508003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752559a700 1 --2- 172.21.15.60:0/1519398414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75080044d0 0x7f7508004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752559a700 1 --2- 172.21.15.60:0/1519398414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508004e40 0x7f750800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752559a700 1 -- 172.21.15.60:0/1519398414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75280a8e00 con 0x7f7508004e40 2020-10-31T22:47:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752559a700 1 -- 172.21.15.60:0/1519398414 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7508004340 con 0x7f75080044d0 2020-10-31T22:47:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752559a700 1 -- 172.21.15.60:0/1519398414 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f750800bc40 con 0x7f7508003720 2020-10-31T22:47:58.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f7526d9d700 1 --2- 172.21.15.60:0/1519398414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508004e40 0x7f750800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f7525d9b700 1 --2- 172.21.15.60:0/1519398414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75080044d0 0x7f7508004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752659c700 1 --2- 172.21.15.60:0/1519398414 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7508003720 0x7f7508003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f7526d9d700 1 -- 172.21.15.60:0/1519398414 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7508003720 msgr2=0x7f7508003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:58.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f7526d9d700 1 --2- 172.21.15.60:0/1519398414 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7508003720 0x7f7508003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f7526d9d700 1 -- 172.21.15.60:0/1519398414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75080044d0 msgr2=0x7f7508004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:58.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f7526d9d700 1 --2- 172.21.15.60:0/1519398414 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f75080044d0 0x7f7508004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f7526d9d700 1 -- 172.21.15.60:0/1519398414 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7508003230 con 0x7f7508004e40 2020-10-31T22:47:58.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752659c700 1 --2- 172.21.15.60:0/1519398414 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7508003720 0x7f7508003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:47:58.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f7526d9d700 1 -- 172.21.15.60:0/1519398414 reap_dead start 2020-10-31T22:47:58.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f7526d9d700 1 --2- 172.21.15.60:0/1519398414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508004e40 0x7f750800b720 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f7520001760 tx=0x7f75280aed90).ready entity=mon.0 client_cookie=7dde2eed143ee282 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:58.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752559a700 1 -- 172.21.15.60:0/1519398414 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7520005b70 con 0x7f7508004e40 2020-10-31T22:47:58.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752559a700 1 -- 172.21.15.60:0/1519398414 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7520005cd0 con 0x7f7508004e40 2020-10-31T22:47:58.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752559a700 1 -- 172.21.15.60:0/1519398414 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75200072c0 con 0x7f7508004e40 2020-10-31T22:47:58.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752759e700 1 -- 172.21.15.60:0/1519398414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508004e40 msgr2=0x7f750800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752759e700 1 --2- 172.21.15.60:0/1519398414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508004e40 0x7f750800b720 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 rx=0x7f7520001760 tx=0x7f75280aed90).stop 2020-10-31T22:47:58.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752759e700 1 -- 172.21.15.60:0/1519398414 shutdown_connections 2020-10-31T22:47:58.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752759e700 1 --2- 172.21.15.60:0/1519398414 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7508004e40 0x7f750800b720 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752759e700 1 -- 172.21.15.60:0/1519398414 >> 172.21.15.60:0/1519398414 conn(0x7f75280b3fd0 msgr2=0x7f75280b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:58.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752759e700 1 -- 172.21.15.60:0/1519398414 shutdown_connections 2020-10-31T22:47:58.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752759e700 1 -- 172.21.15.60:0/1519398414 wait complete. 2020-10-31T22:47:58.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752759e700 1 Processor -- start 2020-10-31T22:47:58.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.970+0000 7f752759e700 1 -- start start 2020-10-31T22:47:58.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f752759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7508004e40 0x7f75280b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f752759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f752814f130 0x7f75280a64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f752759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75280a6990 0x7f75280647d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f752759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752814f5b0 con 0x7f752814f130 2020-10-31T22:47:58.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f752759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752809e750 con 0x7f7508004e40 2020-10-31T22:47:58.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f752759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752809e9f0 con 0x7f75280a6990 2020-10-31T22:47:58.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f7525d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f752814f130 0x7f75280a64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f7525d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f752814f130 0x7f75280a64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45732/0 (socket says 172.21.15.60:45732) 2020-10-31T22:47:58.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f7525d9b700 1 -- 172.21.15.60:0/1233982715 learned_addr learned my addr 172.21.15.60:0/1233982715 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:58.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f7526d9d700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75280a6990 0x7f75280647d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f752659c700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7508004e40 0x7f75280b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f7525d9b700 1 -- 172.21.15.60:0/1233982715 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75280a6990 msgr2=0x7f75280647d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f7525d9b700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75280a6990 0x7f75280647d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f7525d9b700 1 -- 172.21.15.60:0/1233982715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7508004e40 msgr2=0x7f75280b14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:58.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f7525d9b700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7508004e40 0x7f75280b14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:58.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f7525d9b700 1 -- 172.21.15.60:0/1233982715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752809ec90 con 0x7f752814f130 2020-10-31T22:47:58.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f752659c700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7508004e40 0x7f75280b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:47:58.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f7525d9b700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f752814f130 0x7f75280a64a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f7518008000 tx=0x7f7518008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:58.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f751f7fe700 1 -- 172.21.15.60:0/1233982715 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f751800f910 con 0x7f752814f130 2020-10-31T22:47:58.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f751f7fe700 1 -- 172.21.15.60:0/1233982715 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751800fa70 con 0x7f752814f130 2020-10-31T22:47:58.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f752759e700 1 -- 172.21.15.60:0/1233982715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7528143620 con 0x7f752814f130 2020-10-31T22:47:58.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f751f7fe700 1 -- 172.21.15.60:0/1233982715 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f751800fc20 con 0x7f752814f130 2020-10-31T22:47:58.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f752759e700 1 -- 172.21.15.60:0/1233982715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75280a6df0 con 0x7f752814f130 2020-10-31T22:47:58.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f751f7fe700 1 -- 172.21.15.60:0/1233982715 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7518014440 con 0x7f752814f130 2020-10-31T22:47:58.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f752759e700 1 -- 172.21.15.60:0/1233982715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7528057100 con 0x7f752814f130 2020-10-31T22:47:58.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.974+0000 7f751f7fe700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f750c0550e0 0x7f750c0575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:58.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.978+0000 7f752659c700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f750c0550e0 0x7f750c0575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:58.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.978+0000 7f751f7fe700 1 -- 172.21.15.60:0/1233982715 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f751806dec0 con 0x7f752814f130 2020-10-31T22:47:58.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.978+0000 7f752659c700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f750c0550e0 0x7f750c0575a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f7510009000 tx=0x7f7510009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:58.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:58.982+0000 7f751f7fe700 1 -- 172.21.15.60:0/1233982715 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7518069df0 con 0x7f752814f130 2020-10-31T22:47:59.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.126+0000 7f752759e700 1 -- 172.21.15.60:0/1233982715 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75280b0850 con 0x7f752814f130 2020-10-31T22:47:59.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.126+0000 7f751f7fe700 1 -- 172.21.15.60:0/1233982715 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+10 (secure 0 0 0) 0x7f7518044240 con 0x7f752814f130 2020-10-31T22:47:59.131 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:47:59.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.126+0000 7f752759e700 1 -- 172.21.15.60:0/1233982715 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f750c0550e0 msgr2=0x7f750c0575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:59.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.126+0000 7f752759e700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f750c0550e0 0x7f750c0575a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f7510009000 tx=0x7f7510009040).stop 2020-10-31T22:47:59.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.126+0000 7f752759e700 1 -- 172.21.15.60:0/1233982715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f752814f130 msgr2=0x7f75280a64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:59.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.126+0000 7f752759e700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f752814f130 0x7f75280a64a0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 rx=0x7f7518008000 tx=0x7f7518008040).stop 2020-10-31T22:47:59.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.126+0000 7f752759e700 1 -- 172.21.15.60:0/1233982715 shutdown_connections 2020-10-31T22:47:59.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.126+0000 7f752759e700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75280a6990 0x7f75280647d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.126+0000 7f752759e700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f750c0550e0 0x7f750c0575a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.126+0000 7f752759e700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7508004e40 0x7f75280b14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.126+0000 7f752759e700 1 --2- 172.21.15.60:0/1233982715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f752814f130 0x7f75280a64a0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.126+0000 7f752759e700 1 -- 172.21.15.60:0/1233982715 >> 172.21.15.60:0/1233982715 conn(0x7f75280b3fd0 msgr2=0x7f752813e150 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:59.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.126+0000 7f752759e700 1 -- 172.21.15.60:0/1233982715 shutdown_connections 2020-10-31T22:47:59.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.126+0000 7f752759e700 1 -- 172.21.15.60:0/1233982715 wait complete. 2020-10-31T22:47:59.144 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:47:59.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.254+0000 7fb550900700 1 Processor -- start 2020-10-31T22:47:59.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.254+0000 7fb550900700 1 -- start start 2020-10-31T22:47:59.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb550900700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb54c063140 0x7fb54c0afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:59.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb550900700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb54c0b14d0 0x7fb54c0ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:59.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb550900700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb54c0b0390 con 0x7fb54c0ae740 2020-10-31T22:47:59.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb550900700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb54c063520 con 0x7fb54c063140 2020-10-31T22:47:59.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb550900700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c0a9070 con 0x7fb54c0b14d0 2020-10-31T22:47:59.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb54bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb54c0b14d0 0x7fb54c0ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:59.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb54affd700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fb54c0ae740 0x7fb54c0aee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:47746/0 (socket says 172.21.15.60:47746) 2020-10-31T22:47:59.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb54affd700 1 -- 172.21.15.60:0/2841844274 learned_addr learned my addr 172.21.15.60:0/2841844274 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:47:59.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb54b7fe700 1 --2- 172.21.15.60:0/2841844274 >> v2:172.21.15.66:3300/0 conn(0x7fb54c063140 0x7fb54c0afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:59.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb54a7fc700 1 -- 172.21.15.60:0/2841844274 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062545635 0 0) 0x7fb54c0b0390 con 0x7fb54c0ae740 2020-10-31T22:47:59.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb54a7fc700 1 -- 172.21.15.60:0/2841844274 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb52c003230 con 0x7fb54c0ae740 2020-10-31T22:47:59.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb54bfff700 1 -- 172.21.15.60:0/2841844274 >> v2:172.21.15.66:3300/0 conn(0x7fb54c063140 msgr2=0x7fb54c0afea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:59.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb54bfff700 1 --2- 172.21.15.60:0/2841844274 >> v2:172.21.15.66:3300/0 conn(0x7fb54c063140 0x7fb54c0afea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb54bfff700 1 -- 172.21.15.60:0/2841844274 >> v1:172.21.15.66:6789/0 conn(0x7fb54c0ae740 legacy=0x7fb54c0aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:59.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb54bfff700 1 -- 172.21.15.60:0/2841844274 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c0a9310 con 0x7fb54c0b14d0 2020-10-31T22:47:59.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb54bfff700 1 --2- 172.21.15.60:0/2841844274 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb54c0b14d0 0x7fb54c0ab860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb5440032b0 tx=0x7fb5440091a0).ready entity=mon.2 client_cookie=ab9cf7e36e3bcf7c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:59.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb54a7fc700 1 -- 172.21.15.60:0/2841844274 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb54400b940 con 0x7fb54c0b14d0 2020-10-31T22:47:59.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb54a7fc700 1 -- 172.21.15.60:0/2841844274 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54400baa0 con 0x7fb54c0b14d0 2020-10-31T22:47:59.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb54a7fc700 1 -- 172.21.15.60:0/2841844274 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb54400bc10 con 0x7fb54c0b14d0 2020-10-31T22:47:59.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb550900700 1 -- 172.21.15.60:0/2841844274 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb54c0b14d0 msgr2=0x7fb54c0ab860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb550900700 1 --2- 172.21.15.60:0/2841844274 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb54c0b14d0 0x7fb54c0ab860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fb5440032b0 tx=0x7fb5440091a0).stop 2020-10-31T22:47:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb550900700 1 -- 172.21.15.60:0/2841844274 shutdown_connections 2020-10-31T22:47:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb550900700 1 --2- 172.21.15.60:0/2841844274 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb54c0b14d0 0x7fb54c0ab860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb550900700 1 --2- 172.21.15.60:0/2841844274 >> v2:172.21.15.66:3300/0 conn(0x7fb54c063140 0x7fb54c0afea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb550900700 1 -- 172.21.15.60:0/2841844274 >> 172.21.15.60:0/2841844274 conn(0x7fb54c06a600 msgr2=0x7fb54c060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:59.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb550900700 1 -- 172.21.15.60:0/2841844274 shutdown_connections 2020-10-31T22:47:59.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.258+0000 7fb550900700 1 -- 172.21.15.60:0/2841844274 wait complete. 2020-10-31T22:47:59.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb550900700 1 Processor -- start 2020-10-31T22:47:59.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb550900700 1 -- start start 2020-10-31T22:47:59.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb550900700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb54c063140 0x7fb54c141190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:59.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb550900700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb54c0ae740 0x7fb54c1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:59.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb550900700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb54c0b14d0 0x7fb54c154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:59.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb550900700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c146b80 con 0x7fb54c0b14d0 2020-10-31T22:47:59.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb550900700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c1447e0 con 0x7fb54c0ae740 2020-10-31T22:47:59.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb550900700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb54c144a80 con 0x7fb54c063140 2020-10-31T22:47:59.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb54bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb54c0b14d0 0x7fb54c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:59.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb54bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb54c0b14d0 0x7fb54c154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45748/0 (socket says 172.21.15.60:45748) 2020-10-31T22:47:59.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb54bfff700 1 -- 172.21.15.60:0/1052902388 learned_addr learned my addr 172.21.15.60:0/1052902388 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:59.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb54affd700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb54c0ae740 0x7fb54c1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:59.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb54b7fe700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb54c063140 0x7fb54c141190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:59.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb54bfff700 1 -- 172.21.15.60:0/1052902388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb54c063140 msgr2=0x7fb54c141190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:59.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb54bfff700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb54c063140 0x7fb54c141190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb54bfff700 1 -- 172.21.15.60:0/1052902388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb54c0ae740 msgr2=0x7fb54c1510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:59.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb54bfff700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb54c0ae740 0x7fb54c1510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb54bfff700 1 -- 172.21.15.60:0/1052902388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c153fa0 con 0x7fb54c0b14d0 2020-10-31T22:47:59.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb54b7fe700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb54c063140 0x7fb54c141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:47:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb54affd700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb54c0ae740 0x7fb54c1510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:47:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb54bfff700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb54c0b14d0 0x7fb54c154440 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7fb5440032b0 tx=0x7fb544016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:59.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb548ff9700 1 -- 172.21.15.60:0/1052902388 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb5440205f0 con 0x7fb54c0b14d0 2020-10-31T22:47:59.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb548ff9700 1 -- 172.21.15.60:0/1052902388 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb544020750 con 0x7fb54c0b14d0 2020-10-31T22:47:59.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb550900700 1 -- 172.21.15.60:0/1052902388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb54c064ae0 con 0x7fb54c0b14d0 2020-10-31T22:47:59.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb548ff9700 1 -- 172.21.15.60:0/1052902388 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb544020ab0 con 0x7fb54c0b14d0 2020-10-31T22:47:59.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.262+0000 7fb550900700 1 -- 172.21.15.60:0/1052902388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb54c067290 con 0x7fb54c0b14d0 2020-10-31T22:47:59.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.266+0000 7fb550900700 1 -- 172.21.15.60:0/1052902388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb54c144610 con 0x7fb54c0b14d0 2020-10-31T22:47:59.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.266+0000 7fb548ff9700 1 -- 172.21.15.60:0/1052902388 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb544027030 con 0x7fb54c0b14d0 2020-10-31T22:47:59.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.266+0000 7fb548ff9700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb530054f10 0x7fb5300573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:59.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.266+0000 7fb54b7fe700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb530054f10 0x7fb5300573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:59.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.266+0000 7fb548ff9700 1 -- 172.21.15.60:0/1052902388 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fb54406ee90 con 0x7fb54c0b14d0 2020-10-31T22:47:59.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.266+0000 7fb54b7fe700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb530054f10 0x7fb5300573d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fb53c00b000 tx=0x7fb53c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:59.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.274+0000 7fb548ff9700 1 -- 172.21.15.60:0/1052902388 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb544045380 con 0x7fb54c0b14d0 2020-10-31T22:47:59.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.418+0000 7fb550900700 1 -- 172.21.15.60:0/1052902388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb54c154130 con 0x7fb54c0b14d0 2020-10-31T22:47:59.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.418+0000 7fb548ff9700 1 -- 172.21.15.60:0/1052902388 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb5440150a0 con 0x7fb54c0b14d0 2020-10-31T22:47:59.423 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:47:59.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.418+0000 7fb550900700 1 -- 172.21.15.60:0/1052902388 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb530054f10 msgr2=0x7fb5300573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:59.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.418+0000 7fb550900700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb530054f10 0x7fb5300573d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7fb53c00b000 tx=0x7fb53c008040).stop 2020-10-31T22:47:59.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.418+0000 7fb550900700 1 -- 172.21.15.60:0/1052902388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb54c0b14d0 msgr2=0x7fb54c154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:59.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.418+0000 7fb550900700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb54c0b14d0 0x7fb54c154440 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 rx=0x7fb5440032b0 tx=0x7fb544016000).stop 2020-10-31T22:47:59.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.418+0000 7fb550900700 1 -- 172.21.15.60:0/1052902388 shutdown_connections 2020-10-31T22:47:59.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.418+0000 7fb550900700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb54c0b14d0 0x7fb54c154440 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.418+0000 7fb550900700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb54c063140 0x7fb54c141190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.418+0000 7fb550900700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb530054f10 0x7fb5300573d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.418+0000 7fb550900700 1 --2- 172.21.15.60:0/1052902388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb54c0ae740 0x7fb54c1510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.418+0000 7fb550900700 1 -- 172.21.15.60:0/1052902388 >> 172.21.15.60:0/1052902388 conn(0x7fb54c06a600 msgr2=0x7fb54c1435b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:59.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.418+0000 7fb550900700 1 -- 172.21.15.60:0/1052902388 shutdown_connections 2020-10-31T22:47:59.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.418+0000 7fb550900700 1 -- 172.21.15.60:0/1052902388 wait complete. 2020-10-31T22:47:59.437 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:47:59.438 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:47:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f5634d2b700 1 Processor -- start 2020-10-31T22:47:59.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f5634d2b700 1 -- start start 2020-10-31T22:47:59.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f5634d2b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f563005b320 0x7f56300b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:59.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f5634d2b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5630140420 0x7f56300b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:59.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f5634d2b700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f563005b700 con 0x7f56300acc80 2020-10-31T22:47:59.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f5634d2b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56300b2830 con 0x7f5630140420 2020-10-31T22:47:59.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f5634d2b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56301408a0 con 0x7f563005b320 2020-10-31T22:47:59.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f562f7fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f563005b320 0x7f56300b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:59.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f562f7fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f563005b320 0x7f56300b1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:58940/0 (socket says 172.21.15.60:58940) 2020-10-31T22:47:59.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f562f7fe700 1 -- 172.21.15.60:0/1252900239 learned_addr learned my addr 172.21.15.60:0/1252900239 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:59.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f562effd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5630140420 0x7f56300b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:59.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f562f7fe700 1 -- 172.21.15.60:0/1252900239 >> v2:172.21.15.66:3300/0 conn(0x7f5630140420 msgr2=0x7f56300b2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:47:59.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f562f7fe700 1 --2- 172.21.15.60:0/1252900239 >> v2:172.21.15.66:3300/0 conn(0x7f5630140420 0x7f56300b2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f562f7fe700 1 -- 172.21.15.60:0/1252900239 >> v1:172.21.15.66:6789/0 conn(0x7f56300acc80 legacy=0x7f56300ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:59.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f562f7fe700 1 -- 172.21.15.60:0/1252900239 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56300b0220 con 0x7f563005b320 2020-10-31T22:47:59.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.542+0000 7f562f7fe700 1 --2- 172.21.15.60:0/1252900239 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f563005b320 0x7f56300b1e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f56280010d0 tx=0x7f5620009270).ready entity=mon.2 client_cookie=6a5ffb2c5d4815b9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:59.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.546+0000 7f562e7fc700 1 -- 172.21.15.60:0/1252900239 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5620009e60 con 0x7f563005b320 2020-10-31T22:47:59.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.546+0000 7f562e7fc700 1 -- 172.21.15.60:0/1252900239 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f562000bac0 con 0x7f563005b320 2020-10-31T22:47:59.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.546+0000 7f562e7fc700 1 -- 172.21.15.60:0/1252900239 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f562000bc30 con 0x7f563005b320 2020-10-31T22:47:59.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.546+0000 7f5634d2b700 1 -- 172.21.15.60:0/1252900239 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f563005b320 msgr2=0x7f56300b1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:59.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.546+0000 7f5634d2b700 1 --2- 172.21.15.60:0/1252900239 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f563005b320 0x7f56300b1e50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f56280010d0 tx=0x7f5620009270).stop 2020-10-31T22:47:59.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.546+0000 7f5634d2b700 1 -- 172.21.15.60:0/1252900239 shutdown_connections 2020-10-31T22:47:59.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.546+0000 7f5634d2b700 1 --2- 172.21.15.60:0/1252900239 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f563005b320 0x7f56300b1e50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.546+0000 7f5634d2b700 1 --2- 172.21.15.60:0/1252900239 >> v2:172.21.15.66:3300/0 conn(0x7f5630140420 0x7f56300b2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.546+0000 7f5634d2b700 1 -- 172.21.15.60:0/1252900239 >> 172.21.15.60:0/1252900239 conn(0x7f56300b61d0 msgr2=0x7f56300b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:59.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.546+0000 7f5634d2b700 1 -- 172.21.15.60:0/1252900239 shutdown_connections 2020-10-31T22:47:59.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.546+0000 7f5634d2b700 1 -- 172.21.15.60:0/1252900239 wait complete. 2020-10-31T22:47:59.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.546+0000 7f5634d2b700 1 Processor -- start 2020-10-31T22:47:59.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.546+0000 7f5634d2b700 1 -- start start 2020-10-31T22:47:59.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f5634d2b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f563005b320 0x7f563013eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:59.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f5634d2b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56300acc80 0x7f563013a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:59.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f5634d2b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5630140420 0x7f5630139330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:59.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f5634d2b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f563013ae30 con 0x7f563005b320 2020-10-31T22:47:59.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f5634d2b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5630140df0 con 0x7f5630140420 2020-10-31T22:47:59.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f5634d2b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f563014f3f0 con 0x7f56300acc80 2020-10-31T22:47:59.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f562f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f563005b320 0x7f563013eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:59.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f562f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f563005b320 0x7f563013eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45758/0 (socket says 172.21.15.60:45758) 2020-10-31T22:47:59.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f562f7fe700 1 -- 172.21.15.60:0/2077435390 learned_addr learned my addr 172.21.15.60:0/2077435390 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:47:59.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f562effd700 1 --2- 172.21.15.60:0/2077435390 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56300acc80 0x7f563013a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:59.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f562ffff700 1 --2- 172.21.15.60:0/2077435390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5630140420 0x7f5630139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:59.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f562f7fe700 1 -- 172.21.15.60:0/2077435390 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56300acc80 msgr2=0x7f563013a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:59.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f562f7fe700 1 --2- 172.21.15.60:0/2077435390 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56300acc80 0x7f563013a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f562f7fe700 1 -- 172.21.15.60:0/2077435390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5630140420 msgr2=0x7f5630139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:59.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f562f7fe700 1 --2- 172.21.15.60:0/2077435390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5630140420 0x7f5630139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f562f7fe700 1 -- 172.21.15.60:0/2077435390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5630143b40 con 0x7f563005b320 2020-10-31T22:47:59.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f562f7fe700 1 --2- 172.21.15.60:0/2077435390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f563005b320 0x7f563013eb60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f56280010d0 tx=0x7f5620016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:59.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f562cff9700 1 -- 172.21.15.60:0/2077435390 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f562000be60 con 0x7f563005b320 2020-10-31T22:47:59.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f562cff9700 1 -- 172.21.15.60:0/2077435390 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56200105b0 con 0x7f563005b320 2020-10-31T22:47:59.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f5634d2b700 1 -- 172.21.15.60:0/2077435390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f563014f650 con 0x7f563005b320 2020-10-31T22:47:59.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f562cff9700 1 -- 172.21.15.60:0/2077435390 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5620010910 con 0x7f563005b320 2020-10-31T22:47:59.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f5634d2b700 1 -- 172.21.15.60:0/2077435390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56301425f0 con 0x7f563005b320 2020-10-31T22:47:59.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.550+0000 7f5634d2b700 1 -- 172.21.15.60:0/2077435390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f563014f810 con 0x7f563005b320 2020-10-31T22:47:59.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.554+0000 7f562cff9700 1 -- 172.21.15.60:0/2077435390 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5620026030 con 0x7f563005b320 2020-10-31T22:47:59.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.554+0000 7f562cff9700 1 --2- 172.21.15.60:0/2077435390 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5614055020 0x7f56140574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:47:59.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.554+0000 7f562cff9700 1 -- 172.21.15.60:0/2077435390 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f562006eaa0 con 0x7f563005b320 2020-10-31T22:47:59.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.554+0000 7f562effd700 1 --2- 172.21.15.60:0/2077435390 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5614055020 0x7f56140574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:47:59.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.554+0000 7f562effd700 1 --2- 172.21.15.60:0/2077435390 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5614055020 0x7f56140574e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f561800b000 tx=0x7f5618006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:47:59.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.558+0000 7f562cff9700 1 -- 172.21.15.60:0/2077435390 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f563014f810 con 0x7f563005b320 2020-10-31T22:47:59.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.746+0000 7f5634d2b700 1 -- 172.21.15.60:0/2077435390 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f563014f810 con 0x7f563005b320 2020-10-31T22:47:59.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.746+0000 7f562cff9700 1 -- 172.21.15.60:0/2077435390 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+2487 (secure 0 0 0) 0x7f563014f810 con 0x7f563005b320 2020-10-31T22:47:59.753 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:47:59.753 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":35,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/290520151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":290520151},{"type":"v1","addr":"172.21.15.66:6833","nonce":290520151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1731313860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1731313860},{"type":"v1","addr":"172.21.15.60:6835","nonce":1731313860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:47:06.422241+0000","modified":"2020-10-31T22:47:08.068754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/265867667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":265867667},{"type":"v1","addr":"172.21.15.60:6837","nonce":265867667}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-10-31T22:47:59.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.750+0000 7f5634d2b700 1 -- 172.21.15.60:0/2077435390 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5614055020 msgr2=0x7f56140574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:59.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.750+0000 7f5634d2b700 1 --2- 172.21.15.60:0/2077435390 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5614055020 0x7f56140574e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f561800b000 tx=0x7f5618006dc0).stop 2020-10-31T22:47:59.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.750+0000 7f5634d2b700 1 -- 172.21.15.60:0/2077435390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f563005b320 msgr2=0x7f563013eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:47:59.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.750+0000 7f5634d2b700 1 --2- 172.21.15.60:0/2077435390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f563005b320 0x7f563013eb60 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 rx=0x7f56280010d0 tx=0x7f5620016000).stop 2020-10-31T22:47:59.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.750+0000 7f5634d2b700 1 -- 172.21.15.60:0/2077435390 shutdown_connections 2020-10-31T22:47:59.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.750+0000 7f5634d2b700 1 --2- 172.21.15.60:0/2077435390 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5614055020 0x7f56140574e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.750+0000 7f5634d2b700 1 --2- 172.21.15.60:0/2077435390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5630140420 0x7f5630139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.750+0000 7f5634d2b700 1 --2- 172.21.15.60:0/2077435390 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f563005b320 0x7f563013eb60 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.750+0000 7f5634d2b700 1 --2- 172.21.15.60:0/2077435390 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56300acc80 0x7f563013a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:47:59.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.750+0000 7f5634d2b700 1 -- 172.21.15.60:0/2077435390 >> 172.21.15.60:0/2077435390 conn(0x7f56300b61d0 msgr2=0x7f56300ad6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:47:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.750+0000 7f5634d2b700 1 -- 172.21.15.60:0/2077435390 shutdown_connections 2020-10-31T22:47:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:47:59.750+0000 7f5634d2b700 1 -- 172.21.15.60:0/2077435390 wait complete. 2020-10-31T22:47:59.758 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2020-10-31T22:48:00.073 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:47:06.422241+0000', 'modified': '2020-10-31T22:47:08.068754+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6174}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6174': {'gid': 6174, 'name': 'a', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/265867667', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 265867667}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 265867667}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [14], 'metadata_pool': 13, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:48:00.074 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:48:00.074 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-10-31T22:48:00.204 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":6174,"want_state":"up:active","state":"up:active","rank_uptime":53.765588416999996,"mdsmap_epoch":35,"osdmap_epoch":77,"osdmap_epoch_barrier":77,"uptime":59.015532024000002} 2020-10-31T22:48:00.204 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 6174, "mdsmap_epoch": 35, "osdmap_epoch": 77, "osdmap_epoch_barrier": 77, "rank_uptime": 53.765588417, "state": "up:active", "uptime": 59.015532024, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:48:00.205 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:48:00.205 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:48:00.206 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:48:00.206 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:00.206 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:00.215 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:48:00.274 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:48:00.274 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:48:00.333 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:48:00.335 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:48:00.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:00.336 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:48:00.385 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:48:00.385 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:00.429 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:48:00.446 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:48:00.446 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:48:00.501 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:48:00.502 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:48:00.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:00.503 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:48:00.504 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:48:00.500+0000 7fc685c0d0c0 -1 init, newargv = 0x55af44585ba0 newargc=9 2020-10-31T22:48:00.504 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13632]: starting ceph client 2020-10-31T22:48:00.515 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13632]: starting fuse 2020-10-31T22:48:01.610 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:48:01.626 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:48:01.627 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:48:01.681 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:48:01.684 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:48:01.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:01.685 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:48:01.733 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:48:01.733 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:48:01.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:01.734 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:48:01.735 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:48:01.735 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:48:01.736 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:48:01.736 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:48:01.737 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:48:01.738 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:48:01.739 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:48:01.739 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:48:01.740 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:48:01.740 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:48:01.741 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:48:01.742 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:48:01.742 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:48:01.743 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:48:01.743 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:48:01.744 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:48:01.744 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:48:01.745 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:48:01.746 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:48:01.746 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:48:01.747 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:48:01.747 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:48:01.823 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.13632.asok 2020-10-31T22:48:01.828 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13632.asok 2020-10-31T22:48:01.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:01.830 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13632.asok status 2020-10-31T22:48:01.926 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:48:01.927 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:48:01.927 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:48:01.927 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:48:01.927 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:48:01.928 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:48:01.928 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:48:01.928 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "13632", 2020-10-31T22:48:01.929 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:48:01.929 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:48:01.929 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:48:01.929 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:48:01.929 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 6402, 2020-10-31T22:48:01.929 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:48:01.930 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:48:01.930 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:48:01.930 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 6402 2020-10-31T22:48:01.930 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:48:01.930 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:48:01.930 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:48:01.931 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:48:01.931 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2978308378 2020-10-31T22:48:01.931 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:48:01.931 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:48:01.932 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:48:01.932 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:48:01.932 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:48:01.932 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2978308378 2020-10-31T22:48:01.932 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:48:01.932 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.6402 172.21.15.152:0/2978308378", 2020-10-31T22:48:01.932 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/2978308378", 2020-10-31T22:48:01.933 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:48:01.934 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 35, 2020-10-31T22:48:01.935 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 77, 2020-10-31T22:48:01.935 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:48:01.936 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:48:01.936 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:48:01.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:01.937 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:01.938 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:01.945 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:48:01.946 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:48:01.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:01.947 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:02.010 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:48:02.011 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:02.029 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:02.048 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:02.065 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:02.083 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:48:02.083 INFO:tasks.cephfs.mount:Terminating background process 2020-10-31T22:48:02.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:02.084 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:02.084 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:02.134 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:48:02.137 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:48:02.137 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:48:02.138 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:48:02.139 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:02.211 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13632]: fuse finished with error 0 and tester_r 0 2020-10-31T22:48:02.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:02.213 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:02.214 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:02.261 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:48:02.262 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:48:02.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:48:02.302 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:02.350 INFO:tasks.cephfs.mount:Terminating background process 2020-10-31T22:48:02.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:02.351 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:02.352 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:02.359 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:48:02.360 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:48:02.361 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi085.front.sepia.ceph.com... 2020-10-31T22:48:02.361 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:48:02.361 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:02.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13102]: fuse finished with error 0 and tester_r 0 2020-10-31T22:48:02.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:02.431 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:02.432 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:02.479 INFO:teuthology.orchestra.run.smithi085.stdout:ext2/ext3 2020-10-31T22:48:02.480 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:48:02.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:48:02.600 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:02.647 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2020-10-31T22:48:02.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.765+0000 7f111eebd700 1 Processor -- start 2020-10-31T22:48:02.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.765+0000 7f111eebd700 1 -- start start 2020-10-31T22:48:02.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111eebd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11180b4410 0x7f111805c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:02.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111eebd700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1118065e90 con 0x7f11180b2e20 2020-10-31T22:48:02.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111eebd700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1118066130 con 0x7f111805c4c0 2020-10-31T22:48:02.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111eebd700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1118141ef0 con 0x7f11180b4410 2020-10-31T22:48:02.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f1117fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f11180b2e20 0x7f1118142580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49904/0 (socket says 172.21.15.60:49904) 2020-10-31T22:48:02.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111d45a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f11180b4410 0x7f111805c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f1117fff700 1 -- 172.21.15.60:0/3244572039 learned_addr learned my addr 172.21.15.60:0/3244572039 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111d45a700 1 -- 172.21.15.60:0/3244572039 >> v1:172.21.15.66:6789/0 conn(0x7f111805c4c0 legacy=0x7f111813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111d45a700 1 -- 172.21.15.60:0/3244572039 >> v1:172.21.15.60:6789/0 conn(0x7f11180b2e20 legacy=0x7f1118142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111d45a700 1 -- 172.21.15.60:0/3244572039 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11180663d0 con 0x7f11180b4410 2020-10-31T22:48:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111d45a700 1 --2- 172.21.15.60:0/3244572039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11180b4410 0x7f111805c8a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f1118066020 tx=0x7f11100091a0).ready entity=mon.0 client_cookie=feb5fc7a40d18251 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f11177fe700 1 -- 172.21.15.60:0/3244572039 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f111000ba10 con 0x7f11180b4410 2020-10-31T22:48:02.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f11177fe700 1 -- 172.21.15.60:0/3244572039 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111000bb70 con 0x7f11180b4410 2020-10-31T22:48:02.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f11177fe700 1 -- 172.21.15.60:0/3244572039 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f111000bce0 con 0x7f11180b4410 2020-10-31T22:48:02.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111eebd700 1 -- 172.21.15.60:0/3244572039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11180b4410 msgr2=0x7f111805c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:02.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111eebd700 1 --2- 172.21.15.60:0/3244572039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11180b4410 0x7f111805c8a0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 rx=0x7f1118066020 tx=0x7f11100091a0).stop 2020-10-31T22:48:02.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111eebd700 1 -- 172.21.15.60:0/3244572039 shutdown_connections 2020-10-31T22:48:02.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111eebd700 1 --2- 172.21.15.60:0/3244572039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11180b4410 0x7f111805c8a0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:02.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111eebd700 1 -- 172.21.15.60:0/3244572039 >> 172.21.15.60:0/3244572039 conn(0x7f11180601e0 msgr2=0x7f111805b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:02.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111eebd700 1 -- 172.21.15.60:0/3244572039 shutdown_connections 2020-10-31T22:48:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.769+0000 7f111eebd700 1 -- 172.21.15.60:0/3244572039 wait complete. 2020-10-31T22:48:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111eebd700 1 Processor -- start 2020-10-31T22:48:02.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111eebd700 1 -- start start 2020-10-31T22:48:02.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111eebd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111805c4c0 0x7f1118145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:02.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111eebd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11180b4410 0x7f11180aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111eebd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11180ac440 0x7f11181511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111eebd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11180ad3b0 con 0x7f111805c4c0 2020-10-31T22:48:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111eebd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1118150dd0 con 0x7f11180b4410 2020-10-31T22:48:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111eebd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11180abe10 con 0x7f11180ac440 2020-10-31T22:48:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111cc59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111805c4c0 0x7f1118145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:02.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111cc59700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111805c4c0 0x7f1118145720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45772/0 (socket says 172.21.15.60:45772) 2020-10-31T22:48:02.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111cc59700 1 -- 172.21.15.60:0/1292639926 learned_addr learned my addr 172.21.15.60:0/1292639926 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:02.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f1117fff700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11180b4410 0x7f11180aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:02.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111d45a700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11180ac440 0x7f11181511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:02.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111cc59700 1 -- 172.21.15.60:0/1292639926 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11180ac440 msgr2=0x7f11181511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:02.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111cc59700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11180ac440 0x7f11181511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:02.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111cc59700 1 -- 172.21.15.60:0/1292639926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11180b4410 msgr2=0x7f11180aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111cc59700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11180b4410 0x7f11180aaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111cc59700 1 -- 172.21.15.60:0/1292639926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1118154320 con 0x7f111805c4c0 2020-10-31T22:48:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f1117fff700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11180b4410 0x7f11180aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111cc59700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111805c4c0 0x7f1118145720 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f110c002f40 tx=0x7f110c006d20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f1115ffb700 1 -- 172.21.15.60:0/1292639926 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f110c00d4a0 con 0x7f111805c4c0 2020-10-31T22:48:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f1115ffb700 1 -- 172.21.15.60:0/1292639926 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c00d600 con 0x7f111805c4c0 2020-10-31T22:48:02.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111eebd700 1 -- 172.21.15.60:0/1292639926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11180ab630 con 0x7f111805c4c0 2020-10-31T22:48:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f1115ffb700 1 -- 172.21.15.60:0/1292639926 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f110c00d960 con 0x7f111805c4c0 2020-10-31T22:48:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.773+0000 7f111eebd700 1 -- 172.21.15.60:0/1292639926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11181516b0 con 0x7f111805c4c0 2020-10-31T22:48:02.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.777+0000 7f111eebd700 1 -- 172.21.15.60:0/1292639926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1118057100 con 0x7f111805c4c0 2020-10-31T22:48:02.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.777+0000 7f1115ffb700 1 -- 172.21.15.60:0/1292639926 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f110c00f030 con 0x7f111805c4c0 2020-10-31T22:48:02.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.777+0000 7f1115ffb700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f10f8055020 0x7f10f80574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:02.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.777+0000 7f1115ffb700 1 -- 172.21.15.60:0/1292639926 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f110c06d850 con 0x7f111805c4c0 2020-10-31T22:48:02.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.777+0000 7f1117fff700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f10f8055020 0x7f10f80574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:02.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.777+0000 7f1117fff700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f10f8055020 0x7f10f80574e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f110800b000 tx=0x7f1108009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:02.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.785+0000 7f1115ffb700 1 -- 172.21.15.60:0/1292639926 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f110c043c40 con 0x7f111805c4c0 2020-10-31T22:48:02.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.925+0000 7f111eebd700 1 -- 172.21.15.60:0/1292639926 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f11180abbf0 con 0x7f111805c4c0 2020-10-31T22:48:02.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.933+0000 7f1115ffb700 1 -- 172.21.15.60:0/1292639926 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f110c047260 con 0x7f111805c4c0 2020-10-31T22:48:02.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.933+0000 7f111eebd700 1 -- 172.21.15.60:0/1292639926 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f10f8055020 msgr2=0x7f10f80574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.933+0000 7f111eebd700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f10f8055020 0x7f10f80574e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7f110800b000 tx=0x7f1108009040).stop 2020-10-31T22:48:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.933+0000 7f111eebd700 1 -- 172.21.15.60:0/1292639926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111805c4c0 msgr2=0x7f1118145720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:02.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.933+0000 7f111eebd700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111805c4c0 0x7f1118145720 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 rx=0x7f110c002f40 tx=0x7f110c006d20).stop 2020-10-31T22:48:02.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.933+0000 7f111eebd700 1 -- 172.21.15.60:0/1292639926 shutdown_connections 2020-10-31T22:48:02.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.933+0000 7f111eebd700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11180ac440 0x7f11181511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:02.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.933+0000 7f111eebd700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f111805c4c0 0x7f1118145720 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:02.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.933+0000 7f111eebd700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f10f8055020 0x7f10f80574e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:02.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.933+0000 7f111eebd700 1 --2- 172.21.15.60:0/1292639926 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11180b4410 0x7f11180aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:02.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.933+0000 7f111eebd700 1 -- 172.21.15.60:0/1292639926 >> 172.21.15.60:0/1292639926 conn(0x7f11180601e0 msgr2=0x7f11180b7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:02.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.933+0000 7f111eebd700 1 -- 172.21.15.60:0/1292639926 shutdown_connections 2020-10-31T22:48:02.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:02.933+0000 7f111eebd700 1 -- 172.21.15.60:0/1292639926 wait complete. 2020-10-31T22:48:02.956 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder' 2020-10-31T22:48:03.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4abfff700 1 Processor -- start 2020-10-31T22:48:03.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4abfff700 1 -- start start 2020-10-31T22:48:03.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4abfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa4ac0af520 0x7fa4ac0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:03.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4abfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ac0af900 con 0x7fa4ac066c90 2020-10-31T22:48:03.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4abfff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ac0afc10 con 0x7fa4ac0670f0 2020-10-31T22:48:03.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4abfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac05bb70 con 0x7fa4ac0af520 2020-10-31T22:48:03.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4aa7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa4ac066c90 0x7fa4ac146060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49920/0 (socket says 172.21.15.60:49920) 2020-10-31T22:48:03.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4aa7fc700 1 -- 172.21.15.60:0/2964298214 learned_addr learned my addr 172.21.15.60:0/2964298214 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:03.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4aaffd700 1 --2- 172.21.15.60:0/2964298214 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa4ac0af520 0x7fa4ac0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:03.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4a9ffb700 1 -- 172.21.15.60:0/2964298214 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236631260 0 0) 0x7fa4ac0afc10 con 0x7fa4ac0670f0 2020-10-31T22:48:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4a9ffb700 1 -- 172.21.15.60:0/2964298214 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa490003230 con 0x7fa4ac0670f0 2020-10-31T22:48:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4a9ffb700 1 -- 172.21.15.60:0/2964298214 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556596086 0 0) 0x7fa4ac0af900 con 0x7fa4ac066c90 2020-10-31T22:48:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4a9ffb700 1 -- 172.21.15.60:0/2964298214 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4ac0afc10 con 0x7fa4ac066c90 2020-10-31T22:48:03.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4aaffd700 1 -- 172.21.15.60:0/2964298214 >> v1:172.21.15.66:6789/0 conn(0x7fa4ac0670f0 legacy=0x7fa4ac150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:03.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4aaffd700 1 -- 172.21.15.60:0/2964298214 >> v1:172.21.15.60:6789/0 conn(0x7fa4ac066c90 legacy=0x7fa4ac146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:03.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4aaffd700 1 -- 172.21.15.60:0/2964298214 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac0ac130 con 0x7fa4ac0af520 2020-10-31T22:48:03.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4aaffd700 1 --2- 172.21.15.60:0/2964298214 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa4ac0af520 0x7fa4ac0ac870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa49c0032b0 tx=0x7fa49c0091a0).ready entity=mon.2 client_cookie=8dd1fe8573f4401b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:03.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4a9ffb700 1 -- 172.21.15.60:0/2964298214 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa49c00b940 con 0x7fa4ac0af520 2020-10-31T22:48:03.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4a9ffb700 1 -- 172.21.15.60:0/2964298214 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c00baa0 con 0x7fa4ac0af520 2020-10-31T22:48:03.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4abfff700 1 -- 172.21.15.60:0/2964298214 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa4ac0af520 msgr2=0x7fa4ac0ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4a9ffb700 1 -- 172.21.15.60:0/2964298214 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa49c00bc10 con 0x7fa4ac0af520 2020-10-31T22:48:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.069+0000 7fa4abfff700 1 --2- 172.21.15.60:0/2964298214 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa4ac0af520 0x7fa4ac0ac870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa49c0032b0 tx=0x7fa49c0091a0).stop 2020-10-31T22:48:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 -- 172.21.15.60:0/2964298214 shutdown_connections 2020-10-31T22:48:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 --2- 172.21.15.60:0/2964298214 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa4ac0af520 0x7fa4ac0ac870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 -- 172.21.15.60:0/2964298214 >> 172.21.15.60:0/2964298214 conn(0x7fa4ac0b3fd0 msgr2=0x7fa4ac0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 -- 172.21.15.60:0/2964298214 shutdown_connections 2020-10-31T22:48:03.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 -- 172.21.15.60:0/2964298214 wait complete. 2020-10-31T22:48:03.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 Processor -- start 2020-10-31T22:48:03.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 -- start start 2020-10-31T22:48:03.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4ac066c90 0x7fa4ac0664e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:03.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa4ac0670f0 0x7fa4ac144290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:03.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4ac0af520 0x7fa4ac144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:03.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac159060 con 0x7fa4ac066c90 2020-10-31T22:48:03.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac061ec0 con 0x7fa4ac0af520 2020-10-31T22:48:03.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ac062160 con 0x7fa4ac0670f0 2020-10-31T22:48:03.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4aaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4ac066c90 0x7fa4ac0664e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:03.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4aaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4ac066c90 0x7fa4ac0664e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45788/0 (socket says 172.21.15.60:45788) 2020-10-31T22:48:03.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4aaffd700 1 -- 172.21.15.60:0/3254679689 learned_addr learned my addr 172.21.15.60:0/3254679689 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:03.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4ab7fe700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4ac0af520 0x7fa4ac144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:03.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4aa7fc700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa4ac0670f0 0x7fa4ac144290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:03.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4aaffd700 1 -- 172.21.15.60:0/3254679689 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa4ac0670f0 msgr2=0x7fa4ac144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:03.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4aaffd700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa4ac0670f0 0x7fa4ac144290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:03.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4aaffd700 1 -- 172.21.15.60:0/3254679689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4ac0af520 msgr2=0x7fa4ac144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:03.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4aaffd700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4ac0af520 0x7fa4ac144780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:03.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4aaffd700 1 -- 172.21.15.60:0/3254679689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ac158d80 con 0x7fa4ac066c90 2020-10-31T22:48:03.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4aa7fc700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa4ac0670f0 0x7fa4ac144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:03.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4aaffd700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4ac066c90 0x7fa4ac0664e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fa49c0032b0 tx=0x7fa49c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:03.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa49bfff700 1 -- 172.21.15.60:0/3254679689 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa49c0205f0 con 0x7fa4ac066c90 2020-10-31T22:48:03.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa49bfff700 1 -- 172.21.15.60:0/3254679689 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49c020750 con 0x7fa4ac066c90 2020-10-31T22:48:03.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 -- 172.21.15.60:0/3254679689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ac144c70 con 0x7fa4ac066c90 2020-10-31T22:48:03.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa49bfff700 1 -- 172.21.15.60:0/3254679689 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa49c020ab0 con 0x7fa4ac066c90 2020-10-31T22:48:03.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.073+0000 7fa4abfff700 1 -- 172.21.15.60:0/3254679689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ac0aada0 con 0x7fa4ac066c90 2020-10-31T22:48:03.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.077+0000 7fa4abfff700 1 -- 172.21.15.60:0/3254679689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4ac061960 con 0x7fa4ac066c90 2020-10-31T22:48:03.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.077+0000 7fa49bfff700 1 -- 172.21.15.60:0/3254679689 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa49c027030 con 0x7fa4ac066c90 2020-10-31T22:48:03.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.077+0000 7fa49bfff700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa488054f10 0x7fa4880573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:03.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.077+0000 7fa49bfff700 1 -- 172.21.15.60:0/3254679689 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fa49c06ed20 con 0x7fa4ac066c90 2020-10-31T22:48:03.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.077+0000 7fa4aa7fc700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa488054f10 0x7fa4880573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:03.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.077+0000 7fa4aa7fc700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa488054f10 0x7fa4880573d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fa4a000b000 tx=0x7fa4a0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:03.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.085+0000 7fa49bfff700 1 -- 172.21.15.60:0/3254679689 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa4ac061960 con 0x7fa4ac066c90 2020-10-31T22:48:03.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.277+0000 7fa4abfff700 1 -- 172.21.15.60:0/3254679689 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]} v 0) v1 -- 0x7fa4ac061960 con 0x7fa4ac066c90 2020-10-31T22:48:03.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.809+0000 7fa49bfff700 1 -- 172.21.15.60:0/3254679689 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_cap_revoke_nonresponder"]}]=0 v292) v1 ==== 139+0+0 (secure 0 0 0) 0x7fa4ac061960 con 0x7fa4ac066c90 2020-10-31T22:48:03.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.813+0000 7fa4abfff700 1 -- 172.21.15.60:0/3254679689 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa488054f10 msgr2=0x7fa4880573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:03.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.813+0000 7fa4abfff700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa488054f10 0x7fa4880573d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fa4a000b000 tx=0x7fa4a0009040).stop 2020-10-31T22:48:03.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.813+0000 7fa4abfff700 1 -- 172.21.15.60:0/3254679689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4ac066c90 msgr2=0x7fa4ac0664e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:03.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.813+0000 7fa4abfff700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4ac066c90 0x7fa4ac0664e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 rx=0x7fa49c0032b0 tx=0x7fa49c016000).stop 2020-10-31T22:48:03.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.813+0000 7fa4abfff700 1 -- 172.21.15.60:0/3254679689 shutdown_connections 2020-10-31T22:48:03.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.813+0000 7fa4abfff700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa488054f10 0x7fa4880573d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:03.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.813+0000 7fa4abfff700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa4ac0af520 0x7fa4ac144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:03.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.813+0000 7fa4abfff700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4ac066c90 0x7fa4ac0664e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:03.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.813+0000 7fa4abfff700 1 --2- 172.21.15.60:0/3254679689 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa4ac0670f0 0x7fa4ac144290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:03.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.813+0000 7fa4abfff700 1 -- 172.21.15.60:0/3254679689 >> 172.21.15.60:0/3254679689 conn(0x7fa4ac0b3fd0 msgr2=0x7fa4ac1457b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.813+0000 7fa4abfff700 1 -- 172.21.15.60:0/3254679689 shutdown_connections 2020-10-31T22:48:03.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.813+0000 7fa4abfff700 1 -- 172.21.15.60:0/3254679689 wait complete. 2020-10-31T22:48:03.841 INFO:tasks.cephfs_test_runner:test_cap_revoke_nonresponder (tasks.cephfs.test_misc.TestMisc) ... ok 2020-10-31T22:48:03.842 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode (tasks.cephfs.test_misc.TestMisc) 2020-10-31T22:48:03.843 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2020-10-31T22:48:03.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5507549700 1 Processor -- start 2020-10-31T22:48:03.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5507549700 1 -- start start 2020-10-31T22:48:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5507549700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f55000ac870 0x7f55000b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5507549700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55000ae8b0 0x7f55001412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5507549700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55000acc50 con 0x7f55000b0e20 2020-10-31T22:48:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5507549700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55000b14c0 con 0x7f55000ae8b0 2020-10-31T22:48:03.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5507549700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55000b5690 con 0x7f55000ac870 2020-10-31T22:48:03.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5506d48700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55000ae8b0 0x7f55001412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:03.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5506d48700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55000ae8b0 0x7f55001412e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45798/0 (socket says 172.21.15.60:45798) 2020-10-31T22:48:03.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5506d48700 1 -- 172.21.15.60:0/4265979964 learned_addr learned my addr 172.21.15.60:0/4265979964 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:03.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5505d46700 1 --1- 172.21.15.60:0/4265979964 >> v1:172.21.15.60:6789/0 conn(0x7f55000b0e20 0x7f55000ae1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49932/0 (socket says 172.21.15.60:49932) 2020-10-31T22:48:03.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5506547700 1 --2- 172.21.15.60:0/4265979964 >> v2:172.21.15.66:3300/0 conn(0x7f55000ac870 0x7f55000b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:03.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5506d48700 1 -- 172.21.15.60:0/4265979964 >> v2:172.21.15.66:3300/0 conn(0x7f55000ac870 msgr2=0x7f55000b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:03.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5506d48700 1 --2- 172.21.15.60:0/4265979964 >> v2:172.21.15.66:3300/0 conn(0x7f55000ac870 0x7f55000b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:03.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5506d48700 1 -- 172.21.15.60:0/4265979964 >> v1:172.21.15.60:6789/0 conn(0x7f55000b0e20 legacy=0x7f55000ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:03.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5506d48700 1 -- 172.21.15.60:0/4265979964 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55000afc10 con 0x7f55000ae8b0 2020-10-31T22:48:03.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5506d48700 1 --2- 172.21.15.60:0/4265979964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000ae8b0 0x7f55001412e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f54f0002f30 tx=0x7f54f0006f10).ready entity=mon.0 client_cookie=234c45c23bc1a82 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:03.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5505545700 1 -- 172.21.15.60:0/4265979964 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54f000de30 con 0x7f55000ae8b0 2020-10-31T22:48:03.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5505545700 1 -- 172.21.15.60:0/4265979964 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f0010470 con 0x7f55000ae8b0 2020-10-31T22:48:03.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5505545700 1 -- 172.21.15.60:0/4265979964 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54f00107d0 con 0x7f55000ae8b0 2020-10-31T22:48:03.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5507549700 1 -- 172.21.15.60:0/4265979964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000ae8b0 msgr2=0x7f55001412e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:03.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.957+0000 7f5507549700 1 --2- 172.21.15.60:0/4265979964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000ae8b0 0x7f55001412e0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 rx=0x7f54f0002f30 tx=0x7f54f0006f10).stop 2020-10-31T22:48:03.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.961+0000 7f5507549700 1 -- 172.21.15.60:0/4265979964 shutdown_connections 2020-10-31T22:48:03.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.961+0000 7f5507549700 1 --2- 172.21.15.60:0/4265979964 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000ae8b0 0x7f55001412e0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:03.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.961+0000 7f5507549700 1 --2- 172.21.15.60:0/4265979964 >> v2:172.21.15.66:3300/0 conn(0x7f55000ac870 0x7f55000b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:03.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.961+0000 7f5507549700 1 -- 172.21.15.60:0/4265979964 >> 172.21.15.60:0/4265979964 conn(0x7f550006a600 msgr2=0x7f5500060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:03.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.961+0000 7f5507549700 1 -- 172.21.15.60:0/4265979964 shutdown_connections 2020-10-31T22:48:03.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.961+0000 7f5507549700 1 -- 172.21.15.60:0/4265979964 wait complete. 2020-10-31T22:48:03.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.961+0000 7f5507549700 1 Processor -- start 2020-10-31T22:48:03.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.961+0000 7f5507549700 1 -- start start 2020-10-31T22:48:03.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5507549700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000ac870 0x7f5500143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:03.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5507549700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55000ae8b0 0x7f55001401a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:03.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5507549700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000b0e20 0x7f5500140690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:03.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5507549700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550009e210 con 0x7f55000b0e20 2020-10-31T22:48:03.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5507549700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550009e440 con 0x7f55000ac870 2020-10-31T22:48:03.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5507549700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f550009e6e0 con 0x7f55000ae8b0 2020-10-31T22:48:03.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5506d48700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000b0e20 0x7f5500140690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:03.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5506547700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000ac870 0x7f5500143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:03.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5506d48700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000b0e20 0x7f5500140690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45804/0 (socket says 172.21.15.60:45804) 2020-10-31T22:48:03.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5506d48700 1 -- 172.21.15.60:0/1807529292 learned_addr learned my addr 172.21.15.60:0/1807529292 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:03.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5505d46700 1 --2- 172.21.15.60:0/1807529292 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55000ae8b0 0x7f55001401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:03.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5506d48700 1 -- 172.21.15.60:0/1807529292 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55000ae8b0 msgr2=0x7f55001401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:03.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5506d48700 1 --2- 172.21.15.60:0/1807529292 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55000ae8b0 0x7f55001401a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:03.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5506d48700 1 -- 172.21.15.60:0/1807529292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000ac870 msgr2=0x7f5500143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:03.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5506d48700 1 --2- 172.21.15.60:0/1807529292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000ac870 0x7f5500143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:03.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5506d48700 1 -- 172.21.15.60:0/1807529292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550009e980 con 0x7f55000b0e20 2020-10-31T22:48:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5506547700 1 --2- 172.21.15.60:0/1807529292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000ac870 0x7f5500143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5506d48700 1 --2- 172.21.15.60:0/1807529292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000b0e20 0x7f5500140690 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f54f0002f30 tx=0x7f54f0006f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f54ff7fe700 1 -- 172.21.15.60:0/1807529292 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54f0018610 con 0x7f55000b0e20 2020-10-31T22:48:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f54ff7fe700 1 -- 172.21.15.60:0/1807529292 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f0018770 con 0x7f55000b0e20 2020-10-31T22:48:03.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f54ff7fe700 1 -- 172.21.15.60:0/1807529292 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54f0018ad0 con 0x7f55000b0e20 2020-10-31T22:48:03.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5507549700 1 -- 172.21.15.60:0/1807529292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5500143e00 con 0x7f55000b0e20 2020-10-31T22:48:03.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5507549700 1 -- 172.21.15.60:0/1807529292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5500140d20 con 0x7f55000b0e20 2020-10-31T22:48:03.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.965+0000 7f5507549700 1 -- 172.21.15.60:0/1807529292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55000657b0 con 0x7f55000b0e20 2020-10-31T22:48:03.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.969+0000 7f54ff7fe700 1 -- 172.21.15.60:0/1807529292 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f54f002b070 con 0x7f55000b0e20 2020-10-31T22:48:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.969+0000 7f54ff7fe700 1 --2- 172.21.15.60:0/1807529292 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54e0055020 0x7f54e00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.969+0000 7f54ff7fe700 1 -- 172.21.15.60:0/1807529292 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f54f0070fd0 con 0x7f55000b0e20 2020-10-31T22:48:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.969+0000 7f5506547700 1 --2- 172.21.15.60:0/1807529292 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54e0055020 0x7f54e00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.969+0000 7f5506547700 1 --2- 172.21.15.60:0/1807529292 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54e0055020 0x7f54e00574e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f54f800b000 tx=0x7f54f80091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:03.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:03.973+0000 7f54ff7fe700 1 -- 172.21.15.60:0/1807529292 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f55000657b0 con 0x7f55000b0e20 2020-10-31T22:48:04.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.169+0000 7f5507549700 1 -- 172.21.15.60:0/1807529292 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f55000657b0 con 0x7f55000b0e20 2020-10-31T22:48:04.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.817+0000 7f54ff7fe700 1 -- 172.21.15.60:0/1807529292 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v293) v1 ==== 129+0+0 (secure 0 0 0) 0x7f55000657b0 con 0x7f55000b0e20 2020-10-31T22:48:04.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.821+0000 7f5507549700 1 -- 172.21.15.60:0/1807529292 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54e0055020 msgr2=0x7f54e00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.821+0000 7f5507549700 1 --2- 172.21.15.60:0/1807529292 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54e0055020 0x7f54e00574e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f54f800b000 tx=0x7f54f80091a0).stop 2020-10-31T22:48:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.821+0000 7f5507549700 1 -- 172.21.15.60:0/1807529292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000b0e20 msgr2=0x7f5500140690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.821+0000 7f5507549700 1 --2- 172.21.15.60:0/1807529292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000b0e20 0x7f5500140690 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 rx=0x7f54f0002f30 tx=0x7f54f0006f10).stop 2020-10-31T22:48:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.821+0000 7f5507549700 1 -- 172.21.15.60:0/1807529292 shutdown_connections 2020-10-31T22:48:04.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.821+0000 7f5507549700 1 --2- 172.21.15.60:0/1807529292 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000b0e20 0x7f5500140690 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:04.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.821+0000 7f5507549700 1 --2- 172.21.15.60:0/1807529292 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54e0055020 0x7f54e00574e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:04.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.821+0000 7f5507549700 1 --2- 172.21.15.60:0/1807529292 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000ac870 0x7f5500143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:04.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.821+0000 7f5507549700 1 --2- 172.21.15.60:0/1807529292 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55000ae8b0 0x7f55001401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:04.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.821+0000 7f5507549700 1 -- 172.21.15.60:0/1807529292 >> 172.21.15.60:0/1807529292 conn(0x7f550006a600 msgr2=0x7f55000a8200 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:04.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.821+0000 7f5507549700 1 -- 172.21.15.60:0/1807529292 shutdown_connections 2020-10-31T22:48:04.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.821+0000 7f5507549700 1 -- 172.21.15.60:0/1807529292 wait complete. 2020-10-31T22:48:04.847 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2020-10-31T22:48:04.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.973+0000 7f3ef7279700 1 Processor -- start 2020-10-31T22:48:04.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.973+0000 7f3ef7279700 1 -- start start 2020-10-31T22:48:04.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.973+0000 7f3ef7279700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3ef00a99c0 0x7f3ef0066f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:04.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.973+0000 7f3ef7279700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef00a75d0 con 0x7f3ef00a95e0 2020-10-31T22:48:04.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.973+0000 7f3ef7279700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ef005afe0 con 0x7f3ef005bb50 2020-10-31T22:48:04.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.973+0000 7f3ef7279700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ef00a9e30 con 0x7f3ef00a99c0 2020-10-31T22:48:04.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.973+0000 7f3ef6a78700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3ef00a99c0 0x7f3ef0066f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:04.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.973+0000 7f3ef6277700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3ef00a95e0 0x7f3ef005b440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49944/0 (socket says 172.21.15.60:49944) 2020-10-31T22:48:04.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.973+0000 7f3ef6277700 1 -- 172.21.15.60:0/2973107941 learned_addr learned my addr 172.21.15.60:0/2973107941 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:04.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef6a78700 1 -- 172.21.15.60:0/2973107941 >> v1:172.21.15.66:6789/0 conn(0x7f3ef005bb50 legacy=0x7f3ef0066830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:04.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef6a78700 1 -- 172.21.15.60:0/2973107941 >> v1:172.21.15.60:6789/0 conn(0x7f3ef00a95e0 legacy=0x7f3ef005b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:04.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef6a78700 1 -- 172.21.15.60:0/2973107941 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef00a8e00 con 0x7f3ef00a99c0 2020-10-31T22:48:04.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef5275700 1 -- 172.21.15.60:0/2973107941 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551069514 0 0) 0x7f3ef00a75d0 con 0x7f3ef00a95e0 2020-10-31T22:48:04.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef6a78700 1 --2- 172.21.15.60:0/2973107941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef00a99c0 0x7f3ef0066f40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f3ee80032b0 tx=0x7f3ee80091a0).ready entity=mon.0 client_cookie=9b9bbb5dabeb03d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:04.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef5275700 1 -- 172.21.15.60:0/2973107941 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee800ba50 con 0x7f3ef00a99c0 2020-10-31T22:48:04.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef5275700 1 -- 172.21.15.60:0/2973107941 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee800bbb0 con 0x7f3ef00a99c0 2020-10-31T22:48:04.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef5275700 1 -- 172.21.15.60:0/2973107941 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee800bd20 con 0x7f3ef00a99c0 2020-10-31T22:48:04.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef7279700 1 -- 172.21.15.60:0/2973107941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef00a99c0 msgr2=0x7f3ef0066f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:04.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef7279700 1 --2- 172.21.15.60:0/2973107941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef00a99c0 0x7f3ef0066f40 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 rx=0x7f3ee80032b0 tx=0x7f3ee80091a0).stop 2020-10-31T22:48:04.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef7279700 1 -- 172.21.15.60:0/2973107941 shutdown_connections 2020-10-31T22:48:04.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef7279700 1 --2- 172.21.15.60:0/2973107941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef00a99c0 0x7f3ef0066f40 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:04.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef7279700 1 -- 172.21.15.60:0/2973107941 >> 172.21.15.60:0/2973107941 conn(0x7f3ef00b3fd0 msgr2=0x7f3ef00b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:04.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef7279700 1 -- 172.21.15.60:0/2973107941 shutdown_connections 2020-10-31T22:48:04.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.977+0000 7f3ef7279700 1 -- 172.21.15.60:0/2973107941 wait complete. 2020-10-31T22:48:04.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef7279700 1 Processor -- start 2020-10-31T22:48:04.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef7279700 1 -- start start 2020-10-31T22:48:04.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef7279700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ef005bb50 0x7f3ef0065f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:04.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef7279700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef00a95e0 0x7f3ef013b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:04.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef7279700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ef00a99c0 0x7f3ef013b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:04.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef7279700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00ace10 con 0x7f3ef00a95e0 2020-10-31T22:48:04.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef7279700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00ad0b0 con 0x7f3ef00a99c0 2020-10-31T22:48:04.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef7279700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ef00ad350 con 0x7f3ef005bb50 2020-10-31T22:48:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef5a76700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef00a95e0 0x7f3ef013b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef5a76700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef00a95e0 0x7f3ef013b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45816/0 (socket says 172.21.15.60:45816) 2020-10-31T22:48:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef5a76700 1 -- 172.21.15.60:0/880064512 learned_addr learned my addr 172.21.15.60:0/880064512 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef6277700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ef005bb50 0x7f3ef0065f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef6a78700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ef00a99c0 0x7f3ef013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef5a76700 1 -- 172.21.15.60:0/880064512 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ef005bb50 msgr2=0x7f3ef0065f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:04.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef5a76700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ef005bb50 0x7f3ef0065f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef5a76700 1 -- 172.21.15.60:0/880064512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ef00a99c0 msgr2=0x7f3ef013b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef5a76700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ef00a99c0 0x7f3ef013b740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef5a76700 1 -- 172.21.15.60:0/880064512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef00674b0 con 0x7f3ef00a95e0 2020-10-31T22:48:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef6277700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ef005bb50 0x7f3ef0065f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef6a78700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ef00a99c0 0x7f3ef013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:04.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef5a76700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef00a95e0 0x7f3ef013b250 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f3ef00615e0 tx=0x7f3ee0007bf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3edf7fe700 1 -- 172.21.15.60:0/880064512 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee000e4a0 con 0x7f3ef00a95e0 2020-10-31T22:48:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3edf7fe700 1 -- 172.21.15.60:0/880064512 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee000e600 con 0x7f3ef00a95e0 2020-10-31T22:48:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef7279700 1 -- 172.21.15.60:0/880064512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ef013bc30 con 0x7f3ef00a95e0 2020-10-31T22:48:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3edf7fe700 1 -- 172.21.15.60:0/880064512 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ee000e960 con 0x7f3ef00a95e0 2020-10-31T22:48:04.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.981+0000 7f3ef7279700 1 -- 172.21.15.60:0/880064512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ef0141c60 con 0x7f3ef00a95e0 2020-10-31T22:48:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.985+0000 7f3ef7279700 1 -- 172.21.15.60:0/880064512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ef0057100 con 0x7f3ef00a95e0 2020-10-31T22:48:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.985+0000 7f3edf7fe700 1 -- 172.21.15.60:0/880064512 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3ee0010030 con 0x7f3ef00a95e0 2020-10-31T22:48:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.985+0000 7f3edf7fe700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3ed0055020 0x7f3ed00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:04.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.985+0000 7f3edf7fe700 1 -- 172.21.15.60:0/880064512 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f3ee006d890 con 0x7f3ef00a95e0 2020-10-31T22:48:04.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.985+0000 7f3ef6277700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3ed0055020 0x7f3ed00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:04.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.985+0000 7f3ef6277700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3ed0055020 0x7f3ed00574e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f3eec00b000 tx=0x7f3eec009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:04.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:04.993+0000 7f3edf7fe700 1 -- 172.21.15.60:0/880064512 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3ee0043d80 con 0x7f3ef00a95e0 2020-10-31T22:48:05.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.137+0000 7f3ef7279700 1 -- 172.21.15.60:0/880064512 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7f3ef00b0850 con 0x7f3ef00a95e0 2020-10-31T22:48:05.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.145+0000 7f3edf7fe700 1 -- 172.21.15.60:0/880064512 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3ee00473a0 con 0x7f3ef00a95e0 2020-10-31T22:48:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.145+0000 7f3ef7279700 1 -- 172.21.15.60:0/880064512 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3ed0055020 msgr2=0x7f3ed00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.145+0000 7f3ef7279700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3ed0055020 0x7f3ed00574e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f3eec00b000 tx=0x7f3eec009040).stop 2020-10-31T22:48:05.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.145+0000 7f3ef7279700 1 -- 172.21.15.60:0/880064512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef00a95e0 msgr2=0x7f3ef013b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.145+0000 7f3ef7279700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef00a95e0 0x7f3ef013b250 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 rx=0x7f3ef00615e0 tx=0x7f3ee0007bf0).stop 2020-10-31T22:48:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.145+0000 7f3ef7279700 1 -- 172.21.15.60:0/880064512 shutdown_connections 2020-10-31T22:48:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.145+0000 7f3ef7279700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3ed0055020 0x7f3ed00574e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.145+0000 7f3ef7279700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3ef00a99c0 0x7f3ef013b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.145+0000 7f3ef7279700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3ef005bb50 0x7f3ef0065f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.145+0000 7f3ef7279700 1 --2- 172.21.15.60:0/880064512 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3ef00a95e0 0x7f3ef013b250 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.145+0000 7f3ef7279700 1 -- 172.21.15.60:0/880064512 >> 172.21.15.60:0/880064512 conn(0x7f3ef00b3fd0 msgr2=0x7f3ef013fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:05.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.149+0000 7f3ef7279700 1 -- 172.21.15.60:0/880064512 shutdown_connections 2020-10-31T22:48:05.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.149+0000 7f3ef7279700 1 -- 172.21.15.60:0/880064512 wait complete. 2020-10-31T22:48:05.168 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:48:05.169 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:05.184 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:05.201 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:05.219 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:05.235 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:48:05.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:05.236 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:05.236 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:05.289 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-10-31T22:48:05.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:48:05.290 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2020-10-31T22:48:05.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:05.291 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:05.291 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:05.298 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:48:05.299 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:48:05.300 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:48:05.301 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-10-31T22:48:05.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.413+0000 7fda56f51700 1 Processor -- start 2020-10-31T22:48:05.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.413+0000 7fda56f51700 1 -- start start 2020-10-31T22:48:05.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda56f51700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5005b320 0x7fda500b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:05.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda56f51700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5005b700 con 0x7fda500acc80 2020-10-31T22:48:05.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda56f51700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda501408a0 con 0x7fda50140420 2020-10-31T22:48:05.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda56f51700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda500b0220 con 0x7fda5005b320 2020-10-31T22:48:05.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda56750700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fda500acc80 0x7fda500adeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49958/0 (socket says 172.21.15.60:49958) 2020-10-31T22:48:05.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda56750700 1 -- 172.21.15.60:0/2933008291 learned_addr learned my addr 172.21.15.60:0/2933008291 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:05.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda55f4f700 1 --2- 172.21.15.60:0/2933008291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5005b320 0x7fda500b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:05.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 -- 172.21.15.60:0/2933008291 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010216557 0 0) 0x7fda5005b700 con 0x7fda500acc80 2020-10-31T22:48:05.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 -- 172.21.15.60:0/2933008291 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda3c003230 con 0x7fda500acc80 2020-10-31T22:48:05.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 -- 172.21.15.60:0/2933008291 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 836655799 0 0) 0x7fda3c003230 con 0x7fda500acc80 2020-10-31T22:48:05.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 -- 172.21.15.60:0/2933008291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5005b320 msgr2=0x7fda500b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:05.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 --2- 172.21.15.60:0/2933008291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5005b320 0x7fda500b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 -- 172.21.15.60:0/2933008291 >> v1:172.21.15.66:6789/0 conn(0x7fda50140420 legacy=0x7fda500ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:05.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 -- 172.21.15.60:0/2933008291 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda500b04c0 con 0x7fda500acc80 2020-10-31T22:48:05.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 -- 172.21.15.60:0/2933008291 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fda400016d0 con 0x7fda500acc80 2020-10-31T22:48:05.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 -- 172.21.15.60:0/2933008291 >> v1:172.21.15.60:6789/0 conn(0x7fda500acc80 legacy=0x7fda500adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:05.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 --2- 172.21.15.60:0/2933008291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c003750 0x7fda3c003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:05.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 --2- 172.21.15.60:0/2933008291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c004090 0x7fda3c004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:05.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 --2- 172.21.15.60:0/2933008291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5005b320 0x7fda3c004bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:05.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 -- 172.21.15.60:0/2933008291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda500b0220 con 0x7fda3c004090 2020-10-31T22:48:05.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 -- 172.21.15.60:0/2933008291 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c005110 con 0x7fda3c003750 2020-10-31T22:48:05.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 -- 172.21.15.60:0/2933008291 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c0052d0 con 0x7fda5005b320 2020-10-31T22:48:05.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda5574e700 1 --2- 172.21.15.60:0/2933008291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c004090 0x7fda3c004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:05.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda55f4f700 1 --2- 172.21.15.60:0/2933008291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c003750 0x7fda3c003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda56750700 1 --2- 172.21.15.60:0/2933008291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5005b320 0x7fda3c004bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda5574e700 1 -- 172.21.15.60:0/2933008291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5005b320 msgr2=0x7fda3c004bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda5574e700 1 --2- 172.21.15.60:0/2933008291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5005b320 0x7fda3c004bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda5574e700 1 -- 172.21.15.60:0/2933008291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c003750 msgr2=0x7fda3c003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda5574e700 1 --2- 172.21.15.60:0/2933008291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda3c003750 0x7fda3c003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda5574e700 1 -- 172.21.15.60:0/2933008291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c003230 con 0x7fda3c004090 2020-10-31T22:48:05.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda5574e700 1 --2- 172.21.15.60:0/2933008291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c004090 0x7fda3c004570 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7fda440010d0 tx=0x7fda44007b60).ready entity=mon.0 client_cookie=925848407a8045cd server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:05.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 -- 172.21.15.60:0/2933008291 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda4400c830 con 0x7fda3c004090 2020-10-31T22:48:05.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 -- 172.21.15.60:0/2933008291 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4400c990 con 0x7fda3c004090 2020-10-31T22:48:05.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda54f4d700 1 -- 172.21.15.60:0/2933008291 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda4400ccf0 con 0x7fda3c004090 2020-10-31T22:48:05.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda56f51700 1 -- 172.21.15.60:0/2933008291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c004090 msgr2=0x7fda3c004570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:05.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda56f51700 1 --2- 172.21.15.60:0/2933008291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda3c004090 0x7fda3c004570 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 rx=0x7fda440010d0 tx=0x7fda44007b60).stop 2020-10-31T22:48:05.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.417+0000 7fda56750700 1 -- 172.21.15.60:0/2933008291 reap_dead start 2020-10-31T22:48:05.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda56f51700 1 -- 172.21.15.60:0/2933008291 shutdown_connections 2020-10-31T22:48:05.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda56f51700 1 -- 172.21.15.60:0/2933008291 >> 172.21.15.60:0/2933008291 conn(0x7fda500b61d0 msgr2=0x7fda500b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:05.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda56f51700 1 -- 172.21.15.60:0/2933008291 shutdown_connections 2020-10-31T22:48:05.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda56f51700 1 -- 172.21.15.60:0/2933008291 wait complete. 2020-10-31T22:48:05.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda56f51700 1 Processor -- start 2020-10-31T22:48:05.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda56f51700 1 -- start start 2020-10-31T22:48:05.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda56f51700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5013eb60 0x7fda5014e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:05.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda56f51700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda501527f0 0x7fda50145320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:05.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda56f51700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda50145810 0x7fda500b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:05.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda56f51700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda500b5da0 con 0x7fda501527f0 2020-10-31T22:48:05.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda56f51700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5014eec0 con 0x7fda50145810 2020-10-31T22:48:05.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda56f51700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda5013ef40 con 0x7fda5013eb60 2020-10-31T22:48:05.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda5574e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda501527f0 0x7fda50145320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:05.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda5574e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda501527f0 0x7fda50145320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45834/0 (socket says 172.21.15.60:45834) 2020-10-31T22:48:05.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda5574e700 1 -- 172.21.15.60:0/2805589224 learned_addr learned my addr 172.21.15.60:0/2805589224 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:05.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda56750700 1 --2- 172.21.15.60:0/2805589224 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda50145810 0x7fda500b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:05.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda55f4f700 1 --2- 172.21.15.60:0/2805589224 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5013eb60 0x7fda5014e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:05.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda5574e700 1 -- 172.21.15.60:0/2805589224 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5013eb60 msgr2=0x7fda5014e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:05.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda5574e700 1 --2- 172.21.15.60:0/2805589224 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5013eb60 0x7fda5014e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda5574e700 1 -- 172.21.15.60:0/2805589224 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda50145810 msgr2=0x7fda500b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:05.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda5574e700 1 --2- 172.21.15.60:0/2805589224 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda50145810 0x7fda500b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda5574e700 1 -- 172.21.15.60:0/2805589224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda500b5b00 con 0x7fda501527f0 2020-10-31T22:48:05.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda5574e700 1 --2- 172.21.15.60:0/2805589224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda501527f0 0x7fda50145320 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fda440010d0 tx=0x7fda44016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:05.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda4effd700 1 -- 172.21.15.60:0/2805589224 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda44013be0 con 0x7fda501527f0 2020-10-31T22:48:05.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda4effd700 1 -- 172.21.15.60:0/2805589224 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda44013d40 con 0x7fda501527f0 2020-10-31T22:48:05.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda56f51700 1 -- 172.21.15.60:0/2805589224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda501520b0 con 0x7fda501527f0 2020-10-31T22:48:05.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.421+0000 7fda4effd700 1 -- 172.21.15.60:0/2805589224 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fda4401d600 con 0x7fda501527f0 2020-10-31T22:48:05.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.425+0000 7fda56f51700 1 -- 172.21.15.60:0/2805589224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda50141740 con 0x7fda501527f0 2020-10-31T22:48:05.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.425+0000 7fda4effd700 1 -- 172.21.15.60:0/2805589224 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fda44024030 con 0x7fda501527f0 2020-10-31T22:48:05.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.425+0000 7fda56f51700 1 -- 172.21.15.60:0/2805589224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda50057100 con 0x7fda501527f0 2020-10-31T22:48:05.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.425+0000 7fda4effd700 1 --2- 172.21.15.60:0/2805589224 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fda300550c0 0x7fda30057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:05.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.425+0000 7fda55f4f700 1 --2- 172.21.15.60:0/2805589224 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fda300550c0 0x7fda30057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:05.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.425+0000 7fda4effd700 1 -- 172.21.15.60:0/2805589224 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6116+0+0 (secure 0 0 0) 0x7fda4406e6e0 con 0x7fda501527f0 2020-10-31T22:48:05.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.425+0000 7fda55f4f700 1 --2- 172.21.15.60:0/2805589224 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fda300550c0 0x7fda30057580 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fda4800b000 tx=0x7fda480091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:05.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.429+0000 7fda4effd700 1 -- 172.21.15.60:0/2805589224 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fda44044ac0 con 0x7fda501527f0 2020-10-31T22:48:05.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.569+0000 7fda56f51700 1 -- 172.21.15.60:0/2805589224 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fda500ad320 con 0x7fda501527f0 2020-10-31T22:48:05.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.573+0000 7fda4effd700 1 -- 172.21.15.60:0/2805589224 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v77) v1 ==== 81+0+33725 (secure 0 0 0) 0x7fda44022020 con 0x7fda501527f0 2020-10-31T22:48:05.581 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:05.581 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:48:05.581 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 77, 2020-10-31T22:48:05.581 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "226f905a-1517-4a8c-8009-08779515965c", 2020-10-31T22:48:05.581 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2020-10-31T22:40:51.928572+0000", 2020-10-31T22:48:05.582 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2020-10-31T22:47:51.986567+0000", 2020-10-31T22:48:05.582 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:48:05.582 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:48:05.582 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-10-31T22:48:05.582 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2020-10-31T22:48:05.582 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2020-10-31T22:48:05.583 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2020-10-31T22:48:05.583 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2020-10-31T22:48:05.583 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2020-10-31T22:48:05.583 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2020-10-31T22:48:05.583 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:48:05.583 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2020-10-31T22:48:05.583 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2020-10-31T22:48:05.584 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-10-31T22:48:05.584 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2020-10-31T22:48:05.584 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2020-10-31T22:48:05.584 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 14, 2020-10-31T22:48:05.584 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2020-10-31T22:48:05.584 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "jewel", 2020-10-31T22:48:05.585 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2020-10-31T22:48:05.585 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "octopus", 2020-10-31T22:48:05.585 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:48:05.585 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.585 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2020-10-31T22:48:05.585 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "device_health_metrics", 2020-10-31T22:48:05.585 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:40:55.846143+0000", 2020-10-31T22:48:05.586 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:48:05.586 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:48:05.586 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:48:05.586 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:48:05.586 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:48:05.586 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:48:05.586 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:48:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:48:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2020-10-31T22:48:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2020-10-31T22:48:05.587 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2020-10-31T22:48:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2020-10-31T22:48:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2020-10-31T22:48:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:48:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:48:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:48:05.588 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:48:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:48:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:48:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:48:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "15", 2020-10-31T22:48:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:48:05.589 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:48:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:48:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:48:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:48:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:48:05.590 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:48:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:48:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:48:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:48:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:48:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:48:05.591 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:48:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:48:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:48:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:48:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:48:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:48:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:48:05.592 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:48:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:48:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:48:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:48:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:48:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:48:05.593 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:48:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:48:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:48:05.594 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:48:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:48:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:48:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:48:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:48:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:48:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:48:05.595 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:48:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:48:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:48:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2020-10-31T22:48:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:48:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_devicehealth": {} 2020-10-31T22:48:05.596 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2020-10-31T22:48:05.597 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2020-10-31T22:48:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:05.358501+0000", 2020-10-31T22:48:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:48:05.598 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:48:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:48:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:48:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:48:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:48:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:48:05.599 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:48:05.600 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:48:05.600 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:48:05.600 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:48:05.600 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:48:05.600 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:48:05.600 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:48:05.601 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:48:05.601 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:48:05.601 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:48:05.601 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:48:05.601 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:48:05.601 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:48:05.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.602 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "18", 2020-10-31T22:48:05.603 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:48:05.603 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:48:05.603 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:48:05.603 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:48:05.603 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:48:05.604 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:48:05.604 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:48:05.604 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:48:05.604 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:48:05.604 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:48:05.604 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:48:05.604 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:48:05.605 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:48:05.605 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:48:05.605 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:48:05.605 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:48:05.605 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:48:05.605 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:48:05.605 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:48:05.606 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:48:05.606 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:48:05.606 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:48:05.606 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:48:05.606 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:48:05.606 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:48:05.606 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:48:05.607 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.607 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:48:05.607 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:48:05.607 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:48:05.607 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:48:05.607 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:48:05.607 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:48:05.608 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:48:05.608 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:48:05.608 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:48:05.608 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:48:05.608 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:48:05.608 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:48:05.608 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:48:05.609 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2020-10-31T22:48:05.609 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.609 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 13, 2020-10-31T22:48:05.609 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2020-10-31T22:48:05.609 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:47:04.119666+0000", 2020-10-31T22:48:05.610 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:48:05.610 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:48:05.610 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:48:05.610 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:48:05.610 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:48:05.610 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:48:05.610 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:48:05.611 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:48:05.611 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:48:05.611 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:48:05.611 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:48:05.611 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:48:05.611 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:48:05.611 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:48:05.611 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:48:05.612 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:48:05.612 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:48:05.612 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:48:05.612 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:48:05.612 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:48:05.613 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.613 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "75", 2020-10-31T22:48:05.613 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:48:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:48:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:48:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:48:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:48:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:48:05.614 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:48:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:48:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:48:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:48:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:48:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:48:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:48:05.615 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:48:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:48:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:48:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:48:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:48:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:48:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:48:05.616 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:48:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:48:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:48:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:48:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:48:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:48:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:48:05.617 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:48:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:48:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:48:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:48:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:48:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:48:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:48:05.618 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:48:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:48:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:48:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:48:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2020-10-31T22:48:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2020-10-31T22:48:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2020-10-31T22:48:05.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:48:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:48:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2020-10-31T22:48:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.620 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 14, 2020-10-31T22:48:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2020-10-31T22:48:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:47:05.419686+0000", 2020-10-31T22:48:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:48:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:48:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:48:05.621 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:48:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:48:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:48:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:48:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:48:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:48:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:48:05.622 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:48:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:48:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:48:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:48:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:48:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:48:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:48:05.623 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:48:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:48:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:48:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "76", 2020-10-31T22:48:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:48:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:48:05.624 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:48:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:48:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:48:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:48:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:48:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:48:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:48:05.625 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:48:05.626 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:48:05.626 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:48:05.626 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:48:05.626 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:48:05.626 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:48:05.626 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:48:05.626 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:48:05.627 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:48:05.627 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:48:05.627 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:48:05.627 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:48:05.627 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:48:05.627 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:48:05.627 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:48:05.628 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:48:05.628 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:48:05.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.628 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:48:05.628 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:48:05.628 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:48:05.628 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:48:05.629 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:48:05.629 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:48:05.629 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:48:05.629 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:48:05.629 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:48:05.629 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:48:05.629 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:48:05.629 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:48:05.630 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:48:05.630 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:48:05.630 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2020-10-31T22:48:05.630 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.630 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.630 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.631 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:48:05.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2020-10-31T22:48:05.631 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:48:05.631 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", 2020-10-31T22:48:05.631 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:05.631 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:05.632 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:05.632 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:05.632 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:05.632 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:05.632 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:05.632 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 74, 2020-10-31T22:48:05.632 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:05.633 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:05.633 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:05.633 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.633 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.633 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.633 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2020-10-31T22:48:05.633 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:05.634 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.634 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.634 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.634 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2020-10-31T22:48:05.634 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:05.634 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.634 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.635 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:05.635 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.635 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.635 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.635 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2020-10-31T22:48:05.635 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:05.635 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.636 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.636 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.636 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2020-10-31T22:48:05.636 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:05.636 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.636 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.636 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.637 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:05.637 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.637 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.637 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.637 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2020-10-31T22:48:05.637 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:05.637 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.638 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.638 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.638 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2020-10-31T22:48:05.638 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:05.638 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.638 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.638 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.638 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:05.639 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.639 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.639 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2020-10-31T22:48:05.639 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:05.639 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.639 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.640 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.640 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2020-10-31T22:48:05.640 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:05.640 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.640 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.640 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.640 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6803/14302", 2020-10-31T22:48:05.641 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6805/14302", 2020-10-31T22:48:05.641 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6809/14302", 2020-10-31T22:48:05.641 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6807/14302", 2020-10-31T22:48:05.641 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:05.641 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:05.641 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:05.641 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.641 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.642 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.642 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:48:05.642 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", 2020-10-31T22:48:05.642 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:05.642 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:05.642 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:05.642 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:05.643 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:05.643 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:05.643 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:05.643 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 63, 2020-10-31T22:48:05.643 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:05.643 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:05.643 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:05.644 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.644 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.644 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2020-10-31T22:48:05.644 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:05.644 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.644 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.644 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.645 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2020-10-31T22:48:05.645 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:05.645 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.645 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.645 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.645 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:05.645 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.646 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.646 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2020-10-31T22:48:05.646 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:05.646 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.646 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.646 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.647 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2020-10-31T22:48:05.647 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:05.647 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.647 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.647 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.647 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:05.647 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.648 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.648 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2020-10-31T22:48:05.648 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:05.648 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.648 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.648 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.648 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2020-10-31T22:48:05.649 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:05.649 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.649 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.649 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.649 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:05.649 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.649 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.650 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.650 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2020-10-31T22:48:05.650 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:05.650 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.650 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.650 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.650 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2020-10-31T22:48:05.651 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:05.651 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.651 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.651 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.651 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/14300", 2020-10-31T22:48:05.651 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6813/14300", 2020-10-31T22:48:05.651 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6817/14300", 2020-10-31T22:48:05.651 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6815/14300", 2020-10-31T22:48:05.652 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:05.652 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:05.652 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:05.652 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.652 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.652 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.652 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:48:05.653 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", 2020-10-31T22:48:05.653 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:05.653 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:05.653 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:05.653 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:05.653 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:05.653 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:05.654 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:05.654 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 74, 2020-10-31T22:48:05.654 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:05.654 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:05.654 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:05.654 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.654 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.654 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2020-10-31T22:48:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2020-10-31T22:48:05.655 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:05.656 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.656 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.656 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.656 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:05.656 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.656 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.656 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.657 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2020-10-31T22:48:05.657 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:05.657 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.657 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.657 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.657 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2020-10-31T22:48:05.657 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:05.658 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.658 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.658 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.658 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:05.658 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.658 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.658 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.658 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6832", 2020-10-31T22:48:05.659 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:05.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.659 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.659 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.659 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6833", 2020-10-31T22:48:05.659 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:05.659 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.660 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.660 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.660 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:05.660 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.660 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.660 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.660 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2020-10-31T22:48:05.661 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:05.661 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.661 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.661 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2020-10-31T22:48:05.661 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:05.661 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.662 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.662 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.662 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6827/14318", 2020-10-31T22:48:05.662 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6829/14318", 2020-10-31T22:48:05.662 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6833/14318", 2020-10-31T22:48:05.662 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6831/14318", 2020-10-31T22:48:05.662 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:05.662 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:05.663 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:05.663 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.663 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.663 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:48:05.663 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", 2020-10-31T22:48:05.663 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:05.664 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:05.664 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:05.664 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:05.664 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:05.664 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:05.664 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:05.664 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 74, 2020-10-31T22:48:05.665 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:05.665 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:05.665 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:05.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.665 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.665 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.665 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2020-10-31T22:48:05.665 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:05.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.666 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.666 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.666 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2020-10-31T22:48:05.666 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:05.666 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.666 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.667 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.667 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:05.667 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.667 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.667 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2020-10-31T22:48:05.667 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:05.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.668 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.668 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.668 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2020-10-31T22:48:05.668 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:05.668 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.668 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.668 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.669 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:05.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.669 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.669 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2020-10-31T22:48:05.669 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:05.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.670 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.670 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.670 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2020-10-31T22:48:05.670 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:05.670 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.670 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.670 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.671 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:05.671 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.671 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.671 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2020-10-31T22:48:05.671 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:05.671 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.672 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.672 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2020-10-31T22:48:05.672 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:05.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.672 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.672 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6819/14301", 2020-10-31T22:48:05.673 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6821/14301", 2020-10-31T22:48:05.673 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/14301", 2020-10-31T22:48:05.673 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6823/14301", 2020-10-31T22:48:05.673 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:05.673 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:05.673 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:05.673 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.674 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.674 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.674 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:48:05.674 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", 2020-10-31T22:48:05.674 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:05.674 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:05.674 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:05.675 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:05.675 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:05.675 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:05.675 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:05.675 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 73, 2020-10-31T22:48:05.675 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:05.675 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:05.675 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:05.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.676 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.676 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6816", 2020-10-31T22:48:05.676 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:05.676 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.676 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.677 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.677 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6817", 2020-10-31T22:48:05.677 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:05.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.677 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.677 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:05.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.678 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.678 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6818", 2020-10-31T22:48:05.678 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:05.678 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.679 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.679 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6819", 2020-10-31T22:48:05.679 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:05.679 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.679 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.680 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:05.680 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.680 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.680 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6822", 2020-10-31T22:48:05.680 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:05.681 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.681 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.681 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.681 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6823", 2020-10-31T22:48:05.681 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:05.681 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.681 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.682 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.682 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:05.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.682 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.682 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.682 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6820", 2020-10-31T22:48:05.683 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:05.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.683 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.683 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6821", 2020-10-31T22:48:05.683 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:05.683 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.683 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.684 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6817/14002", 2020-10-31T22:48:05.684 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6819/14002", 2020-10-31T22:48:05.684 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6823/14002", 2020-10-31T22:48:05.684 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6821/14002", 2020-10-31T22:48:05.684 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:05.684 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:05.685 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:05.685 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.685 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:48:05.685 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", 2020-10-31T22:48:05.685 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:05.686 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:05.686 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:05.686 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:05.686 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:05.686 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:05.686 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:05.686 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 74, 2020-10-31T22:48:05.686 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:05.687 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:05.687 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:05.687 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.687 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.687 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6800", 2020-10-31T22:48:05.687 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:05.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.688 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.688 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6801", 2020-10-31T22:48:05.688 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:05.688 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.688 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.689 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:05.689 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.689 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.689 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6802", 2020-10-31T22:48:05.689 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:05.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.690 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.690 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.690 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6803", 2020-10-31T22:48:05.690 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:05.690 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.690 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.690 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.691 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:05.691 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.691 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.691 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6806", 2020-10-31T22:48:05.691 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:05.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.692 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.692 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6807", 2020-10-31T22:48:05.692 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:05.692 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.693 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.693 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:05.693 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.693 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.693 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6804", 2020-10-31T22:48:05.694 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:05.694 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.694 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.694 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.694 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6805", 2020-10-31T22:48:05.694 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:05.694 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.695 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.695 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6801/14001", 2020-10-31T22:48:05.695 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6803/14001", 2020-10-31T22:48:05.695 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6807/14001", 2020-10-31T22:48:05.695 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6805/14001", 2020-10-31T22:48:05.695 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:05.695 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:05.696 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:05.696 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.696 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.696 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.696 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:48:05.696 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", 2020-10-31T22:48:05.696 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:05.697 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:05.697 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:05.697 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:05.697 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:05.697 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:05.697 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:05.697 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 74, 2020-10-31T22:48:05.698 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:05.698 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:05.698 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:05.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.698 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.698 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.698 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6808", 2020-10-31T22:48:05.698 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:05.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.699 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.699 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.699 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6809", 2020-10-31T22:48:05.699 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:05.699 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.699 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.700 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:05.700 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.700 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.700 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6810", 2020-10-31T22:48:05.700 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:05.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.701 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.701 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6811", 2020-10-31T22:48:05.701 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:05.701 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.701 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.701 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.702 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:05.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.702 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.702 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.702 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6814", 2020-10-31T22:48:05.702 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:05.702 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.703 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.703 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.703 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6815", 2020-10-31T22:48:05.703 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:05.703 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.703 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.703 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.704 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:05.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.704 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.704 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6812", 2020-10-31T22:48:05.704 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:05.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.704 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.705 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.705 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6813", 2020-10-31T22:48:05.705 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:05.705 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.705 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.705 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.705 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6809/14003", 2020-10-31T22:48:05.706 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6811/14003", 2020-10-31T22:48:05.706 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6815/14003", 2020-10-31T22:48:05.706 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6813/14003", 2020-10-31T22:48:05.706 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:05.706 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:05.706 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:05.707 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.707 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.707 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.707 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:48:05.707 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", 2020-10-31T22:48:05.707 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:05.707 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:05.707 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:05.708 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:05.708 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:05.708 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:05.708 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:05.708 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 73, 2020-10-31T22:48:05.708 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:05.708 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:05.709 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:05.709 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.709 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.709 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.709 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6824", 2020-10-31T22:48:05.709 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:05.709 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.710 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.710 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.710 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6825", 2020-10-31T22:48:05.710 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:05.710 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.710 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.711 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:05.711 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.711 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.711 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6826", 2020-10-31T22:48:05.711 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:05.711 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.712 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.712 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.712 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6827", 2020-10-31T22:48:05.712 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:05.712 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.712 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.712 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.713 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:05.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.713 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.713 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6830", 2020-10-31T22:48:05.713 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:05.713 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6831", 2020-10-31T22:48:05.714 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:05.714 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.714 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.714 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:05.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:05.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.715 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:05.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6828", 2020-10-31T22:48:05.715 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:05.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.715 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.716 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:05.716 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6829", 2020-10-31T22:48:05.716 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:05.716 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.716 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.716 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.716 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6825/14046", 2020-10-31T22:48:05.717 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6827/14046", 2020-10-31T22:48:05.717 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6831/14046", 2020-10-31T22:48:05.717 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6829/14046", 2020-10-31T22:48:05.717 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:05.717 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:05.717 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:05.717 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:05.717 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.718 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:48:05.718 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2020-10-31T22:48:05.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.718 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:48:05.718 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:05.718 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:05.718 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:05.719 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:05.719 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:05.719 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.314917+0000", 2020-10-31T22:48:05.719 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:05.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.719 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:48:05.720 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:05.720 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:05.720 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:05.720 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:05.720 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:05.720 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.643069+0000", 2020-10-31T22:48:05.720 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:05.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.721 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:48:05.721 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:05.721 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:05.721 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:05.721 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:05.721 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:05.722 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.662572+0000", 2020-10-31T22:48:05.722 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:05.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.722 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:48:05.722 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:05.722 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.664868+0000", 2020-10-31T22:48:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:48:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:05.724 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551107+0000", 2020-10-31T22:48:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:48:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:05.725 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.400568+0000", 2020-10-31T22:48:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:48:05.726 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551173+0000", 2020-10-31T22:48:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:05.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:48:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:05.728 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.604302+0000", 2020-10-31T22:48:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:48:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2020-10-31T22:48:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2020-10-31T22:48:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2020-10-31T22:48:05.729 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2020-10-31T22:48:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: "blacklist": { 2020-10-31T22:48:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: "172.21.15.152:0/2872377370": "2020-10-31T23:47:51.180113+0000" 2020-10-31T22:48:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2020-10-31T22:48:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2020-10-31T22:48:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2020-10-31T22:48:05.730 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2020-10-31T22:48:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2020-10-31T22:48:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2020-10-31T22:48:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: "ruleset-failure-domain": "osd", 2020-10-31T22:48:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2020-10-31T22:48:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:05.731 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2020-10-31T22:48:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2020-10-31T22:48:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2020-10-31T22:48:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2020-10-31T22:48:05.732 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {} 2020-10-31T22:48:05.732 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:48:05.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.573+0000 7fda56f51700 1 -- 172.21.15.60:0/2805589224 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fda300550c0 msgr2=0x7fda30057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:05.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.573+0000 7fda56f51700 1 --2- 172.21.15.60:0/2805589224 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fda300550c0 0x7fda30057580 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fda4800b000 tx=0x7fda480091a0).stop 2020-10-31T22:48:05.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.573+0000 7fda56f51700 1 -- 172.21.15.60:0/2805589224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda501527f0 msgr2=0x7fda50145320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:05.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.573+0000 7fda56f51700 1 --2- 172.21.15.60:0/2805589224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda501527f0 0x7fda50145320 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 rx=0x7fda440010d0 tx=0x7fda44016000).stop 2020-10-31T22:48:05.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.573+0000 7fda56f51700 1 -- 172.21.15.60:0/2805589224 shutdown_connections 2020-10-31T22:48:05.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.573+0000 7fda56f51700 1 --2- 172.21.15.60:0/2805589224 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fda300550c0 0x7fda30057580 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.573+0000 7fda56f51700 1 --2- 172.21.15.60:0/2805589224 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda50145810 0x7fda500b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.573+0000 7fda56f51700 1 --2- 172.21.15.60:0/2805589224 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5013eb60 0x7fda5014e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.573+0000 7fda56f51700 1 --2- 172.21.15.60:0/2805589224 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fda501527f0 0x7fda50145320 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.573+0000 7fda56f51700 1 -- 172.21.15.60:0/2805589224 >> 172.21.15.60:0/2805589224 conn(0x7fda500b61d0 msgr2=0x7fda500b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:05.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.573+0000 7fda56f51700 1 -- 172.21.15.60:0/2805589224 shutdown_connections 2020-10-31T22:48:05.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.577+0000 7fda56f51700 1 -- 172.21.15.60:0/2805589224 wait complete. 2020-10-31T22:48:05.736 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:05.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.849+0000 7efefbfff700 1 Processor -- start 2020-10-31T22:48:05.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.849+0000 7efefbfff700 1 -- start start 2020-10-31T22:48:05.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.849+0000 7efefbfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efefc0ac870 0x7efefc0b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:05.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.849+0000 7efefbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efefc0b0e20 0x7efefc0ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:05.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.849+0000 7efefbfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efefc0acc50 con 0x7efefc0ae690 2020-10-31T22:48:05.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.849+0000 7efefbfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efefc0b14c0 con 0x7efefc0b0e20 2020-10-31T22:48:05.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.849+0000 7efefbfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efefc0b5690 con 0x7efefc0ac870 2020-10-31T22:48:05.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efef3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efefc0b0e20 0x7efefc0ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:05.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efef3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efefc0b0e20 0x7efefc0ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45842/0 (socket says 172.21.15.60:45842) 2020-10-31T22:48:05.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efef3fff700 1 -- 172.21.15.60:0/4022513445 learned_addr learned my addr 172.21.15.60:0/4022513445 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:05.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefaffd700 1 --2- 172.21.15.60:0/4022513445 >> v2:172.21.15.66:3300/0 conn(0x7efefc0ac870 0x7efefc0b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:05.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efef3fff700 1 -- 172.21.15.60:0/4022513445 >> v2:172.21.15.66:3300/0 conn(0x7efefc0ac870 msgr2=0x7efefc0b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:05.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efef3fff700 1 --2- 172.21.15.60:0/4022513445 >> v2:172.21.15.66:3300/0 conn(0x7efefc0ac870 0x7efefc0b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efef3fff700 1 -- 172.21.15.60:0/4022513445 >> v1:172.21.15.60:6789/0 conn(0x7efefc0ae690 legacy=0x7efefc1412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:05.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefa7fc700 1 -- 172.21.15.60:0/4022513445 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557660331 0 0) 0x7efefc0acc50 con 0x7efefc0ae690 2020-10-31T22:48:05.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efef3fff700 1 -- 172.21.15.60:0/4022513445 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc0afc10 con 0x7efefc0b0e20 2020-10-31T22:48:05.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efef3fff700 1 --2- 172.21.15.60:0/4022513445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efefc0b0e20 0x7efefc0ae1a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7efeec002f30 tx=0x7efeec006e80).ready entity=mon.0 client_cookie=4870645973d81f46 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:05.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefa7fc700 1 -- 172.21.15.60:0/4022513445 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeec009880 con 0x7efefc0b0e20 2020-10-31T22:48:05.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefa7fc700 1 -- 172.21.15.60:0/4022513445 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec0099e0 con 0x7efefc0b0e20 2020-10-31T22:48:05.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefa7fc700 1 -- 172.21.15.60:0/4022513445 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeec009d40 con 0x7efefc0b0e20 2020-10-31T22:48:05.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefbfff700 1 -- 172.21.15.60:0/4022513445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efefc0b0e20 msgr2=0x7efefc0ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:05.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefbfff700 1 --2- 172.21.15.60:0/4022513445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efefc0b0e20 0x7efefc0ae1a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 rx=0x7efeec002f30 tx=0x7efeec006e80).stop 2020-10-31T22:48:05.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefbfff700 1 -- 172.21.15.60:0/4022513445 shutdown_connections 2020-10-31T22:48:05.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefbfff700 1 --2- 172.21.15.60:0/4022513445 >> v2:172.21.15.66:3300/0 conn(0x7efefc0ac870 0x7efefc0b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefbfff700 1 --2- 172.21.15.60:0/4022513445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efefc0b0e20 0x7efefc0ae1a0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefbfff700 1 -- 172.21.15.60:0/4022513445 >> 172.21.15.60:0/4022513445 conn(0x7efefc06a600 msgr2=0x7efefc060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:05.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefbfff700 1 -- 172.21.15.60:0/4022513445 shutdown_connections 2020-10-31T22:48:05.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefbfff700 1 -- 172.21.15.60:0/4022513445 wait complete. 2020-10-31T22:48:05.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefbfff700 1 Processor -- start 2020-10-31T22:48:05.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.853+0000 7efefbfff700 1 -- start start 2020-10-31T22:48:05.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efefbfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efefc0ac870 0x7efefc143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:05.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efefbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efefc0ae690 0x7efefc065ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:05.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efefbfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc0b0e20 0x7efefc065fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:05.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efefbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc09f180 con 0x7efefc0ae690 2020-10-31T22:48:05.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efefbfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc14c6f0 con 0x7efefc0b0e20 2020-10-31T22:48:05.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efefbfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efefc14c990 con 0x7efefc0ac870 2020-10-31T22:48:05.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efef3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efefc0ae690 0x7efefc065ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:05.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efef3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efefc0ae690 0x7efefc065ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45846/0 (socket says 172.21.15.60:45846) 2020-10-31T22:48:05.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efef3fff700 1 -- 172.21.15.60:0/711718015 learned_addr learned my addr 172.21.15.60:0/711718015 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:05.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efefaffd700 1 --2- 172.21.15.60:0/711718015 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efefc0ac870 0x7efefc143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:05.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efefb7fe700 1 --2- 172.21.15.60:0/711718015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc0b0e20 0x7efefc065fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:05.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efef3fff700 1 -- 172.21.15.60:0/711718015 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efefc0ac870 msgr2=0x7efefc143c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:05.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efef3fff700 1 --2- 172.21.15.60:0/711718015 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efefc0ac870 0x7efefc143c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efef3fff700 1 -- 172.21.15.60:0/711718015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc0b0e20 msgr2=0x7efefc065fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:05.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efef3fff700 1 --2- 172.21.15.60:0/711718015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc0b0e20 0x7efefc065fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:05.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efef3fff700 1 -- 172.21.15.60:0/711718015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc14cc30 con 0x7efefc0ae690 2020-10-31T22:48:05.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efef3fff700 1 --2- 172.21.15.60:0/711718015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efefc0ae690 0x7efefc065ac0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7efeec002f30 tx=0x7efeec015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:05.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efef8ff9700 1 -- 172.21.15.60:0/711718015 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeec011d70 con 0x7efefc0ae690 2020-10-31T22:48:05.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efef8ff9700 1 -- 172.21.15.60:0/711718015 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec01e460 con 0x7efefc0ae690 2020-10-31T22:48:05.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efefbfff700 1 -- 172.21.15.60:0/711718015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efefc14c3e0 con 0x7efefc0ae690 2020-10-31T22:48:05.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efef8ff9700 1 -- 172.21.15.60:0/711718015 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efeec01e7c0 con 0x7efefc0ae690 2020-10-31T22:48:05.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.857+0000 7efefbfff700 1 -- 172.21.15.60:0/711718015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efefc144100 con 0x7efefc0ae690 2020-10-31T22:48:05.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.861+0000 7efef8ff9700 1 -- 172.21.15.60:0/711718015 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7efeec025030 con 0x7efefc0ae690 2020-10-31T22:48:05.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.861+0000 7efefbfff700 1 -- 172.21.15.60:0/711718015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efefc14cdc0 con 0x7efefc0ae690 2020-10-31T22:48:05.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.861+0000 7efef8ff9700 1 --2- 172.21.15.60:0/711718015 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efed4055020 0x7efed40574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:05.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.861+0000 7efef8ff9700 1 -- 172.21.15.60:0/711718015 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6116+0+0 (secure 0 0 0) 0x7efeec06ef30 con 0x7efefc0ae690 2020-10-31T22:48:05.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.861+0000 7efefaffd700 1 --2- 172.21.15.60:0/711718015 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efed4055020 0x7efed40574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:05.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.861+0000 7efefaffd700 1 --2- 172.21.15.60:0/711718015 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efed4055020 0x7efed40574e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7efee400c000 tx=0x7efee4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:05.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:05.865+0000 7efef8ff9700 1 -- 172.21.15.60:0/711718015 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7efeec045420 con 0x7efefc0ae690 2020-10-31T22:48:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.057+0000 7efefbfff700 1 -- 172.21.15.60:0/711718015 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efefc057100 con 0x7efefc0ae690 2020-10-31T22:48:06.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.057+0000 7efef8ff9700 1 -- 172.21.15.60:0/711718015 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+2487 (secure 0 0 0) 0x7efeec06c9d0 con 0x7efefc0ae690 2020-10-31T22:48:06.065 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:06.065 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":35,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/290520151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":290520151},{"type":"v1","addr":"172.21.15.66:6833","nonce":290520151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1731313860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1731313860},{"type":"v1","addr":"172.21.15.60:6835","nonce":1731313860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:47:06.422241+0000","modified":"2020-10-31T22:47:08.068754+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6174},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6174":{"gid":6174,"name":"a","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/265867667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":265867667},{"type":"v1","addr":"172.21.15.60:6837","nonce":265867667}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-10-31T22:48:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.061+0000 7efefbfff700 1 -- 172.21.15.60:0/711718015 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efed4055020 msgr2=0x7efed40574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.061+0000 7efefbfff700 1 --2- 172.21.15.60:0/711718015 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efed4055020 0x7efed40574e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7efee400c000 tx=0x7efee4008040).stop 2020-10-31T22:48:06.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.061+0000 7efefbfff700 1 -- 172.21.15.60:0/711718015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efefc0ae690 msgr2=0x7efefc065ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:06.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.061+0000 7efefbfff700 1 --2- 172.21.15.60:0/711718015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efefc0ae690 0x7efefc065ac0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 rx=0x7efeec002f30 tx=0x7efeec015000).stop 2020-10-31T22:48:06.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.061+0000 7efefbfff700 1 -- 172.21.15.60:0/711718015 shutdown_connections 2020-10-31T22:48:06.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.061+0000 7efefbfff700 1 --2- 172.21.15.60:0/711718015 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efed4055020 0x7efed40574e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.061+0000 7efefbfff700 1 --2- 172.21.15.60:0/711718015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efefc0b0e20 0x7efefc065fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.061+0000 7efefbfff700 1 --2- 172.21.15.60:0/711718015 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efefc0ac870 0x7efefc143c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.061+0000 7efefbfff700 1 --2- 172.21.15.60:0/711718015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efefc0ae690 0x7efefc065ac0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.061+0000 7efefbfff700 1 -- 172.21.15.60:0/711718015 >> 172.21.15.60:0/711718015 conn(0x7efefc06a600 msgr2=0x7efefc0aaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:06.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.061+0000 7efefbfff700 1 -- 172.21.15.60:0/711718015 shutdown_connections 2020-10-31T22:48:06.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.061+0000 7efefbfff700 1 -- 172.21.15.60:0/711718015 wait complete. 2020-10-31T22:48:06.072 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 35 2020-10-31T22:48:06.079 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-10-31T22:48:06.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.189+0000 7f7f1725b700 1 Processor -- start 2020-10-31T22:48:06.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.189+0000 7f7f1725b700 1 -- start start 2020-10-31T22:48:06.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.189+0000 7f7f1725b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f100b1a10 0x7f7f10142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:06.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.189+0000 7f7f1725b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7f1013ebe0 0x7f7f100b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:06.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f100abea0 con 0x7f7f100af200 2020-10-31T22:48:06.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1006a970 con 0x7f7f1013ebe0 2020-10-31T22:48:06.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10141870 con 0x7f7f100b1a10 2020-10-31T22:48:06.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f15a58700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7f1013ebe0 0x7f7f100b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:06.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f16a5a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7f100af200 0x7f7f1006a260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:49994/0 (socket says 172.21.15.60:49994) 2020-10-31T22:48:06.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f16a5a700 1 -- 172.21.15.60:0/3814265885 learned_addr learned my addr 172.21.15.60:0/3814265885 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:06.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f16259700 1 --2- 172.21.15.60:0/3814265885 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f100b1a10 0x7f7f10142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:06.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f15a58700 1 -- 172.21.15.60:0/3814265885 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f100b1a10 msgr2=0x7f7f10142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:06.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f15a58700 1 --2- 172.21.15.60:0/3814265885 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f100b1a10 0x7f7f10142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f15a58700 1 -- 172.21.15.60:0/3814265885 >> v1:172.21.15.60:6789/0 conn(0x7f7f100af200 legacy=0x7f7f1006a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:06.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f15a58700 1 -- 172.21.15.60:0/3814265885 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f10141b10 con 0x7f7f1013ebe0 2020-10-31T22:48:06.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f16259700 1 --2- 172.21.15.60:0/3814265885 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f100b1a10 0x7f7f10142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:06.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f15a58700 1 --2- 172.21.15.60:0/3814265885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f1013ebe0 0x7f7f100b1df0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f7f00002f30 tx=0x7f7f00006dc0).ready entity=mon.0 client_cookie=c226f33b0dbcd7b2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:06.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f15257700 1 -- 172.21.15.60:0/3814265885 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f000097f0 con 0x7f7f1013ebe0 2020-10-31T22:48:06.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f15257700 1 -- 172.21.15.60:0/3814265885 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f00009950 con 0x7f7f1013ebe0 2020-10-31T22:48:06.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f15257700 1 -- 172.21.15.60:0/3814265885 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f00009cb0 con 0x7f7f1013ebe0 2020-10-31T22:48:06.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 -- 172.21.15.60:0/3814265885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f1013ebe0 msgr2=0x7f7f100b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:06.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 --2- 172.21.15.60:0/3814265885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f1013ebe0 0x7f7f100b1df0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 rx=0x7f7f00002f30 tx=0x7f7f00006dc0).stop 2020-10-31T22:48:06.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 -- 172.21.15.60:0/3814265885 shutdown_connections 2020-10-31T22:48:06.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 --2- 172.21.15.60:0/3814265885 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f100b1a10 0x7f7f10142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 --2- 172.21.15.60:0/3814265885 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f1013ebe0 0x7f7f100b1df0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 -- 172.21.15.60:0/3814265885 >> 172.21.15.60:0/3814265885 conn(0x7f7f100b5300 msgr2=0x7f7f100b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:06.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 -- 172.21.15.60:0/3814265885 shutdown_connections 2020-10-31T22:48:06.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 -- 172.21.15.60:0/3814265885 wait complete. 2020-10-31T22:48:06.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 Processor -- start 2020-10-31T22:48:06.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 -- start start 2020-10-31T22:48:06.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f100af200 0x7f7f10131890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:06.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f100b1a10 0x7f7f1013cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:06.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f1013ebe0 0x7f7f1013ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:06.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10064320 con 0x7f7f100af200 2020-10-31T22:48:06.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f100645c0 con 0x7f7f100b1a10 2020-10-31T22:48:06.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f1725b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f10064860 con 0x7f7f1013ebe0 2020-10-31T22:48:06.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f16259700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f100af200 0x7f7f10131890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:06.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f16259700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f100af200 0x7f7f10131890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45860/0 (socket says 172.21.15.60:45860) 2020-10-31T22:48:06.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f16259700 1 -- 172.21.15.60:0/4109695072 learned_addr learned my addr 172.21.15.60:0/4109695072 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:06.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f16a5a700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f1013ebe0 0x7f7f1013ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:06.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.193+0000 7f7f15a58700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f100b1a10 0x7f7f1013cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:06.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7f16259700 1 -- 172.21.15.60:0/4109695072 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f1013ebe0 msgr2=0x7f7f1013ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:06.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7f16259700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f1013ebe0 0x7f7f1013ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7f16259700 1 -- 172.21.15.60:0/4109695072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f100b1a10 msgr2=0x7f7f1013cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:06.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7f16259700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f100b1a10 0x7f7f1013cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7f16259700 1 -- 172.21.15.60:0/4109695072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f10064b00 con 0x7f7f100af200 2020-10-31T22:48:06.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7f15a58700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f100b1a10 0x7f7f1013cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:06.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7f16259700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f100af200 0x7f7f10131890 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f7f0c007000 tx=0x7f7f0c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:06.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7eff7fe700 1 -- 172.21.15.60:0/4109695072 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f0c00ce90 con 0x7f7f100af200 2020-10-31T22:48:06.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7eff7fe700 1 -- 172.21.15.60:0/4109695072 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c007750 con 0x7f7f100af200 2020-10-31T22:48:06.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7f1725b700 1 -- 172.21.15.60:0/4109695072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f10131d80 con 0x7f7f100af200 2020-10-31T22:48:06.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7eff7fe700 1 -- 172.21.15.60:0/4109695072 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7f0c007ab0 con 0x7f7f100af200 2020-10-31T22:48:06.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7f1725b700 1 -- 172.21.15.60:0/4109695072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f100ab430 con 0x7f7f100af200 2020-10-31T22:48:06.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7f1725b700 1 -- 172.21.15.60:0/4109695072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f10064c90 con 0x7f7f100af200 2020-10-31T22:48:06.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7eff7fe700 1 -- 172.21.15.60:0/4109695072 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7f0c007c10 con 0x7f7f100af200 2020-10-31T22:48:06.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7eff7fe700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ef0055020 0x7f7ef00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:06.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7f15a58700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ef0055020 0x7f7ef00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.197+0000 7f7eff7fe700 1 -- 172.21.15.60:0/4109695072 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6116+0+0 (secure 0 0 0) 0x7f7f0c06dd90 con 0x7f7f100af200 2020-10-31T22:48:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.201+0000 7f7f15a58700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ef0055020 0x7f7ef00574e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f7f00019000 tx=0x7f7f00015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:06.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.205+0000 7f7eff7fe700 1 -- 172.21.15.60:0/4109695072 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7f0c044110 con 0x7f7f100af200 2020-10-31T22:48:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.389+0000 7f7f1725b700 1 -- 172.21.15.60:0/4109695072 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7f10057100 con 0x7f7f100af200 2020-10-31T22:48:06.823 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:48:06.821+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:48:06.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.825+0000 7f7eff7fe700 1 -- 172.21.15.60:0/4109695072 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7f0c069e60 con 0x7f7f100af200 2020-10-31T22:48:06.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.825+0000 7f7f1725b700 1 -- 172.21.15.60:0/4109695072 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ef0055020 msgr2=0x7f7ef00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:06.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.825+0000 7f7f1725b700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ef0055020 0x7f7ef00574e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f7f00019000 tx=0x7f7f00015000).stop 2020-10-31T22:48:06.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.825+0000 7f7f1725b700 1 -- 172.21.15.60:0/4109695072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f100af200 msgr2=0x7f7f10131890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:06.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.825+0000 7f7f1725b700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f100af200 0x7f7f10131890 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 rx=0x7f7f0c007000 tx=0x7f7f0c008040).stop 2020-10-31T22:48:06.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.829+0000 7f7f1725b700 1 -- 172.21.15.60:0/4109695072 shutdown_connections 2020-10-31T22:48:06.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.829+0000 7f7f1725b700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7f1013ebe0 0x7f7f1013ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.829+0000 7f7f1725b700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7f100af200 0x7f7f10131890 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.829+0000 7f7f1725b700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7ef0055020 0x7f7ef00574e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.829+0000 7f7f1725b700 1 --2- 172.21.15.60:0/4109695072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7f100b1a10 0x7f7f1013cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.829+0000 7f7f1725b700 1 -- 172.21.15.60:0/4109695072 >> 172.21.15.60:0/4109695072 conn(0x7f7f100b5300 msgr2=0x7f7f100b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:06.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.829+0000 7f7f1725b700 1 -- 172.21.15.60:0/4109695072 shutdown_connections 2020-10-31T22:48:06.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.829+0000 7f7f1725b700 1 -- 172.21.15.60:0/4109695072 wait complete. 2020-10-31T22:48:06.837 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-10-31T22:48:06.850 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:06.860 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:48:06.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606f3d3700 1 Processor -- start 2020-10-31T22:48:06.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606f3d3700 1 -- start start 2020-10-31T22:48:06.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606f3d3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f606813f3d0 0x7f606805c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:06.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606f3d3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f60680ae630 0x7f60680b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:06.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606f3d3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f606805c800 con 0x7f60680b1bb0 2020-10-31T22:48:06.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606f3d3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60680adc50 con 0x7f60680ae630 2020-10-31T22:48:06.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606e3d1700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f60680b1bb0 0x7f606813ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50016/0 (socket says 172.21.15.60:50016) 2020-10-31T22:48:06.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606e3d1700 1 -- 172.21.15.60:0/2326614846 learned_addr learned my addr 172.21.15.60:0/2326614846 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:06.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606f3d3700 1 -- 172.21.15.60:0/2326614846 --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60680adef0 con 0x7f606813f3d0 2020-10-31T22:48:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606ebd2700 1 --2- 172.21.15.60:0/2326614846 >> v2:172.21.15.60:3300/0 conn(0x7f60680ae630 0x7f60680b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606dbd0700 1 --2- 172.21.15.60:0/2326614846 >> v2:172.21.15.66:3300/0 conn(0x7f606813f3d0 0x7f606805c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606d3cf700 1 -- 172.21.15.60:0/2326614846 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3694725372 0 0) 0x7f606805c800 con 0x7f60680b1bb0 2020-10-31T22:48:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606d3cf700 1 -- 172.21.15.60:0/2326614846 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6050003230 con 0x7f60680b1bb0 2020-10-31T22:48:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606ebd2700 1 -- 172.21.15.60:0/2326614846 >> v2:172.21.15.66:3300/0 conn(0x7f606813f3d0 msgr2=0x7f606805c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:06.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606ebd2700 1 --2- 172.21.15.60:0/2326614846 >> v2:172.21.15.66:3300/0 conn(0x7f606813f3d0 0x7f606805c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606ebd2700 1 -- 172.21.15.60:0/2326614846 >> v1:172.21.15.60:6789/0 conn(0x7f60680b1bb0 legacy=0x7f606813ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:06.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606ebd2700 1 -- 172.21.15.60:0/2326614846 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60680ae190 con 0x7f60680ae630 2020-10-31T22:48:06.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606ebd2700 1 --2- 172.21.15.60:0/2326614846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680ae630 0x7f60680b0210 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f60600032b0 tx=0x7f60600091a0).ready entity=mon.0 client_cookie=c334fb7e0a058525 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:06.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606d3cf700 1 -- 172.21.15.60:0/2326614846 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f606000b9a0 con 0x7f60680ae630 2020-10-31T22:48:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606d3cf700 1 -- 172.21.15.60:0/2326614846 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606000bb00 con 0x7f60680ae630 2020-10-31T22:48:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606d3cf700 1 -- 172.21.15.60:0/2326614846 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f606000bc70 con 0x7f60680ae630 2020-10-31T22:48:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606f3d3700 1 -- 172.21.15.60:0/2326614846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680ae630 msgr2=0x7f60680b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:06.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.949+0000 7f606f3d3700 1 --2- 172.21.15.60:0/2326614846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680ae630 0x7f60680b0210 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 rx=0x7f60600032b0 tx=0x7f60600091a0).stop 2020-10-31T22:48:06.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606f3d3700 1 -- 172.21.15.60:0/2326614846 shutdown_connections 2020-10-31T22:48:06.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606f3d3700 1 --2- 172.21.15.60:0/2326614846 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680ae630 0x7f60680b0210 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606f3d3700 1 --2- 172.21.15.60:0/2326614846 >> v2:172.21.15.66:3300/0 conn(0x7f606813f3d0 0x7f606805c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606f3d3700 1 -- 172.21.15.60:0/2326614846 >> 172.21.15.60:0/2326614846 conn(0x7f60680b5300 msgr2=0x7f60680b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606f3d3700 1 -- 172.21.15.60:0/2326614846 shutdown_connections 2020-10-31T22:48:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606f3d3700 1 -- 172.21.15.60:0/2326614846 wait complete. 2020-10-31T22:48:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606f3d3700 1 Processor -- start 2020-10-31T22:48:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606f3d3700 1 -- start start 2020-10-31T22:48:06.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606f3d3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680b1bb0 0x7f6068140a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606f3d3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f606813f3d0 0x7f606813a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606f3d3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6068142490 0x7f6068142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606f3d3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60681419b0 con 0x7f60680b1bb0 2020-10-31T22:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606f3d3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6068145dd0 con 0x7f606813f3d0 2020-10-31T22:48:06.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606f3d3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6068145270 con 0x7f6068142490 2020-10-31T22:48:06.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.953+0000 7f606e3d1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680b1bb0 0x7f6068140a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:06.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f606e3d1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680b1bb0 0x7f6068140a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45886/0 (socket says 172.21.15.60:45886) 2020-10-31T22:48:06.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f606e3d1700 1 -- 172.21.15.60:0/1674015894 learned_addr learned my addr 172.21.15.60:0/1674015894 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:06.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f606dbd0700 1 --2- 172.21.15.60:0/1674015894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f606813f3d0 0x7f606813a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:06.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f606ebd2700 1 --2- 172.21.15.60:0/1674015894 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6068142490 0x7f6068142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:06.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f606e3d1700 1 -- 172.21.15.60:0/1674015894 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6068142490 msgr2=0x7f6068142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:06.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f606e3d1700 1 --2- 172.21.15.60:0/1674015894 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6068142490 0x7f6068142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f606e3d1700 1 -- 172.21.15.60:0/1674015894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f606813f3d0 msgr2=0x7f606813a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:06.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f606e3d1700 1 --2- 172.21.15.60:0/1674015894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f606813f3d0 0x7f606813a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:06.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f606e3d1700 1 -- 172.21.15.60:0/1674015894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6068146000 con 0x7f60680b1bb0 2020-10-31T22:48:06.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f606e3d1700 1 --2- 172.21.15.60:0/1674015894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680b1bb0 0x7f6068140a10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f60640010d0 tx=0x7f6064007a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:06.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f60577fe700 1 -- 172.21.15.60:0/1674015894 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60640072e0 con 0x7f60680b1bb0 2020-10-31T22:48:06.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f60577fe700 1 -- 172.21.15.60:0/1674015894 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6064007440 con 0x7f60680b1bb0 2020-10-31T22:48:06.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f606f3d3700 1 -- 172.21.15.60:0/1674015894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60681462a0 con 0x7f60680b1bb0 2020-10-31T22:48:06.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f60577fe700 1 -- 172.21.15.60:0/1674015894 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60640057d0 con 0x7f60680b1bb0 2020-10-31T22:48:06.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f606f3d3700 1 -- 172.21.15.60:0/1674015894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6068144e40 con 0x7f60680b1bb0 2020-10-31T22:48:06.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f606f3d3700 1 -- 172.21.15.60:0/1674015894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6068057100 con 0x7f60680b1bb0 2020-10-31T22:48:06.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f60577fe700 1 -- 172.21.15.60:0/1674015894 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f606401a060 con 0x7f60680b1bb0 2020-10-31T22:48:06.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f60577fe700 1 --2- 172.21.15.60:0/1674015894 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6048054f90 0x7f6048057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:06.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f60577fe700 1 -- 172.21.15.60:0/1674015894 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f606406ce10 con 0x7f60680b1bb0 2020-10-31T22:48:06.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.957+0000 7f606dbd0700 1 --2- 172.21.15.60:0/1674015894 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6048054f90 0x7f6048057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:06.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.961+0000 7f606dbd0700 1 --2- 172.21.15.60:0/1674015894 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6048054f90 0x7f6048057450 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f605800c000 tx=0x7f6058008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:06.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:06.965+0000 7f60577fe700 1 -- 172.21.15.60:0/1674015894 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f60640432b0 con 0x7f60680b1bb0 2020-10-31T22:48:07.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.149+0000 7f606f3d3700 1 -- 172.21.15.60:0/1674015894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60680b10e0 con 0x7f60680b1bb0 2020-10-31T22:48:07.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.153+0000 7f60577fe700 1 -- 172.21.15.60:0/1674015894 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+2129 (secure 0 0 0) 0x7f6064018070 con 0x7f60680b1bb0 2020-10-31T22:48:07.159 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:07.159 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":36,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/290520151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":290520151},{"type":"v1","addr":"172.21.15.66:6833","nonce":290520151}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1731313860","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1731313860},{"type":"v1","addr":"172.21.15.60:6835","nonce":1731313860}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:47:06.422241+0000","modified":"2020-10-31T22:48:06.822533+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[14],"metadata_pool":13,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2020-10-31T22:48:07.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.153+0000 7f606f3d3700 1 -- 172.21.15.60:0/1674015894 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6048054f90 msgr2=0x7f6048057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:07.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.153+0000 7f606f3d3700 1 --2- 172.21.15.60:0/1674015894 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6048054f90 0x7f6048057450 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f605800c000 tx=0x7f6058008040).stop 2020-10-31T22:48:07.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.153+0000 7f606f3d3700 1 -- 172.21.15.60:0/1674015894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680b1bb0 msgr2=0x7f6068140a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:07.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.153+0000 7f606f3d3700 1 --2- 172.21.15.60:0/1674015894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680b1bb0 0x7f6068140a10 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 rx=0x7f60640010d0 tx=0x7f6064007a10).stop 2020-10-31T22:48:07.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.153+0000 7f606f3d3700 1 -- 172.21.15.60:0/1674015894 shutdown_connections 2020-10-31T22:48:07.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.153+0000 7f606f3d3700 1 --2- 172.21.15.60:0/1674015894 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6068142490 0x7f6068142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:07.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.153+0000 7f606f3d3700 1 --2- 172.21.15.60:0/1674015894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60680b1bb0 0x7f6068140a10 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:07.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.153+0000 7f606f3d3700 1 --2- 172.21.15.60:0/1674015894 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6048054f90 0x7f6048057450 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:07.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.153+0000 7f606f3d3700 1 --2- 172.21.15.60:0/1674015894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f606813f3d0 0x7f606813a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:07.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.153+0000 7f606f3d3700 1 -- 172.21.15.60:0/1674015894 >> 172.21.15.60:0/1674015894 conn(0x7f60680b5300 msgr2=0x7f606813ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:07.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.153+0000 7f606f3d3700 1 -- 172.21.15.60:0/1674015894 shutdown_connections 2020-10-31T22:48:07.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.153+0000 7f606f3d3700 1 -- 172.21.15.60:0/1674015894 wait complete. 2020-10-31T22:48:07.165 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 36 2020-10-31T22:48:07.173 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:48:07.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.325+0000 7f329d25c700 1 Processor -- start 2020-10-31T22:48:07.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329d25c700 1 -- start start 2020-10-31T22:48:07.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329d25c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b52a0 0x7f329814a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:07.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329d25c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f32980b0e50 0x7f3298146120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:07.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329d25c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32981496f0 con 0x7f329813f870 2020-10-31T22:48:07.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329d25c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329805ca50 con 0x7f32980b0e50 2020-10-31T22:48:07.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329d25c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3298149920 con 0x7f32980b52a0 2020-10-31T22:48:07.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329759e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f329813f870 0x7f329813fd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50032/0 (socket says 172.21.15.60:50032) 2020-10-31T22:48:07.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329759e700 1 -- 172.21.15.60:0/3539013351 learned_addr learned my addr 172.21.15.60:0/3539013351 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:07.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329659c700 1 --2- 172.21.15.60:0/3539013351 >> v2:172.21.15.66:3300/0 conn(0x7f32980b0e50 0x7f3298146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:07.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f3296d9d700 1 --2- 172.21.15.60:0/3539013351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b52a0 0x7f329814a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:07.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f3295d9b700 1 -- 172.21.15.60:0/3539013351 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048601201 0 0) 0x7f32981496f0 con 0x7f329813f870 2020-10-31T22:48:07.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f3295d9b700 1 -- 172.21.15.60:0/3539013351 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f327c003230 con 0x7f329813f870 2020-10-31T22:48:07.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f3295d9b700 1 -- 172.21.15.60:0/3539013351 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2349014270 0 0) 0x7f327c003230 con 0x7f329813f870 2020-10-31T22:48:07.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329659c700 1 -- 172.21.15.60:0/3539013351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b52a0 msgr2=0x7f329814a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:07.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329659c700 1 --2- 172.21.15.60:0/3539013351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b52a0 0x7f329814a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:07.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329659c700 1 -- 172.21.15.60:0/3539013351 >> v1:172.21.15.60:6789/0 conn(0x7f329813f870 legacy=0x7f329813fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:07.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329659c700 1 -- 172.21.15.60:0/3539013351 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3298149bc0 con 0x7f32980b0e50 2020-10-31T22:48:07.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329659c700 1 --2- 172.21.15.60:0/3539013351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32980b0e50 0x7f3298146120 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f3290001bf0 tx=0x7f328c006dc0).ready entity=mon.1 client_cookie=39434ff87f62055e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:07.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f3295d9b700 1 -- 172.21.15.60:0/3539013351 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3290001a50 con 0x7f32980b0e50 2020-10-31T22:48:07.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f3295d9b700 1 -- 172.21.15.60:0/3539013351 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c009580 con 0x7f32980b0e50 2020-10-31T22:48:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f3295d9b700 1 -- 172.21.15.60:0/3539013351 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f328c0096f0 con 0x7f32980b0e50 2020-10-31T22:48:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329d25c700 1 -- 172.21.15.60:0/3539013351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32980b0e50 msgr2=0x7f3298146120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329d25c700 1 --2- 172.21.15.60:0/3539013351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32980b0e50 0x7f3298146120 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f3290001bf0 tx=0x7f328c006dc0).stop 2020-10-31T22:48:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329d25c700 1 -- 172.21.15.60:0/3539013351 shutdown_connections 2020-10-31T22:48:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329d25c700 1 --2- 172.21.15.60:0/3539013351 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b52a0 0x7f329814a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:07.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329d25c700 1 --2- 172.21.15.60:0/3539013351 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32980b0e50 0x7f3298146120 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:07.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329d25c700 1 -- 172.21.15.60:0/3539013351 >> 172.21.15.60:0/3539013351 conn(0x7f3298060c10 msgr2=0x7f32980b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:07.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329d25c700 1 -- 172.21.15.60:0/3539013351 shutdown_connections 2020-10-31T22:48:07.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.329+0000 7f329d25c700 1 -- 172.21.15.60:0/3539013351 wait complete. 2020-10-31T22:48:07.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f329d25c700 1 Processor -- start 2020-10-31T22:48:07.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f329d25c700 1 -- start start 2020-10-31T22:48:07.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f329d25c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0e50 0x7f32980633e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:07.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f329d25c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b52a0 0x7f3298155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:07.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f329d25c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f329813f870 0x7f3298155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:07.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f329d25c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329813bc00 con 0x7f32980b0e50 2020-10-31T22:48:07.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f329d25c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3298146600 con 0x7f329813f870 2020-10-31T22:48:07.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f329d25c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32981468a0 con 0x7f32980b52a0 2020-10-31T22:48:07.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f3296d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0e50 0x7f32980633e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:07.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f3296d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0e50 0x7f32980633e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45898/0 (socket says 172.21.15.60:45898) 2020-10-31T22:48:07.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f3296d9d700 1 -- 172.21.15.60:0/2293648366 learned_addr learned my addr 172.21.15.60:0/2293648366 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:07.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f329659c700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b52a0 0x7f3298155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:07.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f3296d9d700 1 -- 172.21.15.60:0/2293648366 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b52a0 msgr2=0x7f3298155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:07.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f3296d9d700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b52a0 0x7f3298155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:07.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f3296d9d700 1 -- 172.21.15.60:0/2293648366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f329813f870 msgr2=0x7f3298155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:07.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f329759e700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f329813f870 0x7f3298155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:07.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f3296d9d700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f329813f870 0x7f3298155900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:07.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f3296d9d700 1 -- 172.21.15.60:0/2293648366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3298146b40 con 0x7f32980b0e50 2020-10-31T22:48:07.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f329759e700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f329813f870 0x7f3298155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:07.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.333+0000 7f3296d9d700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0e50 0x7f32980633e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f328800c000 tx=0x7f3288006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:07.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.337+0000 7f3287fff700 1 -- 172.21.15.60:0/2293648366 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f328800ca80 con 0x7f32980b0e50 2020-10-31T22:48:07.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.337+0000 7f3287fff700 1 -- 172.21.15.60:0/2293648366 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328800cbe0 con 0x7f32980b0e50 2020-10-31T22:48:07.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.337+0000 7f329d25c700 1 -- 172.21.15.60:0/2293648366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3298146de0 con 0x7f32980b0e50 2020-10-31T22:48:07.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.337+0000 7f3287fff700 1 -- 172.21.15.60:0/2293648366 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f32880123f0 con 0x7f32980b0e50 2020-10-31T22:48:07.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.337+0000 7f329d25c700 1 -- 172.21.15.60:0/2293648366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3298146160 con 0x7f32980b0e50 2020-10-31T22:48:07.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.337+0000 7f329d25c700 1 -- 172.21.15.60:0/2293648366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3298057100 con 0x7f32980b0e50 2020-10-31T22:48:07.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.337+0000 7f3287fff700 1 -- 172.21.15.60:0/2293648366 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3288012550 con 0x7f32980b0e50 2020-10-31T22:48:07.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.337+0000 7f3287fff700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3274054f10 0x7f32740573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:07.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.337+0000 7f3287fff700 1 -- 172.21.15.60:0/2293648366 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f328806dfa0 con 0x7f32980b0e50 2020-10-31T22:48:07.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.337+0000 7f329659c700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3274054f10 0x7f32740573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:07.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.337+0000 7f329659c700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3274054f10 0x7f32740573d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f328c019000 tx=0x7f328c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:07.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.345+0000 7f3287fff700 1 -- 172.21.15.60:0/2293648366 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3288044340 con 0x7f32980b0e50 2020-10-31T22:48:07.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.529+0000 7f329d25c700 1 -- 172.21.15.60:0/2293648366 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f329805aa30 con 0x7f32980b0e50 2020-10-31T22:48:07.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.837+0000 7f3287fff700 1 -- 172.21.15.60:0/2293648366 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3288047960 con 0x7f32980b0e50 2020-10-31T22:48:07.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.841+0000 7f329d25c700 1 -- 172.21.15.60:0/2293648366 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3274054f10 msgr2=0x7f32740573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:07.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.841+0000 7f329d25c700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3274054f10 0x7f32740573d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f328c019000 tx=0x7f328c015000).stop 2020-10-31T22:48:07.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.841+0000 7f329d25c700 1 -- 172.21.15.60:0/2293648366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0e50 msgr2=0x7f32980633e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:07.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.841+0000 7f329d25c700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0e50 0x7f32980633e0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 rx=0x7f328800c000 tx=0x7f3288006dc0).stop 2020-10-31T22:48:07.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.841+0000 7f329d25c700 1 -- 172.21.15.60:0/2293648366 shutdown_connections 2020-10-31T22:48:07.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.841+0000 7f329d25c700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3274054f10 0x7f32740573d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:07.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.841+0000 7f329d25c700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f329813f870 0x7f3298155900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:07.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.841+0000 7f329d25c700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0e50 0x7f32980633e0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:07.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.841+0000 7f329d25c700 1 --2- 172.21.15.60:0/2293648366 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b52a0 0x7f3298155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:07.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.841+0000 7f329d25c700 1 -- 172.21.15.60:0/2293648366 >> 172.21.15.60:0/2293648366 conn(0x7f3298060c10 msgr2=0x7f32980b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:07.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.841+0000 7f329d25c700 1 -- 172.21.15.60:0/2293648366 shutdown_connections 2020-10-31T22:48:07.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.841+0000 7f329d25c700 1 -- 172.21.15.60:0/2293648366 wait complete. 2020-10-31T22:48:07.865 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:48:07.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.985+0000 7f087b2ce700 1 Processor -- start 2020-10-31T22:48:07.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.985+0000 7f087b2ce700 1 -- start start 2020-10-31T22:48:07.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087b2ce700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0874065f70 0x7f08740b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:07.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087b2ce700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f08740b2e20 0x7f0874142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:07.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087b2ce700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0874066410 con 0x7f087405c660 2020-10-31T22:48:07.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087b2ce700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0874066d60 con 0x7f0874065f70 2020-10-31T22:48:07.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087b2ce700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08740b5e80 con 0x7f08740b2e20 2020-10-31T22:48:07.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f0878869700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0874065f70 0x7f08740b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:07.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f0878869700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0874065f70 0x7f08740b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45910/0 (socket says 172.21.15.60:45910) 2020-10-31T22:48:07.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f0878869700 1 -- 172.21.15.60:0/1927540965 learned_addr learned my addr 172.21.15.60:0/1927540965 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:07.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087906a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f087405c660 0x7f087413f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50044/0 (socket says 172.21.15.60:50044) 2020-10-31T22:48:07.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087986b700 1 --2- 172.21.15.60:0/1927540965 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f08740b2e20 0x7f0874142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:07.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f0878869700 1 -- 172.21.15.60:0/1927540965 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f08740b2e20 msgr2=0x7f0874142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:07.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f0878869700 1 --2- 172.21.15.60:0/1927540965 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f08740b2e20 0x7f0874142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:07.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f0878869700 1 -- 172.21.15.60:0/1927540965 >> v1:172.21.15.60:6789/0 conn(0x7f087405c660 legacy=0x7f087413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:07.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f0878869700 1 -- 172.21.15.60:0/1927540965 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08740666b0 con 0x7f0874065f70 2020-10-31T22:48:07.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f0867fff700 1 -- 172.21.15.60:0/1927540965 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944659697 0 0) 0x7f0874066410 con 0x7f087405c660 2020-10-31T22:48:07.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f0878869700 1 --2- 172.21.15.60:0/1927540965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0874065f70 0x7f08740b5990 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f0870002f30 tx=0x7f0870006e80).ready entity=mon.0 client_cookie=cecd5aae5cc6e68f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:07.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f0867fff700 1 -- 172.21.15.60:0/1927540965 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08700097f0 con 0x7f0874065f70 2020-10-31T22:48:07.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f0867fff700 1 -- 172.21.15.60:0/1927540965 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0870009950 con 0x7f0874065f70 2020-10-31T22:48:07.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f0867fff700 1 -- 172.21.15.60:0/1927540965 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0870009cb0 con 0x7f0874065f70 2020-10-31T22:48:07.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087b2ce700 1 -- 172.21.15.60:0/1927540965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0874065f70 msgr2=0x7f08740b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:08.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087b2ce700 1 --2- 172.21.15.60:0/1927540965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0874065f70 0x7f08740b5990 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 rx=0x7f0870002f30 tx=0x7f0870006e80).stop 2020-10-31T22:48:08.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087b2ce700 1 -- 172.21.15.60:0/1927540965 shutdown_connections 2020-10-31T22:48:08.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087b2ce700 1 --2- 172.21.15.60:0/1927540965 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f08740b2e20 0x7f0874142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:08.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087b2ce700 1 --2- 172.21.15.60:0/1927540965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0874065f70 0x7f08740b5990 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:08.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087b2ce700 1 -- 172.21.15.60:0/1927540965 >> 172.21.15.60:0/1927540965 conn(0x7f08740601e0 msgr2=0x7f087405b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:08.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087b2ce700 1 -- 172.21.15.60:0/1927540965 shutdown_connections 2020-10-31T22:48:08.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.989+0000 7f087b2ce700 1 -- 172.21.15.60:0/1927540965 wait complete. 2020-10-31T22:48:08.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087b2ce700 1 Processor -- start 2020-10-31T22:48:08.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087b2ce700 1 -- start start 2020-10-31T22:48:08.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087b2ce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f087405c660 0x7f08740ad200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:08.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087b2ce700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0874065f70 0x7f08740ad6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:08.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087b2ce700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08740b2e20 0x7f0874154700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:08.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087b2ce700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08740acb30 con 0x7f087405c660 2020-10-31T22:48:08.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087b2ce700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08740aebf0 con 0x7f08740b2e20 2020-10-31T22:48:08.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087b2ce700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08740aee90 con 0x7f0874065f70 2020-10-31T22:48:08.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087906a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f087405c660 0x7f08740ad200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:08.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087906a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f087405c660 0x7f08740ad200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45914/0 (socket says 172.21.15.60:45914) 2020-10-31T22:48:08.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087906a700 1 -- 172.21.15.60:0/2940588731 learned_addr learned my addr 172.21.15.60:0/2940588731 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:08.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f0878869700 1 --2- 172.21.15.60:0/2940588731 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0874065f70 0x7f08740ad6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:08.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087986b700 1 --2- 172.21.15.60:0/2940588731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08740b2e20 0x7f0874154700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:08.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087906a700 1 -- 172.21.15.60:0/2940588731 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0874065f70 msgr2=0x7f08740ad6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:08.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087906a700 1 --2- 172.21.15.60:0/2940588731 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0874065f70 0x7f08740ad6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:08.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087906a700 1 -- 172.21.15.60:0/2940588731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08740b2e20 msgr2=0x7f0874154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:08.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087906a700 1 --2- 172.21.15.60:0/2940588731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08740b2e20 0x7f0874154700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:08.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087906a700 1 -- 172.21.15.60:0/2940588731 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08740acd60 con 0x7f087405c660 2020-10-31T22:48:08.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087906a700 1 --2- 172.21.15.60:0/2940588731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f087405c660 0x7f08740ad200 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f0868000e90 tx=0x7f0868007a00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:08.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f08667fc700 1 -- 172.21.15.60:0/2940588731 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08680072e0 con 0x7f087405c660 2020-10-31T22:48:08.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f08667fc700 1 -- 172.21.15.60:0/2940588731 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0868005520 con 0x7f087405c660 2020-10-31T22:48:08.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087b2ce700 1 -- 172.21.15.60:0/2940588731 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08740a8250 con 0x7f087405c660 2020-10-31T22:48:08.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f08667fc700 1 -- 172.21.15.60:0/2940588731 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0868005880 con 0x7f087405c660 2020-10-31T22:48:08.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.993+0000 7f087b2ce700 1 -- 172.21.15.60:0/2940588731 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08741476a0 con 0x7f087405c660 2020-10-31T22:48:08.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.997+0000 7f087b2ce700 1 -- 172.21.15.60:0/2940588731 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08740acef0 con 0x7f087405c660 2020-10-31T22:48:08.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.997+0000 7f08667fc700 1 -- 172.21.15.60:0/2940588731 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0868010070 con 0x7f087405c660 2020-10-31T22:48:08.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.997+0000 7f08667fc700 1 --2- 172.21.15.60:0/2940588731 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f085c054f90 0x7f085c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:08.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.997+0000 7f08667fc700 1 -- 172.21.15.60:0/2940588731 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6202+0+0 (secure 0 0 0) 0x7f086806d180 con 0x7f087405c660 2020-10-31T22:48:08.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.997+0000 7f0878869700 1 --2- 172.21.15.60:0/2940588731 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f085c054f90 0x7f085c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:08.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:07.997+0000 7f0878869700 1 --2- 172.21.15.60:0/2940588731 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f085c054f90 0x7f085c057450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f087001c000 tx=0x7f0870015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:08.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.005+0000 7f08667fc700 1 -- 172.21.15.60:0/2940588731 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0868043580 con 0x7f087405c660 2020-10-31T22:48:08.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.149+0000 7f087b2ce700 1 -- 172.21.15.60:0/2940588731 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0874057100 con 0x7f087405c660 2020-10-31T22:48:08.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.857+0000 7f08667fc700 1 -- 172.21.15.60:0/2940588731 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) v1 ==== 185+0+0 (secure 0 0 0) 0x7f0868046ba0 con 0x7f087405c660 2020-10-31T22:48:08.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.861+0000 7f087b2ce700 1 -- 172.21.15.60:0/2940588731 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f085c054f90 msgr2=0x7f085c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:08.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.861+0000 7f087b2ce700 1 --2- 172.21.15.60:0/2940588731 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f085c054f90 0x7f085c057450 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f087001c000 tx=0x7f0870015000).stop 2020-10-31T22:48:08.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.861+0000 7f087b2ce700 1 -- 172.21.15.60:0/2940588731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f087405c660 msgr2=0x7f08740ad200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:08.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.861+0000 7f087b2ce700 1 --2- 172.21.15.60:0/2940588731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f087405c660 0x7f08740ad200 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 rx=0x7f0868000e90 tx=0x7f0868007a00).stop 2020-10-31T22:48:08.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.865+0000 7f087b2ce700 1 -- 172.21.15.60:0/2940588731 shutdown_connections 2020-10-31T22:48:08.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.865+0000 7f087b2ce700 1 --2- 172.21.15.60:0/2940588731 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f085c054f90 0x7f085c057450 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:08.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.865+0000 7f087b2ce700 1 --2- 172.21.15.60:0/2940588731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f08740b2e20 0x7f0874154700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:08.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.865+0000 7f087b2ce700 1 --2- 172.21.15.60:0/2940588731 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f087405c660 0x7f08740ad200 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:08.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.865+0000 7f087b2ce700 1 --2- 172.21.15.60:0/2940588731 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0874065f70 0x7f08740ad6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:08.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.865+0000 7f087b2ce700 1 -- 172.21.15.60:0/2940588731 >> 172.21.15.60:0/2940588731 conn(0x7f08740601e0 msgr2=0x7f087413e680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:08.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.865+0000 7f087b2ce700 1 -- 172.21.15.60:0/2940588731 shutdown_connections 2020-10-31T22:48:08.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.865+0000 7f087b2ce700 1 -- 172.21.15.60:0/2940588731 wait complete. 2020-10-31T22:48:08.874 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:48:08.884 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-10-31T22:48:08.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682e4b5700 1 Processor -- start 2020-10-31T22:48:08.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682e4b5700 1 -- start start 2020-10-31T22:48:09.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682e4b5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f682805b180 0x7f682805fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:09.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682e4b5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6828060220 0x7f68280aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:09.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682e4b5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682805f3c0 con 0x7f68280b0b70 2020-10-31T22:48:09.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682e4b5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6828145f70 con 0x7f682805b180 2020-10-31T22:48:09.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682e4b5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682805f5f0 con 0x7f6828060220 2020-10-31T22:48:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682d4b3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f682805b180 0x7f682805fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682ccb2700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f68280b0b70 0x7f682813f030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50062/0 (socket says 172.21.15.60:50062) 2020-10-31T22:48:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682ccb2700 1 -- 172.21.15.60:0/2506097298 learned_addr learned my addr 172.21.15.60:0/2506097298 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682dcb4700 1 --2- 172.21.15.60:0/2506097298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6828060220 0x7f68280aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682d4b3700 1 -- 172.21.15.60:0/2506097298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6828060220 msgr2=0x7f68280aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682d4b3700 1 --2- 172.21.15.60:0/2506097298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6828060220 0x7f68280aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:09.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682d4b3700 1 -- 172.21.15.60:0/2506097298 >> v1:172.21.15.60:6789/0 conn(0x7f68280b0b70 legacy=0x7f682813f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:09.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682d4b3700 1 -- 172.21.15.60:0/2506097298 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682805f890 con 0x7f682805b180 2020-10-31T22:48:09.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f682d4b3700 1 --2- 172.21.15.60:0/2506097298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f682805b180 0x7f682805fd30 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f681c0032b0 tx=0x7f681c0091a0).ready entity=mon.0 client_cookie=d0dc2f6c8beda197 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:09.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.993+0000 7f6827fff700 1 -- 172.21.15.60:0/2506097298 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f681c00b9a0 con 0x7f682805b180 2020-10-31T22:48:09.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.997+0000 7f6827fff700 1 -- 172.21.15.60:0/2506097298 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681c00bb00 con 0x7f682805b180 2020-10-31T22:48:09.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.997+0000 7f6827fff700 1 -- 172.21.15.60:0/2506097298 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f681c00bc70 con 0x7f682805b180 2020-10-31T22:48:09.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.997+0000 7f682e4b5700 1 -- 172.21.15.60:0/2506097298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f682805b180 msgr2=0x7f682805fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:09.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.997+0000 7f682e4b5700 1 --2- 172.21.15.60:0/2506097298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f682805b180 0x7f682805fd30 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 rx=0x7f681c0032b0 tx=0x7f681c0091a0).stop 2020-10-31T22:48:09.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.997+0000 7f682e4b5700 1 -- 172.21.15.60:0/2506097298 shutdown_connections 2020-10-31T22:48:09.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.997+0000 7f682e4b5700 1 --2- 172.21.15.60:0/2506097298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6828060220 0x7f68280aef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.997+0000 7f682e4b5700 1 --2- 172.21.15.60:0/2506097298 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f682805b180 0x7f682805fd30 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.997+0000 7f682e4b5700 1 -- 172.21.15.60:0/2506097298 >> 172.21.15.60:0/2506097298 conn(0x7f68280b61d0 msgr2=0x7f68280b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.997+0000 7f682e4b5700 1 -- 172.21.15.60:0/2506097298 shutdown_connections 2020-10-31T22:48:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.997+0000 7f682e4b5700 1 -- 172.21.15.60:0/2506097298 wait complete. 2020-10-31T22:48:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.997+0000 7f682e4b5700 1 Processor -- start 2020-10-31T22:48:09.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:08.997+0000 7f682e4b5700 1 -- start start 2020-10-31T22:48:09.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682e4b5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f682805b180 0x7f682813b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:09.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682e4b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6828060220 0x7f682813b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:09.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682e4b5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68280b0b70 0x7f682813c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:09.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682e4b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682813db20 con 0x7f6828060220 2020-10-31T22:48:09.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682e4b5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68281432e0 con 0x7f68280b0b70 2020-10-31T22:48:09.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682e4b5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f682813cfc0 con 0x7f682805b180 2020-10-31T22:48:09.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682ccb2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6828060220 0x7f682813b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:09.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682d4b3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f682805b180 0x7f682813b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:09.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682ccb2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6828060220 0x7f682813b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45932/0 (socket says 172.21.15.60:45932) 2020-10-31T22:48:09.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682ccb2700 1 -- 172.21.15.60:0/2186471096 learned_addr learned my addr 172.21.15.60:0/2186471096 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:09.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682dcb4700 1 --2- 172.21.15.60:0/2186471096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68280b0b70 0x7f682813c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:09.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682ccb2700 1 -- 172.21.15.60:0/2186471096 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f682805b180 msgr2=0x7f682813b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:09.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682ccb2700 1 --2- 172.21.15.60:0/2186471096 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f682805b180 0x7f682813b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:09.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682ccb2700 1 -- 172.21.15.60:0/2186471096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68280b0b70 msgr2=0x7f682813c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:09.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682ccb2700 1 --2- 172.21.15.60:0/2186471096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68280b0b70 0x7f682813c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:09.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682ccb2700 1 -- 172.21.15.60:0/2186471096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682813bea0 con 0x7f6828060220 2020-10-31T22:48:09.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682ccb2700 1 --2- 172.21.15.60:0/2186471096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6828060220 0x7f682813b710 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f68280b6d90 tx=0x7f6814007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:09.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f68267fc700 1 -- 172.21.15.60:0/2186471096 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68140072e0 con 0x7f6828060220 2020-10-31T22:48:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f68267fc700 1 -- 172.21.15.60:0/2186471096 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6814007440 con 0x7f6828060220 2020-10-31T22:48:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682e4b5700 1 -- 172.21.15.60:0/2186471096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682813d880 con 0x7f6828060220 2020-10-31T22:48:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f68267fc700 1 -- 172.21.15.60:0/2186471096 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68140057d0 con 0x7f6828060220 2020-10-31T22:48:09.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682e4b5700 1 -- 172.21.15.60:0/2186471096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6828143820 con 0x7f6828060220 2020-10-31T22:48:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.001+0000 7f682e4b5700 1 -- 172.21.15.60:0/2186471096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6828057100 con 0x7f6828060220 2020-10-31T22:48:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.005+0000 7f68267fc700 1 -- 172.21.15.60:0/2186471096 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f681401a060 con 0x7f6828060220 2020-10-31T22:48:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.005+0000 7f68267fc700 1 --2- 172.21.15.60:0/2186471096 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6810054f90 0x7f6810057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.005+0000 7f68267fc700 1 -- 172.21.15.60:0/2186471096 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5764+0+0 (secure 0 0 0) 0x7f681406cd20 con 0x7f6828060220 2020-10-31T22:48:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.005+0000 7f682d4b3700 1 --2- 172.21.15.60:0/2186471096 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6810054f90 0x7f6810057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:09.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.005+0000 7f682d4b3700 1 --2- 172.21.15.60:0/2186471096 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6810054f90 0x7f6810057450 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f681c01b000 tx=0x7f681c016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:09.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.013+0000 7f68267fc700 1 -- 172.21.15.60:0/2186471096 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6814043260 con 0x7f6828060220 2020-10-31T22:48:09.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.153+0000 7f682e4b5700 1 -- 172.21.15.60:0/2186471096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6828060700 con 0x7f6828060220 2020-10-31T22:48:09.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.877+0000 7f68267fc700 1 -- 172.21.15.60:0/2186471096 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6814018070 con 0x7f6828060220 2020-10-31T22:48:09.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.881+0000 7f682e4b5700 1 -- 172.21.15.60:0/2186471096 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6810054f90 msgr2=0x7f6810057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:09.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.881+0000 7f682e4b5700 1 --2- 172.21.15.60:0/2186471096 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6810054f90 0x7f6810057450 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f681c01b000 tx=0x7f681c016000).stop 2020-10-31T22:48:09.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.881+0000 7f682e4b5700 1 -- 172.21.15.60:0/2186471096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6828060220 msgr2=0x7f682813b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:09.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.881+0000 7f682e4b5700 1 --2- 172.21.15.60:0/2186471096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6828060220 0x7f682813b710 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 rx=0x7f68280b6d90 tx=0x7f6814007b50).stop 2020-10-31T22:48:09.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.881+0000 7f682e4b5700 1 -- 172.21.15.60:0/2186471096 shutdown_connections 2020-10-31T22:48:09.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.881+0000 7f682e4b5700 1 --2- 172.21.15.60:0/2186471096 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6810054f90 0x7f6810057450 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:09.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.881+0000 7f682e4b5700 1 --2- 172.21.15.60:0/2186471096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f68280b0b70 0x7f682813c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:09.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.881+0000 7f682e4b5700 1 --2- 172.21.15.60:0/2186471096 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f682805b180 0x7f682813b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:09.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.881+0000 7f682e4b5700 1 --2- 172.21.15.60:0/2186471096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6828060220 0x7f682813b710 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:09.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.881+0000 7f682e4b5700 1 -- 172.21.15.60:0/2186471096 >> 172.21.15.60:0/2186471096 conn(0x7f68280b61d0 msgr2=0x7f68280b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:09.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.881+0000 7f682e4b5700 1 -- 172.21.15.60:0/2186471096 shutdown_connections 2020-10-31T22:48:09.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:09.881+0000 7f682e4b5700 1 -- 172.21.15.60:0/2186471096 wait complete. 2020-10-31T22:48:09.891 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2020-10-31T22:48:09.901 INFO:tasks.ceph.mds.a:Restarting daemon 2020-10-31T22:48:09.902 INFO:tasks.ceph.mds.a:Stopping old one... 2020-10-31T22:48:09.902 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-10-31T22:48:09.903 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:48:09.903 INFO:tasks.ceph.mds.c:Restarting daemon 2020-10-31T22:48:09.903 INFO:tasks.ceph.mds.c:Stopping old one... 2020-10-31T22:48:09.904 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-10-31T22:48:09.904 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:48:09.904 INFO:tasks.ceph.mds.b:Restarting daemon 2020-10-31T22:48:09.905 INFO:tasks.ceph.mds.b:Stopping old one... 2020-10-31T22:48:09.906 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-10-31T22:48:09.906 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:48:09.912 INFO:tasks.ceph.mds.a:Stopped 2020-10-31T22:48:09.912 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-10-31T22:48:09.915 INFO:tasks.ceph.mds.c:Stopped 2020-10-31T22:48:09.915 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-10-31T22:48:09.916 INFO:tasks.ceph.mds.b:Stopped 2020-10-31T22:48:09.917 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-10-31T22:48:09.959 INFO:tasks.ceph.mds.a:Started 2020-10-31T22:48:09.959 DEBUG:teuthology.parallel:result is None 2020-10-31T22:48:09.960 INFO:tasks.ceph.mds.b:Started 2020-10-31T22:48:09.960 DEBUG:teuthology.parallel:result is None 2020-10-31T22:48:09.961 INFO:tasks.ceph.mds.c:Started 2020-10-31T22:48:09.961 DEBUG:teuthology.parallel:result is None 2020-10-31T22:48:09.962 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-10-31T22:48:10.030 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:48:10.032 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:48:10.036 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:48:10.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.069+0000 7f1179121700 1 Processor -- start 2020-10-31T22:48:10.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.069+0000 7f1179121700 1 -- start start 2020-10-31T22:48:10.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1179121700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f11740ae970 0x7f11740a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:10.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1179121700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11740adea0 0x7f1174066830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:10.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1179121700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11740ae330 con 0x7f11740a95e0 2020-10-31T22:48:10.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1179121700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f117405b6f0 con 0x7f11740ae970 2020-10-31T22:48:10.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1179121700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11740a79a0 con 0x7f11740adea0 2020-10-31T22:48:10.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f11737fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f11740ae970 0x7f11740a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:10.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1178920700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11740adea0 0x7f1174066830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:10.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1173fff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f11740a95e0 0x7f117405afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:47966/0 (socket says 172.21.15.60:47966) 2020-10-31T22:48:10.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1173fff700 1 -- 172.21.15.60:0/2517438717 learned_addr learned my addr 172.21.15.60:0/2517438717 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:10.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1178920700 1 -- 172.21.15.60:0/2517438717 >> v2:172.21.15.66:3300/0 conn(0x7f11740ae970 msgr2=0x7f11740a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:10.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1178920700 1 --2- 172.21.15.60:0/2517438717 >> v2:172.21.15.66:3300/0 conn(0x7f11740ae970 0x7f11740a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:10.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1178920700 1 -- 172.21.15.60:0/2517438717 >> v1:172.21.15.66:6789/0 conn(0x7f11740a95e0 legacy=0x7f117405afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:10.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1172ffd700 1 -- 172.21.15.60:0/2517438717 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469480843 0 0) 0x7f11740ae330 con 0x7f11740a95e0 2020-10-31T22:48:10.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1178920700 1 -- 172.21.15.60:0/2517438717 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740ad7a0 con 0x7f11740adea0 2020-10-31T22:48:10.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f11737fe700 1 --2- 172.21.15.60:0/2517438717 >> v2:172.21.15.66:3300/0 conn(0x7f11740ae970 0x7f11740a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:10.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1178920700 1 --2- 172.21.15.60:0/2517438717 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11740adea0 0x7f1174066830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f1164002f30 tx=0x7f1164006dc0).ready entity=mon.2 client_cookie=c35cb872eb33417a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1172ffd700 1 -- 172.21.15.60:0/2517438717 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1164009760 con 0x7f11740adea0 2020-10-31T22:48:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1172ffd700 1 -- 172.21.15.60:0/2517438717 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11640098c0 con 0x7f11740adea0 2020-10-31T22:48:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1172ffd700 1 -- 172.21.15.60:0/2517438717 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1164009c20 con 0x7f11740adea0 2020-10-31T22:48:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1179121700 1 -- 172.21.15.60:0/2517438717 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11740adea0 msgr2=0x7f1174066830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1179121700 1 --2- 172.21.15.60:0/2517438717 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11740adea0 0x7f1174066830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f1164002f30 tx=0x7f1164006dc0).stop 2020-10-31T22:48:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1179121700 1 -- 172.21.15.60:0/2517438717 shutdown_connections 2020-10-31T22:48:10.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1179121700 1 --2- 172.21.15.60:0/2517438717 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11740adea0 0x7f1174066830 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1179121700 1 --2- 172.21.15.60:0/2517438717 >> v2:172.21.15.66:3300/0 conn(0x7f11740ae970 0x7f11740a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1179121700 1 -- 172.21.15.60:0/2517438717 >> 172.21.15.60:0/2517438717 conn(0x7f11740b3fd0 msgr2=0x7f11740b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1179121700 1 -- 172.21.15.60:0/2517438717 shutdown_connections 2020-10-31T22:48:10.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.073+0000 7f1179121700 1 -- 172.21.15.60:0/2517438717 wait complete. 2020-10-31T22:48:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1179121700 1 Processor -- start 2020-10-31T22:48:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1179121700 1 -- start start 2020-10-31T22:48:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1179121700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11740a95e0 0x7f1174065f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1179121700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11740adea0 0x7f117409f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:10.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1179121700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11740ae970 0x7f117409fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1179121700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117409e010 con 0x7f11740a95e0 2020-10-31T22:48:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1179121700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117409e2b0 con 0x7f11740ae970 2020-10-31T22:48:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1179121700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f117409e550 con 0x7f11740adea0 2020-10-31T22:48:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1173fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11740a95e0 0x7f1174065f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1173fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11740a95e0 0x7f1174065f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45968/0 (socket says 172.21.15.60:45968) 2020-10-31T22:48:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1173fff700 1 -- 172.21.15.60:0/26250783 learned_addr learned my addr 172.21.15.60:0/26250783 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:10.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f11737fe700 1 --2- 172.21.15.60:0/26250783 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11740adea0 0x7f117409f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:10.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1178920700 1 --2- 172.21.15.60:0/26250783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11740ae970 0x7f117409fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:10.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1173fff700 1 -- 172.21.15.60:0/26250783 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11740adea0 msgr2=0x7f117409f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:10.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1173fff700 1 --2- 172.21.15.60:0/26250783 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11740adea0 0x7f117409f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:10.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1173fff700 1 -- 172.21.15.60:0/26250783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11740ae970 msgr2=0x7f117409fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:10.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1173fff700 1 --2- 172.21.15.60:0/26250783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11740ae970 0x7f117409fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:10.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1173fff700 1 -- 172.21.15.60:0/26250783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117409e7f0 con 0x7f11740a95e0 2020-10-31T22:48:10.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1173fff700 1 --2- 172.21.15.60:0/26250783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11740a95e0 0x7f1174065f60 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f116c001210 tx=0x7f116c007d70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:10.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f11717fa700 1 -- 172.21.15.60:0/26250783 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f116c005c40 con 0x7f11740a95e0 2020-10-31T22:48:10.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f11717fa700 1 -- 172.21.15.60:0/26250783 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f116c005da0 con 0x7f11740a95e0 2020-10-31T22:48:10.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1179121700 1 -- 172.21.15.60:0/26250783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1174143580 con 0x7f11740a95e0 2020-10-31T22:48:10.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f11717fa700 1 -- 172.21.15.60:0/26250783 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f116c007300 con 0x7f11740a95e0 2020-10-31T22:48:10.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1179121700 1 -- 172.21.15.60:0/26250783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1174153d30 con 0x7f11740a95e0 2020-10-31T22:48:10.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.077+0000 7f1179121700 1 -- 172.21.15.60:0/26250783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11740ab750 con 0x7f11740a95e0 2020-10-31T22:48:10.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.081+0000 7f11717fa700 1 -- 172.21.15.60:0/26250783 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f116c010030 con 0x7f11740a95e0 2020-10-31T22:48:10.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.081+0000 7f11717fa700 1 --2- 172.21.15.60:0/26250783 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1158054f90 0x7f1158057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:10.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.081+0000 7f11717fa700 1 -- 172.21.15.60:0/26250783 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5382+0+0 (secure 0 0 0) 0x7f116c06d830 con 0x7f11740a95e0 2020-10-31T22:48:10.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.081+0000 7f11737fe700 1 --2- 172.21.15.60:0/26250783 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1158054f90 0x7f1158057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:10.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.081+0000 7f11737fe700 1 --2- 172.21.15.60:0/26250783 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1158054f90 0x7f1158057450 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f115c00b000 tx=0x7f115c006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:10.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.085+0000 7f11717fa700 1 -- 172.21.15.60:0/26250783 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f11740ab750 con 0x7f11740a95e0 2020-10-31T22:48:10.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:10.241+0000 7f1179121700 1 -- 172.21.15.60:0/26250783 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f11740ab750 con 0x7f11740a95e0 2020-10-31T22:48:11.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.073+0000 7f11717fa700 1 -- 172.21.15.60:0/26250783 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v83) v1 ==== 97+0+0 (secure 0 0 0) 0x7f11740ab750 con 0x7f11740a95e0 2020-10-31T22:48:11.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.073+0000 7f1179121700 1 -- 172.21.15.60:0/26250783 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1158054f90 msgr2=0x7f1158057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.073+0000 7f1179121700 1 --2- 172.21.15.60:0/26250783 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1158054f90 0x7f1158057450 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f115c00b000 tx=0x7f115c006dc0).stop 2020-10-31T22:48:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.073+0000 7f1179121700 1 -- 172.21.15.60:0/26250783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11740a95e0 msgr2=0x7f1174065f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.073+0000 7f1179121700 1 --2- 172.21.15.60:0/26250783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11740a95e0 0x7f1174065f60 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 rx=0x7f116c001210 tx=0x7f116c007d70).stop 2020-10-31T22:48:11.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.073+0000 7f1179121700 1 -- 172.21.15.60:0/26250783 shutdown_connections 2020-10-31T22:48:11.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.077+0000 7f1179121700 1 --2- 172.21.15.60:0/26250783 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1158054f90 0x7f1158057450 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.077+0000 7f1179121700 1 --2- 172.21.15.60:0/26250783 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11740ae970 0x7f117409fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.077+0000 7f1179121700 1 --2- 172.21.15.60:0/26250783 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11740a95e0 0x7f1174065f60 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.077+0000 7f1179121700 1 --2- 172.21.15.60:0/26250783 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11740adea0 0x7f117409f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.077+0000 7f1179121700 1 -- 172.21.15.60:0/26250783 >> 172.21.15.60:0/26250783 conn(0x7f11740b3fd0 msgr2=0x7f11740a9f40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:11.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.077+0000 7f1179121700 1 -- 172.21.15.60:0/26250783 shutdown_connections 2020-10-31T22:48:11.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.077+0000 7f1179121700 1 -- 172.21.15.60:0/26250783 wait complete. 2020-10-31T22:48:11.086 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blacklist entries 2020-10-31T22:48:11.096 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2020-10-31T22:48:11.097 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-10-31T22:48:11.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.205+0000 7fee26a52700 1 Processor -- start 2020-10-31T22:48:11.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.205+0000 7fee26a52700 1 -- start start 2020-10-31T22:48:11.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee26a52700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee200b24a0 0x7fee200b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee26a52700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fee20141fe0 0x7fee20142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee26a52700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee20145180 con 0x7fee200b5570 2020-10-31T22:48:11.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee26a52700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee200afae0 con 0x7fee200b24a0 2020-10-31T22:48:11.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee26a52700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee20141bf0 con 0x7fee20141fe0 2020-10-31T22:48:11.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee2524f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee200b24a0 0x7fee200b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee2524f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fee200b24a0 0x7fee200b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45980/0 (socket says 172.21.15.60:45980) 2020-10-31T22:48:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee25a50700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fee200b5570 0x7fee20145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50114/0 (socket says 172.21.15.60:50114) 2020-10-31T22:48:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee2524f700 1 -- 172.21.15.60:0/921964396 learned_addr learned my addr 172.21.15.60:0/921964396 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:11.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee26251700 1 --2- 172.21.15.60:0/921964396 >> v2:172.21.15.66:3300/0 conn(0x7fee20141fe0 0x7fee20142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee2524f700 1 -- 172.21.15.60:0/921964396 >> v2:172.21.15.66:3300/0 conn(0x7fee20141fe0 msgr2=0x7fee20142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:11.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee2524f700 1 --2- 172.21.15.60:0/921964396 >> v2:172.21.15.66:3300/0 conn(0x7fee20141fe0 0x7fee20142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee2524f700 1 -- 172.21.15.60:0/921964396 >> v1:172.21.15.60:6789/0 conn(0x7fee200b5570 legacy=0x7fee20145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee2524f700 1 -- 172.21.15.60:0/921964396 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee200b0670 con 0x7fee200b24a0 2020-10-31T22:48:11.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee2524f700 1 --2- 172.21.15.60:0/921964396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee200b24a0 0x7fee200b5950 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7fee2005f580 tx=0x7fee1c006e80).ready entity=mon.0 client_cookie=3b0719a5322dda30 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:11.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee24a4e700 1 -- 172.21.15.60:0/921964396 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee1c0097b0 con 0x7fee200b24a0 2020-10-31T22:48:11.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee24a4e700 1 -- 172.21.15.60:0/921964396 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c009910 con 0x7fee200b24a0 2020-10-31T22:48:11.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee24a4e700 1 -- 172.21.15.60:0/921964396 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee1c009c70 con 0x7fee200b24a0 2020-10-31T22:48:11.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee26a52700 1 -- 172.21.15.60:0/921964396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee200b24a0 msgr2=0x7fee200b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee26a52700 1 --2- 172.21.15.60:0/921964396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee200b24a0 0x7fee200b5950 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 rx=0x7fee2005f580 tx=0x7fee1c006e80).stop 2020-10-31T22:48:11.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee26a52700 1 -- 172.21.15.60:0/921964396 shutdown_connections 2020-10-31T22:48:11.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee26a52700 1 --2- 172.21.15.60:0/921964396 >> v2:172.21.15.66:3300/0 conn(0x7fee20141fe0 0x7fee20142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee26a52700 1 --2- 172.21.15.60:0/921964396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee200b24a0 0x7fee200b5950 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee26a52700 1 -- 172.21.15.60:0/921964396 >> 172.21.15.60:0/921964396 conn(0x7fee200b8e90 msgr2=0x7fee200b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:11.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee26a52700 1 -- 172.21.15.60:0/921964396 shutdown_connections 2020-10-31T22:48:11.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.209+0000 7fee26a52700 1 -- 172.21.15.60:0/921964396 wait complete. 2020-10-31T22:48:11.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.213+0000 7fee26a52700 1 Processor -- start 2020-10-31T22:48:11.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.213+0000 7fee26a52700 1 -- start start 2020-10-31T22:48:11.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.213+0000 7fee26a52700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee200b24a0 0x7fee200b1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.213+0000 7fee26a52700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee200b5570 0x7fee2013a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.213+0000 7fee26a52700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee20141fe0 0x7fee200b6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.213+0000 7fee26a52700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee20143ed0 con 0x7fee20141fe0 2020-10-31T22:48:11.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.213+0000 7fee26a52700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee20143050 con 0x7fee200b24a0 2020-10-31T22:48:11.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.213+0000 7fee26a52700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee20067860 con 0x7fee200b5570 2020-10-31T22:48:11.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.213+0000 7fee26251700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee20141fe0 0x7fee200b6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.213+0000 7fee26251700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee20141fe0 0x7fee200b6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45988/0 (socket says 172.21.15.60:45988) 2020-10-31T22:48:11.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee26251700 1 -- 172.21.15.60:0/1961629025 learned_addr learned my addr 172.21.15.60:0/1961629025 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:11.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee25a50700 1 --2- 172.21.15.60:0/1961629025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee200b24a0 0x7fee200b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee2524f700 1 --2- 172.21.15.60:0/1961629025 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee200b5570 0x7fee2013a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee26251700 1 -- 172.21.15.60:0/1961629025 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee200b5570 msgr2=0x7fee2013a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee26251700 1 --2- 172.21.15.60:0/1961629025 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee200b5570 0x7fee2013a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee26251700 1 -- 172.21.15.60:0/1961629025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee200b24a0 msgr2=0x7fee200b1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee26251700 1 --2- 172.21.15.60:0/1961629025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee200b24a0 0x7fee200b1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee26251700 1 -- 172.21.15.60:0/1961629025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee200b4c00 con 0x7fee20141fe0 2020-10-31T22:48:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee26251700 1 --2- 172.21.15.60:0/1961629025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee20141fe0 0x7fee200b6500 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fee18006dd0 tx=0x7fee180091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee0effd700 1 -- 172.21.15.60:0/1961629025 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee1800c9e0 con 0x7fee20141fe0 2020-10-31T22:48:11.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee0effd700 1 -- 172.21.15.60:0/1961629025 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1800cb40 con 0x7fee20141fe0 2020-10-31T22:48:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee26a52700 1 -- 172.21.15.60:0/1961629025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee200b7fd0 con 0x7fee20141fe0 2020-10-31T22:48:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee0effd700 1 -- 172.21.15.60:0/1961629025 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fee1800cea0 con 0x7fee20141fe0 2020-10-31T22:48:11.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee26a52700 1 -- 172.21.15.60:0/1961629025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2013b7e0 con 0x7fee20141fe0 2020-10-31T22:48:11.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee26a52700 1 -- 172.21.15.60:0/1961629025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee200b6b90 con 0x7fee20141fe0 2020-10-31T22:48:11.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.217+0000 7fee0effd700 1 -- 172.21.15.60:0/1961629025 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fee18022070 con 0x7fee20141fe0 2020-10-31T22:48:11.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.221+0000 7fee0effd700 1 --2- 172.21.15.60:0/1961629025 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee00054f10 0x7fee000573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.221+0000 7fee0effd700 1 -- 172.21.15.60:0/1961629025 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fee1806de00 con 0x7fee20141fe0 2020-10-31T22:48:11.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.221+0000 7fee25a50700 1 --2- 172.21.15.60:0/1961629025 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee00054f10 0x7fee000573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.221+0000 7fee25a50700 1 --2- 172.21.15.60:0/1961629025 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee00054f10 0x7fee000573d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fee1000d000 tx=0x7fee10007ac0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:11.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.229+0000 7fee0effd700 1 -- 172.21.15.60:0/1961629025 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fee18044650 con 0x7fee20141fe0 2020-10-31T22:48:11.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.425+0000 7fee26a52700 1 -- 172.21.15.60:0/1961629025 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fee20057100 con 0x7fee20141fe0 2020-10-31T22:48:11.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.425+0000 7fee0effd700 1 -- 172.21.15.60:0/1961629025 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fee18016070 con 0x7fee20141fe0 2020-10-31T22:48:11.431 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:11.431 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:48:11.432 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2020-10-31T22:48:11.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.432 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2020-10-31T22:48:11.433 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f7D/cFRAAHQ9NU7VSs14mi5sC/GwHng==", 2020-10-31T22:48:11.433 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.433 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:11.434 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:11.434 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:11.434 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:11.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.435 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2020-10-31T22:48:11.435 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f5SPjJBAAVjFv2PdBZ7j94etJrAT0tA==", 2020-10-31T22:48:11.435 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.435 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:11.435 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:11.435 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:11.435 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:11.436 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.436 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2020-10-31T22:48:11.436 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKpdoHhAAhhlaYqOQoI6tTKexjRpbGA==", 2020-10-31T22:48:11.436 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.436 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:11.437 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:11.437 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:11.437 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:11.437 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.437 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2020-10-31T22:48:11.438 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDR551f7MwsMRAACZIQlAKm3BdVbDs2gQAfxg==", 2020-10-31T22:48:11.438 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.438 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:11.438 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:11.438 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:11.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.439 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2020-10-31T22:48:11.439 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDU551f07HQFxAAokMFXwsbgKGtJNpnKerdGg==", 2020-10-31T22:48:11.439 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.439 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:11.439 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:11.439 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:11.440 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.440 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2020-10-31T22:48:11.440 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDW551fODyjOhAAJ+j8KITJidSpltSiJaQZGw==", 2020-10-31T22:48:11.440 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.440 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:11.441 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:11.441 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:11.441 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.441 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2020-10-31T22:48:11.441 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDZ551fs+aCIhAAwpbmgGQjU05W3hZofTtHdg==", 2020-10-31T22:48:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.443 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2020-10-31T22:48:11.443 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDe551fI5nIMxAAwwNSHQYDPS6G2achKIpwqg==", 2020-10-31T22:48:11.443 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.443 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:11.443 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:11.443 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:11.443 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.444 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2020-10-31T22:48:11.444 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDh551f68p2GhAAhlGpZLPg8RqouzStqN4tFw==", 2020-10-31T22:48:11.444 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.444 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:11.444 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:11.444 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:11.445 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.445 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2020-10-31T22:48:11.445 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDk551fUi3kARAAsXPU7HEhqax8Go00CqgdNw==", 2020-10-31T22:48:11.445 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.445 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:11.446 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:11.446 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:11.446 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.446 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2020-10-31T22:48:11.447 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDm551fKh4aJRAAj+whV4kueCu2Og7wZ05tNw==", 2020-10-31T22:48:11.447 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.447 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:11.447 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:11.447 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:11.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.447 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.448 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2020-10-31T22:48:11.448 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551flXvBJxAAtD4URDL2NV0zyAympufvVA==", 2020-10-31T22:48:11.448 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.448 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:11.448 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:48:11.448 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:48:11.449 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.449 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2020-10-31T22:48:11.449 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fQ/OGKhAA/xGrRlUW52pP6E6SWXYAGA==", 2020-10-31T22:48:11.449 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.449 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:11.450 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:48:11.450 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:48:11.450 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.450 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2020-10-31T22:48:11.450 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDP551fITgCMxAAQy5CQzqda1YjdUtTRxbsPQ==", 2020-10-31T22:48:11.451 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.451 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:48:11.451 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:11.451 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:11.451 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:11.451 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.452 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2020-10-31T22:48:11.452 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551feZUgExAAvGt2fUb5GhkkFQ0dbgP5nw==", 2020-10-31T22:48:11.452 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.452 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:48:11.452 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:48:11.452 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:11.453 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:11.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:11.453 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2020-10-31T22:48:11.453 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKiN5EBAAhHtXXE4+yydXWOK7agZ14g==", 2020-10-31T22:48:11.453 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:11.454 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:48:11.454 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:48:11.455 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:11.455 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.455 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:11.455 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:11.455 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:48:11.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.425+0000 7fee26a52700 1 -- 172.21.15.60:0/1961629025 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee00054f10 msgr2=0x7fee000573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.425+0000 7fee26a52700 1 --2- 172.21.15.60:0/1961629025 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee00054f10 0x7fee000573d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7fee1000d000 tx=0x7fee10007ac0).stop 2020-10-31T22:48:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.425+0000 7fee26a52700 1 -- 172.21.15.60:0/1961629025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee20141fe0 msgr2=0x7fee200b6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.425+0000 7fee26a52700 1 --2- 172.21.15.60:0/1961629025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee20141fe0 0x7fee200b6500 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 rx=0x7fee18006dd0 tx=0x7fee180091a0).stop 2020-10-31T22:48:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.425+0000 7fee26a52700 1 -- 172.21.15.60:0/1961629025 shutdown_connections 2020-10-31T22:48:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.425+0000 7fee26a52700 1 --2- 172.21.15.60:0/1961629025 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fee20141fe0 0x7fee200b6500 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.425+0000 7fee26a52700 1 --2- 172.21.15.60:0/1961629025 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee00054f10 0x7fee000573d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.425+0000 7fee26a52700 1 --2- 172.21.15.60:0/1961629025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fee200b24a0 0x7fee200b1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.425+0000 7fee26a52700 1 --2- 172.21.15.60:0/1961629025 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fee200b5570 0x7fee2013a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.425+0000 7fee26a52700 1 -- 172.21.15.60:0/1961629025 >> 172.21.15.60:0/1961629025 conn(0x7fee200b8e90 msgr2=0x7fee20065c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.425+0000 7fee26a52700 1 -- 172.21.15.60:0/1961629025 shutdown_connections 2020-10-31T22:48:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.425+0000 7fee26a52700 1 -- 172.21.15.60:0/1961629025 wait complete. 2020-10-31T22:48:11.459 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:48:11.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5aa6544700 1 Processor -- start 2020-10-31T22:48:11.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5aa6544700 1 -- start start 2020-10-31T22:48:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5aa6544700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5aa00b2820 0x7f5aa00af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5aa6544700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa01459c0 con 0x7f5aa00b1000 2020-10-31T22:48:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5aa6544700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aa0063520 con 0x7f5aa0063140 2020-10-31T22:48:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5aa6544700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aa00b2060 con 0x7f5aa00b2820 2020-10-31T22:48:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5aa5d43700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5aa00b2820 0x7f5aa00af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5aa4d41700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5aa00b1000 0x7f5aa00aeda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50130/0 (socket says 172.21.15.60:50130) 2020-10-31T22:48:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5aa4d41700 1 -- 172.21.15.60:0/1947988245 learned_addr learned my addr 172.21.15.60:0/1947988245 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:11.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5aa5d43700 1 -- 172.21.15.60:0/1947988245 >> v1:172.21.15.66:6789/0 conn(0x7f5aa0063140 legacy=0x7f5aa01452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5aa5d43700 1 -- 172.21.15.60:0/1947988245 >> v1:172.21.15.60:6789/0 conn(0x7f5aa00b1000 legacy=0x7f5aa00aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5a8ffff700 1 -- 172.21.15.60:0/1947988245 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309732585 0 0) 0x7f5aa01459c0 con 0x7f5aa00b1000 2020-10-31T22:48:11.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5aa5d43700 1 -- 172.21.15.60:0/1947988245 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa00b02e0 con 0x7f5aa00b2820 2020-10-31T22:48:11.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5aa5d43700 1 --2- 172.21.15.60:0/1947988245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aa00b2820 0x7f5aa00af4b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f5a980032b0 tx=0x7f5a980091a0).ready entity=mon.0 client_cookie=421e915ec13aab3c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:11.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5a8ffff700 1 -- 172.21.15.60:0/1947988245 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a9800bae0 con 0x7f5aa00b2820 2020-10-31T22:48:11.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5a8ffff700 1 -- 172.21.15.60:0/1947988245 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9800bc40 con 0x7f5aa00b2820 2020-10-31T22:48:11.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.569+0000 7f5a8ffff700 1 -- 172.21.15.60:0/1947988245 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a9800bdb0 con 0x7f5aa00b2820 2020-10-31T22:48:11.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 -- 172.21.15.60:0/1947988245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aa00b2820 msgr2=0x7f5aa00af4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 --2- 172.21.15.60:0/1947988245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aa00b2820 0x7f5aa00af4b0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 rx=0x7f5a980032b0 tx=0x7f5a980091a0).stop 2020-10-31T22:48:11.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 -- 172.21.15.60:0/1947988245 shutdown_connections 2020-10-31T22:48:11.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 --2- 172.21.15.60:0/1947988245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aa00b2820 0x7f5aa00af4b0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 -- 172.21.15.60:0/1947988245 >> 172.21.15.60:0/1947988245 conn(0x7f5aa006a600 msgr2=0x7f5aa0060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:11.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 -- 172.21.15.60:0/1947988245 shutdown_connections 2020-10-31T22:48:11.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 -- 172.21.15.60:0/1947988245 wait complete. 2020-10-31T22:48:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 Processor -- start 2020-10-31T22:48:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 -- start start 2020-10-31T22:48:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aa0063140 0x7f5aa00aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aa00b1000 0x7f5aa0066b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5aa00b2820 0x7f5aa00a9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa0067130 con 0x7f5aa0063140 2020-10-31T22:48:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa00673d0 con 0x7f5aa00b2820 2020-10-31T22:48:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa6544700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa0153fc0 con 0x7f5aa00b1000 2020-10-31T22:48:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa5542700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aa0063140 0x7f5aa00aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa5542700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aa0063140 0x7f5aa00aa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:45998/0 (socket says 172.21.15.60:45998) 2020-10-31T22:48:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.573+0000 7f5aa5542700 1 -- 172.21.15.60:0/433207911 learned_addr learned my addr 172.21.15.60:0/433207911 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5aa4d41700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aa00b1000 0x7f5aa0066b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5aa5d43700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5aa00b2820 0x7f5aa00a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5aa5542700 1 -- 172.21.15.60:0/433207911 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aa00b1000 msgr2=0x7f5aa0066b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5aa5542700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aa00b1000 0x7f5aa0066b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5aa5542700 1 -- 172.21.15.60:0/433207911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5aa00b2820 msgr2=0x7f5aa00a9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5aa5542700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5aa00b2820 0x7f5aa00a9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5aa5542700 1 -- 172.21.15.60:0/433207911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aa0154260 con 0x7f5aa0063140 2020-10-31T22:48:11.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5aa4d41700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aa00b1000 0x7f5aa0066b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:11.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5aa5d43700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5aa00b2820 0x7f5aa00a9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:11.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5aa5542700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aa0063140 0x7f5aa00aa2b0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f5aa0062910 tx=0x7f5a9c007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:11.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5a8e7fc700 1 -- 172.21.15.60:0/433207911 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a9c010510 con 0x7f5aa0063140 2020-10-31T22:48:11.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5a8e7fc700 1 -- 172.21.15.60:0/433207911 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a9c010670 con 0x7f5aa0063140 2020-10-31T22:48:11.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5aa6544700 1 -- 172.21.15.60:0/433207911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa00abf00 con 0x7f5aa0063140 2020-10-31T22:48:11.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5a8e7fc700 1 -- 172.21.15.60:0/433207911 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a9c0107e0 con 0x7f5aa0063140 2020-10-31T22:48:11.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5aa6544700 1 -- 172.21.15.60:0/433207911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa0154700 con 0x7f5aa0063140 2020-10-31T22:48:11.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5aa6544700 1 -- 172.21.15.60:0/433207911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa01543f0 con 0x7f5aa0063140 2020-10-31T22:48:11.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5a8e7fc700 1 -- 172.21.15.60:0/433207911 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5a9c010070 con 0x7f5aa0063140 2020-10-31T22:48:11.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5a8e7fc700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5a80055020 0x7f5a800574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5a8e7fc700 1 -- 172.21.15.60:0/433207911 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5a9c06d020 con 0x7f5aa0063140 2020-10-31T22:48:11.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.577+0000 7f5aa4d41700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5a80055020 0x7f5a800574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.581+0000 7f5aa4d41700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5a80055020 0x7f5a800574e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f5a90008000 tx=0x7f5a90009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:11.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.585+0000 7f5a8e7fc700 1 -- 172.21.15.60:0/433207911 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5a9c043870 con 0x7f5aa0063140 2020-10-31T22:48:11.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.725+0000 7f5aa6544700 1 -- 172.21.15.60:0/433207911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5aa0057100 con 0x7f5aa0063140 2020-10-31T22:48:11.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.729+0000 7f5a8e7fc700 1 -- 172.21.15.60:0/433207911 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+13182 (secure 0 0 0) 0x7f5a9c046e90 con 0x7f5aa0063140 2020-10-31T22:48:11.735 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:11.735 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":83,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:48:11.069130+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":14,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:48:11.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.729+0000 7f5aa6544700 1 -- 172.21.15.60:0/433207911 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5a80055020 msgr2=0x7f5a800574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.729+0000 7f5aa6544700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5a80055020 0x7f5a800574e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f5a90008000 tx=0x7f5a90009040).stop 2020-10-31T22:48:11.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.729+0000 7f5aa6544700 1 -- 172.21.15.60:0/433207911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aa0063140 msgr2=0x7f5aa00aa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.729+0000 7f5aa6544700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aa0063140 0x7f5aa00aa2b0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 rx=0x7f5aa0062910 tx=0x7f5a9c007b90).stop 2020-10-31T22:48:11.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.729+0000 7f5aa6544700 1 -- 172.21.15.60:0/433207911 shutdown_connections 2020-10-31T22:48:11.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.729+0000 7f5aa6544700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5a80055020 0x7f5a800574e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.729+0000 7f5aa6544700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5aa00b2820 0x7f5aa00a9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.729+0000 7f5aa6544700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aa0063140 0x7f5aa00aa2b0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.729+0000 7f5aa6544700 1 --2- 172.21.15.60:0/433207911 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aa00b1000 0x7f5aa0066b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.729+0000 7f5aa6544700 1 -- 172.21.15.60:0/433207911 >> 172.21.15.60:0/433207911 conn(0x7f5aa006a600 msgr2=0x7f5aa00b4140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:11.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.729+0000 7f5aa6544700 1 -- 172.21.15.60:0/433207911 shutdown_connections 2020-10-31T22:48:11.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.729+0000 7f5aa6544700 1 -- 172.21.15.60:0/433207911 wait complete. 2020-10-31T22:48:11.749 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-31T22:48:11.749 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:48:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.861+0000 7f0dc84f7700 1 Processor -- start 2020-10-31T22:48:11.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.861+0000 7f0dc84f7700 1 -- start start 2020-10-31T22:48:11.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.861+0000 7f0dc84f7700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0dc0062c70 0x7f0dc01431a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.861+0000 7f0dc84f7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0dc00afbe0 0x7f0dc005b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.861+0000 7f0dc84f7700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc00b2730 con 0x7f0dc005bcb0 2020-10-31T22:48:11.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.861+0000 7f0dc84f7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc013d620 con 0x7f0dc00afbe0 2020-10-31T22:48:11.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.861+0000 7f0dc84f7700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc00b2960 con 0x7f0dc0062c70 2020-10-31T22:48:11.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.861+0000 7f0dc5a92700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0dc00afbe0 0x7f0dc005b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc5a92700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0dc00afbe0 0x7f0dc005b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46010/0 (socket says 172.21.15.60:46010) 2020-10-31T22:48:11.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc5a92700 1 -- 172.21.15.60:0/2915477212 learned_addr learned my addr 172.21.15.60:0/2915477212 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:11.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc6293700 1 --2- 172.21.15.60:0/2915477212 >> v2:172.21.15.66:3300/0 conn(0x7f0dc0062c70 0x7f0dc01431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc5a92700 1 -- 172.21.15.60:0/2915477212 >> v2:172.21.15.66:3300/0 conn(0x7f0dc0062c70 msgr2=0x7f0dc01431a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:11.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc5a92700 1 --2- 172.21.15.60:0/2915477212 >> v2:172.21.15.66:3300/0 conn(0x7f0dc0062c70 0x7f0dc01431a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc5a92700 1 -- 172.21.15.60:0/2915477212 >> v1:172.21.15.66:6789/0 conn(0x7f0dc005bcb0 legacy=0x7f0dc00b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc5a92700 1 -- 172.21.15.60:0/2915477212 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00b1df0 con 0x7f0dc00afbe0 2020-10-31T22:48:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc6293700 1 --2- 172.21.15.60:0/2915477212 >> v2:172.21.15.66:3300/0 conn(0x7f0dc0062c70 0x7f0dc01431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc5a92700 1 --2- 172.21.15.60:0/2915477212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dc00afbe0 0x7f0dc005b7c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f0db0002f30 tx=0x7f0db0006e80).ready entity=mon.0 client_cookie=4e5313c6a723a1d1 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:11.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc5291700 1 -- 172.21.15.60:0/2915477212 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0db00097f0 con 0x7f0dc00afbe0 2020-10-31T22:48:11.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc5291700 1 -- 172.21.15.60:0/2915477212 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db0009950 con 0x7f0dc00afbe0 2020-10-31T22:48:11.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc5291700 1 -- 172.21.15.60:0/2915477212 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0db0009cb0 con 0x7f0dc00afbe0 2020-10-31T22:48:11.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc84f7700 1 -- 172.21.15.60:0/2915477212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dc00afbe0 msgr2=0x7f0dc005b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc84f7700 1 --2- 172.21.15.60:0/2915477212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dc00afbe0 0x7f0dc005b7c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 rx=0x7f0db0002f30 tx=0x7f0db0006e80).stop 2020-10-31T22:48:11.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc84f7700 1 -- 172.21.15.60:0/2915477212 shutdown_connections 2020-10-31T22:48:11.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc84f7700 1 --2- 172.21.15.60:0/2915477212 >> v2:172.21.15.66:3300/0 conn(0x7f0dc0062c70 0x7f0dc01431a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc84f7700 1 --2- 172.21.15.60:0/2915477212 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dc00afbe0 0x7f0dc005b7c0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc84f7700 1 -- 172.21.15.60:0/2915477212 >> 172.21.15.60:0/2915477212 conn(0x7f0dc005fae0 msgr2=0x7f0dc005fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:11.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc84f7700 1 -- 172.21.15.60:0/2915477212 shutdown_connections 2020-10-31T22:48:11.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc84f7700 1 -- 172.21.15.60:0/2915477212 wait complete. 2020-10-31T22:48:11.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc84f7700 1 Processor -- start 2020-10-31T22:48:11.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.865+0000 7f0dc84f7700 1 -- start start 2020-10-31T22:48:11.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc84f7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dc005bcb0 0x7f0dc0065290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc84f7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dc0062c70 0x7f0dc0066e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc84f7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dc00afbe0 0x7f0dc0067380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc84f7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00aa210 con 0x7f0dc00afbe0 2020-10-31T22:48:11.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc84f7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc0063a10 con 0x7f0dc005bcb0 2020-10-31T22:48:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc84f7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc00aa470 con 0x7f0dc0062c70 2020-10-31T22:48:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc6a94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dc00afbe0 0x7f0dc0067380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc6a94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dc00afbe0 0x7f0dc0067380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46016/0 (socket says 172.21.15.60:46016) 2020-10-31T22:48:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc6a94700 1 -- 172.21.15.60:0/1844089807 learned_addr learned my addr 172.21.15.60:0/1844089807 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc5a92700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dc0062c70 0x7f0dc0066e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc6293700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dc005bcb0 0x7f0dc0065290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc5a92700 1 -- 172.21.15.60:0/1844089807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dc005bcb0 msgr2=0x7f0dc0065290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc5a92700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dc005bcb0 0x7f0dc0065290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc5a92700 1 -- 172.21.15.60:0/1844089807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dc00afbe0 msgr2=0x7f0dc0067380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc5a92700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dc00afbe0 0x7f0dc0067380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc5a92700 1 -- 172.21.15.60:0/1844089807 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc00a9a30 con 0x7f0dc0062c70 2020-10-31T22:48:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc6a94700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dc00afbe0 0x7f0dc0067380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:11.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc5a92700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dc0062c70 0x7f0dc0066e90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f0db0002f30 tx=0x7f0db0015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:11.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0daf7fe700 1 -- 172.21.15.60:0/1844089807 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0db0011bd0 con 0x7f0dc0062c70 2020-10-31T22:48:11.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc84f7700 1 -- 172.21.15.60:0/1844089807 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc0067870 con 0x7f0dc0062c70 2020-10-31T22:48:11.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0daf7fe700 1 -- 172.21.15.60:0/1844089807 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db0011d30 con 0x7f0dc0062c70 2020-10-31T22:48:11.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0daf7fe700 1 -- 172.21.15.60:0/1844089807 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0db0011ea0 con 0x7f0dc0062c70 2020-10-31T22:48:11.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.869+0000 7f0dc84f7700 1 -- 172.21.15.60:0/1844089807 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc00ab7f0 con 0x7f0dc0062c70 2020-10-31T22:48:11.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.873+0000 7f0dc84f7700 1 -- 172.21.15.60:0/1844089807 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc00a9df0 con 0x7f0dc0062c70 2020-10-31T22:48:11.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.873+0000 7f0daf7fe700 1 -- 172.21.15.60:0/1844089807 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0db001a040 con 0x7f0dc0062c70 2020-10-31T22:48:11.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.873+0000 7f0daf7fe700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0da0054f10 0x7f0da00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:11.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.873+0000 7f0daf7fe700 1 -- 172.21.15.60:0/1844089807 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f0db006e780 con 0x7f0dc0062c70 2020-10-31T22:48:11.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.873+0000 7f0dc6293700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0da0054f10 0x7f0da00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:11.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.873+0000 7f0dc6293700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0da0054f10 0x7f0da00573d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f0dbc00c000 tx=0x7f0dbc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:11.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:11.881+0000 7f0daf7fe700 1 -- 172.21.15.60:0/1844089807 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0db0048e60 con 0x7f0dc0062c70 2020-10-31T22:48:12.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.029+0000 7f0dc84f7700 1 -- 172.21.15.60:0/1844089807 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f0dc00a9bc0 con 0x7f0dc0062c70 2020-10-31T22:48:12.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.029+0000 7f0daf7fe700 1 -- 172.21.15.60:0/1844089807 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v83) v1 ==== 110+0+10 (secure 0 0 0) 0x7f0db0023020 con 0x7f0dc0062c70 2020-10-31T22:48:12.036 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:48:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.029+0000 7f0dc84f7700 1 -- 172.21.15.60:0/1844089807 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0da0054f10 msgr2=0x7f0da00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.029+0000 7f0dc84f7700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0da0054f10 0x7f0da00573d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f0dbc00c000 tx=0x7f0dbc008040).stop 2020-10-31T22:48:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.029+0000 7f0dc84f7700 1 -- 172.21.15.60:0/1844089807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dc0062c70 msgr2=0x7f0dc0066e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.029+0000 7f0dc84f7700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dc0062c70 0x7f0dc0066e90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f0db0002f30 tx=0x7f0db0015000).stop 2020-10-31T22:48:12.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.029+0000 7f0dc84f7700 1 -- 172.21.15.60:0/1844089807 shutdown_connections 2020-10-31T22:48:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.029+0000 7f0dc84f7700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0dc00afbe0 0x7f0dc0067380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.029+0000 7f0dc84f7700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0da0054f10 0x7f0da00573d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.029+0000 7f0dc84f7700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0dc005bcb0 0x7f0dc0065290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.029+0000 7f0dc84f7700 1 --2- 172.21.15.60:0/1844089807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0dc0062c70 0x7f0dc0066e90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.029+0000 7f0dc84f7700 1 -- 172.21.15.60:0/1844089807 >> 172.21.15.60:0/1844089807 conn(0x7f0dc005fae0 msgr2=0x7f0dc0143750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.029+0000 7f0dc84f7700 1 -- 172.21.15.60:0/1844089807 shutdown_connections 2020-10-31T22:48:12.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.029+0000 7f0dc84f7700 1 -- 172.21.15.60:0/1844089807 wait complete. 2020-10-31T22:48:12.050 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:48:12.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.161+0000 7fa86f5f6700 1 Processor -- start 2020-10-31T22:48:12.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.161+0000 7fa86f5f6700 1 -- start start 2020-10-31T22:48:12.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86f5f6700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa8680af660 0x7fa86813c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86f5f6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8680aff20 0x7fa8680ae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86f5f6700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8680b2b70 con 0x7fa8680b2790 2020-10-31T22:48:12.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86f5f6700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8680b0db0 con 0x7fa8680af660 2020-10-31T22:48:12.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86f5f6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8680b1050 con 0x7fa8680aff20 2020-10-31T22:48:12.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86cb91700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa8680af660 0x7fa86813c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86db93700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8680aff20 0x7fa8680ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86cb91700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa8680af660 0x7fa86813c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:56958/0 (socket says 172.21.15.60:56958) 2020-10-31T22:48:12.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86cb91700 1 -- 172.21.15.60:0/3114413149 learned_addr learned my addr 172.21.15.60:0/3114413149 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:12.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86cb91700 1 -- 172.21.15.60:0/3114413149 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8680aff20 msgr2=0x7fa8680ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:12.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86cb91700 1 --2- 172.21.15.60:0/3114413149 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8680aff20 0x7fa8680ae520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86cb91700 1 -- 172.21.15.60:0/3114413149 >> v1:172.21.15.66:6789/0 conn(0x7fa8680b2790 legacy=0x7fa86813bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86cb91700 1 -- 172.21.15.60:0/3114413149 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8680b12f0 con 0x7fa8680af660 2020-10-31T22:48:12.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86db93700 1 --2- 172.21.15.60:0/3114413149 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8680aff20 0x7fa8680ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:12.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86cb91700 1 --2- 172.21.15.60:0/3114413149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8680af660 0x7fa86813c360 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fa858002f30 tx=0x7fa858006e80).ready entity=mon.1 client_cookie=29172f15bdcc4a29 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:12.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa85ffff700 1 -- 172.21.15.60:0/3114413149 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8580097f0 con 0x7fa8680af660 2020-10-31T22:48:12.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa85ffff700 1 -- 172.21.15.60:0/3114413149 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa858009950 con 0x7fa8680af660 2020-10-31T22:48:12.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa85ffff700 1 -- 172.21.15.60:0/3114413149 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa858009cb0 con 0x7fa8680af660 2020-10-31T22:48:12.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86f5f6700 1 -- 172.21.15.60:0/3114413149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8680af660 msgr2=0x7fa86813c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.165+0000 7fa86f5f6700 1 --2- 172.21.15.60:0/3114413149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8680af660 0x7fa86813c360 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7fa858002f30 tx=0x7fa858006e80).stop 2020-10-31T22:48:12.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.169+0000 7fa86f5f6700 1 -- 172.21.15.60:0/3114413149 shutdown_connections 2020-10-31T22:48:12.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.169+0000 7fa86f5f6700 1 --2- 172.21.15.60:0/3114413149 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8680aff20 0x7fa8680ae520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.169+0000 7fa86f5f6700 1 --2- 172.21.15.60:0/3114413149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8680af660 0x7fa86813c360 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.169+0000 7fa86f5f6700 1 -- 172.21.15.60:0/3114413149 >> 172.21.15.60:0/3114413149 conn(0x7fa8680b5d30 msgr2=0x7fa8680b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:12.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.169+0000 7fa86f5f6700 1 -- 172.21.15.60:0/3114413149 shutdown_connections 2020-10-31T22:48:12.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.169+0000 7fa86f5f6700 1 -- 172.21.15.60:0/3114413149 wait complete. 2020-10-31T22:48:12.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.169+0000 7fa86f5f6700 1 Processor -- start 2020-10-31T22:48:12.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.169+0000 7fa86f5f6700 1 -- start start 2020-10-31T22:48:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86f5f6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8680af660 0x7fa8680ac450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86f5f6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8680aff20 0x7fa868142100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86f5f6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8680b2790 0x7fa8681518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86f5f6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa868142d00 con 0x7fa8680af660 2020-10-31T22:48:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86f5f6700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86813f700 con 0x7fa8680b2790 2020-10-31T22:48:12.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86f5f6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa868151160 con 0x7fa8680aff20 2020-10-31T22:48:12.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86d392700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8680af660 0x7fa8680ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86d392700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8680af660 0x7fa8680ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46026/0 (socket says 172.21.15.60:46026) 2020-10-31T22:48:12.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86d392700 1 -- 172.21.15.60:0/1336561519 learned_addr learned my addr 172.21.15.60:0/1336561519 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:12.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86cb91700 1 --2- 172.21.15.60:0/1336561519 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8680aff20 0x7fa868142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86db93700 1 --2- 172.21.15.60:0/1336561519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8680b2790 0x7fa8681518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86d392700 1 -- 172.21.15.60:0/1336561519 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8680aff20 msgr2=0x7fa868142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86d392700 1 --2- 172.21.15.60:0/1336561519 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8680aff20 0x7fa868142100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86d392700 1 -- 172.21.15.60:0/1336561519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8680b2790 msgr2=0x7fa8681518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86d392700 1 --2- 172.21.15.60:0/1336561519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8680b2790 0x7fa8681518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86d392700 1 -- 172.21.15.60:0/1336561519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa868151400 con 0x7fa8680af660 2020-10-31T22:48:12.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86d392700 1 --2- 172.21.15.60:0/1336561519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8680af660 0x7fa8680ac450 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fa868062880 tx=0x7fa864007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:12.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa85e7fc700 1 -- 172.21.15.60:0/1336561519 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa8640027b0 con 0x7fa8680af660 2020-10-31T22:48:12.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa85e7fc700 1 -- 172.21.15.60:0/1336561519 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa864002910 con 0x7fa8680af660 2020-10-31T22:48:12.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa85e7fc700 1 -- 172.21.15.60:0/1336561519 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa864002c70 con 0x7fa8680af660 2020-10-31T22:48:12.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86f5f6700 1 -- 172.21.15.60:0/1336561519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8681425f0 con 0x7fa8680af660 2020-10-31T22:48:12.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86f5f6700 1 -- 172.21.15.60:0/1336561519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86813de20 con 0x7fa8680af660 2020-10-31T22:48:12.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.173+0000 7fa86f5f6700 1 -- 172.21.15.60:0/1336561519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa868151590 con 0x7fa8680af660 2020-10-31T22:48:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.177+0000 7fa85e7fc700 1 -- 172.21.15.60:0/1336561519 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa86401a460 con 0x7fa8680af660 2020-10-31T22:48:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.177+0000 7fa85e7fc700 1 --2- 172.21.15.60:0/1336561519 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa850054fd0 0x7fa850057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.177+0000 7fa85e7fc700 1 -- 172.21.15.60:0/1336561519 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa86406dba0 con 0x7fa8680af660 2020-10-31T22:48:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.177+0000 7fa86cb91700 1 --2- 172.21.15.60:0/1336561519 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa850054fd0 0x7fa850057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.177+0000 7fa86cb91700 1 --2- 172.21.15.60:0/1336561519 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa850054fd0 0x7fa850057490 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fa858020000 tx=0x7fa858015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:12.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.185+0000 7fa85e7fc700 1 -- 172.21.15.60:0/1336561519 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa864044280 con 0x7fa8680af660 2020-10-31T22:48:12.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.325+0000 7fa86f5f6700 1 -- 172.21.15.60:0/1336561519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa868057100 con 0x7fa8680af660 2020-10-31T22:48:12.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.325+0000 7fa85e7fc700 1 -- 172.21.15.60:0/1336561519 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v83) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa8640478a0 con 0x7fa8680af660 2020-10-31T22:48:12.331 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:48:12.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.325+0000 7fa86f5f6700 1 -- 172.21.15.60:0/1336561519 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa850054fd0 msgr2=0x7fa850057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.325+0000 7fa86f5f6700 1 --2- 172.21.15.60:0/1336561519 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa850054fd0 0x7fa850057490 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7fa858020000 tx=0x7fa858015000).stop 2020-10-31T22:48:12.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.325+0000 7fa86f5f6700 1 -- 172.21.15.60:0/1336561519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8680af660 msgr2=0x7fa8680ac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.325+0000 7fa86f5f6700 1 --2- 172.21.15.60:0/1336561519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8680af660 0x7fa8680ac450 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 rx=0x7fa868062880 tx=0x7fa864007c20).stop 2020-10-31T22:48:12.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.325+0000 7fa86f5f6700 1 -- 172.21.15.60:0/1336561519 shutdown_connections 2020-10-31T22:48:12.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.325+0000 7fa86f5f6700 1 --2- 172.21.15.60:0/1336561519 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa850054fd0 0x7fa850057490 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.325+0000 7fa86f5f6700 1 --2- 172.21.15.60:0/1336561519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8680b2790 0x7fa8681518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.325+0000 7fa86f5f6700 1 --2- 172.21.15.60:0/1336561519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8680af660 0x7fa8680ac450 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.325+0000 7fa86f5f6700 1 --2- 172.21.15.60:0/1336561519 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8680aff20 0x7fa868142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.325+0000 7fa86f5f6700 1 -- 172.21.15.60:0/1336561519 >> 172.21.15.60:0/1336561519 conn(0x7fa8680b5d30 msgr2=0x7fa8680b3750 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.325+0000 7fa86f5f6700 1 -- 172.21.15.60:0/1336561519 shutdown_connections 2020-10-31T22:48:12.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.325+0000 7fa86f5f6700 1 -- 172.21.15.60:0/1336561519 wait complete. 2020-10-31T22:48:12.345 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-10-31T22:48:12.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbcaaf85700 1 Processor -- start 2020-10-31T22:48:12.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbcaaf85700 1 -- start start 2020-10-31T22:48:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbcaaf85700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbca40b14f0 0x7fbca405b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbcaaf85700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbca40ae730 0x7fbca41402c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbcaaf85700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca40af920 con 0x7fbca40aeb90 2020-10-31T22:48:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbcaaf85700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca40b18d0 con 0x7fbca40ae730 2020-10-31T22:48:12.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbcaaf85700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca405f3c0 con 0x7fbca40b14f0 2020-10-31T22:48:12.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbca9782700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbca40ae730 0x7fbca41402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbca9f83700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbca40b14f0 0x7fbca405b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbca9782700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbca40ae730 0x7fbca41402c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:56972/0 (socket says 172.21.15.60:56972) 2020-10-31T22:48:12.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbca9782700 1 -- 172.21.15.60:0/344002543 learned_addr learned my addr 172.21.15.60:0/344002543 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:12.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbcaa784700 1 --1- 172.21.15.60:0/344002543 >> v1:172.21.15.66:6789/0 conn(0x7fbca40aeb90 0x7fbca41407b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:48042/0 (socket says 172.21.15.60:48042) 2020-10-31T22:48:12.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbca9782700 1 -- 172.21.15.60:0/344002543 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbca40b14f0 msgr2=0x7fbca405b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:12.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbca9782700 1 --2- 172.21.15.60:0/344002543 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbca40b14f0 0x7fbca405b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbca9782700 1 -- 172.21.15.60:0/344002543 >> v1:172.21.15.66:6789/0 conn(0x7fbca40aeb90 legacy=0x7fbca41407b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbca9782700 1 -- 172.21.15.60:0/344002543 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca40a55d0 con 0x7fbca40ae730 2020-10-31T22:48:12.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbca8f81700 1 -- 172.21.15.60:0/344002543 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951849483 0 0) 0x7fbca40af920 con 0x7fbca40aeb90 2020-10-31T22:48:12.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbca9782700 1 --2- 172.21.15.60:0/344002543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbca40ae730 0x7fbca41402c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fbc94002f30 tx=0x7fbc94006e80).ready entity=mon.1 client_cookie=8a53da6a6503fbb8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:12.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.453+0000 7fbca8f81700 1 -- 172.21.15.60:0/344002543 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc940097f0 con 0x7fbca40ae730 2020-10-31T22:48:12.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.457+0000 7fbca8f81700 1 -- 172.21.15.60:0/344002543 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc94009950 con 0x7fbca40ae730 2020-10-31T22:48:12.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.457+0000 7fbca8f81700 1 -- 172.21.15.60:0/344002543 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc94009cb0 con 0x7fbca40ae730 2020-10-31T22:48:12.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.457+0000 7fbcaaf85700 1 -- 172.21.15.60:0/344002543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbca40ae730 msgr2=0x7fbca41402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.457+0000 7fbcaaf85700 1 --2- 172.21.15.60:0/344002543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbca40ae730 0x7fbca41402c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7fbc94002f30 tx=0x7fbc94006e80).stop 2020-10-31T22:48:12.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.457+0000 7fbcaaf85700 1 -- 172.21.15.60:0/344002543 shutdown_connections 2020-10-31T22:48:12.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.457+0000 7fbcaaf85700 1 --2- 172.21.15.60:0/344002543 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbca40b14f0 0x7fbca405b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.457+0000 7fbcaaf85700 1 --2- 172.21.15.60:0/344002543 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbca40ae730 0x7fbca41402c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.457+0000 7fbcaaf85700 1 -- 172.21.15.60:0/344002543 >> 172.21.15.60:0/344002543 conn(0x7fbca4060de0 msgr2=0x7fbca4062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:12.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.457+0000 7fbcaaf85700 1 -- 172.21.15.60:0/344002543 shutdown_connections 2020-10-31T22:48:12.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.457+0000 7fbcaaf85700 1 -- 172.21.15.60:0/344002543 wait complete. 2020-10-31T22:48:12.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.457+0000 7fbcaaf85700 1 Processor -- start 2020-10-31T22:48:12.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.457+0000 7fbcaaf85700 1 -- start start 2020-10-31T22:48:12.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaaf85700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbca40ae730 0x7fbca4065190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaaf85700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbca40aeb90 0x7fbca40a6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaaf85700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca40b14f0 0x7fbca414e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaaf85700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4066f10 con 0x7fbca40b14f0 2020-10-31T22:48:12.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaaf85700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4064860 con 0x7fbca40aeb90 2020-10-31T22:48:12.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaaf85700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4065d00 con 0x7fbca40ae730 2020-10-31T22:48:12.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaa784700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca40b14f0 0x7fbca414e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaa784700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca40b14f0 0x7fbca414e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46044/0 (socket says 172.21.15.60:46044) 2020-10-31T22:48:12.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaa784700 1 -- 172.21.15.60:0/59629677 learned_addr learned my addr 172.21.15.60:0/59629677 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:12.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbca9782700 1 --2- 172.21.15.60:0/59629677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbca40aeb90 0x7fbca40a6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbca9f83700 1 --2- 172.21.15.60:0/59629677 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbca40ae730 0x7fbca4065190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaa784700 1 -- 172.21.15.60:0/59629677 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbca40ae730 msgr2=0x7fbca4065190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaa784700 1 --2- 172.21.15.60:0/59629677 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbca40ae730 0x7fbca4065190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaa784700 1 -- 172.21.15.60:0/59629677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbca40aeb90 msgr2=0x7fbca40a6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaa784700 1 --2- 172.21.15.60:0/59629677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbca40aeb90 0x7fbca40a6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaa784700 1 -- 172.21.15.60:0/59629677 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca4066c70 con 0x7fbca40b14f0 2020-10-31T22:48:12.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaa784700 1 --2- 172.21.15.60:0/59629677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca40b14f0 0x7fbca414e840 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fbc9c000f60 tx=0x7fbc9c007960).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:12.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbc92ffd700 1 -- 172.21.15.60:0/59629677 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc9c0072e0 con 0x7fbca40b14f0 2020-10-31T22:48:12.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbc92ffd700 1 -- 172.21.15.60:0/59629677 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c005570 con 0x7fbca40b14f0 2020-10-31T22:48:12.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaaf85700 1 -- 172.21.15.60:0/59629677 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca4064a50 con 0x7fbca40b14f0 2020-10-31T22:48:12.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbc92ffd700 1 -- 172.21.15.60:0/59629677 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc9c0058d0 con 0x7fbca40b14f0 2020-10-31T22:48:12.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.461+0000 7fbcaaf85700 1 -- 172.21.15.60:0/59629677 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca4066820 con 0x7fbca40b14f0 2020-10-31T22:48:12.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.465+0000 7fbcaaf85700 1 -- 172.21.15.60:0/59629677 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca4066ad0 con 0x7fbca40b14f0 2020-10-31T22:48:12.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.465+0000 7fbc92ffd700 1 -- 172.21.15.60:0/59629677 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbc9c01a060 con 0x7fbca40b14f0 2020-10-31T22:48:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.465+0000 7fbc92ffd700 1 --2- 172.21.15.60:0/59629677 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc84054f90 0x7fbc84057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.465+0000 7fbc92ffd700 1 -- 172.21.15.60:0/59629677 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fbc9c06cd50 con 0x7fbca40b14f0 2020-10-31T22:48:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.465+0000 7fbca9f83700 1 --2- 172.21.15.60:0/59629677 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc84054f90 0x7fbc84057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.465+0000 7fbca9f83700 1 --2- 172.21.15.60:0/59629677 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc84054f90 0x7fbc84057450 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fbca000b000 tx=0x7fbca00091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:12.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.469+0000 7fbc92ffd700 1 -- 172.21.15.60:0/59629677 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbca4066ad0 con 0x7fbca40b14f0 2020-10-31T22:48:12.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.613+0000 7fbcaaf85700 1 -- 172.21.15.60:0/59629677 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fbca4066ad0 con 0x7fbca40b14f0 2020-10-31T22:48:12.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.613+0000 7fbc92ffd700 1 -- 172.21.15.60:0/59629677 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v83) v1 ==== 84+0+143 (secure 0 0 0) 0x7fbca4066ad0 con 0x7fbca40b14f0 2020-10-31T22:48:12.622 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:12.622 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2020-10-31T22:48:12.622 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:12.623 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2020-10-31T22:48:12.623 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "device_health_metrics" 2020-10-31T22:48:12.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:12.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:12.623 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2020-10-31T22:48:12.623 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2020-10-31T22:48:12.623 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:12.624 INFO:teuthology.orchestra.run.smithi060.stdout:] 2020-10-31T22:48:12.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.617+0000 7fbcaaf85700 1 -- 172.21.15.60:0/59629677 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc84054f90 msgr2=0x7fbc84057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.617+0000 7fbcaaf85700 1 --2- 172.21.15.60:0/59629677 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc84054f90 0x7fbc84057450 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7fbca000b000 tx=0x7fbca00091a0).stop 2020-10-31T22:48:12.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.617+0000 7fbcaaf85700 1 -- 172.21.15.60:0/59629677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca40b14f0 msgr2=0x7fbca414e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.617+0000 7fbcaaf85700 1 --2- 172.21.15.60:0/59629677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca40b14f0 0x7fbca414e840 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 rx=0x7fbc9c000f60 tx=0x7fbc9c007960).stop 2020-10-31T22:48:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.617+0000 7fbcaaf85700 1 -- 172.21.15.60:0/59629677 shutdown_connections 2020-10-31T22:48:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.617+0000 7fbcaaf85700 1 --2- 172.21.15.60:0/59629677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbca40b14f0 0x7fbca414e840 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.617+0000 7fbcaaf85700 1 --2- 172.21.15.60:0/59629677 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbca40ae730 0x7fbca4065190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.617+0000 7fbcaaf85700 1 --2- 172.21.15.60:0/59629677 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc84054f90 0x7fbc84057450 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.617+0000 7fbcaaf85700 1 --2- 172.21.15.60:0/59629677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbca40aeb90 0x7fbca40a6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.617+0000 7fbcaaf85700 1 -- 172.21.15.60:0/59629677 >> 172.21.15.60:0/59629677 conn(0x7fbca4060de0 msgr2=0x7fbca40b42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:12.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.617+0000 7fbcaaf85700 1 -- 172.21.15.60:0/59629677 shutdown_connections 2020-10-31T22:48:12.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.617+0000 7fbcaaf85700 1 -- 172.21.15.60:0/59629677 wait complete. 2020-10-31T22:48:12.637 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-10-31T22:48:12.638 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:48:12.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1642a94700 1 Processor -- start 2020-10-31T22:48:12.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1642a94700 1 -- start start 2020-10-31T22:48:12.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1642a94700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f163c0a95e0 0x7f163c0a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1642a94700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f163c05b440 0x7f163c05b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1642a94700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f163c0a75d0 con 0x7f163c066830 2020-10-31T22:48:12.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1642a94700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163c05afe0 con 0x7f163c05b440 2020-10-31T22:48:12.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1642a94700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c0a8e00 con 0x7f163c0a95e0 2020-10-31T22:48:12.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1641291700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f163c05b440 0x7f163c05b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1641a92700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f163c0a95e0 0x7f163c0a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1641291700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f163c05b440 0x7f163c05b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:56984/0 (socket says 172.21.15.60:56984) 2020-10-31T22:48:12.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1641291700 1 -- 172.21.15.60:0/2338251029 learned_addr learned my addr 172.21.15.60:0/2338251029 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:12.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1642293700 1 --1- 172.21.15.60:0/2338251029 >> v1:172.21.15.66:6789/0 conn(0x7f163c066830 0x7f163c066c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:48052/0 (socket says 172.21.15.60:48052) 2020-10-31T22:48:12.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1641291700 1 -- 172.21.15.60:0/2338251029 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f163c0a95e0 msgr2=0x7f163c0a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:12.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1641291700 1 --2- 172.21.15.60:0/2338251029 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f163c0a95e0 0x7f163c0a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1641291700 1 -- 172.21.15.60:0/2338251029 >> v1:172.21.15.66:6789/0 conn(0x7f163c066830 legacy=0x7f163c066c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1641291700 1 -- 172.21.15.60:0/2338251029 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c0aeaf0 con 0x7f163c05b440 2020-10-31T22:48:12.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1641291700 1 --2- 172.21.15.60:0/2338251029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163c05b440 0x7f163c05b8a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f162c002f30 tx=0x7f162c006e80).ready entity=mon.1 client_cookie=c7fd2ffadec06b89 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:12.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1640a90700 1 -- 172.21.15.60:0/2338251029 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f162c0097f0 con 0x7f163c05b440 2020-10-31T22:48:12.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1640a90700 1 -- 172.21.15.60:0/2338251029 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c009950 con 0x7f163c05b440 2020-10-31T22:48:12.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1642a94700 1 -- 172.21.15.60:0/2338251029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163c05b440 msgr2=0x7f163c05b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.745+0000 7f1642a94700 1 --2- 172.21.15.60:0/2338251029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163c05b440 0x7f163c05b8a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f162c002f30 tx=0x7f162c006e80).stop 2020-10-31T22:48:12.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.749+0000 7f1642a94700 1 -- 172.21.15.60:0/2338251029 shutdown_connections 2020-10-31T22:48:12.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.749+0000 7f1642a94700 1 --2- 172.21.15.60:0/2338251029 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f163c0a95e0 0x7f163c0a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.749+0000 7f1642a94700 1 --2- 172.21.15.60:0/2338251029 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163c05b440 0x7f163c05b8a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.749+0000 7f1642a94700 1 -- 172.21.15.60:0/2338251029 >> 172.21.15.60:0/2338251029 conn(0x7f163c0b3fd0 msgr2=0x7f163c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:12.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.749+0000 7f1642a94700 1 -- 172.21.15.60:0/2338251029 shutdown_connections 2020-10-31T22:48:12.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.749+0000 7f1642a94700 1 -- 172.21.15.60:0/2338251029 wait complete. 2020-10-31T22:48:12.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.749+0000 7f1642a94700 1 Processor -- start 2020-10-31T22:48:12.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.749+0000 7f1642a94700 1 -- start start 2020-10-31T22:48:12.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1642a94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f163c05b440 0x7f163c1424c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1642a94700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163c066830 0x7f163c152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1642a94700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f163c0a95e0 0x7f163c14e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1642a94700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c152c60 con 0x7f163c05b440 2020-10-31T22:48:12.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1642a94700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163c061e10 con 0x7f163c066830 2020-10-31T22:48:12.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1642a94700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163c1454a0 con 0x7f163c0a95e0 2020-10-31T22:48:12.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1641a92700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f163c05b440 0x7f163c1424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1641a92700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f163c05b440 0x7f163c1424c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46054/0 (socket says 172.21.15.60:46054) 2020-10-31T22:48:12.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1641a92700 1 -- 172.21.15.60:0/1351201741 learned_addr learned my addr 172.21.15.60:0/1351201741 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:12.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1641291700 1 --2- 172.21.15.60:0/1351201741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163c066830 0x7f163c152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1642293700 1 --2- 172.21.15.60:0/1351201741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f163c0a95e0 0x7f163c14e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1641a92700 1 -- 172.21.15.60:0/1351201741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f163c0a95e0 msgr2=0x7f163c14e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1641a92700 1 --2- 172.21.15.60:0/1351201741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f163c0a95e0 0x7f163c14e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1641a92700 1 -- 172.21.15.60:0/1351201741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163c066830 msgr2=0x7f163c152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:12.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1641a92700 1 --2- 172.21.15.60:0/1351201741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163c066830 0x7f163c152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:12.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1641a92700 1 -- 172.21.15.60:0/1351201741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c145740 con 0x7f163c05b440 2020-10-31T22:48:12.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1641a92700 1 --2- 172.21.15.60:0/1351201741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f163c05b440 0x7f163c1424c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f163800c000 tx=0x7f1638006d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:12.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f162affd700 1 -- 172.21.15.60:0/1351201741 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1638010780 con 0x7f163c05b440 2020-10-31T22:48:12.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f162affd700 1 -- 172.21.15.60:0/1351201741 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16380108e0 con 0x7f163c05b440 2020-10-31T22:48:12.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1642a94700 1 -- 172.21.15.60:0/1351201741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f163c061900 con 0x7f163c05b440 2020-10-31T22:48:12.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f162affd700 1 -- 172.21.15.60:0/1351201741 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1638010c40 con 0x7f163c05b440 2020-10-31T22:48:12.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.753+0000 7f1642a94700 1 -- 172.21.15.60:0/1351201741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f163c061be0 con 0x7f163c05b440 2020-10-31T22:48:12.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.757+0000 7f1642a94700 1 -- 172.21.15.60:0/1351201741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163c057100 con 0x7f163c05b440 2020-10-31T22:48:12.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.757+0000 7f162affd700 1 -- 172.21.15.60:0/1351201741 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f163801b410 con 0x7f163c05b440 2020-10-31T22:48:12.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.757+0000 7f162affd700 1 --2- 172.21.15.60:0/1351201741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f161c054f10 0x7f161c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:12.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.757+0000 7f162affd700 1 -- 172.21.15.60:0/1351201741 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f163806d800 con 0x7f163c05b440 2020-10-31T22:48:12.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.757+0000 7f1641291700 1 --2- 172.21.15.60:0/1351201741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f161c054f10 0x7f161c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:12.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.757+0000 7f1641291700 1 --2- 172.21.15.60:0/1351201741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f161c054f10 0x7f161c0573d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f162c01c000 tx=0x7f162c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:12.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.765+0000 7f162affd700 1 -- 172.21.15.60:0/1351201741 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1638043ee0 con 0x7f163c05b440 2020-10-31T22:48:12.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:12.909+0000 7f1642a94700 1 -- 172.21.15.60:0/1351201741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f163c061fe0 con 0x7f163c05b440 2020-10-31T22:48:13.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:13.909+0000 7f162affd700 1 -- 172.21.15.60:0/1351201741 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v84) v1 ==== 133+0+0 (secure 0 0 0) 0x7f1638047500 con 0x7f163c05b440 2020-10-31T22:48:13.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:13.913+0000 7f1642a94700 1 -- 172.21.15.60:0/1351201741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f161c054f10 msgr2=0x7f161c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:13.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:13.913+0000 7f1642a94700 1 --2- 172.21.15.60:0/1351201741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f161c054f10 0x7f161c0573d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f162c01c000 tx=0x7f162c015000).stop 2020-10-31T22:48:13.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:13.913+0000 7f1642a94700 1 -- 172.21.15.60:0/1351201741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f163c05b440 msgr2=0x7f163c1424c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:13.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:13.913+0000 7f1642a94700 1 --2- 172.21.15.60:0/1351201741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f163c05b440 0x7f163c1424c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 rx=0x7f163800c000 tx=0x7f1638006d60).stop 2020-10-31T22:48:13.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:13.913+0000 7f1642a94700 1 -- 172.21.15.60:0/1351201741 shutdown_connections 2020-10-31T22:48:13.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:13.913+0000 7f1642a94700 1 --2- 172.21.15.60:0/1351201741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f163c0a95e0 0x7f163c14e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:13.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:13.913+0000 7f1642a94700 1 --2- 172.21.15.60:0/1351201741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f163c05b440 0x7f163c1424c0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:13.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:13.913+0000 7f1642a94700 1 --2- 172.21.15.60:0/1351201741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f161c054f10 0x7f161c0573d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:13.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:13.913+0000 7f1642a94700 1 --2- 172.21.15.60:0/1351201741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163c066830 0x7f163c152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:13.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:13.913+0000 7f1642a94700 1 -- 172.21.15.60:0/1351201741 >> 172.21.15.60:0/1351201741 conn(0x7f163c0b3fd0 msgr2=0x7f163c0aa2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:13.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:13.913+0000 7f1642a94700 1 -- 172.21.15.60:0/1351201741 shutdown_connections 2020-10-31T22:48:13.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:13.913+0000 7f1642a94700 1 -- 172.21.15.60:0/1351201741 wait complete. 2020-10-31T22:48:13.925 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:48:13.937 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-10-31T22:48:14.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.061+0000 7fa609b1e700 1 Processor -- start 2020-10-31T22:48:14.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.061+0000 7fa609b1e700 1 -- start start 2020-10-31T22:48:14.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.065+0000 7fa609b1e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa6040b1d50 0x7fa6040ac020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:14.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.065+0000 7fa609b1e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60413f630 con 0x7fa6040a8140 2020-10-31T22:48:14.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.065+0000 7fa609b1e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6040b2130 con 0x7fa60413bcc0 2020-10-31T22:48:14.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.065+0000 7fa609b1e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6040ae220 con 0x7fa6040b1d50 2020-10-31T22:48:14.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.065+0000 7fa60931d700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa60413bcc0 0x7fa60413c170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:48070/0 (socket says 172.21.15.60:48070) 2020-10-31T22:48:14.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.065+0000 7fa60931d700 1 -- 172.21.15.60:0/3842056239 learned_addr learned my addr 172.21.15.60:0/3842056239 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:14.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.065+0000 7fa608b1c700 1 --2- 172.21.15.60:0/3842056239 >> v2:172.21.15.66:3300/0 conn(0x7fa6040b1d50 0x7fa6040ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:14.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.065+0000 7fa608b1c700 1 -- 172.21.15.60:0/3842056239 >> v1:172.21.15.66:6789/0 conn(0x7fa60413bcc0 legacy=0x7fa60413c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:14.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.065+0000 7fa608b1c700 1 -- 172.21.15.60:0/3842056239 >> v1:172.21.15.60:6789/0 conn(0x7fa6040a8140 legacy=0x7fa6040adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:14.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.065+0000 7fa608b1c700 1 -- 172.21.15.60:0/3842056239 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60405c0f0 con 0x7fa6040b1d50 2020-10-31T22:48:14.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.065+0000 7fa608b1c700 1 --2- 172.21.15.60:0/3842056239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6040b1d50 0x7fa6040ac020 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fa6040ada60 tx=0x7fa5f8006dc0).ready entity=mon.1 client_cookie=605885e92620ea5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:14.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.069+0000 7fa6037fe700 1 -- 172.21.15.60:0/3842056239 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f80097b0 con 0x7fa6040b1d50 2020-10-31T22:48:14.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.069+0000 7fa6037fe700 1 -- 172.21.15.60:0/3842056239 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f8009910 con 0x7fa6040b1d50 2020-10-31T22:48:14.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.069+0000 7fa6037fe700 1 -- 172.21.15.60:0/3842056239 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5f8009cb0 con 0x7fa6040b1d50 2020-10-31T22:48:14.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.069+0000 7fa609b1e700 1 -- 172.21.15.60:0/3842056239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6040b1d50 msgr2=0x7fa6040ac020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:14.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.069+0000 7fa609b1e700 1 --2- 172.21.15.60:0/3842056239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6040b1d50 0x7fa6040ac020 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fa6040ada60 tx=0x7fa5f8006dc0).stop 2020-10-31T22:48:14.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.069+0000 7fa609b1e700 1 -- 172.21.15.60:0/3842056239 shutdown_connections 2020-10-31T22:48:14.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa609b1e700 1 --2- 172.21.15.60:0/3842056239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6040b1d50 0x7fa6040ac020 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:14.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa609b1e700 1 -- 172.21.15.60:0/3842056239 >> 172.21.15.60:0/3842056239 conn(0x7fa6040b5330 msgr2=0x7fa6040b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:14.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa609b1e700 1 -- 172.21.15.60:0/3842056239 shutdown_connections 2020-10-31T22:48:14.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa609b1e700 1 -- 172.21.15.60:0/3842056239 wait complete. 2020-10-31T22:48:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa609b1e700 1 Processor -- start 2020-10-31T22:48:14.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa609b1e700 1 -- start start 2020-10-31T22:48:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa609b1e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6040a8140 0x7fa60405b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa609b1e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6040b1d50 0x7fa6040af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa609b1e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa60413bcc0 0x7fa6040af740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:14.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa609b1e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040a7df0 con 0x7fa6040b1d50 2020-10-31T22:48:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa609b1e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040b0d40 con 0x7fa60413bcc0 2020-10-31T22:48:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa609b1e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6040aab10 con 0x7fa6040a8140 2020-10-31T22:48:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa603fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6040b1d50 0x7fa6040af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa603fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6040b1d50 0x7fa6040af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46070/0 (socket says 172.21.15.60:46070) 2020-10-31T22:48:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa603fff700 1 -- 172.21.15.60:0/2235556506 learned_addr learned my addr 172.21.15.60:0/2235556506 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:14.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa608b1c700 1 --2- 172.21.15.60:0/2235556506 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6040a8140 0x7fa60405b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa60931d700 1 --2- 172.21.15.60:0/2235556506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa60413bcc0 0x7fa6040af740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa603fff700 1 -- 172.21.15.60:0/2235556506 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6040a8140 msgr2=0x7fa60405b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa603fff700 1 --2- 172.21.15.60:0/2235556506 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6040a8140 0x7fa60405b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa603fff700 1 -- 172.21.15.60:0/2235556506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa60413bcc0 msgr2=0x7fa6040af740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa603fff700 1 --2- 172.21.15.60:0/2235556506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa60413bcc0 0x7fa6040af740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:14.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa603fff700 1 -- 172.21.15.60:0/2235556506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6040b1160 con 0x7fa6040b1d50 2020-10-31T22:48:14.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa603fff700 1 --2- 172.21.15.60:0/2235556506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6040b1d50 0x7fa6040af250 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fa604060ee0 tx=0x7fa5fc007f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:14.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa601ffb700 1 -- 172.21.15.60:0/2235556506 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5fc00ce10 con 0x7fa6040b1d50 2020-10-31T22:48:14.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa601ffb700 1 -- 172.21.15.60:0/2235556506 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc006a70 con 0x7fa6040b1d50 2020-10-31T22:48:14.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa609b1e700 1 -- 172.21.15.60:0/2235556506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6040b0aa0 con 0x7fa6040b1d50 2020-10-31T22:48:14.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa601ffb700 1 -- 172.21.15.60:0/2235556506 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa5fc006dd0 con 0x7fa6040b1d50 2020-10-31T22:48:14.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.073+0000 7fa609b1e700 1 -- 172.21.15.60:0/2235556506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa604146380 con 0x7fa6040b1d50 2020-10-31T22:48:14.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.077+0000 7fa609b1e700 1 -- 172.21.15.60:0/2235556506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa604057100 con 0x7fa6040b1d50 2020-10-31T22:48:14.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.077+0000 7fa601ffb700 1 -- 172.21.15.60:0/2235556506 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa5fc010030 con 0x7fa6040b1d50 2020-10-31T22:48:14.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.077+0000 7fa601ffb700 1 --2- 172.21.15.60:0/2235556506 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5e4054f10 0x7fa5e40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:14.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.077+0000 7fa601ffb700 1 -- 172.21.15.60:0/2235556506 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fa5fc003070 con 0x7fa6040b1d50 2020-10-31T22:48:14.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.077+0000 7fa608b1c700 1 --2- 172.21.15.60:0/2235556506 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5e4054f10 0x7fa5e40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:14.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.077+0000 7fa608b1c700 1 --2- 172.21.15.60:0/2235556506 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5e4054f10 0x7fa5e40573d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fa5f801b000 tx=0x7fa5f8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:14.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.081+0000 7fa601ffb700 1 -- 172.21.15.60:0/2235556506 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa5fc043ee0 con 0x7fa6040b1d50 2020-10-31T22:48:14.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:14.221+0000 7fa609b1e700 1 -- 172.21.15.60:0/2235556506 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fa6040b12f0 con 0x7fa6040b1d50 2020-10-31T22:48:15.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.073+0000 7fa601ffb700 1 -- 172.21.15.60:0/2235556506 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v86) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa5fc047500 con 0x7fa6040b1d50 2020-10-31T22:48:15.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.085+0000 7fa609b1e700 1 -- 172.21.15.60:0/2235556506 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5e4054f10 msgr2=0x7fa5e40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.085+0000 7fa609b1e700 1 --2- 172.21.15.60:0/2235556506 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5e4054f10 0x7fa5e40573d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fa5f801b000 tx=0x7fa5f8015000).stop 2020-10-31T22:48:15.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.085+0000 7fa609b1e700 1 -- 172.21.15.60:0/2235556506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6040b1d50 msgr2=0x7fa6040af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.085+0000 7fa609b1e700 1 --2- 172.21.15.60:0/2235556506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6040b1d50 0x7fa6040af250 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 rx=0x7fa604060ee0 tx=0x7fa5fc007f60).stop 2020-10-31T22:48:15.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.085+0000 7fa609b1e700 1 -- 172.21.15.60:0/2235556506 shutdown_connections 2020-10-31T22:48:15.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.085+0000 7fa609b1e700 1 --2- 172.21.15.60:0/2235556506 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5e4054f10 0x7fa5e40573d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.085+0000 7fa609b1e700 1 --2- 172.21.15.60:0/2235556506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa60413bcc0 0x7fa6040af740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.085+0000 7fa609b1e700 1 --2- 172.21.15.60:0/2235556506 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa6040a8140 0x7fa60405b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.085+0000 7fa609b1e700 1 --2- 172.21.15.60:0/2235556506 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6040b1d50 0x7fa6040af250 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.085+0000 7fa609b1e700 1 -- 172.21.15.60:0/2235556506 >> 172.21.15.60:0/2235556506 conn(0x7fa6040b5330 msgr2=0x7fa60413eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:15.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.085+0000 7fa609b1e700 1 -- 172.21.15.60:0/2235556506 shutdown_connections 2020-10-31T22:48:15.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.085+0000 7fa609b1e700 1 -- 172.21.15.60:0/2235556506 wait complete. 2020-10-31T22:48:15.094 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2020-10-31T22:48:15.106 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-10-31T22:48:15.144 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:48:15.155 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:48:15.158 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:48:15.160 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:48:15.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.217+0000 7fec32ee5700 1 Processor -- start 2020-10-31T22:48:15.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.217+0000 7fec32ee5700 1 -- start start 2020-10-31T22:48:15.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec32ee5700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fec2c0b5950 0x7fec2c142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec32ee5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c142b00 con 0x7fec2c0b24a0 2020-10-31T22:48:15.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec32ee5700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec2c0b4440 con 0x7fec2c0b5570 2020-10-31T22:48:15.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec32ee5700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2c13f930 con 0x7fec2c0b5950 2020-10-31T22:48:15.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec316e2700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fec2c0b24a0 0x7fec2c141f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50216/0 (socket says 172.21.15.60:50216) 2020-10-31T22:48:15.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec316e2700 1 -- 172.21.15.60:0/3295668583 learned_addr learned my addr 172.21.15.60:0/3295668583 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:15.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec326e4700 1 --2- 172.21.15.60:0/3295668583 >> v2:172.21.15.66:3300/0 conn(0x7fec2c0b5950 0x7fec2c142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 -- 172.21.15.60:0/3295668583 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228168669 0 0) 0x7fec2c142b00 con 0x7fec2c0b24a0 2020-10-31T22:48:15.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 -- 172.21.15.60:0/3295668583 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec14003230 con 0x7fec2c0b24a0 2020-10-31T22:48:15.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 -- 172.21.15.60:0/3295668583 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1966097886 0 0) 0x7fec14003230 con 0x7fec2c0b24a0 2020-10-31T22:48:15.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 -- 172.21.15.60:0/3295668583 >> v2:172.21.15.66:3300/0 conn(0x7fec2c0b5950 msgr2=0x7fec2c142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 --2- 172.21.15.60:0/3295668583 >> v2:172.21.15.66:3300/0 conn(0x7fec2c0b5950 0x7fec2c142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 -- 172.21.15.60:0/3295668583 >> v1:172.21.15.66:6789/0 conn(0x7fec2c0b5570 legacy=0x7fec2c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 -- 172.21.15.60:0/3295668583 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c146060 con 0x7fec2c0b24a0 2020-10-31T22:48:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 -- 172.21.15.60:0/3295668583 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fec280016d0 con 0x7fec2c0b24a0 2020-10-31T22:48:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 -- 172.21.15.60:0/3295668583 >> v1:172.21.15.60:6789/0 conn(0x7fec2c0b24a0 legacy=0x7fec2c141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 --2- 172.21.15.60:0/3295668583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec14003720 0x7fec14003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 --2- 172.21.15.60:0/3295668583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec140044d0 0x7fec14004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 --2- 172.21.15.60:0/3295668583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec14004e40 0x7fec1400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 -- 172.21.15.60:0/3295668583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c13f930 con 0x7fec140044d0 2020-10-31T22:48:15.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 -- 172.21.15.60:0/3295668583 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec14004340 con 0x7fec14003720 2020-10-31T22:48:15.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 -- 172.21.15.60:0/3295668583 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1400bc40 con 0x7fec14004e40 2020-10-31T22:48:15.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec316e2700 1 --2- 172.21.15.60:0/3295668583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec140044d0 0x7fec14004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec31ee3700 1 --2- 172.21.15.60:0/3295668583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec14003720 0x7fec14003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec326e4700 1 --2- 172.21.15.60:0/3295668583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec14004e40 0x7fec1400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec316e2700 1 -- 172.21.15.60:0/3295668583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec14004e40 msgr2=0x7fec1400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:15.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec316e2700 1 --2- 172.21.15.60:0/3295668583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec14004e40 0x7fec1400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec316e2700 1 -- 172.21.15.60:0/3295668583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec14003720 msgr2=0x7fec14003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:15.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec316e2700 1 --2- 172.21.15.60:0/3295668583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec14003720 0x7fec14003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec316e2700 1 -- 172.21.15.60:0/3295668583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec14003230 con 0x7fec140044d0 2020-10-31T22:48:15.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec326e4700 1 --2- 172.21.15.60:0/3295668583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec14004e40 0x7fec1400b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:15.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec326e4700 1 -- 172.21.15.60:0/3295668583 reap_dead start 2020-10-31T22:48:15.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec316e2700 1 --2- 172.21.15.60:0/3295668583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec140044d0 0x7fec14004950 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fec280013e0 tx=0x7fec2c061260).ready entity=mon.0 client_cookie=142d15fa6747e042 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:15.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 -- 172.21.15.60:0/3295668583 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec280070d0 con 0x7fec140044d0 2020-10-31T22:48:15.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 -- 172.21.15.60:0/3295668583 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec28007230 con 0x7fec140044d0 2020-10-31T22:48:15.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec30ee1700 1 -- 172.21.15.60:0/3295668583 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec280055e0 con 0x7fec140044d0 2020-10-31T22:48:15.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec32ee5700 1 -- 172.21.15.60:0/3295668583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec140044d0 msgr2=0x7fec14004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec32ee5700 1 --2- 172.21.15.60:0/3295668583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec140044d0 0x7fec14004950 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 rx=0x7fec280013e0 tx=0x7fec2c061260).stop 2020-10-31T22:48:15.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec32ee5700 1 -- 172.21.15.60:0/3295668583 shutdown_connections 2020-10-31T22:48:15.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec32ee5700 1 --2- 172.21.15.60:0/3295668583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec140044d0 0x7fec14004950 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec32ee5700 1 -- 172.21.15.60:0/3295668583 >> 172.21.15.60:0/3295668583 conn(0x7fec2c0b8e90 msgr2=0x7fec2c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:15.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec32ee5700 1 -- 172.21.15.60:0/3295668583 shutdown_connections 2020-10-31T22:48:15.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.221+0000 7fec32ee5700 1 -- 172.21.15.60:0/3295668583 wait complete. 2020-10-31T22:48:15.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec32ee5700 1 Processor -- start 2020-10-31T22:48:15.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec32ee5700 1 -- start start 2020-10-31T22:48:15.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec32ee5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec140044d0 0x7fec2c0a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec32ee5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec2c148ec0 0x7fec2c13e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec32ee5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec2c13ea40 0x7fec2c09de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec32ee5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c0a11d0 con 0x7fec140044d0 2020-10-31T22:48:15.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec32ee5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c148c50 con 0x7fec2c13ea40 2020-10-31T22:48:15.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec32ee5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2c1481c0 con 0x7fec2c148ec0 2020-10-31T22:48:15.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec31ee3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec140044d0 0x7fec2c0a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec31ee3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec140044d0 0x7fec2c0a0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46092/0 (socket says 172.21.15.60:46092) 2020-10-31T22:48:15.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec31ee3700 1 -- 172.21.15.60:0/2660619810 learned_addr learned my addr 172.21.15.60:0/2660619810 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:15.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec316e2700 1 --2- 172.21.15.60:0/2660619810 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec2c148ec0 0x7fec2c13e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec326e4700 1 --2- 172.21.15.60:0/2660619810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec2c13ea40 0x7fec2c09de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec31ee3700 1 -- 172.21.15.60:0/2660619810 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec2c148ec0 msgr2=0x7fec2c13e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec31ee3700 1 --2- 172.21.15.60:0/2660619810 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec2c148ec0 0x7fec2c13e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec31ee3700 1 -- 172.21.15.60:0/2660619810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec2c13ea40 msgr2=0x7fec2c09de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec31ee3700 1 --2- 172.21.15.60:0/2660619810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec2c13ea40 0x7fec2c09de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec31ee3700 1 -- 172.21.15.60:0/2660619810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c148460 con 0x7fec140044d0 2020-10-31T22:48:15.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec31ee3700 1 --2- 172.21.15.60:0/2660619810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec140044d0 0x7fec2c0a0950 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fec2000b000 tx=0x7fec20009040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:15.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec1effd700 1 -- 172.21.15.60:0/2660619810 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec200155f0 con 0x7fec140044d0 2020-10-31T22:48:15.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec1effd700 1 -- 172.21.15.60:0/2660619810 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec20010040 con 0x7fec140044d0 2020-10-31T22:48:15.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec32ee5700 1 -- 172.21.15.60:0/2660619810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec2c1488d0 con 0x7fec140044d0 2020-10-31T22:48:15.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec1effd700 1 -- 172.21.15.60:0/2660619810 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec20015940 con 0x7fec140044d0 2020-10-31T22:48:15.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.225+0000 7fec32ee5700 1 -- 172.21.15.60:0/2660619810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec2c13f070 con 0x7fec140044d0 2020-10-31T22:48:15.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.229+0000 7fec32ee5700 1 -- 172.21.15.60:0/2660619810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec2c1517a0 con 0x7fec140044d0 2020-10-31T22:48:15.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.229+0000 7fec1effd700 1 -- 172.21.15.60:0/2660619810 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fec20015aa0 con 0x7fec140044d0 2020-10-31T22:48:15.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.229+0000 7fec1effd700 1 --2- 172.21.15.60:0/2660619810 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fec0c055020 0x7fec0c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.229+0000 7fec1effd700 1 -- 172.21.15.60:0/2660619810 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fec2006dab0 con 0x7fec140044d0 2020-10-31T22:48:15.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.229+0000 7fec316e2700 1 --2- 172.21.15.60:0/2660619810 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fec0c055020 0x7fec0c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.229+0000 7fec316e2700 1 --2- 172.21.15.60:0/2660619810 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fec0c055020 0x7fec0c0574e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fec28019000 tx=0x7fec28015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:15.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.237+0000 7fec1effd700 1 -- 172.21.15.60:0/2660619810 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fec20043fa0 con 0x7fec140044d0 2020-10-31T22:48:15.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.429+0000 7fec32ee5700 1 -- 172.21.15.60:0/2660619810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fec2c148ac0 con 0x7fec140044d0 2020-10-31T22:48:15.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.437+0000 7fec1effd700 1 -- 172.21.15.60:0/2660619810 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 15 and data pool 16 v40) v1 ==== 189+0+0 (secure 0 0 0) 0x7fec200475c0 con 0x7fec140044d0 2020-10-31T22:48:15.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.441+0000 7fec32ee5700 1 -- 172.21.15.60:0/2660619810 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fec0c055020 msgr2=0x7fec0c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.441+0000 7fec32ee5700 1 --2- 172.21.15.60:0/2660619810 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fec0c055020 0x7fec0c0574e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fec28019000 tx=0x7fec28015000).stop 2020-10-31T22:48:15.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.441+0000 7fec32ee5700 1 -- 172.21.15.60:0/2660619810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec140044d0 msgr2=0x7fec2c0a0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.441+0000 7fec32ee5700 1 --2- 172.21.15.60:0/2660619810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec140044d0 0x7fec2c0a0950 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 rx=0x7fec2000b000 tx=0x7fec20009040).stop 2020-10-31T22:48:15.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.441+0000 7fec32ee5700 1 -- 172.21.15.60:0/2660619810 shutdown_connections 2020-10-31T22:48:15.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.441+0000 7fec32ee5700 1 --2- 172.21.15.60:0/2660619810 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fec0c055020 0x7fec0c0574e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.441+0000 7fec32ee5700 1 --2- 172.21.15.60:0/2660619810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec2c13ea40 0x7fec2c09de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.441+0000 7fec32ee5700 1 --2- 172.21.15.60:0/2660619810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fec140044d0 0x7fec2c0a0950 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.441+0000 7fec32ee5700 1 --2- 172.21.15.60:0/2660619810 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec2c148ec0 0x7fec2c13e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.441+0000 7fec32ee5700 1 -- 172.21.15.60:0/2660619810 >> 172.21.15.60:0/2660619810 conn(0x7fec2c0b8e90 msgr2=0x7fec2c0b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:15.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.441+0000 7fec32ee5700 1 -- 172.21.15.60:0/2660619810 shutdown_connections 2020-10-31T22:48:15.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.441+0000 7fec32ee5700 1 -- 172.21.15.60:0/2660619810 wait complete. 2020-10-31T22:48:15.455 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 15 and data pool 16 2020-10-31T22:48:15.471 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:48:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faefd471700 1 Processor -- start 2020-10-31T22:48:15.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faefd471700 1 -- start start 2020-10-31T22:48:15.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faefd471700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7faef80af520 0x7faef80ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faefd471700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faef8066c90 0x7faef80670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faefd471700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faef8146060 0x7faef81464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faefd471700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef80af900 con 0x7faef8066c90 2020-10-31T22:48:15.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faefd471700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faef80afc10 con 0x7faef80af520 2020-10-31T22:48:15.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faefd471700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef805bb70 con 0x7faef8146060 2020-10-31T22:48:15.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faef77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faef8066c90 0x7faef80670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faef77fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faef8066c90 0x7faef80670f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46098/0 (socket says 172.21.15.60:46098) 2020-10-31T22:48:15.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faef77fe700 1 -- 172.21.15.60:0/3955227 learned_addr learned my addr 172.21.15.60:0/3955227 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:15.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faefcc70700 1 --2- 172.21.15.60:0/3955227 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faef8146060 0x7faef81464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faef7fff700 1 --2- 172.21.15.60:0/3955227 >> v2:172.21.15.66:3300/0 conn(0x7faef80af520 0x7faef80ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faef77fe700 1 -- 172.21.15.60:0/3955227 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faef8146060 msgr2=0x7faef81464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faef77fe700 1 --2- 172.21.15.60:0/3955227 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faef8146060 0x7faef81464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faef77fe700 1 -- 172.21.15.60:0/3955227 >> v2:172.21.15.66:3300/0 conn(0x7faef80af520 msgr2=0x7faef80ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faef77fe700 1 --2- 172.21.15.60:0/3955227 >> v2:172.21.15.66:3300/0 conn(0x7faef80af520 0x7faef80ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faef77fe700 1 -- 172.21.15.60:0/3955227 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef80ac130 con 0x7faef8066c90 2020-10-31T22:48:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faef77fe700 1 --2- 172.21.15.60:0/3955227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef8066c90 0x7faef80670f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7faeec002f30 tx=0x7faeec006e80).ready entity=mon.0 client_cookie=2ab9da46746bdb01 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faef6ffd700 1 -- 172.21.15.60:0/3955227 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faeec0097f0 con 0x7faef8066c90 2020-10-31T22:48:15.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faef6ffd700 1 -- 172.21.15.60:0/3955227 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faeec009950 con 0x7faef8066c90 2020-10-31T22:48:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faef6ffd700 1 -- 172.21.15.60:0/3955227 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faeec009ac0 con 0x7faef8066c90 2020-10-31T22:48:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faefd471700 1 -- 172.21.15.60:0/3955227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef8066c90 msgr2=0x7faef80670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.621+0000 7faefd471700 1 --2- 172.21.15.60:0/3955227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef8066c90 0x7faef80670f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 rx=0x7faeec002f30 tx=0x7faeec006e80).stop 2020-10-31T22:48:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 -- 172.21.15.60:0/3955227 shutdown_connections 2020-10-31T22:48:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 --2- 172.21.15.60:0/3955227 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faef8146060 0x7faef81464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 --2- 172.21.15.60:0/3955227 >> v2:172.21.15.66:3300/0 conn(0x7faef80af520 0x7faef80ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 --2- 172.21.15.60:0/3955227 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef8066c90 0x7faef80670f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 -- 172.21.15.60:0/3955227 >> 172.21.15.60:0/3955227 conn(0x7faef80b3fd0 msgr2=0x7faef80b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 -- 172.21.15.60:0/3955227 shutdown_connections 2020-10-31T22:48:15.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 -- 172.21.15.60:0/3955227 wait complete. 2020-10-31T22:48:15.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 Processor -- start 2020-10-31T22:48:15.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 -- start start 2020-10-31T22:48:15.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faef8066c90 0x7faef81479c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faef80af520 0x7faef80a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef8146060 0x7faef813fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef80b2fb0 con 0x7faef8146060 2020-10-31T22:48:15.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef8155e70 con 0x7faef80af520 2020-10-31T22:48:15.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef80b3210 con 0x7faef8066c90 2020-10-31T22:48:15.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefcc70700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef8146060 0x7faef813fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefcc70700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef8146060 0x7faef813fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46108/0 (socket says 172.21.15.60:46108) 2020-10-31T22:48:15.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefcc70700 1 -- 172.21.15.60:0/129877347 learned_addr learned my addr 172.21.15.60:0/129877347 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:15.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faef7fff700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faef8066c90 0x7faef81479c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faef77fe700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faef80af520 0x7faef80a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefcc70700 1 -- 172.21.15.60:0/129877347 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faef8066c90 msgr2=0x7faef81479c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefcc70700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faef8066c90 0x7faef81479c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefcc70700 1 -- 172.21.15.60:0/129877347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faef80af520 msgr2=0x7faef80a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefcc70700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faef80af520 0x7faef80a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefcc70700 1 -- 172.21.15.60:0/129877347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef80a8880 con 0x7faef8146060 2020-10-31T22:48:15.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faef77fe700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faef80af520 0x7faef80a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:15.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faef7fff700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faef8066c90 0x7faef81479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:15.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefcc70700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef8146060 0x7faef813fe60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7faef000a000 tx=0x7faef0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:15.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faef57fa700 1 -- 172.21.15.60:0/129877347 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef000ba70 con 0x7faef8146060 2020-10-31T22:48:15.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faef57fa700 1 -- 172.21.15.60:0/129877347 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef000bbd0 con 0x7faef8146060 2020-10-31T22:48:15.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 -- 172.21.15.60:0/129877347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faef80a8340 con 0x7faef8146060 2020-10-31T22:48:15.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faef57fa700 1 -- 172.21.15.60:0/129877347 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef0012420 con 0x7faef8146060 2020-10-31T22:48:15.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.625+0000 7faefd471700 1 -- 172.21.15.60:0/129877347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faef8155b20 con 0x7faef8146060 2020-10-31T22:48:15.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.629+0000 7faefd471700 1 -- 172.21.15.60:0/129877347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faef80b3410 con 0x7faef8146060 2020-10-31T22:48:15.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.629+0000 7faef57fa700 1 -- 172.21.15.60:0/129877347 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7faef0012580 con 0x7faef8146060 2020-10-31T22:48:15.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.629+0000 7faef57fa700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faed8055020 0x7faed80574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.629+0000 7faef57fa700 1 -- 172.21.15.60:0/129877347 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faef006e300 con 0x7faef8146060 2020-10-31T22:48:15.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.629+0000 7faef7fff700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faed8055020 0x7faed80574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.629+0000 7faef7fff700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faed8055020 0x7faed80574e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7faee800c000 tx=0x7faee8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:15.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.637+0000 7faef57fa700 1 -- 172.21.15.60:0/129877347 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7faef0044720 con 0x7faef8146060 2020-10-31T22:48:15.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.773+0000 7faefd471700 1 -- 172.21.15.60:0/129877347 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faef8057100 con 0x7faef8146060 2020-10-31T22:48:15.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.773+0000 7faef57fa700 1 -- 172.21.15.60:0/129877347 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16054 (secure 0 0 0) 0x7faef0047d40 con 0x7faef8146060 2020-10-31T22:48:15.781 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:15.781 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":87,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:48:15.434802+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:48:12.972001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-10-31T22:48:14.284102+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:48:15.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.777+0000 7faefd471700 1 -- 172.21.15.60:0/129877347 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faed8055020 msgr2=0x7faed80574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.777+0000 7faefd471700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faed8055020 0x7faed80574e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7faee800c000 tx=0x7faee8008040).stop 2020-10-31T22:48:15.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.777+0000 7faefd471700 1 -- 172.21.15.60:0/129877347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef8146060 msgr2=0x7faef813fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.777+0000 7faefd471700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef8146060 0x7faef813fe60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 rx=0x7faef000a000 tx=0x7faef0008040).stop 2020-10-31T22:48:15.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.777+0000 7faefd471700 1 -- 172.21.15.60:0/129877347 shutdown_connections 2020-10-31T22:48:15.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.777+0000 7faefd471700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef8146060 0x7faef813fe60 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.777+0000 7faefd471700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faef8066c90 0x7faef81479c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.777+0000 7faefd471700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faed8055020 0x7faed80574e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.777+0000 7faefd471700 1 --2- 172.21.15.60:0/129877347 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faef80af520 0x7faef80a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.777+0000 7faefd471700 1 -- 172.21.15.60:0/129877347 >> 172.21.15.60:0/129877347 conn(0x7faef80b3fd0 msgr2=0x7faef8145360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:15.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.777+0000 7faefd471700 1 -- 172.21.15.60:0/129877347 shutdown_connections 2020-10-31T22:48:15.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.777+0000 7faefd471700 1 -- 172.21.15.60:0/129877347 wait complete. 2020-10-31T22:48:15.796 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:48:15.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329f517700 1 Processor -- start 2020-10-31T22:48:15.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329f517700 1 -- start start 2020-10-31T22:48:15.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329f517700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3298063140 0x7f32980add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329f517700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f32980b0b50 0x7f32980b1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329f517700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3298063520 con 0x7f32980b1df0 2020-10-31T22:48:15.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329f517700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32980adbd0 con 0x7f32980b0b50 2020-10-31T22:48:15.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329f517700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32980afed0 con 0x7f3298063140 2020-10-31T22:48:15.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329dd14700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f32980b0b50 0x7f32980b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329dd14700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f32980b0b50 0x7f32980b1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46116/0 (socket says 172.21.15.60:46116) 2020-10-31T22:48:15.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329dd14700 1 -- 172.21.15.60:0/997206721 learned_addr learned my addr 172.21.15.60:0/997206721 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:15.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329e515700 1 --2- 172.21.15.60:0/997206721 >> v2:172.21.15.66:3300/0 conn(0x7f3298063140 0x7f32980add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329dd14700 1 -- 172.21.15.60:0/997206721 >> v2:172.21.15.66:3300/0 conn(0x7f3298063140 msgr2=0x7f32980add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:15.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329dd14700 1 --2- 172.21.15.60:0/997206721 >> v2:172.21.15.66:3300/0 conn(0x7f3298063140 0x7f32980add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329dd14700 1 -- 172.21.15.60:0/997206721 >> v1:172.21.15.66:6789/0 conn(0x7f32980b1df0 legacy=0x7f32980b5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329dd14700 1 -- 172.21.15.60:0/997206721 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32980b0170 con 0x7f32980b0b50 2020-10-31T22:48:15.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.905+0000 7f329dd14700 1 --2- 172.21.15.60:0/997206721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0b50 0x7f32980b1900 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f328c002f30 tx=0x7f328c006e80).ready entity=mon.0 client_cookie=32b6c95431dce599 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:15.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.909+0000 7f329d513700 1 -- 172.21.15.60:0/997206721 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f328c0097f0 con 0x7f32980b0b50 2020-10-31T22:48:15.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.909+0000 7f329d513700 1 -- 172.21.15.60:0/997206721 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c009950 con 0x7f32980b0b50 2020-10-31T22:48:15.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.909+0000 7f329d513700 1 -- 172.21.15.60:0/997206721 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f328c009cb0 con 0x7f32980b0b50 2020-10-31T22:48:15.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.909+0000 7f329f517700 1 -- 172.21.15.60:0/997206721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0b50 msgr2=0x7f32980b1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.909+0000 7f329f517700 1 --2- 172.21.15.60:0/997206721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0b50 0x7f32980b1900 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 rx=0x7f328c002f30 tx=0x7f328c006e80).stop 2020-10-31T22:48:15.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.909+0000 7f329f517700 1 -- 172.21.15.60:0/997206721 shutdown_connections 2020-10-31T22:48:15.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.909+0000 7f329f517700 1 --2- 172.21.15.60:0/997206721 >> v2:172.21.15.66:3300/0 conn(0x7f3298063140 0x7f32980add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.909+0000 7f329f517700 1 --2- 172.21.15.60:0/997206721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0b50 0x7f32980b1900 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.909+0000 7f329f517700 1 -- 172.21.15.60:0/997206721 >> 172.21.15.60:0/997206721 conn(0x7f329806a600 msgr2=0x7f3298060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:15.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.909+0000 7f329f517700 1 -- 172.21.15.60:0/997206721 shutdown_connections 2020-10-31T22:48:15.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.909+0000 7f329f517700 1 -- 172.21.15.60:0/997206721 wait complete. 2020-10-31T22:48:15.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.909+0000 7f329f517700 1 Processor -- start 2020-10-31T22:48:15.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.909+0000 7f329f517700 1 -- start start 2020-10-31T22:48:15.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.909+0000 7f329f517700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3298063140 0x7f32980aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329f517700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0b50 0x7f3298066ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329f517700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b1df0 0x7f3298066fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329f517700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32980674b0 con 0x7f32980b0b50 2020-10-31T22:48:15.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329f517700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3298065210 con 0x7f3298063140 2020-10-31T22:48:15.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329f517700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32980654b0 con 0x7f32980b1df0 2020-10-31T22:48:15.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329dd14700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0b50 0x7f3298066ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329dd14700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0b50 0x7f3298066ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46120/0 (socket says 172.21.15.60:46120) 2020-10-31T22:48:15.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329dd14700 1 -- 172.21.15.60:0/2587818653 learned_addr learned my addr 172.21.15.60:0/2587818653 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:15.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329e515700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3298063140 0x7f32980aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329ed16700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b1df0 0x7f3298066fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329dd14700 1 -- 172.21.15.60:0/2587818653 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b1df0 msgr2=0x7f3298066fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329dd14700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b1df0 0x7f3298066fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329dd14700 1 -- 172.21.15.60:0/2587818653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3298063140 msgr2=0x7f32980aa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:15.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329dd14700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3298063140 0x7f32980aa3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:15.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329dd14700 1 -- 172.21.15.60:0/2587818653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3298065750 con 0x7f32980b0b50 2020-10-31T22:48:15.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329ed16700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b1df0 0x7f3298066fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:15.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329dd14700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0b50 0x7f3298066ad0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f328c002f30 tx=0x7f328c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:15.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f328b7fe700 1 -- 172.21.15.60:0/2587818653 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f328c011ca0 con 0x7f32980b0b50 2020-10-31T22:48:15.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f328b7fe700 1 -- 172.21.15.60:0/2587818653 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c011e00 con 0x7f32980b0b50 2020-10-31T22:48:15.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329f517700 1 -- 172.21.15.60:0/2587818653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32980aac40 con 0x7f32980b0b50 2020-10-31T22:48:15.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f328b7fe700 1 -- 172.21.15.60:0/2587818653 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f328c01e650 con 0x7f32980b0b50 2020-10-31T22:48:15.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329f517700 1 -- 172.21.15.60:0/2587818653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3298064d00 con 0x7f32980b0b50 2020-10-31T22:48:15.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f329f517700 1 -- 172.21.15.60:0/2587818653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3298057100 con 0x7f32980b0b50 2020-10-31T22:48:15.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f328b7fe700 1 -- 172.21.15.60:0/2587818653 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f328c025030 con 0x7f32980b0b50 2020-10-31T22:48:15.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.913+0000 7f328b7fe700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3278054f30 0x7f32780573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:15.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.917+0000 7f328b7fe700 1 -- 172.21.15.60:0/2587818653 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f328c06ee00 con 0x7f32980b0b50 2020-10-31T22:48:15.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.917+0000 7f329e515700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3278054f30 0x7f32780573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:15.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.917+0000 7f329e515700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3278054f30 0x7f32780573f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f329400b000 tx=0x7f3294008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:15.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:15.921+0000 7f328b7fe700 1 -- 172.21.15.60:0/2587818653 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f328c045320 con 0x7f32980b0b50 2020-10-31T22:48:16.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.061+0000 7f329f517700 1 -- 172.21.15.60:0/2587818653 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f329805ed50 con 0x7f32980b0b50 2020-10-31T22:48:16.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.065+0000 7f328b7fe700 1 -- 172.21.15.60:0/2587818653 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f328c023020 con 0x7f32980b0b50 2020-10-31T22:48:16.070 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:16.071 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":87,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:48:15.434802+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:48:12.972001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-10-31T22:48:14.284102+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:48:16.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.065+0000 7f329f517700 1 -- 172.21.15.60:0/2587818653 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3278054f30 msgr2=0x7f32780573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.065+0000 7f329f517700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3278054f30 0x7f32780573f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7f329400b000 tx=0x7f3294008040).stop 2020-10-31T22:48:16.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.065+0000 7f329f517700 1 -- 172.21.15.60:0/2587818653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0b50 msgr2=0x7f3298066ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.065+0000 7f329f517700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0b50 0x7f3298066ad0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 rx=0x7f328c002f30 tx=0x7f328c015000).stop 2020-10-31T22:48:16.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.065+0000 7f329f517700 1 -- 172.21.15.60:0/2587818653 shutdown_connections 2020-10-31T22:48:16.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.065+0000 7f329f517700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32980b1df0 0x7f3298066fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.065+0000 7f329f517700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3278054f30 0x7f32780573f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.065+0000 7f329f517700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3298063140 0x7f32980aa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.065+0000 7f329f517700 1 --2- 172.21.15.60:0/2587818653 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32980b0b50 0x7f3298066ad0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.065+0000 7f329f517700 1 -- 172.21.15.60:0/2587818653 >> 172.21.15.60:0/2587818653 conn(0x7f329806a600 msgr2=0x7f32980a8140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:16.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.065+0000 7f329f517700 1 -- 172.21.15.60:0/2587818653 shutdown_connections 2020-10-31T22:48:16.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.065+0000 7f329f517700 1 -- 172.21.15.60:0/2587818653 wait complete. 2020-10-31T22:48:16.085 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-10-31T22:48:16.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc47c883700 1 Processor -- start 2020-10-31T22:48:16.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc47c883700 1 -- start start 2020-10-31T22:48:16.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc47c883700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc478143d60 0x7fc4780b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc47c883700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4780b0fd0 0x7fc4780b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc47c883700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc478064980 con 0x7fc478143980 2020-10-31T22:48:16.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc47c883700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4780b29d0 con 0x7fc478143d60 2020-10-31T22:48:16.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc47c883700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4780612a0 con 0x7fc4780b0fd0 2020-10-31T22:48:16.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc475d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc478143d60 0x7fc4780b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc475d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc478143d60 0x7fc4780b1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46128/0 (socket says 172.21.15.60:46128) 2020-10-31T22:48:16.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc475d9b700 1 -- 172.21.15.60:0/2805700546 learned_addr learned my addr 172.21.15.60:0/2805700546 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:16.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc476d9d700 1 --2- 172.21.15.60:0/2805700546 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4780b0fd0 0x7fc4780b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc475d9b700 1 -- 172.21.15.60:0/2805700546 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4780b0fd0 msgr2=0x7fc4780b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:16.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc475d9b700 1 --2- 172.21.15.60:0/2805700546 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4780b0fd0 0x7fc4780b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc47559a700 1 -- 172.21.15.60:0/2805700546 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345295740 0 0) 0x7fc478064980 con 0x7fc478143980 2020-10-31T22:48:16.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc475d9b700 1 -- 172.21.15.60:0/2805700546 >> v1:172.21.15.60:6789/0 conn(0x7fc478143980 legacy=0x7fc4780b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc475d9b700 1 -- 172.21.15.60:0/2805700546 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc478064e50 con 0x7fc478143d60 2020-10-31T22:48:16.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc476d9d700 1 --2- 172.21.15.60:0/2805700546 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4780b0fd0 0x7fc4780b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:16.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.201+0000 7fc475d9b700 1 --2- 172.21.15.60:0/2805700546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc478143d60 0x7fc4780b1ff0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fc46c002f30 tx=0x7fc46c006e80).ready entity=mon.0 client_cookie=b305fd63d0682fbb server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:16.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47559a700 1 -- 172.21.15.60:0/2805700546 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc46c0097f0 con 0x7fc478143d60 2020-10-31T22:48:16.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47559a700 1 -- 172.21.15.60:0/2805700546 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c009950 con 0x7fc478143d60 2020-10-31T22:48:16.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47559a700 1 -- 172.21.15.60:0/2805700546 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc46c009cb0 con 0x7fc478143d60 2020-10-31T22:48:16.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 -- 172.21.15.60:0/2805700546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc478143d60 msgr2=0x7fc4780b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 --2- 172.21.15.60:0/2805700546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc478143d60 0x7fc4780b1ff0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 rx=0x7fc46c002f30 tx=0x7fc46c006e80).stop 2020-10-31T22:48:16.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 -- 172.21.15.60:0/2805700546 shutdown_connections 2020-10-31T22:48:16.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 --2- 172.21.15.60:0/2805700546 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4780b0fd0 0x7fc4780b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 --2- 172.21.15.60:0/2805700546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc478143d60 0x7fc4780b1ff0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 -- 172.21.15.60:0/2805700546 >> 172.21.15.60:0/2805700546 conn(0x7fc47806a260 msgr2=0x7fc478063c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:16.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 -- 172.21.15.60:0/2805700546 shutdown_connections 2020-10-31T22:48:16.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 -- 172.21.15.60:0/2805700546 wait complete. 2020-10-31T22:48:16.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 Processor -- start 2020-10-31T22:48:16.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 -- start start 2020-10-31T22:48:16.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4780b0fd0 0x7fc4780aa500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc478143980 0x7fc478155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc478143d60 0x7fc478155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc478145fc0 con 0x7fc478143d60 2020-10-31T22:48:16.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4781455e0 con 0x7fc4780b0fd0 2020-10-31T22:48:16.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.205+0000 7fc47c883700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc478145880 con 0x7fc478143980 2020-10-31T22:48:16.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc476d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc478143d60 0x7fc478155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc476d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc478143d60 0x7fc478155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46136/0 (socket says 172.21.15.60:46136) 2020-10-31T22:48:16.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc476d9d700 1 -- 172.21.15.60:0/1045947864 learned_addr learned my addr 172.21.15.60:0/1045947864 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:16.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc47659c700 1 --2- 172.21.15.60:0/1045947864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4780b0fd0 0x7fc4780aa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc475d9b700 1 --2- 172.21.15.60:0/1045947864 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc478143980 0x7fc478155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc476d9d700 1 -- 172.21.15.60:0/1045947864 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc478143980 msgr2=0x7fc478155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc476d9d700 1 --2- 172.21.15.60:0/1045947864 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc478143980 0x7fc478155180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc476d9d700 1 -- 172.21.15.60:0/1045947864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4780b0fd0 msgr2=0x7fc4780aa500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc476d9d700 1 --2- 172.21.15.60:0/1045947864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4780b0fd0 0x7fc4780aa500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc476d9d700 1 -- 172.21.15.60:0/1045947864 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc478145b20 con 0x7fc478143d60 2020-10-31T22:48:16.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc476d9d700 1 --2- 172.21.15.60:0/1045947864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc478143d60 0x7fc478155670 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fc470006dd0 tx=0x7fc470008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:16.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc4677fe700 1 -- 172.21.15.60:0/1045947864 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc47000c8c0 con 0x7fc478143d60 2020-10-31T22:48:16.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc4677fe700 1 -- 172.21.15.60:0/1045947864 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47000ca20 con 0x7fc478143d60 2020-10-31T22:48:16.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc47c883700 1 -- 172.21.15.60:0/1045947864 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4781450d0 con 0x7fc478143d60 2020-10-31T22:48:16.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc4677fe700 1 -- 172.21.15.60:0/1045947864 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc47000cd80 con 0x7fc478143d60 2020-10-31T22:48:16.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc47c883700 1 -- 172.21.15.60:0/1045947864 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc478155b60 con 0x7fc478143d60 2020-10-31T22:48:16.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc4677fe700 1 -- 172.21.15.60:0/1045947864 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc47001d460 con 0x7fc478143d60 2020-10-31T22:48:16.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc4677fe700 1 --2- 172.21.15.60:0/1045947864 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc454054f10 0x7fc4540573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc47659c700 1 --2- 172.21.15.60:0/1045947864 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc454054f10 0x7fc4540573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc4677fe700 1 -- 172.21.15.60:0/1045947864 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc47006df00 con 0x7fc478143d60 2020-10-31T22:48:16.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc47659c700 1 --2- 172.21.15.60:0/1045947864 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc454054f10 0x7fc4540573d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fc46800d000 tx=0x7fc468009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:16.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.209+0000 7fc47c883700 1 -- 172.21.15.60:0/1045947864 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc478145cb0 con 0x7fc478143d60 2020-10-31T22:48:16.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.217+0000 7fc4677fe700 1 -- 172.21.15.60:0/1045947864 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc4700443c0 con 0x7fc478143d60 2020-10-31T22:48:16.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.401+0000 7fc47c883700 1 -- 172.21.15.60:0/1045947864 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc478057100 con 0x7fc478143d60 2020-10-31T22:48:16.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.437+0000 7fc4677fe700 1 -- 172.21.15.60:0/1045947864 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc4700479e0 con 0x7fc478143d60 2020-10-31T22:48:16.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.441+0000 7fc47c883700 1 -- 172.21.15.60:0/1045947864 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc454054f10 msgr2=0x7fc4540573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.441+0000 7fc47c883700 1 --2- 172.21.15.60:0/1045947864 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc454054f10 0x7fc4540573d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fc46800d000 tx=0x7fc468009040).stop 2020-10-31T22:48:16.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.441+0000 7fc47c883700 1 -- 172.21.15.60:0/1045947864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc478143d60 msgr2=0x7fc478155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.441+0000 7fc47c883700 1 --2- 172.21.15.60:0/1045947864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc478143d60 0x7fc478155670 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 rx=0x7fc470006dd0 tx=0x7fc470008040).stop 2020-10-31T22:48:16.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.445+0000 7fc47c883700 1 -- 172.21.15.60:0/1045947864 shutdown_connections 2020-10-31T22:48:16.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.445+0000 7fc47c883700 1 --2- 172.21.15.60:0/1045947864 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc478143d60 0x7fc478155670 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.445+0000 7fc47c883700 1 --2- 172.21.15.60:0/1045947864 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc454054f10 0x7fc4540573d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.445+0000 7fc47c883700 1 --2- 172.21.15.60:0/1045947864 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4780b0fd0 0x7fc4780aa500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.445+0000 7fc47c883700 1 --2- 172.21.15.60:0/1045947864 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc478143980 0x7fc478155180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.445+0000 7fc47c883700 1 -- 172.21.15.60:0/1045947864 >> 172.21.15.60:0/1045947864 conn(0x7fc47806a260 msgr2=0x7fc47805f720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:16.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.445+0000 7fc47c883700 1 -- 172.21.15.60:0/1045947864 shutdown_connections 2020-10-31T22:48:16.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.445+0000 7fc47c883700 1 -- 172.21.15.60:0/1045947864 wait complete. 2020-10-31T22:48:16.467 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:16.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 Processor -- start 2020-10-31T22:48:16.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 -- start start 2020-10-31T22:48:16.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645405afe0 0x7f645405b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f64540608a0 0x7f6454146a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64540b0030 0x7f64540aec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6454146f30 con 0x7f64540b0030 2020-10-31T22:48:16.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64540b07b0 con 0x7f64540608a0 2020-10-31T22:48:16.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6454146300 con 0x7f645405afe0 2020-10-31T22:48:16.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645359e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64540b0030 0x7f64540aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645359e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f64540b0030 0x7f64540aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46144/0 (socket says 172.21.15.60:46144) 2020-10-31T22:48:16.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645359e700 1 -- 172.21.15.60:0/1244796193 learned_addr learned my addr 172.21.15.60:0/1244796193 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:16.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645259c700 1 --2- 172.21.15.60:0/1244796193 >> v2:172.21.15.66:3300/0 conn(0x7f64540608a0 0x7f6454146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f6452d9d700 1 --2- 172.21.15.60:0/1244796193 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645405afe0 0x7f645405b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645359e700 1 -- 172.21.15.60:0/1244796193 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645405afe0 msgr2=0x7f645405b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:16.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645359e700 1 --2- 172.21.15.60:0/1244796193 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645405afe0 0x7f645405b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645359e700 1 -- 172.21.15.60:0/1244796193 >> v2:172.21.15.66:3300/0 conn(0x7f64540608a0 msgr2=0x7f6454146a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:16.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645359e700 1 --2- 172.21.15.60:0/1244796193 >> v2:172.21.15.66:3300/0 conn(0x7f64540608a0 0x7f6454146a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645359e700 1 -- 172.21.15.60:0/1244796193 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64541465a0 con 0x7f64540b0030 2020-10-31T22:48:16.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645359e700 1 --2- 172.21.15.60:0/1244796193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64540b0030 0x7f64540aec60 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f643c002f30 tx=0x7f643c006e80).ready entity=mon.0 client_cookie=2743ce200c14a0d3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:16.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f6451d9b700 1 -- 172.21.15.60:0/1244796193 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f643c009640 con 0x7f64540b0030 2020-10-31T22:48:16.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f6451d9b700 1 -- 172.21.15.60:0/1244796193 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c0097a0 con 0x7f64540b0030 2020-10-31T22:48:16.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f6451d9b700 1 -- 172.21.15.60:0/1244796193 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f643c009b00 con 0x7f64540b0030 2020-10-31T22:48:16.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 -- 172.21.15.60:0/1244796193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64540b0030 msgr2=0x7f64540aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 --2- 172.21.15.60:0/1244796193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64540b0030 0x7f64540aec60 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 rx=0x7f643c002f30 tx=0x7f643c006e80).stop 2020-10-31T22:48:16.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 -- 172.21.15.60:0/1244796193 shutdown_connections 2020-10-31T22:48:16.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 --2- 172.21.15.60:0/1244796193 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64540b0030 0x7f64540aec60 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 --2- 172.21.15.60:0/1244796193 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645405afe0 0x7f645405b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 --2- 172.21.15.60:0/1244796193 >> v2:172.21.15.66:3300/0 conn(0x7f64540608a0 0x7f6454146a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 -- 172.21.15.60:0/1244796193 >> 172.21.15.60:0/1244796193 conn(0x7f64540b61d0 msgr2=0x7f64540b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:16.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 -- 172.21.15.60:0/1244796193 shutdown_connections 2020-10-31T22:48:16.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.569+0000 7f645882a700 1 -- 172.21.15.60:0/1244796193 wait complete. 2020-10-31T22:48:16.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645882a700 1 Processor -- start 2020-10-31T22:48:16.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645882a700 1 -- start start 2020-10-31T22:48:16.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645882a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f645405afe0 0x7f6454145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645882a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64540608a0 0x7f6454149b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645882a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64540b0030 0x7f645414c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645882a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645414bfe0 con 0x7f64540608a0 2020-10-31T22:48:16.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645882a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6454148e70 con 0x7f645405afe0 2020-10-31T22:48:16.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645882a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64541490a0 con 0x7f64540b0030 2020-10-31T22:48:16.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64540608a0 0x7f6454149b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64540608a0 0x7f6454149b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46148/0 (socket says 172.21.15.60:46148) 2020-10-31T22:48:16.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645259c700 1 -- 172.21.15.60:0/4129315878 learned_addr learned my addr 172.21.15.60:0/4129315878 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:16.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f6452d9d700 1 --2- 172.21.15.60:0/4129315878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f645405afe0 0x7f6454145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645359e700 1 --2- 172.21.15.60:0/4129315878 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64540b0030 0x7f645414c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645259c700 1 -- 172.21.15.60:0/4129315878 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64540b0030 msgr2=0x7f645414c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645259c700 1 --2- 172.21.15.60:0/4129315878 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64540b0030 0x7f645414c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645259c700 1 -- 172.21.15.60:0/4129315878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f645405afe0 msgr2=0x7f6454145130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645259c700 1 --2- 172.21.15.60:0/4129315878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f645405afe0 0x7f6454145130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645259c700 1 -- 172.21.15.60:0/4129315878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6454149340 con 0x7f64540608a0 2020-10-31T22:48:16.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645259c700 1 --2- 172.21.15.60:0/4129315878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64540608a0 0x7f6454149b80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f645414b9f0 tx=0x7f644c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:16.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f644bfff700 1 -- 172.21.15.60:0/4129315878 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f644c00cb30 con 0x7f64540608a0 2020-10-31T22:48:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f644bfff700 1 -- 172.21.15.60:0/4129315878 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c00cc90 con 0x7f64540608a0 2020-10-31T22:48:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645882a700 1 -- 172.21.15.60:0/4129315878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6454148350 con 0x7f64540608a0 2020-10-31T22:48:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f644bfff700 1 -- 172.21.15.60:0/4129315878 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f644c0123f0 con 0x7f64540608a0 2020-10-31T22:48:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.573+0000 7f645882a700 1 -- 172.21.15.60:0/4129315878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645414cae0 con 0x7f64540608a0 2020-10-31T22:48:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.577+0000 7f645882a700 1 -- 172.21.15.60:0/4129315878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64541484e0 con 0x7f64540608a0 2020-10-31T22:48:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.577+0000 7f644bfff700 1 -- 172.21.15.60:0/4129315878 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f644c022070 con 0x7f64540608a0 2020-10-31T22:48:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.577+0000 7f644bfff700 1 --2- 172.21.15.60:0/4129315878 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6438054f90 0x7f6438057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.577+0000 7f644bfff700 1 -- 172.21.15.60:0/4129315878 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f644c06e080 con 0x7f64540608a0 2020-10-31T22:48:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.577+0000 7f6452d9d700 1 --2- 172.21.15.60:0/4129315878 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6438054f90 0x7f6438057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.577+0000 7f6452d9d700 1 --2- 172.21.15.60:0/4129315878 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6438054f90 0x7f6438057450 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f644400b000 tx=0x7f6444006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:16.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.581+0000 7f644bfff700 1 -- 172.21.15.60:0/4129315878 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f644c0445a0 con 0x7f64540608a0 2020-10-31T22:48:16.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.765+0000 7f645882a700 1 -- 172.21.15.60:0/4129315878 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6454057100 con 0x7f64540608a0 2020-10-31T22:48:16.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.765+0000 7f644bfff700 1 -- 172.21.15.60:0/4129315878 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f644c047bc0 con 0x7f64540608a0 2020-10-31T22:48:16.771 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:16.772 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":41,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3668788118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3668788118},{"type":"v1","addr":"172.21.15.60:6835","nonce":3668788118}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6516,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/3884009815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3884009815},{"type":"v1","addr":"172.21.15.60:6837","nonce":3884009815}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:48:15.434973+0000","modified":"2020-10-31T22:48:16.437431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"b","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/2702869569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2702869569},{"type":"v1","addr":"172.21.15.66:6833","nonce":2702869569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-10-31T22:48:16.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.765+0000 7f645882a700 1 -- 172.21.15.60:0/4129315878 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6438054f90 msgr2=0x7f6438057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.765+0000 7f645882a700 1 --2- 172.21.15.60:0/4129315878 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6438054f90 0x7f6438057450 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f644400b000 tx=0x7f6444006dc0).stop 2020-10-31T22:48:16.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.765+0000 7f645882a700 1 -- 172.21.15.60:0/4129315878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64540608a0 msgr2=0x7f6454149b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.765+0000 7f645882a700 1 --2- 172.21.15.60:0/4129315878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64540608a0 0x7f6454149b80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 rx=0x7f645414b9f0 tx=0x7f644c0091a0).stop 2020-10-31T22:48:16.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.765+0000 7f645882a700 1 -- 172.21.15.60:0/4129315878 shutdown_connections 2020-10-31T22:48:16.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.765+0000 7f645882a700 1 --2- 172.21.15.60:0/4129315878 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f64540b0030 0x7f645414c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.765+0000 7f645882a700 1 --2- 172.21.15.60:0/4129315878 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6438054f90 0x7f6438057450 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.765+0000 7f645882a700 1 --2- 172.21.15.60:0/4129315878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f645405afe0 0x7f6454145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.765+0000 7f645882a700 1 --2- 172.21.15.60:0/4129315878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f64540608a0 0x7f6454149b80 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.765+0000 7f645882a700 1 -- 172.21.15.60:0/4129315878 >> 172.21.15.60:0/4129315878 conn(0x7f64540b61d0 msgr2=0x7f64540b2b60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:16.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.765+0000 7f645882a700 1 -- 172.21.15.60:0/4129315878 shutdown_connections 2020-10-31T22:48:16.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.765+0000 7f645882a700 1 -- 172.21.15.60:0/4129315878 wait complete. 2020-10-31T22:48:16.776 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 41 2020-10-31T22:48:16.786 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:48:16.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.893+0000 7efe6ca4e700 1 Processor -- start 2020-10-31T22:48:16.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.893+0000 7efe6ca4e700 1 -- start start 2020-10-31T22:48:16.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe680aabf0 0x7efe6813fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe680b1460 0x7efe681392c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe680adec0 con 0x7efe680adae0 2020-10-31T22:48:16.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe68140b60 con 0x7efe680b1460 2020-10-31T22:48:16.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe681400f0 con 0x7efe680aabf0 2020-10-31T22:48:16.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe66d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efe680b1460 0x7efe681392c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efe680adae0 0x7efe680b0d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50292/0 (socket says 172.21.15.60:50292) 2020-10-31T22:48:16.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6659c700 1 -- 172.21.15.60:0/2908151737 learned_addr learned my addr 172.21.15.60:0/2908151737 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:16.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe5dd9b700 1 --2- 172.21.15.60:0/2908151737 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe680aabf0 0x7efe6813fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe66d9d700 1 -- 172.21.15.60:0/2908151737 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe680aabf0 msgr2=0x7efe6813fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:16.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe66d9d700 1 --2- 172.21.15.60:0/2908151737 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe680aabf0 0x7efe6813fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe66d9d700 1 -- 172.21.15.60:0/2908151737 >> v1:172.21.15.60:6789/0 conn(0x7efe680adae0 legacy=0x7efe680b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe65d9b700 1 -- 172.21.15.60:0/2908151737 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531061937 0 0) 0x7efe680adec0 con 0x7efe680adae0 2020-10-31T22:48:16.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe66d9d700 1 -- 172.21.15.60:0/2908151737 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68140380 con 0x7efe680b1460 2020-10-31T22:48:16.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe5dd9b700 1 --2- 172.21.15.60:0/2908151737 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe680aabf0 0x7efe6813fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:16.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe66d9d700 1 --2- 172.21.15.60:0/2908151737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe680b1460 0x7efe681392c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7efe600032b0 tx=0x7efe600091a0).ready entity=mon.0 client_cookie=85a36b51412b98a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:16.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe65d9b700 1 -- 172.21.15.60:0/2908151737 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe6000ba50 con 0x7efe680b1460 2020-10-31T22:48:16.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe65d9b700 1 -- 172.21.15.60:0/2908151737 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe6000bbb0 con 0x7efe680b1460 2020-10-31T22:48:16.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 -- 172.21.15.60:0/2908151737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe680b1460 msgr2=0x7efe681392c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 --2- 172.21.15.60:0/2908151737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe680b1460 0x7efe681392c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 rx=0x7efe600032b0 tx=0x7efe600091a0).stop 2020-10-31T22:48:16.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe65d9b700 1 -- 172.21.15.60:0/2908151737 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe6000bd20 con 0x7efe680b1460 2020-10-31T22:48:16.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 -- 172.21.15.60:0/2908151737 shutdown_connections 2020-10-31T22:48:16.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 --2- 172.21.15.60:0/2908151737 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe680b1460 0x7efe681392c0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 --2- 172.21.15.60:0/2908151737 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe680aabf0 0x7efe6813fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 -- 172.21.15.60:0/2908151737 >> 172.21.15.60:0/2908151737 conn(0x7efe6806a260 msgr2=0x7efe68061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:16.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 -- 172.21.15.60:0/2908151737 shutdown_connections 2020-10-31T22:48:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 -- 172.21.15.60:0/2908151737 wait complete. 2020-10-31T22:48:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 Processor -- start 2020-10-31T22:48:16.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.897+0000 7efe6ca4e700 1 -- start start 2020-10-31T22:48:16.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6ca4e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe680aabf0 0x7efe680a90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6ca4e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe680adae0 0x7efe681383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6ca4e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe680b1460 0x7efe681388b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6ca4e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe6813a690 con 0x7efe680aabf0 2020-10-31T22:48:16.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6ca4e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe68142eb0 con 0x7efe680b1460 2020-10-31T22:48:16.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6ca4e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe68141f00 con 0x7efe680adae0 2020-10-31T22:48:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe680aabf0 0x7efe680a90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe680aabf0 0x7efe680a90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46160/0 (socket says 172.21.15.60:46160) 2020-10-31T22:48:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6659c700 1 -- 172.21.15.60:0/4163312121 learned_addr learned my addr 172.21.15.60:0/4163312121 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe5dd9b700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe680adae0 0x7efe681383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe66d9d700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe680b1460 0x7efe681388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6659c700 1 -- 172.21.15.60:0/4163312121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe680adae0 msgr2=0x7efe681383c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6659c700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe680adae0 0x7efe681383c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6659c700 1 -- 172.21.15.60:0/4163312121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe680b1460 msgr2=0x7efe681388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:16.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6659c700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe680b1460 0x7efe681388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:16.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6659c700 1 -- 172.21.15.60:0/4163312121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68138da0 con 0x7efe680aabf0 2020-10-31T22:48:16.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe66d9d700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe680b1460 0x7efe681388b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:16.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6659c700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe680aabf0 0x7efe680a90a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7efe58000b80 tx=0x7efe580079b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:16.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe5ffff700 1 -- 172.21.15.60:0/4163312121 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe580072e0 con 0x7efe680aabf0 2020-10-31T22:48:16.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe5ffff700 1 -- 172.21.15.60:0/4163312121 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58007440 con 0x7efe680aabf0 2020-10-31T22:48:16.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6ca4e700 1 -- 172.21.15.60:0/4163312121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe681430a0 con 0x7efe680aabf0 2020-10-31T22:48:16.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe5ffff700 1 -- 172.21.15.60:0/4163312121 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe580057d0 con 0x7efe680aabf0 2020-10-31T22:48:16.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6ca4e700 1 -- 172.21.15.60:0/4163312121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe68142a60 con 0x7efe680aabf0 2020-10-31T22:48:16.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe6ca4e700 1 -- 172.21.15.60:0/4163312121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe68057100 con 0x7efe680aabf0 2020-10-31T22:48:16.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.901+0000 7efe5ffff700 1 -- 172.21.15.60:0/4163312121 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7efe58010070 con 0x7efe680aabf0 2020-10-31T22:48:16.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.905+0000 7efe5ffff700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe4c054f30 0x7efe4c0573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:16.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.905+0000 7efe5dd9b700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe4c054f30 0x7efe4c0573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:16.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.905+0000 7efe5ffff700 1 -- 172.21.15.60:0/4163312121 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efe5806d030 con 0x7efe680aabf0 2020-10-31T22:48:16.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.905+0000 7efe5dd9b700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe4c054f30 0x7efe4c0573f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7efe5000c000 tx=0x7efe50008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:16.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:16.909+0000 7efe5ffff700 1 -- 172.21.15.60:0/4163312121 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7efe58043550 con 0x7efe680aabf0 2020-10-31T22:48:17.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.053+0000 7efe6ca4e700 1 -- 172.21.15.60:0/4163312121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe6805aa70 con 0x7efe680aabf0 2020-10-31T22:48:17.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.053+0000 7efe5ffff700 1 -- 172.21.15.60:0/4163312121 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16041 (secure 0 0 0) 0x7efe58046b70 con 0x7efe680aabf0 2020-10-31T22:48:17.062 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:17.062 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:48:16.438220+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:48:12.972001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-10-31T22:48:14.284102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:48:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.057+0000 7efe6ca4e700 1 -- 172.21.15.60:0/4163312121 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe4c054f30 msgr2=0x7efe4c0573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.057+0000 7efe6ca4e700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe4c054f30 0x7efe4c0573f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7efe5000c000 tx=0x7efe50008040).stop 2020-10-31T22:48:17.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.057+0000 7efe6ca4e700 1 -- 172.21.15.60:0/4163312121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe680aabf0 msgr2=0x7efe680a90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.057+0000 7efe6ca4e700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe680aabf0 0x7efe680a90a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 rx=0x7efe58000b80 tx=0x7efe580079b0).stop 2020-10-31T22:48:17.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.057+0000 7efe6ca4e700 1 -- 172.21.15.60:0/4163312121 shutdown_connections 2020-10-31T22:48:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.057+0000 7efe6ca4e700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe4c054f30 0x7efe4c0573f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.057+0000 7efe6ca4e700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe680b1460 0x7efe681388b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.057+0000 7efe6ca4e700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe680aabf0 0x7efe680a90a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.057+0000 7efe6ca4e700 1 --2- 172.21.15.60:0/4163312121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe680adae0 0x7efe681383c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.057+0000 7efe6ca4e700 1 -- 172.21.15.60:0/4163312121 >> 172.21.15.60:0/4163312121 conn(0x7efe6806a260 msgr2=0x7efe68066ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:17.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.057+0000 7efe6ca4e700 1 -- 172.21.15.60:0/4163312121 shutdown_connections 2020-10-31T22:48:17.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.057+0000 7efe6ca4e700 1 -- 172.21.15.60:0/4163312121 wait complete. 2020-10-31T22:48:17.076 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:48:17.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.193+0000 7f47f0964700 1 Processor -- start 2020-10-31T22:48:17.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.193+0000 7f47f0964700 1 -- start start 2020-10-31T22:48:17.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.193+0000 7f47f0964700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec0ae200 0x7f47ec0a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.193+0000 7f47f0964700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f47ec0ac110 0x7f47ec0af980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.193+0000 7f47f0964700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47ec05b700 con 0x7f47ec05b320 2020-10-31T22:48:17.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.193+0000 7f47f0964700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47ec0807c0 con 0x7f47ec0ac110 2020-10-31T22:48:17.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.193+0000 7f47f0964700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0ab730 con 0x7f47ec0ae200 2020-10-31T22:48:17.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.193+0000 7f47ead9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f47ec05b320 0x7f47ec07ff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50304/0 (socket says 172.21.15.60:50304) 2020-10-31T22:48:17.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.193+0000 7f47ead9d700 1 -- 172.21.15.60:0/153697435 learned_addr learned my addr 172.21.15.60:0/153697435 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:17.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.193+0000 7f47ea59c700 1 --2- 172.21.15.60:0/153697435 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec0ae200 0x7f47ec0a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47eb59e700 1 --2- 172.21.15.60:0/153697435 >> v2:172.21.15.66:3300/0 conn(0x7f47ec0ac110 0x7f47ec0af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 -- 172.21.15.60:0/153697435 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650953425 0 0) 0x7f47ec05b700 con 0x7f47ec05b320 2020-10-31T22:48:17.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 -- 172.21.15.60:0/153697435 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47d4003230 con 0x7f47ec05b320 2020-10-31T22:48:17.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 -- 172.21.15.60:0/153697435 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2332861085 0 0) 0x7f47d4003230 con 0x7f47ec05b320 2020-10-31T22:48:17.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 -- 172.21.15.60:0/153697435 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec0ae200 msgr2=0x7f47ec0a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:17.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 --2- 172.21.15.60:0/153697435 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec0ae200 0x7f47ec0a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 -- 172.21.15.60:0/153697435 >> v2:172.21.15.66:3300/0 conn(0x7f47ec0ac110 msgr2=0x7f47ec0af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:17.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 --2- 172.21.15.60:0/153697435 >> v2:172.21.15.66:3300/0 conn(0x7f47ec0ac110 0x7f47ec0af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 -- 172.21.15.60:0/153697435 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec0ab9d0 con 0x7f47ec05b320 2020-10-31T22:48:17.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 -- 172.21.15.60:0/153697435 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f47e00016d0 con 0x7f47ec05b320 2020-10-31T22:48:17.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 -- 172.21.15.60:0/153697435 >> v1:172.21.15.60:6789/0 conn(0x7f47ec05b320 legacy=0x7f47ec07ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 --2- 172.21.15.60:0/153697435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d4003720 0x7f47d4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 --2- 172.21.15.60:0/153697435 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec0ae200 0x7f47d40044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 --2- 172.21.15.60:0/153697435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d40049c0 0x7f47d4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 -- 172.21.15.60:0/153697435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0807c0 con 0x7f47d4003720 2020-10-31T22:48:17.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 -- 172.21.15.60:0/153697435 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0ab730 con 0x7f47d40049c0 2020-10-31T22:48:17.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 -- 172.21.15.60:0/153697435 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d40041c0 con 0x7f47ec0ae200 2020-10-31T22:48:17.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47eb59e700 1 --2- 172.21.15.60:0/153697435 >> v2:172.21.15.66:3300/0 conn(0x7f47ec0ac110 0x7f47ec0af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:17.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47ead9d700 1 --2- 172.21.15.60:0/153697435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d4003720 0x7f47d4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47ea59c700 1 --2- 172.21.15.60:0/153697435 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec0ae200 0x7f47d40044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47eb59e700 1 --2- 172.21.15.60:0/153697435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d40049c0 0x7f47d4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47ead9d700 1 -- 172.21.15.60:0/153697435 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec0ae200 msgr2=0x7f47d40044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:17.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47ead9d700 1 --2- 172.21.15.60:0/153697435 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec0ae200 0x7f47d40044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47ead9d700 1 -- 172.21.15.60:0/153697435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d40049c0 msgr2=0x7f47d4004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:17.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47ead9d700 1 --2- 172.21.15.60:0/153697435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47d40049c0 0x7f47d4004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47ead9d700 1 -- 172.21.15.60:0/153697435 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d4003230 con 0x7f47d4003720 2020-10-31T22:48:17.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47ead9d700 1 --2- 172.21.15.60:0/153697435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d4003720 0x7f47d4003b40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f47d40054a0 tx=0x7f47ec067300).ready entity=mon.0 client_cookie=ee7be4bdd5e11faf server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:17.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 -- 172.21.15.60:0/153697435 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47e00070d0 con 0x7f47d4003720 2020-10-31T22:48:17.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 -- 172.21.15.60:0/153697435 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e0007230 con 0x7f47d4003720 2020-10-31T22:48:17.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47e9d9b700 1 -- 172.21.15.60:0/153697435 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47e00055e0 con 0x7f47d4003720 2020-10-31T22:48:17.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47f0964700 1 -- 172.21.15.60:0/153697435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d4003720 msgr2=0x7f47d4003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47f0964700 1 --2- 172.21.15.60:0/153697435 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47d4003720 0x7f47d4003b40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 rx=0x7f47d40054a0 tx=0x7f47ec067300).stop 2020-10-31T22:48:17.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47eb59e700 1 -- 172.21.15.60:0/153697435 reap_dead start 2020-10-31T22:48:17.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47f0964700 1 -- 172.21.15.60:0/153697435 shutdown_connections 2020-10-31T22:48:17.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47f0964700 1 -- 172.21.15.60:0/153697435 >> 172.21.15.60:0/153697435 conn(0x7f47ec0b3fd0 msgr2=0x7f47ec0b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:17.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47f0964700 1 -- 172.21.15.60:0/153697435 shutdown_connections 2020-10-31T22:48:17.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.197+0000 7f47f0964700 1 -- 172.21.15.60:0/153697435 wait complete. 2020-10-31T22:48:17.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47f0964700 1 Processor -- start 2020-10-31T22:48:17.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47f0964700 1 -- start start 2020-10-31T22:48:17.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47f0964700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec064cc0 0x7f47ec0a6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47f0964700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0a0b80 0x7f47ec0a6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47f0964700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec13d790 0x7f47ec13dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47f0964700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0a1ca0 con 0x7f47ec0a0b80 2020-10-31T22:48:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47f0964700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0a0980 con 0x7f47ec064cc0 2020-10-31T22:48:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47f0964700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec0650a0 con 0x7f47ec13d790 2020-10-31T22:48:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47ea59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0a0b80 0x7f47ec0a6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47ea59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0a0b80 0x7f47ec0a6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46180/0 (socket says 172.21.15.60:46180) 2020-10-31T22:48:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47ea59c700 1 -- 172.21.15.60:0/2444093790 learned_addr learned my addr 172.21.15.60:0/2444093790 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47eb59e700 1 --2- 172.21.15.60:0/2444093790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec13d790 0x7f47ec13dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47ead9d700 1 --2- 172.21.15.60:0/2444093790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec064cc0 0x7f47ec0a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47ea59c700 1 -- 172.21.15.60:0/2444093790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec13d790 msgr2=0x7f47ec13dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47ea59c700 1 --2- 172.21.15.60:0/2444093790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec13d790 0x7f47ec13dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47ea59c700 1 -- 172.21.15.60:0/2444093790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec064cc0 msgr2=0x7f47ec0a6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47ea59c700 1 --2- 172.21.15.60:0/2444093790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec064cc0 0x7f47ec0a6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47ea59c700 1 -- 172.21.15.60:0/2444093790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec09fd00 con 0x7f47ec0a0b80 2020-10-31T22:48:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47ea59c700 1 --2- 172.21.15.60:0/2444093790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0a0b80 0x7f47ec0a6920 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f47dc006750 tx=0x7f47dc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:17.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47db7fe700 1 -- 172.21.15.60:0/2444093790 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47dc00f9e0 con 0x7f47ec0a0b80 2020-10-31T22:48:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47db7fe700 1 -- 172.21.15.60:0/2444093790 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc00fb40 con 0x7f47ec0a0b80 2020-10-31T22:48:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47f0964700 1 -- 172.21.15.60:0/2444093790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47ec09ffa0 con 0x7f47ec0a0b80 2020-10-31T22:48:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47db7fe700 1 -- 172.21.15.60:0/2444093790 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47dc00fcb0 con 0x7f47ec0a0b80 2020-10-31T22:48:17.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.201+0000 7f47f0964700 1 -- 172.21.15.60:0/2444093790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47ec0a04e0 con 0x7f47ec0a0b80 2020-10-31T22:48:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.205+0000 7f47f0964700 1 -- 172.21.15.60:0/2444093790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47ec0a06a0 con 0x7f47ec0a0b80 2020-10-31T22:48:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.205+0000 7f47db7fe700 1 -- 172.21.15.60:0/2444093790 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f47dc024070 con 0x7f47ec0a0b80 2020-10-31T22:48:17.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.205+0000 7f47db7fe700 1 --2- 172.21.15.60:0/2444093790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47d00550b0 0x7f47d0057570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.205+0000 7f47db7fe700 1 -- 172.21.15.60:0/2444093790 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f47dc06e3b0 con 0x7f47ec0a0b80 2020-10-31T22:48:17.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.205+0000 7f47ead9d700 1 --2- 172.21.15.60:0/2444093790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47d00550b0 0x7f47d0057570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.205+0000 7f47ead9d700 1 --2- 172.21.15.60:0/2444093790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47d00550b0 0x7f47d0057570 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f47e001a000 tx=0x7f47e0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:17.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.209+0000 7f47db7fe700 1 -- 172.21.15.60:0/2444093790 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f47dc0447c0 con 0x7f47ec0a0b80 2020-10-31T22:48:17.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.401+0000 7f47f0964700 1 -- 172.21.15.60:0/2444093790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f47ec057100 con 0x7f47ec0a0b80 2020-10-31T22:48:17.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.409+0000 7f47db7fe700 1 -- 172.21.15.60:0/2444093790 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v21) v1 ==== 184+0+0 (secure 0 0 0) 0x7f47dc047de0 con 0x7f47ec0a0b80 2020-10-31T22:48:17.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.413+0000 7f47f0964700 1 -- 172.21.15.60:0/2444093790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47d00550b0 msgr2=0x7f47d0057570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.413+0000 7f47f0964700 1 --2- 172.21.15.60:0/2444093790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47d00550b0 0x7f47d0057570 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7f47e001a000 tx=0x7f47e0015000).stop 2020-10-31T22:48:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.413+0000 7f47f0964700 1 -- 172.21.15.60:0/2444093790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0a0b80 msgr2=0x7f47ec0a6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.413+0000 7f47f0964700 1 --2- 172.21.15.60:0/2444093790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0a0b80 0x7f47ec0a6920 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 rx=0x7f47dc006750 tx=0x7f47dc008040).stop 2020-10-31T22:48:17.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.413+0000 7f47f0964700 1 -- 172.21.15.60:0/2444093790 shutdown_connections 2020-10-31T22:48:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.413+0000 7f47f0964700 1 --2- 172.21.15.60:0/2444093790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47ec13d790 0x7f47ec13dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.413+0000 7f47f0964700 1 --2- 172.21.15.60:0/2444093790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47d00550b0 0x7f47d0057570 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.413+0000 7f47f0964700 1 --2- 172.21.15.60:0/2444093790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47ec064cc0 0x7f47ec0a6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.413+0000 7f47f0964700 1 --2- 172.21.15.60:0/2444093790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec0a0b80 0x7f47ec0a6920 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.413+0000 7f47f0964700 1 -- 172.21.15.60:0/2444093790 >> 172.21.15.60:0/2444093790 conn(0x7f47ec0b3fd0 msgr2=0x7f47ec07fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.413+0000 7f47f0964700 1 -- 172.21.15.60:0/2444093790 shutdown_connections 2020-10-31T22:48:17.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.413+0000 7f47f0964700 1 -- 172.21.15.60:0/2444093790 wait complete. 2020-10-31T22:48:17.422 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2020-10-31T22:48:17.432 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:48:17.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.549+0000 7f934582d700 1 Processor -- start 2020-10-31T22:48:17.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.549+0000 7f934582d700 1 -- start start 2020-10-31T22:48:17.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.549+0000 7f934582d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f93400b1570 0x7f9340024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.549+0000 7f934582d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f93400803e0 0x7f9340159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.549+0000 7f934582d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93400b1950 con 0x7f9340025480 2020-10-31T22:48:17.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.549+0000 7f934582d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9340080850 con 0x7f93400b1570 2020-10-31T22:48:17.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.549+0000 7f934582d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9340025910 con 0x7f93400803e0 2020-10-31T22:48:17.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934502c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f93400b1570 0x7f9340024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934482b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9340025480 0x7f934007fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50324/0 (socket says 172.21.15.60:50324) 2020-10-31T22:48:17.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934482b700 1 -- 172.21.15.60:0/647674284 learned_addr learned my addr 172.21.15.60:0/647674284 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:17.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f9346a8f700 1 --2- 172.21.15.60:0/647674284 >> v2:172.21.15.66:3300/0 conn(0x7f93400803e0 0x7f9340159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934502c700 1 -- 172.21.15.60:0/647674284 >> v2:172.21.15.66:3300/0 conn(0x7f93400803e0 msgr2=0x7f9340159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934502c700 1 --2- 172.21.15.60:0/647674284 >> v2:172.21.15.66:3300/0 conn(0x7f93400803e0 0x7f9340159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934502c700 1 -- 172.21.15.60:0/647674284 >> v1:172.21.15.60:6789/0 conn(0x7f9340025480 legacy=0x7f934007fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934502c700 1 -- 172.21.15.60:0/647674284 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9340062720 con 0x7f93400b1570 2020-10-31T22:48:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934502c700 1 --2- 172.21.15.60:0/647674284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400b1570 0x7f9340024f90 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f9330002f30 tx=0x7f9330006dc0).ready entity=mon.0 client_cookie=1439c2c1e75be87a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f933ffff700 1 -- 172.21.15.60:0/647674284 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f93300097b0 con 0x7f93400b1570 2020-10-31T22:48:17.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f933ffff700 1 -- 172.21.15.60:0/647674284 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9330009910 con 0x7f93400b1570 2020-10-31T22:48:17.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f933ffff700 1 -- 172.21.15.60:0/647674284 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9330009c70 con 0x7f93400b1570 2020-10-31T22:48:17.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934582d700 1 -- 172.21.15.60:0/647674284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400b1570 msgr2=0x7f9340024f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934582d700 1 --2- 172.21.15.60:0/647674284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400b1570 0x7f9340024f90 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 rx=0x7f9330002f30 tx=0x7f9330006dc0).stop 2020-10-31T22:48:17.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934582d700 1 -- 172.21.15.60:0/647674284 shutdown_connections 2020-10-31T22:48:17.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934582d700 1 --2- 172.21.15.60:0/647674284 >> v2:172.21.15.66:3300/0 conn(0x7f93400803e0 0x7f9340159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934582d700 1 --2- 172.21.15.60:0/647674284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400b1570 0x7f9340024f90 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934582d700 1 -- 172.21.15.60:0/647674284 >> 172.21.15.60:0/647674284 conn(0x7f93400b5440 msgr2=0x7f93400b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:17.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934582d700 1 -- 172.21.15.60:0/647674284 shutdown_connections 2020-10-31T22:48:17.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.553+0000 7f934582d700 1 -- 172.21.15.60:0/647674284 wait complete. 2020-10-31T22:48:17.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934582d700 1 Processor -- start 2020-10-31T22:48:17.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934582d700 1 -- start start 2020-10-31T22:48:17.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934582d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9340025480 0x7f9340065420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934582d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400803e0 0x7f9340143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934582d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93400b1570 0x7f93400afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934582d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93400a40a0 con 0x7f93400803e0 2020-10-31T22:48:17.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934582d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93401433d0 con 0x7f93400b1570 2020-10-31T22:48:17.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934582d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9340143670 con 0x7f9340025480 2020-10-31T22:48:17.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934482b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400803e0 0x7f9340143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934502c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9340025480 0x7f9340065420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f9346a8f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93400b1570 0x7f93400afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934482b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400803e0 0x7f9340143b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46196/0 (socket says 172.21.15.60:46196) 2020-10-31T22:48:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934482b700 1 -- 172.21.15.60:0/3137007489 learned_addr learned my addr 172.21.15.60:0/3137007489 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f9346a8f700 1 -- 172.21.15.60:0/3137007489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9340025480 msgr2=0x7f9340065420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f9346a8f700 1 --2- 172.21.15.60:0/3137007489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9340025480 0x7f9340065420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f9346a8f700 1 -- 172.21.15.60:0/3137007489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400803e0 msgr2=0x7f9340143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f9346a8f700 1 --2- 172.21.15.60:0/3137007489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400803e0 0x7f9340143b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f9346a8f700 1 -- 172.21.15.60:0/3137007489 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9340065910 con 0x7f93400b1570 2020-10-31T22:48:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934502c700 1 --2- 172.21.15.60:0/3137007489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9340025480 0x7f9340065420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f9346a8f700 1 --2- 172.21.15.60:0/3137007489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93400b1570 0x7f93400afcf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f933800c000 tx=0x7f9338006dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f933dffb700 1 -- 172.21.15.60:0/3137007489 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f933800c7e0 con 0x7f93400b1570 2020-10-31T22:48:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f933dffb700 1 -- 172.21.15.60:0/3137007489 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933800c940 con 0x7f93400b1570 2020-10-31T22:48:17.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934582d700 1 -- 172.21.15.60:0/3137007489 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93400801d0 con 0x7f93400b1570 2020-10-31T22:48:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f933dffb700 1 -- 172.21.15.60:0/3137007489 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f933800cca0 con 0x7f93400b1570 2020-10-31T22:48:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.557+0000 7f934582d700 1 -- 172.21.15.60:0/3137007489 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9340144000 con 0x7f93400b1570 2020-10-31T22:48:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.561+0000 7f934582d700 1 -- 172.21.15.60:0/3137007489 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9340143870 con 0x7f93400b1570 2020-10-31T22:48:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.561+0000 7f933dffb700 1 -- 172.21.15.60:0/3137007489 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f933801c460 con 0x7f93400b1570 2020-10-31T22:48:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.561+0000 7f933dffb700 1 --2- 172.21.15.60:0/3137007489 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9320054f90 0x7f9320057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.561+0000 7f933dffb700 1 -- 172.21.15.60:0/3137007489 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f933806dd70 con 0x7f93400b1570 2020-10-31T22:48:17.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.561+0000 7f934502c700 1 --2- 172.21.15.60:0/3137007489 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9320054f90 0x7f9320057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.561+0000 7f934502c700 1 --2- 172.21.15.60:0/3137007489 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9320054f90 0x7f9320057450 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f933001a000 tx=0x7f9330015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:17.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.573+0000 7f933dffb700 1 -- 172.21.15.60:0/3137007489 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9340143870 con 0x7f93400b1570 2020-10-31T22:48:17.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.765+0000 7f934582d700 1 -- 172.21.15.60:0/3137007489 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9340143870 con 0x7f93400b1570 2020-10-31T22:48:17.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.777+0000 7f933dffb700 1 -- 172.21.15.60:0/3137007489 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v22) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9340143870 con 0x7f93400b1570 2020-10-31T22:48:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.777+0000 7f934582d700 1 -- 172.21.15.60:0/3137007489 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9320054f90 msgr2=0x7f9320057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.777+0000 7f934582d700 1 --2- 172.21.15.60:0/3137007489 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9320054f90 0x7f9320057450 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f933001a000 tx=0x7f9330015000).stop 2020-10-31T22:48:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.777+0000 7f934582d700 1 -- 172.21.15.60:0/3137007489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93400b1570 msgr2=0x7f93400afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.777+0000 7f934582d700 1 --2- 172.21.15.60:0/3137007489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93400b1570 0x7f93400afcf0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f933800c000 tx=0x7f9338006dc0).stop 2020-10-31T22:48:17.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.777+0000 7f934582d700 1 -- 172.21.15.60:0/3137007489 shutdown_connections 2020-10-31T22:48:17.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.777+0000 7f934582d700 1 --2- 172.21.15.60:0/3137007489 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9320054f90 0x7f9320057450 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.777+0000 7f934582d700 1 --2- 172.21.15.60:0/3137007489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f93400b1570 0x7f93400afcf0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.777+0000 7f934582d700 1 --2- 172.21.15.60:0/3137007489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9340025480 0x7f9340065420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.777+0000 7f934582d700 1 --2- 172.21.15.60:0/3137007489 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f93400803e0 0x7f9340143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.777+0000 7f934582d700 1 -- 172.21.15.60:0/3137007489 >> 172.21.15.60:0/3137007489 conn(0x7f93400b5440 msgr2=0x7f9340132c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:17.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.777+0000 7f934582d700 1 -- 172.21.15.60:0/3137007489 shutdown_connections 2020-10-31T22:48:17.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.777+0000 7f934582d700 1 -- 172.21.15.60:0/3137007489 wait complete. 2020-10-31T22:48:17.788 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.1 2020-10-31T22:48:17.800 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:17.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.909+0000 7f47a38eb700 1 Processor -- start 2020-10-31T22:48:17.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.909+0000 7f47a38eb700 1 -- start start 2020-10-31T22:48:17.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.909+0000 7f47a38eb700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f479c0b25f0 0x7f479c13fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a38eb700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f479c0b1840 0x7f479c13d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a38eb700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f479c0a9390 con 0x7f479c05f3c0 2020-10-31T22:48:17.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a38eb700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c0b02e0 con 0x7f479c0b25f0 2020-10-31T22:48:17.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a38eb700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f479c0606a0 con 0x7f479c0b1840 2020-10-31T22:48:17.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a1687700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f479c0b25f0 0x7f479c13fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a1687700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f479c0b25f0 0x7f479c13fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46202/0 (socket says 172.21.15.60:46202) 2020-10-31T22:48:17.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a1687700 1 -- 172.21.15.60:0/2167539988 learned_addr learned my addr 172.21.15.60:0/2167539988 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:17.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a1e88700 1 --2- 172.21.15.60:0/2167539988 >> v2:172.21.15.66:3300/0 conn(0x7f479c0b1840 0x7f479c13d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a1687700 1 -- 172.21.15.60:0/2167539988 >> v2:172.21.15.66:3300/0 conn(0x7f479c0b1840 msgr2=0x7f479c13d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:17.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a1687700 1 --2- 172.21.15.60:0/2167539988 >> v2:172.21.15.66:3300/0 conn(0x7f479c0b1840 0x7f479c13d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a1687700 1 -- 172.21.15.60:0/2167539988 >> v1:172.21.15.66:6789/0 conn(0x7f479c05f3c0 legacy=0x7f479c05ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a1687700 1 -- 172.21.15.60:0/2167539988 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c0b0040 con 0x7f479c0b25f0 2020-10-31T22:48:17.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a1687700 1 --2- 172.21.15.60:0/2167539988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479c0b25f0 0x7f479c13fc40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f4798002f30 tx=0x7f4798006e80).ready entity=mon.0 client_cookie=d400fb18c8c9ca2e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:17.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f4793fff700 1 -- 172.21.15.60:0/2167539988 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47980097f0 con 0x7f479c0b25f0 2020-10-31T22:48:17.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f4793fff700 1 -- 172.21.15.60:0/2167539988 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4798009950 con 0x7f479c0b25f0 2020-10-31T22:48:17.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f4793fff700 1 -- 172.21.15.60:0/2167539988 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4798009cb0 con 0x7f479c0b25f0 2020-10-31T22:48:17.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a38eb700 1 -- 172.21.15.60:0/2167539988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479c0b25f0 msgr2=0x7f479c13fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a38eb700 1 --2- 172.21.15.60:0/2167539988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479c0b25f0 0x7f479c13fc40 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 rx=0x7f4798002f30 tx=0x7f4798006e80).stop 2020-10-31T22:48:17.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a38eb700 1 -- 172.21.15.60:0/2167539988 shutdown_connections 2020-10-31T22:48:17.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a38eb700 1 --2- 172.21.15.60:0/2167539988 >> v2:172.21.15.66:3300/0 conn(0x7f479c0b1840 0x7f479c13d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a38eb700 1 --2- 172.21.15.60:0/2167539988 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479c0b25f0 0x7f479c13fc40 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a38eb700 1 -- 172.21.15.60:0/2167539988 >> 172.21.15.60:0/2167539988 conn(0x7f479c0b5d30 msgr2=0x7f479c0b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:17.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a38eb700 1 -- 172.21.15.60:0/2167539988 shutdown_connections 2020-10-31T22:48:17.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a38eb700 1 -- 172.21.15.60:0/2167539988 wait complete. 2020-10-31T22:48:17.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a38eb700 1 Processor -- start 2020-10-31T22:48:17.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.913+0000 7f47a38eb700 1 -- start start 2020-10-31T22:48:17.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a38eb700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f479c05f3c0 0x7f479c140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a38eb700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f479c0b1840 0x7f479c13f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a38eb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479c0b25f0 0x7f479c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a38eb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0aa010 con 0x7f479c0b25f0 2020-10-31T22:48:17.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a38eb700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0b4130 con 0x7f479c05f3c0 2020-10-31T22:48:17.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a38eb700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479c0a9d70 con 0x7f479c0b1840 2020-10-31T22:48:17.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a1e88700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479c0b25f0 0x7f479c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a1e88700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479c0b25f0 0x7f479c14eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46212/0 (socket says 172.21.15.60:46212) 2020-10-31T22:48:17.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a1e88700 1 -- 172.21.15.60:0/1056879385 learned_addr learned my addr 172.21.15.60:0/1056879385 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:17.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a0e86700 1 --2- 172.21.15.60:0/1056879385 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f479c0b1840 0x7f479c13f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a1687700 1 --2- 172.21.15.60:0/1056879385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f479c05f3c0 0x7f479c140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a1e88700 1 -- 172.21.15.60:0/1056879385 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f479c0b1840 msgr2=0x7f479c13f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a1e88700 1 --2- 172.21.15.60:0/1056879385 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f479c0b1840 0x7f479c13f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a1e88700 1 -- 172.21.15.60:0/1056879385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f479c05f3c0 msgr2=0x7f479c140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:17.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a1e88700 1 --2- 172.21.15.60:0/1056879385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f479c05f3c0 0x7f479c140fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:17.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a1e88700 1 -- 172.21.15.60:0/1056879385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c145cb0 con 0x7f479c0b25f0 2020-10-31T22:48:17.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a1e88700 1 --2- 172.21.15.60:0/1056879385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479c0b25f0 0x7f479c14eee0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f479400a000 tx=0x7f4794008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:17.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47927fc700 1 -- 172.21.15.60:0/1056879385 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f479400b9e0 con 0x7f479c0b25f0 2020-10-31T22:48:17.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47927fc700 1 -- 172.21.15.60:0/1056879385 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479400bb40 con 0x7f479c0b25f0 2020-10-31T22:48:17.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a38eb700 1 -- 172.21.15.60:0/1056879385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f479c145f50 con 0x7f479c0b25f0 2020-10-31T22:48:17.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47927fc700 1 -- 172.21.15.60:0/1056879385 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f479400bea0 con 0x7f479c0b25f0 2020-10-31T22:48:17.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.917+0000 7f47a38eb700 1 -- 172.21.15.60:0/1056879385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c14e8d0 con 0x7f479c0b25f0 2020-10-31T22:48:17.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.921+0000 7f47a38eb700 1 -- 172.21.15.60:0/1056879385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479c057100 con 0x7f479c0b25f0 2020-10-31T22:48:17.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.921+0000 7f47927fc700 1 -- 172.21.15.60:0/1056879385 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f479401c460 con 0x7f479c0b25f0 2020-10-31T22:48:17.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.921+0000 7f47927fc700 1 --2- 172.21.15.60:0/1056879385 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4784055050 0x7f4784057510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:17.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.921+0000 7f47927fc700 1 -- 172.21.15.60:0/1056879385 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f479406dff0 con 0x7f479c0b25f0 2020-10-31T22:48:17.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.921+0000 7f47a1687700 1 --2- 172.21.15.60:0/1056879385 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4784055050 0x7f4784057510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:17.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.921+0000 7f47a1687700 1 --2- 172.21.15.60:0/1056879385 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4784055050 0x7f4784057510 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f479801c000 tx=0x7f4798015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:17.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:17.929+0000 7f47927fc700 1 -- 172.21.15.60:0/1056879385 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f47940444b0 con 0x7f479c0b25f0 2020-10-31T22:48:18.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.113+0000 7f47a38eb700 1 -- 172.21.15.60:0/1056879385 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f479c0008d0 con 0x7f479c0b25f0 2020-10-31T22:48:18.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.117+0000 7f47927fc700 1 -- 172.21.15.60:0/1056879385 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f4794047ad0 con 0x7f479c0b25f0 2020-10-31T22:48:18.123 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:18.123 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":41,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3668788118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3668788118},{"type":"v1","addr":"172.21.15.60:6835","nonce":3668788118}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6516,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/3884009815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3884009815},{"type":"v1","addr":"172.21.15.60:6837","nonce":3884009815}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:48:15.434973+0000","modified":"2020-10-31T22:48:16.437431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"b","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/2702869569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2702869569},{"type":"v1","addr":"172.21.15.66:6833","nonce":2702869569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-10-31T22:48:18.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.117+0000 7f47a38eb700 1 -- 172.21.15.60:0/1056879385 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4784055050 msgr2=0x7f4784057510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.117+0000 7f47a38eb700 1 --2- 172.21.15.60:0/1056879385 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4784055050 0x7f4784057510 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f479801c000 tx=0x7f4798015000).stop 2020-10-31T22:48:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.117+0000 7f47a38eb700 1 -- 172.21.15.60:0/1056879385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479c0b25f0 msgr2=0x7f479c14eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.117+0000 7f47a38eb700 1 --2- 172.21.15.60:0/1056879385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479c0b25f0 0x7f479c14eee0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 rx=0x7f479400a000 tx=0x7f4794008040).stop 2020-10-31T22:48:18.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.117+0000 7f47a38eb700 1 -- 172.21.15.60:0/1056879385 shutdown_connections 2020-10-31T22:48:18.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.117+0000 7f47a38eb700 1 --2- 172.21.15.60:0/1056879385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f479c0b25f0 0x7f479c14eee0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:18.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.117+0000 7f47a38eb700 1 --2- 172.21.15.60:0/1056879385 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4784055050 0x7f4784057510 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:18.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.117+0000 7f47a38eb700 1 --2- 172.21.15.60:0/1056879385 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f479c05f3c0 0x7f479c140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:18.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.117+0000 7f47a38eb700 1 --2- 172.21.15.60:0/1056879385 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f479c0b1840 0x7f479c13f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:18.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.117+0000 7f47a38eb700 1 -- 172.21.15.60:0/1056879385 >> 172.21.15.60:0/1056879385 conn(0x7f479c0b5d30 msgr2=0x7f479c0abb70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:18.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.117+0000 7f47a38eb700 1 -- 172.21.15.60:0/1056879385 shutdown_connections 2020-10-31T22:48:18.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.117+0000 7f47a38eb700 1 -- 172.21.15.60:0/1056879385 wait complete. 2020-10-31T22:48:18.131 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 41 2020-10-31T22:48:18.446 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:48:15.434973+0000', 'modified': '2020-10-31T22:48:16.437431+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6519}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6519': {'gid': 6519, 'name': 'b', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6833/2702869569', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 2702869569}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 2702869569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:48:18.447 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:48:18.447 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-10-31T22:48:18.580 INFO:teuthology.orchestra.run.smithi066.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":6519,"want_state":"up:active","state":"up:active","rank_uptime":3.1313865289999998,"mdsmap_epoch":41,"osdmap_epoch":88,"osdmap_epoch_barrier":87,"uptime":8.5314989600000004} 2020-10-31T22:48:18.581 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 6519, "mdsmap_epoch": 41, "osdmap_epoch": 88, "osdmap_epoch_barrier": 87, "rank_uptime": 3.131386529, "state": "up:active", "uptime": 8.53149896, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:48:18.582 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:48:18.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7ee42700 1 Processor -- start 2020-10-31T22:48:18.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7ee42700 1 -- start start 2020-10-31T22:48:18.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7ee42700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffa780af520 0x7ffa780ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:18.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7ee42700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ffa780670f0 0x7ffa78150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:18.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7ee42700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa780af900 con 0x7ffa78066c90 2020-10-31T22:48:18.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7ee42700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa780afc10 con 0x7ffa780af520 2020-10-31T22:48:18.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7ee42700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7805bb70 con 0x7ffa780670f0 2020-10-31T22:48:18.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7de40700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffa780af520 0x7ffa780ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:18.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7e641700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ffa780670f0 0x7ffa78150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:18.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7de40700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ffa780af520 0x7ffa780ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46218/0 (socket says 172.21.15.60:46218) 2020-10-31T22:48:18.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7d63f700 1 --1- 172.21.15.60:0/2096404765 >> v1:172.21.15.66:6789/0 conn(0x7ffa78066c90 0x7ffa78146060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:48220/0 (socket says 172.21.15.60:48220) 2020-10-31T22:48:18.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7de40700 1 -- 172.21.15.60:0/2096404765 learned_addr learned my addr 172.21.15.60:0/2096404765 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:18.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7de40700 1 -- 172.21.15.60:0/2096404765 >> v2:172.21.15.66:3300/0 conn(0x7ffa780670f0 msgr2=0x7ffa78150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:18.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7de40700 1 --2- 172.21.15.60:0/2096404765 >> v2:172.21.15.66:3300/0 conn(0x7ffa780670f0 0x7ffa78150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:18.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7de40700 1 -- 172.21.15.60:0/2096404765 >> v1:172.21.15.66:6789/0 conn(0x7ffa78066c90 legacy=0x7ffa78146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:18.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7de40700 1 -- 172.21.15.60:0/2096404765 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa780ac130 con 0x7ffa780af520 2020-10-31T22:48:18.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.697+0000 7ffa7de40700 1 --2- 172.21.15.60:0/2096404765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa780af520 0x7ffa780ac870 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7ffa68002f30 tx=0x7ffa68006e80).ready entity=mon.0 client_cookie=7f0c4a2a8382fa59 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:18.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ce3e700 1 -- 172.21.15.60:0/2096404765 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa680097f0 con 0x7ffa780af520 2020-10-31T22:48:18.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ce3e700 1 -- 172.21.15.60:0/2096404765 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa68009950 con 0x7ffa780af520 2020-10-31T22:48:18.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ce3e700 1 -- 172.21.15.60:0/2096404765 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa68009cb0 con 0x7ffa780af520 2020-10-31T22:48:18.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2096404765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa780af520 msgr2=0x7ffa780ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:18.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 --2- 172.21.15.60:0/2096404765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa780af520 0x7ffa780ac870 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 rx=0x7ffa68002f30 tx=0x7ffa68006e80).stop 2020-10-31T22:48:18.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2096404765 shutdown_connections 2020-10-31T22:48:18.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 --2- 172.21.15.60:0/2096404765 >> v2:172.21.15.66:3300/0 conn(0x7ffa780670f0 0x7ffa78150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:18.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 --2- 172.21.15.60:0/2096404765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa780af520 0x7ffa780ac870 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:18.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2096404765 >> 172.21.15.60:0/2096404765 conn(0x7ffa780b3fd0 msgr2=0x7ffa780b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:18.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2096404765 shutdown_connections 2020-10-31T22:48:18.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2096404765 wait complete. 2020-10-31T22:48:18.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 Processor -- start 2020-10-31T22:48:18.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 -- start start 2020-10-31T22:48:18.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa78066c90 0x7ffa780aa130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:18.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa780670f0 0x7ffa78155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:18.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa780af520 0x7ffa78155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:18.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78149880 con 0x7ffa780af520 2020-10-31T22:48:18.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78154ef0 con 0x7ffa78066c90 2020-10-31T22:48:18.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa78062000 con 0x7ffa780670f0 2020-10-31T22:48:18.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7e641700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa780af520 0x7ffa78155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:18.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7e641700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa780af520 0x7ffa78155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46224/0 (socket says 172.21.15.60:46224) 2020-10-31T22:48:18.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7e641700 1 -- 172.21.15.60:0/2857341684 learned_addr learned my addr 172.21.15.60:0/2857341684 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:18.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7de40700 1 --2- 172.21.15.60:0/2857341684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa78066c90 0x7ffa780aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:18.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7d63f700 1 --2- 172.21.15.60:0/2857341684 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa780670f0 0x7ffa78155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:18.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7e641700 1 -- 172.21.15.60:0/2857341684 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa780670f0 msgr2=0x7ffa78155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:18.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7e641700 1 --2- 172.21.15.60:0/2857341684 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa780670f0 0x7ffa78155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:18.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7e641700 1 -- 172.21.15.60:0/2857341684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa78066c90 msgr2=0x7ffa780aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:18.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7e641700 1 --2- 172.21.15.60:0/2857341684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa78066c90 0x7ffa780aa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:18.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7e641700 1 -- 172.21.15.60:0/2857341684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa78062230 con 0x7ffa780af520 2020-10-31T22:48:18.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7e641700 1 --2- 172.21.15.60:0/2857341684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa780af520 0x7ffa78155800 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7ffa78148d60 tx=0x7ffa700091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:18.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa76ffd700 1 -- 172.21.15.60:0/2857341684 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa7000cbc0 con 0x7ffa780af520 2020-10-31T22:48:18.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa76ffd700 1 -- 172.21.15.60:0/2857341684 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7000cd20 con 0x7ffa780af520 2020-10-31T22:48:18.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2857341684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa780624d0 con 0x7ffa780af520 2020-10-31T22:48:18.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa76ffd700 1 -- 172.21.15.60:0/2857341684 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffa700125e0 con 0x7ffa780af520 2020-10-31T22:48:18.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.701+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2857341684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa780ab4b0 con 0x7ffa780af520 2020-10-31T22:48:18.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.705+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2857341684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa78149b90 con 0x7ffa780af520 2020-10-31T22:48:18.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.705+0000 7ffa76ffd700 1 -- 172.21.15.60:0/2857341684 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ffa70022070 con 0x7ffa780af520 2020-10-31T22:48:18.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.705+0000 7ffa76ffd700 1 --2- 172.21.15.60:0/2857341684 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ffa58054f90 0x7ffa58057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:18.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.705+0000 7ffa76ffd700 1 -- 172.21.15.60:0/2857341684 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ffa7006e940 con 0x7ffa780af520 2020-10-31T22:48:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.705+0000 7ffa7de40700 1 --2- 172.21.15.60:0/2857341684 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ffa58054f90 0x7ffa58057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.705+0000 7ffa7de40700 1 --2- 172.21.15.60:0/2857341684 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ffa58054f90 0x7ffa58057450 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7ffa6801a000 tx=0x7ffa68015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:18.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.713+0000 7ffa76ffd700 1 -- 172.21.15.60:0/2857341684 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ffa70044e60 con 0x7ffa780af520 2020-10-31T22:48:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.853+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2857341684 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa78057100 con 0x7ffa780af520 2020-10-31T22:48:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.853+0000 7ffa76ffd700 1 -- 172.21.15.60:0/2857341684 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16041 (secure 0 0 0) 0x7ffa7002cec0 con 0x7ffa780af520 2020-10-31T22:48:18.862 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:18.862 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:48:16.438220+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:48:12.972001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-10-31T22:48:14.284102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:48:18.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.857+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2857341684 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ffa58054f90 msgr2=0x7ffa58057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:18.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.857+0000 7ffa7ee42700 1 --2- 172.21.15.60:0/2857341684 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ffa58054f90 0x7ffa58057450 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7ffa6801a000 tx=0x7ffa68015000).stop 2020-10-31T22:48:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.857+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2857341684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa780af520 msgr2=0x7ffa78155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.857+0000 7ffa7ee42700 1 --2- 172.21.15.60:0/2857341684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa780af520 0x7ffa78155800 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 rx=0x7ffa78148d60 tx=0x7ffa700091a0).stop 2020-10-31T22:48:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.857+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2857341684 shutdown_connections 2020-10-31T22:48:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.857+0000 7ffa7ee42700 1 --2- 172.21.15.60:0/2857341684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa780af520 0x7ffa78155800 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.857+0000 7ffa7ee42700 1 --2- 172.21.15.60:0/2857341684 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ffa58054f90 0x7ffa58057450 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:18.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.857+0000 7ffa7ee42700 1 --2- 172.21.15.60:0/2857341684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffa78066c90 0x7ffa780aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:18.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.857+0000 7ffa7ee42700 1 --2- 172.21.15.60:0/2857341684 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffa780670f0 0x7ffa78155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:18.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.857+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2857341684 >> 172.21.15.60:0/2857341684 conn(0x7ffa780b3fd0 msgr2=0x7ffa78145350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:18.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.857+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2857341684 shutdown_connections 2020-10-31T22:48:18.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.857+0000 7ffa7ee42700 1 -- 172.21.15.60:0/2857341684 wait complete. 2020-10-31T22:48:18.880 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:48:12.972001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:48:14.284102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:48:18.881 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:48:19.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.997+0000 7f4594fcc700 1 Processor -- start 2020-10-31T22:48:19.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.997+0000 7f4594fcc700 1 -- start start 2020-10-31T22:48:19.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.997+0000 7f4594fcc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45900b5570 0x7f45900b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.997+0000 7f4594fcc700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4590141f00 0x7f4590142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.997+0000 7f4594fcc700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45900b4440 con 0x7f45900b24a0 2020-10-31T22:48:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.997+0000 7f4594fcc700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459013f930 con 0x7f4590141f00 2020-10-31T22:48:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.997+0000 7f4594fcc700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4590146060 con 0x7f45900b5570 2020-10-31T22:48:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.997+0000 7f458effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f45900b24a0 0x7f4590145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50366/0 (socket says 172.21.15.60:50366) 2020-10-31T22:48:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.997+0000 7f458effd700 1 -- 172.21.15.60:0/1235684849 learned_addr learned my addr 172.21.15.60:0/1235684849 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:19.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.997+0000 7f458ffff700 1 --2- 172.21.15.60:0/1235684849 >> v2:172.21.15.66:3300/0 conn(0x7f4590141f00 0x7f4590142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.997+0000 7f458f7fe700 1 --2- 172.21.15.60:0/1235684849 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45900b5570 0x7f45900b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.997+0000 7f458e7fc700 1 -- 172.21.15.60:0/1235684849 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 172167199 0 0) 0x7f45900b4440 con 0x7f45900b24a0 2020-10-31T22:48:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:18.997+0000 7f458e7fc700 1 -- 172.21.15.60:0/1235684849 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4570003230 con 0x7f45900b24a0 2020-10-31T22:48:19.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f458ffff700 1 -- 172.21.15.60:0/1235684849 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45900b5570 msgr2=0x7f45900b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f458ffff700 1 --2- 172.21.15.60:0/1235684849 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45900b5570 0x7f45900b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f458ffff700 1 -- 172.21.15.60:0/1235684849 >> v1:172.21.15.60:6789/0 conn(0x7f45900b24a0 legacy=0x7f4590145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f458ffff700 1 -- 172.21.15.60:0/1235684849 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45900b02f0 con 0x7f4590141f00 2020-10-31T22:48:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f458ffff700 1 --2- 172.21.15.60:0/1235684849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4590141f00 0x7f4590142390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f45880032b0 tx=0x7f45880091a0).ready entity=mon.1 client_cookie=acae1fbb04949b5f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f458e7fc700 1 -- 172.21.15.60:0/1235684849 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f458800b940 con 0x7f4590141f00 2020-10-31T22:48:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f458e7fc700 1 -- 172.21.15.60:0/1235684849 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458800baa0 con 0x7f4590141f00 2020-10-31T22:48:19.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f458e7fc700 1 -- 172.21.15.60:0/1235684849 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f458800bc10 con 0x7f4590141f00 2020-10-31T22:48:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f4594fcc700 1 -- 172.21.15.60:0/1235684849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4590141f00 msgr2=0x7f4590142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f4594fcc700 1 --2- 172.21.15.60:0/1235684849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4590141f00 0x7f4590142390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f45880032b0 tx=0x7f45880091a0).stop 2020-10-31T22:48:19.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f4594fcc700 1 -- 172.21.15.60:0/1235684849 shutdown_connections 2020-10-31T22:48:19.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f4594fcc700 1 --2- 172.21.15.60:0/1235684849 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4590141f00 0x7f4590142390 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f4594fcc700 1 --2- 172.21.15.60:0/1235684849 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45900b5570 0x7f45900b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f4594fcc700 1 -- 172.21.15.60:0/1235684849 >> 172.21.15.60:0/1235684849 conn(0x7f45900b8e90 msgr2=0x7f45900b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f4594fcc700 1 -- 172.21.15.60:0/1235684849 shutdown_connections 2020-10-31T22:48:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f4594fcc700 1 -- 172.21.15.60:0/1235684849 wait complete. 2020-10-31T22:48:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f4594fcc700 1 Processor -- start 2020-10-31T22:48:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.001+0000 7f4594fcc700 1 -- start start 2020-10-31T22:48:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f4594fcc700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45900b24a0 0x7f45900b6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f4594fcc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45900b5570 0x7f45900ac700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f4594fcc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4590141f00 0x7f45900acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f4594fcc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4590148ac0 con 0x7f4590141f00 2020-10-31T22:48:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f4594fcc700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4590148270 con 0x7f45900b24a0 2020-10-31T22:48:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f4594fcc700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4590148cf0 con 0x7f45900b5570 2020-10-31T22:48:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4590141f00 0x7f45900acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4590141f00 0x7f45900acbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46238/0 (socket says 172.21.15.60:46238) 2020-10-31T22:48:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458ffff700 1 -- 172.21.15.60:0/1941567373 learned_addr learned my addr 172.21.15.60:0/1941567373 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458effd700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45900b5570 0x7f45900ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458f7fe700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45900b24a0 0x7f45900b6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458ffff700 1 -- 172.21.15.60:0/1941567373 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45900b5570 msgr2=0x7f45900ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458ffff700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45900b5570 0x7f45900ac700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458ffff700 1 -- 172.21.15.60:0/1941567373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45900b24a0 msgr2=0x7f45900b6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458ffff700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45900b24a0 0x7f45900b6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458ffff700 1 -- 172.21.15.60:0/1941567373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45900af490 con 0x7f4590141f00 2020-10-31T22:48:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458effd700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45900b5570 0x7f45900ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458ffff700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4590141f00 0x7f45900acbf0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f45880032b0 tx=0x7f4588016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458cff9700 1 -- 172.21.15.60:0/1941567373 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45880205f0 con 0x7f4590141f00 2020-10-31T22:48:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458cff9700 1 -- 172.21.15.60:0/1941567373 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4588020750 con 0x7f4590141f00 2020-10-31T22:48:19.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f4594fcc700 1 -- 172.21.15.60:0/1941567373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4590150940 con 0x7f4590141f00 2020-10-31T22:48:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458cff9700 1 -- 172.21.15.60:0/1941567373 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4588020ab0 con 0x7f4590141f00 2020-10-31T22:48:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f4594fcc700 1 -- 172.21.15.60:0/1941567373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45900ad0e0 con 0x7f4590141f00 2020-10-31T22:48:19.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f4594fcc700 1 -- 172.21.15.60:0/1941567373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4590057100 con 0x7f4590141f00 2020-10-31T22:48:19.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.005+0000 7f458cff9700 1 -- 172.21.15.60:0/1941567373 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4588027030 con 0x7f4590141f00 2020-10-31T22:48:19.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.009+0000 7f458cff9700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4574054f10 0x7f45740573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.009+0000 7f458cff9700 1 -- 172.21.15.60:0/1941567373 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f458806f040 con 0x7f4590141f00 2020-10-31T22:48:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.009+0000 7f458f7fe700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4574054f10 0x7f45740573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.009+0000 7f458f7fe700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4574054f10 0x7f45740573d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f458000b000 tx=0x7f4580008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:19.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.013+0000 7f458cff9700 1 -- 172.21.15.60:0/1941567373 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4588045560 con 0x7f4590141f00 2020-10-31T22:48:19.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.153+0000 7f4594fcc700 1 -- 172.21.15.60:0/1941567373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f459005a8e0 con 0x7f4590141f00 2020-10-31T22:48:19.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.153+0000 7f458cff9700 1 -- 172.21.15.60:0/1941567373 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v88) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4588025020 con 0x7f4590141f00 2020-10-31T22:48:19.161 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:48:19.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.157+0000 7f4594fcc700 1 -- 172.21.15.60:0/1941567373 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4574054f10 msgr2=0x7f45740573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.157+0000 7f4594fcc700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4574054f10 0x7f45740573d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f458000b000 tx=0x7f4580008040).stop 2020-10-31T22:48:19.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.157+0000 7f4594fcc700 1 -- 172.21.15.60:0/1941567373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4590141f00 msgr2=0x7f45900acbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.157+0000 7f4594fcc700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4590141f00 0x7f45900acbf0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 rx=0x7f45880032b0 tx=0x7f4588016000).stop 2020-10-31T22:48:19.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.157+0000 7f4594fcc700 1 -- 172.21.15.60:0/1941567373 shutdown_connections 2020-10-31T22:48:19.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.157+0000 7f4594fcc700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4590141f00 0x7f45900acbf0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.157+0000 7f4594fcc700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4574054f10 0x7f45740573d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.157+0000 7f4594fcc700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f45900b24a0 0x7f45900b6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.157+0000 7f4594fcc700 1 --2- 172.21.15.60:0/1941567373 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f45900b5570 0x7f45900ac700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.157+0000 7f4594fcc700 1 -- 172.21.15.60:0/1941567373 >> 172.21.15.60:0/1941567373 conn(0x7f45900b8e90 msgr2=0x7f45900b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:19.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.157+0000 7f4594fcc700 1 -- 172.21.15.60:0/1941567373 shutdown_connections 2020-10-31T22:48:19.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.157+0000 7f4594fcc700 1 -- 172.21.15.60:0/1941567373 wait complete. 2020-10-31T22:48:19.177 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:48:19.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578bfff700 1 Processor -- start 2020-10-31T22:48:19.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578bfff700 1 -- start start 2020-10-31T22:48:19.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f578c0af520 0x7f578c0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578bfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f578c066c90 0x7f578c0670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578bfff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f578c0af900 con 0x7f578c146060 2020-10-31T22:48:19.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578bfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c0afc10 con 0x7f578c0af520 2020-10-31T22:48:19.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578bfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f578c05bb70 con 0x7f578c066c90 2020-10-31T22:48:19.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f578c0af520 0x7f578c0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f578c0af520 0x7f578c0ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46246/0 (socket says 172.21.15.60:46246) 2020-10-31T22:48:19.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578affd700 1 -- 172.21.15.60:0/3402341247 learned_addr learned my addr 172.21.15.60:0/3402341247 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:19.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578a7fc700 1 --2- 172.21.15.60:0/3402341247 >> v2:172.21.15.66:3300/0 conn(0x7f578c066c90 0x7f578c0670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578affd700 1 -- 172.21.15.60:0/3402341247 >> v2:172.21.15.66:3300/0 conn(0x7f578c066c90 msgr2=0x7f578c0670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:19.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578affd700 1 --2- 172.21.15.60:0/3402341247 >> v2:172.21.15.66:3300/0 conn(0x7f578c066c90 0x7f578c0670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578affd700 1 -- 172.21.15.60:0/3402341247 >> v1:172.21.15.66:6789/0 conn(0x7f578c146060 legacy=0x7f578c149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578affd700 1 -- 172.21.15.60:0/3402341247 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c0ac130 con 0x7f578c0af520 2020-10-31T22:48:19.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.289+0000 7f578a7fc700 1 --2- 172.21.15.60:0/3402341247 >> v2:172.21.15.66:3300/0 conn(0x7f578c066c90 0x7f578c0670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:19.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578affd700 1 --2- 172.21.15.60:0/3402341247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c0af520 0x7f578c0ac870 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f577c002f30 tx=0x7f577c006e80).ready entity=mon.0 client_cookie=fdbc1946995279ee server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:19.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f5789ffb700 1 -- 172.21.15.60:0/3402341247 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f577c009960 con 0x7f578c0af520 2020-10-31T22:48:19.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f5789ffb700 1 -- 172.21.15.60:0/3402341247 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c009ac0 con 0x7f578c0af520 2020-10-31T22:48:19.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f5789ffb700 1 -- 172.21.15.60:0/3402341247 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f577c009e20 con 0x7f578c0af520 2020-10-31T22:48:19.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 -- 172.21.15.60:0/3402341247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c0af520 msgr2=0x7f578c0ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 --2- 172.21.15.60:0/3402341247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c0af520 0x7f578c0ac870 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 rx=0x7f577c002f30 tx=0x7f577c006e80).stop 2020-10-31T22:48:19.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 -- 172.21.15.60:0/3402341247 shutdown_connections 2020-10-31T22:48:19.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 --2- 172.21.15.60:0/3402341247 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c0af520 0x7f578c0ac870 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 --2- 172.21.15.60:0/3402341247 >> v2:172.21.15.66:3300/0 conn(0x7f578c066c90 0x7f578c0670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 -- 172.21.15.60:0/3402341247 >> 172.21.15.60:0/3402341247 conn(0x7f578c0b3fd0 msgr2=0x7f578c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:19.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 -- 172.21.15.60:0/3402341247 shutdown_connections 2020-10-31T22:48:19.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 -- 172.21.15.60:0/3402341247 wait complete. 2020-10-31T22:48:19.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 Processor -- start 2020-10-31T22:48:19.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 -- start start 2020-10-31T22:48:19.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c066c90 0x7f578c147450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f578c0af520 0x7f578c0a8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f578c146060 0x7f578c13fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c159310 con 0x7f578c066c90 2020-10-31T22:48:19.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f578c140a30 con 0x7f578c0af520 2020-10-31T22:48:19.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.293+0000 7f578bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f578c140cd0 con 0x7f578c146060 2020-10-31T22:48:19.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c066c90 0x7f578c147450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c066c90 0x7f578c147450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46250/0 (socket says 172.21.15.60:46250) 2020-10-31T22:48:19.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578affd700 1 -- 172.21.15.60:0/2388095340 learned_addr learned my addr 172.21.15.60:0/2388095340 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578b7fe700 1 --2- 172.21.15.60:0/2388095340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f578c146060 0x7f578c13fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578a7fc700 1 --2- 172.21.15.60:0/2388095340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f578c0af520 0x7f578c0a8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578affd700 1 -- 172.21.15.60:0/2388095340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f578c146060 msgr2=0x7f578c13fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578affd700 1 --2- 172.21.15.60:0/2388095340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f578c146060 0x7f578c13fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578affd700 1 -- 172.21.15.60:0/2388095340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f578c0af520 msgr2=0x7f578c0a8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578affd700 1 --2- 172.21.15.60:0/2388095340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f578c0af520 0x7f578c0a8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578affd700 1 -- 172.21.15.60:0/2388095340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c140f70 con 0x7f578c066c90 2020-10-31T22:48:19.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578affd700 1 --2- 172.21.15.60:0/2388095340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c066c90 0x7f578c147450 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f577c002f30 tx=0x7f577c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:19.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f5783fff700 1 -- 172.21.15.60:0/2388095340 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f577c011c10 con 0x7f578c066c90 2020-10-31T22:48:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f5783fff700 1 -- 172.21.15.60:0/2388095340 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577c011d70 con 0x7f578c066c90 2020-10-31T22:48:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f5783fff700 1 -- 172.21.15.60:0/2388095340 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f577c01d640 con 0x7f578c066c90 2020-10-31T22:48:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578bfff700 1 -- 172.21.15.60:0/2388095340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578c0a8dc0 con 0x7f578c066c90 2020-10-31T22:48:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578bfff700 1 -- 172.21.15.60:0/2388095340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f578c0a8a20 con 0x7f578c066c90 2020-10-31T22:48:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578bfff700 1 -- 172.21.15.60:0/2388095340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f578c141100 con 0x7f578c066c90 2020-10-31T22:48:19.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f5783fff700 1 -- 172.21.15.60:0/2388095340 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f577c00f070 con 0x7f578c066c90 2020-10-31T22:48:19.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f5783fff700 1 --2- 172.21.15.60:0/2388095340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5764055020 0x7f57640574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f5783fff700 1 -- 172.21.15.60:0/2388095340 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f577c06f590 con 0x7f578c066c90 2020-10-31T22:48:19.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.297+0000 7f578a7fc700 1 --2- 172.21.15.60:0/2388095340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5764055020 0x7f57640574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.301+0000 7f578a7fc700 1 --2- 172.21.15.60:0/2388095340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5764055020 0x7f57640574e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f577400c000 tx=0x7f5774008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:19.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.305+0000 7f5783fff700 1 -- 172.21.15.60:0/2388095340 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f577c045b30 con 0x7f578c066c90 2020-10-31T22:48:19.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.449+0000 7f578bfff700 1 -- 172.21.15.60:0/2388095340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f578c057100 con 0x7f578c066c90 2020-10-31T22:48:19.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.449+0000 7f5783fff700 1 -- 172.21.15.60:0/2388095340 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v88) v1 ==== 92+0+10 (secure 0 0 0) 0x7f577c0490d0 con 0x7f578c066c90 2020-10-31T22:48:19.458 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:48:19.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.453+0000 7f578bfff700 1 -- 172.21.15.60:0/2388095340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5764055020 msgr2=0x7f57640574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.453+0000 7f578bfff700 1 --2- 172.21.15.60:0/2388095340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5764055020 0x7f57640574e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f577400c000 tx=0x7f5774008040).stop 2020-10-31T22:48:19.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.453+0000 7f578bfff700 1 -- 172.21.15.60:0/2388095340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c066c90 msgr2=0x7f578c147450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.453+0000 7f578bfff700 1 --2- 172.21.15.60:0/2388095340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c066c90 0x7f578c147450 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 rx=0x7f577c002f30 tx=0x7f577c015000).stop 2020-10-31T22:48:19.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.453+0000 7f578bfff700 1 -- 172.21.15.60:0/2388095340 shutdown_connections 2020-10-31T22:48:19.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.453+0000 7f578bfff700 1 --2- 172.21.15.60:0/2388095340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f578c146060 0x7f578c13fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.453+0000 7f578bfff700 1 --2- 172.21.15.60:0/2388095340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f578c066c90 0x7f578c147450 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.453+0000 7f578bfff700 1 --2- 172.21.15.60:0/2388095340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5764055020 0x7f57640574e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.453+0000 7f578bfff700 1 --2- 172.21.15.60:0/2388095340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f578c0af520 0x7f578c0a8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.453+0000 7f578bfff700 1 -- 172.21.15.60:0/2388095340 >> 172.21.15.60:0/2388095340 conn(0x7f578c0b3fd0 msgr2=0x7f578c145340 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:19.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.453+0000 7f578bfff700 1 -- 172.21.15.60:0/2388095340 shutdown_connections 2020-10-31T22:48:19.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.453+0000 7f578bfff700 1 -- 172.21.15.60:0/2388095340 wait complete. 2020-10-31T22:48:19.472 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:48:19.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e359e700 1 Processor -- start 2020-10-31T22:48:19.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e359e700 1 -- start start 2020-10-31T22:48:19.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e359e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd4e4063140 0x7fd4e40afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e359e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd4e40ae740 0x7fd4e40b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e359e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e40b0390 con 0x7fd4e40aee10 2020-10-31T22:48:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e359e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e4063520 con 0x7fd4e4063140 2020-10-31T22:48:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e359e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e40b19c0 con 0x7fd4e40ae740 2020-10-31T22:48:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd4e4063140 0x7fd4e40afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd4e4063140 0x7fd4e40afea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46258/0 (socket says 172.21.15.60:46258) 2020-10-31T22:48:19.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e2d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd4e40aee10 0x7fd4e40ab860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50396/0 (socket says 172.21.15.60:50396) 2020-10-31T22:48:19.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e259c700 1 -- 172.21.15.60:0/4165465756 learned_addr learned my addr 172.21.15.60:0/4165465756 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e1d9b700 1 --2- 172.21.15.60:0/4165465756 >> v2:172.21.15.66:3300/0 conn(0x7fd4e40ae740 0x7fd4e40b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e259c700 1 -- 172.21.15.60:0/4165465756 >> v2:172.21.15.66:3300/0 conn(0x7fd4e40ae740 msgr2=0x7fd4e40b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e259c700 1 --2- 172.21.15.60:0/4165465756 >> v2:172.21.15.66:3300/0 conn(0x7fd4e40ae740 0x7fd4e40b14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e259c700 1 -- 172.21.15.60:0/4165465756 >> v1:172.21.15.60:6789/0 conn(0x7fd4e40aee10 legacy=0x7fd4e40ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e259c700 1 -- 172.21.15.60:0/4165465756 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e40a9070 con 0x7fd4e4063140 2020-10-31T22:48:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e1d9b700 1 --2- 172.21.15.60:0/4165465756 >> v2:172.21.15.66:3300/0 conn(0x7fd4e40ae740 0x7fd4e40b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e259c700 1 --2- 172.21.15.60:0/4165465756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4e4063140 0x7fd4e40afea0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7fd4d4002f30 tx=0x7fd4d4006e80).ready entity=mon.0 client_cookie=cfcf32a198d0acd5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e159a700 1 -- 172.21.15.60:0/4165465756 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d40097f0 con 0x7fd4e4063140 2020-10-31T22:48:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e159a700 1 -- 172.21.15.60:0/4165465756 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d4009950 con 0x7fd4e4063140 2020-10-31T22:48:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e159a700 1 -- 172.21.15.60:0/4165465756 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d4009cb0 con 0x7fd4e4063140 2020-10-31T22:48:19.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e359e700 1 -- 172.21.15.60:0/4165465756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4e4063140 msgr2=0x7fd4e40afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.593+0000 7fd4e359e700 1 --2- 172.21.15.60:0/4165465756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4e4063140 0x7fd4e40afea0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 rx=0x7fd4d4002f30 tx=0x7fd4d4006e80).stop 2020-10-31T22:48:19.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.597+0000 7fd4e359e700 1 -- 172.21.15.60:0/4165465756 shutdown_connections 2020-10-31T22:48:19.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.597+0000 7fd4e359e700 1 --2- 172.21.15.60:0/4165465756 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4e4063140 0x7fd4e40afea0 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.597+0000 7fd4e359e700 1 --2- 172.21.15.60:0/4165465756 >> v2:172.21.15.66:3300/0 conn(0x7fd4e40ae740 0x7fd4e40b14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.597+0000 7fd4e359e700 1 -- 172.21.15.60:0/4165465756 >> 172.21.15.60:0/4165465756 conn(0x7fd4e406a600 msgr2=0x7fd4e4060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:19.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.597+0000 7fd4e359e700 1 -- 172.21.15.60:0/4165465756 shutdown_connections 2020-10-31T22:48:19.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.597+0000 7fd4e359e700 1 -- 172.21.15.60:0/4165465756 wait complete. 2020-10-31T22:48:19.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.597+0000 7fd4e359e700 1 Processor -- start 2020-10-31T22:48:19.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.597+0000 7fd4e359e700 1 -- start start 2020-10-31T22:48:19.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4e4063140 0x7fd4e40639a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4e40ae740 0x7fd4e41419d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4e40aee10 0x7fd4e4141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e41423b0 con 0x7fd4e4063140 2020-10-31T22:48:19.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e4143e70 con 0x7fd4e40ae740 2020-10-31T22:48:19.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e41429a0 con 0x7fd4e40aee10 2020-10-31T22:48:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4e4063140 0x7fd4e40639a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4e4063140 0x7fd4e40639a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46264/0 (socket says 172.21.15.60:46264) 2020-10-31T22:48:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e259c700 1 -- 172.21.15.60:0/2407599177 learned_addr learned my addr 172.21.15.60:0/2407599177 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e1d9b700 1 --2- 172.21.15.60:0/2407599177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4e40ae740 0x7fd4e41419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e2d9d700 1 --2- 172.21.15.60:0/2407599177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4e40aee10 0x7fd4e4141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e259c700 1 -- 172.21.15.60:0/2407599177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4e40aee10 msgr2=0x7fd4e4141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e259c700 1 --2- 172.21.15.60:0/2407599177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4e40aee10 0x7fd4e4141ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e259c700 1 -- 172.21.15.60:0/2407599177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4e40ae740 msgr2=0x7fd4e41419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e259c700 1 --2- 172.21.15.60:0/2407599177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4e40ae740 0x7fd4e41419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e259c700 1 -- 172.21.15.60:0/2407599177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4141560 con 0x7fd4e4063140 2020-10-31T22:48:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e259c700 1 --2- 172.21.15.60:0/2407599177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4e4063140 0x7fd4e40639a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7fd4d4002f30 tx=0x7fd4d4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4d37fe700 1 -- 172.21.15.60:0/2407599177 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d4011e50 con 0x7fd4e4063140 2020-10-31T22:48:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4d37fe700 1 -- 172.21.15.60:0/2407599177 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d401e460 con 0x7fd4e4063140 2020-10-31T22:48:19.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e359e700 1 -- 172.21.15.60:0/2407599177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e4146de0 con 0x7fd4e4063140 2020-10-31T22:48:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4d37fe700 1 -- 172.21.15.60:0/2407599177 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd4d401e7c0 con 0x7fd4e4063140 2020-10-31T22:48:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.601+0000 7fd4e359e700 1 -- 172.21.15.60:0/2407599177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e4142620 con 0x7fd4e4063140 2020-10-31T22:48:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.605+0000 7fd4e359e700 1 -- 172.21.15.60:0/2407599177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e4146c40 con 0x7fd4e4063140 2020-10-31T22:48:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.605+0000 7fd4d37fe700 1 -- 172.21.15.60:0/2407599177 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd4d4025030 con 0x7fd4e4063140 2020-10-31T22:48:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.605+0000 7fd4d37fe700 1 --2- 172.21.15.60:0/2407599177 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd4c0054f10 0x7fd4c00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.605+0000 7fd4d37fe700 1 -- 172.21.15.60:0/2407599177 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd4d406ede0 con 0x7fd4e4063140 2020-10-31T22:48:19.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.605+0000 7fd4e1d9b700 1 --2- 172.21.15.60:0/2407599177 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd4c0054f10 0x7fd4c00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.605+0000 7fd4e1d9b700 1 --2- 172.21.15.60:0/2407599177 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd4c0054f10 0x7fd4c00573d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fd4d800d000 tx=0x7fd4d8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:19.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.617+0000 7fd4d37fe700 1 -- 172.21.15.60:0/2407599177 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd4e4146c40 con 0x7fd4e4063140 2020-10-31T22:48:19.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.761+0000 7fd4e359e700 1 -- 172.21.15.60:0/2407599177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4e4146c40 con 0x7fd4e4063140 2020-10-31T22:48:19.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.761+0000 7fd4d37fe700 1 -- 172.21.15.60:0/2407599177 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd4e4146c40 con 0x7fd4e4063140 2020-10-31T22:48:19.767 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:48:19.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.761+0000 7fd4e359e700 1 -- 172.21.15.60:0/2407599177 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd4c0054f10 msgr2=0x7fd4c00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.761+0000 7fd4e359e700 1 --2- 172.21.15.60:0/2407599177 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd4c0054f10 0x7fd4c00573d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7fd4d800d000 tx=0x7fd4d8008040).stop 2020-10-31T22:48:19.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.761+0000 7fd4e359e700 1 -- 172.21.15.60:0/2407599177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4e4063140 msgr2=0x7fd4e40639a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.761+0000 7fd4e359e700 1 --2- 172.21.15.60:0/2407599177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4e4063140 0x7fd4e40639a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 rx=0x7fd4d4002f30 tx=0x7fd4d4015000).stop 2020-10-31T22:48:19.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.761+0000 7fd4e359e700 1 -- 172.21.15.60:0/2407599177 shutdown_connections 2020-10-31T22:48:19.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.761+0000 7fd4e359e700 1 --2- 172.21.15.60:0/2407599177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4e40aee10 0x7fd4e4141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.761+0000 7fd4e359e700 1 --2- 172.21.15.60:0/2407599177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd4e4063140 0x7fd4e40639a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.761+0000 7fd4e359e700 1 --2- 172.21.15.60:0/2407599177 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd4c0054f10 0x7fd4c00573d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.761+0000 7fd4e359e700 1 --2- 172.21.15.60:0/2407599177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4e40ae740 0x7fd4e41419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.761+0000 7fd4e359e700 1 -- 172.21.15.60:0/2407599177 >> 172.21.15.60:0/2407599177 conn(0x7fd4e406a600 msgr2=0x7fd4e40a9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:19.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.761+0000 7fd4e359e700 1 -- 172.21.15.60:0/2407599177 shutdown_connections 2020-10-31T22:48:19.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.761+0000 7fd4e359e700 1 -- 172.21.15.60:0/2407599177 wait complete. 2020-10-31T22:48:19.781 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:48:19.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61cbfff700 1 Processor -- start 2020-10-31T22:48:19.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61cbfff700 1 -- start start 2020-10-31T22:48:19.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61cbfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f61cc05b320 0x7f61cc0b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61cbfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc05b700 con 0x7f61cc0ad610 2020-10-31T22:48:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61cbfff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61cc140750 con 0x7f61cc0acc60 2020-10-31T22:48:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61cbfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61cc0b0340 con 0x7f61cc05b320 2020-10-31T22:48:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61cb7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f61cc0ad610 0x7f61cc0ada80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50412/0 (socket says 172.21.15.60:50412) 2020-10-31T22:48:19.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61caffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f61cc05b320 0x7f61cc0b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61cb7fe700 1 -- 172.21.15.60:0/2645069846 learned_addr learned my addr 172.21.15.60:0/2645069846 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:19.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61c9ffb700 1 -- 172.21.15.60:0/2645069846 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933481535 0 0) 0x7f61cc05b700 con 0x7f61cc0ad610 2020-10-31T22:48:19.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61c9ffb700 1 -- 172.21.15.60:0/2645069846 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61ac003230 con 0x7f61cc0ad610 2020-10-31T22:48:19.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61caffd700 1 -- 172.21.15.60:0/2645069846 >> v1:172.21.15.66:6789/0 conn(0x7f61cc0acc60 legacy=0x7f61cc0b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61caffd700 1 -- 172.21.15.60:0/2645069846 >> v1:172.21.15.60:6789/0 conn(0x7f61cc0ad610 legacy=0x7f61cc0ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61c9ffb700 1 -- 172.21.15.60:0/2645069846 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714575808 0 0) 0x7f61cc140750 con 0x7f61cc0acc60 2020-10-31T22:48:19.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61caffd700 1 -- 172.21.15.60:0/2645069846 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc0b05e0 con 0x7f61cc05b320 2020-10-31T22:48:19.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.897+0000 7f61caffd700 1 --2- 172.21.15.60:0/2645069846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc05b320 0x7f61cc0b1db0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f61bc002f30 tx=0x7f61bc006dc0).ready entity=mon.1 client_cookie=8b727afa6408167e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:19.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.901+0000 7f61c9ffb700 1 -- 172.21.15.60:0/2645069846 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61bc009800 con 0x7f61cc05b320 2020-10-31T22:48:19.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.901+0000 7f61c9ffb700 1 -- 172.21.15.60:0/2645069846 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc009960 con 0x7f61cc05b320 2020-10-31T22:48:19.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.901+0000 7f61c9ffb700 1 -- 172.21.15.60:0/2645069846 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61bc009cc0 con 0x7f61cc05b320 2020-10-31T22:48:19.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.901+0000 7f61cbfff700 1 -- 172.21.15.60:0/2645069846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc05b320 msgr2=0x7f61cc0b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.901+0000 7f61cbfff700 1 --2- 172.21.15.60:0/2645069846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc05b320 0x7f61cc0b1db0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f61bc002f30 tx=0x7f61bc006dc0).stop 2020-10-31T22:48:19.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.901+0000 7f61cbfff700 1 -- 172.21.15.60:0/2645069846 shutdown_connections 2020-10-31T22:48:19.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.901+0000 7f61cbfff700 1 --2- 172.21.15.60:0/2645069846 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc05b320 0x7f61cc0b1db0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.901+0000 7f61cbfff700 1 -- 172.21.15.60:0/2645069846 >> 172.21.15.60:0/2645069846 conn(0x7f61cc0b61d0 msgr2=0x7f61cc0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:19.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.901+0000 7f61cbfff700 1 -- 172.21.15.60:0/2645069846 shutdown_connections 2020-10-31T22:48:19.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.901+0000 7f61cbfff700 1 -- 172.21.15.60:0/2645069846 wait complete. 2020-10-31T22:48:19.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.901+0000 7f61cbfff700 1 Processor -- start 2020-10-31T22:48:19.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.901+0000 7f61cbfff700 1 -- start start 2020-10-31T22:48:19.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61cbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61cc05b320 0x7f61cc14e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61cbfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61cc0acc60 0x7f61cc152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61cbfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc0ad610 0x7f61cc0b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61cbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc1411e0 con 0x7f61cc05b320 2020-10-31T22:48:19.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61cbfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc151e10 con 0x7f61cc0ad610 2020-10-31T22:48:19.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61cbfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc140f40 con 0x7f61cc0acc60 2020-10-31T22:48:19.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61caffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61cc05b320 0x7f61cc14e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61caffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61cc05b320 0x7f61cc14e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46278/0 (socket says 172.21.15.60:46278) 2020-10-31T22:48:19.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61caffd700 1 -- 172.21.15.60:0/1415500316 learned_addr learned my addr 172.21.15.60:0/1415500316 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:19.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61ca7fc700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61cc0acc60 0x7f61cc152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61cb7fe700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc0ad610 0x7f61cc0b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61caffd700 1 -- 172.21.15.60:0/1415500316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61cc0acc60 msgr2=0x7f61cc152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61caffd700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61cc0acc60 0x7f61cc152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61caffd700 1 -- 172.21.15.60:0/1415500316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc0ad610 msgr2=0x7f61cc0b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:19.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61caffd700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc0ad610 0x7f61cc0b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:19.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61caffd700 1 -- 172.21.15.60:0/1415500316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc152070 con 0x7f61cc05b320 2020-10-31T22:48:19.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61cb7fe700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc0ad610 0x7f61cc0b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:19.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61caffd700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61cc05b320 0x7f61cc14e740 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f61bc002f30 tx=0x7f61bc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:19.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61c3fff700 1 -- 172.21.15.60:0/1415500316 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61bc011c80 con 0x7f61cc05b320 2020-10-31T22:48:19.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61c3fff700 1 -- 172.21.15.60:0/1415500316 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61bc011de0 con 0x7f61cc05b320 2020-10-31T22:48:19.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61c3fff700 1 -- 172.21.15.60:0/1415500316 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61bc01d640 con 0x7f61cc05b320 2020-10-31T22:48:19.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61cbfff700 1 -- 172.21.15.60:0/1415500316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc14ec30 con 0x7f61cc05b320 2020-10-31T22:48:19.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61cbfff700 1 -- 172.21.15.60:0/1415500316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc064ce0 con 0x7f61cc05b320 2020-10-31T22:48:19.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.905+0000 7f61cbfff700 1 -- 172.21.15.60:0/1415500316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61cc057100 con 0x7f61cc05b320 2020-10-31T22:48:19.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.909+0000 7f61c3fff700 1 -- 172.21.15.60:0/1415500316 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f61bc00f070 con 0x7f61cc05b320 2020-10-31T22:48:19.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.909+0000 7f61c3fff700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f61b0054f10 0x7f61b00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:19.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.909+0000 7f61c3fff700 1 -- 172.21.15.60:0/1415500316 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f61bc070220 con 0x7f61cc05b320 2020-10-31T22:48:19.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.909+0000 7f61ca7fc700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f61b0054f10 0x7f61b00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:19.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.909+0000 7f61ca7fc700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f61b0054f10 0x7f61b00573d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f61b400d000 tx=0x7f61b4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:19.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:19.913+0000 7f61c3fff700 1 -- 172.21.15.60:0/1415500316 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f61bc04a060 con 0x7f61cc05b320 2020-10-31T22:48:20.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.061+0000 7f61cbfff700 1 -- 172.21.15.60:0/1415500316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f61cc0ae950 con 0x7f61cc05b320 2020-10-31T22:48:20.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.061+0000 7f61c3fff700 1 -- 172.21.15.60:0/1415500316 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+10 (secure 0 0 0) 0x7f61bc049c50 con 0x7f61cc05b320 2020-10-31T22:48:20.067 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:48:20.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.061+0000 7f61cbfff700 1 -- 172.21.15.60:0/1415500316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f61b0054f10 msgr2=0x7f61b00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:20.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.061+0000 7f61cbfff700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f61b0054f10 0x7f61b00573d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7f61b400d000 tx=0x7f61b4009040).stop 2020-10-31T22:48:20.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.061+0000 7f61cbfff700 1 -- 172.21.15.60:0/1415500316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61cc05b320 msgr2=0x7f61cc14e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:20.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.061+0000 7f61cbfff700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61cc05b320 0x7f61cc14e740 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 rx=0x7f61bc002f30 tx=0x7f61bc015000).stop 2020-10-31T22:48:20.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.061+0000 7f61cbfff700 1 -- 172.21.15.60:0/1415500316 shutdown_connections 2020-10-31T22:48:20.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.061+0000 7f61cbfff700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f61b0054f10 0x7f61b00573d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.061+0000 7f61cbfff700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61cc0ad610 0x7f61cc0b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.061+0000 7f61cbfff700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61cc05b320 0x7f61cc14e740 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.061+0000 7f61cbfff700 1 --2- 172.21.15.60:0/1415500316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61cc0acc60 0x7f61cc152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.061+0000 7f61cbfff700 1 -- 172.21.15.60:0/1415500316 >> 172.21.15.60:0/1415500316 conn(0x7f61cc0b61d0 msgr2=0x7f61cc13e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:20.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.061+0000 7f61cbfff700 1 -- 172.21.15.60:0/1415500316 shutdown_connections 2020-10-31T22:48:20.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.061+0000 7f61cbfff700 1 -- 172.21.15.60:0/1415500316 wait complete. 2020-10-31T22:48:20.081 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:48:20.082 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ef59e700 1 Processor -- start 2020-10-31T22:48:20.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ef59e700 1 -- start start 2020-10-31T22:48:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ef59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13f00ae5b0 0x7f13f005afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ef59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13f005b4d0 0x7f13f013f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ef59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f13f0141c90 0x7f13f013f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ef59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f0142210 con 0x7f13f00ae5b0 2020-10-31T22:48:20.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ef59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13f01424b0 con 0x7f13f0141c90 2020-10-31T22:48:20.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ef59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f0142750 con 0x7f13f005b4d0 2020-10-31T22:48:20.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ee59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13f00ae5b0 0x7f13f005afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:20.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ee59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13f00ae5b0 0x7f13f005afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46286/0 (socket says 172.21.15.60:46286) 2020-10-31T22:48:20.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ee59c700 1 -- 172.21.15.60:0/1440389508 learned_addr learned my addr 172.21.15.60:0/1440389508 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:20.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13eed9d700 1 --2- 172.21.15.60:0/1440389508 >> v2:172.21.15.66:3300/0 conn(0x7f13f0141c90 0x7f13f013f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:20.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13edd9b700 1 --2- 172.21.15.60:0/1440389508 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13f005b4d0 0x7f13f013f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:20.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ee59c700 1 -- 172.21.15.60:0/1440389508 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13f005b4d0 msgr2=0x7f13f013f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:20.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ee59c700 1 --2- 172.21.15.60:0/1440389508 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13f005b4d0 0x7f13f013f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ee59c700 1 -- 172.21.15.60:0/1440389508 >> v2:172.21.15.66:3300/0 conn(0x7f13f0141c90 msgr2=0x7f13f013f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:20.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ee59c700 1 --2- 172.21.15.60:0/1440389508 >> v2:172.21.15.66:3300/0 conn(0x7f13f0141c90 0x7f13f013f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ee59c700 1 -- 172.21.15.60:0/1440389508 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f01429f0 con 0x7f13f00ae5b0 2020-10-31T22:48:20.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ee59c700 1 --2- 172.21.15.60:0/1440389508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00ae5b0 0x7f13f005afe0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f13e00032b0 tx=0x7f13e0009270).ready entity=mon.0 client_cookie=180389da409102f2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:20.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ed59a700 1 -- 172.21.15.60:0/1440389508 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e0009e60 con 0x7f13f00ae5b0 2020-10-31T22:48:20.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ed59a700 1 -- 172.21.15.60:0/1440389508 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e000bc00 con 0x7f13f00ae5b0 2020-10-31T22:48:20.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ed59a700 1 -- 172.21.15.60:0/1440389508 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e000bd70 con 0x7f13f00ae5b0 2020-10-31T22:48:20.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ef59e700 1 -- 172.21.15.60:0/1440389508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00ae5b0 msgr2=0x7f13f005afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:20.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.189+0000 7f13ef59e700 1 --2- 172.21.15.60:0/1440389508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00ae5b0 0x7f13f005afe0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 rx=0x7f13e00032b0 tx=0x7f13e0009270).stop 2020-10-31T22:48:20.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 -- 172.21.15.60:0/1440389508 shutdown_connections 2020-10-31T22:48:20.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 --2- 172.21.15.60:0/1440389508 >> v2:172.21.15.66:3300/0 conn(0x7f13f0141c90 0x7f13f013f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 --2- 172.21.15.60:0/1440389508 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00ae5b0 0x7f13f005afe0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 --2- 172.21.15.60:0/1440389508 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13f005b4d0 0x7f13f013f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 -- 172.21.15.60:0/1440389508 >> 172.21.15.60:0/1440389508 conn(0x7f13f00b61d0 msgr2=0x7f13f00b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:20.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 -- 172.21.15.60:0/1440389508 shutdown_connections 2020-10-31T22:48:20.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 -- 172.21.15.60:0/1440389508 wait complete. 2020-10-31T22:48:20.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 Processor -- start 2020-10-31T22:48:20.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 -- start start 2020-10-31T22:48:20.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00ae5b0 0x7f13f013ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:20.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13f0141c90 0x7f13f0144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:20.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13f0148e90 0x7f13f0145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:20.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f01481f0 con 0x7f13f00ae5b0 2020-10-31T22:48:20.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f0148490 con 0x7f13f0141c90 2020-10-31T22:48:20.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ef59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f0148730 con 0x7f13f0148e90 2020-10-31T22:48:20.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ee59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00ae5b0 0x7f13f013ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:20.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ee59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00ae5b0 0x7f13f013ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46296/0 (socket says 172.21.15.60:46296) 2020-10-31T22:48:20.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13ee59c700 1 -- 172.21.15.60:0/3536822352 learned_addr learned my addr 172.21.15.60:0/3536822352 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:20.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13edd9b700 1 --2- 172.21.15.60:0/3536822352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13f0141c90 0x7f13f0144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:20.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.193+0000 7f13eed9d700 1 --2- 172.21.15.60:0/3536822352 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13f0148e90 0x7f13f0145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:20.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13ee59c700 1 -- 172.21.15.60:0/3536822352 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13f0148e90 msgr2=0x7f13f0145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:20.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13ee59c700 1 --2- 172.21.15.60:0/3536822352 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13f0148e90 0x7f13f0145330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13ee59c700 1 -- 172.21.15.60:0/3536822352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13f0141c90 msgr2=0x7f13f0144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:20.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13ee59c700 1 --2- 172.21.15.60:0/3536822352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13f0141c90 0x7f13f0144e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13ee59c700 1 -- 172.21.15.60:0/3536822352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f01489d0 con 0x7f13f00ae5b0 2020-10-31T22:48:20.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13ee59c700 1 --2- 172.21.15.60:0/3536822352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00ae5b0 0x7f13f013ca20 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f13e00032b0 tx=0x7f13e0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:20.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13df7fe700 1 -- 172.21.15.60:0/3536822352 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e00107a0 con 0x7f13f00ae5b0 2020-10-31T22:48:20.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13df7fe700 1 -- 172.21.15.60:0/3536822352 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13e000bed0 con 0x7f13f00ae5b0 2020-10-31T22:48:20.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13ef59e700 1 -- 172.21.15.60:0/3536822352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f0147e60 con 0x7f13f00ae5b0 2020-10-31T22:48:20.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13df7fe700 1 -- 172.21.15.60:0/3536822352 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13e0010af0 con 0x7f13f00ae5b0 2020-10-31T22:48:20.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13ef59e700 1 -- 172.21.15.60:0/3536822352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f0145a40 con 0x7f13f00ae5b0 2020-10-31T22:48:20.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13ef59e700 1 -- 172.21.15.60:0/3536822352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f0147b00 con 0x7f13f00ae5b0 2020-10-31T22:48:20.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13df7fe700 1 -- 172.21.15.60:0/3536822352 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f13e0026030 con 0x7f13f00ae5b0 2020-10-31T22:48:20.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13df7fe700 1 --2- 172.21.15.60:0/3536822352 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f13cc054f30 0x7f13cc0573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:20.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13df7fe700 1 -- 172.21.15.60:0/3536822352 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f13e006ec30 con 0x7f13f00ae5b0 2020-10-31T22:48:20.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13edd9b700 1 --2- 172.21.15.60:0/3536822352 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f13cc054f30 0x7f13cc0573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:20.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.197+0000 7f13edd9b700 1 --2- 172.21.15.60:0/3536822352 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f13cc054f30 0x7f13cc0573f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f13e400b000 tx=0x7f13e4006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:20.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.205+0000 7f13df7fe700 1 -- 172.21.15.60:0/3536822352 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f13f0147b00 con 0x7f13f00ae5b0 2020-10-31T22:48:20.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.385+0000 7f13ef59e700 1 -- 172.21.15.60:0/3536822352 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13f0147b00 con 0x7f13f00ae5b0 2020-10-31T22:48:20.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.385+0000 7f13df7fe700 1 -- 172.21.15.60:0/3536822352 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f13e00249d0 con 0x7f13f00ae5b0 2020-10-31T22:48:20.392 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:20.392 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":41,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3668788118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3668788118},{"type":"v1","addr":"172.21.15.60:6835","nonce":3668788118}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6516,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/3884009815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3884009815},{"type":"v1","addr":"172.21.15.60:6837","nonce":3884009815}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:48:15.434973+0000","modified":"2020-10-31T22:48:16.437431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"b","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/2702869569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2702869569},{"type":"v1","addr":"172.21.15.66:6833","nonce":2702869569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-10-31T22:48:20.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.385+0000 7f13ef59e700 1 -- 172.21.15.60:0/3536822352 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f13cc054f30 msgr2=0x7f13cc0573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:20.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.385+0000 7f13ef59e700 1 --2- 172.21.15.60:0/3536822352 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f13cc054f30 0x7f13cc0573f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7f13e400b000 tx=0x7f13e4006dc0).stop 2020-10-31T22:48:20.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.385+0000 7f13ef59e700 1 -- 172.21.15.60:0/3536822352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00ae5b0 msgr2=0x7f13f013ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:20.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.385+0000 7f13ef59e700 1 --2- 172.21.15.60:0/3536822352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00ae5b0 0x7f13f013ca20 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 rx=0x7f13e00032b0 tx=0x7f13e0016000).stop 2020-10-31T22:48:20.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.385+0000 7f13ef59e700 1 -- 172.21.15.60:0/3536822352 shutdown_connections 2020-10-31T22:48:20.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.385+0000 7f13ef59e700 1 --2- 172.21.15.60:0/3536822352 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13f0148e90 0x7f13f0145330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.385+0000 7f13ef59e700 1 --2- 172.21.15.60:0/3536822352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13f00ae5b0 0x7f13f013ca20 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.385+0000 7f13ef59e700 1 --2- 172.21.15.60:0/3536822352 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f13cc054f30 0x7f13cc0573f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.385+0000 7f13ef59e700 1 --2- 172.21.15.60:0/3536822352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13f0141c90 0x7f13f0144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:20.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.385+0000 7f13ef59e700 1 -- 172.21.15.60:0/3536822352 >> 172.21.15.60:0/3536822352 conn(0x7f13f00b61d0 msgr2=0x7f13f005b950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:20.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.389+0000 7f13ef59e700 1 -- 172.21.15.60:0/3536822352 shutdown_connections 2020-10-31T22:48:20.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:20.389+0000 7f13ef59e700 1 -- 172.21.15.60:0/3536822352 wait complete. 2020-10-31T22:48:20.397 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 41 2020-10-31T22:48:20.706 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:48:15.434973+0000', 'modified': '2020-10-31T22:48:16.437431+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6519}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6519': {'gid': 6519, 'name': 'b', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6833/2702869569', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 2702869569}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 2702869569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:48:20.707 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:48:20.708 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-10-31T22:48:20.842 INFO:teuthology.orchestra.run.smithi066.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":6519,"want_state":"up:active","state":"up:active","rank_uptime":5.3917290060000003,"mdsmap_epoch":41,"osdmap_epoch":88,"osdmap_epoch_barrier":87,"uptime":10.791842527} 2020-10-31T22:48:20.843 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 6519, "mdsmap_epoch": 41, "osdmap_epoch": 88, "osdmap_epoch_barrier": 87, "rank_uptime": 5.391729006, "state": "up:active", "uptime": 10.791842527, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:48:20.844 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:48:20.844 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:48:20.845 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:48:20.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:20.850 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:20.863 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:48:20.934 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:48:21.239 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:48:21.255 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:48:21.256 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:48:21.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:21.258 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:48:21.307 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:48:21.308 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:21.349 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:48:21.362 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:48:21.363 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:48:21.422 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:48:21.423 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:48:21.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:21.424 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:48:21.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13718]: starting ceph client 2020-10-31T22:48:21.425 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:48:21.419+0000 7f2d79e8a0c0 -1 init, newargv = 0x55a098499c00 newargc=9 2020-10-31T22:48:21.434 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13718]: starting fuse 2020-10-31T22:48:21.440 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:48:21.440 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:48:21.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:21.441 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:48:21.441 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:48:21.442 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:48:21.442 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:48:21.442 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:48:21.443 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:48:21.443 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:48:21.443 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:48:21.444 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:48:21.444 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:48:21.444 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:48:21.444 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:48:21.445 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:48:21.445 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:48:21.445 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:48:21.446 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:48:21.446 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:48:21.446 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:48:21.447 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:48:21.447 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:48:21.447 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:48:21.448 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:48:21.448 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:48:21.528 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.13718.asok 2020-10-31T22:48:21.533 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13718.asok 2020-10-31T22:48:21.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:21.535 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13718.asok status 2020-10-31T22:48:21.631 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:48:21.631 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:48:21.631 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:48:21.632 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:48:21.632 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:48:21.632 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:48:21.632 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:48:21.632 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "13718", 2020-10-31T22:48:21.632 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:48:21.633 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:48:21.633 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:48:21.633 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:48:21.633 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 6666, 2020-10-31T22:48:21.633 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:48:21.633 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:48:21.634 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:48:21.634 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 6666 2020-10-31T22:48:21.634 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:48:21.634 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:48:21.634 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:48:21.634 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:48:21.634 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2374117467 2020-10-31T22:48:21.635 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:48:21.635 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:48:21.635 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:48:21.635 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:48:21.635 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:48:21.635 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2374117467 2020-10-31T22:48:21.636 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:48:21.636 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.6666 172.21.15.152:0/2374117467", 2020-10-31T22:48:21.636 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/2374117467", 2020-10-31T22:48:21.636 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:48:21.636 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 41, 2020-10-31T22:48:21.636 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 88, 2020-10-31T22:48:21.638 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:48:21.638 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:48:21.638 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:48:21.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:21.643 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:21.643 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:21.651 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:48:21.652 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:48:21.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:21.653 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:21.711 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:48:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.825+0000 7f582f85d700 1 Processor -- start 2020-10-31T22:48:21.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.825+0000 7f582f85d700 1 -- start start 2020-10-31T22:48:21.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582f85d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f58280b1ee0 0x7f58280af470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:21.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582f85d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f58280a8270 0x7f58281419d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:21.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582f85d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58280b22c0 con 0x7f58280ada30 2020-10-31T22:48:21.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582f85d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5828141ec0 con 0x7f58280b1ee0 2020-10-31T22:48:21.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582f85d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5828061ab0 con 0x7f58280a8270 2020-10-31T22:48:21.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582d5f9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f58280b1ee0 0x7f58280af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:21.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582ddfa700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f58280ada30 0x7f582805afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50440/0 (socket says 172.21.15.60:50440) 2020-10-31T22:48:21.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582ddfa700 1 -- 172.21.15.60:0/4132079503 learned_addr learned my addr 172.21.15.60:0/4132079503 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:21.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582cdf8700 1 --2- 172.21.15.60:0/4132079503 >> v2:172.21.15.66:3300/0 conn(0x7f58280a8270 0x7f58281419d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:21.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f581ffff700 1 -- 172.21.15.60:0/4132079503 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2028361250 0 0) 0x7f58280b22c0 con 0x7f58280ada30 2020-10-31T22:48:21.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f581ffff700 1 -- 172.21.15.60:0/4132079503 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5814003230 con 0x7f58280ada30 2020-10-31T22:48:21.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582d5f9700 1 -- 172.21.15.60:0/4132079503 >> v2:172.21.15.66:3300/0 conn(0x7f58280a8270 msgr2=0x7f58281419d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:21.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582d5f9700 1 --2- 172.21.15.60:0/4132079503 >> v2:172.21.15.66:3300/0 conn(0x7f58280a8270 0x7f58281419d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:21.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582d5f9700 1 -- 172.21.15.60:0/4132079503 >> v1:172.21.15.60:6789/0 conn(0x7f58280ada30 legacy=0x7f582805afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:21.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582d5f9700 1 -- 172.21.15.60:0/4132079503 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5828061d50 con 0x7f58280b1ee0 2020-10-31T22:48:21.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582d5f9700 1 --2- 172.21.15.60:0/4132079503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58280b1ee0 0x7f58280af470 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f5818002f30 tx=0x7f5818006dc0).ready entity=mon.0 client_cookie=414db05ea1b6a066 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:21.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f581ffff700 1 -- 172.21.15.60:0/4132079503 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f58180096f0 con 0x7f58280b1ee0 2020-10-31T22:48:21.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f581ffff700 1 -- 172.21.15.60:0/4132079503 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5818009850 con 0x7f58280b1ee0 2020-10-31T22:48:21.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f581ffff700 1 -- 172.21.15.60:0/4132079503 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5818009bb0 con 0x7f58280b1ee0 2020-10-31T22:48:21.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582f85d700 1 -- 172.21.15.60:0/4132079503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58280b1ee0 msgr2=0x7f58280af470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:21.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582f85d700 1 --2- 172.21.15.60:0/4132079503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58280b1ee0 0x7f58280af470 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 rx=0x7f5818002f30 tx=0x7f5818006dc0).stop 2020-10-31T22:48:21.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582f85d700 1 -- 172.21.15.60:0/4132079503 shutdown_connections 2020-10-31T22:48:21.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582f85d700 1 --2- 172.21.15.60:0/4132079503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58280b1ee0 0x7f58280af470 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:21.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582f85d700 1 --2- 172.21.15.60:0/4132079503 >> v2:172.21.15.66:3300/0 conn(0x7f58280a8270 0x7f58281419d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:21.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582f85d700 1 -- 172.21.15.60:0/4132079503 >> 172.21.15.60:0/4132079503 conn(0x7f5828062310 msgr2=0x7f5828062720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:21.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582f85d700 1 -- 172.21.15.60:0/4132079503 shutdown_connections 2020-10-31T22:48:21.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.829+0000 7f582f85d700 1 -- 172.21.15.60:0/4132079503 wait complete. 2020-10-31T22:48:21.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582f85d700 1 Processor -- start 2020-10-31T22:48:21.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582f85d700 1 -- start start 2020-10-31T22:48:21.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582f85d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58280a8270 0x7f5828142340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:21.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582f85d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f58280ada30 0x7f58280658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:21.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582f85d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58280b1ee0 0x7f5828065d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:21.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582f85d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5828067050 con 0x7f58280b1ee0 2020-10-31T22:48:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582f85d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5828065470 con 0x7f58280a8270 2020-10-31T22:48:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582f85d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5828066280 con 0x7f58280ada30 2020-10-31T22:48:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582ddfa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58280b1ee0 0x7f5828065d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582ddfa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58280b1ee0 0x7f5828065d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46310/0 (socket says 172.21.15.60:46310) 2020-10-31T22:48:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582d5f9700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58280a8270 0x7f5828142340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582ddfa700 1 -- 172.21.15.60:0/3578085359 learned_addr learned my addr 172.21.15.60:0/3578085359 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:21.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582cdf8700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f58280ada30 0x7f58280658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582d5f9700 1 -- 172.21.15.60:0/3578085359 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f58280ada30 msgr2=0x7f58280658a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582d5f9700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f58280ada30 0x7f58280658a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582d5f9700 1 -- 172.21.15.60:0/3578085359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58280b1ee0 msgr2=0x7f5828065d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582d5f9700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58280b1ee0 0x7f5828065d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582d5f9700 1 -- 172.21.15.60:0/3578085359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582813dc30 con 0x7f58280a8270 2020-10-31T22:48:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582ddfa700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58280b1ee0 0x7f5828065d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:21.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582d5f9700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58280a8270 0x7f5828142340 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f5828065780 tx=0x7f5818015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:21.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f581e7fc700 1 -- 172.21.15.60:0/3578085359 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5818011890 con 0x7f58280a8270 2020-10-31T22:48:21.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f581e7fc700 1 -- 172.21.15.60:0/3578085359 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58180119f0 con 0x7f58280a8270 2020-10-31T22:48:21.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582f85d700 1 -- 172.21.15.60:0/3578085359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582813ded0 con 0x7f58280a8270 2020-10-31T22:48:21.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f581e7fc700 1 -- 172.21.15.60:0/3578085359 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5818011d50 con 0x7f58280a8270 2020-10-31T22:48:21.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.833+0000 7f582f85d700 1 -- 172.21.15.60:0/3578085359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5828151c10 con 0x7f58280a8270 2020-10-31T22:48:21.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.837+0000 7f582f85d700 1 -- 172.21.15.60:0/3578085359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5828057100 con 0x7f58280a8270 2020-10-31T22:48:21.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.837+0000 7f581e7fc700 1 -- 172.21.15.60:0/3578085359 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5818024030 con 0x7f58280a8270 2020-10-31T22:48:21.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.837+0000 7f581e7fc700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5808054f10 0x7f58080573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:21.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.837+0000 7f581e7fc700 1 -- 172.21.15.60:0/3578085359 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f581806e8c0 con 0x7f58280a8270 2020-10-31T22:48:21.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.837+0000 7f582cdf8700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5808054f10 0x7f58080573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:21.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.837+0000 7f582cdf8700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5808054f10 0x7f58080573d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f582400b000 tx=0x7f58240091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.849+0000 7f581e7fc700 1 -- 172.21.15.60:0/3578085359 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5818044de0 con 0x7f58280a8270 2020-10-31T22:48:22.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.993+0000 7f582f85d700 1 -- 172.21.15.60:0/3578085359 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58280655b0 con 0x7f58280a8270 2020-10-31T22:48:22.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.997+0000 7f581e7fc700 1 -- 172.21.15.60:0/3578085359 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f5818022020 con 0x7f58280a8270 2020-10-31T22:48:22.003 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:22.003 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":88,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:48:16.438220+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":15,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:48:12.972001+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":16,"pool_name":"cephfs_data","create_time":"2020-10-31T22:48:14.284102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:48:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.997+0000 7f582f85d700 1 -- 172.21.15.60:0/3578085359 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5808054f10 msgr2=0x7f58080573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.997+0000 7f582f85d700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5808054f10 0x7f58080573d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7f582400b000 tx=0x7f58240091a0).stop 2020-10-31T22:48:22.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.997+0000 7f582f85d700 1 -- 172.21.15.60:0/3578085359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58280a8270 msgr2=0x7f5828142340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.997+0000 7f582f85d700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58280a8270 0x7f5828142340 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f5828065780 tx=0x7f5818015000).stop 2020-10-31T22:48:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.997+0000 7f582f85d700 1 -- 172.21.15.60:0/3578085359 shutdown_connections 2020-10-31T22:48:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.997+0000 7f582f85d700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f58280b1ee0 0x7f5828065d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.997+0000 7f582f85d700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5808054f10 0x7f58080573d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.997+0000 7f582f85d700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58280a8270 0x7f5828142340 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.997+0000 7f582f85d700 1 --2- 172.21.15.60:0/3578085359 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f58280ada30 0x7f58280658a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.997+0000 7f582f85d700 1 -- 172.21.15.60:0/3578085359 >> 172.21.15.60:0/3578085359 conn(0x7f5828062310 msgr2=0x7f58281410a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.997+0000 7f582f85d700 1 -- 172.21.15.60:0/3578085359 shutdown_connections 2020-10-31T22:48:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:21.997+0000 7f582f85d700 1 -- 172.21.15.60:0/3578085359 wait complete. 2020-10-31T22:48:22.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 15, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:48:12.972001+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 16, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:48:14.284102+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:48:22.029 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:48:22.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d3d74b700 1 Processor -- start 2020-10-31T22:48:22.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d3d74b700 1 -- start start 2020-10-31T22:48:22.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d3d74b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d3805b180 0x7f3d3805fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d3d74b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3d38060220 0x7f3d380aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d3d74b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3805f3c0 con 0x7f3d380b0b70 2020-10-31T22:48:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d3d74b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d38145f70 con 0x7f3d38060220 2020-10-31T22:48:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d3d74b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3805f5f0 con 0x7f3d3805b180 2020-10-31T22:48:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d377fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3d380b0b70 0x7f3d3813f030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50450/0 (socket says 172.21.15.60:50450) 2020-10-31T22:48:22.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d377fe700 1 -- 172.21.15.60:0/1137964881 learned_addr learned my addr 172.21.15.60:0/1137964881 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d37fff700 1 --2- 172.21.15.60:0/1137964881 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d3805b180 0x7f3d3805fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d3cf4a700 1 --2- 172.21.15.60:0/1137964881 >> v2:172.21.15.66:3300/0 conn(0x7f3d38060220 0x7f3d380aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d36ffd700 1 -- 172.21.15.60:0/1137964881 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776151993 0 0) 0x7f3d3805f3c0 con 0x7f3d380b0b70 2020-10-31T22:48:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d36ffd700 1 -- 172.21.15.60:0/1137964881 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d18003230 con 0x7f3d380b0b70 2020-10-31T22:48:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d36ffd700 1 -- 172.21.15.60:0/1137964881 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 554799403 0 0) 0x7f3d18003230 con 0x7f3d380b0b70 2020-10-31T22:48:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d36ffd700 1 -- 172.21.15.60:0/1137964881 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d3805b180 msgr2=0x7f3d3805fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:22.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d36ffd700 1 --2- 172.21.15.60:0/1137964881 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d3805b180 0x7f3d3805fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d36ffd700 1 -- 172.21.15.60:0/1137964881 >> v2:172.21.15.66:3300/0 conn(0x7f3d38060220 msgr2=0x7f3d380aef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:22.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d36ffd700 1 --2- 172.21.15.60:0/1137964881 >> v2:172.21.15.66:3300/0 conn(0x7f3d38060220 0x7f3d380aef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d36ffd700 1 -- 172.21.15.60:0/1137964881 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3805f890 con 0x7f3d380b0b70 2020-10-31T22:48:22.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.141+0000 7f3d36ffd700 1 -- 172.21.15.60:0/1137964881 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f3d280016d0 con 0x7f3d380b0b70 2020-10-31T22:48:22.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d36ffd700 1 -- 172.21.15.60:0/1137964881 >> v1:172.21.15.60:6789/0 conn(0x7f3d380b0b70 legacy=0x7f3d3813f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d36ffd700 1 --2- 172.21.15.60:0/1137964881 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d3805b180 0x7f3d18003720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d36ffd700 1 --2- 172.21.15.60:0/1137964881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d18003c30 0x7f3d180044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d36ffd700 1 --2- 172.21.15.60:0/1137964881 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d180049c0 0x7f3d18004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d36ffd700 1 -- 172.21.15.60:0/1137964881 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d38145f70 con 0x7f3d18003c30 2020-10-31T22:48:22.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d36ffd700 1 -- 172.21.15.60:0/1137964881 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3805f5f0 con 0x7f3d180049c0 2020-10-31T22:48:22.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d36ffd700 1 -- 172.21.15.60:0/1137964881 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180041f0 con 0x7f3d3805b180 2020-10-31T22:48:22.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d377fe700 1 --2- 172.21.15.60:0/1137964881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d18003c30 0x7f3d180044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d3cf4a700 1 --2- 172.21.15.60:0/1137964881 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d180049c0 0x7f3d18004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d37fff700 1 --2- 172.21.15.60:0/1137964881 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d3805b180 0x7f3d18003720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d377fe700 1 -- 172.21.15.60:0/1137964881 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d3805b180 msgr2=0x7f3d18003720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d377fe700 1 --2- 172.21.15.60:0/1137964881 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d3805b180 0x7f3d18003720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d377fe700 1 -- 172.21.15.60:0/1137964881 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d180049c0 msgr2=0x7f3d18004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d377fe700 1 --2- 172.21.15.60:0/1137964881 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d180049c0 0x7f3d18004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d377fe700 1 -- 172.21.15.60:0/1137964881 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d18003230 con 0x7f3d18003c30 2020-10-31T22:48:22.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d377fe700 1 --2- 172.21.15.60:0/1137964881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d18003c30 0x7f3d180044d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f3d280013e0 tx=0x7f3d28007740).ready entity=mon.0 client_cookie=3d679339c047ff0d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:22.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d36ffd700 1 -- 172.21.15.60:0/1137964881 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d280070d0 con 0x7f3d18003c30 2020-10-31T22:48:22.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d36ffd700 1 -- 172.21.15.60:0/1137964881 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d28007230 con 0x7f3d18003c30 2020-10-31T22:48:22.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d36ffd700 1 -- 172.21.15.60:0/1137964881 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d280055e0 con 0x7f3d18003c30 2020-10-31T22:48:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d3d74b700 1 -- 172.21.15.60:0/1137964881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d18003c30 msgr2=0x7f3d180044d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d3d74b700 1 --2- 172.21.15.60:0/1137964881 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d18003c30 0x7f3d180044d0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 rx=0x7f3d280013e0 tx=0x7f3d28007740).stop 2020-10-31T22:48:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d3cf4a700 1 -- 172.21.15.60:0/1137964881 reap_dead start 2020-10-31T22:48:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d3d74b700 1 -- 172.21.15.60:0/1137964881 shutdown_connections 2020-10-31T22:48:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d3d74b700 1 -- 172.21.15.60:0/1137964881 >> 172.21.15.60:0/1137964881 conn(0x7f3d380b61d0 msgr2=0x7f3d380b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:22.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d3d74b700 1 -- 172.21.15.60:0/1137964881 shutdown_connections 2020-10-31T22:48:22.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d3d74b700 1 -- 172.21.15.60:0/1137964881 wait complete. 2020-10-31T22:48:22.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d3d74b700 1 Processor -- start 2020-10-31T22:48:22.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.145+0000 7f3d3d74b700 1 -- start start 2020-10-31T22:48:22.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3d74b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d381442e0 0x7f3d3813e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3d74b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d3813e9d0 0x7f3d381411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3d74b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d381416d0 0x7f3d380a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3d74b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d380aceb0 con 0x7f3d381416d0 2020-10-31T22:48:22.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3d74b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d380ab710 con 0x7f3d3813e9d0 2020-10-31T22:48:22.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3d74b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d381446c0 con 0x7f3d381442e0 2020-10-31T22:48:22.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3cf4a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d381416d0 0x7f3d380a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3cf4a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d381416d0 0x7f3d380a9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46330/0 (socket says 172.21.15.60:46330) 2020-10-31T22:48:22.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3cf4a700 1 -- 172.21.15.60:0/2144443726 learned_addr learned my addr 172.21.15.60:0/2144443726 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:22.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d377fe700 1 --2- 172.21.15.60:0/2144443726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d3813e9d0 0x7f3d381411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d37fff700 1 --2- 172.21.15.60:0/2144443726 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d381442e0 0x7f3d3813e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3cf4a700 1 -- 172.21.15.60:0/2144443726 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d381442e0 msgr2=0x7f3d3813e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3cf4a700 1 --2- 172.21.15.60:0/2144443726 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d381442e0 0x7f3d3813e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3cf4a700 1 -- 172.21.15.60:0/2144443726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d3813e9d0 msgr2=0x7f3d381411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3cf4a700 1 --2- 172.21.15.60:0/2144443726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d3813e9d0 0x7f3d381411e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3cf4a700 1 -- 172.21.15.60:0/2144443726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d380ac4d0 con 0x7f3d381416d0 2020-10-31T22:48:22.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3cf4a700 1 --2- 172.21.15.60:0/2144443726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d381416d0 0x7f3d380a9fe0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f3d380acff0 tx=0x7f3d300091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:22.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d357fa700 1 -- 172.21.15.60:0/2144443726 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3000f910 con 0x7f3d381416d0 2020-10-31T22:48:22.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d357fa700 1 -- 172.21.15.60:0/2144443726 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3000fa70 con 0x7f3d381416d0 2020-10-31T22:48:22.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d357fa700 1 -- 172.21.15.60:0/2144443726 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d3000fbe0 con 0x7f3d381416d0 2020-10-31T22:48:22.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3d74b700 1 -- 172.21.15.60:0/2144443726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d380ac770 con 0x7f3d381416d0 2020-10-31T22:48:22.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3d74b700 1 -- 172.21.15.60:0/2144443726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3813ee50 con 0x7f3d381416d0 2020-10-31T22:48:22.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.149+0000 7f3d3d74b700 1 -- 172.21.15.60:0/2144443726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d38057100 con 0x7f3d381416d0 2020-10-31T22:48:22.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.153+0000 7f3d357fa700 1 -- 172.21.15.60:0/2144443726 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3d3000fd40 con 0x7f3d381416d0 2020-10-31T22:48:22.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.153+0000 7f3d357fa700 1 --2- 172.21.15.60:0/2144443726 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d1c0550c0 0x7f3d1c057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.153+0000 7f3d357fa700 1 -- 172.21.15.60:0/2144443726 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3d3006deb0 con 0x7f3d381416d0 2020-10-31T22:48:22.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.153+0000 7f3d37fff700 1 --2- 172.21.15.60:0/2144443726 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d1c0550c0 0x7f3d1c057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.153+0000 7f3d37fff700 1 --2- 172.21.15.60:0/2144443726 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d1c0550c0 0x7f3d1c057580 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f3d20008000 tx=0x7f3d20008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:22.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.157+0000 7f3d357fa700 1 -- 172.21.15.60:0/2144443726 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3d30044330 con 0x7f3d381416d0 2020-10-31T22:48:22.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.301+0000 7f3d3d74b700 1 -- 172.21.15.60:0/2144443726 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3d380b1d10 con 0x7f3d381416d0 2020-10-31T22:48:22.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.301+0000 7f3d357fa700 1 -- 172.21.15.60:0/2144443726 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v88) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3d30018020 con 0x7f3d381416d0 2020-10-31T22:48:22.312 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:48:22.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.305+0000 7f3d3d74b700 1 -- 172.21.15.60:0/2144443726 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d1c0550c0 msgr2=0x7f3d1c057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.305+0000 7f3d3d74b700 1 --2- 172.21.15.60:0/2144443726 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d1c0550c0 0x7f3d1c057580 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7f3d20008000 tx=0x7f3d20008040).stop 2020-10-31T22:48:22.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.305+0000 7f3d3d74b700 1 -- 172.21.15.60:0/2144443726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d381416d0 msgr2=0x7f3d380a9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.305+0000 7f3d3d74b700 1 --2- 172.21.15.60:0/2144443726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d381416d0 0x7f3d380a9fe0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 rx=0x7f3d380acff0 tx=0x7f3d300091a0).stop 2020-10-31T22:48:22.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.305+0000 7f3d3d74b700 1 -- 172.21.15.60:0/2144443726 shutdown_connections 2020-10-31T22:48:22.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.305+0000 7f3d3d74b700 1 --2- 172.21.15.60:0/2144443726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d381416d0 0x7f3d380a9fe0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.305+0000 7f3d3d74b700 1 --2- 172.21.15.60:0/2144443726 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d381442e0 0x7f3d3813e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.305+0000 7f3d3d74b700 1 --2- 172.21.15.60:0/2144443726 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d1c0550c0 0x7f3d1c057580 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.305+0000 7f3d3d74b700 1 --2- 172.21.15.60:0/2144443726 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d3813e9d0 0x7f3d381411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.305+0000 7f3d3d74b700 1 -- 172.21.15.60:0/2144443726 >> 172.21.15.60:0/2144443726 conn(0x7f3d380b61d0 msgr2=0x7f3d380b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:22.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.305+0000 7f3d3d74b700 1 -- 172.21.15.60:0/2144443726 shutdown_connections 2020-10-31T22:48:22.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.305+0000 7f3d3d74b700 1 -- 172.21.15.60:0/2144443726 wait complete. 2020-10-31T22:48:22.324 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:48:22.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe38b574700 1 Processor -- start 2020-10-31T22:48:22.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe38b574700 1 -- start start 2020-10-31T22:48:22.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe38b574700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3840b5570 0x7fe3840b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe38b574700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3840b24a0 0x7fe384145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe38b574700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3840b4440 con 0x7fe384145e40 2020-10-31T22:48:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe38b574700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe38413f930 con 0x7fe3840b24a0 2020-10-31T22:48:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe38b574700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3840b02f0 con 0x7fe3840b5570 2020-10-31T22:48:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe38ad73700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe384145e40 0x7fe384141f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50472/0 (socket says 172.21.15.60:50472) 2020-10-31T22:48:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe38ad73700 1 -- 172.21.15.60:0/3589299822 learned_addr learned my addr 172.21.15.60:0/3589299822 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe389d71700 1 --2- 172.21.15.60:0/3589299822 >> v2:172.21.15.60:3300/0 conn(0x7fe3840b24a0 0x7fe384145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe38a572700 1 --2- 172.21.15.60:0/3589299822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3840b5570 0x7fe3840b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe389570700 1 -- 172.21.15.60:0/3589299822 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 441163873 0 0) 0x7fe3840b4440 con 0x7fe384145e40 2020-10-31T22:48:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe389570700 1 -- 172.21.15.60:0/3589299822 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe370003230 con 0x7fe384145e40 2020-10-31T22:48:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe389d71700 1 -- 172.21.15.60:0/3589299822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3840b5570 msgr2=0x7fe3840b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe389d71700 1 --2- 172.21.15.60:0/3589299822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3840b5570 0x7fe3840b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe389d71700 1 -- 172.21.15.60:0/3589299822 >> v1:172.21.15.60:6789/0 conn(0x7fe384145e40 legacy=0x7fe384141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe389570700 1 -- 172.21.15.60:0/3589299822 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2722248337 0 0) 0x7fe370003230 con 0x7fe384145e40 2020-10-31T22:48:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe389d71700 1 -- 172.21.15.60:0/3589299822 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3840b0590 con 0x7fe3840b24a0 2020-10-31T22:48:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe389d71700 1 --2- 172.21.15.60:0/3589299822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3840b24a0 0x7fe384145950 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fe384141c20 tx=0x7fe378006dc0).ready entity=mon.0 client_cookie=3247dba34e2adea3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe389570700 1 -- 172.21.15.60:0/3589299822 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe374001a50 con 0x7fe3840b24a0 2020-10-31T22:48:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe389570700 1 -- 172.21.15.60:0/3589299822 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37800d570 con 0x7fe3840b24a0 2020-10-31T22:48:22.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe389570700 1 -- 172.21.15.60:0/3589299822 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37800d6e0 con 0x7fe3840b24a0 2020-10-31T22:48:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe38b574700 1 -- 172.21.15.60:0/3589299822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3840b24a0 msgr2=0x7fe384145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.433+0000 7fe38b574700 1 --2- 172.21.15.60:0/3589299822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3840b24a0 0x7fe384145950 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 rx=0x7fe384141c20 tx=0x7fe378006dc0).stop 2020-10-31T22:48:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.437+0000 7fe38b574700 1 -- 172.21.15.60:0/3589299822 shutdown_connections 2020-10-31T22:48:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.437+0000 7fe38b574700 1 --2- 172.21.15.60:0/3589299822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3840b5570 0x7fe3840b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.437+0000 7fe38b574700 1 --2- 172.21.15.60:0/3589299822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3840b24a0 0x7fe384145950 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.437+0000 7fe38b574700 1 -- 172.21.15.60:0/3589299822 >> 172.21.15.60:0/3589299822 conn(0x7fe3840b8e90 msgr2=0x7fe3840b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:22.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.437+0000 7fe38b574700 1 -- 172.21.15.60:0/3589299822 shutdown_connections 2020-10-31T22:48:22.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.437+0000 7fe38b574700 1 -- 172.21.15.60:0/3589299822 wait complete. 2020-10-31T22:48:22.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.437+0000 7fe38b574700 1 Processor -- start 2020-10-31T22:48:22.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.437+0000 7fe38b574700 1 -- start start 2020-10-31T22:48:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38b574700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3840b24a0 0x7fe3840aee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38b574700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3840b5570 0x7fe3840adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38b574700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe384145e40 0x7fe384146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38b574700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3841483f0 con 0x7fe3840b24a0 2020-10-31T22:48:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38b574700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3840ae4d0 con 0x7fe384145e40 2020-10-31T22:48:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38b574700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe384148620 con 0x7fe3840b5570 2020-10-31T22:48:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38a572700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3840b24a0 0x7fe3840aee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38a572700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3840b24a0 0x7fe3840aee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46340/0 (socket says 172.21.15.60:46340) 2020-10-31T22:48:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38a572700 1 -- 172.21.15.60:0/2555654674 learned_addr learned my addr 172.21.15.60:0/2555654674 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38ad73700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe384145e40 0x7fe384146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe389d71700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3840b5570 0x7fe3840adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38a572700 1 -- 172.21.15.60:0/2555654674 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3840b5570 msgr2=0x7fe3840adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38a572700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3840b5570 0x7fe3840adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38a572700 1 -- 172.21.15.60:0/2555654674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe384145e40 msgr2=0x7fe384146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38a572700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe384145e40 0x7fe384146590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38a572700 1 -- 172.21.15.60:0/2555654674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3841488c0 con 0x7fe3840b24a0 2020-10-31T22:48:22.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38ad73700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe384145e40 0x7fe384146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:22.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38a572700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3840b24a0 0x7fe3840aee80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fe37c00c000 tx=0x7fe37c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:22.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe3837fe700 1 -- 172.21.15.60:0/2555654674 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37c00ca10 con 0x7fe3840b24a0 2020-10-31T22:48:22.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe3837fe700 1 -- 172.21.15.60:0/2555654674 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37c00cb70 con 0x7fe3840b24a0 2020-10-31T22:48:22.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38b574700 1 -- 172.21.15.60:0/2555654674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe384148b60 con 0x7fe3840b24a0 2020-10-31T22:48:22.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe3837fe700 1 -- 172.21.15.60:0/2555654674 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37c0123f0 con 0x7fe3840b24a0 2020-10-31T22:48:22.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.441+0000 7fe38b574700 1 -- 172.21.15.60:0/2555654674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe384150880 con 0x7fe3840b24a0 2020-10-31T22:48:22.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.445+0000 7fe38b574700 1 -- 172.21.15.60:0/2555654674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe384057100 con 0x7fe3840b24a0 2020-10-31T22:48:22.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.445+0000 7fe3837fe700 1 -- 172.21.15.60:0/2555654674 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe37c012550 con 0x7fe3840b24a0 2020-10-31T22:48:22.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.445+0000 7fe3837fe700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe364054f10 0x7fe3640573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.445+0000 7fe3837fe700 1 -- 172.21.15.60:0/2555654674 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe37c06de00 con 0x7fe3840b24a0 2020-10-31T22:48:22.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.445+0000 7fe389d71700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe364054f10 0x7fe3640573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.445+0000 7fe389d71700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe364054f10 0x7fe3640573d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fe37801c000 tx=0x7fe378015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:22.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.449+0000 7fe3837fe700 1 -- 172.21.15.60:0/2555654674 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe37c0442c0 con 0x7fe3840b24a0 2020-10-31T22:48:22.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.593+0000 7fe38b574700 1 -- 172.21.15.60:0/2555654674 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe38405a8e0 con 0x7fe3840b24a0 2020-10-31T22:48:22.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.593+0000 7fe3837fe700 1 -- 172.21.15.60:0/2555654674 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v88) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe37c0478e0 con 0x7fe3840b24a0 2020-10-31T22:48:22.601 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:48:22.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.597+0000 7fe38b574700 1 -- 172.21.15.60:0/2555654674 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe364054f10 msgr2=0x7fe3640573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.597+0000 7fe38b574700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe364054f10 0x7fe3640573d0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7fe37801c000 tx=0x7fe378015000).stop 2020-10-31T22:48:22.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.597+0000 7fe38b574700 1 -- 172.21.15.60:0/2555654674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3840b24a0 msgr2=0x7fe3840aee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.597+0000 7fe38b574700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3840b24a0 0x7fe3840aee80 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 rx=0x7fe37c00c000 tx=0x7fe37c006dc0).stop 2020-10-31T22:48:22.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.597+0000 7fe38b574700 1 -- 172.21.15.60:0/2555654674 shutdown_connections 2020-10-31T22:48:22.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.597+0000 7fe38b574700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe364054f10 0x7fe3640573d0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.597+0000 7fe38b574700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe384145e40 0x7fe384146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.597+0000 7fe38b574700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3840b24a0 0x7fe3840aee80 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.597+0000 7fe38b574700 1 --2- 172.21.15.60:0/2555654674 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3840b5570 0x7fe3840adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.597+0000 7fe38b574700 1 -- 172.21.15.60:0/2555654674 >> 172.21.15.60:0/2555654674 conn(0x7fe3840b8e90 msgr2=0x7fe3840b3760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:22.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.597+0000 7fe38b574700 1 -- 172.21.15.60:0/2555654674 shutdown_connections 2020-10-31T22:48:22.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.597+0000 7fe38b574700 1 -- 172.21.15.60:0/2555654674 wait complete. 2020-10-31T22:48:22.614 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:48:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca923d700 1 Processor -- start 2020-10-31T22:48:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca923d700 1 -- start start 2020-10-31T22:48:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca923d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdca40af520 0x7fdca40ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca923d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdca4066c90 0x7fdca40670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca923d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdca4146060 0x7fdca41464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca923d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca40af900 con 0x7fdca4066c90 2020-10-31T22:48:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca923d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca40afc10 con 0x7fdca40af520 2020-10-31T22:48:22.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca923d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca405bb70 con 0x7fdca4146060 2020-10-31T22:48:22.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca37fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdca4066c90 0x7fdca40670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca37fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdca4066c90 0x7fdca40670f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46348/0 (socket says 172.21.15.60:46348) 2020-10-31T22:48:22.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca37fe700 1 -- 172.21.15.60:0/967825830 learned_addr learned my addr 172.21.15.60:0/967825830 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:22.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca8a3c700 1 --2- 172.21.15.60:0/967825830 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdca4146060 0x7fdca41464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca3fff700 1 --2- 172.21.15.60:0/967825830 >> v2:172.21.15.66:3300/0 conn(0x7fdca40af520 0x7fdca40ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca37fe700 1 -- 172.21.15.60:0/967825830 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdca4146060 msgr2=0x7fdca41464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:22.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca37fe700 1 --2- 172.21.15.60:0/967825830 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdca4146060 0x7fdca41464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca37fe700 1 -- 172.21.15.60:0/967825830 >> v2:172.21.15.66:3300/0 conn(0x7fdca40af520 msgr2=0x7fdca40ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:22.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca37fe700 1 --2- 172.21.15.60:0/967825830 >> v2:172.21.15.66:3300/0 conn(0x7fdca40af520 0x7fdca40ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca37fe700 1 -- 172.21.15.60:0/967825830 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca40ac130 con 0x7fdca4066c90 2020-10-31T22:48:22.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca8a3c700 1 --2- 172.21.15.60:0/967825830 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdca4146060 0x7fdca41464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:22.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca3fff700 1 --2- 172.21.15.60:0/967825830 >> v2:172.21.15.66:3300/0 conn(0x7fdca40af520 0x7fdca40ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:22.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca37fe700 1 --2- 172.21.15.60:0/967825830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca4066c90 0x7fdca40670f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fdc98002f30 tx=0x7fdc98006e80).ready entity=mon.0 client_cookie=900d1db059fe45d3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:22.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca2ffd700 1 -- 172.21.15.60:0/967825830 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc98009640 con 0x7fdca4066c90 2020-10-31T22:48:22.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca2ffd700 1 -- 172.21.15.60:0/967825830 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc980097a0 con 0x7fdca4066c90 2020-10-31T22:48:22.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca2ffd700 1 -- 172.21.15.60:0/967825830 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc98009b00 con 0x7fdca4066c90 2020-10-31T22:48:22.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca923d700 1 -- 172.21.15.60:0/967825830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca4066c90 msgr2=0x7fdca40670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.729+0000 7fdca923d700 1 --2- 172.21.15.60:0/967825830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca4066c90 0x7fdca40670f0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 rx=0x7fdc98002f30 tx=0x7fdc98006e80).stop 2020-10-31T22:48:22.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 -- 172.21.15.60:0/967825830 shutdown_connections 2020-10-31T22:48:22.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 --2- 172.21.15.60:0/967825830 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdca4146060 0x7fdca41464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 --2- 172.21.15.60:0/967825830 >> v2:172.21.15.66:3300/0 conn(0x7fdca40af520 0x7fdca40ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 --2- 172.21.15.60:0/967825830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca4066c90 0x7fdca40670f0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 -- 172.21.15.60:0/967825830 >> 172.21.15.60:0/967825830 conn(0x7fdca40b3fd0 msgr2=0x7fdca40b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:22.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 -- 172.21.15.60:0/967825830 shutdown_connections 2020-10-31T22:48:22.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 -- 172.21.15.60:0/967825830 wait complete. 2020-10-31T22:48:22.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 Processor -- start 2020-10-31T22:48:22.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 -- start start 2020-10-31T22:48:22.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdca4066c90 0x7fdca40acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdca40af520 0x7fdca4154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca4146060 0x7fdca41554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca4155990 con 0x7fdca4146060 2020-10-31T22:48:22.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca4061b20 con 0x7fdca4066c90 2020-10-31T22:48:22.750 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca923d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca41496e0 con 0x7fdca40af520 2020-10-31T22:48:22.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca8a3c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca4146060 0x7fdca41554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca8a3c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca4146060 0x7fdca41554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46358/0 (socket says 172.21.15.60:46358) 2020-10-31T22:48:22.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca8a3c700 1 -- 172.21.15.60:0/2899575661 learned_addr learned my addr 172.21.15.60:0/2899575661 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:22.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca37fe700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdca40af520 0x7fdca4154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.733+0000 7fdca3fff700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdca4066c90 0x7fdca40acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca8a3c700 1 -- 172.21.15.60:0/2899575661 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdca40af520 msgr2=0x7fdca4154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca8a3c700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdca40af520 0x7fdca4154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca8a3c700 1 -- 172.21.15.60:0/2899575661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdca4066c90 msgr2=0x7fdca40acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca8a3c700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdca4066c90 0x7fdca40acad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca8a3c700 1 -- 172.21.15.60:0/2899575661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca4149df0 con 0x7fdca4146060 2020-10-31T22:48:22.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca3fff700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdca4066c90 0x7fdca40acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:22.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca8a3c700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca4146060 0x7fdca41554a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fdc9c00c000 tx=0x7fdc9c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:22.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca17fa700 1 -- 172.21.15.60:0/2899575661 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc9c00cce0 con 0x7fdca4146060 2020-10-31T22:48:22.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca17fa700 1 -- 172.21.15.60:0/2899575661 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c00ce40 con 0x7fdca4146060 2020-10-31T22:48:22.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca17fa700 1 -- 172.21.15.60:0/2899575661 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc9c0125e0 con 0x7fdca4146060 2020-10-31T22:48:22.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca923d700 1 -- 172.21.15.60:0/2899575661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca40638e0 con 0x7fdca4146060 2020-10-31T22:48:22.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca923d700 1 -- 172.21.15.60:0/2899575661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca414b6b0 con 0x7fdca4146060 2020-10-31T22:48:22.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca923d700 1 -- 172.21.15.60:0/2899575661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca4061980 con 0x7fdca4146060 2020-10-31T22:48:22.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca17fa700 1 -- 172.21.15.60:0/2899575661 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fdc9c022070 con 0x7fdca4146060 2020-10-31T22:48:22.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca17fa700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdc84054f30 0x7fdc840573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:22.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca3fff700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdc84054f30 0x7fdc840573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:22.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.737+0000 7fdca17fa700 1 -- 172.21.15.60:0/2899575661 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdc9c06e310 con 0x7fdca4146060 2020-10-31T22:48:22.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.741+0000 7fdca3fff700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdc84054f30 0x7fdc840573f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fdc94008000 tx=0x7fdc94008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:22.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.745+0000 7fdca17fa700 1 -- 172.21.15.60:0/2899575661 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdca4061980 con 0x7fdca4146060 2020-10-31T22:48:22.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.893+0000 7fdca923d700 1 -- 172.21.15.60:0/2899575661 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdca4061980 con 0x7fdca4146060 2020-10-31T22:48:22.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.893+0000 7fdca17fa700 1 -- 172.21.15.60:0/2899575661 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+10 (secure 0 0 0) 0x7fdc9c016020 con 0x7fdca4146060 2020-10-31T22:48:22.901 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:48:22.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.893+0000 7fdca923d700 1 -- 172.21.15.60:0/2899575661 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdc84054f30 msgr2=0x7fdc840573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.893+0000 7fdca923d700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdc84054f30 0x7fdc840573f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7fdc94008000 tx=0x7fdc94008040).stop 2020-10-31T22:48:22.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.893+0000 7fdca923d700 1 -- 172.21.15.60:0/2899575661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca4146060 msgr2=0x7fdca41554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:22.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.893+0000 7fdca923d700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca4146060 0x7fdca41554a0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 rx=0x7fdc9c00c000 tx=0x7fdc9c0091a0).stop 2020-10-31T22:48:22.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.893+0000 7fdca923d700 1 -- 172.21.15.60:0/2899575661 shutdown_connections 2020-10-31T22:48:22.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.893+0000 7fdca923d700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdca4146060 0x7fdca41554a0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.893+0000 7fdca923d700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdc84054f30 0x7fdc840573f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.893+0000 7fdca923d700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdca4066c90 0x7fdca40acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.893+0000 7fdca923d700 1 --2- 172.21.15.60:0/2899575661 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdca40af520 0x7fdca4154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.893+0000 7fdca923d700 1 -- 172.21.15.60:0/2899575661 >> 172.21.15.60:0/2899575661 conn(0x7fdca40b3fd0 msgr2=0x7fdca40b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.897+0000 7fdca923d700 1 -- 172.21.15.60:0/2899575661 shutdown_connections 2020-10-31T22:48:22.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:22.897+0000 7fdca923d700 1 -- 172.21.15.60:0/2899575661 wait complete. 2020-10-31T22:48:22.915 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:48:23.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.021+0000 7fd4921ed700 1 Processor -- start 2020-10-31T22:48:23.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.021+0000 7fd4921ed700 1 -- start start 2020-10-31T22:48:23.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.021+0000 7fd4921ed700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd48c0b24a0 0x7fd48c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4911eb700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd48c0b5570 0x7fd48c145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:48366/0 (socket says 172.21.15.60:48366) 2020-10-31T22:48:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4911eb700 1 -- 172.21.15.60:0/1702409103 learned_addr learned my addr 172.21.15.60:0/1702409103 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4909ea700 1 --2- 172.21.15.60:0/1702409103 >> v2:172.21.15.66:3300/0 conn(0x7fd48c0b24a0 0x7fd48c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4921ed700 1 -- 172.21.15.60:0/1702409103 --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c0b4440 con 0x7fd48c141f00 2020-10-31T22:48:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4921ed700 1 -- 172.21.15.60:0/1702409103 --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd48c146060 con 0x7fd48c0b5570 2020-10-31T22:48:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4921ed700 1 -- 172.21.15.60:0/1702409103 --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd48c13f930 con 0x7fd48c0b24a0 2020-10-31T22:48:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd47bfff700 1 -- 172.21.15.60:0/1702409103 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276379670 0 0) 0x7fd48c0b4440 con 0x7fd48c141f00 2020-10-31T22:48:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd47bfff700 1 -- 172.21.15.60:0/1702409103 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd474003230 con 0x7fd48c141f00 2020-10-31T22:48:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd47bfff700 1 -- 172.21.15.60:0/1702409103 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2301667815 0 0) 0x7fd48c146060 con 0x7fd48c0b5570 2020-10-31T22:48:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd47bfff700 1 -- 172.21.15.60:0/1702409103 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd48c0b4440 con 0x7fd48c0b5570 2020-10-31T22:48:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4909ea700 1 -- 172.21.15.60:0/1702409103 >> v1:172.21.15.66:6789/0 conn(0x7fd48c0b5570 legacy=0x7fd48c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4909ea700 1 -- 172.21.15.60:0/1702409103 >> v1:172.21.15.60:6789/0 conn(0x7fd48c141f00 legacy=0x7fd48c142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd47bfff700 1 -- 172.21.15.60:0/1702409103 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 168723180 0 0) 0x7fd474003230 con 0x7fd48c141f00 2020-10-31T22:48:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4909ea700 1 -- 172.21.15.60:0/1702409103 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c0b02f0 con 0x7fd48c0b24a0 2020-10-31T22:48:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4909ea700 1 --2- 172.21.15.60:0/1702409103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd48c0b24a0 0x7fd48c0b5950 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fd484001450 tx=0x7fd47c006dc0).ready entity=mon.1 client_cookie=683575b7fab2e253 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd47bfff700 1 -- 172.21.15.60:0/1702409103 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd484001a50 con 0x7fd48c0b24a0 2020-10-31T22:48:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd47bfff700 1 -- 172.21.15.60:0/1702409103 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c00d610 con 0x7fd48c0b24a0 2020-10-31T22:48:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd47bfff700 1 -- 172.21.15.60:0/1702409103 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd47c00d780 con 0x7fd48c0b24a0 2020-10-31T22:48:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4921ed700 1 -- 172.21.15.60:0/1702409103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd48c0b24a0 msgr2=0x7fd48c0b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4921ed700 1 --2- 172.21.15.60:0/1702409103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd48c0b24a0 0x7fd48c0b5950 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7fd484001450 tx=0x7fd47c006dc0).stop 2020-10-31T22:48:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4921ed700 1 -- 172.21.15.60:0/1702409103 shutdown_connections 2020-10-31T22:48:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4921ed700 1 --2- 172.21.15.60:0/1702409103 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd48c0b24a0 0x7fd48c0b5950 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4921ed700 1 -- 172.21.15.60:0/1702409103 >> 172.21.15.60:0/1702409103 conn(0x7fd48c0b8e90 msgr2=0x7fd48c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:23.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4921ed700 1 -- 172.21.15.60:0/1702409103 shutdown_connections 2020-10-31T22:48:23.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.025+0000 7fd4921ed700 1 -- 172.21.15.60:0/1702409103 wait complete. 2020-10-31T22:48:23.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4921ed700 1 Processor -- start 2020-10-31T22:48:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4921ed700 1 -- start start 2020-10-31T22:48:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4921ed700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd48c0b24a0 0x7fd48c148d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4921ed700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd48c0b5570 0x7fd48c0ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4921ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd48c141f00 0x7fd48c0acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4921ed700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0af1e0 con 0x7fd48c141f00 2020-10-31T22:48:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4921ed700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c0ad240 con 0x7fd48c0b24a0 2020-10-31T22:48:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4921ed700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48c144ae0 con 0x7fd48c0b5570 2020-10-31T22:48:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4919ec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd48c141f00 0x7fd48c0acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4919ec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd48c141f00 0x7fd48c0acd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46372/0 (socket says 172.21.15.60:46372) 2020-10-31T22:48:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4919ec700 1 -- 172.21.15.60:0/3105245637 learned_addr learned my addr 172.21.15.60:0/3105245637 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4911eb700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd48c0b24a0 0x7fd48c148d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4909ea700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd48c0b5570 0x7fd48c0ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4919ec700 1 -- 172.21.15.60:0/3105245637 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd48c0b5570 msgr2=0x7fd48c0ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4919ec700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd48c0b5570 0x7fd48c0ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4919ec700 1 -- 172.21.15.60:0/3105245637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd48c0b24a0 msgr2=0x7fd48c148d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4919ec700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd48c0b24a0 0x7fd48c148d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4919ec700 1 -- 172.21.15.60:0/3105245637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c144d80 con 0x7fd48c141f00 2020-10-31T22:48:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4911eb700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd48c0b24a0 0x7fd48c148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:23.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4919ec700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd48c141f00 0x7fd48c0acd50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fd484001c30 tx=0x7fd484001a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:23.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd47a7fc700 1 -- 172.21.15.60:0/3105245637 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd48400f070 con 0x7fd48c141f00 2020-10-31T22:48:23.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd47a7fc700 1 -- 172.21.15.60:0/3105245637 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48400cdb0 con 0x7fd48c141f00 2020-10-31T22:48:23.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4921ed700 1 -- 172.21.15.60:0/3105245637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd48c154200 con 0x7fd48c141f00 2020-10-31T22:48:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd47a7fc700 1 -- 172.21.15.60:0/3105245637 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd484014610 con 0x7fd48c141f00 2020-10-31T22:48:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.029+0000 7fd4921ed700 1 -- 172.21.15.60:0/3105245637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd48c143db0 con 0x7fd48c141f00 2020-10-31T22:48:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.033+0000 7fd4921ed700 1 -- 172.21.15.60:0/3105245637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd48c1444a0 con 0x7fd48c141f00 2020-10-31T22:48:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.033+0000 7fd47a7fc700 1 -- 172.21.15.60:0/3105245637 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd48401b060 con 0x7fd48c141f00 2020-10-31T22:48:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.033+0000 7fd47a7fc700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd46c054f10 0x7fd46c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:23.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.033+0000 7fd47a7fc700 1 -- 172.21.15.60:0/3105245637 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd48406e0b0 con 0x7fd48c141f00 2020-10-31T22:48:23.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.033+0000 7fd4911eb700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd46c054f10 0x7fd46c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:23.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.033+0000 7fd4911eb700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd46c054f10 0x7fd46c0573d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fd48800b000 tx=0x7fd488009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:23.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.037+0000 7fd47a7fc700 1 -- 172.21.15.60:0/3105245637 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd4840445d0 con 0x7fd48c141f00 2020-10-31T22:48:23.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.185+0000 7fd4921ed700 1 -- 172.21.15.60:0/3105245637 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd48c144f10 con 0x7fd48c141f00 2020-10-31T22:48:23.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.185+0000 7fd47a7fc700 1 -- 172.21.15.60:0/3105245637 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+10 (secure 0 0 0) 0x7fd484019070 con 0x7fd48c141f00 2020-10-31T22:48:23.192 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:48:23.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.185+0000 7fd4921ed700 1 -- 172.21.15.60:0/3105245637 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd46c054f10 msgr2=0x7fd46c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:23.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.185+0000 7fd4921ed700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd46c054f10 0x7fd46c0573d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7fd48800b000 tx=0x7fd488009040).stop 2020-10-31T22:48:23.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.185+0000 7fd4921ed700 1 -- 172.21.15.60:0/3105245637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd48c141f00 msgr2=0x7fd48c0acd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:23.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.185+0000 7fd4921ed700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd48c141f00 0x7fd48c0acd50 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 rx=0x7fd484001c30 tx=0x7fd484001a50).stop 2020-10-31T22:48:23.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.185+0000 7fd4921ed700 1 -- 172.21.15.60:0/3105245637 shutdown_connections 2020-10-31T22:48:23.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.185+0000 7fd4921ed700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd48c141f00 0x7fd48c0acd50 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.185+0000 7fd4921ed700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd46c054f10 0x7fd46c0573d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.185+0000 7fd4921ed700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd48c0b24a0 0x7fd48c148d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.185+0000 7fd4921ed700 1 --2- 172.21.15.60:0/3105245637 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd48c0b5570 0x7fd48c0ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.185+0000 7fd4921ed700 1 -- 172.21.15.60:0/3105245637 >> 172.21.15.60:0/3105245637 conn(0x7fd48c0b8e90 msgr2=0x7fd48c0b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:23.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.185+0000 7fd4921ed700 1 -- 172.21.15.60:0/3105245637 shutdown_connections 2020-10-31T22:48:23.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.185+0000 7fd4921ed700 1 -- 172.21.15.60:0/3105245637 wait complete. 2020-10-31T22:48:23.206 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:48:23.207 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:23.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.309+0000 7f1fc65f4700 1 Processor -- start 2020-10-31T22:48:23.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.309+0000 7f1fc65f4700 1 -- start start 2020-10-31T22:48:23.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.309+0000 7f1fc65f4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1fc00ac010 0x7f1fc00662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:23.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.309+0000 7f1fc65f4700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1fc00ae970 0x7f1fc00667e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:23.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.309+0000 7f1fc65f4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc00ac3f0 con 0x7f1fc00a7580 2020-10-31T22:48:23.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.309+0000 7f1fc65f4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc0145e50 con 0x7f1fc00ac010 2020-10-31T22:48:23.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.309+0000 7f1fc65f4700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc0065e50 con 0x7f1fc00ae970 2020-10-31T22:48:23.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.309+0000 7f1fc55f2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1fc00ac010 0x7f1fc00662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:23.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.309+0000 7f1fc4df1700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1fc00a7580 0x7f1fc01423b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50516/0 (socket says 172.21.15.60:50516) 2020-10-31T22:48:23.320 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc4df1700 1 -- 172.21.15.60:0/3203275963 learned_addr learned my addr 172.21.15.60:0/3203275963 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:23.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc5df3700 1 --2- 172.21.15.60:0/3203275963 >> v2:172.21.15.66:3300/0 conn(0x7f1fc00ae970 0x7f1fc00667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:23.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc5df3700 1 -- 172.21.15.60:0/3203275963 >> v2:172.21.15.60:3300/0 conn(0x7f1fc00ac010 msgr2=0x7f1fc00662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:23.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc5df3700 1 --2- 172.21.15.60:0/3203275963 >> v2:172.21.15.60:3300/0 conn(0x7f1fc00ac010 0x7f1fc00662f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc5df3700 1 -- 172.21.15.60:0/3203275963 >> v1:172.21.15.60:6789/0 conn(0x7f1fc00a7580 legacy=0x7f1fc01423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:23.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc5df3700 1 -- 172.21.15.60:0/3203275963 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0145b50 con 0x7f1fc00ae970 2020-10-31T22:48:23.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fb7fff700 1 -- 172.21.15.60:0/3203275963 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3819529435 0 0) 0x7f1fc00ac3f0 con 0x7f1fc00a7580 2020-10-31T22:48:23.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc55f2700 1 --2- 172.21.15.60:0/3203275963 >> v2:172.21.15.60:3300/0 conn(0x7f1fc00ac010 0x7f1fc00662f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:23.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc5df3700 1 --2- 172.21.15.60:0/3203275963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ae970 0x7f1fc00667e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f1fb80032b0 tx=0x7f1fb80091a0).ready entity=mon.1 client_cookie=600f8caa397b51eb server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:23.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fb7fff700 1 -- 172.21.15.60:0/3203275963 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fb800b9a0 con 0x7f1fc00ae970 2020-10-31T22:48:23.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fb7fff700 1 -- 172.21.15.60:0/3203275963 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb800bb00 con 0x7f1fc00ae970 2020-10-31T22:48:23.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc65f4700 1 -- 172.21.15.60:0/3203275963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ae970 msgr2=0x7f1fc00667e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:23.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc65f4700 1 --2- 172.21.15.60:0/3203275963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ae970 0x7f1fc00667e0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f1fb80032b0 tx=0x7f1fb80091a0).stop 2020-10-31T22:48:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fb7fff700 1 -- 172.21.15.60:0/3203275963 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fb800bc70 con 0x7f1fc00ae970 2020-10-31T22:48:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc65f4700 1 -- 172.21.15.60:0/3203275963 shutdown_connections 2020-10-31T22:48:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc65f4700 1 --2- 172.21.15.60:0/3203275963 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ae970 0x7f1fc00667e0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc65f4700 1 --2- 172.21.15.60:0/3203275963 >> v2:172.21.15.60:3300/0 conn(0x7f1fc00ac010 0x7f1fc00662f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc65f4700 1 -- 172.21.15.60:0/3203275963 >> 172.21.15.60:0/3203275963 conn(0x7f1fc00b3fd0 msgr2=0x7f1fc00b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:23.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc65f4700 1 -- 172.21.15.60:0/3203275963 shutdown_connections 2020-10-31T22:48:23.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc65f4700 1 -- 172.21.15.60:0/3203275963 wait complete. 2020-10-31T22:48:23.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc65f4700 1 Processor -- start 2020-10-31T22:48:23.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.313+0000 7f1fc65f4700 1 -- start start 2020-10-31T22:48:23.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc65f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc00a7580 0x7f1fc00b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:23.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc65f4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00ac010 0x7f1fc0153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:23.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc65f4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ae970 0x7f1fc0154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:23.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc65f4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc0143670 con 0x7f1fc00a7580 2020-10-31T22:48:23.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc65f4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc0144f40 con 0x7f1fc00ae970 2020-10-31T22:48:23.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc65f4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc0144560 con 0x7f1fc00ac010 2020-10-31T22:48:23.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc55f2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc00a7580 0x7f1fc00b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:23.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc55f2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc00a7580 0x7f1fc00b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46382/0 (socket says 172.21.15.60:46382) 2020-10-31T22:48:23.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc55f2700 1 -- 172.21.15.60:0/1221034304 learned_addr learned my addr 172.21.15.60:0/1221034304 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:23.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc4df1700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00ac010 0x7f1fc0153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:23.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc5df3700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ae970 0x7f1fc0154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:23.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc55f2700 1 -- 172.21.15.60:0/1221034304 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00ac010 msgr2=0x7f1fc0153e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:23.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc55f2700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00ac010 0x7f1fc0153e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc55f2700 1 -- 172.21.15.60:0/1221034304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ae970 msgr2=0x7f1fc0154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:23.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc55f2700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ae970 0x7f1fc0154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc55f2700 1 -- 172.21.15.60:0/1221034304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc0144800 con 0x7f1fc00a7580 2020-10-31T22:48:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc5df3700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ae970 0x7f1fc0154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc55f2700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc00a7580 0x7f1fc00b2ea0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f1fc00b3e50 tx=0x7f1fbc006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fb67fc700 1 -- 172.21.15.60:0/1221034304 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fbc00ca80 con 0x7f1fc00a7580 2020-10-31T22:48:23.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fb67fc700 1 -- 172.21.15.60:0/1221034304 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fbc00cbe0 con 0x7f1fc00a7580 2020-10-31T22:48:23.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fb67fc700 1 -- 172.21.15.60:0/1221034304 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fbc0123f0 con 0x7f1fc00a7580 2020-10-31T22:48:23.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc65f4700 1 -- 172.21.15.60:0/1221034304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc0144aa0 con 0x7f1fc00a7580 2020-10-31T22:48:23.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.317+0000 7f1fc65f4700 1 -- 172.21.15.60:0/1221034304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc0154820 con 0x7f1fc00a7580 2020-10-31T22:48:23.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.321+0000 7f1fc65f4700 1 -- 172.21.15.60:0/1221034304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc0144c30 con 0x7f1fc00a7580 2020-10-31T22:48:23.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.321+0000 7f1fb67fc700 1 -- 172.21.15.60:0/1221034304 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1fbc012550 con 0x7f1fc00a7580 2020-10-31T22:48:23.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.321+0000 7f1fb67fc700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa8054f10 0x7f1fa80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:23.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.321+0000 7f1fc4df1700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa8054f10 0x7f1fa80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:23.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.321+0000 7f1fb67fc700 1 -- 172.21.15.60:0/1221034304 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1fbc06e0d0 con 0x7f1fc00a7580 2020-10-31T22:48:23.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.321+0000 7f1fc4df1700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa8054f10 0x7f1fa80573d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f1fb000d000 tx=0x7f1fb00079d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:23.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.329+0000 7f1fb67fc700 1 -- 172.21.15.60:0/1221034304 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1fbc044480 con 0x7f1fc00a7580 2020-10-31T22:48:23.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.517+0000 7f1fc65f4700 1 -- 172.21.15.60:0/1221034304 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1fc0057100 con 0x7f1fc00a7580 2020-10-31T22:48:23.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.517+0000 7f1fb67fc700 1 -- 172.21.15.60:0/1221034304 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f1fbc047aa0 con 0x7f1fc00a7580 2020-10-31T22:48:23.526 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:23.526 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":41,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3668788118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3668788118},{"type":"v1","addr":"172.21.15.60:6835","nonce":3668788118}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6516,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/3884009815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3884009815},{"type":"v1","addr":"172.21.15.60:6837","nonce":3884009815}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:48:15.434973+0000","modified":"2020-10-31T22:48:16.437431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"b","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/2702869569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2702869569},{"type":"v1","addr":"172.21.15.66:6833","nonce":2702869569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-10-31T22:48:23.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.521+0000 7f1fc65f4700 1 -- 172.21.15.60:0/1221034304 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa8054f10 msgr2=0x7f1fa80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:23.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.521+0000 7f1fc65f4700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa8054f10 0x7f1fa80573d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7f1fb000d000 tx=0x7f1fb00079d0).stop 2020-10-31T22:48:23.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.521+0000 7f1fc65f4700 1 -- 172.21.15.60:0/1221034304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc00a7580 msgr2=0x7f1fc00b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:23.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.521+0000 7f1fc65f4700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc00a7580 0x7f1fc00b2ea0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 rx=0x7f1fc00b3e50 tx=0x7f1fbc006dc0).stop 2020-10-31T22:48:23.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.521+0000 7f1fc65f4700 1 -- 172.21.15.60:0/1221034304 shutdown_connections 2020-10-31T22:48:23.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.521+0000 7f1fc65f4700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fa8054f10 0x7f1fa80573d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.521+0000 7f1fc65f4700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fc00ae970 0x7f1fc0154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.521+0000 7f1fc65f4700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fc00a7580 0x7f1fc00b2ea0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.521+0000 7f1fc65f4700 1 --2- 172.21.15.60:0/1221034304 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fc00ac010 0x7f1fc0153e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:23.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.521+0000 7f1fc65f4700 1 -- 172.21.15.60:0/1221034304 >> 172.21.15.60:0/1221034304 conn(0x7f1fc00b3fd0 msgr2=0x7f1fc005afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:23.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.521+0000 7f1fc65f4700 1 -- 172.21.15.60:0/1221034304 shutdown_connections 2020-10-31T22:48:23.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:23.521+0000 7f1fc65f4700 1 -- 172.21.15.60:0/1221034304 wait complete. 2020-10-31T22:48:23.530 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 41 2020-10-31T22:48:23.842 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 41, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:48:15.434973+0000', 'modified': '2020-10-31T22:48:16.437431+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6519}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6519': {'gid': 6519, 'name': 'b', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6833/2702869569', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 2702869569}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 2702869569}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [16], 'metadata_pool': 15, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:48:23.843 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:48:23.844 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-10-31T22:48:23.974 INFO:teuthology.orchestra.run.smithi066.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":6519,"want_state":"up:active","state":"up:active","rank_uptime":8.5243652179999998,"mdsmap_epoch":41,"osdmap_epoch":88,"osdmap_epoch_barrier":87,"uptime":13.924480300000001} 2020-10-31T22:48:23.974 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 6519, "mdsmap_epoch": 41, "osdmap_epoch": 88, "osdmap_epoch_barrier": 87, "rank_uptime": 8.524365218, "state": "up:active", "uptime": 13.9244803, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:48:23.975 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:48:23.976 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-10-31T22:48:23.977 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi085.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-10-31T22:48:23.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:23.978 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:23.986 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:48:24.043 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:48:24.044 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:48:24.099 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:48:24.100 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:48:24.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:24.101 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:48:24.147 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:48:24.148 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:24.191 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:48:24.206 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:48:24.207 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:48:24.263 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:48:24.265 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:48:24.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:24.266 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:48:24.267 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:2020-10-31T22:48:24.265+0000 7fe10df8a0c0 -1 init, newargv = 0x563485327b30 newargc=9 2020-10-31T22:48:24.267 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13196]: starting ceph client 2020-10-31T22:48:24.278 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13196]: starting fuse 2020-10-31T22:48:25.373 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:48:25.389 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:48:25.389 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:48:25.443 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:48:25.444 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:48:25.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:25.445 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:48:25.492 INFO:teuthology.orchestra.run.smithi085.stdout:50 2020-10-31T22:48:25.493 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-10-31T22:48:25.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:25.494 INFO:teuthology.orchestra.run.smithi085:> sudo python3 -c ' 2020-10-31T22:48:25.494 INFO:teuthology.orchestra.run.smithi085:> import glob 2020-10-31T22:48:25.494 INFO:teuthology.orchestra.run.smithi085:> import re 2020-10-31T22:48:25.495 INFO:teuthology.orchestra.run.smithi085:> import os 2020-10-31T22:48:25.495 INFO:teuthology.orchestra.run.smithi085:> import subprocess 2020-10-31T22:48:25.495 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:48:25.496 INFO:teuthology.orchestra.run.smithi085:> def find_socket(client_name): 2020-10-31T22:48:25.496 INFO:teuthology.orchestra.run.smithi085:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-10-31T22:48:25.496 INFO:teuthology.orchestra.run.smithi085:> files = glob.glob(asok_path) 2020-10-31T22:48:25.497 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:48:25.497 INFO:teuthology.orchestra.run.smithi085:> # Given a non-glob path, it better be there 2020-10-31T22:48:25.497 INFO:teuthology.orchestra.run.smithi085:> if "*" not in asok_path: 2020-10-31T22:48:25.498 INFO:teuthology.orchestra.run.smithi085:> assert(len(files) == 1) 2020-10-31T22:48:25.498 INFO:teuthology.orchestra.run.smithi085:> return files[0] 2020-10-31T22:48:25.498 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:48:25.499 INFO:teuthology.orchestra.run.smithi085:> for f in files: 2020-10-31T22:48:25.499 INFO:teuthology.orchestra.run.smithi085:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:48:25.501 INFO:teuthology.orchestra.run.smithi085:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:48:25.501 INFO:teuthology.orchestra.run.smithi085:> return f 2020-10-31T22:48:25.503 INFO:teuthology.orchestra.run.smithi085:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:48:25.503 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:48:25.503 INFO:teuthology.orchestra.run.smithi085:> print(find_socket("client.1")) 2020-10-31T22:48:25.504 INFO:teuthology.orchestra.run.smithi085:> ' 2020-10-31T22:48:25.583 INFO:teuthology.orchestra.run.smithi085.stdout:/var/run/ceph/ceph-client.1.13196.asok 2020-10-31T22:48:25.588 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13196.asok 2020-10-31T22:48:25.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:25.589 INFO:teuthology.orchestra.run.smithi085:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13196.asok status 2020-10-31T22:48:25.685 INFO:teuthology.orchestra.run.smithi085.stdout:{ 2020-10-31T22:48:25.685 INFO:teuthology.orchestra.run.smithi085.stdout: "metadata": { 2020-10-31T22:48:25.686 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:48:25.686 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:48:25.686 INFO:teuthology.orchestra.run.smithi085.stdout: "entity_id": "1", 2020-10-31T22:48:25.686 INFO:teuthology.orchestra.run.smithi085.stdout: "hostname": "smithi085", 2020-10-31T22:48:25.686 INFO:teuthology.orchestra.run.smithi085.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-10-31T22:48:25.687 INFO:teuthology.orchestra.run.smithi085.stdout: "pid": "13196", 2020-10-31T22:48:25.687 INFO:teuthology.orchestra.run.smithi085.stdout: "root": "/" 2020-10-31T22:48:25.687 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:48:25.687 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_count": 0, 2020-10-31T22:48:25.689 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_pinned_count": 0, 2020-10-31T22:48:25.689 INFO:teuthology.orchestra.run.smithi085.stdout: "id": 6622, 2020-10-31T22:48:25.690 INFO:teuthology.orchestra.run.smithi085.stdout: "inst": { 2020-10-31T22:48:25.690 INFO:teuthology.orchestra.run.smithi085.stdout: "name": { 2020-10-31T22:48:25.691 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "client", 2020-10-31T22:48:25.691 INFO:teuthology.orchestra.run.smithi085.stdout: "num": 6622 2020-10-31T22:48:25.691 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:48:25.692 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:48:25.692 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:48:25.692 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:48:25.692 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 3085156868 2020-10-31T22:48:25.693 INFO:teuthology.orchestra.run.smithi085.stdout: } 2020-10-31T22:48:25.693 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:48:25.693 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:48:25.693 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:48:25.693 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:48:25.694 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 3085156868 2020-10-31T22:48:25.694 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:48:25.694 INFO:teuthology.orchestra.run.smithi085.stdout: "inst_str": "client.6622 172.21.15.85:0/3085156868", 2020-10-31T22:48:25.694 INFO:teuthology.orchestra.run.smithi085.stdout: "addr_str": "172.21.15.85:0/3085156868", 2020-10-31T22:48:25.694 INFO:teuthology.orchestra.run.smithi085.stdout: "inode_count": 1, 2020-10-31T22:48:25.695 INFO:teuthology.orchestra.run.smithi085.stdout: "mds_epoch": 41, 2020-10-31T22:48:25.695 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch": 88, 2020-10-31T22:48:25.695 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:48:25.695 INFO:teuthology.orchestra.run.smithi085.stdout: "blacklisted": false 2020-10-31T22:48:25.695 INFO:teuthology.orchestra.run.smithi085.stdout:} 2020-10-31T22:48:25.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:25.697 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:25.698 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:25.705 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:48:25.706 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:48:25.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:25.707 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:25.767 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:25.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3bfff700 1 Processor -- start 2020-10-31T22:48:25.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3bfff700 1 -- start start 2020-10-31T22:48:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faa3c05f3c0 0x7faa3c05f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3c0b2cc0 0x7faa3c141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3bfff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa3c0b31d0 con 0x7faa3c13f230 2020-10-31T22:48:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3bfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa3c0b3e50 con 0x7faa3c05f3c0 2020-10-31T22:48:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c0b3470 con 0x7faa3c0b2cc0 2020-10-31T22:48:25.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faa3c05f3c0 0x7faa3c05f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:25.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3a7fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3c0b2cc0 0x7faa3c141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:25.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faa3c05f3c0 0x7faa3c05f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46392/0 (socket says 172.21.15.60:46392) 2020-10-31T22:48:25.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3b7fe700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7faa3c13f230 0x7faa3c0659e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:48396/0 (socket says 172.21.15.60:48396) 2020-10-31T22:48:25.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3affd700 1 -- 172.21.15.60:0/1367126460 learned_addr learned my addr 172.21.15.60:0/1367126460 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:25.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3a7fc700 1 -- 172.21.15.60:0/1367126460 >> v2:172.21.15.60:3300/0 conn(0x7faa3c05f3c0 msgr2=0x7faa3c05f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:25.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3a7fc700 1 --2- 172.21.15.60:0/1367126460 >> v2:172.21.15.60:3300/0 conn(0x7faa3c05f3c0 0x7faa3c05f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:25.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3a7fc700 1 -- 172.21.15.60:0/1367126460 >> v1:172.21.15.66:6789/0 conn(0x7faa3c13f230 legacy=0x7faa3c0659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa39ffb700 1 -- 172.21.15.60:0/1367126460 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2968498237 0 0) 0x7faa3c0b31d0 con 0x7faa3c13f230 2020-10-31T22:48:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3a7fc700 1 -- 172.21.15.60:0/1367126460 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c0b3710 con 0x7faa3c0b2cc0 2020-10-31T22:48:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3a7fc700 1 --2- 172.21.15.60:0/1367126460 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3c0b2cc0 0x7faa3c141d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7faa24002f30 tx=0x7faa24006dc0).ready entity=mon.2 client_cookie=1a9ee8b883060bca server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa39ffb700 1 -- 172.21.15.60:0/1367126460 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa24009760 con 0x7faa3c0b2cc0 2020-10-31T22:48:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa39ffb700 1 -- 172.21.15.60:0/1367126460 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa240098c0 con 0x7faa3c0b2cc0 2020-10-31T22:48:25.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa39ffb700 1 -- 172.21.15.60:0/1367126460 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa24009c20 con 0x7faa3c0b2cc0 2020-10-31T22:48:25.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3bfff700 1 -- 172.21.15.60:0/1367126460 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3c0b2cc0 msgr2=0x7faa3c141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:25.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3bfff700 1 --2- 172.21.15.60:0/1367126460 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3c0b2cc0 0x7faa3c141d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7faa24002f30 tx=0x7faa24006dc0).stop 2020-10-31T22:48:25.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3bfff700 1 -- 172.21.15.60:0/1367126460 shutdown_connections 2020-10-31T22:48:25.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3bfff700 1 --2- 172.21.15.60:0/1367126460 >> v2:172.21.15.60:3300/0 conn(0x7faa3c05f3c0 0x7faa3c05f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:25.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.885+0000 7faa3bfff700 1 --2- 172.21.15.60:0/1367126460 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3c0b2cc0 0x7faa3c141d50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:25.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3bfff700 1 -- 172.21.15.60:0/1367126460 >> 172.21.15.60:0/1367126460 conn(0x7faa3c0b83f0 msgr2=0x7faa3c0b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:25.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3bfff700 1 -- 172.21.15.60:0/1367126460 shutdown_connections 2020-10-31T22:48:25.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3bfff700 1 -- 172.21.15.60:0/1367126460 wait complete. 2020-10-31T22:48:25.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3bfff700 1 Processor -- start 2020-10-31T22:48:25.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3bfff700 1 -- start start 2020-10-31T22:48:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa3c05f3c0 0x7faa3c0ad830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3c0b2cc0 0x7faa3c145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa3c13f230 0x7faa3c154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:25.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c147970 con 0x7faa3c13f230 2020-10-31T22:48:25.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3bfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c148190 con 0x7faa3c05f3c0 2020-10-31T22:48:25.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c147c50 con 0x7faa3c0b2cc0 2020-10-31T22:48:25.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa3c13f230 0x7faa3c154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa3c13f230 0x7faa3c154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46400/0 (socket says 172.21.15.60:46400) 2020-10-31T22:48:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3affd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa3c05f3c0 0x7faa3c0ad830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3b7fe700 1 -- 172.21.15.60:0/4208222047 learned_addr learned my addr 172.21.15.60:0/4208222047 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:25.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3a7fc700 1 --2- 172.21.15.60:0/4208222047 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3c0b2cc0 0x7faa3c145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:25.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3affd700 1 -- 172.21.15.60:0/4208222047 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3c0b2cc0 msgr2=0x7faa3c145970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:25.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3affd700 1 --2- 172.21.15.60:0/4208222047 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3c0b2cc0 0x7faa3c145970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:25.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3affd700 1 -- 172.21.15.60:0/4208222047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa3c13f230 msgr2=0x7faa3c154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3affd700 1 --2- 172.21.15.60:0/4208222047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa3c13f230 0x7faa3c154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3affd700 1 -- 172.21.15.60:0/4208222047 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c147ef0 con 0x7faa3c05f3c0 2020-10-31T22:48:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3b7fe700 1 --2- 172.21.15.60:0/4208222047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa3c13f230 0x7faa3c154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.889+0000 7faa3affd700 1 --2- 172.21.15.60:0/4208222047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa3c05f3c0 0x7faa3c0ad830 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7faa3c1441e0 tx=0x7faa2c009270).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.893+0000 7faa33fff700 1 -- 172.21.15.60:0/4208222047 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c00c950 con 0x7faa3c05f3c0 2020-10-31T22:48:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.893+0000 7faa33fff700 1 -- 172.21.15.60:0/4208222047 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c00cab0 con 0x7faa3c05f3c0 2020-10-31T22:48:25.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.893+0000 7faa3bfff700 1 -- 172.21.15.60:0/4208222047 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa3c145330 con 0x7faa3c05f3c0 2020-10-31T22:48:25.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.893+0000 7faa33fff700 1 -- 172.21.15.60:0/4208222047 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2c00ce10 con 0x7faa3c05f3c0 2020-10-31T22:48:25.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.893+0000 7faa3bfff700 1 -- 172.21.15.60:0/4208222047 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3c1476f0 con 0x7faa3c05f3c0 2020-10-31T22:48:25.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.893+0000 7faa3bfff700 1 -- 172.21.15.60:0/4208222047 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3c057100 con 0x7faa3c05f3c0 2020-10-31T22:48:25.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.893+0000 7faa33fff700 1 -- 172.21.15.60:0/4208222047 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7faa2c022070 con 0x7faa3c05f3c0 2020-10-31T22:48:25.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.893+0000 7faa33fff700 1 --2- 172.21.15.60:0/4208222047 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa14054f90 0x7faa14057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:25.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.893+0000 7faa33fff700 1 -- 172.21.15.60:0/4208222047 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faa2c06e0b0 con 0x7faa3c05f3c0 2020-10-31T22:48:25.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.893+0000 7faa3a7fc700 1 --2- 172.21.15.60:0/4208222047 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa14054f90 0x7faa14057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:25.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.897+0000 7faa3a7fc700 1 --2- 172.21.15.60:0/4208222047 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa14054f90 0x7faa14057450 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7faa2401a000 tx=0x7faa24015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:25.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:25.901+0000 7faa33fff700 1 -- 172.21.15.60:0/4208222047 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7faa2c0444d0 con 0x7faa3c05f3c0 2020-10-31T22:48:26.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:26.093+0000 7faa3bfff700 1 -- 172.21.15.60:0/4208222047 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa3c05a870 con 0x7faa3c05f3c0 2020-10-31T22:48:26.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:26.093+0000 7faa33fff700 1 -- 172.21.15.60:0/4208222047 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2493 (secure 0 0 0) 0x7faa2c047af0 con 0x7faa3c05f3c0 2020-10-31T22:48:26.103 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:26.103 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":41,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3668788118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3668788118},{"type":"v1","addr":"172.21.15.60:6835","nonce":3668788118}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6516,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/3884009815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3884009815},{"type":"v1","addr":"172.21.15.60:6837","nonce":3884009815}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:48:15.434973+0000","modified":"2020-10-31T22:48:16.437431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"b","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/2702869569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2702869569},{"type":"v1","addr":"172.21.15.66:6833","nonce":2702869569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-10-31T22:48:26.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:26.097+0000 7faa3bfff700 1 -- 172.21.15.60:0/4208222047 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa14054f90 msgr2=0x7faa14057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:26.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:26.097+0000 7faa3bfff700 1 --2- 172.21.15.60:0/4208222047 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa14054f90 0x7faa14057450 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7faa2401a000 tx=0x7faa24015000).stop 2020-10-31T22:48:26.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:26.097+0000 7faa3bfff700 1 -- 172.21.15.60:0/4208222047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa3c05f3c0 msgr2=0x7faa3c0ad830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:26.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:26.097+0000 7faa3bfff700 1 --2- 172.21.15.60:0/4208222047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa3c05f3c0 0x7faa3c0ad830 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7faa3c1441e0 tx=0x7faa2c009270).stop 2020-10-31T22:48:26.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:26.097+0000 7faa3bfff700 1 -- 172.21.15.60:0/4208222047 shutdown_connections 2020-10-31T22:48:26.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:26.097+0000 7faa3bfff700 1 --2- 172.21.15.60:0/4208222047 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faa3c13f230 0x7faa3c154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:26.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:26.097+0000 7faa3bfff700 1 --2- 172.21.15.60:0/4208222047 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faa14054f90 0x7faa14057450 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:26.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:26.097+0000 7faa3bfff700 1 --2- 172.21.15.60:0/4208222047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faa3c05f3c0 0x7faa3c0ad830 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:26.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:26.097+0000 7faa3bfff700 1 --2- 172.21.15.60:0/4208222047 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faa3c0b2cc0 0x7faa3c145970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:26.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:26.097+0000 7faa3bfff700 1 -- 172.21.15.60:0/4208222047 >> 172.21.15.60:0/4208222047 conn(0x7faa3c0b83f0 msgr2=0x7faa3c140a50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:26.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:26.097+0000 7faa3bfff700 1 -- 172.21.15.60:0/4208222047 shutdown_connections 2020-10-31T22:48:26.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:26.097+0000 7faa3bfff700 1 -- 172.21.15.60:0/4208222047 wait complete. 2020-10-31T22:48:26.111 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 41 2020-10-31T22:48:26.123 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump inode 1 2020-10-31T22:48:26.254 INFO:teuthology.orchestra.run.smithi066.stdout:{"path":"/","ino":1,"rdev":0,"ctime":"2020-10-31T22:48:21.708526+0000","btime":"2020-10-31T22:48:15.441692+0000","mode":17407,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":16,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":0,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2020-10-31T22:48:15.441692+0000","atime":"0.000000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2020-10-31T22:48:21.708526+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"2020-10-31T22:48:15.441692+0000"},"version":3,"file_data_version":0,"xattr_version":1,"backtrace_version":3,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":2,"is_frozen":false,"is_freezing":false,"pins":{"request":1,"lock":3,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"authpin":1},"nref":9,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":1,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"xlockdone","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":1,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{"gather_set":[],"state":"sync","is_leased":false,"num_rdlocks":1,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"nestlock":{},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent"],"client_caps":[{"client_id":6622,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2},{"client_id":6666,"pending":"pLsXsFs","issued":"pLsXsFs","wanted":"-","last_sent":2}],"loner":-1,"want_loner":-1,"mds_caps_wanted":[]} 2020-10-31T22:48:26.255 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "2020-10-31T22:48:15.441692+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "0.000000", "auth_pins": 2, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 1, "state": "xlockdone", "xlock_by": {} }, "backtrace_version": 3, "btime": "2020-10-31T22:48:15.441692+0000", "change_attr": 1, "client_caps": [ { "client_id": 6622, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" }, { "client_id": 6666, "issued": "pLsXsFs", "last_sent": 2, "pending": "pLsXsFs", "wanted": "-" } ], "client_ranges": [], "ctime": "2020-10-31T22:48:21.708526+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 0, "ino": 1, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 16, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": -1, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 17407, "mtime": "2020-10-31T22:48:15.441692+0000", "nestlock": {}, "nlink": 1, "nref": 9, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/", "pins": { "authpin": 1, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 3, "request": 1 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2020-10-31T22:48:21.708526+0000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": { "gather_set": [], "is_leased": false, "num_rdlocks": 1, "num_wrlocks": 0, "num_xlocks": 0, "state": "sync", "xlock_by": {} }, "states": [ "auth", "dirty", "dirtyparent" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 0, "truncate_size": 18446744073709551615, "uid": 0, "version": 3, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 1, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [] } 2020-10-31T22:48:26.256 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:48:26.256 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:26.280 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:26.296 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:26.321 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:26.350 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:48:26.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:26.352 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:26.352 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:26.419 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:48:26.419 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:48:26.420 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:48:26.421 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:48:26.421 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:26.512 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13718]: fuse finished with error 0 and tester_r 0 2020-10-31T22:48:26.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:26.515 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:26.516 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:26.578 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:48:26.579 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:48:26.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:48:26.622 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:26.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:26.692 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:26.693 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:26.704 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:48:26.707 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:48:26.708 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi085.front.sepia.ceph.com... 2020-10-31T22:48:26.708 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:48:26.712 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:26.778 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13196]: fuse finished with error 0 and tester_r 0 2020-10-31T22:48:26.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:26.780 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:26.781 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:26.831 INFO:teuthology.orchestra.run.smithi085.stdout:ext2/ext3 2020-10-31T22:48:26.834 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:48:26.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:48:26.874 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:26.919 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2020-10-31T22:48:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa14cd8c700 1 Processor -- start 2020-10-31T22:48:27.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa14cd8c700 1 -- start start 2020-10-31T22:48:27.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa14cd8c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa148067440 0x7fa1480b25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:27.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa14cd8c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1480613f0 con 0x7fa1480b30c0 2020-10-31T22:48:27.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa14cd8c700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1480b2ae0 con 0x7fa148060e70 2020-10-31T22:48:27.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa14cd8c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480a9ce0 con 0x7fa148067440 2020-10-31T22:48:27.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa14659c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa1480b30c0 0x7fa1480b1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50540/0 (socket says 172.21.15.60:50540) 2020-10-31T22:48:27.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa14659c700 1 -- 172.21.15.60:0/2453688437 learned_addr learned my addr 172.21.15.60:0/2453688437 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:27.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa146d9d700 1 --2- 172.21.15.60:0/2453688437 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa148067440 0x7fa1480b25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:27.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa14559a700 1 -- 172.21.15.60:0/2453688437 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1164652753 0 0) 0x7fa1480613f0 con 0x7fa1480b30c0 2020-10-31T22:48:27.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa14559a700 1 -- 172.21.15.60:0/2453688437 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa128003230 con 0x7fa1480b30c0 2020-10-31T22:48:27.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa14559a700 1 -- 172.21.15.60:0/2453688437 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3591786661 0 0) 0x7fa1480b2ae0 con 0x7fa148060e70 2020-10-31T22:48:27.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa14559a700 1 -- 172.21.15.60:0/2453688437 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1480613f0 con 0x7fa148060e70 2020-10-31T22:48:27.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa146d9d700 1 -- 172.21.15.60:0/2453688437 >> v1:172.21.15.66:6789/0 conn(0x7fa148060e70 legacy=0x7fa1481421e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:27.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa146d9d700 1 -- 172.21.15.60:0/2453688437 >> v1:172.21.15.60:6789/0 conn(0x7fa1480b30c0 legacy=0x7fa1480b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:27.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa146d9d700 1 -- 172.21.15.60:0/2453688437 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1480b34a0 con 0x7fa148067440 2020-10-31T22:48:27.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.045+0000 7fa146d9d700 1 --2- 172.21.15.60:0/2453688437 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa148067440 0x7fa1480b25f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fa1400032b0 tx=0x7fa1400091a0).ready entity=mon.2 client_cookie=3833680b8d1ab2c5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.049+0000 7fa14559a700 1 -- 172.21.15.60:0/2453688437 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14000b9a0 con 0x7fa148067440 2020-10-31T22:48:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.049+0000 7fa14559a700 1 -- 172.21.15.60:0/2453688437 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14000bb00 con 0x7fa148067440 2020-10-31T22:48:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.049+0000 7fa14559a700 1 -- 172.21.15.60:0/2453688437 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14000bc70 con 0x7fa148067440 2020-10-31T22:48:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.049+0000 7fa14cd8c700 1 -- 172.21.15.60:0/2453688437 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa148067440 msgr2=0x7fa1480b25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:27.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.049+0000 7fa14cd8c700 1 --2- 172.21.15.60:0/2453688437 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa148067440 0x7fa1480b25f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fa1400032b0 tx=0x7fa1400091a0).stop 2020-10-31T22:48:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.049+0000 7fa14cd8c700 1 -- 172.21.15.60:0/2453688437 shutdown_connections 2020-10-31T22:48:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.049+0000 7fa14cd8c700 1 --2- 172.21.15.60:0/2453688437 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa148067440 0x7fa1480b25f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.049+0000 7fa14cd8c700 1 -- 172.21.15.60:0/2453688437 >> 172.21.15.60:0/2453688437 conn(0x7fa14806a260 msgr2=0x7fa148063c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.049+0000 7fa14cd8c700 1 -- 172.21.15.60:0/2453688437 shutdown_connections 2020-10-31T22:48:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.049+0000 7fa14cd8c700 1 -- 172.21.15.60:0/2453688437 wait complete. 2020-10-31T22:48:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.049+0000 7fa14cd8c700 1 Processor -- start 2020-10-31T22:48:27.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.049+0000 7fa14cd8c700 1 -- start start 2020-10-31T22:48:27.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.049+0000 7fa14cd8c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa148060e70 0x7fa1480667e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:27.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa14cd8c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa148067440 0x7fa1480ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:27.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa14cd8c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1480b30c0 0x7fa1480aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa14cd8c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa148151b90 con 0x7fa1480b30c0 2020-10-31T22:48:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa14cd8c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480acad0 con 0x7fa148067440 2020-10-31T22:48:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa14cd8c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1480af030 con 0x7fa148060e70 2020-10-31T22:48:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa146d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1480b30c0 0x7fa1480aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa146d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1480b30c0 0x7fa1480aeb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46412/0 (socket says 172.21.15.60:46412) 2020-10-31T22:48:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa146d9d700 1 -- 172.21.15.60:0/3161054173 learned_addr learned my addr 172.21.15.60:0/3161054173 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:27.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa14659c700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa148060e70 0x7fa1480667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa145d9b700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa148067440 0x7fa1480ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa146d9d700 1 -- 172.21.15.60:0/3161054173 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa148060e70 msgr2=0x7fa1480667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa146d9d700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa148060e70 0x7fa1480667e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa146d9d700 1 -- 172.21.15.60:0/3161054173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa148067440 msgr2=0x7fa1480ae650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa146d9d700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa148067440 0x7fa1480ae650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa146d9d700 1 -- 172.21.15.60:0/3161054173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1481518c0 con 0x7fa1480b30c0 2020-10-31T22:48:27.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa145d9b700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa148067440 0x7fa1480ae650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa146d9d700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1480b30c0 0x7fa1480aeb40 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fa1400032b0 tx=0x7fa140016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa13f7fe700 1 -- 172.21.15.60:0/3161054173 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14000bc70 con 0x7fa1480b30c0 2020-10-31T22:48:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa13f7fe700 1 -- 172.21.15.60:0/3161054173 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14001f5e0 con 0x7fa1480b30c0 2020-10-31T22:48:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa14cd8c700 1 -- 172.21.15.60:0/3161054173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1480acf70 con 0x7fa1480b30c0 2020-10-31T22:48:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa13f7fe700 1 -- 172.21.15.60:0/3161054173 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14001f940 con 0x7fa1480b30c0 2020-10-31T22:48:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa14cd8c700 1 -- 172.21.15.60:0/3161054173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1481432b0 con 0x7fa1480b30c0 2020-10-31T22:48:27.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa13f7fe700 1 -- 172.21.15.60:0/3161054173 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa140026030 con 0x7fa1480b30c0 2020-10-31T22:48:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa14cd8c700 1 -- 172.21.15.60:0/3161054173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1480b03f0 con 0x7fa1480b30c0 2020-10-31T22:48:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa13f7fe700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa12c054f10 0x7fa12c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:27.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa14659c700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa12c054f10 0x7fa12c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:27.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.053+0000 7fa13f7fe700 1 -- 172.21.15.60:0/3161054173 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa14006e6b0 con 0x7fa1480b30c0 2020-10-31T22:48:27.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.057+0000 7fa14659c700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa12c054f10 0x7fa12c0573d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fa13000b000 tx=0x7fa130009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:27.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.061+0000 7fa13f7fe700 1 -- 172.21.15.60:0/3161054173 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa140044ac0 con 0x7fa1480b30c0 2020-10-31T22:48:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.205+0000 7fa14cd8c700 1 -- 172.21.15.60:0/3161054173 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa148057100 con 0x7fa1480b30c0 2020-10-31T22:48:27.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.213+0000 7fa13f7fe700 1 -- 172.21.15.60:0/3161054173 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa1400480e0 con 0x7fa1480b30c0 2020-10-31T22:48:27.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.213+0000 7fa14cd8c700 1 -- 172.21.15.60:0/3161054173 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa12c054f10 msgr2=0x7fa12c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.213+0000 7fa14cd8c700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa12c054f10 0x7fa12c0573d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7fa13000b000 tx=0x7fa130009040).stop 2020-10-31T22:48:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.213+0000 7fa14cd8c700 1 -- 172.21.15.60:0/3161054173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1480b30c0 msgr2=0x7fa1480aeb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:27.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.213+0000 7fa14cd8c700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1480b30c0 0x7fa1480aeb40 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 rx=0x7fa1400032b0 tx=0x7fa140016000).stop 2020-10-31T22:48:27.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.213+0000 7fa14cd8c700 1 -- 172.21.15.60:0/3161054173 shutdown_connections 2020-10-31T22:48:27.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.213+0000 7fa14cd8c700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1480b30c0 0x7fa1480aeb40 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.213+0000 7fa14cd8c700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa148060e70 0x7fa1480667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.213+0000 7fa14cd8c700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa12c054f10 0x7fa12c0573d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.217+0000 7fa14cd8c700 1 --2- 172.21.15.60:0/3161054173 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa148067440 0x7fa1480ae650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.217+0000 7fa14cd8c700 1 -- 172.21.15.60:0/3161054173 >> 172.21.15.60:0/3161054173 conn(0x7fa14806a260 msgr2=0x7fa1480647f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:27.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.217+0000 7fa14cd8c700 1 -- 172.21.15.60:0/3161054173 shutdown_connections 2020-10-31T22:48:27.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.217+0000 7fa14cd8c700 1 -- 172.21.15.60:0/3161054173 wait complete. 2020-10-31T22:48:27.236 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode' 2020-10-31T22:48:27.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2decef5700 1 Processor -- start 2020-10-31T22:48:27.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2decef5700 1 -- start start 2020-10-31T22:48:27.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2decef5700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2de805c4c0 0x7f2de805c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:27.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2decef5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2de80b2e20 0x7f2de8146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:27.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2decef5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2de80b4410 0x7f2de813f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:27.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2decef5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de8141ef0 con 0x7f2de80b4410 2020-10-31T22:48:27.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2decef5700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de8065e90 con 0x7f2de805c4c0 2020-10-31T22:48:27.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2decef5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de8066130 con 0x7f2de80b2e20 2020-10-31T22:48:27.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2de6d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2de80b4410 0x7f2de813f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:27.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2de6d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2de80b4410 0x7f2de813f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46422/0 (socket says 172.21.15.60:46422) 2020-10-31T22:48:27.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2de6d9d700 1 -- 172.21.15.60:0/3757974215 learned_addr learned my addr 172.21.15.60:0/3757974215 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:27.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2de659c700 1 --2- 172.21.15.60:0/3757974215 >> v2:172.21.15.66:3300/0 conn(0x7f2de805c4c0 0x7f2de805c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:27.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2de5d9b700 1 --2- 172.21.15.60:0/3757974215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2de80b2e20 0x7f2de8146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:27.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2de6d9d700 1 -- 172.21.15.60:0/3757974215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2de80b2e20 msgr2=0x7f2de8146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:27.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2de6d9d700 1 --2- 172.21.15.60:0/3757974215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2de80b2e20 0x7f2de8146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2de6d9d700 1 -- 172.21.15.60:0/3757974215 >> v2:172.21.15.66:3300/0 conn(0x7f2de805c4c0 msgr2=0x7f2de805c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:27.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2de6d9d700 1 --2- 172.21.15.60:0/3757974215 >> v2:172.21.15.66:3300/0 conn(0x7f2de805c4c0 0x7f2de805c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2de6d9d700 1 -- 172.21.15.60:0/3757974215 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de80663d0 con 0x7f2de80b4410 2020-10-31T22:48:27.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.353+0000 7f2de659c700 1 --2- 172.21.15.60:0/3757974215 >> v2:172.21.15.66:3300/0 conn(0x7f2de805c4c0 0x7f2de805c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:27.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2de6d9d700 1 --2- 172.21.15.60:0/3757974215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2de80b4410 0x7f2de813f390 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f2de00032b0 tx=0x7f2de0009270).ready entity=mon.0 client_cookie=39c20c03fe3e43b3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:27.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2de559a700 1 -- 172.21.15.60:0/3757974215 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2de0009e60 con 0x7f2de80b4410 2020-10-31T22:48:27.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2de559a700 1 -- 172.21.15.60:0/3757974215 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de000bc00 con 0x7f2de80b4410 2020-10-31T22:48:27.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2de559a700 1 -- 172.21.15.60:0/3757974215 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2de000bd70 con 0x7f2de80b4410 2020-10-31T22:48:27.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2decef5700 1 -- 172.21.15.60:0/3757974215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2de80b4410 msgr2=0x7f2de813f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:27.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2decef5700 1 --2- 172.21.15.60:0/3757974215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2de80b4410 0x7f2de813f390 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 rx=0x7f2de00032b0 tx=0x7f2de0009270).stop 2020-10-31T22:48:27.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2decef5700 1 -- 172.21.15.60:0/3757974215 shutdown_connections 2020-10-31T22:48:27.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2decef5700 1 --2- 172.21.15.60:0/3757974215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2de80b4410 0x7f2de813f390 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2decef5700 1 --2- 172.21.15.60:0/3757974215 >> v2:172.21.15.66:3300/0 conn(0x7f2de805c4c0 0x7f2de805c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2decef5700 1 --2- 172.21.15.60:0/3757974215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2de80b2e20 0x7f2de8146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2decef5700 1 -- 172.21.15.60:0/3757974215 >> 172.21.15.60:0/3757974215 conn(0x7f2de80601e0 msgr2=0x7f2de805b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:27.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2decef5700 1 -- 172.21.15.60:0/3757974215 shutdown_connections 2020-10-31T22:48:27.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2decef5700 1 -- 172.21.15.60:0/3757974215 wait complete. 2020-10-31T22:48:27.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2decef5700 1 Processor -- start 2020-10-31T22:48:27.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.357+0000 7f2decef5700 1 -- start start 2020-10-31T22:48:27.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2decef5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2de805c4c0 0x7f2de80b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:27.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2decef5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2de80b4410 0x7f2de80aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:27.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2decef5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2de80aece0 0x7f2de8154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:27.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2decef5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80af6b0 con 0x7f2de80b4410 2020-10-31T22:48:27.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2decef5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80aeaf0 con 0x7f2de80aece0 2020-10-31T22:48:27.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2decef5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de80af190 con 0x7f2de805c4c0 2020-10-31T22:48:27.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2de5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2de80b4410 0x7f2de80aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:27.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2de5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2de80b4410 0x7f2de80aaf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46426/0 (socket says 172.21.15.60:46426) 2020-10-31T22:48:27.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2de5d9b700 1 -- 172.21.15.60:0/3228270896 learned_addr learned my addr 172.21.15.60:0/3228270896 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:27.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2de659c700 1 --2- 172.21.15.60:0/3228270896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2de805c4c0 0x7f2de80b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:27.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2de6d9d700 1 --2- 172.21.15.60:0/3228270896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2de80aece0 0x7f2de8154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:27.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2de5d9b700 1 -- 172.21.15.60:0/3228270896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2de805c4c0 msgr2=0x7f2de80b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:27.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2de5d9b700 1 --2- 172.21.15.60:0/3228270896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2de805c4c0 0x7f2de80b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2de5d9b700 1 -- 172.21.15.60:0/3228270896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2de80aece0 msgr2=0x7f2de8154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:27.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2de5d9b700 1 --2- 172.21.15.60:0/3228270896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2de80aece0 0x7f2de8154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2de5d9b700 1 -- 172.21.15.60:0/3228270896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de80af410 con 0x7f2de80b4410 2020-10-31T22:48:27.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2de5d9b700 1 --2- 172.21.15.60:0/3228270896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2de80b4410 0x7f2de80aaf70 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f2dd800c000 tx=0x7f2dd8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:27.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2dd77fe700 1 -- 172.21.15.60:0/3228270896 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dd800ca10 con 0x7f2de80b4410 2020-10-31T22:48:27.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2dd77fe700 1 -- 172.21.15.60:0/3228270896 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd800cb70 con 0x7f2de80b4410 2020-10-31T22:48:27.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2decef5700 1 -- 172.21.15.60:0/3228270896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de80aa830 con 0x7f2de80b4410 2020-10-31T22:48:27.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2dd77fe700 1 -- 172.21.15.60:0/3228270896 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dd80123f0 con 0x7f2de80b4410 2020-10-31T22:48:27.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2decef5700 1 -- 172.21.15.60:0/3228270896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de80aa340 con 0x7f2de80b4410 2020-10-31T22:48:27.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2decef5700 1 -- 172.21.15.60:0/3228270896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de8057100 con 0x7f2de80b4410 2020-10-31T22:48:27.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.361+0000 7f2dd77fe700 1 -- 172.21.15.60:0/3228270896 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2dd8012550 con 0x7f2de80b4410 2020-10-31T22:48:27.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.365+0000 7f2dd77fe700 1 --2- 172.21.15.60:0/3228270896 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2dc4054f90 0x7f2dc4057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:27.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.365+0000 7f2dd77fe700 1 -- 172.21.15.60:0/3228270896 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2dd806dd20 con 0x7f2de80b4410 2020-10-31T22:48:27.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.365+0000 7f2de659c700 1 --2- 172.21.15.60:0/3228270896 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2dc4054f90 0x7f2dc4057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:27.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.365+0000 7f2de659c700 1 --2- 172.21.15.60:0/3228270896 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2dc4054f90 0x7f2dc4057450 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f2ddc00c000 tx=0x7f2ddc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:27.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.369+0000 7f2dd77fe700 1 -- 172.21.15.60:0/3228270896 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2dd80441e0 con 0x7f2de80b4410 2020-10-31T22:48:27.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.557+0000 7f2decef5700 1 -- 172.21.15.60:0/3228270896 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]} v 0) v1 -- 0x7f2de805aa70 con 0x7f2de80b4410 2020-10-31T22:48:27.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.985+0000 7f2dd77fe700 1 -- 172.21.15.60:0/3228270896 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode"]}]=0 v314) v1 ==== 126+0+0 (secure 0 0 0) 0x7f2dd8047800 con 0x7f2de80b4410 2020-10-31T22:48:27.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.989+0000 7f2decef5700 1 -- 172.21.15.60:0/3228270896 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2dc4054f90 msgr2=0x7f2dc4057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:27.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.989+0000 7f2decef5700 1 --2- 172.21.15.60:0/3228270896 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2dc4054f90 0x7f2dc4057450 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f2ddc00c000 tx=0x7f2ddc008040).stop 2020-10-31T22:48:27.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.989+0000 7f2decef5700 1 -- 172.21.15.60:0/3228270896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2de80b4410 msgr2=0x7f2de80aaf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:27.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.989+0000 7f2decef5700 1 --2- 172.21.15.60:0/3228270896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2de80b4410 0x7f2de80aaf70 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 rx=0x7f2dd800c000 tx=0x7f2dd8006dc0).stop 2020-10-31T22:48:27.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.989+0000 7f2decef5700 1 -- 172.21.15.60:0/3228270896 shutdown_connections 2020-10-31T22:48:27.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.989+0000 7f2decef5700 1 --2- 172.21.15.60:0/3228270896 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2dc4054f90 0x7f2dc4057450 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.989+0000 7f2decef5700 1 --2- 172.21.15.60:0/3228270896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2de80aece0 0x7f2de8154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.989+0000 7f2decef5700 1 --2- 172.21.15.60:0/3228270896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2de805c4c0 0x7f2de80b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.989+0000 7f2decef5700 1 --2- 172.21.15.60:0/3228270896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2de80b4410 0x7f2de80aaf70 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:27.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.989+0000 7f2decef5700 1 -- 172.21.15.60:0/3228270896 >> 172.21.15.60:0/3228270896 conn(0x7f2de80601e0 msgr2=0x7f2de80b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:27.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.989+0000 7f2decef5700 1 -- 172.21.15.60:0/3228270896 shutdown_connections 2020-10-31T22:48:28.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:27.989+0000 7f2decef5700 1 -- 172.21.15.60:0/3228270896 wait complete. 2020-10-31T22:48:28.015 INFO:tasks.cephfs_test_runner:test_dump_inode (tasks.cephfs.test_misc.TestMisc) ... ok 2020-10-31T22:48:28.016 INFO:tasks.cephfs_test_runner:Starting test: test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) 2020-10-31T22:48:28.016 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2020-10-31T22:48:28.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 Processor -- start 2020-10-31T22:48:28.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 -- start start 2020-10-31T22:48:28.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5d4005c4c0 0x7f5d4005c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:28.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d400b2e20 0x7f5d40146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:28.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5d400b4410 0x7f5d4013f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:28.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d40141ef0 con 0x7f5d400b4410 2020-10-31T22:48:28.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d40065e90 con 0x7f5d4005c4c0 2020-10-31T22:48:28.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d40066130 con 0x7f5d400b2e20 2020-10-31T22:48:28.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d44d7d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5d400b4410 0x7f5d4013f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:28.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d44d7d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5d400b4410 0x7f5d4013f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46436/0 (socket says 172.21.15.60:46436) 2020-10-31T22:48:28.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d44d7d700 1 -- 172.21.15.60:0/318538901 learned_addr learned my addr 172.21.15.60:0/318538901 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:28.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d3ffff700 1 --2- 172.21.15.60:0/318538901 >> v2:172.21.15.66:3300/0 conn(0x7f5d4005c4c0 0x7f5d4005c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:28.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d3f7fe700 1 --2- 172.21.15.60:0/318538901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d400b2e20 0x7f5d40146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:28.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d44d7d700 1 -- 172.21.15.60:0/318538901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d400b2e20 msgr2=0x7f5d40146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:28.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d44d7d700 1 --2- 172.21.15.60:0/318538901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d400b2e20 0x7f5d40146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:28.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d44d7d700 1 -- 172.21.15.60:0/318538901 >> v2:172.21.15.66:3300/0 conn(0x7f5d4005c4c0 msgr2=0x7f5d4005c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:28.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d44d7d700 1 --2- 172.21.15.60:0/318538901 >> v2:172.21.15.66:3300/0 conn(0x7f5d4005c4c0 0x7f5d4005c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:28.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d44d7d700 1 -- 172.21.15.60:0/318538901 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d400663d0 con 0x7f5d400b4410 2020-10-31T22:48:28.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d3f7fe700 1 --2- 172.21.15.60:0/318538901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d400b2e20 0x7f5d40146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:28.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d44d7d700 1 --2- 172.21.15.60:0/318538901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d400b4410 0x7f5d4013f390 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f5d380032b0 tx=0x7f5d38009270).ready entity=mon.0 client_cookie=a7e7cf5f282247e1 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:28.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d3effd700 1 -- 172.21.15.60:0/318538901 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d3800bc00 con 0x7f5d400b4410 2020-10-31T22:48:28.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d3effd700 1 -- 172.21.15.60:0/318538901 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3800bd60 con 0x7f5d400b4410 2020-10-31T22:48:28.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d3effd700 1 -- 172.21.15.60:0/318538901 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d38011400 con 0x7f5d400b4410 2020-10-31T22:48:28.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 -- 172.21.15.60:0/318538901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d400b4410 msgr2=0x7f5d4013f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:28.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 --2- 172.21.15.60:0/318538901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d400b4410 0x7f5d4013f390 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 rx=0x7f5d380032b0 tx=0x7f5d38009270).stop 2020-10-31T22:48:28.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 -- 172.21.15.60:0/318538901 shutdown_connections 2020-10-31T22:48:28.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 --2- 172.21.15.60:0/318538901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d400b4410 0x7f5d4013f390 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:28.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 --2- 172.21.15.60:0/318538901 >> v2:172.21.15.66:3300/0 conn(0x7f5d4005c4c0 0x7f5d4005c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:28.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 --2- 172.21.15.60:0/318538901 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d400b2e20 0x7f5d40146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:28.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 -- 172.21.15.60:0/318538901 >> 172.21.15.60:0/318538901 conn(0x7f5d400601e0 msgr2=0x7f5d4005b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:28.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 -- 172.21.15.60:0/318538901 shutdown_connections 2020-10-31T22:48:28.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.133+0000 7f5d467e0700 1 -- 172.21.15.60:0/318538901 wait complete. 2020-10-31T22:48:28.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d467e0700 1 Processor -- start 2020-10-31T22:48:28.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d467e0700 1 -- start start 2020-10-31T22:48:28.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d467e0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d4005c4c0 0x7f5d400b1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:28.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d467e0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d400b4410 0x7f5d40154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:28.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d467e0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d400ab2d0 0x7f5d40154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:28.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d467e0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d40154f20 con 0x7f5d4005c4c0 2020-10-31T22:48:28.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d467e0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400ab800 con 0x7f5d400ab2d0 2020-10-31T22:48:28.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d467e0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d400abaa0 con 0x7f5d400b4410 2020-10-31T22:48:28.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d3ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d4005c4c0 0x7f5d400b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:28.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d3ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d4005c4c0 0x7f5d400b1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46438/0 (socket says 172.21.15.60:46438) 2020-10-31T22:48:28.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d3ffff700 1 -- 172.21.15.60:0/2504291226 learned_addr learned my addr 172.21.15.60:0/2504291226 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:28.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d44d7d700 1 --2- 172.21.15.60:0/2504291226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d400ab2d0 0x7f5d40154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:28.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d3f7fe700 1 --2- 172.21.15.60:0/2504291226 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d400b4410 0x7f5d40154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:28.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d3ffff700 1 -- 172.21.15.60:0/2504291226 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d400b4410 msgr2=0x7f5d40154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:28.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d3ffff700 1 --2- 172.21.15.60:0/2504291226 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d400b4410 0x7f5d40154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:28.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d3ffff700 1 -- 172.21.15.60:0/2504291226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d400ab2d0 msgr2=0x7f5d40154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:28.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d3ffff700 1 --2- 172.21.15.60:0/2504291226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d400ab2d0 0x7f5d40154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:28.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d3ffff700 1 -- 172.21.15.60:0/2504291226 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d400abd40 con 0x7f5d4005c4c0 2020-10-31T22:48:28.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d3ffff700 1 --2- 172.21.15.60:0/2504291226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d4005c4c0 0x7f5d400b1790 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f5d30003070 tx=0x7f5d30008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:28.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d3d7fa700 1 -- 172.21.15.60:0/2504291226 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d30009790 con 0x7f5d4005c4c0 2020-10-31T22:48:28.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d3d7fa700 1 -- 172.21.15.60:0/2504291226 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d300098f0 con 0x7f5d4005c4c0 2020-10-31T22:48:28.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d3d7fa700 1 -- 172.21.15.60:0/2504291226 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5d30009c50 con 0x7f5d4005c4c0 2020-10-31T22:48:28.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d467e0700 1 -- 172.21.15.60:0/2504291226 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d401540a0 con 0x7f5d4005c4c0 2020-10-31T22:48:28.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.137+0000 7f5d467e0700 1 -- 172.21.15.60:0/2504291226 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d400ac050 con 0x7f5d4005c4c0 2020-10-31T22:48:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.141+0000 7f5d467e0700 1 -- 172.21.15.60:0/2504291226 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d40154230 con 0x7f5d4005c4c0 2020-10-31T22:48:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.141+0000 7f5d3d7fa700 1 -- 172.21.15.60:0/2504291226 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5d30013480 con 0x7f5d4005c4c0 2020-10-31T22:48:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.141+0000 7f5d3d7fa700 1 --2- 172.21.15.60:0/2504291226 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5d24054f10 0x7f5d240573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.141+0000 7f5d3d7fa700 1 -- 172.21.15.60:0/2504291226 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5d3006e0b0 con 0x7f5d4005c4c0 2020-10-31T22:48:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.141+0000 7f5d3f7fe700 1 --2- 172.21.15.60:0/2504291226 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5d24054f10 0x7f5d240573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.141+0000 7f5d3f7fe700 1 --2- 172.21.15.60:0/2504291226 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5d24054f10 0x7f5d240573d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f5d2800d000 tx=0x7f5d28008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:28.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.145+0000 7f5d3d7fa700 1 -- 172.21.15.60:0/2504291226 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5d30044570 con 0x7f5d4005c4c0 2020-10-31T22:48:28.346 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.337+0000 7f5d467e0700 1 -- 172.21.15.60:0/2504291226 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7f5d40057100 con 0x7f5d4005c4c0 2020-10-31T22:48:28.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.985+0000 7f5d3d7fa700 1 -- 172.21.15.60:0/2504291226 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v315) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5d30009db0 con 0x7f5d4005c4c0 2020-10-31T22:48:28.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.989+0000 7f5d467e0700 1 -- 172.21.15.60:0/2504291226 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5d24054f10 msgr2=0x7f5d240573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.989+0000 7f5d467e0700 1 --2- 172.21.15.60:0/2504291226 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5d24054f10 0x7f5d240573d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f5d2800d000 tx=0x7f5d28008040).stop 2020-10-31T22:48:29.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.989+0000 7f5d467e0700 1 -- 172.21.15.60:0/2504291226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d4005c4c0 msgr2=0x7f5d400b1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.989+0000 7f5d467e0700 1 --2- 172.21.15.60:0/2504291226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d4005c4c0 0x7f5d400b1790 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 rx=0x7f5d30003070 tx=0x7f5d30008040).stop 2020-10-31T22:48:29.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.993+0000 7f5d467e0700 1 -- 172.21.15.60:0/2504291226 shutdown_connections 2020-10-31T22:48:29.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.993+0000 7f5d467e0700 1 --2- 172.21.15.60:0/2504291226 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5d24054f10 0x7f5d240573d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.993+0000 7f5d467e0700 1 --2- 172.21.15.60:0/2504291226 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d400ab2d0 0x7f5d40154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.993+0000 7f5d467e0700 1 --2- 172.21.15.60:0/2504291226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d4005c4c0 0x7f5d400b1790 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.993+0000 7f5d467e0700 1 --2- 172.21.15.60:0/2504291226 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d400b4410 0x7f5d40154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.993+0000 7f5d467e0700 1 -- 172.21.15.60:0/2504291226 >> 172.21.15.60:0/2504291226 conn(0x7f5d400601e0 msgr2=0x7f5d40140fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:29.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.993+0000 7f5d467e0700 1 -- 172.21.15.60:0/2504291226 shutdown_connections 2020-10-31T22:48:29.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:28.993+0000 7f5d467e0700 1 -- 172.21.15.60:0/2504291226 wait complete. 2020-10-31T22:48:29.017 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2020-10-31T22:48:29.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.137+0000 7fe3862c8700 1 Processor -- start 2020-10-31T22:48:29.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.137+0000 7fe3862c8700 1 -- start start 2020-10-31T22:48:29.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3862c8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3800b5380 0x7fe3800ac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:29.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3862c8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3800acd60 con 0x7fe3800b0fd0 2020-10-31T22:48:29.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3862c8700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3800b5760 con 0x7fe3800b0b50 2020-10-31T22:48:29.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3862c8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800ad650 con 0x7fe3800b5380 2020-10-31T22:48:29.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe385ac7700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe3800b0fd0 0x7fe3800b2230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50586/0 (socket says 172.21.15.60:50586) 2020-10-31T22:48:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe385ac7700 1 -- 172.21.15.60:0/1982521845 learned_addr learned my addr 172.21.15.60:0/1982521845 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3852c6700 1 --2- 172.21.15.60:0/1982521845 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3800b5380 0x7fe3800ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe36ffff700 1 -- 172.21.15.60:0/1982521845 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158923924 0 0) 0x7fe3800acd60 con 0x7fe3800b0fd0 2020-10-31T22:48:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe36ffff700 1 -- 172.21.15.60:0/1982521845 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe368003230 con 0x7fe3800b0fd0 2020-10-31T22:48:29.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe36ffff700 1 -- 172.21.15.60:0/1982521845 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556956516 0 0) 0x7fe3800b5760 con 0x7fe3800b0b50 2020-10-31T22:48:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe36ffff700 1 -- 172.21.15.60:0/1982521845 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3800acd60 con 0x7fe3800b0b50 2020-10-31T22:48:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3852c6700 1 -- 172.21.15.60:0/1982521845 >> v1:172.21.15.66:6789/0 conn(0x7fe3800b0b50 legacy=0x7fe3800b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3852c6700 1 -- 172.21.15.60:0/1982521845 >> v1:172.21.15.60:6789/0 conn(0x7fe3800b0fd0 legacy=0x7fe3800b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe36ffff700 1 -- 172.21.15.60:0/1982521845 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 503113681 0 0) 0x7fe368003230 con 0x7fe3800b0fd0 2020-10-31T22:48:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3852c6700 1 -- 172.21.15.60:0/1982521845 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3800b2940 con 0x7fe3800b5380 2020-10-31T22:48:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3852c6700 1 --2- 172.21.15.60:0/1982521845 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3800b5380 0x7fe3800ac530 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fe378001bf0 tx=0x7fe37c006dc0).ready entity=mon.2 client_cookie=39c609758a169b06 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:29.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe36ffff700 1 -- 172.21.15.60:0/1982521845 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe378001a50 con 0x7fe3800b5380 2020-10-31T22:48:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe36ffff700 1 -- 172.21.15.60:0/1982521845 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37c00d5c0 con 0x7fe3800b5380 2020-10-31T22:48:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe36ffff700 1 -- 172.21.15.60:0/1982521845 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37c00d730 con 0x7fe3800b5380 2020-10-31T22:48:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3862c8700 1 -- 172.21.15.60:0/1982521845 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3800b5380 msgr2=0x7fe3800ac530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3862c8700 1 --2- 172.21.15.60:0/1982521845 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3800b5380 0x7fe3800ac530 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fe378001bf0 tx=0x7fe37c006dc0).stop 2020-10-31T22:48:29.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3862c8700 1 -- 172.21.15.60:0/1982521845 shutdown_connections 2020-10-31T22:48:29.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3862c8700 1 --2- 172.21.15.60:0/1982521845 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3800b5380 0x7fe3800ac530 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3862c8700 1 -- 172.21.15.60:0/1982521845 >> 172.21.15.60:0/1982521845 conn(0x7fe38006a600 msgr2=0x7fe380060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:29.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3862c8700 1 -- 172.21.15.60:0/1982521845 shutdown_connections 2020-10-31T22:48:29.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.141+0000 7fe3862c8700 1 -- 172.21.15.60:0/1982521845 wait complete. 2020-10-31T22:48:29.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.145+0000 7fe3862c8700 1 Processor -- start 2020-10-31T22:48:29.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.145+0000 7fe3862c8700 1 -- start start 2020-10-31T22:48:29.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.145+0000 7fe3862c8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3800b0b50 0x7fe38005b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:29.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.145+0000 7fe3862c8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3800b0fd0 0x7fe38009f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:29.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.145+0000 7fe3862c8700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3800b5380 0x7fe38009fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:29.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.145+0000 7fe3862c8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3800a2650 con 0x7fe3800b0b50 2020-10-31T22:48:29.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.145+0000 7fe3862c8700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38009ed00 con 0x7fe3800b5380 2020-10-31T22:48:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.145+0000 7fe3862c8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38009e050 con 0x7fe3800b0fd0 2020-10-31T22:48:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.145+0000 7fe3852c6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3800b0b50 0x7fe38005b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.145+0000 7fe3852c6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3800b0b50 0x7fe38005b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46452/0 (socket says 172.21.15.60:46452) 2020-10-31T22:48:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.145+0000 7fe3852c6700 1 -- 172.21.15.60:0/1856314480 learned_addr learned my addr 172.21.15.60:0/1856314480 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.145+0000 7fe385ac7700 1 --2- 172.21.15.60:0/1856314480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3800b5380 0x7fe38009fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:29.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.145+0000 7fe384ac5700 1 --2- 172.21.15.60:0/1856314480 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3800b0fd0 0x7fe38009f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:29.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe3852c6700 1 -- 172.21.15.60:0/1856314480 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3800b0fd0 msgr2=0x7fe38009f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe3852c6700 1 --2- 172.21.15.60:0/1856314480 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3800b0fd0 0x7fe38009f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe3852c6700 1 -- 172.21.15.60:0/1856314480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3800b5380 msgr2=0x7fe38009fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe3852c6700 1 --2- 172.21.15.60:0/1856314480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3800b5380 0x7fe38009fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe3852c6700 1 -- 172.21.15.60:0/1856314480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe38009e2f0 con 0x7fe3800b0b50 2020-10-31T22:48:29.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe3852c6700 1 --2- 172.21.15.60:0/1856314480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3800b0b50 0x7fe38005b3d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fe378001bf0 tx=0x7fe37c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:29.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe36e7fc700 1 -- 172.21.15.60:0/1856314480 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37c011b40 con 0x7fe3800b0b50 2020-10-31T22:48:29.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe3862c8700 1 -- 172.21.15.60:0/1856314480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe38009e590 con 0x7fe3800b0b50 2020-10-31T22:48:29.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe36e7fc700 1 -- 172.21.15.60:0/1856314480 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37c011ca0 con 0x7fe3800b0b50 2020-10-31T22:48:29.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe36e7fc700 1 -- 172.21.15.60:0/1856314480 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe37c01d450 con 0x7fe3800b0b50 2020-10-31T22:48:29.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe3862c8700 1 -- 172.21.15.60:0/1856314480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3800a04b0 con 0x7fe3800b0b50 2020-10-31T22:48:29.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe3862c8700 1 -- 172.21.15.60:0/1856314480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe38009f730 con 0x7fe3800b0b50 2020-10-31T22:48:29.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe36e7fc700 1 -- 172.21.15.60:0/1856314480 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe37c024030 con 0x7fe3800b0b50 2020-10-31T22:48:29.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe36e7fc700 1 --2- 172.21.15.60:0/1856314480 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe360054f90 0x7fe360057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:29.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe36e7fc700 1 -- 172.21.15.60:0/1856314480 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe37c06ea90 con 0x7fe3800b0b50 2020-10-31T22:48:29.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe384ac5700 1 --2- 172.21.15.60:0/1856314480 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe360054f90 0x7fe360057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:29.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.149+0000 7fe384ac5700 1 --2- 172.21.15.60:0/1856314480 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe360054f90 0x7fe360057450 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fe37000d000 tx=0x7fe3700079f0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:29.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.157+0000 7fe36e7fc700 1 -- 172.21.15.60:0/1856314480 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe38009f730 con 0x7fe3800b0b50 2020-10-31T22:48:29.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.301+0000 7fe3862c8700 1 -- 172.21.15.60:0/1856314480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7fe38009f730 con 0x7fe3800b0b50 2020-10-31T22:48:29.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.309+0000 7fe36e7fc700 1 -- 172.21.15.60:0/1856314480 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe38009f730 con 0x7fe3800b0b50 2020-10-31T22:48:29.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.309+0000 7fe3862c8700 1 -- 172.21.15.60:0/1856314480 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe360054f90 msgr2=0x7fe360057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.309+0000 7fe3862c8700 1 --2- 172.21.15.60:0/1856314480 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe360054f90 0x7fe360057450 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fe37000d000 tx=0x7fe3700079f0).stop 2020-10-31T22:48:29.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.309+0000 7fe3862c8700 1 -- 172.21.15.60:0/1856314480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3800b0b50 msgr2=0x7fe38005b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.309+0000 7fe3862c8700 1 --2- 172.21.15.60:0/1856314480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3800b0b50 0x7fe38005b3d0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 rx=0x7fe378001bf0 tx=0x7fe37c015000).stop 2020-10-31T22:48:29.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.309+0000 7fe3862c8700 1 -- 172.21.15.60:0/1856314480 shutdown_connections 2020-10-31T22:48:29.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.309+0000 7fe3862c8700 1 --2- 172.21.15.60:0/1856314480 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe360054f90 0x7fe360057450 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.309+0000 7fe3862c8700 1 --2- 172.21.15.60:0/1856314480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3800b5380 0x7fe38009fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.309+0000 7fe3862c8700 1 --2- 172.21.15.60:0/1856314480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3800b0b50 0x7fe38005b3d0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.309+0000 7fe3862c8700 1 --2- 172.21.15.60:0/1856314480 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe3800b0fd0 0x7fe38009f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.309+0000 7fe3862c8700 1 -- 172.21.15.60:0/1856314480 >> 172.21.15.60:0/1856314480 conn(0x7fe38006a600 msgr2=0x7fe3800aa350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:29.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.309+0000 7fe3862c8700 1 -- 172.21.15.60:0/1856314480 shutdown_connections 2020-10-31T22:48:29.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.309+0000 7fe3862c8700 1 -- 172.21.15.60:0/1856314480 wait complete. 2020-10-31T22:48:29.329 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:48:29.330 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:29.347 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:29.364 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:29.381 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:29.399 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:48:29.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:29.400 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:29.400 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:29.446 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-10-31T22:48:29.447 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:48:29.448 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2020-10-31T22:48:29.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:29.449 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:29.449 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:29.461 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:48:29.463 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:48:29.464 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:48:29.464 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-10-31T22:48:29.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 Processor -- start 2020-10-31T22:48:29.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 -- start start 2020-10-31T22:48:29.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0be40ac870 0x7f0be4146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:29.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0be4146550 0x7f0be4150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:29.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be40af900 con 0x7f0be40af520 2020-10-31T22:48:29.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be40afc10 con 0x7f0be40ac870 2020-10-31T22:48:29.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be405bb70 con 0x7f0be4146550 2020-10-31T22:48:29.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be27fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0be40ac870 0x7f0be4146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:29.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be2ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0be40af520 0x7f0be4066c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50596/0 (socket says 172.21.15.60:50596) 2020-10-31T22:48:29.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be2ffd700 1 -- 172.21.15.60:0/3825704893 learned_addr learned my addr 172.21.15.60:0/3825704893 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:29.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be37fe700 1 --2- 172.21.15.60:0/3825704893 >> v2:172.21.15.66:3300/0 conn(0x7f0be4146550 0x7f0be4150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:29.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be27fc700 1 -- 172.21.15.60:0/3825704893 >> v2:172.21.15.66:3300/0 conn(0x7f0be4146550 msgr2=0x7f0be4150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:29.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be27fc700 1 --2- 172.21.15.60:0/3825704893 >> v2:172.21.15.66:3300/0 conn(0x7f0be4146550 0x7f0be4150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be1ffb700 1 -- 172.21.15.60:0/3825704893 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917951004 0 0) 0x7f0be40af900 con 0x7f0be40af520 2020-10-31T22:48:29.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be27fc700 1 -- 172.21.15.60:0/3825704893 >> v1:172.21.15.60:6789/0 conn(0x7f0be40af520 legacy=0x7f0be4066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be27fc700 1 -- 172.21.15.60:0/3825704893 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be40ac130 con 0x7f0be40ac870 2020-10-31T22:48:29.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be27fc700 1 --2- 172.21.15.60:0/3825704893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0be40ac870 0x7f0be4146060 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f0bd4002f30 tx=0x7f0bd4006dc0).ready entity=mon.0 client_cookie=651ba3dbded85fe7 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:29.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be1ffb700 1 -- 172.21.15.60:0/3825704893 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bd40097b0 con 0x7f0be40ac870 2020-10-31T22:48:29.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be1ffb700 1 -- 172.21.15.60:0/3825704893 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd4009910 con 0x7f0be40ac870 2020-10-31T22:48:29.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be1ffb700 1 -- 172.21.15.60:0/3825704893 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bd4009c70 con 0x7f0be40ac870 2020-10-31T22:48:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 -- 172.21.15.60:0/3825704893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0be40ac870 msgr2=0x7f0be4146060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 --2- 172.21.15.60:0/3825704893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0be40ac870 0x7f0be4146060 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 rx=0x7f0bd4002f30 tx=0x7f0bd4006dc0).stop 2020-10-31T22:48:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 -- 172.21.15.60:0/3825704893 shutdown_connections 2020-10-31T22:48:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 --2- 172.21.15.60:0/3825704893 >> v2:172.21.15.66:3300/0 conn(0x7f0be4146550 0x7f0be4150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 --2- 172.21.15.60:0/3825704893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0be40ac870 0x7f0be4146060 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 -- 172.21.15.60:0/3825704893 >> 172.21.15.60:0/3825704893 conn(0x7f0be40b3fd0 msgr2=0x7f0be40b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:29.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 -- 172.21.15.60:0/3825704893 shutdown_connections 2020-10-31T22:48:29.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.581+0000 7f0be3fff700 1 -- 172.21.15.60:0/3825704893 wait complete. 2020-10-31T22:48:29.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.585+0000 7f0be3fff700 1 Processor -- start 2020-10-31T22:48:29.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.585+0000 7f0be3fff700 1 -- start start 2020-10-31T22:48:29.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.585+0000 7f0be3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0be40ac870 0x7f0be40ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:29.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.585+0000 7f0be3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0be40af520 0x7f0be4158b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:29.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be3fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0be4146550 0x7f0be4159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:29.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be4147260 con 0x7f0be40af520 2020-10-31T22:48:29.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be3fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be4147500 con 0x7f0be4146550 2020-10-31T22:48:29.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be3fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be4158690 con 0x7f0be40ac870 2020-10-31T22:48:29.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0be40af520 0x7f0be4158b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:29.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0be40af520 0x7f0be4158b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46468/0 (socket says 172.21.15.60:46468) 2020-10-31T22:48:29.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be27fc700 1 -- 172.21.15.60:0/2167117805 learned_addr learned my addr 172.21.15.60:0/2167117805 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:29.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be37fe700 1 --2- 172.21.15.60:0/2167117805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0be4146550 0x7f0be4159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:29.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be2ffd700 1 --2- 172.21.15.60:0/2167117805 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0be40ac870 0x7f0be40ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:29.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be27fc700 1 -- 172.21.15.60:0/2167117805 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0be40ac870 msgr2=0x7f0be40ae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be27fc700 1 --2- 172.21.15.60:0/2167117805 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0be40ac870 0x7f0be40ae100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be27fc700 1 -- 172.21.15.60:0/2167117805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0be4146550 msgr2=0x7f0be4159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be27fc700 1 --2- 172.21.15.60:0/2167117805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0be4146550 0x7f0be4159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be27fc700 1 -- 172.21.15.60:0/2167117805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be40626c0 con 0x7f0be40af520 2020-10-31T22:48:29.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be27fc700 1 --2- 172.21.15.60:0/2167117805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0be40af520 0x7f0be4158b30 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f0bd4002f30 tx=0x7f0bd4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:29.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0bdbfff700 1 -- 172.21.15.60:0/2167117805 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bd4009e20 con 0x7f0be40af520 2020-10-31T22:48:29.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0bdbfff700 1 -- 172.21.15.60:0/2167117805 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd4011ce0 con 0x7f0be40af520 2020-10-31T22:48:29.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be3fff700 1 -- 172.21.15.60:0/2167117805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be4147ff0 con 0x7f0be40af520 2020-10-31T22:48:29.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0bdbfff700 1 -- 172.21.15.60:0/2167117805 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0bd401d630 con 0x7f0be40af520 2020-10-31T22:48:29.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be3fff700 1 -- 172.21.15.60:0/2167117805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be41551e0 con 0x7f0be40af520 2020-10-31T22:48:29.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0bdbfff700 1 -- 172.21.15.60:0/2167117805 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0bd4024030 con 0x7f0be40af520 2020-10-31T22:48:29.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0be3fff700 1 -- 172.21.15.60:0/2167117805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be4147e00 con 0x7f0be40af520 2020-10-31T22:48:29.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.589+0000 7f0bdbfff700 1 --2- 172.21.15.60:0/2167117805 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0bc8054f10 0x7f0bc80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:29.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.593+0000 7f0bdbfff700 1 -- 172.21.15.60:0/2167117805 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0bd406e870 con 0x7f0be40af520 2020-10-31T22:48:29.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.593+0000 7f0be2ffd700 1 --2- 172.21.15.60:0/2167117805 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0bc8054f10 0x7f0bc80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:29.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.593+0000 7f0be2ffd700 1 --2- 172.21.15.60:0/2167117805 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0bc8054f10 0x7f0bc80573d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f0bcc00b000 tx=0x7f0bcc009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:29.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.597+0000 7f0bdbfff700 1 -- 172.21.15.60:0/2167117805 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0be4147e00 con 0x7f0be40af520 2020-10-31T22:48:29.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.745+0000 7f0be3fff700 1 -- 172.21.15.60:0/2167117805 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f0be4062850 con 0x7f0be40af520 2020-10-31T22:48:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.749+0000 7f0bdbfff700 1 -- 172.21.15.60:0/2167117805 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v88) v1 ==== 81+0+33648 (secure 0 0 0) 0x7f0be4062850 con 0x7f0be40af520 2020-10-31T22:48:29.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.749+0000 7f0be3fff700 1 -- 172.21.15.60:0/2167117805 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0bc8054f10 msgr2=0x7f0bc80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.749+0000 7f0be3fff700 1 --2- 172.21.15.60:0/2167117805 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0bc8054f10 0x7f0bc80573d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7f0bcc00b000 tx=0x7f0bcc009040).stop 2020-10-31T22:48:29.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.749+0000 7f0be3fff700 1 -- 172.21.15.60:0/2167117805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0be40af520 msgr2=0x7f0be4158b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:29.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.749+0000 7f0be3fff700 1 --2- 172.21.15.60:0/2167117805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0be40af520 0x7f0be4158b30 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 rx=0x7f0bd4002f30 tx=0x7f0bd4015000).stop 2020-10-31T22:48:29.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.749+0000 7f0be3fff700 1 -- 172.21.15.60:0/2167117805 shutdown_connections 2020-10-31T22:48:29.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.749+0000 7f0be3fff700 1 --2- 172.21.15.60:0/2167117805 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0bc8054f10 0x7f0bc80573d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.749+0000 7f0be3fff700 1 --2- 172.21.15.60:0/2167117805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0be4146550 0x7f0be4159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.749+0000 7f0be3fff700 1 --2- 172.21.15.60:0/2167117805 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0be40ac870 0x7f0be40ae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.749+0000 7f0be3fff700 1 --2- 172.21.15.60:0/2167117805 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0be40af520 0x7f0be4158b30 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.749+0000 7f0be3fff700 1 -- 172.21.15.60:0/2167117805 >> 172.21.15.60:0/2167117805 conn(0x7f0be40b3fd0 msgr2=0x7f0be4145350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.749+0000 7f0be3fff700 1 -- 172.21.15.60:0/2167117805 shutdown_connections 2020-10-31T22:48:29.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:29.749+0000 7f0be3fff700 1 -- 172.21.15.60:0/2167117805 wait complete. 2020-10-31T22:48:29.759 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:29.759 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:48:29.760 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 88, 2020-10-31T22:48:29.760 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "226f905a-1517-4a8c-8009-08779515965c", 2020-10-31T22:48:29.760 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2020-10-31T22:40:51.928572+0000", 2020-10-31T22:48:29.760 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2020-10-31T22:48:16.438220+0000", 2020-10-31T22:48:29.760 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:48:29.760 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:48:29.760 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-10-31T22:48:29.761 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2020-10-31T22:48:29.761 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2020-10-31T22:48:29.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2020-10-31T22:48:29.761 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2020-10-31T22:48:29.761 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2020-10-31T22:48:29.761 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2020-10-31T22:48:29.761 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:48:29.762 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2020-10-31T22:48:29.762 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2020-10-31T22:48:29.762 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-10-31T22:48:29.763 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2020-10-31T22:48:29.763 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2020-10-31T22:48:29.763 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 16, 2020-10-31T22:48:29.764 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2020-10-31T22:48:29.764 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "jewel", 2020-10-31T22:48:29.764 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2020-10-31T22:48:29.764 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "octopus", 2020-10-31T22:48:29.764 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:48:29.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.768 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2020-10-31T22:48:29.769 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "device_health_metrics", 2020-10-31T22:48:29.769 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:40:55.846143+0000", 2020-10-31T22:48:29.769 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:48:29.769 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:48:29.769 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:48:29.769 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:48:29.770 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:48:29.770 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:48:29.770 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:48:29.770 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:48:29.770 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2020-10-31T22:48:29.770 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2020-10-31T22:48:29.771 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2020-10-31T22:48:29.771 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2020-10-31T22:48:29.771 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2020-10-31T22:48:29.771 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:48:29.771 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:48:29.771 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:48:29.771 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:48:29.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:48:29.772 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:48:29.772 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:48:29.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "15", 2020-10-31T22:48:29.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:48:29.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:48:29.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:48:29.773 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:48:29.773 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:48:29.773 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:48:29.773 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:48:29.773 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:48:29.773 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:48:29.773 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:48:29.774 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:48:29.774 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:48:29.774 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:48:29.774 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:48:29.774 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:48:29.774 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:48:29.774 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:48:29.775 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:48:29.775 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:48:29.775 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:48:29.775 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:48:29.775 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:48:29.775 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:48:29.775 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:48:29.776 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:48:29.776 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:48:29.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.776 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:48:29.776 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:48:29.776 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:48:29.776 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:48:29.776 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:48:29.777 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:48:29.777 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:48:29.777 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:48:29.779 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:48:29.779 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:48:29.779 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:48:29.780 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:48:29.780 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2020-10-31T22:48:29.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.780 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:48:29.781 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_devicehealth": {} 2020-10-31T22:48:29.781 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.781 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2020-10-31T22:48:29.782 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2020-10-31T22:48:29.782 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:05.358501+0000", 2020-10-31T22:48:29.782 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:48:29.782 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:48:29.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:48:29.783 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:48:29.783 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:48:29.783 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:48:29.783 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:48:29.784 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:48:29.784 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:48:29.784 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:48:29.784 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:48:29.784 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:48:29.785 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:48:29.785 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:48:29.785 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:48:29.785 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:48:29.785 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:48:29.786 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:48:29.786 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:48:29.786 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:48:29.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.786 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "18", 2020-10-31T22:48:29.787 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:48:29.787 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:48:29.787 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:48:29.787 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:48:29.787 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:48:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:48:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:48:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:48:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:48:29.788 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:48:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:48:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:48:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:48:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:48:29.789 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:48:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:48:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:48:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:48:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:48:29.790 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:48:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:48:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:48:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:48:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:48:29.791 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:48:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:48:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:48:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:48:29.792 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:48:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:48:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:48:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:48:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:48:29.793 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:48:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:48:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:48:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:48:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:48:29.794 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:48:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2020-10-31T22:48:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.795 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 15, 2020-10-31T22:48:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2020-10-31T22:48:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:48:12.972001+0000", 2020-10-31T22:48:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:48:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:48:29.796 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:48:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:48:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:48:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:48:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:48:29.797 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:48:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:48:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:48:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:48:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:48:29.798 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:48:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:48:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:48:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:48:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:48:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:48:29.799 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:48:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:48:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "87", 2020-10-31T22:48:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:48:29.800 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:48:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:48:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:48:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:48:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:48:29.801 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:48:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:48:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:48:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:48:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:48:29.802 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:48:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:48:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:48:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:48:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:48:29.803 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:48:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:48:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:48:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:48:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:48:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:48:29.804 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:48:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:48:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:48:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:48:29.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:48:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:48:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:48:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:48:29.806 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:48:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:48:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:48:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:48:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:48:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:48:29.807 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:48:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:48:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2020-10-31T22:48:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2020-10-31T22:48:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2020-10-31T22:48:29.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:48:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:48:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2020-10-31T22:48:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 16, 2020-10-31T22:48:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2020-10-31T22:48:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:48:14.284102+0000", 2020-10-31T22:48:29.810 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:48:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:48:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:48:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:48:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:48:29.811 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:48:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:48:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:48:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:48:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:48:29.812 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:48:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:48:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:48:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:48:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:48:29.813 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:48:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:48:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:48:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:48:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:48:29.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "88", 2020-10-31T22:48:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:48:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:48:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:48:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:48:29.815 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:48:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:48:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:48:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:48:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:48:29.816 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:48:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:48:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:48:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:48:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:48:29.817 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:48:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:48:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:48:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:48:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:48:29.818 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:48:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:48:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:48:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:48:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:48:29.819 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:48:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:48:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:48:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:48:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:48:29.820 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:48:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:48:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:48:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:48:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:48:29.821 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:48:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:48:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:48:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:48:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:48:29.822 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:48:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2020-10-31T22:48:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.823 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:48:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2020-10-31T22:48:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:48:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", 2020-10-31T22:48:29.824 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:29.825 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 86, 2020-10-31T22:48:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:29.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2020-10-31T22:48:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:29.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2020-10-31T22:48:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.828 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2020-10-31T22:48:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2020-10-31T22:48:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2020-10-31T22:48:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2020-10-31T22:48:29.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:29.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2020-10-31T22:48:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2020-10-31T22:48:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6803/14302", 2020-10-31T22:48:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6805/14302", 2020-10-31T22:48:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6809/14302", 2020-10-31T22:48:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6807/14302", 2020-10-31T22:48:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:29.837 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:48:29.838 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", 2020-10-31T22:48:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:29.839 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 85, 2020-10-31T22:48:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:29.840 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2020-10-31T22:48:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2020-10-31T22:48:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:29.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2020-10-31T22:48:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2020-10-31T22:48:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2020-10-31T22:48:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:29.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2020-10-31T22:48:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.847 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2020-10-31T22:48:29.848 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2020-10-31T22:48:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:29.849 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/14300", 2020-10-31T22:48:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6813/14300", 2020-10-31T22:48:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6817/14300", 2020-10-31T22:48:29.850 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6815/14300", 2020-10-31T22:48:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:48:29.851 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", 2020-10-31T22:48:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:29.852 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 86, 2020-10-31T22:48:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2020-10-31T22:48:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2020-10-31T22:48:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2020-10-31T22:48:29.856 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:29.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2020-10-31T22:48:29.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6832", 2020-10-31T22:48:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6833", 2020-10-31T22:48:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.860 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2020-10-31T22:48:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2020-10-31T22:48:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.862 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6827/14318", 2020-10-31T22:48:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6829/14318", 2020-10-31T22:48:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6833/14318", 2020-10-31T22:48:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6831/14318", 2020-10-31T22:48:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:48:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", 2020-10-31T22:48:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:29.864 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 86, 2020-10-31T22:48:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:29.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2020-10-31T22:48:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2020-10-31T22:48:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.867 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2020-10-31T22:48:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2020-10-31T22:48:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.869 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2020-10-31T22:48:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2020-10-31T22:48:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:29.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2020-10-31T22:48:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2020-10-31T22:48:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6819/14301", 2020-10-31T22:48:29.873 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6821/14301", 2020-10-31T22:48:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/14301", 2020-10-31T22:48:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6823/14301", 2020-10-31T22:48:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:48:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", 2020-10-31T22:48:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:29.875 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 86, 2020-10-31T22:48:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:29.876 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6816", 2020-10-31T22:48:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6817", 2020-10-31T22:48:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.878 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6818", 2020-10-31T22:48:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6819", 2020-10-31T22:48:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.880 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6822", 2020-10-31T22:48:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6823", 2020-10-31T22:48:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.882 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6820", 2020-10-31T22:48:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6821", 2020-10-31T22:48:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6817/14002", 2020-10-31T22:48:29.884 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6819/14002", 2020-10-31T22:48:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6823/14002", 2020-10-31T22:48:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6821/14002", 2020-10-31T22:48:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:48:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", 2020-10-31T22:48:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:29.886 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 86, 2020-10-31T22:48:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:29.887 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6800", 2020-10-31T22:48:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6801", 2020-10-31T22:48:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:29.889 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6802", 2020-10-31T22:48:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6803", 2020-10-31T22:48:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:29.891 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6806", 2020-10-31T22:48:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.893 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.893 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6807", 2020-10-31T22:48:29.893 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:29.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.893 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.893 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6804", 2020-10-31T22:48:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:29.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6805", 2020-10-31T22:48:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.895 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6801/14001", 2020-10-31T22:48:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6803/14001", 2020-10-31T22:48:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6807/14001", 2020-10-31T22:48:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6805/14001", 2020-10-31T22:48:29.896 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:48:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", 2020-10-31T22:48:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:29.898 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 86, 2020-10-31T22:48:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:29.899 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6808", 2020-10-31T22:48:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6809", 2020-10-31T22:48:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:29.901 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.902 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6810", 2020-10-31T22:48:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6811", 2020-10-31T22:48:29.903 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.904 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6814", 2020-10-31T22:48:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6815", 2020-10-31T22:48:29.905 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6812", 2020-10-31T22:48:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6813", 2020-10-31T22:48:29.907 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6809/14003", 2020-10-31T22:48:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6811/14003", 2020-10-31T22:48:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6815/14003", 2020-10-31T22:48:29.908 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6813/14003", 2020-10-31T22:48:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:48:29.909 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", 2020-10-31T22:48:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:29.910 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 73, 2020-10-31T22:48:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.911 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6824", 2020-10-31T22:48:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6825", 2020-10-31T22:48:29.912 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.913 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6826", 2020-10-31T22:48:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6827", 2020-10-31T22:48:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:29.914 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.915 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6830", 2020-10-31T22:48:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6831", 2020-10-31T22:48:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:29.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6828", 2020-10-31T22:48:29.917 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6829", 2020-10-31T22:48:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.918 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6825/14046", 2020-10-31T22:48:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6827/14046", 2020-10-31T22:48:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6831/14046", 2020-10-31T22:48:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6829/14046", 2020-10-31T22:48:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:29.919 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:48:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2020-10-31T22:48:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:48:29.920 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.314917+0000", 2020-10-31T22:48:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:29.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:48:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:29.922 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.643069+0000", 2020-10-31T22:48:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:48:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:29.923 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.662572+0000", 2020-10-31T22:48:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.924 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:48:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.664868+0000", 2020-10-31T22:48:29.925 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:48:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:29.926 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551107+0000", 2020-10-31T22:48:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:48:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:29.927 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.400568+0000", 2020-10-31T22:48:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:48:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551173+0000", 2020-10-31T22:48:29.929 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:48:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:29.930 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.604302+0000", 2020-10-31T22:48:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:48:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2020-10-31T22:48:29.931 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2020-10-31T22:48:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2020-10-31T22:48:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2020-10-31T22:48:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "blacklist": {}, 2020-10-31T22:48:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2020-10-31T22:48:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2020-10-31T22:48:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2020-10-31T22:48:29.932 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2020-10-31T22:48:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2020-10-31T22:48:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2020-10-31T22:48:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: "ruleset-failure-domain": "osd", 2020-10-31T22:48:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2020-10-31T22:48:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:29.933 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2020-10-31T22:48:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2020-10-31T22:48:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2020-10-31T22:48:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2020-10-31T22:48:29.934 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {} 2020-10-31T22:48:29.934 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:48:29.936 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:30.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d7ac58700 1 Processor -- start 2020-10-31T22:48:30.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d7ac58700 1 -- start start 2020-10-31T22:48:30.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d7ac58700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d74063140 0x7f1d740b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:30.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d7ac58700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1d740b1000 0x7f1d741452b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:30.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d7ac58700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1d740b2820 0x7f1d740aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:30.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d7ac58700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d740b2060 con 0x7f1d740b1000 2020-10-31T22:48:30.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d7ac58700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d74063520 con 0x7f1d740b2820 2020-10-31T22:48:30.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d7ac58700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d740b02e0 con 0x7f1d74063140 2020-10-31T22:48:30.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d79455700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1d740b1000 0x7f1d741452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:30.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d79455700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1d740b1000 0x7f1d741452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46474/0 (socket says 172.21.15.60:46474) 2020-10-31T22:48:30.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d79455700 1 -- 172.21.15.60:0/4010174318 learned_addr learned my addr 172.21.15.60:0/4010174318 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d79c56700 1 --2- 172.21.15.60:0/4010174318 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d74063140 0x7f1d740b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d7a457700 1 --2- 172.21.15.60:0/4010174318 >> v2:172.21.15.66:3300/0 conn(0x7f1d740b2820 0x7f1d740aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:30.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d79455700 1 -- 172.21.15.60:0/4010174318 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d74063140 msgr2=0x7f1d740b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d79455700 1 --2- 172.21.15.60:0/4010174318 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d74063140 0x7f1d740b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d79455700 1 -- 172.21.15.60:0/4010174318 >> v2:172.21.15.66:3300/0 conn(0x7f1d740b2820 msgr2=0x7f1d740aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d79455700 1 --2- 172.21.15.60:0/4010174318 >> v2:172.21.15.66:3300/0 conn(0x7f1d740b2820 0x7f1d740aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d79455700 1 -- 172.21.15.60:0/4010174318 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d740b1dc0 con 0x7f1d740b1000 2020-10-31T22:48:30.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.053+0000 7f1d79455700 1 --2- 172.21.15.60:0/4010174318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d740b1000 0x7f1d741452b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f1d70002f30 tx=0x7f1d70006e80).ready entity=mon.0 client_cookie=786a300e254b1374 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:30.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d78c54700 1 -- 172.21.15.60:0/4010174318 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d70009640 con 0x7f1d740b1000 2020-10-31T22:48:30.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d78c54700 1 -- 172.21.15.60:0/4010174318 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d700097a0 con 0x7f1d740b1000 2020-10-31T22:48:30.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d78c54700 1 -- 172.21.15.60:0/4010174318 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d70009b00 con 0x7f1d740b1000 2020-10-31T22:48:30.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 -- 172.21.15.60:0/4010174318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d740b1000 msgr2=0x7f1d741452b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:30.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 --2- 172.21.15.60:0/4010174318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d740b1000 0x7f1d741452b0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 rx=0x7f1d70002f30 tx=0x7f1d70006e80).stop 2020-10-31T22:48:30.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 -- 172.21.15.60:0/4010174318 shutdown_connections 2020-10-31T22:48:30.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 --2- 172.21.15.60:0/4010174318 >> v2:172.21.15.66:3300/0 conn(0x7f1d740b2820 0x7f1d740aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 --2- 172.21.15.60:0/4010174318 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d74063140 0x7f1d740b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 --2- 172.21.15.60:0/4010174318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d740b1000 0x7f1d741452b0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 -- 172.21.15.60:0/4010174318 >> 172.21.15.60:0/4010174318 conn(0x7f1d7406a600 msgr2=0x7f1d74060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 -- 172.21.15.60:0/4010174318 shutdown_connections 2020-10-31T22:48:30.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 -- 172.21.15.60:0/4010174318 wait complete. 2020-10-31T22:48:30.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 Processor -- start 2020-10-31T22:48:30.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 -- start start 2020-10-31T22:48:30.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d74063140 0x7f1d74065ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:30.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d740b1000 0x7f1d74150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:30.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d740b2820 0x7f1d74150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d74151490 con 0x7f1d74063140 2020-10-31T22:48:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d74066b80 con 0x7f1d740b1000 2020-10-31T22:48:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d74066e20 con 0x7f1d740b2820 2020-10-31T22:48:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d79c56700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d74063140 0x7f1d74065ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d79c56700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d74063140 0x7f1d74065ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46480/0 (socket says 172.21.15.60:46480) 2020-10-31T22:48:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d79c56700 1 -- 172.21.15.60:0/690202068 learned_addr learned my addr 172.21.15.60:0/690202068 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:30.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d79455700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d740b1000 0x7f1d74150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:30.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7a457700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d740b2820 0x7f1d74150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d79c56700 1 -- 172.21.15.60:0/690202068 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d740b2820 msgr2=0x7f1d74150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d79c56700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d740b2820 0x7f1d74150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d79c56700 1 -- 172.21.15.60:0/690202068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d740b1000 msgr2=0x7f1d74150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d79c56700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d740b1000 0x7f1d74150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d79c56700 1 -- 172.21.15.60:0/690202068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d740670c0 con 0x7f1d74063140 2020-10-31T22:48:30.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d79455700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d740b1000 0x7f1d74150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d79c56700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d74063140 0x7f1d74065ca0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f1d6800c000 tx=0x7f1d68006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d66ffd700 1 -- 172.21.15.60:0/690202068 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d6800ca80 con 0x7f1d74063140 2020-10-31T22:48:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d66ffd700 1 -- 172.21.15.60:0/690202068 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6800cbe0 con 0x7f1d74063140 2020-10-31T22:48:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 -- 172.21.15.60:0/690202068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d740a48a0 con 0x7f1d74063140 2020-10-31T22:48:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d66ffd700 1 -- 172.21.15.60:0/690202068 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d680123f0 con 0x7f1d74063140 2020-10-31T22:48:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.057+0000 7f1d7ac58700 1 -- 172.21.15.60:0/690202068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d740a25e0 con 0x7f1d74063140 2020-10-31T22:48:30.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.061+0000 7f1d7ac58700 1 -- 172.21.15.60:0/690202068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d74067250 con 0x7f1d74063140 2020-10-31T22:48:30.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.061+0000 7f1d66ffd700 1 -- 172.21.15.60:0/690202068 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1d68012550 con 0x7f1d74063140 2020-10-31T22:48:30.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.061+0000 7f1d66ffd700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1d54054f10 0x7f1d540573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:30.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.061+0000 7f1d66ffd700 1 -- 172.21.15.60:0/690202068 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1d6806de30 con 0x7f1d74063140 2020-10-31T22:48:30.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.061+0000 7f1d79455700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1d54054f10 0x7f1d540573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:30.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.065+0000 7f1d79455700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1d54054f10 0x7f1d540573d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f1d70016000 tx=0x7f1d70015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:30.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.069+0000 7f1d66ffd700 1 -- 172.21.15.60:0/690202068 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1d680442f0 con 0x7f1d74063140 2020-10-31T22:48:30.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.257+0000 7f1d7ac58700 1 -- 172.21.15.60:0/690202068 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d74057100 con 0x7f1d74063140 2020-10-31T22:48:30.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.257+0000 7f1d66ffd700 1 -- 172.21.15.60:0/690202068 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f1d68047910 con 0x7f1d74063140 2020-10-31T22:48:30.265 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:30.265 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":41,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3668788118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3668788118},{"type":"v1","addr":"172.21.15.60:6835","nonce":3668788118}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6516,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/3884009815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3884009815},{"type":"v1","addr":"172.21.15.60:6837","nonce":3884009815}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:48:15.434973+0000","modified":"2020-10-31T22:48:16.437431+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6519},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6519":{"gid":6519,"name":"b","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/2702869569","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2702869569},{"type":"v1","addr":"172.21.15.66:6833","nonce":2702869569}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-10-31T22:48:30.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.261+0000 7f1d7ac58700 1 -- 172.21.15.60:0/690202068 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1d54054f10 msgr2=0x7f1d540573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:30.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.261+0000 7f1d7ac58700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1d54054f10 0x7f1d540573d0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7f1d70016000 tx=0x7f1d70015000).stop 2020-10-31T22:48:30.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.261+0000 7f1d7ac58700 1 -- 172.21.15.60:0/690202068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d74063140 msgr2=0x7f1d74065ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:30.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.261+0000 7f1d7ac58700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d74063140 0x7f1d74065ca0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 rx=0x7f1d6800c000 tx=0x7f1d68006dc0).stop 2020-10-31T22:48:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.261+0000 7f1d7ac58700 1 -- 172.21.15.60:0/690202068 shutdown_connections 2020-10-31T22:48:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.261+0000 7f1d7ac58700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d740b2820 0x7f1d74150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.261+0000 7f1d7ac58700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d74063140 0x7f1d74065ca0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.261+0000 7f1d7ac58700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1d54054f10 0x7f1d540573d0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.261+0000 7f1d7ac58700 1 --2- 172.21.15.60:0/690202068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d740b1000 0x7f1d74150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.261+0000 7f1d7ac58700 1 -- 172.21.15.60:0/690202068 >> 172.21.15.60:0/690202068 conn(0x7f1d7406a600 msgr2=0x7f1d740a9170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:30.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.261+0000 7f1d7ac58700 1 -- 172.21.15.60:0/690202068 shutdown_connections 2020-10-31T22:48:30.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.261+0000 7f1d7ac58700 1 -- 172.21.15.60:0/690202068 wait complete. 2020-10-31T22:48:30.270 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 41 2020-10-31T22:48:30.279 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-10-31T22:48:30.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08ea15700 1 Processor -- start 2020-10-31T22:48:30.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08ea15700 1 -- start start 2020-10-31T22:48:30.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08ea15700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb0880b1a10 0x7fb088142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:30.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08ea15700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb08813ebe0 0x7fb0880b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:30.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08ea15700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0880abea0 con 0x7fb0880af200 2020-10-31T22:48:30.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08ea15700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb088141870 con 0x7fb08813ebe0 2020-10-31T22:48:30.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08ea15700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb088141b10 con 0x7fb0880b1a10 2020-10-31T22:48:30.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08d212700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb08813ebe0 0x7fb0880b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:30.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08e214700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb0880af200 0x7fb0880afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50628/0 (socket says 172.21.15.60:50628) 2020-10-31T22:48:30.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08e214700 1 -- 172.21.15.60:0/4570626 learned_addr learned my addr 172.21.15.60:0/4570626 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:30.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08da13700 1 --2- 172.21.15.60:0/4570626 >> v2:172.21.15.66:3300/0 conn(0x7fb0880b1a10 0x7fb088142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:30.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08ca11700 1 -- 172.21.15.60:0/4570626 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3621604806 0 0) 0x7fb0880abea0 con 0x7fb0880af200 2020-10-31T22:48:30.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08ca11700 1 -- 172.21.15.60:0/4570626 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb070003230 con 0x7fb0880af200 2020-10-31T22:48:30.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08d212700 1 -- 172.21.15.60:0/4570626 >> v2:172.21.15.66:3300/0 conn(0x7fb0880b1a10 msgr2=0x7fb088142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:30.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08d212700 1 --2- 172.21.15.60:0/4570626 >> v2:172.21.15.66:3300/0 conn(0x7fb0880b1a10 0x7fb088142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08d212700 1 -- 172.21.15.60:0/4570626 >> v1:172.21.15.60:6789/0 conn(0x7fb0880af200 legacy=0x7fb0880afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:30.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08d212700 1 -- 172.21.15.60:0/4570626 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb088141db0 con 0x7fb08813ebe0 2020-10-31T22:48:30.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08d212700 1 --2- 172.21.15.60:0/4570626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb08813ebe0 0x7fb0880b1df0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fb078002f30 tx=0x7fb078006dc0).ready entity=mon.0 client_cookie=d73c39e2090b51f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:30.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08ca11700 1 -- 172.21.15.60:0/4570626 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb07800fab0 con 0x7fb08813ebe0 2020-10-31T22:48:30.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08ca11700 1 -- 172.21.15.60:0/4570626 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07800fc10 con 0x7fb08813ebe0 2020-10-31T22:48:30.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08ca11700 1 -- 172.21.15.60:0/4570626 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb078016360 con 0x7fb08813ebe0 2020-10-31T22:48:30.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08ea15700 1 -- 172.21.15.60:0/4570626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb08813ebe0 msgr2=0x7fb0880b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:30.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.389+0000 7fb08ea15700 1 --2- 172.21.15.60:0/4570626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb08813ebe0 0x7fb0880b1df0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 rx=0x7fb078002f30 tx=0x7fb078006dc0).stop 2020-10-31T22:48:30.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.393+0000 7fb08ea15700 1 -- 172.21.15.60:0/4570626 shutdown_connections 2020-10-31T22:48:30.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.393+0000 7fb08ea15700 1 --2- 172.21.15.60:0/4570626 >> v2:172.21.15.66:3300/0 conn(0x7fb0880b1a10 0x7fb088142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.393+0000 7fb08ea15700 1 --2- 172.21.15.60:0/4570626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb08813ebe0 0x7fb0880b1df0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.393+0000 7fb08ea15700 1 -- 172.21.15.60:0/4570626 >> 172.21.15.60:0/4570626 conn(0x7fb0880b5300 msgr2=0x7fb0880b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:30.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.393+0000 7fb08ea15700 1 -- 172.21.15.60:0/4570626 shutdown_connections 2020-10-31T22:48:30.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.393+0000 7fb08ea15700 1 -- 172.21.15.60:0/4570626 wait complete. 2020-10-31T22:48:30.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.393+0000 7fb08ea15700 1 Processor -- start 2020-10-31T22:48:30.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.393+0000 7fb08ea15700 1 -- start start 2020-10-31T22:48:30.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.393+0000 7fb08ea15700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0880af200 0x7fb08805baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:30.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08ea15700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0880b1a10 0x7fb088064bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:30.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08ea15700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb08813ebe0 0x7fb0880650a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:30.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08ea15700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880aab80 con 0x7fb0880b1a10 2020-10-31T22:48:30.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08ea15700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880aae20 con 0x7fb08813ebe0 2020-10-31T22:48:30.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08ea15700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880a9af0 con 0x7fb0880af200 2020-10-31T22:48:30.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08d212700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0880b1a10 0x7fb088064bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:30.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08d212700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0880b1a10 0x7fb088064bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46498/0 (socket says 172.21.15.60:46498) 2020-10-31T22:48:30.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08e214700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb08813ebe0 0x7fb0880650a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:30.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08d212700 1 -- 172.21.15.60:0/2852981238 learned_addr learned my addr 172.21.15.60:0/2852981238 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:30.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08da13700 1 --2- 172.21.15.60:0/2852981238 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0880af200 0x7fb08805baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:30.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08d212700 1 -- 172.21.15.60:0/2852981238 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0880af200 msgr2=0x7fb08805baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:30.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08d212700 1 --2- 172.21.15.60:0/2852981238 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0880af200 0x7fb08805baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08d212700 1 -- 172.21.15.60:0/2852981238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb08813ebe0 msgr2=0x7fb0880650a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:30.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08d212700 1 --2- 172.21.15.60:0/2852981238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb08813ebe0 0x7fb0880650a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:30.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08d212700 1 -- 172.21.15.60:0/2852981238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0880aa4b0 con 0x7fb0880b1a10 2020-10-31T22:48:30.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08d212700 1 --2- 172.21.15.60:0/2852981238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0880b1a10 0x7fb088064bb0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fb078002f30 tx=0x7fb078017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:30.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb076ffd700 1 -- 172.21.15.60:0/2852981238 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb07801d070 con 0x7fb0880b1a10 2020-10-31T22:48:30.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08ea15700 1 -- 172.21.15.60:0/2852981238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0880abd20 con 0x7fb0880b1a10 2020-10-31T22:48:30.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb076ffd700 1 -- 172.21.15.60:0/2852981238 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07800f540 con 0x7fb0880b1a10 2020-10-31T22:48:30.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb076ffd700 1 -- 172.21.15.60:0/2852981238 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0780175f0 con 0x7fb0880b1a10 2020-10-31T22:48:30.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08ea15700 1 -- 172.21.15.60:0/2852981238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0880ab8e0 con 0x7fb0880b1a10 2020-10-31T22:48:30.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08ea15700 1 -- 172.21.15.60:0/2852981238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb088057100 con 0x7fb0880b1a10 2020-10-31T22:48:30.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb076ffd700 1 -- 172.21.15.60:0/2852981238 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb078017750 con 0x7fb0880b1a10 2020-10-31T22:48:30.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb076ffd700 1 --2- 172.21.15.60:0/2852981238 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb068054f10 0x7fb0680573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:30.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb076ffd700 1 -- 172.21.15.60:0/2852981238 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb07806e250 con 0x7fb0880b1a10 2020-10-31T22:48:30.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08da13700 1 --2- 172.21.15.60:0/2852981238 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb068054f10 0x7fb0680573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:30.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.397+0000 7fb08da13700 1 --2- 172.21.15.60:0/2852981238 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb068054f10 0x7fb0680573d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fb08400b000 tx=0x7fb0840091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:30.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.405+0000 7fb076ffd700 1 -- 172.21.15.60:0/2852981238 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb0780446d0 con 0x7fb0880b1a10 2020-10-31T22:48:30.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:30.593+0000 7fb08ea15700 1 -- 172.21.15.60:0/2852981238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb0880aaf90 con 0x7fb0880b1a10 2020-10-31T22:48:31.311 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:48:31.305+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:48:31.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.313+0000 7fb076ffd700 1 -- 172.21.15.60:0/2852981238 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb078047cf0 con 0x7fb0880b1a10 2020-10-31T22:48:31.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.317+0000 7fb08ea15700 1 -- 172.21.15.60:0/2852981238 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb068054f10 msgr2=0x7fb0680573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:31.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.317+0000 7fb08ea15700 1 --2- 172.21.15.60:0/2852981238 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb068054f10 0x7fb0680573d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fb08400b000 tx=0x7fb0840091a0).stop 2020-10-31T22:48:31.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.317+0000 7fb08ea15700 1 -- 172.21.15.60:0/2852981238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0880b1a10 msgr2=0x7fb088064bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:31.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.317+0000 7fb08ea15700 1 --2- 172.21.15.60:0/2852981238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0880b1a10 0x7fb088064bb0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 rx=0x7fb078002f30 tx=0x7fb078017000).stop 2020-10-31T22:48:31.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.317+0000 7fb08ea15700 1 -- 172.21.15.60:0/2852981238 shutdown_connections 2020-10-31T22:48:31.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.317+0000 7fb08ea15700 1 --2- 172.21.15.60:0/2852981238 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb068054f10 0x7fb0680573d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.317+0000 7fb08ea15700 1 --2- 172.21.15.60:0/2852981238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb08813ebe0 0x7fb0880650a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.317+0000 7fb08ea15700 1 --2- 172.21.15.60:0/2852981238 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0880af200 0x7fb08805baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.317+0000 7fb08ea15700 1 --2- 172.21.15.60:0/2852981238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0880b1a10 0x7fb088064bb0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.317+0000 7fb08ea15700 1 -- 172.21.15.60:0/2852981238 >> 172.21.15.60:0/2852981238 conn(0x7fb0880b5300 msgr2=0x7fb0880b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.317+0000 7fb08ea15700 1 -- 172.21.15.60:0/2852981238 shutdown_connections 2020-10-31T22:48:31.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.317+0000 7fb08ea15700 1 -- 172.21.15.60:0/2852981238 wait complete. 2020-10-31T22:48:31.325 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-10-31T22:48:31.340 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:31.345 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:48:31.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.449+0000 7f044cc56700 1 Processor -- start 2020-10-31T22:48:31.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.449+0000 7f044cc56700 1 -- start start 2020-10-31T22:48:31.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f04480b1bb0 0x7f044805c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:31.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04480ae630 0x7f044813ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:31.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f044813f1b0 0x7f04480b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:31.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044805c5e0 con 0x7f04480b1bb0 2020-10-31T22:48:31.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044813f630 con 0x7f044813f1b0 2020-10-31T22:48:31.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044805c800 con 0x7f04480ae630 2020-10-31T22:48:31.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f04477fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f04480b1bb0 0x7f044805c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:31.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f04477fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f04480b1bb0 0x7f044805c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46502/0 (socket says 172.21.15.60:46502) 2020-10-31T22:48:31.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f04477fe700 1 -- 172.21.15.60:0/2995234396 learned_addr learned my addr 172.21.15.60:0/2995234396 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:31.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f0447fff700 1 --2- 172.21.15.60:0/2995234396 >> v2:172.21.15.66:3300/0 conn(0x7f044813f1b0 0x7f04480b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:31.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f0446ffd700 1 --2- 172.21.15.60:0/2995234396 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04480ae630 0x7f044813ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:31.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f04477fe700 1 -- 172.21.15.60:0/2995234396 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04480ae630 msgr2=0x7f044813ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:31.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f04477fe700 1 --2- 172.21.15.60:0/2995234396 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04480ae630 0x7f044813ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f04477fe700 1 -- 172.21.15.60:0/2995234396 >> v2:172.21.15.66:3300/0 conn(0x7f044813f1b0 msgr2=0x7f04480b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:31.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f04477fe700 1 --2- 172.21.15.60:0/2995234396 >> v2:172.21.15.66:3300/0 conn(0x7f044813f1b0 0x7f04480b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f04477fe700 1 -- 172.21.15.60:0/2995234396 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04480adc50 con 0x7f04480b1bb0 2020-10-31T22:48:31.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f04477fe700 1 --2- 172.21.15.60:0/2995234396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04480b1bb0 0x7f044805c0f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f044805c720 tx=0x7f0440009270).ready entity=mon.0 client_cookie=f760714e5bdfbc13 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:31.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f04467fc700 1 -- 172.21.15.60:0/2995234396 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f044000bbc0 con 0x7f04480b1bb0 2020-10-31T22:48:31.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f04467fc700 1 -- 172.21.15.60:0/2995234396 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044000bd20 con 0x7f04480b1bb0 2020-10-31T22:48:31.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f04467fc700 1 -- 172.21.15.60:0/2995234396 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f044000be90 con 0x7f04480b1bb0 2020-10-31T22:48:31.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 -- 172.21.15.60:0/2995234396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04480b1bb0 msgr2=0x7f044805c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:31.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 --2- 172.21.15.60:0/2995234396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04480b1bb0 0x7f044805c0f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 rx=0x7f044805c720 tx=0x7f0440009270).stop 2020-10-31T22:48:31.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 -- 172.21.15.60:0/2995234396 shutdown_connections 2020-10-31T22:48:31.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 --2- 172.21.15.60:0/2995234396 >> v2:172.21.15.66:3300/0 conn(0x7f044813f1b0 0x7f04480b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 --2- 172.21.15.60:0/2995234396 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f04480b1bb0 0x7f044805c0f0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 --2- 172.21.15.60:0/2995234396 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f04480ae630 0x7f044813ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 -- 172.21.15.60:0/2995234396 >> 172.21.15.60:0/2995234396 conn(0x7f04480b5300 msgr2=0x7f04480b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:31.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 -- 172.21.15.60:0/2995234396 shutdown_connections 2020-10-31T22:48:31.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.453+0000 7f044cc56700 1 -- 172.21.15.60:0/2995234396 wait complete. 2020-10-31T22:48:31.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f044cc56700 1 Processor -- start 2020-10-31T22:48:31.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f044cc56700 1 -- start start 2020-10-31T22:48:31.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f044cc56700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04480b1bb0 0x7f04481412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:31.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f044cc56700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f044813f1b0 0x7f04480b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:31.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f044cc56700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f044813ece0 0x7f04480642d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:31.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f044cc56700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04481403f0 con 0x7f044813ece0 2020-10-31T22:48:31.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f044cc56700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448066ed0 con 0x7f04480b1bb0 2020-10-31T22:48:31.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f044cc56700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0448066c70 con 0x7f044813f1b0 2020-10-31T22:48:31.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f0447fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f044813ece0 0x7f04480642d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:31.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f04477fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04480b1bb0 0x7f04481412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:31.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f0447fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f044813ece0 0x7f04480642d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46512/0 (socket says 172.21.15.60:46512) 2020-10-31T22:48:31.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f0447fff700 1 -- 172.21.15.60:0/3232276238 learned_addr learned my addr 172.21.15.60:0/3232276238 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:31.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f0446ffd700 1 --2- 172.21.15.60:0/3232276238 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f044813f1b0 0x7f04480b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:31.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f0447fff700 1 -- 172.21.15.60:0/3232276238 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f044813f1b0 msgr2=0x7f04480b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:31.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f0447fff700 1 --2- 172.21.15.60:0/3232276238 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f044813f1b0 0x7f04480b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f0447fff700 1 -- 172.21.15.60:0/3232276238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04480b1bb0 msgr2=0x7f04481412a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:31.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f0447fff700 1 --2- 172.21.15.60:0/3232276238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04480b1bb0 0x7f04481412a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f0447fff700 1 -- 172.21.15.60:0/3232276238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0448140150 con 0x7f044813ece0 2020-10-31T22:48:31.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f04477fe700 1 --2- 172.21.15.60:0/3232276238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04480b1bb0 0x7f04481412a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:31.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f0447fff700 1 --2- 172.21.15.60:0/3232276238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f044813ece0 0x7f04480642d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f043000a000 tx=0x7f0430008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:31.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f0444ff9700 1 -- 172.21.15.60:0/3232276238 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0430011850 con 0x7f044813ece0 2020-10-31T22:48:31.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f0444ff9700 1 -- 172.21.15.60:0/3232276238 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04300119b0 con 0x7f044813ece0 2020-10-31T22:48:31.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f044cc56700 1 -- 172.21.15.60:0/3232276238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04480b3c70 con 0x7f044813ece0 2020-10-31T22:48:31.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f0444ff9700 1 -- 172.21.15.60:0/3232276238 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0430011d10 con 0x7f044813ece0 2020-10-31T22:48:31.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.457+0000 7f044cc56700 1 -- 172.21.15.60:0/3232276238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0448062dd0 con 0x7f044813ece0 2020-10-31T22:48:31.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.461+0000 7f044cc56700 1 -- 172.21.15.60:0/3232276238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0448057100 con 0x7f044813ece0 2020-10-31T22:48:31.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.461+0000 7f0444ff9700 1 -- 172.21.15.60:0/3232276238 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f043001c460 con 0x7f044813ece0 2020-10-31T22:48:31.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.461+0000 7f0444ff9700 1 --2- 172.21.15.60:0/3232276238 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f042c054f10 0x7f042c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:31.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.461+0000 7f0444ff9700 1 -- 172.21.15.60:0/3232276238 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f043006dfa0 con 0x7f044813ece0 2020-10-31T22:48:31.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.461+0000 7f04477fe700 1 --2- 172.21.15.60:0/3232276238 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f042c054f10 0x7f042c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:31.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.461+0000 7f04477fe700 1 --2- 172.21.15.60:0/3232276238 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f042c054f10 0x7f042c0573d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f044001a000 tx=0x7f0440016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:31.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.465+0000 7f0444ff9700 1 -- 172.21.15.60:0/3232276238 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0430044300 con 0x7f044813ece0 2020-10-31T22:48:31.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.653+0000 7f044cc56700 1 -- 172.21.15.60:0/3232276238 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f044805ee00 con 0x7f044813ece0 2020-10-31T22:48:31.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.653+0000 7f0444ff9700 1 -- 172.21.15.60:0/3232276238 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+2132 (secure 0 0 0) 0x7f0430047920 con 0x7f044813ece0 2020-10-31T22:48:31.659 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:31.660 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":42,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6507,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3668788118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3668788118},{"type":"v1","addr":"172.21.15.60:6835","nonce":3668788118}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":38},{"gid":6516,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/3884009815","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3884009815},{"type":"v1","addr":"172.21.15.60:6837","nonce":3884009815}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:48:15.434973+0000","modified":"2020-10-31T22:48:31.310667+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":89,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[16],"metadata_pool":15,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2020-10-31T22:48:31.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.653+0000 7f044cc56700 1 -- 172.21.15.60:0/3232276238 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f042c054f10 msgr2=0x7f042c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:31.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.653+0000 7f044cc56700 1 --2- 172.21.15.60:0/3232276238 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f042c054f10 0x7f042c0573d0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7f044001a000 tx=0x7f0440016000).stop 2020-10-31T22:48:31.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.653+0000 7f044cc56700 1 -- 172.21.15.60:0/3232276238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f044813ece0 msgr2=0x7f04480642d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:31.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.653+0000 7f044cc56700 1 --2- 172.21.15.60:0/3232276238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f044813ece0 0x7f04480642d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 rx=0x7f043000a000 tx=0x7f0430008040).stop 2020-10-31T22:48:31.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.653+0000 7f044cc56700 1 -- 172.21.15.60:0/3232276238 shutdown_connections 2020-10-31T22:48:31.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.653+0000 7f044cc56700 1 --2- 172.21.15.60:0/3232276238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f044813ece0 0x7f04480642d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.653+0000 7f044cc56700 1 --2- 172.21.15.60:0/3232276238 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f042c054f10 0x7f042c0573d0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.653+0000 7f044cc56700 1 --2- 172.21.15.60:0/3232276238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f04480b1bb0 0x7f04481412a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.653+0000 7f044cc56700 1 --2- 172.21.15.60:0/3232276238 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f044813f1b0 0x7f04480b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.653+0000 7f044cc56700 1 -- 172.21.15.60:0/3232276238 >> 172.21.15.60:0/3232276238 conn(0x7f04480b5300 msgr2=0x7f04480b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:31.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.653+0000 7f044cc56700 1 -- 172.21.15.60:0/3232276238 shutdown_connections 2020-10-31T22:48:31.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.653+0000 7f044cc56700 1 -- 172.21.15.60:0/3232276238 wait complete. 2020-10-31T22:48:31.663 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 42 2020-10-31T22:48:31.673 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:48:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa86b700 1 Processor -- start 2020-10-31T22:48:31.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa86b700 1 -- start start 2020-10-31T22:48:31.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa86b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ef40b24a0 0x7f8ef40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:31.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa86b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8ef4141fe0 0x7f8ef4142450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:31.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa86b700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef4145180 con 0x7f8ef40b5570 2020-10-31T22:48:31.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa86b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef40afae0 con 0x7f8ef4141fe0 2020-10-31T22:48:31.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa86b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef4141bf0 con 0x7f8ef40b24a0 2020-10-31T22:48:31.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa06a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8ef4141fe0 0x7f8ef4142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:31.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa06a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8ef4141fe0 0x7f8ef4142450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46520/0 (socket says 172.21.15.60:46520) 2020-10-31T22:48:31.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa06a700 1 -- 172.21.15.60:0/2379824771 learned_addr learned my addr 172.21.15.60:0/2379824771 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:31.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8ef9068700 1 --2- 172.21.15.60:0/2379824771 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ef40b24a0 0x7f8ef40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:31.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa06a700 1 -- 172.21.15.60:0/2379824771 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ef40b24a0 msgr2=0x7f8ef40b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:31.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa06a700 1 --2- 172.21.15.60:0/2379824771 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ef40b24a0 0x7f8ef40b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa06a700 1 -- 172.21.15.60:0/2379824771 >> v1:172.21.15.66:6789/0 conn(0x7f8ef40b5570 legacy=0x7f8ef4145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:31.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa06a700 1 -- 172.21.15.60:0/2379824771 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef40b0670 con 0x7f8ef4141fe0 2020-10-31T22:48:31.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa06a700 1 --2- 172.21.15.60:0/2379824771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef4141fe0 0x7f8ef4142450 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f8ef4061290 tx=0x7f8eec009270).ready entity=mon.0 client_cookie=afbe829c49ea9833 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8ef8867700 1 -- 172.21.15.60:0/2379824771 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eec009e90 con 0x7f8ef4141fe0 2020-10-31T22:48:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8ef8867700 1 -- 172.21.15.60:0/2379824771 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec00bbc0 con 0x7f8ef4141fe0 2020-10-31T22:48:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8ef8867700 1 -- 172.21.15.60:0/2379824771 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eec00bd30 con 0x7f8ef4141fe0 2020-10-31T22:48:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa86b700 1 -- 172.21.15.60:0/2379824771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef4141fe0 msgr2=0x7f8ef4142450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:31.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.781+0000 7f8efa86b700 1 --2- 172.21.15.60:0/2379824771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef4141fe0 0x7f8ef4142450 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 rx=0x7f8ef4061290 tx=0x7f8eec009270).stop 2020-10-31T22:48:31.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa86b700 1 -- 172.21.15.60:0/2379824771 shutdown_connections 2020-10-31T22:48:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa86b700 1 --2- 172.21.15.60:0/2379824771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef4141fe0 0x7f8ef4142450 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa86b700 1 --2- 172.21.15.60:0/2379824771 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ef40b24a0 0x7f8ef40b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa86b700 1 -- 172.21.15.60:0/2379824771 >> 172.21.15.60:0/2379824771 conn(0x7f8ef40b8e90 msgr2=0x7f8ef40b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa86b700 1 -- 172.21.15.60:0/2379824771 shutdown_connections 2020-10-31T22:48:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa86b700 1 -- 172.21.15.60:0/2379824771 wait complete. 2020-10-31T22:48:31.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa86b700 1 Processor -- start 2020-10-31T22:48:31.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa86b700 1 -- start start 2020-10-31T22:48:31.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa86b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ef40b24a0 0x7f8ef413fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:31.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa86b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ef40b5570 0x7f8ef41512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:31.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa86b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef4141fe0 0x7f8ef41517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:31.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa86b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef4150c40 con 0x7f8ef4141fe0 2020-10-31T22:48:31.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa86b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef4139730 con 0x7f8ef40b24a0 2020-10-31T22:48:31.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa86b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef413ebb0 con 0x7f8ef40b5570 2020-10-31T22:48:31.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa06a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef4141fe0 0x7f8ef41517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:31.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa06a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef4141fe0 0x7f8ef41517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46526/0 (socket says 172.21.15.60:46526) 2020-10-31T22:48:31.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8ef9869700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ef40b24a0 0x7f8ef413fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:31.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8efa06a700 1 -- 172.21.15.60:0/650951570 learned_addr learned my addr 172.21.15.60:0/650951570 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:31.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.785+0000 7f8ef9068700 1 --2- 172.21.15.60:0/650951570 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ef40b5570 0x7f8ef41512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:31.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.789+0000 7f8efa06a700 1 -- 172.21.15.60:0/650951570 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ef40b5570 msgr2=0x7f8ef41512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:31.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.789+0000 7f8efa06a700 1 --2- 172.21.15.60:0/650951570 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ef40b5570 0x7f8ef41512d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.789+0000 7f8efa06a700 1 -- 172.21.15.60:0/650951570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ef40b24a0 msgr2=0x7f8ef413fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:31.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.789+0000 7f8efa06a700 1 --2- 172.21.15.60:0/650951570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ef40b24a0 0x7f8ef413fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:31.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.789+0000 7f8efa06a700 1 -- 172.21.15.60:0/650951570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef413ee50 con 0x7f8ef4141fe0 2020-10-31T22:48:31.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.789+0000 7f8efa06a700 1 --2- 172.21.15.60:0/650951570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef4141fe0 0x7f8ef41517c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f8ef4061290 tx=0x7f8eec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:31.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.789+0000 7f8ee2ffd700 1 -- 172.21.15.60:0/650951570 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eec01f5e0 con 0x7f8ef4141fe0 2020-10-31T22:48:31.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.789+0000 7f8ee2ffd700 1 -- 172.21.15.60:0/650951570 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec01f740 con 0x7f8ef4141fe0 2020-10-31T22:48:31.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.789+0000 7f8efa86b700 1 -- 172.21.15.60:0/650951570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef4150e30 con 0x7f8ef4141fe0 2020-10-31T22:48:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.789+0000 7f8ee2ffd700 1 -- 172.21.15.60:0/650951570 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8eec01faa0 con 0x7f8ef4141fe0 2020-10-31T22:48:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.789+0000 7f8efa86b700 1 -- 172.21.15.60:0/650951570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef413e8a0 con 0x7f8ef4141fe0 2020-10-31T22:48:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.789+0000 7f8efa86b700 1 -- 172.21.15.60:0/650951570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef4150ff0 con 0x7f8ef4141fe0 2020-10-31T22:48:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.789+0000 7f8ee2ffd700 1 -- 172.21.15.60:0/650951570 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8eec026030 con 0x7f8ef4141fe0 2020-10-31T22:48:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.793+0000 7f8ee2ffd700 1 --2- 172.21.15.60:0/650951570 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8ed40550c0 0x7f8ed4057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.793+0000 7f8ee2ffd700 1 -- 172.21.15.60:0/650951570 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8eec06ea50 con 0x7f8ef4141fe0 2020-10-31T22:48:31.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.793+0000 7f8ef9869700 1 --2- 172.21.15.60:0/650951570 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8ed40550c0 0x7f8ed4057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:31.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.793+0000 7f8ef9869700 1 --2- 172.21.15.60:0/650951570 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8ed40550c0 0x7f8ed4057580 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f8ee400d000 tx=0x7f8ee4007ad0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:31.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.797+0000 7f8ee2ffd700 1 -- 172.21.15.60:0/650951570 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8eec044f20 con 0x7f8ef4141fe0 2020-10-31T22:48:31.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:31.985+0000 7f8efa86b700 1 -- 172.21.15.60:0/650951570 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8ef4057100 con 0x7f8ef4141fe0 2020-10-31T22:48:32.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.313+0000 7f8ee2ffd700 1 -- 172.21.15.60:0/650951570 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8eec0150a0 con 0x7f8ef4141fe0 2020-10-31T22:48:32.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.317+0000 7f8efa86b700 1 -- 172.21.15.60:0/650951570 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8ed40550c0 msgr2=0x7f8ed4057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:32.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.317+0000 7f8efa86b700 1 --2- 172.21.15.60:0/650951570 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8ed40550c0 0x7f8ed4057580 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7f8ee400d000 tx=0x7f8ee4007ad0).stop 2020-10-31T22:48:32.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.317+0000 7f8efa86b700 1 -- 172.21.15.60:0/650951570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef4141fe0 msgr2=0x7f8ef41517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:32.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.317+0000 7f8efa86b700 1 --2- 172.21.15.60:0/650951570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef4141fe0 0x7f8ef41517c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 rx=0x7f8ef4061290 tx=0x7f8eec016000).stop 2020-10-31T22:48:32.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.317+0000 7f8efa86b700 1 -- 172.21.15.60:0/650951570 shutdown_connections 2020-10-31T22:48:32.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.317+0000 7f8efa86b700 1 --2- 172.21.15.60:0/650951570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ef4141fe0 0x7f8ef41517c0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:32.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.317+0000 7f8efa86b700 1 --2- 172.21.15.60:0/650951570 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8ed40550c0 0x7f8ed4057580 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:32.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.317+0000 7f8efa86b700 1 --2- 172.21.15.60:0/650951570 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ef40b24a0 0x7f8ef413fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:32.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.317+0000 7f8efa86b700 1 --2- 172.21.15.60:0/650951570 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ef40b5570 0x7f8ef41512d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:32.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.317+0000 7f8efa86b700 1 -- 172.21.15.60:0/650951570 >> 172.21.15.60:0/650951570 conn(0x7f8ef40b8e90 msgr2=0x7f8ef405fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:32.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.317+0000 7f8efa86b700 1 -- 172.21.15.60:0/650951570 shutdown_connections 2020-10-31T22:48:32.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.321+0000 7f8efa86b700 1 -- 172.21.15.60:0/650951570 wait complete. 2020-10-31T22:48:32.345 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:48:32.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.465+0000 7f7a7f3a5700 1 Processor -- start 2020-10-31T22:48:32.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.465+0000 7f7a7f3a5700 1 -- start start 2020-10-31T22:48:32.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7a7805c660 0x7f7a780b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:32.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7a78065f70 0x7f7a7813f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:32.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a78066410 con 0x7f7a7813f880 2020-10-31T22:48:32.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a78066d60 con 0x7f7a7805c660 2020-10-31T22:48:32.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a780b5e80 con 0x7f7a78065f70 2020-10-31T22:48:32.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7d141700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7a7805c660 0x7f7a780b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:32.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7d942700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7a7813f880 0x7f7a78142610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50670/0 (socket says 172.21.15.60:50670) 2020-10-31T22:48:32.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7d942700 1 -- 172.21.15.60:0/1039411034 learned_addr learned my addr 172.21.15.60:0/1039411034 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:32.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7c940700 1 --2- 172.21.15.60:0/1039411034 >> v2:172.21.15.66:3300/0 conn(0x7f7a78065f70 0x7f7a7813f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:32.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a6bfff700 1 -- 172.21.15.60:0/1039411034 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550783627 0 0) 0x7f7a78066410 con 0x7f7a7813f880 2020-10-31T22:48:32.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a6bfff700 1 -- 172.21.15.60:0/1039411034 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a5c003230 con 0x7f7a7813f880 2020-10-31T22:48:32.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7d141700 1 -- 172.21.15.60:0/1039411034 >> v2:172.21.15.66:3300/0 conn(0x7f7a78065f70 msgr2=0x7f7a7813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:32.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7d141700 1 --2- 172.21.15.60:0/1039411034 >> v2:172.21.15.66:3300/0 conn(0x7f7a78065f70 0x7f7a7813f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:32.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a6bfff700 1 -- 172.21.15.60:0/1039411034 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2688200713 0 0) 0x7f7a5c003230 con 0x7f7a7813f880 2020-10-31T22:48:32.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7d141700 1 -- 172.21.15.60:0/1039411034 >> v1:172.21.15.60:6789/0 conn(0x7f7a7813f880 legacy=0x7f7a78142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:32.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7d141700 1 -- 172.21.15.60:0/1039411034 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a780666b0 con 0x7f7a7805c660 2020-10-31T22:48:32.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7d141700 1 --2- 172.21.15.60:0/1039411034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a7805c660 0x7f7a780b5990 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f7a70001bf0 tx=0x7f7a74006dc0).ready entity=mon.0 client_cookie=a3a34e8fde6ad905 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a6bfff700 1 -- 172.21.15.60:0/1039411034 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a70001a50 con 0x7f7a7805c660 2020-10-31T22:48:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a6bfff700 1 -- 172.21.15.60:0/1039411034 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a7400d5c0 con 0x7f7a7805c660 2020-10-31T22:48:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1039411034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a7805c660 msgr2=0x7f7a780b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 --2- 172.21.15.60:0/1039411034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a7805c660 0x7f7a780b5990 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 rx=0x7f7a70001bf0 tx=0x7f7a74006dc0).stop 2020-10-31T22:48:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a6bfff700 1 -- 172.21.15.60:0/1039411034 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a7400d730 con 0x7f7a7805c660 2020-10-31T22:48:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1039411034 shutdown_connections 2020-10-31T22:48:32.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 --2- 172.21.15.60:0/1039411034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a7805c660 0x7f7a780b5990 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 --2- 172.21.15.60:0/1039411034 >> v2:172.21.15.66:3300/0 conn(0x7f7a78065f70 0x7f7a7813f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1039411034 >> 172.21.15.60:0/1039411034 conn(0x7f7a780601e0 msgr2=0x7f7a7805b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1039411034 shutdown_connections 2020-10-31T22:48:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1039411034 wait complete. 2020-10-31T22:48:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 Processor -- start 2020-10-31T22:48:32.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.469+0000 7f7a7f3a5700 1 -- start start 2020-10-31T22:48:32.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7f3a5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a7805c660 0x7f7a780aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:32.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7f3a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a78065f70 0x7f7a780a9200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7f3a5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a7813f880 0x7f7a780ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7f3a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a780ae510 con 0x7f7a78065f70 2020-10-31T22:48:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7f3a5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a78151780 con 0x7f7a7805c660 2020-10-31T22:48:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7f3a5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a78151a20 con 0x7f7a7813f880 2020-10-31T22:48:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7c940700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a78065f70 0x7f7a780a9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7c940700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a78065f70 0x7f7a780a9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46538/0 (socket says 172.21.15.60:46538) 2020-10-31T22:48:32.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7c940700 1 -- 172.21.15.60:0/1990683185 learned_addr learned my addr 172.21.15.60:0/1990683185 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7d942700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a7813f880 0x7f7a780ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7d141700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a7805c660 0x7f7a780aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7c940700 1 -- 172.21.15.60:0/1990683185 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a7813f880 msgr2=0x7f7a780ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7c940700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a7813f880 0x7f7a780ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7c940700 1 -- 172.21.15.60:0/1990683185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a7805c660 msgr2=0x7f7a780aecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7c940700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a7805c660 0x7f7a780aecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:32.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7c940700 1 -- 172.21.15.60:0/1990683185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a780ae760 con 0x7f7a78065f70 2020-10-31T22:48:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7d942700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a7813f880 0x7f7a780ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7d141700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a7805c660 0x7f7a780aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7c940700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a78065f70 0x7f7a780a9200 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f7a6c00c000 tx=0x7f7a6c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a6a7fc700 1 -- 172.21.15.60:0/1990683185 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a6c00cb70 con 0x7f7a78065f70 2020-10-31T22:48:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1990683185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a780adf10 con 0x7f7a78065f70 2020-10-31T22:48:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a6a7fc700 1 -- 172.21.15.60:0/1990683185 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c00ccd0 con 0x7f7a78065f70 2020-10-31T22:48:32.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a6a7fc700 1 -- 172.21.15.60:0/1990683185 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a6c0125e0 con 0x7f7a78065f70 2020-10-31T22:48:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1990683185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a780aa9b0 con 0x7f7a78065f70 2020-10-31T22:48:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1990683185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a780ae8f0 con 0x7f7a78065f70 2020-10-31T22:48:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a6a7fc700 1 -- 172.21.15.60:0/1990683185 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7a6c012740 con 0x7f7a78065f70 2020-10-31T22:48:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a6a7fc700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7a60054f10 0x7f7a600573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a6a7fc700 1 -- 172.21.15.60:0/1990683185 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f7a6c06dfd0 con 0x7f7a78065f70 2020-10-31T22:48:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.473+0000 7f7a7d141700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7a60054f10 0x7f7a600573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:32.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.477+0000 7f7a7d141700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7a60054f10 0x7f7a600573d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f7a7401a000 tx=0x7f7a74015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:32.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.481+0000 7f7a6a7fc700 1 -- 172.21.15.60:0/1990683185 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7a6c0443a0 con 0x7f7a78065f70 2020-10-31T22:48:32.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:32.625+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1990683185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7a780ab000 con 0x7f7a78065f70 2020-10-31T22:48:33.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.317+0000 7f7a6a7fc700 1 -- 172.21.15.60:0/1990683185 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) v1 ==== 185+0+0 (secure 0 0 0) 0x7f7a6c0479c0 con 0x7f7a78065f70 2020-10-31T22:48:33.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.321+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1990683185 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7a60054f10 msgr2=0x7f7a600573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:33.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.321+0000 7f7a7f3a5700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7a60054f10 0x7f7a600573d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7f7a7401a000 tx=0x7f7a74015000).stop 2020-10-31T22:48:33.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.321+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1990683185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a78065f70 msgr2=0x7f7a780a9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:33.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.321+0000 7f7a7f3a5700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a78065f70 0x7f7a780a9200 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 rx=0x7f7a6c00c000 tx=0x7f7a6c006dc0).stop 2020-10-31T22:48:33.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.321+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1990683185 shutdown_connections 2020-10-31T22:48:33.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.321+0000 7f7a7f3a5700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a7813f880 0x7f7a780ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:33.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.321+0000 7f7a7f3a5700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7a60054f10 0x7f7a600573d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:33.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.321+0000 7f7a7f3a5700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a7805c660 0x7f7a780aecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:33.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.321+0000 7f7a7f3a5700 1 --2- 172.21.15.60:0/1990683185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a78065f70 0x7f7a780a9200 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:33.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.321+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1990683185 >> 172.21.15.60:0/1990683185 conn(0x7f7a780601e0 msgr2=0x7f7a78142530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:33.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.321+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1990683185 shutdown_connections 2020-10-31T22:48:33.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.321+0000 7f7a7f3a5700 1 -- 172.21.15.60:0/1990683185 wait complete. 2020-10-31T22:48:33.331 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:48:33.343 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-10-31T22:48:33.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 Processor -- start 2020-10-31T22:48:33.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 -- start start 2020-10-31T22:48:33.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2a880b5570 0x7f2a880b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:33.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a880b24a0 0x7f2a88145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:33.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a880b4440 con 0x7f2a88145e40 2020-10-31T22:48:33.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8813f930 con 0x7f2a880b5570 2020-10-31T22:48:33.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880b02f0 con 0x7f2a880b24a0 2020-10-31T22:48:33.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8d500700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2a880b5570 0x7f2a880b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:33.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8dd01700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2a88145e40 0x7f2a88141f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50680/0 (socket says 172.21.15.60:50680) 2020-10-31T22:48:33.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8dd01700 1 -- 172.21.15.60:0/446116657 learned_addr learned my addr 172.21.15.60:0/446116657 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:33.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8ccff700 1 --2- 172.21.15.60:0/446116657 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a880b24a0 0x7f2a88145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:33.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8d500700 1 -- 172.21.15.60:0/446116657 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a880b24a0 msgr2=0x7f2a88145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:33.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8d500700 1 --2- 172.21.15.60:0/446116657 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a880b24a0 0x7f2a88145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:33.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8d500700 1 -- 172.21.15.60:0/446116657 >> v1:172.21.15.60:6789/0 conn(0x7f2a88145e40 legacy=0x7f2a88141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:33.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8d500700 1 -- 172.21.15.60:0/446116657 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a880b0590 con 0x7f2a880b5570 2020-10-31T22:48:33.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a7ffff700 1 -- 172.21.15.60:0/446116657 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576457786 0 0) 0x7f2a880b4440 con 0x7f2a88145e40 2020-10-31T22:48:33.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8d500700 1 --2- 172.21.15.60:0/446116657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a880b5570 0x7f2a880b5950 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f2a88141c20 tx=0x7f2a840091a0).ready entity=mon.0 client_cookie=e3524b92d2798b28 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:33.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a7ffff700 1 -- 172.21.15.60:0/446116657 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a84009e70 con 0x7f2a880b5570 2020-10-31T22:48:33.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a7ffff700 1 -- 172.21.15.60:0/446116657 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8400bbc0 con 0x7f2a880b5570 2020-10-31T22:48:33.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a7ffff700 1 -- 172.21.15.60:0/446116657 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a8400bd30 con 0x7f2a880b5570 2020-10-31T22:48:33.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 -- 172.21.15.60:0/446116657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a880b5570 msgr2=0x7f2a880b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:33.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 --2- 172.21.15.60:0/446116657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a880b5570 0x7f2a880b5950 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 rx=0x7f2a88141c20 tx=0x7f2a840091a0).stop 2020-10-31T22:48:33.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 -- 172.21.15.60:0/446116657 shutdown_connections 2020-10-31T22:48:33.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 --2- 172.21.15.60:0/446116657 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a880b5570 0x7f2a880b5950 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:33.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 --2- 172.21.15.60:0/446116657 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a880b24a0 0x7f2a88145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:33.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 -- 172.21.15.60:0/446116657 >> 172.21.15.60:0/446116657 conn(0x7f2a880b8e90 msgr2=0x7f2a880b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:33.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 -- 172.21.15.60:0/446116657 shutdown_connections 2020-10-31T22:48:33.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.453+0000 7f2a8e502700 1 -- 172.21.15.60:0/446116657 wait complete. 2020-10-31T22:48:33.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8e502700 1 Processor -- start 2020-10-31T22:48:33.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8e502700 1 -- start start 2020-10-31T22:48:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8e502700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a880b24a0 0x7f2a88141500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8e502700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a880b5570 0x7f2a881540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8e502700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a88145e40 0x7f2a880acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8e502700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a881446f0 con 0x7f2a880b24a0 2020-10-31T22:48:33.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8e502700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a88144450 con 0x7f2a880b5570 2020-10-31T22:48:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8e502700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880ac690 con 0x7f2a88145e40 2020-10-31T22:48:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8d500700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a880b24a0 0x7f2a88141500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8d500700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a880b24a0 0x7f2a88141500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46550/0 (socket says 172.21.15.60:46550) 2020-10-31T22:48:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8d500700 1 -- 172.21.15.60:0/1539399686 learned_addr learned my addr 172.21.15.60:0/1539399686 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8dd01700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a88145e40 0x7f2a880acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8ccff700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a880b5570 0x7f2a881540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:33.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8d500700 1 -- 172.21.15.60:0/1539399686 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a88145e40 msgr2=0x7f2a880acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:33.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8d500700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a88145e40 0x7f2a880acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:33.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8d500700 1 -- 172.21.15.60:0/1539399686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a880b5570 msgr2=0x7f2a881540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:33.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8d500700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a880b5570 0x7f2a881540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:33.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8d500700 1 -- 172.21.15.60:0/1539399686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a880ac930 con 0x7f2a880b24a0 2020-10-31T22:48:33.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8dd01700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a88145e40 0x7f2a880acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:33.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8d500700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a880b24a0 0x7f2a88141500 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f2a88141c20 tx=0x7f2a84016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:33.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a7e7fc700 1 -- 172.21.15.60:0/1539399686 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a8401f5e0 con 0x7f2a880b24a0 2020-10-31T22:48:33.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a7e7fc700 1 -- 172.21.15.60:0/1539399686 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8401f740 con 0x7f2a880b24a0 2020-10-31T22:48:33.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8e502700 1 -- 172.21.15.60:0/1539399686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a880af1f0 con 0x7f2a880b24a0 2020-10-31T22:48:33.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a7e7fc700 1 -- 172.21.15.60:0/1539399686 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2a8401faa0 con 0x7f2a880b24a0 2020-10-31T22:48:33.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.457+0000 7f2a8e502700 1 -- 172.21.15.60:0/1539399686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a8809de90 con 0x7f2a880b24a0 2020-10-31T22:48:33.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.461+0000 7f2a8e502700 1 -- 172.21.15.60:0/1539399686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a88057100 con 0x7f2a880b24a0 2020-10-31T22:48:33.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.461+0000 7f2a7e7fc700 1 -- 172.21.15.60:0/1539399686 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2a8400f070 con 0x7f2a880b24a0 2020-10-31T22:48:33.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.461+0000 7f2a7e7fc700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2a70054f10 0x7f2a700573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:33.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.461+0000 7f2a7e7fc700 1 -- 172.21.15.60:0/1539399686 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f2a8406e6e0 con 0x7f2a880b24a0 2020-10-31T22:48:33.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.461+0000 7f2a8ccff700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2a70054f10 0x7f2a700573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:33.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.461+0000 7f2a8ccff700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2a70054f10 0x7f2a700573d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f2a7800c000 tx=0x7f2a78008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:33.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.473+0000 7f2a7e7fc700 1 -- 172.21.15.60:0/1539399686 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2a84044d60 con 0x7f2a880b24a0 2020-10-31T22:48:33.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:33.621+0000 7f2a8e502700 1 -- 172.21.15.60:0/1539399686 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2a8805a8e0 con 0x7f2a880b24a0 2020-10-31T22:48:34.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.321+0000 7f2a7e7fc700 1 -- 172.21.15.60:0/1539399686 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2a840150d0 con 0x7f2a880b24a0 2020-10-31T22:48:34.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.325+0000 7f2a8e502700 1 -- 172.21.15.60:0/1539399686 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2a70054f10 msgr2=0x7f2a700573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:34.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.325+0000 7f2a8e502700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2a70054f10 0x7f2a700573d0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f2a7800c000 tx=0x7f2a78008040).stop 2020-10-31T22:48:34.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.325+0000 7f2a8e502700 1 -- 172.21.15.60:0/1539399686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a880b24a0 msgr2=0x7f2a88141500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:34.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.325+0000 7f2a8e502700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a880b24a0 0x7f2a88141500 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 rx=0x7f2a88141c20 tx=0x7f2a84016000).stop 2020-10-31T22:48:34.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.325+0000 7f2a8e502700 1 -- 172.21.15.60:0/1539399686 shutdown_connections 2020-10-31T22:48:34.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.325+0000 7f2a8e502700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a88145e40 0x7f2a880acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:34.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.325+0000 7f2a8e502700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a880b24a0 0x7f2a88141500 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:34.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.325+0000 7f2a8e502700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2a70054f10 0x7f2a700573d0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:34.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.325+0000 7f2a8e502700 1 --2- 172.21.15.60:0/1539399686 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a880b5570 0x7f2a881540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:34.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.325+0000 7f2a8e502700 1 -- 172.21.15.60:0/1539399686 >> 172.21.15.60:0/1539399686 conn(0x7f2a880b8e90 msgr2=0x7f2a880b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:34.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.325+0000 7f2a8e502700 1 -- 172.21.15.60:0/1539399686 shutdown_connections 2020-10-31T22:48:34.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.325+0000 7f2a8e502700 1 -- 172.21.15.60:0/1539399686 wait complete. 2020-10-31T22:48:34.334 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2020-10-31T22:48:34.348 INFO:tasks.ceph.mds.a:Restarting daemon 2020-10-31T22:48:34.348 INFO:tasks.ceph.mds.a:Stopping old one... 2020-10-31T22:48:34.348 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-10-31T22:48:34.348 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:48:34.349 INFO:tasks.ceph.mds.c:Restarting daemon 2020-10-31T22:48:34.349 INFO:tasks.ceph.mds.c:Stopping old one... 2020-10-31T22:48:34.349 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-10-31T22:48:34.349 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:48:34.350 INFO:tasks.ceph.mds.b:Restarting daemon 2020-10-31T22:48:34.350 INFO:tasks.ceph.mds.b:Stopping old one... 2020-10-31T22:48:34.350 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-10-31T22:48:34.350 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:48:34.364 INFO:tasks.ceph.mds.c:Stopped 2020-10-31T22:48:34.365 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-10-31T22:48:34.367 INFO:tasks.ceph.mds.a:Stopped 2020-10-31T22:48:34.367 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-10-31T22:48:34.368 INFO:tasks.ceph.mds.b:Stopped 2020-10-31T22:48:34.370 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-10-31T22:48:34.403 INFO:tasks.ceph.mds.c:Started 2020-10-31T22:48:34.404 DEBUG:teuthology.parallel:result is None 2020-10-31T22:48:34.404 INFO:tasks.ceph.mds.a:Started 2020-10-31T22:48:34.405 DEBUG:teuthology.parallel:result is None 2020-10-31T22:48:34.410 INFO:tasks.ceph.mds.b:Started 2020-10-31T22:48:34.411 DEBUG:teuthology.parallel:result is None 2020-10-31T22:48:34.412 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-10-31T22:48:34.478 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:48:34.482 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:48:34.492 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:48:34.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46c53dd700 1 Processor -- start 2020-10-31T22:48:34.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46c53dd700 1 -- start start 2020-10-31T22:48:34.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46c53dd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46c00b0db0 0x7f46c0141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:34.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46c53dd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f46c00afb30 0x7f46c01420e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:34.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46c53dd700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c00a8320 con 0x7f46c00b5440 2020-10-31T22:48:34.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46c53dd700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c00b5820 con 0x7f46c00afb30 2020-10-31T22:48:34.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46c53dd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00a8550 con 0x7f46c00b0db0 2020-10-31T22:48:34.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46beffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f46c00b5440 0x7f46c00af420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50724/0 (socket says 172.21.15.60:50724) 2020-10-31T22:48:34.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46beffd700 1 -- 172.21.15.60:0/4276603801 learned_addr learned my addr 172.21.15.60:0/4276603801 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:34.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46bf7fe700 1 --2- 172.21.15.60:0/4276603801 >> v2:172.21.15.66:3300/0 conn(0x7f46c00afb30 0x7f46c01420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:34.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46be7fc700 1 --2- 172.21.15.60:0/4276603801 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46c00b0db0 0x7f46c0141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:34.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46bdffb700 1 -- 172.21.15.60:0/4276603801 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1124692493 0 0) 0x7f46c00a8320 con 0x7f46c00b5440 2020-10-31T22:48:34.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46bdffb700 1 -- 172.21.15.60:0/4276603801 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46a4003230 con 0x7f46c00b5440 2020-10-31T22:48:34.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46bf7fe700 1 -- 172.21.15.60:0/4276603801 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46c00b0db0 msgr2=0x7f46c0141bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:34.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46bf7fe700 1 --2- 172.21.15.60:0/4276603801 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46c00b0db0 0x7f46c0141bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:34.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46bf7fe700 1 -- 172.21.15.60:0/4276603801 >> v1:172.21.15.60:6789/0 conn(0x7f46c00b5440 legacy=0x7f46c00af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:34.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46bf7fe700 1 -- 172.21.15.60:0/4276603801 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c00ad870 con 0x7f46c00afb30 2020-10-31T22:48:34.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46be7fc700 1 --2- 172.21.15.60:0/4276603801 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46c00b0db0 0x7f46c0141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:34.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46bf7fe700 1 --2- 172.21.15.60:0/4276603801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46c00afb30 0x7f46c01420e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f46b0002f30 tx=0x7f46b0006dc0).ready entity=mon.1 client_cookie=9b77cae53d7681db server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:34.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.525+0000 7f46bdffb700 1 -- 172.21.15.60:0/4276603801 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b00096a0 con 0x7f46c00afb30 2020-10-31T22:48:34.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.529+0000 7f46bdffb700 1 -- 172.21.15.60:0/4276603801 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b0009800 con 0x7f46c00afb30 2020-10-31T22:48:34.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.529+0000 7f46bdffb700 1 -- 172.21.15.60:0/4276603801 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b0009b60 con 0x7f46c00afb30 2020-10-31T22:48:34.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.529+0000 7f46c53dd700 1 -- 172.21.15.60:0/4276603801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46c00afb30 msgr2=0x7f46c01420e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:34.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.529+0000 7f46c53dd700 1 --2- 172.21.15.60:0/4276603801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46c00afb30 0x7f46c01420e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f46b0002f30 tx=0x7f46b0006dc0).stop 2020-10-31T22:48:34.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.529+0000 7f46c53dd700 1 -- 172.21.15.60:0/4276603801 shutdown_connections 2020-10-31T22:48:34.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.529+0000 7f46c53dd700 1 --2- 172.21.15.60:0/4276603801 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46c00afb30 0x7f46c01420e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:34.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.529+0000 7f46c53dd700 1 --2- 172.21.15.60:0/4276603801 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46c00b0db0 0x7f46c0141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:34.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.529+0000 7f46c53dd700 1 -- 172.21.15.60:0/4276603801 >> 172.21.15.60:0/4276603801 conn(0x7f46c0060c10 msgr2=0x7f46c00b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:34.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.529+0000 7f46c53dd700 1 -- 172.21.15.60:0/4276603801 shutdown_connections 2020-10-31T22:48:34.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.529+0000 7f46c53dd700 1 -- 172.21.15.60:0/4276603801 wait complete. 2020-10-31T22:48:34.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.529+0000 7f46c53dd700 1 Processor -- start 2020-10-31T22:48:34.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.529+0000 7f46c53dd700 1 -- start start 2020-10-31T22:48:34.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46c53dd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46c00afb30 0x7f46c0141340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:34.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46c53dd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46c00b0db0 0x7f46c0151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:34.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46c53dd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c00b5440 0x7f46c013dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:34.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46c53dd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00a28b0 con 0x7f46c00b5440 2020-10-31T22:48:34.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46c53dd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c00646e0 con 0x7f46c00b0db0 2020-10-31T22:48:34.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46c53dd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c0151820 con 0x7f46c00afb30 2020-10-31T22:48:34.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46bf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c00b5440 0x7f46c013dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:34.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46bf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c00b5440 0x7f46c013dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46598/0 (socket says 172.21.15.60:46598) 2020-10-31T22:48:34.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46beffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46c00afb30 0x7f46c0141340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:34.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46bf7fe700 1 -- 172.21.15.60:0/4054116054 learned_addr learned my addr 172.21.15.60:0/4054116054 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:34.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46be7fc700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46c00b0db0 0x7f46c0151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:34.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46bf7fe700 1 -- 172.21.15.60:0/4054116054 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46c00afb30 msgr2=0x7f46c0141340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:34.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46bf7fe700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46c00afb30 0x7f46c0141340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:34.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46bf7fe700 1 -- 172.21.15.60:0/4054116054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46c00b0db0 msgr2=0x7f46c0151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:34.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46bf7fe700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46c00b0db0 0x7f46c0151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:34.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46bf7fe700 1 -- 172.21.15.60:0/4054116054 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c0064940 con 0x7f46c00b5440 2020-10-31T22:48:34.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46be7fc700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46c00b0db0 0x7f46c0151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:34.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46beffd700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46c00afb30 0x7f46c0141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:34.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46bf7fe700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c00b5440 0x7f46c013dd80 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f46b0002f30 tx=0x7f46b0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:34.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46affff700 1 -- 172.21.15.60:0/4054116054 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b0011960 con 0x7f46c00b5440 2020-10-31T22:48:34.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46affff700 1 -- 172.21.15.60:0/4054116054 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b0011ac0 con 0x7f46c00b5440 2020-10-31T22:48:34.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46c53dd700 1 -- 172.21.15.60:0/4054116054 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c0064be0 con 0x7f46c00b5440 2020-10-31T22:48:34.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46affff700 1 -- 172.21.15.60:0/4054116054 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f46b0011e20 con 0x7f46c00b5440 2020-10-31T22:48:34.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46c53dd700 1 -- 172.21.15.60:0/4054116054 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c00658f0 con 0x7f46c00b5440 2020-10-31T22:48:34.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46c53dd700 1 -- 172.21.15.60:0/4054116054 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c0057100 con 0x7f46c00b5440 2020-10-31T22:48:34.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.533+0000 7f46affff700 1 -- 172.21.15.60:0/4054116054 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f46b000f070 con 0x7f46c00b5440 2020-10-31T22:48:34.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.537+0000 7f46affff700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f469c054f10 0x7f469c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:34.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.537+0000 7f46affff700 1 -- 172.21.15.60:0/4054116054 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f46b006e260 con 0x7f46c00b5440 2020-10-31T22:48:34.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.537+0000 7f46beffd700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f469c054f10 0x7f469c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:34.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.537+0000 7f46beffd700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f469c054f10 0x7f469c0573d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f46b800d000 tx=0x7f46b8007cf0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:34.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.541+0000 7f46affff700 1 -- 172.21.15.60:0/4054116054 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f46b00449c0 con 0x7f46c00b5440 2020-10-31T22:48:34.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:34.701+0000 7f46c53dd700 1 -- 172.21.15.60:0/4054116054 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f46c005aa30 con 0x7f46c00b5440 2020-10-31T22:48:35.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.501+0000 7f46affff700 1 -- 172.21.15.60:0/4054116054 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v93) v1 ==== 97+0+0 (secure 0 0 0) 0x7f46b0022020 con 0x7f46c00b5440 2020-10-31T22:48:35.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.505+0000 7f46c53dd700 1 -- 172.21.15.60:0/4054116054 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f469c054f10 msgr2=0x7f469c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:35.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.505+0000 7f46c53dd700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f469c054f10 0x7f469c0573d0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f46b800d000 tx=0x7f46b8007cf0).stop 2020-10-31T22:48:35.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.505+0000 7f46c53dd700 1 -- 172.21.15.60:0/4054116054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c00b5440 msgr2=0x7f46c013dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:35.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.505+0000 7f46c53dd700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c00b5440 0x7f46c013dd80 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 rx=0x7f46b0002f30 tx=0x7f46b0015000).stop 2020-10-31T22:48:35.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.505+0000 7f46c53dd700 1 -- 172.21.15.60:0/4054116054 shutdown_connections 2020-10-31T22:48:35.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.505+0000 7f46c53dd700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46c00b5440 0x7f46c013dd80 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:35.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.505+0000 7f46c53dd700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46c00afb30 0x7f46c0141340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:35.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.505+0000 7f46c53dd700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f469c054f10 0x7f469c0573d0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:35.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.505+0000 7f46c53dd700 1 --2- 172.21.15.60:0/4054116054 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46c00b0db0 0x7f46c0151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:35.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.505+0000 7f46c53dd700 1 -- 172.21.15.60:0/4054116054 >> 172.21.15.60:0/4054116054 conn(0x7f46c0060c10 msgr2=0x7f46c00b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:35.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.505+0000 7f46c53dd700 1 -- 172.21.15.60:0/4054116054 shutdown_connections 2020-10-31T22:48:35.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.505+0000 7f46c53dd700 1 -- 172.21.15.60:0/4054116054 wait complete. 2020-10-31T22:48:35.514 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blacklist entries 2020-10-31T22:48:35.530 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2020-10-31T22:48:35.531 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-10-31T22:48:35.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.641+0000 7f3b262c9700 1 Processor -- start 2020-10-31T22:48:35.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.641+0000 7f3b262c9700 1 -- start start 2020-10-31T22:48:35.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.641+0000 7f3b262c9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b200b5570 0x7f3b200b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:35.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.641+0000 7f3b262c9700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3b200b24a0 0x7f3b20145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:35.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.641+0000 7f3b262c9700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b20145180 con 0x7f3b20145d10 2020-10-31T22:48:35.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.641+0000 7f3b262c9700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b200afae0 con 0x7f3b200b24a0 2020-10-31T22:48:35.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.641+0000 7f3b262c9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b20141bf0 con 0x7f3b200b5570 2020-10-31T22:48:35.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.641+0000 7f3b25ac8700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3b20145d10 0x7f3b20141fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50744/0 (socket says 172.21.15.60:50744) 2020-10-31T22:48:35.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.641+0000 7f3b25ac8700 1 -- 172.21.15.60:0/228763045 learned_addr learned my addr 172.21.15.60:0/228763045 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:35.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.641+0000 7f3b24ac6700 1 --2- 172.21.15.60:0/228763045 >> v2:172.21.15.66:3300/0 conn(0x7f3b200b24a0 0x7f3b20145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:35.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.641+0000 7f3b252c7700 1 --2- 172.21.15.60:0/228763045 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b200b5570 0x7f3b200b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:35.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.641+0000 7f3b13fff700 1 -- 172.21.15.60:0/228763045 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4092524417 0 0) 0x7f3b20145180 con 0x7f3b20145d10 2020-10-31T22:48:35.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.641+0000 7f3b13fff700 1 -- 172.21.15.60:0/228763045 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b04003230 con 0x7f3b20145d10 2020-10-31T22:48:35.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b24ac6700 1 -- 172.21.15.60:0/228763045 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b200b5570 msgr2=0x7f3b200b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:35.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b24ac6700 1 --2- 172.21.15.60:0/228763045 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b200b5570 0x7f3b200b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:35.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b24ac6700 1 -- 172.21.15.60:0/228763045 >> v1:172.21.15.60:6789/0 conn(0x7f3b20145d10 legacy=0x7f3b20141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:35.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b13fff700 1 -- 172.21.15.60:0/228763045 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2855387224 0 0) 0x7f3b04003230 con 0x7f3b20145d10 2020-10-31T22:48:35.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b24ac6700 1 -- 172.21.15.60:0/228763045 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b200b0670 con 0x7f3b200b24a0 2020-10-31T22:48:35.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b252c7700 1 --2- 172.21.15.60:0/228763045 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b200b5570 0x7f3b200b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:35.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b24ac6700 1 --2- 172.21.15.60:0/228763045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b200b24a0 0x7f3b20145820 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f3b18001bf0 tx=0x7f3b14006dc0).ready entity=mon.1 client_cookie=7d16f66de8bf4e5a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:35.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b13fff700 1 -- 172.21.15.60:0/228763045 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b18001a50 con 0x7f3b200b24a0 2020-10-31T22:48:35.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b13fff700 1 -- 172.21.15.60:0/228763045 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1400d570 con 0x7f3b200b24a0 2020-10-31T22:48:35.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b13fff700 1 -- 172.21.15.60:0/228763045 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b1400d6e0 con 0x7f3b200b24a0 2020-10-31T22:48:35.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b262c9700 1 -- 172.21.15.60:0/228763045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b200b24a0 msgr2=0x7f3b20145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:35.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b262c9700 1 --2- 172.21.15.60:0/228763045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b200b24a0 0x7f3b20145820 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f3b18001bf0 tx=0x7f3b14006dc0).stop 2020-10-31T22:48:35.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b262c9700 1 -- 172.21.15.60:0/228763045 shutdown_connections 2020-10-31T22:48:35.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b262c9700 1 --2- 172.21.15.60:0/228763045 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b200b5570 0x7f3b200b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:35.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b262c9700 1 --2- 172.21.15.60:0/228763045 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b200b24a0 0x7f3b20145820 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:35.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b262c9700 1 -- 172.21.15.60:0/228763045 >> 172.21.15.60:0/228763045 conn(0x7f3b200b8e90 msgr2=0x7f3b200b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:35.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b262c9700 1 -- 172.21.15.60:0/228763045 shutdown_connections 2020-10-31T22:48:35.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b262c9700 1 -- 172.21.15.60:0/228763045 wait complete. 2020-10-31T22:48:35.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b262c9700 1 Processor -- start 2020-10-31T22:48:35.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.645+0000 7f3b262c9700 1 -- start start 2020-10-31T22:48:35.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b262c9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b200b24a0 0x7f3b2013e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:35.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b262c9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b200b5570 0x7f3b20153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:35.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b262c9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b20145d10 0x7f3b20140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:35.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b262c9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b20148200 con 0x7f3b200b5570 2020-10-31T22:48:35.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b262c9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b20144c50 con 0x7f3b20145d10 2020-10-31T22:48:35.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b262c9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b2013ffe0 con 0x7f3b200b24a0 2020-10-31T22:48:35.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b24ac6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b200b5570 0x7f3b20153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:35.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b24ac6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b200b5570 0x7f3b20153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46612/0 (socket says 172.21.15.60:46612) 2020-10-31T22:48:35.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b24ac6700 1 -- 172.21.15.60:0/3222670085 learned_addr learned my addr 172.21.15.60:0/3222670085 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:35.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b25ac8700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b20145d10 0x7f3b20140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:35.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b252c7700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b200b24a0 0x7f3b2013e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:35.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b24ac6700 1 -- 172.21.15.60:0/3222670085 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b200b24a0 msgr2=0x7f3b2013e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:35.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b24ac6700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b200b24a0 0x7f3b2013e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:35.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b24ac6700 1 -- 172.21.15.60:0/3222670085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b20145d10 msgr2=0x7f3b20140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b24ac6700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b20145d10 0x7f3b20140410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b24ac6700 1 -- 172.21.15.60:0/3222670085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20144e80 con 0x7f3b200b5570 2020-10-31T22:48:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b25ac8700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b20145d10 0x7f3b20140410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b24ac6700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b200b5570 0x7f3b20153cd0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f3b18001bf0 tx=0x7f3b14015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b127fc700 1 -- 172.21.15.60:0/3222670085 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b14011960 con 0x7f3b200b5570 2020-10-31T22:48:35.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b127fc700 1 -- 172.21.15.60:0/3222670085 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b14011ac0 con 0x7f3b200b5570 2020-10-31T22:48:35.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b262c9700 1 -- 172.21.15.60:0/3222670085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b20141480 con 0x7f3b200b5570 2020-10-31T22:48:35.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b127fc700 1 -- 172.21.15.60:0/3222670085 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3b14011e20 con 0x7f3b200b5570 2020-10-31T22:48:35.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.649+0000 7f3b262c9700 1 -- 172.21.15.60:0/3222670085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b20141720 con 0x7f3b200b5570 2020-10-31T22:48:35.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.653+0000 7f3b127fc700 1 -- 172.21.15.60:0/3222670085 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3b14024030 con 0x7f3b200b5570 2020-10-31T22:48:35.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.653+0000 7f3b262c9700 1 -- 172.21.15.60:0/3222670085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b200af630 con 0x7f3b200b5570 2020-10-31T22:48:35.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.653+0000 7f3b127fc700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3b08055020 0x7f3b080574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:35.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.653+0000 7f3b127fc700 1 -- 172.21.15.60:0/3222670085 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f3b1406e390 con 0x7f3b200b5570 2020-10-31T22:48:35.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.653+0000 7f3b252c7700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3b08055020 0x7f3b080574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:35.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.653+0000 7f3b252c7700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3b08055020 0x7f3b080574e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f3b1c00b000 tx=0x7f3b1c006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:35.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.661+0000 7f3b127fc700 1 -- 172.21.15.60:0/3222670085 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3b14044be0 con 0x7f3b200b5570 2020-10-31T22:48:35.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.853+0000 7f3b262c9700 1 -- 172.21.15.60:0/3222670085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3b20140120 con 0x7f3b200b5570 2020-10-31T22:48:35.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.857+0000 7f3b127fc700 1 -- 172.21.15.60:0/3222670085 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f3b14022020 con 0x7f3b200b5570 2020-10-31T22:48:35.863 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:35.864 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:48:35.864 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2020-10-31T22:48:35.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.864 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2020-10-31T22:48:35.865 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f7D/cFRAAHQ9NU7VSs14mi5sC/GwHng==", 2020-10-31T22:48:35.865 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.865 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:35.866 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:35.866 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:35.866 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:35.867 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.868 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2020-10-31T22:48:35.868 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f5SPjJBAAVjFv2PdBZ7j94etJrAT0tA==", 2020-10-31T22:48:35.868 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:35.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:35.869 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:35.870 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:35.870 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.871 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2020-10-31T22:48:35.871 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKpdoHhAAhhlaYqOQoI6tTKexjRpbGA==", 2020-10-31T22:48:35.872 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:35.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:35.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:35.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:35.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.873 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2020-10-31T22:48:35.873 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDR551f7MwsMRAACZIQlAKm3BdVbDs2gQAfxg==", 2020-10-31T22:48:35.874 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:35.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:35.874 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:35.874 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.875 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2020-10-31T22:48:35.875 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDU551f07HQFxAAokMFXwsbgKGtJNpnKerdGg==", 2020-10-31T22:48:35.875 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:35.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:35.875 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:35.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.876 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2020-10-31T22:48:35.876 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDW551fODyjOhAAJ+j8KITJidSpltSiJaQZGw==", 2020-10-31T22:48:35.876 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:35.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:35.877 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:35.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.877 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2020-10-31T22:48:35.878 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDZ551fs+aCIhAAwpbmgGQjU05W3hZofTtHdg==", 2020-10-31T22:48:35.878 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:35.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:35.878 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:35.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.879 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2020-10-31T22:48:35.879 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDe551fI5nIMxAAwwNSHQYDPS6G2achKIpwqg==", 2020-10-31T22:48:35.879 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.879 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:35.879 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:35.879 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:35.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.880 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2020-10-31T22:48:35.880 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDh551f68p2GhAAhlGpZLPg8RqouzStqN4tFw==", 2020-10-31T22:48:35.880 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:35.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:35.881 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:35.881 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.881 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2020-10-31T22:48:35.882 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDk551fUi3kARAAsXPU7HEhqax8Go00CqgdNw==", 2020-10-31T22:48:35.882 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.882 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:35.882 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:35.882 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:35.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.883 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2020-10-31T22:48:35.883 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDm551fKh4aJRAAj+whV4kueCu2Og7wZ05tNw==", 2020-10-31T22:48:35.883 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:35.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:35.884 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:35.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.884 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2020-10-31T22:48:35.884 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551flXvBJxAAtD4URDL2NV0zyAympufvVA==", 2020-10-31T22:48:35.884 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.885 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:35.885 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:48:35.885 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:48:35.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.885 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2020-10-31T22:48:35.886 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fQ/OGKhAA/xGrRlUW52pP6E6SWXYAGA==", 2020-10-31T22:48:35.886 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.886 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:35.886 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:48:35.886 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:48:35.886 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.887 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2020-10-31T22:48:35.887 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDP551fITgCMxAAQy5CQzqda1YjdUtTRxbsPQ==", 2020-10-31T22:48:35.887 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.887 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:48:35.887 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:35.888 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:35.888 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:35.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.889 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2020-10-31T22:48:35.889 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551feZUgExAAvGt2fUb5GhkkFQ0dbgP5nw==", 2020-10-31T22:48:35.889 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.889 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:48:35.889 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:48:35.889 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:35.890 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:35.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:35.890 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2020-10-31T22:48:35.890 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKiN5EBAAhHtXXE4+yydXWOK7agZ14g==", 2020-10-31T22:48:35.890 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:35.891 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:48:35.891 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:48:35.891 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:35.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:35.891 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:35.891 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:48:35.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.857+0000 7f3b262c9700 1 -- 172.21.15.60:0/3222670085 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3b08055020 msgr2=0x7f3b080574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:35.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.857+0000 7f3b262c9700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3b08055020 0x7f3b080574e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7f3b1c00b000 tx=0x7f3b1c006dc0).stop 2020-10-31T22:48:35.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.857+0000 7f3b262c9700 1 -- 172.21.15.60:0/3222670085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b200b5570 msgr2=0x7f3b20153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:35.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.857+0000 7f3b262c9700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b200b5570 0x7f3b20153cd0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 rx=0x7f3b18001bf0 tx=0x7f3b14015000).stop 2020-10-31T22:48:35.893 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.857+0000 7f3b262c9700 1 -- 172.21.15.60:0/3222670085 shutdown_connections 2020-10-31T22:48:35.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.857+0000 7f3b262c9700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3b08055020 0x7f3b080574e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:35.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.857+0000 7f3b262c9700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b20145d10 0x7f3b20140410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:35.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.857+0000 7f3b262c9700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b200b24a0 0x7f3b2013e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:35.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.857+0000 7f3b262c9700 1 --2- 172.21.15.60:0/3222670085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3b200b5570 0x7f3b20153cd0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:35.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.857+0000 7f3b262c9700 1 -- 172.21.15.60:0/3222670085 >> 172.21.15.60:0/3222670085 conn(0x7f3b200b8e90 msgr2=0x7f3b200659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:35.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.857+0000 7f3b262c9700 1 -- 172.21.15.60:0/3222670085 shutdown_connections 2020-10-31T22:48:35.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:35.857+0000 7f3b262c9700 1 -- 172.21.15.60:0/3222670085 wait complete. 2020-10-31T22:48:35.895 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:48:36.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13cf59e700 1 Processor -- start 2020-10-31T22:48:36.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13cf59e700 1 -- start start 2020-10-31T22:48:36.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13cf59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13d00ac870 0x7f13d00b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13cf59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f13d00b0e20 0x7f13d00ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13cf59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d00acc50 con 0x7f13d00ae690 2020-10-31T22:48:36.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13cf59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d00b14c0 con 0x7f13d00ac870 2020-10-31T22:48:36.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13cf59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d00b5690 con 0x7f13d00b0e20 2020-10-31T22:48:36.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13ced9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f13d00ae690 0x7f13d01412e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50758/0 (socket says 172.21.15.60:50758) 2020-10-31T22:48:36.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13ce59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f13d00ac870 0x7f13d00b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13ced9d700 1 -- 172.21.15.60:0/2299552549 learned_addr learned my addr 172.21.15.60:0/2299552549 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:36.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13cdd9b700 1 --2- 172.21.15.60:0/2299552549 >> v2:172.21.15.66:3300/0 conn(0x7f13d00b0e20 0x7f13d00ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13ce59c700 1 -- 172.21.15.60:0/2299552549 >> v2:172.21.15.66:3300/0 conn(0x7f13d00b0e20 msgr2=0x7f13d00ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:36.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13ce59c700 1 --2- 172.21.15.60:0/2299552549 >> v2:172.21.15.66:3300/0 conn(0x7f13d00b0e20 0x7f13d00ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13ce59c700 1 -- 172.21.15.60:0/2299552549 >> v1:172.21.15.60:6789/0 conn(0x7f13d00ae690 legacy=0x7f13d01412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13ce59c700 1 -- 172.21.15.60:0/2299552549 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d00afc10 con 0x7f13d00ac870 2020-10-31T22:48:36.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13ce59c700 1 --2- 172.21.15.60:0/2299552549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13d00ac870 0x7f13d00b5060 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f13c0002f30 tx=0x7f13c0006dc0).ready entity=mon.0 client_cookie=74060e8a23329125 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:36.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13cd59a700 1 -- 172.21.15.60:0/2299552549 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13c0009840 con 0x7f13d00ac870 2020-10-31T22:48:36.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13cd59a700 1 -- 172.21.15.60:0/2299552549 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c00099a0 con 0x7f13d00ac870 2020-10-31T22:48:36.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13cd59a700 1 -- 172.21.15.60:0/2299552549 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13c0009d00 con 0x7f13d00ac870 2020-10-31T22:48:36.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13cf59e700 1 -- 172.21.15.60:0/2299552549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13d00ac870 msgr2=0x7f13d00b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.001+0000 7f13cf59e700 1 --2- 172.21.15.60:0/2299552549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13d00ac870 0x7f13d00b5060 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 rx=0x7f13c0002f30 tx=0x7f13c0006dc0).stop 2020-10-31T22:48:36.012 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.005+0000 7f13cf59e700 1 -- 172.21.15.60:0/2299552549 shutdown_connections 2020-10-31T22:48:36.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.005+0000 7f13cf59e700 1 --2- 172.21.15.60:0/2299552549 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13d00ac870 0x7f13d00b5060 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.005+0000 7f13cf59e700 1 --2- 172.21.15.60:0/2299552549 >> v2:172.21.15.66:3300/0 conn(0x7f13d00b0e20 0x7f13d00ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.005+0000 7f13cf59e700 1 -- 172.21.15.60:0/2299552549 >> 172.21.15.60:0/2299552549 conn(0x7f13d006a600 msgr2=0x7f13d0060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:36.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.005+0000 7f13cf59e700 1 -- 172.21.15.60:0/2299552549 shutdown_connections 2020-10-31T22:48:36.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.005+0000 7f13cf59e700 1 -- 172.21.15.60:0/2299552549 wait complete. 2020-10-31T22:48:36.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.005+0000 7f13cf59e700 1 Processor -- start 2020-10-31T22:48:36.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.005+0000 7f13cf59e700 1 -- start start 2020-10-31T22:48:36.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.005+0000 7f13cf59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13d00ac870 0x7f13d00aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.005+0000 7f13cf59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13d00ae690 0x7f13d014e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.005+0000 7f13cf59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13d00b0e20 0x7f13d0152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.005+0000 7f13cf59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0144970 con 0x7f13d00ac870 2020-10-31T22:48:36.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.005+0000 7f13cf59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0151e10 con 0x7f13d00b0e20 2020-10-31T22:48:36.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.005+0000 7f13cf59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d0144ba0 con 0x7f13d00ae690 2020-10-31T22:48:36.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13ce59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13d00ac870 0x7f13d00aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13ce59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13d00ac870 0x7f13d00aaba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46624/0 (socket says 172.21.15.60:46624) 2020-10-31T22:48:36.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13ce59c700 1 -- 172.21.15.60:0/387286415 learned_addr learned my addr 172.21.15.60:0/387286415 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:36.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13cdd9b700 1 --2- 172.21.15.60:0/387286415 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13d00ae690 0x7f13d014e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13ced9d700 1 --2- 172.21.15.60:0/387286415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13d00b0e20 0x7f13d0152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13ce59c700 1 -- 172.21.15.60:0/387286415 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13d00ae690 msgr2=0x7f13d014e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13ce59c700 1 --2- 172.21.15.60:0/387286415 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13d00ae690 0x7f13d014e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13ce59c700 1 -- 172.21.15.60:0/387286415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13d00b0e20 msgr2=0x7f13d0152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13ce59c700 1 --2- 172.21.15.60:0/387286415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13d00b0e20 0x7f13d0152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13ce59c700 1 -- 172.21.15.60:0/387286415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d0152070 con 0x7f13d00ac870 2020-10-31T22:48:36.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13ce59c700 1 --2- 172.21.15.60:0/387286415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13d00ac870 0x7f13d00aaba0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f13c0002f30 tx=0x7f13c0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:36.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13c77fe700 1 -- 172.21.15.60:0/387286415 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13c0011b40 con 0x7f13d00ac870 2020-10-31T22:48:36.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13c77fe700 1 -- 172.21.15.60:0/387286415 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c0011ca0 con 0x7f13d00ac870 2020-10-31T22:48:36.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13c77fe700 1 -- 172.21.15.60:0/387286415 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f13c001d440 con 0x7f13d00ac870 2020-10-31T22:48:36.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13cf59e700 1 -- 172.21.15.60:0/387286415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d01445b0 con 0x7f13d00ac870 2020-10-31T22:48:36.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13cf59e700 1 -- 172.21.15.60:0/387286415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d0065420 con 0x7f13d00ac870 2020-10-31T22:48:36.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13cf59e700 1 -- 172.21.15.60:0/387286415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d0057100 con 0x7f13d00ac870 2020-10-31T22:48:36.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.009+0000 7f13c77fe700 1 -- 172.21.15.60:0/387286415 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f13c0017070 con 0x7f13d00ac870 2020-10-31T22:48:36.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.013+0000 7f13c77fe700 1 --2- 172.21.15.60:0/387286415 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f13b4055020 0x7f13b40574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.013+0000 7f13c77fe700 1 -- 172.21.15.60:0/387286415 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f13c006e270 con 0x7f13d00ac870 2020-10-31T22:48:36.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.013+0000 7f13cdd9b700 1 --2- 172.21.15.60:0/387286415 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f13b4055020 0x7f13b40574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.013+0000 7f13cdd9b700 1 --2- 172.21.15.60:0/387286415 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f13b4055020 0x7f13b40574e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f13b800b000 tx=0x7f13b80091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:36.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.017+0000 7f13c77fe700 1 -- 172.21.15.60:0/387286415 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f13c0044a40 con 0x7f13d00ac870 2020-10-31T22:48:36.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.157+0000 7f13cf59e700 1 -- 172.21.15.60:0/387286415 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13d005ed50 con 0x7f13d00ac870 2020-10-31T22:48:36.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.157+0000 7f13c77fe700 1 -- 172.21.15.60:0/387286415 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) v1 ==== 74+0+13182 (secure 0 0 0) 0x7f13c0022090 con 0x7f13d00ac870 2020-10-31T22:48:36.165 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:36.165 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":93,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:48:35.498825+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:48:36.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.161+0000 7f13cf59e700 1 -- 172.21.15.60:0/387286415 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f13b4055020 msgr2=0x7f13b40574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.161+0000 7f13cf59e700 1 --2- 172.21.15.60:0/387286415 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f13b4055020 0x7f13b40574e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f13b800b000 tx=0x7f13b80091a0).stop 2020-10-31T22:48:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.161+0000 7f13cf59e700 1 -- 172.21.15.60:0/387286415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13d00ac870 msgr2=0x7f13d00aaba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.161+0000 7f13cf59e700 1 --2- 172.21.15.60:0/387286415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13d00ac870 0x7f13d00aaba0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 rx=0x7f13c0002f30 tx=0x7f13c0015000).stop 2020-10-31T22:48:36.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.161+0000 7f13cf59e700 1 -- 172.21.15.60:0/387286415 shutdown_connections 2020-10-31T22:48:36.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.161+0000 7f13cf59e700 1 --2- 172.21.15.60:0/387286415 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f13b4055020 0x7f13b40574e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.161+0000 7f13cf59e700 1 --2- 172.21.15.60:0/387286415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13d00b0e20 0x7f13d0152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.161+0000 7f13cf59e700 1 --2- 172.21.15.60:0/387286415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13d00ac870 0x7f13d00aaba0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.161+0000 7f13cf59e700 1 --2- 172.21.15.60:0/387286415 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13d00ae690 0x7f13d014e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.161+0000 7f13cf59e700 1 -- 172.21.15.60:0/387286415 >> 172.21.15.60:0/387286415 conn(0x7f13d006a600 msgr2=0x7f13d00a8140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:36.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.161+0000 7f13cf59e700 1 -- 172.21.15.60:0/387286415 shutdown_connections 2020-10-31T22:48:36.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.161+0000 7f13cf59e700 1 -- 172.21.15.60:0/387286415 wait complete. 2020-10-31T22:48:36.179 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-31T22:48:36.180 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:48:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18ac62700 1 Processor -- start 2020-10-31T22:48:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18ac62700 1 -- start start 2020-10-31T22:48:36.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18ac62700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc1840ac870 0x7fc184146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18ac62700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc184146550 0x7fc184150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18ac62700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1840af900 con 0x7fc1840af520 2020-10-31T22:48:36.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18ac62700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1840afc10 con 0x7fc184146550 2020-10-31T22:48:36.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18ac62700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc18405bb70 con 0x7fc1840ac870 2020-10-31T22:48:36.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18a461700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc184146550 0x7fc184150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18a461700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc184146550 0x7fc184150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46636/0 (socket says 172.21.15.60:46636) 2020-10-31T22:48:36.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18a461700 1 -- 172.21.15.60:0/1727758206 learned_addr learned my addr 172.21.15.60:0/1727758206 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:36.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18945f700 1 --2- 172.21.15.60:0/1727758206 >> v2:172.21.15.66:3300/0 conn(0x7fc1840ac870 0x7fc184146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18a461700 1 -- 172.21.15.60:0/1727758206 >> v2:172.21.15.66:3300/0 conn(0x7fc1840ac870 msgr2=0x7fc184146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:36.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18a461700 1 --2- 172.21.15.60:0/1727758206 >> v2:172.21.15.66:3300/0 conn(0x7fc1840ac870 0x7fc184146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18a461700 1 -- 172.21.15.60:0/1727758206 >> v1:172.21.15.66:6789/0 conn(0x7fc1840af520 legacy=0x7fc184066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18a461700 1 -- 172.21.15.60:0/1727758206 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1840ac130 con 0x7fc184146550 2020-10-31T22:48:36.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.293+0000 7fc18945f700 1 --2- 172.21.15.60:0/1727758206 >> v2:172.21.15.66:3300/0 conn(0x7fc1840ac870 0x7fc184146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:36.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.297+0000 7fc18a461700 1 --2- 172.21.15.60:0/1727758206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184146550 0x7fc184150980 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fc17c0032b0 tx=0x7fc17c009270).ready entity=mon.0 client_cookie=9257ef904d0492ed server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:36.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.297+0000 7fc188c5e700 1 -- 172.21.15.60:0/1727758206 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc17c00bc00 con 0x7fc184146550 2020-10-31T22:48:36.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.297+0000 7fc188c5e700 1 -- 172.21.15.60:0/1727758206 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17c00bd60 con 0x7fc184146550 2020-10-31T22:48:36.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.297+0000 7fc188c5e700 1 -- 172.21.15.60:0/1727758206 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc17c011400 con 0x7fc184146550 2020-10-31T22:48:36.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.297+0000 7fc18ac62700 1 -- 172.21.15.60:0/1727758206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184146550 msgr2=0x7fc184150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.297+0000 7fc18ac62700 1 --2- 172.21.15.60:0/1727758206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184146550 0x7fc184150980 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 rx=0x7fc17c0032b0 tx=0x7fc17c009270).stop 2020-10-31T22:48:36.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.297+0000 7fc18ac62700 1 -- 172.21.15.60:0/1727758206 shutdown_connections 2020-10-31T22:48:36.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.297+0000 7fc18ac62700 1 --2- 172.21.15.60:0/1727758206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc184146550 0x7fc184150980 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.297+0000 7fc18ac62700 1 --2- 172.21.15.60:0/1727758206 >> v2:172.21.15.66:3300/0 conn(0x7fc1840ac870 0x7fc184146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.297+0000 7fc18ac62700 1 -- 172.21.15.60:0/1727758206 >> 172.21.15.60:0/1727758206 conn(0x7fc1840b3fd0 msgr2=0x7fc1840b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:36.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.297+0000 7fc18ac62700 1 -- 172.21.15.60:0/1727758206 shutdown_connections 2020-10-31T22:48:36.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.297+0000 7fc18ac62700 1 -- 172.21.15.60:0/1727758206 wait complete. 2020-10-31T22:48:36.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18ac62700 1 Processor -- start 2020-10-31T22:48:36.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18ac62700 1 -- start start 2020-10-31T22:48:36.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18ac62700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1840ac870 0x7fc184145700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18ac62700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1840af520 0x7fc1841484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18ac62700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc184146550 0x7fc184155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18ac62700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840aada0 con 0x7fc1840af520 2020-10-31T22:48:36.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18ac62700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc184155e40 con 0x7fc184146550 2020-10-31T22:48:36.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18ac62700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc184147b60 con 0x7fc1840ac870 2020-10-31T22:48:36.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18945f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1840af520 0x7fc1841484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18945f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1840af520 0x7fc1841484c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46640/0 (socket says 172.21.15.60:46640) 2020-10-31T22:48:36.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18945f700 1 -- 172.21.15.60:0/732867622 learned_addr learned my addr 172.21.15.60:0/732867622 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:36.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc189c60700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1840ac870 0x7fc184145700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18a461700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc184146550 0x7fc184155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18945f700 1 -- 172.21.15.60:0/732867622 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1840ac870 msgr2=0x7fc184145700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18945f700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1840ac870 0x7fc184145700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18945f700 1 -- 172.21.15.60:0/732867622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc184146550 msgr2=0x7fc184155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18945f700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc184146550 0x7fc184155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18945f700 1 -- 172.21.15.60:0/732867622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1841478c0 con 0x7fc1840af520 2020-10-31T22:48:36.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18a461700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc184146550 0x7fc184155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:36.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18945f700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1840af520 0x7fc1841484c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7fc180006910 tx=0x7fc180008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:36.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc172ffd700 1 -- 172.21.15.60:0/732867622 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc180009920 con 0x7fc1840af520 2020-10-31T22:48:36.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc172ffd700 1 -- 172.21.15.60:0/732867622 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc180009a80 con 0x7fc1840af520 2020-10-31T22:48:36.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18ac62700 1 -- 172.21.15.60:0/732867622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc184144080 con 0x7fc1840af520 2020-10-31T22:48:36.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc172ffd700 1 -- 172.21.15.60:0/732867622 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc180009de0 con 0x7fc1840af520 2020-10-31T22:48:36.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.301+0000 7fc18ac62700 1 -- 172.21.15.60:0/732867622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc184147550 con 0x7fc1840af520 2020-10-31T22:48:36.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.305+0000 7fc18ac62700 1 -- 172.21.15.60:0/732867622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc184057100 con 0x7fc1840af520 2020-10-31T22:48:36.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.305+0000 7fc172ffd700 1 -- 172.21.15.60:0/732867622 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc180013480 con 0x7fc1840af520 2020-10-31T22:48:36.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.305+0000 7fc172ffd700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc164054f10 0x7fc1640573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.305+0000 7fc189c60700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc164054f10 0x7fc1640573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.305+0000 7fc172ffd700 1 -- 172.21.15.60:0/732867622 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fc18006df50 con 0x7fc1840af520 2020-10-31T22:48:36.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.305+0000 7fc189c60700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc164054f10 0x7fc1640573d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fc17400b000 tx=0x7fc174009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:36.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.313+0000 7fc172ffd700 1 -- 172.21.15.60:0/732867622 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc180044630 con 0x7fc1840af520 2020-10-31T22:48:36.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.453+0000 7fc18ac62700 1 -- 172.21.15.60:0/732867622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc1840afe20 con 0x7fc1840af520 2020-10-31T22:48:36.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.453+0000 7fc172ffd700 1 -- 172.21.15.60:0/732867622 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v93) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc180047c50 con 0x7fc1840af520 2020-10-31T22:48:36.462 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:48:36.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.457+0000 7fc18ac62700 1 -- 172.21.15.60:0/732867622 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc164054f10 msgr2=0x7fc1640573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.457+0000 7fc18ac62700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc164054f10 0x7fc1640573d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7fc17400b000 tx=0x7fc174009040).stop 2020-10-31T22:48:36.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.457+0000 7fc18ac62700 1 -- 172.21.15.60:0/732867622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1840af520 msgr2=0x7fc1841484c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.457+0000 7fc18ac62700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1840af520 0x7fc1841484c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 rx=0x7fc180006910 tx=0x7fc180008040).stop 2020-10-31T22:48:36.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.457+0000 7fc18ac62700 1 -- 172.21.15.60:0/732867622 shutdown_connections 2020-10-31T22:48:36.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.457+0000 7fc18ac62700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc164054f10 0x7fc1640573d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.457+0000 7fc18ac62700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc184146550 0x7fc184155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.457+0000 7fc18ac62700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1840ac870 0x7fc184145700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.457+0000 7fc18ac62700 1 --2- 172.21.15.60:0/732867622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1840af520 0x7fc1841484c0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.457+0000 7fc18ac62700 1 -- 172.21.15.60:0/732867622 >> 172.21.15.60:0/732867622 conn(0x7fc1840b3fd0 msgr2=0x7fc1840ade90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.457+0000 7fc18ac62700 1 -- 172.21.15.60:0/732867622 shutdown_connections 2020-10-31T22:48:36.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.457+0000 7fc18ac62700 1 -- 172.21.15.60:0/732867622 wait complete. 2020-10-31T22:48:36.475 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:48:36.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.589+0000 7f101e241700 1 Processor -- start 2020-10-31T22:48:36.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.589+0000 7f101e241700 1 -- start start 2020-10-31T22:48:36.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f10180b1bb0 0x7f101805afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f10180af580 0x7f101813fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10180ab150 0x7f10180ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10180b1120 con 0x7f10180b1bb0 2020-10-31T22:48:36.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10180af9c0 con 0x7f10180af580 2020-10-31T22:48:36.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10180a8850 con 0x7f10180ab150 2020-10-31T22:48:36.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101d23f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f10180b1bb0 0x7f101805afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101d23f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f10180b1bb0 0x7f101805afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46646/0 (socket says 172.21.15.60:46646) 2020-10-31T22:48:36.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101da40700 1 --2- 172.21.15.60:0/1272998851 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10180ab150 0x7f10180ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101d23f700 1 -- 172.21.15.60:0/1272998851 learned_addr learned my addr 172.21.15.60:0/1272998851 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:36.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101ca3e700 1 --2- 172.21.15.60:0/1272998851 >> v2:172.21.15.66:3300/0 conn(0x7f10180af580 0x7f101813fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101da40700 1 -- 172.21.15.60:0/1272998851 >> v2:172.21.15.66:3300/0 conn(0x7f10180af580 msgr2=0x7f101813fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:36.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101da40700 1 --2- 172.21.15.60:0/1272998851 >> v2:172.21.15.66:3300/0 conn(0x7f10180af580 0x7f101813fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101da40700 1 -- 172.21.15.60:0/1272998851 >> v2:172.21.15.60:3300/0 conn(0x7f10180b1bb0 msgr2=0x7f101805afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:36.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101da40700 1 --2- 172.21.15.60:0/1272998851 >> v2:172.21.15.60:3300/0 conn(0x7f10180b1bb0 0x7f101805afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101da40700 1 -- 172.21.15.60:0/1272998851 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10180a8af0 con 0x7f10180ab150 2020-10-31T22:48:36.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101d23f700 1 --2- 172.21.15.60:0/1272998851 >> v2:172.21.15.60:3300/0 conn(0x7f10180b1bb0 0x7f101805afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:36.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101da40700 1 --2- 172.21.15.60:0/1272998851 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10180ab150 0x7f10180ab5e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f10100032b0 tx=0x7f10100091a0).ready entity=mon.2 client_cookie=9b89bbb3f0dfc91e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:36.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f100ffff700 1 -- 172.21.15.60:0/1272998851 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f101000b940 con 0x7f10180ab150 2020-10-31T22:48:36.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f100ffff700 1 -- 172.21.15.60:0/1272998851 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101000baa0 con 0x7f10180ab150 2020-10-31T22:48:36.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f100ffff700 1 -- 172.21.15.60:0/1272998851 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f101000bc10 con 0x7f10180ab150 2020-10-31T22:48:36.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 -- 172.21.15.60:0/1272998851 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10180ab150 msgr2=0x7f10180ab5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 --2- 172.21.15.60:0/1272998851 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10180ab150 0x7f10180ab5e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f10100032b0 tx=0x7f10100091a0).stop 2020-10-31T22:48:36.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 -- 172.21.15.60:0/1272998851 shutdown_connections 2020-10-31T22:48:36.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 --2- 172.21.15.60:0/1272998851 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10180ab150 0x7f10180ab5e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 --2- 172.21.15.60:0/1272998851 >> v2:172.21.15.60:3300/0 conn(0x7f10180b1bb0 0x7f101805afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 --2- 172.21.15.60:0/1272998851 >> v2:172.21.15.66:3300/0 conn(0x7f10180af580 0x7f101813fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 -- 172.21.15.60:0/1272998851 >> 172.21.15.60:0/1272998851 conn(0x7f10180b5330 msgr2=0x7f10180b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:36.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 -- 172.21.15.60:0/1272998851 shutdown_connections 2020-10-31T22:48:36.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.593+0000 7f101e241700 1 -- 172.21.15.60:0/1272998851 wait complete. 2020-10-31T22:48:36.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101e241700 1 Processor -- start 2020-10-31T22:48:36.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101e241700 1 -- start start 2020-10-31T22:48:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101e241700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10180ab150 0x7f101813e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101e241700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10180af580 0x7f101814f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101e241700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10180b1bb0 0x7f1018141e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101e241700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f101814e8b0 con 0x7f10180b1bb0 2020-10-31T22:48:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101e241700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1018143bd0 con 0x7f10180ab150 2020-10-31T22:48:36.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101e241700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f101813f460 con 0x7f10180af580 2020-10-31T22:48:36.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101d23f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10180ab150 0x7f101813e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101ca3e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10180af580 0x7f101814f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101da40700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10180b1bb0 0x7f1018141e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101d23f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10180ab150 0x7f101813e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:57588/0 (socket says 172.21.15.60:57588) 2020-10-31T22:48:36.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101d23f700 1 -- 172.21.15.60:0/3023031798 learned_addr learned my addr 172.21.15.60:0/3023031798 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:36.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101ca3e700 1 -- 172.21.15.60:0/3023031798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10180ab150 msgr2=0x7f101813e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101ca3e700 1 --2- 172.21.15.60:0/3023031798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10180ab150 0x7f101813e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101ca3e700 1 -- 172.21.15.60:0/3023031798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10180b1bb0 msgr2=0x7f1018141e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101ca3e700 1 --2- 172.21.15.60:0/3023031798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10180b1bb0 0x7f1018141e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101ca3e700 1 -- 172.21.15.60:0/3023031798 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101814eae0 con 0x7f10180af580 2020-10-31T22:48:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101da40700 1 --2- 172.21.15.60:0/3023031798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10180b1bb0 0x7f1018141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101d23f700 1 --2- 172.21.15.60:0/3023031798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10180ab150 0x7f101813e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:36.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.597+0000 7f101ca3e700 1 --2- 172.21.15.60:0/3023031798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10180af580 0x7f101814f220 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f100800c000 tx=0x7f1008006dc0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.601+0000 7f100e7fc700 1 -- 172.21.15.60:0/3023031798 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f100800ca10 con 0x7f10180af580 2020-10-31T22:48:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.601+0000 7f100e7fc700 1 -- 172.21.15.60:0/3023031798 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f100800cb70 con 0x7f10180af580 2020-10-31T22:48:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.601+0000 7f101e241700 1 -- 172.21.15.60:0/3023031798 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f101814ed80 con 0x7f10180af580 2020-10-31T22:48:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.601+0000 7f100e7fc700 1 -- 172.21.15.60:0/3023031798 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f100800be30 con 0x7f10180af580 2020-10-31T22:48:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.601+0000 7f101e241700 1 -- 172.21.15.60:0/3023031798 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1018142340 con 0x7f10180af580 2020-10-31T22:48:36.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.601+0000 7f101e241700 1 -- 172.21.15.60:0/3023031798 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f101814ef10 con 0x7f10180af580 2020-10-31T22:48:36.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.601+0000 7f100e7fc700 1 -- 172.21.15.60:0/3023031798 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f100801c460 con 0x7f10180af580 2020-10-31T22:48:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.601+0000 7f100e7fc700 1 --2- 172.21.15.60:0/3023031798 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1000054f30 0x7f10000573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.601+0000 7f101d23f700 1 --2- 172.21.15.60:0/3023031798 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1000054f30 0x7f10000573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.601+0000 7f100e7fc700 1 -- 172.21.15.60:0/3023031798 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f100806db30 con 0x7f10180af580 2020-10-31T22:48:36.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.601+0000 7f101d23f700 1 --2- 172.21.15.60:0/3023031798 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1000054f30 0x7f10000573f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f1014008000 tx=0x7f1014008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:36.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.613+0000 7f100e7fc700 1 -- 172.21.15.60:0/3023031798 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1008044190 con 0x7f10180af580 2020-10-31T22:48:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.757+0000 7f101e241700 1 -- 172.21.15.60:0/3023031798 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1018057100 con 0x7f10180af580 2020-10-31T22:48:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.757+0000 7f100e7fc700 1 -- 172.21.15.60:0/3023031798 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v93) v1 ==== 92+0+10 (secure 0 0 0) 0x7f10080477b0 con 0x7f10180af580 2020-10-31T22:48:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.761+0000 7f101e241700 1 -- 172.21.15.60:0/3023031798 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1000054f30 msgr2=0x7f10000573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.761+0000 7f101e241700 1 --2- 172.21.15.60:0/3023031798 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1000054f30 0x7f10000573f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f1014008000 tx=0x7f1014008040).stop 2020-10-31T22:48:36.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.761+0000 7f101e241700 1 -- 172.21.15.60:0/3023031798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10180af580 msgr2=0x7f101814f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.761+0000 7f101e241700 1 --2- 172.21.15.60:0/3023031798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10180af580 0x7f101814f220 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f100800c000 tx=0x7f1008006dc0).stop 2020-10-31T22:48:36.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.761+0000 7f101e241700 1 -- 172.21.15.60:0/3023031798 shutdown_connections 2020-10-31T22:48:36.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.761+0000 7f101e241700 1 --2- 172.21.15.60:0/3023031798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f10180b1bb0 0x7f1018141e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.761+0000 7f101e241700 1 --2- 172.21.15.60:0/3023031798 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1000054f30 0x7f10000573f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.761+0000 7f101e241700 1 --2- 172.21.15.60:0/3023031798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10180ab150 0x7f101813e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.761+0000 7f101e241700 1 --2- 172.21.15.60:0/3023031798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10180af580 0x7f101814f220 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.761+0000 7f101e241700 1 -- 172.21.15.60:0/3023031798 >> 172.21.15.60:0/3023031798 conn(0x7f10180b5330 msgr2=0x7f10180a9990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:36.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.761+0000 7f101e241700 1 -- 172.21.15.60:0/3023031798 shutdown_connections 2020-10-31T22:48:36.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.761+0000 7f101e241700 1 -- 172.21.15.60:0/3023031798 wait complete. 2020-10-31T22:48:36.771 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:48:36.785 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-10-31T22:48:36.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.893+0000 7ff1ce1b7700 1 Processor -- start 2020-10-31T22:48:36.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.893+0000 7ff1ce1b7700 1 -- start start 2020-10-31T22:48:36.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.893+0000 7ff1ce1b7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1c80ac990 0x7ff1c813ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1ce1b7700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff1c80ae030 0x7ff1c80a7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1ce1b7700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1c805bf90 con 0x7ff1c805bbb0 2020-10-31T22:48:36.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1ce1b7700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1c80ab410 con 0x7ff1c80ae030 2020-10-31T22:48:36.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1ce1b7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c80ab600 con 0x7ff1c80ac990 2020-10-31T22:48:36.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1cd1b5700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff1c805bbb0 0x7ff1c80ac280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50796/0 (socket says 172.21.15.60:50796) 2020-10-31T22:48:36.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1cd1b5700 1 -- 172.21.15.60:0/2341656121 learned_addr learned my addr 172.21.15.60:0/2341656121 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:36.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1cc9b4700 1 --2- 172.21.15.60:0/2341656121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1c80ac990 0x7ff1c813ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1cd9b6700 1 --2- 172.21.15.60:0/2341656121 >> v2:172.21.15.66:3300/0 conn(0x7ff1c80ae030 0x7ff1c80a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1b3fff700 1 -- 172.21.15.60:0/2341656121 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2652500167 0 0) 0x7ff1c805bf90 con 0x7ff1c805bbb0 2020-10-31T22:48:36.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1b3fff700 1 -- 172.21.15.60:0/2341656121 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1ac003230 con 0x7ff1c805bbb0 2020-10-31T22:48:36.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1b3fff700 1 -- 172.21.15.60:0/2341656121 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4205030807 0 0) 0x7ff1ac003230 con 0x7ff1c805bbb0 2020-10-31T22:48:36.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1cd9b6700 1 -- 172.21.15.60:0/2341656121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1c80ac990 msgr2=0x7ff1c813ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:36.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1cd9b6700 1 --2- 172.21.15.60:0/2341656121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1c80ac990 0x7ff1c813ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1cd9b6700 1 -- 172.21.15.60:0/2341656121 >> v1:172.21.15.60:6789/0 conn(0x7ff1c805bbb0 legacy=0x7ff1c80ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1cd9b6700 1 -- 172.21.15.60:0/2341656121 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c80ab8a0 con 0x7ff1c80ae030 2020-10-31T22:48:36.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1cc9b4700 1 --2- 172.21.15.60:0/2341656121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1c80ac990 0x7ff1c813ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:36.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1cd9b6700 1 --2- 172.21.15.60:0/2341656121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c80ae030 0x7ff1c80a7150 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7ff1c4001870 tx=0x7ff1c000a360).ready entity=mon.1 client_cookie=5a41896520420b05 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:36.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1b3fff700 1 -- 172.21.15.60:0/2341656121 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1c40016d0 con 0x7ff1c80ae030 2020-10-31T22:48:36.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1b3fff700 1 -- 172.21.15.60:0/2341656121 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c000cbb0 con 0x7ff1c80ae030 2020-10-31T22:48:36.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1b3fff700 1 -- 172.21.15.60:0/2341656121 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1c0010410 con 0x7ff1c80ae030 2020-10-31T22:48:36.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2341656121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c80ae030 msgr2=0x7ff1c80a7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1ce1b7700 1 --2- 172.21.15.60:0/2341656121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c80ae030 0x7ff1c80a7150 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7ff1c4001870 tx=0x7ff1c000a360).stop 2020-10-31T22:48:36.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2341656121 shutdown_connections 2020-10-31T22:48:36.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1ce1b7700 1 --2- 172.21.15.60:0/2341656121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c80ae030 0x7ff1c80a7150 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1ce1b7700 1 --2- 172.21.15.60:0/2341656121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1c80ac990 0x7ff1c813ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2341656121 >> 172.21.15.60:0/2341656121 conn(0x7ff1c80b3fd0 msgr2=0x7ff1c80b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:36.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2341656121 shutdown_connections 2020-10-31T22:48:36.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2341656121 wait complete. 2020-10-31T22:48:36.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.897+0000 7ff1ce1b7700 1 Processor -- start 2020-10-31T22:48:36.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1ce1b7700 1 -- start start 2020-10-31T22:48:36.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1ce1b7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c805bbb0 0x7ff1c80a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1ce1b7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1c80ac990 0x7ff1c81365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1ce1b7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c80ae030 0x7ff1c8064bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1ce1b7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c8062c20 con 0x7ff1c805bbb0 2020-10-31T22:48:36.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1ce1b7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c8066210 con 0x7ff1c80ae030 2020-10-31T22:48:36.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1ce1b7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1c8136a90 con 0x7ff1c80ac990 2020-10-31T22:48:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1cd1b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c805bbb0 0x7ff1c80a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1cd1b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c805bbb0 0x7ff1c80a9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46666/0 (socket says 172.21.15.60:46666) 2020-10-31T22:48:36.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1cd1b5700 1 -- 172.21.15.60:0/2672639568 learned_addr learned my addr 172.21.15.60:0/2672639568 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1cd9b6700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c80ae030 0x7ff1c8064bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1cc9b4700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1c80ac990 0x7ff1c81365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1cd1b5700 1 -- 172.21.15.60:0/2672639568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1c80ac990 msgr2=0x7ff1c81365a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1cd1b5700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1c80ac990 0x7ff1c81365a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1cd1b5700 1 -- 172.21.15.60:0/2672639568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c80ae030 msgr2=0x7ff1c8064bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:36.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1cd1b5700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c80ae030 0x7ff1c8064bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:36.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1cd1b5700 1 -- 172.21.15.60:0/2672639568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1c8065700 con 0x7ff1c805bbb0 2020-10-31T22:48:36.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1cd9b6700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c80ae030 0x7ff1c8064bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:36.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1cd1b5700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c805bbb0 0x7ff1c80a9d90 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7ff1c81364f0 tx=0x7ff1c40011f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:36.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1baffd700 1 -- 172.21.15.60:0/2672639568 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1c4007170 con 0x7ff1c805bbb0 2020-10-31T22:48:36.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2672639568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1c80636c0 con 0x7ff1c805bbb0 2020-10-31T22:48:36.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1baffd700 1 -- 172.21.15.60:0/2672639568 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1c40072d0 con 0x7ff1c805bbb0 2020-10-31T22:48:36.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1baffd700 1 -- 172.21.15.60:0/2672639568 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff1c40048f0 con 0x7ff1c805bbb0 2020-10-31T22:48:36.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2672639568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1c80650c0 con 0x7ff1c805bbb0 2020-10-31T22:48:36.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2672639568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1c8063b60 con 0x7ff1c805bbb0 2020-10-31T22:48:36.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1baffd700 1 -- 172.21.15.60:0/2672639568 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff1c4010070 con 0x7ff1c805bbb0 2020-10-31T22:48:36.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.901+0000 7ff1baffd700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff1a4054f10 0x7ff1a40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:36.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.905+0000 7ff1baffd700 1 -- 172.21.15.60:0/2672639568 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5253+0+0 (secure 0 0 0) 0x7ff1c406d020 con 0x7ff1c805bbb0 2020-10-31T22:48:36.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.905+0000 7ff1cc9b4700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff1a4054f10 0x7ff1a40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:36.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.905+0000 7ff1cc9b4700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff1a4054f10 0x7ff1a40573d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7ff1bc00b000 tx=0x7ff1bc006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:36.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:36.909+0000 7ff1baffd700 1 -- 172.21.15.60:0/2672639568 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff1c40437d0 con 0x7ff1c805bbb0 2020-10-31T22:48:37.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.049+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2672639568 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff1c80648e0 con 0x7ff1c805bbb0 2020-10-31T22:48:37.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.049+0000 7ff1baffd700 1 -- 172.21.15.60:0/2672639568 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v93) v1 ==== 84+0+143 (secure 0 0 0) 0x7ff1c4019030 con 0x7ff1c805bbb0 2020-10-31T22:48:37.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.049+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2672639568 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff1a4054f10 msgr2=0x7ff1a40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:37.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.049+0000 7ff1ce1b7700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff1a4054f10 0x7ff1a40573d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7ff1bc00b000 tx=0x7ff1bc006dc0).stop 2020-10-31T22:48:37.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.049+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2672639568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c805bbb0 msgr2=0x7ff1c80a9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:37.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.049+0000 7ff1ce1b7700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c805bbb0 0x7ff1c80a9d90 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 rx=0x7ff1c81364f0 tx=0x7ff1c40011f0).stop 2020-10-31T22:48:37.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.049+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2672639568 shutdown_connections 2020-10-31T22:48:37.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.049+0000 7ff1ce1b7700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff1a4054f10 0x7ff1a40573d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:37.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.049+0000 7ff1ce1b7700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff1c80ae030 0x7ff1c8064bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:37.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.049+0000 7ff1ce1b7700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1c805bbb0 0x7ff1c80a9d90 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:37.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.049+0000 7ff1ce1b7700 1 --2- 172.21.15.60:0/2672639568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff1c80ac990 0x7ff1c81365a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:37.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.049+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2672639568 >> 172.21.15.60:0/2672639568 conn(0x7ff1c80b3fd0 msgr2=0x7ff1c80a7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:37.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.053+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2672639568 shutdown_connections 2020-10-31T22:48:37.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.053+0000 7ff1ce1b7700 1 -- 172.21.15.60:0/2672639568 wait complete. 2020-10-31T22:48:37.061 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:37.061 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2020-10-31T22:48:37.061 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:37.061 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2020-10-31T22:48:37.062 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "device_health_metrics" 2020-10-31T22:48:37.062 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:37.062 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:37.062 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2020-10-31T22:48:37.062 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2020-10-31T22:48:37.062 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:37.062 INFO:teuthology.orchestra.run.smithi060.stdout:] 2020-10-31T22:48:37.070 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-10-31T22:48:37.071 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:48:37.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb444e8e700 1 Processor -- start 2020-10-31T22:48:37.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb444e8e700 1 -- start start 2020-10-31T22:48:37.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb444e8e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4400b2820 0x7fb4400add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:37.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb444e8e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb4400b1bd0 0x7fb440149af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:37.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb444e8e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb440063520 con 0x7fb440063140 2020-10-31T22:48:37.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb444e8e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4400ae260 con 0x7fb4400b1bd0 2020-10-31T22:48:37.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb444e8e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4400b23f0 con 0x7fb4400b2820 2020-10-31T22:48:37.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb43ffff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb4400b1bd0 0x7fb440149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:37.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb43effd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4400b2820 0x7fb4400add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:37.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb43effd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4400b2820 0x7fb4400add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:59864/0 (socket says 172.21.15.60:59864) 2020-10-31T22:48:37.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb43f7fe700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fb440063140 0x7fb4400b0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:48678/0 (socket says 172.21.15.60:48678) 2020-10-31T22:48:37.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb43ffff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb4400b1bd0 0x7fb440149af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:57612/0 (socket says 172.21.15.60:57612) 2020-10-31T22:48:37.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb43effd700 1 -- 172.21.15.60:0/2642538450 learned_addr learned my addr 172.21.15.60:0/2642538450 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:37.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb43effd700 1 -- 172.21.15.60:0/2642538450 >> v2:172.21.15.66:3300/0 conn(0x7fb4400b1bd0 msgr2=0x7fb440149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:37.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb43effd700 1 --2- 172.21.15.60:0/2642538450 >> v2:172.21.15.66:3300/0 conn(0x7fb4400b1bd0 0x7fb440149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:37.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb43effd700 1 -- 172.21.15.60:0/2642538450 >> v1:172.21.15.66:6789/0 conn(0x7fb440063140 legacy=0x7fb4400b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:37.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb43effd700 1 -- 172.21.15.60:0/2642538450 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4400b2150 con 0x7fb4400b2820 2020-10-31T22:48:37.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb43effd700 1 --2- 172.21.15.60:0/2642538450 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4400b2820 0x7fb4400add70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb434002f30 tx=0x7fb434006e80).ready entity=mon.2 client_cookie=15be8adeca24996b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:37.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb43e7fc700 1 -- 172.21.15.60:0/2642538450 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4340097f0 con 0x7fb4400b2820 2020-10-31T22:48:37.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb43e7fc700 1 -- 172.21.15.60:0/2642538450 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb434009950 con 0x7fb4400b2820 2020-10-31T22:48:37.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb43e7fc700 1 -- 172.21.15.60:0/2642538450 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb434009cb0 con 0x7fb4400b2820 2020-10-31T22:48:37.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb444e8e700 1 -- 172.21.15.60:0/2642538450 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4400b2820 msgr2=0x7fb4400add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:37.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.185+0000 7fb444e8e700 1 --2- 172.21.15.60:0/2642538450 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4400b2820 0x7fb4400add70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fb434002f30 tx=0x7fb434006e80).stop 2020-10-31T22:48:37.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.189+0000 7fb444e8e700 1 -- 172.21.15.60:0/2642538450 shutdown_connections 2020-10-31T22:48:37.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.189+0000 7fb444e8e700 1 --2- 172.21.15.60:0/2642538450 >> v2:172.21.15.66:3300/0 conn(0x7fb4400b1bd0 0x7fb440149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:37.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.189+0000 7fb444e8e700 1 --2- 172.21.15.60:0/2642538450 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4400b2820 0x7fb4400add70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:37.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.189+0000 7fb444e8e700 1 -- 172.21.15.60:0/2642538450 >> 172.21.15.60:0/2642538450 conn(0x7fb44006a600 msgr2=0x7fb440060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:37.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.189+0000 7fb444e8e700 1 -- 172.21.15.60:0/2642538450 shutdown_connections 2020-10-31T22:48:37.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.189+0000 7fb444e8e700 1 -- 172.21.15.60:0/2642538450 wait complete. 2020-10-31T22:48:37.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.189+0000 7fb444e8e700 1 Processor -- start 2020-10-31T22:48:37.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.189+0000 7fb444e8e700 1 -- start start 2020-10-31T22:48:37.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb444e8e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb440063140 0x7fb44005c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:37.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb444e8e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4400b1bd0 0x7fb440065a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:37.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb444e8e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4400b2820 0x7fb440065f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:37.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb444e8e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb440154ce0 con 0x7fb4400b2820 2020-10-31T22:48:37.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb444e8e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb44014c8b0 con 0x7fb440063140 2020-10-31T22:48:37.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb444e8e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb440154ed0 con 0x7fb4400b1bd0 2020-10-31T22:48:37.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4400b2820 0x7fb440065f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:37.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4400b2820 0x7fb440065f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46684/0 (socket says 172.21.15.60:46684) 2020-10-31T22:48:37.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43ffff700 1 -- 172.21.15.60:0/1793854408 learned_addr learned my addr 172.21.15.60:0/1793854408 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:37.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43effd700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4400b1bd0 0x7fb440065a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:37.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43f7fe700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb440063140 0x7fb44005c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:37.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43effd700 1 -- 172.21.15.60:0/1793854408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb440063140 msgr2=0x7fb44005c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:37.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43effd700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb440063140 0x7fb44005c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:37.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43effd700 1 -- 172.21.15.60:0/1793854408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4400b2820 msgr2=0x7fb440065f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:37.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43effd700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4400b2820 0x7fb440065f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:37.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43effd700 1 -- 172.21.15.60:0/1793854408 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4400652e0 con 0x7fb4400b1bd0 2020-10-31T22:48:37.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43ffff700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4400b2820 0x7fb440065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:37.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43effd700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4400b1bd0 0x7fb440065a20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb434002f30 tx=0x7fb434015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:37.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43cff9700 1 -- 172.21.15.60:0/1793854408 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb434011b00 con 0x7fb4400b1bd0 2020-10-31T22:48:37.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43cff9700 1 -- 172.21.15.60:0/1793854408 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb434011c60 con 0x7fb4400b1bd0 2020-10-31T22:48:37.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb444e8e700 1 -- 172.21.15.60:0/1793854408 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb440065580 con 0x7fb4400b1bd0 2020-10-31T22:48:37.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb43cff9700 1 -- 172.21.15.60:0/1793854408 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43401e460 con 0x7fb4400b1bd0 2020-10-31T22:48:37.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb444e8e700 1 -- 172.21.15.60:0/1793854408 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb440066400 con 0x7fb4400b1bd0 2020-10-31T22:48:37.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.193+0000 7fb444e8e700 1 -- 172.21.15.60:0/1793854408 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb440065710 con 0x7fb4400b1bd0 2020-10-31T22:48:37.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.197+0000 7fb43cff9700 1 -- 172.21.15.60:0/1793854408 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb434025030 con 0x7fb4400b1bd0 2020-10-31T22:48:37.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.197+0000 7fb43cff9700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb420054f10 0x7fb4200573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:37.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.197+0000 7fb43cff9700 1 -- 172.21.15.60:0/1793854408 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fb43406ea90 con 0x7fb4400b1bd0 2020-10-31T22:48:37.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.197+0000 7fb43f7fe700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb420054f10 0x7fb4200573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:37.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.197+0000 7fb43f7fe700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb420054f10 0x7fb4200573d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fb43000d000 tx=0x7fb430007ac0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:37.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.205+0000 7fb43cff9700 1 -- 172.21.15.60:0/1793854408 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb434045210 con 0x7fb4400b1bd0 2020-10-31T22:48:37.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:37.349+0000 7fb444e8e700 1 -- 172.21.15.60:0/1793854408 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fb440057100 con 0x7fb4400b1bd0 2020-10-31T22:48:38.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.365+0000 7fb43cff9700 1 -- 172.21.15.60:0/1793854408 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v94) v1 ==== 133+0+0 (secure 0 0 0) 0x7fb434023020 con 0x7fb4400b1bd0 2020-10-31T22:48:38.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.369+0000 7fb444e8e700 1 -- 172.21.15.60:0/1793854408 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb420054f10 msgr2=0x7fb4200573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:38.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.369+0000 7fb444e8e700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb420054f10 0x7fb4200573d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7fb43000d000 tx=0x7fb430007ac0).stop 2020-10-31T22:48:38.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.369+0000 7fb444e8e700 1 -- 172.21.15.60:0/1793854408 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4400b1bd0 msgr2=0x7fb440065a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:38.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.369+0000 7fb444e8e700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4400b1bd0 0x7fb440065a20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7fb434002f30 tx=0x7fb434015000).stop 2020-10-31T22:48:38.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.369+0000 7fb444e8e700 1 -- 172.21.15.60:0/1793854408 shutdown_connections 2020-10-31T22:48:38.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.369+0000 7fb444e8e700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4400b2820 0x7fb440065f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:38.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.369+0000 7fb444e8e700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb420054f10 0x7fb4200573d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:38.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.369+0000 7fb444e8e700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb440063140 0x7fb44005c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.369+0000 7fb444e8e700 1 --2- 172.21.15.60:0/1793854408 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4400b1bd0 0x7fb440065a20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.369+0000 7fb444e8e700 1 -- 172.21.15.60:0/1793854408 >> 172.21.15.60:0/1793854408 conn(0x7fb44006a600 msgr2=0x7fb4400aaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:38.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.369+0000 7fb444e8e700 1 -- 172.21.15.60:0/1793854408 shutdown_connections 2020-10-31T22:48:38.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.369+0000 7fb444e8e700 1 -- 172.21.15.60:0/1793854408 wait complete. 2020-10-31T22:48:38.392 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:48:38.393 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-10-31T22:48:38.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.501+0000 7fc4b4afe700 1 Processor -- start 2020-10-31T22:48:38.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.501+0000 7fc4b4afe700 1 -- start start 2020-10-31T22:48:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc4b00ae040 0x7fc4b00af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc4b00aac80 0x7fc4b00ab0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b00aff00 con 0x7fc4b00b52a0 2020-10-31T22:48:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b00b0320 con 0x7fc4b00aac80 2020-10-31T22:48:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b00af9c0 con 0x7fc4b00ae040 2020-10-31T22:48:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4aed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc4b00aac80 0x7fc4b00ab0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:38.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4aed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc4b00aac80 0x7fc4b00ab0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46692/0 (socket says 172.21.15.60:46692) 2020-10-31T22:48:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4aed9d700 1 -- 172.21.15.60:0/1084470346 learned_addr learned my addr 172.21.15.60:0/1084470346 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4add9b700 1 --2- 172.21.15.60:0/1084470346 >> v2:172.21.15.66:3300/0 conn(0x7fc4b00ae040 0x7fc4b00af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4aed9d700 1 -- 172.21.15.60:0/1084470346 >> v2:172.21.15.66:3300/0 conn(0x7fc4b00ae040 msgr2=0x7fc4b00af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4aed9d700 1 --2- 172.21.15.60:0/1084470346 >> v2:172.21.15.66:3300/0 conn(0x7fc4b00ae040 0x7fc4b00af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4aed9d700 1 -- 172.21.15.60:0/1084470346 >> v1:172.21.15.66:6789/0 conn(0x7fc4b00b52a0 legacy=0x7fc4b0140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4aed9d700 1 -- 172.21.15.60:0/1084470346 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b00afc60 con 0x7fc4b00aac80 2020-10-31T22:48:38.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4aed9d700 1 --2- 172.21.15.60:0/1084470346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b00aac80 0x7fc4b00ab0d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fc4a80032b0 tx=0x7fc4a8009270).ready entity=mon.0 client_cookie=84f661fe035fa15a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:38.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4ad59a700 1 -- 172.21.15.60:0/1084470346 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4a8009e60 con 0x7fc4b00aac80 2020-10-31T22:48:38.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4ad59a700 1 -- 172.21.15.60:0/1084470346 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a800bc00 con 0x7fc4b00aac80 2020-10-31T22:48:38.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4ad59a700 1 -- 172.21.15.60:0/1084470346 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4a800bd70 con 0x7fc4b00aac80 2020-10-31T22:48:38.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 -- 172.21.15.60:0/1084470346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b00aac80 msgr2=0x7fc4b00ab0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 --2- 172.21.15.60:0/1084470346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b00aac80 0x7fc4b00ab0d0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 rx=0x7fc4a80032b0 tx=0x7fc4a8009270).stop 2020-10-31T22:48:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 -- 172.21.15.60:0/1084470346 shutdown_connections 2020-10-31T22:48:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 --2- 172.21.15.60:0/1084470346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b00aac80 0x7fc4b00ab0d0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 --2- 172.21.15.60:0/1084470346 >> v2:172.21.15.66:3300/0 conn(0x7fc4b00ae040 0x7fc4b00af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 -- 172.21.15.60:0/1084470346 >> 172.21.15.60:0/1084470346 conn(0x7fc4b0060c50 msgr2=0x7fc4b00b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 -- 172.21.15.60:0/1084470346 shutdown_connections 2020-10-31T22:48:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 -- 172.21.15.60:0/1084470346 wait complete. 2020-10-31T22:48:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 Processor -- start 2020-10-31T22:48:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.505+0000 7fc4b4afe700 1 -- start start 2020-10-31T22:48:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4b4afe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4b00aac80 0x7fc4b013e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4b4afe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b00ae040 0x7fc4b014ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4b4afe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4b00b52a0 0x7fc4b014f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:38.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4b4afe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00a8800 con 0x7fc4b00ae040 2020-10-31T22:48:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4b4afe700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b009f8e0 con 0x7fc4b00b52a0 2020-10-31T22:48:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4b4afe700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00649e0 con 0x7fc4b00aac80 2020-10-31T22:48:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4add9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b00ae040 0x7fc4b014ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4add9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b00ae040 0x7fc4b014ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46696/0 (socket says 172.21.15.60:46696) 2020-10-31T22:48:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4add9b700 1 -- 172.21.15.60:0/906801940 learned_addr learned my addr 172.21.15.60:0/906801940 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4ae59c700 1 --2- 172.21.15.60:0/906801940 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4b00aac80 0x7fc4b013e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4aed9d700 1 --2- 172.21.15.60:0/906801940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4b00b52a0 0x7fc4b014f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4add9b700 1 -- 172.21.15.60:0/906801940 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4b00aac80 msgr2=0x7fc4b013e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4add9b700 1 --2- 172.21.15.60:0/906801940 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4b00aac80 0x7fc4b013e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:38.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4add9b700 1 -- 172.21.15.60:0/906801940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4b00b52a0 msgr2=0x7fc4b014f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:38.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4add9b700 1 --2- 172.21.15.60:0/906801940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4b00b52a0 0x7fc4b014f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:38.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4add9b700 1 -- 172.21.15.60:0/906801940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b0064f50 con 0x7fc4b00ae040 2020-10-31T22:48:38.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4add9b700 1 --2- 172.21.15.60:0/906801940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b00ae040 0x7fc4b014ed40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7fc4a400c000 tx=0x7fc4a4006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:38.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc49f7fe700 1 -- 172.21.15.60:0/906801940 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4a400ca10 con 0x7fc4b00ae040 2020-10-31T22:48:38.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc49f7fe700 1 -- 172.21.15.60:0/906801940 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a400cb70 con 0x7fc4b00ae040 2020-10-31T22:48:38.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4b4afe700 1 -- 172.21.15.60:0/906801940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b0065250 con 0x7fc4b00ae040 2020-10-31T22:48:38.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc49f7fe700 1 -- 172.21.15.60:0/906801940 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc4a40123f0 con 0x7fc4b00ae040 2020-10-31T22:48:38.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4b4afe700 1 -- 172.21.15.60:0/906801940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b014f720 con 0x7fc4b00ae040 2020-10-31T22:48:38.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc49f7fe700 1 -- 172.21.15.60:0/906801940 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc4a4012550 con 0x7fc4b00ae040 2020-10-31T22:48:38.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4b4afe700 1 -- 172.21.15.60:0/906801940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b0064850 con 0x7fc4b00ae040 2020-10-31T22:48:38.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc49f7fe700 1 --2- 172.21.15.60:0/906801940 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc48c054f10 0x7fc48c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:38.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc49f7fe700 1 -- 172.21.15.60:0/906801940 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fc4a406d9a0 con 0x7fc4b00ae040 2020-10-31T22:48:38.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4ae59c700 1 --2- 172.21.15.60:0/906801940 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc48c054f10 0x7fc48c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:38.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.509+0000 7fc4ae59c700 1 --2- 172.21.15.60:0/906801940 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc48c054f10 0x7fc48c0573d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fc4a000d000 tx=0x7fc4a0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:38.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.517+0000 7fc49f7fe700 1 -- 172.21.15.60:0/906801940 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc4a4044030 con 0x7fc4b00ae040 2020-10-31T22:48:38.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:38.653+0000 7fc4b4afe700 1 -- 172.21.15.60:0/906801940 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fc4b0064490 con 0x7fc4b00ae040 2020-10-31T22:48:39.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.505+0000 7fc49f7fe700 1 -- 172.21.15.60:0/906801940 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v97) v1 ==== 125+0+0 (secure 0 0 0) 0x7fc4a4047650 con 0x7fc4b00ae040 2020-10-31T22:48:39.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.509+0000 7fc4b4afe700 1 -- 172.21.15.60:0/906801940 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc48c054f10 msgr2=0x7fc48c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:39.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.509+0000 7fc4b4afe700 1 --2- 172.21.15.60:0/906801940 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc48c054f10 0x7fc48c0573d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7fc4a000d000 tx=0x7fc4a0009040).stop 2020-10-31T22:48:39.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.509+0000 7fc4b4afe700 1 -- 172.21.15.60:0/906801940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b00ae040 msgr2=0x7fc4b014ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:39.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.509+0000 7fc4b4afe700 1 --2- 172.21.15.60:0/906801940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b00ae040 0x7fc4b014ed40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 rx=0x7fc4a400c000 tx=0x7fc4a4006dc0).stop 2020-10-31T22:48:39.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.513+0000 7fc4b4afe700 1 -- 172.21.15.60:0/906801940 shutdown_connections 2020-10-31T22:48:39.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.513+0000 7fc4b4afe700 1 --2- 172.21.15.60:0/906801940 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc48c054f10 0x7fc48c0573d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:39.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.513+0000 7fc4b4afe700 1 --2- 172.21.15.60:0/906801940 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4b00b52a0 0x7fc4b014f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:39.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.513+0000 7fc4b4afe700 1 --2- 172.21.15.60:0/906801940 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4b00aac80 0x7fc4b013e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:39.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.513+0000 7fc4b4afe700 1 --2- 172.21.15.60:0/906801940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc4b00ae040 0x7fc4b014ed40 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:39.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.513+0000 7fc4b4afe700 1 -- 172.21.15.60:0/906801940 >> 172.21.15.60:0/906801940 conn(0x7fc4b0060c50 msgr2=0x7fc4b00672f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:39.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.513+0000 7fc4b4afe700 1 -- 172.21.15.60:0/906801940 shutdown_connections 2020-10-31T22:48:39.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.513+0000 7fc4b4afe700 1 -- 172.21.15.60:0/906801940 wait complete. 2020-10-31T22:48:39.527 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2020-10-31T22:48:39.532 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-10-31T22:48:39.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.641+0000 7f7562dc0700 1 Processor -- start 2020-10-31T22:48:39.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.641+0000 7f7562dc0700 1 -- start start 2020-10-31T22:48:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f7562dc0700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f755c065f70 0x7f755c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f7562dc0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c066410 con 0x7f755c0b2e20 2020-10-31T22:48:39.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f7562dc0700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755c0666b0 con 0x7f755c05c660 2020-10-31T22:48:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f7562dc0700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f755c066d60 con 0x7f755c065f70 2020-10-31T22:48:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f756135d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f755c0b2e20 0x7f755c142610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50842/0 (socket says 172.21.15.60:50842) 2020-10-31T22:48:39.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f756135d700 1 -- 172.21.15.60:0/208537665 learned_addr learned my addr 172.21.15.60:0/208537665 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755bfff700 1 --2- 172.21.15.60:0/208537665 >> v2:172.21.15.66:3300/0 conn(0x7f755c065f70 0x7f755c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 -- 172.21.15.60:0/208537665 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786897428 0 0) 0x7f755c066410 con 0x7f755c0b2e20 2020-10-31T22:48:39.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 -- 172.21.15.60:0/208537665 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7548003230 con 0x7f755c0b2e20 2020-10-31T22:48:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 -- 172.21.15.60:0/208537665 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2480923879 0 0) 0x7f7548003230 con 0x7f755c0b2e20 2020-10-31T22:48:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 -- 172.21.15.60:0/208537665 >> v2:172.21.15.66:3300/0 conn(0x7f755c065f70 msgr2=0x7f755c0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 --2- 172.21.15.60:0/208537665 >> v2:172.21.15.66:3300/0 conn(0x7f755c065f70 0x7f755c0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:39.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 -- 172.21.15.60:0/208537665 >> v1:172.21.15.66:6789/0 conn(0x7f755c05c660 legacy=0x7f755c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:39.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 -- 172.21.15.60:0/208537665 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c142170 con 0x7f755c0b2e20 2020-10-31T22:48:39.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 -- 172.21.15.60:0/208537665 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f7554001a50 con 0x7f755c0b2e20 2020-10-31T22:48:39.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 -- 172.21.15.60:0/208537665 >> v1:172.21.15.60:6789/0 conn(0x7f755c0b2e20 legacy=0x7f755c142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 --2- 172.21.15.60:0/208537665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7548003770 0x7f7548003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 --2- 172.21.15.60:0/208537665 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75480044d0 0x7f7548004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 --2- 172.21.15.60:0/208537665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7548004e40 0x7f754800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:39.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 -- 172.21.15.60:0/208537665 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754800bc10 con 0x7f7548004e40 2020-10-31T22:48:39.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 -- 172.21.15.60:0/208537665 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754800bd50 con 0x7f7548003770 2020-10-31T22:48:39.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 -- 172.21.15.60:0/208537665 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754800be90 con 0x7f75480044d0 2020-10-31T22:48:39.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f756135d700 1 --2- 172.21.15.60:0/208537665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7548004e40 0x7f754800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:39.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f7560b5c700 1 --2- 172.21.15.60:0/208537665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7548003770 0x7f7548003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:39.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755bfff700 1 --2- 172.21.15.60:0/208537665 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75480044d0 0x7f7548004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:39.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f756135d700 1 -- 172.21.15.60:0/208537665 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75480044d0 msgr2=0x7f7548004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:39.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f756135d700 1 --2- 172.21.15.60:0/208537665 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f75480044d0 0x7f7548004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:39.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f756135d700 1 -- 172.21.15.60:0/208537665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7548003770 msgr2=0x7f7548003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:39.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f756135d700 1 --2- 172.21.15.60:0/208537665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7548003770 0x7f7548003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:39.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f756135d700 1 -- 172.21.15.60:0/208537665 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7548003230 con 0x7f7548004e40 2020-10-31T22:48:39.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f7560b5c700 1 --2- 172.21.15.60:0/208537665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7548003770 0x7f7548003b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:39.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f756135d700 1 -- 172.21.15.60:0/208537665 reap_dead start 2020-10-31T22:48:39.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f756135d700 1 --2- 172.21.15.60:0/208537665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7548004e40 0x7f754800b720 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f7554001760 tx=0x7f755c066840).ready entity=mon.0 client_cookie=8a11eaee94684d9c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:39.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 -- 172.21.15.60:0/208537665 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7554005b70 con 0x7f7548004e40 2020-10-31T22:48:39.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 -- 172.21.15.60:0/208537665 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7554005cd0 con 0x7f7548004e40 2020-10-31T22:48:39.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f755b7fe700 1 -- 172.21.15.60:0/208537665 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f75540072c0 con 0x7f7548004e40 2020-10-31T22:48:39.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f7562dc0700 1 -- 172.21.15.60:0/208537665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7548004e40 msgr2=0x7f754800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:39.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f7562dc0700 1 --2- 172.21.15.60:0/208537665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7548004e40 0x7f754800b720 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 rx=0x7f7554001760 tx=0x7f755c066840).stop 2020-10-31T22:48:39.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f7562dc0700 1 -- 172.21.15.60:0/208537665 shutdown_connections 2020-10-31T22:48:39.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f7562dc0700 1 --2- 172.21.15.60:0/208537665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7548004e40 0x7f754800b720 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:39.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f7562dc0700 1 -- 172.21.15.60:0/208537665 >> 172.21.15.60:0/208537665 conn(0x7f755c0601e0 msgr2=0x7f755c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:39.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f7562dc0700 1 -- 172.21.15.60:0/208537665 shutdown_connections 2020-10-31T22:48:39.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.645+0000 7f7562dc0700 1 -- 172.21.15.60:0/208537665 wait complete. 2020-10-31T22:48:39.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f7562dc0700 1 Processor -- start 2020-10-31T22:48:39.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f7562dc0700 1 -- start start 2020-10-31T22:48:39.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f7562dc0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7548004e40 0x7f755c0a9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:39.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f7562dc0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f755c0a8090 0x7f755c09f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:39.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f7562dc0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f755c0ad280 0x7f755c1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:39.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f7562dc0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c154c00 con 0x7f7548004e40 2020-10-31T22:48:39.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f7562dc0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755c1546f0 con 0x7f755c0ad280 2020-10-31T22:48:39.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f7562dc0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755c09f8c0 con 0x7f755c0a8090 2020-10-31T22:48:39.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f7560b5c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7548004e40 0x7f755c0a9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:39.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f7560b5c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7548004e40 0x7f755c0a9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46716/0 (socket says 172.21.15.60:46716) 2020-10-31T22:48:39.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f7560b5c700 1 -- 172.21.15.60:0/3763379903 learned_addr learned my addr 172.21.15.60:0/3763379903 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:39.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f755bfff700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f755c0a8090 0x7f755c09f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:39.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f756135d700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f755c0ad280 0x7f755c1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:39.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f755bfff700 1 -- 172.21.15.60:0/3763379903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f755c0ad280 msgr2=0x7f755c1507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:39.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f755bfff700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f755c0ad280 0x7f755c1507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:39.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f755bfff700 1 -- 172.21.15.60:0/3763379903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7548004e40 msgr2=0x7f755c0a9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:39.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f755bfff700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7548004e40 0x7f755c0a9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:39.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f755bfff700 1 -- 172.21.15.60:0/3763379903 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f755c154960 con 0x7f755c0a8090 2020-10-31T22:48:39.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f7560b5c700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7548004e40 0x7f755c0a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:39.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.649+0000 7f755bfff700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f755c0a8090 0x7f755c09f0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f755c09e390 tx=0x7f754c008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:39.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.653+0000 7f7559ffb700 1 -- 172.21.15.60:0/3763379903 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f754c0126e0 con 0x7f755c0a8090 2020-10-31T22:48:39.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.653+0000 7f7559ffb700 1 -- 172.21.15.60:0/3763379903 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c012840 con 0x7f755c0a8090 2020-10-31T22:48:39.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.653+0000 7f7562dc0700 1 -- 172.21.15.60:0/3763379903 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c0a94f0 con 0x7f755c0a8090 2020-10-31T22:48:39.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.653+0000 7f7559ffb700 1 -- 172.21.15.60:0/3763379903 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f754c012ba0 con 0x7f755c0a8090 2020-10-31T22:48:39.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.653+0000 7f7562dc0700 1 -- 172.21.15.60:0/3763379903 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755c0ad6f0 con 0x7f755c0a8090 2020-10-31T22:48:39.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.653+0000 7f7562dc0700 1 -- 172.21.15.60:0/3763379903 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755c057100 con 0x7f755c0a8090 2020-10-31T22:48:39.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.653+0000 7f7559ffb700 1 -- 172.21.15.60:0/3763379903 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f754c012d00 con 0x7f755c0a8090 2020-10-31T22:48:39.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.653+0000 7f7559ffb700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f753c054f90 0x7f753c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:39.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.653+0000 7f7559ffb700 1 -- 172.21.15.60:0/3763379903 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f754c06ea40 con 0x7f755c0a8090 2020-10-31T22:48:39.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.653+0000 7f7560b5c700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f753c054f90 0x7f753c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:39.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.653+0000 7f7560b5c700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f753c054f90 0x7f753c057450 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f7550009000 tx=0x7f755000c040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:39.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.661+0000 7f7559ffb700 1 -- 172.21.15.60:0/3763379903 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f754c044fd0 con 0x7f755c0a8090 2020-10-31T22:48:39.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.849+0000 7f7562dc0700 1 -- 172.21.15.60:0/3763379903 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f755c05aa70 con 0x7f755c0a8090 2020-10-31T22:48:39.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.865+0000 7f7559ffb700 1 -- 172.21.15.60:0/3763379903 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 17 and data pool 18 v46) v1 ==== 189+0+0 (secure 0 0 0) 0x7f754c0485f0 con 0x7f755c0a8090 2020-10-31T22:48:39.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.873+0000 7f7562dc0700 1 -- 172.21.15.60:0/3763379903 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f753c054f90 msgr2=0x7f753c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.873+0000 7f7562dc0700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f753c054f90 0x7f753c057450 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f7550009000 tx=0x7f755000c040).stop 2020-10-31T22:48:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.873+0000 7f7562dc0700 1 -- 172.21.15.60:0/3763379903 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f755c0a8090 msgr2=0x7f755c09f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:39.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.873+0000 7f7562dc0700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f755c0a8090 0x7f755c09f0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f755c09e390 tx=0x7f754c008040).stop 2020-10-31T22:48:39.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.873+0000 7f7562dc0700 1 -- 172.21.15.60:0/3763379903 shutdown_connections 2020-10-31T22:48:39.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.873+0000 7f7562dc0700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f753c054f90 0x7f753c057450 secure :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0x7f7550009000 tx=0x7f755000c040).stop 2020-10-31T22:48:39.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.873+0000 7f7562dc0700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f755c0ad280 0x7f755c1507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:39.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.873+0000 7f7562dc0700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7548004e40 0x7f755c0a9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:39.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.873+0000 7f7562dc0700 1 --2- 172.21.15.60:0/3763379903 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f755c0a8090 0x7f755c09f0f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:39.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.873+0000 7f7562dc0700 1 -- 172.21.15.60:0/3763379903 >> 172.21.15.60:0/3763379903 conn(0x7f755c0601e0 msgr2=0x7f755c0b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:39.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.873+0000 7f7562dc0700 1 -- 172.21.15.60:0/3763379903 shutdown_connections 2020-10-31T22:48:39.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.873+0000 7f7562dc0700 1 -- 172.21.15.60:0/3763379903 wait complete. 2020-10-31T22:48:39.884 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 17 and data pool 18 2020-10-31T22:48:39.896 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:48:40.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.993+0000 7f29ba517700 1 Processor -- start 2020-10-31T22:48:40.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.993+0000 7f29ba517700 1 -- start start 2020-10-31T22:48:40.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.993+0000 7f29ba517700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f29b40b1a10 0x7f29b4142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.993+0000 7f29ba517700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b40abea0 con 0x7f29b40af200 2020-10-31T22:48:40.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.993+0000 7f29ba517700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b4141870 con 0x7f29b413ebe0 2020-10-31T22:48:40.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.993+0000 7f29ba517700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b4141b10 con 0x7f29b40b1a10 2020-10-31T22:48:40.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.993+0000 7f29b9d16700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f29b40af200 0x7f29b40b0850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50864/0 (socket says 172.21.15.60:50864) 2020-10-31T22:48:40.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.993+0000 7f29b9d16700 1 -- 172.21.15.60:0/1382461308 learned_addr learned my addr 172.21.15.60:0/1382461308 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:40.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.993+0000 7f29b9515700 1 --2- 172.21.15.60:0/1382461308 >> v2:172.21.15.66:3300/0 conn(0x7f29b40b1a10 0x7f29b4142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.993+0000 7f29abfff700 1 -- 172.21.15.60:0/1382461308 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279885908 0 0) 0x7f29b40abea0 con 0x7f29b40af200 2020-10-31T22:48:40.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.993+0000 7f29abfff700 1 -- 172.21.15.60:0/1382461308 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2998004340 con 0x7f29b40af200 2020-10-31T22:48:40.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29abfff700 1 -- 172.21.15.60:0/1382461308 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3775107968 0 0) 0x7f2998004340 con 0x7f29b40af200 2020-10-31T22:48:40.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29b9515700 1 -- 172.21.15.60:0/1382461308 >> v1:172.21.15.66:6789/0 conn(0x7f29b413ebe0 legacy=0x7f29b40afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29b9515700 1 -- 172.21.15.60:0/1382461308 >> v1:172.21.15.60:6789/0 conn(0x7f29b40af200 legacy=0x7f29b40b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29b9515700 1 -- 172.21.15.60:0/1382461308 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b4141db0 con 0x7f29b40b1a10 2020-10-31T22:48:40.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29b9515700 1 --2- 172.21.15.60:0/1382461308 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29b40b1a10 0x7f29b4142250 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f29ac001bf0 tx=0x7f29a4006dc0).ready entity=mon.1 client_cookie=9f3e4bcbe8cdbbdb server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:40.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29abfff700 1 -- 172.21.15.60:0/1382461308 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29ac001a50 con 0x7f29b40b1a10 2020-10-31T22:48:40.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29abfff700 1 -- 172.21.15.60:0/1382461308 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a4009620 con 0x7f29b40b1a10 2020-10-31T22:48:40.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29abfff700 1 -- 172.21.15.60:0/1382461308 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a4009790 con 0x7f29b40b1a10 2020-10-31T22:48:40.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29ba517700 1 -- 172.21.15.60:0/1382461308 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29b40b1a10 msgr2=0x7f29b4142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29ba517700 1 --2- 172.21.15.60:0/1382461308 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29b40b1a10 0x7f29b4142250 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f29ac001bf0 tx=0x7f29a4006dc0).stop 2020-10-31T22:48:40.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29ba517700 1 -- 172.21.15.60:0/1382461308 shutdown_connections 2020-10-31T22:48:40.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29ba517700 1 --2- 172.21.15.60:0/1382461308 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29b40b1a10 0x7f29b4142250 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29ba517700 1 -- 172.21.15.60:0/1382461308 >> 172.21.15.60:0/1382461308 conn(0x7f29b40b5300 msgr2=0x7f29b40b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:40.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29ba517700 1 -- 172.21.15.60:0/1382461308 shutdown_connections 2020-10-31T22:48:40.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:39.997+0000 7f29ba517700 1 -- 172.21.15.60:0/1382461308 wait complete. 2020-10-31T22:48:40.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29ba517700 1 Processor -- start 2020-10-31T22:48:40.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29ba517700 1 -- start start 2020-10-31T22:48:40.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29ba517700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b40af200 0x7f29b40aa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29ba517700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29b40b1a10 0x7f29b413e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29ba517700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29b413ebe0 0x7f29b4063380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29ba517700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4065b60 con 0x7f29b40af200 2020-10-31T22:48:40.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29ba517700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40aaf30 con 0x7f29b413ebe0 2020-10-31T22:48:40.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29ba517700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40ab6a0 con 0x7f29b40b1a10 2020-10-31T22:48:40.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29b9515700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b40af200 0x7f29b40aa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29b9515700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b40af200 0x7f29b40aa010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46730/0 (socket says 172.21.15.60:46730) 2020-10-31T22:48:40.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29b9515700 1 -- 172.21.15.60:0/3312056356 learned_addr learned my addr 172.21.15.60:0/3312056356 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:40.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29b9d16700 1 --2- 172.21.15.60:0/3312056356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29b413ebe0 0x7f29b4063380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29b8d14700 1 --2- 172.21.15.60:0/3312056356 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29b40b1a10 0x7f29b413e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29b9515700 1 -- 172.21.15.60:0/3312056356 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29b40b1a10 msgr2=0x7f29b413e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29b9515700 1 --2- 172.21.15.60:0/3312056356 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29b40b1a10 0x7f29b413e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29b9515700 1 -- 172.21.15.60:0/3312056356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29b413ebe0 msgr2=0x7f29b4063380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29b9515700 1 --2- 172.21.15.60:0/3312056356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29b413ebe0 0x7f29b4063380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29b9515700 1 -- 172.21.15.60:0/3312056356 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40ab160 con 0x7f29b40af200 2020-10-31T22:48:40.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29b9515700 1 --2- 172.21.15.60:0/3312056356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b40af200 0x7f29b40aa010 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f29ac001bf0 tx=0x7f29b413f160).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:40.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29aa7fc700 1 -- 172.21.15.60:0/3312056356 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a4012ba0 con 0x7f29b40af200 2020-10-31T22:48:40.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29aa7fc700 1 -- 172.21.15.60:0/3312056356 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a4012d00 con 0x7f29b40af200 2020-10-31T22:48:40.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29ba517700 1 -- 172.21.15.60:0/3312056356 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b40ab400 con 0x7f29b40af200 2020-10-31T22:48:40.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29aa7fc700 1 -- 172.21.15.60:0/3312056356 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a401e630 con 0x7f29b40af200 2020-10-31T22:48:40.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.001+0000 7f29ba517700 1 -- 172.21.15.60:0/3312056356 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b40ab8d0 con 0x7f29b40af200 2020-10-31T22:48:40.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.005+0000 7f29ba517700 1 -- 172.21.15.60:0/3312056356 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b40ab8d0 con 0x7f29b40af200 2020-10-31T22:48:40.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.005+0000 7f29aa7fc700 1 -- 172.21.15.60:0/3312056356 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f29a4024020 con 0x7f29b40af200 2020-10-31T22:48:40.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.005+0000 7f29aa7fc700 1 --2- 172.21.15.60:0/3312056356 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f299c054f10 0x7f299c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.005+0000 7f29aa7fc700 1 -- 172.21.15.60:0/3312056356 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f29a406eb10 con 0x7f29b40af200 2020-10-31T22:48:40.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.005+0000 7f29b8d14700 1 --2- 172.21.15.60:0/3312056356 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f299c054f10 0x7f299c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.005+0000 7f29b8d14700 1 --2- 172.21.15.60:0/3312056356 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f299c054f10 0x7f299c0573d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f29b000d000 tx=0x7f29b0007b60).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:40.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.013+0000 7f29aa7fc700 1 -- 172.21.15.60:0/3312056356 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f29a4045030 con 0x7f29b40af200 2020-10-31T22:48:40.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.149+0000 7f29ba517700 1 -- 172.21.15.60:0/3312056356 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29b40ab8d0 con 0x7f29b40af200 2020-10-31T22:48:40.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.153+0000 7f29aa7fc700 1 -- 172.21.15.60:0/3312056356 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f29a4048650 con 0x7f29b40af200 2020-10-31T22:48:40.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.157+0000 7f29ba517700 1 -- 172.21.15.60:0/3312056356 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f299c054f10 msgr2=0x7f299c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.157+0000 7f29ba517700 1 --2- 172.21.15.60:0/3312056356 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f299c054f10 0x7f299c0573d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f29b000d000 tx=0x7f29b0007b60).stop 2020-10-31T22:48:40.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.157+0000 7f29ba517700 1 -- 172.21.15.60:0/3312056356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b40af200 msgr2=0x7f29b40aa010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.157+0000 7f29ba517700 1 --2- 172.21.15.60:0/3312056356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b40af200 0x7f29b40aa010 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 rx=0x7f29ac001bf0 tx=0x7f29b413f160).stop 2020-10-31T22:48:40.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.157+0000 7f29ba517700 1 -- 172.21.15.60:0/3312056356 shutdown_connections 2020-10-31T22:48:40.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.157+0000 7f29ba517700 1 --2- 172.21.15.60:0/3312056356 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f299c054f10 0x7f299c0573d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.157+0000 7f29ba517700 1 --2- 172.21.15.60:0/3312056356 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29b413ebe0 0x7f29b4063380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.157+0000 7f29ba517700 1 --2- 172.21.15.60:0/3312056356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29b40af200 0x7f29b40aa010 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.157+0000 7f29ba517700 1 --2- 172.21.15.60:0/3312056356 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29b40b1a10 0x7f29b413e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.157+0000 7f29ba517700 1 -- 172.21.15.60:0/3312056356 >> 172.21.15.60:0/3312056356 conn(0x7f29b40b5300 msgr2=0x7f29b40b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:40.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.157+0000 7f29ba517700 1 -- 172.21.15.60:0/3312056356 shutdown_connections 2020-10-31T22:48:40.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.157+0000 7f29ba517700 1 -- 172.21.15.60:0/3312056356 wait complete. 2020-10-31T22:48:40.172 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:40.172 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":98,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:48:39.857558+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:48:37.407586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2020-10-31T22:48:38.710432+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:48:40.188 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:48:40.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7f59e700 1 Processor -- start 2020-10-31T22:48:40.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7f59e700 1 -- start start 2020-10-31T22:48:40.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7f59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4b800b5570 0x7f4b800b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7f59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b80145180 con 0x7f4b800b24a0 2020-10-31T22:48:40.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7f59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b800b0670 con 0x7f4b80141fe0 2020-10-31T22:48:40.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7f59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b800afae0 con 0x7f4b800b5570 2020-10-31T22:48:40.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b77fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4b800b24a0 0x7f4b80145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50876/0 (socket says 172.21.15.60:50876) 2020-10-31T22:48:40.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b77fff700 1 -- 172.21.15.60:0/1645020971 learned_addr learned my addr 172.21.15.60:0/1645020971 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:40.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7e59c700 1 --2- 172.21.15.60:0/1645020971 >> v2:172.21.15.66:3300/0 conn(0x7f4b800b5570 0x7f4b800b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212741234 0 0) 0x7f4b80145180 con 0x7f4b800b24a0 2020-10-31T22:48:40.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b60003230 con 0x7f4b800b24a0 2020-10-31T22:48:40.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035658951 0 0) 0x7f4b800b0670 con 0x7f4b80141fe0 2020-10-31T22:48:40.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b80145180 con 0x7f4b80141fe0 2020-10-31T22:48:40.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4173097499 0 0) 0x7f4b60003230 con 0x7f4b800b24a0 2020-10-31T22:48:40.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 >> v2:172.21.15.66:3300/0 conn(0x7f4b800b5570 msgr2=0x7f4b800b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:40.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7dd9b700 1 --2- 172.21.15.60:0/1645020971 >> v2:172.21.15.66:3300/0 conn(0x7f4b800b5570 0x7f4b800b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 >> v1:172.21.15.66:6789/0 conn(0x7f4b80141fe0 legacy=0x7f4b80142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800b0910 con 0x7f4b800b24a0 2020-10-31T22:48:40.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f4b680016d0 con 0x7f4b800b24a0 2020-10-31T22:48:40.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.297+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 >> v1:172.21.15.60:6789/0 conn(0x7f4b800b24a0 legacy=0x7f4b80145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7dd9b700 1 --2- 172.21.15.60:0/1645020971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b600038b0 0x7f4b60003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7dd9b700 1 --2- 172.21.15.60:0/1645020971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b600044d0 0x7f4b60004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7dd9b700 1 --2- 172.21.15.60:0/1645020971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b60004e40 0x7f4b6000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800afae0 con 0x7f4b60004e40 2020-10-31T22:48:40.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6000bc10 con 0x7f4b600038b0 2020-10-31T22:48:40.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6000bda0 con 0x7f4b600044d0 2020-10-31T22:48:40.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7ed9d700 1 --2- 172.21.15.60:0/1645020971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b60004e40 0x7f4b6000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7e59c700 1 --2- 172.21.15.60:0/1645020971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b600038b0 0x7f4b60003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b77fff700 1 --2- 172.21.15.60:0/1645020971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b600044d0 0x7f4b60004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7ed9d700 1 -- 172.21.15.60:0/1645020971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b600044d0 msgr2=0x7f4b60004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:40.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7ed9d700 1 --2- 172.21.15.60:0/1645020971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b600044d0 0x7f4b60004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7ed9d700 1 -- 172.21.15.60:0/1645020971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b600038b0 msgr2=0x7f4b60003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:40.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7ed9d700 1 --2- 172.21.15.60:0/1645020971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b600038b0 0x7f4b60003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7ed9d700 1 -- 172.21.15.60:0/1645020971 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b60003230 con 0x7f4b60004e40 2020-10-31T22:48:40.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7ed9d700 1 -- 172.21.15.60:0/1645020971 reap_dead start 2020-10-31T22:48:40.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7ed9d700 1 --2- 172.21.15.60:0/1645020971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b60004e40 0x7f4b6000b720 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f4b78001450 tx=0x7f4b78007ee0).ready entity=mon.0 client_cookie=935e2b3ec95c1feb server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:40.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b780020c0 con 0x7f4b60004e40 2020-10-31T22:48:40.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b7800cc00 con 0x7f4b60004e40 2020-10-31T22:48:40.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7dd9b700 1 -- 172.21.15.60:0/1645020971 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b78012400 con 0x7f4b60004e40 2020-10-31T22:48:40.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7f59e700 1 -- 172.21.15.60:0/1645020971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b60004e40 msgr2=0x7f4b6000b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7f59e700 1 --2- 172.21.15.60:0/1645020971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b60004e40 0x7f4b6000b720 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 rx=0x7f4b78001450 tx=0x7f4b78007ee0).stop 2020-10-31T22:48:40.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7f59e700 1 -- 172.21.15.60:0/1645020971 shutdown_connections 2020-10-31T22:48:40.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7f59e700 1 --2- 172.21.15.60:0/1645020971 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b60004e40 0x7f4b6000b720 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7f59e700 1 -- 172.21.15.60:0/1645020971 >> 172.21.15.60:0/1645020971 conn(0x7f4b800b8e90 msgr2=0x7f4b800b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:40.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7f59e700 1 -- 172.21.15.60:0/1645020971 shutdown_connections 2020-10-31T22:48:40.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.301+0000 7f4b7f59e700 1 -- 172.21.15.60:0/1645020971 wait complete. 2020-10-31T22:48:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b7f59e700 1 Processor -- start 2020-10-31T22:48:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b7f59e700 1 -- start start 2020-10-31T22:48:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b7f59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b60004e40 0x7f4b801413f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b7f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b80144820 0x7f4b80144040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b7f59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b801540d0 0x7f4b80154550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b7f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800b7fe0 con 0x7f4b80144820 2020-10-31T22:48:40.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b7f59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b800b1270 con 0x7f4b801540d0 2020-10-31T22:48:40.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b7f59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b80144fa0 con 0x7f4b60004e40 2020-10-31T22:48:40.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b77fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b80144820 0x7f4b80144040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b77fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b80144820 0x7f4b80144040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46752/0 (socket says 172.21.15.60:46752) 2020-10-31T22:48:40.326 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b77fff700 1 -- 172.21.15.60:0/545435495 learned_addr learned my addr 172.21.15.60:0/545435495 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:40.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b7ed9d700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b801540d0 0x7f4b80154550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.327 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b7e59c700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b60004e40 0x7f4b801413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b77fff700 1 -- 172.21.15.60:0/545435495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b60004e40 msgr2=0x7f4b801413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b77fff700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b60004e40 0x7f4b801413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b77fff700 1 -- 172.21.15.60:0/545435495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b801540d0 msgr2=0x7f4b80154550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b77fff700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b801540d0 0x7f4b80154550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b77fff700 1 -- 172.21.15.60:0/545435495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b800b14a0 con 0x7f4b80144820 2020-10-31T22:48:40.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b7ed9d700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b801540d0 0x7f4b80154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:40.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b77fff700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b80144820 0x7f4b80144040 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f4b6800d000 tx=0x7f4b800b0aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:40.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b777fe700 1 -- 172.21.15.60:0/545435495 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6800f880 con 0x7f4b80144820 2020-10-31T22:48:40.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b777fe700 1 -- 172.21.15.60:0/545435495 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6800f9e0 con 0x7f4b80144820 2020-10-31T22:48:40.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b7f59e700 1 -- 172.21.15.60:0/545435495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b800b1740 con 0x7f4b80144820 2020-10-31T22:48:40.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b777fe700 1 -- 172.21.15.60:0/545435495 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b6800fd40 con 0x7f4b80144820 2020-10-31T22:48:40.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.305+0000 7f4b7f59e700 1 -- 172.21.15.60:0/545435495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b80154a40 con 0x7f4b80144820 2020-10-31T22:48:40.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.309+0000 7f4b7f59e700 1 -- 172.21.15.60:0/545435495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b80057100 con 0x7f4b80144820 2020-10-31T22:48:40.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.309+0000 7f4b777fe700 1 -- 172.21.15.60:0/545435495 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4b6801b030 con 0x7f4b80144820 2020-10-31T22:48:40.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.309+0000 7f4b777fe700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4b64054f90 0x7f4b64057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.309+0000 7f4b7e59c700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4b64054f90 0x7f4b64057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.309+0000 7f4b777fe700 1 -- 172.21.15.60:0/545435495 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4b6806d320 con 0x7f4b80144820 2020-10-31T22:48:40.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.309+0000 7f4b7e59c700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4b64054f90 0x7f4b64057450 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f4b70008000 tx=0x7f4b70008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:40.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.317+0000 7f4b777fe700 1 -- 172.21.15.60:0/545435495 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4b68043840 con 0x7f4b80144820 2020-10-31T22:48:40.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.461+0000 7f4b7f59e700 1 -- 172.21.15.60:0/545435495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b8005a8e0 con 0x7f4b80144820 2020-10-31T22:48:40.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.461+0000 7f4b777fe700 1 -- 172.21.15.60:0/545435495 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16054 (secure 0 0 0) 0x7f4b68019030 con 0x7f4b80144820 2020-10-31T22:48:40.467 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:40.468 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":98,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:48:39.857558+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:48:37.407586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2020-10-31T22:48:38.710432+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:48:40.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.465+0000 7f4b7f59e700 1 -- 172.21.15.60:0/545435495 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4b64054f90 msgr2=0x7f4b64057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.465+0000 7f4b7f59e700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4b64054f90 0x7f4b64057450 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7f4b70008000 tx=0x7f4b70008040).stop 2020-10-31T22:48:40.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.465+0000 7f4b7f59e700 1 -- 172.21.15.60:0/545435495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b80144820 msgr2=0x7f4b80144040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.465+0000 7f4b7f59e700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b80144820 0x7f4b80144040 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 rx=0x7f4b6800d000 tx=0x7f4b800b0aa0).stop 2020-10-31T22:48:40.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.465+0000 7f4b7f59e700 1 -- 172.21.15.60:0/545435495 shutdown_connections 2020-10-31T22:48:40.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.465+0000 7f4b7f59e700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4b64054f90 0x7f4b64057450 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.465+0000 7f4b7f59e700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b801540d0 0x7f4b80154550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.465+0000 7f4b7f59e700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b60004e40 0x7f4b801413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.465+0000 7f4b7f59e700 1 --2- 172.21.15.60:0/545435495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b80144820 0x7f4b80144040 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.465+0000 7f4b7f59e700 1 -- 172.21.15.60:0/545435495 >> 172.21.15.60:0/545435495 conn(0x7f4b800b8e90 msgr2=0x7f4b8013e370 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:40.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.465+0000 7f4b7f59e700 1 -- 172.21.15.60:0/545435495 shutdown_connections 2020-10-31T22:48:40.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.465+0000 7f4b7f59e700 1 -- 172.21.15.60:0/545435495 wait complete. 2020-10-31T22:48:40.488 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-10-31T22:48:40.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.601+0000 7f6460a69700 1 Processor -- start 2020-10-31T22:48:40.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.601+0000 7f6460a69700 1 -- start start 2020-10-31T22:48:40.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6460a69700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645c05c660 0x7f645c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6460a69700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f645c0b2e20 0x7f645c142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6460a69700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645c066410 con 0x7f645c065f70 2020-10-31T22:48:40.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6460a69700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645c066d60 con 0x7f645c0b2e20 2020-10-31T22:48:40.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6460a69700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0b5e80 con 0x7f645c05c660 2020-10-31T22:48:40.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f645ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f645c0b2e20 0x7f645c142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f645ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f645c0b2e20 0x7f645c142610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46762/0 (socket says 172.21.15.60:46762) 2020-10-31T22:48:40.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f645ad9d700 1 -- 172.21.15.60:0/495424538 learned_addr learned my addr 172.21.15.60:0/495424538 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:40.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f645a59c700 1 --2- 172.21.15.60:0/495424538 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645c05c660 0x7f645c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f645ad9d700 1 -- 172.21.15.60:0/495424538 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645c05c660 msgr2=0x7f645c0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:40.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f645ad9d700 1 --2- 172.21.15.60:0/495424538 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645c05c660 0x7f645c0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f645ad9d700 1 -- 172.21.15.60:0/495424538 >> v1:172.21.15.66:6789/0 conn(0x7f645c065f70 legacy=0x7f645c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f645ad9d700 1 -- 172.21.15.60:0/495424538 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c0666b0 con 0x7f645c0b2e20 2020-10-31T22:48:40.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6459d9b700 1 -- 172.21.15.60:0/495424538 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2498274465 0 0) 0x7f645c066410 con 0x7f645c065f70 2020-10-31T22:48:40.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f645ad9d700 1 --2- 172.21.15.60:0/495424538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f645c0b2e20 0x7f645c142610 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f645c0afe90 tx=0x7f6454009270).ready entity=mon.0 client_cookie=e3d0e5043f96faf9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:40.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6459d9b700 1 -- 172.21.15.60:0/495424538 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6454009e90 con 0x7f645c0b2e20 2020-10-31T22:48:40.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6459d9b700 1 -- 172.21.15.60:0/495424538 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645400bbc0 con 0x7f645c0b2e20 2020-10-31T22:48:40.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6459d9b700 1 -- 172.21.15.60:0/495424538 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f645400bd30 con 0x7f645c0b2e20 2020-10-31T22:48:40.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6460a69700 1 -- 172.21.15.60:0/495424538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f645c0b2e20 msgr2=0x7f645c142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6460a69700 1 --2- 172.21.15.60:0/495424538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f645c0b2e20 0x7f645c142610 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 rx=0x7f645c0afe90 tx=0x7f6454009270).stop 2020-10-31T22:48:40.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6460a69700 1 -- 172.21.15.60:0/495424538 shutdown_connections 2020-10-31T22:48:40.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6460a69700 1 --2- 172.21.15.60:0/495424538 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f645c0b2e20 0x7f645c142610 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6460a69700 1 --2- 172.21.15.60:0/495424538 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645c05c660 0x7f645c0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6460a69700 1 -- 172.21.15.60:0/495424538 >> 172.21.15.60:0/495424538 conn(0x7f645c0601e0 msgr2=0x7f645c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:40.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6460a69700 1 -- 172.21.15.60:0/495424538 shutdown_connections 2020-10-31T22:48:40.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.605+0000 7f6460a69700 1 -- 172.21.15.60:0/495424538 wait complete. 2020-10-31T22:48:40.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.609+0000 7f6460a69700 1 Processor -- start 2020-10-31T22:48:40.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.609+0000 7f6460a69700 1 -- start start 2020-10-31T22:48:40.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.609+0000 7f6460a69700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f645c05c660 0x7f645c147b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.609+0000 7f6460a69700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645c065f70 0x7f645c0addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.609+0000 7f6460a69700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f645c0b2e20 0x7f645c0ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.609+0000 7f6460a69700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0aa0a0 con 0x7f645c05c660 2020-10-31T22:48:40.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.609+0000 7f6460a69700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0ab0a0 con 0x7f645c0b2e20 2020-10-31T22:48:40.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.609+0000 7f6460a69700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c0ab340 con 0x7f645c065f70 2020-10-31T22:48:40.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.609+0000 7f645a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f645c05c660 0x7f645c147b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.609+0000 7f645a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f645c05c660 0x7f645c147b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46766/0 (socket says 172.21.15.60:46766) 2020-10-31T22:48:40.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.609+0000 7f645a59c700 1 -- 172.21.15.60:0/4087112703 learned_addr learned my addr 172.21.15.60:0/4087112703 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:40.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.609+0000 7f645ad9d700 1 --2- 172.21.15.60:0/4087112703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f645c0b2e20 0x7f645c0ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.609+0000 7f6451d9b700 1 --2- 172.21.15.60:0/4087112703 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645c065f70 0x7f645c0addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.613+0000 7f645a59c700 1 -- 172.21.15.60:0/4087112703 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645c065f70 msgr2=0x7f645c0addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.613+0000 7f645a59c700 1 --2- 172.21.15.60:0/4087112703 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645c065f70 0x7f645c0addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.613+0000 7f645a59c700 1 -- 172.21.15.60:0/4087112703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f645c0b2e20 msgr2=0x7f645c0ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.613+0000 7f645a59c700 1 --2- 172.21.15.60:0/4087112703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f645c0b2e20 0x7f645c0ae2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.613+0000 7f645a59c700 1 -- 172.21.15.60:0/4087112703 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c0ac420 con 0x7f645c05c660 2020-10-31T22:48:40.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.613+0000 7f645a59c700 1 --2- 172.21.15.60:0/4087112703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f645c05c660 0x7f645c147b80 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f644c006a50 tx=0x7f644c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:40.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.613+0000 7f6453fff700 1 -- 172.21.15.60:0/4087112703 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f644c00ca10 con 0x7f645c05c660 2020-10-31T22:48:40.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.613+0000 7f6453fff700 1 -- 172.21.15.60:0/4087112703 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f644c00eed0 con 0x7f645c05c660 2020-10-31T22:48:40.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.613+0000 7f6453fff700 1 -- 172.21.15.60:0/4087112703 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f644c00cd60 con 0x7f645c05c660 2020-10-31T22:48:40.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.613+0000 7f6460a69700 1 -- 172.21.15.60:0/4087112703 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645c0ac6c0 con 0x7f645c05c660 2020-10-31T22:48:40.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.613+0000 7f6460a69700 1 -- 172.21.15.60:0/4087112703 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645c0ae7d0 con 0x7f645c05c660 2020-10-31T22:48:40.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.613+0000 7f6460a69700 1 -- 172.21.15.60:0/4087112703 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645c057100 con 0x7f645c05c660 2020-10-31T22:48:40.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.613+0000 7f6453fff700 1 -- 172.21.15.60:0/4087112703 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f644c01c460 con 0x7f645c05c660 2020-10-31T22:48:40.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.613+0000 7f6453fff700 1 --2- 172.21.15.60:0/4087112703 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6440054f90 0x7f6440057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:40.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.617+0000 7f6453fff700 1 -- 172.21.15.60:0/4087112703 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f644c06df30 con 0x7f645c05c660 2020-10-31T22:48:40.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.617+0000 7f6451d9b700 1 --2- 172.21.15.60:0/4087112703 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6440054f90 0x7f6440057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:40.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.617+0000 7f6451d9b700 1 --2- 172.21.15.60:0/4087112703 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6440054f90 0x7f6440057450 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f644400d000 tx=0x7f6444007980).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:40.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.621+0000 7f6453fff700 1 -- 172.21.15.60:0/4087112703 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f644c044350 con 0x7f645c05c660 2020-10-31T22:48:40.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.809+0000 7f6460a69700 1 -- 172.21.15.60:0/4087112703 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f645c05aa70 con 0x7f645c05c660 2020-10-31T22:48:40.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.869+0000 7f6453fff700 1 -- 172.21.15.60:0/4087112703 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7f644c047970 con 0x7f645c05c660 2020-10-31T22:48:40.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.873+0000 7f6460a69700 1 -- 172.21.15.60:0/4087112703 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6440054f90 msgr2=0x7f6440057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.873+0000 7f6460a69700 1 --2- 172.21.15.60:0/4087112703 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6440054f90 0x7f6440057450 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7f644400d000 tx=0x7f6444007980).stop 2020-10-31T22:48:40.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.873+0000 7f6460a69700 1 -- 172.21.15.60:0/4087112703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f645c05c660 msgr2=0x7f645c147b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:40.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.873+0000 7f6460a69700 1 --2- 172.21.15.60:0/4087112703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f645c05c660 0x7f645c147b80 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 rx=0x7f644c006a50 tx=0x7f644c006dc0).stop 2020-10-31T22:48:40.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.873+0000 7f6460a69700 1 -- 172.21.15.60:0/4087112703 shutdown_connections 2020-10-31T22:48:40.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.873+0000 7f6460a69700 1 --2- 172.21.15.60:0/4087112703 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6440054f90 0x7f6440057450 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.873+0000 7f6460a69700 1 --2- 172.21.15.60:0/4087112703 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f645c0b2e20 0x7f645c0ae2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.873+0000 7f6460a69700 1 --2- 172.21.15.60:0/4087112703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f645c05c660 0x7f645c147b80 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.873+0000 7f6460a69700 1 --2- 172.21.15.60:0/4087112703 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f645c065f70 0x7f645c0addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:40.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.873+0000 7f6460a69700 1 -- 172.21.15.60:0/4087112703 >> 172.21.15.60:0/4087112703 conn(0x7f645c0601e0 msgr2=0x7f645c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:40.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.873+0000 7f6460a69700 1 -- 172.21.15.60:0/4087112703 shutdown_connections 2020-10-31T22:48:40.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:40.873+0000 7f6460a69700 1 -- 172.21.15.60:0/4087112703 wait complete. 2020-10-31T22:48:40.895 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:41.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47df59e700 1 Processor -- start 2020-10-31T22:48:41.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47df59e700 1 -- start start 2020-10-31T22:48:41.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47df59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47e00b24a0 0x7f47e00b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47df59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f47e0141fe0 0x7f47e0142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47df59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e0145180 con 0x7f47e00b5570 2020-10-31T22:48:41.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47df59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e00afae0 con 0x7f47e00b24a0 2020-10-31T22:48:41.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47df59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e0141bf0 con 0x7f47e0141fe0 2020-10-31T22:48:41.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47ded9d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f47e0141fe0 0x7f47e0142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47ded9d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f47e0141fe0 0x7f47e0142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:57712/0 (socket says 172.21.15.60:57712) 2020-10-31T22:48:41.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47ded9d700 1 -- 172.21.15.60:0/939728398 learned_addr learned my addr 172.21.15.60:0/939728398 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:41.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47d5d9b700 1 --2- 172.21.15.60:0/939728398 >> v2:172.21.15.60:3300/0 conn(0x7f47e00b24a0 0x7f47e00b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47ded9d700 1 -- 172.21.15.60:0/939728398 >> v2:172.21.15.60:3300/0 conn(0x7f47e00b24a0 msgr2=0x7f47e00b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:41.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47ded9d700 1 --2- 172.21.15.60:0/939728398 >> v2:172.21.15.60:3300/0 conn(0x7f47e00b24a0 0x7f47e00b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47ded9d700 1 -- 172.21.15.60:0/939728398 >> v1:172.21.15.60:6789/0 conn(0x7f47e00b5570 legacy=0x7f47e0145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47ded9d700 1 -- 172.21.15.60:0/939728398 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e00b0670 con 0x7f47e0141fe0 2020-10-31T22:48:41.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47ded9d700 1 --2- 172.21.15.60:0/939728398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e0141fe0 0x7f47e0142490 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f47e005f580 tx=0x7f47d8009270).ready entity=mon.1 client_cookie=a851a98e7161a889 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47ddd9b700 1 -- 172.21.15.60:0/939728398 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47d8009e60 con 0x7f47e0141fe0 2020-10-31T22:48:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47ddd9b700 1 -- 172.21.15.60:0/939728398 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d800bbc0 con 0x7f47e0141fe0 2020-10-31T22:48:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47ddd9b700 1 -- 172.21.15.60:0/939728398 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47d800bd30 con 0x7f47e0141fe0 2020-10-31T22:48:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47df59e700 1 -- 172.21.15.60:0/939728398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e0141fe0 msgr2=0x7f47e0142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47df59e700 1 --2- 172.21.15.60:0/939728398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e0141fe0 0x7f47e0142490 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f47e005f580 tx=0x7f47d8009270).stop 2020-10-31T22:48:41.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47df59e700 1 -- 172.21.15.60:0/939728398 shutdown_connections 2020-10-31T22:48:41.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47df59e700 1 --2- 172.21.15.60:0/939728398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e0141fe0 0x7f47e0142490 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47df59e700 1 --2- 172.21.15.60:0/939728398 >> v2:172.21.15.60:3300/0 conn(0x7f47e00b24a0 0x7f47e00b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47df59e700 1 -- 172.21.15.60:0/939728398 >> 172.21.15.60:0/939728398 conn(0x7f47e00b8e90 msgr2=0x7f47e00b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:41.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.005+0000 7f47df59e700 1 -- 172.21.15.60:0/939728398 shutdown_connections 2020-10-31T22:48:41.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47df59e700 1 -- 172.21.15.60:0/939728398 wait complete. 2020-10-31T22:48:41.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47df59e700 1 Processor -- start 2020-10-31T22:48:41.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47df59e700 1 -- start start 2020-10-31T22:48:41.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47df59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e00b24a0 0x7f47e0144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47df59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e00b5570 0x7f47e00aec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47df59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47e0141fe0 0x7f47e00af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47df59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00b7ee0 con 0x7f47e00b5570 2020-10-31T22:48:41.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47df59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00b7190 con 0x7f47e00b24a0 2020-10-31T22:48:41.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47df59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00af600 con 0x7f47e0141fe0 2020-10-31T22:48:41.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47d5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e00b5570 0x7f47e00aec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47d5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e00b5570 0x7f47e00aec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46780/0 (socket says 172.21.15.60:46780) 2020-10-31T22:48:41.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47d5d9b700 1 -- 172.21.15.60:0/362035265 learned_addr learned my addr 172.21.15.60:0/362035265 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:41.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47de59c700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e00b24a0 0x7f47e0144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47ded9d700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47e0141fe0 0x7f47e00af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47d5d9b700 1 -- 172.21.15.60:0/362035265 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47e0141fe0 msgr2=0x7f47e00af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47d5d9b700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47e0141fe0 0x7f47e00af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47d5d9b700 1 -- 172.21.15.60:0/362035265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e00b24a0 msgr2=0x7f47e0144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47d5d9b700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e00b24a0 0x7f47e0144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47d5d9b700 1 -- 172.21.15.60:0/362035265 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e00b7c40 con 0x7f47e00b5570 2020-10-31T22:48:41.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47ded9d700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47e0141fe0 0x7f47e00af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:41.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47de59c700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e00b24a0 0x7f47e0144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:41.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47d5d9b700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e00b5570 0x7f47e00aec20 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f47c800c000 tx=0x7f47c8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:41.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47d7fff700 1 -- 172.21.15.60:0/362035265 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47c800cae0 con 0x7f47e00b5570 2020-10-31T22:48:41.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47d7fff700 1 -- 172.21.15.60:0/362035265 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c800cc40 con 0x7f47e00b5570 2020-10-31T22:48:41.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47df59e700 1 -- 172.21.15.60:0/362035265 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e00b73f0 con 0x7f47e00b5570 2020-10-31T22:48:41.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47d7fff700 1 -- 172.21.15.60:0/362035265 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47c80123f0 con 0x7f47e00b5570 2020-10-31T22:48:41.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.009+0000 7f47df59e700 1 -- 172.21.15.60:0/362035265 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e00b8080 con 0x7f47e00b5570 2020-10-31T22:48:41.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.013+0000 7f47df59e700 1 -- 172.21.15.60:0/362035265 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e00b7580 con 0x7f47e00b5570 2020-10-31T22:48:41.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.013+0000 7f47d7fff700 1 -- 172.21.15.60:0/362035265 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f47c8012550 con 0x7f47e00b5570 2020-10-31T22:48:41.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.013+0000 7f47d7fff700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47c4054f90 0x7f47c4057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.013+0000 7f47d7fff700 1 -- 172.21.15.60:0/362035265 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f47c806dfa0 con 0x7f47e00b5570 2020-10-31T22:48:41.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.013+0000 7f47de59c700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47c4054f90 0x7f47c4057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.013+0000 7f47de59c700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47c4054f90 0x7f47c4057450 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f47d000b000 tx=0x7f47d0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:41.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.017+0000 7f47d7fff700 1 -- 172.21.15.60:0/362035265 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f47c80443c0 con 0x7f47e00b5570 2020-10-31T22:48:41.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.209+0000 7f47df59e700 1 -- 172.21.15.60:0/362035265 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f47e0057100 con 0x7f47e00b5570 2020-10-31T22:48:41.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.209+0000 7f47d7fff700 1 -- 172.21.15.60:0/362035265 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2484 (secure 0 0 0) 0x7f47c80479e0 con 0x7f47e00b5570 2020-10-31T22:48:41.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.213+0000 7f47df59e700 1 -- 172.21.15.60:0/362035265 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47c4054f90 msgr2=0x7f47c4057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.213+0000 7f47df59e700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47c4054f90 0x7f47c4057450 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f47d000b000 tx=0x7f47d0009040).stop 2020-10-31T22:48:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.213+0000 7f47df59e700 1 -- 172.21.15.60:0/362035265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e00b5570 msgr2=0x7f47e00aec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.213+0000 7f47df59e700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e00b5570 0x7f47e00aec20 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 rx=0x7f47c800c000 tx=0x7f47c8006dc0).stop 2020-10-31T22:48:41.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.213+0000 7f47df59e700 1 -- 172.21.15.60:0/362035265 shutdown_connections 2020-10-31T22:48:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.213+0000 7f47df59e700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47e0141fe0 0x7f47e00af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.213+0000 7f47df59e700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47c4054f90 0x7f47c4057450 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.213+0000 7f47df59e700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47e00b24a0 0x7f47e0144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.213+0000 7f47df59e700 1 --2- 172.21.15.60:0/362035265 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47e00b5570 0x7f47e00aec20 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.213+0000 7f47df59e700 1 -- 172.21.15.60:0/362035265 >> 172.21.15.60:0/362035265 conn(0x7f47e00b8e90 msgr2=0x7f47e0065e80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:41.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.213+0000 7f47df59e700 1 -- 172.21.15.60:0/362035265 shutdown_connections 2020-10-31T22:48:41.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.213+0000 7f47df59e700 1 -- 172.21.15.60:0/362035265 wait complete. 2020-10-31T22:48:41.228 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 47 2020-10-31T22:48:41.230 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:41.230 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":47,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6822,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6835/458791799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458791799},{"type":"v1","addr":"172.21.15.60:6835","nonce":458791799}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45},{"gid":6825,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/332317680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":332317680},{"type":"v1","addr":"172.21.15.60:6837","nonce":332317680}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:48:39.857912+0000","modified":"2020-10-31T22:48:40.861506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6831},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6831":{"gid":6831,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/588884767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":588884767},{"type":"v1","addr":"172.21.15.66:6833","nonce":588884767}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-10-31T22:48:41.232 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:48:41.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.337+0000 7ff47a3b0700 1 Processor -- start 2020-10-31T22:48:41.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.337+0000 7ff47a3b0700 1 -- start start 2020-10-31T22:48:41.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff47a3b0700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff4740b1d50 0x7ff47405c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff47a3b0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4740b2130 con 0x7ff474140230 2020-10-31T22:48:41.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff47a3b0700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4740af380 con 0x7ff4740b0d60 2020-10-31T22:48:41.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff47a3b0700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47406a9b0 con 0x7ff4740b1d50 2020-10-31T22:48:41.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff479baf700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff474140230 0x7ff47413c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50926/0 (socket says 172.21.15.60:50926) 2020-10-31T22:48:41.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff479baf700 1 -- 172.21.15.60:0/3320507280 learned_addr learned my addr 172.21.15.60:0/3320507280 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:41.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff4793ae700 1 --2- 172.21.15.60:0/3320507280 >> v2:172.21.15.66:3300/0 conn(0x7ff4740b1d50 0x7ff47405c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff46bfff700 1 -- 172.21.15.60:0/3320507280 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070219468 0 0) 0x7ff4740b2130 con 0x7ff474140230 2020-10-31T22:48:41.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff46bfff700 1 -- 172.21.15.60:0/3320507280 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff458003230 con 0x7ff474140230 2020-10-31T22:48:41.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff4793ae700 1 -- 172.21.15.60:0/3320507280 >> v1:172.21.15.66:6789/0 conn(0x7ff4740b0d60 legacy=0x7ff47413fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff4793ae700 1 -- 172.21.15.60:0/3320507280 >> v1:172.21.15.60:6789/0 conn(0x7ff474140230 legacy=0x7ff47413c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff4793ae700 1 -- 172.21.15.60:0/3320507280 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47405b160 con 0x7ff4740b1d50 2020-10-31T22:48:41.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff4793ae700 1 --2- 172.21.15.60:0/3320507280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4740b1d50 0x7ff47405c6a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7ff470002f30 tx=0x7ff470006dc0).ready entity=mon.1 client_cookie=e27c4ffb94e08ba7 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:41.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff46bfff700 1 -- 172.21.15.60:0/3320507280 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff470009800 con 0x7ff4740b1d50 2020-10-31T22:48:41.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff46bfff700 1 -- 172.21.15.60:0/3320507280 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff470009960 con 0x7ff4740b1d50 2020-10-31T22:48:41.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff46bfff700 1 -- 172.21.15.60:0/3320507280 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff470009cc0 con 0x7ff4740b1d50 2020-10-31T22:48:41.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3320507280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4740b1d50 msgr2=0x7ff47405c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff47a3b0700 1 --2- 172.21.15.60:0/3320507280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4740b1d50 0x7ff47405c6a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7ff470002f30 tx=0x7ff470006dc0).stop 2020-10-31T22:48:41.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3320507280 shutdown_connections 2020-10-31T22:48:41.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff47a3b0700 1 --2- 172.21.15.60:0/3320507280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4740b1d50 0x7ff47405c6a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.341+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3320507280 >> 172.21.15.60:0/3320507280 conn(0x7ff4740b5300 msgr2=0x7ff4740b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:41.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.345+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3320507280 shutdown_connections 2020-10-31T22:48:41.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.345+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3320507280 wait complete. 2020-10-31T22:48:41.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.345+0000 7ff47a3b0700 1 Processor -- start 2020-10-31T22:48:41.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.345+0000 7ff47a3b0700 1 -- start start 2020-10-31T22:48:41.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff47a3b0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4740b0d60 0x7ff4740630f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff47a3b0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4740b1d50 0x7ff474151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff47a3b0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff474140230 0x7ff4740aab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff47a3b0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff474066cf0 con 0x7ff4740b0d60 2020-10-31T22:48:41.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff47a3b0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff474152410 con 0x7ff4740b1d50 2020-10-31T22:48:41.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff47a3b0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4740a9ec0 con 0x7ff474140230 2020-10-31T22:48:41.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff4793ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4740b0d60 0x7ff4740630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff4793ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4740b0d60 0x7ff4740630f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46792/0 (socket says 172.21.15.60:46792) 2020-10-31T22:48:41.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff4793ae700 1 -- 172.21.15.60:0/3959304583 learned_addr learned my addr 172.21.15.60:0/3959304583 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:41.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff478bad700 1 --2- 172.21.15.60:0/3959304583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4740b1d50 0x7ff474151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff479baf700 1 --2- 172.21.15.60:0/3959304583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff474140230 0x7ff4740aab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff4793ae700 1 -- 172.21.15.60:0/3959304583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff474140230 msgr2=0x7ff4740aab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff4793ae700 1 --2- 172.21.15.60:0/3959304583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff474140230 0x7ff4740aab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff4793ae700 1 -- 172.21.15.60:0/3959304583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4740b1d50 msgr2=0x7ff474151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff4793ae700 1 --2- 172.21.15.60:0/3959304583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4740b1d50 0x7ff474151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff4793ae700 1 -- 172.21.15.60:0/3959304583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4740aa160 con 0x7ff4740b0d60 2020-10-31T22:48:41.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff4793ae700 1 --2- 172.21.15.60:0/3959304583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4740b0d60 0x7ff4740630f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7ff470002f30 tx=0x7ff470015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:41.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff46a7fc700 1 -- 172.21.15.60:0/3959304583 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff470011b80 con 0x7ff4740b0d60 2020-10-31T22:48:41.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff46a7fc700 1 -- 172.21.15.60:0/3959304583 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff470011ce0 con 0x7ff4740b0d60 2020-10-31T22:48:41.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff46a7fc700 1 -- 172.21.15.60:0/3959304583 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff47001d630 con 0x7ff4740b0d60 2020-10-31T22:48:41.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3959304583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4740aa6c0 con 0x7ff4740b0d60 2020-10-31T22:48:41.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.349+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3959304583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4740a9300 con 0x7ff4740b0d60 2020-10-31T22:48:41.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.353+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3959304583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff474057100 con 0x7ff4740b0d60 2020-10-31T22:48:41.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.353+0000 7ff46a7fc700 1 -- 172.21.15.60:0/3959304583 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff470017070 con 0x7ff4740b0d60 2020-10-31T22:48:41.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.353+0000 7ff46a7fc700 1 --2- 172.21.15.60:0/3959304583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff45c054f10 0x7ff45c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.353+0000 7ff46a7fc700 1 -- 172.21.15.60:0/3959304583 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff47006e480 con 0x7ff4740b0d60 2020-10-31T22:48:41.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.353+0000 7ff478bad700 1 --2- 172.21.15.60:0/3959304583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff45c054f10 0x7ff45c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.353+0000 7ff478bad700 1 --2- 172.21.15.60:0/3959304583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff45c054f10 0x7ff45c0573d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7ff46400d000 tx=0x7ff464007b60).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:41.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.361+0000 7ff46a7fc700 1 -- 172.21.15.60:0/3959304583 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff4700449a0 con 0x7ff4740b0d60 2020-10-31T22:48:41.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.505+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3959304583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4740aa2f0 con 0x7ff4740b0d60 2020-10-31T22:48:41.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.505+0000 7ff46a7fc700 1 -- 172.21.15.60:0/3959304583 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+16041 (secure 0 0 0) 0x7ff470022090 con 0x7ff4740b0d60 2020-10-31T22:48:41.514 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:41.514 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":99,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:48:40.861615+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:48:37.407586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2020-10-31T22:48:38.710432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:48:41.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.509+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3959304583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff45c054f10 msgr2=0x7ff45c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.509+0000 7ff47a3b0700 1 --2- 172.21.15.60:0/3959304583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff45c054f10 0x7ff45c0573d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7ff46400d000 tx=0x7ff464007b60).stop 2020-10-31T22:48:41.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.509+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3959304583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4740b0d60 msgr2=0x7ff4740630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.509+0000 7ff47a3b0700 1 --2- 172.21.15.60:0/3959304583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4740b0d60 0x7ff4740630f0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 rx=0x7ff470002f30 tx=0x7ff470015000).stop 2020-10-31T22:48:41.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.509+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3959304583 shutdown_connections 2020-10-31T22:48:41.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.509+0000 7ff47a3b0700 1 --2- 172.21.15.60:0/3959304583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff474140230 0x7ff4740aab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.509+0000 7ff47a3b0700 1 --2- 172.21.15.60:0/3959304583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff4740b0d60 0x7ff4740630f0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.509+0000 7ff47a3b0700 1 --2- 172.21.15.60:0/3959304583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff45c054f10 0x7ff45c0573d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.509+0000 7ff47a3b0700 1 --2- 172.21.15.60:0/3959304583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4740b1d50 0x7ff474151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.509+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3959304583 >> 172.21.15.60:0/3959304583 conn(0x7ff4740b5300 msgr2=0x7ff47413f900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:41.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.509+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3959304583 shutdown_connections 2020-10-31T22:48:41.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.509+0000 7ff47a3b0700 1 -- 172.21.15.60:0/3959304583 wait complete. 2020-10-31T22:48:41.534 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:48:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.653+0000 7f3843fff700 1 Processor -- start 2020-10-31T22:48:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.653+0000 7f3843fff700 1 -- start start 2020-10-31T22:48:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.653+0000 7f3843fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38440b1570 0x7f3844024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.653+0000 7f3843fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3844025480 0x7f384407fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.653+0000 7f3843fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38440b1950 con 0x7f38440801c0 2020-10-31T22:48:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.653+0000 7f3843fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3844062720 con 0x7f3844025480 2020-10-31T22:48:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.653+0000 7f3843fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3844066cb0 con 0x7f38440b1570 2020-10-31T22:48:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.653+0000 7f3842ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3844025480 0x7f384407fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.653+0000 7f3842ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3844025480 0x7f384407fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46802/0 (socket says 172.21.15.60:46802) 2020-10-31T22:48:41.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.653+0000 7f3842ffd700 1 -- 172.21.15.60:0/3351802560 learned_addr learned my addr 172.21.15.60:0/3351802560 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.653+0000 7f38437fe700 1 --2- 172.21.15.60:0/3351802560 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38440b1570 0x7f3844024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3842ffd700 1 -- 172.21.15.60:0/3351802560 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38440b1570 msgr2=0x7f3844024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3842ffd700 1 --2- 172.21.15.60:0/3351802560 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38440b1570 0x7f3844024f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3842ffd700 1 -- 172.21.15.60:0/3351802560 >> v1:172.21.15.66:6789/0 conn(0x7f38440801c0 legacy=0x7f38440afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3842ffd700 1 -- 172.21.15.60:0/3351802560 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38440aca00 con 0x7f3844025480 2020-10-31T22:48:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3842ffd700 1 --2- 172.21.15.60:0/3351802560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3844025480 0x7f384407fcd0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f382c002f30 tx=0x7f382c006e80).ready entity=mon.0 client_cookie=cf4da278a6994dc server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f38427fc700 1 -- 172.21.15.60:0/3351802560 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f382c0097f0 con 0x7f3844025480 2020-10-31T22:48:41.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f38427fc700 1 -- 172.21.15.60:0/3351802560 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382c009950 con 0x7f3844025480 2020-10-31T22:48:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f38427fc700 1 -- 172.21.15.60:0/3351802560 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f382c009ac0 con 0x7f3844025480 2020-10-31T22:48:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3843fff700 1 -- 172.21.15.60:0/3351802560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3844025480 msgr2=0x7f384407fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3843fff700 1 --2- 172.21.15.60:0/3351802560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3844025480 0x7f384407fcd0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 rx=0x7f382c002f30 tx=0x7f382c006e80).stop 2020-10-31T22:48:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3843fff700 1 -- 172.21.15.60:0/3351802560 shutdown_connections 2020-10-31T22:48:41.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3843fff700 1 --2- 172.21.15.60:0/3351802560 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38440b1570 0x7f3844024f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3843fff700 1 --2- 172.21.15.60:0/3351802560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3844025480 0x7f384407fcd0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3843fff700 1 -- 172.21.15.60:0/3351802560 >> 172.21.15.60:0/3351802560 conn(0x7f38440b5440 msgr2=0x7f38440b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3843fff700 1 -- 172.21.15.60:0/3351802560 shutdown_connections 2020-10-31T22:48:41.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3843fff700 1 -- 172.21.15.60:0/3351802560 wait complete. 2020-10-31T22:48:41.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3843fff700 1 Processor -- start 2020-10-31T22:48:41.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.657+0000 7f3843fff700 1 -- start start 2020-10-31T22:48:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3843fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3844025480 0x7f384409fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3843fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38440801c0 0x7f3844066060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3843fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38440b1570 0x7f3844141b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3843fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384409e550 con 0x7f38440b1570 2020-10-31T22:48:41.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3843fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38441414c0 con 0x7f38440801c0 2020-10-31T22:48:41.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3843fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384409e010 con 0x7f3844025480 2020-10-31T22:48:41.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3849418700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38440b1570 0x7f3844141b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3849418700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38440b1570 0x7f3844141b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46810/0 (socket says 172.21.15.60:46810) 2020-10-31T22:48:41.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3842ffd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38440801c0 0x7f3844066060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3849418700 1 -- 172.21.15.60:0/1382839575 learned_addr learned my addr 172.21.15.60:0/1382839575 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:41.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f38437fe700 1 --2- 172.21.15.60:0/1382839575 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3844025480 0x7f384409fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3849418700 1 -- 172.21.15.60:0/1382839575 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3844025480 msgr2=0x7f384409fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3849418700 1 --2- 172.21.15.60:0/1382839575 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3844025480 0x7f384409fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3849418700 1 -- 172.21.15.60:0/1382839575 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38440801c0 msgr2=0x7f3844066060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3849418700 1 --2- 172.21.15.60:0/1382839575 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38440801c0 0x7f3844066060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3849418700 1 -- 172.21.15.60:0/1382839575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384409e2b0 con 0x7f38440b1570 2020-10-31T22:48:41.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3849418700 1 --2- 172.21.15.60:0/1382839575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38440b1570 0x7f3844141b10 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f38440b32e0 tx=0x7f383c007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:41.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f383bfff700 1 -- 172.21.15.60:0/1382839575 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f383c00ce20 con 0x7f38440b1570 2020-10-31T22:48:41.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f383bfff700 1 -- 172.21.15.60:0/1382839575 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c00a7b0 con 0x7f38440b1570 2020-10-31T22:48:41.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3843fff700 1 -- 172.21.15.60:0/1382839575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38440a1d20 con 0x7f38440b1570 2020-10-31T22:48:41.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f383bfff700 1 -- 172.21.15.60:0/1382839575 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f383c00ab10 con 0x7f38440b1570 2020-10-31T22:48:41.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.661+0000 7f3843fff700 1 -- 172.21.15.60:0/1382839575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3844025cb0 con 0x7f38440b1570 2020-10-31T22:48:41.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.665+0000 7f3843fff700 1 -- 172.21.15.60:0/1382839575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3844025f00 con 0x7f38440b1570 2020-10-31T22:48:41.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.665+0000 7f383bfff700 1 -- 172.21.15.60:0/1382839575 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f383c019030 con 0x7f38440b1570 2020-10-31T22:48:41.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.665+0000 7f383bfff700 1 --2- 172.21.15.60:0/1382839575 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3828054f00 0x7f38280573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:41.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.665+0000 7f383bfff700 1 -- 172.21.15.60:0/1382839575 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f383c06d220 con 0x7f38440b1570 2020-10-31T22:48:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.665+0000 7f38437fe700 1 --2- 172.21.15.60:0/1382839575 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3828054f00 0x7f38280573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.665+0000 7f38437fe700 1 --2- 172.21.15.60:0/1382839575 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3828054f00 0x7f38280573c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f3834008000 tx=0x7f3834008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:41.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.669+0000 7f383bfff700 1 -- 172.21.15.60:0/1382839575 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f383c043740 con 0x7f38440b1570 2020-10-31T22:48:41.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.861+0000 7f3843fff700 1 -- 172.21.15.60:0/1382839575 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f3844057100 con 0x7f38440b1570 2020-10-31T22:48:41.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.869+0000 7f383bfff700 1 -- 172.21.15.60:0/1382839575 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v23) v1 ==== 184+0+0 (secure 0 0 0) 0x7f383c046d60 con 0x7f38440b1570 2020-10-31T22:48:41.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.873+0000 7f3843fff700 1 -- 172.21.15.60:0/1382839575 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3828054f00 msgr2=0x7f38280573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.873+0000 7f3843fff700 1 --2- 172.21.15.60:0/1382839575 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3828054f00 0x7f38280573c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f3834008000 tx=0x7f3834008040).stop 2020-10-31T22:48:41.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.873+0000 7f3843fff700 1 -- 172.21.15.60:0/1382839575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38440b1570 msgr2=0x7f3844141b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:41.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.873+0000 7f3843fff700 1 --2- 172.21.15.60:0/1382839575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38440b1570 0x7f3844141b10 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 rx=0x7f38440b32e0 tx=0x7f383c007e40).stop 2020-10-31T22:48:41.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.873+0000 7f3843fff700 1 -- 172.21.15.60:0/1382839575 shutdown_connections 2020-10-31T22:48:41.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.873+0000 7f3843fff700 1 --2- 172.21.15.60:0/1382839575 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38440b1570 0x7f3844141b10 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.873+0000 7f3843fff700 1 --2- 172.21.15.60:0/1382839575 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3844025480 0x7f384409fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.873+0000 7f3843fff700 1 --2- 172.21.15.60:0/1382839575 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3828054f00 0x7f38280573c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.873+0000 7f3843fff700 1 --2- 172.21.15.60:0/1382839575 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38440801c0 0x7f3844066060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:41.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.873+0000 7f3843fff700 1 -- 172.21.15.60:0/1382839575 >> 172.21.15.60:0/1382839575 conn(0x7f38440b5440 msgr2=0x7f38440adba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:41.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.873+0000 7f3843fff700 1 -- 172.21.15.60:0/1382839575 shutdown_connections 2020-10-31T22:48:41.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:41.873+0000 7f3843fff700 1 -- 172.21.15.60:0/1382839575 wait complete. 2020-10-31T22:48:41.882 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2020-10-31T22:48:41.894 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:48:42.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f7918c19700 1 Processor -- start 2020-10-31T22:48:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f7918c19700 1 -- start start 2020-10-31T22:48:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f7918c19700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f791405b320 0x7f791407ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f7918c19700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f79140ae200 0x7f79140a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:42.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f7918c19700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f791405b700 con 0x7f79140ac110 2020-10-31T22:48:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f7918c19700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79140807c0 con 0x7f79140ae200 2020-10-31T22:48:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f7918c19700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79140ab730 con 0x7f791405b320 2020-10-31T22:48:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f791259c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f79140ae200 0x7f79140a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f791359e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f79140ac110 0x7f79140ae970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50954/0 (socket says 172.21.15.60:50954) 2020-10-31T22:48:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f791359e700 1 -- 172.21.15.60:0/713956003 learned_addr learned my addr 172.21.15.60:0/713956003 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f7912d9d700 1 --2- 172.21.15.60:0/713956003 >> v2:172.21.15.66:3300/0 conn(0x7f791405b320 0x7f791407ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:42.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f791259c700 1 -- 172.21.15.60:0/713956003 >> v2:172.21.15.66:3300/0 conn(0x7f791405b320 msgr2=0x7f791407ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f791259c700 1 --2- 172.21.15.60:0/713956003 >> v2:172.21.15.66:3300/0 conn(0x7f791405b320 0x7f791407ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f791259c700 1 -- 172.21.15.60:0/713956003 >> v1:172.21.15.60:6789/0 conn(0x7f79140ac110 legacy=0x7f79140ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f791259c700 1 -- 172.21.15.60:0/713956003 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79140ab9d0 con 0x7f79140ae200 2020-10-31T22:48:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f791259c700 1 --2- 172.21.15.60:0/713956003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79140ae200 0x7f79140a74b0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f78fc002f30 tx=0x7f78fc006dc0).ready entity=mon.0 client_cookie=95da0205600fcb58 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f7911d9b700 1 -- 172.21.15.60:0/713956003 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78fc0097f0 con 0x7f79140ae200 2020-10-31T22:48:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f7911d9b700 1 -- 172.21.15.60:0/713956003 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc009950 con 0x7f79140ae200 2020-10-31T22:48:42.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f7911d9b700 1 -- 172.21.15.60:0/713956003 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78fc009cb0 con 0x7f79140ae200 2020-10-31T22:48:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f7918c19700 1 -- 172.21.15.60:0/713956003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79140ae200 msgr2=0x7f79140a74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.017+0000 7f7918c19700 1 --2- 172.21.15.60:0/713956003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79140ae200 0x7f79140a74b0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 rx=0x7f78fc002f30 tx=0x7f78fc006dc0).stop 2020-10-31T22:48:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.021+0000 7f7918c19700 1 -- 172.21.15.60:0/713956003 shutdown_connections 2020-10-31T22:48:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.021+0000 7f7918c19700 1 --2- 172.21.15.60:0/713956003 >> v2:172.21.15.66:3300/0 conn(0x7f791405b320 0x7f791407ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.021+0000 7f7918c19700 1 --2- 172.21.15.60:0/713956003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79140ae200 0x7f79140a74b0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.021+0000 7f7918c19700 1 -- 172.21.15.60:0/713956003 >> 172.21.15.60:0/713956003 conn(0x7f79140b3fd0 msgr2=0x7f79140b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:42.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.021+0000 7f7918c19700 1 -- 172.21.15.60:0/713956003 shutdown_connections 2020-10-31T22:48:42.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.021+0000 7f7918c19700 1 -- 172.21.15.60:0/713956003 wait complete. 2020-10-31T22:48:42.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.021+0000 7f7918c19700 1 Processor -- start 2020-10-31T22:48:42.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.021+0000 7f7918c19700 1 -- start start 2020-10-31T22:48:42.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f7918c19700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f791405b320 0x7f79140662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f7918c19700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79140ac110 0x7f7914140920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f7918c19700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79140ae200 0x7f79140aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f7918c19700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79140b2060 con 0x7f79140ac110 2020-10-31T22:48:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f7918c19700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f791413c8e0 con 0x7f79140ae200 2020-10-31T22:48:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f7918c19700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79140b2250 con 0x7f791405b320 2020-10-31T22:48:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f791259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79140ac110 0x7f7914140920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:42.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f791259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79140ac110 0x7f7914140920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46822/0 (socket says 172.21.15.60:46822) 2020-10-31T22:48:42.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f791259c700 1 -- 172.21.15.60:0/2413427790 learned_addr learned my addr 172.21.15.60:0/2413427790 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:42.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f7912d9d700 1 --2- 172.21.15.60:0/2413427790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f791405b320 0x7f79140662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:42.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f791359e700 1 --2- 172.21.15.60:0/2413427790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79140ae200 0x7f79140aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f791259c700 1 -- 172.21.15.60:0/2413427790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f791405b320 msgr2=0x7f79140662e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f791259c700 1 --2- 172.21.15.60:0/2413427790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f791405b320 0x7f79140662e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f791259c700 1 -- 172.21.15.60:0/2413427790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79140ae200 msgr2=0x7f79140aa7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f791259c700 1 --2- 172.21.15.60:0/2413427790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79140ae200 0x7f79140aa7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f791259c700 1 -- 172.21.15.60:0/2413427790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79140b24f0 con 0x7f79140ac110 2020-10-31T22:48:42.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f791259c700 1 --2- 172.21.15.60:0/2413427790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79140ac110 0x7f7914140920 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f78fc002f30 tx=0x7f78fc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f790b7fe700 1 -- 172.21.15.60:0/2413427790 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78fc011ca0 con 0x7f79140ac110 2020-10-31T22:48:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f790b7fe700 1 -- 172.21.15.60:0/2413427790 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78fc011e00 con 0x7f79140ac110 2020-10-31T22:48:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f7918c19700 1 -- 172.21.15.60:0/2413427790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f791413cad0 con 0x7f79140ac110 2020-10-31T22:48:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f790b7fe700 1 -- 172.21.15.60:0/2413427790 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f78fc01d640 con 0x7f79140ac110 2020-10-31T22:48:42.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.025+0000 7f7918c19700 1 -- 172.21.15.60:0/2413427790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f791413cf70 con 0x7f79140ac110 2020-10-31T22:48:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.029+0000 7f790b7fe700 1 -- 172.21.15.60:0/2413427790 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f78fc024030 con 0x7f79140ac110 2020-10-31T22:48:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.029+0000 7f7918c19700 1 -- 172.21.15.60:0/2413427790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f791413cc60 con 0x7f79140ac110 2020-10-31T22:48:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.029+0000 7f790b7fe700 1 --2- 172.21.15.60:0/2413427790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f78f8054f90 0x7f78f8057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:42.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.029+0000 7f790b7fe700 1 -- 172.21.15.60:0/2413427790 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f78fc06ee60 con 0x7f79140ac110 2020-10-31T22:48:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.029+0000 7f7912d9d700 1 --2- 172.21.15.60:0/2413427790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f78f8054f90 0x7f78f8057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:42.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.029+0000 7f7912d9d700 1 --2- 172.21.15.60:0/2413427790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f78f8054f90 0x7f78f8057450 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f790400c000 tx=0x7f7904008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:42.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.037+0000 7f790b7fe700 1 -- 172.21.15.60:0/2413427790 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f78fc045270 con 0x7f79140ac110 2020-10-31T22:48:42.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.229+0000 7f7918c19700 1 -- 172.21.15.60:0/2413427790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7914057100 con 0x7f79140ac110 2020-10-31T22:48:42.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.237+0000 7f790b7fe700 1 -- 172.21.15.60:0/2413427790 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v24) v1 ==== 184+0+0 (secure 0 0 0) 0x7f78fc022070 con 0x7f79140ac110 2020-10-31T22:48:42.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.241+0000 7f7918c19700 1 -- 172.21.15.60:0/2413427790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f78f8054f90 msgr2=0x7f78f8057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:42.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.241+0000 7f7918c19700 1 --2- 172.21.15.60:0/2413427790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f78f8054f90 0x7f78f8057450 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f790400c000 tx=0x7f7904008040).stop 2020-10-31T22:48:42.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.241+0000 7f7918c19700 1 -- 172.21.15.60:0/2413427790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79140ac110 msgr2=0x7f7914140920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:42.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.241+0000 7f7918c19700 1 --2- 172.21.15.60:0/2413427790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79140ac110 0x7f7914140920 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 rx=0x7f78fc002f30 tx=0x7f78fc015000).stop 2020-10-31T22:48:42.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.241+0000 7f7918c19700 1 -- 172.21.15.60:0/2413427790 shutdown_connections 2020-10-31T22:48:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.241+0000 7f7918c19700 1 --2- 172.21.15.60:0/2413427790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f78f8054f90 0x7f78f8057450 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.241+0000 7f7918c19700 1 --2- 172.21.15.60:0/2413427790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79140ae200 0x7f79140aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.241+0000 7f7918c19700 1 --2- 172.21.15.60:0/2413427790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f791405b320 0x7f79140662e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.241+0000 7f7918c19700 1 --2- 172.21.15.60:0/2413427790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79140ac110 0x7f7914140920 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.241+0000 7f7918c19700 1 -- 172.21.15.60:0/2413427790 >> 172.21.15.60:0/2413427790 conn(0x7f79140b3fd0 msgr2=0x7f79140b3700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.241+0000 7f7918c19700 1 -- 172.21.15.60:0/2413427790 shutdown_connections 2020-10-31T22:48:42.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.241+0000 7f7918c19700 1 -- 172.21.15.60:0/2413427790 wait complete. 2020-10-31T22:48:42.249 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.1 2020-10-31T22:48:42.261 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:42.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.369+0000 7f1a58e9b700 1 Processor -- start 2020-10-31T22:48:42.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.369+0000 7f1a58e9b700 1 -- start start 2020-10-31T22:48:42.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.369+0000 7f1a58e9b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1a540aead0 0x7f1a54141d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:42.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.369+0000 7f1a58e9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1a540af390 0x7f1a5413b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.369+0000 7f1a58e9b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a540af820 con 0x7f1a540b52a0 2020-10-31T22:48:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.369+0000 7f1a58e9b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5405c4f0 con 0x7f1a540af390 2020-10-31T22:48:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.369+0000 7f1a58e9b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5406a430 con 0x7f1a540aead0 2020-10-31T22:48:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.369+0000 7f1a5259c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1a540b52a0 0x7f1a5405bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50964/0 (socket says 172.21.15.60:50964) 2020-10-31T22:48:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.369+0000 7f1a5259c700 1 -- 172.21.15.60:0/294293817 learned_addr learned my addr 172.21.15.60:0/294293817 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.369+0000 7f1a52d9d700 1 --2- 172.21.15.60:0/294293817 >> v2:172.21.15.60:3300/0 conn(0x7f1a540af390 0x7f1a5413b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.369+0000 7f1a51d9b700 1 --2- 172.21.15.60:0/294293817 >> v2:172.21.15.66:3300/0 conn(0x7f1a540aead0 0x7f1a54141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.369+0000 7f1a5159a700 1 -- 172.21.15.60:0/294293817 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581806742 0 0) 0x7f1a540af820 con 0x7f1a540b52a0 2020-10-31T22:48:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a5159a700 1 -- 172.21.15.60:0/294293817 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a34003230 con 0x7f1a540b52a0 2020-10-31T22:48:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a52d9d700 1 -- 172.21.15.60:0/294293817 >> v2:172.21.15.66:3300/0 conn(0x7f1a540aead0 msgr2=0x7f1a54141d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a52d9d700 1 --2- 172.21.15.60:0/294293817 >> v2:172.21.15.66:3300/0 conn(0x7f1a540aead0 0x7f1a54141d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a52d9d700 1 -- 172.21.15.60:0/294293817 >> v1:172.21.15.60:6789/0 conn(0x7f1a540b52a0 legacy=0x7f1a5405bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a52d9d700 1 -- 172.21.15.60:0/294293817 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5405b160 con 0x7f1a540af390 2020-10-31T22:48:42.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a52d9d700 1 --2- 172.21.15.60:0/294293817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a540af390 0x7f1a5413b830 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f1a5406a5e0 tx=0x7f1a4c0091a0).ready entity=mon.0 client_cookie=5033c07daa7735a4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:42.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a5159a700 1 -- 172.21.15.60:0/294293817 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a4c00b970 con 0x7f1a540af390 2020-10-31T22:48:42.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a5159a700 1 -- 172.21.15.60:0/294293817 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c00bad0 con 0x7f1a540af390 2020-10-31T22:48:42.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a5159a700 1 -- 172.21.15.60:0/294293817 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a4c00bc40 con 0x7f1a540af390 2020-10-31T22:48:42.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a58e9b700 1 -- 172.21.15.60:0/294293817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a540af390 msgr2=0x7f1a5413b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:42.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a58e9b700 1 --2- 172.21.15.60:0/294293817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a540af390 0x7f1a5413b830 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 rx=0x7f1a5406a5e0 tx=0x7f1a4c0091a0).stop 2020-10-31T22:48:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a58e9b700 1 -- 172.21.15.60:0/294293817 shutdown_connections 2020-10-31T22:48:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a58e9b700 1 --2- 172.21.15.60:0/294293817 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a540af390 0x7f1a5413b830 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a58e9b700 1 --2- 172.21.15.60:0/294293817 >> v2:172.21.15.66:3300/0 conn(0x7f1a540aead0 0x7f1a54141d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a58e9b700 1 -- 172.21.15.60:0/294293817 >> 172.21.15.60:0/294293817 conn(0x7f1a54060c10 msgr2=0x7f1a540b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:42.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a58e9b700 1 -- 172.21.15.60:0/294293817 shutdown_connections 2020-10-31T22:48:42.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.373+0000 7f1a58e9b700 1 -- 172.21.15.60:0/294293817 wait complete. 2020-10-31T22:48:42.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a58e9b700 1 Processor -- start 2020-10-31T22:48:42.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a58e9b700 1 -- start start 2020-10-31T22:48:42.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a58e9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a540aead0 0x7f1a540b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:42.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a58e9b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a540af390 0x7f1a54143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:42.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a58e9b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a540b52a0 0x7f1a540a87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:42.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a58e9b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540aab80 con 0x7f1a540aead0 2020-10-31T22:48:42.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a58e9b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54146180 con 0x7f1a540af390 2020-10-31T22:48:42.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a58e9b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540aadb0 con 0x7f1a540b52a0 2020-10-31T22:48:42.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a5259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a540aead0 0x7f1a540b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:42.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a5259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a540aead0 0x7f1a540b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46834/0 (socket says 172.21.15.60:46834) 2020-10-31T22:48:42.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a5259c700 1 -- 172.21.15.60:0/162494400 learned_addr learned my addr 172.21.15.60:0/162494400 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:42.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a52d9d700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a540b52a0 0x7f1a540a87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:42.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a51d9b700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a540af390 0x7f1a54143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:42.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a5259c700 1 -- 172.21.15.60:0/162494400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a540b52a0 msgr2=0x7f1a540a87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:42.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a5259c700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a540b52a0 0x7f1a540a87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a5259c700 1 -- 172.21.15.60:0/162494400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a540af390 msgr2=0x7f1a54143ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:42.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a5259c700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a540af390 0x7f1a54143ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a5259c700 1 -- 172.21.15.60:0/162494400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a540ab050 con 0x7f1a540aead0 2020-10-31T22:48:42.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a51d9b700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a540af390 0x7f1a54143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:42.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.377+0000 7f1a5259c700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a540aead0 0x7f1a540b3dd0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f1a440010d0 tx=0x7f1a44007a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:42.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.381+0000 7f1a4b7fe700 1 -- 172.21.15.60:0/162494400 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a440072e0 con 0x7f1a540aead0 2020-10-31T22:48:42.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.381+0000 7f1a58e9b700 1 -- 172.21.15.60:0/162494400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a541431e0 con 0x7f1a540aead0 2020-10-31T22:48:42.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.381+0000 7f1a58e9b700 1 -- 172.21.15.60:0/162494400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a540aa060 con 0x7f1a540aead0 2020-10-31T22:48:42.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.381+0000 7f1a4b7fe700 1 -- 172.21.15.60:0/162494400 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a44007440 con 0x7f1a540aead0 2020-10-31T22:48:42.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.381+0000 7f1a4b7fe700 1 -- 172.21.15.60:0/162494400 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a440055c0 con 0x7f1a540aead0 2020-10-31T22:48:42.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.381+0000 7f1a4b7fe700 1 -- 172.21.15.60:0/162494400 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1a44010070 con 0x7f1a540aead0 2020-10-31T22:48:42.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.381+0000 7f1a58e9b700 1 -- 172.21.15.60:0/162494400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2c003340 con 0x7f1a540aead0 2020-10-31T22:48:42.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.381+0000 7f1a4b7fe700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1a38054f10 0x7f1a380573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:42.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.381+0000 7f1a4b7fe700 1 -- 172.21.15.60:0/162494400 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1a4406cf80 con 0x7f1a540aead0 2020-10-31T22:48:42.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.381+0000 7f1a51d9b700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1a38054f10 0x7f1a380573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:42.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.381+0000 7f1a51d9b700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1a38054f10 0x7f1a380573d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f1a3c00c000 tx=0x7f1a3c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:42.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.389+0000 7f1a4b7fe700 1 -- 172.21.15.60:0/162494400 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1a44043400 con 0x7f1a540aead0 2020-10-31T22:48:42.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.573+0000 7f1a58e9b700 1 -- 172.21.15.60:0/162494400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a2c0036e0 con 0x7f1a540aead0 2020-10-31T22:48:42.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.573+0000 7f1a4b7fe700 1 -- 172.21.15.60:0/162494400 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2484 (secure 0 0 0) 0x7f1a44046a20 con 0x7f1a540aead0 2020-10-31T22:48:42.582 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:42.582 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":47,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6822,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6835/458791799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458791799},{"type":"v1","addr":"172.21.15.60:6835","nonce":458791799}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45},{"gid":6825,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/332317680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":332317680},{"type":"v1","addr":"172.21.15.60:6837","nonce":332317680}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:48:39.857912+0000","modified":"2020-10-31T22:48:40.861506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6831},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6831":{"gid":6831,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/588884767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":588884767},{"type":"v1","addr":"172.21.15.66:6833","nonce":588884767}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-10-31T22:48:42.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.577+0000 7f1a58e9b700 1 -- 172.21.15.60:0/162494400 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1a38054f10 msgr2=0x7f1a380573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:42.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.577+0000 7f1a58e9b700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1a38054f10 0x7f1a380573d0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f1a3c00c000 tx=0x7f1a3c008040).stop 2020-10-31T22:48:42.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.577+0000 7f1a58e9b700 1 -- 172.21.15.60:0/162494400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a540aead0 msgr2=0x7f1a540b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:42.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.577+0000 7f1a58e9b700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a540aead0 0x7f1a540b3dd0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 rx=0x7f1a440010d0 tx=0x7f1a44007a10).stop 2020-10-31T22:48:42.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.577+0000 7f1a58e9b700 1 -- 172.21.15.60:0/162494400 shutdown_connections 2020-10-31T22:48:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.577+0000 7f1a58e9b700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a540b52a0 0x7f1a540a87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.577+0000 7f1a58e9b700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a540aead0 0x7f1a540b3dd0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.577+0000 7f1a58e9b700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1a38054f10 0x7f1a380573d0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.577+0000 7f1a58e9b700 1 --2- 172.21.15.60:0/162494400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a540af390 0x7f1a54143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.577+0000 7f1a58e9b700 1 -- 172.21.15.60:0/162494400 >> 172.21.15.60:0/162494400 conn(0x7f1a54060c10 msgr2=0x7f1a540b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:42.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.577+0000 7f1a58e9b700 1 -- 172.21.15.60:0/162494400 shutdown_connections 2020-10-31T22:48:42.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:42.577+0000 7f1a58e9b700 1 -- 172.21.15.60:0/162494400 wait complete. 2020-10-31T22:48:42.585 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 47 2020-10-31T22:48:42.899 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:48:39.857912+0000', 'modified': '2020-10-31T22:48:40.861506+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6831}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6831': {'gid': 6831, 'name': 'b', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6833/588884767', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 588884767}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 588884767}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:48:42.900 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:48:42.900 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-10-31T22:48:43.031 INFO:teuthology.orchestra.run.smithi066.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":6831,"want_state":"up:active","state":"up:active","rank_uptime":3.159409374,"mdsmap_epoch":47,"osdmap_epoch":99,"osdmap_epoch_barrier":98,"uptime":8.5242216559999999} 2020-10-31T22:48:43.032 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 6831, "mdsmap_epoch": 47, "osdmap_epoch": 99, "osdmap_epoch_barrier": 98, "rank_uptime": 3.159409374, "state": "up:active", "uptime": 8.524221656, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:48:43.032 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:48:43.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.145+0000 7f3e6ffff700 1 Processor -- start 2020-10-31T22:48:43.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.145+0000 7f3e6ffff700 1 -- start start 2020-10-31T22:48:43.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3e700b5570 0x7f3e700b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6ffff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3e70141fe0 0x7f3e70142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6ffff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e70145180 con 0x7f3e700b24a0 2020-10-31T22:48:43.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6ffff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e700afae0 con 0x7f3e700b5570 2020-10-31T22:48:43.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6ffff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e70141bf0 con 0x7f3e70141fe0 2020-10-31T22:48:43.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3e700b5570 0x7f3e700b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6e7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3e700b24a0 0x7f3e70145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50980/0 (socket says 172.21.15.60:50980) 2020-10-31T22:48:43.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6e7fc700 1 -- 172.21.15.60:0/1227056748 learned_addr learned my addr 172.21.15.60:0/1227056748 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:43.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6f7fe700 1 --2- 172.21.15.60:0/1227056748 >> v2:172.21.15.66:3300/0 conn(0x7f3e70141fe0 0x7f3e70142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6effd700 1 -- 172.21.15.60:0/1227056748 >> v2:172.21.15.66:3300/0 conn(0x7f3e70141fe0 msgr2=0x7f3e70142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:43.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6effd700 1 --2- 172.21.15.60:0/1227056748 >> v2:172.21.15.66:3300/0 conn(0x7f3e70141fe0 0x7f3e70142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6effd700 1 -- 172.21.15.60:0/1227056748 >> v1:172.21.15.60:6789/0 conn(0x7f3e700b24a0 legacy=0x7f3e70145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6dffb700 1 -- 172.21.15.60:0/1227056748 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2839483394 0 0) 0x7f3e70145180 con 0x7f3e700b24a0 2020-10-31T22:48:43.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6effd700 1 -- 172.21.15.60:0/1227056748 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e700b0670 con 0x7f3e700b5570 2020-10-31T22:48:43.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6f7fe700 1 --2- 172.21.15.60:0/1227056748 >> v2:172.21.15.66:3300/0 conn(0x7f3e70141fe0 0x7f3e70142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:43.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6effd700 1 --2- 172.21.15.60:0/1227056748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e700b5570 0x7f3e700b5950 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f3e7005f580 tx=0x7f3e58006dc0).ready entity=mon.0 client_cookie=cf7aaeb140de7779 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:43.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6dffb700 1 -- 172.21.15.60:0/1227056748 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e580097b0 con 0x7f3e700b5570 2020-10-31T22:48:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6dffb700 1 -- 172.21.15.60:0/1227056748 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e58009910 con 0x7f3e700b5570 2020-10-31T22:48:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6dffb700 1 -- 172.21.15.60:0/1227056748 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e58009c70 con 0x7f3e700b5570 2020-10-31T22:48:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6ffff700 1 -- 172.21.15.60:0/1227056748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e700b5570 msgr2=0x7f3e700b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6ffff700 1 --2- 172.21.15.60:0/1227056748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e700b5570 0x7f3e700b5950 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 rx=0x7f3e7005f580 tx=0x7f3e58006dc0).stop 2020-10-31T22:48:43.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6ffff700 1 -- 172.21.15.60:0/1227056748 shutdown_connections 2020-10-31T22:48:43.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6ffff700 1 --2- 172.21.15.60:0/1227056748 >> v2:172.21.15.66:3300/0 conn(0x7f3e70141fe0 0x7f3e70142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6ffff700 1 --2- 172.21.15.60:0/1227056748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e700b5570 0x7f3e700b5950 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6ffff700 1 -- 172.21.15.60:0/1227056748 >> 172.21.15.60:0/1227056748 conn(0x7f3e700b8e90 msgr2=0x7f3e700b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:43.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6ffff700 1 -- 172.21.15.60:0/1227056748 shutdown_connections 2020-10-31T22:48:43.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.149+0000 7f3e6ffff700 1 -- 172.21.15.60:0/1227056748 wait complete. 2020-10-31T22:48:43.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6ffff700 1 Processor -- start 2020-10-31T22:48:43.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6ffff700 1 -- start start 2020-10-31T22:48:43.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e700b24a0 0x7f3e7013bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6ffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e700b5570 0x7f3e7013fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e70141fe0 0x7f3e70150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7013fca0 con 0x7f3e700b24a0 2020-10-31T22:48:43.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6ffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e70144a60 con 0x7f3e700b5570 2020-10-31T22:48:43.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e70154c50 con 0x7f3e70141fe0 2020-10-31T22:48:43.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e700b24a0 0x7f3e7013bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e700b24a0 0x7f3e7013bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46848/0 (socket says 172.21.15.60:46848) 2020-10-31T22:48:43.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6effd700 1 -- 172.21.15.60:0/4262787617 learned_addr learned my addr 172.21.15.60:0/4262787617 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:43.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6e7fc700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e700b5570 0x7f3e7013fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6f7fe700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e70141fe0 0x7f3e70150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6effd700 1 -- 172.21.15.60:0/4262787617 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e70141fe0 msgr2=0x7f3e70150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6effd700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e70141fe0 0x7f3e70150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6effd700 1 -- 172.21.15.60:0/4262787617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e700b5570 msgr2=0x7f3e7013fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6effd700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e700b5570 0x7f3e7013fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6effd700 1 -- 172.21.15.60:0/4262787617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e70154ef0 con 0x7f3e700b24a0 2020-10-31T22:48:43.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6f7fe700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e70141fe0 0x7f3e70150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:43.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6effd700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e700b24a0 0x7f3e7013bed0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f3e7005f580 tx=0x7f3e58015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:43.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e67fff700 1 -- 172.21.15.60:0/4262787617 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e58009c10 con 0x7f3e700b24a0 2020-10-31T22:48:43.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e67fff700 1 -- 172.21.15.60:0/4262787617 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e58009e20 con 0x7f3e700b24a0 2020-10-31T22:48:43.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6ffff700 1 -- 172.21.15.60:0/4262787617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e70144c90 con 0x7f3e700b24a0 2020-10-31T22:48:43.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e67fff700 1 -- 172.21.15.60:0/4262787617 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e5801d640 con 0x7f3e700b24a0 2020-10-31T22:48:43.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.153+0000 7f3e6ffff700 1 -- 172.21.15.60:0/4262787617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e700b5fc0 con 0x7f3e700b24a0 2020-10-31T22:48:43.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.157+0000 7f3e6ffff700 1 -- 172.21.15.60:0/4262787617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e70057100 con 0x7f3e700b24a0 2020-10-31T22:48:43.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.157+0000 7f3e67fff700 1 -- 172.21.15.60:0/4262787617 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3e5800f070 con 0x7f3e700b24a0 2020-10-31T22:48:43.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.157+0000 7f3e67fff700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3e54054f90 0x7f3e54057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.157+0000 7f3e67fff700 1 -- 172.21.15.60:0/4262787617 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3e5806f580 con 0x7f3e700b24a0 2020-10-31T22:48:43.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.157+0000 7f3e6e7fc700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3e54054f90 0x7f3e54057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.157+0000 7f3e6e7fc700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3e54054f90 0x7f3e54057450 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f3e6000b000 tx=0x7f3e60009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:43.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.161+0000 7f3e67fff700 1 -- 172.21.15.60:0/4262787617 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3e58045ae0 con 0x7f3e700b24a0 2020-10-31T22:48:43.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.305+0000 7f3e6ffff700 1 -- 172.21.15.60:0/4262787617 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3e70144e20 con 0x7f3e700b24a0 2020-10-31T22:48:43.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.305+0000 7f3e67fff700 1 -- 172.21.15.60:0/4262787617 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f3e580490c0 con 0x7f3e700b24a0 2020-10-31T22:48:43.312 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:43.312 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":99,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:48:40.861615+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:48:37.407586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2020-10-31T22:48:38.710432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:48:43.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.305+0000 7f3e6ffff700 1 -- 172.21.15.60:0/4262787617 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3e54054f90 msgr2=0x7f3e54057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.305+0000 7f3e6ffff700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3e54054f90 0x7f3e54057450 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f3e6000b000 tx=0x7f3e60009040).stop 2020-10-31T22:48:43.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.305+0000 7f3e6ffff700 1 -- 172.21.15.60:0/4262787617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e700b24a0 msgr2=0x7f3e7013bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.305+0000 7f3e6ffff700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e700b24a0 0x7f3e7013bed0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 rx=0x7f3e7005f580 tx=0x7f3e58015000).stop 2020-10-31T22:48:43.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.309+0000 7f3e6ffff700 1 -- 172.21.15.60:0/4262787617 shutdown_connections 2020-10-31T22:48:43.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.309+0000 7f3e6ffff700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e70141fe0 0x7f3e70150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.309+0000 7f3e6ffff700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e700b24a0 0x7f3e7013bed0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.309+0000 7f3e6ffff700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3e54054f90 0x7f3e54057450 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.309+0000 7f3e6ffff700 1 --2- 172.21.15.60:0/4262787617 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e700b5570 0x7f3e7013fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.309+0000 7f3e6ffff700 1 -- 172.21.15.60:0/4262787617 >> 172.21.15.60:0/4262787617 conn(0x7f3e700b8e90 msgr2=0x7f3e701456e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:43.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.309+0000 7f3e6ffff700 1 -- 172.21.15.60:0/4262787617 shutdown_connections 2020-10-31T22:48:43.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.309+0000 7f3e6ffff700 1 -- 172.21.15.60:0/4262787617 wait complete. 2020-10-31T22:48:43.326 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:48:37.407586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:48:38.710432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:48:43.327 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:48:43.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.445+0000 7ff3b6fc0700 1 Processor -- start 2020-10-31T22:48:43.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.445+0000 7ff3b6fc0700 1 -- start start 2020-10-31T22:48:43.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.445+0000 7ff3b6fc0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff3b00b2790 0x7ff3b00aff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.445+0000 7ff3b6fc0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b00b2b70 con 0x7ff3b00af660 2020-10-31T22:48:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.445+0000 7ff3b6fc0700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b00b0410 con 0x7ff3b013c360 2020-10-31T22:48:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.445+0000 7ff3b6fc0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b013c7d0 con 0x7ff3b00b2790 2020-10-31T22:48:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.445+0000 7ff3b4d5c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff3b00b2790 0x7ff3b00aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.445+0000 7ff3affff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff3b00af660 0x7ff3b013bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:50994/0 (socket says 172.21.15.60:50994) 2020-10-31T22:48:43.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.445+0000 7ff3affff700 1 -- 172.21.15.60:0/2618310179 learned_addr learned my addr 172.21.15.60:0/2618310179 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.445+0000 7ff3b4d5c700 1 -- 172.21.15.60:0/2618310179 >> v1:172.21.15.66:6789/0 conn(0x7ff3b013c360 legacy=0x7ff3b00ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.445+0000 7ff3b4d5c700 1 -- 172.21.15.60:0/2618310179 >> v1:172.21.15.60:6789/0 conn(0x7ff3b00af660 legacy=0x7ff3b013bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.445+0000 7ff3b4d5c700 1 -- 172.21.15.60:0/2618310179 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b00b0db0 con 0x7ff3b00b2790 2020-10-31T22:48:43.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.445+0000 7ff3af7fe700 1 -- 172.21.15.60:0/2618310179 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2545878156 0 0) 0x7ff3b00b2b70 con 0x7ff3b00af660 2020-10-31T22:48:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.445+0000 7ff3b4d5c700 1 --2- 172.21.15.60:0/2618310179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3b00b2790 0x7ff3b00aff20 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7ff3a0002f30 tx=0x7ff3a0006dc0).ready entity=mon.0 client_cookie=6bf84a7f43e9923 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.449+0000 7ff3af7fe700 1 -- 172.21.15.60:0/2618310179 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3a00097f0 con 0x7ff3b00b2790 2020-10-31T22:48:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.449+0000 7ff3af7fe700 1 -- 172.21.15.60:0/2618310179 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a0009950 con 0x7ff3b00b2790 2020-10-31T22:48:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.449+0000 7ff3af7fe700 1 -- 172.21.15.60:0/2618310179 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3a0009cb0 con 0x7ff3b00b2790 2020-10-31T22:48:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.449+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/2618310179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3b00b2790 msgr2=0x7ff3b00aff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.449+0000 7ff3b6fc0700 1 --2- 172.21.15.60:0/2618310179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3b00b2790 0x7ff3b00aff20 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 rx=0x7ff3a0002f30 tx=0x7ff3a0006dc0).stop 2020-10-31T22:48:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.449+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/2618310179 shutdown_connections 2020-10-31T22:48:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.449+0000 7ff3b6fc0700 1 --2- 172.21.15.60:0/2618310179 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3b00b2790 0x7ff3b00aff20 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.449+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/2618310179 >> 172.21.15.60:0/2618310179 conn(0x7ff3b00b5d30 msgr2=0x7ff3b00b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.449+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/2618310179 shutdown_connections 2020-10-31T22:48:43.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.449+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/2618310179 wait complete. 2020-10-31T22:48:43.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.449+0000 7ff3b6fc0700 1 Processor -- start 2020-10-31T22:48:43.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.449+0000 7ff3b6fc0700 1 -- start start 2020-10-31T22:48:43.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3b6fc0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3b00af660 0x7ff3b0138d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3b6fc0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3b00b2790 0x7ff3b0152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3b6fc0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3b013c360 0x7ff3b0152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3b6fc0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b00aa7e0 con 0x7ff3b00b2790 2020-10-31T22:48:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3b6fc0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0153120 con 0x7ff3b00af660 2020-10-31T22:48:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3b6fc0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b005b5a0 con 0x7ff3b013c360 2020-10-31T22:48:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3affff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3b00b2790 0x7ff3b0152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3affff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3b00b2790 0x7ff3b0152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46862/0 (socket says 172.21.15.60:46862) 2020-10-31T22:48:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3affff700 1 -- 172.21.15.60:0/1785322591 learned_addr learned my addr 172.21.15.60:0/1785322591 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:43.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3b4d5c700 1 --2- 172.21.15.60:0/1785322591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3b00af660 0x7ff3b0138d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3b555d700 1 --2- 172.21.15.60:0/1785322591 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3b013c360 0x7ff3b0152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3affff700 1 -- 172.21.15.60:0/1785322591 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3b013c360 msgr2=0x7ff3b0152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3affff700 1 --2- 172.21.15.60:0/1785322591 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3b013c360 0x7ff3b0152c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3affff700 1 -- 172.21.15.60:0/1785322591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3b00af660 msgr2=0x7ff3b0138d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3affff700 1 --2- 172.21.15.60:0/1785322591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3b00af660 0x7ff3b0138d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3affff700 1 -- 172.21.15.60:0/1785322591 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b005bcc0 con 0x7ff3b00b2790 2020-10-31T22:48:43.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3affff700 1 --2- 172.21.15.60:0/1785322591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3b00b2790 0x7ff3b0152740 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7ff3a4000b80 tx=0x7ff3a4007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:43.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3adffb700 1 -- 172.21.15.60:0/1785322591 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3a40073b0 con 0x7ff3b00b2790 2020-10-31T22:48:43.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3adffb700 1 -- 172.21.15.60:0/1785322591 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a40055e0 con 0x7ff3b00b2790 2020-10-31T22:48:43.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/1785322591 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b01423c0 con 0x7ff3b00b2790 2020-10-31T22:48:43.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3adffb700 1 -- 172.21.15.60:0/1785322591 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff3a4005940 con 0x7ff3b00b2790 2020-10-31T22:48:43.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/1785322591 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b0139700 con 0x7ff3b00b2790 2020-10-31T22:48:43.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.453+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/1785322591 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b005be50 con 0x7ff3b00b2790 2020-10-31T22:48:43.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.457+0000 7ff3adffb700 1 -- 172.21.15.60:0/1785322591 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff3a401a060 con 0x7ff3b00b2790 2020-10-31T22:48:43.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.457+0000 7ff3adffb700 1 --2- 172.21.15.60:0/1785322591 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff390055020 0x7ff3900574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.457+0000 7ff3b4d5c700 1 --2- 172.21.15.60:0/1785322591 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff390055020 0x7ff3900574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.457+0000 7ff3adffb700 1 -- 172.21.15.60:0/1785322591 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff3a406d260 con 0x7ff3b00b2790 2020-10-31T22:48:43.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.457+0000 7ff3b4d5c700 1 --2- 172.21.15.60:0/1785322591 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff390055020 0x7ff3900574e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7ff3a001b000 tx=0x7ff3a0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:43.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.465+0000 7ff3adffb700 1 -- 172.21.15.60:0/1785322591 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff3a4043780 con 0x7ff3b00b2790 2020-10-31T22:48:43.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.609+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/1785322591 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff3b005b6e0 con 0x7ff3b00b2790 2020-10-31T22:48:43.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.609+0000 7ff3adffb700 1 -- 172.21.15.60:0/1785322591 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v99) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff3a4018070 con 0x7ff3b00b2790 2020-10-31T22:48:43.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.609+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/1785322591 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff390055020 msgr2=0x7ff3900574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.609+0000 7ff3b6fc0700 1 --2- 172.21.15.60:0/1785322591 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff390055020 0x7ff3900574e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7ff3a001b000 tx=0x7ff3a0015000).stop 2020-10-31T22:48:43.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.609+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/1785322591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3b00b2790 msgr2=0x7ff3b0152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.609+0000 7ff3b6fc0700 1 --2- 172.21.15.60:0/1785322591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3b00b2790 0x7ff3b0152740 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 rx=0x7ff3a4000b80 tx=0x7ff3a4007a30).stop 2020-10-31T22:48:43.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.609+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/1785322591 shutdown_connections 2020-10-31T22:48:43.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.609+0000 7ff3b6fc0700 1 --2- 172.21.15.60:0/1785322591 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3b013c360 0x7ff3b0152c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.609+0000 7ff3b6fc0700 1 --2- 172.21.15.60:0/1785322591 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff390055020 0x7ff3900574e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.609+0000 7ff3b6fc0700 1 --2- 172.21.15.60:0/1785322591 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3b00af660 0x7ff3b0138d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.609+0000 7ff3b6fc0700 1 --2- 172.21.15.60:0/1785322591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3b00b2790 0x7ff3b0152740 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.609+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/1785322591 >> 172.21.15.60:0/1785322591 conn(0x7ff3b00b5d30 msgr2=0x7ff3b005f470 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:43.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.609+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/1785322591 shutdown_connections 2020-10-31T22:48:43.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.609+0000 7ff3b6fc0700 1 -- 172.21.15.60:0/1785322591 wait complete. 2020-10-31T22:48:43.783 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:48:43.784 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:48:43.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.905+0000 7facff59e700 1 Processor -- start 2020-10-31T22:48:43.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.905+0000 7facff59e700 1 -- start start 2020-10-31T22:48:43.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facff59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fad000b1e50 0x7fad00145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facff59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad000a54e0 0x7fad00145d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facff59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad000b0e50 con 0x7fad000b0290 2020-10-31T22:48:43.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facff59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad000b2230 con 0x7fad000b1e50 2020-10-31T22:48:43.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facff59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad00146200 con 0x7fad000a54e0 2020-10-31T22:48:43.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfed9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fad000b0290 0x7fad000b0740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51006/0 (socket says 172.21.15.60:51006) 2020-10-31T22:48:43.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfed9d700 1 -- 172.21.15.60:0/2943870254 learned_addr learned my addr 172.21.15.60:0/2943870254 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:43.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfe59c700 1 --2- 172.21.15.60:0/2943870254 >> v2:172.21.15.60:3300/0 conn(0x7fad000b1e50 0x7fad00145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfdd9b700 1 --2- 172.21.15.60:0/2943870254 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad000a54e0 0x7fad00145d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfd59a700 1 -- 172.21.15.60:0/2943870254 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218253052 0 0) 0x7facf8001120 con 0x7fad000b0290 2020-10-31T22:48:43.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfd59a700 1 -- 172.21.15.60:0/2943870254 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7face0003230 con 0x7fad000b0290 2020-10-31T22:48:43.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfe59c700 1 -- 172.21.15.60:0/2943870254 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad000a54e0 msgr2=0x7fad00145d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:43.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfd59a700 1 -- 172.21.15.60:0/2943870254 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2272379164 0 0) 0x7face0003230 con 0x7fad000b0290 2020-10-31T22:48:43.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfe59c700 1 --2- 172.21.15.60:0/2943870254 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad000a54e0 0x7fad00145d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfe59c700 1 -- 172.21.15.60:0/2943870254 >> v1:172.21.15.60:6789/0 conn(0x7fad000b0290 legacy=0x7fad000b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfe59c700 1 -- 172.21.15.60:0/2943870254 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0005fba0 con 0x7fad000b1e50 2020-10-31T22:48:43.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfdd9b700 1 --2- 172.21.15.60:0/2943870254 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad000a54e0 0x7fad00145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:43.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfe59c700 1 --2- 172.21.15.60:0/2943870254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad000b1e50 0x7fad00145820 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7facf8001a50 tx=0x7facf0006dc0).ready entity=mon.0 client_cookie=f22a5897ab96ecd4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:43.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfd59a700 1 -- 172.21.15.60:0/2943870254 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facf80018b0 con 0x7fad000b1e50 2020-10-31T22:48:43.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfd59a700 1 -- 172.21.15.60:0/2943870254 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf000d570 con 0x7fad000b1e50 2020-10-31T22:48:43.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facff59e700 1 -- 172.21.15.60:0/2943870254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad000b1e50 msgr2=0x7fad00145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facfd59a700 1 -- 172.21.15.60:0/2943870254 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facf000d6e0 con 0x7fad000b1e50 2020-10-31T22:48:43.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facff59e700 1 --2- 172.21.15.60:0/2943870254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad000b1e50 0x7fad00145820 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 rx=0x7facf8001a50 tx=0x7facf0006dc0).stop 2020-10-31T22:48:43.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facff59e700 1 -- 172.21.15.60:0/2943870254 shutdown_connections 2020-10-31T22:48:43.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facff59e700 1 --2- 172.21.15.60:0/2943870254 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad000b1e50 0x7fad00145820 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facff59e700 1 --2- 172.21.15.60:0/2943870254 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad000a54e0 0x7fad00145d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facff59e700 1 -- 172.21.15.60:0/2943870254 >> 172.21.15.60:0/2943870254 conn(0x7fad00060de0 msgr2=0x7fad00062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:43.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facff59e700 1 -- 172.21.15.60:0/2943870254 shutdown_connections 2020-10-31T22:48:43.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.909+0000 7facff59e700 1 -- 172.21.15.60:0/2943870254 wait complete. 2020-10-31T22:48:43.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facff59e700 1 Processor -- start 2020-10-31T22:48:43.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facff59e700 1 -- start start 2020-10-31T22:48:43.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facff59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad000a54e0 0x7fad000b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facff59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad000b0290 0x7fad00148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facff59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad000b1e50 0x7fad000a3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facff59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad000a7130 con 0x7fad000a54e0 2020-10-31T22:48:43.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facff59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad000b35d0 con 0x7fad000b1e50 2020-10-31T22:48:43.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facff59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad000a3d70 con 0x7fad000b0290 2020-10-31T22:48:43.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facfe59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad000a54e0 0x7fad000b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facfe59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad000a54e0 0x7fad000b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46878/0 (socket says 172.21.15.60:46878) 2020-10-31T22:48:43.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facfe59c700 1 -- 172.21.15.60:0/516281649 learned_addr learned my addr 172.21.15.60:0/516281649 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:43.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facfdd9b700 1 --2- 172.21.15.60:0/516281649 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad000b0290 0x7fad00148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facfed9d700 1 --2- 172.21.15.60:0/516281649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad000b1e50 0x7fad000a3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facfe59c700 1 -- 172.21.15.60:0/516281649 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad000b0290 msgr2=0x7fad00148b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facfe59c700 1 --2- 172.21.15.60:0/516281649 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad000b0290 0x7fad00148b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facfe59c700 1 -- 172.21.15.60:0/516281649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad000b1e50 msgr2=0x7fad000a3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:43.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facfe59c700 1 --2- 172.21.15.60:0/516281649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad000b1e50 0x7fad000a3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:43.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facfe59c700 1 -- 172.21.15.60:0/516281649 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad000a3fa0 con 0x7fad000a54e0 2020-10-31T22:48:43.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facfe59c700 1 --2- 172.21.15.60:0/516281649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad000a54e0 0x7fad000b30e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7facf8001a50 tx=0x7facf0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:43.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facf77fe700 1 -- 172.21.15.60:0/516281649 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facf00118d0 con 0x7fad000a54e0 2020-10-31T22:48:43.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facf77fe700 1 -- 172.21.15.60:0/516281649 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf0011a30 con 0x7fad000a54e0 2020-10-31T22:48:43.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facff59e700 1 -- 172.21.15.60:0/516281649 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad000a6ad0 con 0x7fad000a54e0 2020-10-31T22:48:43.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facf77fe700 1 -- 172.21.15.60:0/516281649 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7facf0011d90 con 0x7fad000a54e0 2020-10-31T22:48:43.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.913+0000 7facff59e700 1 -- 172.21.15.60:0/516281649 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad000ae720 con 0x7fad000a54e0 2020-10-31T22:48:43.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.917+0000 7facff59e700 1 -- 172.21.15.60:0/516281649 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad00057100 con 0x7fad000a54e0 2020-10-31T22:48:43.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.917+0000 7facf77fe700 1 -- 172.21.15.60:0/516281649 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7facf0024030 con 0x7fad000a54e0 2020-10-31T22:48:43.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.917+0000 7facf77fe700 1 --2- 172.21.15.60:0/516281649 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7face4054f90 0x7face4057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:43.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.917+0000 7facf77fe700 1 -- 172.21.15.60:0/516281649 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7facf006e5b0 con 0x7fad000a54e0 2020-10-31T22:48:43.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.917+0000 7facfdd9b700 1 --2- 172.21.15.60:0/516281649 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7face4054f90 0x7face4057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:43.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.917+0000 7facfdd9b700 1 --2- 172.21.15.60:0/516281649 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7face4054f90 0x7face4057450 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7face800b000 tx=0x7face80091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:43.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:43.921+0000 7facf77fe700 1 -- 172.21.15.60:0/516281649 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7facf0044ad0 con 0x7fad000a54e0 2020-10-31T22:48:44.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.065+0000 7facff59e700 1 -- 172.21.15.60:0/516281649 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fad000a3000 con 0x7fad000a54e0 2020-10-31T22:48:44.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.065+0000 7facf77fe700 1 -- 172.21.15.60:0/516281649 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v99) v1 ==== 92+0+10 (secure 0 0 0) 0x7facf0022020 con 0x7fad000a54e0 2020-10-31T22:48:44.073 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:48:44.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.065+0000 7facff59e700 1 -- 172.21.15.60:0/516281649 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7face4054f90 msgr2=0x7face4057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.065+0000 7facff59e700 1 --2- 172.21.15.60:0/516281649 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7face4054f90 0x7face4057450 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7face800b000 tx=0x7face80091a0).stop 2020-10-31T22:48:44.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.065+0000 7facff59e700 1 -- 172.21.15.60:0/516281649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad000a54e0 msgr2=0x7fad000b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.065+0000 7facff59e700 1 --2- 172.21.15.60:0/516281649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad000a54e0 0x7fad000b30e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 rx=0x7facf8001a50 tx=0x7facf0015000).stop 2020-10-31T22:48:44.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.065+0000 7facff59e700 1 -- 172.21.15.60:0/516281649 shutdown_connections 2020-10-31T22:48:44.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.065+0000 7facff59e700 1 --2- 172.21.15.60:0/516281649 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7face4054f90 0x7face4057450 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.069+0000 7facff59e700 1 --2- 172.21.15.60:0/516281649 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad000b1e50 0x7fad000a3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.069+0000 7facff59e700 1 --2- 172.21.15.60:0/516281649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad000a54e0 0x7fad000b30e0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.069+0000 7facff59e700 1 --2- 172.21.15.60:0/516281649 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad000b0290 0x7fad00148b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.069+0000 7facff59e700 1 -- 172.21.15.60:0/516281649 >> 172.21.15.60:0/516281649 conn(0x7fad00060de0 msgr2=0x7fad000aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:44.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.069+0000 7facff59e700 1 -- 172.21.15.60:0/516281649 shutdown_connections 2020-10-31T22:48:44.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.069+0000 7facff59e700 1 -- 172.21.15.60:0/516281649 wait complete. 2020-10-31T22:48:44.085 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:48:44.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.201+0000 7f8256f98700 1 Processor -- start 2020-10-31T22:48:44.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.201+0000 7f8256f98700 1 -- start start 2020-10-31T22:48:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.201+0000 7f8256f98700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f82500afdc0 0x7f825013be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.201+0000 7f8256f98700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f825013c310 0x7f82500aa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.201+0000 7f8256f98700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82501429d0 con 0x7f82500a7530 2020-10-31T22:48:44.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.201+0000 7f8256f98700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8250142c70 con 0x7f82500afdc0 2020-10-31T22:48:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.201+0000 7f8256f98700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f825013e8e0 con 0x7f825013c310 2020-10-31T22:48:44.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.201+0000 7f8255795700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f82500a7530 0x7f825013edf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51020/0 (socket says 172.21.15.60:51020) 2020-10-31T22:48:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.201+0000 7f8255795700 1 -- 172.21.15.60:0/2645823733 learned_addr learned my addr 172.21.15.60:0/2645823733 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.201+0000 7f8255f96700 1 --2- 172.21.15.60:0/2645823733 >> v2:172.21.15.60:3300/0 conn(0x7f82500afdc0 0x7f825013be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.201+0000 7f8256797700 1 --2- 172.21.15.60:0/2645823733 >> v2:172.21.15.66:3300/0 conn(0x7f825013c310 0x7f82500aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8254f94700 1 -- 172.21.15.60:0/2645823733 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080133994 0 0) 0x7f82501429d0 con 0x7f82500a7530 2020-10-31T22:48:44.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8254f94700 1 -- 172.21.15.60:0/2645823733 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8238003230 con 0x7f82500a7530 2020-10-31T22:48:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8255f96700 1 -- 172.21.15.60:0/2645823733 >> v2:172.21.15.66:3300/0 conn(0x7f825013c310 msgr2=0x7f82500aa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8255f96700 1 --2- 172.21.15.60:0/2645823733 >> v2:172.21.15.66:3300/0 conn(0x7f825013c310 0x7f82500aa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8255f96700 1 -- 172.21.15.60:0/2645823733 >> v1:172.21.15.60:6789/0 conn(0x7f82500a7530 legacy=0x7f825013edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8255f96700 1 -- 172.21.15.60:0/2645823733 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82500abb30 con 0x7f82500afdc0 2020-10-31T22:48:44.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8255f96700 1 --2- 172.21.15.60:0/2645823733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82500afdc0 0x7f825013be20 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f824c002f30 tx=0x7f824c006d60).ready entity=mon.0 client_cookie=9394b0493f32f4ac server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:44.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8254f94700 1 -- 172.21.15.60:0/2645823733 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f824c009580 con 0x7f82500afdc0 2020-10-31T22:48:44.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8254f94700 1 -- 172.21.15.60:0/2645823733 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824c0096e0 con 0x7f82500afdc0 2020-10-31T22:48:44.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8254f94700 1 -- 172.21.15.60:0/2645823733 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f824c009850 con 0x7f82500afdc0 2020-10-31T22:48:44.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 -- 172.21.15.60:0/2645823733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82500afdc0 msgr2=0x7f825013be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 --2- 172.21.15.60:0/2645823733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82500afdc0 0x7f825013be20 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 rx=0x7f824c002f30 tx=0x7f824c006d60).stop 2020-10-31T22:48:44.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 -- 172.21.15.60:0/2645823733 shutdown_connections 2020-10-31T22:48:44.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 --2- 172.21.15.60:0/2645823733 >> v2:172.21.15.66:3300/0 conn(0x7f825013c310 0x7f82500aa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 --2- 172.21.15.60:0/2645823733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82500afdc0 0x7f825013be20 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 -- 172.21.15.60:0/2645823733 >> 172.21.15.60:0/2645823733 conn(0x7f82500b3fd0 msgr2=0x7f82500b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:44.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 -- 172.21.15.60:0/2645823733 shutdown_connections 2020-10-31T22:48:44.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 -- 172.21.15.60:0/2645823733 wait complete. 2020-10-31T22:48:44.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 Processor -- start 2020-10-31T22:48:44.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 -- start start 2020-10-31T22:48:44.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82500afdc0 0x7f82500aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825013c310 0x7f82500b2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82500aaa70 0x7f82500b2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8250140c70 con 0x7f825013c310 2020-10-31T22:48:44.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8250130a00 con 0x7f82500afdc0 2020-10-31T22:48:44.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.205+0000 7f8256f98700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8250140ea0 con 0x7f82500aaa70 2020-10-31T22:48:44.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f8255795700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825013c310 0x7f82500b2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f8255795700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825013c310 0x7f82500b2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46892/0 (socket says 172.21.15.60:46892) 2020-10-31T22:48:44.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f8255795700 1 -- 172.21.15.60:0/3960879740 learned_addr learned my addr 172.21.15.60:0/3960879740 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:44.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f8256797700 1 --2- 172.21.15.60:0/3960879740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82500aaa70 0x7f82500b2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f8255f96700 1 --2- 172.21.15.60:0/3960879740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82500afdc0 0x7f82500aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f8255795700 1 -- 172.21.15.60:0/3960879740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82500aaa70 msgr2=0x7f82500b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f8255795700 1 --2- 172.21.15.60:0/3960879740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82500aaa70 0x7f82500b2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f8255795700 1 -- 172.21.15.60:0/3960879740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82500afdc0 msgr2=0x7f82500aa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f8255795700 1 --2- 172.21.15.60:0/3960879740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82500afdc0 0x7f82500aa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f8255795700 1 -- 172.21.15.60:0/3960879740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8250141140 con 0x7f825013c310 2020-10-31T22:48:44.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f8255795700 1 --2- 172.21.15.60:0/3960879740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825013c310 0x7f82500b2140 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f82400010d0 tx=0x7f8240007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:44.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f823effd700 1 -- 172.21.15.60:0/3960879740 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82400072e0 con 0x7f825013c310 2020-10-31T22:48:44.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f823effd700 1 -- 172.21.15.60:0/3960879740 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8240007440 con 0x7f825013c310 2020-10-31T22:48:44.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f8256f98700 1 -- 172.21.15.60:0/3960879740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825013be60 con 0x7f825013c310 2020-10-31T22:48:44.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f823effd700 1 -- 172.21.15.60:0/3960879740 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82400057d0 con 0x7f825013c310 2020-10-31T22:48:44.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f8256f98700 1 -- 172.21.15.60:0/3960879740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82500b3830 con 0x7f825013c310 2020-10-31T22:48:44.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f8256f98700 1 -- 172.21.15.60:0/3960879740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82501412d0 con 0x7f825013c310 2020-10-31T22:48:44.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f823effd700 1 -- 172.21.15.60:0/3960879740 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8240010070 con 0x7f825013c310 2020-10-31T22:48:44.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f823effd700 1 --2- 172.21.15.60:0/3960879740 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8230054f10 0x7f82300573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.209+0000 7f823effd700 1 -- 172.21.15.60:0/3960879740 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f824006cfe0 con 0x7f825013c310 2020-10-31T22:48:44.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.213+0000 7f8255f96700 1 --2- 172.21.15.60:0/3960879740 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8230054f10 0x7f82300573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.213+0000 7f8255f96700 1 --2- 172.21.15.60:0/3960879740 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8230054f10 0x7f82300573d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f824c01b000 tx=0x7f824c016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:44.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.217+0000 7f823effd700 1 -- 172.21.15.60:0/3960879740 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8240043460 con 0x7f825013c310 2020-10-31T22:48:44.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.357+0000 7f8256f98700 1 -- 172.21.15.60:0/3960879740 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8250057100 con 0x7f825013c310 2020-10-31T22:48:44.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.357+0000 7f823effd700 1 -- 172.21.15.60:0/3960879740 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8240046a80 con 0x7f825013c310 2020-10-31T22:48:44.366 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:48:44.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.361+0000 7f8256f98700 1 -- 172.21.15.60:0/3960879740 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8230054f10 msgr2=0x7f82300573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.361+0000 7f8256f98700 1 --2- 172.21.15.60:0/3960879740 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8230054f10 0x7f82300573d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f824c01b000 tx=0x7f824c016000).stop 2020-10-31T22:48:44.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.361+0000 7f8256f98700 1 -- 172.21.15.60:0/3960879740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825013c310 msgr2=0x7f82500b2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.361+0000 7f8256f98700 1 --2- 172.21.15.60:0/3960879740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825013c310 0x7f82500b2140 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 rx=0x7f82400010d0 tx=0x7f8240007a30).stop 2020-10-31T22:48:44.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.361+0000 7f8256f98700 1 -- 172.21.15.60:0/3960879740 shutdown_connections 2020-10-31T22:48:44.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.361+0000 7f8256f98700 1 --2- 172.21.15.60:0/3960879740 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82500aaa70 0x7f82500b2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.361+0000 7f8256f98700 1 --2- 172.21.15.60:0/3960879740 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8230054f10 0x7f82300573d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.361+0000 7f8256f98700 1 --2- 172.21.15.60:0/3960879740 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f82500afdc0 0x7f82500aa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.361+0000 7f8256f98700 1 --2- 172.21.15.60:0/3960879740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f825013c310 0x7f82500b2140 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.361+0000 7f8256f98700 1 -- 172.21.15.60:0/3960879740 >> 172.21.15.60:0/3960879740 conn(0x7f82500b3fd0 msgr2=0x7f825013ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:44.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.361+0000 7f8256f98700 1 -- 172.21.15.60:0/3960879740 shutdown_connections 2020-10-31T22:48:44.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.361+0000 7f8256f98700 1 -- 172.21.15.60:0/3960879740 wait complete. 2020-10-31T22:48:44.380 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:48:44.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.489+0000 7f884d0ea700 1 Processor -- start 2020-10-31T22:48:44.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884d0ea700 1 -- start start 2020-10-31T22:48:44.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884d0ea700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f884805b180 0x7f884805fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884d0ea700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8848060220 0x7f88480aef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884d0ea700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884805f3c0 con 0x7f88480b0b70 2020-10-31T22:48:44.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884d0ea700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8848145f70 con 0x7f8848060220 2020-10-31T22:48:44.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884d0ea700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884805f5f0 con 0x7f884805b180 2020-10-31T22:48:44.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884c8e9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8848060220 0x7f88480aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884c8e9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8848060220 0x7f88480aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46902/0 (socket says 172.21.15.60:46902) 2020-10-31T22:48:44.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884c8e9700 1 -- 172.21.15.60:0/1618721464 learned_addr learned my addr 172.21.15.60:0/1618721464 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:44.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f8847fff700 1 --2- 172.21.15.60:0/1618721464 >> v2:172.21.15.66:3300/0 conn(0x7f884805b180 0x7f884805fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884c8e9700 1 -- 172.21.15.60:0/1618721464 >> v2:172.21.15.66:3300/0 conn(0x7f884805b180 msgr2=0x7f884805fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:44.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884c8e9700 1 --2- 172.21.15.60:0/1618721464 >> v2:172.21.15.66:3300/0 conn(0x7f884805b180 0x7f884805fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884c8e9700 1 -- 172.21.15.60:0/1618721464 >> v1:172.21.15.66:6789/0 conn(0x7f88480b0b70 legacy=0x7f884813f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884c8e9700 1 -- 172.21.15.60:0/1618721464 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884805f890 con 0x7f8848060220 2020-10-31T22:48:44.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884c8e9700 1 --2- 172.21.15.60:0/1618721464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8848060220 0x7f88480aef50 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f88400032b0 tx=0x7f8840009270).ready entity=mon.0 client_cookie=453f8eb20a65a315 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:44.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f8846ffd700 1 -- 172.21.15.60:0/1618721464 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8840009e60 con 0x7f8848060220 2020-10-31T22:48:44.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f8846ffd700 1 -- 172.21.15.60:0/1618721464 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884000bc00 con 0x7f8848060220 2020-10-31T22:48:44.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f8846ffd700 1 -- 172.21.15.60:0/1618721464 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f884000bd70 con 0x7f8848060220 2020-10-31T22:48:44.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884d0ea700 1 -- 172.21.15.60:0/1618721464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8848060220 msgr2=0x7f88480aef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.493+0000 7f884d0ea700 1 --2- 172.21.15.60:0/1618721464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8848060220 0x7f88480aef50 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 rx=0x7f88400032b0 tx=0x7f8840009270).stop 2020-10-31T22:48:44.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f884d0ea700 1 -- 172.21.15.60:0/1618721464 shutdown_connections 2020-10-31T22:48:44.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f884d0ea700 1 --2- 172.21.15.60:0/1618721464 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8848060220 0x7f88480aef50 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f884d0ea700 1 --2- 172.21.15.60:0/1618721464 >> v2:172.21.15.66:3300/0 conn(0x7f884805b180 0x7f884805fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f884d0ea700 1 -- 172.21.15.60:0/1618721464 >> 172.21.15.60:0/1618721464 conn(0x7f88480b61d0 msgr2=0x7f88480b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:44.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f884d0ea700 1 -- 172.21.15.60:0/1618721464 shutdown_connections 2020-10-31T22:48:44.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f884d0ea700 1 -- 172.21.15.60:0/1618721464 wait complete. 2020-10-31T22:48:44.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f884d0ea700 1 Processor -- start 2020-10-31T22:48:44.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f884d0ea700 1 -- start start 2020-10-31T22:48:44.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f884d0ea700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884805b180 0x7f8848141d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f884d0ea700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8848060220 0x7f884813fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f884d0ea700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88480b0b70 0x7f8848148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f884d0ea700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8848140ac0 con 0x7f884805b180 2020-10-31T22:48:44.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f884d0ea700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88480ab9b0 con 0x7f88480b0b70 2020-10-31T22:48:44.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f884d0ea700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88480abc50 con 0x7f8848060220 2020-10-31T22:48:44.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.497+0000 7f8847fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884805b180 0x7f8848141d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f8847fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884805b180 0x7f8848141d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46904/0 (socket says 172.21.15.60:46904) 2020-10-31T22:48:44.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f8847fff700 1 -- 172.21.15.60:0/3948202883 learned_addr learned my addr 172.21.15.60:0/3948202883 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:44.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f88477fe700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8848060220 0x7f884813fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f884c8e9700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88480b0b70 0x7f8848148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f8847fff700 1 -- 172.21.15.60:0/3948202883 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8848060220 msgr2=0x7f884813fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f8847fff700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8848060220 0x7f884813fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f8847fff700 1 -- 172.21.15.60:0/3948202883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88480b0b70 msgr2=0x7f8848148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f8847fff700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88480b0b70 0x7f8848148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f8847fff700 1 -- 172.21.15.60:0/3948202883 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8848141620 con 0x7f884805b180 2020-10-31T22:48:44.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f88477fe700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8848060220 0x7f884813fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:44.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f8847fff700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884805b180 0x7f8848141d60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f883800c000 tx=0x7f8838006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:44.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f88457fa700 1 -- 172.21.15.60:0/3948202883 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f883800ca10 con 0x7f884805b180 2020-10-31T22:48:44.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f88457fa700 1 -- 172.21.15.60:0/3948202883 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883800cb70 con 0x7f884805b180 2020-10-31T22:48:44.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f884d0ea700 1 -- 172.21.15.60:0/3948202883 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88481418c0 con 0x7f884805b180 2020-10-31T22:48:44.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f88457fa700 1 -- 172.21.15.60:0/3948202883 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f88380123f0 con 0x7f884805b180 2020-10-31T22:48:44.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f884d0ea700 1 -- 172.21.15.60:0/3948202883 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8848148810 con 0x7f884805b180 2020-10-31T22:48:44.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f884d0ea700 1 -- 172.21.15.60:0/3948202883 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88480ab7e0 con 0x7f884805b180 2020-10-31T22:48:44.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.501+0000 7f88457fa700 1 -- 172.21.15.60:0/3948202883 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8838012550 con 0x7f884805b180 2020-10-31T22:48:44.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.505+0000 7f88457fa700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8828054f90 0x7f8828057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.505+0000 7f88477fe700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8828054f90 0x7f8828057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.505+0000 7f88457fa700 1 -- 172.21.15.60:0/3948202883 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f883806de80 con 0x7f884805b180 2020-10-31T22:48:44.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.505+0000 7f88477fe700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8828054f90 0x7f8828057450 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f883c00d000 tx=0x7f883c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:44.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.509+0000 7f88457fa700 1 -- 172.21.15.60:0/3948202883 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8838044230 con 0x7f884805b180 2020-10-31T22:48:44.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.649+0000 7f884d0ea700 1 -- 172.21.15.60:0/3948202883 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8848141a50 con 0x7f884805b180 2020-10-31T22:48:44.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.649+0000 7f88457fa700 1 -- 172.21.15.60:0/3948202883 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8838047850 con 0x7f884805b180 2020-10-31T22:48:44.657 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:48:44.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.653+0000 7f884d0ea700 1 -- 172.21.15.60:0/3948202883 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8828054f90 msgr2=0x7f8828057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.653+0000 7f884d0ea700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8828054f90 0x7f8828057450 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f883c00d000 tx=0x7f883c009040).stop 2020-10-31T22:48:44.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.653+0000 7f884d0ea700 1 -- 172.21.15.60:0/3948202883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884805b180 msgr2=0x7f8848141d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.653+0000 7f884d0ea700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884805b180 0x7f8848141d60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 rx=0x7f883800c000 tx=0x7f8838006dc0).stop 2020-10-31T22:48:44.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.653+0000 7f884d0ea700 1 -- 172.21.15.60:0/3948202883 shutdown_connections 2020-10-31T22:48:44.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.653+0000 7f884d0ea700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8828054f90 0x7f8828057450 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.653+0000 7f884d0ea700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88480b0b70 0x7f8848148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.653+0000 7f884d0ea700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f884805b180 0x7f8848141d60 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.653+0000 7f884d0ea700 1 --2- 172.21.15.60:0/3948202883 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8848060220 0x7f884813fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.653+0000 7f884d0ea700 1 -- 172.21.15.60:0/3948202883 >> 172.21.15.60:0/3948202883 conn(0x7f88480b61d0 msgr2=0x7f8848144f20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:44.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.653+0000 7f884d0ea700 1 -- 172.21.15.60:0/3948202883 shutdown_connections 2020-10-31T22:48:44.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.653+0000 7f884d0ea700 1 -- 172.21.15.60:0/3948202883 wait complete. 2020-10-31T22:48:44.674 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:48:44.675 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:44.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946f8f3700 1 Processor -- start 2020-10-31T22:48:44.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946f8f3700 1 -- start start 2020-10-31T22:48:44.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946f8f3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f94680adae0 0x7f946813fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946f8f3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94680adec0 con 0x7f94680b1460 2020-10-31T22:48:44.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946f8f3700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9468140b60 con 0x7f94680aabf0 2020-10-31T22:48:44.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946f8f3700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94681400f0 con 0x7f94680adae0 2020-10-31T22:48:44.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946de90700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f94680b1460 0x7f94681392c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51052/0 (socket says 172.21.15.60:51052) 2020-10-31T22:48:44.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946de90700 1 -- 172.21.15.60:0/1031538047 learned_addr learned my addr 172.21.15.60:0/1031538047 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:44.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946d68f700 1 --2- 172.21.15.60:0/1031538047 >> v2:172.21.15.66:3300/0 conn(0x7f94680adae0 0x7f946813fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f9467fff700 1 -- 172.21.15.60:0/1031538047 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472050255 0 0) 0x7f94680adec0 con 0x7f94680b1460 2020-10-31T22:48:44.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f9467fff700 1 -- 172.21.15.60:0/1031538047 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9448003230 con 0x7f94680b1460 2020-10-31T22:48:44.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946d68f700 1 -- 172.21.15.60:0/1031538047 >> v1:172.21.15.66:6789/0 conn(0x7f94680aabf0 legacy=0x7f94680b0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f9467fff700 1 -- 172.21.15.60:0/1031538047 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931851097 0 0) 0x7f9468140b60 con 0x7f94680aabf0 2020-10-31T22:48:44.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946d68f700 1 -- 172.21.15.60:0/1031538047 >> v1:172.21.15.60:6789/0 conn(0x7f94680b1460 legacy=0x7f94681392c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946d68f700 1 -- 172.21.15.60:0/1031538047 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9468140380 con 0x7f94680adae0 2020-10-31T22:48:44.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946d68f700 1 --2- 172.21.15.60:0/1031538047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94680adae0 0x7f946813fc00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f94580032b0 tx=0x7f94580091a0).ready entity=mon.1 client_cookie=da72a87bd15f9868 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:44.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f9467fff700 1 -- 172.21.15.60:0/1031538047 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f945800b9a0 con 0x7f94680adae0 2020-10-31T22:48:44.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f9467fff700 1 -- 172.21.15.60:0/1031538047 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945800bb00 con 0x7f94680adae0 2020-10-31T22:48:44.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f9467fff700 1 -- 172.21.15.60:0/1031538047 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f945800bc70 con 0x7f94680adae0 2020-10-31T22:48:44.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946f8f3700 1 -- 172.21.15.60:0/1031538047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94680adae0 msgr2=0x7f946813fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.785+0000 7f946f8f3700 1 --2- 172.21.15.60:0/1031538047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94680adae0 0x7f946813fc00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7f94580032b0 tx=0x7f94580091a0).stop 2020-10-31T22:48:44.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.789+0000 7f946f8f3700 1 -- 172.21.15.60:0/1031538047 shutdown_connections 2020-10-31T22:48:44.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.789+0000 7f946f8f3700 1 --2- 172.21.15.60:0/1031538047 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94680adae0 0x7f946813fc00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.789+0000 7f946f8f3700 1 -- 172.21.15.60:0/1031538047 >> 172.21.15.60:0/1031538047 conn(0x7f946806a260 msgr2=0x7f9468061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.789+0000 7f946f8f3700 1 -- 172.21.15.60:0/1031538047 shutdown_connections 2020-10-31T22:48:44.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.789+0000 7f946f8f3700 1 -- 172.21.15.60:0/1031538047 wait complete. 2020-10-31T22:48:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.789+0000 7f946f8f3700 1 Processor -- start 2020-10-31T22:48:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.789+0000 7f946f8f3700 1 -- start start 2020-10-31T22:48:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.789+0000 7f946f8f3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94680aabf0 0x7f946814eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.789+0000 7f946f8f3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94680adae0 0x7f94681420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.789+0000 7f946f8f3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94680b1460 0x7f9468142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.789+0000 7f946f8f3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9468135430 con 0x7f94680b1460 2020-10-31T22:48:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.789+0000 7f946f8f3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9468147050 con 0x7f94680adae0 2020-10-31T22:48:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.789+0000 7f946f8f3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94681463d0 con 0x7f94680aabf0 2020-10-31T22:48:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946de90700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94680b1460 0x7f9468142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946de90700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94680b1460 0x7f9468142c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46922/0 (socket says 172.21.15.60:46922) 2020-10-31T22:48:44.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946de90700 1 -- 172.21.15.60:0/3921817105 learned_addr learned my addr 172.21.15.60:0/3921817105 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946d68f700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94680aabf0 0x7f946814eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946ce8e700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94680adae0 0x7f94681420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946de90700 1 -- 172.21.15.60:0/3921817105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94680aabf0 msgr2=0x7f946814eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946de90700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94680aabf0 0x7f946814eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946de90700 1 -- 172.21.15.60:0/3921817105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94680adae0 msgr2=0x7f94681420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946de90700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94680adae0 0x7f94681420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946de90700 1 -- 172.21.15.60:0/3921817105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9468146670 con 0x7f94680b1460 2020-10-31T22:48:44.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946ce8e700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94680adae0 0x7f94681420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:44.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946d68f700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94680aabf0 0x7f946814eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:44.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946de90700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94680b1460 0x7f9468142c20 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f94681417a0 tx=0x7f9450007970).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:44.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f94667fc700 1 -- 172.21.15.60:0/3921817105 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94500072e0 con 0x7f94680b1460 2020-10-31T22:48:44.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f94667fc700 1 -- 172.21.15.60:0/3921817105 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9450007440 con 0x7f94680b1460 2020-10-31T22:48:44.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946f8f3700 1 -- 172.21.15.60:0/3921817105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9468146bb0 con 0x7f94680b1460 2020-10-31T22:48:44.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f94667fc700 1 -- 172.21.15.60:0/3921817105 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f94500057d0 con 0x7f94680b1460 2020-10-31T22:48:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946f8f3700 1 -- 172.21.15.60:0/3921817105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9468142990 con 0x7f94680b1460 2020-10-31T22:48:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f946f8f3700 1 -- 172.21.15.60:0/3921817105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9468146d40 con 0x7f94680b1460 2020-10-31T22:48:44.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.793+0000 7f94667fc700 1 -- 172.21.15.60:0/3921817105 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9450010070 con 0x7f94680b1460 2020-10-31T22:48:44.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.797+0000 7f94667fc700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f944c055020 0x7f944c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:44.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.797+0000 7f946d68f700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f944c055020 0x7f944c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:44.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.797+0000 7f94667fc700 1 -- 172.21.15.60:0/3921817105 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f945006d160 con 0x7f94680b1460 2020-10-31T22:48:44.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.797+0000 7f946d68f700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f944c055020 0x7f944c0574e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f9458019000 tx=0x7f9458016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:44.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.801+0000 7f94667fc700 1 -- 172.21.15.60:0/3921817105 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9450043570 con 0x7f94680b1460 2020-10-31T22:48:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.989+0000 7f946f8f3700 1 -- 172.21.15.60:0/3921817105 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9468057100 con 0x7f94680b1460 2020-10-31T22:48:44.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.993+0000 7f94667fc700 1 -- 172.21.15.60:0/3921817105 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2484 (secure 0 0 0) 0x7f9450046b90 con 0x7f94680b1460 2020-10-31T22:48:44.999 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:44.999 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":47,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6822,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6835/458791799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458791799},{"type":"v1","addr":"172.21.15.60:6835","nonce":458791799}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45},{"gid":6825,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/332317680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":332317680},{"type":"v1","addr":"172.21.15.60:6837","nonce":332317680}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:48:39.857912+0000","modified":"2020-10-31T22:48:40.861506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6831},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6831":{"gid":6831,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/588884767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":588884767},{"type":"v1","addr":"172.21.15.66:6833","nonce":588884767}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-10-31T22:48:45.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.993+0000 7f946f8f3700 1 -- 172.21.15.60:0/3921817105 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f944c055020 msgr2=0x7f944c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:45.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.993+0000 7f946f8f3700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f944c055020 0x7f944c0574e0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f9458019000 tx=0x7f9458016000).stop 2020-10-31T22:48:45.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.993+0000 7f946f8f3700 1 -- 172.21.15.60:0/3921817105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94680b1460 msgr2=0x7f9468142c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:45.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.993+0000 7f946f8f3700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94680b1460 0x7f9468142c20 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 rx=0x7f94681417a0 tx=0x7f9450007970).stop 2020-10-31T22:48:45.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.993+0000 7f946f8f3700 1 -- 172.21.15.60:0/3921817105 shutdown_connections 2020-10-31T22:48:45.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.993+0000 7f946f8f3700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f94680b1460 0x7f9468142c20 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.993+0000 7f946f8f3700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f94680aabf0 0x7f946814eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.993+0000 7f946f8f3700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f944c055020 0x7f944c0574e0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.993+0000 7f946f8f3700 1 --2- 172.21.15.60:0/3921817105 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94680adae0 0x7f94681420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.993+0000 7f946f8f3700 1 -- 172.21.15.60:0/3921817105 >> 172.21.15.60:0/3921817105 conn(0x7f946806a260 msgr2=0x7f94680617d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.993+0000 7f946f8f3700 1 -- 172.21.15.60:0/3921817105 shutdown_connections 2020-10-31T22:48:45.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:44.993+0000 7f946f8f3700 1 -- 172.21.15.60:0/3921817105 wait complete. 2020-10-31T22:48:45.003 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 47 2020-10-31T22:48:45.200 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:48:45.202 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:48:45.207 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:48:45.211 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:48:45.319 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:48:39.857912+0000', 'modified': '2020-10-31T22:48:40.861506+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6831}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6831': {'gid': 6831, 'name': 'b', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6833/588884767', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 588884767}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 588884767}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:48:45.320 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:48:45.321 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-10-31T22:48:45.453 INFO:teuthology.orchestra.run.smithi066.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":6831,"want_state":"up:active","state":"up:active","rank_uptime":5.5814861530000002,"mdsmap_epoch":47,"osdmap_epoch":99,"osdmap_epoch_barrier":98,"uptime":10.946306687} 2020-10-31T22:48:45.453 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 6831, "mdsmap_epoch": 47, "osdmap_epoch": 99, "osdmap_epoch_barrier": 98, "rank_uptime": 5.581486153, "state": "up:active", "uptime": 10.946306687, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:48:45.454 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:48:45.454 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:48:45.455 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:48:45.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:45.455 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:45.463 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:48:45.521 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:48:45.521 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:48:45.576 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:48:45.577 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:48:45.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:45.578 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:48:45.627 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:48:45.628 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:45.669 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:48:45.686 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:48:45.687 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:48:45.752 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:48:45.753 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:48:45.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:45.754 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:48:45.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:48:45.743+0000 7f6e5972c0c0 -1 init, newargv = 0x55898a339350 newargc=9 2020-10-31T22:48:45.758 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13799]: starting ceph client 2020-10-31T22:48:45.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13799]: starting fuse 2020-10-31T22:48:45.765 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:48:45.765 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:48:45.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:45.766 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:48:45.766 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:48:45.766 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:48:45.767 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:48:45.767 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:48:45.767 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:48:45.768 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:48:45.768 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:48:45.768 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:48:45.769 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:48:45.769 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:48:45.769 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:48:45.770 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:48:45.770 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:48:45.770 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:48:45.771 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:48:45.771 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:48:45.771 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:48:45.772 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:48:45.772 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:48:45.772 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:48:45.773 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:48:45.773 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:48:45.857 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.13799.asok 2020-10-31T22:48:45.863 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13799.asok 2020-10-31T22:48:45.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:45.864 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13799.asok status 2020-10-31T22:48:45.969 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:48:45.969 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:48:45.970 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:48:45.970 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:48:45.970 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:48:45.970 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:48:45.970 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:48:45.970 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "13799", 2020-10-31T22:48:45.971 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:48:45.971 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:48:45.971 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:48:45.971 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:48:45.971 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 6996, 2020-10-31T22:48:45.971 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:48:45.971 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:48:45.972 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:48:45.972 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 6996 2020-10-31T22:48:45.972 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:48:45.972 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:48:45.972 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:48:45.972 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:48:45.972 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2632440653 2020-10-31T22:48:45.973 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:48:45.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:48:45.973 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:48:45.973 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:48:45.973 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:48:45.973 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2632440653 2020-10-31T22:48:45.973 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:48:45.974 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.6996 172.21.15.152:0/2632440653", 2020-10-31T22:48:45.974 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/2632440653", 2020-10-31T22:48:45.974 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:48:45.975 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 47, 2020-10-31T22:48:45.975 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 99, 2020-10-31T22:48:45.976 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:48:45.976 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:48:45.976 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:48:45.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:45.980 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:45.981 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:45.987 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:48:45.988 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:48:45.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:45.989 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:46.052 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:48:46.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.165+0000 7f34422e1700 1 Processor -- start 2020-10-31T22:48:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.165+0000 7f34422e1700 1 -- start start 2020-10-31T22:48:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f34422e1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f343c0afbc0 0x7f343c0b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f34422e1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f343c0adf30 0x7f343c13e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f34422e1700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c0ab980 con 0x7f343c0af3e0 2020-10-31T22:48:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f34422e1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343c0af7c0 con 0x7f343c0afbc0 2020-10-31T22:48:46.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f34422e1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c0ae520 con 0x7f343c0adf30 2020-10-31T22:48:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f3440ade700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f343c0afbc0 0x7f343c0b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f3440ade700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f343c0afbc0 0x7f343c0b0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46926/0 (socket says 172.21.15.60:46926) 2020-10-31T22:48:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f3440ade700 1 -- 172.21.15.60:0/467593925 learned_addr learned my addr 172.21.15.60:0/467593925 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f3441ae0700 1 --2- 172.21.15.60:0/467593925 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f343c0adf30 0x7f343c13e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f3440ade700 1 -- 172.21.15.60:0/467593925 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f343c0adf30 msgr2=0x7f343c13e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f3440ade700 1 --2- 172.21.15.60:0/467593925 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f343c0adf30 0x7f343c13e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f3440ade700 1 -- 172.21.15.60:0/467593925 >> v1:172.21.15.66:6789/0 conn(0x7f343c0af3e0 legacy=0x7f343c0ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f3440ade700 1 -- 172.21.15.60:0/467593925 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c0b1520 con 0x7f343c0afbc0 2020-10-31T22:48:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f3440ade700 1 --2- 172.21.15.60:0/467593925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f343c0afbc0 0x7f343c0b0ef0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f34380032b0 tx=0x7f3438009270).ready entity=mon.0 client_cookie=724e06d5f80f395a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f342ffff700 1 -- 172.21.15.60:0/467593925 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3438009e60 con 0x7f343c0afbc0 2020-10-31T22:48:46.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f342ffff700 1 -- 172.21.15.60:0/467593925 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343800bc90 con 0x7f343c0afbc0 2020-10-31T22:48:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f342ffff700 1 -- 172.21.15.60:0/467593925 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f343800be00 con 0x7f343c0afbc0 2020-10-31T22:48:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f34422e1700 1 -- 172.21.15.60:0/467593925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f343c0afbc0 msgr2=0x7f343c0b0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f34422e1700 1 --2- 172.21.15.60:0/467593925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f343c0afbc0 0x7f343c0b0ef0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 rx=0x7f34380032b0 tx=0x7f3438009270).stop 2020-10-31T22:48:46.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f34422e1700 1 -- 172.21.15.60:0/467593925 shutdown_connections 2020-10-31T22:48:46.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f34422e1700 1 --2- 172.21.15.60:0/467593925 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f343c0adf30 0x7f343c13e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f34422e1700 1 --2- 172.21.15.60:0/467593925 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f343c0afbc0 0x7f343c0b0ef0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f34422e1700 1 -- 172.21.15.60:0/467593925 >> 172.21.15.60:0/467593925 conn(0x7f343c061dc0 msgr2=0x7f343c0621a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f34422e1700 1 -- 172.21.15.60:0/467593925 shutdown_connections 2020-10-31T22:48:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.169+0000 7f34422e1700 1 -- 172.21.15.60:0/467593925 wait complete. 2020-10-31T22:48:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f34422e1700 1 Processor -- start 2020-10-31T22:48:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f34422e1700 1 -- start start 2020-10-31T22:48:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f34422e1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f343c0adf30 0x7f343c0aac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f34422e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f343c0af3e0 0x7f343c144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f34422e1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f343c0afbc0 0x7f343c1452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f34422e1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c066410 con 0x7f343c0af3e0 2020-10-31T22:48:46.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f34422e1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c066670 con 0x7f343c0afbc0 2020-10-31T22:48:46.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f34422e1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c066910 con 0x7f343c0adf30 2020-10-31T22:48:46.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f3440ade700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f343c0af3e0 0x7f343c144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f3440ade700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f343c0af3e0 0x7f343c144dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46932/0 (socket says 172.21.15.60:46932) 2020-10-31T22:48:46.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f3440ade700 1 -- 172.21.15.60:0/1814311357 learned_addr learned my addr 172.21.15.60:0/1814311357 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:46.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f34412df700 1 --2- 172.21.15.60:0/1814311357 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f343c0adf30 0x7f343c0aac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f3441ae0700 1 --2- 172.21.15.60:0/1814311357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f343c0afbc0 0x7f343c1452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f3440ade700 1 -- 172.21.15.60:0/1814311357 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f343c0adf30 msgr2=0x7f343c0aac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f3440ade700 1 --2- 172.21.15.60:0/1814311357 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f343c0adf30 0x7f343c0aac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f3440ade700 1 -- 172.21.15.60:0/1814311357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f343c0afbc0 msgr2=0x7f343c1452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f3440ade700 1 --2- 172.21.15.60:0/1814311357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f343c0afbc0 0x7f343c1452c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f3440ade700 1 -- 172.21.15.60:0/1814311357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c152d60 con 0x7f343c0af3e0 2020-10-31T22:48:46.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f3440ade700 1 --2- 172.21.15.60:0/1814311357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f343c0af3e0 0x7f343c144dd0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f34380032b0 tx=0x7f3438016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:46.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f342effd700 1 -- 172.21.15.60:0/1814311357 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f343801f5e0 con 0x7f343c0af3e0 2020-10-31T22:48:46.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f342effd700 1 -- 172.21.15.60:0/1814311357 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343801f740 con 0x7f343c0af3e0 2020-10-31T22:48:46.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f34422e1700 1 -- 172.21.15.60:0/1814311357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c144960 con 0x7f343c0af3e0 2020-10-31T22:48:46.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f342effd700 1 -- 172.21.15.60:0/1814311357 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f343801faa0 con 0x7f343c0af3e0 2020-10-31T22:48:46.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f34422e1700 1 -- 172.21.15.60:0/1814311357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343c152b10 con 0x7f343c0af3e0 2020-10-31T22:48:46.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.173+0000 7f34422e1700 1 -- 172.21.15.60:0/1814311357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343c144af0 con 0x7f343c0af3e0 2020-10-31T22:48:46.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.177+0000 7f342effd700 1 -- 172.21.15.60:0/1814311357 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3438026030 con 0x7f343c0af3e0 2020-10-31T22:48:46.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.177+0000 7f342effd700 1 --2- 172.21.15.60:0/1814311357 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3418054f10 0x7f34180573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.177+0000 7f342effd700 1 -- 172.21.15.60:0/1814311357 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f343806eae0 con 0x7f343c0af3e0 2020-10-31T22:48:46.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.177+0000 7f34412df700 1 --2- 172.21.15.60:0/1814311357 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3418054f10 0x7f34180573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.177+0000 7f34412df700 1 --2- 172.21.15.60:0/1814311357 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3418054f10 0x7f34180573d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f343000b000 tx=0x7f3430009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:46.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.181+0000 7f342effd700 1 -- 172.21.15.60:0/1814311357 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3438044ef0 con 0x7f343c0af3e0 2020-10-31T22:48:46.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.321+0000 7f34422e1700 1 -- 172.21.15.60:0/1814311357 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f343c066ad0 con 0x7f343c0af3e0 2020-10-31T22:48:46.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.325+0000 7f342effd700 1 -- 172.21.15.60:0/1814311357 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+16041 (secure 0 0 0) 0x7f3438024020 con 0x7f343c0af3e0 2020-10-31T22:48:46.331 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:46.331 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":99,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:48:40.861615+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:48:37.407586+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":18,"pool_name":"cephfs_data","create_time":"2020-10-31T22:48:38.710432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:48:46.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.325+0000 7f34422e1700 1 -- 172.21.15.60:0/1814311357 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3418054f10 msgr2=0x7f34180573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.325+0000 7f34422e1700 1 --2- 172.21.15.60:0/1814311357 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3418054f10 0x7f34180573d0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f343000b000 tx=0x7f3430009040).stop 2020-10-31T22:48:46.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.325+0000 7f34422e1700 1 -- 172.21.15.60:0/1814311357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f343c0af3e0 msgr2=0x7f343c144dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.325+0000 7f34422e1700 1 --2- 172.21.15.60:0/1814311357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f343c0af3e0 0x7f343c144dd0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 rx=0x7f34380032b0 tx=0x7f3438016000).stop 2020-10-31T22:48:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.325+0000 7f34422e1700 1 -- 172.21.15.60:0/1814311357 shutdown_connections 2020-10-31T22:48:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.325+0000 7f34422e1700 1 --2- 172.21.15.60:0/1814311357 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3418054f10 0x7f34180573d0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.325+0000 7f34422e1700 1 --2- 172.21.15.60:0/1814311357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f343c0afbc0 0x7f343c1452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.325+0000 7f34422e1700 1 --2- 172.21.15.60:0/1814311357 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f343c0adf30 0x7f343c0aac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.325+0000 7f34422e1700 1 --2- 172.21.15.60:0/1814311357 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f343c0af3e0 0x7f343c144dd0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.325+0000 7f34422e1700 1 -- 172.21.15.60:0/1814311357 >> 172.21.15.60:0/1814311357 conn(0x7f343c061dc0 msgr2=0x7f343c0621a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.325+0000 7f34422e1700 1 -- 172.21.15.60:0/1814311357 shutdown_connections 2020-10-31T22:48:46.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.325+0000 7f34422e1700 1 -- 172.21.15.60:0/1814311357 wait complete. 2020-10-31T22:48:46.344 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:48:37.407586+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '98', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:48:38.710432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '99', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:48:46.346 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:48:46.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06bc949700 1 Processor -- start 2020-10-31T22:48:46.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06bc949700 1 -- start start 2020-10-31T22:48:46.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06bc949700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06b80b1bb0 0x7f06b805afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06bc949700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f06b80af580 0x7f06b813fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06bc949700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b80b1120 con 0x7f06b80ab150 2020-10-31T22:48:46.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06bc949700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b80af9c0 con 0x7f06b80af580 2020-10-31T22:48:46.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06bc949700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b80a8850 con 0x7f06b80b1bb0 2020-10-31T22:48:46.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06b659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f06b80af580 0x7f06b813fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06b659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f06b80af580 0x7f06b813fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46940/0 (socket says 172.21.15.60:46940) 2020-10-31T22:48:46.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06b659c700 1 -- 172.21.15.60:0/1444168021 learned_addr learned my addr 172.21.15.60:0/1444168021 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:46.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06b6d9d700 1 --2- 172.21.15.60:0/1444168021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06b80b1bb0 0x7f06b805afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06b659c700 1 -- 172.21.15.60:0/1444168021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06b80b1bb0 msgr2=0x7f06b805afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:46.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06b659c700 1 --2- 172.21.15.60:0/1444168021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06b80b1bb0 0x7f06b805afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06b659c700 1 -- 172.21.15.60:0/1444168021 >> v1:172.21.15.60:6789/0 conn(0x7f06b80ab150 legacy=0x7f06b80adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06b659c700 1 -- 172.21.15.60:0/1444168021 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b80a8af0 con 0x7f06b80af580 2020-10-31T22:48:46.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06b659c700 1 --2- 172.21.15.60:0/1444168021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b80af580 0x7f06b813fb20 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f06ac002f30 tx=0x7f06ac006e80).ready entity=mon.0 client_cookie=e2764bddff08429a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:46.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06b5d9b700 1 -- 172.21.15.60:0/1444168021 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ac0097f0 con 0x7f06b80af580 2020-10-31T22:48:46.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06b5d9b700 1 -- 172.21.15.60:0/1444168021 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac009950 con 0x7f06b80af580 2020-10-31T22:48:46.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06b5d9b700 1 -- 172.21.15.60:0/1444168021 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ac009cb0 con 0x7f06b80af580 2020-10-31T22:48:46.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06bc949700 1 -- 172.21.15.60:0/1444168021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b80af580 msgr2=0x7f06b813fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.465+0000 7f06bc949700 1 --2- 172.21.15.60:0/1444168021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b80af580 0x7f06b813fb20 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 rx=0x7f06ac002f30 tx=0x7f06ac006e80).stop 2020-10-31T22:48:46.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.469+0000 7f06bc949700 1 -- 172.21.15.60:0/1444168021 shutdown_connections 2020-10-31T22:48:46.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.469+0000 7f06bc949700 1 --2- 172.21.15.60:0/1444168021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06b80b1bb0 0x7f06b805afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.469+0000 7f06bc949700 1 --2- 172.21.15.60:0/1444168021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b80af580 0x7f06b813fb20 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.469+0000 7f06bc949700 1 -- 172.21.15.60:0/1444168021 >> 172.21.15.60:0/1444168021 conn(0x7f06b80b5330 msgr2=0x7f06b80b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:46.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.469+0000 7f06bc949700 1 -- 172.21.15.60:0/1444168021 shutdown_connections 2020-10-31T22:48:46.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.469+0000 7f06bc949700 1 -- 172.21.15.60:0/1444168021 wait complete. 2020-10-31T22:48:46.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.469+0000 7f06bc949700 1 Processor -- start 2020-10-31T22:48:46.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.469+0000 7f06bc949700 1 -- start start 2020-10-31T22:48:46.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06bc949700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06b80ab150 0x7f06b813a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06bc949700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b80af580 0x7f06b813f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06bc949700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06b80b1bb0 0x7f06b813f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06bc949700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b813c3c0 con 0x7f06b80af580 2020-10-31T22:48:46.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06bc949700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b8142bf0 con 0x7f06b80ab150 2020-10-31T22:48:46.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06bc949700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b8142e90 con 0x7f06b80b1bb0 2020-10-31T22:48:46.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06b659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b80af580 0x7f06b813f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06b659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b80af580 0x7f06b813f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46946/0 (socket says 172.21.15.60:46946) 2020-10-31T22:48:46.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06b659c700 1 -- 172.21.15.60:0/596649519 learned_addr learned my addr 172.21.15.60:0/596649519 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:46.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06b759e700 1 --2- 172.21.15.60:0/596649519 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06b80b1bb0 0x7f06b813f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06b6d9d700 1 --2- 172.21.15.60:0/596649519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06b80ab150 0x7f06b813a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06b659c700 1 -- 172.21.15.60:0/596649519 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06b80b1bb0 msgr2=0x7f06b813f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06b659c700 1 --2- 172.21.15.60:0/596649519 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06b80b1bb0 0x7f06b813f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06b659c700 1 -- 172.21.15.60:0/596649519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06b80ab150 msgr2=0x7f06b813a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06b659c700 1 --2- 172.21.15.60:0/596649519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06b80ab150 0x7f06b813a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06b659c700 1 -- 172.21.15.60:0/596649519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b8143130 con 0x7f06b80af580 2020-10-31T22:48:46.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06b659c700 1 --2- 172.21.15.60:0/596649519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b80af580 0x7f06b813f2b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f06ac002f30 tx=0x7f06ac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:46.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06a7fff700 1 -- 172.21.15.60:0/596649519 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ac011bb0 con 0x7f06b80af580 2020-10-31T22:48:46.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06a7fff700 1 -- 172.21.15.60:0/596649519 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ac011d10 con 0x7f06b80af580 2020-10-31T22:48:46.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06bc949700 1 -- 172.21.15.60:0/596649519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b8142150 con 0x7f06b80af580 2020-10-31T22:48:46.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06a7fff700 1 -- 172.21.15.60:0/596649519 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f06ac01e650 con 0x7f06b80af580 2020-10-31T22:48:46.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06bc949700 1 -- 172.21.15.60:0/596649519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b813c040 con 0x7f06b80af580 2020-10-31T22:48:46.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.473+0000 7f06bc949700 1 -- 172.21.15.60:0/596649519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b8057100 con 0x7f06b80af580 2020-10-31T22:48:46.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.477+0000 7f06a7fff700 1 -- 172.21.15.60:0/596649519 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f06ac025030 con 0x7f06b80af580 2020-10-31T22:48:46.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.477+0000 7f06a7fff700 1 --2- 172.21.15.60:0/596649519 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0694054f10 0x7f06940573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.477+0000 7f06a7fff700 1 -- 172.21.15.60:0/596649519 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f06ac06f100 con 0x7f06b80af580 2020-10-31T22:48:46.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.477+0000 7f06b6d9d700 1 --2- 172.21.15.60:0/596649519 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0694054f10 0x7f06940573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.477+0000 7f06b6d9d700 1 --2- 172.21.15.60:0/596649519 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0694054f10 0x7f06940573d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f06a8008000 tx=0x7f06a8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:46.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.481+0000 7f06a7fff700 1 -- 172.21.15.60:0/596649519 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f06ac045510 con 0x7f06b80af580 2020-10-31T22:48:46.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.625+0000 7f06bc949700 1 -- 172.21.15.60:0/596649519 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f06b806b290 con 0x7f06b80af580 2020-10-31T22:48:46.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.625+0000 7f06a7fff700 1 -- 172.21.15.60:0/596649519 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v99) v1 ==== 110+0+10 (secure 0 0 0) 0x7f06ac0230b0 con 0x7f06b80af580 2020-10-31T22:48:46.632 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:48:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.629+0000 7f06bc949700 1 -- 172.21.15.60:0/596649519 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0694054f10 msgr2=0x7f06940573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.629+0000 7f06bc949700 1 --2- 172.21.15.60:0/596649519 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0694054f10 0x7f06940573d0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f06a8008000 tx=0x7f06a8008040).stop 2020-10-31T22:48:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.629+0000 7f06bc949700 1 -- 172.21.15.60:0/596649519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b80af580 msgr2=0x7f06b813f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.629+0000 7f06bc949700 1 --2- 172.21.15.60:0/596649519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b80af580 0x7f06b813f2b0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 rx=0x7f06ac002f30 tx=0x7f06ac015000).stop 2020-10-31T22:48:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.629+0000 7f06bc949700 1 -- 172.21.15.60:0/596649519 shutdown_connections 2020-10-31T22:48:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.629+0000 7f06bc949700 1 --2- 172.21.15.60:0/596649519 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06b80b1bb0 0x7f06b813f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.629+0000 7f06bc949700 1 --2- 172.21.15.60:0/596649519 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0694054f10 0x7f06940573d0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.629+0000 7f06bc949700 1 --2- 172.21.15.60:0/596649519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06b80ab150 0x7f06b813a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.629+0000 7f06bc949700 1 --2- 172.21.15.60:0/596649519 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06b80af580 0x7f06b813f2b0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.629+0000 7f06bc949700 1 -- 172.21.15.60:0/596649519 >> 172.21.15.60:0/596649519 conn(0x7f06b80b5330 msgr2=0x7f06b80b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:46.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.629+0000 7f06bc949700 1 -- 172.21.15.60:0/596649519 shutdown_connections 2020-10-31T22:48:46.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.629+0000 7f06bc949700 1 -- 172.21.15.60:0/596649519 wait complete. 2020-10-31T22:48:46.646 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:48:46.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.761+0000 7fbe6ae45700 1 Processor -- start 2020-10-31T22:48:46.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.761+0000 7fbe6ae45700 1 -- start start 2020-10-31T22:48:46.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.761+0000 7fbe6ae45700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe6405b320 0x7fbe640b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.761+0000 7fbe6ae45700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe6405b700 con 0x7fbe640acc60 2020-10-31T22:48:46.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.761+0000 7fbe6ae45700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe64140750 con 0x7fbe640ad610 2020-10-31T22:48:46.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.761+0000 7fbe6ae45700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe640b0340 con 0x7fbe6405b320 2020-10-31T22:48:46.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.761+0000 7fbe69642700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbe640acc60 0x7fbe640b22a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51090/0 (socket says 172.21.15.60:51090) 2020-10-31T22:48:46.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.761+0000 7fbe69642700 1 -- 172.21.15.60:0/771946907 learned_addr learned my addr 172.21.15.60:0/771946907 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:46.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.761+0000 7fbe69e43700 1 --2- 172.21.15.60:0/771946907 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe6405b320 0x7fbe640b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe68e41700 1 -- 172.21.15.60:0/771946907 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1475643690 0 0) 0x7fbe6405b700 con 0x7fbe640acc60 2020-10-31T22:48:46.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe68e41700 1 -- 172.21.15.60:0/771946907 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe4c003230 con 0x7fbe640acc60 2020-10-31T22:48:46.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe68e41700 1 -- 172.21.15.60:0/771946907 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541563880 0 0) 0x7fbe64140750 con 0x7fbe640ad610 2020-10-31T22:48:46.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe69e43700 1 -- 172.21.15.60:0/771946907 >> v1:172.21.15.66:6789/0 conn(0x7fbe640ad610 legacy=0x7fbe640ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe69e43700 1 -- 172.21.15.60:0/771946907 >> v1:172.21.15.60:6789/0 conn(0x7fbe640acc60 legacy=0x7fbe640b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe69e43700 1 -- 172.21.15.60:0/771946907 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe640b05e0 con 0x7fbe6405b320 2020-10-31T22:48:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe69e43700 1 --2- 172.21.15.60:0/771946907 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe6405b320 0x7fbe640b1db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fbe600032b0 tx=0x7fbe600091a0).ready entity=mon.2 client_cookie=502ae0149d109c41 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe68e41700 1 -- 172.21.15.60:0/771946907 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe6000b9f0 con 0x7fbe6405b320 2020-10-31T22:48:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe68e41700 1 -- 172.21.15.60:0/771946907 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6000bb50 con 0x7fbe6405b320 2020-10-31T22:48:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe68e41700 1 -- 172.21.15.60:0/771946907 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe6000bcc0 con 0x7fbe6405b320 2020-10-31T22:48:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe6ae45700 1 -- 172.21.15.60:0/771946907 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe6405b320 msgr2=0x7fbe640b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe6ae45700 1 --2- 172.21.15.60:0/771946907 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe6405b320 0x7fbe640b1db0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7fbe600032b0 tx=0x7fbe600091a0).stop 2020-10-31T22:48:46.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe6ae45700 1 -- 172.21.15.60:0/771946907 shutdown_connections 2020-10-31T22:48:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe6ae45700 1 --2- 172.21.15.60:0/771946907 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe6405b320 0x7fbe640b1db0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe6ae45700 1 -- 172.21.15.60:0/771946907 >> 172.21.15.60:0/771946907 conn(0x7fbe640b61d0 msgr2=0x7fbe640b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe6ae45700 1 -- 172.21.15.60:0/771946907 shutdown_connections 2020-10-31T22:48:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.765+0000 7fbe6ae45700 1 -- 172.21.15.60:0/771946907 wait complete. 2020-10-31T22:48:46.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe6ae45700 1 Processor -- start 2020-10-31T22:48:46.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe6ae45700 1 -- start start 2020-10-31T22:48:46.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe6ae45700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe6405b320 0x7fbe6413b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe6ae45700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe640acc60 0x7fbe64139330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe6ae45700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe640ad610 0x7fbe64139820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe6ae45700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6413bea0 con 0x7fbe6405b320 2020-10-31T22:48:46.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe6ae45700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6413cd50 con 0x7fbe640acc60 2020-10-31T22:48:46.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe6ae45700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6413c0d0 con 0x7fbe640ad610 2020-10-31T22:48:46.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe69e43700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe6405b320 0x7fbe6413b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe69e43700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe6405b320 0x7fbe6413b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46958/0 (socket says 172.21.15.60:46958) 2020-10-31T22:48:46.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe69e43700 1 -- 172.21.15.60:0/4015759432 learned_addr learned my addr 172.21.15.60:0/4015759432 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:46.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe6a644700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe640ad610 0x7fbe64139820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe69642700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe640acc60 0x7fbe64139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe69e43700 1 -- 172.21.15.60:0/4015759432 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe640ad610 msgr2=0x7fbe64139820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe69e43700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe640ad610 0x7fbe64139820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe69e43700 1 -- 172.21.15.60:0/4015759432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe640acc60 msgr2=0x7fbe64139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe69e43700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe640acc60 0x7fbe64139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe69e43700 1 -- 172.21.15.60:0/4015759432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6413c370 con 0x7fbe6405b320 2020-10-31T22:48:46.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe6a644700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe640ad610 0x7fbe64139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:46.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe69642700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe640acc60 0x7fbe64139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:46.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe69e43700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe6405b320 0x7fbe6413b870 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fbe600032b0 tx=0x7fbe60016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:46.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe52ffd700 1 -- 172.21.15.60:0/4015759432 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe6001f3f0 con 0x7fbe6405b320 2020-10-31T22:48:46.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe52ffd700 1 -- 172.21.15.60:0/4015759432 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6001f550 con 0x7fbe6405b320 2020-10-31T22:48:46.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe6ae45700 1 -- 172.21.15.60:0/4015759432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe6413c610 con 0x7fbe6405b320 2020-10-31T22:48:46.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe52ffd700 1 -- 172.21.15.60:0/4015759432 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbe6001f8b0 con 0x7fbe6405b320 2020-10-31T22:48:46.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.769+0000 7fbe6ae45700 1 -- 172.21.15.60:0/4015759432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe64139d10 con 0x7fbe6405b320 2020-10-31T22:48:46.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.773+0000 7fbe6ae45700 1 -- 172.21.15.60:0/4015759432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe64057100 con 0x7fbe6405b320 2020-10-31T22:48:46.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.773+0000 7fbe52ffd700 1 -- 172.21.15.60:0/4015759432 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbe60026030 con 0x7fbe6405b320 2020-10-31T22:48:46.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.773+0000 7fbe52ffd700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbe44054f30 0x7fbe440573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:46.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.773+0000 7fbe52ffd700 1 -- 172.21.15.60:0/4015759432 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbe6006e740 con 0x7fbe6405b320 2020-10-31T22:48:46.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.773+0000 7fbe69642700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbe44054f30 0x7fbe440573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:46.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.773+0000 7fbe69642700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbe44054f30 0x7fbe440573f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fbe5400b000 tx=0x7fbe54009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:46.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.785+0000 7fbe52ffd700 1 -- 172.21.15.60:0/4015759432 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbe60044b50 con 0x7fbe6405b320 2020-10-31T22:48:46.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.925+0000 7fbe6ae45700 1 -- 172.21.15.60:0/4015759432 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fbe640ae950 con 0x7fbe6405b320 2020-10-31T22:48:46.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.929+0000 7fbe52ffd700 1 -- 172.21.15.60:0/4015759432 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v99) v1 ==== 92+0+10 (secure 0 0 0) 0x7fbe60048170 con 0x7fbe6405b320 2020-10-31T22:48:46.934 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:48:46.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.929+0000 7fbe6ae45700 1 -- 172.21.15.60:0/4015759432 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbe44054f30 msgr2=0x7fbe440573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.929+0000 7fbe6ae45700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbe44054f30 0x7fbe440573f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7fbe5400b000 tx=0x7fbe54009040).stop 2020-10-31T22:48:46.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.929+0000 7fbe6ae45700 1 -- 172.21.15.60:0/4015759432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe6405b320 msgr2=0x7fbe6413b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:46.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.929+0000 7fbe6ae45700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe6405b320 0x7fbe6413b870 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 rx=0x7fbe600032b0 tx=0x7fbe60016000).stop 2020-10-31T22:48:46.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.929+0000 7fbe6ae45700 1 -- 172.21.15.60:0/4015759432 shutdown_connections 2020-10-31T22:48:46.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.929+0000 7fbe6ae45700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe640ad610 0x7fbe64139820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.929+0000 7fbe6ae45700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe6405b320 0x7fbe6413b870 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.929+0000 7fbe6ae45700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbe44054f30 0x7fbe440573f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.929+0000 7fbe6ae45700 1 --2- 172.21.15.60:0/4015759432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe640acc60 0x7fbe64139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:46.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.929+0000 7fbe6ae45700 1 -- 172.21.15.60:0/4015759432 >> 172.21.15.60:0/4015759432 conn(0x7fbe640b61d0 msgr2=0x7fbe641460a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:46.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.929+0000 7fbe6ae45700 1 -- 172.21.15.60:0/4015759432 shutdown_connections 2020-10-31T22:48:46.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:46.929+0000 7fbe6ae45700 1 -- 172.21.15.60:0/4015759432 wait complete. 2020-10-31T22:48:46.947 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:48:47.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe41fae700 1 Processor -- start 2020-10-31T22:48:47.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe41fae700 1 -- start start 2020-10-31T22:48:47.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe41fae700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe3c0b5950 0x7efe3c142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe41fae700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c142b00 con 0x7efe3c0b24a0 2020-10-31T22:48:47.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe41fae700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3c0b4440 con 0x7efe3c0b5570 2020-10-31T22:48:47.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe41fae700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c13f930 con 0x7efe3c0b5950 2020-10-31T22:48:47.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe3bfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7efe3c0b24a0 0x7efe3c141f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51106/0 (socket says 172.21.15.60:51106) 2020-10-31T22:48:47.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe3bfff700 1 -- 172.21.15.60:0/4036126635 learned_addr learned my addr 172.21.15.60:0/4036126635 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:47.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe417ad700 1 --2- 172.21.15.60:0/4036126635 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe3c0b5950 0x7efe3c142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe3b7fe700 1 -- 172.21.15.60:0/4036126635 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2742738449 0 0) 0x7efe3c142b00 con 0x7efe3c0b24a0 2020-10-31T22:48:47.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe3b7fe700 1 -- 172.21.15.60:0/4036126635 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe1c003230 con 0x7efe3c0b24a0 2020-10-31T22:48:47.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe3b7fe700 1 -- 172.21.15.60:0/4036126635 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613105777 0 0) 0x7efe3c0b4440 con 0x7efe3c0b5570 2020-10-31T22:48:47.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe3b7fe700 1 -- 172.21.15.60:0/4036126635 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe3c142b00 con 0x7efe3c0b5570 2020-10-31T22:48:47.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe3b7fe700 1 -- 172.21.15.60:0/4036126635 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1665412518 0 0) 0x7efe1c003230 con 0x7efe3c0b24a0 2020-10-31T22:48:47.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe417ad700 1 -- 172.21.15.60:0/4036126635 >> v1:172.21.15.66:6789/0 conn(0x7efe3c0b5570 legacy=0x7efe3c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe417ad700 1 -- 172.21.15.60:0/4036126635 >> v1:172.21.15.60:6789/0 conn(0x7efe3c0b24a0 legacy=0x7efe3c141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.065+0000 7efe417ad700 1 -- 172.21.15.60:0/4036126635 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c146060 con 0x7efe3c0b5950 2020-10-31T22:48:47.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.069+0000 7efe417ad700 1 --2- 172.21.15.60:0/4036126635 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe3c0b5950 0x7efe3c142610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7efe24001870 tx=0x7efe340091a0).ready entity=mon.2 client_cookie=6a81f8184b87b46e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:47.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.069+0000 7efe3b7fe700 1 -- 172.21.15.60:0/4036126635 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe240016d0 con 0x7efe3c0b5950 2020-10-31T22:48:47.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.069+0000 7efe3b7fe700 1 -- 172.21.15.60:0/4036126635 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3400b800 con 0x7efe3c0b5950 2020-10-31T22:48:47.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.069+0000 7efe3b7fe700 1 -- 172.21.15.60:0/4036126635 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe3400b970 con 0x7efe3c0b5950 2020-10-31T22:48:47.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.069+0000 7efe41fae700 1 -- 172.21.15.60:0/4036126635 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe3c0b5950 msgr2=0x7efe3c142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.069+0000 7efe41fae700 1 --2- 172.21.15.60:0/4036126635 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe3c0b5950 0x7efe3c142610 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7efe24001870 tx=0x7efe340091a0).stop 2020-10-31T22:48:47.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.069+0000 7efe41fae700 1 -- 172.21.15.60:0/4036126635 shutdown_connections 2020-10-31T22:48:47.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.069+0000 7efe41fae700 1 --2- 172.21.15.60:0/4036126635 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe3c0b5950 0x7efe3c142610 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.069+0000 7efe41fae700 1 -- 172.21.15.60:0/4036126635 >> 172.21.15.60:0/4036126635 conn(0x7efe3c0b8e90 msgr2=0x7efe3c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:47.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.069+0000 7efe41fae700 1 -- 172.21.15.60:0/4036126635 shutdown_connections 2020-10-31T22:48:47.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.069+0000 7efe41fae700 1 -- 172.21.15.60:0/4036126635 wait complete. 2020-10-31T22:48:47.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.069+0000 7efe41fae700 1 Processor -- start 2020-10-31T22:48:47.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.069+0000 7efe41fae700 1 -- start start 2020-10-31T22:48:47.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe41fae700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0b24a0 0x7efe3c141010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe41fae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe3c0b5570 0x7efe3c1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe41fae700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe3c0b5950 0x7efe3c13e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe41fae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c155020 con 0x7efe3c0b5570 2020-10-31T22:48:47.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe41fae700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c147a90 con 0x7efe3c0b24a0 2020-10-31T22:48:47.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe41fae700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe3c148b40 con 0x7efe3c0b5950 2020-10-31T22:48:47.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe3bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe3c0b5570 0x7efe3c1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe40fac700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0b24a0 0x7efe3c141010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe3bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe3c0b5570 0x7efe3c1536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46974/0 (socket says 172.21.15.60:46974) 2020-10-31T22:48:47.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe3bfff700 1 -- 172.21.15.60:0/412991841 learned_addr learned my addr 172.21.15.60:0/412991841 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:47.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe417ad700 1 --2- 172.21.15.60:0/412991841 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe3c0b5950 0x7efe3c13e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe3bfff700 1 -- 172.21.15.60:0/412991841 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe3c0b5950 msgr2=0x7efe3c13e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe3bfff700 1 --2- 172.21.15.60:0/412991841 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe3c0b5950 0x7efe3c13e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe3bfff700 1 -- 172.21.15.60:0/412991841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0b24a0 msgr2=0x7efe3c141010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe3bfff700 1 --2- 172.21.15.60:0/412991841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0b24a0 0x7efe3c141010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe3bfff700 1 -- 172.21.15.60:0/412991841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3c148de0 con 0x7efe3c0b5570 2020-10-31T22:48:47.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe417ad700 1 --2- 172.21.15.60:0/412991841 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe3c0b5950 0x7efe3c13e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:47.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe3bfff700 1 --2- 172.21.15.60:0/412991841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe3c0b5570 0x7efe3c1536a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7efe24000fa0 tx=0x7efe24001ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:47.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe39ffb700 1 -- 172.21.15.60:0/412991841 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe2400ce40 con 0x7efe3c0b5570 2020-10-31T22:48:47.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe39ffb700 1 -- 172.21.15.60:0/412991841 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe24007170 con 0x7efe3c0b5570 2020-10-31T22:48:47.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe39ffb700 1 -- 172.21.15.60:0/412991841 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efe2400a7c0 con 0x7efe3c0b5570 2020-10-31T22:48:47.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe41fae700 1 -- 172.21.15.60:0/412991841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe3c153200 con 0x7efe3c0b5570 2020-10-31T22:48:47.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe41fae700 1 -- 172.21.15.60:0/412991841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3c148420 con 0x7efe3c0b5570 2020-10-31T22:48:47.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe39ffb700 1 -- 172.21.15.60:0/412991841 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7efe24010070 con 0x7efe3c0b5570 2020-10-31T22:48:47.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.073+0000 7efe41fae700 1 -- 172.21.15.60:0/412991841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe3c153390 con 0x7efe3c0b5570 2020-10-31T22:48:47.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.077+0000 7efe39ffb700 1 --2- 172.21.15.60:0/412991841 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe20055020 0x7efe200574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.077+0000 7efe39ffb700 1 -- 172.21.15.60:0/412991841 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efe2406d4d0 con 0x7efe3c0b5570 2020-10-31T22:48:47.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.077+0000 7efe40fac700 1 --2- 172.21.15.60:0/412991841 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe20055020 0x7efe200574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.077+0000 7efe40fac700 1 --2- 172.21.15.60:0/412991841 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe20055020 0x7efe200574e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7efe2c00d000 tx=0x7efe2c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:47.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.081+0000 7efe39ffb700 1 -- 172.21.15.60:0/412991841 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7efe240439f0 con 0x7efe3c0b5570 2020-10-31T22:48:47.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.225+0000 7efe41fae700 1 -- 172.21.15.60:0/412991841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efe3c148730 con 0x7efe3c0b5570 2020-10-31T22:48:47.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.225+0000 7efe39ffb700 1 -- 172.21.15.60:0/412991841 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v99) v1 ==== 104+0+10 (secure 0 0 0) 0x7efe24019070 con 0x7efe3c0b5570 2020-10-31T22:48:47.230 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:48:47.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.225+0000 7efe41fae700 1 -- 172.21.15.60:0/412991841 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe20055020 msgr2=0x7efe200574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.225+0000 7efe41fae700 1 --2- 172.21.15.60:0/412991841 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe20055020 0x7efe200574e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7efe2c00d000 tx=0x7efe2c009040).stop 2020-10-31T22:48:47.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.225+0000 7efe41fae700 1 -- 172.21.15.60:0/412991841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe3c0b5570 msgr2=0x7efe3c1536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.225+0000 7efe41fae700 1 --2- 172.21.15.60:0/412991841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe3c0b5570 0x7efe3c1536a0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 rx=0x7efe24000fa0 tx=0x7efe24001ac0).stop 2020-10-31T22:48:47.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.225+0000 7efe41fae700 1 -- 172.21.15.60:0/412991841 shutdown_connections 2020-10-31T22:48:47.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.225+0000 7efe41fae700 1 --2- 172.21.15.60:0/412991841 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe3c0b5950 0x7efe3c13e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.225+0000 7efe41fae700 1 --2- 172.21.15.60:0/412991841 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efe20055020 0x7efe200574e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.225+0000 7efe41fae700 1 --2- 172.21.15.60:0/412991841 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe3c0b24a0 0x7efe3c141010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.225+0000 7efe41fae700 1 --2- 172.21.15.60:0/412991841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efe3c0b5570 0x7efe3c1536a0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.225+0000 7efe41fae700 1 -- 172.21.15.60:0/412991841 >> 172.21.15.60:0/412991841 conn(0x7efe3c0b8e90 msgr2=0x7efe3c0b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:47.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.229+0000 7efe41fae700 1 -- 172.21.15.60:0/412991841 shutdown_connections 2020-10-31T22:48:47.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.229+0000 7efe41fae700 1 -- 172.21.15.60:0/412991841 wait complete. 2020-10-31T22:48:47.252 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:48:47.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.365+0000 7f6595b6a700 1 Processor -- start 2020-10-31T22:48:47.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.365+0000 7f6595b6a700 1 -- start start 2020-10-31T22:48:47.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f659005c660 0x7f65900b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6590065f70 0x7f659013f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f659013f880 0x7f6590142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6590066d60 con 0x7f6590065f70 2020-10-31T22:48:47.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65900b5e80 con 0x7f659013f880 2020-10-31T22:48:47.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6590066410 con 0x7f659005c660 2020-10-31T22:48:47.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6590065f70 0x7f659013f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6590065f70 0x7f659013f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46982/0 (socket says 172.21.15.60:46982) 2020-10-31T22:48:47.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658effd700 1 -- 172.21.15.60:0/3792296804 learned_addr learned my addr 172.21.15.60:0/3792296804 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:47.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658ffff700 1 --2- 172.21.15.60:0/3792296804 >> v2:172.21.15.66:3300/0 conn(0x7f659013f880 0x7f6590142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658f7fe700 1 --2- 172.21.15.60:0/3792296804 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f659005c660 0x7f65900b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658effd700 1 -- 172.21.15.60:0/3792296804 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f659005c660 msgr2=0x7f65900b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:47.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658effd700 1 --2- 172.21.15.60:0/3792296804 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f659005c660 0x7f65900b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658effd700 1 -- 172.21.15.60:0/3792296804 >> v2:172.21.15.66:3300/0 conn(0x7f659013f880 msgr2=0x7f6590142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:47.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658effd700 1 --2- 172.21.15.60:0/3792296804 >> v2:172.21.15.66:3300/0 conn(0x7f659013f880 0x7f6590142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658effd700 1 -- 172.21.15.60:0/3792296804 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65900666b0 con 0x7f6590065f70 2020-10-31T22:48:47.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658ffff700 1 --2- 172.21.15.60:0/3792296804 >> v2:172.21.15.66:3300/0 conn(0x7f659013f880 0x7f6590142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:47.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658effd700 1 --2- 172.21.15.60:0/3792296804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6590065f70 0x7f659013f390 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f65900b0560 tx=0x7f6584006e80).ready entity=mon.0 client_cookie=9717fa30f1f7cbb1 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:47.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658e7fc700 1 -- 172.21.15.60:0/3792296804 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65840097b0 con 0x7f6590065f70 2020-10-31T22:48:47.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658e7fc700 1 -- 172.21.15.60:0/3792296804 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6584009910 con 0x7f6590065f70 2020-10-31T22:48:47.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f658e7fc700 1 -- 172.21.15.60:0/3792296804 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6584009c70 con 0x7f6590065f70 2020-10-31T22:48:47.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 -- 172.21.15.60:0/3792296804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6590065f70 msgr2=0x7f659013f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 --2- 172.21.15.60:0/3792296804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6590065f70 0x7f659013f390 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 rx=0x7f65900b0560 tx=0x7f6584006e80).stop 2020-10-31T22:48:47.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 -- 172.21.15.60:0/3792296804 shutdown_connections 2020-10-31T22:48:47.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 --2- 172.21.15.60:0/3792296804 >> v2:172.21.15.66:3300/0 conn(0x7f659013f880 0x7f6590142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 --2- 172.21.15.60:0/3792296804 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f659005c660 0x7f65900b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 --2- 172.21.15.60:0/3792296804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6590065f70 0x7f659013f390 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 -- 172.21.15.60:0/3792296804 >> 172.21.15.60:0/3792296804 conn(0x7f65900601e0 msgr2=0x7f659005b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 -- 172.21.15.60:0/3792296804 shutdown_connections 2020-10-31T22:48:47.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.369+0000 7f6595b6a700 1 -- 172.21.15.60:0/3792296804 wait complete. 2020-10-31T22:48:47.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f6595b6a700 1 Processor -- start 2020-10-31T22:48:47.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f6595b6a700 1 -- start start 2020-10-31T22:48:47.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f6595b6a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f659005c660 0x7f65900b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f6595b6a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6590065f70 0x7f6590154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f6595b6a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f659013f880 0x7f65900acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f6595b6a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65900abeb0 con 0x7f6590065f70 2020-10-31T22:48:47.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f6595b6a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6590150bc0 con 0x7f659013f880 2020-10-31T22:48:47.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f6595b6a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6590150db0 con 0x7f659005c660 2020-10-31T22:48:47.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6590065f70 0x7f6590154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6590065f70 0x7f6590154b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:46986/0 (socket says 172.21.15.60:46986) 2020-10-31T22:48:47.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658effd700 1 -- 172.21.15.60:0/2387003109 learned_addr learned my addr 172.21.15.60:0/2387003109 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:47.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658ffff700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f659013f880 0x7f65900acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658f7fe700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f659005c660 0x7f65900b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658effd700 1 -- 172.21.15.60:0/2387003109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f659005c660 msgr2=0x7f65900b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658effd700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f659005c660 0x7f65900b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658effd700 1 -- 172.21.15.60:0/2387003109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f659013f880 msgr2=0x7f65900acaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658effd700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f659013f880 0x7f65900acaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658effd700 1 -- 172.21.15.60:0/2387003109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6590151050 con 0x7f6590065f70 2020-10-31T22:48:47.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658ffff700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f659013f880 0x7f65900acaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:47.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658f7fe700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f659005c660 0x7f65900b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:47.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658effd700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6590065f70 0x7f6590154b90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f65900b0560 tx=0x7f6584015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:47.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658cff9700 1 -- 172.21.15.60:0/2387003109 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6584011ca0 con 0x7f6590065f70 2020-10-31T22:48:47.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658cff9700 1 -- 172.21.15.60:0/2387003109 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6584011e00 con 0x7f6590065f70 2020-10-31T22:48:47.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f658cff9700 1 -- 172.21.15.60:0/2387003109 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f658401e650 con 0x7f6590065f70 2020-10-31T22:48:47.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f6595b6a700 1 -- 172.21.15.60:0/2387003109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65901512f0 con 0x7f6590065f70 2020-10-31T22:48:47.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.373+0000 7f6595b6a700 1 -- 172.21.15.60:0/2387003109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6590151ab0 con 0x7f6590065f70 2020-10-31T22:48:47.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.377+0000 7f658cff9700 1 -- 172.21.15.60:0/2387003109 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6584025030 con 0x7f6590065f70 2020-10-31T22:48:47.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.377+0000 7f6595b6a700 1 -- 172.21.15.60:0/2387003109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65900ac6c0 con 0x7f6590065f70 2020-10-31T22:48:47.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.377+0000 7f658cff9700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6570054f10 0x7f65700573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.377+0000 7f658cff9700 1 -- 172.21.15.60:0/2387003109 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f658406ef80 con 0x7f6590065f70 2020-10-31T22:48:47.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.377+0000 7f658f7fe700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6570054f10 0x7f65700573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.377+0000 7f658f7fe700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6570054f10 0x7f65700573d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f6580008000 tx=0x7f6580008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:47.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.385+0000 7f658cff9700 1 -- 172.21.15.60:0/2387003109 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f65900ac6c0 con 0x7f6590065f70 2020-10-31T22:48:47.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.529+0000 7f6595b6a700 1 -- 172.21.15.60:0/2387003109 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f65900ac6c0 con 0x7f6590065f70 2020-10-31T22:48:47.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.529+0000 7f658cff9700 1 -- 172.21.15.60:0/2387003109 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v99) v1 ==== 100+0+10 (secure 0 0 0) 0x7f65900ac6c0 con 0x7f6590065f70 2020-10-31T22:48:47.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.533+0000 7f6595b6a700 1 -- 172.21.15.60:0/2387003109 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6570054f10 msgr2=0x7f65700573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.533+0000 7f6595b6a700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6570054f10 0x7f65700573d0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7f6580008000 tx=0x7f6580008040).stop 2020-10-31T22:48:47.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.533+0000 7f6595b6a700 1 -- 172.21.15.60:0/2387003109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6590065f70 msgr2=0x7f6590154b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.533+0000 7f6595b6a700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6590065f70 0x7f6590154b90 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 rx=0x7f65900b0560 tx=0x7f6584015000).stop 2020-10-31T22:48:47.540 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:48:47.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.533+0000 7f6595b6a700 1 -- 172.21.15.60:0/2387003109 shutdown_connections 2020-10-31T22:48:47.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.533+0000 7f6595b6a700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6570054f10 0x7f65700573d0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.533+0000 7f6595b6a700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f659013f880 0x7f65900acaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.533+0000 7f6595b6a700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f659005c660 0x7f65900b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.533+0000 7f6595b6a700 1 --2- 172.21.15.60:0/2387003109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6590065f70 0x7f6590154b90 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.533+0000 7f6595b6a700 1 -- 172.21.15.60:0/2387003109 >> 172.21.15.60:0/2387003109 conn(0x7f65900601e0 msgr2=0x7f65900b8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:47.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.533+0000 7f6595b6a700 1 -- 172.21.15.60:0/2387003109 shutdown_connections 2020-10-31T22:48:47.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.533+0000 7f6595b6a700 1 -- 172.21.15.60:0/2387003109 wait complete. 2020-10-31T22:48:47.553 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:48:47.554 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:47.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80eec2700 1 Processor -- start 2020-10-31T22:48:47.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80eec2700 1 -- start start 2020-10-31T22:48:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80eec2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb800047d00 0x7fb80003e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80eec2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb80003edf0 0x7fb80003d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80eec2700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8000d4130 con 0x7fb80003dda0 2020-10-31T22:48:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80eec2700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8000ce940 con 0x7fb800047d00 2020-10-31T22:48:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80eec2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000d4fe0 con 0x7fb80003edf0 2020-10-31T22:48:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80dec0700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb800047d00 0x7fb80003e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80d6bf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb80003edf0 0x7fb80003d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80dec0700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb800047d00 0x7fb80003e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:57930/0 (socket says 172.21.15.60:57930) 2020-10-31T22:48:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80e6c1700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fb80003dda0 0x7fb8000d0be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:49002/0 (socket says 172.21.15.60:49002) 2020-10-31T22:48:47.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80dec0700 1 -- 172.21.15.60:0/461230091 learned_addr learned my addr 172.21.15.60:0/461230091 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:47.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80dec0700 1 -- 172.21.15.60:0/461230091 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb80003edf0 msgr2=0x7fb80003d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:47.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80dec0700 1 --2- 172.21.15.60:0/461230091 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb80003edf0 0x7fb80003d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80dec0700 1 -- 172.21.15.60:0/461230091 >> v1:172.21.15.66:6789/0 conn(0x7fb80003dda0 legacy=0x7fb8000d0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80dec0700 1 -- 172.21.15.60:0/461230091 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800040ca0 con 0x7fb800047d00 2020-10-31T22:48:47.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80dec0700 1 --2- 172.21.15.60:0/461230091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb800047d00 0x7fb80003e900 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fb8000d5120 tx=0x7fb804006e80).ready entity=mon.1 client_cookie=fb22b273d95cc545 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:47.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80cebe700 1 -- 172.21.15.60:0/461230091 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8040097b0 con 0x7fb800047d00 2020-10-31T22:48:47.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80cebe700 1 -- 172.21.15.60:0/461230091 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb804009910 con 0x7fb800047d00 2020-10-31T22:48:47.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80cebe700 1 -- 172.21.15.60:0/461230091 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb804009c70 con 0x7fb800047d00 2020-10-31T22:48:47.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80eec2700 1 -- 172.21.15.60:0/461230091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb800047d00 msgr2=0x7fb80003e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.701+0000 7fb80eec2700 1 --2- 172.21.15.60:0/461230091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb800047d00 0x7fb80003e900 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7fb8000d5120 tx=0x7fb804006e80).stop 2020-10-31T22:48:47.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80eec2700 1 -- 172.21.15.60:0/461230091 shutdown_connections 2020-10-31T22:48:47.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80eec2700 1 --2- 172.21.15.60:0/461230091 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb800047d00 0x7fb80003e900 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80eec2700 1 --2- 172.21.15.60:0/461230091 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb80003edf0 0x7fb80003d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80eec2700 1 -- 172.21.15.60:0/461230091 >> 172.21.15.60:0/461230091 conn(0x7fb80000aed0 msgr2=0x7fb8000472b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:47.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80eec2700 1 -- 172.21.15.60:0/461230091 shutdown_connections 2020-10-31T22:48:47.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80eec2700 1 -- 172.21.15.60:0/461230091 wait complete. 2020-10-31T22:48:47.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80eec2700 1 Processor -- start 2020-10-31T22:48:47.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80eec2700 1 -- start start 2020-10-31T22:48:47.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80eec2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb80003dda0 0x7fb80003c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80eec2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb80003edf0 0x7fb8000cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80eec2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb800047d00 0x7fb80003bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80eec2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000c3530 con 0x7fb80003edf0 2020-10-31T22:48:47.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80eec2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80003b700 con 0x7fb800047d00 2020-10-31T22:48:47.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80eec2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000c3710 con 0x7fb80003dda0 2020-10-31T22:48:47.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.705+0000 7fb80d6bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb80003edf0 0x7fb8000cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb80d6bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb80003edf0 0x7fb8000cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47002/0 (socket says 172.21.15.60:47002) 2020-10-31T22:48:47.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb80e6c1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb800047d00 0x7fb80003bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb80d6bf700 1 -- 172.21.15.60:0/4257316681 learned_addr learned my addr 172.21.15.60:0/4257316681 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:47.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb80dec0700 1 --2- 172.21.15.60:0/4257316681 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb80003dda0 0x7fb80003c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb80d6bf700 1 -- 172.21.15.60:0/4257316681 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb80003dda0 msgr2=0x7fb80003c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb80d6bf700 1 --2- 172.21.15.60:0/4257316681 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb80003dda0 0x7fb80003c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb80d6bf700 1 -- 172.21.15.60:0/4257316681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb800047d00 msgr2=0x7fb80003bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb80d6bf700 1 --2- 172.21.15.60:0/4257316681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb800047d00 0x7fb80003bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb80d6bf700 1 -- 172.21.15.60:0/4257316681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8000c39b0 con 0x7fb80003edf0 2020-10-31T22:48:47.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb80d6bf700 1 --2- 172.21.15.60:0/4257316681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb80003edf0 0x7fb8000cdb00 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7fb7f800c000 tx=0x7fb7f8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:47.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb7f6ffd700 1 -- 172.21.15.60:0/4257316681 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7f800ca10 con 0x7fb80003edf0 2020-10-31T22:48:47.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb7f6ffd700 1 -- 172.21.15.60:0/4257316681 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f800cb70 con 0x7fb80003edf0 2020-10-31T22:48:47.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb80eec2700 1 -- 172.21.15.60:0/4257316681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8000cdff0 con 0x7fb80003edf0 2020-10-31T22:48:47.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb7f6ffd700 1 -- 172.21.15.60:0/4257316681 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb7f80123f0 con 0x7fb80003edf0 2020-10-31T22:48:47.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb80eec2700 1 -- 172.21.15.60:0/4257316681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8000c4930 con 0x7fb80003edf0 2020-10-31T22:48:47.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb7f6ffd700 1 -- 172.21.15.60:0/4257316681 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb7f8012550 con 0x7fb80003edf0 2020-10-31T22:48:47.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb80eec2700 1 -- 172.21.15.60:0/4257316681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80003b870 con 0x7fb80003edf0 2020-10-31T22:48:47.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb7f6ffd700 1 --2- 172.21.15.60:0/4257316681 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb7e80550c0 0x7fb7e8057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:47.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb7f6ffd700 1 -- 172.21.15.60:0/4257316681 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb7f806dd00 con 0x7fb80003edf0 2020-10-31T22:48:47.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.709+0000 7fb80dec0700 1 --2- 172.21.15.60:0/4257316681 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb7e80550c0 0x7fb7e8057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:47.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.713+0000 7fb80dec0700 1 --2- 172.21.15.60:0/4257316681 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb7e80550c0 0x7fb7e8057580 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fb80401c000 tx=0x7fb804015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:47.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.717+0000 7fb7f6ffd700 1 -- 172.21.15.60:0/4257316681 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb80003b870 con 0x7fb80003edf0 2020-10-31T22:48:47.911 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.905+0000 7fb80eec2700 1 -- 172.21.15.60:0/4257316681 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb80003b870 con 0x7fb80003edf0 2020-10-31T22:48:47.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.905+0000 7fb7f6ffd700 1 -- 172.21.15.60:0/4257316681 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2484 (secure 0 0 0) 0x7fb80003b870 con 0x7fb80003edf0 2020-10-31T22:48:47.912 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:47.913 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":47,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6822,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6835/458791799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458791799},{"type":"v1","addr":"172.21.15.60:6835","nonce":458791799}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45},{"gid":6825,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/332317680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":332317680},{"type":"v1","addr":"172.21.15.60:6837","nonce":332317680}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:48:39.857912+0000","modified":"2020-10-31T22:48:40.861506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6831},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6831":{"gid":6831,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/588884767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":588884767},{"type":"v1","addr":"172.21.15.66:6833","nonce":588884767}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-10-31T22:48:47.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.909+0000 7fb80eec2700 1 -- 172.21.15.60:0/4257316681 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb7e80550c0 msgr2=0x7fb7e8057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.909+0000 7fb80eec2700 1 --2- 172.21.15.60:0/4257316681 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb7e80550c0 0x7fb7e8057580 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7fb80401c000 tx=0x7fb804015000).stop 2020-10-31T22:48:47.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.909+0000 7fb80eec2700 1 -- 172.21.15.60:0/4257316681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb80003edf0 msgr2=0x7fb8000cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:47.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.909+0000 7fb80eec2700 1 --2- 172.21.15.60:0/4257316681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb80003edf0 0x7fb8000cdb00 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 rx=0x7fb7f800c000 tx=0x7fb7f8006dc0).stop 2020-10-31T22:48:47.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.909+0000 7fb80eec2700 1 -- 172.21.15.60:0/4257316681 shutdown_connections 2020-10-31T22:48:47.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.909+0000 7fb80eec2700 1 --2- 172.21.15.60:0/4257316681 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb7e80550c0 0x7fb7e8057580 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.909+0000 7fb80eec2700 1 --2- 172.21.15.60:0/4257316681 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb800047d00 0x7fb80003bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.909+0000 7fb80eec2700 1 --2- 172.21.15.60:0/4257316681 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb80003dda0 0x7fb80003c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.909+0000 7fb80eec2700 1 --2- 172.21.15.60:0/4257316681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb80003edf0 0x7fb8000cdb00 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:47.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.909+0000 7fb80eec2700 1 -- 172.21.15.60:0/4257316681 >> 172.21.15.60:0/4257316681 conn(0x7fb80000aed0 msgr2=0x7fb800042b20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:47.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.909+0000 7fb80eec2700 1 -- 172.21.15.60:0/4257316681 shutdown_connections 2020-10-31T22:48:47.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:47.909+0000 7fb80eec2700 1 -- 172.21.15.60:0/4257316681 wait complete. 2020-10-31T22:48:47.938 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 47 2020-10-31T22:48:48.253 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:48:39.857912+0000', 'modified': '2020-10-31T22:48:40.861506+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6831}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6831': {'gid': 6831, 'name': 'b', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6833/588884767', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 588884767}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 588884767}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:48:48.253 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:48:48.254 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-10-31T22:48:48.402 INFO:teuthology.orchestra.run.smithi066.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":6831,"want_state":"up:active","state":"up:active","rank_uptime":8.5280983300000006,"mdsmap_epoch":47,"osdmap_epoch":99,"osdmap_epoch_barrier":98,"uptime":13.892920801000001} 2020-10-31T22:48:48.403 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 6831, "mdsmap_epoch": 47, "osdmap_epoch": 99, "osdmap_epoch_barrier": 98, "rank_uptime": 8.52809833, "state": "up:active", "uptime": 13.892920801, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:48:48.405 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:48:48.406 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-10-31T22:48:48.407 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi085.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-10-31T22:48:48.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:48.409 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:48.429 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:48:48.498 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:48:48.500 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:48:48.567 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:48:48.568 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:48:48.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:48.570 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:48:48.633 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:48:48.640 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:48.681 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:48:48.711 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:48:48.712 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:48:48.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:2020-10-31T22:48:48.756+0000 7fe87fdff0c0 -1 init, newargv = 0x55f043f1e000 newargc=9ceph-fuse[13299 2020-10-31T22:48:48.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:]: starting ceph client 2020-10-31T22:48:48.773 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13299]: starting fuse 2020-10-31T22:48:48.785 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:48:48.785 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:48:48.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:48.786 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:48:48.842 INFO:teuthology.orchestra.run.smithi085.stdout:50 2020-10-31T22:48:48.842 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-10-31T22:48:48.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:48.843 INFO:teuthology.orchestra.run.smithi085:> sudo python3 -c ' 2020-10-31T22:48:48.844 INFO:teuthology.orchestra.run.smithi085:> import glob 2020-10-31T22:48:48.844 INFO:teuthology.orchestra.run.smithi085:> import re 2020-10-31T22:48:48.844 INFO:teuthology.orchestra.run.smithi085:> import os 2020-10-31T22:48:48.845 INFO:teuthology.orchestra.run.smithi085:> import subprocess 2020-10-31T22:48:48.846 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:48:48.846 INFO:teuthology.orchestra.run.smithi085:> def find_socket(client_name): 2020-10-31T22:48:48.846 INFO:teuthology.orchestra.run.smithi085:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-10-31T22:48:48.847 INFO:teuthology.orchestra.run.smithi085:> files = glob.glob(asok_path) 2020-10-31T22:48:48.847 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:48:48.847 INFO:teuthology.orchestra.run.smithi085:> # Given a non-glob path, it better be there 2020-10-31T22:48:48.848 INFO:teuthology.orchestra.run.smithi085:> if "*" not in asok_path: 2020-10-31T22:48:48.848 INFO:teuthology.orchestra.run.smithi085:> assert(len(files) == 1) 2020-10-31T22:48:48.848 INFO:teuthology.orchestra.run.smithi085:> return files[0] 2020-10-31T22:48:48.848 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:48:48.849 INFO:teuthology.orchestra.run.smithi085:> for f in files: 2020-10-31T22:48:48.849 INFO:teuthology.orchestra.run.smithi085:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:48:48.849 INFO:teuthology.orchestra.run.smithi085:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:48:48.850 INFO:teuthology.orchestra.run.smithi085:> return f 2020-10-31T22:48:48.851 INFO:teuthology.orchestra.run.smithi085:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:48:48.852 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:48:48.852 INFO:teuthology.orchestra.run.smithi085:> print(find_socket("client.1")) 2020-10-31T22:48:48.853 INFO:teuthology.orchestra.run.smithi085:> ' 2020-10-31T22:48:48.936 INFO:teuthology.orchestra.run.smithi085.stdout:/var/run/ceph/ceph-client.1.13299.asok 2020-10-31T22:48:48.947 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13299.asok 2020-10-31T22:48:48.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:48.948 INFO:teuthology.orchestra.run.smithi085:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13299.asok status 2020-10-31T22:48:49.095 INFO:teuthology.orchestra.run.smithi085.stdout:{ 2020-10-31T22:48:49.096 INFO:teuthology.orchestra.run.smithi085.stdout: "metadata": { 2020-10-31T22:48:49.096 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:48:49.096 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:48:49.096 INFO:teuthology.orchestra.run.smithi085.stdout: "entity_id": "1", 2020-10-31T22:48:49.096 INFO:teuthology.orchestra.run.smithi085.stdout: "hostname": "smithi085", 2020-10-31T22:48:49.096 INFO:teuthology.orchestra.run.smithi085.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-10-31T22:48:49.096 INFO:teuthology.orchestra.run.smithi085.stdout: "pid": "13299", 2020-10-31T22:48:49.097 INFO:teuthology.orchestra.run.smithi085.stdout: "root": "/" 2020-10-31T22:48:49.097 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:48:49.098 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_count": 0, 2020-10-31T22:48:49.098 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_pinned_count": 0, 2020-10-31T22:48:49.098 INFO:teuthology.orchestra.run.smithi085.stdout: "id": 6257, 2020-10-31T22:48:49.098 INFO:teuthology.orchestra.run.smithi085.stdout: "inst": { 2020-10-31T22:48:49.099 INFO:teuthology.orchestra.run.smithi085.stdout: "name": { 2020-10-31T22:48:49.099 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "client", 2020-10-31T22:48:49.099 INFO:teuthology.orchestra.run.smithi085.stdout: "num": 6257 2020-10-31T22:48:49.099 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:48:49.099 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:48:49.099 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:48:49.099 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:48:49.100 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 4110128936 2020-10-31T22:48:49.100 INFO:teuthology.orchestra.run.smithi085.stdout: } 2020-10-31T22:48:49.100 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:48:49.100 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:48:49.101 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:48:49.101 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:48:49.101 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 4110128936 2020-10-31T22:48:49.101 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:48:49.102 INFO:teuthology.orchestra.run.smithi085.stdout: "inst_str": "client.6257 172.21.15.85:0/4110128936", 2020-10-31T22:48:49.102 INFO:teuthology.orchestra.run.smithi085.stdout: "addr_str": "172.21.15.85:0/4110128936", 2020-10-31T22:48:49.102 INFO:teuthology.orchestra.run.smithi085.stdout: "inode_count": 1, 2020-10-31T22:48:49.102 INFO:teuthology.orchestra.run.smithi085.stdout: "mds_epoch": 47, 2020-10-31T22:48:49.109 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch": 99, 2020-10-31T22:48:49.110 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:48:49.110 INFO:teuthology.orchestra.run.smithi085.stdout: "blacklisted": false 2020-10-31T22:48:49.110 INFO:teuthology.orchestra.run.smithi085.stdout:} 2020-10-31T22:48:49.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:49.112 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:49.113 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:49.123 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:48:49.123 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:48:49.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:49.126 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:49.198 INFO:teuthology.orchestra.run.smithi152:> cd /home/ubuntu/cephtest/mnt.0 && sudo mkdir -p foo 2020-10-31T22:48:49.245 INFO:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-10-31T22:48:49.245 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:48:49.245 INFO:teuthology.orchestra.run.smithi152:> import stat 2020-10-31T22:48:49.265 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:48:49.267 INFO:teuthology.orchestra.run.smithi152:> print(os.stat("/home/ubuntu/cephtest/mnt.0/foo").st_ino) 2020-10-31T22:48:49.267 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:48:49.367 INFO:teuthology.orchestra.run.smithi152.stdout:1099511627776 2020-10-31T22:48:49.557 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:49.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d359e700 1 Processor -- start 2020-10-31T22:48:49.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d359e700 1 -- start start 2020-10-31T22:48:49.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56d40af520 0x7f56d40ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:49.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d359e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f56d4066c90 0x7f56d40670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:49.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d359e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d40af900 con 0x7f56d4146060 2020-10-31T22:48:49.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d359e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d40afc10 con 0x7f56d4066c90 2020-10-31T22:48:49.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d405bb70 con 0x7f56d40af520 2020-10-31T22:48:49.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d2d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f56d4146060 0x7f56d4149620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51144/0 (socket says 172.21.15.60:51144) 2020-10-31T22:48:49.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d2d9d700 1 -- 172.21.15.60:0/102763639 learned_addr learned my addr 172.21.15.60:0/102763639 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:49.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d1d9b700 1 --2- 172.21.15.60:0/102763639 >> v2:172.21.15.60:3300/0 conn(0x7f56d4066c90 0x7f56d40670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:49.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d259c700 1 --2- 172.21.15.60:0/102763639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56d40af520 0x7f56d40ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:49.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d159a700 1 -- 172.21.15.60:0/102763639 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678882592 0 0) 0x7f56d40af900 con 0x7f56d4146060 2020-10-31T22:48:49.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d159a700 1 -- 172.21.15.60:0/102763639 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56b4003230 con 0x7f56d4146060 2020-10-31T22:48:49.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d1d9b700 1 -- 172.21.15.60:0/102763639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56d40af520 msgr2=0x7f56d40ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:49.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d1d9b700 1 --2- 172.21.15.60:0/102763639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56d40af520 0x7f56d40ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:49.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d1d9b700 1 -- 172.21.15.60:0/102763639 >> v1:172.21.15.60:6789/0 conn(0x7f56d4146060 legacy=0x7f56d4149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:49.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d1d9b700 1 -- 172.21.15.60:0/102763639 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d40ac130 con 0x7f56d4066c90 2020-10-31T22:48:49.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d1d9b700 1 --2- 172.21.15.60:0/102763639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56d4066c90 0x7f56d40670f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f56bc002f30 tx=0x7f56bc006dc0).ready entity=mon.0 client_cookie=c494d901fe161ab6 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:49.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d159a700 1 -- 172.21.15.60:0/102763639 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56bc0096a0 con 0x7f56d4066c90 2020-10-31T22:48:49.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d159a700 1 -- 172.21.15.60:0/102763639 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56bc009800 con 0x7f56d4066c90 2020-10-31T22:48:49.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d359e700 1 -- 172.21.15.60:0/102763639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56d4066c90 msgr2=0x7f56d40670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:49.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d159a700 1 -- 172.21.15.60:0/102763639 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56bc009b60 con 0x7f56d4066c90 2020-10-31T22:48:49.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.673+0000 7f56d359e700 1 --2- 172.21.15.60:0/102763639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56d4066c90 0x7f56d40670f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 rx=0x7f56bc002f30 tx=0x7f56bc006dc0).stop 2020-10-31T22:48:49.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d359e700 1 -- 172.21.15.60:0/102763639 shutdown_connections 2020-10-31T22:48:49.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d359e700 1 --2- 172.21.15.60:0/102763639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56d40af520 0x7f56d40ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:49.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d359e700 1 --2- 172.21.15.60:0/102763639 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56d4066c90 0x7f56d40670f0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d359e700 1 -- 172.21.15.60:0/102763639 >> 172.21.15.60:0/102763639 conn(0x7f56d40b3fd0 msgr2=0x7f56d40b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d359e700 1 -- 172.21.15.60:0/102763639 shutdown_connections 2020-10-31T22:48:49.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d359e700 1 -- 172.21.15.60:0/102763639 wait complete. 2020-10-31T22:48:49.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d359e700 1 Processor -- start 2020-10-31T22:48:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d359e700 1 -- start start 2020-10-31T22:48:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56d4066c90 0x7f56d40aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56d40af520 0x7f56d40aa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56d4146060 0x7f56d4062880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:49.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40a7e90 con 0x7f56d4146060 2020-10-31T22:48:49.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40a85a0 con 0x7f56d4066c90 2020-10-31T22:48:49.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d40a8840 con 0x7f56d40af520 2020-10-31T22:48:49.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d2d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56d4146060 0x7f56d4062880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:49.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d2d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56d4146060 0x7f56d4062880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47016/0 (socket says 172.21.15.60:47016) 2020-10-31T22:48:49.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d2d9d700 1 -- 172.21.15.60:0/1671821340 learned_addr learned my addr 172.21.15.60:0/1671821340 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:49.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d259c700 1 --2- 172.21.15.60:0/1671821340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56d4066c90 0x7f56d40aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:49.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d1d9b700 1 --2- 172.21.15.60:0/1671821340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56d40af520 0x7f56d40aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:49.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d2d9d700 1 -- 172.21.15.60:0/1671821340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56d40af520 msgr2=0x7f56d40aa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:49.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d2d9d700 1 --2- 172.21.15.60:0/1671821340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56d40af520 0x7f56d40aa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:49.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d2d9d700 1 -- 172.21.15.60:0/1671821340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56d4066c90 msgr2=0x7f56d40aa9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:49.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d2d9d700 1 --2- 172.21.15.60:0/1671821340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56d4066c90 0x7f56d40aa9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:49.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d2d9d700 1 -- 172.21.15.60:0/1671821340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d40a8ae0 con 0x7f56d4146060 2020-10-31T22:48:49.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.677+0000 7f56d2d9d700 1 --2- 172.21.15.60:0/1671821340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56d4146060 0x7f56d4062880 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f56cc001450 tx=0x7f56cc007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:49.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.681+0000 7f56cb7fe700 1 -- 172.21.15.60:0/1671821340 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56cc005b70 con 0x7f56d4146060 2020-10-31T22:48:49.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.681+0000 7f56cb7fe700 1 -- 172.21.15.60:0/1671821340 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc005cd0 con 0x7f56d4146060 2020-10-31T22:48:49.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.681+0000 7f56d359e700 1 -- 172.21.15.60:0/1671821340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d40a8d80 con 0x7f56d4146060 2020-10-31T22:48:49.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.681+0000 7f56cb7fe700 1 -- 172.21.15.60:0/1671821340 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56cc007300 con 0x7f56d4146060 2020-10-31T22:48:49.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.681+0000 7f56d359e700 1 -- 172.21.15.60:0/1671821340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d4158430 con 0x7f56d4146060 2020-10-31T22:48:49.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.681+0000 7f56d359e700 1 -- 172.21.15.60:0/1671821340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d40a9b20 con 0x7f56d4146060 2020-10-31T22:48:49.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.681+0000 7f56cb7fe700 1 -- 172.21.15.60:0/1671821340 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f56cc010030 con 0x7f56d4146060 2020-10-31T22:48:49.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.681+0000 7f56cb7fe700 1 --2- 172.21.15.60:0/1671821340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f56b8054f10 0x7f56b80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:49.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.681+0000 7f56d259c700 1 --2- 172.21.15.60:0/1671821340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f56b8054f10 0x7f56b80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:49.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.681+0000 7f56cb7fe700 1 -- 172.21.15.60:0/1671821340 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f56cc06dac0 con 0x7f56d4146060 2020-10-31T22:48:49.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.681+0000 7f56d259c700 1 --2- 172.21.15.60:0/1671821340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f56b8054f10 0x7f56b80573d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f56c400b000 tx=0x7f56c4006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:49.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.685+0000 7f56cb7fe700 1 -- 172.21.15.60:0/1671821340 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f56d40a9b20 con 0x7f56d4146060 2020-10-31T22:48:49.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.873+0000 7f56d359e700 1 -- 172.21.15.60:0/1671821340 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56d40a9b20 con 0x7f56d4146060 2020-10-31T22:48:49.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.873+0000 7f56cb7fe700 1 -- 172.21.15.60:0/1671821340 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2484 (secure 0 0 0) 0x7f56d40a9b20 con 0x7f56d4146060 2020-10-31T22:48:49.881 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:49.881 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":47,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6822,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6835/458791799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458791799},{"type":"v1","addr":"172.21.15.60:6835","nonce":458791799}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45},{"gid":6825,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/332317680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":332317680},{"type":"v1","addr":"172.21.15.60:6837","nonce":332317680}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:48:39.857912+0000","modified":"2020-10-31T22:48:40.861506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6831},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6831":{"gid":6831,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/588884767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":588884767},{"type":"v1","addr":"172.21.15.66:6833","nonce":588884767}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-10-31T22:48:49.882 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.877+0000 7f56d359e700 1 -- 172.21.15.60:0/1671821340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f56b8054f10 msgr2=0x7f56b80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:49.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.877+0000 7f56d359e700 1 --2- 172.21.15.60:0/1671821340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f56b8054f10 0x7f56b80573d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f56c400b000 tx=0x7f56c4006dc0).stop 2020-10-31T22:48:49.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.877+0000 7f56d359e700 1 -- 172.21.15.60:0/1671821340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56d4146060 msgr2=0x7f56d4062880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:49.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.877+0000 7f56d359e700 1 --2- 172.21.15.60:0/1671821340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56d4146060 0x7f56d4062880 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 rx=0x7f56cc001450 tx=0x7f56cc007d30).stop 2020-10-31T22:48:49.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.877+0000 7f56d359e700 1 -- 172.21.15.60:0/1671821340 shutdown_connections 2020-10-31T22:48:49.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.877+0000 7f56d359e700 1 --2- 172.21.15.60:0/1671821340 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56d4146060 0x7f56d4062880 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:49.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.877+0000 7f56d359e700 1 --2- 172.21.15.60:0/1671821340 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f56b8054f10 0x7f56b80573d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:49.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.877+0000 7f56d359e700 1 --2- 172.21.15.60:0/1671821340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56d4066c90 0x7f56d40aa9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:49.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.877+0000 7f56d359e700 1 --2- 172.21.15.60:0/1671821340 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56d40af520 0x7f56d40aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:49.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.877+0000 7f56d359e700 1 -- 172.21.15.60:0/1671821340 >> 172.21.15.60:0/1671821340 conn(0x7f56d40b3fd0 msgr2=0x7f56d40b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:49.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.877+0000 7f56d359e700 1 -- 172.21.15.60:0/1671821340 shutdown_connections 2020-10-31T22:48:49.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:49.877+0000 7f56d359e700 1 -- 172.21.15.60:0/1671821340 wait complete. 2020-10-31T22:48:49.885 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 47 2020-10-31T22:48:49.895 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json dump inode 0x10000000000 2020-10-31T22:48:50.021 INFO:teuthology.orchestra.run.smithi066.stdout:{"path":"/foo","ino":1099511627776,"rdev":0,"ctime":"2020-10-31T22:48:49.232601+0000","btime":"2020-10-31T22:48:49.232601+0000","mode":16877,"uid":0,"gid":0,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2020-10-31T22:48:49.232601+0000","atime":"2020-10-31T22:48:49.232601+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":0,"rsubdirs":1,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1},"nref":4,"versionlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":6996,"pending":"pAsxLsXsxFsx","issued":"pAsxLsXsxFsx","wanted":"-","last_sent":1}],"loner":6996,"want_loner":6996,"mds_caps_wanted":[]} 2020-10-31T22:48:50.023 DEBUG:tasks.cephfs.filesystem:_json_asok output { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2020-10-31T22:48:49.232601+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "backtrace_version": 2, "btime": "2020-10-31T22:48:49.232601+0000", "change_attr": 0, "client_caps": [ { "client_id": 6996, "issued": "pAsxLsXsxFsx", "last_sent": 1, "pending": "pAsxLsXsxFsx", "wanted": "-" } ], "client_ranges": [], "ctime": "2020-10-31T22:48:49.232601+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "flocklock": {}, "gid": 0, "ino": 1099511627776, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 6996, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2020-10-31T22:48:49.232601+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "path": "/foo", "pins": { "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 0, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 0, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "xlock_by": {} }, "want_loner": 6996, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "xlock_by": {} }, "xattrs": [] } 2020-10-31T22:48:50.024 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:48:50.024 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:50.043 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:50.060 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:50.077 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:50.094 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:48:50.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:50.095 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:50.096 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:50.146 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:48:50.148 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:48:50.148 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:48:50.152 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:48:50.152 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:50.220 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13799]: fuse finished with error 0 and tester_r 0 2020-10-31T22:48:50.222 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:50.223 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:50.223 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:50.269 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:48:50.270 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:48:50.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:48:50.346 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:50.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:50.355 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:50.355 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:50.365 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:48:50.366 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:48:50.366 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi085.front.sepia.ceph.com... 2020-10-31T22:48:50.367 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:48:50.367 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:50.450 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13299]: fuse finished with error 0 and tester_r 0 2020-10-31T22:48:50.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:50.452 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:50.452 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:50.499 INFO:teuthology.orchestra.run.smithi085.stdout:ext2/ext3 2020-10-31T22:48:50.500 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:48:50.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:48:50.550 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:50.556 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2020-10-31T22:48:50.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f0692123700 1 Processor -- start 2020-10-31T22:48:50.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f0692123700 1 -- start start 2020-10-31T22:48:50.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f0692123700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f068c05afe0 0x7f068c0aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:50.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f0692123700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c0aefc0 0x7f068c14c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:50.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f0692123700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068c0631f0 con 0x7f068c062e10 2020-10-31T22:48:50.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f0692123700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f068c0b1840 con 0x7f068c05afe0 2020-10-31T22:48:50.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f0692123700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068c1454d0 con 0x7f068c0aefc0 2020-10-31T22:48:50.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f068b7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f068c062e10 0x7f068c0afbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51158/0 (socket says 172.21.15.60:51158) 2020-10-31T22:48:50.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f068b7fe700 1 -- 172.21.15.60:0/3626437086 learned_addr learned my addr 172.21.15.60:0/3626437086 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:50.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f068affd700 1 --2- 172.21.15.60:0/3626437086 >> v2:172.21.15.60:3300/0 conn(0x7f068c05afe0 0x7f068c0aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:50.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f068bfff700 1 --2- 172.21.15.60:0/3626437086 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c0aefc0 0x7f068c14c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:50.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f068a7fc700 1 -- 172.21.15.60:0/3626437086 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739979623 0 0) 0x7f068c0631f0 con 0x7f068c062e10 2020-10-31T22:48:50.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f068a7fc700 1 -- 172.21.15.60:0/3626437086 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0678003230 con 0x7f068c062e10 2020-10-31T22:48:50.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f068affd700 1 -- 172.21.15.60:0/3626437086 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c0aefc0 msgr2=0x7f068c14c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:50.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f068affd700 1 --2- 172.21.15.60:0/3626437086 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c0aefc0 0x7f068c14c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:50.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f068affd700 1 -- 172.21.15.60:0/3626437086 >> v1:172.21.15.60:6789/0 conn(0x7f068c062e10 legacy=0x7f068c0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:50.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f068affd700 1 -- 172.21.15.60:0/3626437086 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c145770 con 0x7f068c05afe0 2020-10-31T22:48:50.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.677+0000 7f068bfff700 1 --2- 172.21.15.60:0/3626437086 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c0aefc0 0x7f068c14c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:50.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.681+0000 7f068affd700 1 --2- 172.21.15.60:0/3626437086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c05afe0 0x7f068c0aead0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f0680002f30 tx=0x7f0680006dc0).ready entity=mon.0 client_cookie=20704260526af452 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:50.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.681+0000 7f068a7fc700 1 -- 172.21.15.60:0/3626437086 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0680009760 con 0x7f068c05afe0 2020-10-31T22:48:50.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.681+0000 7f068a7fc700 1 -- 172.21.15.60:0/3626437086 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06800098c0 con 0x7f068c05afe0 2020-10-31T22:48:50.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.681+0000 7f068a7fc700 1 -- 172.21.15.60:0/3626437086 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0680009c20 con 0x7f068c05afe0 2020-10-31T22:48:50.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.681+0000 7f0692123700 1 -- 172.21.15.60:0/3626437086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c05afe0 msgr2=0x7f068c0aead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:50.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.681+0000 7f0692123700 1 --2- 172.21.15.60:0/3626437086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c05afe0 0x7f068c0aead0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 rx=0x7f0680002f30 tx=0x7f0680006dc0).stop 2020-10-31T22:48:50.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.681+0000 7f0692123700 1 -- 172.21.15.60:0/3626437086 shutdown_connections 2020-10-31T22:48:50.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.681+0000 7f0692123700 1 --2- 172.21.15.60:0/3626437086 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c0aefc0 0x7f068c14c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:50.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.681+0000 7f0692123700 1 --2- 172.21.15.60:0/3626437086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c05afe0 0x7f068c0aead0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:50.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.681+0000 7f0692123700 1 -- 172.21.15.60:0/3626437086 >> 172.21.15.60:0/3626437086 conn(0x7f068c05fae0 msgr2=0x7f068c05fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:50.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.681+0000 7f0692123700 1 -- 172.21.15.60:0/3626437086 shutdown_connections 2020-10-31T22:48:50.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.681+0000 7f0692123700 1 -- 172.21.15.60:0/3626437086 wait complete. 2020-10-31T22:48:50.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.681+0000 7f0692123700 1 Processor -- start 2020-10-31T22:48:50.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.681+0000 7f0692123700 1 -- start start 2020-10-31T22:48:50.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f0692123700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c05afe0 0x7f068c0b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:50.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f0692123700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c062e10 0x7f068c1424b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:50.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f0692123700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c0aefc0 0x7f068c1429a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:50.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f0692123700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c064ed0 con 0x7f068c05afe0 2020-10-31T22:48:50.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f0692123700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c0b4a50 con 0x7f068c062e10 2020-10-31T22:48:50.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f0692123700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068c067090 con 0x7f068c0aefc0 2020-10-31T22:48:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f068b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c05afe0 0x7f068c0b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f068b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c05afe0 0x7f068c0b5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47028/0 (socket says 172.21.15.60:47028) 2020-10-31T22:48:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f068b7fe700 1 -- 172.21.15.60:0/3789505764 learned_addr learned my addr 172.21.15.60:0/3789505764 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f068bfff700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c0aefc0 0x7f068c1429a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f068affd700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c062e10 0x7f068c1424b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f068b7fe700 1 -- 172.21.15.60:0/3789505764 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c0aefc0 msgr2=0x7f068c1429a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:50.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f068b7fe700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c0aefc0 0x7f068c1429a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f068b7fe700 1 -- 172.21.15.60:0/3789505764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c062e10 msgr2=0x7f068c1424b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f068b7fe700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c062e10 0x7f068c1424b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:50.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f068b7fe700 1 -- 172.21.15.60:0/3789505764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c067330 con 0x7f068c05afe0 2020-10-31T22:48:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f068bfff700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c0aefc0 0x7f068c1429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f068b7fe700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c05afe0 0x7f068c0b5720 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f067c001450 tx=0x7f067c007d90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f0688ff9700 1 -- 172.21.15.60:0/3789505764 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f067c005c40 con 0x7f068c05afe0 2020-10-31T22:48:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f0688ff9700 1 -- 172.21.15.60:0/3789505764 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067c005da0 con 0x7f068c05afe0 2020-10-31T22:48:50.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f0692123700 1 -- 172.21.15.60:0/3789505764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068c0675d0 con 0x7f068c05afe0 2020-10-31T22:48:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f0688ff9700 1 -- 172.21.15.60:0/3789505764 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f067c007300 con 0x7f068c05afe0 2020-10-31T22:48:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f0692123700 1 -- 172.21.15.60:0/3789505764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068c0b5010 con 0x7f068c05afe0 2020-10-31T22:48:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f0692123700 1 -- 172.21.15.60:0/3789505764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068c057100 con 0x7f068c05afe0 2020-10-31T22:48:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.685+0000 7f0688ff9700 1 -- 172.21.15.60:0/3789505764 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f067c010030 con 0x7f068c05afe0 2020-10-31T22:48:50.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.689+0000 7f0688ff9700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f066c055020 0x7f066c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:50.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.689+0000 7f0688ff9700 1 -- 172.21.15.60:0/3789505764 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f067c06db50 con 0x7f068c05afe0 2020-10-31T22:48:50.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.689+0000 7f068affd700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f066c055020 0x7f066c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:50.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.689+0000 7f068affd700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f066c055020 0x7f066c0574e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f0680018000 tx=0x7f0680015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:50.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.693+0000 7f0688ff9700 1 -- 172.21.15.60:0/3789505764 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f067c044070 con 0x7f068c05afe0 2020-10-31T22:48:50.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.837+0000 7f0692123700 1 -- 172.21.15.60:0/3789505764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f068c067760 con 0x7f068c05afe0 2020-10-31T22:48:50.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.845+0000 7f0688ff9700 1 -- 172.21.15.60:0/3789505764 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f067c047690 con 0x7f068c05afe0 2020-10-31T22:48:50.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.849+0000 7f0692123700 1 -- 172.21.15.60:0/3789505764 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f066c055020 msgr2=0x7f066c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:50.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.849+0000 7f0692123700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f066c055020 0x7f066c0574e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7f0680018000 tx=0x7f0680015000).stop 2020-10-31T22:48:50.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.849+0000 7f0692123700 1 -- 172.21.15.60:0/3789505764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c05afe0 msgr2=0x7f068c0b5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:50.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.849+0000 7f0692123700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c05afe0 0x7f068c0b5720 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 rx=0x7f067c001450 tx=0x7f067c007d90).stop 2020-10-31T22:48:50.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.849+0000 7f0692123700 1 -- 172.21.15.60:0/3789505764 shutdown_connections 2020-10-31T22:48:50.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.849+0000 7f0692123700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f068c0aefc0 0x7f068c1429a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:50.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.849+0000 7f0692123700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f068c05afe0 0x7f068c0b5720 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:50.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.849+0000 7f0692123700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f066c055020 0x7f066c0574e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:50.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.849+0000 7f0692123700 1 --2- 172.21.15.60:0/3789505764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f068c062e10 0x7f068c1424b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:50.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.849+0000 7f0692123700 1 -- 172.21.15.60:0/3789505764 >> 172.21.15.60:0/3789505764 conn(0x7f068c05fae0 msgr2=0x7f068c143300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:50.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.849+0000 7f0692123700 1 -- 172.21.15.60:0/3789505764 shutdown_connections 2020-10-31T22:48:50.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.849+0000 7f0692123700 1 -- 172.21.15.60:0/3789505764 wait complete. 2020-10-31T22:48:50.869 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical' 2020-10-31T22:48:50.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.977+0000 7f5b109d1700 1 Processor -- start 2020-10-31T22:48:50.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.977+0000 7f5b109d1700 1 -- start start 2020-10-31T22:48:50.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.977+0000 7f5b109d1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5b0c0b1a10 0x7f5b0c142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:50.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.977+0000 7f5b109d1700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c0abea0 con 0x7f5b0c13ebe0 2020-10-31T22:48:50.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.977+0000 7f5b109d1700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c141870 con 0x7f5b0c0af200 2020-10-31T22:48:50.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.977+0000 7f5b109d1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0c141b10 con 0x7f5b0c0b1a10 2020-10-31T22:48:50.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.977+0000 7f5b0a59c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5b0c13ebe0 0x7f5b0c0afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51174/0 (socket says 172.21.15.60:51174) 2020-10-31T22:48:50.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.977+0000 7f5b0ad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5b0c0b1a10 0x7f5b0c142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:50.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.977+0000 7f5b0a59c700 1 -- 172.21.15.60:0/1063331930 learned_addr learned my addr 172.21.15.60:0/1063331930 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:50.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.977+0000 7f5b0ad9d700 1 -- 172.21.15.60:0/1063331930 >> v1:172.21.15.66:6789/0 conn(0x7f5b0c0af200 legacy=0x7f5b0c0b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:50.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.977+0000 7f5b0ad9d700 1 -- 172.21.15.60:0/1063331930 >> v1:172.21.15.60:6789/0 conn(0x7f5b0c13ebe0 legacy=0x7f5b0c0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:50.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.977+0000 7f5b09d9b700 1 -- 172.21.15.60:0/1063331930 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046326673 0 0) 0x7f5b0c0abea0 con 0x7f5b0c13ebe0 2020-10-31T22:48:50.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.977+0000 7f5b0ad9d700 1 -- 172.21.15.60:0/1063331930 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c141db0 con 0x7f5b0c0b1a10 2020-10-31T22:48:50.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.977+0000 7f5b0ad9d700 1 --2- 172.21.15.60:0/1063331930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b0c0b1a10 0x7f5b0c142250 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f5afc002f30 tx=0x7f5afc00d250).ready entity=mon.0 client_cookie=f652f4ad27335175 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:50.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.981+0000 7f5b09d9b700 1 -- 172.21.15.60:0/1063331930 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5afc00fc00 con 0x7f5b0c0b1a10 2020-10-31T22:48:50.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.981+0000 7f5b09d9b700 1 -- 172.21.15.60:0/1063331930 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc00fd60 con 0x7f5b0c0b1a10 2020-10-31T22:48:50.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.981+0000 7f5b09d9b700 1 -- 172.21.15.60:0/1063331930 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5afc015400 con 0x7f5b0c0b1a10 2020-10-31T22:48:50.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.981+0000 7f5b109d1700 1 -- 172.21.15.60:0/1063331930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b0c0b1a10 msgr2=0x7f5b0c142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:50.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.981+0000 7f5b109d1700 1 --2- 172.21.15.60:0/1063331930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b0c0b1a10 0x7f5b0c142250 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 rx=0x7f5afc002f30 tx=0x7f5afc00d250).stop 2020-10-31T22:48:50.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.981+0000 7f5b109d1700 1 -- 172.21.15.60:0/1063331930 shutdown_connections 2020-10-31T22:48:50.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.981+0000 7f5b109d1700 1 --2- 172.21.15.60:0/1063331930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b0c0b1a10 0x7f5b0c142250 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:50.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.981+0000 7f5b109d1700 1 -- 172.21.15.60:0/1063331930 >> 172.21.15.60:0/1063331930 conn(0x7f5b0c0b5300 msgr2=0x7f5b0c0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:50.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.981+0000 7f5b109d1700 1 -- 172.21.15.60:0/1063331930 shutdown_connections 2020-10-31T22:48:50.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.981+0000 7f5b109d1700 1 -- 172.21.15.60:0/1063331930 wait complete. 2020-10-31T22:48:50.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.981+0000 7f5b109d1700 1 Processor -- start 2020-10-31T22:48:50.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.981+0000 7f5b109d1700 1 -- start start 2020-10-31T22:48:50.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b109d1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b0c0af200 0x7f5b0c1411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:50.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b109d1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b0c0b1a10 0x7f5b0c13a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:50.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b109d1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b0c13ebe0 0x7f5b0c13aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:50.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b109d1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c065080 con 0x7f5b0c0b1a10 2020-10-31T22:48:50.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b109d1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0652b0 con 0x7f5b0c13ebe0 2020-10-31T22:48:50.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b109d1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c065550 con 0x7f5b0c0af200 2020-10-31T22:48:50.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b0a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b0c0b1a10 0x7f5b0c13a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:50.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b0a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b0c0b1a10 0x7f5b0c13a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47044/0 (socket says 172.21.15.60:47044) 2020-10-31T22:48:50.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b0ad9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b0c0af200 0x7f5b0c1411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:51.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b0a59c700 1 -- 172.21.15.60:0/121774945 learned_addr learned my addr 172.21.15.60:0/121774945 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:51.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b0b59e700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b0c13ebe0 0x7f5b0c13aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:51.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b0a59c700 1 -- 172.21.15.60:0/121774945 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b0c0af200 msgr2=0x7f5b0c1411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:51.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b0a59c700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b0c0af200 0x7f5b0c1411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:51.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b0a59c700 1 -- 172.21.15.60:0/121774945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b0c13ebe0 msgr2=0x7f5b0c13aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:51.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b0a59c700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b0c13ebe0 0x7f5b0c13aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:51.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b0a59c700 1 -- 172.21.15.60:0/121774945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0657f0 con 0x7f5b0c0b1a10 2020-10-31T22:48:51.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b0ad9d700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b0c0af200 0x7f5b0c1411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:51.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b0b59e700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b0c13ebe0 0x7f5b0c13aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:51.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b0a59c700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b0c0b1a10 0x7f5b0c13a9f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f5b00000b80 tx=0x7f5b00007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:51.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5afbfff700 1 -- 172.21.15.60:0/121774945 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b000072e0 con 0x7f5b0c0b1a10 2020-10-31T22:48:51.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5afbfff700 1 -- 172.21.15.60:0/121774945 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b00007440 con 0x7f5b0c0b1a10 2020-10-31T22:48:51.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b109d1700 1 -- 172.21.15.60:0/121774945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c065a90 con 0x7f5b0c0b1a10 2020-10-31T22:48:51.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5afbfff700 1 -- 172.21.15.60:0/121774945 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b000057d0 con 0x7f5b0c0b1a10 2020-10-31T22:48:51.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b109d1700 1 -- 172.21.15.60:0/121774945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c13b3d0 con 0x7f5b0c0b1a10 2020-10-31T22:48:51.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.985+0000 7f5b109d1700 1 -- 172.21.15.60:0/121774945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c057100 con 0x7f5b0c0b1a10 2020-10-31T22:48:51.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.989+0000 7f5afbfff700 1 -- 172.21.15.60:0/121774945 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5b0001a060 con 0x7f5b0c0b1a10 2020-10-31T22:48:51.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.989+0000 7f5afbfff700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5ae8054f10 0x7f5ae80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:51.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.989+0000 7f5b0ad9d700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5ae8054f10 0x7f5ae80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:51.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.989+0000 7f5afbfff700 1 -- 172.21.15.60:0/121774945 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5b0006d2e0 con 0x7f5b0c0b1a10 2020-10-31T22:48:51.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.989+0000 7f5b0ad9d700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5ae8054f10 0x7f5ae80573d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f5afc01e000 tx=0x7f5afc01a000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:51.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:50.997+0000 7f5afbfff700 1 -- 172.21.15.60:0/121774945 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5b000436f0 con 0x7f5b0c0b1a10 2020-10-31T22:48:51.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:51.185+0000 7f5b109d1700 1 -- 172.21.15.60:0/121774945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]} v 0) v1 -- 0x7f5b0c066ea0 con 0x7f5b0c0b1a10 2020-10-31T22:48:51.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:51.945+0000 7f5afbfff700 1 -- 172.21.15.60:0/121774945 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_dump_inode_hexademical"]}]=0 v337) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5b00018020 con 0x7f5b0c0b1a10 2020-10-31T22:48:51.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:51.949+0000 7f5b109d1700 1 -- 172.21.15.60:0/121774945 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5ae8054f10 msgr2=0x7f5ae80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:51.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:51.949+0000 7f5b109d1700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5ae8054f10 0x7f5ae80573d0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7f5afc01e000 tx=0x7f5afc01a000).stop 2020-10-31T22:48:51.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:51.949+0000 7f5b109d1700 1 -- 172.21.15.60:0/121774945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b0c0b1a10 msgr2=0x7f5b0c13a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:51.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:51.949+0000 7f5b109d1700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b0c0b1a10 0x7f5b0c13a9f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 rx=0x7f5b00000b80 tx=0x7f5b00007a30).stop 2020-10-31T22:48:51.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:51.949+0000 7f5b109d1700 1 -- 172.21.15.60:0/121774945 shutdown_connections 2020-10-31T22:48:51.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:51.949+0000 7f5b109d1700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5ae8054f10 0x7f5ae80573d0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:51.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:51.949+0000 7f5b109d1700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b0c13ebe0 0x7f5b0c13aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:51.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:51.949+0000 7f5b109d1700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b0c0af200 0x7f5b0c1411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:51.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:51.949+0000 7f5b109d1700 1 --2- 172.21.15.60:0/121774945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b0c0b1a10 0x7f5b0c13a9f0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:51.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:51.949+0000 7f5b109d1700 1 -- 172.21.15.60:0/121774945 >> 172.21.15.60:0/121774945 conn(0x7f5b0c0b5300 msgr2=0x7f5b0c0b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:51.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:51.949+0000 7f5b109d1700 1 -- 172.21.15.60:0/121774945 shutdown_connections 2020-10-31T22:48:51.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:51.949+0000 7f5b109d1700 1 -- 172.21.15.60:0/121774945 wait complete. 2020-10-31T22:48:51.973 INFO:tasks.cephfs_test_runner:test_dump_inode_hexademical (tasks.cephfs.test_misc.TestMisc) ... ok 2020-10-31T22:48:51.974 INFO:tasks.cephfs_test_runner:Starting test: test_filtered_df (tasks.cephfs.test_misc.TestMisc) 2020-10-31T22:48:51.974 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2020-10-31T22:48:52.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc14e7af700 1 Processor -- start 2020-10-31T22:48:52.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc14e7af700 1 -- start start 2020-10-31T22:48:52.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc14e7af700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc1480b2790 0x7fc148142a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:52.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc14e7af700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc1480afef0 0x7fc14813ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:52.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc14e7af700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1480acfa0 con 0x7fc14813f360 2020-10-31T22:48:52.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc14e7af700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1480b2b70 con 0x7fc1480b2790 2020-10-31T22:48:52.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc14e7af700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1480ac800 con 0x7fc1480afef0 2020-10-31T22:48:52.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc14cd4c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fc14813f360 0x7fc14813b820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51188/0 (socket says 172.21.15.60:51188) 2020-10-31T22:48:52.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc14cd4c700 1 -- 172.21.15.60:0/3121921705 learned_addr learned my addr 172.21.15.60:0/3121921705 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:52.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc147fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc1480b2790 0x7fc148142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:52.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc1477fe700 1 --2- 172.21.15.60:0/3121921705 >> v2:172.21.15.66:3300/0 conn(0x7fc1480afef0 0x7fc14813ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:52.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc146ffd700 1 -- 172.21.15.60:0/3121921705 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548947138 0 0) 0x7fc1480acfa0 con 0x7fc14813f360 2020-10-31T22:48:52.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc146ffd700 1 -- 172.21.15.60:0/3121921705 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc134003230 con 0x7fc14813f360 2020-10-31T22:48:52.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc147fff700 1 -- 172.21.15.60:0/3121921705 >> v2:172.21.15.66:3300/0 conn(0x7fc1480afef0 msgr2=0x7fc14813ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc147fff700 1 --2- 172.21.15.60:0/3121921705 >> v2:172.21.15.66:3300/0 conn(0x7fc1480afef0 0x7fc14813ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc147fff700 1 -- 172.21.15.60:0/3121921705 >> v1:172.21.15.60:6789/0 conn(0x7fc14813f360 legacy=0x7fc14813b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc147fff700 1 -- 172.21.15.60:0/3121921705 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc148142f60 con 0x7fc1480b2790 2020-10-31T22:48:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.085+0000 7fc147fff700 1 --2- 172.21.15.60:0/3121921705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1480b2790 0x7fc148142a70 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fc13c002f30 tx=0x7fc13c006dc0).ready entity=mon.0 client_cookie=45d42e97c331a20 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc146ffd700 1 -- 172.21.15.60:0/3121921705 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc13c0096f0 con 0x7fc1480b2790 2020-10-31T22:48:52.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc146ffd700 1 -- 172.21.15.60:0/3121921705 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c009850 con 0x7fc1480b2790 2020-10-31T22:48:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc146ffd700 1 -- 172.21.15.60:0/3121921705 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc13c009bb0 con 0x7fc1480b2790 2020-10-31T22:48:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 -- 172.21.15.60:0/3121921705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1480b2790 msgr2=0x7fc148142a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 --2- 172.21.15.60:0/3121921705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1480b2790 0x7fc148142a70 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 rx=0x7fc13c002f30 tx=0x7fc13c006dc0).stop 2020-10-31T22:48:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 -- 172.21.15.60:0/3121921705 shutdown_connections 2020-10-31T22:48:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 --2- 172.21.15.60:0/3121921705 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1480b2790 0x7fc148142a70 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:52.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 --2- 172.21.15.60:0/3121921705 >> v2:172.21.15.66:3300/0 conn(0x7fc1480afef0 0x7fc14813ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 -- 172.21.15.60:0/3121921705 >> 172.21.15.60:0/3121921705 conn(0x7fc1480b5d30 msgr2=0x7fc1480b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 -- 172.21.15.60:0/3121921705 shutdown_connections 2020-10-31T22:48:52.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 -- 172.21.15.60:0/3121921705 wait complete. 2020-10-31T22:48:52.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 Processor -- start 2020-10-31T22:48:52.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 -- start start 2020-10-31T22:48:52.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1480afef0 0x7fc1480b3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:52.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1480b2790 0x7fc148138520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:52.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc14813f360 0x7fc148138a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:52.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1480ac690 con 0x7fc1480afef0 2020-10-31T22:48:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1480ab360 con 0x7fc1480b2790 2020-10-31T22:48:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.089+0000 7fc14e7af700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc148067060 con 0x7fc14813f360 2020-10-31T22:48:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc147fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1480afef0 0x7fc1480b3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc147fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1480afef0 0x7fc1480b3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47056/0 (socket says 172.21.15.60:47056) 2020-10-31T22:48:52.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc147fff700 1 -- 172.21.15.60:0/516599832 learned_addr learned my addr 172.21.15.60:0/516599832 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc14cd4c700 1 --2- 172.21.15.60:0/516599832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc14813f360 0x7fc148138a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc1477fe700 1 --2- 172.21.15.60:0/516599832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1480b2790 0x7fc148138520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc147fff700 1 -- 172.21.15.60:0/516599832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc14813f360 msgr2=0x7fc148138a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc147fff700 1 --2- 172.21.15.60:0/516599832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc14813f360 0x7fc148138a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc147fff700 1 -- 172.21.15.60:0/516599832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1480b2790 msgr2=0x7fc148138520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc147fff700 1 --2- 172.21.15.60:0/516599832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1480b2790 0x7fc148138520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:52.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc147fff700 1 -- 172.21.15.60:0/516599832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc148067300 con 0x7fc1480afef0 2020-10-31T22:48:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc147fff700 1 --2- 172.21.15.60:0/516599832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1480afef0 0x7fc1480b3d80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fc13c002f30 tx=0x7fc13c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:52.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc1457fa700 1 -- 172.21.15.60:0/516599832 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc13c009e30 con 0x7fc1480afef0 2020-10-31T22:48:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc1457fa700 1 -- 172.21.15.60:0/516599832 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc13c011bf0 con 0x7fc1480afef0 2020-10-31T22:48:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc14e7af700 1 -- 172.21.15.60:0/516599832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1480675a0 con 0x7fc1480afef0 2020-10-31T22:48:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc1457fa700 1 -- 172.21.15.60:0/516599832 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc13c01d450 con 0x7fc1480afef0 2020-10-31T22:48:52.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc14e7af700 1 -- 172.21.15.60:0/516599832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc148066df0 con 0x7fc1480afef0 2020-10-31T22:48:52.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc1457fa700 1 -- 172.21.15.60:0/516599832 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc13c024030 con 0x7fc1480afef0 2020-10-31T22:48:52.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc14e7af700 1 -- 172.21.15.60:0/516599832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc14814e930 con 0x7fc1480afef0 2020-10-31T22:48:52.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.093+0000 7fc1457fa700 1 --2- 172.21.15.60:0/516599832 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc128054f10 0x7fc1280573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:52.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.097+0000 7fc1457fa700 1 -- 172.21.15.60:0/516599832 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc13c06eac0 con 0x7fc1480afef0 2020-10-31T22:48:52.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.097+0000 7fc1477fe700 1 --2- 172.21.15.60:0/516599832 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc128054f10 0x7fc1280573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:52.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.097+0000 7fc1477fe700 1 --2- 172.21.15.60:0/516599832 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc128054f10 0x7fc1280573d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fc13800b000 tx=0x7fc138006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:52.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.101+0000 7fc1457fa700 1 -- 172.21.15.60:0/516599832 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc14814e930 con 0x7fc1480afef0 2020-10-31T22:48:52.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.293+0000 7fc14e7af700 1 -- 172.21.15.60:0/516599832 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7fc14814e930 con 0x7fc1480afef0 2020-10-31T22:48:52.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.945+0000 7fc1457fa700 1 -- 172.21.15.60:0/516599832 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v338) v1 ==== 130+0+0 (secure 0 0 0) 0x7fc14814e930 con 0x7fc1480afef0 2020-10-31T22:48:52.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.949+0000 7fc14e7af700 1 -- 172.21.15.60:0/516599832 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc128054f10 msgr2=0x7fc1280573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:52.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.949+0000 7fc14e7af700 1 --2- 172.21.15.60:0/516599832 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc128054f10 0x7fc1280573d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fc13800b000 tx=0x7fc138006dc0).stop 2020-10-31T22:48:52.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.949+0000 7fc14e7af700 1 -- 172.21.15.60:0/516599832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1480afef0 msgr2=0x7fc1480b3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:52.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.949+0000 7fc14e7af700 1 --2- 172.21.15.60:0/516599832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1480afef0 0x7fc1480b3d80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 rx=0x7fc13c002f30 tx=0x7fc13c015000).stop 2020-10-31T22:48:52.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.949+0000 7fc14e7af700 1 -- 172.21.15.60:0/516599832 shutdown_connections 2020-10-31T22:48:52.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.949+0000 7fc14e7af700 1 --2- 172.21.15.60:0/516599832 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc14813f360 0x7fc148138a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:52.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.949+0000 7fc14e7af700 1 --2- 172.21.15.60:0/516599832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc1480afef0 0x7fc1480b3d80 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:52.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.949+0000 7fc14e7af700 1 --2- 172.21.15.60:0/516599832 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc128054f10 0x7fc1280573d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:52.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.949+0000 7fc14e7af700 1 --2- 172.21.15.60:0/516599832 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1480b2790 0x7fc148138520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:52.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.949+0000 7fc14e7af700 1 -- 172.21.15.60:0/516599832 >> 172.21.15.60:0/516599832 conn(0x7fc1480b5d30 msgr2=0x7fc1480af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:52.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.949+0000 7fc14e7af700 1 -- 172.21.15.60:0/516599832 shutdown_connections 2020-10-31T22:48:52.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:52.949+0000 7fc14e7af700 1 -- 172.21.15.60:0/516599832 wait complete. 2020-10-31T22:48:52.975 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2020-10-31T22:48:53.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b649bf700 1 Processor -- start 2020-10-31T22:48:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b649bf700 1 -- start start 2020-10-31T22:48:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b649bf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b6005b320 0x7f7b600b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b649bf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7b600acc60 0x7f7b600b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b649bf700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6005b700 con 0x7f7b600ad610 2020-10-31T22:48:53.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b649bf700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b60140750 con 0x7f7b600acc60 2020-10-31T22:48:53.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b649bf700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b600b0340 con 0x7f7b6005b320 2020-10-31T22:48:53.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b5f59e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7b600ad610 0x7f7b600ada70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51202/0 (socket says 172.21.15.60:51202) 2020-10-31T22:48:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b5f59e700 1 -- 172.21.15.60:0/3022777400 learned_addr learned my addr 172.21.15.60:0/3022777400 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b5e59c700 1 --2- 172.21.15.60:0/3022777400 >> v2:172.21.15.60:3300/0 conn(0x7f7b600acc60 0x7f7b600b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b5ed9d700 1 --2- 172.21.15.60:0/3022777400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b6005b320 0x7f7b600b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b5dd9b700 1 -- 172.21.15.60:0/3022777400 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595817145 0 0) 0x7f7b6005b700 con 0x7f7b600ad610 2020-10-31T22:48:53.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b5dd9b700 1 -- 172.21.15.60:0/3022777400 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b40003230 con 0x7f7b600ad610 2020-10-31T22:48:53.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b5dd9b700 1 -- 172.21.15.60:0/3022777400 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1646416893 0 0) 0x7f7b40003230 con 0x7f7b600ad610 2020-10-31T22:48:53.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b5e59c700 1 -- 172.21.15.60:0/3022777400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b6005b320 msgr2=0x7f7b600b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:53.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b5e59c700 1 --2- 172.21.15.60:0/3022777400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b6005b320 0x7f7b600b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b5e59c700 1 -- 172.21.15.60:0/3022777400 >> v1:172.21.15.60:6789/0 conn(0x7f7b600ad610 legacy=0x7f7b600ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:53.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.097+0000 7f7b5e59c700 1 -- 172.21.15.60:0/3022777400 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b600b05e0 con 0x7f7b600acc60 2020-10-31T22:48:53.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b5e59c700 1 --2- 172.21.15.60:0/3022777400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b600acc60 0x7f7b600b22a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f7b58001bf0 tx=0x7f7b48006dc0).ready entity=mon.0 client_cookie=47ad4bf265f65bb8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:53.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b5dd9b700 1 -- 172.21.15.60:0/3022777400 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b58001a50 con 0x7f7b600acc60 2020-10-31T22:48:53.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b5dd9b700 1 -- 172.21.15.60:0/3022777400 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4800d570 con 0x7f7b600acc60 2020-10-31T22:48:53.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b5dd9b700 1 -- 172.21.15.60:0/3022777400 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4800d6e0 con 0x7f7b600acc60 2020-10-31T22:48:53.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 -- 172.21.15.60:0/3022777400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b600acc60 msgr2=0x7f7b600b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:53.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 --2- 172.21.15.60:0/3022777400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b600acc60 0x7f7b600b22a0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 rx=0x7f7b58001bf0 tx=0x7f7b48006dc0).stop 2020-10-31T22:48:53.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 -- 172.21.15.60:0/3022777400 shutdown_connections 2020-10-31T22:48:53.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 --2- 172.21.15.60:0/3022777400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b6005b320 0x7f7b600b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 --2- 172.21.15.60:0/3022777400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b600acc60 0x7f7b600b22a0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 -- 172.21.15.60:0/3022777400 >> 172.21.15.60:0/3022777400 conn(0x7f7b600b61d0 msgr2=0x7f7b600b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:53.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 -- 172.21.15.60:0/3022777400 shutdown_connections 2020-10-31T22:48:53.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 -- 172.21.15.60:0/3022777400 wait complete. 2020-10-31T22:48:53.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 Processor -- start 2020-10-31T22:48:53.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 -- start start 2020-10-31T22:48:53.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b6005b320 0x7f7b6013ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b600acc60 0x7f7b60143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b600ad610 0x7f7b60143e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b601412d0 con 0x7f7b600acc60 2020-10-31T22:48:53.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b60065ec0 con 0x7f7b600ad610 2020-10-31T22:48:53.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.101+0000 7f7b649bf700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b601417e0 con 0x7f7b6005b320 2020-10-31T22:48:53.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b5e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b600acc60 0x7f7b60143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b5e59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b600acc60 0x7f7b60143910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47072/0 (socket says 172.21.15.60:47072) 2020-10-31T22:48:53.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b5e59c700 1 -- 172.21.15.60:0/2016930157 learned_addr learned my addr 172.21.15.60:0/2016930157 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:53.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b5f59e700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b600ad610 0x7f7b60143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b5ed9d700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b6005b320 0x7f7b6013ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b5f59e700 1 -- 172.21.15.60:0/2016930157 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b6005b320 msgr2=0x7f7b6013ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:53.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b5f59e700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b6005b320 0x7f7b6013ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b5f59e700 1 -- 172.21.15.60:0/2016930157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b600acc60 msgr2=0x7f7b60143910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b5f59e700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b600acc60 0x7f7b60143910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b5f59e700 1 -- 172.21.15.60:0/2016930157 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b60141a80 con 0x7f7b600ad610 2020-10-31T22:48:53.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b5e59c700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b600acc60 0x7f7b60143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b5f59e700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b600ad610 0x7f7b60143e00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f7b58001cb0 tx=0x7f7b58002190).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b57fff700 1 -- 172.21.15.60:0/2016930157 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b58004a80 con 0x7f7b600ad610 2020-10-31T22:48:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b57fff700 1 -- 172.21.15.60:0/2016930157 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b58004be0 con 0x7f7b600ad610 2020-10-31T22:48:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b649bf700 1 -- 172.21.15.60:0/2016930157 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b60141d20 con 0x7f7b600ad610 2020-10-31T22:48:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b57fff700 1 -- 172.21.15.60:0/2016930157 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b58007170 con 0x7f7b600ad610 2020-10-31T22:48:53.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b649bf700 1 -- 172.21.15.60:0/2016930157 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b60140f50 con 0x7f7b600ad610 2020-10-31T22:48:53.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b649bf700 1 -- 172.21.15.60:0/2016930157 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b601415f0 con 0x7f7b600ad610 2020-10-31T22:48:53.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b57fff700 1 -- 172.21.15.60:0/2016930157 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7b5801b060 con 0x7f7b600ad610 2020-10-31T22:48:53.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.105+0000 7f7b57fff700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7b44054f10 0x7f7b440573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.109+0000 7f7b57fff700 1 -- 172.21.15.60:0/2016930157 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7b5806ddb0 con 0x7f7b600ad610 2020-10-31T22:48:53.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.109+0000 7f7b5ed9d700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7b44054f10 0x7f7b440573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.109+0000 7f7b5ed9d700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7b44054f10 0x7f7b440573d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f7b5000b000 tx=0x7f7b50006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:53.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.117+0000 7f7b57fff700 1 -- 172.21.15.60:0/2016930157 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7b580442d0 con 0x7f7b600ad610 2020-10-31T22:48:53.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.261+0000 7f7b649bf700 1 -- 172.21.15.60:0/2016930157 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7f7b60057100 con 0x7f7b600ad610 2020-10-31T22:48:53.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.273+0000 7f7b57fff700 1 -- 172.21.15.60:0/2016930157 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7b58019030 con 0x7f7b600ad610 2020-10-31T22:48:53.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.277+0000 7f7b649bf700 1 -- 172.21.15.60:0/2016930157 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7b44054f10 msgr2=0x7f7b440573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:53.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.277+0000 7f7b649bf700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7b44054f10 0x7f7b440573d0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7f7b5000b000 tx=0x7f7b50006dc0).stop 2020-10-31T22:48:53.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.277+0000 7f7b649bf700 1 -- 172.21.15.60:0/2016930157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b600ad610 msgr2=0x7f7b60143e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:53.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.277+0000 7f7b649bf700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b600ad610 0x7f7b60143e00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f7b58001cb0 tx=0x7f7b58002190).stop 2020-10-31T22:48:53.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.277+0000 7f7b649bf700 1 -- 172.21.15.60:0/2016930157 shutdown_connections 2020-10-31T22:48:53.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.277+0000 7f7b649bf700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7b44054f10 0x7f7b440573d0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.277+0000 7f7b649bf700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b600ad610 0x7f7b60143e00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.277+0000 7f7b649bf700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b6005b320 0x7f7b6013ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.277+0000 7f7b649bf700 1 --2- 172.21.15.60:0/2016930157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b600acc60 0x7f7b60143910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.277+0000 7f7b649bf700 1 -- 172.21.15.60:0/2016930157 >> 172.21.15.60:0/2016930157 conn(0x7f7b600b61d0 msgr2=0x7f7b6013c130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:53.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.277+0000 7f7b649bf700 1 -- 172.21.15.60:0/2016930157 shutdown_connections 2020-10-31T22:48:53.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.277+0000 7f7b649bf700 1 -- 172.21.15.60:0/2016930157 wait complete. 2020-10-31T22:48:53.297 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:48:53.297 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:53.315 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:53.334 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:53.351 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:48:53.371 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:48:53.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:53.372 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:53.372 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:48:53.422 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-10-31T22:48:53.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:48:53.424 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2020-10-31T22:48:53.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:48:53.425 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:48:53.425 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:48:53.432 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:48:53.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:48:53.433 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:48:53.434 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-10-31T22:48:53.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.545+0000 7f706a7e3700 1 Processor -- start 2020-10-31T22:48:53.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.545+0000 7f706a7e3700 1 -- start start 2020-10-31T22:48:53.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f706a7e3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70640b52a0 0x7f7064141d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f706a7e3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f70640af390 0x7f706413b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f706a7e3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70640af820 con 0x7f70640aead0 2020-10-31T22:48:53.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f706a7e3700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f706405c4f0 con 0x7f70640af390 2020-10-31T22:48:53.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f706a7e3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f706406a430 con 0x7f70640b52a0 2020-10-31T22:48:53.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f705b7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f70640aead0 0x7f706405bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51214/0 (socket says 172.21.15.60:51214) 2020-10-31T22:48:53.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f705b7fe700 1 -- 172.21.15.60:0/1457442808 learned_addr learned my addr 172.21.15.60:0/1457442808 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:53.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f7068d80700 1 --2- 172.21.15.60:0/1457442808 >> v2:172.21.15.66:3300/0 conn(0x7f70640af390 0x7f706413b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f7063fff700 1 --2- 172.21.15.60:0/1457442808 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70640b52a0 0x7f7064141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 -- 172.21.15.60:0/1457442808 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3888400658 0 0) 0x7f70640af820 con 0x7f70640aead0 2020-10-31T22:48:53.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 -- 172.21.15.60:0/1457442808 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7044003230 con 0x7f70640aead0 2020-10-31T22:48:53.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 -- 172.21.15.60:0/1457442808 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3235677223 0 0) 0x7f7044003230 con 0x7f70640aead0 2020-10-31T22:48:53.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 -- 172.21.15.60:0/1457442808 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70640b52a0 msgr2=0x7f7064141d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:53.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 --2- 172.21.15.60:0/1457442808 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70640b52a0 0x7f7064141d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 -- 172.21.15.60:0/1457442808 >> v2:172.21.15.66:3300/0 conn(0x7f70640af390 msgr2=0x7f706413b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:53.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 --2- 172.21.15.60:0/1457442808 >> v2:172.21.15.66:3300/0 conn(0x7f70640af390 0x7f706413b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 -- 172.21.15.60:0/1457442808 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706405b160 con 0x7f70640aead0 2020-10-31T22:48:53.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 -- 172.21.15.60:0/1457442808 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f704c0016d0 con 0x7f70640aead0 2020-10-31T22:48:53.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 -- 172.21.15.60:0/1457442808 >> v1:172.21.15.60:6789/0 conn(0x7f70640aead0 legacy=0x7f706405bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:53.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 --2- 172.21.15.60:0/1457442808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70440037d0 0x7f7044003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 --2- 172.21.15.60:0/1457442808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70440044d0 0x7f7044004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 --2- 172.21.15.60:0/1457442808 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70640b52a0 0x7f7044004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 -- 172.21.15.60:0/1457442808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706405c4f0 con 0x7f70440037d0 2020-10-31T22:48:53.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f7063fff700 1 --2- 172.21.15.60:0/1457442808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70440037d0 0x7f7044003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 -- 172.21.15.60:0/1457442808 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706406a430 con 0x7f70440044d0 2020-10-31T22:48:53.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 -- 172.21.15.60:0/1457442808 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7044005330 con 0x7f70640b52a0 2020-10-31T22:48:53.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f705b7fe700 1 --2- 172.21.15.60:0/1457442808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70440044d0 0x7f7044004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f7068d80700 1 --2- 172.21.15.60:0/1457442808 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70640b52a0 0x7f7044004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f7063fff700 1 -- 172.21.15.60:0/1457442808 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70640b52a0 msgr2=0x7f7044004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:53.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f7063fff700 1 --2- 172.21.15.60:0/1457442808 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f70640b52a0 0x7f7044004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f7063fff700 1 -- 172.21.15.60:0/1457442808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70440044d0 msgr2=0x7f7044004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:53.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f7063fff700 1 --2- 172.21.15.60:0/1457442808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70440044d0 0x7f7044004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f7063fff700 1 -- 172.21.15.60:0/1457442808 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7044003230 con 0x7f70440037d0 2020-10-31T22:48:53.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f705b7fe700 1 --2- 172.21.15.60:0/1457442808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f70440044d0 0x7f7044004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:53.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f7063fff700 1 --2- 172.21.15.60:0/1457442808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70440037d0 0x7f7044003bf0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f705400c000 tx=0x7f7054008040).ready entity=mon.0 client_cookie=b848d4b109e6d862 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:53.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 -- 172.21.15.60:0/1457442808 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f705400e9d0 con 0x7f70440037d0 2020-10-31T22:48:53.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 -- 172.21.15.60:0/1457442808 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705400eb30 con 0x7f70440037d0 2020-10-31T22:48:53.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f70637fe700 1 -- 172.21.15.60:0/1457442808 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f705400ee90 con 0x7f70440037d0 2020-10-31T22:48:53.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f706a7e3700 1 -- 172.21.15.60:0/1457442808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70440037d0 msgr2=0x7f7044003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:53.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f706a7e3700 1 --2- 172.21.15.60:0/1457442808 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f70440037d0 0x7f7044003bf0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 rx=0x7f705400c000 tx=0x7f7054008040).stop 2020-10-31T22:48:53.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.549+0000 7f7068d80700 1 -- 172.21.15.60:0/1457442808 reap_dead start 2020-10-31T22:48:53.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f706a7e3700 1 -- 172.21.15.60:0/1457442808 shutdown_connections 2020-10-31T22:48:53.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f706a7e3700 1 -- 172.21.15.60:0/1457442808 >> 172.21.15.60:0/1457442808 conn(0x7f7064060c10 msgr2=0x7f70640b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f706a7e3700 1 -- 172.21.15.60:0/1457442808 shutdown_connections 2020-10-31T22:48:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f706a7e3700 1 -- 172.21.15.60:0/1457442808 wait complete. 2020-10-31T22:48:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f706a7e3700 1 Processor -- start 2020-10-31T22:48:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f706a7e3700 1 -- start start 2020-10-31T22:48:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f706a7e3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7064147ec0 0x7f7064145370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f706a7e3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7064150bb0 0x7f7064151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f706a7e3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7064154100 0x7f7064154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f706a7e3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70640a9e00 con 0x7f7064154100 2020-10-31T22:48:53.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f706a7e3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70641482a0 con 0x7f7064150bb0 2020-10-31T22:48:53.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f706a7e3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70641463d0 con 0x7f7064147ec0 2020-10-31T22:48:53.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f7068d80700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7064154100 0x7f7064154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f7068d80700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7064154100 0x7f7064154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47094/0 (socket says 172.21.15.60:47094) 2020-10-31T22:48:53.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f7068d80700 1 -- 172.21.15.60:0/543008394 learned_addr learned my addr 172.21.15.60:0/543008394 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:53.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f705b7fe700 1 --2- 172.21.15.60:0/543008394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7064150bb0 0x7f7064151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.553+0000 7f7063fff700 1 --2- 172.21.15.60:0/543008394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7064147ec0 0x7f7064145370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f7068d80700 1 -- 172.21.15.60:0/543008394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7064147ec0 msgr2=0x7f7064145370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:53.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f7068d80700 1 --2- 172.21.15.60:0/543008394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7064147ec0 0x7f7064145370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f7068d80700 1 -- 172.21.15.60:0/543008394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7064150bb0 msgr2=0x7f7064151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:53.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f7068d80700 1 --2- 172.21.15.60:0/543008394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7064150bb0 0x7f7064151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f7068d80700 1 -- 172.21.15.60:0/543008394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7064146670 con 0x7f7064154100 2020-10-31T22:48:53.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f7068d80700 1 --2- 172.21.15.60:0/543008394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7064154100 0x7f7064154580 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f705c00b000 tx=0x7f705c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:53.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f7061ffb700 1 -- 172.21.15.60:0/543008394 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f705c00e970 con 0x7f7064154100 2020-10-31T22:48:53.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f7061ffb700 1 -- 172.21.15.60:0/543008394 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f705c00ead0 con 0x7f7064154100 2020-10-31T22:48:53.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f706a7e3700 1 -- 172.21.15.60:0/543008394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70640aa030 con 0x7f7064154100 2020-10-31T22:48:53.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f7061ffb700 1 -- 172.21.15.60:0/543008394 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f705c00ee30 con 0x7f7064154100 2020-10-31T22:48:53.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f706a7e3700 1 -- 172.21.15.60:0/543008394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7064151520 con 0x7f7064154100 2020-10-31T22:48:53.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f706a7e3700 1 -- 172.21.15.60:0/543008394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7064057100 con 0x7f7064154100 2020-10-31T22:48:53.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f7061ffb700 1 -- 172.21.15.60:0/543008394 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f705c014470 con 0x7f7064154100 2020-10-31T22:48:53.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f7061ffb700 1 --2- 172.21.15.60:0/543008394 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7048054f30 0x7f70480573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:53.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.557+0000 7f7061ffb700 1 -- 172.21.15.60:0/543008394 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f705c06def0 con 0x7f7064154100 2020-10-31T22:48:53.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.561+0000 7f7063fff700 1 --2- 172.21.15.60:0/543008394 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7048054f30 0x7f70480573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:53.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.561+0000 7f7063fff700 1 --2- 172.21.15.60:0/543008394 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7048054f30 0x7f70480573f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f705401c000 tx=0x7f705401a000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:53.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.565+0000 7f7061ffb700 1 -- 172.21.15.60:0/543008394 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f705c044310 con 0x7f7064154100 2020-10-31T22:48:53.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.709+0000 7f706a7e3700 1 -- 172.21.15.60:0/543008394 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f706409e030 con 0x7f7064154100 2020-10-31T22:48:53.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.709+0000 7f7061ffb700 1 -- 172.21.15.60:0/543008394 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v99) v1 ==== 81+0+33648 (secure 0 0 0) 0x7f705c018020 con 0x7f7064154100 2020-10-31T22:48:53.718 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:53.718 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:48:53.719 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 99, 2020-10-31T22:48:53.719 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "226f905a-1517-4a8c-8009-08779515965c", 2020-10-31T22:48:53.719 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2020-10-31T22:40:51.928572+0000", 2020-10-31T22:48:53.719 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2020-10-31T22:48:40.861615+0000", 2020-10-31T22:48:53.720 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:48:53.720 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:48:53.720 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-10-31T22:48:53.720 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2020-10-31T22:48:53.721 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2020-10-31T22:48:53.721 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2020-10-31T22:48:53.722 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2020-10-31T22:48:53.722 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2020-10-31T22:48:53.723 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2020-10-31T22:48:53.723 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:48:53.724 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2020-10-31T22:48:53.724 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2020-10-31T22:48:53.724 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-10-31T22:48:53.725 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2020-10-31T22:48:53.725 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2020-10-31T22:48:53.725 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 18, 2020-10-31T22:48:53.726 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2020-10-31T22:48:53.726 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "jewel", 2020-10-31T22:48:53.726 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2020-10-31T22:48:53.727 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "octopus", 2020-10-31T22:48:53.727 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:48:53.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.727 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2020-10-31T22:48:53.727 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "device_health_metrics", 2020-10-31T22:48:53.728 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:40:55.846143+0000", 2020-10-31T22:48:53.728 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:48:53.728 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:48:53.728 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:48:53.728 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:48:53.728 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:48:53.729 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:48:53.729 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:48:53.729 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:48:53.729 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2020-10-31T22:48:53.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2020-10-31T22:48:53.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2020-10-31T22:48:53.730 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2020-10-31T22:48:53.731 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2020-10-31T22:48:53.731 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:48:53.731 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:48:53.731 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:48:53.732 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:48:53.732 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:48:53.732 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:48:53.732 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:48:53.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.732 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "15", 2020-10-31T22:48:53.733 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:48:53.733 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:48:53.733 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:48:53.733 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:48:53.733 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:48:53.734 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:48:53.734 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:48:53.734 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:48:53.734 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:48:53.735 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:48:53.735 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:48:53.736 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:48:53.736 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:48:53.736 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:48:53.736 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:48:53.737 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:48:53.737 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:48:53.737 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:48:53.738 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:48:53.738 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:48:53.738 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:48:53.739 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:48:53.739 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:48:53.739 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:48:53.740 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:48:53.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:48:53.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.741 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:48:53.741 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:48:53.742 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:48:53.742 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:48:53.742 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:48:53.742 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:48:53.742 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:48:53.743 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:48:53.746 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:48:53.747 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:48:53.747 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:48:53.747 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:48:53.747 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2020-10-31T22:48:53.747 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.747 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:48:53.748 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_devicehealth": {} 2020-10-31T22:48:53.748 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.748 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2020-10-31T22:48:53.748 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2020-10-31T22:48:53.748 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:05.358501+0000", 2020-10-31T22:48:53.749 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:48:53.749 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:48:53.749 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:48:53.750 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:48:53.750 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:48:53.751 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:48:53.751 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:48:53.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:48:53.751 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:48:53.752 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:48:53.752 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:48:53.752 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:48:53.752 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:48:53.753 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:48:53.753 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:48:53.753 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:48:53.753 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:48:53.753 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:48:53.753 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:48:53.753 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:48:53.754 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.754 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "18", 2020-10-31T22:48:53.754 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:48:53.754 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:48:53.754 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:48:53.754 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:48:53.754 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:48:53.755 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:48:53.755 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:48:53.755 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:48:53.755 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:48:53.755 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:48:53.755 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:48:53.755 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:48:53.756 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:48:53.756 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:48:53.756 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:48:53.756 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:48:53.756 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:48:53.757 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:48:53.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:48:53.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:48:53.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:48:53.758 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:48:53.758 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:48:53.758 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:48:53.758 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:48:53.758 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:48:53.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.759 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:48:53.759 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:48:53.759 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:48:53.759 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:48:53.759 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:48:53.759 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:48:53.759 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:48:53.760 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:48:53.760 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:48:53.760 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:48:53.760 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:48:53.760 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:48:53.760 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:48:53.760 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2020-10-31T22:48:53.761 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 17, 2020-10-31T22:48:53.761 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2020-10-31T22:48:53.761 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:48:37.407586+0000", 2020-10-31T22:48:53.761 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:48:53.762 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:48:53.762 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:48:53.762 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:48:53.762 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:48:53.762 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:48:53.762 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:48:53.762 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:48:53.763 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:48:53.763 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:48:53.763 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:48:53.763 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:48:53.763 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:48:53.763 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:48:53.764 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:48:53.764 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:48:53.764 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:48:53.765 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:48:53.765 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:48:53.765 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:48:53.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.765 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "98", 2020-10-31T22:48:53.765 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:48:53.766 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:48:53.766 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:48:53.766 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:48:53.766 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:48:53.768 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:48:53.769 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:48:53.769 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:48:53.769 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:48:53.769 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:48:53.769 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:48:53.770 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:48:53.770 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:48:53.770 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:48:53.770 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:48:53.770 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:48:53.770 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:48:53.771 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:48:53.771 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:48:53.771 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:48:53.771 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:48:53.771 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:48:53.772 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:48:53.772 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:48:53.772 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:48:53.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:48:53.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.773 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:48:53.773 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:48:53.773 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:48:53.773 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:48:53.773 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:48:53.773 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:48:53.773 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:48:53.774 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:48:53.774 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:48:53.774 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:48:53.774 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:48:53.774 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:48:53.774 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2020-10-31T22:48:53.775 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2020-10-31T22:48:53.775 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2020-10-31T22:48:53.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.775 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:48:53.775 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:48:53.775 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2020-10-31T22:48:53.775 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.776 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.776 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 18, 2020-10-31T22:48:53.776 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2020-10-31T22:48:53.776 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:48:38.710432+0000", 2020-10-31T22:48:53.777 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:48:53.777 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:48:53.777 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:48:53.777 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:48:53.777 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:48:53.777 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:48:53.778 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:48:53.778 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:48:53.778 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:48:53.778 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:48:53.779 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:48:53.779 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:48:53.780 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:48:53.780 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:48:53.781 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:48:53.781 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:48:53.781 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:48:53.781 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:48:53.782 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:48:53.782 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:48:53.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.782 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "99", 2020-10-31T22:48:53.782 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:48:53.782 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:48:53.783 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:48:53.783 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:48:53.783 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:48:53.783 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:48:53.783 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:48:53.783 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:48:53.784 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:48:53.784 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:48:53.784 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:48:53.784 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:48:53.784 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:48:53.784 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:48:53.784 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:48:53.785 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:48:53.785 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:48:53.785 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:48:53.785 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:48:53.785 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:48:53.785 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:48:53.786 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:48:53.786 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:48:53.786 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:48:53.786 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:48:53.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:48:53.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.787 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:48:53.787 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:48:53.787 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:48:53.787 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:48:53.787 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:48:53.787 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:48:53.788 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:48:53.788 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:48:53.788 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:48:53.788 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:48:53.788 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:48:53.788 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:48:53.788 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:48:53.789 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:48:53.789 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2020-10-31T22:48:53.789 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.790 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.790 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.790 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:48:53.790 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2020-10-31T22:48:53.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.791 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:48:53.791 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", 2020-10-31T22:48:53.791 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:53.791 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:53.791 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:53.791 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:53.791 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:53.792 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:53.792 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:53.792 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 97, 2020-10-31T22:48:53.792 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:53.792 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:53.792 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:53.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2020-10-31T22:48:53.793 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:53.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.793 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2020-10-31T22:48:53.794 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:53.794 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.794 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.795 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:53.795 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.795 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.795 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2020-10-31T22:48:53.796 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:53.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.796 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.796 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.796 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2020-10-31T22:48:53.797 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:53.797 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.797 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.797 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.797 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:53.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2020-10-31T22:48:53.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:53.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2020-10-31T22:48:53.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:53.799 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.799 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.800 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:53.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2020-10-31T22:48:53.801 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:53.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.801 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2020-10-31T22:48:53.801 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:48:53.801 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.802 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.802 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6803/14302", 2020-10-31T22:48:53.802 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6805/14302", 2020-10-31T22:48:53.802 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6809/14302", 2020-10-31T22:48:53.802 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6807/14302", 2020-10-31T22:48:53.803 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:53.803 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:53.803 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:53.803 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.803 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:48:53.804 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", 2020-10-31T22:48:53.804 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:53.804 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:53.804 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:53.804 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:53.804 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:53.804 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:53.805 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:53.805 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 97, 2020-10-31T22:48:53.805 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:53.805 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:53.806 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:53.806 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.806 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.806 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2020-10-31T22:48:53.806 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:53.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.807 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.807 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.807 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2020-10-31T22:48:53.807 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:53.807 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.807 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.808 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:53.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.808 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.808 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2020-10-31T22:48:53.808 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:53.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.809 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.809 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2020-10-31T22:48:53.809 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:53.809 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.809 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.810 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:53.810 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2020-10-31T22:48:53.811 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:53.811 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.811 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.811 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.811 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2020-10-31T22:48:53.812 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:53.812 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.812 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.812 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:53.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.813 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.813 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2020-10-31T22:48:53.813 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:53.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.813 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.813 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2020-10-31T22:48:53.814 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:48:53.814 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.814 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.814 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/14300", 2020-10-31T22:48:53.814 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6813/14300", 2020-10-31T22:48:53.815 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6817/14300", 2020-10-31T22:48:53.815 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6815/14300", 2020-10-31T22:48:53.815 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:53.815 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:53.815 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:53.815 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.815 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.816 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:48:53.816 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", 2020-10-31T22:48:53.816 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:53.816 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:53.816 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:53.816 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:53.816 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:53.817 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:53.817 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:53.817 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 97, 2020-10-31T22:48:53.817 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:53.817 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:53.817 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:53.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.818 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2020-10-31T22:48:53.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:53.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2020-10-31T22:48:53.819 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:53.819 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.819 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.819 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:53.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2020-10-31T22:48:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2020-10-31T22:48:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.821 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6832", 2020-10-31T22:48:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.822 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6833", 2020-10-31T22:48:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.823 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2020-10-31T22:48:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2020-10-31T22:48:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:48:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.825 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6827/14318", 2020-10-31T22:48:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6829/14318", 2020-10-31T22:48:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6833/14318", 2020-10-31T22:48:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6831/14318", 2020-10-31T22:48:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:53.826 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:48:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", 2020-10-31T22:48:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:53.827 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 97, 2020-10-31T22:48:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:53.828 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2020-10-31T22:48:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.829 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2020-10-31T22:48:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.830 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2020-10-31T22:48:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2020-10-31T22:48:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:53.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2020-10-31T22:48:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.833 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2020-10-31T22:48:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:53.834 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.835 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2020-10-31T22:48:53.835 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:53.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.835 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.836 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2020-10-31T22:48:53.836 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:48:53.836 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.836 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.836 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6819/14301", 2020-10-31T22:48:53.836 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6821/14301", 2020-10-31T22:48:53.837 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/14301", 2020-10-31T22:48:53.837 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6823/14301", 2020-10-31T22:48:53.837 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:53.837 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:53.837 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:53.838 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.839 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.839 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:48:53.839 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", 2020-10-31T22:48:53.840 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:53.840 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:53.840 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:53.840 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:53.840 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:53.840 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:53.840 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:53.841 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 94, 2020-10-31T22:48:53.841 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:53.841 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:53.841 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:53.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6816", 2020-10-31T22:48:53.842 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:53.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.842 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6817", 2020-10-31T22:48:53.842 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:53.843 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.843 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.843 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:53.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.843 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.843 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6818", 2020-10-31T22:48:53.844 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:53.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6819", 2020-10-31T22:48:53.844 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:53.844 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.845 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.845 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:53.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6822", 2020-10-31T22:48:53.846 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:53.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.846 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.846 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6823", 2020-10-31T22:48:53.846 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:53.846 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.847 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.847 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:53.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6820", 2020-10-31T22:48:53.848 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:53.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6821", 2020-10-31T22:48:53.848 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:48:53.848 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.849 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.849 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6817/14002", 2020-10-31T22:48:53.849 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6819/14002", 2020-10-31T22:48:53.849 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6823/14002", 2020-10-31T22:48:53.849 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6821/14002", 2020-10-31T22:48:53.849 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:53.850 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:53.850 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:53.850 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.850 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:48:53.850 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", 2020-10-31T22:48:53.851 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:53.851 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:53.851 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:53.851 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:53.851 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:53.851 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:53.851 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:53.851 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 86, 2020-10-31T22:48:53.852 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:53.852 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:53.852 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:53.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6800", 2020-10-31T22:48:53.853 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:53.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6801", 2020-10-31T22:48:53.853 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:53.853 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.854 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.854 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:53.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6802", 2020-10-31T22:48:53.855 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:53.855 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.855 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.855 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.855 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6803", 2020-10-31T22:48:53.855 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:53.855 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.856 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.856 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:53.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.856 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.856 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6806", 2020-10-31T22:48:53.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:53.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.857 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6807", 2020-10-31T22:48:53.857 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:53.857 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.858 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.858 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:53.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6804", 2020-10-31T22:48:53.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:53.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6805", 2020-10-31T22:48:53.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:48:53.859 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.860 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6801/14001", 2020-10-31T22:48:53.860 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6803/14001", 2020-10-31T22:48:53.860 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6807/14001", 2020-10-31T22:48:53.860 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6805/14001", 2020-10-31T22:48:53.861 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:53.861 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:53.861 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:53.861 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.861 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:48:53.862 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", 2020-10-31T22:48:53.862 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:53.862 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:53.862 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:53.862 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:53.862 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:53.862 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:53.863 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:53.863 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 96, 2020-10-31T22:48:53.863 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:53.863 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:53.863 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:53.863 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6808", 2020-10-31T22:48:53.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:53.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6809", 2020-10-31T22:48:53.865 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:53.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.865 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.866 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:53.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6810", 2020-10-31T22:48:53.866 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:53.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.867 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6811", 2020-10-31T22:48:53.867 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:53.867 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.867 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.868 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:53.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6814", 2020-10-31T22:48:53.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:53.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6815", 2020-10-31T22:48:53.869 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:53.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.869 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.870 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:53.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6812", 2020-10-31T22:48:53.870 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:53.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.871 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6813", 2020-10-31T22:48:53.871 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:48:53.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.871 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.872 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6809/14003", 2020-10-31T22:48:53.872 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6811/14003", 2020-10-31T22:48:53.872 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6815/14003", 2020-10-31T22:48:53.872 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6813/14003", 2020-10-31T22:48:53.872 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:53.872 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:53.873 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:53.873 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:48:53.873 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", 2020-10-31T22:48:53.873 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:48:53.874 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:48:53.874 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:48:53.874 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:48:53.874 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:48:53.874 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:48:53.874 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:48:53.874 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 97, 2020-10-31T22:48:53.875 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:48:53.875 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:48:53.875 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:48:53.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6824", 2020-10-31T22:48:53.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:53.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.876 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6825", 2020-10-31T22:48:53.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:53.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.877 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.877 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:48:53.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.877 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6826", 2020-10-31T22:48:53.878 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:53.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.878 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.878 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6827", 2020-10-31T22:48:53.878 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:53.878 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.879 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.879 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:48:53.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6830", 2020-10-31T22:48:53.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:53.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6831", 2020-10-31T22:48:53.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:53.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.881 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.881 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:48:53.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:48:53.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:48:53.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6828", 2020-10-31T22:48:53.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:53.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:48:53.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6829", 2020-10-31T22:48:53.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:48:53.883 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.883 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.883 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6825/14046", 2020-10-31T22:48:53.883 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6827/14046", 2020-10-31T22:48:53.884 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6831/14046", 2020-10-31T22:48:53.884 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6829/14046", 2020-10-31T22:48:53.884 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:48:53.884 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:48:53.884 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:48:53.884 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:53.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.885 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:48:53.885 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2020-10-31T22:48:53.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.885 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:48:53.885 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:53.885 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:53.886 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:53.886 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:53.886 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:53.886 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.314917+0000", 2020-10-31T22:48:53.886 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:53.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.887 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:48:53.887 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:53.887 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:53.887 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:53.887 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:53.887 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:53.887 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.643069+0000", 2020-10-31T22:48:53.888 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:53.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.888 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:48:53.888 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:53.888 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:53.888 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:53.889 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:53.889 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:53.889 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.662572+0000", 2020-10-31T22:48:53.889 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:53.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.889 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:48:53.890 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:53.890 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:53.890 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:53.890 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:53.890 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:53.890 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.664868+0000", 2020-10-31T22:48:53.890 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:53.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.891 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:48:53.891 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:53.891 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:53.891 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:53.891 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:53.891 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:53.892 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551107+0000", 2020-10-31T22:48:53.892 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:53.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.892 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:48:53.892 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:53.892 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:53.893 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:53.893 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:53.893 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:53.893 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.400568+0000", 2020-10-31T22:48:53.893 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:53.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.894 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:48:53.894 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:53.894 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:53.894 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:53.894 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:53.894 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:53.894 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551173+0000", 2020-10-31T22:48:53.895 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:53.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.895 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:53.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:48:53.895 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:48:53.895 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:48:53.896 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:48:53.896 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:48:53.896 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:48:53.896 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.604302+0000", 2020-10-31T22:48:53.896 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:48:53.896 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.896 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:48:53.897 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2020-10-31T22:48:53.897 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2020-10-31T22:48:53.897 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2020-10-31T22:48:53.897 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2020-10-31T22:48:53.897 INFO:teuthology.orchestra.run.smithi060.stdout: "blacklist": {}, 2020-10-31T22:48:53.897 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2020-10-31T22:48:53.897 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2020-10-31T22:48:53.898 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2020-10-31T22:48:53.898 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2020-10-31T22:48:53.898 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2020-10-31T22:48:53.898 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2020-10-31T22:48:53.898 INFO:teuthology.orchestra.run.smithi060.stdout: "ruleset-failure-domain": "osd", 2020-10-31T22:48:53.898 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2020-10-31T22:48:53.898 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:53.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:53.899 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2020-10-31T22:48:53.899 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2020-10-31T22:48:53.899 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2020-10-31T22:48:53.899 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2020-10-31T22:48:53.899 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {} 2020-10-31T22:48:53.899 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:48:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.713+0000 7f706a7e3700 1 -- 172.21.15.60:0/543008394 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7048054f30 msgr2=0x7f70480573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.713+0000 7f706a7e3700 1 --2- 172.21.15.60:0/543008394 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7048054f30 0x7f70480573f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7f705401c000 tx=0x7f705401a000).stop 2020-10-31T22:48:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.713+0000 7f706a7e3700 1 -- 172.21.15.60:0/543008394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7064154100 msgr2=0x7f7064154580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.713+0000 7f706a7e3700 1 --2- 172.21.15.60:0/543008394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7064154100 0x7f7064154580 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 rx=0x7f705c00b000 tx=0x7f705c008040).stop 2020-10-31T22:48:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.713+0000 7f706a7e3700 1 -- 172.21.15.60:0/543008394 shutdown_connections 2020-10-31T22:48:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.713+0000 7f706a7e3700 1 --2- 172.21.15.60:0/543008394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7064154100 0x7f7064154580 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.713+0000 7f706a7e3700 1 --2- 172.21.15.60:0/543008394 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7064147ec0 0x7f7064145370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.713+0000 7f706a7e3700 1 --2- 172.21.15.60:0/543008394 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7048054f30 0x7f70480573f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.713+0000 7f706a7e3700 1 --2- 172.21.15.60:0/543008394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7064150bb0 0x7f7064151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.713+0000 7f706a7e3700 1 -- 172.21.15.60:0/543008394 >> 172.21.15.60:0/543008394 conn(0x7f7064060c10 msgr2=0x7f706405bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.713+0000 7f706a7e3700 1 -- 172.21.15.60:0/543008394 shutdown_connections 2020-10-31T22:48:53.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:53.713+0000 7f706a7e3700 1 -- 172.21.15.60:0/543008394 wait complete. 2020-10-31T22:48:53.903 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:54.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259b32700 1 Processor -- start 2020-10-31T22:48:54.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259b32700 1 -- start start 2020-10-31T22:48:54.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259b32700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22540b2820 0x7f22540af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:54.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259b32700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22541459c0 con 0x7f2254063140 2020-10-31T22:48:54.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259b32700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2254063520 con 0x7f22540b1000 2020-10-31T22:48:54.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259b32700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22540b2060 con 0x7f22540b2820 2020-10-31T22:48:54.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259331700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22540b2820 0x7f22540af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:54.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259331700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f22540b2820 0x7f22540af4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47100/0 (socket says 172.21.15.60:47100) 2020-10-31T22:48:54.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2258b30700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2254063140 0x7f22541452b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51234/0 (socket says 172.21.15.60:51234) 2020-10-31T22:48:54.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259331700 1 -- 172.21.15.60:0/60709829 learned_addr learned my addr 172.21.15.60:0/60709829 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:54.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f22537fe700 1 -- 172.21.15.60:0/60709829 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828528932 0 0) 0x7f2254063520 con 0x7f22540b1000 2020-10-31T22:48:54.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f22537fe700 1 -- 172.21.15.60:0/60709829 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2240003230 con 0x7f22540b1000 2020-10-31T22:48:54.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259331700 1 -- 172.21.15.60:0/60709829 >> v1:172.21.15.66:6789/0 conn(0x7f22540b1000 legacy=0x7f22540aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:54.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259331700 1 -- 172.21.15.60:0/60709829 >> v1:172.21.15.60:6789/0 conn(0x7f2254063140 legacy=0x7f22541452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:54.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f22537fe700 1 -- 172.21.15.60:0/60709829 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312202851 0 0) 0x7f22541459c0 con 0x7f2254063140 2020-10-31T22:48:54.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259331700 1 -- 172.21.15.60:0/60709829 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22540b02e0 con 0x7f22540b2820 2020-10-31T22:48:54.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259331700 1 --2- 172.21.15.60:0/60709829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540b2820 0x7f22540af4b0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f224c0032b0 tx=0x7f224c009270).ready entity=mon.0 client_cookie=2239da86ff8ce66e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:54.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f22537fe700 1 -- 172.21.15.60:0/60709829 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f224c009e60 con 0x7f22540b2820 2020-10-31T22:48:54.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f22537fe700 1 -- 172.21.15.60:0/60709829 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224c00bc90 con 0x7f22540b2820 2020-10-31T22:48:54.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f22537fe700 1 -- 172.21.15.60:0/60709829 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f224c00be00 con 0x7f22540b2820 2020-10-31T22:48:54.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259b32700 1 -- 172.21.15.60:0/60709829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540b2820 msgr2=0x7f22540af4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:54.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.025+0000 7f2259b32700 1 --2- 172.21.15.60:0/60709829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540b2820 0x7f22540af4b0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 rx=0x7f224c0032b0 tx=0x7f224c009270).stop 2020-10-31T22:48:54.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2259b32700 1 -- 172.21.15.60:0/60709829 shutdown_connections 2020-10-31T22:48:54.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2259b32700 1 --2- 172.21.15.60:0/60709829 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540b2820 0x7f22540af4b0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:54.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2259b32700 1 -- 172.21.15.60:0/60709829 >> 172.21.15.60:0/60709829 conn(0x7f225406a600 msgr2=0x7f2254060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:54.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2259b32700 1 -- 172.21.15.60:0/60709829 shutdown_connections 2020-10-31T22:48:54.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2259b32700 1 -- 172.21.15.60:0/60709829 wait complete. 2020-10-31T22:48:54.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2259b32700 1 Processor -- start 2020-10-31T22:48:54.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2259b32700 1 -- start start 2020-10-31T22:48:54.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2259b32700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2254063140 0x7f2254153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:54.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2259b32700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540b1000 0x7f2254063860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:54.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2259b32700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22540b2820 0x7f225413ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:54.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2259b32700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22540ab900 con 0x7f22540b1000 2020-10-31T22:48:54.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2259b32700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22540673c0 con 0x7f22540b2820 2020-10-31T22:48:54.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2259b32700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22541544a0 con 0x7f2254063140 2020-10-31T22:48:54.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2253fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540b1000 0x7f2254063860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:54.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2258b30700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2254063140 0x7f2254153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:54.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2259331700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22540b2820 0x7f225413ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:54.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2253fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540b1000 0x7f2254063860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47106/0 (socket says 172.21.15.60:47106) 2020-10-31T22:48:54.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.029+0000 7f2253fff700 1 -- 172.21.15.60:0/2890292131 learned_addr learned my addr 172.21.15.60:0/2890292131 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:54.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2253fff700 1 -- 172.21.15.60:0/2890292131 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2254063140 msgr2=0x7f2254153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:54.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2253fff700 1 --2- 172.21.15.60:0/2890292131 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2254063140 0x7f2254153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:54.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2253fff700 1 -- 172.21.15.60:0/2890292131 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22540b2820 msgr2=0x7f225413ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:54.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2253fff700 1 --2- 172.21.15.60:0/2890292131 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22540b2820 0x7f225413ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2253fff700 1 -- 172.21.15.60:0/2890292131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2254154740 con 0x7f22540b1000 2020-10-31T22:48:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2253fff700 1 --2- 172.21.15.60:0/2890292131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540b1000 0x7f2254063860 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f22440010d0 tx=0x7f2244007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:54.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2251ffb700 1 -- 172.21.15.60:0/2890292131 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f224400f470 con 0x7f22540b1000 2020-10-31T22:48:54.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2251ffb700 1 -- 172.21.15.60:0/2890292131 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224400f5d0 con 0x7f22540b1000 2020-10-31T22:48:54.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2259b32700 1 -- 172.21.15.60:0/2890292131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22541549e0 con 0x7f22540b1000 2020-10-31T22:48:54.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2251ffb700 1 -- 172.21.15.60:0/2890292131 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f224400f930 con 0x7f22540b1000 2020-10-31T22:48:54.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2259b32700 1 -- 172.21.15.60:0/2890292131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22540abfa0 con 0x7f22540b1000 2020-10-31T22:48:54.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2259b32700 1 -- 172.21.15.60:0/2890292131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2254057100 con 0x7f22540b1000 2020-10-31T22:48:54.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2251ffb700 1 -- 172.21.15.60:0/2890292131 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2244019030 con 0x7f22540b1000 2020-10-31T22:48:54.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2251ffb700 1 --2- 172.21.15.60:0/2890292131 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2234054f10 0x7f22340573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:54.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2251ffb700 1 -- 172.21.15.60:0/2890292131 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f224406d190 con 0x7f22540b1000 2020-10-31T22:48:54.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.033+0000 7f2258b30700 1 --2- 172.21.15.60:0/2890292131 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2234054f10 0x7f22340573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:54.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.037+0000 7f2258b30700 1 --2- 172.21.15.60:0/2890292131 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2234054f10 0x7f22340573d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f224800d000 tx=0x7f2248007930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:54.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.041+0000 7f2251ffb700 1 -- 172.21.15.60:0/2890292131 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f22440436b0 con 0x7f22540b1000 2020-10-31T22:48:54.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.229+0000 7f2259b32700 1 -- 172.21.15.60:0/2890292131 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f225405ed50 con 0x7f22540b1000 2020-10-31T22:48:54.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.233+0000 7f2251ffb700 1 -- 172.21.15.60:0/2890292131 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+2484 (secure 0 0 0) 0x7f2244046cd0 con 0x7f22540b1000 2020-10-31T22:48:54.239 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:54.239 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":47,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6822,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6835/458791799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458791799},{"type":"v1","addr":"172.21.15.60:6835","nonce":458791799}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45},{"gid":6825,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/332317680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":332317680},{"type":"v1","addr":"172.21.15.60:6837","nonce":332317680}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:48:39.857912+0000","modified":"2020-10-31T22:48:40.861506+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6831},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6831":{"gid":6831,"name":"b","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/588884767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":588884767},{"type":"v1","addr":"172.21.15.66:6833","nonce":588884767}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-10-31T22:48:54.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.233+0000 7f2259b32700 1 -- 172.21.15.60:0/2890292131 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2234054f10 msgr2=0x7f22340573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:54.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.233+0000 7f2259b32700 1 --2- 172.21.15.60:0/2890292131 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2234054f10 0x7f22340573d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7f224800d000 tx=0x7f2248007930).stop 2020-10-31T22:48:54.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.233+0000 7f2259b32700 1 -- 172.21.15.60:0/2890292131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540b1000 msgr2=0x7f2254063860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:54.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.233+0000 7f2259b32700 1 --2- 172.21.15.60:0/2890292131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540b1000 0x7f2254063860 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 rx=0x7f22440010d0 tx=0x7f2244007ab0).stop 2020-10-31T22:48:54.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.233+0000 7f2259b32700 1 -- 172.21.15.60:0/2890292131 shutdown_connections 2020-10-31T22:48:54.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.233+0000 7f2259b32700 1 --2- 172.21.15.60:0/2890292131 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2234054f10 0x7f22340573d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:54.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.233+0000 7f2259b32700 1 --2- 172.21.15.60:0/2890292131 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22540b2820 0x7f225413ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:54.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.233+0000 7f2259b32700 1 --2- 172.21.15.60:0/2890292131 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2254063140 0x7f2254153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:54.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.233+0000 7f2259b32700 1 --2- 172.21.15.60:0/2890292131 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f22540b1000 0x7f2254063860 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:54.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.233+0000 7f2259b32700 1 -- 172.21.15.60:0/2890292131 >> 172.21.15.60:0/2890292131 conn(0x7f225406a600 msgr2=0x7f22540b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:54.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.233+0000 7f2259b32700 1 -- 172.21.15.60:0/2890292131 shutdown_connections 2020-10-31T22:48:54.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.233+0000 7f2259b32700 1 -- 172.21.15.60:0/2890292131 wait complete. 2020-10-31T22:48:54.242 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 47 2020-10-31T22:48:54.252 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-10-31T22:48:54.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.361+0000 7f5bca90f700 1 Processor -- start 2020-10-31T22:48:54.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.361+0000 7f5bca90f700 1 -- start start 2020-10-31T22:48:54.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.361+0000 7f5bca90f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5bc40ac870 0x7f5bc40b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:54.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.361+0000 7f5bca90f700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5bc40ae8b0 0x7f5bc41412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:54.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.361+0000 7f5bca90f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc40acc50 con 0x7f5bc40b0e20 2020-10-31T22:48:54.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.361+0000 7f5bca90f700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc40b14c0 con 0x7f5bc40ae8b0 2020-10-31T22:48:54.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.361+0000 7f5bca90f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc40b5690 con 0x7f5bc40ac870 2020-10-31T22:48:54.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.361+0000 7f5bc910c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5bc40b0e20 0x7f5bc40ae1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51248/0 (socket says 172.21.15.60:51248) 2020-10-31T22:48:54.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.361+0000 7f5bc910c700 1 -- 172.21.15.60:0/104385358 learned_addr learned my addr 172.21.15.60:0/104385358 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:54.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bc990d700 1 --2- 172.21.15.60:0/104385358 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5bc40ac870 0x7f5bc40b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:54.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bca10e700 1 --2- 172.21.15.60:0/104385358 >> v2:172.21.15.66:3300/0 conn(0x7f5bc40ae8b0 0x7f5bc41412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:54.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bc890b700 1 -- 172.21.15.60:0/104385358 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208203542 0 0) 0x7f5bc40acc50 con 0x7f5bc40b0e20 2020-10-31T22:48:54.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bc890b700 1 -- 172.21.15.60:0/104385358 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ba8003230 con 0x7f5bc40b0e20 2020-10-31T22:48:54.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bc990d700 1 -- 172.21.15.60:0/104385358 >> v2:172.21.15.66:3300/0 conn(0x7f5bc40ae8b0 msgr2=0x7f5bc41412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:54.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bc990d700 1 --2- 172.21.15.60:0/104385358 >> v2:172.21.15.66:3300/0 conn(0x7f5bc40ae8b0 0x7f5bc41412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:54.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bc990d700 1 -- 172.21.15.60:0/104385358 >> v1:172.21.15.60:6789/0 conn(0x7f5bc40b0e20 legacy=0x7f5bc40ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:54.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bc890b700 1 -- 172.21.15.60:0/104385358 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2005545367 0 0) 0x7f5ba8003230 con 0x7f5bc40b0e20 2020-10-31T22:48:54.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bc990d700 1 -- 172.21.15.60:0/104385358 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc40afc10 con 0x7f5bc40ac870 2020-10-31T22:48:54.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bc990d700 1 --2- 172.21.15.60:0/104385358 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5bc40ac870 0x7f5bc40b5060 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f5bb0001870 tx=0x7f5bb80091a0).ready entity=mon.2 client_cookie=94c579238e1492e8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:54.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bc890b700 1 -- 172.21.15.60:0/104385358 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bb00016d0 con 0x7f5bc40ac870 2020-10-31T22:48:54.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bc890b700 1 -- 172.21.15.60:0/104385358 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb800b890 con 0x7f5bc40ac870 2020-10-31T22:48:54.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bc890b700 1 -- 172.21.15.60:0/104385358 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bb800ba00 con 0x7f5bc40ac870 2020-10-31T22:48:54.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bca90f700 1 -- 172.21.15.60:0/104385358 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5bc40ac870 msgr2=0x7f5bc40b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:54.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bca90f700 1 --2- 172.21.15.60:0/104385358 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5bc40ac870 0x7f5bc40b5060 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f5bb0001870 tx=0x7f5bb80091a0).stop 2020-10-31T22:48:54.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bca90f700 1 -- 172.21.15.60:0/104385358 shutdown_connections 2020-10-31T22:48:54.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bca90f700 1 --2- 172.21.15.60:0/104385358 >> v2:172.21.15.66:3300/0 conn(0x7f5bc40ae8b0 0x7f5bc41412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:54.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bca90f700 1 --2- 172.21.15.60:0/104385358 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5bc40ac870 0x7f5bc40b5060 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:54.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bca90f700 1 -- 172.21.15.60:0/104385358 >> 172.21.15.60:0/104385358 conn(0x7f5bc406a600 msgr2=0x7f5bc4060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:54.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bca90f700 1 -- 172.21.15.60:0/104385358 shutdown_connections 2020-10-31T22:48:54.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.365+0000 7f5bca90f700 1 -- 172.21.15.60:0/104385358 wait complete. 2020-10-31T22:48:54.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bca90f700 1 Processor -- start 2020-10-31T22:48:54.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bca90f700 1 -- start start 2020-10-31T22:48:54.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bca90f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bc40ac870 0x7f5bc4144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:54.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bca90f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40ae8b0 0x7f5bc414d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:54.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bca90f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5bc40b0e20 0x7f5bc414daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:54.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bca90f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc40665d0 con 0x7f5bc40ae8b0 2020-10-31T22:48:54.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bca90f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc40652c0 con 0x7f5bc40ac870 2020-10-31T22:48:54.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bca90f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc4065560 con 0x7f5bc40b0e20 2020-10-31T22:48:54.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bc910c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40ae8b0 0x7f5bc414d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:54.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bc990d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bc40ac870 0x7f5bc4144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:54.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bc910c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40ae8b0 0x7f5bc414d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47118/0 (socket says 172.21.15.60:47118) 2020-10-31T22:48:54.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bc910c700 1 -- 172.21.15.60:0/2809828953 learned_addr learned my addr 172.21.15.60:0/2809828953 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:54.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bca10e700 1 --2- 172.21.15.60:0/2809828953 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5bc40b0e20 0x7f5bc414daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:54.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bc910c700 1 -- 172.21.15.60:0/2809828953 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5bc40b0e20 msgr2=0x7f5bc414daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:54.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bc910c700 1 --2- 172.21.15.60:0/2809828953 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5bc40b0e20 0x7f5bc414daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:54.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bc910c700 1 -- 172.21.15.60:0/2809828953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bc40ac870 msgr2=0x7f5bc4144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:54.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bc910c700 1 --2- 172.21.15.60:0/2809828953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bc40ac870 0x7f5bc4144d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:54.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bc910c700 1 -- 172.21.15.60:0/2809828953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc4065800 con 0x7f5bc40ae8b0 2020-10-31T22:48:54.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bc910c700 1 --2- 172.21.15.60:0/2809828953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40ae8b0 0x7f5bc414d600 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f5bb0001930 tx=0x7f5bb0001ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:54.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bc2ffd700 1 -- 172.21.15.60:0/2809828953 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bb000ce40 con 0x7f5bc40ae8b0 2020-10-31T22:48:54.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bc2ffd700 1 -- 172.21.15.60:0/2809828953 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0007170 con 0x7f5bc40ae8b0 2020-10-31T22:48:54.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bca90f700 1 -- 172.21.15.60:0/2809828953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc4066780 con 0x7f5bc40ae8b0 2020-10-31T22:48:54.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bc2ffd700 1 -- 172.21.15.60:0/2809828953 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5bb000a7b0 con 0x7f5bc40ae8b0 2020-10-31T22:48:54.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.369+0000 7f5bca90f700 1 -- 172.21.15.60:0/2809828953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc409f330 con 0x7f5bc40ae8b0 2020-10-31T22:48:54.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.373+0000 7f5bca90f700 1 -- 172.21.15.60:0/2809828953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc4066910 con 0x7f5bc40ae8b0 2020-10-31T22:48:54.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.373+0000 7f5bc2ffd700 1 -- 172.21.15.60:0/2809828953 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5bb0010070 con 0x7f5bc40ae8b0 2020-10-31T22:48:54.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.373+0000 7f5bc2ffd700 1 --2- 172.21.15.60:0/2809828953 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5bac054f10 0x7f5bac0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:54.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.373+0000 7f5bc2ffd700 1 -- 172.21.15.60:0/2809828953 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5bb006d540 con 0x7f5bc40ae8b0 2020-10-31T22:48:54.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.373+0000 7f5bc990d700 1 --2- 172.21.15.60:0/2809828953 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5bac054f10 0x7f5bac0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:54.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.373+0000 7f5bc990d700 1 --2- 172.21.15.60:0/2809828953 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5bac054f10 0x7f5bac0573d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f5bb801b000 tx=0x7f5bb8016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:54.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.377+0000 7f5bc2ffd700 1 -- 172.21.15.60:0/2809828953 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5bb00439c0 con 0x7f5bc40ae8b0 2020-10-31T22:48:54.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:54.565+0000 7f5bca90f700 1 -- 172.21.15.60:0/2809828953 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5bc4057100 con 0x7f5bc40ae8b0 2020-10-31T22:48:55.276 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:48:55.269+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:48:55.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.277+0000 7f5bc2ffd700 1 -- 172.21.15.60:0/2809828953 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5bb0019030 con 0x7f5bc40ae8b0 2020-10-31T22:48:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.277+0000 7f5bca90f700 1 -- 172.21.15.60:0/2809828953 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5bac054f10 msgr2=0x7f5bac0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.277+0000 7f5bca90f700 1 --2- 172.21.15.60:0/2809828953 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5bac054f10 0x7f5bac0573d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7f5bb801b000 tx=0x7f5bb8016000).stop 2020-10-31T22:48:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.277+0000 7f5bca90f700 1 -- 172.21.15.60:0/2809828953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40ae8b0 msgr2=0x7f5bc414d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:55.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.277+0000 7f5bca90f700 1 --2- 172.21.15.60:0/2809828953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40ae8b0 0x7f5bc414d600 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 rx=0x7f5bb0001930 tx=0x7f5bb0001ae0).stop 2020-10-31T22:48:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.277+0000 7f5bca90f700 1 -- 172.21.15.60:0/2809828953 shutdown_connections 2020-10-31T22:48:55.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.277+0000 7f5bca90f700 1 --2- 172.21.15.60:0/2809828953 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5bc40b0e20 0x7f5bc414daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.277+0000 7f5bca90f700 1 --2- 172.21.15.60:0/2809828953 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5bac054f10 0x7f5bac0573d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.277+0000 7f5bca90f700 1 --2- 172.21.15.60:0/2809828953 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5bc40ac870 0x7f5bc4144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.277+0000 7f5bca90f700 1 --2- 172.21.15.60:0/2809828953 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5bc40ae8b0 0x7f5bc414d600 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.277+0000 7f5bca90f700 1 -- 172.21.15.60:0/2809828953 >> 172.21.15.60:0/2809828953 conn(0x7f5bc406a600 msgr2=0x7f5bc40b3100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:55.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.277+0000 7f5bca90f700 1 -- 172.21.15.60:0/2809828953 shutdown_connections 2020-10-31T22:48:55.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.277+0000 7f5bca90f700 1 -- 172.21.15.60:0/2809828953 wait complete. 2020-10-31T22:48:55.296 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-10-31T22:48:55.302 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:48:55.317 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:48:55.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb44a4ee700 1 Processor -- start 2020-10-31T22:48:55.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb44a4ee700 1 -- start start 2020-10-31T22:48:55.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb44a4ee700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb4440b5570 0x7fb4440b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:55.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb44a4ee700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb444145180 con 0x7fb444141fe0 2020-10-31T22:48:55.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb44a4ee700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4440b0670 con 0x7fb4440b24a0 2020-10-31T22:48:55.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb44a4ee700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4440afae0 con 0x7fb4440b5570 2020-10-31T22:48:55.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb449ced700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb444141fe0 0x7fb444142490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51264/0 (socket says 172.21.15.60:51264) 2020-10-31T22:48:55.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb4494ec700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb4440b5570 0x7fb4440b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:55.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb449ced700 1 -- 172.21.15.60:0/3547635445 learned_addr learned my addr 172.21.15.60:0/3547635445 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:55.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb437fff700 1 -- 172.21.15.60:0/3547635445 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380889856 0 0) 0x7fb444145180 con 0x7fb444141fe0 2020-10-31T22:48:55.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb437fff700 1 -- 172.21.15.60:0/3547635445 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb428003230 con 0x7fb444141fe0 2020-10-31T22:48:55.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb4494ec700 1 -- 172.21.15.60:0/3547635445 >> v1:172.21.15.66:6789/0 conn(0x7fb4440b24a0 legacy=0x7fb444145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:55.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb437fff700 1 -- 172.21.15.60:0/3547635445 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307436360 0 0) 0x7fb4440b0670 con 0x7fb4440b24a0 2020-10-31T22:48:55.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb4494ec700 1 -- 172.21.15.60:0/3547635445 >> v1:172.21.15.60:6789/0 conn(0x7fb444141fe0 legacy=0x7fb444142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:55.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.417+0000 7fb4494ec700 1 -- 172.21.15.60:0/3547635445 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4440b0910 con 0x7fb4440b5570 2020-10-31T22:48:55.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.421+0000 7fb4494ec700 1 --2- 172.21.15.60:0/3547635445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4440b5570 0x7fb4440b5950 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7fb44405f580 tx=0x7fb438006dc0).ready entity=mon.0 client_cookie=1b5ab531d2f1542a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:55.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.421+0000 7fb437fff700 1 -- 172.21.15.60:0/3547635445 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb4380097c0 con 0x7fb4440b5570 2020-10-31T22:48:55.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.421+0000 7fb437fff700 1 -- 172.21.15.60:0/3547635445 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb438009920 con 0x7fb4440b5570 2020-10-31T22:48:55.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.421+0000 7fb44a4ee700 1 -- 172.21.15.60:0/3547635445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4440b5570 msgr2=0x7fb4440b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:55.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.421+0000 7fb437fff700 1 -- 172.21.15.60:0/3547635445 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb438009c80 con 0x7fb4440b5570 2020-10-31T22:48:55.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.421+0000 7fb44a4ee700 1 --2- 172.21.15.60:0/3547635445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4440b5570 0x7fb4440b5950 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 rx=0x7fb44405f580 tx=0x7fb438006dc0).stop 2020-10-31T22:48:55.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.421+0000 7fb44a4ee700 1 -- 172.21.15.60:0/3547635445 shutdown_connections 2020-10-31T22:48:55.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.421+0000 7fb44a4ee700 1 --2- 172.21.15.60:0/3547635445 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb4440b5570 0x7fb4440b5950 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.421+0000 7fb44a4ee700 1 -- 172.21.15.60:0/3547635445 >> 172.21.15.60:0/3547635445 conn(0x7fb4440b8e90 msgr2=0x7fb4440b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.421+0000 7fb44a4ee700 1 -- 172.21.15.60:0/3547635445 shutdown_connections 2020-10-31T22:48:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.421+0000 7fb44a4ee700 1 -- 172.21.15.60:0/3547635445 wait complete. 2020-10-31T22:48:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.421+0000 7fb44a4ee700 1 Processor -- start 2020-10-31T22:48:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.421+0000 7fb44a4ee700 1 -- start start 2020-10-31T22:48:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb44a4ee700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4440b24a0 0x7fb444143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:55.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb44a4ee700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4440b5570 0x7fb444150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:55.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb44a4ee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb444141fe0 0x7fb444151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:55.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb44a4ee700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4441470b0 con 0x7fb444141fe0 2020-10-31T22:48:55.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb44a4ee700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4440b8150 con 0x7fb4440b24a0 2020-10-31T22:48:55.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb44a4ee700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4440b7eb0 con 0x7fb4440b5570 2020-10-31T22:48:55.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb449ced700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb444141fe0 0x7fb444151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:55.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb449ced700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb444141fe0 0x7fb444151380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47134/0 (socket says 172.21.15.60:47134) 2020-10-31T22:48:55.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb449ced700 1 -- 172.21.15.60:0/1393224986 learned_addr learned my addr 172.21.15.60:0/1393224986 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:55.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb4494ec700 1 --2- 172.21.15.60:0/1393224986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4440b24a0 0x7fb444143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:55.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb448ceb700 1 --2- 172.21.15.60:0/1393224986 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4440b5570 0x7fb444150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:55.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb449ced700 1 -- 172.21.15.60:0/1393224986 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4440b5570 msgr2=0x7fb444150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:55.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb449ced700 1 --2- 172.21.15.60:0/1393224986 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4440b5570 0x7fb444150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb449ced700 1 -- 172.21.15.60:0/1393224986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4440b24a0 msgr2=0x7fb444143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:55.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb449ced700 1 --2- 172.21.15.60:0/1393224986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4440b24a0 0x7fb444143800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb449ced700 1 -- 172.21.15.60:0/1393224986 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4441509f0 con 0x7fb444141fe0 2020-10-31T22:48:55.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb449ced700 1 --2- 172.21.15.60:0/1393224986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb444141fe0 0x7fb444151380 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7fb43c001450 tx=0x7fb43c007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:55.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb4367fc700 1 -- 172.21.15.60:0/1393224986 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43c00ce10 con 0x7fb444141fe0 2020-10-31T22:48:55.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb4367fc700 1 -- 172.21.15.60:0/1393224986 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb43c005b70 con 0x7fb444141fe0 2020-10-31T22:48:55.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb44a4ee700 1 -- 172.21.15.60:0/1393224986 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4441442e0 con 0x7fb444141fe0 2020-10-31T22:48:55.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb4367fc700 1 -- 172.21.15.60:0/1393224986 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb43c007110 con 0x7fb444141fe0 2020-10-31T22:48:55.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb44a4ee700 1 -- 172.21.15.60:0/1393224986 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4440b70f0 con 0x7fb444141fe0 2020-10-31T22:48:55.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb44a4ee700 1 -- 172.21.15.60:0/1393224986 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb444150820 con 0x7fb444141fe0 2020-10-31T22:48:55.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb4367fc700 1 -- 172.21.15.60:0/1393224986 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb43c010030 con 0x7fb444141fe0 2020-10-31T22:48:55.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.425+0000 7fb4367fc700 1 --2- 172.21.15.60:0/1393224986 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb42c054f10 0x7fb42c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:55.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.429+0000 7fb4367fc700 1 -- 172.21.15.60:0/1393224986 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb43c06d930 con 0x7fb444141fe0 2020-10-31T22:48:55.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.429+0000 7fb4494ec700 1 --2- 172.21.15.60:0/1393224986 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb42c054f10 0x7fb42c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:55.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.429+0000 7fb4494ec700 1 --2- 172.21.15.60:0/1393224986 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb42c054f10 0x7fb42c0573d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fb438019000 tx=0x7fb438015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:55.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.437+0000 7fb4367fc700 1 -- 172.21.15.60:0/1393224986 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb43c043e00 con 0x7fb444141fe0 2020-10-31T22:48:55.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.629+0000 7fb44a4ee700 1 -- 172.21.15.60:0/1393224986 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb444150b80 con 0x7fb444141fe0 2020-10-31T22:48:55.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.629+0000 7fb4367fc700 1 -- 172.21.15.60:0/1393224986 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+2127 (secure 0 0 0) 0x7fb43c047420 con 0x7fb444141fe0 2020-10-31T22:48:55.635 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:55.635 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":48,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6822,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6835/458791799","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":458791799},{"type":"v1","addr":"172.21.15.60:6835","nonce":458791799}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":45},{"gid":6825,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/332317680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":332317680},{"type":"v1","addr":"172.21.15.60:6837","nonce":332317680}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:48:39.857912+0000","modified":"2020-10-31T22:48:55.275170+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2020-10-31T22:48:55.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.629+0000 7fb44a4ee700 1 -- 172.21.15.60:0/1393224986 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb42c054f10 msgr2=0x7fb42c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:55.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.629+0000 7fb44a4ee700 1 --2- 172.21.15.60:0/1393224986 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb42c054f10 0x7fb42c0573d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fb438019000 tx=0x7fb438015000).stop 2020-10-31T22:48:55.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.629+0000 7fb44a4ee700 1 -- 172.21.15.60:0/1393224986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb444141fe0 msgr2=0x7fb444151380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:55.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.629+0000 7fb44a4ee700 1 --2- 172.21.15.60:0/1393224986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb444141fe0 0x7fb444151380 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 rx=0x7fb43c001450 tx=0x7fb43c007d30).stop 2020-10-31T22:48:55.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.629+0000 7fb44a4ee700 1 -- 172.21.15.60:0/1393224986 shutdown_connections 2020-10-31T22:48:55.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.629+0000 7fb44a4ee700 1 --2- 172.21.15.60:0/1393224986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb444141fe0 0x7fb444151380 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.629+0000 7fb44a4ee700 1 --2- 172.21.15.60:0/1393224986 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb42c054f10 0x7fb42c0573d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.629+0000 7fb44a4ee700 1 --2- 172.21.15.60:0/1393224986 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4440b24a0 0x7fb444143800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.629+0000 7fb44a4ee700 1 --2- 172.21.15.60:0/1393224986 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4440b5570 0x7fb444150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.629+0000 7fb44a4ee700 1 -- 172.21.15.60:0/1393224986 >> 172.21.15.60:0/1393224986 conn(0x7fb4440b8e90 msgr2=0x7fb4440b3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:55.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.629+0000 7fb44a4ee700 1 -- 172.21.15.60:0/1393224986 shutdown_connections 2020-10-31T22:48:55.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.629+0000 7fb44a4ee700 1 -- 172.21.15.60:0/1393224986 wait complete. 2020-10-31T22:48:55.645 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 48 2020-10-31T22:48:55.648 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:48:55.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72affff700 1 Processor -- start 2020-10-31T22:48:55.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72affff700 1 -- start start 2020-10-31T22:48:55.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72affff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f72b00631c0 0x7f72b00b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:55.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72affff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f72b00ae740 0x7f72b00ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:55.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72affff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b00b03b0 con 0x7f72b00a9130 2020-10-31T22:48:55.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72affff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b00b15e0 con 0x7f72b00631c0 2020-10-31T22:48:55.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72affff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b00635a0 con 0x7f72b00ae740 2020-10-31T22:48:55.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72aeffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f72b00631c0 0x7f72b00b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:55.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72aeffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f72b00631c0 0x7f72b00b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47138/0 (socket says 172.21.15.60:47138) 2020-10-31T22:48:55.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72aeffd700 1 -- 172.21.15.60:0/1248018432 learned_addr learned my addr 172.21.15.60:0/1248018432 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:55.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72a67fc700 1 --1- 172.21.15.60:0/1248018432 >> v1:172.21.15.60:6789/0 conn(0x7f72b00a9130 0x7f72b0143010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51276/0 (socket says 172.21.15.60:51276) 2020-10-31T22:48:55.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72af7fe700 1 --2- 172.21.15.60:0/1248018432 >> v2:172.21.15.66:3300/0 conn(0x7f72b00ae740 0x7f72b00ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:55.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72aeffd700 1 -- 172.21.15.60:0/1248018432 >> v2:172.21.15.66:3300/0 conn(0x7f72b00ae740 msgr2=0x7f72b00ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:55.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72aeffd700 1 --2- 172.21.15.60:0/1248018432 >> v2:172.21.15.66:3300/0 conn(0x7f72b00ae740 0x7f72b00ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72aeffd700 1 -- 172.21.15.60:0/1248018432 >> v1:172.21.15.60:6789/0 conn(0x7f72b00a9130 legacy=0x7f72b0143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:55.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72aeffd700 1 -- 172.21.15.60:0/1248018432 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00af2c0 con 0x7f72b00631c0 2020-10-31T22:48:55.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72ae7fc700 1 -- 172.21.15.60:0/1248018432 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150906612 0 0) 0x7f72b00b03b0 con 0x7f72b00a9130 2020-10-31T22:48:55.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72aeffd700 1 --2- 172.21.15.60:0/1248018432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b00631c0 0x7f72b00b1d90 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f72a0002f30 tx=0x7f72a0006e80).ready entity=mon.0 client_cookie=38c16a1de136c430 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:55.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72ae7fc700 1 -- 172.21.15.60:0/1248018432 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a00099e0 con 0x7f72b00631c0 2020-10-31T22:48:55.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72ae7fc700 1 -- 172.21.15.60:0/1248018432 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a0009b40 con 0x7f72b00631c0 2020-10-31T22:48:55.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72ae7fc700 1 -- 172.21.15.60:0/1248018432 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a0009ea0 con 0x7f72b00631c0 2020-10-31T22:48:55.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72affff700 1 -- 172.21.15.60:0/1248018432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b00631c0 msgr2=0x7f72b00b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:55.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.765+0000 7f72affff700 1 --2- 172.21.15.60:0/1248018432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b00631c0 0x7f72b00b1d90 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 rx=0x7f72a0002f30 tx=0x7f72a0006e80).stop 2020-10-31T22:48:55.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.769+0000 7f72affff700 1 -- 172.21.15.60:0/1248018432 shutdown_connections 2020-10-31T22:48:55.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.769+0000 7f72affff700 1 --2- 172.21.15.60:0/1248018432 >> v2:172.21.15.66:3300/0 conn(0x7f72b00ae740 0x7f72b00ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.769+0000 7f72affff700 1 --2- 172.21.15.60:0/1248018432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b00631c0 0x7f72b00b1d90 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.769+0000 7f72affff700 1 -- 172.21.15.60:0/1248018432 >> 172.21.15.60:0/1248018432 conn(0x7f72b006a600 msgr2=0x7f72b0060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:55.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.769+0000 7f72affff700 1 -- 172.21.15.60:0/1248018432 shutdown_connections 2020-10-31T22:48:55.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.769+0000 7f72affff700 1 -- 172.21.15.60:0/1248018432 wait complete. 2020-10-31T22:48:55.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.769+0000 7f72affff700 1 Processor -- start 2020-10-31T22:48:55.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.769+0000 7f72affff700 1 -- start start 2020-10-31T22:48:55.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72affff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72b00631c0 0x7f72b013c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:55.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72affff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b00a9130 0x7f72b0139260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:55.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72affff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b00ae740 0x7f72b0139750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:55.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72affff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b0063f20 con 0x7f72b00a9130 2020-10-31T22:48:55.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72affff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b00641c0 con 0x7f72b00ae740 2020-10-31T22:48:55.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72affff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b0064460 con 0x7f72b00631c0 2020-10-31T22:48:55.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72a67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b00a9130 0x7f72b0139260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:55.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72a67fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b00a9130 0x7f72b0139260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47146/0 (socket says 172.21.15.60:47146) 2020-10-31T22:48:55.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72aeffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72b00631c0 0x7f72b013c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:55.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72a67fc700 1 -- 172.21.15.60:0/1323391671 learned_addr learned my addr 172.21.15.60:0/1323391671 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:55.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72af7fe700 1 --2- 172.21.15.60:0/1323391671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b00ae740 0x7f72b0139750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:55.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72aeffd700 1 -- 172.21.15.60:0/1323391671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b00ae740 msgr2=0x7f72b0139750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:55.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72aeffd700 1 --2- 172.21.15.60:0/1323391671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b00ae740 0x7f72b0139750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72aeffd700 1 -- 172.21.15.60:0/1323391671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b00a9130 msgr2=0x7f72b0139260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:55.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72aeffd700 1 --2- 172.21.15.60:0/1323391671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b00a9130 0x7f72b0139260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:55.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72aeffd700 1 -- 172.21.15.60:0/1323391671 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00b2d50 con 0x7f72b00631c0 2020-10-31T22:48:55.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72a67fc700 1 --2- 172.21.15.60:0/1323391671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b00a9130 0x7f72b0139260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:55.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72aeffd700 1 --2- 172.21.15.60:0/1323391671 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72b00631c0 0x7f72b013c570 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f72a0002f30 tx=0x7f72a0017000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:55.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72acff9700 1 -- 172.21.15.60:0/1323391671 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a00119d0 con 0x7f72b00631c0 2020-10-31T22:48:55.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72acff9700 1 -- 172.21.15.60:0/1323391671 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a0011b30 con 0x7f72b00631c0 2020-10-31T22:48:55.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72affff700 1 -- 172.21.15.60:0/1323391671 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b00b4680 con 0x7f72b00631c0 2020-10-31T22:48:55.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72acff9700 1 -- 172.21.15.60:0/1323391671 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f72a0011e90 con 0x7f72b00631c0 2020-10-31T22:48:55.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.773+0000 7f72affff700 1 -- 172.21.15.60:0/1323391671 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b0063ba0 con 0x7f72b00631c0 2020-10-31T22:48:55.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.777+0000 7f72affff700 1 -- 172.21.15.60:0/1323391671 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b005d020 con 0x7f72b00631c0 2020-10-31T22:48:55.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.777+0000 7f72acff9700 1 -- 172.21.15.60:0/1323391671 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f72a002b070 con 0x7f72b00631c0 2020-10-31T22:48:55.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.777+0000 7f72acff9700 1 --2- 172.21.15.60:0/1323391671 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7294055020 0x7f72940574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:55.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.777+0000 7f72acff9700 1 -- 172.21.15.60:0/1323391671 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f72a0072450 con 0x7f72b00631c0 2020-10-31T22:48:55.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.777+0000 7f72a67fc700 1 --2- 172.21.15.60:0/1323391671 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7294055020 0x7f72940574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:55.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.777+0000 7f72a67fc700 1 --2- 172.21.15.60:0/1323391671 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7294055020 0x7f72940574e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f729800d000 tx=0x7f7298007a00).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:55.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.785+0000 7f72acff9700 1 -- 172.21.15.60:0/1323391671 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f72a0048880 con 0x7f72b00631c0 2020-10-31T22:48:55.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:55.977+0000 7f72affff700 1 -- 172.21.15.60:0/1323391671 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f72b0057100 con 0x7f72b00631c0 2020-10-31T22:48:56.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.281+0000 7f72acff9700 1 -- 172.21.15.60:0/1323391671 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7f72a004bea0 con 0x7f72b00631c0 2020-10-31T22:48:56.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.285+0000 7f72affff700 1 -- 172.21.15.60:0/1323391671 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7294055020 msgr2=0x7f72940574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:56.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.285+0000 7f72affff700 1 --2- 172.21.15.60:0/1323391671 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7294055020 0x7f72940574e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f729800d000 tx=0x7f7298007a00).stop 2020-10-31T22:48:56.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.285+0000 7f72affff700 1 -- 172.21.15.60:0/1323391671 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72b00631c0 msgr2=0x7f72b013c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:56.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.285+0000 7f72affff700 1 --2- 172.21.15.60:0/1323391671 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72b00631c0 0x7f72b013c570 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f72a0002f30 tx=0x7f72a0017000).stop 2020-10-31T22:48:56.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.285+0000 7f72affff700 1 -- 172.21.15.60:0/1323391671 shutdown_connections 2020-10-31T22:48:56.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.285+0000 7f72affff700 1 --2- 172.21.15.60:0/1323391671 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7294055020 0x7f72940574e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:56.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.285+0000 7f72affff700 1 --2- 172.21.15.60:0/1323391671 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72b00ae740 0x7f72b0139750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:56.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.285+0000 7f72affff700 1 --2- 172.21.15.60:0/1323391671 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f72b00631c0 0x7f72b013c570 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:56.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.285+0000 7f72affff700 1 --2- 172.21.15.60:0/1323391671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f72b00a9130 0x7f72b0139260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:56.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.285+0000 7f72affff700 1 -- 172.21.15.60:0/1323391671 >> 172.21.15.60:0/1323391671 conn(0x7f72b006a600 msgr2=0x7f72b013e480 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:56.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.285+0000 7f72affff700 1 -- 172.21.15.60:0/1323391671 shutdown_connections 2020-10-31T22:48:56.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.285+0000 7f72affff700 1 -- 172.21.15.60:0/1323391671 wait complete. 2020-10-31T22:48:56.308 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:48:56.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.433+0000 7f9a251da700 1 Processor -- start 2020-10-31T22:48:56.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a251da700 1 -- start start 2020-10-31T22:48:56.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a251da700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9a200abf70 0x7f9a200afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:56.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a251da700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a200b0390 con 0x7f9a200ae740 2020-10-31T22:48:56.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a251da700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a20063520 con 0x7f9a20063140 2020-10-31T22:48:56.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a251da700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a200a9070 con 0x7f9a200abf70 2020-10-31T22:48:56.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a177fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9a200ae740 0x7f9a200ab860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51288/0 (socket says 172.21.15.60:51288) 2020-10-31T22:48:56.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a177fe700 1 -- 172.21.15.60:0/3794232139 learned_addr learned my addr 172.21.15.60:0/3794232139 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:56.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a249d9700 1 --2- 172.21.15.60:0/3794232139 >> v2:172.21.15.60:3300/0 conn(0x7f9a200abf70 0x7f9a200afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:56.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a1f7fe700 1 -- 172.21.15.60:0/3794232139 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789529679 0 0) 0x7f9a200b0390 con 0x7f9a200ae740 2020-10-31T22:48:56.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a1f7fe700 1 -- 172.21.15.60:0/3794232139 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a00003230 con 0x7f9a200ae740 2020-10-31T22:48:56.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a1f7fe700 1 -- 172.21.15.60:0/3794232139 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 496378172 0 0) 0x7f9a00003230 con 0x7f9a200ae740 2020-10-31T22:48:56.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a249d9700 1 -- 172.21.15.60:0/3794232139 >> v1:172.21.15.66:6789/0 conn(0x7f9a20063140 legacy=0x7f9a200aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:56.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a249d9700 1 -- 172.21.15.60:0/3794232139 >> v1:172.21.15.60:6789/0 conn(0x7f9a200ae740 legacy=0x7f9a200ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:56.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a249d9700 1 -- 172.21.15.60:0/3794232139 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a200a9310 con 0x7f9a200abf70 2020-10-31T22:48:56.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a249d9700 1 --2- 172.21.15.60:0/3794232139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a200abf70 0x7f9a200afea0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f9a08001870 tx=0x7f9a180091a0).ready entity=mon.0 client_cookie=92af8213364df625 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:56.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a1f7fe700 1 -- 172.21.15.60:0/3794232139 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a080016d0 con 0x7f9a200abf70 2020-10-31T22:48:56.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a1f7fe700 1 -- 172.21.15.60:0/3794232139 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1800b860 con 0x7f9a200abf70 2020-10-31T22:48:56.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a1f7fe700 1 -- 172.21.15.60:0/3794232139 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a1800b9d0 con 0x7f9a200abf70 2020-10-31T22:48:56.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a251da700 1 -- 172.21.15.60:0/3794232139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a200abf70 msgr2=0x7f9a200afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:56.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a251da700 1 --2- 172.21.15.60:0/3794232139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a200abf70 0x7f9a200afea0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 rx=0x7f9a08001870 tx=0x7f9a180091a0).stop 2020-10-31T22:48:56.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a251da700 1 -- 172.21.15.60:0/3794232139 shutdown_connections 2020-10-31T22:48:56.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a251da700 1 --2- 172.21.15.60:0/3794232139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a200abf70 0x7f9a200afea0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:56.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a251da700 1 -- 172.21.15.60:0/3794232139 >> 172.21.15.60:0/3794232139 conn(0x7f9a2006a600 msgr2=0x7f9a20060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:56.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a251da700 1 -- 172.21.15.60:0/3794232139 shutdown_connections 2020-10-31T22:48:56.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a251da700 1 -- 172.21.15.60:0/3794232139 wait complete. 2020-10-31T22:48:56.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.437+0000 7f9a251da700 1 Processor -- start 2020-10-31T22:48:56.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a251da700 1 -- start start 2020-10-31T22:48:56.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a251da700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a20063140 0x7f9a200649b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:56.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a251da700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a200abf70 0x7f9a20066270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:56.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a251da700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a200ae740 0x7f9a2014ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:56.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a251da700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2013b310 con 0x7f9a200ae740 2020-10-31T22:48:56.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a251da700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2009df30 con 0x7f9a20063140 2020-10-31T22:48:56.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a251da700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a20066760 con 0x7f9a200abf70 2020-10-31T22:48:56.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a249d9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a200ae740 0x7f9a2014ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:56.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a1ffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a20063140 0x7f9a200649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:56.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a249d9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a200ae740 0x7f9a2014ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47162/0 (socket says 172.21.15.60:47162) 2020-10-31T22:48:56.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a249d9700 1 -- 172.21.15.60:0/3398624467 learned_addr learned my addr 172.21.15.60:0/3398624467 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:56.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a177fe700 1 --2- 172.21.15.60:0/3398624467 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a200abf70 0x7f9a20066270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a1ffff700 1 -- 172.21.15.60:0/3398624467 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a200abf70 msgr2=0x7f9a20066270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a1ffff700 1 --2- 172.21.15.60:0/3398624467 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a200abf70 0x7f9a20066270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a1ffff700 1 -- 172.21.15.60:0/3398624467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a200ae740 msgr2=0x7f9a2014ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a1ffff700 1 --2- 172.21.15.60:0/3398624467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a200ae740 0x7f9a2014ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a1ffff700 1 -- 172.21.15.60:0/3398624467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2009e160 con 0x7f9a20063140 2020-10-31T22:48:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a249d9700 1 --2- 172.21.15.60:0/3398624467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a200ae740 0x7f9a2014ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:48:56.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a1ffff700 1 --2- 172.21.15.60:0/3398624467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a20063140 0x7f9a200649b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f9a10001190 tx=0x7f9a10007a30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a1dffb700 1 -- 172.21.15.60:0/3398624467 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a1000e4a0 con 0x7f9a20063140 2020-10-31T22:48:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a251da700 1 -- 172.21.15.60:0/3398624467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2009e400 con 0x7f9a20063140 2020-10-31T22:48:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a1dffb700 1 -- 172.21.15.60:0/3398624467 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1000e600 con 0x7f9a20063140 2020-10-31T22:48:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a1dffb700 1 -- 172.21.15.60:0/3398624467 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a1000e960 con 0x7f9a20063140 2020-10-31T22:48:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a251da700 1 -- 172.21.15.60:0/3398624467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2009e7c0 con 0x7f9a20063140 2020-10-31T22:48:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a251da700 1 -- 172.21.15.60:0/3398624467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a200673b0 con 0x7f9a20063140 2020-10-31T22:48:56.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.441+0000 7f9a1dffb700 1 -- 172.21.15.60:0/3398624467 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9a10019030 con 0x7f9a20063140 2020-10-31T22:48:56.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.445+0000 7f9a1dffb700 1 --2- 172.21.15.60:0/3398624467 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a04054f10 0x7f9a040573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:56.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.445+0000 7f9a1dffb700 1 -- 172.21.15.60:0/3398624467 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9a1006ce20 con 0x7f9a20063140 2020-10-31T22:48:56.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.445+0000 7f9a177fe700 1 --2- 172.21.15.60:0/3398624467 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a04054f10 0x7f9a040573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:56.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.445+0000 7f9a177fe700 1 --2- 172.21.15.60:0/3398624467 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a04054f10 0x7f9a040573d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f9a0800d000 tx=0x7f9a08000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:56.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.453+0000 7f9a1dffb700 1 -- 172.21.15.60:0/3398624467 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9a10041df0 con 0x7f9a20063140 2020-10-31T22:48:56.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:56.601+0000 7f9a251da700 1 -- 172.21.15.60:0/3398624467 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9a2014ecb0 con 0x7f9a20063140 2020-10-31T22:48:57.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.325+0000 7f9a1dffb700 1 -- 172.21.15.60:0/3398624467 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v101) v1 ==== 185+0+0 (secure 0 0 0) 0x7f9a200673b0 con 0x7f9a20063140 2020-10-31T22:48:57.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.329+0000 7f9a251da700 1 -- 172.21.15.60:0/3398624467 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a04054f10 msgr2=0x7f9a040573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:57.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.329+0000 7f9a251da700 1 --2- 172.21.15.60:0/3398624467 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a04054f10 0x7f9a040573d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f9a0800d000 tx=0x7f9a08000b80).stop 2020-10-31T22:48:57.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.329+0000 7f9a251da700 1 -- 172.21.15.60:0/3398624467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a20063140 msgr2=0x7f9a200649b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:57.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.329+0000 7f9a251da700 1 --2- 172.21.15.60:0/3398624467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a20063140 0x7f9a200649b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f9a10001190 tx=0x7f9a10007a30).stop 2020-10-31T22:48:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.329+0000 7f9a251da700 1 -- 172.21.15.60:0/3398624467 shutdown_connections 2020-10-31T22:48:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.329+0000 7f9a251da700 1 --2- 172.21.15.60:0/3398624467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a200ae740 0x7f9a2014ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.329+0000 7f9a251da700 1 --2- 172.21.15.60:0/3398624467 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a04054f10 0x7f9a040573d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.329+0000 7f9a251da700 1 --2- 172.21.15.60:0/3398624467 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a20063140 0x7f9a200649b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:57.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.329+0000 7f9a251da700 1 --2- 172.21.15.60:0/3398624467 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a200abf70 0x7f9a20066270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:57.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.329+0000 7f9a251da700 1 -- 172.21.15.60:0/3398624467 >> 172.21.15.60:0/3398624467 conn(0x7f9a2006a600 msgr2=0x7f9a200ab630 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:57.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.329+0000 7f9a251da700 1 -- 172.21.15.60:0/3398624467 shutdown_connections 2020-10-31T22:48:57.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.329+0000 7f9a251da700 1 -- 172.21.15.60:0/3398624467 wait complete. 2020-10-31T22:48:57.340 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:48:57.355 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-10-31T22:48:57.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 Processor -- start 2020-10-31T22:48:57.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 -- start start 2020-10-31T22:48:57.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f922c0ac870 0x7f922c146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:57.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f922c146550 0x7f922c150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:57.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f922c0af900 con 0x7f922c0af520 2020-10-31T22:48:57.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922c0afc10 con 0x7f922c146550 2020-10-31T22:48:57.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f922c05bb70 con 0x7f922c0ac870 2020-10-31T22:48:57.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232493700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f922c146550 0x7f922c150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:57.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9231c92700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f922c0af520 0x7f922c066c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51302/0 (socket says 172.21.15.60:51302) 2020-10-31T22:48:57.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9231c92700 1 -- 172.21.15.60:0/264155590 learned_addr learned my addr 172.21.15.60:0/264155590 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:48:57.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9231491700 1 --2- 172.21.15.60:0/264155590 >> v2:172.21.15.66:3300/0 conn(0x7f922c0ac870 0x7f922c146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:57.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232493700 1 -- 172.21.15.60:0/264155590 >> v2:172.21.15.66:3300/0 conn(0x7f922c0ac870 msgr2=0x7f922c146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:57.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232493700 1 --2- 172.21.15.60:0/264155590 >> v2:172.21.15.66:3300/0 conn(0x7f922c0ac870 0x7f922c146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:57.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232493700 1 -- 172.21.15.60:0/264155590 >> v1:172.21.15.60:6789/0 conn(0x7f922c0af520 legacy=0x7f922c066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:57.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9230c90700 1 -- 172.21.15.60:0/264155590 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833118596 0 0) 0x7f922c0af900 con 0x7f922c0af520 2020-10-31T22:48:57.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232493700 1 -- 172.21.15.60:0/264155590 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c0ac130 con 0x7f922c146550 2020-10-31T22:48:57.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9231491700 1 --2- 172.21.15.60:0/264155590 >> v2:172.21.15.66:3300/0 conn(0x7f922c0ac870 0x7f922c146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:57.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232493700 1 --2- 172.21.15.60:0/264155590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f922c146550 0x7f922c150980 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f92240032b0 tx=0x7f92240091a0).ready entity=mon.0 client_cookie=6c5268d6fb7a0a81 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:57.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9230c90700 1 -- 172.21.15.60:0/264155590 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f922400ba50 con 0x7f922c146550 2020-10-31T22:48:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9230c90700 1 -- 172.21.15.60:0/264155590 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f922400bbb0 con 0x7f922c146550 2020-10-31T22:48:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9230c90700 1 -- 172.21.15.60:0/264155590 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f922400bd20 con 0x7f922c146550 2020-10-31T22:48:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 -- 172.21.15.60:0/264155590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f922c146550 msgr2=0x7f922c150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 --2- 172.21.15.60:0/264155590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f922c146550 0x7f922c150980 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 rx=0x7f92240032b0 tx=0x7f92240091a0).stop 2020-10-31T22:48:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 -- 172.21.15.60:0/264155590 shutdown_connections 2020-10-31T22:48:57.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 --2- 172.21.15.60:0/264155590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f922c146550 0x7f922c150980 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:57.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 --2- 172.21.15.60:0/264155590 >> v2:172.21.15.66:3300/0 conn(0x7f922c0ac870 0x7f922c146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:57.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 -- 172.21.15.60:0/264155590 >> 172.21.15.60:0/264155590 conn(0x7f922c0b3fd0 msgr2=0x7f922c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:57.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 -- 172.21.15.60:0/264155590 shutdown_connections 2020-10-31T22:48:57.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.473+0000 7f9232c94700 1 -- 172.21.15.60:0/264155590 wait complete. 2020-10-31T22:48:57.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9232c94700 1 Processor -- start 2020-10-31T22:48:57.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9232c94700 1 -- start start 2020-10-31T22:48:57.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9232c94700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f922c0ac870 0x7f922c0a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9232c94700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f922c0af520 0x7f922c0a9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9232c94700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f922c146550 0x7f922c141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9232c94700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c0aa9f0 con 0x7f922c0af520 2020-10-31T22:48:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9232c94700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922c1445c0 con 0x7f922c0ac870 2020-10-31T22:48:57.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9232c94700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c148390 con 0x7f922c146550 2020-10-31T22:48:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9231491700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f922c0af520 0x7f922c0a9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9231491700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f922c0af520 0x7f922c0a9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47174/0 (socket says 172.21.15.60:47174) 2020-10-31T22:48:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9231491700 1 -- 172.21.15.60:0/4061151861 learned_addr learned my addr 172.21.15.60:0/4061151861 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9231c92700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f922c0ac870 0x7f922c0a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9232493700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f922c146550 0x7f922c141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:57.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9231491700 1 -- 172.21.15.60:0/4061151861 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f922c146550 msgr2=0x7f922c141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:57.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9231491700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f922c146550 0x7f922c141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:57.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9231491700 1 -- 172.21.15.60:0/4061151861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f922c0ac870 msgr2=0x7f922c0a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:57.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9231491700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f922c0ac870 0x7f922c0a84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:57.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9231491700 1 -- 172.21.15.60:0/4061151861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c148630 con 0x7f922c0af520 2020-10-31T22:48:57.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9231c92700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f922c0ac870 0x7f922c0a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:48:57.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9232493700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f922c146550 0x7f922c141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:48:57.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9231491700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f922c0af520 0x7f922c0a9650 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f9220007000 tx=0x7f9220008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:57.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f921f7fe700 1 -- 172.21.15.60:0/4061151861 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f922000ce90 con 0x7f922c0af520 2020-10-31T22:48:57.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f921f7fe700 1 -- 172.21.15.60:0/4061151861 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9220007750 con 0x7f922c0af520 2020-10-31T22:48:57.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f921f7fe700 1 -- 172.21.15.60:0/4061151861 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9220007ab0 con 0x7f922c0af520 2020-10-31T22:48:57.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9232c94700 1 -- 172.21.15.60:0/4061151861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f922c1488d0 con 0x7f922c0af520 2020-10-31T22:48:57.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9232c94700 1 -- 172.21.15.60:0/4061151861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f922c0a90d0 con 0x7f922c0af520 2020-10-31T22:48:57.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.477+0000 7f9232c94700 1 -- 172.21.15.60:0/4061151861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f922c057100 con 0x7f922c0af520 2020-10-31T22:48:57.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.481+0000 7f921f7fe700 1 -- 172.21.15.60:0/4061151861 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9220007c10 con 0x7f922c0af520 2020-10-31T22:48:57.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.481+0000 7f921f7fe700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9208055020 0x7f92080574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:57.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.481+0000 7f9231c92700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9208055020 0x7f92080574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:57.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.481+0000 7f921f7fe700 1 -- 172.21.15.60:0/4061151861 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f922006da60 con 0x7f922c0af520 2020-10-31T22:48:57.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.481+0000 7f9231c92700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9208055020 0x7f92080574e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f922800b000 tx=0x7f9228009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:57.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.485+0000 7f921f7fe700 1 -- 172.21.15.60:0/4061151861 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9220044080 con 0x7f922c0af520 2020-10-31T22:48:57.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:57.629+0000 7f9232c94700 1 -- 172.21.15.60:0/4061151861 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f922c0b4ea0 con 0x7f922c0af520 2020-10-31T22:48:58.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.337+0000 7f921f7fe700 1 -- 172.21.15.60:0/4061151861 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v102) v1 ==== 173+0+0 (secure 0 0 0) 0x7f92200476a0 con 0x7f922c0af520 2020-10-31T22:48:58.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.341+0000 7f9232c94700 1 -- 172.21.15.60:0/4061151861 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9208055020 msgr2=0x7f92080574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:58.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.341+0000 7f9232c94700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9208055020 0x7f92080574e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f922800b000 tx=0x7f9228009040).stop 2020-10-31T22:48:58.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.341+0000 7f9232c94700 1 -- 172.21.15.60:0/4061151861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f922c0af520 msgr2=0x7f922c0a9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:58.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.341+0000 7f9232c94700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f922c0af520 0x7f922c0a9650 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 rx=0x7f9220007000 tx=0x7f9220008040).stop 2020-10-31T22:48:58.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.341+0000 7f9232c94700 1 -- 172.21.15.60:0/4061151861 shutdown_connections 2020-10-31T22:48:58.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.341+0000 7f9232c94700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f922c146550 0x7f922c141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:58.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.341+0000 7f9232c94700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9208055020 0x7f92080574e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:58.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.341+0000 7f9232c94700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f922c0ac870 0x7f922c0a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:58.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.341+0000 7f9232c94700 1 --2- 172.21.15.60:0/4061151861 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f922c0af520 0x7f922c0a9650 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:58.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.341+0000 7f9232c94700 1 -- 172.21.15.60:0/4061151861 >> 172.21.15.60:0/4061151861 conn(0x7f922c0b3fd0 msgr2=0x7f922c0b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:58.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.341+0000 7f9232c94700 1 -- 172.21.15.60:0/4061151861 shutdown_connections 2020-10-31T22:48:58.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.341+0000 7f9232c94700 1 -- 172.21.15.60:0/4061151861 wait complete. 2020-10-31T22:48:58.350 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2020-10-31T22:48:58.361 INFO:tasks.ceph.mds.a:Restarting daemon 2020-10-31T22:48:58.362 INFO:tasks.ceph.mds.a:Stopping old one... 2020-10-31T22:48:58.362 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-10-31T22:48:58.362 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:48:58.363 INFO:tasks.ceph.mds.c:Restarting daemon 2020-10-31T22:48:58.363 INFO:tasks.ceph.mds.c:Stopping old one... 2020-10-31T22:48:58.363 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-10-31T22:48:58.364 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:48:58.364 INFO:tasks.ceph.mds.b:Restarting daemon 2020-10-31T22:48:58.364 INFO:tasks.ceph.mds.b:Stopping old one... 2020-10-31T22:48:58.365 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-10-31T22:48:58.365 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:48:58.376 INFO:tasks.ceph.mds.a:Stopped 2020-10-31T22:48:58.376 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-10-31T22:48:58.378 INFO:tasks.ceph.mds.b:Stopped 2020-10-31T22:48:58.378 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-10-31T22:48:58.379 INFO:tasks.ceph.mds.c:Stopped 2020-10-31T22:48:58.379 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-10-31T22:48:58.422 INFO:tasks.ceph.mds.b:Started 2020-10-31T22:48:58.423 DEBUG:teuthology.parallel:result is None 2020-10-31T22:48:58.426 INFO:tasks.ceph.mds.a:Started 2020-10-31T22:48:58.427 DEBUG:teuthology.parallel:result is None 2020-10-31T22:48:58.428 INFO:tasks.ceph.mds.c:Started 2020-10-31T22:48:58.429 DEBUG:teuthology.parallel:result is None 2020-10-31T22:48:58.429 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-10-31T22:48:58.499 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:48:58.500 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:48:58.504 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:48:58.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.541+0000 7f56c2555700 1 Processor -- start 2020-10-31T22:48:58.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.541+0000 7f56c2555700 1 -- start start 2020-10-31T22:48:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.541+0000 7f56c2555700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56bc0b1a10 0x7f56bc142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:58.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.541+0000 7f56c2555700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f56bc13ebe0 0x7f56bc0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.541+0000 7f56c2555700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f56bc0af200 0x7f56bc0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.541+0000 7f56c2555700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56bc0abea0 con 0x7f56bc13ebe0 2020-10-31T22:48:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.541+0000 7f56c2555700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56bc141870 con 0x7f56bc0af200 2020-10-31T22:48:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.541+0000 7f56c2555700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc141b10 con 0x7f56bc0b1a10 2020-10-31T22:48:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.541+0000 7f56c0d52700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f56bc13ebe0 0x7f56bc0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:58.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.541+0000 7f56c0d52700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f56bc13ebe0 0x7f56bc0b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47202/0 (socket says 172.21.15.60:47202) 2020-10-31T22:48:58.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.541+0000 7f56c0d52700 1 -- 172.21.15.60:0/1747868433 learned_addr learned my addr 172.21.15.60:0/1747868433 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:58.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.541+0000 7f56c1d54700 1 --2- 172.21.15.60:0/1747868433 >> v2:172.21.15.66:3300/0 conn(0x7f56bc0af200 0x7f56bc0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:58.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c1553700 1 --2- 172.21.15.60:0/1747868433 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56bc0b1a10 0x7f56bc142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:58.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c0d52700 1 -- 172.21.15.60:0/1747868433 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56bc0b1a10 msgr2=0x7f56bc142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:58.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c0d52700 1 --2- 172.21.15.60:0/1747868433 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56bc0b1a10 0x7f56bc142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:58.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c0d52700 1 -- 172.21.15.60:0/1747868433 >> v2:172.21.15.66:3300/0 conn(0x7f56bc0af200 msgr2=0x7f56bc0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:58.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c0d52700 1 --2- 172.21.15.60:0/1747868433 >> v2:172.21.15.66:3300/0 conn(0x7f56bc0af200 0x7f56bc0afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:58.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c0d52700 1 -- 172.21.15.60:0/1747868433 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc141db0 con 0x7f56bc13ebe0 2020-10-31T22:48:58.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c0d52700 1 --2- 172.21.15.60:0/1747868433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56bc13ebe0 0x7f56bc0b1df0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f56b8002f30 tx=0x7f56b8006e80).ready entity=mon.0 client_cookie=cdc9d1464270b3cf server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:58.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56affff700 1 -- 172.21.15.60:0/1747868433 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b8009640 con 0x7f56bc13ebe0 2020-10-31T22:48:58.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56affff700 1 -- 172.21.15.60:0/1747868433 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b80097a0 con 0x7f56bc13ebe0 2020-10-31T22:48:58.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56affff700 1 -- 172.21.15.60:0/1747868433 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b8009b00 con 0x7f56bc13ebe0 2020-10-31T22:48:58.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c2555700 1 -- 172.21.15.60:0/1747868433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56bc13ebe0 msgr2=0x7f56bc0b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:58.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c2555700 1 --2- 172.21.15.60:0/1747868433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56bc13ebe0 0x7f56bc0b1df0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 rx=0x7f56b8002f30 tx=0x7f56b8006e80).stop 2020-10-31T22:48:58.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c2555700 1 -- 172.21.15.60:0/1747868433 shutdown_connections 2020-10-31T22:48:58.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c2555700 1 --2- 172.21.15.60:0/1747868433 >> v2:172.21.15.66:3300/0 conn(0x7f56bc0af200 0x7f56bc0afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:58.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c2555700 1 --2- 172.21.15.60:0/1747868433 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56bc0b1a10 0x7f56bc142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:58.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c2555700 1 --2- 172.21.15.60:0/1747868433 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56bc13ebe0 0x7f56bc0b1df0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:58.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c2555700 1 -- 172.21.15.60:0/1747868433 >> 172.21.15.60:0/1747868433 conn(0x7f56bc0b5300 msgr2=0x7f56bc0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:58.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c2555700 1 -- 172.21.15.60:0/1747868433 shutdown_connections 2020-10-31T22:48:58.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c2555700 1 -- 172.21.15.60:0/1747868433 wait complete. 2020-10-31T22:48:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c2555700 1 Processor -- start 2020-10-31T22:48:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.545+0000 7f56c2555700 1 -- start start 2020-10-31T22:48:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c2555700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56bc0af200 0x7f56bc150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c2555700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56bc0b1a10 0x7f56bc13a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c2555700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56bc13ebe0 0x7f56bc0aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:58.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c2555700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc140bd0 con 0x7f56bc13ebe0 2020-10-31T22:48:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c2555700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc13f8d0 con 0x7f56bc0af200 2020-10-31T22:48:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c2555700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc13fb70 con 0x7f56bc0b1a10 2020-10-31T22:48:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c1d54700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56bc13ebe0 0x7f56bc0aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c1d54700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56bc13ebe0 0x7f56bc0aae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47210/0 (socket says 172.21.15.60:47210) 2020-10-31T22:48:58.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c1d54700 1 -- 172.21.15.60:0/2538874564 learned_addr learned my addr 172.21.15.60:0/2538874564 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c0d52700 1 --2- 172.21.15.60:0/2538874564 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56bc0b1a10 0x7f56bc13a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:58.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c1553700 1 --2- 172.21.15.60:0/2538874564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56bc0af200 0x7f56bc150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c1d54700 1 -- 172.21.15.60:0/2538874564 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56bc0b1a10 msgr2=0x7f56bc13a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c1d54700 1 --2- 172.21.15.60:0/2538874564 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56bc0b1a10 0x7f56bc13a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c1d54700 1 -- 172.21.15.60:0/2538874564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56bc0af200 msgr2=0x7f56bc150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c1d54700 1 --2- 172.21.15.60:0/2538874564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56bc0af200 0x7f56bc150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:58.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c1d54700 1 -- 172.21.15.60:0/2538874564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc13fe10 con 0x7f56bc13ebe0 2020-10-31T22:48:58.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c1d54700 1 --2- 172.21.15.60:0/2538874564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56bc13ebe0 0x7f56bc0aae40 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f56b4006dd0 tx=0x7f56b40091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:58.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56ae7fc700 1 -- 172.21.15.60:0/2538874564 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b400ca00 con 0x7f56bc13ebe0 2020-10-31T22:48:58.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56ae7fc700 1 -- 172.21.15.60:0/2538874564 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b400cb60 con 0x7f56bc13ebe0 2020-10-31T22:48:58.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c2555700 1 -- 172.21.15.60:0/2538874564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56bc1400b0 con 0x7f56bc13ebe0 2020-10-31T22:48:58.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56ae7fc700 1 -- 172.21.15.60:0/2538874564 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56b40123f0 con 0x7f56bc13ebe0 2020-10-31T22:48:58.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c2555700 1 -- 172.21.15.60:0/2538874564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56bc1414a0 con 0x7f56bc13ebe0 2020-10-31T22:48:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56c2555700 1 -- 172.21.15.60:0/2538874564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56bc0a84b0 con 0x7f56bc13ebe0 2020-10-31T22:48:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.549+0000 7f56ae7fc700 1 -- 172.21.15.60:0/2538874564 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f56b4022070 con 0x7f56bc13ebe0 2020-10-31T22:48:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.553+0000 7f56ae7fc700 1 --2- 172.21.15.60:0/2538874564 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f569c054f10 0x7f569c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.553+0000 7f56ae7fc700 1 -- 172.21.15.60:0/2538874564 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f56b406df00 con 0x7f56bc13ebe0 2020-10-31T22:48:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.553+0000 7f56c1553700 1 --2- 172.21.15.60:0/2538874564 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f569c054f10 0x7f569c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:58.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.553+0000 7f56c1553700 1 --2- 172.21.15.60:0/2538874564 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f569c054f10 0x7f569c0573d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f56b000b000 tx=0x7f56b0006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:58.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.557+0000 7f56ae7fc700 1 -- 172.21.15.60:0/2538874564 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f56b40445f0 con 0x7f56bc13ebe0 2020-10-31T22:48:58.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:58.713+0000 7f56c2555700 1 -- 172.21.15.60:0/2538874564 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f56bc13f6f0 con 0x7f56bc13ebe0 2020-10-31T22:48:59.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.521+0000 7f56ae7fc700 1 -- 172.21.15.60:0/2538874564 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v105) v1 ==== 97+0+0 (secure 0 0 0) 0x7f56b4016030 con 0x7f56bc13ebe0 2020-10-31T22:48:59.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.521+0000 7f56c2555700 1 -- 172.21.15.60:0/2538874564 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f569c054f10 msgr2=0x7f569c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:59.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.521+0000 7f56c2555700 1 --2- 172.21.15.60:0/2538874564 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f569c054f10 0x7f569c0573d0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f56b000b000 tx=0x7f56b0006dc0).stop 2020-10-31T22:48:59.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.521+0000 7f56c2555700 1 -- 172.21.15.60:0/2538874564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56bc13ebe0 msgr2=0x7f56bc0aae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:59.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.521+0000 7f56c2555700 1 --2- 172.21.15.60:0/2538874564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56bc13ebe0 0x7f56bc0aae40 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 rx=0x7f56b4006dd0 tx=0x7f56b40091a0).stop 2020-10-31T22:48:59.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.525+0000 7f56c2555700 1 -- 172.21.15.60:0/2538874564 shutdown_connections 2020-10-31T22:48:59.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.525+0000 7f56c2555700 1 --2- 172.21.15.60:0/2538874564 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f56bc13ebe0 0x7f56bc0aae40 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:59.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.525+0000 7f56c2555700 1 --2- 172.21.15.60:0/2538874564 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f569c054f10 0x7f569c0573d0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:59.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.525+0000 7f56c2555700 1 --2- 172.21.15.60:0/2538874564 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56bc0af200 0x7f56bc150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:59.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.525+0000 7f56c2555700 1 --2- 172.21.15.60:0/2538874564 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f56bc0b1a10 0x7f56bc13a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:59.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.525+0000 7f56c2555700 1 -- 172.21.15.60:0/2538874564 >> 172.21.15.60:0/2538874564 conn(0x7f56bc0b5300 msgr2=0x7f56bc0ad240 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:59.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.525+0000 7f56c2555700 1 -- 172.21.15.60:0/2538874564 shutdown_connections 2020-10-31T22:48:59.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.525+0000 7f56c2555700 1 -- 172.21.15.60:0/2538874564 wait complete. 2020-10-31T22:48:59.532 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blacklist entries 2020-10-31T22:48:59.545 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2020-10-31T22:48:59.546 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-10-31T22:48:59.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dc07b7700 1 Processor -- start 2020-10-31T22:48:59.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dc07b7700 1 -- start start 2020-10-31T22:48:59.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dc07b7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6db8062e10 0x7f6db80afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:59.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dc07b7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db805afe0 0x7f6db80b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:59.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dc07b7700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db80631f0 con 0x7f6db80aead0 2020-10-31T22:48:59.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dc07b7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db80b1840 con 0x7f6db8062e10 2020-10-31T22:48:59.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dc07b7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db81454d0 con 0x7f6db805afe0 2020-10-31T22:48:59.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dbe553700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6db8062e10 0x7f6db80afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:59.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dbe553700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6db8062e10 0x7f6db80afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47218/0 (socket says 172.21.15.60:47218) 2020-10-31T22:48:59.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dbe553700 1 -- 172.21.15.60:0/3975528297 learned_addr learned my addr 172.21.15.60:0/3975528297 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:59.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dbdd52700 1 --2- 172.21.15.60:0/3975528297 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db805afe0 0x7f6db80b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:59.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dbe553700 1 -- 172.21.15.60:0/3975528297 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db805afe0 msgr2=0x7f6db80b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:48:59.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dbe553700 1 --2- 172.21.15.60:0/3975528297 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db805afe0 0x7f6db80b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:59.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dbe553700 1 -- 172.21.15.60:0/3975528297 >> v1:172.21.15.66:6789/0 conn(0x7f6db80aead0 legacy=0x7f6db80aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:59.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dbe553700 1 -- 172.21.15.60:0/3975528297 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db8145770 con 0x7f6db8062e10 2020-10-31T22:48:59.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dbe553700 1 --2- 172.21.15.60:0/3975528297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8062e10 0x7f6db80afbe0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f6db4002f30 tx=0x7f6db4006e80).ready entity=mon.0 client_cookie=95e77d5aca12329d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:59.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dbd551700 1 -- 172.21.15.60:0/3975528297 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db40097f0 con 0x7f6db8062e10 2020-10-31T22:48:59.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dbd551700 1 -- 172.21.15.60:0/3975528297 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db4009950 con 0x7f6db8062e10 2020-10-31T22:48:59.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dbd551700 1 -- 172.21.15.60:0/3975528297 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6db4009cb0 con 0x7f6db8062e10 2020-10-31T22:48:59.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3975528297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8062e10 msgr2=0x7f6db80afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:59.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.653+0000 7f6dc07b7700 1 --2- 172.21.15.60:0/3975528297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8062e10 0x7f6db80afbe0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 rx=0x7f6db4002f30 tx=0x7f6db4006e80).stop 2020-10-31T22:48:59.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3975528297 shutdown_connections 2020-10-31T22:48:59.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dc07b7700 1 --2- 172.21.15.60:0/3975528297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8062e10 0x7f6db80afbe0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:59.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dc07b7700 1 --2- 172.21.15.60:0/3975528297 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db805afe0 0x7f6db80b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:59.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3975528297 >> 172.21.15.60:0/3975528297 conn(0x7f6db805fae0 msgr2=0x7f6db805fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:59.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3975528297 shutdown_connections 2020-10-31T22:48:59.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3975528297 wait complete. 2020-10-31T22:48:59.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dc07b7700 1 Processor -- start 2020-10-31T22:48:59.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dc07b7700 1 -- start start 2020-10-31T22:48:59.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dc07b7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6db805afe0 0x7f6db80b4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:59.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dc07b7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8062e10 0x7f6db8150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:59.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dc07b7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db80aead0 0x7f6db81510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:59.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dc07b7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db80aa890 con 0x7f6db8062e10 2020-10-31T22:48:59.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dc07b7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db8146460 con 0x7f6db805afe0 2020-10-31T22:48:59.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dc07b7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db8146700 con 0x7f6db80aead0 2020-10-31T22:48:59.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dbdd52700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8062e10 0x7f6db8150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:59.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dbdd52700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8062e10 0x7f6db8150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47226/0 (socket says 172.21.15.60:47226) 2020-10-31T22:48:59.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dbdd52700 1 -- 172.21.15.60:0/3185450077 learned_addr learned my addr 172.21.15.60:0/3185450077 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:48:59.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dbe553700 1 --2- 172.21.15.60:0/3185450077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6db805afe0 0x7f6db80b4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:59.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dbed54700 1 --2- 172.21.15.60:0/3185450077 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db80aead0 0x7f6db81510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:59.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dbdd52700 1 -- 172.21.15.60:0/3185450077 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db80aead0 msgr2=0x7f6db81510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:59.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.657+0000 7f6dbdd52700 1 --2- 172.21.15.60:0/3185450077 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db80aead0 0x7f6db81510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:59.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6dbdd52700 1 -- 172.21.15.60:0/3185450077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6db805afe0 msgr2=0x7f6db80b4110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:59.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6dbdd52700 1 --2- 172.21.15.60:0/3185450077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6db805afe0 0x7f6db80b4110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:59.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6dbdd52700 1 -- 172.21.15.60:0/3185450077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db80ab0a0 con 0x7f6db8062e10 2020-10-31T22:48:59.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6dbdd52700 1 --2- 172.21.15.60:0/3185450077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8062e10 0x7f6db8150be0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f6da800c000 tx=0x7f6da8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:59.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6da77fe700 1 -- 172.21.15.60:0/3185450077 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da800caa0 con 0x7f6db8062e10 2020-10-31T22:48:59.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6da77fe700 1 -- 172.21.15.60:0/3185450077 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da800cc00 con 0x7f6db8062e10 2020-10-31T22:48:59.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3185450077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db80b4740 con 0x7f6db8062e10 2020-10-31T22:48:59.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6da77fe700 1 -- 172.21.15.60:0/3185450077 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da800ee80 con 0x7f6db8062e10 2020-10-31T22:48:59.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3185450077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db80aa590 con 0x7f6db8062e10 2020-10-31T22:48:59.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3185450077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db81468c0 con 0x7f6db8062e10 2020-10-31T22:48:59.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6da77fe700 1 -- 172.21.15.60:0/3185450077 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6da801c460 con 0x7f6db8062e10 2020-10-31T22:48:59.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6da77fe700 1 --2- 172.21.15.60:0/3185450077 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6d98055050 0x7f6d98057510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:48:59.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6da77fe700 1 -- 172.21.15.60:0/3185450077 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6da806dba0 con 0x7f6db8062e10 2020-10-31T22:48:59.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6dbe553700 1 --2- 172.21.15.60:0/3185450077 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6d98055050 0x7f6d98057510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:48:59.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.661+0000 7f6dbe553700 1 --2- 172.21.15.60:0/3185450077 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6d98055050 0x7f6d98057510 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f6db401c000 tx=0x7f6db4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:48:59.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.673+0000 7f6da77fe700 1 -- 172.21.15.60:0/3185450077 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6da8044390 con 0x7f6db8062e10 2020-10-31T22:48:59.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.861+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3185450077 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6db8057100 con 0x7f6db8062e10 2020-10-31T22:48:59.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.861+0000 7f6da77fe700 1 -- 172.21.15.60:0/3185450077 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f6da80479b0 con 0x7f6db8062e10 2020-10-31T22:48:59.869 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:48:59.869 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:48:59.870 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2020-10-31T22:48:59.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.870 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2020-10-31T22:48:59.870 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f7D/cFRAAHQ9NU7VSs14mi5sC/GwHng==", 2020-10-31T22:48:59.870 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.870 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:59.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:59.871 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:59.871 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:59.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.871 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2020-10-31T22:48:59.872 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f5SPjJBAAVjFv2PdBZ7j94etJrAT0tA==", 2020-10-31T22:48:59.872 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:59.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:59.872 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:59.873 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:59.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.875 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2020-10-31T22:48:59.875 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKpdoHhAAhhlaYqOQoI6tTKexjRpbGA==", 2020-10-31T22:48:59.875 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:59.875 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:59.876 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:59.876 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:59.876 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.876 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2020-10-31T22:48:59.876 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDR551f7MwsMRAACZIQlAKm3BdVbDs2gQAfxg==", 2020-10-31T22:48:59.877 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:59.877 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:59.877 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:59.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.878 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2020-10-31T22:48:59.878 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDU551f07HQFxAAokMFXwsbgKGtJNpnKerdGg==", 2020-10-31T22:48:59.878 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:59.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:59.878 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:59.879 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.879 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2020-10-31T22:48:59.880 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDW551fODyjOhAAJ+j8KITJidSpltSiJaQZGw==", 2020-10-31T22:48:59.880 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:59.880 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:59.880 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:59.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.881 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2020-10-31T22:48:59.881 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDZ551fs+aCIhAAwpbmgGQjU05W3hZofTtHdg==", 2020-10-31T22:48:59.881 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:59.881 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:59.881 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:59.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.882 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2020-10-31T22:48:59.883 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDe551fI5nIMxAAwwNSHQYDPS6G2achKIpwqg==", 2020-10-31T22:48:59.883 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:59.883 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:59.883 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:59.883 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.884 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2020-10-31T22:48:59.884 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDh551f68p2GhAAhlGpZLPg8RqouzStqN4tFw==", 2020-10-31T22:48:59.884 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.884 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:59.884 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:59.885 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:59.885 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.885 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2020-10-31T22:48:59.885 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDk551fUi3kARAAsXPU7HEhqax8Go00CqgdNw==", 2020-10-31T22:48:59.885 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.886 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:59.886 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:59.886 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:59.886 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.886 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2020-10-31T22:48:59.887 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDm551fKh4aJRAAj+whV4kueCu2Og7wZ05tNw==", 2020-10-31T22:48:59.887 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.887 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:59.887 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:59.887 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:59.887 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.888 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2020-10-31T22:48:59.888 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551flXvBJxAAtD4URDL2NV0zyAympufvVA==", 2020-10-31T22:48:59.888 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.888 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:59.888 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:48:59.888 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:48:59.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.894 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2020-10-31T22:48:59.894 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fQ/OGKhAA/xGrRlUW52pP6E6SWXYAGA==", 2020-10-31T22:48:59.894 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.895 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:48:59.895 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:48:59.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:48:59.896 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.897 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.897 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2020-10-31T22:48:59.897 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDP551fITgCMxAAQy5CQzqda1YjdUtTRxbsPQ==", 2020-10-31T22:48:59.898 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.898 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:48:59.898 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:48:59.899 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:48:59.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:59.899 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.899 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.899 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2020-10-31T22:48:59.900 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551feZUgExAAvGt2fUb5GhkkFQ0dbgP5nw==", 2020-10-31T22:48:59.900 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.900 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:48:59.900 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:48:59.900 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:59.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:48:59.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:48:59.901 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2020-10-31T22:48:59.901 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKiN5EBAAhHtXXE4+yydXWOK7agZ14g==", 2020-10-31T22:48:59.901 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:48:59.901 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:48:59.901 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:48:59.901 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:48:59.902 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.902 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:48:59.902 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:48:59.902 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:48:59.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.865+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3185450077 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6d98055050 msgr2=0x7f6d98057510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:59.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.865+0000 7f6dc07b7700 1 --2- 172.21.15.60:0/3185450077 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6d98055050 0x7f6d98057510 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f6db401c000 tx=0x7f6db4015000).stop 2020-10-31T22:48:59.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.865+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3185450077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8062e10 msgr2=0x7f6db8150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:48:59.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.865+0000 7f6dc07b7700 1 --2- 172.21.15.60:0/3185450077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8062e10 0x7f6db8150be0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 rx=0x7f6da800c000 tx=0x7f6da8006dc0).stop 2020-10-31T22:48:59.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.865+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3185450077 shutdown_connections 2020-10-31T22:48:59.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.865+0000 7f6dc07b7700 1 --2- 172.21.15.60:0/3185450077 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db80aead0 0x7f6db81510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:59.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.865+0000 7f6dc07b7700 1 --2- 172.21.15.60:0/3185450077 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6d98055050 0x7f6d98057510 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:59.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.865+0000 7f6dc07b7700 1 --2- 172.21.15.60:0/3185450077 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6db805afe0 0x7f6db80b4110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:59.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.865+0000 7f6dc07b7700 1 --2- 172.21.15.60:0/3185450077 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8062e10 0x7f6db8150be0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:48:59.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.865+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3185450077 >> 172.21.15.60:0/3185450077 conn(0x7f6db805fae0 msgr2=0x7f6db8143bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:48:59.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.865+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3185450077 shutdown_connections 2020-10-31T22:48:59.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:48:59.865+0000 7f6dc07b7700 1 -- 172.21.15.60:0/3185450077 wait complete. 2020-10-31T22:48:59.907 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:49:00.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29c0834700 1 Processor -- start 2020-10-31T22:49:00.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29c0834700 1 -- start start 2020-10-31T22:49:00.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29c0834700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29bc140420 0x7f29bc0ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29c0834700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f29bc0b2560 0x7f29bc0adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29c0834700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29bc05b700 con 0x7f29bc05b320 2020-10-31T22:49:00.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29c0834700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29bc1408a0 con 0x7f29bc0b2560 2020-10-31T22:49:00.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29c0834700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc0b0220 con 0x7f29bc140420 2020-10-31T22:49:00.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29bad9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f29bc05b320 0x7f29bc0b1e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51368/0 (socket says 172.21.15.60:51368) 2020-10-31T22:49:00.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29bad9d700 1 -- 172.21.15.60:0/558286422 learned_addr learned my addr 172.21.15.60:0/558286422 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:00.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29ba59c700 1 --2- 172.21.15.60:0/558286422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29bc140420 0x7f29bc0ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29bb59e700 1 --2- 172.21.15.60:0/558286422 >> v2:172.21.15.66:3300/0 conn(0x7f29bc0b2560 0x7f29bc0adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29b9d9b700 1 -- 172.21.15.60:0/558286422 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630624459 0 0) 0x7f29bc05b700 con 0x7f29bc05b320 2020-10-31T22:49:00.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29b9d9b700 1 -- 172.21.15.60:0/558286422 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f299c003230 con 0x7f29bc05b320 2020-10-31T22:49:00.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29ba59c700 1 -- 172.21.15.60:0/558286422 >> v2:172.21.15.66:3300/0 conn(0x7f29bc0b2560 msgr2=0x7f29bc0adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:00.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29ba59c700 1 --2- 172.21.15.60:0/558286422 >> v2:172.21.15.66:3300/0 conn(0x7f29bc0b2560 0x7f29bc0adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29ba59c700 1 -- 172.21.15.60:0/558286422 >> v1:172.21.15.60:6789/0 conn(0x7f29bc05b320 legacy=0x7f29bc0b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29ba59c700 1 -- 172.21.15.60:0/558286422 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc0b04c0 con 0x7f29bc140420 2020-10-31T22:49:00.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29bb59e700 1 --2- 172.21.15.60:0/558286422 >> v2:172.21.15.66:3300/0 conn(0x7f29bc0b2560 0x7f29bc0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:00.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.017+0000 7f29ba59c700 1 --2- 172.21.15.60:0/558286422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29bc140420 0x7f29bc0ad7a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f29a4002f30 tx=0x7f29a4006dc0).ready entity=mon.2 client_cookie=a3fd4482014708fb server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:00.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29b9d9b700 1 -- 172.21.15.60:0/558286422 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a40096a0 con 0x7f29bc140420 2020-10-31T22:49:00.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29b9d9b700 1 -- 172.21.15.60:0/558286422 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a4009800 con 0x7f29bc140420 2020-10-31T22:49:00.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29b9d9b700 1 -- 172.21.15.60:0/558286422 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a4009b60 con 0x7f29bc140420 2020-10-31T22:49:00.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 -- 172.21.15.60:0/558286422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29bc140420 msgr2=0x7f29bc0ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 --2- 172.21.15.60:0/558286422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29bc140420 0x7f29bc0ad7a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f29a4002f30 tx=0x7f29a4006dc0).stop 2020-10-31T22:49:00.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 -- 172.21.15.60:0/558286422 shutdown_connections 2020-10-31T22:49:00.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 --2- 172.21.15.60:0/558286422 >> v2:172.21.15.66:3300/0 conn(0x7f29bc0b2560 0x7f29bc0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 --2- 172.21.15.60:0/558286422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29bc140420 0x7f29bc0ad7a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 -- 172.21.15.60:0/558286422 >> 172.21.15.60:0/558286422 conn(0x7f29bc0b61d0 msgr2=0x7f29bc0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:00.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 -- 172.21.15.60:0/558286422 shutdown_connections 2020-10-31T22:49:00.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 -- 172.21.15.60:0/558286422 wait complete. 2020-10-31T22:49:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 Processor -- start 2020-10-31T22:49:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 -- start start 2020-10-31T22:49:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29bc05b320 0x7f29bc146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc0b2560 0x7f29bc144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29bc140420 0x7f29bc14e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc13cf00 con 0x7f29bc0b2560 2020-10-31T22:49:00.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc142470 con 0x7f29bc140420 2020-10-31T22:49:00.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29c0834700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29bc142710 con 0x7f29bc05b320 2020-10-31T22:49:00.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29ba59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc0b2560 0x7f29bc144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29ba59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc0b2560 0x7f29bc144d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47240/0 (socket says 172.21.15.60:47240) 2020-10-31T22:49:00.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29ba59c700 1 -- 172.21.15.60:0/512798388 learned_addr learned my addr 172.21.15.60:0/512798388 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:00.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29bad9d700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29bc05b320 0x7f29bc146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.021+0000 7f29bb59e700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29bc140420 0x7f29bc14e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29ba59c700 1 -- 172.21.15.60:0/512798388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29bc05b320 msgr2=0x7f29bc146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29ba59c700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29bc05b320 0x7f29bc146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29ba59c700 1 -- 172.21.15.60:0/512798388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29bc140420 msgr2=0x7f29bc14e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29ba59c700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29bc140420 0x7f29bc14e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29ba59c700 1 -- 172.21.15.60:0/512798388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29bc140ed0 con 0x7f29bc0b2560 2020-10-31T22:49:00.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29bad9d700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29bc05b320 0x7f29bc146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29ba59c700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc0b2560 0x7f29bc144d60 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f29a4002f30 tx=0x7f29a4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29b3fff700 1 -- 172.21.15.60:0/512798388 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a4011a20 con 0x7f29bc0b2560 2020-10-31T22:49:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29b3fff700 1 -- 172.21.15.60:0/512798388 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a4011b80 con 0x7f29bc0b2560 2020-10-31T22:49:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29b3fff700 1 -- 172.21.15.60:0/512798388 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f29a401c3b0 con 0x7f29bc0b2560 2020-10-31T22:49:00.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29c0834700 1 -- 172.21.15.60:0/512798388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29bc145540 con 0x7f29bc0b2560 2020-10-31T22:49:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29c0834700 1 -- 172.21.15.60:0/512798388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29bc14ee10 con 0x7f29bc0b2560 2020-10-31T22:49:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29c0834700 1 -- 172.21.15.60:0/512798388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29bc13d070 con 0x7f29bc0b2560 2020-10-31T22:49:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29b3fff700 1 -- 172.21.15.60:0/512798388 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f29a400f070 con 0x7f29bc0b2560 2020-10-31T22:49:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29b3fff700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f29a0054f90 0x7f29a0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29b3fff700 1 -- 172.21.15.60:0/512798388 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f29a406e340 con 0x7f29bc0b2560 2020-10-31T22:49:00.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29bad9d700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f29a0054f90 0x7f29a0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.025+0000 7f29bad9d700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f29a0054f90 0x7f29a0057450 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f29b400d000 tx=0x7f29b4007cf0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:00.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.029+0000 7f29b3fff700 1 -- 172.21.15.60:0/512798388 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f29a4044af0 con 0x7f29bc0b2560 2020-10-31T22:49:00.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.173+0000 7f29c0834700 1 -- 172.21.15.60:0/512798388 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29bc057100 con 0x7f29bc0b2560 2020-10-31T22:49:00.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.173+0000 7f29b3fff700 1 -- 172.21.15.60:0/512798388 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+13183 (secure 0 0 0) 0x7f29a4023030 con 0x7f29bc0b2560 2020-10-31T22:49:00.183 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:00.183 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":105,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:48:59.515998+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":94,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":96,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":97,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:49:00.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.177+0000 7f29c0834700 1 -- 172.21.15.60:0/512798388 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f29a0054f90 msgr2=0x7f29a0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.177+0000 7f29c0834700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f29a0054f90 0x7f29a0057450 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f29b400d000 tx=0x7f29b4007cf0).stop 2020-10-31T22:49:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.177+0000 7f29c0834700 1 -- 172.21.15.60:0/512798388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc0b2560 msgr2=0x7f29bc144d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.177+0000 7f29c0834700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc0b2560 0x7f29bc144d60 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 rx=0x7f29a4002f30 tx=0x7f29a4015000).stop 2020-10-31T22:49:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.177+0000 7f29c0834700 1 -- 172.21.15.60:0/512798388 shutdown_connections 2020-10-31T22:49:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.177+0000 7f29c0834700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f29a0054f90 0x7f29a0057450 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.177+0000 7f29c0834700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29bc140420 0x7f29bc14e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.177+0000 7f29c0834700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29bc05b320 0x7f29bc146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.177+0000 7f29c0834700 1 --2- 172.21.15.60:0/512798388 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f29bc0b2560 0x7f29bc144d60 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.177+0000 7f29c0834700 1 -- 172.21.15.60:0/512798388 >> 172.21.15.60:0/512798388 conn(0x7f29bc0b61d0 msgr2=0x7f29bc0b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.177+0000 7f29c0834700 1 -- 172.21.15.60:0/512798388 shutdown_connections 2020-10-31T22:49:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.177+0000 7f29c0834700 1 -- 172.21.15.60:0/512798388 wait complete. 2020-10-31T22:49:00.196 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-31T22:49:00.197 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:49:00.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.313+0000 7f5ab0e04700 1 Processor -- start 2020-10-31T22:49:00.328 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.313+0000 7f5ab0e04700 1 -- start start 2020-10-31T22:49:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.313+0000 7f5ab0e04700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5aac13d1c0 0x7f5aac064a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.313+0000 7f5ab0e04700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aac064f10 0x7f5aac143160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.313+0000 7f5ab0e04700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5aac05caa0 con 0x7f5aac05c570 2020-10-31T22:49:00.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.313+0000 7f5ab0e04700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5aac05b850 con 0x7f5aac13d1c0 2020-10-31T22:49:00.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.313+0000 7f5ab0e04700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac05baf0 con 0x7f5aac064f10 2020-10-31T22:49:00.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.313+0000 7f5aaa59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5aac13d1c0 0x7f5aac064a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.313+0000 7f5aaad9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5aac05c570 0x7f5aac13fbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51386/0 (socket says 172.21.15.60:51386) 2020-10-31T22:49:00.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.313+0000 7f5aaad9d700 1 -- 172.21.15.60:0/2709287560 learned_addr learned my addr 172.21.15.60:0/2709287560 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:00.333 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.313+0000 7f5aa9d9b700 1 --2- 172.21.15.60:0/2709287560 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aac064f10 0x7f5aac143160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.313+0000 7f5aa959a700 1 -- 172.21.15.60:0/2709287560 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664548628 0 0) 0x7f5aac05caa0 con 0x7f5aac05c570 2020-10-31T22:49:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.313+0000 7f5aa959a700 1 -- 172.21.15.60:0/2709287560 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a8c003230 con 0x7f5aac05c570 2020-10-31T22:49:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5aaa59c700 1 -- 172.21.15.60:0/2709287560 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aac064f10 msgr2=0x7f5aac143160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5aaa59c700 1 --2- 172.21.15.60:0/2709287560 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aac064f10 0x7f5aac143160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5aaa59c700 1 -- 172.21.15.60:0/2709287560 >> v1:172.21.15.60:6789/0 conn(0x7f5aac05c570 legacy=0x7f5aac13fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5aaa59c700 1 -- 172.21.15.60:0/2709287560 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aac05bd90 con 0x7f5aac13d1c0 2020-10-31T22:49:00.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5aa9d9b700 1 --2- 172.21.15.60:0/2709287560 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aac064f10 0x7f5aac143160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:00.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5aaa59c700 1 --2- 172.21.15.60:0/2709287560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aac13d1c0 0x7f5aac064a20 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f5a94002f30 tx=0x7f5a94006dc0).ready entity=mon.0 client_cookie=fa64095a91b7d6a2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:00.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5aa959a700 1 -- 172.21.15.60:0/2709287560 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a94009760 con 0x7f5aac13d1c0 2020-10-31T22:49:00.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5aa959a700 1 -- 172.21.15.60:0/2709287560 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a940098c0 con 0x7f5aac13d1c0 2020-10-31T22:49:00.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5aa959a700 1 -- 172.21.15.60:0/2709287560 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5a94009c20 con 0x7f5aac13d1c0 2020-10-31T22:49:00.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5ab0e04700 1 -- 172.21.15.60:0/2709287560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aac13d1c0 msgr2=0x7f5aac064a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5ab0e04700 1 --2- 172.21.15.60:0/2709287560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aac13d1c0 0x7f5aac064a20 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 rx=0x7f5a94002f30 tx=0x7f5a94006dc0).stop 2020-10-31T22:49:00.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5ab0e04700 1 -- 172.21.15.60:0/2709287560 shutdown_connections 2020-10-31T22:49:00.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5ab0e04700 1 --2- 172.21.15.60:0/2709287560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aac13d1c0 0x7f5aac064a20 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5ab0e04700 1 --2- 172.21.15.60:0/2709287560 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aac064f10 0x7f5aac143160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5ab0e04700 1 -- 172.21.15.60:0/2709287560 >> 172.21.15.60:0/2709287560 conn(0x7f5aac0b6380 msgr2=0x7f5aac0b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:00.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5ab0e04700 1 -- 172.21.15.60:0/2709287560 shutdown_connections 2020-10-31T22:49:00.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5ab0e04700 1 -- 172.21.15.60:0/2709287560 wait complete. 2020-10-31T22:49:00.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5ab0e04700 1 Processor -- start 2020-10-31T22:49:00.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.317+0000 7f5ab0e04700 1 -- start start 2020-10-31T22:49:00.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5ab0e04700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aac05c570 0x7f5aac0b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5ab0e04700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5aac13d1c0 0x7f5aac151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5ab0e04700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aac0ac420 0x7f5aac151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5ab0e04700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac152480 con 0x7f5aac0ac420 2020-10-31T22:49:00.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5ab0e04700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac0adad0 con 0x7f5aac13d1c0 2020-10-31T22:49:00.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5ab0e04700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5aac0ac0c0 con 0x7f5aac05c570 2020-10-31T22:49:00.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aaad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aac0ac420 0x7f5aac151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.339 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aaad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aac0ac420 0x7f5aac151f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47256/0 (socket says 172.21.15.60:47256) 2020-10-31T22:49:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aaad9d700 1 -- 172.21.15.60:0/341800983 learned_addr learned my addr 172.21.15.60:0/341800983 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aaa59c700 1 --2- 172.21.15.60:0/341800983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aac05c570 0x7f5aac0b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aa9d9b700 1 --2- 172.21.15.60:0/341800983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5aac13d1c0 0x7f5aac151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aaad9d700 1 -- 172.21.15.60:0/341800983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aac05c570 msgr2=0x7f5aac0b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aaad9d700 1 --2- 172.21.15.60:0/341800983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aac05c570 0x7f5aac0b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aaad9d700 1 -- 172.21.15.60:0/341800983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5aac13d1c0 msgr2=0x7f5aac151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aaad9d700 1 --2- 172.21.15.60:0/341800983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5aac13d1c0 0x7f5aac151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aaad9d700 1 -- 172.21.15.60:0/341800983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aac0add00 con 0x7f5aac0ac420 2020-10-31T22:49:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aaad9d700 1 --2- 172.21.15.60:0/341800983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aac0ac420 0x7f5aac151f90 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f5aa4001450 tx=0x7f5aa4007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aa37fe700 1 -- 172.21.15.60:0/341800983 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aa4005b70 con 0x7f5aac0ac420 2020-10-31T22:49:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aa37fe700 1 -- 172.21.15.60:0/341800983 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa4005cd0 con 0x7f5aac0ac420 2020-10-31T22:49:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aa37fe700 1 -- 172.21.15.60:0/341800983 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aa4007300 con 0x7f5aac0ac420 2020-10-31T22:49:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5ab0e04700 1 -- 172.21.15.60:0/341800983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aac0adfa0 con 0x7f5aac0ac420 2020-10-31T22:49:00.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5ab0e04700 1 -- 172.21.15.60:0/341800983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aac0ab1f0 con 0x7f5aac0ac420 2020-10-31T22:49:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5ab0e04700 1 -- 172.21.15.60:0/341800983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aac0ae130 con 0x7f5aac0ac420 2020-10-31T22:49:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.321+0000 7f5aa37fe700 1 -- 172.21.15.60:0/341800983 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5aa4010030 con 0x7f5aac0ac420 2020-10-31T22:49:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.325+0000 7f5aa37fe700 1 --2- 172.21.15.60:0/341800983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5a90054f30 0x7f5a900573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.325+0000 7f5aa37fe700 1 -- 172.21.15.60:0/341800983 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f5aa406d6e0 con 0x7f5aac0ac420 2020-10-31T22:49:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.325+0000 7f5aaa59c700 1 --2- 172.21.15.60:0/341800983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5a90054f30 0x7f5a900573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.325+0000 7f5aaa59c700 1 --2- 172.21.15.60:0/341800983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5a90054f30 0x7f5a900573f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f5a94018000 tx=0x7f5a94015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:00.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.329+0000 7f5aa37fe700 1 -- 172.21.15.60:0/341800983 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5aa4043f30 con 0x7f5aac0ac420 2020-10-31T22:49:00.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.477+0000 7f5ab0e04700 1 -- 172.21.15.60:0/341800983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f5aac0ac200 con 0x7f5aac0ac420 2020-10-31T22:49:00.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.477+0000 7f5aa37fe700 1 -- 172.21.15.60:0/341800983 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v105) v1 ==== 110+0+10 (secure 0 0 0) 0x7f5aa4047550 con 0x7f5aac0ac420 2020-10-31T22:49:00.486 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:49:00.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.481+0000 7f5ab0e04700 1 -- 172.21.15.60:0/341800983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5a90054f30 msgr2=0x7f5a900573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.481+0000 7f5ab0e04700 1 --2- 172.21.15.60:0/341800983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5a90054f30 0x7f5a900573f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f5a94018000 tx=0x7f5a94015000).stop 2020-10-31T22:49:00.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.481+0000 7f5ab0e04700 1 -- 172.21.15.60:0/341800983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aac0ac420 msgr2=0x7f5aac151f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.481+0000 7f5ab0e04700 1 --2- 172.21.15.60:0/341800983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aac0ac420 0x7f5aac151f90 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 rx=0x7f5aa4001450 tx=0x7f5aa4007d30).stop 2020-10-31T22:49:00.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.481+0000 7f5ab0e04700 1 -- 172.21.15.60:0/341800983 shutdown_connections 2020-10-31T22:49:00.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.481+0000 7f5ab0e04700 1 --2- 172.21.15.60:0/341800983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5aac0ac420 0x7f5aac151f90 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.481+0000 7f5ab0e04700 1 --2- 172.21.15.60:0/341800983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5aac05c570 0x7f5aac0b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.481+0000 7f5ab0e04700 1 --2- 172.21.15.60:0/341800983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5a90054f30 0x7f5a900573f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.481+0000 7f5ab0e04700 1 --2- 172.21.15.60:0/341800983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5aac13d1c0 0x7f5aac151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.481+0000 7f5ab0e04700 1 -- 172.21.15.60:0/341800983 >> 172.21.15.60:0/341800983 conn(0x7f5aac0b6380 msgr2=0x7f5aac141c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:00.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.481+0000 7f5ab0e04700 1 -- 172.21.15.60:0/341800983 shutdown_connections 2020-10-31T22:49:00.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.481+0000 7f5ab0e04700 1 -- 172.21.15.60:0/341800983 wait complete. 2020-10-31T22:49:00.504 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:49:00.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.617+0000 7fa15e206700 1 Processor -- start 2020-10-31T22:49:00.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.617+0000 7fa15e206700 1 -- start start 2020-10-31T22:49:00.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15e206700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa1580b5570 0x7fa1580b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15e206700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa158141f00 0x7fa158142360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15e206700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1580b4440 con 0x7fa1580b24a0 2020-10-31T22:49:00.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15e206700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa15813f930 con 0x7fa158141f00 2020-10-31T22:49:00.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15e206700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa158146060 con 0x7fa1580b5570 2020-10-31T22:49:00.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15da05700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa158141f00 0x7fa158142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15da05700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa158141f00 0x7fa158142360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47262/0 (socket says 172.21.15.60:47262) 2020-10-31T22:49:00.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15da05700 1 -- 172.21.15.60:0/4264611038 learned_addr learned my addr 172.21.15.60:0/4264611038 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:00.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15d204700 1 --2- 172.21.15.60:0/4264611038 >> v2:172.21.15.66:3300/0 conn(0x7fa1580b5570 0x7fa1580b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15da05700 1 -- 172.21.15.60:0/4264611038 >> v2:172.21.15.66:3300/0 conn(0x7fa1580b5570 msgr2=0x7fa1580b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:00.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15da05700 1 --2- 172.21.15.60:0/4264611038 >> v2:172.21.15.66:3300/0 conn(0x7fa1580b5570 0x7fa1580b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15da05700 1 -- 172.21.15.60:0/4264611038 >> v1:172.21.15.66:6789/0 conn(0x7fa1580b24a0 legacy=0x7fa158145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15da05700 1 -- 172.21.15.60:0/4264611038 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1580b02f0 con 0x7fa158141f00 2020-10-31T22:49:00.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15da05700 1 --2- 172.21.15.60:0/4264611038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa158141f00 0x7fa158142360 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7fa1500032b0 tx=0x7fa150009270).ready entity=mon.0 client_cookie=e1ca620654ad2179 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:00.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa14bfff700 1 -- 172.21.15.60:0/4264611038 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa150009e60 con 0x7fa158141f00 2020-10-31T22:49:00.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa14bfff700 1 -- 172.21.15.60:0/4264611038 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15000bc00 con 0x7fa158141f00 2020-10-31T22:49:00.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa14bfff700 1 -- 172.21.15.60:0/4264611038 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa15000bd70 con 0x7fa158141f00 2020-10-31T22:49:00.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15e206700 1 -- 172.21.15.60:0/4264611038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa158141f00 msgr2=0x7fa158142360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15e206700 1 --2- 172.21.15.60:0/4264611038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa158141f00 0x7fa158142360 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 rx=0x7fa1500032b0 tx=0x7fa150009270).stop 2020-10-31T22:49:00.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15e206700 1 -- 172.21.15.60:0/4264611038 shutdown_connections 2020-10-31T22:49:00.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15e206700 1 --2- 172.21.15.60:0/4264611038 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa158141f00 0x7fa158142360 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15e206700 1 --2- 172.21.15.60:0/4264611038 >> v2:172.21.15.66:3300/0 conn(0x7fa1580b5570 0x7fa1580b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15e206700 1 -- 172.21.15.60:0/4264611038 >> 172.21.15.60:0/4264611038 conn(0x7fa1580b8e90 msgr2=0x7fa1580b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:00.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15e206700 1 -- 172.21.15.60:0/4264611038 shutdown_connections 2020-10-31T22:49:00.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.621+0000 7fa15e206700 1 -- 172.21.15.60:0/4264611038 wait complete. 2020-10-31T22:49:00.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15e206700 1 Processor -- start 2020-10-31T22:49:00.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15e206700 1 -- start start 2020-10-31T22:49:00.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15e206700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1580b24a0 0x7fa158066230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15e206700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1580b5570 0x7fa158143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15e206700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa158141f00 0x7fa158143f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15e206700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1580ae400 con 0x7fa1580b5570 2020-10-31T22:49:00.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15e206700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1580ae630 con 0x7fa158141f00 2020-10-31T22:49:00.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15e206700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1580ae8d0 con 0x7fa1580b24a0 2020-10-31T22:49:00.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15ca03700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1580b5570 0x7fa158143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15ca03700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1580b5570 0x7fa158143a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47266/0 (socket says 172.21.15.60:47266) 2020-10-31T22:49:00.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15ca03700 1 -- 172.21.15.60:0/247492853 learned_addr learned my addr 172.21.15.60:0/247492853 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:00.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15da05700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa158141f00 0x7fa158143f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15d204700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1580b24a0 0x7fa158066230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15ca03700 1 -- 172.21.15.60:0/247492853 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1580b24a0 msgr2=0x7fa158066230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15ca03700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1580b24a0 0x7fa158066230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15ca03700 1 -- 172.21.15.60:0/247492853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa158141f00 msgr2=0x7fa158143f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15ca03700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa158141f00 0x7fa158143f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15ca03700 1 -- 172.21.15.60:0/247492853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1580aeb70 con 0x7fa1580b5570 2020-10-31T22:49:00.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15da05700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa158141f00 0x7fa158143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:00.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15d204700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1580b24a0 0x7fa158066230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:00.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15ca03700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1580b5570 0x7fa158143a20 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7fa158141de0 tx=0x7fa14c007be0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:00.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa14a7fc700 1 -- 172.21.15.60:0/247492853 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14c007240 con 0x7fa1580b5570 2020-10-31T22:49:00.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa14a7fc700 1 -- 172.21.15.60:0/247492853 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa14c0073a0 con 0x7fa1580b5570 2020-10-31T22:49:00.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15e206700 1 -- 172.21.15.60:0/247492853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa158144400 con 0x7fa1580b5570 2020-10-31T22:49:00.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa14a7fc700 1 -- 172.21.15.60:0/247492853 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa14c0066d0 con 0x7fa1580b5570 2020-10-31T22:49:00.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.625+0000 7fa15e206700 1 -- 172.21.15.60:0/247492853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1580acd90 con 0x7fa1580b5570 2020-10-31T22:49:00.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.629+0000 7fa15e206700 1 -- 172.21.15.60:0/247492853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1581451a0 con 0x7fa1580b5570 2020-10-31T22:49:00.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.629+0000 7fa14a7fc700 1 -- 172.21.15.60:0/247492853 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa14c010030 con 0x7fa1580b5570 2020-10-31T22:49:00.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.629+0000 7fa14a7fc700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa140054f90 0x7fa140057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.629+0000 7fa14a7fc700 1 -- 172.21.15.60:0/247492853 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa14c06cfb0 con 0x7fa1580b5570 2020-10-31T22:49:00.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.629+0000 7fa15d204700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa140054f90 0x7fa140057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.629+0000 7fa15d204700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa140054f90 0x7fa140057450 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fa15400b000 tx=0x7fa154008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:00.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.637+0000 7fa14a7fc700 1 -- 172.21.15.60:0/247492853 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa14c043670 con 0x7fa1580b5570 2020-10-31T22:49:00.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.777+0000 7fa15e206700 1 -- 172.21.15.60:0/247492853 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa1580aed00 con 0x7fa1580b5570 2020-10-31T22:49:00.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.781+0000 7fa14a7fc700 1 -- 172.21.15.60:0/247492853 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v105) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa14c046c90 con 0x7fa1580b5570 2020-10-31T22:49:00.786 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:49:00.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.781+0000 7fa15e206700 1 -- 172.21.15.60:0/247492853 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa140054f90 msgr2=0x7fa140057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.781+0000 7fa15e206700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa140054f90 0x7fa140057450 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7fa15400b000 tx=0x7fa154008040).stop 2020-10-31T22:49:00.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.781+0000 7fa15e206700 1 -- 172.21.15.60:0/247492853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1580b5570 msgr2=0x7fa158143a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.781+0000 7fa15e206700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1580b5570 0x7fa158143a20 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 rx=0x7fa158141de0 tx=0x7fa14c007be0).stop 2020-10-31T22:49:00.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.781+0000 7fa15e206700 1 -- 172.21.15.60:0/247492853 shutdown_connections 2020-10-31T22:49:00.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.781+0000 7fa15e206700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa140054f90 0x7fa140057450 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.781+0000 7fa15e206700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa158141f00 0x7fa158143f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.781+0000 7fa15e206700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1580b24a0 0x7fa158066230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.781+0000 7fa15e206700 1 --2- 172.21.15.60:0/247492853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1580b5570 0x7fa158143a20 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.781+0000 7fa15e206700 1 -- 172.21.15.60:0/247492853 >> 172.21.15.60:0/247492853 conn(0x7fa1580b8e90 msgr2=0x7fa1580b3a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:00.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.781+0000 7fa15e206700 1 -- 172.21.15.60:0/247492853 shutdown_connections 2020-10-31T22:49:00.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.781+0000 7fa15e206700 1 -- 172.21.15.60:0/247492853 wait complete. 2020-10-31T22:49:00.802 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-10-31T22:49:00.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79e0640700 1 Processor -- start 2020-10-31T22:49:00.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79e0640700 1 -- start start 2020-10-31T22:49:00.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79e0640700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f79d81438a0 0x7f79d80b2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79e0640700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79d814a420 0x7f79d8146290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79e0640700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79d81497e0 con 0x7f79d80b2940 2020-10-31T22:49:00.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79e0640700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79d8149a40 con 0x7f79d81438a0 2020-10-31T22:49:00.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79e0640700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8149ce0 con 0x7f79d814a420 2020-10-31T22:49:00.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79debdd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79d814a420 0x7f79d8146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79debdd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79d814a420 0x7f79d8146290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:60462/0 (socket says 172.21.15.60:60462) 2020-10-31T22:49:00.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79de3dc700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f79d81438a0 0x7f79d80b2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79debdd700 1 -- 172.21.15.60:0/2672100435 learned_addr learned my addr 172.21.15.60:0/2672100435 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:00.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79dd3da700 1 -- 172.21.15.60:0/2672100435 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 894172479 0 0) 0x7f79d81497e0 con 0x7f79d80b2940 2020-10-31T22:49:00.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79dd3da700 1 -- 172.21.15.60:0/2672100435 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c4003230 con 0x7f79d80b2940 2020-10-31T22:49:00.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79debdd700 1 -- 172.21.15.60:0/2672100435 >> v2:172.21.15.66:3300/0 conn(0x7f79d81438a0 msgr2=0x7f79d80b2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:00.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79debdd700 1 --2- 172.21.15.60:0/2672100435 >> v2:172.21.15.66:3300/0 conn(0x7f79d81438a0 0x7f79d80b2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79debdd700 1 -- 172.21.15.60:0/2672100435 >> v1:172.21.15.66:6789/0 conn(0x7f79d80b2940 legacy=0x7f79d805fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.909+0000 7f79debdd700 1 -- 172.21.15.60:0/2672100435 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d8149f80 con 0x7f79d814a420 2020-10-31T22:49:00.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.913+0000 7f79debdd700 1 --2- 172.21.15.60:0/2672100435 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79d814a420 0x7f79d8146290 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f79d0002f30 tx=0x7f79d0006e80).ready entity=mon.2 client_cookie=73fb503020af7d16 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:00.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.913+0000 7f79dd3da700 1 -- 172.21.15.60:0/2672100435 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d0009640 con 0x7f79d814a420 2020-10-31T22:49:00.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.913+0000 7f79dd3da700 1 -- 172.21.15.60:0/2672100435 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d00097a0 con 0x7f79d814a420 2020-10-31T22:49:00.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.913+0000 7f79dd3da700 1 -- 172.21.15.60:0/2672100435 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d0009910 con 0x7f79d814a420 2020-10-31T22:49:00.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.913+0000 7f79e0640700 1 -- 172.21.15.60:0/2672100435 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79d814a420 msgr2=0x7f79d8146290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.913+0000 7f79e0640700 1 --2- 172.21.15.60:0/2672100435 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79d814a420 0x7f79d8146290 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f79d0002f30 tx=0x7f79d0006e80).stop 2020-10-31T22:49:00.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.913+0000 7f79e0640700 1 -- 172.21.15.60:0/2672100435 shutdown_connections 2020-10-31T22:49:00.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.913+0000 7f79e0640700 1 --2- 172.21.15.60:0/2672100435 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79d814a420 0x7f79d8146290 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.913+0000 7f79e0640700 1 --2- 172.21.15.60:0/2672100435 >> v2:172.21.15.66:3300/0 conn(0x7f79d81438a0 0x7f79d80b2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.913+0000 7f79e0640700 1 -- 172.21.15.60:0/2672100435 >> 172.21.15.60:0/2672100435 conn(0x7f79d80b5d30 msgr2=0x7f79d80b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:00.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.913+0000 7f79e0640700 1 -- 172.21.15.60:0/2672100435 shutdown_connections 2020-10-31T22:49:00.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.913+0000 7f79e0640700 1 -- 172.21.15.60:0/2672100435 wait complete. 2020-10-31T22:49:00.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.913+0000 7f79e0640700 1 Processor -- start 2020-10-31T22:49:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.913+0000 7f79e0640700 1 -- start start 2020-10-31T22:49:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79e0640700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d81438a0 0x7f79d8145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79e0640700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79d814a420 0x7f79d8142c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79e0640700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79d80a9a40 0x7f79d8143170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79e0640700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d8145c90 con 0x7f79d80a9a40 2020-10-31T22:49:00.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79e0640700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d81493b0 con 0x7f79d81438a0 2020-10-31T22:49:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79e0640700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d80ac270 con 0x7f79d814a420 2020-10-31T22:49:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79debdd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79d80a9a40 0x7f79d8143170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79de3dc700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d81438a0 0x7f79d8145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79debdd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79d80a9a40 0x7f79d8143170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47284/0 (socket says 172.21.15.60:47284) 2020-10-31T22:49:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79de3dc700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d81438a0 0x7f79d8145400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:58216/0 (socket says 172.21.15.60:58216) 2020-10-31T22:49:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79debdd700 1 -- 172.21.15.60:0/2369194487 learned_addr learned my addr 172.21.15.60:0/2369194487 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:00.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79ddbdb700 1 --2- 172.21.15.60:0/2369194487 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79d814a420 0x7f79d8142c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79debdd700 1 -- 172.21.15.60:0/2369194487 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79d814a420 msgr2=0x7f79d8142c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79debdd700 1 --2- 172.21.15.60:0/2369194487 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79d814a420 0x7f79d8142c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79debdd700 1 -- 172.21.15.60:0/2369194487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d81438a0 msgr2=0x7f79d8145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:00.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79debdd700 1 --2- 172.21.15.60:0/2369194487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d81438a0 0x7f79d8145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:00.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79debdd700 1 -- 172.21.15.60:0/2369194487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d80ab890 con 0x7f79d80a9a40 2020-10-31T22:49:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79de3dc700 1 --2- 172.21.15.60:0/2369194487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d81438a0 0x7f79d8145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79debdd700 1 --2- 172.21.15.60:0/2369194487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79d80a9a40 0x7f79d8143170 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f79d0002f30 tx=0x7f79d0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:00.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79d77fe700 1 -- 172.21.15.60:0/2369194487 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d0011cf0 con 0x7f79d80a9a40 2020-10-31T22:49:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79d77fe700 1 -- 172.21.15.60:0/2369194487 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0011e50 con 0x7f79d80a9a40 2020-10-31T22:49:00.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79e0640700 1 -- 172.21.15.60:0/2369194487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d80abb30 con 0x7f79d80a9a40 2020-10-31T22:49:00.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79d77fe700 1 -- 172.21.15.60:0/2369194487 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d00205e0 con 0x7f79d80a9a40 2020-10-31T22:49:00.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79e0640700 1 -- 172.21.15.60:0/2369194487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79d8143660 con 0x7f79d80a9a40 2020-10-31T22:49:00.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79e0640700 1 -- 172.21.15.60:0/2369194487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79d80abfd0 con 0x7f79d80a9a40 2020-10-31T22:49:00.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.917+0000 7f79d77fe700 1 -- 172.21.15.60:0/2369194487 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f79d000f070 con 0x7f79d80a9a40 2020-10-31T22:49:00.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.921+0000 7f79d77fe700 1 --2- 172.21.15.60:0/2369194487 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f79b8054f10 0x7f79b80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:00.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.921+0000 7f79d77fe700 1 -- 172.21.15.60:0/2369194487 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f79d006dbb0 con 0x7f79d80a9a40 2020-10-31T22:49:00.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.921+0000 7f79de3dc700 1 --2- 172.21.15.60:0/2369194487 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f79b8054f10 0x7f79b80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:00.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.921+0000 7f79de3dc700 1 --2- 172.21.15.60:0/2369194487 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f79b8054f10 0x7f79b80573d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f79c800b000 tx=0x7f79c80091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:00.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:00.929+0000 7f79d77fe700 1 -- 172.21.15.60:0/2369194487 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f79d80abfd0 con 0x7f79d80a9a40 2020-10-31T22:49:01.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.069+0000 7f79e0640700 1 -- 172.21.15.60:0/2369194487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f79d80abfd0 con 0x7f79d80a9a40 2020-10-31T22:49:01.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.069+0000 7f79d77fe700 1 -- 172.21.15.60:0/2369194487 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v105) v1 ==== 84+0+143 (secure 0 0 0) 0x7f79d80abfd0 con 0x7f79d80a9a40 2020-10-31T22:49:01.078 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:01.078 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2020-10-31T22:49:01.079 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:01.079 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2020-10-31T22:49:01.079 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "device_health_metrics" 2020-10-31T22:49:01.080 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:01.080 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:01.081 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2020-10-31T22:49:01.082 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2020-10-31T22:49:01.082 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:01.083 INFO:teuthology.orchestra.run.smithi060.stdout:] 2020-10-31T22:49:01.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.073+0000 7f79e0640700 1 -- 172.21.15.60:0/2369194487 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f79b8054f10 msgr2=0x7f79b80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:01.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.073+0000 7f79e0640700 1 --2- 172.21.15.60:0/2369194487 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f79b8054f10 0x7f79b80573d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f79c800b000 tx=0x7f79c80091a0).stop 2020-10-31T22:49:01.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.073+0000 7f79e0640700 1 -- 172.21.15.60:0/2369194487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79d80a9a40 msgr2=0x7f79d8143170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:01.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.073+0000 7f79e0640700 1 --2- 172.21.15.60:0/2369194487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79d80a9a40 0x7f79d8143170 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 rx=0x7f79d0002f30 tx=0x7f79d0016000).stop 2020-10-31T22:49:01.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.073+0000 7f79e0640700 1 -- 172.21.15.60:0/2369194487 shutdown_connections 2020-10-31T22:49:01.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.073+0000 7f79e0640700 1 --2- 172.21.15.60:0/2369194487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79d80a9a40 0x7f79d8143170 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:01.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.073+0000 7f79e0640700 1 --2- 172.21.15.60:0/2369194487 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f79b8054f10 0x7f79b80573d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:01.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.073+0000 7f79e0640700 1 --2- 172.21.15.60:0/2369194487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f79d81438a0 0x7f79d8145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:01.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.073+0000 7f79e0640700 1 --2- 172.21.15.60:0/2369194487 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79d814a420 0x7f79d8142c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:01.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.073+0000 7f79e0640700 1 -- 172.21.15.60:0/2369194487 >> 172.21.15.60:0/2369194487 conn(0x7f79d80b5d30 msgr2=0x7f79d80afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:01.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.073+0000 7f79e0640700 1 -- 172.21.15.60:0/2369194487 shutdown_connections 2020-10-31T22:49:01.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.073+0000 7f79e0640700 1 -- 172.21.15.60:0/2369194487 wait complete. 2020-10-31T22:49:01.098 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-10-31T22:49:01.099 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:49:01.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.213+0000 7f83229cd700 1 Processor -- start 2020-10-31T22:49:01.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.213+0000 7f83229cd700 1 -- start start 2020-10-31T22:49:01.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83229cd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f831c0acc60 0x7f831c0b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:01.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83229cd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f831c0ad610 0x7f831c0ada80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:01.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83229cd700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f831c05b700 con 0x7f831c05b320 2020-10-31T22:49:01.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83229cd700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c140750 con 0x7f831c0acc60 2020-10-31T22:49:01.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83229cd700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f831c0b0340 con 0x7f831c0ad610 2020-10-31T22:49:01.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83211ca700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f831c0acc60 0x7f831c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:01.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83211ca700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f831c0acc60 0x7f831c0b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47290/0 (socket says 172.21.15.60:47290) 2020-10-31T22:49:01.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83211ca700 1 -- 172.21.15.60:0/142872218 learned_addr learned my addr 172.21.15.60:0/142872218 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:01.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83221cc700 1 --2- 172.21.15.60:0/142872218 >> v2:172.21.15.66:3300/0 conn(0x7f831c0ad610 0x7f831c0ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:01.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83211ca700 1 -- 172.21.15.60:0/142872218 >> v2:172.21.15.66:3300/0 conn(0x7f831c0ad610 msgr2=0x7f831c0ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:01.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83211ca700 1 --2- 172.21.15.60:0/142872218 >> v2:172.21.15.66:3300/0 conn(0x7f831c0ad610 0x7f831c0ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:01.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83211ca700 1 -- 172.21.15.60:0/142872218 >> v1:172.21.15.66:6789/0 conn(0x7f831c05b320 legacy=0x7f831c0b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:01.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83211ca700 1 -- 172.21.15.60:0/142872218 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c0b05e0 con 0x7f831c0acc60 2020-10-31T22:49:01.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83211ca700 1 --2- 172.21.15.60:0/142872218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f831c0acc60 0x7f831c0b24c0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f8310002f30 tx=0x7f8310006e80).ready entity=mon.0 client_cookie=8e5eee8b3b8472c2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:01.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83209c9700 1 -- 172.21.15.60:0/142872218 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83100097f0 con 0x7f831c0acc60 2020-10-31T22:49:01.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83209c9700 1 -- 172.21.15.60:0/142872218 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8310009950 con 0x7f831c0acc60 2020-10-31T22:49:01.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83209c9700 1 -- 172.21.15.60:0/142872218 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8310009cb0 con 0x7f831c0acc60 2020-10-31T22:49:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83229cd700 1 -- 172.21.15.60:0/142872218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f831c0acc60 msgr2=0x7f831c0b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:01.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83229cd700 1 --2- 172.21.15.60:0/142872218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f831c0acc60 0x7f831c0b24c0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 rx=0x7f8310002f30 tx=0x7f8310006e80).stop 2020-10-31T22:49:01.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83229cd700 1 -- 172.21.15.60:0/142872218 shutdown_connections 2020-10-31T22:49:01.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83229cd700 1 --2- 172.21.15.60:0/142872218 >> v2:172.21.15.66:3300/0 conn(0x7f831c0ad610 0x7f831c0ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:01.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83229cd700 1 --2- 172.21.15.60:0/142872218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f831c0acc60 0x7f831c0b24c0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:01.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83229cd700 1 -- 172.21.15.60:0/142872218 >> 172.21.15.60:0/142872218 conn(0x7f831c0b61d0 msgr2=0x7f831c0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:01.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83229cd700 1 -- 172.21.15.60:0/142872218 shutdown_connections 2020-10-31T22:49:01.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.217+0000 7f83229cd700 1 -- 172.21.15.60:0/142872218 wait complete. 2020-10-31T22:49:01.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83229cd700 1 Processor -- start 2020-10-31T22:49:01.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83229cd700 1 -- start start 2020-10-31T22:49:01.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83229cd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f831c05b320 0x7f831c13cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83229cd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f831c0acc60 0x7f831c14f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83229cd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f831c0ad610 0x7f831c13b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83229cd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c14c6b0 con 0x7f831c05b320 2020-10-31T22:49:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83229cd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831c063e20 con 0x7f831c0acc60 2020-10-31T22:49:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83229cd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831c0640c0 con 0x7f831c0ad610 2020-10-31T22:49:01.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83219cb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f831c05b320 0x7f831c13cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83219cb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f831c05b320 0x7f831c13cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47294/0 (socket says 172.21.15.60:47294) 2020-10-31T22:49:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83219cb700 1 -- 172.21.15.60:0/3203486910 learned_addr learned my addr 172.21.15.60:0/3203486910 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83211ca700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f831c0acc60 0x7f831c14f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83221cc700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f831c0ad610 0x7f831c13b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:01.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83219cb700 1 -- 172.21.15.60:0/3203486910 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f831c0ad610 msgr2=0x7f831c13b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83219cb700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f831c0ad610 0x7f831c13b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83219cb700 1 -- 172.21.15.60:0/3203486910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f831c0acc60 msgr2=0x7f831c14f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83219cb700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f831c0acc60 0x7f831c14f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:01.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83219cb700 1 -- 172.21.15.60:0/3203486910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c141320 con 0x7f831c05b320 2020-10-31T22:49:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83211ca700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f831c0acc60 0x7f831c14f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83221cc700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f831c0ad610 0x7f831c13b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:01.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83219cb700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f831c05b320 0x7f831c13cc30 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f831c0b6d90 tx=0x7f8318007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f830effd700 1 -- 172.21.15.60:0/3203486910 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8318007030 con 0x7f831c05b320 2020-10-31T22:49:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f830effd700 1 -- 172.21.15.60:0/3203486910 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8318007190 con 0x7f831c05b320 2020-10-31T22:49:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83229cd700 1 -- 172.21.15.60:0/3203486910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f831c14f750 con 0x7f831c05b320 2020-10-31T22:49:01.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f830effd700 1 -- 172.21.15.60:0/3203486910 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83180064e0 con 0x7f831c05b320 2020-10-31T22:49:01.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.221+0000 7f83229cd700 1 -- 172.21.15.60:0/3203486910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c063b90 con 0x7f831c05b320 2020-10-31T22:49:01.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.225+0000 7f83229cd700 1 -- 172.21.15.60:0/3203486910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f831c064280 con 0x7f831c05b320 2020-10-31T22:49:01.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.225+0000 7f830effd700 1 -- 172.21.15.60:0/3203486910 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8318010070 con 0x7f831c05b320 2020-10-31T22:49:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.225+0000 7f830effd700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f82fc054f10 0x7f82fc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:01.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.225+0000 7f830effd700 1 -- 172.21.15.60:0/3203486910 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f831806ce80 con 0x7f831c05b320 2020-10-31T22:49:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.225+0000 7f83211ca700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f82fc054f10 0x7f82fc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.225+0000 7f83211ca700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f82fc054f10 0x7f82fc0573d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f831001a000 tx=0x7f8310015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:01.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.229+0000 7f830effd700 1 -- 172.21.15.60:0/3203486910 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f83180436d0 con 0x7f831c05b320 2020-10-31T22:49:01.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:01.369+0000 7f83229cd700 1 -- 172.21.15.60:0/3203486910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f831c057100 con 0x7f831c05b320 2020-10-31T22:49:02.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.361+0000 7f830effd700 1 -- 172.21.15.60:0/3203486910 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v106) v1 ==== 133+0+0 (secure 0 0 0) 0x7f8318018030 con 0x7f831c05b320 2020-10-31T22:49:02.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.369+0000 7f83229cd700 1 -- 172.21.15.60:0/3203486910 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f82fc054f10 msgr2=0x7f82fc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:02.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.369+0000 7f83229cd700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f82fc054f10 0x7f82fc0573d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f831001a000 tx=0x7f8310015000).stop 2020-10-31T22:49:02.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.369+0000 7f83229cd700 1 -- 172.21.15.60:0/3203486910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f831c05b320 msgr2=0x7f831c13cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:02.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.369+0000 7f83229cd700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f831c05b320 0x7f831c13cc30 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 rx=0x7f831c0b6d90 tx=0x7f8318007b50).stop 2020-10-31T22:49:02.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.369+0000 7f83229cd700 1 -- 172.21.15.60:0/3203486910 shutdown_connections 2020-10-31T22:49:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.369+0000 7f83229cd700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f831c0ad610 0x7f831c13b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.369+0000 7f83229cd700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f831c05b320 0x7f831c13cc30 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.369+0000 7f83229cd700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f82fc054f10 0x7f82fc0573d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.369+0000 7f83229cd700 1 --2- 172.21.15.60:0/3203486910 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f831c0acc60 0x7f831c14f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.369+0000 7f83229cd700 1 -- 172.21.15.60:0/3203486910 >> 172.21.15.60:0/3203486910 conn(0x7f831c0b61d0 msgr2=0x7f831c139540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:02.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.369+0000 7f83229cd700 1 -- 172.21.15.60:0/3203486910 shutdown_connections 2020-10-31T22:49:02.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.369+0000 7f83229cd700 1 -- 172.21.15.60:0/3203486910 wait complete. 2020-10-31T22:49:02.376 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:49:02.390 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-10-31T22:49:02.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.509+0000 7fa7cd9f5700 1 Processor -- start 2020-10-31T22:49:02.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.509+0000 7fa7cd9f5700 1 -- start start 2020-10-31T22:49:02.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.509+0000 7fa7cd9f5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7c80b5570 0x7fa7c80b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:02.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.509+0000 7fa7cd9f5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7c80b24a0 0x7fa7c8145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:02.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.509+0000 7fa7cd9f5700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa7c8145e40 0x7fa7c8141f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:02.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.509+0000 7fa7cd9f5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c813f930 con 0x7fa7c80b5570 2020-10-31T22:49:02.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.509+0000 7fa7cd9f5700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7c80b4440 con 0x7fa7c8145e40 2020-10-31T22:49:02.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.509+0000 7fa7cd9f5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c80b02f0 con 0x7fa7c80b24a0 2020-10-31T22:49:02.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.509+0000 7fa7cc9f3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7c80b5570 0x7fa7c80b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:02.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.509+0000 7fa7cc9f3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7c80b5570 0x7fa7c80b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47302/0 (socket says 172.21.15.60:47302) 2020-10-31T22:49:02.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.509+0000 7fa7cd1f4700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa7c8145e40 0x7fa7c8141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:02.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cc9f3700 1 -- 172.21.15.60:0/1884523506 learned_addr learned my addr 172.21.15.60:0/1884523506 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:02.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7c7fff700 1 --2- 172.21.15.60:0/1884523506 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7c80b24a0 0x7fa7c8145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd1f4700 1 -- 172.21.15.60:0/1884523506 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7c80b24a0 msgr2=0x7fa7c8145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd1f4700 1 --2- 172.21.15.60:0/1884523506 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7c80b24a0 0x7fa7c8145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd1f4700 1 -- 172.21.15.60:0/1884523506 >> v2:172.21.15.60:3300/0 conn(0x7fa7c80b5570 msgr2=0x7fa7c80b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:02.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd1f4700 1 --2- 172.21.15.60:0/1884523506 >> v2:172.21.15.60:3300/0 conn(0x7fa7c80b5570 0x7fa7c80b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd1f4700 1 -- 172.21.15.60:0/1884523506 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c80b0590 con 0x7fa7c8145e40 2020-10-31T22:49:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cc9f3700 1 --2- 172.21.15.60:0/1884523506 >> v2:172.21.15.60:3300/0 conn(0x7fa7c80b5570 0x7fa7c80b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd1f4700 1 --2- 172.21.15.60:0/1884523506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7c8145e40 0x7fa7c8141f00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fa7c8141c20 tx=0x7fa7c0006dc0).ready entity=mon.1 client_cookie=dc878485180011ca server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7c77fe700 1 -- 172.21.15.60:0/1884523506 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7c00095f0 con 0x7fa7c8145e40 2020-10-31T22:49:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7c77fe700 1 -- 172.21.15.60:0/1884523506 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c0009750 con 0x7fa7c8145e40 2020-10-31T22:49:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7c77fe700 1 -- 172.21.15.60:0/1884523506 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7c0009ab0 con 0x7fa7c8145e40 2020-10-31T22:49:02.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/1884523506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7c8145e40 msgr2=0x7fa7c8141f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:02.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd9f5700 1 --2- 172.21.15.60:0/1884523506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7c8145e40 0x7fa7c8141f00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fa7c8141c20 tx=0x7fa7c0006dc0).stop 2020-10-31T22:49:02.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/1884523506 shutdown_connections 2020-10-31T22:49:02.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd9f5700 1 --2- 172.21.15.60:0/1884523506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7c8145e40 0x7fa7c8141f00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:02.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd9f5700 1 --2- 172.21.15.60:0/1884523506 >> v2:172.21.15.60:3300/0 conn(0x7fa7c80b5570 0x7fa7c80b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:02.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd9f5700 1 --2- 172.21.15.60:0/1884523506 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7c80b24a0 0x7fa7c8145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:02.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/1884523506 >> 172.21.15.60:0/1884523506 conn(0x7fa7c80b8e90 msgr2=0x7fa7c80b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/1884523506 shutdown_connections 2020-10-31T22:49:02.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/1884523506 wait complete. 2020-10-31T22:49:02.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd9f5700 1 Processor -- start 2020-10-31T22:49:02.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.513+0000 7fa7cd9f5700 1 -- start start 2020-10-31T22:49:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd9f5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7c80b24a0 0x7fa7c8143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:02.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd9f5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7c80b5570 0x7fa7c80aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:02.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd9f5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7c8145e40 0x7fa7c80ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:02.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd9f5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c8147f90 con 0x7fa7c8145e40 2020-10-31T22:49:02.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd9f5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c8147890 con 0x7fa7c80b24a0 2020-10-31T22:49:02.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd9f5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c8144af0 con 0x7fa7c80b5570 2020-10-31T22:49:02.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd1f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7c8145e40 0x7fa7c80ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:02.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd1f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7c8145e40 0x7fa7c80ab540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47312/0 (socket says 172.21.15.60:47312) 2020-10-31T22:49:02.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd1f4700 1 -- 172.21.15.60:0/814305216 learned_addr learned my addr 172.21.15.60:0/814305216 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:02.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cc9f3700 1 --2- 172.21.15.60:0/814305216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7c80b24a0 0x7fa7c8143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:02.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7c7fff700 1 --2- 172.21.15.60:0/814305216 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7c80b5570 0x7fa7c80aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:02.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd1f4700 1 -- 172.21.15.60:0/814305216 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7c80b5570 msgr2=0x7fa7c80aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:02.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd1f4700 1 --2- 172.21.15.60:0/814305216 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7c80b5570 0x7fa7c80aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:02.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd1f4700 1 -- 172.21.15.60:0/814305216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7c80b24a0 msgr2=0x7fa7c8143fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:02.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd1f4700 1 --2- 172.21.15.60:0/814305216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7c80b24a0 0x7fa7c8143fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:02.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd1f4700 1 -- 172.21.15.60:0/814305216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c8144850 con 0x7fa7c8145e40 2020-10-31T22:49:02.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd1f4700 1 --2- 172.21.15.60:0/814305216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7c8145e40 0x7fa7c80ab540 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7fa7c8141c20 tx=0x7fa7c0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:02.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7c5ffb700 1 -- 172.21.15.60:0/814305216 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7c00119a0 con 0x7fa7c8145e40 2020-10-31T22:49:02.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7c5ffb700 1 -- 172.21.15.60:0/814305216 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c0011b00 con 0x7fa7c8145e40 2020-10-31T22:49:02.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/814305216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c8147af0 con 0x7fa7c8145e40 2020-10-31T22:49:02.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7c5ffb700 1 -- 172.21.15.60:0/814305216 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7c0011e60 con 0x7fa7c8145e40 2020-10-31T22:49:02.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.517+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/814305216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c81430d0 con 0x7fa7c8145e40 2020-10-31T22:49:02.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.521+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/814305216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c809e030 con 0x7fa7c8145e40 2020-10-31T22:49:02.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.521+0000 7fa7c5ffb700 1 -- 172.21.15.60:0/814305216 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa7c0024030 con 0x7fa7c8145e40 2020-10-31T22:49:02.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.521+0000 7fa7c5ffb700 1 --2- 172.21.15.60:0/814305216 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa7ac0550c0 0x7fa7ac057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:02.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.521+0000 7fa7c5ffb700 1 -- 172.21.15.60:0/814305216 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fa7c006e5d0 con 0x7fa7c8145e40 2020-10-31T22:49:02.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.521+0000 7fa7cc9f3700 1 --2- 172.21.15.60:0/814305216 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa7ac0550c0 0x7fa7ac057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:02.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.521+0000 7fa7cc9f3700 1 --2- 172.21.15.60:0/814305216 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa7ac0550c0 0x7fa7ac057580 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fa7b0008000 tx=0x7fa7b0008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:02.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.529+0000 7fa7c5ffb700 1 -- 172.21.15.60:0/814305216 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa7c0044d00 con 0x7fa7c8145e40 2020-10-31T22:49:02.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:02.677+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/814305216 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fa7c80ad690 con 0x7fa7c8145e40 2020-10-31T22:49:03.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.565+0000 7fa7c5ffb700 1 -- 172.21.15.60:0/814305216 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v108) v1 ==== 125+0+0 (secure 0 0 0) 0x7fa7c0022020 con 0x7fa7c8145e40 2020-10-31T22:49:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.569+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/814305216 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa7ac0550c0 msgr2=0x7fa7ac057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:03.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.569+0000 7fa7cd9f5700 1 --2- 172.21.15.60:0/814305216 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa7ac0550c0 0x7fa7ac057580 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7fa7b0008000 tx=0x7fa7b0008040).stop 2020-10-31T22:49:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.569+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/814305216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7c8145e40 msgr2=0x7fa7c80ab540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.569+0000 7fa7cd9f5700 1 --2- 172.21.15.60:0/814305216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7c8145e40 0x7fa7c80ab540 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 rx=0x7fa7c8141c20 tx=0x7fa7c0015000).stop 2020-10-31T22:49:03.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.569+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/814305216 shutdown_connections 2020-10-31T22:49:03.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.569+0000 7fa7cd9f5700 1 --2- 172.21.15.60:0/814305216 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7c8145e40 0x7fa7c80ab540 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.569+0000 7fa7cd9f5700 1 --2- 172.21.15.60:0/814305216 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa7ac0550c0 0x7fa7ac057580 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.569+0000 7fa7cd9f5700 1 --2- 172.21.15.60:0/814305216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7c80b24a0 0x7fa7c8143fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.569+0000 7fa7cd9f5700 1 --2- 172.21.15.60:0/814305216 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7c80b5570 0x7fa7c80aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.569+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/814305216 >> 172.21.15.60:0/814305216 conn(0x7fa7c80b8e90 msgr2=0x7fa7c813fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:03.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.569+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/814305216 shutdown_connections 2020-10-31T22:49:03.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.569+0000 7fa7cd9f5700 1 -- 172.21.15.60:0/814305216 wait complete. 2020-10-31T22:49:03.581 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2020-10-31T22:49:03.591 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-10-31T22:49:03.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.705+0000 7fe84d837700 1 Processor -- start 2020-10-31T22:49:03.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.705+0000 7fe84d837700 1 -- start start 2020-10-31T22:49:03.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.705+0000 7fe84d837700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe8480ac8d0 0x7fe8480accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:03.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.705+0000 7fe84d837700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe8480ae7c0 0x7fe848066f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:03.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.705+0000 7fe84d837700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe848067450 0x7fe8480ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:03.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.705+0000 7fe84d837700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84813fad0 con 0x7fe8480ae7c0 2020-10-31T22:49:03.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.705+0000 7fe84d837700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8480ad1a0 con 0x7fe8480ac8d0 2020-10-31T22:49:03.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.705+0000 7fe84d837700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe848145470 con 0x7fe848067450 2020-10-31T22:49:03.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.705+0000 7fe8467fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe8480ae7c0 0x7fe848066f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:03.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe8467fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe8480ae7c0 0x7fe848066f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47318/0 (socket says 172.21.15.60:47318) 2020-10-31T22:49:03.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe8467fc700 1 -- 172.21.15.60:0/450190209 learned_addr learned my addr 172.21.15.60:0/450190209 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:03.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe8477fe700 1 --2- 172.21.15.60:0/450190209 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe848067450 0x7fe8480ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:03.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe846ffd700 1 --2- 172.21.15.60:0/450190209 >> v2:172.21.15.66:3300/0 conn(0x7fe8480ac8d0 0x7fe8480accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:03.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe8467fc700 1 -- 172.21.15.60:0/450190209 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe848067450 msgr2=0x7fe8480ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:03.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe8467fc700 1 --2- 172.21.15.60:0/450190209 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe848067450 0x7fe8480ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe8467fc700 1 -- 172.21.15.60:0/450190209 >> v2:172.21.15.66:3300/0 conn(0x7fe8480ac8d0 msgr2=0x7fe8480accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:03.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe8467fc700 1 --2- 172.21.15.60:0/450190209 >> v2:172.21.15.66:3300/0 conn(0x7fe8480ac8d0 0x7fe8480accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe8467fc700 1 -- 172.21.15.60:0/450190209 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe848145710 con 0x7fe8480ae7c0 2020-10-31T22:49:03.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe8467fc700 1 --2- 172.21.15.60:0/450190209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8480ae7c0 0x7fe848066f60 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fe8380032b0 tx=0x7fe838009270).ready entity=mon.0 client_cookie=d74183b93f5b6d69 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:03.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe845ffb700 1 -- 172.21.15.60:0/450190209 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe838009e60 con 0x7fe8480ae7c0 2020-10-31T22:49:03.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe845ffb700 1 -- 172.21.15.60:0/450190209 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83800bb50 con 0x7fe8480ae7c0 2020-10-31T22:49:03.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe845ffb700 1 -- 172.21.15.60:0/450190209 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe83800bcc0 con 0x7fe8480ae7c0 2020-10-31T22:49:03.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe84d837700 1 -- 172.21.15.60:0/450190209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8480ae7c0 msgr2=0x7fe848066f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:03.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe84d837700 1 --2- 172.21.15.60:0/450190209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8480ae7c0 0x7fe848066f60 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 rx=0x7fe8380032b0 tx=0x7fe838009270).stop 2020-10-31T22:49:03.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe84d837700 1 -- 172.21.15.60:0/450190209 shutdown_connections 2020-10-31T22:49:03.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe84d837700 1 --2- 172.21.15.60:0/450190209 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe848067450 0x7fe8480ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe84d837700 1 --2- 172.21.15.60:0/450190209 >> v2:172.21.15.66:3300/0 conn(0x7fe8480ac8d0 0x7fe8480accb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe84d837700 1 --2- 172.21.15.60:0/450190209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8480ae7c0 0x7fe848066f60 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe84d837700 1 -- 172.21.15.60:0/450190209 >> 172.21.15.60:0/450190209 conn(0x7fe84806a260 msgr2=0x7fe848061e50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:03.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe84d837700 1 -- 172.21.15.60:0/450190209 shutdown_connections 2020-10-31T22:49:03.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe84d837700 1 -- 172.21.15.60:0/450190209 wait complete. 2020-10-31T22:49:03.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe84d837700 1 Processor -- start 2020-10-31T22:49:03.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.709+0000 7fe84d837700 1 -- start start 2020-10-31T22:49:03.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe84d837700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8480ac8d0 0x7fe84809e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:03.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe84d837700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8480ae7c0 0x7fe8480a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:03.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe84d837700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe848142290 0x7fe84813e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:03.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe84d837700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84809f560 con 0x7fe8480ae7c0 2020-10-31T22:49:03.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe84d837700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84809de90 con 0x7fe848142290 2020-10-31T22:49:03.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe84d837700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84809e0c0 con 0x7fe8480ac8d0 2020-10-31T22:49:03.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe8467fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8480ae7c0 0x7fe8480a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:03.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe8467fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8480ae7c0 0x7fe8480a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47324/0 (socket says 172.21.15.60:47324) 2020-10-31T22:49:03.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe8467fc700 1 -- 172.21.15.60:0/878930073 learned_addr learned my addr 172.21.15.60:0/878930073 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:03.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe846ffd700 1 --2- 172.21.15.60:0/878930073 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8480ac8d0 0x7fe84809e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:03.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe8477fe700 1 --2- 172.21.15.60:0/878930073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe848142290 0x7fe84813e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:03.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe8467fc700 1 -- 172.21.15.60:0/878930073 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8480ac8d0 msgr2=0x7fe84809e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:03.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe8467fc700 1 --2- 172.21.15.60:0/878930073 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8480ac8d0 0x7fe84809e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe8467fc700 1 -- 172.21.15.60:0/878930073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe848142290 msgr2=0x7fe84813e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:03.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe8467fc700 1 --2- 172.21.15.60:0/878930073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe848142290 0x7fe84813e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe8467fc700 1 -- 172.21.15.60:0/878930073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8481518e0 con 0x7fe8480ae7c0 2020-10-31T22:49:03.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe8467fc700 1 --2- 172.21.15.60:0/878930073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8480ae7c0 0x7fe8480a0380 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7fe8380032b0 tx=0x7fe838016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:03.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe83ffff700 1 -- 172.21.15.60:0/878930073 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe83801f3f0 con 0x7fe8480ae7c0 2020-10-31T22:49:03.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe83ffff700 1 -- 172.21.15.60:0/878930073 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83801f550 con 0x7fe8480ae7c0 2020-10-31T22:49:03.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe84d837700 1 -- 172.21.15.60:0/878930073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe848151630 con 0x7fe8480ae7c0 2020-10-31T22:49:03.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe83ffff700 1 -- 172.21.15.60:0/878930073 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe83801f8b0 con 0x7fe8480ae7c0 2020-10-31T22:49:03.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe84d837700 1 -- 172.21.15.60:0/878930073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe848144310 con 0x7fe8480ae7c0 2020-10-31T22:49:03.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.713+0000 7fe84d837700 1 -- 172.21.15.60:0/878930073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe848057100 con 0x7fe8480ae7c0 2020-10-31T22:49:03.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.717+0000 7fe83ffff700 1 -- 172.21.15.60:0/878930073 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe838026030 con 0x7fe8480ae7c0 2020-10-31T22:49:03.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.717+0000 7fe83ffff700 1 --2- 172.21.15.60:0/878930073 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe82c054f10 0x7fe82c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:03.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.717+0000 7fe83ffff700 1 -- 172.21.15.60:0/878930073 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fe83806e380 con 0x7fe8480ae7c0 2020-10-31T22:49:03.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.717+0000 7fe846ffd700 1 --2- 172.21.15.60:0/878930073 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe82c054f10 0x7fe82c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:03.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.717+0000 7fe846ffd700 1 --2- 172.21.15.60:0/878930073 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe82c054f10 0x7fe82c0573d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fe83000b000 tx=0x7fe830006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:03.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.721+0000 7fe83ffff700 1 -- 172.21.15.60:0/878930073 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe838044910 con 0x7fe8480ae7c0 2020-10-31T22:49:03.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.913+0000 7fe84d837700 1 -- 172.21.15.60:0/878930073 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fe848151a70 con 0x7fe8480ae7c0 2020-10-31T22:49:03.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.925+0000 7fe83ffff700 1 -- 172.21.15.60:0/878930073 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 19 and data pool 20 v52) v1 ==== 189+0+0 (secure 0 0 0) 0x7fe8380240d0 con 0x7fe8480ae7c0 2020-10-31T22:49:03.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.933+0000 7fe84d837700 1 -- 172.21.15.60:0/878930073 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe82c054f10 msgr2=0x7fe82c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:03.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.933+0000 7fe84d837700 1 --2- 172.21.15.60:0/878930073 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe82c054f10 0x7fe82c0573d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fe83000b000 tx=0x7fe830006dc0).stop 2020-10-31T22:49:03.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.933+0000 7fe84d837700 1 -- 172.21.15.60:0/878930073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8480ae7c0 msgr2=0x7fe8480a0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:03.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.933+0000 7fe84d837700 1 --2- 172.21.15.60:0/878930073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8480ae7c0 0x7fe8480a0380 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 rx=0x7fe8380032b0 tx=0x7fe838016000).stop 2020-10-31T22:49:03.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.933+0000 7fe84d837700 1 -- 172.21.15.60:0/878930073 shutdown_connections 2020-10-31T22:49:03.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.933+0000 7fe84d837700 1 --2- 172.21.15.60:0/878930073 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe82c054f10 0x7fe82c0573d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.933+0000 7fe84d837700 1 --2- 172.21.15.60:0/878930073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe848142290 0x7fe84813e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.933+0000 7fe84d837700 1 --2- 172.21.15.60:0/878930073 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8480ac8d0 0x7fe84809e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.933+0000 7fe84d837700 1 --2- 172.21.15.60:0/878930073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8480ae7c0 0x7fe8480a0380 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:03.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.933+0000 7fe84d837700 1 -- 172.21.15.60:0/878930073 >> 172.21.15.60:0/878930073 conn(0x7fe84806a260 msgr2=0x7fe8480afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:03.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.937+0000 7fe84d837700 1 -- 172.21.15.60:0/878930073 shutdown_connections 2020-10-31T22:49:03.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:03.937+0000 7fe84d837700 1 -- 172.21.15.60:0/878930073 wait complete. 2020-10-31T22:49:03.944 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 19 and data pool 20 2020-10-31T22:49:03.957 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:49:04.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.049+0000 7feec4428700 1 Processor -- start 2020-10-31T22:49:04.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 -- start start 2020-10-31T22:49:04.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7feebc05c4c0 0x7feebc05c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feebc0b2e20 0x7feebc146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feebc0b4410 0x7feebc13f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feebc141ef0 con 0x7feebc0b4410 2020-10-31T22:49:04.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feebc065e90 con 0x7feebc05c4c0 2020-10-31T22:49:04.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc066130 con 0x7feebc0b2e20 2020-10-31T22:49:04.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec29c5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feebc0b4410 0x7feebc13f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec29c5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feebc0b4410 0x7feebc13f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47346/0 (socket says 172.21.15.60:47346) 2020-10-31T22:49:04.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec29c5700 1 -- 172.21.15.60:0/661007691 learned_addr learned my addr 172.21.15.60:0/661007691 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:04.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec19c3700 1 --2- 172.21.15.60:0/661007691 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feebc0b2e20 0x7feebc146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec21c4700 1 --2- 172.21.15.60:0/661007691 >> v2:172.21.15.66:3300/0 conn(0x7feebc05c4c0 0x7feebc05c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec29c5700 1 -- 172.21.15.60:0/661007691 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feebc0b2e20 msgr2=0x7feebc146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:04.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec29c5700 1 --2- 172.21.15.60:0/661007691 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feebc0b2e20 0x7feebc146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec29c5700 1 -- 172.21.15.60:0/661007691 >> v2:172.21.15.66:3300/0 conn(0x7feebc05c4c0 msgr2=0x7feebc05c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:04.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec29c5700 1 --2- 172.21.15.60:0/661007691 >> v2:172.21.15.66:3300/0 conn(0x7feebc05c4c0 0x7feebc05c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec29c5700 1 -- 172.21.15.60:0/661007691 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc0663d0 con 0x7feebc0b4410 2020-10-31T22:49:04.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec19c3700 1 --2- 172.21.15.60:0/661007691 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feebc0b2e20 0x7feebc146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:04.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec21c4700 1 --2- 172.21.15.60:0/661007691 >> v2:172.21.15.66:3300/0 conn(0x7feebc05c4c0 0x7feebc05c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec29c5700 1 --2- 172.21.15.60:0/661007691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc0b4410 0x7feebc13f390 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7feeb4002f30 tx=0x7feeb4006e80).ready entity=mon.0 client_cookie=56f191d1bf73fc7c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec11c2700 1 -- 172.21.15.60:0/661007691 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feeb40097f0 con 0x7feebc0b4410 2020-10-31T22:49:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec11c2700 1 -- 172.21.15.60:0/661007691 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4009950 con 0x7feebc0b4410 2020-10-31T22:49:04.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 -- 172.21.15.60:0/661007691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc0b4410 msgr2=0x7feebc13f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec11c2700 1 -- 172.21.15.60:0/661007691 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feeb4009cb0 con 0x7feebc0b4410 2020-10-31T22:49:04.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 --2- 172.21.15.60:0/661007691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc0b4410 0x7feebc13f390 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 rx=0x7feeb4002f30 tx=0x7feeb4006e80).stop 2020-10-31T22:49:04.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 -- 172.21.15.60:0/661007691 shutdown_connections 2020-10-31T22:49:04.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 --2- 172.21.15.60:0/661007691 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc0b4410 0x7feebc13f390 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 --2- 172.21.15.60:0/661007691 >> v2:172.21.15.66:3300/0 conn(0x7feebc05c4c0 0x7feebc05c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 --2- 172.21.15.60:0/661007691 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feebc0b2e20 0x7feebc146020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 -- 172.21.15.60:0/661007691 >> 172.21.15.60:0/661007691 conn(0x7feebc0601e0 msgr2=0x7feebc05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:04.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 -- 172.21.15.60:0/661007691 shutdown_connections 2020-10-31T22:49:04.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.053+0000 7feec4428700 1 -- 172.21.15.60:0/661007691 wait complete. 2020-10-31T22:49:04.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec4428700 1 Processor -- start 2020-10-31T22:49:04.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec4428700 1 -- start start 2020-10-31T22:49:04.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec4428700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feebc05c4c0 0x7feebc145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec4428700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feebc0b4410 0x7feebc0adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec4428700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc0ab7a0 0x7feebc0ae4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec4428700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0ae9a0 con 0x7feebc0ab7a0 2020-10-31T22:49:04.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec4428700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0aec80 con 0x7feebc05c4c0 2020-10-31T22:49:04.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec4428700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0aef20 con 0x7feebc0b4410 2020-10-31T22:49:04.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec29c5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc0ab7a0 0x7feebc0ae4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec29c5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc0ab7a0 0x7feebc0ae4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47352/0 (socket says 172.21.15.60:47352) 2020-10-31T22:49:04.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec29c5700 1 -- 172.21.15.60:0/2286284112 learned_addr learned my addr 172.21.15.60:0/2286284112 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:04.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec21c4700 1 --2- 172.21.15.60:0/2286284112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feebc05c4c0 0x7feebc145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec19c3700 1 --2- 172.21.15.60:0/2286284112 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feebc0b4410 0x7feebc0adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec29c5700 1 -- 172.21.15.60:0/2286284112 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feebc0b4410 msgr2=0x7feebc0adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec29c5700 1 --2- 172.21.15.60:0/2286284112 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feebc0b4410 0x7feebc0adfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec29c5700 1 -- 172.21.15.60:0/2286284112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feebc05c4c0 msgr2=0x7feebc145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec29c5700 1 --2- 172.21.15.60:0/2286284112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feebc05c4c0 0x7feebc145740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec29c5700 1 -- 172.21.15.60:0/2286284112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc0af1c0 con 0x7feebc0ab7a0 2020-10-31T22:49:04.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec29c5700 1 --2- 172.21.15.60:0/2286284112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc0ab7a0 0x7feebc0ae4b0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7feeb4002f30 tx=0x7feeb4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:04.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feeaf7fe700 1 -- 172.21.15.60:0/2286284112 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feeb4011b00 con 0x7feebc0ab7a0 2020-10-31T22:49:04.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feeaf7fe700 1 -- 172.21.15.60:0/2286284112 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb4011c60 con 0x7feebc0ab7a0 2020-10-31T22:49:04.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec4428700 1 -- 172.21.15.60:0/2286284112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feebc0af460 con 0x7feebc0ab7a0 2020-10-31T22:49:04.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feeaf7fe700 1 -- 172.21.15.60:0/2286284112 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feeb401e460 con 0x7feebc0ab7a0 2020-10-31T22:49:04.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.057+0000 7feec4428700 1 -- 172.21.15.60:0/2286284112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feebc0abd20 con 0x7feebc0ab7a0 2020-10-31T22:49:04.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.061+0000 7feec4428700 1 -- 172.21.15.60:0/2286284112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feebc0af5f0 con 0x7feebc0ab7a0 2020-10-31T22:49:04.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.061+0000 7feeaf7fe700 1 -- 172.21.15.60:0/2286284112 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7feeb401a040 con 0x7feebc0ab7a0 2020-10-31T22:49:04.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.061+0000 7feeaf7fe700 1 --2- 172.21.15.60:0/2286284112 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee9c054f10 0x7fee9c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.061+0000 7feeaf7fe700 1 -- 172.21.15.60:0/2286284112 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6073+0+0 (secure 0 0 0) 0x7feeb406e9d0 con 0x7feebc0ab7a0 2020-10-31T22:49:04.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.061+0000 7feec21c4700 1 --2- 172.21.15.60:0/2286284112 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee9c054f10 0x7fee9c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.061+0000 7feec21c4700 1 --2- 172.21.15.60:0/2286284112 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee9c054f10 0x7fee9c0573d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7feeb800c000 tx=0x7feeb8008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:04.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.069+0000 7feeaf7fe700 1 -- 172.21.15.60:0/2286284112 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7feeb4044ef0 con 0x7feebc0ab7a0 2020-10-31T22:49:04.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.217+0000 7feec4428700 1 -- 172.21.15.60:0/2286284112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feebc057100 con 0x7feebc0ab7a0 2020-10-31T22:49:04.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.217+0000 7feeaf7fe700 1 -- 172.21.15.60:0/2286284112 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16065 (secure 0 0 0) 0x7feeb4023020 con 0x7feebc0ab7a0 2020-10-31T22:49:04.224 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:04.224 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":109,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:49:03.919528+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:49:01.432008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2020-10-31T22:49:02.732480+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:49:04.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.221+0000 7feec4428700 1 -- 172.21.15.60:0/2286284112 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee9c054f10 msgr2=0x7fee9c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.221+0000 7feec4428700 1 --2- 172.21.15.60:0/2286284112 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee9c054f10 0x7fee9c0573d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7feeb800c000 tx=0x7feeb8008040).stop 2020-10-31T22:49:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.221+0000 7feec4428700 1 -- 172.21.15.60:0/2286284112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc0ab7a0 msgr2=0x7feebc0ae4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.221+0000 7feec4428700 1 --2- 172.21.15.60:0/2286284112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc0ab7a0 0x7feebc0ae4b0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 rx=0x7feeb4002f30 tx=0x7feeb4015000).stop 2020-10-31T22:49:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.221+0000 7feec4428700 1 -- 172.21.15.60:0/2286284112 shutdown_connections 2020-10-31T22:49:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.221+0000 7feec4428700 1 --2- 172.21.15.60:0/2286284112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feebc0ab7a0 0x7feebc0ae4b0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.221+0000 7feec4428700 1 --2- 172.21.15.60:0/2286284112 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fee9c054f10 0x7fee9c0573d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.221+0000 7feec4428700 1 --2- 172.21.15.60:0/2286284112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feebc05c4c0 0x7feebc145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.221+0000 7feec4428700 1 --2- 172.21.15.60:0/2286284112 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feebc0b4410 0x7feebc0adfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.221+0000 7feec4428700 1 -- 172.21.15.60:0/2286284112 >> 172.21.15.60:0/2286284112 conn(0x7feebc0601e0 msgr2=0x7feebc0b4f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.221+0000 7feec4428700 1 -- 172.21.15.60:0/2286284112 shutdown_connections 2020-10-31T22:49:04.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.221+0000 7feec4428700 1 -- 172.21.15.60:0/2286284112 wait complete. 2020-10-31T22:49:04.238 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:49:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.345+0000 7fe31a91a700 1 Processor -- start 2020-10-31T22:49:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.345+0000 7fe31a91a700 1 -- start start 2020-10-31T22:49:04.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe31a91a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3140b1a10 0x7fe314142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe31a91a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3140abea0 con 0x7fe31413ebe0 2020-10-31T22:49:04.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe31a91a700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe314141870 con 0x7fe3140af200 2020-10-31T22:49:04.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe31a91a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe314141b10 con 0x7fe3140b1a10 2020-10-31T22:49:04.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe319918700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe3140b1a10 0x7fe314142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe319117700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe31413ebe0 0x7fe3140afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51492/0 (socket says 172.21.15.60:51492) 2020-10-31T22:49:04.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe319117700 1 -- 172.21.15.60:0/1563979350 learned_addr learned my addr 172.21.15.60:0/1563979350 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:04.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe318916700 1 -- 172.21.15.60:0/1563979350 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1188745863 0 0) 0x7fe3140abea0 con 0x7fe31413ebe0 2020-10-31T22:49:04.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe318916700 1 -- 172.21.15.60:0/1563979350 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2f4003230 con 0x7fe31413ebe0 2020-10-31T22:49:04.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe319918700 1 -- 172.21.15.60:0/1563979350 >> v1:172.21.15.66:6789/0 conn(0x7fe3140af200 legacy=0x7fe3140b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe319918700 1 -- 172.21.15.60:0/1563979350 >> v1:172.21.15.60:6789/0 conn(0x7fe31413ebe0 legacy=0x7fe3140afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe319918700 1 -- 172.21.15.60:0/1563979350 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314141db0 con 0x7fe3140b1a10 2020-10-31T22:49:04.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe319918700 1 --2- 172.21.15.60:0/1563979350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3140b1a10 0x7fe314142250 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7fe304002f30 tx=0x7fe304006dc0).ready entity=mon.0 client_cookie=d9451216263c2d5c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:04.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe318916700 1 -- 172.21.15.60:0/1563979350 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe304009800 con 0x7fe3140b1a10 2020-10-31T22:49:04.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe318916700 1 -- 172.21.15.60:0/1563979350 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe304009960 con 0x7fe3140b1a10 2020-10-31T22:49:04.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe318916700 1 -- 172.21.15.60:0/1563979350 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe304009cc0 con 0x7fe3140b1a10 2020-10-31T22:49:04.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe31a91a700 1 -- 172.21.15.60:0/1563979350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3140b1a10 msgr2=0x7fe314142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe31a91a700 1 --2- 172.21.15.60:0/1563979350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3140b1a10 0x7fe314142250 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 rx=0x7fe304002f30 tx=0x7fe304006dc0).stop 2020-10-31T22:49:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe31a91a700 1 -- 172.21.15.60:0/1563979350 shutdown_connections 2020-10-31T22:49:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe31a91a700 1 --2- 172.21.15.60:0/1563979350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3140b1a10 0x7fe314142250 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe31a91a700 1 -- 172.21.15.60:0/1563979350 >> 172.21.15.60:0/1563979350 conn(0x7fe3140b5300 msgr2=0x7fe3140b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe31a91a700 1 -- 172.21.15.60:0/1563979350 shutdown_connections 2020-10-31T22:49:04.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.349+0000 7fe31a91a700 1 -- 172.21.15.60:0/1563979350 wait complete. 2020-10-31T22:49:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe31a91a700 1 Processor -- start 2020-10-31T22:49:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe31a91a700 1 -- start start 2020-10-31T22:49:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe31a91a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3140af200 0x7fe3140b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe31a91a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3140b1a10 0x7fe314152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe31a91a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31413ebe0 0x7fe314152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe31a91a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe314063330 con 0x7fe3140b1a10 2020-10-31T22:49:04.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe31a91a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3140635d0 con 0x7fe3140af200 2020-10-31T22:49:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe31a91a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe314063870 con 0x7fe31413ebe0 2020-10-31T22:49:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe319117700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3140b1a10 0x7fe314152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe319117700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3140b1a10 0x7fe314152180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47364/0 (socket says 172.21.15.60:47364) 2020-10-31T22:49:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe319117700 1 -- 172.21.15.60:0/2854110582 learned_addr learned my addr 172.21.15.60:0/2854110582 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe319918700 1 --2- 172.21.15.60:0/2854110582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3140af200 0x7fe3140b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe31a119700 1 --2- 172.21.15.60:0/2854110582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31413ebe0 0x7fe314152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe319117700 1 -- 172.21.15.60:0/2854110582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31413ebe0 msgr2=0x7fe314152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe319117700 1 --2- 172.21.15.60:0/2854110582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31413ebe0 0x7fe314152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe319117700 1 -- 172.21.15.60:0/2854110582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3140af200 msgr2=0x7fe3140b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe319117700 1 --2- 172.21.15.60:0/2854110582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3140af200 0x7fe3140b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe319117700 1 -- 172.21.15.60:0/2854110582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314063b10 con 0x7fe3140b1a10 2020-10-31T22:49:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe319117700 1 --2- 172.21.15.60:0/2854110582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3140b1a10 0x7fe314152180 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fe2fc001450 tx=0x7fe2fc007e20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:04.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe312ffd700 1 -- 172.21.15.60:0/2854110582 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2fc00cea0 con 0x7fe3140b1a10 2020-10-31T22:49:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe312ffd700 1 -- 172.21.15.60:0/2854110582 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2fc005b70 con 0x7fe3140b1a10 2020-10-31T22:49:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe312ffd700 1 -- 172.21.15.60:0/2854110582 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe2fc007110 con 0x7fe3140b1a10 2020-10-31T22:49:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe31a91a700 1 -- 172.21.15.60:0/2854110582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe314152b60 con 0x7fe3140b1a10 2020-10-31T22:49:04.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.353+0000 7fe31a91a700 1 -- 172.21.15.60:0/2854110582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3140648a0 con 0x7fe3140b1a10 2020-10-31T22:49:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.357+0000 7fe31a91a700 1 -- 172.21.15.60:0/2854110582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3140641f0 con 0x7fe3140b1a10 2020-10-31T22:49:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.357+0000 7fe312ffd700 1 -- 172.21.15.60:0/2854110582 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe2fc010030 con 0x7fe3140b1a10 2020-10-31T22:49:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.357+0000 7fe312ffd700 1 --2- 172.21.15.60:0/2854110582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe2f8054f10 0x7fe2f80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.357+0000 7fe312ffd700 1 -- 172.21.15.60:0/2854110582 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe2fc06da20 con 0x7fe3140b1a10 2020-10-31T22:49:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.357+0000 7fe319918700 1 --2- 172.21.15.60:0/2854110582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe2f8054f10 0x7fe2f80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.357+0000 7fe319918700 1 --2- 172.21.15.60:0/2854110582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe2f8054f10 0x7fe2f80573d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fe30401a000 tx=0x7fe304015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:04.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.365+0000 7fe312ffd700 1 -- 172.21.15.60:0/2854110582 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe3140641f0 con 0x7fe3140b1a10 2020-10-31T22:49:04.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.509+0000 7fe31a91a700 1 -- 172.21.15.60:0/2854110582 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe3140641f0 con 0x7fe3140b1a10 2020-10-31T22:49:04.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.513+0000 7fe312ffd700 1 -- 172.21.15.60:0/2854110582 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+16065 (secure 0 0 0) 0x7fe3140641f0 con 0x7fe3140b1a10 2020-10-31T22:49:04.519 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:04.520 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":109,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:49:03.919528+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:49:01.432008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2020-10-31T22:49:02.732480+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:49:04.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.513+0000 7fe31a91a700 1 -- 172.21.15.60:0/2854110582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe2f8054f10 msgr2=0x7fe2f80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.513+0000 7fe31a91a700 1 --2- 172.21.15.60:0/2854110582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe2f8054f10 0x7fe2f80573d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7fe30401a000 tx=0x7fe304015000).stop 2020-10-31T22:49:04.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.513+0000 7fe31a91a700 1 -- 172.21.15.60:0/2854110582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3140b1a10 msgr2=0x7fe314152180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.513+0000 7fe31a91a700 1 --2- 172.21.15.60:0/2854110582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3140b1a10 0x7fe314152180 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 rx=0x7fe2fc001450 tx=0x7fe2fc007e20).stop 2020-10-31T22:49:04.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.513+0000 7fe31a91a700 1 -- 172.21.15.60:0/2854110582 shutdown_connections 2020-10-31T22:49:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.513+0000 7fe31a91a700 1 --2- 172.21.15.60:0/2854110582 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe31413ebe0 0x7fe314152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.513+0000 7fe31a91a700 1 --2- 172.21.15.60:0/2854110582 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe2f8054f10 0x7fe2f80573d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.513+0000 7fe31a91a700 1 --2- 172.21.15.60:0/2854110582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe3140af200 0x7fe3140b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.513+0000 7fe31a91a700 1 --2- 172.21.15.60:0/2854110582 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe3140b1a10 0x7fe314152180 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.513+0000 7fe31a91a700 1 -- 172.21.15.60:0/2854110582 >> 172.21.15.60:0/2854110582 conn(0x7fe3140b5300 msgr2=0x7fe3140b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.513+0000 7fe31a91a700 1 -- 172.21.15.60:0/2854110582 shutdown_connections 2020-10-31T22:49:04.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.513+0000 7fe31a91a700 1 -- 172.21.15.60:0/2854110582 wait complete. 2020-10-31T22:49:04.533 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-10-31T22:49:04.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.645+0000 7f0a5ffff700 1 Processor -- start 2020-10-31T22:49:04.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5ffff700 1 -- start start 2020-10-31T22:49:04.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5ffff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0a600b5380 0x7f0a600ac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0a600b0b50 0x7f0a600b1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600b1b20 0x7f0a600b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5ffff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a600ad650 con 0x7f0a600b0b50 2020-10-31T22:49:04.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5ffff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a600acd60 con 0x7f0a600b5380 2020-10-31T22:49:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a600b5760 con 0x7f0a600b1b20 2020-10-31T22:49:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5e7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0a600b0b50 0x7f0a600b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5e7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0a600b0b50 0x7f0a600b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47370/0 (socket says 172.21.15.60:47370) 2020-10-31T22:49:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5e7fc700 1 -- 172.21.15.60:0/547407850 learned_addr learned my addr 172.21.15.60:0/547407850 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:04.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5effd700 1 --2- 172.21.15.60:0/547407850 >> v2:172.21.15.66:3300/0 conn(0x7f0a600b5380 0x7f0a600ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5f7fe700 1 --2- 172.21.15.60:0/547407850 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600b1b20 0x7f0a600b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5e7fc700 1 -- 172.21.15.60:0/547407850 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600b1b20 msgr2=0x7f0a600b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:04.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5e7fc700 1 --2- 172.21.15.60:0/547407850 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600b1b20 0x7f0a600b1f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5e7fc700 1 -- 172.21.15.60:0/547407850 >> v2:172.21.15.66:3300/0 conn(0x7f0a600b5380 msgr2=0x7f0a600ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:04.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5e7fc700 1 --2- 172.21.15.60:0/547407850 >> v2:172.21.15.66:3300/0 conn(0x7f0a600b5380 0x7f0a600ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5e7fc700 1 -- 172.21.15.60:0/547407850 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a600b14f0 con 0x7f0a600b0b50 2020-10-31T22:49:04.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5e7fc700 1 --2- 172.21.15.60:0/547407850 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a600b0b50 0x7f0a600b1000 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f0a48002f30 tx=0x7f0a48006e80).ready entity=mon.0 client_cookie=3e964d8f81239d7a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:04.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5dffb700 1 -- 172.21.15.60:0/547407850 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a48009640 con 0x7f0a600b0b50 2020-10-31T22:49:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5dffb700 1 -- 172.21.15.60:0/547407850 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a480097a0 con 0x7f0a600b0b50 2020-10-31T22:49:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5dffb700 1 -- 172.21.15.60:0/547407850 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a48009b00 con 0x7f0a600b0b50 2020-10-31T22:49:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5ffff700 1 -- 172.21.15.60:0/547407850 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a600b0b50 msgr2=0x7f0a600b1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5ffff700 1 --2- 172.21.15.60:0/547407850 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a600b0b50 0x7f0a600b1000 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 rx=0x7f0a48002f30 tx=0x7f0a48006e80).stop 2020-10-31T22:49:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5ffff700 1 -- 172.21.15.60:0/547407850 shutdown_connections 2020-10-31T22:49:04.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5ffff700 1 --2- 172.21.15.60:0/547407850 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600b1b20 0x7f0a600b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5ffff700 1 --2- 172.21.15.60:0/547407850 >> v2:172.21.15.66:3300/0 conn(0x7f0a600b5380 0x7f0a600ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.649+0000 7f0a5ffff700 1 --2- 172.21.15.60:0/547407850 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a600b0b50 0x7f0a600b1000 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5ffff700 1 -- 172.21.15.60:0/547407850 >> 172.21.15.60:0/547407850 conn(0x7f0a6006a600 msgr2=0x7f0a60060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:04.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5ffff700 1 -- 172.21.15.60:0/547407850 shutdown_connections 2020-10-31T22:49:04.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5ffff700 1 -- 172.21.15.60:0/547407850 wait complete. 2020-10-31T22:49:04.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5ffff700 1 Processor -- start 2020-10-31T22:49:04.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5ffff700 1 -- start start 2020-10-31T22:49:04.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600b0b50 0x7f0a600b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5ffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a600b1b20 0x7f0a60065a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a600b5380 0x7f0a60065f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a600ab640 con 0x7f0a600b5380 2020-10-31T22:49:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5ffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a600aa3e0 con 0x7f0a600b1b20 2020-10-31T22:49:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a600aa680 con 0x7f0a600b0b50 2020-10-31T22:49:04.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a600b5380 0x7f0a60065f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a600b5380 0x7f0a60065f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47380/0 (socket says 172.21.15.60:47380) 2020-10-31T22:49:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5f7fe700 1 -- 172.21.15.60:0/2251574837 learned_addr learned my addr 172.21.15.60:0/2251574837 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5e7fc700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a600b1b20 0x7f0a60065a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.653+0000 7f0a5effd700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600b0b50 0x7f0a600b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a5f7fe700 1 -- 172.21.15.60:0/2251574837 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600b0b50 msgr2=0x7f0a600b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a5f7fe700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600b0b50 0x7f0a600b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a5f7fe700 1 -- 172.21.15.60:0/2251574837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a600b1b20 msgr2=0x7f0a60065a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a5f7fe700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a600b1b20 0x7f0a60065a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a5f7fe700 1 -- 172.21.15.60:0/2251574837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a600aa920 con 0x7f0a600b5380 2020-10-31T22:49:04.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a5effd700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600b0b50 0x7f0a600b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:04.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a5e7fc700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a600b1b20 0x7f0a60065a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:04.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a5f7fe700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a600b5380 0x7f0a60065f60 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f0a58006dd0 tx=0x7f0a580091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:04.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a57fff700 1 -- 172.21.15.60:0/2251574837 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a5800eee0 con 0x7f0a600b5380 2020-10-31T22:49:04.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a57fff700 1 -- 172.21.15.60:0/2251574837 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a5800cbb0 con 0x7f0a600b5380 2020-10-31T22:49:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a5ffff700 1 -- 172.21.15.60:0/2251574837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a60066450 con 0x7f0a600b5380 2020-10-31T22:49:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a57fff700 1 -- 172.21.15.60:0/2251574837 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a580123f0 con 0x7f0a600b5380 2020-10-31T22:49:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a5ffff700 1 -- 172.21.15.60:0/2251574837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a600642d0 con 0x7f0a600b5380 2020-10-31T22:49:04.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a5ffff700 1 -- 172.21.15.60:0/2251574837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a600abc50 con 0x7f0a600b5380 2020-10-31T22:49:04.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a57fff700 1 -- 172.21.15.60:0/2251574837 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0a58022070 con 0x7f0a600b5380 2020-10-31T22:49:04.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a57fff700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0a44054f90 0x7f0a44057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:04.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a57fff700 1 -- 172.21.15.60:0/2251574837 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0a5806e1e0 con 0x7f0a600b5380 2020-10-31T22:49:04.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.657+0000 7f0a5effd700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0a44054f90 0x7f0a44057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:04.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.661+0000 7f0a5effd700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0a44054f90 0x7f0a44057450 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f0a5000b000 tx=0x7f0a50008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:04.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.665+0000 7f0a57fff700 1 -- 172.21.15.60:0/2251574837 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0a600abc50 con 0x7f0a600b5380 2020-10-31T22:49:04.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.853+0000 7f0a5ffff700 1 -- 172.21.15.60:0/2251574837 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0a600abc50 con 0x7f0a600b5380 2020-10-31T22:49:04.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.925+0000 7f0a57fff700 1 -- 172.21.15.60:0/2251574837 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v53) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0a600abc50 con 0x7f0a600b5380 2020-10-31T22:49:04.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.929+0000 7f0a5ffff700 1 -- 172.21.15.60:0/2251574837 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0a44054f90 msgr2=0x7f0a44057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.929+0000 7f0a5ffff700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0a44054f90 0x7f0a44057450 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f0a5000b000 tx=0x7f0a50008040).stop 2020-10-31T22:49:04.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.929+0000 7f0a5ffff700 1 -- 172.21.15.60:0/2251574837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a600b5380 msgr2=0x7f0a60065f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:04.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.929+0000 7f0a5ffff700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a600b5380 0x7f0a60065f60 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 rx=0x7f0a58006dd0 tx=0x7f0a580091a0).stop 2020-10-31T22:49:04.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.929+0000 7f0a5ffff700 1 -- 172.21.15.60:0/2251574837 shutdown_connections 2020-10-31T22:49:04.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.929+0000 7f0a5ffff700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a600b5380 0x7f0a60065f60 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.929+0000 7f0a5ffff700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a600b0b50 0x7f0a600b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.929+0000 7f0a5ffff700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0a44054f90 0x7f0a44057450 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.929+0000 7f0a5ffff700 1 --2- 172.21.15.60:0/2251574837 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a600b1b20 0x7f0a60065a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:04.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.929+0000 7f0a5ffff700 1 -- 172.21.15.60:0/2251574837 >> 172.21.15.60:0/2251574837 conn(0x7f0a6006a600 msgr2=0x7f0a600b4920 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:04.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.929+0000 7f0a5ffff700 1 -- 172.21.15.60:0/2251574837 shutdown_connections 2020-10-31T22:49:04.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:04.929+0000 7f0a5ffff700 1 -- 172.21.15.60:0/2251574837 wait complete. 2020-10-31T22:49:04.950 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:49:05.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a941c9700 1 Processor -- start 2020-10-31T22:49:05.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a941c9700 1 -- start start 2020-10-31T22:49:05.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a941c9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4a8c0a7850 0x7f4a8c05bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a941c9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a8c146790 0x7f4a8c146be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a941c9700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a8c0af200 con 0x7f4a8c05b960 2020-10-31T22:49:05.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a941c9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a8c0b0f00 con 0x7f4a8c0a7850 2020-10-31T22:49:05.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a941c9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c0b11a0 con 0x7f4a8c146790 2020-10-31T22:49:05.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a91f65700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4a8c05b960 0x7f4a8c0aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51520/0 (socket says 172.21.15.60:51520) 2020-10-31T22:49:05.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a91f65700 1 -- 172.21.15.60:0/1379161998 learned_addr learned my addr 172.21.15.60:0/1379161998 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:05.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a91764700 1 --2- 172.21.15.60:0/1379161998 >> v2:172.21.15.60:3300/0 conn(0x7f4a8c0a7850 0x7f4a8c05bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a92766700 1 --2- 172.21.15.60:0/1379161998 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a8c146790 0x7f4a8c146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a90f63700 1 -- 172.21.15.60:0/1379161998 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126715743 0 0) 0x7f4a8c0af200 con 0x7f4a8c05b960 2020-10-31T22:49:05.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a90f63700 1 -- 172.21.15.60:0/1379161998 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a78003230 con 0x7f4a8c05b960 2020-10-31T22:49:05.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a91764700 1 -- 172.21.15.60:0/1379161998 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a8c146790 msgr2=0x7f4a8c146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:05.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a91764700 1 --2- 172.21.15.60:0/1379161998 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a8c146790 0x7f4a8c146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a91764700 1 -- 172.21.15.60:0/1379161998 >> v1:172.21.15.60:6789/0 conn(0x7f4a8c05b960 legacy=0x7f4a8c0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a90f63700 1 -- 172.21.15.60:0/1379161998 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3740949626 0 0) 0x7f4a78003230 con 0x7f4a8c05b960 2020-10-31T22:49:05.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a91764700 1 -- 172.21.15.60:0/1379161998 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8c0b1440 con 0x7f4a8c0a7850 2020-10-31T22:49:05.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a91764700 1 --2- 172.21.15.60:0/1379161998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a8c0a7850 0x7f4a8c05bd40 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f4a7c001870 tx=0x7f4a80006dc0).ready entity=mon.0 client_cookie=30e853e88618f02c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:05.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a90f63700 1 -- 172.21.15.60:0/1379161998 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a7c0016d0 con 0x7f4a8c0a7850 2020-10-31T22:49:05.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a90f63700 1 -- 172.21.15.60:0/1379161998 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8000d570 con 0x7f4a8c0a7850 2020-10-31T22:49:05.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a90f63700 1 -- 172.21.15.60:0/1379161998 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a8000d6e0 con 0x7f4a8c0a7850 2020-10-31T22:49:05.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a941c9700 1 -- 172.21.15.60:0/1379161998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a8c0a7850 msgr2=0x7f4a8c05bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a941c9700 1 --2- 172.21.15.60:0/1379161998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a8c0a7850 0x7f4a8c05bd40 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 rx=0x7f4a7c001870 tx=0x7f4a80006dc0).stop 2020-10-31T22:49:05.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a941c9700 1 -- 172.21.15.60:0/1379161998 shutdown_connections 2020-10-31T22:49:05.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a941c9700 1 --2- 172.21.15.60:0/1379161998 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a8c146790 0x7f4a8c146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a941c9700 1 --2- 172.21.15.60:0/1379161998 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a8c0a7850 0x7f4a8c05bd40 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.057+0000 7f4a941c9700 1 -- 172.21.15.60:0/1379161998 >> 172.21.15.60:0/1379161998 conn(0x7f4a8c06a260 msgr2=0x7f4a8c061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:05.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a941c9700 1 -- 172.21.15.60:0/1379161998 shutdown_connections 2020-10-31T22:49:05.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a941c9700 1 -- 172.21.15.60:0/1379161998 wait complete. 2020-10-31T22:49:05.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a941c9700 1 Processor -- start 2020-10-31T22:49:05.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a941c9700 1 -- start start 2020-10-31T22:49:05.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a941c9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a8c05b960 0x7f4a8c14d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a941c9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c0a7850 0x7f4a8c0ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a941c9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a8c146790 0x7f4a8c0add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a941c9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c0b3ba0 con 0x7f4a8c146790 2020-10-31T22:49:05.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a941c9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c0b4490 con 0x7f4a8c0a7850 2020-10-31T22:49:05.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a941c9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8c0b4730 con 0x7f4a8c05b960 2020-10-31T22:49:05.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a92766700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a8c146790 0x7f4a8c0add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a92766700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a8c146790 0x7f4a8c0add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47394/0 (socket says 172.21.15.60:47394) 2020-10-31T22:49:05.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a92766700 1 -- 172.21.15.60:0/3416903764 learned_addr learned my addr 172.21.15.60:0/3416903764 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:05.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a91f65700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a8c05b960 0x7f4a8c14d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.061+0000 7f4a91764700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c0a7850 0x7f4a8c0ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.065+0000 7f4a92766700 1 -- 172.21.15.60:0/3416903764 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a8c05b960 msgr2=0x7f4a8c14d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.065+0000 7f4a92766700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a8c05b960 0x7f4a8c14d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.065+0000 7f4a92766700 1 -- 172.21.15.60:0/3416903764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c0a7850 msgr2=0x7f4a8c0ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.065+0000 7f4a92766700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c0a7850 0x7f4a8c0ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.065+0000 7f4a92766700 1 -- 172.21.15.60:0/3416903764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a8c0b49d0 con 0x7f4a8c146790 2020-10-31T22:49:05.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.065+0000 7f4a91764700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c0a7850 0x7f4a8c0ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:05.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.065+0000 7f4a92766700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a8c146790 0x7f4a8c0add90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f4a84006dd0 tx=0x7f4a840091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:05.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.065+0000 7f4a8affd700 1 -- 172.21.15.60:0/3416903764 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a8400cbb0 con 0x7f4a8c146790 2020-10-31T22:49:05.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.065+0000 7f4a8affd700 1 -- 172.21.15.60:0/3416903764 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8400cd10 con 0x7f4a8c146790 2020-10-31T22:49:05.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.065+0000 7f4a941c9700 1 -- 172.21.15.60:0/3416903764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a8c0b2cc0 con 0x7f4a8c146790 2020-10-31T22:49:05.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.065+0000 7f4a8affd700 1 -- 172.21.15.60:0/3416903764 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a840125e0 con 0x7f4a8c146790 2020-10-31T22:49:05.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.065+0000 7f4a941c9700 1 -- 172.21.15.60:0/3416903764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a8c0ae280 con 0x7f4a8c146790 2020-10-31T22:49:05.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.065+0000 7f4a941c9700 1 -- 172.21.15.60:0/3416903764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a8c0b3370 con 0x7f4a8c146790 2020-10-31T22:49:05.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.065+0000 7f4a8affd700 1 -- 172.21.15.60:0/3416903764 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4a84022070 con 0x7f4a8c146790 2020-10-31T22:49:05.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.069+0000 7f4a8affd700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4a6c054f90 0x7f4a6c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.069+0000 7f4a91f65700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4a6c054f90 0x7f4a6c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.069+0000 7f4a8affd700 1 -- 172.21.15.60:0/3416903764 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4a8406e3a0 con 0x7f4a8c146790 2020-10-31T22:49:05.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.069+0000 7f4a91f65700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4a6c054f90 0x7f4a6c057450 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f4a7c00b000 tx=0x7f4a7c000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:05.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.073+0000 7f4a8affd700 1 -- 172.21.15.60:0/3416903764 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4a8c0b3370 con 0x7f4a8c146790 2020-10-31T22:49:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.261+0000 7f4a941c9700 1 -- 172.21.15.60:0/3416903764 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a8c0b3370 con 0x7f4a8c146790 2020-10-31T22:49:05.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.261+0000 7f4a8affd700 1 -- 172.21.15.60:0/3416903764 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f4a8c0b3370 con 0x7f4a8c146790 2020-10-31T22:49:05.268 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:05.268 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1212236578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1212236578},{"type":"v1","addr":"172.21.15.60:6835","nonce":1212236578}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3130935285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3130935285},{"type":"v1","addr":"172.21.15.66:6833","nonce":3130935285}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:49:03.919960+0000","modified":"2020-10-31T22:49:04.922872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7173},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7173":{"gid":7173,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/1399264415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1399264415},{"type":"v1","addr":"172.21.15.60:6837","nonce":1399264415}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-10-31T22:49:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.261+0000 7f4a941c9700 1 -- 172.21.15.60:0/3416903764 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4a6c054f90 msgr2=0x7f4a6c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.261+0000 7f4a941c9700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4a6c054f90 0x7f4a6c057450 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f4a7c00b000 tx=0x7f4a7c000b80).stop 2020-10-31T22:49:05.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.261+0000 7f4a941c9700 1 -- 172.21.15.60:0/3416903764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a8c146790 msgr2=0x7f4a8c0add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.261+0000 7f4a941c9700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a8c146790 0x7f4a8c0add90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 rx=0x7f4a84006dd0 tx=0x7f4a840091a0).stop 2020-10-31T22:49:05.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.265+0000 7f4a941c9700 1 -- 172.21.15.60:0/3416903764 shutdown_connections 2020-10-31T22:49:05.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.265+0000 7f4a941c9700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a8c146790 0x7f4a8c0add90 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.265+0000 7f4a941c9700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a8c05b960 0x7f4a8c14d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.265+0000 7f4a941c9700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4a6c054f90 0x7f4a6c057450 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.265+0000 7f4a941c9700 1 --2- 172.21.15.60:0/3416903764 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a8c0a7850 0x7f4a8c0ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.265+0000 7f4a941c9700 1 -- 172.21.15.60:0/3416903764 >> 172.21.15.60:0/3416903764 conn(0x7f4a8c06a260 msgr2=0x7f4a8c0a66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:05.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.265+0000 7f4a941c9700 1 -- 172.21.15.60:0/3416903764 shutdown_connections 2020-10-31T22:49:05.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.265+0000 7f4a941c9700 1 -- 172.21.15.60:0/3416903764 wait complete. 2020-10-31T22:49:05.271 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 53 2020-10-31T22:49:05.281 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:49:05.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.381+0000 7f816dad0700 1 Processor -- start 2020-10-31T22:49:05.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816dad0700 1 -- start start 2020-10-31T22:49:05.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816dad0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81680b1a10 0x7f8168142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816dad0700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f81680af200 0x7f81680b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816dad0700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81680abea0 con 0x7f816813ebe0 2020-10-31T22:49:05.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816dad0700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8168141870 con 0x7f81680af200 2020-10-31T22:49:05.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816dad0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8168141b10 con 0x7f81680b1a10 2020-10-31T22:49:05.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816d2cf700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f81680af200 0x7f81680b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816d2cf700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f81680af200 0x7f81680b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:58334/0 (socket says 172.21.15.60:58334) 2020-10-31T22:49:05.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816d2cf700 1 -- 172.21.15.60:0/3116164618 learned_addr learned my addr 172.21.15.60:0/3116164618 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:05.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816cace700 1 --2- 172.21.15.60:0/3116164618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81680b1a10 0x7f8168142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816d2cf700 1 -- 172.21.15.60:0/3116164618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81680b1a10 msgr2=0x7f8168142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:05.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816d2cf700 1 --2- 172.21.15.60:0/3116164618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81680b1a10 0x7f8168142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816d2cf700 1 -- 172.21.15.60:0/3116164618 >> v1:172.21.15.66:6789/0 conn(0x7f816813ebe0 legacy=0x7f81680afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816d2cf700 1 -- 172.21.15.60:0/3116164618 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8168141db0 con 0x7f81680af200 2020-10-31T22:49:05.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816cace700 1 --2- 172.21.15.60:0/3116164618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81680b1a10 0x7f8168142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:05.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816d2cf700 1 --2- 172.21.15.60:0/3116164618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81680af200 0x7f81680b1df0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f8160002f30 tx=0x7f8160006f10).ready entity=mon.1 client_cookie=6835d37e2aca4f8f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:05.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f81677fe700 1 -- 172.21.15.60:0/3116164618 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f816000cb70 con 0x7f81680af200 2020-10-31T22:49:05.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f81677fe700 1 -- 172.21.15.60:0/3116164618 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816000ccd0 con 0x7f81680af200 2020-10-31T22:49:05.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f81677fe700 1 -- 172.21.15.60:0/3116164618 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8160010600 con 0x7f81680af200 2020-10-31T22:49:05.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816dad0700 1 -- 172.21.15.60:0/3116164618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81680af200 msgr2=0x7f81680b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816dad0700 1 --2- 172.21.15.60:0/3116164618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81680af200 0x7f81680b1df0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7f8160002f30 tx=0x7f8160006f10).stop 2020-10-31T22:49:05.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816dad0700 1 -- 172.21.15.60:0/3116164618 shutdown_connections 2020-10-31T22:49:05.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816dad0700 1 --2- 172.21.15.60:0/3116164618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81680af200 0x7f81680b1df0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.385+0000 7f816dad0700 1 --2- 172.21.15.60:0/3116164618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81680b1a10 0x7f8168142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.389+0000 7f816dad0700 1 -- 172.21.15.60:0/3116164618 >> 172.21.15.60:0/3116164618 conn(0x7f81680b5300 msgr2=0x7f81680b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:05.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.389+0000 7f816dad0700 1 -- 172.21.15.60:0/3116164618 shutdown_connections 2020-10-31T22:49:05.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.389+0000 7f816dad0700 1 -- 172.21.15.60:0/3116164618 wait complete. 2020-10-31T22:49:05.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.389+0000 7f816dad0700 1 Processor -- start 2020-10-31T22:49:05.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.389+0000 7f816dad0700 1 -- start start 2020-10-31T22:49:05.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816dad0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81680af200 0x7f816814fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816dad0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81680b1a10 0x7f81680ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816dad0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f816813ebe0 0x7f816814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816dad0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8168063940 con 0x7f81680af200 2020-10-31T22:49:05.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816dad0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81680a9470 con 0x7f816813ebe0 2020-10-31T22:49:05.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816dad0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81680a9710 con 0x7f81680b1a10 2020-10-31T22:49:05.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816cace700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81680af200 0x7f816814fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816cace700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81680af200 0x7f816814fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47404/0 (socket says 172.21.15.60:47404) 2020-10-31T22:49:05.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816cace700 1 -- 172.21.15.60:0/4144292708 learned_addr learned my addr 172.21.15.60:0/4144292708 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:05.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816d2cf700 1 --2- 172.21.15.60:0/4144292708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f816813ebe0 0x7f816814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f8167fff700 1 --2- 172.21.15.60:0/4144292708 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81680b1a10 0x7f81680ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816cace700 1 -- 172.21.15.60:0/4144292708 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81680b1a10 msgr2=0x7f81680ad5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816cace700 1 --2- 172.21.15.60:0/4144292708 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81680b1a10 0x7f81680ad5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816cace700 1 -- 172.21.15.60:0/4144292708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f816813ebe0 msgr2=0x7f816814d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816cace700 1 --2- 172.21.15.60:0/4144292708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f816813ebe0 0x7f816814d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816cace700 1 -- 172.21.15.60:0/4144292708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816814cc50 con 0x7f81680af200 2020-10-31T22:49:05.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816cace700 1 --2- 172.21.15.60:0/4144292708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81680af200 0x7f816814fed0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f815c00c000 tx=0x7f815c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:05.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f8165ffb700 1 -- 172.21.15.60:0/4144292708 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f815c00cae0 con 0x7f81680af200 2020-10-31T22:49:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f8165ffb700 1 -- 172.21.15.60:0/4144292708 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c00cc40 con 0x7f81680af200 2020-10-31T22:49:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816dad0700 1 -- 172.21.15.60:0/4144292708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816814c900 con 0x7f81680af200 2020-10-31T22:49:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f8165ffb700 1 -- 172.21.15.60:0/4144292708 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f815c0123f0 con 0x7f81680af200 2020-10-31T22:49:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816dad0700 1 -- 172.21.15.60:0/4144292708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816813dc30 con 0x7f81680af200 2020-10-31T22:49:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.393+0000 7f816dad0700 1 -- 172.21.15.60:0/4144292708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81680a9290 con 0x7f81680af200 2020-10-31T22:49:05.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.397+0000 7f8165ffb700 1 -- 172.21.15.60:0/4144292708 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f815c012550 con 0x7f81680af200 2020-10-31T22:49:05.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.397+0000 7f8165ffb700 1 --2- 172.21.15.60:0/4144292708 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8148054f10 0x7f81480573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.397+0000 7f8165ffb700 1 -- 172.21.15.60:0/4144292708 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f815c06e100 con 0x7f81680af200 2020-10-31T22:49:05.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.397+0000 7f8167fff700 1 --2- 172.21.15.60:0/4144292708 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8148054f10 0x7f81480573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.397+0000 7f8167fff700 1 --2- 172.21.15.60:0/4144292708 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8148054f10 0x7f81480573d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f815800d000 tx=0x7f8158007ee0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:05.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.401+0000 7f8165ffb700 1 -- 172.21.15.60:0/4144292708 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f815c044520 con 0x7f81680af200 2020-10-31T22:49:05.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.541+0000 7f816dad0700 1 -- 172.21.15.60:0/4144292708 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f816814cde0 con 0x7f81680af200 2020-10-31T22:49:05.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.541+0000 7f8165ffb700 1 -- 172.21.15.60:0/4144292708 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f815c047b40 con 0x7f81680af200 2020-10-31T22:49:05.548 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:05.548 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":110,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:49:04.923755+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:49:01.432008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2020-10-31T22:49:02.732480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:49:05.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.545+0000 7f816dad0700 1 -- 172.21.15.60:0/4144292708 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8148054f10 msgr2=0x7f81480573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.545+0000 7f816dad0700 1 --2- 172.21.15.60:0/4144292708 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8148054f10 0x7f81480573d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f815800d000 tx=0x7f8158007ee0).stop 2020-10-31T22:49:05.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.545+0000 7f816dad0700 1 -- 172.21.15.60:0/4144292708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81680af200 msgr2=0x7f816814fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.545+0000 7f816dad0700 1 --2- 172.21.15.60:0/4144292708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81680af200 0x7f816814fed0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 rx=0x7f815c00c000 tx=0x7f815c006dc0).stop 2020-10-31T22:49:05.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.545+0000 7f816dad0700 1 -- 172.21.15.60:0/4144292708 shutdown_connections 2020-10-31T22:49:05.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.545+0000 7f816dad0700 1 --2- 172.21.15.60:0/4144292708 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8148054f10 0x7f81480573d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.545+0000 7f816dad0700 1 --2- 172.21.15.60:0/4144292708 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f816813ebe0 0x7f816814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.545+0000 7f816dad0700 1 --2- 172.21.15.60:0/4144292708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81680af200 0x7f816814fed0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.545+0000 7f816dad0700 1 --2- 172.21.15.60:0/4144292708 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81680b1a10 0x7f81680ad5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.545+0000 7f816dad0700 1 -- 172.21.15.60:0/4144292708 >> 172.21.15.60:0/4144292708 conn(0x7f81680b5300 msgr2=0x7f81680ae830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:05.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.545+0000 7f816dad0700 1 -- 172.21.15.60:0/4144292708 shutdown_connections 2020-10-31T22:49:05.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.545+0000 7f816dad0700 1 -- 172.21.15.60:0/4144292708 wait complete. 2020-10-31T22:49:05.568 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:49:05.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bfdeb6700 1 Processor -- start 2020-10-31T22:49:05.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bfdeb6700 1 -- start start 2020-10-31T22:49:05.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bfdeb6700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6bf80ae200 0x7f6bf80a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bfdeb6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6bf80ac110 0x7f6bf80af980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bfdeb6700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf805b700 con 0x7f6bf805b320 2020-10-31T22:49:05.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bfdeb6700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf80807c0 con 0x7f6bf80ae200 2020-10-31T22:49:05.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bfdeb6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf80ab730 con 0x7f6bf80ac110 2020-10-31T22:49:05.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bf77fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6bf80ae200 0x7f6bf80a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bfcc54700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6bf80ac110 0x7f6bf80af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bf77fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6bf80ae200 0x7f6bf80a74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:58350/0 (socket says 172.21.15.60:58350) 2020-10-31T22:49:05.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bf77fe700 1 -- 172.21.15.60:0/3141632022 learned_addr learned my addr 172.21.15.60:0/3141632022 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:05.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bf7fff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f6bf805b320 0x7f6bf807ff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:49416/0 (socket says 172.21.15.60:49416) 2020-10-31T22:49:05.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bfcc54700 1 -- 172.21.15.60:0/3141632022 >> v2:172.21.15.66:3300/0 conn(0x7f6bf80ae200 msgr2=0x7f6bf80a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:05.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bfcc54700 1 --2- 172.21.15.60:0/3141632022 >> v2:172.21.15.66:3300/0 conn(0x7f6bf80ae200 0x7f6bf80a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bfcc54700 1 -- 172.21.15.60:0/3141632022 >> v1:172.21.15.66:6789/0 conn(0x7f6bf805b320 legacy=0x7f6bf807ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bfcc54700 1 -- 172.21.15.60:0/3141632022 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf80ab9d0 con 0x7f6bf80ac110 2020-10-31T22:49:05.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bf6ffd700 1 -- 172.21.15.60:0/3141632022 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273160043 0 0) 0x7f6bf805b700 con 0x7f6bf805b320 2020-10-31T22:49:05.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bf77fe700 1 --2- 172.21.15.60:0/3141632022 >> v2:172.21.15.66:3300/0 conn(0x7f6bf80ae200 0x7f6bf80a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:05.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.685+0000 7f6bfcc54700 1 --2- 172.21.15.60:0/3141632022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6bf80ac110 0x7f6bf80af980 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6bf0002f30 tx=0x7f6bf0006dc0).ready entity=mon.2 client_cookie=1ce4f3ae82e11b3b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:05.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.689+0000 7f6bf6ffd700 1 -- 172.21.15.60:0/3141632022 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bf0009760 con 0x7f6bf80ac110 2020-10-31T22:49:05.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.689+0000 7f6bf6ffd700 1 -- 172.21.15.60:0/3141632022 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf00098c0 con 0x7f6bf80ac110 2020-10-31T22:49:05.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.689+0000 7f6bf6ffd700 1 -- 172.21.15.60:0/3141632022 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6bf0009c20 con 0x7f6bf80ac110 2020-10-31T22:49:05.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.689+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3141632022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6bf80ac110 msgr2=0x7f6bf80af980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.689+0000 7f6bfdeb6700 1 --2- 172.21.15.60:0/3141632022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6bf80ac110 0x7f6bf80af980 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f6bf0002f30 tx=0x7f6bf0006dc0).stop 2020-10-31T22:49:05.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.689+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3141632022 shutdown_connections 2020-10-31T22:49:05.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.689+0000 7f6bfdeb6700 1 --2- 172.21.15.60:0/3141632022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6bf80ac110 0x7f6bf80af980 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.689+0000 7f6bfdeb6700 1 --2- 172.21.15.60:0/3141632022 >> v2:172.21.15.66:3300/0 conn(0x7f6bf80ae200 0x7f6bf80a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.689+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3141632022 >> 172.21.15.60:0/3141632022 conn(0x7f6bf80b3fd0 msgr2=0x7f6bf80b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:05.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.689+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3141632022 shutdown_connections 2020-10-31T22:49:05.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.689+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3141632022 wait complete. 2020-10-31T22:49:05.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.689+0000 7f6bfdeb6700 1 Processor -- start 2020-10-31T22:49:05.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.689+0000 7f6bfdeb6700 1 -- start start 2020-10-31T22:49:05.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bfdeb6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6bf805b320 0x7f6bf812f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bfdeb6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf80ac110 0x7f6bf80a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bfdeb6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bf80ae200 0x7f6bf80a9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bfdeb6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf8065a50 con 0x7f6bf80ac110 2020-10-31T22:49:05.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bfdeb6700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf8065c80 con 0x7f6bf80ae200 2020-10-31T22:49:05.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bfdeb6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf8065f20 con 0x7f6bf805b320 2020-10-31T22:49:05.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bf77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf80ac110 0x7f6bf80a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bf77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf80ac110 0x7f6bf80a8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47420/0 (socket says 172.21.15.60:47420) 2020-10-31T22:49:05.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bf77fe700 1 -- 172.21.15.60:0/3870348450 learned_addr learned my addr 172.21.15.60:0/3870348450 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:05.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bf7fff700 1 --2- 172.21.15.60:0/3870348450 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6bf805b320 0x7f6bf812f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bfcc54700 1 --2- 172.21.15.60:0/3870348450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bf80ae200 0x7f6bf80a9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bf77fe700 1 -- 172.21.15.60:0/3870348450 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6bf805b320 msgr2=0x7f6bf812f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bf77fe700 1 --2- 172.21.15.60:0/3870348450 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6bf805b320 0x7f6bf812f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bf77fe700 1 -- 172.21.15.60:0/3870348450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bf80ae200 msgr2=0x7f6bf80a9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bf77fe700 1 --2- 172.21.15.60:0/3870348450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bf80ae200 0x7f6bf80a9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bf77fe700 1 -- 172.21.15.60:0/3870348450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf80661c0 con 0x7f6bf80ac110 2020-10-31T22:49:05.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bf77fe700 1 --2- 172.21.15.60:0/3870348450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf80ac110 0x7f6bf80a8f50 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f6be000c000 tx=0x7f6be0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:05.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bf4ff9700 1 -- 172.21.15.60:0/3870348450 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6be000c950 con 0x7f6bf80ac110 2020-10-31T22:49:05.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bf4ff9700 1 -- 172.21.15.60:0/3870348450 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be000cab0 con 0x7f6bf80ac110 2020-10-31T22:49:05.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3870348450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf8080250 con 0x7f6bf80ac110 2020-10-31T22:49:05.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bf4ff9700 1 -- 172.21.15.60:0/3870348450 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6be000ce10 con 0x7f6bf80ac110 2020-10-31T22:49:05.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3870348450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf80643c0 con 0x7f6bf80ac110 2020-10-31T22:49:05.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.693+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3870348450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf8066350 con 0x7f6bf80ac110 2020-10-31T22:49:05.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.697+0000 7f6bf4ff9700 1 -- 172.21.15.60:0/3870348450 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6be001b400 con 0x7f6bf80ac110 2020-10-31T22:49:05.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.697+0000 7f6bf4ff9700 1 --2- 172.21.15.60:0/3870348450 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6bdc054f90 0x7f6bdc057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:05.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.697+0000 7f6bf4ff9700 1 -- 172.21.15.60:0/3870348450 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6be006e140 con 0x7f6bf80ac110 2020-10-31T22:49:05.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.697+0000 7f6bf7fff700 1 --2- 172.21.15.60:0/3870348450 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6bdc054f90 0x7f6bdc057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:05.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.697+0000 7f6bf7fff700 1 --2- 172.21.15.60:0/3870348450 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6bdc054f90 0x7f6bdc057450 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f6be800d000 tx=0x7f6be8007cb0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:05.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.705+0000 7f6bf4ff9700 1 -- 172.21.15.60:0/3870348450 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6be00445a0 con 0x7f6bf80ac110 2020-10-31T22:49:05.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.893+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3870348450 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f6bf8057100 con 0x7f6bf80ac110 2020-10-31T22:49:05.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.901+0000 7f6bf4ff9700 1 -- 172.21.15.60:0/3870348450 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v25) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6be0047bc0 con 0x7f6bf80ac110 2020-10-31T22:49:05.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.901+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3870348450 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6bdc054f90 msgr2=0x7f6bdc057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.901+0000 7f6bfdeb6700 1 --2- 172.21.15.60:0/3870348450 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6bdc054f90 0x7f6bdc057450 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f6be800d000 tx=0x7f6be8007cb0).stop 2020-10-31T22:49:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.901+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3870348450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf80ac110 msgr2=0x7f6bf80a8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.901+0000 7f6bfdeb6700 1 --2- 172.21.15.60:0/3870348450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf80ac110 0x7f6bf80a8f50 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 rx=0x7f6be000c000 tx=0x7f6be0008040).stop 2020-10-31T22:49:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.901+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3870348450 shutdown_connections 2020-10-31T22:49:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.901+0000 7f6bfdeb6700 1 --2- 172.21.15.60:0/3870348450 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6bdc054f90 0x7f6bdc057450 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.901+0000 7f6bfdeb6700 1 --2- 172.21.15.60:0/3870348450 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6bf80ae200 0x7f6bf80a9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.901+0000 7f6bfdeb6700 1 --2- 172.21.15.60:0/3870348450 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6bf805b320 0x7f6bf812f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.901+0000 7f6bfdeb6700 1 --2- 172.21.15.60:0/3870348450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6bf80ac110 0x7f6bf80a8f50 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.901+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3870348450 >> 172.21.15.60:0/3870348450 conn(0x7f6bf80b3fd0 msgr2=0x7f6bf80b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.901+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3870348450 shutdown_connections 2020-10-31T22:49:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:05.901+0000 7f6bfdeb6700 1 -- 172.21.15.60:0/3870348450 wait complete. 2020-10-31T22:49:05.963 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2020-10-31T22:49:05.963 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:49:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.093+0000 7f619bfff700 1 Processor -- start 2020-10-31T22:49:06.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.093+0000 7f619bfff700 1 -- start start 2020-10-31T22:49:06.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.093+0000 7f619bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f619c0256a0 0x7f619c07fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:06.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.093+0000 7f619bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f619c0801c0 0x7f619c159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.093+0000 7f619bfff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f619c0b1950 con 0x7f619c0b1570 2020-10-31T22:49:06.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.093+0000 7f619bfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f619c062720 con 0x7f619c0801c0 2020-10-31T22:49:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.093+0000 7f619bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619c066cb0 con 0x7f619c0256a0 2020-10-31T22:49:06.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f61a153f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f619c0801c0 0x7f619c159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:06.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f619affd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f619c0256a0 0x7f619c07fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:06.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f61a153f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f619c0801c0 0x7f619c159210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47430/0 (socket says 172.21.15.60:47430) 2020-10-31T22:49:06.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f619b7fe700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f619c0b1570 0x7f619c024f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:49430/0 (socket says 172.21.15.60:49430) 2020-10-31T22:49:06.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f61a153f700 1 -- 172.21.15.60:0/384884827 learned_addr learned my addr 172.21.15.60:0/384884827 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:06.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f61a153f700 1 -- 172.21.15.60:0/384884827 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f619c0256a0 msgr2=0x7f619c07fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:06.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f61a153f700 1 --2- 172.21.15.60:0/384884827 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f619c0256a0 0x7f619c07fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f61a153f700 1 -- 172.21.15.60:0/384884827 >> v1:172.21.15.66:6789/0 conn(0x7f619c0b1570 legacy=0x7f619c024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:06.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f61a153f700 1 -- 172.21.15.60:0/384884827 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c0aca00 con 0x7f619c0801c0 2020-10-31T22:49:06.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f619a7fc700 1 -- 172.21.15.60:0/384884827 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168424660 0 0) 0x7f619c0b1950 con 0x7f619c0b1570 2020-10-31T22:49:06.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f61a153f700 1 --2- 172.21.15.60:0/384884827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f619c0801c0 0x7f619c159210 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f6194002f30 tx=0x7f6194006e80).ready entity=mon.0 client_cookie=85b37c4cfe7fa9f2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:06.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f619a7fc700 1 -- 172.21.15.60:0/384884827 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61940097f0 con 0x7f619c0801c0 2020-10-31T22:49:06.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f619a7fc700 1 -- 172.21.15.60:0/384884827 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6194009950 con 0x7f619c0801c0 2020-10-31T22:49:06.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f619a7fc700 1 -- 172.21.15.60:0/384884827 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6194009cb0 con 0x7f619c0801c0 2020-10-31T22:49:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f619bfff700 1 -- 172.21.15.60:0/384884827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f619c0801c0 msgr2=0x7f619c159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f619bfff700 1 --2- 172.21.15.60:0/384884827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f619c0801c0 0x7f619c159210 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 rx=0x7f6194002f30 tx=0x7f6194006e80).stop 2020-10-31T22:49:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f619bfff700 1 -- 172.21.15.60:0/384884827 shutdown_connections 2020-10-31T22:49:06.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f619bfff700 1 --2- 172.21.15.60:0/384884827 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f619c0801c0 0x7f619c159210 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f619bfff700 1 --2- 172.21.15.60:0/384884827 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f619c0256a0 0x7f619c07fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f619bfff700 1 -- 172.21.15.60:0/384884827 >> 172.21.15.60:0/384884827 conn(0x7f619c0b5440 msgr2=0x7f619c0b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:06.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f619bfff700 1 -- 172.21.15.60:0/384884827 shutdown_connections 2020-10-31T22:49:06.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.097+0000 7f619bfff700 1 -- 172.21.15.60:0/384884827 wait complete. 2020-10-31T22:49:06.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619bfff700 1 Processor -- start 2020-10-31T22:49:06.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619bfff700 1 -- start start 2020-10-31T22:49:06.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f619c0256a0 0x7f619c12f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:06.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f619c0801c0 0x7f619c12c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:06.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f619c0b1570 0x7f619c12cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:06.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0b3550 con 0x7f619c0801c0 2020-10-31T22:49:06.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619bfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0b37f0 con 0x7f619c0256a0 2020-10-31T22:49:06.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619c0b3a90 con 0x7f619c0b1570 2020-10-31T22:49:06.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f619c0801c0 0x7f619c12c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:06.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f619c0801c0 0x7f619c12c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47434/0 (socket says 172.21.15.60:47434) 2020-10-31T22:49:06.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619affd700 1 -- 172.21.15.60:0/2067704334 learned_addr learned my addr 172.21.15.60:0/2067704334 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:06.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f61a153f700 1 --2- 172.21.15.60:0/2067704334 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f619c0b1570 0x7f619c12cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:06.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619b7fe700 1 --2- 172.21.15.60:0/2067704334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f619c0256a0 0x7f619c12f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:06.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619affd700 1 -- 172.21.15.60:0/2067704334 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f619c0b1570 msgr2=0x7f619c12cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:06.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619affd700 1 --2- 172.21.15.60:0/2067704334 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f619c0b1570 0x7f619c12cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619affd700 1 -- 172.21.15.60:0/2067704334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f619c0256a0 msgr2=0x7f619c12f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619affd700 1 --2- 172.21.15.60:0/2067704334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f619c0256a0 0x7f619c12f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619affd700 1 -- 172.21.15.60:0/2067704334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619c0b3d30 con 0x7f619c0801c0 2020-10-31T22:49:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619affd700 1 --2- 172.21.15.60:0/2067704334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f619c0801c0 0x7f619c12c810 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f618400c000 tx=0x7f6184006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f6193fff700 1 -- 172.21.15.60:0/2067704334 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f618400ca10 con 0x7f619c0801c0 2020-10-31T22:49:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f6193fff700 1 -- 172.21.15.60:0/2067704334 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618400cb70 con 0x7f619c0801c0 2020-10-31T22:49:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619bfff700 1 -- 172.21.15.60:0/2067704334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f619c1302d0 con 0x7f619c0801c0 2020-10-31T22:49:06.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f6193fff700 1 -- 172.21.15.60:0/2067704334 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f618400ee80 con 0x7f619c0801c0 2020-10-31T22:49:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.101+0000 7f619bfff700 1 -- 172.21.15.60:0/2067704334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f619c0b3040 con 0x7f619c0801c0 2020-10-31T22:49:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.105+0000 7f619bfff700 1 -- 172.21.15.60:0/2067704334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f619c057100 con 0x7f619c0801c0 2020-10-31T22:49:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.105+0000 7f6193fff700 1 -- 172.21.15.60:0/2067704334 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f618401c460 con 0x7f619c0801c0 2020-10-31T22:49:06.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.105+0000 7f6193fff700 1 --2- 172.21.15.60:0/2067704334 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6180055020 0x7f61800574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.105+0000 7f6193fff700 1 -- 172.21.15.60:0/2067704334 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f618406de80 con 0x7f619c0801c0 2020-10-31T22:49:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.105+0000 7f619b7fe700 1 --2- 172.21.15.60:0/2067704334 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6180055020 0x7f61800574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.105+0000 7f619b7fe700 1 --2- 172.21.15.60:0/2067704334 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6180055020 0x7f61800574e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f618c00d000 tx=0x7f618c007cb0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:06.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.109+0000 7f6193fff700 1 -- 172.21.15.60:0/2067704334 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6184044340 con 0x7f619c0801c0 2020-10-31T22:49:06.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.305+0000 7f619bfff700 1 -- 172.21.15.60:0/2067704334 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f619c0b3ec0 con 0x7f619c0801c0 2020-10-31T22:49:06.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.313+0000 7f6193fff700 1 -- 172.21.15.60:0/2067704334 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v26) v1 ==== 184+0+0 (secure 0 0 0) 0x7f6184047960 con 0x7f619c0801c0 2020-10-31T22:49:06.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.313+0000 7f619bfff700 1 -- 172.21.15.60:0/2067704334 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6180055020 msgr2=0x7f61800574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:06.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.313+0000 7f619bfff700 1 --2- 172.21.15.60:0/2067704334 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6180055020 0x7f61800574e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f618c00d000 tx=0x7f618c007cb0).stop 2020-10-31T22:49:06.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.313+0000 7f619bfff700 1 -- 172.21.15.60:0/2067704334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f619c0801c0 msgr2=0x7f619c12c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:06.321 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.313+0000 7f619bfff700 1 --2- 172.21.15.60:0/2067704334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f619c0801c0 0x7f619c12c810 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 rx=0x7f618400c000 tx=0x7f6184006dc0).stop 2020-10-31T22:49:06.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.317+0000 7f619bfff700 1 -- 172.21.15.60:0/2067704334 shutdown_connections 2020-10-31T22:49:06.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.317+0000 7f619bfff700 1 --2- 172.21.15.60:0/2067704334 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f619c0b1570 0x7f619c12cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.322 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.317+0000 7f619bfff700 1 --2- 172.21.15.60:0/2067704334 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6180055020 0x7f61800574e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.317+0000 7f619bfff700 1 --2- 172.21.15.60:0/2067704334 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f619c0256a0 0x7f619c12f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.317+0000 7f619bfff700 1 --2- 172.21.15.60:0/2067704334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f619c0801c0 0x7f619c12c810 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.317+0000 7f619bfff700 1 -- 172.21.15.60:0/2067704334 >> 172.21.15.60:0/2067704334 conn(0x7f619c0b5440 msgr2=0x7f619c0aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.317+0000 7f619bfff700 1 -- 172.21.15.60:0/2067704334 shutdown_connections 2020-10-31T22:49:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.317+0000 7f619bfff700 1 -- 172.21.15.60:0/2067704334 wait complete. 2020-10-31T22:49:06.323 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.1 2020-10-31T22:49:06.335 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:49:06.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce84969700 1 Processor -- start 2020-10-31T22:49:06.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce84969700 1 -- start start 2020-10-31T22:49:06.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce84969700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fce80063140 0x7fce80140360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:06.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce84969700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fce800af130 0x7fce80140850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:06.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce84969700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce80063520 con 0x7fce800b13c0 2020-10-31T22:49:06.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce84969700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce801430e0 con 0x7fce800af130 2020-10-31T22:49:06.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce84969700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce80143380 con 0x7fce80063140 2020-10-31T22:49:06.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce7ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fce800b13c0 0x7fce800b1b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51576/0 (socket says 172.21.15.60:51576) 2020-10-31T22:49:06.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce7ffff700 1 -- 172.21.15.60:0/3579643149 learned_addr learned my addr 172.21.15.60:0/3579643149 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:06.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce7effd700 1 --2- 172.21.15.60:0/3579643149 >> v2:172.21.15.60:3300/0 conn(0x7fce800af130 0x7fce80140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:06.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce7f7fe700 1 --2- 172.21.15.60:0/3579643149 >> v2:172.21.15.66:3300/0 conn(0x7fce80063140 0x7fce80140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce7e7fc700 1 -- 172.21.15.60:0/3579643149 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4102370360 0 0) 0x7fce80063520 con 0x7fce800b13c0 2020-10-31T22:49:06.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce7e7fc700 1 -- 172.21.15.60:0/3579643149 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce6c003230 con 0x7fce800b13c0 2020-10-31T22:49:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce7effd700 1 -- 172.21.15.60:0/3579643149 >> v2:172.21.15.66:3300/0 conn(0x7fce80063140 msgr2=0x7fce80140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce7effd700 1 --2- 172.21.15.60:0/3579643149 >> v2:172.21.15.66:3300/0 conn(0x7fce80063140 0x7fce80140360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce7effd700 1 -- 172.21.15.60:0/3579643149 >> v1:172.21.15.60:6789/0 conn(0x7fce800b13c0 legacy=0x7fce800b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce7effd700 1 -- 172.21.15.60:0/3579643149 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce80143620 con 0x7fce800af130 2020-10-31T22:49:06.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce7effd700 1 --2- 172.21.15.60:0/3579643149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800af130 0x7fce80140850 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7fce74002f30 tx=0x7fce74006dc0).ready entity=mon.0 client_cookie=db997ed48648d8ab server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:06.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.445+0000 7fce7e7fc700 1 -- 172.21.15.60:0/3579643149 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce740096f0 con 0x7fce800af130 2020-10-31T22:49:06.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.449+0000 7fce7e7fc700 1 -- 172.21.15.60:0/3579643149 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce74009850 con 0x7fce800af130 2020-10-31T22:49:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.449+0000 7fce7e7fc700 1 -- 172.21.15.60:0/3579643149 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce74009bb0 con 0x7fce800af130 2020-10-31T22:49:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.449+0000 7fce84969700 1 -- 172.21.15.60:0/3579643149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800af130 msgr2=0x7fce80140850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.449+0000 7fce84969700 1 --2- 172.21.15.60:0/3579643149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800af130 0x7fce80140850 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 rx=0x7fce74002f30 tx=0x7fce74006dc0).stop 2020-10-31T22:49:06.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.449+0000 7fce84969700 1 -- 172.21.15.60:0/3579643149 shutdown_connections 2020-10-31T22:49:06.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.449+0000 7fce84969700 1 --2- 172.21.15.60:0/3579643149 >> v2:172.21.15.66:3300/0 conn(0x7fce80063140 0x7fce80140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.449+0000 7fce84969700 1 --2- 172.21.15.60:0/3579643149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce800af130 0x7fce80140850 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.449+0000 7fce84969700 1 -- 172.21.15.60:0/3579643149 >> 172.21.15.60:0/3579643149 conn(0x7fce8006a600 msgr2=0x7fce80060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:06.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.449+0000 7fce84969700 1 -- 172.21.15.60:0/3579643149 shutdown_connections 2020-10-31T22:49:06.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.449+0000 7fce84969700 1 -- 172.21.15.60:0/3579643149 wait complete. 2020-10-31T22:49:06.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.449+0000 7fce84969700 1 Processor -- start 2020-10-31T22:49:06.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.449+0000 7fce84969700 1 -- start start 2020-10-31T22:49:06.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce84969700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce80063140 0x7fce800a9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:06.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce84969700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce800af130 0x7fce800653e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:06.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce84969700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce800b13c0 0x7fce800658d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:06.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce84969700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce800aa2e0 con 0x7fce80063140 2020-10-31T22:49:06.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce84969700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce80065dc0 con 0x7fce800b13c0 2020-10-31T22:49:06.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce84969700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce8009df30 con 0x7fce800af130 2020-10-31T22:49:06.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce7f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce80063140 0x7fce800a9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:06.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce7f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce80063140 0x7fce800a9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47446/0 (socket says 172.21.15.60:47446) 2020-10-31T22:49:06.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce7f7fe700 1 -- 172.21.15.60:0/4077095979 learned_addr learned my addr 172.21.15.60:0/4077095979 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:06.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce7effd700 1 --2- 172.21.15.60:0/4077095979 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce800af130 0x7fce800653e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:06.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce7ffff700 1 --2- 172.21.15.60:0/4077095979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce800b13c0 0x7fce800658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:06.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce7f7fe700 1 -- 172.21.15.60:0/4077095979 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce800af130 msgr2=0x7fce800653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:06.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce7f7fe700 1 --2- 172.21.15.60:0/4077095979 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce800af130 0x7fce800653e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce7f7fe700 1 -- 172.21.15.60:0/4077095979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce800b13c0 msgr2=0x7fce800658d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:06.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce7f7fe700 1 --2- 172.21.15.60:0/4077095979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce800b13c0 0x7fce800658d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce7f7fe700 1 -- 172.21.15.60:0/4077095979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8009e160 con 0x7fce80063140 2020-10-31T22:49:06.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce7f7fe700 1 --2- 172.21.15.60:0/4077095979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce80063140 0x7fce800a9550 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fce80065f00 tx=0x7fce700091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:06.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce7cff9700 1 -- 172.21.15.60:0/4077095979 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce7000ca80 con 0x7fce80063140 2020-10-31T22:49:06.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce7cff9700 1 -- 172.21.15.60:0/4077095979 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce7000cbe0 con 0x7fce80063140 2020-10-31T22:49:06.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce84969700 1 -- 172.21.15.60:0/4077095979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce800675a0 con 0x7fce80063140 2020-10-31T22:49:06.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce7cff9700 1 -- 172.21.15.60:0/4077095979 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fce700123f0 con 0x7fce80063140 2020-10-31T22:49:06.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.453+0000 7fce84969700 1 -- 172.21.15.60:0/4077095979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce800abe20 con 0x7fce80063140 2020-10-31T22:49:06.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.457+0000 7fce7cff9700 1 -- 172.21.15.60:0/4077095979 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fce70022070 con 0x7fce80063140 2020-10-31T22:49:06.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.457+0000 7fce84969700 1 -- 172.21.15.60:0/4077095979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce800673c0 con 0x7fce80063140 2020-10-31T22:49:06.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.457+0000 7fce7cff9700 1 --2- 172.21.15.60:0/4077095979 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce60054f10 0x7fce600573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:06.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.457+0000 7fce7cff9700 1 -- 172.21.15.60:0/4077095979 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fce7006e0d0 con 0x7fce80063140 2020-10-31T22:49:06.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.457+0000 7fce7effd700 1 --2- 172.21.15.60:0/4077095979 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce60054f10 0x7fce600573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:06.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.457+0000 7fce7effd700 1 --2- 172.21.15.60:0/4077095979 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce60054f10 0x7fce600573d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fce7401b000 tx=0x7fce74015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:06.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.465+0000 7fce7cff9700 1 -- 172.21.15.60:0/4077095979 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fce700445f0 con 0x7fce80063140 2020-10-31T22:49:06.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.649+0000 7fce84969700 1 -- 172.21.15.60:0/4077095979 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce80057100 con 0x7fce80063140 2020-10-31T22:49:06.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.649+0000 7fce7cff9700 1 -- 172.21.15.60:0/4077095979 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+2493 (secure 0 0 0) 0x7fce70047c10 con 0x7fce80063140 2020-10-31T22:49:06.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.649+0000 7fce84969700 1 -- 172.21.15.60:0/4077095979 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce60054f10 msgr2=0x7fce600573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:06.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.649+0000 7fce84969700 1 --2- 172.21.15.60:0/4077095979 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce60054f10 0x7fce600573d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7fce7401b000 tx=0x7fce74015000).stop 2020-10-31T22:49:06.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.649+0000 7fce84969700 1 -- 172.21.15.60:0/4077095979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce80063140 msgr2=0x7fce800a9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:06.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.649+0000 7fce84969700 1 --2- 172.21.15.60:0/4077095979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce80063140 0x7fce800a9550 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 rx=0x7fce80065f00 tx=0x7fce700091a0).stop 2020-10-31T22:49:06.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.649+0000 7fce84969700 1 -- 172.21.15.60:0/4077095979 shutdown_connections 2020-10-31T22:49:06.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.649+0000 7fce84969700 1 --2- 172.21.15.60:0/4077095979 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fce60054f10 0x7fce600573d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.649+0000 7fce84969700 1 --2- 172.21.15.60:0/4077095979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce800b13c0 0x7fce800658d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.649+0000 7fce84969700 1 --2- 172.21.15.60:0/4077095979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fce80063140 0x7fce800a9550 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.649+0000 7fce84969700 1 --2- 172.21.15.60:0/4077095979 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce800af130 0x7fce800653e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:06.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.649+0000 7fce84969700 1 -- 172.21.15.60:0/4077095979 >> 172.21.15.60:0/4077095979 conn(0x7fce8006a600 msgr2=0x7fce800b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:06.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.649+0000 7fce84969700 1 -- 172.21.15.60:0/4077095979 shutdown_connections 2020-10-31T22:49:06.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:06.649+0000 7fce84969700 1 -- 172.21.15.60:0/4077095979 wait complete. 2020-10-31T22:49:06.658 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:06.658 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1212236578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1212236578},{"type":"v1","addr":"172.21.15.60:6835","nonce":1212236578}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3130935285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3130935285},{"type":"v1","addr":"172.21.15.66:6833","nonce":3130935285}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:49:03.919960+0000","modified":"2020-10-31T22:49:04.922872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7173},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7173":{"gid":7173,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/1399264415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1399264415},{"type":"v1","addr":"172.21.15.60:6837","nonce":1399264415}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-10-31T22:49:06.659 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 53 2020-10-31T22:49:06.971 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:49:03.919960+0000', 'modified': '2020-10-31T22:49:04.922872+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7173}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7173': {'gid': 7173, 'name': 'c', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/1399264415', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 1399264415}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 1399264415}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:49:06.971 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:49:06.972 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:49:07.105 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":7173,"want_state":"up:active","state":"up:active","rank_uptime":3.1708311349999998,"mdsmap_epoch":53,"osdmap_epoch":110,"osdmap_epoch_barrier":109,"uptime":8.5878696120000004} 2020-10-31T22:49:07.105 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 7173, "mdsmap_epoch": 53, "osdmap_epoch": 110, "osdmap_epoch_barrier": 109, "rank_uptime": 3.170831135, "state": "up:active", "uptime": 8.587869612, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:49:07.106 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:49:07.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.213+0000 7fd13e6f1700 1 Processor -- start 2020-10-31T22:49:07.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.213+0000 7fd13e6f1700 1 -- start start 2020-10-31T22:49:07.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13e6f1700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd138062c70 0x7fd1381431a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13e6f1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1380afbe0 0x7fd13805b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13e6f1700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1380b1c40 con 0x7fd1380a9120 2020-10-31T22:49:07.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13e6f1700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13813d620 con 0x7fd138062c70 2020-10-31T22:49:07.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13e6f1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1380b27d0 con 0x7fd1380afbe0 2020-10-31T22:49:07.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13cc8e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1380afbe0 0x7fd13805b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd137fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd138062c70 0x7fd1381431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13cc8e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1380afbe0 0x7fd13805b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:60646/0 (socket says 172.21.15.60:60646) 2020-10-31T22:49:07.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd12f7fe700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd1380a9120 0x7fd1380b1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:49458/0 (socket says 172.21.15.60:49458) 2020-10-31T22:49:07.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd137fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd138062c70 0x7fd1381431a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:58390/0 (socket says 172.21.15.60:58390) 2020-10-31T22:49:07.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13cc8e700 1 -- 172.21.15.60:0/2139535112 learned_addr learned my addr 172.21.15.60:0/2139535112 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:07.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd137fff700 1 -- 172.21.15.60:0/2139535112 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1380afbe0 msgr2=0x7fd13805b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:07.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd137fff700 1 --2- 172.21.15.60:0/2139535112 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1380afbe0 0x7fd13805b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd137fff700 1 -- 172.21.15.60:0/2139535112 >> v1:172.21.15.66:6789/0 conn(0x7fd1380a9120 legacy=0x7fd1380b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd137fff700 1 -- 172.21.15.60:0/2139535112 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1380b2a70 con 0x7fd138062c70 2020-10-31T22:49:07.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd1377fe700 1 -- 172.21.15.60:0/2139535112 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 974430651 0 0) 0x7fd1380b1c40 con 0x7fd1380a9120 2020-10-31T22:49:07.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd137fff700 1 --2- 172.21.15.60:0/2139535112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd138062c70 0x7fd1381431a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fd128002f30 tx=0x7fd128006dc0).ready entity=mon.1 client_cookie=45dd9d231979a361 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:07.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd1377fe700 1 -- 172.21.15.60:0/2139535112 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd128009760 con 0x7fd138062c70 2020-10-31T22:49:07.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd1377fe700 1 -- 172.21.15.60:0/2139535112 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1280098c0 con 0x7fd138062c70 2020-10-31T22:49:07.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd1377fe700 1 -- 172.21.15.60:0/2139535112 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd128009c20 con 0x7fd138062c70 2020-10-31T22:49:07.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2139535112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd138062c70 msgr2=0x7fd1381431a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13e6f1700 1 --2- 172.21.15.60:0/2139535112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd138062c70 0x7fd1381431a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7fd128002f30 tx=0x7fd128006dc0).stop 2020-10-31T22:49:07.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2139535112 shutdown_connections 2020-10-31T22:49:07.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13e6f1700 1 --2- 172.21.15.60:0/2139535112 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1380afbe0 0x7fd13805b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13e6f1700 1 --2- 172.21.15.60:0/2139535112 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd138062c70 0x7fd1381431a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2139535112 >> 172.21.15.60:0/2139535112 conn(0x7fd13805fae0 msgr2=0x7fd13805fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:07.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2139535112 shutdown_connections 2020-10-31T22:49:07.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.217+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2139535112 wait complete. 2020-10-31T22:49:07.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd13e6f1700 1 Processor -- start 2020-10-31T22:49:07.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd13e6f1700 1 -- start start 2020-10-31T22:49:07.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd13e6f1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd138062c70 0x7fd13805bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd13e6f1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1380a9120 0x7fd1380ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd13e6f1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1380afbe0 0x7fd1380ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd13e6f1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13805d6e0 con 0x7fd138062c70 2020-10-31T22:49:07.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd13e6f1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1381396b0 con 0x7fd1380a9120 2020-10-31T22:49:07.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd13e6f1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13813d7a0 con 0x7fd1380afbe0 2020-10-31T22:49:07.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd137fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd138062c70 0x7fd13805bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd137fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd138062c70 0x7fd13805bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47460/0 (socket says 172.21.15.60:47460) 2020-10-31T22:49:07.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd137fff700 1 -- 172.21.15.60:0/2874810499 learned_addr learned my addr 172.21.15.60:0/2874810499 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:07.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd13cc8e700 1 --2- 172.21.15.60:0/2874810499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1380afbe0 0x7fd1380ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd12f7fe700 1 --2- 172.21.15.60:0/2874810499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1380a9120 0x7fd1380ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd137fff700 1 -- 172.21.15.60:0/2874810499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1380afbe0 msgr2=0x7fd1380ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd137fff700 1 --2- 172.21.15.60:0/2874810499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1380afbe0 0x7fd1380ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd137fff700 1 -- 172.21.15.60:0/2874810499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1380a9120 msgr2=0x7fd1380ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd137fff700 1 --2- 172.21.15.60:0/2874810499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1380a9120 0x7fd1380ad3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd137fff700 1 -- 172.21.15.60:0/2874810499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1380acb90 con 0x7fd138062c70 2020-10-31T22:49:07.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd137fff700 1 --2- 172.21.15.60:0/2874810499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd138062c70 0x7fd13805bfb0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7fd1380ab9c0 tx=0x7fd128015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:07.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd135ffb700 1 -- 172.21.15.60:0/2874810499 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd128011990 con 0x7fd138062c70 2020-10-31T22:49:07.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd135ffb700 1 -- 172.21.15.60:0/2874810499 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd128011af0 con 0x7fd138062c70 2020-10-31T22:49:07.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd135ffb700 1 -- 172.21.15.60:0/2874810499 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd128011e50 con 0x7fd138062c70 2020-10-31T22:49:07.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2874810499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1380ab470 con 0x7fd138062c70 2020-10-31T22:49:07.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.221+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2874810499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1380ab1a0 con 0x7fd138062c70 2020-10-31T22:49:07.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.225+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2874810499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1380ab780 con 0x7fd138062c70 2020-10-31T22:49:07.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.225+0000 7fd135ffb700 1 -- 172.21.15.60:0/2874810499 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd128024030 con 0x7fd138062c70 2020-10-31T22:49:07.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.225+0000 7fd135ffb700 1 --2- 172.21.15.60:0/2874810499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd11c054f10 0x7fd11c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.225+0000 7fd135ffb700 1 -- 172.21.15.60:0/2874810499 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd12806e820 con 0x7fd138062c70 2020-10-31T22:49:07.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.225+0000 7fd12f7fe700 1 --2- 172.21.15.60:0/2874810499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd11c054f10 0x7fd11c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.225+0000 7fd12f7fe700 1 --2- 172.21.15.60:0/2874810499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd11c054f10 0x7fd11c0573d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fd12000d000 tx=0x7fd1200079b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:07.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.229+0000 7fd135ffb700 1 -- 172.21.15.60:0/2874810499 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd128044d40 con 0x7fd138062c70 2020-10-31T22:49:07.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.373+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2874810499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd138057100 con 0x7fd138062c70 2020-10-31T22:49:07.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.373+0000 7fd135ffb700 1 -- 172.21.15.60:0/2874810499 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16052 (secure 0 0 0) 0x7fd128022090 con 0x7fd138062c70 2020-10-31T22:49:07.381 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:07.381 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":110,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:49:04.923755+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:49:01.432008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2020-10-31T22:49:02.732480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:49:07.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.377+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2874810499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd11c054f10 msgr2=0x7fd11c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.377+0000 7fd13e6f1700 1 --2- 172.21.15.60:0/2874810499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd11c054f10 0x7fd11c0573d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7fd12000d000 tx=0x7fd1200079b0).stop 2020-10-31T22:49:07.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.377+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2874810499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd138062c70 msgr2=0x7fd13805bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.377+0000 7fd13e6f1700 1 --2- 172.21.15.60:0/2874810499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd138062c70 0x7fd13805bfb0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 rx=0x7fd1380ab9c0 tx=0x7fd128015000).stop 2020-10-31T22:49:07.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.377+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2874810499 shutdown_connections 2020-10-31T22:49:07.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.377+0000 7fd13e6f1700 1 --2- 172.21.15.60:0/2874810499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1380afbe0 0x7fd1380ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.377+0000 7fd13e6f1700 1 --2- 172.21.15.60:0/2874810499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd138062c70 0x7fd13805bfb0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.377+0000 7fd13e6f1700 1 --2- 172.21.15.60:0/2874810499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd11c054f10 0x7fd11c0573d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.377+0000 7fd13e6f1700 1 --2- 172.21.15.60:0/2874810499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1380a9120 0x7fd1380ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.377+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2874810499 >> 172.21.15.60:0/2874810499 conn(0x7fd13805fae0 msgr2=0x7fd1380b3120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:07.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.377+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2874810499 shutdown_connections 2020-10-31T22:49:07.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.377+0000 7fd13e6f1700 1 -- 172.21.15.60:0/2874810499 wait complete. 2020-10-31T22:49:07.396 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:49:01.432008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:49:02.732480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:49:07.397 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:49:07.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 Processor -- start 2020-10-31T22:49:07.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 -- start start 2020-10-31T22:49:07.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa55c0ac870 0x7fa55c146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa55c146550 0x7fa55c150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c0af900 con 0x7fa55c0af520 2020-10-31T22:49:07.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c0afc10 con 0x7fa55c146550 2020-10-31T22:49:07.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c05bb70 con 0x7fa55c0ac870 2020-10-31T22:49:07.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55affd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa55c0af520 0x7fa55c066c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51604/0 (socket says 172.21.15.60:51604) 2020-10-31T22:49:07.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55affd700 1 -- 172.21.15.60:0/3452646141 learned_addr learned my addr 172.21.15.60:0/3452646141 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:07.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55b7fe700 1 --2- 172.21.15.60:0/3452646141 >> v2:172.21.15.60:3300/0 conn(0x7fa55c146550 0x7fa55c150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55a7fc700 1 --2- 172.21.15.60:0/3452646141 >> v2:172.21.15.66:3300/0 conn(0x7fa55c0ac870 0x7fa55c146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa559ffb700 1 -- 172.21.15.60:0/3452646141 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1448398875 0 0) 0x7fa55c0af900 con 0x7fa55c0af520 2020-10-31T22:49:07.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa559ffb700 1 -- 172.21.15.60:0/3452646141 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa540003230 con 0x7fa55c0af520 2020-10-31T22:49:07.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55b7fe700 1 -- 172.21.15.60:0/3452646141 >> v2:172.21.15.66:3300/0 conn(0x7fa55c0ac870 msgr2=0x7fa55c146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:07.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55b7fe700 1 --2- 172.21.15.60:0/3452646141 >> v2:172.21.15.66:3300/0 conn(0x7fa55c0ac870 0x7fa55c146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55b7fe700 1 -- 172.21.15.60:0/3452646141 >> v1:172.21.15.60:6789/0 conn(0x7fa55c0af520 legacy=0x7fa55c066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55b7fe700 1 -- 172.21.15.60:0/3452646141 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c0ac130 con 0x7fa55c146550 2020-10-31T22:49:07.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55b7fe700 1 --2- 172.21.15.60:0/3452646141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55c146550 0x7fa55c150980 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7fa5540032b0 tx=0x7fa5540091a0).ready entity=mon.0 client_cookie=b6a30bce3a2eddb9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:07.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa559ffb700 1 -- 172.21.15.60:0/3452646141 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa55400b940 con 0x7fa55c146550 2020-10-31T22:49:07.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa559ffb700 1 -- 172.21.15.60:0/3452646141 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55400baa0 con 0x7fa55c146550 2020-10-31T22:49:07.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa559ffb700 1 -- 172.21.15.60:0/3452646141 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa55400bc10 con 0x7fa55c146550 2020-10-31T22:49:07.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 -- 172.21.15.60:0/3452646141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55c146550 msgr2=0x7fa55c150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.520 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 --2- 172.21.15.60:0/3452646141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55c146550 0x7fa55c150980 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 rx=0x7fa5540032b0 tx=0x7fa5540091a0).stop 2020-10-31T22:49:07.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 -- 172.21.15.60:0/3452646141 shutdown_connections 2020-10-31T22:49:07.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 --2- 172.21.15.60:0/3452646141 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55c146550 0x7fa55c150980 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 --2- 172.21.15.60:0/3452646141 >> v2:172.21.15.66:3300/0 conn(0x7fa55c0ac870 0x7fa55c146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 -- 172.21.15.60:0/3452646141 >> 172.21.15.60:0/3452646141 conn(0x7fa55c0b3fd0 msgr2=0x7fa55c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:07.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 -- 172.21.15.60:0/3452646141 shutdown_connections 2020-10-31T22:49:07.521 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.509+0000 7fa55bfff700 1 -- 172.21.15.60:0/3452646141 wait complete. 2020-10-31T22:49:07.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55bfff700 1 Processor -- start 2020-10-31T22:49:07.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55bfff700 1 -- start start 2020-10-31T22:49:07.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55c0ac870 0x7fa55c0aa770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa55c0af520 0x7fa55c148060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa55c146550 0x7fa55c148550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0a98b0 con 0x7fa55c0ac870 2020-10-31T22:49:07.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55bfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0621c0 con 0x7fa55c146550 2020-10-31T22:49:07.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c155190 con 0x7fa55c0af520 2020-10-31T22:49:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55c0ac870 0x7fa55c0aa770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55c0ac870 0x7fa55c0aa770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47474/0 (socket says 172.21.15.60:47474) 2020-10-31T22:49:07.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55affd700 1 -- 172.21.15.60:0/3818400069 learned_addr learned my addr 172.21.15.60:0/3818400069 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:07.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55b7fe700 1 --2- 172.21.15.60:0/3818400069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa55c146550 0x7fa55c148550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55a7fc700 1 --2- 172.21.15.60:0/3818400069 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa55c0af520 0x7fa55c148060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55affd700 1 -- 172.21.15.60:0/3818400069 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa55c0af520 msgr2=0x7fa55c148060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55affd700 1 --2- 172.21.15.60:0/3818400069 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa55c0af520 0x7fa55c148060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55affd700 1 -- 172.21.15.60:0/3818400069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa55c146550 msgr2=0x7fa55c148550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55affd700 1 --2- 172.21.15.60:0/3818400069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa55c146550 0x7fa55c148550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55affd700 1 -- 172.21.15.60:0/3818400069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c155430 con 0x7fa55c0ac870 2020-10-31T22:49:07.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55affd700 1 --2- 172.21.15.60:0/3818400069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55c0ac870 0x7fa55c0aa770 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7fa54c001250 tx=0x7fa54c0027a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:07.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa54bfff700 1 -- 172.21.15.60:0/3818400069 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54c0072e0 con 0x7fa55c0ac870 2020-10-31T22:49:07.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa54bfff700 1 -- 172.21.15.60:0/3818400069 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c0054b0 con 0x7fa55c0ac870 2020-10-31T22:49:07.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55bfff700 1 -- 172.21.15.60:0/3818400069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c1556d0 con 0x7fa55c0ac870 2020-10-31T22:49:07.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa54bfff700 1 -- 172.21.15.60:0/3818400069 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa54c005810 con 0x7fa55c0ac870 2020-10-31T22:49:07.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.513+0000 7fa55bfff700 1 -- 172.21.15.60:0/3818400069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c154e80 con 0x7fa55c0ac870 2020-10-31T22:49:07.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.517+0000 7fa54bfff700 1 -- 172.21.15.60:0/3818400069 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa54c01a060 con 0x7fa55c0ac870 2020-10-31T22:49:07.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.517+0000 7fa55bfff700 1 -- 172.21.15.60:0/3818400069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c155890 con 0x7fa55c0ac870 2020-10-31T22:49:07.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.517+0000 7fa54bfff700 1 --2- 172.21.15.60:0/3818400069 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5380550c0 0x7fa538057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.517+0000 7fa55a7fc700 1 --2- 172.21.15.60:0/3818400069 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5380550c0 0x7fa538057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.517+0000 7fa54bfff700 1 -- 172.21.15.60:0/3818400069 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa54c06d360 con 0x7fa55c0ac870 2020-10-31T22:49:07.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.517+0000 7fa55a7fc700 1 --2- 172.21.15.60:0/3818400069 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5380550c0 0x7fa538057580 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fa55000b000 tx=0x7fa550008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:07.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.521+0000 7fa54bfff700 1 -- 172.21.15.60:0/3818400069 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa54c043710 con 0x7fa55c0ac870 2020-10-31T22:49:07.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.661+0000 7fa55bfff700 1 -- 172.21.15.60:0/3818400069 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fa55c057100 con 0x7fa55c0ac870 2020-10-31T22:49:07.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.661+0000 7fa54bfff700 1 -- 172.21.15.60:0/3818400069 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v110) v1 ==== 110+0+10 (secure 0 0 0) 0x7fa54c018020 con 0x7fa55c0ac870 2020-10-31T22:49:07.669 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:49:07.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.665+0000 7fa55bfff700 1 -- 172.21.15.60:0/3818400069 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5380550c0 msgr2=0x7fa538057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.665+0000 7fa55bfff700 1 --2- 172.21.15.60:0/3818400069 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5380550c0 0x7fa538057580 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7fa55000b000 tx=0x7fa550008040).stop 2020-10-31T22:49:07.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.665+0000 7fa55bfff700 1 -- 172.21.15.60:0/3818400069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55c0ac870 msgr2=0x7fa55c0aa770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.665+0000 7fa55bfff700 1 --2- 172.21.15.60:0/3818400069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55c0ac870 0x7fa55c0aa770 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 rx=0x7fa54c001250 tx=0x7fa54c0027a0).stop 2020-10-31T22:49:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.665+0000 7fa55bfff700 1 -- 172.21.15.60:0/3818400069 shutdown_connections 2020-10-31T22:49:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.665+0000 7fa55bfff700 1 --2- 172.21.15.60:0/3818400069 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa5380550c0 0x7fa538057580 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.665+0000 7fa55bfff700 1 --2- 172.21.15.60:0/3818400069 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa55c146550 0x7fa55c148550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.665+0000 7fa55bfff700 1 --2- 172.21.15.60:0/3818400069 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa55c0ac870 0x7fa55c0aa770 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.665+0000 7fa55bfff700 1 --2- 172.21.15.60:0/3818400069 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa55c0af520 0x7fa55c148060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.665+0000 7fa55bfff700 1 -- 172.21.15.60:0/3818400069 >> 172.21.15.60:0/3818400069 conn(0x7fa55c0b3fd0 msgr2=0x7fa55c0b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:07.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.665+0000 7fa55bfff700 1 -- 172.21.15.60:0/3818400069 shutdown_connections 2020-10-31T22:49:07.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.665+0000 7fa55bfff700 1 -- 172.21.15.60:0/3818400069 wait complete. 2020-10-31T22:49:07.689 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:49:07.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63dbfff700 1 Processor -- start 2020-10-31T22:49:07.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63dbfff700 1 -- start start 2020-10-31T22:49:07.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63dbfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63dc05b180 0x7f63dc05fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63dbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f63dc0b0b70 0x7f63dc13f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63dbfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f63dc060220 0x7f63dc13f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63dbfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc05f3c0 con 0x7f63dc0b0b70 2020-10-31T22:49:07.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63dbfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63dc145f70 con 0x7f63dc060220 2020-10-31T22:49:07.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63dbfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc05f5f0 con 0x7f63dc05b180 2020-10-31T22:49:07.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63da7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f63dc0b0b70 0x7f63dc13f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63da7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f63dc0b0b70 0x7f63dc13f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47482/0 (socket says 172.21.15.60:47482) 2020-10-31T22:49:07.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63da7fc700 1 -- 172.21.15.60:0/1225995129 learned_addr learned my addr 172.21.15.60:0/1225995129 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:07.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63db7fe700 1 --2- 172.21.15.60:0/1225995129 >> v2:172.21.15.66:3300/0 conn(0x7f63dc060220 0x7f63dc13f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63daffd700 1 --2- 172.21.15.60:0/1225995129 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63dc05b180 0x7f63dc05fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63da7fc700 1 -- 172.21.15.60:0/1225995129 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63dc05b180 msgr2=0x7f63dc05fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:07.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63da7fc700 1 --2- 172.21.15.60:0/1225995129 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63dc05b180 0x7f63dc05fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63da7fc700 1 -- 172.21.15.60:0/1225995129 >> v2:172.21.15.66:3300/0 conn(0x7f63dc060220 msgr2=0x7f63dc13f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:07.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63da7fc700 1 --2- 172.21.15.60:0/1225995129 >> v2:172.21.15.66:3300/0 conn(0x7f63dc060220 0x7f63dc13f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63da7fc700 1 -- 172.21.15.60:0/1225995129 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc05f890 con 0x7f63dc0b0b70 2020-10-31T22:49:07.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63daffd700 1 --2- 172.21.15.60:0/1225995129 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63dc05b180 0x7f63dc05fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:07.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63da7fc700 1 --2- 172.21.15.60:0/1225995129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63dc0b0b70 0x7f63dc13f030 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f63c4002f30 tx=0x7f63c4006e80).ready entity=mon.0 client_cookie=ffc46811700ae20c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:07.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63d9ffb700 1 -- 172.21.15.60:0/1225995129 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63c40097f0 con 0x7f63dc0b0b70 2020-10-31T22:49:07.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63d9ffb700 1 -- 172.21.15.60:0/1225995129 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c4009950 con 0x7f63dc0b0b70 2020-10-31T22:49:07.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63d9ffb700 1 -- 172.21.15.60:0/1225995129 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63c4009cb0 con 0x7f63dc0b0b70 2020-10-31T22:49:07.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63dbfff700 1 -- 172.21.15.60:0/1225995129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63dc0b0b70 msgr2=0x7f63dc13f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.805+0000 7f63dbfff700 1 --2- 172.21.15.60:0/1225995129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63dc0b0b70 0x7f63dc13f030 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 rx=0x7f63c4002f30 tx=0x7f63c4006e80).stop 2020-10-31T22:49:07.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 -- 172.21.15.60:0/1225995129 shutdown_connections 2020-10-31T22:49:07.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 --2- 172.21.15.60:0/1225995129 >> v2:172.21.15.66:3300/0 conn(0x7f63dc060220 0x7f63dc13f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 --2- 172.21.15.60:0/1225995129 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63dc05b180 0x7f63dc05fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 --2- 172.21.15.60:0/1225995129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63dc0b0b70 0x7f63dc13f030 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 -- 172.21.15.60:0/1225995129 >> 172.21.15.60:0/1225995129 conn(0x7f63dc0b61d0 msgr2=0x7f63dc0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:07.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 -- 172.21.15.60:0/1225995129 shutdown_connections 2020-10-31T22:49:07.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 -- 172.21.15.60:0/1225995129 wait complete. 2020-10-31T22:49:07.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 Processor -- start 2020-10-31T22:49:07.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 -- start start 2020-10-31T22:49:07.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63dc05b180 0x7f63dc1487f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63dc060220 0x7f63dc1417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63dc0b0b70 0x7f63dc153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc142dd0 con 0x7f63dc05b180 2020-10-31T22:49:07.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc142710 con 0x7f63dc0b0b70 2020-10-31T22:49:07.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63dbfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63dc1429b0 con 0x7f63dc060220 2020-10-31T22:49:07.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63daffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63dc05b180 0x7f63dc1487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63daffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63dc05b180 0x7f63dc1487f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47488/0 (socket says 172.21.15.60:47488) 2020-10-31T22:49:07.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63daffd700 1 -- 172.21.15.60:0/4083511245 learned_addr learned my addr 172.21.15.60:0/4083511245 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:07.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63da7fc700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63dc060220 0x7f63dc1417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63db7fe700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63dc0b0b70 0x7f63dc153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63daffd700 1 -- 172.21.15.60:0/4083511245 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63dc060220 msgr2=0x7f63dc1417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63daffd700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63dc060220 0x7f63dc1417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63daffd700 1 -- 172.21.15.60:0/4083511245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63dc0b0b70 msgr2=0x7f63dc153f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63daffd700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63dc0b0b70 0x7f63dc153f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63daffd700 1 -- 172.21.15.60:0/4083511245 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63dc148df0 con 0x7f63dc05b180 2020-10-31T22:49:07.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63db7fe700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63dc0b0b70 0x7f63dc153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:07.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.809+0000 7f63daffd700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63dc05b180 0x7f63dc1487f0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f63cc006910 tx=0x7f63cc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:07.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.813+0000 7f63d3fff700 1 -- 172.21.15.60:0/4083511245 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63cc009980 con 0x7f63dc05b180 2020-10-31T22:49:07.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.813+0000 7f63d3fff700 1 -- 172.21.15.60:0/4083511245 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc009ae0 con 0x7f63dc05b180 2020-10-31T22:49:07.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.813+0000 7f63dbfff700 1 -- 172.21.15.60:0/4083511245 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63dc149090 con 0x7f63dc05b180 2020-10-31T22:49:07.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.813+0000 7f63d3fff700 1 -- 172.21.15.60:0/4083511245 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f63cc009e40 con 0x7f63dc05b180 2020-10-31T22:49:07.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.813+0000 7f63dbfff700 1 -- 172.21.15.60:0/4083511245 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63dc0a9fe0 con 0x7f63dc05b180 2020-10-31T22:49:07.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.813+0000 7f63dbfff700 1 -- 172.21.15.60:0/4083511245 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63dc148630 con 0x7f63dc05b180 2020-10-31T22:49:07.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.813+0000 7f63d3fff700 1 -- 172.21.15.60:0/4083511245 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f63cc013480 con 0x7f63dc05b180 2020-10-31T22:49:07.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.813+0000 7f63d3fff700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f63c0054f10 0x7f63c00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:07.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.813+0000 7f63da7fc700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f63c0054f10 0x7f63c00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:07.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.813+0000 7f63d3fff700 1 -- 172.21.15.60:0/4083511245 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f63cc06e060 con 0x7f63dc05b180 2020-10-31T22:49:07.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.813+0000 7f63da7fc700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f63c0054f10 0x7f63c00573d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f63c401c000 tx=0x7f63c4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:07.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.821+0000 7f63d3fff700 1 -- 172.21.15.60:0/4083511245 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f63cc044520 con 0x7f63dc05b180 2020-10-31T22:49:07.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.965+0000 7f63dbfff700 1 -- 172.21.15.60:0/4083511245 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f63dc057100 con 0x7f63dc05b180 2020-10-31T22:49:07.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.965+0000 7f63d3fff700 1 -- 172.21.15.60:0/4083511245 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7f63cc047b40 con 0x7f63dc05b180 2020-10-31T22:49:07.972 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:49:07.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.969+0000 7f63dbfff700 1 -- 172.21.15.60:0/4083511245 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f63c0054f10 msgr2=0x7f63c00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.969+0000 7f63dbfff700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f63c0054f10 0x7f63c00573d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f63c401c000 tx=0x7f63c4015000).stop 2020-10-31T22:49:07.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.969+0000 7f63dbfff700 1 -- 172.21.15.60:0/4083511245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63dc05b180 msgr2=0x7f63dc1487f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:07.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.969+0000 7f63dbfff700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63dc05b180 0x7f63dc1487f0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 rx=0x7f63cc006910 tx=0x7f63cc008040).stop 2020-10-31T22:49:07.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.969+0000 7f63dbfff700 1 -- 172.21.15.60:0/4083511245 shutdown_connections 2020-10-31T22:49:07.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.969+0000 7f63dbfff700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f63c0054f10 0x7f63c00573d0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.969+0000 7f63dbfff700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63dc0b0b70 0x7f63dc153f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.969+0000 7f63dbfff700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f63dc05b180 0x7f63dc1487f0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.969+0000 7f63dbfff700 1 --2- 172.21.15.60:0/4083511245 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63dc060220 0x7f63dc1417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:07.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.969+0000 7f63dbfff700 1 -- 172.21.15.60:0/4083511245 >> 172.21.15.60:0/4083511245 conn(0x7f63dc0b61d0 msgr2=0x7f63dc0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:07.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.969+0000 7f63dbfff700 1 -- 172.21.15.60:0/4083511245 shutdown_connections 2020-10-31T22:49:07.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:07.969+0000 7f63dbfff700 1 -- 172.21.15.60:0/4083511245 wait complete. 2020-10-31T22:49:07.986 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:49:08.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f16909bd700 1 Processor -- start 2020-10-31T22:49:08.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f16909bd700 1 -- start start 2020-10-31T22:49:08.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f16909bd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f168c0b0dc0 0x7f168c0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f16909bd700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c0653c0 con 0x7f168c13fd20 2020-10-31T22:49:08.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f16909bd700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f168c066b10 con 0x7f168c0664e0 2020-10-31T22:49:08.109 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f16909bd700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168c066930 con 0x7f168c0b0dc0 2020-10-31T22:49:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f168a59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f168c0b0dc0 0x7f168c0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f1689d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f168c13fd20 0x7f168c13d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51634/0 (socket says 172.21.15.60:51634) 2020-10-31T22:49:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f1689d9b700 1 -- 172.21.15.60:0/1251968497 learned_addr learned my addr 172.21.15.60:0/1251968497 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:08.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f168959a700 1 -- 172.21.15.60:0/1251968497 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912724669 0 0) 0x7f168c0653c0 con 0x7f168c13fd20 2020-10-31T22:49:08.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f168959a700 1 -- 172.21.15.60:0/1251968497 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1670003230 con 0x7f168c13fd20 2020-10-31T22:49:08.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f168a59c700 1 -- 172.21.15.60:0/1251968497 >> v1:172.21.15.66:6789/0 conn(0x7f168c0664e0 legacy=0x7f168c143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f168a59c700 1 -- 172.21.15.60:0/1251968497 >> v1:172.21.15.60:6789/0 conn(0x7f168c13fd20 legacy=0x7f168c13d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f168a59c700 1 -- 172.21.15.60:0/1251968497 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c066db0 con 0x7f168c0b0dc0 2020-10-31T22:49:08.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.101+0000 7f168a59c700 1 --2- 172.21.15.60:0/1251968497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f168c0b0dc0 0x7f168c0b2d50 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f1680002f30 tx=0x7f1680006dc0).ready entity=mon.0 client_cookie=f4445b8a169de095 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:08.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.105+0000 7f168959a700 1 -- 172.21.15.60:0/1251968497 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1680009800 con 0x7f168c0b0dc0 2020-10-31T22:49:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.105+0000 7f168959a700 1 -- 172.21.15.60:0/1251968497 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1680009960 con 0x7f168c0b0dc0 2020-10-31T22:49:08.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.105+0000 7f16909bd700 1 -- 172.21.15.60:0/1251968497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f168c0b0dc0 msgr2=0x7f168c0b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.105+0000 7f168959a700 1 -- 172.21.15.60:0/1251968497 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1680009cc0 con 0x7f168c0b0dc0 2020-10-31T22:49:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.105+0000 7f16909bd700 1 --2- 172.21.15.60:0/1251968497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f168c0b0dc0 0x7f168c0b2d50 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 rx=0x7f1680002f30 tx=0x7f1680006dc0).stop 2020-10-31T22:49:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.105+0000 7f16909bd700 1 -- 172.21.15.60:0/1251968497 shutdown_connections 2020-10-31T22:49:08.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.105+0000 7f16909bd700 1 --2- 172.21.15.60:0/1251968497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f168c0b0dc0 0x7f168c0b2d50 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.105+0000 7f16909bd700 1 -- 172.21.15.60:0/1251968497 >> 172.21.15.60:0/1251968497 conn(0x7f168c06a260 msgr2=0x7f168c063c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:08.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.105+0000 7f16909bd700 1 -- 172.21.15.60:0/1251968497 shutdown_connections 2020-10-31T22:49:08.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.105+0000 7f16909bd700 1 -- 172.21.15.60:0/1251968497 wait complete. 2020-10-31T22:49:08.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.105+0000 7f16909bd700 1 Processor -- start 2020-10-31T22:49:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.105+0000 7f16909bd700 1 -- start start 2020-10-31T22:49:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f16909bd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f168c0664e0 0x7f168c13b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f16909bd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f168c0b0dc0 0x7f168c142df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f16909bd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f168c13fd20 0x7f168c145170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f16909bd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c147020 con 0x7f168c0664e0 2020-10-31T22:49:08.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f16909bd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f168c1449a0 con 0x7f168c0b0dc0 2020-10-31T22:49:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f16909bd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168c144c40 con 0x7f168c13fd20 2020-10-31T22:49:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f168a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f168c0664e0 0x7f168c13b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f168a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f168c0664e0 0x7f168c13b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47502/0 (socket says 172.21.15.60:47502) 2020-10-31T22:49:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f168a59c700 1 -- 172.21.15.60:0/3716966283 learned_addr learned my addr 172.21.15.60:0/3716966283 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f1689d9b700 1 --2- 172.21.15.60:0/3716966283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f168c0b0dc0 0x7f168c142df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f168ad9d700 1 --2- 172.21.15.60:0/3716966283 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f168c13fd20 0x7f168c145170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f168a59c700 1 -- 172.21.15.60:0/3716966283 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f168c13fd20 msgr2=0x7f168c145170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f168a59c700 1 --2- 172.21.15.60:0/3716966283 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f168c13fd20 0x7f168c145170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f168a59c700 1 -- 172.21.15.60:0/3716966283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f168c0b0dc0 msgr2=0x7f168c142df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f168a59c700 1 --2- 172.21.15.60:0/3716966283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f168c0b0dc0 0x7f168c142df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f168a59c700 1 -- 172.21.15.60:0/3716966283 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c146d10 con 0x7f168c0664e0 2020-10-31T22:49:08.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f168a59c700 1 --2- 172.21.15.60:0/3716966283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f168c0664e0 0x7f168c13b2b0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f1680002f30 tx=0x7f1680015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:08.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f167b7fe700 1 -- 172.21.15.60:0/3716966283 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1680011ad0 con 0x7f168c0664e0 2020-10-31T22:49:08.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f167b7fe700 1 -- 172.21.15.60:0/3716966283 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1680011c30 con 0x7f168c0664e0 2020-10-31T22:49:08.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f16909bd700 1 -- 172.21.15.60:0/3716966283 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168c145660 con 0x7f168c0664e0 2020-10-31T22:49:08.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f167b7fe700 1 -- 172.21.15.60:0/3716966283 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f168001d440 con 0x7f168c0664e0 2020-10-31T22:49:08.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f16909bd700 1 -- 172.21.15.60:0/3716966283 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c14f880 con 0x7f168c0664e0 2020-10-31T22:49:08.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f167b7fe700 1 -- 172.21.15.60:0/3716966283 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1680017070 con 0x7f168c0664e0 2020-10-31T22:49:08.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f167b7fe700 1 --2- 172.21.15.60:0/3716966283 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1668054f10 0x7f16680573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f167b7fe700 1 -- 172.21.15.60:0/3716966283 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f168006e6f0 con 0x7f168c0664e0 2020-10-31T22:49:08.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f1689d9b700 1 --2- 172.21.15.60:0/3716966283 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1668054f10 0x7f16680573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f16909bd700 1 -- 172.21.15.60:0/3716966283 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168c0aa4a0 con 0x7f168c0664e0 2020-10-31T22:49:08.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.109+0000 7f1689d9b700 1 --2- 172.21.15.60:0/3716966283 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1668054f10 0x7f16680573d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f167c00d000 tx=0x7f167c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:08.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.117+0000 7f167b7fe700 1 -- 172.21.15.60:0/3716966283 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f168c0aa4a0 con 0x7f168c0664e0 2020-10-31T22:49:08.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.261+0000 7f16909bd700 1 -- 172.21.15.60:0/3716966283 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f168c0aa4a0 con 0x7f168c0664e0 2020-10-31T22:49:08.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.265+0000 7f167b7fe700 1 -- 172.21.15.60:0/3716966283 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+10 (secure 0 0 0) 0x7f168c0aa4a0 con 0x7f168c0664e0 2020-10-31T22:49:08.269 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:49:08.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.265+0000 7f16909bd700 1 -- 172.21.15.60:0/3716966283 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1668054f10 msgr2=0x7f16680573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.265+0000 7f16909bd700 1 --2- 172.21.15.60:0/3716966283 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1668054f10 0x7f16680573d0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f167c00d000 tx=0x7f167c009040).stop 2020-10-31T22:49:08.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.265+0000 7f16909bd700 1 -- 172.21.15.60:0/3716966283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f168c0664e0 msgr2=0x7f168c13b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.265+0000 7f16909bd700 1 --2- 172.21.15.60:0/3716966283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f168c0664e0 0x7f168c13b2b0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 rx=0x7f1680002f30 tx=0x7f1680015000).stop 2020-10-31T22:49:08.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.265+0000 7f16909bd700 1 -- 172.21.15.60:0/3716966283 shutdown_connections 2020-10-31T22:49:08.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.265+0000 7f16909bd700 1 --2- 172.21.15.60:0/3716966283 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f168c13fd20 0x7f168c145170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.265+0000 7f16909bd700 1 --2- 172.21.15.60:0/3716966283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f168c0664e0 0x7f168c13b2b0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.265+0000 7f16909bd700 1 --2- 172.21.15.60:0/3716966283 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1668054f10 0x7f16680573d0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.265+0000 7f16909bd700 1 --2- 172.21.15.60:0/3716966283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f168c0b0dc0 0x7f168c142df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.265+0000 7f16909bd700 1 -- 172.21.15.60:0/3716966283 >> 172.21.15.60:0/3716966283 conn(0x7f168c06a260 msgr2=0x7f168c0b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:08.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.265+0000 7f16909bd700 1 -- 172.21.15.60:0/3716966283 shutdown_connections 2020-10-31T22:49:08.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.265+0000 7f16909bd700 1 -- 172.21.15.60:0/3716966283 wait complete. 2020-10-31T22:49:08.290 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:49:08.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.401+0000 7f517caea700 1 Processor -- start 2020-10-31T22:49:08.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.401+0000 7f517caea700 1 -- start start 2020-10-31T22:49:08.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.401+0000 7f517caea700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f517805c660 0x7f51780b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.401+0000 7f517caea700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5178065f70 0x7f517813f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.401+0000 7f517caea700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5178066410 con 0x7f517813f880 2020-10-31T22:49:08.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.401+0000 7f517caea700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5178066d60 con 0x7f517805c660 2020-10-31T22:49:08.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.401+0000 7f517caea700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51780b5e80 con 0x7f5178065f70 2020-10-31T22:49:08.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.401+0000 7f517659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f517805c660 0x7f51780b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.401+0000 7f517659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f517805c660 0x7f51780b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47510/0 (socket says 172.21.15.60:47510) 2020-10-31T22:49:08.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.401+0000 7f517659c700 1 -- 172.21.15.60:0/3692847495 learned_addr learned my addr 172.21.15.60:0/3692847495 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:08.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.401+0000 7f5175d9b700 1 --2- 172.21.15.60:0/3692847495 >> v2:172.21.15.66:3300/0 conn(0x7f5178065f70 0x7f517813f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517659c700 1 -- 172.21.15.60:0/3692847495 >> v2:172.21.15.66:3300/0 conn(0x7f5178065f70 msgr2=0x7f517813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:08.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517659c700 1 --2- 172.21.15.60:0/3692847495 >> v2:172.21.15.66:3300/0 conn(0x7f5178065f70 0x7f517813f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517659c700 1 -- 172.21.15.60:0/3692847495 >> v1:172.21.15.66:6789/0 conn(0x7f517813f880 legacy=0x7f5178142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517659c700 1 -- 172.21.15.60:0/3692847495 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51780666b0 con 0x7f517805c660 2020-10-31T22:49:08.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517659c700 1 --2- 172.21.15.60:0/3692847495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f517805c660 0x7f51780b5990 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f51780b5fc0 tx=0x7f5170006e80).ready entity=mon.0 client_cookie=9e56cc342f9852b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:08.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517559a700 1 -- 172.21.15.60:0/3692847495 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51700097b0 con 0x7f517805c660 2020-10-31T22:49:08.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517559a700 1 -- 172.21.15.60:0/3692847495 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5170009910 con 0x7f517805c660 2020-10-31T22:49:08.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517559a700 1 -- 172.21.15.60:0/3692847495 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5170009c70 con 0x7f517805c660 2020-10-31T22:49:08.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 -- 172.21.15.60:0/3692847495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f517805c660 msgr2=0x7f51780b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 --2- 172.21.15.60:0/3692847495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f517805c660 0x7f51780b5990 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 rx=0x7f51780b5fc0 tx=0x7f5170006e80).stop 2020-10-31T22:49:08.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 -- 172.21.15.60:0/3692847495 shutdown_connections 2020-10-31T22:49:08.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 --2- 172.21.15.60:0/3692847495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f517805c660 0x7f51780b5990 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 --2- 172.21.15.60:0/3692847495 >> v2:172.21.15.66:3300/0 conn(0x7f5178065f70 0x7f517813f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 -- 172.21.15.60:0/3692847495 >> 172.21.15.60:0/3692847495 conn(0x7f51780601e0 msgr2=0x7f517805b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:08.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 -- 172.21.15.60:0/3692847495 shutdown_connections 2020-10-31T22:49:08.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 -- 172.21.15.60:0/3692847495 wait complete. 2020-10-31T22:49:08.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 Processor -- start 2020-10-31T22:49:08.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 -- start start 2020-10-31T22:49:08.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f517805c660 0x7f51780ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5178065f70 0x7f51780aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f517813f880 0x7f5178154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51780b9300 con 0x7f5178065f70 2020-10-31T22:49:08.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51780aedf0 con 0x7f517813f880 2020-10-31T22:49:08.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.405+0000 7f517caea700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51781546d0 con 0x7f517805c660 2020-10-31T22:49:08.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f5175d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5178065f70 0x7f51780aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f5175d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5178065f70 0x7f51780aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47518/0 (socket says 172.21.15.60:47518) 2020-10-31T22:49:08.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f5175d9b700 1 -- 172.21.15.60:0/2072188177 learned_addr learned my addr 172.21.15.60:0/2072188177 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:08.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f5176d9d700 1 --2- 172.21.15.60:0/2072188177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f517813f880 0x7f5178154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f517659c700 1 --2- 172.21.15.60:0/2072188177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f517805c660 0x7f51780ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f5175d9b700 1 -- 172.21.15.60:0/2072188177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f517805c660 msgr2=0x7f51780ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f5175d9b700 1 --2- 172.21.15.60:0/2072188177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f517805c660 0x7f51780ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f5175d9b700 1 -- 172.21.15.60:0/2072188177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f517813f880 msgr2=0x7f5178154b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f5175d9b700 1 --2- 172.21.15.60:0/2072188177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f517813f880 0x7f5178154b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f5175d9b700 1 -- 172.21.15.60:0/2072188177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51780adf20 con 0x7f5178065f70 2020-10-31T22:49:08.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f5175d9b700 1 --2- 172.21.15.60:0/2072188177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5178065f70 0x7f51780aa8b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f51780b2050 tx=0x7f5160006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:08.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f516f7fe700 1 -- 172.21.15.60:0/2072188177 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f516000ca10 con 0x7f5178065f70 2020-10-31T22:49:08.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f516f7fe700 1 -- 172.21.15.60:0/2072188177 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516000cb70 con 0x7f5178065f70 2020-10-31T22:49:08.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f517caea700 1 -- 172.21.15.60:0/2072188177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51780ae1c0 con 0x7f5178065f70 2020-10-31T22:49:08.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f516f7fe700 1 -- 172.21.15.60:0/2072188177 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f51600123f0 con 0x7f5178065f70 2020-10-31T22:49:08.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f517caea700 1 -- 172.21.15.60:0/2072188177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51780aada0 con 0x7f5178065f70 2020-10-31T22:49:08.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f517caea700 1 -- 172.21.15.60:0/2072188177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5178057100 con 0x7f5178065f70 2020-10-31T22:49:08.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.409+0000 7f516f7fe700 1 -- 172.21.15.60:0/2072188177 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5160012550 con 0x7f5178065f70 2020-10-31T22:49:08.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.413+0000 7f516f7fe700 1 --2- 172.21.15.60:0/2072188177 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5150054f10 0x7f51500573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.413+0000 7f516f7fe700 1 -- 172.21.15.60:0/2072188177 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f516006dd00 con 0x7f5178065f70 2020-10-31T22:49:08.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.413+0000 7f517659c700 1 --2- 172.21.15.60:0/2072188177 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5150054f10 0x7f51500573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.413+0000 7f517659c700 1 --2- 172.21.15.60:0/2072188177 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5150054f10 0x7f51500573d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f517001c000 tx=0x7f5170015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:08.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.417+0000 7f516f7fe700 1 -- 172.21.15.60:0/2072188177 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5160071030 con 0x7f5178065f70 2020-10-31T22:49:08.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.561+0000 7f517caea700 1 -- 172.21.15.60:0/2072188177 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f51780ae350 con 0x7f5178065f70 2020-10-31T22:49:08.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.561+0000 7f516f7fe700 1 -- 172.21.15.60:0/2072188177 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+10 (secure 0 0 0) 0x7f51600441c0 con 0x7f5178065f70 2020-10-31T22:49:08.567 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:49:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.561+0000 7f517caea700 1 -- 172.21.15.60:0/2072188177 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5150054f10 msgr2=0x7f51500573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.561+0000 7f517caea700 1 --2- 172.21.15.60:0/2072188177 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5150054f10 0x7f51500573d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f517001c000 tx=0x7f5170015000).stop 2020-10-31T22:49:08.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.561+0000 7f517caea700 1 -- 172.21.15.60:0/2072188177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5178065f70 msgr2=0x7f51780aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.561+0000 7f517caea700 1 --2- 172.21.15.60:0/2072188177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5178065f70 0x7f51780aa8b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 rx=0x7f51780b2050 tx=0x7f5160006dc0).stop 2020-10-31T22:49:08.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.561+0000 7f517caea700 1 -- 172.21.15.60:0/2072188177 shutdown_connections 2020-10-31T22:49:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.561+0000 7f517caea700 1 --2- 172.21.15.60:0/2072188177 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5150054f10 0x7f51500573d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.561+0000 7f517caea700 1 --2- 172.21.15.60:0/2072188177 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f517813f880 0x7f5178154b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.561+0000 7f517caea700 1 --2- 172.21.15.60:0/2072188177 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f517805c660 0x7f51780ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.561+0000 7f517caea700 1 --2- 172.21.15.60:0/2072188177 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5178065f70 0x7f51780aa8b0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.561+0000 7f517caea700 1 -- 172.21.15.60:0/2072188177 >> 172.21.15.60:0/2072188177 conn(0x7f51780601e0 msgr2=0x7f51780b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:08.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.561+0000 7f517caea700 1 -- 172.21.15.60:0/2072188177 shutdown_connections 2020-10-31T22:49:08.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.561+0000 7f517caea700 1 -- 172.21.15.60:0/2072188177 wait complete. 2020-10-31T22:49:08.581 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:49:08.582 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:49:08.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ee38d700 1 Processor -- start 2020-10-31T22:49:08.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ee38d700 1 -- start start 2020-10-31T22:49:08.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ee38d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e8146ea0 0x7f33e805bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ee38d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e80af200 con 0x7f33e805b960 2020-10-31T22:49:08.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ee38d700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e80b0f00 con 0x7f33e80a7850 2020-10-31T22:49:08.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ee38d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80b11a0 con 0x7f33e8146ea0 2020-10-31T22:49:08.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e7fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f33e805b960 0x7f33e80aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51660/0 (socket says 172.21.15.60:51660) 2020-10-31T22:49:08.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e7fff700 1 -- 172.21.15.60:0/3517242672 learned_addr learned my addr 172.21.15.60:0/3517242672 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:08.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ec92a700 1 --2- 172.21.15.60:0/3517242672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e8146ea0 0x7f33e805bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1915882720 0 0) 0x7f33e80af200 con 0x7f33e805b960 2020-10-31T22:49:08.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33c8003230 con 0x7f33e805b960 2020-10-31T22:49:08.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333406374 0 0) 0x7f33e80b0f00 con 0x7f33e80a7850 2020-10-31T22:49:08.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e80af200 con 0x7f33e80a7850 2020-10-31T22:49:08.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2920945082 0 0) 0x7f33c8003230 con 0x7f33e805b960 2020-10-31T22:49:08.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e8146ea0 msgr2=0x7f33e805bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:08.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 --2- 172.21.15.60:0/3517242672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e8146ea0 0x7f33e805bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 >> v1:172.21.15.66:6789/0 conn(0x7f33e80a7850 legacy=0x7f33e8146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e80b1440 con 0x7f33e805b960 2020-10-31T22:49:08.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f33d00016d0 con 0x7f33e805b960 2020-10-31T22:49:08.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ec92a700 1 --2- 172.21.15.60:0/3517242672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e8146ea0 0x7f33e805bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:08.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 >> v1:172.21.15.60:6789/0 conn(0x7f33e805b960 legacy=0x7f33e80aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 --2- 172.21.15.60:0/3517242672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33c80038e0 0x7f33c8003ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 --2- 172.21.15.60:0/3517242672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e8146ea0 0x7f33c80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 --2- 172.21.15.60:0/3517242672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33c80049c0 0x7f33c8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80b11a0 con 0x7f33c80049c0 2020-10-31T22:49:08.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c8005360 con 0x7f33c80038e0 2020-10-31T22:49:08.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c800b770 con 0x7f33e8146ea0 2020-10-31T22:49:08.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ec92a700 1 --2- 172.21.15.60:0/3517242672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33c80049c0 0x7f33c8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e7fff700 1 --2- 172.21.15.60:0/3517242672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33c80038e0 0x7f33c8003ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e77fe700 1 --2- 172.21.15.60:0/3517242672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e8146ea0 0x7f33c80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ec92a700 1 -- 172.21.15.60:0/3517242672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e8146ea0 msgr2=0x7f33c80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:08.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ec92a700 1 --2- 172.21.15.60:0/3517242672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e8146ea0 0x7f33c80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ec92a700 1 -- 172.21.15.60:0/3517242672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33c80038e0 msgr2=0x7f33c8003ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:08.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ec92a700 1 --2- 172.21.15.60:0/3517242672 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33c80038e0 0x7f33c8003ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ec92a700 1 -- 172.21.15.60:0/3517242672 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c8003230 con 0x7f33c80049c0 2020-10-31T22:49:08.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33ec92a700 1 --2- 172.21.15.60:0/3517242672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33c80049c0 0x7f33c8004e40 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f33c80054a0 tx=0x7f33d8008040).ready entity=mon.0 client_cookie=f78ce248a688942a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:08.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d800ec30 con 0x7f33c80049c0 2020-10-31T22:49:08.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.689+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d800ed90 con 0x7f33c80049c0 2020-10-31T22:49:08.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.693+0000 7f33e6ffd700 1 -- 172.21.15.60:0/3517242672 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d80125e0 con 0x7f33c80049c0 2020-10-31T22:49:08.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.693+0000 7f33ee38d700 1 -- 172.21.15.60:0/3517242672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33c80049c0 msgr2=0x7f33c8004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.693+0000 7f33ee38d700 1 --2- 172.21.15.60:0/3517242672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33c80049c0 0x7f33c8004e40 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 rx=0x7f33c80054a0 tx=0x7f33d8008040).stop 2020-10-31T22:49:08.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.693+0000 7f33ec92a700 1 -- 172.21.15.60:0/3517242672 reap_dead start 2020-10-31T22:49:08.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.693+0000 7f33ee38d700 1 -- 172.21.15.60:0/3517242672 shutdown_connections 2020-10-31T22:49:08.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.693+0000 7f33ee38d700 1 -- 172.21.15.60:0/3517242672 >> 172.21.15.60:0/3517242672 conn(0x7f33e806a260 msgr2=0x7f33e8061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:08.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.693+0000 7f33ee38d700 1 -- 172.21.15.60:0/3517242672 shutdown_connections 2020-10-31T22:49:08.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.693+0000 7f33ee38d700 1 -- 172.21.15.60:0/3517242672 wait complete. 2020-10-31T22:49:08.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.693+0000 7f33ee38d700 1 Processor -- start 2020-10-31T22:49:08.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.693+0000 7f33ee38d700 1 -- start start 2020-10-31T22:49:08.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33ee38d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e814ccc0 0x7f33e813f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33ee38d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e80acef0 0x7f33e813f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33ee38d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33e80a8040 0x7f33e80a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33ee38d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e814d0a0 con 0x7f33e80acef0 2020-10-31T22:49:08.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33ee38d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80aa340 con 0x7f33e80a8040 2020-10-31T22:49:08.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33ee38d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80aa5e0 con 0x7f33e814ccc0 2020-10-31T22:49:08.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33e77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e80acef0 0x7f33e813f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33e7fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e814ccc0 0x7f33e813f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33e77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e80acef0 0x7f33e813f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47538/0 (socket says 172.21.15.60:47538) 2020-10-31T22:49:08.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33e77fe700 1 -- 172.21.15.60:0/173086626 learned_addr learned my addr 172.21.15.60:0/173086626 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:08.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33ec92a700 1 --2- 172.21.15.60:0/173086626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33e80a8040 0x7f33e80a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33e7fff700 1 -- 172.21.15.60:0/173086626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33e80a8040 msgr2=0x7f33e80a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33e7fff700 1 --2- 172.21.15.60:0/173086626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33e80a8040 0x7f33e80a84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33e7fff700 1 -- 172.21.15.60:0/173086626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e80acef0 msgr2=0x7f33e813f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33e7fff700 1 --2- 172.21.15.60:0/173086626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e80acef0 0x7f33e813f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33e7fff700 1 -- 172.21.15.60:0/173086626 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e80aa880 con 0x7f33e814ccc0 2020-10-31T22:49:08.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33e77fe700 1 --2- 172.21.15.60:0/173086626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e80acef0 0x7f33e813f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:08.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33e7fff700 1 --2- 172.21.15.60:0/173086626 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e814ccc0 0x7f33e813f3a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f33d000d000 tx=0x7f33d0007600).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:08.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33e57fa700 1 -- 172.21.15.60:0/173086626 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d0011850 con 0x7f33e814ccc0 2020-10-31T22:49:08.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33e57fa700 1 -- 172.21.15.60:0/173086626 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d00119b0 con 0x7f33e814ccc0 2020-10-31T22:49:08.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33ee38d700 1 -- 172.21.15.60:0/173086626 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e80aab20 con 0x7f33e814ccc0 2020-10-31T22:49:08.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33e57fa700 1 -- 172.21.15.60:0/173086626 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33d0011d10 con 0x7f33e814ccc0 2020-10-31T22:49:08.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33ee38d700 1 -- 172.21.15.60:0/173086626 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e813fd80 con 0x7f33e814ccc0 2020-10-31T22:49:08.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.697+0000 7f33ee38d700 1 -- 172.21.15.60:0/173086626 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e80aacb0 con 0x7f33e814ccc0 2020-10-31T22:49:08.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.701+0000 7f33e57fa700 1 -- 172.21.15.60:0/173086626 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f33d001b030 con 0x7f33e814ccc0 2020-10-31T22:49:08.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.701+0000 7f33e57fa700 1 --2- 172.21.15.60:0/173086626 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33cc055050 0x7f33cc057510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:08.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.701+0000 7f33e57fa700 1 -- 172.21.15.60:0/173086626 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f33d006d260 con 0x7f33e814ccc0 2020-10-31T22:49:08.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.701+0000 7f33e77fe700 1 --2- 172.21.15.60:0/173086626 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33cc055050 0x7f33cc057510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:08.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.701+0000 7f33e77fe700 1 --2- 172.21.15.60:0/173086626 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33cc055050 0x7f33cc057510 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f33e000d000 tx=0x7f33e000c040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:08.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.713+0000 7f33e57fa700 1 -- 172.21.15.60:0/173086626 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f33d00436e0 con 0x7f33e814ccc0 2020-10-31T22:49:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.897+0000 7f33ee38d700 1 -- 172.21.15.60:0/173086626 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33e8057100 con 0x7f33e814ccc0 2020-10-31T22:49:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.897+0000 7f33e57fa700 1 -- 172.21.15.60:0/173086626 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f33d0019030 con 0x7f33e814ccc0 2020-10-31T22:49:08.903 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:08.904 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1212236578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1212236578},{"type":"v1","addr":"172.21.15.60:6835","nonce":1212236578}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3130935285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3130935285},{"type":"v1","addr":"172.21.15.66:6833","nonce":3130935285}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:49:03.919960+0000","modified":"2020-10-31T22:49:04.922872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7173},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7173":{"gid":7173,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/1399264415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1399264415},{"type":"v1","addr":"172.21.15.60:6837","nonce":1399264415}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-10-31T22:49:08.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.897+0000 7f33ee38d700 1 -- 172.21.15.60:0/173086626 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33cc055050 msgr2=0x7f33cc057510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.897+0000 7f33ee38d700 1 --2- 172.21.15.60:0/173086626 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33cc055050 0x7f33cc057510 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f33e000d000 tx=0x7f33e000c040).stop 2020-10-31T22:49:08.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.901+0000 7f33ee38d700 1 -- 172.21.15.60:0/173086626 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e814ccc0 msgr2=0x7f33e813f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:08.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.901+0000 7f33ee38d700 1 --2- 172.21.15.60:0/173086626 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e814ccc0 0x7f33e813f3a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f33d000d000 tx=0x7f33d0007600).stop 2020-10-31T22:49:08.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.901+0000 7f33ee38d700 1 -- 172.21.15.60:0/173086626 shutdown_connections 2020-10-31T22:49:08.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.901+0000 7f33ee38d700 1 --2- 172.21.15.60:0/173086626 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33cc055050 0x7f33cc057510 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.901+0000 7f33ee38d700 1 --2- 172.21.15.60:0/173086626 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f33e80a8040 0x7f33e80a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.901+0000 7f33ee38d700 1 --2- 172.21.15.60:0/173086626 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f33e814ccc0 0x7f33e813f3a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.901+0000 7f33ee38d700 1 --2- 172.21.15.60:0/173086626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33e80acef0 0x7f33e813f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.901+0000 7f33ee38d700 1 -- 172.21.15.60:0/173086626 >> 172.21.15.60:0/173086626 conn(0x7f33e806a260 msgr2=0x7f33e81481a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.901+0000 7f33ee38d700 1 -- 172.21.15.60:0/173086626 shutdown_connections 2020-10-31T22:49:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:08.901+0000 7f33ee38d700 1 -- 172.21.15.60:0/173086626 wait complete. 2020-10-31T22:49:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 53 2020-10-31T22:49:09.225 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:49:03.919960+0000', 'modified': '2020-10-31T22:49:04.922872+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7173}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7173': {'gid': 7173, 'name': 'c', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/1399264415', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 1399264415}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 1399264415}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:49:09.225 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:49:09.226 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:49:09.354 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":7173,"want_state":"up:active","state":"up:active","rank_uptime":5.4209619360000003,"mdsmap_epoch":53,"osdmap_epoch":110,"osdmap_epoch_barrier":109,"uptime":10.837990129} 2020-10-31T22:49:09.355 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 7173, "mdsmap_epoch": 53, "osdmap_epoch": 110, "osdmap_epoch_barrier": 109, "rank_uptime": 5.420961936, "state": "up:active", "uptime": 10.837990129, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:49:09.356 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:49:09.356 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:49:09.356 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:49:09.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:09.357 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:09.364 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:49:09.421 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:49:09.422 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:49:09.477 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:49:09.478 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:49:09.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:09.479 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:49:09.525 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:49:09.526 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:09.569 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:49:09.584 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:49:09.585 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:49:09.641 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:49:09.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:49:09.639+0000 7f0fbd5910c0 -1 init, newargv = 0x55a9364d8550 newargc=9ceph-fuse[ 2020-10-31T22:49:09.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:13899]: starting ceph client 2020-10-31T22:49:09.642 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:49:09.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:09.644 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:49:09.650 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13899]: starting fuse 2020-10-31T22:49:09.654 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:49:09.655 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:49:09.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:09.655 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:49:09.656 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:49:09.656 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:49:09.656 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:49:09.657 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:49:09.657 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:49:09.657 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:49:09.658 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:49:09.658 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:49:09.658 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:49:09.659 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:49:09.659 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:49:09.659 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:49:09.660 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:49:09.660 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:49:09.660 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:49:09.660 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:49:09.661 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:49:09.661 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:49:09.661 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:49:09.662 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:49:09.662 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:49:09.662 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:49:09.740 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.13899.asok 2020-10-31T22:49:09.744 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13899.asok 2020-10-31T22:49:09.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:09.745 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13899.asok status 2020-10-31T22:49:09.841 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:49:09.842 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:49:09.842 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:49:09.842 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:49:09.842 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:49:09.842 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:49:09.843 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:49:09.843 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "13899", 2020-10-31T22:49:09.843 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:49:09.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:49:09.843 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:49:09.843 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:49:09.844 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 6443, 2020-10-31T22:49:09.844 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:49:09.844 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:49:09.845 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:49:09.845 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 6443 2020-10-31T22:49:09.845 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:49:09.845 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:49:09.845 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:49:09.845 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:49:09.846 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 976965961 2020-10-31T22:49:09.846 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:49:09.846 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:49:09.846 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:49:09.846 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:49:09.846 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:49:09.846 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 976965961 2020-10-31T22:49:09.847 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:49:09.847 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.6443 172.21.15.152:0/976965961", 2020-10-31T22:49:09.847 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/976965961", 2020-10-31T22:49:09.847 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:49:09.847 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 53, 2020-10-31T22:49:09.847 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 110, 2020-10-31T22:49:09.847 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:49:09.848 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:49:09.848 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:49:09.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:09.852 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:09.853 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:09.860 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:49:09.861 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:49:09.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:09.862 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:09.920 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:49:10.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c97fff700 1 Processor -- start 2020-10-31T22:49:10.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c97fff700 1 -- start start 2020-10-31T22:49:10.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c97fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5c980b5570 0x7f5c980b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c97fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c980b24a0 0x7f5c98145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c97fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c98145180 con 0x7f5c98145d10 2020-10-31T22:49:10.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c97fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c980afae0 con 0x7f5c980b5570 2020-10-31T22:49:10.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c97fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c98141bf0 con 0x7f5c980b24a0 2020-10-31T22:49:10.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c8ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c980b24a0 0x7f5c98145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c96ffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5c980b5570 0x7f5c980b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c96ffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5c980b5570 0x7f5c980b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:58480/0 (socket says 172.21.15.60:58480) 2020-10-31T22:49:10.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c96ffd700 1 -- 172.21.15.60:0/3449853448 learned_addr learned my addr 172.21.15.60:0/3449853448 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:10.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c8ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c980b24a0 0x7f5c98145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:60734/0 (socket says 172.21.15.60:60734) 2020-10-31T22:49:10.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c977fe700 1 --1- 172.21.15.60:0/3449853448 >> v1:172.21.15.66:6789/0 conn(0x7f5c98145d10 0x7f5c98141fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:49552/0 (socket says 172.21.15.60:49552) 2020-10-31T22:49:10.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c96ffd700 1 -- 172.21.15.60:0/3449853448 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c980b24a0 msgr2=0x7f5c98145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:10.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c96ffd700 1 --2- 172.21.15.60:0/3449853448 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c980b24a0 0x7f5c98145820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c96ffd700 1 -- 172.21.15.60:0/3449853448 >> v1:172.21.15.66:6789/0 conn(0x7f5c98145d10 legacy=0x7f5c98141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c96ffd700 1 -- 172.21.15.60:0/3449853448 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c980b0670 con 0x7f5c980b5570 2020-10-31T22:49:10.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c96ffd700 1 --2- 172.21.15.60:0/3449853448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c980b5570 0x7f5c980b5950 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f5c88002f30 tx=0x7f5c88006e80).ready entity=mon.1 client_cookie=8dd28b213c10778e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:10.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c967fc700 1 -- 172.21.15.60:0/3449853448 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c880097f0 con 0x7f5c980b5570 2020-10-31T22:49:10.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c967fc700 1 -- 172.21.15.60:0/3449853448 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c88009950 con 0x7f5c980b5570 2020-10-31T22:49:10.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c967fc700 1 -- 172.21.15.60:0/3449853448 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c88009cb0 con 0x7f5c980b5570 2020-10-31T22:49:10.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c97fff700 1 -- 172.21.15.60:0/3449853448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c980b5570 msgr2=0x7f5c980b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.033+0000 7f5c97fff700 1 --2- 172.21.15.60:0/3449853448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c980b5570 0x7f5c980b5950 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f5c88002f30 tx=0x7f5c88006e80).stop 2020-10-31T22:49:10.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 -- 172.21.15.60:0/3449853448 shutdown_connections 2020-10-31T22:49:10.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 --2- 172.21.15.60:0/3449853448 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c980b5570 0x7f5c980b5950 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 --2- 172.21.15.60:0/3449853448 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c980b24a0 0x7f5c98145820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 -- 172.21.15.60:0/3449853448 >> 172.21.15.60:0/3449853448 conn(0x7f5c980b8e90 msgr2=0x7f5c980b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:10.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 -- 172.21.15.60:0/3449853448 shutdown_connections 2020-10-31T22:49:10.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 -- 172.21.15.60:0/3449853448 wait complete. 2020-10-31T22:49:10.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 Processor -- start 2020-10-31T22:49:10.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 -- start start 2020-10-31T22:49:10.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c980b24a0 0x7f5c981549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c980b5570 0x7f5c9813be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c98145d10 0x7f5c981391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c98143e90 con 0x7f5c980b24a0 2020-10-31T22:49:10.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c981440f0 con 0x7f5c98145d10 2020-10-31T22:49:10.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c98144390 con 0x7f5c980b5570 2020-10-31T22:49:10.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c96ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c980b24a0 0x7f5c981549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c96ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c980b24a0 0x7f5c981549f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47550/0 (socket says 172.21.15.60:47550) 2020-10-31T22:49:10.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c96ffd700 1 -- 172.21.15.60:0/73921631 learned_addr learned my addr 172.21.15.60:0/73921631 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:10.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c8ffff700 1 --2- 172.21.15.60:0/73921631 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c980b5570 0x7f5c9813be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c977fe700 1 --2- 172.21.15.60:0/73921631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c98145d10 0x7f5c981391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c96ffd700 1 -- 172.21.15.60:0/73921631 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c980b5570 msgr2=0x7f5c9813be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c96ffd700 1 --2- 172.21.15.60:0/73921631 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c980b5570 0x7f5c9813be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c96ffd700 1 -- 172.21.15.60:0/73921631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c98145d10 msgr2=0x7f5c981391a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c96ffd700 1 --2- 172.21.15.60:0/73921631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c98145d10 0x7f5c981391a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c96ffd700 1 -- 172.21.15.60:0/73921631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c98144630 con 0x7f5c980b24a0 2020-10-31T22:49:10.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c96ffd700 1 --2- 172.21.15.60:0/73921631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c980b24a0 0x7f5c981549f0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f5c88002f30 tx=0x7f5c88015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:10.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c94ff9700 1 -- 172.21.15.60:0/73921631 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c88011bf0 con 0x7f5c980b24a0 2020-10-31T22:49:10.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c94ff9700 1 -- 172.21.15.60:0/73921631 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c88011d50 con 0x7f5c980b24a0 2020-10-31T22:49:10.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 -- 172.21.15.60:0/73921631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c98139ca0 con 0x7f5c980b24a0 2020-10-31T22:49:10.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c94ff9700 1 -- 172.21.15.60:0/73921631 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c8801e650 con 0x7f5c980b24a0 2020-10-31T22:49:10.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.037+0000 7f5c97fff700 1 -- 172.21.15.60:0/73921631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c9813fa90 con 0x7f5c980b24a0 2020-10-31T22:49:10.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.041+0000 7f5c97fff700 1 -- 172.21.15.60:0/73921631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c98057100 con 0x7f5c980b24a0 2020-10-31T22:49:10.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.041+0000 7f5c94ff9700 1 -- 172.21.15.60:0/73921631 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5c88025030 con 0x7f5c980b24a0 2020-10-31T22:49:10.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.041+0000 7f5c94ff9700 1 --2- 172.21.15.60:0/73921631 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c7c054f10 0x7f5c7c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.041+0000 7f5c94ff9700 1 -- 172.21.15.60:0/73921631 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5c8806ed40 con 0x7f5c980b24a0 2020-10-31T22:49:10.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.041+0000 7f5c8ffff700 1 --2- 172.21.15.60:0/73921631 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c7c054f10 0x7f5c7c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.041+0000 7f5c8ffff700 1 --2- 172.21.15.60:0/73921631 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c7c054f10 0x7f5c7c0573d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f5c8000b000 tx=0x7f5c80006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:10.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.045+0000 7f5c94ff9700 1 -- 172.21.15.60:0/73921631 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5c88045260 con 0x7f5c980b24a0 2020-10-31T22:49:10.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.189+0000 7f5c97fff700 1 -- 172.21.15.60:0/73921631 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c9805a8e0 con 0x7f5c980b24a0 2020-10-31T22:49:10.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.193+0000 7f5c94ff9700 1 -- 172.21.15.60:0/73921631 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f5c88023020 con 0x7f5c980b24a0 2020-10-31T22:49:10.199 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:10.199 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":110,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:49:04.923755+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":19,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:49:01.432008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":20,"pool_name":"cephfs_data","create_time":"2020-10-31T22:49:02.732480+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:49:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.197+0000 7f5c97fff700 1 -- 172.21.15.60:0/73921631 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c7c054f10 msgr2=0x7f5c7c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.197+0000 7f5c97fff700 1 --2- 172.21.15.60:0/73921631 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c7c054f10 0x7f5c7c0573d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f5c8000b000 tx=0x7f5c80006dc0).stop 2020-10-31T22:49:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.197+0000 7f5c97fff700 1 -- 172.21.15.60:0/73921631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c980b24a0 msgr2=0x7f5c981549f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.197+0000 7f5c97fff700 1 --2- 172.21.15.60:0/73921631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c980b24a0 0x7f5c981549f0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 rx=0x7f5c88002f30 tx=0x7f5c88015000).stop 2020-10-31T22:49:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.197+0000 7f5c97fff700 1 -- 172.21.15.60:0/73921631 shutdown_connections 2020-10-31T22:49:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.197+0000 7f5c97fff700 1 --2- 172.21.15.60:0/73921631 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c7c054f10 0x7f5c7c0573d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.197+0000 7f5c97fff700 1 --2- 172.21.15.60:0/73921631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c98145d10 0x7f5c981391a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.197+0000 7f5c97fff700 1 --2- 172.21.15.60:0/73921631 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c980b24a0 0x7f5c981549f0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.197+0000 7f5c97fff700 1 --2- 172.21.15.60:0/73921631 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c980b5570 0x7f5c9813be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.197+0000 7f5c97fff700 1 -- 172.21.15.60:0/73921631 >> 172.21.15.60:0/73921631 conn(0x7f5c980b8e90 msgr2=0x7f5c9813dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:10.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.197+0000 7f5c97fff700 1 -- 172.21.15.60:0/73921631 shutdown_connections 2020-10-31T22:49:10.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.197+0000 7f5c97fff700 1 -- 172.21.15.60:0/73921631 wait complete. 2020-10-31T22:49:10.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 19, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:49:01.432008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '109', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 20, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:49:02.732480+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:49:10.222 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:49:10.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.341+0000 7fe893fff700 1 Processor -- start 2020-10-31T22:49:10.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.341+0000 7fe893fff700 1 -- start start 2020-10-31T22:49:10.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8940b14f0 0x7fe8940a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe8940ab820 0x7fe8940ae730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe8940aec20 0x7fe8941403a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8940b18d0 con 0x7fe8940aec20 2020-10-31T22:49:10.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8940afac0 con 0x7fe8940ab820 2020-10-31T22:49:10.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89405b520 con 0x7fe8940b14f0 2020-10-31T22:49:10.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe8937fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe8940aec20 0x7fe8941403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe8937fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe8940aec20 0x7fe8941403a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47562/0 (socket says 172.21.15.60:47562) 2020-10-31T22:49:10.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe8937fe700 1 -- 172.21.15.60:0/1450936484 learned_addr learned my addr 172.21.15.60:0/1450936484 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:10.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe8927fc700 1 --2- 172.21.15.60:0/1450936484 >> v2:172.21.15.66:3300/0 conn(0x7fe8940ab820 0x7fe8940ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe892ffd700 1 --2- 172.21.15.60:0/1450936484 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8940b14f0 0x7fe8940a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe8937fe700 1 -- 172.21.15.60:0/1450936484 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8940b14f0 msgr2=0x7fe8940a4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe8937fe700 1 --2- 172.21.15.60:0/1450936484 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8940b14f0 0x7fe8940a4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe8937fe700 1 -- 172.21.15.60:0/1450936484 >> v2:172.21.15.66:3300/0 conn(0x7fe8940ab820 msgr2=0x7fe8940ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe8937fe700 1 --2- 172.21.15.60:0/1450936484 >> v2:172.21.15.66:3300/0 conn(0x7fe8940ab820 0x7fe8940ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe8937fe700 1 -- 172.21.15.60:0/1450936484 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89405b900 con 0x7fe8940aec20 2020-10-31T22:49:10.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe892ffd700 1 --2- 172.21.15.60:0/1450936484 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8940b14f0 0x7fe8940a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:10.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe8937fe700 1 --2- 172.21.15.60:0/1450936484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8940aec20 0x7fe8941403a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fe88c003300 tx=0x7fe88c009250).ready entity=mon.0 client_cookie=5f7e533bbf1d2be5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:10.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe891ffb700 1 -- 172.21.15.60:0/1450936484 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe88c00ba50 con 0x7fe8940aec20 2020-10-31T22:49:10.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe891ffb700 1 -- 172.21.15.60:0/1450936484 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c00bbb0 con 0x7fe8940aec20 2020-10-31T22:49:10.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe891ffb700 1 -- 172.21.15.60:0/1450936484 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe88c00bd20 con 0x7fe8940aec20 2020-10-31T22:49:10.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 -- 172.21.15.60:0/1450936484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8940aec20 msgr2=0x7fe8941403a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 --2- 172.21.15.60:0/1450936484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8940aec20 0x7fe8941403a0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 rx=0x7fe88c003300 tx=0x7fe88c009250).stop 2020-10-31T22:49:10.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 -- 172.21.15.60:0/1450936484 shutdown_connections 2020-10-31T22:49:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 --2- 172.21.15.60:0/1450936484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8940aec20 0x7fe8941403a0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 --2- 172.21.15.60:0/1450936484 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8940b14f0 0x7fe8940a4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 --2- 172.21.15.60:0/1450936484 >> v2:172.21.15.66:3300/0 conn(0x7fe8940ab820 0x7fe8940ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 -- 172.21.15.60:0/1450936484 >> 172.21.15.60:0/1450936484 conn(0x7fe894060de0 msgr2=0x7fe894062a60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 -- 172.21.15.60:0/1450936484 shutdown_connections 2020-10-31T22:49:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 -- 172.21.15.60:0/1450936484 wait complete. 2020-10-31T22:49:10.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 Processor -- start 2020-10-31T22:49:10.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 -- start start 2020-10-31T22:49:10.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8940ab820 0x7fe8941428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8940aec20 0x7fe894064220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8940b14f0 0x7fe894064710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe894063840 con 0x7fe8940ab820 2020-10-31T22:49:10.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe894063ae0 con 0x7fe8940b14f0 2020-10-31T22:49:10.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.345+0000 7fe893fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe894063d80 con 0x7fe8940aec20 2020-10-31T22:49:10.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe892ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8940ab820 0x7fe8941428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe892ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8940ab820 0x7fe8941428a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47568/0 (socket says 172.21.15.60:47568) 2020-10-31T22:49:10.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe8927fc700 1 --2- 172.21.15.60:0/355816852 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8940aec20 0x7fe894064220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe892ffd700 1 -- 172.21.15.60:0/355816852 learned_addr learned my addr 172.21.15.60:0/355816852 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:10.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe8937fe700 1 --2- 172.21.15.60:0/355816852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8940b14f0 0x7fe894064710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe892ffd700 1 -- 172.21.15.60:0/355816852 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8940aec20 msgr2=0x7fe894064220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe892ffd700 1 --2- 172.21.15.60:0/355816852 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8940aec20 0x7fe894064220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe892ffd700 1 -- 172.21.15.60:0/355816852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8940b14f0 msgr2=0x7fe894064710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe892ffd700 1 --2- 172.21.15.60:0/355816852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8940b14f0 0x7fe894064710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe892ffd700 1 -- 172.21.15.60:0/355816852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8940a5200 con 0x7fe8940ab820 2020-10-31T22:49:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe892ffd700 1 --2- 172.21.15.60:0/355816852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8940ab820 0x7fe8941428a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fe884006910 tx=0x7fe884008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:10.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe88bfff700 1 -- 172.21.15.60:0/355816852 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe884009980 con 0x7fe8940ab820 2020-10-31T22:49:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe88bfff700 1 -- 172.21.15.60:0/355816852 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe884009ae0 con 0x7fe8940ab820 2020-10-31T22:49:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe893fff700 1 -- 172.21.15.60:0/355816852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe894064f10 con 0x7fe8940ab820 2020-10-31T22:49:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe88bfff700 1 -- 172.21.15.60:0/355816852 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe884009e40 con 0x7fe8940ab820 2020-10-31T22:49:10.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe893fff700 1 -- 172.21.15.60:0/355816852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe894152b80 con 0x7fe8940ab820 2020-10-31T22:49:10.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe893fff700 1 -- 172.21.15.60:0/355816852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8940ab4c0 con 0x7fe8940ab820 2020-10-31T22:49:10.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe88bfff700 1 -- 172.21.15.60:0/355816852 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe884013480 con 0x7fe8940ab820 2020-10-31T22:49:10.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe88bfff700 1 --2- 172.21.15.60:0/355816852 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe878055020 0x7fe8780574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.361 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe88bfff700 1 -- 172.21.15.60:0/355816852 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe88406e200 con 0x7fe8940ab820 2020-10-31T22:49:10.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.349+0000 7fe8927fc700 1 --2- 172.21.15.60:0/355816852 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe878055020 0x7fe8780574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.353+0000 7fe8927fc700 1 --2- 172.21.15.60:0/355816852 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe878055020 0x7fe8780574e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fe87c00b000 tx=0x7fe87c006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:10.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.357+0000 7fe88bfff700 1 -- 172.21.15.60:0/355816852 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe8940ab4c0 con 0x7fe8940ab820 2020-10-31T22:49:10.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.497+0000 7fe893fff700 1 -- 172.21.15.60:0/355816852 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fe8940ab4c0 con 0x7fe8940ab820 2020-10-31T22:49:10.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.501+0000 7fe88bfff700 1 -- 172.21.15.60:0/355816852 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v110) v1 ==== 110+0+10 (secure 0 0 0) 0x7fe8940ab4c0 con 0x7fe8940ab820 2020-10-31T22:49:10.506 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:49:10.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.501+0000 7fe893fff700 1 -- 172.21.15.60:0/355816852 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe878055020 msgr2=0x7fe8780574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.501+0000 7fe893fff700 1 --2- 172.21.15.60:0/355816852 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe878055020 0x7fe8780574e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7fe87c00b000 tx=0x7fe87c006dc0).stop 2020-10-31T22:49:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.501+0000 7fe893fff700 1 -- 172.21.15.60:0/355816852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8940ab820 msgr2=0x7fe8941428a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.501+0000 7fe893fff700 1 --2- 172.21.15.60:0/355816852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8940ab820 0x7fe8941428a0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 rx=0x7fe884006910 tx=0x7fe884008040).stop 2020-10-31T22:49:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.501+0000 7fe893fff700 1 -- 172.21.15.60:0/355816852 shutdown_connections 2020-10-31T22:49:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.501+0000 7fe893fff700 1 --2- 172.21.15.60:0/355816852 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe878055020 0x7fe8780574e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.501+0000 7fe893fff700 1 --2- 172.21.15.60:0/355816852 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe8940b14f0 0x7fe894064710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.501+0000 7fe893fff700 1 --2- 172.21.15.60:0/355816852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe8940ab820 0x7fe8941428a0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.501+0000 7fe893fff700 1 --2- 172.21.15.60:0/355816852 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8940aec20 0x7fe894064220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.501+0000 7fe893fff700 1 -- 172.21.15.60:0/355816852 >> 172.21.15.60:0/355816852 conn(0x7fe894060de0 msgr2=0x7fe894140170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:10.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.501+0000 7fe893fff700 1 -- 172.21.15.60:0/355816852 shutdown_connections 2020-10-31T22:49:10.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.501+0000 7fe893fff700 1 -- 172.21.15.60:0/355816852 wait complete. 2020-10-31T22:49:10.520 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:49:10.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.641+0000 7f7bd2e1a700 1 Processor -- start 2020-10-31T22:49:10.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.641+0000 7f7bd2e1a700 1 -- start start 2020-10-31T22:49:10.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.641+0000 7f7bd2e1a700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7bcc0b5380 0x7f7bcc0ac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.641+0000 7f7bd2e1a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bcc0b0b50 0x7f7bcc0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.641+0000 7f7bd2e1a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7bcc0b1b20 0x7f7bcc0b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.641+0000 7f7bd2e1a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bcc0ad650 con 0x7f7bcc0b1b20 2020-10-31T22:49:10.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.641+0000 7f7bd2e1a700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bcc0acd60 con 0x7f7bcc0b5380 2020-10-31T22:49:10.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.641+0000 7f7bd2e1a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc0b5760 con 0x7f7bcc0b0b50 2020-10-31T22:49:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.641+0000 7f7bd2619700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7bcc0b1b20 0x7f7bcc0b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.641+0000 7f7bd2619700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7bcc0b1b20 0x7f7bcc0b1f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47574/0 (socket says 172.21.15.60:47574) 2020-10-31T22:49:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.641+0000 7f7bd2619700 1 -- 172.21.15.60:0/931037993 learned_addr learned my addr 172.21.15.60:0/931037993 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd1617700 1 --2- 172.21.15.60:0/931037993 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bcc0b0b50 0x7f7bcc0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd1e18700 1 --2- 172.21.15.60:0/931037993 >> v2:172.21.15.66:3300/0 conn(0x7f7bcc0b5380 0x7f7bcc0ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2619700 1 -- 172.21.15.60:0/931037993 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bcc0b0b50 msgr2=0x7f7bcc0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:10.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2619700 1 --2- 172.21.15.60:0/931037993 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bcc0b0b50 0x7f7bcc0b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2619700 1 -- 172.21.15.60:0/931037993 >> v2:172.21.15.66:3300/0 conn(0x7f7bcc0b5380 msgr2=0x7f7bcc0ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:10.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2619700 1 --2- 172.21.15.60:0/931037993 >> v2:172.21.15.66:3300/0 conn(0x7f7bcc0b5380 0x7f7bcc0ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2619700 1 -- 172.21.15.60:0/931037993 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc0b14c0 con 0x7f7bcc0b1b20 2020-10-31T22:49:10.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2619700 1 --2- 172.21.15.60:0/931037993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc0b1b20 0x7f7bcc0b1f70 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f7bc40032b0 tx=0x7f7bc4009270).ready entity=mon.0 client_cookie=b79c31860080ac43 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:10.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd0e16700 1 -- 172.21.15.60:0/931037993 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bc4009e60 con 0x7f7bcc0b1b20 2020-10-31T22:49:10.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd0e16700 1 -- 172.21.15.60:0/931037993 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc400bb50 con 0x7f7bcc0b1b20 2020-10-31T22:49:10.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd0e16700 1 -- 172.21.15.60:0/931037993 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bc400bcc0 con 0x7f7bcc0b1b20 2020-10-31T22:49:10.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/931037993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc0b1b20 msgr2=0x7f7bcc0b1f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2e1a700 1 --2- 172.21.15.60:0/931037993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc0b1b20 0x7f7bcc0b1f70 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 rx=0x7f7bc40032b0 tx=0x7f7bc4009270).stop 2020-10-31T22:49:10.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/931037993 shutdown_connections 2020-10-31T22:49:10.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2e1a700 1 --2- 172.21.15.60:0/931037993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc0b1b20 0x7f7bcc0b1f70 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2e1a700 1 --2- 172.21.15.60:0/931037993 >> v2:172.21.15.66:3300/0 conn(0x7f7bcc0b5380 0x7f7bcc0ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2e1a700 1 --2- 172.21.15.60:0/931037993 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bcc0b0b50 0x7f7bcc0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/931037993 >> 172.21.15.60:0/931037993 conn(0x7f7bcc06a600 msgr2=0x7f7bcc060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:10.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/931037993 shutdown_connections 2020-10-31T22:49:10.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.645+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/931037993 wait complete. 2020-10-31T22:49:10.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd2e1a700 1 Processor -- start 2020-10-31T22:49:10.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd2e1a700 1 -- start start 2020-10-31T22:49:10.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd2e1a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc0b0b50 0x7f7bcc066960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.658 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd2e1a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bcc0b1b20 0x7f7bcc0ab5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd2e1a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7bcc0b5380 0x7f7bcc09fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd1e18700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc0b0b50 0x7f7bcc066960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd2e1a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc13f350 con 0x7f7bcc0b0b50 2020-10-31T22:49:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd2e1a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc09de90 con 0x7f7bcc0b5380 2020-10-31T22:49:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd2e1a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bcc09e0c0 con 0x7f7bcc0b1b20 2020-10-31T22:49:10.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd1e18700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc0b0b50 0x7f7bcc066960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47578/0 (socket says 172.21.15.60:47578) 2020-10-31T22:49:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd1e18700 1 -- 172.21.15.60:0/2502616134 learned_addr learned my addr 172.21.15.60:0/2502616134 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd1617700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bcc0b1b20 0x7f7bcc0ab5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd2619700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7bcc0b5380 0x7f7bcc09fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd1e18700 1 -- 172.21.15.60:0/2502616134 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bcc0b1b20 msgr2=0x7f7bcc0ab5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd1e18700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bcc0b1b20 0x7f7bcc0ab5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd1e18700 1 -- 172.21.15.60:0/2502616134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7bcc0b5380 msgr2=0x7f7bcc09fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd1e18700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7bcc0b5380 0x7f7bcc09fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd1e18700 1 -- 172.21.15.60:0/2502616134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bcc09e360 con 0x7f7bcc0b0b50 2020-10-31T22:49:10.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd2619700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7bcc0b5380 0x7f7bcc09fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:10.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.649+0000 7f7bd1e18700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc0b0b50 0x7f7bcc066960 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f7bbc00c000 tx=0x7f7bbc006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:10.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.653+0000 7f7bbaffd700 1 -- 172.21.15.60:0/2502616134 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bbc00cae0 con 0x7f7bcc0b0b50 2020-10-31T22:49:10.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.653+0000 7f7bbaffd700 1 -- 172.21.15.60:0/2502616134 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bbc00cc40 con 0x7f7bcc0b0b50 2020-10-31T22:49:10.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.653+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/2502616134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bcc09e600 con 0x7f7bcc0b0b50 2020-10-31T22:49:10.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.653+0000 7f7bbaffd700 1 -- 172.21.15.60:0/2502616134 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bbc011450 con 0x7f7bcc0b0b50 2020-10-31T22:49:10.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.653+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/2502616134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bcc150e20 con 0x7f7bcc0b0b50 2020-10-31T22:49:10.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.653+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/2502616134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bcc0672b0 con 0x7f7bcc0b0b50 2020-10-31T22:49:10.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.653+0000 7f7bbaffd700 1 -- 172.21.15.60:0/2502616134 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7bbc021070 con 0x7f7bcc0b0b50 2020-10-31T22:49:10.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.653+0000 7f7bbaffd700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7bac054f90 0x7f7bac057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.653+0000 7f7bbaffd700 1 -- 172.21.15.60:0/2502616134 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f7bbc06f890 con 0x7f7bcc0b0b50 2020-10-31T22:49:10.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.657+0000 7f7bd1617700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7bac054f90 0x7f7bac057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.657+0000 7f7bd1617700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7bac054f90 0x7f7bac057450 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f7bc800b000 tx=0x7f7bc8006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:10.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.661+0000 7f7bbaffd700 1 -- 172.21.15.60:0/2502616134 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7bcc0672b0 con 0x7f7bcc0b0b50 2020-10-31T22:49:10.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.801+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/2502616134 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7bcc0672b0 con 0x7f7bcc0b0b50 2020-10-31T22:49:10.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.801+0000 7f7bbaffd700 1 -- 172.21.15.60:0/2502616134 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v110) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7bcc0672b0 con 0x7f7bcc0b0b50 2020-10-31T22:49:10.809 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:49:10.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.805+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/2502616134 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7bac054f90 msgr2=0x7f7bac057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.805+0000 7f7bd2e1a700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7bac054f90 0x7f7bac057450 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f7bc800b000 tx=0x7f7bc8006dc0).stop 2020-10-31T22:49:10.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.805+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/2502616134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc0b0b50 msgr2=0x7f7bcc066960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.805+0000 7f7bd2e1a700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc0b0b50 0x7f7bcc066960 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 rx=0x7f7bbc00c000 tx=0x7f7bbc006dc0).stop 2020-10-31T22:49:10.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.805+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/2502616134 shutdown_connections 2020-10-31T22:49:10.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.805+0000 7f7bd2e1a700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7bac054f90 0x7f7bac057450 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.805+0000 7f7bd2e1a700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7bcc0b5380 0x7f7bcc09fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.805+0000 7f7bd2e1a700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bcc0b0b50 0x7f7bcc066960 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.805+0000 7f7bd2e1a700 1 --2- 172.21.15.60:0/2502616134 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7bcc0b1b20 0x7f7bcc0ab5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.805+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/2502616134 >> 172.21.15.60:0/2502616134 conn(0x7f7bcc06a600 msgr2=0x7f7bcc0a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:10.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.805+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/2502616134 shutdown_connections 2020-10-31T22:49:10.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.805+0000 7f7bd2e1a700 1 -- 172.21.15.60:0/2502616134 wait complete. 2020-10-31T22:49:10.829 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:49:10.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.957+0000 7f3c72144700 1 Processor -- start 2020-10-31T22:49:10.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.957+0000 7f3c72144700 1 -- start start 2020-10-31T22:49:10.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c72144700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3c6c0afef0 0x7f3c6c0ad730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c72144700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c6c0b0500 0x7f3c6c1413c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c72144700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6c0b02d0 con 0x7f3c6c0b0bc0 2020-10-31T22:49:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c72144700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6c0a8060 con 0x7f3c6c0afef0 2020-10-31T22:49:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c72144700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0a8300 con 0x7f3c6c0b0500 2020-10-31T22:49:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c70941700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3c6c0b0bc0 0x7f3c6c0adc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51724/0 (socket says 172.21.15.60:51724) 2020-10-31T22:49:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c70941700 1 -- 172.21.15.60:0/3459599079 learned_addr learned my addr 172.21.15.60:0/3459599079 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c71142700 1 --2- 172.21.15.60:0/3459599079 >> v2:172.21.15.66:3300/0 conn(0x7f3c6c0afef0 0x7f3c6c0ad730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c71943700 1 --2- 172.21.15.60:0/3459599079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c6c0b0500 0x7f3c6c1413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c5bfff700 1 -- 172.21.15.60:0/3459599079 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2339437339 0 0) 0x7f3c6c0b02d0 con 0x7f3c6c0b0bc0 2020-10-31T22:49:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c5bfff700 1 -- 172.21.15.60:0/3459599079 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c54003230 con 0x7f3c6c0b0bc0 2020-10-31T22:49:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c71943700 1 -- 172.21.15.60:0/3459599079 >> v2:172.21.15.66:3300/0 conn(0x7f3c6c0afef0 msgr2=0x7f3c6c0ad730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c71943700 1 --2- 172.21.15.60:0/3459599079 >> v2:172.21.15.66:3300/0 conn(0x7f3c6c0afef0 0x7f3c6c0ad730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c71943700 1 -- 172.21.15.60:0/3459599079 >> v1:172.21.15.60:6789/0 conn(0x7f3c6c0b0bc0 legacy=0x7f3c6c0adc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c71943700 1 -- 172.21.15.60:0/3459599079 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c0af290 con 0x7f3c6c0b0500 2020-10-31T22:49:10.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c71943700 1 --2- 172.21.15.60:0/3459599079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c6c0b0500 0x7f3c6c1413c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3c640032b0 tx=0x7f3c640091a0).ready entity=mon.2 client_cookie=708cbf170e79bd57 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:10.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c5bfff700 1 -- 172.21.15.60:0/3459599079 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c6400b940 con 0x7f3c6c0b0500 2020-10-31T22:49:10.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c5bfff700 1 -- 172.21.15.60:0/3459599079 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6400baa0 con 0x7f3c6c0b0500 2020-10-31T22:49:10.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c5bfff700 1 -- 172.21.15.60:0/3459599079 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c6400bc10 con 0x7f3c6c0b0500 2020-10-31T22:49:10.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c72144700 1 -- 172.21.15.60:0/3459599079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c6c0b0500 msgr2=0x7f3c6c1413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c72144700 1 --2- 172.21.15.60:0/3459599079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c6c0b0500 0x7f3c6c1413c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f3c640032b0 tx=0x7f3c640091a0).stop 2020-10-31T22:49:10.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c72144700 1 -- 172.21.15.60:0/3459599079 shutdown_connections 2020-10-31T22:49:10.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c72144700 1 --2- 172.21.15.60:0/3459599079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c6c0b0500 0x7f3c6c1413c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c72144700 1 --2- 172.21.15.60:0/3459599079 >> v2:172.21.15.66:3300/0 conn(0x7f3c6c0afef0 0x7f3c6c0ad730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c72144700 1 -- 172.21.15.60:0/3459599079 >> 172.21.15.60:0/3459599079 conn(0x7f3c6c0b4840 msgr2=0x7f3c6c0b4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c72144700 1 -- 172.21.15.60:0/3459599079 shutdown_connections 2020-10-31T22:49:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.961+0000 7f3c72144700 1 -- 172.21.15.60:0/3459599079 wait complete. 2020-10-31T22:49:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.965+0000 7f3c72144700 1 Processor -- start 2020-10-31T22:49:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.965+0000 7f3c72144700 1 -- start start 2020-10-31T22:49:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.965+0000 7f3c72144700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c6c0afef0 0x7f3c6c05f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.965+0000 7f3c72144700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c6c0b0500 0x7f3c6c154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.965+0000 7f3c72144700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c6c0b0bc0 0x7f3c6c154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.965+0000 7f3c72144700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0ab150 con 0x7f3c6c0afef0 2020-10-31T22:49:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.965+0000 7f3c72144700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0a9150 con 0x7f3c6c0b0500 2020-10-31T22:49:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.965+0000 7f3c72144700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6c0a85a0 con 0x7f3c6c0b0bc0 2020-10-31T22:49:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.965+0000 7f3c71142700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c6c0afef0 0x7f3c6c05f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.965+0000 7f3c71142700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c6c0afef0 0x7f3c6c05f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47592/0 (socket says 172.21.15.60:47592) 2020-10-31T22:49:10.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.965+0000 7f3c71142700 1 -- 172.21.15.60:0/3096191818 learned_addr learned my addr 172.21.15.60:0/3096191818 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:10.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.965+0000 7f3c70941700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c6c0b0500 0x7f3c6c154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.965+0000 7f3c71943700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c6c0b0bc0 0x7f3c6c154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c71142700 1 -- 172.21.15.60:0/3096191818 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c6c0b0bc0 msgr2=0x7f3c6c154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c71142700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c6c0b0bc0 0x7f3c6c154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c71142700 1 -- 172.21.15.60:0/3096191818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c6c0b0500 msgr2=0x7f3c6c154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:10.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c71142700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c6c0b0500 0x7f3c6c154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:10.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c71142700 1 -- 172.21.15.60:0/3096191818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c6c0a8840 con 0x7f3c6c0afef0 2020-10-31T22:49:10.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c71943700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c6c0b0bc0 0x7f3c6c154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:10.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c71142700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c6c0afef0 0x7f3c6c05f700 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f3c6800c000 tx=0x7f3c68006d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:10.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c5a7fc700 1 -- 172.21.15.60:0/3096191818 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c6800b890 con 0x7f3c6c0afef0 2020-10-31T22:49:10.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c5a7fc700 1 -- 172.21.15.60:0/3096191818 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6800b9f0 con 0x7f3c6c0afef0 2020-10-31T22:49:10.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c72144700 1 -- 172.21.15.60:0/3096191818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c6c0a8ae0 con 0x7f3c6c0afef0 2020-10-31T22:49:10.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c5a7fc700 1 -- 172.21.15.60:0/3096191818 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3c6800bd50 con 0x7f3c6c0afef0 2020-10-31T22:49:10.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c72144700 1 -- 172.21.15.60:0/3096191818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c6c05fd90 con 0x7f3c6c0afef0 2020-10-31T22:49:10.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c72144700 1 -- 172.21.15.60:0/3096191818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6c057100 con 0x7f3c6c0afef0 2020-10-31T22:49:10.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c5a7fc700 1 -- 172.21.15.60:0/3096191818 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3c6801c460 con 0x7f3c6c0afef0 2020-10-31T22:49:10.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c5a7fc700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c4c054f90 0x7f3c4c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:10.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c5a7fc700 1 -- 172.21.15.60:0/3096191818 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3c6806ddb0 con 0x7f3c6c0afef0 2020-10-31T22:49:10.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c70941700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c4c054f90 0x7f3c4c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:10.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.969+0000 7f3c70941700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c4c054f90 0x7f3c4c057450 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f3c5c00d000 tx=0x7f3c5c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:10.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:10.977+0000 7f3c5a7fc700 1 -- 172.21.15.60:0/3096191818 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3c68044270 con 0x7f3c6c0afef0 2020-10-31T22:49:11.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.125+0000 7f3c72144700 1 -- 172.21.15.60:0/3096191818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c6c0ae7c0 con 0x7f3c6c0afef0 2020-10-31T22:49:11.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.125+0000 7f3c5a7fc700 1 -- 172.21.15.60:0/3096191818 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+10 (secure 0 0 0) 0x7f3c68047890 con 0x7f3c6c0afef0 2020-10-31T22:49:11.132 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:49:11.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.125+0000 7f3c72144700 1 -- 172.21.15.60:0/3096191818 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c4c054f90 msgr2=0x7f3c4c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:11.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.125+0000 7f3c72144700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c4c054f90 0x7f3c4c057450 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f3c5c00d000 tx=0x7f3c5c009040).stop 2020-10-31T22:49:11.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.125+0000 7f3c72144700 1 -- 172.21.15.60:0/3096191818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c6c0afef0 msgr2=0x7f3c6c05f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:11.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.125+0000 7f3c72144700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c6c0afef0 0x7f3c6c05f700 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 rx=0x7f3c6800c000 tx=0x7f3c68006d60).stop 2020-10-31T22:49:11.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.125+0000 7f3c72144700 1 -- 172.21.15.60:0/3096191818 shutdown_connections 2020-10-31T22:49:11.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.125+0000 7f3c72144700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3c6c0b0bc0 0x7f3c6c154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.125+0000 7f3c72144700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c6c0afef0 0x7f3c6c05f700 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.125+0000 7f3c72144700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3c4c054f90 0x7f3c4c057450 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.125+0000 7f3c72144700 1 --2- 172.21.15.60:0/3096191818 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3c6c0b0500 0x7f3c6c154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.125+0000 7f3c72144700 1 -- 172.21.15.60:0/3096191818 >> 172.21.15.60:0/3096191818 conn(0x7f3c6c0b4840 msgr2=0x7f3c6c0ad650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:11.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.125+0000 7f3c72144700 1 -- 172.21.15.60:0/3096191818 shutdown_connections 2020-10-31T22:49:11.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.125+0000 7f3c72144700 1 -- 172.21.15.60:0/3096191818 wait complete. 2020-10-31T22:49:11.146 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:49:11.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.273+0000 7fa74beac700 1 Processor -- start 2020-10-31T22:49:11.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.273+0000 7fa74beac700 1 -- start start 2020-10-31T22:49:11.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa74405c660 0x7fa7440b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:11.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa744065f70 0x7fa74413f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:11.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa744066410 con 0x7fa74413f880 2020-10-31T22:49:11.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa744066d60 con 0x7fa744065f70 2020-10-31T22:49:11.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440b5e80 con 0x7fa74405c660 2020-10-31T22:49:11.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa749447700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa744065f70 0x7fa74413f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:11.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa749447700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa744065f70 0x7fa74413f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47600/0 (socket says 172.21.15.60:47600) 2020-10-31T22:49:11.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa749447700 1 -- 172.21.15.60:0/1536163059 learned_addr learned my addr 172.21.15.60:0/1536163059 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:11.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa749c48700 1 --2- 172.21.15.60:0/1536163059 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa74405c660 0x7fa7440b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa749447700 1 -- 172.21.15.60:0/1536163059 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa74405c660 msgr2=0x7fa7440b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa749447700 1 --2- 172.21.15.60:0/1536163059 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa74405c660 0x7fa7440b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa749447700 1 -- 172.21.15.60:0/1536163059 >> v1:172.21.15.66:6789/0 conn(0x7fa74413f880 legacy=0x7fa744142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa749447700 1 -- 172.21.15.60:0/1536163059 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7440666b0 con 0x7fa744065f70 2020-10-31T22:49:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa749c48700 1 --2- 172.21.15.60:0/1536163059 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa74405c660 0x7fa7440b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:49:11.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa749447700 1 --2- 172.21.15.60:0/1536163059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa744065f70 0x7fa74413f390 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fa74405c0a0 tx=0x7fa734006e80).ready entity=mon.0 client_cookie=775b13c19b717d1b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:11.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa748c46700 1 -- 172.21.15.60:0/1536163059 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa734009770 con 0x7fa744065f70 2020-10-31T22:49:11.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa748c46700 1 -- 172.21.15.60:0/1536163059 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7340098d0 con 0x7fa744065f70 2020-10-31T22:49:11.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa748c46700 1 -- 172.21.15.60:0/1536163059 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa734009a40 con 0x7fa744065f70 2020-10-31T22:49:11.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 -- 172.21.15.60:0/1536163059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa744065f70 msgr2=0x7fa74413f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:11.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 --2- 172.21.15.60:0/1536163059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa744065f70 0x7fa74413f390 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 rx=0x7fa74405c0a0 tx=0x7fa734006e80).stop 2020-10-31T22:49:11.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 -- 172.21.15.60:0/1536163059 shutdown_connections 2020-10-31T22:49:11.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 --2- 172.21.15.60:0/1536163059 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa74405c660 0x7fa7440b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 --2- 172.21.15.60:0/1536163059 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa744065f70 0x7fa74413f390 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 -- 172.21.15.60:0/1536163059 >> 172.21.15.60:0/1536163059 conn(0x7fa7440601e0 msgr2=0x7fa74405b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:11.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 -- 172.21.15.60:0/1536163059 shutdown_connections 2020-10-31T22:49:11.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 -- 172.21.15.60:0/1536163059 wait complete. 2020-10-31T22:49:11.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 Processor -- start 2020-10-31T22:49:11.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 -- start start 2020-10-31T22:49:11.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa74405c660 0x7fa7440b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:11.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa744065f70 0x7fa744151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:11.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa74413f880 0x7fa744140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:11.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa744151c80 con 0x7fa74405c660 2020-10-31T22:49:11.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa744141b20 con 0x7fa744065f70 2020-10-31T22:49:11.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.277+0000 7fa74beac700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440acee0 con 0x7fa74413f880 2020-10-31T22:49:11.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa749c48700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa74405c660 0x7fa7440b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:11.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa749c48700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa74405c660 0x7fa7440b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47608/0 (socket says 172.21.15.60:47608) 2020-10-31T22:49:11.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa749c48700 1 -- 172.21.15.60:0/2505143954 learned_addr learned my addr 172.21.15.60:0/2505143954 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:11.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa749447700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa744065f70 0x7fa744151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:11.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa74a449700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa74413f880 0x7fa744140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:11.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa749c48700 1 -- 172.21.15.60:0/2505143954 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa74413f880 msgr2=0x7fa744140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:11.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa749c48700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa74413f880 0x7fa744140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa749c48700 1 -- 172.21.15.60:0/2505143954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa744065f70 msgr2=0x7fa744151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:11.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa749c48700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa744065f70 0x7fa744151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa749c48700 1 -- 172.21.15.60:0/2505143954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7440ad140 con 0x7fa74405c660 2020-10-31T22:49:11.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa749447700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa744065f70 0x7fa744151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:11.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa749c48700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa74405c660 0x7fa7440b1fb0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fa740007000 tx=0x7fa740008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:11.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa732ffd700 1 -- 172.21.15.60:0/2505143954 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa74000ce90 con 0x7fa74405c660 2020-10-31T22:49:11.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa732ffd700 1 -- 172.21.15.60:0/2505143954 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa740007750 con 0x7fa74405c660 2020-10-31T22:49:11.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa74beac700 1 -- 172.21.15.60:0/2505143954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7440ad3e0 con 0x7fa74405c660 2020-10-31T22:49:11.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa732ffd700 1 -- 172.21.15.60:0/2505143954 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa740007ab0 con 0x7fa74405c660 2020-10-31T22:49:11.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa74beac700 1 -- 172.21.15.60:0/2505143954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7440aa260 con 0x7fa74405c660 2020-10-31T22:49:11.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa74beac700 1 -- 172.21.15.60:0/2505143954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa744057100 con 0x7fa74405c660 2020-10-31T22:49:11.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa732ffd700 1 -- 172.21.15.60:0/2505143954 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa740007c10 con 0x7fa74405c660 2020-10-31T22:49:11.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa732ffd700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa724054f10 0x7fa7240573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:11.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa749447700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa724054f10 0x7fa7240573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:11.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.281+0000 7fa732ffd700 1 -- 172.21.15.60:0/2505143954 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa74006e8f0 con 0x7fa74405c660 2020-10-31T22:49:11.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.285+0000 7fa749447700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa724054f10 0x7fa7240573d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fa734019000 tx=0x7fa734016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:11.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.293+0000 7fa732ffd700 1 -- 172.21.15.60:0/2505143954 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa740044ca0 con 0x7fa74405c660 2020-10-31T22:49:11.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.437+0000 7fa74beac700 1 -- 172.21.15.60:0/2505143954 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa7440ada20 con 0x7fa74405c660 2020-10-31T22:49:11.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.437+0000 7fa732ffd700 1 -- 172.21.15.60:0/2505143954 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa7400482c0 con 0x7fa74405c660 2020-10-31T22:49:11.442 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:49:11.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.437+0000 7fa74beac700 1 -- 172.21.15.60:0/2505143954 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa724054f10 msgr2=0x7fa7240573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:11.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.437+0000 7fa74beac700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa724054f10 0x7fa7240573d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7fa734019000 tx=0x7fa734016000).stop 2020-10-31T22:49:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.437+0000 7fa74beac700 1 -- 172.21.15.60:0/2505143954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa74405c660 msgr2=0x7fa7440b1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.437+0000 7fa74beac700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa74405c660 0x7fa7440b1fb0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 rx=0x7fa740007000 tx=0x7fa740008040).stop 2020-10-31T22:49:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.437+0000 7fa74beac700 1 -- 172.21.15.60:0/2505143954 shutdown_connections 2020-10-31T22:49:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.437+0000 7fa74beac700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa74413f880 0x7fa744140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.437+0000 7fa74beac700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa74405c660 0x7fa7440b1fb0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.437+0000 7fa74beac700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa724054f10 0x7fa7240573d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.437+0000 7fa74beac700 1 --2- 172.21.15.60:0/2505143954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa744065f70 0x7fa744151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.437+0000 7fa74beac700 1 -- 172.21.15.60:0/2505143954 >> 172.21.15.60:0/2505143954 conn(0x7fa7440601e0 msgr2=0x7fa7440b84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:11.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.437+0000 7fa74beac700 1 -- 172.21.15.60:0/2505143954 shutdown_connections 2020-10-31T22:49:11.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.437+0000 7fa74beac700 1 -- 172.21.15.60:0/2505143954 wait complete. 2020-10-31T22:49:11.456 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:49:11.457 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:49:11.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.561+0000 7f9cf6511700 1 Processor -- start 2020-10-31T22:49:11.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.561+0000 7f9cf6511700 1 -- start start 2020-10-31T22:49:11.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf6511700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9cf00af520 0x7f9cf00ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:11.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf6511700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cf00670f0 0x7f9cf0150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:11.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf6511700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf00af900 con 0x7f9cf0066c90 2020-10-31T22:49:11.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf6511700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf00afc10 con 0x7f9cf00af520 2020-10-31T22:49:11.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf6511700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf005bb70 con 0x7f9cf00670f0 2020-10-31T22:49:11.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf550f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9cf00af520 0x7f9cf00ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:11.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf550f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9cf00af520 0x7f9cf00ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47616/0 (socket says 172.21.15.60:47616) 2020-10-31T22:49:11.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf550f700 1 -- 172.21.15.60:0/2098350444 learned_addr learned my addr 172.21.15.60:0/2098350444 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf5d10700 1 --2- 172.21.15.60:0/2098350444 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cf00670f0 0x7f9cf0150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9ce7fff700 1 -- 172.21.15.60:0/2098350444 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305491675 0 0) 0x7f9cf00af900 con 0x7f9cf0066c90 2020-10-31T22:49:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf550f700 1 -- 172.21.15.60:0/2098350444 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cf00670f0 msgr2=0x7f9cf0150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:11.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf550f700 1 --2- 172.21.15.60:0/2098350444 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cf00670f0 0x7f9cf0150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf550f700 1 -- 172.21.15.60:0/2098350444 >> v1:172.21.15.66:6789/0 conn(0x7f9cf0066c90 legacy=0x7f9cf0146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf550f700 1 -- 172.21.15.60:0/2098350444 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf00ac130 con 0x7f9cf00af520 2020-10-31T22:49:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf550f700 1 --2- 172.21.15.60:0/2098350444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf00af520 0x7f9cf00ac870 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f9ce0002f30 tx=0x7f9ce0006e80).ready entity=mon.0 client_cookie=27eadb89383b3cd8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9ce7fff700 1 -- 172.21.15.60:0/2098350444 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ce00097f0 con 0x7f9cf00af520 2020-10-31T22:49:11.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9ce7fff700 1 -- 172.21.15.60:0/2098350444 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce0009950 con 0x7f9cf00af520 2020-10-31T22:49:11.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9ce7fff700 1 -- 172.21.15.60:0/2098350444 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ce0009cb0 con 0x7f9cf00af520 2020-10-31T22:49:11.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf6511700 1 -- 172.21.15.60:0/2098350444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf00af520 msgr2=0x7f9cf00ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:11.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf6511700 1 --2- 172.21.15.60:0/2098350444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf00af520 0x7f9cf00ac870 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 rx=0x7f9ce0002f30 tx=0x7f9ce0006e80).stop 2020-10-31T22:49:11.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf6511700 1 -- 172.21.15.60:0/2098350444 shutdown_connections 2020-10-31T22:49:11.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf6511700 1 --2- 172.21.15.60:0/2098350444 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cf00670f0 0x7f9cf0150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf6511700 1 --2- 172.21.15.60:0/2098350444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf00af520 0x7f9cf00ac870 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf6511700 1 -- 172.21.15.60:0/2098350444 >> 172.21.15.60:0/2098350444 conn(0x7f9cf00b3fd0 msgr2=0x7f9cf00b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:11.582 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf6511700 1 -- 172.21.15.60:0/2098350444 shutdown_connections 2020-10-31T22:49:11.582 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.565+0000 7f9cf6511700 1 -- 172.21.15.60:0/2098350444 wait complete. 2020-10-31T22:49:11.582 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf6511700 1 Processor -- start 2020-10-31T22:49:11.582 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf6511700 1 -- start start 2020-10-31T22:49:11.582 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf6511700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf0066c90 0x7f9cf014bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:11.582 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf6511700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf00670f0 0x7f9cf0141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf6511700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cf00af520 0x7f9cf0141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf6511700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf00a8ac0 con 0x7f9cf00670f0 2020-10-31T22:49:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf6511700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf01421e0 con 0x7f9cf0066c90 2020-10-31T22:49:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf6511700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf00a9690 con 0x7f9cf00af520 2020-10-31T22:49:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf4d0e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf00670f0 0x7f9cf0141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf4d0e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf00670f0 0x7f9cf0141800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47620/0 (socket says 172.21.15.60:47620) 2020-10-31T22:49:11.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf4d0e700 1 -- 172.21.15.60:0/1827573869 learned_addr learned my addr 172.21.15.60:0/1827573869 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf5d10700 1 --2- 172.21.15.60:0/1827573869 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cf00af520 0x7f9cf0141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf550f700 1 --2- 172.21.15.60:0/1827573869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf0066c90 0x7f9cf014bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf4d0e700 1 -- 172.21.15.60:0/1827573869 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cf00af520 msgr2=0x7f9cf0141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf4d0e700 1 --2- 172.21.15.60:0/1827573869 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cf00af520 0x7f9cf0141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf4d0e700 1 -- 172.21.15.60:0/1827573869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf0066c90 msgr2=0x7f9cf014bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf4d0e700 1 --2- 172.21.15.60:0/1827573869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf0066c90 0x7f9cf014bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf4d0e700 1 -- 172.21.15.60:0/1827573869 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf00a8cb0 con 0x7f9cf00670f0 2020-10-31T22:49:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf4d0e700 1 --2- 172.21.15.60:0/1827573869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf00670f0 0x7f9cf0141800 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f9cf00a8570 tx=0x7f9cec007dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9ce67fc700 1 -- 172.21.15.60:0/1827573869 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cec00a7e0 con 0x7f9cf00670f0 2020-10-31T22:49:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9ce67fc700 1 -- 172.21.15.60:0/1827573869 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec00a940 con 0x7f9cf00670f0 2020-10-31T22:49:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf6511700 1 -- 172.21.15.60:0/1827573869 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf00a8f50 con 0x7f9cf00670f0 2020-10-31T22:49:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9ce67fc700 1 -- 172.21.15.60:0/1827573869 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cec00aca0 con 0x7f9cf00670f0 2020-10-31T22:49:11.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.569+0000 7f9cf6511700 1 -- 172.21.15.60:0/1827573869 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf00ad770 con 0x7f9cf00670f0 2020-10-31T22:49:11.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.573+0000 7f9cf6511700 1 -- 172.21.15.60:0/1827573869 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf0148630 con 0x7f9cf00670f0 2020-10-31T22:49:11.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.573+0000 7f9ce67fc700 1 -- 172.21.15.60:0/1827573869 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9cec019030 con 0x7f9cf00670f0 2020-10-31T22:49:11.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.573+0000 7f9ce67fc700 1 --2- 172.21.15.60:0/1827573869 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9cd0055020 0x7f9cd00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:11.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.573+0000 7f9cf550f700 1 --2- 172.21.15.60:0/1827573869 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9cd0055020 0x7f9cd00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:11.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.573+0000 7f9ce67fc700 1 -- 172.21.15.60:0/1827573869 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9cec06d050 con 0x7f9cf00670f0 2020-10-31T22:49:11.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.573+0000 7f9cf550f700 1 --2- 172.21.15.60:0/1827573869 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9cd0055020 0x7f9cd00574e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f9ce001c000 tx=0x7f9ce0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:11.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.577+0000 7f9ce67fc700 1 -- 172.21.15.60:0/1827573869 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9cec041df0 con 0x7f9cf00670f0 2020-10-31T22:49:11.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.761+0000 7f9cf6511700 1 -- 172.21.15.60:0/1827573869 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cf0057100 con 0x7f9cf00670f0 2020-10-31T22:49:11.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.761+0000 7f9ce67fc700 1 -- 172.21.15.60:0/1827573869 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f9cf0148630 con 0x7f9cf00670f0 2020-10-31T22:49:11.767 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:11.767 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1212236578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1212236578},{"type":"v1","addr":"172.21.15.60:6835","nonce":1212236578}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3130935285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3130935285},{"type":"v1","addr":"172.21.15.66:6833","nonce":3130935285}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:49:03.919960+0000","modified":"2020-10-31T22:49:04.922872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7173},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7173":{"gid":7173,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/1399264415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1399264415},{"type":"v1","addr":"172.21.15.60:6837","nonce":1399264415}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-10-31T22:49:11.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.765+0000 7f9cf6511700 1 -- 172.21.15.60:0/1827573869 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9cd0055020 msgr2=0x7f9cd00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:11.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.765+0000 7f9cf6511700 1 --2- 172.21.15.60:0/1827573869 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9cd0055020 0x7f9cd00574e0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7f9ce001c000 tx=0x7f9ce0015000).stop 2020-10-31T22:49:11.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.765+0000 7f9cf6511700 1 -- 172.21.15.60:0/1827573869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf00670f0 msgr2=0x7f9cf0141800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:11.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.765+0000 7f9cf6511700 1 --2- 172.21.15.60:0/1827573869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf00670f0 0x7f9cf0141800 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 rx=0x7f9cf00a8570 tx=0x7f9cec007dc0).stop 2020-10-31T22:49:11.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.765+0000 7f9cf6511700 1 -- 172.21.15.60:0/1827573869 shutdown_connections 2020-10-31T22:49:11.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.765+0000 7f9cf6511700 1 --2- 172.21.15.60:0/1827573869 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cf00af520 0x7f9cf0141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.765+0000 7f9cf6511700 1 --2- 172.21.15.60:0/1827573869 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9cd0055020 0x7f9cd00574e0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.765+0000 7f9cf6511700 1 --2- 172.21.15.60:0/1827573869 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cf0066c90 0x7f9cf014bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.765+0000 7f9cf6511700 1 --2- 172.21.15.60:0/1827573869 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9cf00670f0 0x7f9cf0141800 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:11.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.765+0000 7f9cf6511700 1 -- 172.21.15.60:0/1827573869 >> 172.21.15.60:0/1827573869 conn(0x7f9cf00b3fd0 msgr2=0x7f9cf00ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:11.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.765+0000 7f9cf6511700 1 -- 172.21.15.60:0/1827573869 shutdown_connections 2020-10-31T22:49:11.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:11.765+0000 7f9cf6511700 1 -- 172.21.15.60:0/1827573869 wait complete. 2020-10-31T22:49:11.772 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 53 2020-10-31T22:49:12.090 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 53, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:49:03.919960+0000', 'modified': '2020-10-31T22:49:04.922872+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7173}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7173': {'gid': 7173, 'name': 'c', 'rank': 0, 'incarnation': 52, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/1399264415', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 1399264415}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 1399264415}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [20], 'metadata_pool': 19, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:49:12.091 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:49:12.092 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:49:12.229 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":7173,"want_state":"up:active","state":"up:active","rank_uptime":8.2942549959999994,"mdsmap_epoch":53,"osdmap_epoch":110,"osdmap_epoch_barrier":109,"uptime":13.711282271} 2020-10-31T22:49:12.230 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 7173, "mdsmap_epoch": 53, "osdmap_epoch": 110, "osdmap_epoch_barrier": 109, "rank_uptime": 8.294254996, "state": "up:active", "uptime": 13.711282271, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:49:12.233 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:49:12.234 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-10-31T22:49:12.235 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi085.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-10-31T22:49:12.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:12.237 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:12.252 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:49:12.317 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:49:12.318 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:49:12.381 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:49:12.383 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:49:12.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:12.384 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:49:12.434 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:49:12.438 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:12.480 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:49:12.495 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:49:12.496 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:49:12.552 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:49:12.553 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:49:12.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:12.554 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:49:12.555 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:2020-10-31T22:49:12.552+0000 7f0f66ab10c0 -1 init, newargv = 0x55636592b7b0 newargc=9 2020-10-31T22:49:12.555 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13378]: starting ceph client 2020-10-31T22:49:12.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13378]: starting fuse 2020-10-31T22:49:13.659 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:49:13.676 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:49:13.676 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:49:13.731 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:49:13.732 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:49:13.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:13.734 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:49:13.779 INFO:teuthology.orchestra.run.smithi085.stdout:50 2020-10-31T22:49:13.779 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-10-31T22:49:13.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:13.780 INFO:teuthology.orchestra.run.smithi085:> sudo python3 -c ' 2020-10-31T22:49:13.781 INFO:teuthology.orchestra.run.smithi085:> import glob 2020-10-31T22:49:13.781 INFO:teuthology.orchestra.run.smithi085:> import re 2020-10-31T22:49:13.781 INFO:teuthology.orchestra.run.smithi085:> import os 2020-10-31T22:49:13.782 INFO:teuthology.orchestra.run.smithi085:> import subprocess 2020-10-31T22:49:13.782 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:49:13.782 INFO:teuthology.orchestra.run.smithi085:> def find_socket(client_name): 2020-10-31T22:49:13.782 INFO:teuthology.orchestra.run.smithi085:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-10-31T22:49:13.783 INFO:teuthology.orchestra.run.smithi085:> files = glob.glob(asok_path) 2020-10-31T22:49:13.783 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:49:13.783 INFO:teuthology.orchestra.run.smithi085:> # Given a non-glob path, it better be there 2020-10-31T22:49:13.784 INFO:teuthology.orchestra.run.smithi085:> if "*" not in asok_path: 2020-10-31T22:49:13.784 INFO:teuthology.orchestra.run.smithi085:> assert(len(files) == 1) 2020-10-31T22:49:13.784 INFO:teuthology.orchestra.run.smithi085:> return files[0] 2020-10-31T22:49:13.785 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:49:13.785 INFO:teuthology.orchestra.run.smithi085:> for f in files: 2020-10-31T22:49:13.785 INFO:teuthology.orchestra.run.smithi085:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:49:13.785 INFO:teuthology.orchestra.run.smithi085:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:49:13.786 INFO:teuthology.orchestra.run.smithi085:> return f 2020-10-31T22:49:13.786 INFO:teuthology.orchestra.run.smithi085:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:49:13.786 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:49:13.787 INFO:teuthology.orchestra.run.smithi085:> print(find_socket("client.1")) 2020-10-31T22:49:13.787 INFO:teuthology.orchestra.run.smithi085:> ' 2020-10-31T22:49:13.864 INFO:teuthology.orchestra.run.smithi085.stdout:/var/run/ceph/ceph-client.1.13378.asok 2020-10-31T22:49:13.869 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13378.asok 2020-10-31T22:49:13.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:13.870 INFO:teuthology.orchestra.run.smithi085:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13378.asok status 2020-10-31T22:49:14.014 INFO:teuthology.orchestra.run.smithi085.stdout:{ 2020-10-31T22:49:14.014 INFO:teuthology.orchestra.run.smithi085.stdout: "metadata": { 2020-10-31T22:49:14.014 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:49:14.014 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:49:14.014 INFO:teuthology.orchestra.run.smithi085.stdout: "entity_id": "1", 2020-10-31T22:49:14.015 INFO:teuthology.orchestra.run.smithi085.stdout: "hostname": "smithi085", 2020-10-31T22:49:14.015 INFO:teuthology.orchestra.run.smithi085.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-10-31T22:49:14.015 INFO:teuthology.orchestra.run.smithi085.stdout: "pid": "13378", 2020-10-31T22:49:14.015 INFO:teuthology.orchestra.run.smithi085.stdout: "root": "/" 2020-10-31T22:49:14.015 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:49:14.015 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_count": 0, 2020-10-31T22:49:14.016 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_pinned_count": 0, 2020-10-31T22:49:14.016 INFO:teuthology.orchestra.run.smithi085.stdout: "id": 6482, 2020-10-31T22:49:14.016 INFO:teuthology.orchestra.run.smithi085.stdout: "inst": { 2020-10-31T22:49:14.016 INFO:teuthology.orchestra.run.smithi085.stdout: "name": { 2020-10-31T22:49:14.016 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "client", 2020-10-31T22:49:14.016 INFO:teuthology.orchestra.run.smithi085.stdout: "num": 6482 2020-10-31T22:49:14.016 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:49:14.016 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:49:14.017 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:49:14.017 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:49:14.017 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 2934030200 2020-10-31T22:49:14.017 INFO:teuthology.orchestra.run.smithi085.stdout: } 2020-10-31T22:49:14.017 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:49:14.017 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:49:14.017 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:49:14.018 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:49:14.018 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 2934030200 2020-10-31T22:49:14.018 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:49:14.018 INFO:teuthology.orchestra.run.smithi085.stdout: "inst_str": "client.6482 172.21.15.85:0/2934030200", 2020-10-31T22:49:14.018 INFO:teuthology.orchestra.run.smithi085.stdout: "addr_str": "172.21.15.85:0/2934030200", 2020-10-31T22:49:14.018 INFO:teuthology.orchestra.run.smithi085.stdout: "inode_count": 1, 2020-10-31T22:49:14.018 INFO:teuthology.orchestra.run.smithi085.stdout: "mds_epoch": 53, 2020-10-31T22:49:14.019 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch": 110, 2020-10-31T22:49:14.019 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:49:14.019 INFO:teuthology.orchestra.run.smithi085.stdout: "blacklisted": false 2020-10-31T22:49:14.019 INFO:teuthology.orchestra.run.smithi085.stdout:} 2020-10-31T22:49:14.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:14.023 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:14.024 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:14.030 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:49:14.031 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:49:14.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:14.031 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:14.089 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2020-10-31T22:49:14.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.201+0000 7fbc2b039700 1 Processor -- start 2020-10-31T22:49:14.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.201+0000 7fbc2b039700 1 -- start start 2020-10-31T22:49:14.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2b039700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbc240b1d50 0x7fbc240b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:14.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2b039700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc240b0950 0x7fbc2405bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:14.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2b039700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc240b2130 con 0x7fbc24141d80 2020-10-31T22:49:14.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2b039700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2413fab0 con 0x7fbc240b1d50 2020-10-31T22:49:14.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2b039700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240af380 con 0x7fbc240b0950 2020-10-31T22:49:14.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2a838700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc240b0950 0x7fbc2405bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:14.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc29836700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fbc24141d80 0x7fbc2405afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:49632/0 (socket says 172.21.15.60:49632) 2020-10-31T22:49:14.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc29836700 1 -- 172.21.15.60:0/2542700488 learned_addr learned my addr 172.21.15.60:0/2542700488 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:14.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2a037700 1 --2- 172.21.15.60:0/2542700488 >> v2:172.21.15.66:3300/0 conn(0x7fbc240b1d50 0x7fbc240b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:14.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc29035700 1 -- 172.21.15.60:0/2542700488 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884034283 0 0) 0x7fbc240b2130 con 0x7fbc24141d80 2020-10-31T22:49:14.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc29035700 1 -- 172.21.15.60:0/2542700488 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc0c003230 con 0x7fbc24141d80 2020-10-31T22:49:14.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2a838700 1 -- 172.21.15.60:0/2542700488 >> v2:172.21.15.66:3300/0 conn(0x7fbc240b1d50 msgr2=0x7fbc240b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:14.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2a838700 1 --2- 172.21.15.60:0/2542700488 >> v2:172.21.15.66:3300/0 conn(0x7fbc240b1d50 0x7fbc240b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2a838700 1 -- 172.21.15.60:0/2542700488 >> v1:172.21.15.66:6789/0 conn(0x7fbc24141d80 legacy=0x7fbc2405afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:14.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2a838700 1 -- 172.21.15.60:0/2542700488 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc240af620 con 0x7fbc240b0950 2020-10-31T22:49:14.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2a838700 1 --2- 172.21.15.60:0/2542700488 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc240b0950 0x7fbc2405bc10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fbc1c0032b0 tx=0x7fbc1c0091a0).ready entity=mon.2 client_cookie=8d44be05831e1a8a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:14.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc29035700 1 -- 172.21.15.60:0/2542700488 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc1c00b940 con 0x7fbc240b0950 2020-10-31T22:49:14.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc29035700 1 -- 172.21.15.60:0/2542700488 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c00baa0 con 0x7fbc240b0950 2020-10-31T22:49:14.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc29035700 1 -- 172.21.15.60:0/2542700488 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc1c00bc10 con 0x7fbc240b0950 2020-10-31T22:49:14.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2b039700 1 -- 172.21.15.60:0/2542700488 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc240b0950 msgr2=0x7fbc2405bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:14.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2b039700 1 --2- 172.21.15.60:0/2542700488 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc240b0950 0x7fbc2405bc10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fbc1c0032b0 tx=0x7fbc1c0091a0).stop 2020-10-31T22:49:14.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2b039700 1 -- 172.21.15.60:0/2542700488 shutdown_connections 2020-10-31T22:49:14.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2b039700 1 --2- 172.21.15.60:0/2542700488 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc240b0950 0x7fbc2405bc10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2b039700 1 --2- 172.21.15.60:0/2542700488 >> v2:172.21.15.66:3300/0 conn(0x7fbc240b1d50 0x7fbc240b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2b039700 1 -- 172.21.15.60:0/2542700488 >> 172.21.15.60:0/2542700488 conn(0x7fbc240b5300 msgr2=0x7fbc240b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:14.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2b039700 1 -- 172.21.15.60:0/2542700488 shutdown_connections 2020-10-31T22:49:14.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.205+0000 7fbc2b039700 1 -- 172.21.15.60:0/2542700488 wait complete. 2020-10-31T22:49:14.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2b039700 1 Processor -- start 2020-10-31T22:49:14.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2b039700 1 -- start start 2020-10-31T22:49:14.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2b039700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc240b0950 0x7fbc240b4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:14.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2b039700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc240b1d50 0x7fbc240ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:14.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2b039700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc24141d80 0x7fbc240aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:14.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2b039700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240a9ea0 con 0x7fbc24141d80 2020-10-31T22:49:14.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2b039700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240aa770 con 0x7fbc240b1d50 2020-10-31T22:49:14.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2b039700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240a8b80 con 0x7fbc240b0950 2020-10-31T22:49:14.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2a838700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc24141d80 0x7fbc240aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2a838700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc24141d80 0x7fbc240aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47638/0 (socket says 172.21.15.60:47638) 2020-10-31T22:49:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2a838700 1 -- 172.21.15.60:0/2081980187 learned_addr learned my addr 172.21.15.60:0/2081980187 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc29836700 1 --2- 172.21.15.60:0/2081980187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc240b1d50 0x7fbc240ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2a037700 1 --2- 172.21.15.60:0/2081980187 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc240b0950 0x7fbc240b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2a838700 1 -- 172.21.15.60:0/2081980187 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc240b0950 msgr2=0x7fbc240b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:14.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2a838700 1 --2- 172.21.15.60:0/2081980187 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc240b0950 0x7fbc240b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2a838700 1 -- 172.21.15.60:0/2081980187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc240b1d50 msgr2=0x7fbc240ad9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2a838700 1 --2- 172.21.15.60:0/2081980187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc240b1d50 0x7fbc240ad9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2a838700 1 -- 172.21.15.60:0/2081980187 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc240aa9d0 con 0x7fbc24141d80 2020-10-31T22:49:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2a838700 1 --2- 172.21.15.60:0/2081980187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc24141d80 0x7fbc240aae70 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fbc1c0032b0 tx=0x7fbc1c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:14.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc137fe700 1 -- 172.21.15.60:0/2081980187 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc1c011ce0 con 0x7fbc24141d80 2020-10-31T22:49:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc137fe700 1 -- 172.21.15.60:0/2081980187 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c011e40 con 0x7fbc24141d80 2020-10-31T22:49:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2b039700 1 -- 172.21.15.60:0/2081980187 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc240a9210 con 0x7fbc24141d80 2020-10-31T22:49:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc137fe700 1 -- 172.21.15.60:0/2081980187 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc1c01f5e0 con 0x7fbc24141d80 2020-10-31T22:49:14.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.209+0000 7fbc2b039700 1 -- 172.21.15.60:0/2081980187 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc240adec0 con 0x7fbc24141d80 2020-10-31T22:49:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.213+0000 7fbc137fe700 1 -- 172.21.15.60:0/2081980187 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbc1c026030 con 0x7fbc24141d80 2020-10-31T22:49:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.213+0000 7fbc2b039700 1 -- 172.21.15.60:0/2081980187 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc24057100 con 0x7fbc24141d80 2020-10-31T22:49:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.213+0000 7fbc137fe700 1 --2- 172.21.15.60:0/2081980187 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc04055020 0x7fbc040574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.213+0000 7fbc137fe700 1 -- 172.21.15.60:0/2081980187 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbc1c06e500 con 0x7fbc24141d80 2020-10-31T22:49:14.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.213+0000 7fbc2a037700 1 --2- 172.21.15.60:0/2081980187 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc04055020 0x7fbc040574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:14.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.213+0000 7fbc2a037700 1 --2- 172.21.15.60:0/2081980187 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc04055020 0x7fbc040574e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fbc2000b000 tx=0x7fbc20006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:14.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.217+0000 7fbc137fe700 1 -- 172.21.15.60:0/2081980187 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbc1c044a20 con 0x7fbc24141d80 2020-10-31T22:49:14.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.405+0000 7fbc2b039700 1 -- 172.21.15.60:0/2081980187 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7fbc2405ee00 con 0x7fbc24141d80 2020-10-31T22:49:14.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.405+0000 7fbc137fe700 1 -- 172.21.15.60:0/2081980187 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1934 (secure 0 0 0) 0x7fbc1c0247a0 con 0x7fbc24141d80 2020-10-31T22:49:14.411 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:14.412 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:49:14.412 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2020-10-31T22:49:14.412 INFO:teuthology.orchestra.run.smithi060.stdout: "total_bytes": 773094113280, 2020-10-31T22:49:14.412 INFO:teuthology.orchestra.run.smithi060.stdout: "total_avail_bytes": 764493037568, 2020-10-31T22:49:14.412 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_bytes": 11141120, 2020-10-31T22:49:14.412 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_bytes": 8601075712, 2020-10-31T22:49:14.412 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_ratio": 0.01112552173435688, 2020-10-31T22:49:14.413 INFO:teuthology.orchestra.run.smithi060.stdout: "num_osds": 8, 2020-10-31T22:49:14.413 INFO:teuthology.orchestra.run.smithi060.stdout: "num_per_pool_osds": 8, 2020-10-31T22:49:14.413 INFO:teuthology.orchestra.run.smithi060.stdout: "num_per_pool_omap_osds": 8 2020-10-31T22:49:14.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:14.413 INFO:teuthology.orchestra.run.smithi060.stdout: "stats_by_class": { 2020-10-31T22:49:14.413 INFO:teuthology.orchestra.run.smithi060.stdout: "ssd": { 2020-10-31T22:49:14.414 INFO:teuthology.orchestra.run.smithi060.stdout: "total_bytes": 773094113280, 2020-10-31T22:49:14.414 INFO:teuthology.orchestra.run.smithi060.stdout: "total_avail_bytes": 764493037568, 2020-10-31T22:49:14.414 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_bytes": 11141120, 2020-10-31T22:49:14.414 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_bytes": 8601075712, 2020-10-31T22:49:14.414 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_ratio": 0.01112552173435688 2020-10-31T22:49:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:49:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_health_metrics", 2020-10-31T22:49:14.415 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1, 2020-10-31T22:49:14.416 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2020-10-31T22:49:14.416 INFO:teuthology.orchestra.run.smithi060.stdout: "stored": 0, 2020-10-31T22:49:14.416 INFO:teuthology.orchestra.run.smithi060.stdout: "objects": 2, 2020-10-31T22:49:14.416 INFO:teuthology.orchestra.run.smithi060.stdout: "kb_used": 0, 2020-10-31T22:49:14.416 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes_used": 0, 2020-10-31T22:49:14.417 INFO:teuthology.orchestra.run.smithi060.stdout: "percent_used": 0, 2020-10-31T22:49:14.417 INFO:teuthology.orchestra.run.smithi060.stdout: "max_avail": 362919100416 2020-10-31T22:49:14.417 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:14.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:14.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:14.417 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd", 2020-10-31T22:49:14.417 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2, 2020-10-31T22:49:14.418 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2020-10-31T22:49:14.418 INFO:teuthology.orchestra.run.smithi060.stdout: "stored": 0, 2020-10-31T22:49:14.418 INFO:teuthology.orchestra.run.smithi060.stdout: "objects": 0, 2020-10-31T22:49:14.418 INFO:teuthology.orchestra.run.smithi060.stdout: "kb_used": 0, 2020-10-31T22:49:14.418 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes_used": 0, 2020-10-31T22:49:14.418 INFO:teuthology.orchestra.run.smithi060.stdout: "percent_used": 0, 2020-10-31T22:49:14.419 INFO:teuthology.orchestra.run.smithi060.stdout: "max_avail": 362919100416 2020-10-31T22:49:14.419 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:14.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:14.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:14.419 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephfs_metadata", 2020-10-31T22:49:14.419 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 19, 2020-10-31T22:49:14.419 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2020-10-31T22:49:14.420 INFO:teuthology.orchestra.run.smithi060.stdout: "stored": 2741, 2020-10-31T22:49:14.420 INFO:teuthology.orchestra.run.smithi060.stdout: "objects": 22, 2020-10-31T22:49:14.420 INFO:teuthology.orchestra.run.smithi060.stdout: "kb_used": 64, 2020-10-31T22:49:14.420 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes_used": 65536, 2020-10-31T22:49:14.420 INFO:teuthology.orchestra.run.smithi060.stdout: "percent_used": 9.0290086518507451e-08, 2020-10-31T22:49:14.420 INFO:teuthology.orchestra.run.smithi060.stdout: "max_avail": 362919100416 2020-10-31T22:49:14.420 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:14.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:14.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:14.421 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephfs_data", 2020-10-31T22:49:14.421 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 20, 2020-10-31T22:49:14.421 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2020-10-31T22:49:14.421 INFO:teuthology.orchestra.run.smithi060.stdout: "stored": 0, 2020-10-31T22:49:14.422 INFO:teuthology.orchestra.run.smithi060.stdout: "objects": 0, 2020-10-31T22:49:14.422 INFO:teuthology.orchestra.run.smithi060.stdout: "kb_used": 0, 2020-10-31T22:49:14.422 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes_used": 0, 2020-10-31T22:49:14.422 INFO:teuthology.orchestra.run.smithi060.stdout: "percent_used": 0, 2020-10-31T22:49:14.422 INFO:teuthology.orchestra.run.smithi060.stdout: "max_avail": 362919100416 2020-10-31T22:49:14.422 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:14.422 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:14.423 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:14.423 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:49:14.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.405+0000 7fbc2b039700 1 -- 172.21.15.60:0/2081980187 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc04055020 msgr2=0x7fbc040574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:14.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.405+0000 7fbc2b039700 1 --2- 172.21.15.60:0/2081980187 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc04055020 0x7fbc040574e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7fbc2000b000 tx=0x7fbc20006dc0).stop 2020-10-31T22:49:14.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.405+0000 7fbc2b039700 1 -- 172.21.15.60:0/2081980187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc24141d80 msgr2=0x7fbc240aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:14.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.405+0000 7fbc2b039700 1 --2- 172.21.15.60:0/2081980187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc24141d80 0x7fbc240aae70 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 rx=0x7fbc1c0032b0 tx=0x7fbc1c016000).stop 2020-10-31T22:49:14.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.405+0000 7fbc2b039700 1 -- 172.21.15.60:0/2081980187 shutdown_connections 2020-10-31T22:49:14.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.405+0000 7fbc2b039700 1 --2- 172.21.15.60:0/2081980187 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc24141d80 0x7fbc240aae70 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.405+0000 7fbc2b039700 1 --2- 172.21.15.60:0/2081980187 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbc240b0950 0x7fbc240b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.405+0000 7fbc2b039700 1 --2- 172.21.15.60:0/2081980187 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbc04055020 0x7fbc040574e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.405+0000 7fbc2b039700 1 --2- 172.21.15.60:0/2081980187 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbc240b1d50 0x7fbc240ad9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.405+0000 7fbc2b039700 1 -- 172.21.15.60:0/2081980187 >> 172.21.15.60:0/2081980187 conn(0x7fbc240b5300 msgr2=0x7fbc240b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:14.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.405+0000 7fbc2b039700 1 -- 172.21.15.60:0/2081980187 shutdown_connections 2020-10-31T22:49:14.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.409+0000 7fbc2b039700 1 -- 172.21.15.60:0/2081980187 wait complete. 2020-10-31T22:49:14.439 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data size -f json-pretty 2020-10-31T22:49:14.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.557+0000 7fdb548f8700 1 Processor -- start 2020-10-31T22:49:14.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb548f8700 1 -- start start 2020-10-31T22:49:14.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb548f8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdb500af520 0x7fdb500ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:14.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb548f8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb50066c90 0x7fdb500670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:14.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb548f8700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb500af900 con 0x7fdb50146060 2020-10-31T22:49:14.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb548f8700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb500afc10 con 0x7fdb500af520 2020-10-31T22:49:14.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb548f8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb5005bb70 con 0x7fdb50066c90 2020-10-31T22:49:14.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4ed9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdb500af520 0x7fdb500ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:14.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4f59e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdb50146060 0x7fdb50149620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51782/0 (socket says 172.21.15.60:51782) 2020-10-31T22:49:14.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4f59e700 1 -- 172.21.15.60:0/23222008 learned_addr learned my addr 172.21.15.60:0/23222008 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:14.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4e59c700 1 --2- 172.21.15.60:0/23222008 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb50066c90 0x7fdb500670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:14.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4dd9b700 1 -- 172.21.15.60:0/23222008 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448942670 0 0) 0x7fdb500af900 con 0x7fdb50146060 2020-10-31T22:49:14.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4dd9b700 1 -- 172.21.15.60:0/23222008 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb30003230 con 0x7fdb50146060 2020-10-31T22:49:14.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4ed9d700 1 -- 172.21.15.60:0/23222008 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb50066c90 msgr2=0x7fdb500670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:14.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4dd9b700 1 -- 172.21.15.60:0/23222008 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 903711896 0 0) 0x7fdb30003230 con 0x7fdb50146060 2020-10-31T22:49:14.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4ed9d700 1 --2- 172.21.15.60:0/23222008 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb50066c90 0x7fdb500670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4ed9d700 1 -- 172.21.15.60:0/23222008 >> v1:172.21.15.60:6789/0 conn(0x7fdb50146060 legacy=0x7fdb50149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:14.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4ed9d700 1 -- 172.21.15.60:0/23222008 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb500ac130 con 0x7fdb500af520 2020-10-31T22:49:14.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4ed9d700 1 --2- 172.21.15.60:0/23222008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb500af520 0x7fdb500ac870 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fdb48001bf0 tx=0x7fdb38006d60).ready entity=mon.0 client_cookie=8c97b6c846658991 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:14.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4dd9b700 1 -- 172.21.15.60:0/23222008 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb48001a50 con 0x7fdb500af520 2020-10-31T22:49:14.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4dd9b700 1 -- 172.21.15.60:0/23222008 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb3800f510 con 0x7fdb500af520 2020-10-31T22:49:14.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb4dd9b700 1 -- 172.21.15.60:0/23222008 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb3800f680 con 0x7fdb500af520 2020-10-31T22:49:14.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb548f8700 1 -- 172.21.15.60:0/23222008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb500af520 msgr2=0x7fdb500ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:14.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb548f8700 1 --2- 172.21.15.60:0/23222008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb500af520 0x7fdb500ac870 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 rx=0x7fdb48001bf0 tx=0x7fdb38006d60).stop 2020-10-31T22:49:14.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb548f8700 1 -- 172.21.15.60:0/23222008 shutdown_connections 2020-10-31T22:49:14.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb548f8700 1 --2- 172.21.15.60:0/23222008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb500af520 0x7fdb500ac870 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb548f8700 1 --2- 172.21.15.60:0/23222008 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb50066c90 0x7fdb500670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb548f8700 1 -- 172.21.15.60:0/23222008 >> 172.21.15.60:0/23222008 conn(0x7fdb500b3fd0 msgr2=0x7fdb500b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:14.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb548f8700 1 -- 172.21.15.60:0/23222008 shutdown_connections 2020-10-31T22:49:14.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.561+0000 7fdb548f8700 1 -- 172.21.15.60:0/23222008 wait complete. 2020-10-31T22:49:14.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.565+0000 7fdb548f8700 1 Processor -- start 2020-10-31T22:49:14.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.565+0000 7fdb548f8700 1 -- start start 2020-10-31T22:49:14.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.565+0000 7fdb548f8700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb50066c90 0x7fdb500a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:14.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.565+0000 7fdb548f8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb500af520 0x7fdb50066040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:14.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.565+0000 7fdb548f8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb50146060 0x7fdb50142330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:14.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.565+0000 7fdb548f8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb50155ec0 con 0x7fdb50146060 2020-10-31T22:49:14.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.565+0000 7fdb548f8700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb50063530 con 0x7fdb50066c90 2020-10-31T22:49:14.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.565+0000 7fdb548f8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb500673a0 con 0x7fdb500af520 2020-10-31T22:49:14.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.565+0000 7fdb4f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb50146060 0x7fdb50142330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:14.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.565+0000 7fdb4f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb50146060 0x7fdb50142330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47652/0 (socket says 172.21.15.60:47652) 2020-10-31T22:49:14.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.565+0000 7fdb4f59e700 1 -- 172.21.15.60:0/2177519332 learned_addr learned my addr 172.21.15.60:0/2177519332 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:14.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb4e59c700 1 --2- 172.21.15.60:0/2177519332 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb500af520 0x7fdb50066040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:14.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb4ed9d700 1 --2- 172.21.15.60:0/2177519332 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb50066c90 0x7fdb500a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:14.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb4f59e700 1 -- 172.21.15.60:0/2177519332 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb500af520 msgr2=0x7fdb50066040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:14.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb4f59e700 1 --2- 172.21.15.60:0/2177519332 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb500af520 0x7fdb50066040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb4f59e700 1 -- 172.21.15.60:0/2177519332 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb50066c90 msgr2=0x7fdb500a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:14.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb4f59e700 1 --2- 172.21.15.60:0/2177519332 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb50066c90 0x7fdb500a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb4f59e700 1 -- 172.21.15.60:0/2177519332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb500aab90 con 0x7fdb50146060 2020-10-31T22:49:14.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb4f59e700 1 --2- 172.21.15.60:0/2177519332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb50146060 0x7fdb50142330 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fdb50063670 tx=0x7fdb480017a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:14.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb47fff700 1 -- 172.21.15.60:0/2177519332 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb4800ce30 con 0x7fdb50146060 2020-10-31T22:49:14.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb47fff700 1 -- 172.21.15.60:0/2177519332 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb4800ab00 con 0x7fdb50146060 2020-10-31T22:49:14.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb548f8700 1 -- 172.21.15.60:0/2177519332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb50063090 con 0x7fdb50146060 2020-10-31T22:49:14.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb47fff700 1 -- 172.21.15.60:0/2177519332 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdb4800ae60 con 0x7fdb50146060 2020-10-31T22:49:14.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb548f8700 1 -- 172.21.15.60:0/2177519332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb50063c50 con 0x7fdb50146060 2020-10-31T22:49:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb548f8700 1 -- 172.21.15.60:0/2177519332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb50063220 con 0x7fdb50146060 2020-10-31T22:49:14.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb47fff700 1 -- 172.21.15.60:0/2177519332 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fdb48010070 con 0x7fdb50146060 2020-10-31T22:49:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.569+0000 7fdb47fff700 1 --2- 172.21.15.60:0/2177519332 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdb34054fd0 0x7fdb34057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.573+0000 7fdb4ed9d700 1 --2- 172.21.15.60:0/2177519332 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdb34054fd0 0x7fdb34057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.573+0000 7fdb47fff700 1 -- 172.21.15.60:0/2177519332 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdb4806d780 con 0x7fdb50146060 2020-10-31T22:49:14.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.573+0000 7fdb4ed9d700 1 --2- 172.21.15.60:0/2177519332 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdb34054fd0 0x7fdb34057490 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fdb38019000 tx=0x7fdb38014000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:14.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.573+0000 7fdb47fff700 1 -- 172.21.15.60:0/2177519332 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdb48043c40 con 0x7fdb50146060 2020-10-31T22:49:14.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.717+0000 7fdb548f8700 1 -- 172.21.15.60:0/2177519332 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"} v 0) v1 -- 0x7fdb500aad20 con 0x7fdb50146060 2020-10-31T22:49:14.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.717+0000 7fdb47fff700 1 -- 172.21.15.60:0/2177519332 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "size", "format": "json-pretty"}]=0 v110) v1 ==== 123+0+64 (secure 0 0 0) 0x7fdb48019030 con 0x7fdb50146060 2020-10-31T22:49:14.725 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:14.725 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:49:14.725 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": "cephfs_data", 2020-10-31T22:49:14.726 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_id": 20, 2020-10-31T22:49:14.726 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2 2020-10-31T22:49:14.726 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:49:14.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.721+0000 7fdb548f8700 1 -- 172.21.15.60:0/2177519332 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdb34054fd0 msgr2=0x7fdb34057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:14.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.721+0000 7fdb548f8700 1 --2- 172.21.15.60:0/2177519332 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdb34054fd0 0x7fdb34057490 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7fdb38019000 tx=0x7fdb38014000).stop 2020-10-31T22:49:14.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.721+0000 7fdb548f8700 1 -- 172.21.15.60:0/2177519332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb50146060 msgr2=0x7fdb50142330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:14.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.721+0000 7fdb548f8700 1 --2- 172.21.15.60:0/2177519332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb50146060 0x7fdb50142330 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 rx=0x7fdb50063670 tx=0x7fdb480017a0).stop 2020-10-31T22:49:14.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.721+0000 7fdb548f8700 1 -- 172.21.15.60:0/2177519332 shutdown_connections 2020-10-31T22:49:14.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.721+0000 7fdb548f8700 1 --2- 172.21.15.60:0/2177519332 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb50146060 0x7fdb50142330 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.721+0000 7fdb548f8700 1 --2- 172.21.15.60:0/2177519332 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdb34054fd0 0x7fdb34057490 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.721+0000 7fdb548f8700 1 --2- 172.21.15.60:0/2177519332 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdb50066c90 0x7fdb500a99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.721+0000 7fdb548f8700 1 --2- 172.21.15.60:0/2177519332 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdb500af520 0x7fdb50066040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:14.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.721+0000 7fdb548f8700 1 -- 172.21.15.60:0/2177519332 >> 172.21.15.60:0/2177519332 conn(0x7fdb500b3fd0 msgr2=0x7fdb501457a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:14.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.721+0000 7fdb548f8700 1 -- 172.21.15.60:0/2177519332 shutdown_connections 2020-10-31T22:49:14.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:14.721+0000 7fdb548f8700 1 -- 172.21.15.60:0/2177519332 wait complete. 2020-10-31T22:49:14.743 INFO:teuthology.orchestra.run.smithi152:> cd /home/ubuntu/cephtest/mnt.0 && sudo df . 2020-10-31T22:49:14.774 INFO:teuthology.orchestra.run.smithi152.stdout:Filesystem 1K-blocks Used Available Use% Mounted on 2020-10-31T22:49:14.775 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-fuse 354410496 0 354410496 0% /home/ubuntu/cephtest/mnt.0 2020-10-31T22:49:14.776 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:49:14.776 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:49:14.791 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:49:14.809 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:49:14.826 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:49:14.843 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:49:14.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:14.844 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:14.844 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:14.894 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:49:14.895 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:49:14.896 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:49:14.896 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:49:14.896 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:14.967 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13899]: fuse finished with error 0 and tester_r 0 2020-10-31T22:49:14.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:14.970 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:14.970 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:15.017 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:49:15.018 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:49:15.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:49:15.045 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:15.094 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:15.094 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:15.095 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:15.102 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:49:15.103 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:49:15.104 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi085.front.sepia.ceph.com... 2020-10-31T22:49:15.104 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:49:15.105 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:15.177 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13378]: fuse finished with error 0 and tester_r 0 2020-10-31T22:49:15.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:15.179 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:15.180 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:15.227 INFO:teuthology.orchestra.run.smithi085.stdout:ext2/ext3 2020-10-31T22:49:15.229 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:49:15.267 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:49:15.271 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:49:15.275 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:49:15.277 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:49:15.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:49:15.350 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:15.396 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2020-10-31T22:49:15.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac86344700 1 Processor -- start 2020-10-31T22:49:15.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac86344700 1 -- start start 2020-10-31T22:49:15.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac86344700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac800af520 0x7fac800ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac86344700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fac80066c90 0x7fac800670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac86344700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac800af900 con 0x7fac80146060 2020-10-31T22:49:15.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac86344700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac800afc10 con 0x7fac800af520 2020-10-31T22:49:15.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac86344700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8005bb70 con 0x7fac80066c90 2020-10-31T22:49:15.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac85342700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac800af520 0x7fac800ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:15.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac85342700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fac800af520 0x7fac800ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47658/0 (socket says 172.21.15.60:47658) 2020-10-31T22:49:15.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac85342700 1 -- 172.21.15.60:0/4159277537 learned_addr learned my addr 172.21.15.60:0/4159277537 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:15.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac84b41700 1 --2- 172.21.15.60:0/4159277537 >> v2:172.21.15.66:3300/0 conn(0x7fac80066c90 0x7fac800670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:15.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac85342700 1 -- 172.21.15.60:0/4159277537 >> v2:172.21.15.66:3300/0 conn(0x7fac80066c90 msgr2=0x7fac800670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:15.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac85342700 1 --2- 172.21.15.60:0/4159277537 >> v2:172.21.15.66:3300/0 conn(0x7fac80066c90 0x7fac800670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:15.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac85342700 1 -- 172.21.15.60:0/4159277537 >> v1:172.21.15.66:6789/0 conn(0x7fac80146060 legacy=0x7fac80149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:15.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac85342700 1 -- 172.21.15.60:0/4159277537 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac800ac130 con 0x7fac800af520 2020-10-31T22:49:15.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.517+0000 7fac85342700 1 --2- 172.21.15.60:0/4159277537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac800af520 0x7fac800ac870 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fac7c002f30 tx=0x7fac7c006e80).ready entity=mon.0 client_cookie=52d6edaeedc29d28 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:15.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.521+0000 7fac73fff700 1 -- 172.21.15.60:0/4159277537 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac7c0097f0 con 0x7fac800af520 2020-10-31T22:49:15.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.521+0000 7fac73fff700 1 -- 172.21.15.60:0/4159277537 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c009950 con 0x7fac800af520 2020-10-31T22:49:15.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.521+0000 7fac73fff700 1 -- 172.21.15.60:0/4159277537 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac7c009cb0 con 0x7fac800af520 2020-10-31T22:49:15.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.521+0000 7fac86344700 1 -- 172.21.15.60:0/4159277537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac800af520 msgr2=0x7fac800ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:15.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.521+0000 7fac86344700 1 --2- 172.21.15.60:0/4159277537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac800af520 0x7fac800ac870 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 rx=0x7fac7c002f30 tx=0x7fac7c006e80).stop 2020-10-31T22:49:15.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.521+0000 7fac86344700 1 -- 172.21.15.60:0/4159277537 shutdown_connections 2020-10-31T22:49:15.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.521+0000 7fac86344700 1 --2- 172.21.15.60:0/4159277537 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac800af520 0x7fac800ac870 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:15.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.521+0000 7fac86344700 1 --2- 172.21.15.60:0/4159277537 >> v2:172.21.15.66:3300/0 conn(0x7fac80066c90 0x7fac800670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:15.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.521+0000 7fac86344700 1 -- 172.21.15.60:0/4159277537 >> 172.21.15.60:0/4159277537 conn(0x7fac800b3fd0 msgr2=0x7fac800b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:15.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.521+0000 7fac86344700 1 -- 172.21.15.60:0/4159277537 shutdown_connections 2020-10-31T22:49:15.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.521+0000 7fac86344700 1 -- 172.21.15.60:0/4159277537 wait complete. 2020-10-31T22:49:15.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.521+0000 7fac86344700 1 Processor -- start 2020-10-31T22:49:15.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.521+0000 7fac86344700 1 -- start start 2020-10-31T22:49:15.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac86344700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac80066c90 0x7fac8013fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac86344700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac800af520 0x7fac800a9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac86344700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac80146060 0x7fac800a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac86344700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac80154f00 con 0x7fac800af520 2020-10-31T22:49:15.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac86344700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac800aa300 con 0x7fac80146060 2020-10-31T22:49:15.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac86344700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac80140920 con 0x7fac80066c90 2020-10-31T22:49:15.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac84b41700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac800af520 0x7fac800a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:15.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac85342700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac80066c90 0x7fac8013fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:15.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac84b41700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac800af520 0x7fac800a9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47664/0 (socket says 172.21.15.60:47664) 2020-10-31T22:49:15.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac84b41700 1 -- 172.21.15.60:0/2955335581 learned_addr learned my addr 172.21.15.60:0/2955335581 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:15.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac85b43700 1 --2- 172.21.15.60:0/2955335581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac80146060 0x7fac800a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:15.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac84b41700 1 -- 172.21.15.60:0/2955335581 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac80066c90 msgr2=0x7fac8013fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:15.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac84b41700 1 --2- 172.21.15.60:0/2955335581 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac80066c90 0x7fac8013fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:15.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac84b41700 1 -- 172.21.15.60:0/2955335581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac80146060 msgr2=0x7fac800a9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:15.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac84b41700 1 --2- 172.21.15.60:0/2955335581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac80146060 0x7fac800a9e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:15.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac84b41700 1 -- 172.21.15.60:0/2955335581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac801550f0 con 0x7fac800af520 2020-10-31T22:49:15.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac84b41700 1 --2- 172.21.15.60:0/2955335581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac800af520 0x7fac800a9920 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fac7400c000 tx=0x7fac74006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:15.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac727fc700 1 -- 172.21.15.60:0/2955335581 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac7400ca10 con 0x7fac800af520 2020-10-31T22:49:15.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac727fc700 1 -- 172.21.15.60:0/2955335581 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7400cb70 con 0x7fac800af520 2020-10-31T22:49:15.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac727fc700 1 -- 172.21.15.60:0/2955335581 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fac740123f0 con 0x7fac800af520 2020-10-31T22:49:15.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac86344700 1 -- 172.21.15.60:0/2955335581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac800a9480 con 0x7fac800af520 2020-10-31T22:49:15.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.525+0000 7fac86344700 1 -- 172.21.15.60:0/2955335581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac800aa760 con 0x7fac800af520 2020-10-31T22:49:15.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.529+0000 7fac86344700 1 -- 172.21.15.60:0/2955335581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac80140690 con 0x7fac800af520 2020-10-31T22:49:15.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.529+0000 7fac727fc700 1 -- 172.21.15.60:0/2955335581 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fac74012550 con 0x7fac800af520 2020-10-31T22:49:15.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.529+0000 7fac727fc700 1 --2- 172.21.15.60:0/2955335581 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fac680550c0 0x7fac68057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.529+0000 7fac727fc700 1 -- 172.21.15.60:0/2955335581 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fac7406dd70 con 0x7fac800af520 2020-10-31T22:49:15.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.529+0000 7fac85342700 1 --2- 172.21.15.60:0/2955335581 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fac680550c0 0x7fac68057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:15.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.529+0000 7fac85342700 1 --2- 172.21.15.60:0/2955335581 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fac680550c0 0x7fac68057580 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fac7c01c000 tx=0x7fac7c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:15.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.537+0000 7fac727fc700 1 -- 172.21.15.60:0/2955335581 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fac80140690 con 0x7fac800af520 2020-10-31T22:49:15.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.681+0000 7fac86344700 1 -- 172.21.15.60:0/2955335581 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fac80140690 con 0x7fac800af520 2020-10-31T22:49:15.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.685+0000 7fac727fc700 1 -- 172.21.15.60:0/2955335581 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fac80140690 con 0x7fac800af520 2020-10-31T22:49:15.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.689+0000 7fac86344700 1 -- 172.21.15.60:0/2955335581 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fac680550c0 msgr2=0x7fac68057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:15.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.689+0000 7fac86344700 1 --2- 172.21.15.60:0/2955335581 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fac680550c0 0x7fac68057580 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7fac7c01c000 tx=0x7fac7c015000).stop 2020-10-31T22:49:15.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.689+0000 7fac86344700 1 -- 172.21.15.60:0/2955335581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac800af520 msgr2=0x7fac800a9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:15.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.689+0000 7fac86344700 1 --2- 172.21.15.60:0/2955335581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac800af520 0x7fac800a9920 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 rx=0x7fac7400c000 tx=0x7fac74006dc0).stop 2020-10-31T22:49:15.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.689+0000 7fac86344700 1 -- 172.21.15.60:0/2955335581 shutdown_connections 2020-10-31T22:49:15.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.689+0000 7fac86344700 1 --2- 172.21.15.60:0/2955335581 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fac680550c0 0x7fac68057580 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:15.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.689+0000 7fac86344700 1 --2- 172.21.15.60:0/2955335581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fac80146060 0x7fac800a9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:15.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.689+0000 7fac86344700 1 --2- 172.21.15.60:0/2955335581 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac80066c90 0x7fac8013fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:15.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.689+0000 7fac86344700 1 --2- 172.21.15.60:0/2955335581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac800af520 0x7fac800a9920 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:15.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.689+0000 7fac86344700 1 -- 172.21.15.60:0/2955335581 >> 172.21.15.60:0/2955335581 conn(0x7fac800b3fd0 msgr2=0x7fac800b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:15.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.689+0000 7fac86344700 1 -- 172.21.15.60:0/2955335581 shutdown_connections 2020-10-31T22:49:15.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.689+0000 7fac86344700 1 -- 172.21.15.60:0/2955335581 wait complete. 2020-10-31T22:49:15.714 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df' 2020-10-31T22:49:15.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0c5e2700 1 Processor -- start 2020-10-31T22:49:15.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0c5e2700 1 -- start start 2020-10-31T22:49:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0c5e2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7faf040b2e20 0x7faf0405c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0c5e2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf040b4410 0x7faf04146020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0c5e2700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf04065e90 con 0x7faf0405c4c0 2020-10-31T22:49:15.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0c5e2700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf04141ef0 con 0x7faf040b2e20 2020-10-31T22:49:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0c5e2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf04066130 con 0x7faf040b4410 2020-10-31T22:49:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0a37e700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7faf0405c4c0 0x7faf0413f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51806/0 (socket says 172.21.15.60:51806) 2020-10-31T22:49:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0a37e700 1 -- 172.21.15.60:0/3965711747 learned_addr learned my addr 172.21.15.60:0/3965711747 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0ab7f700 1 --2- 172.21.15.60:0/3965711747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf040b4410 0x7faf04146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf09b7d700 1 --2- 172.21.15.60:0/3965711747 >> v2:172.21.15.66:3300/0 conn(0x7faf040b2e20 0x7faf0405c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 -- 172.21.15.60:0/3965711747 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873564058 0 0) 0x7faf04065e90 con 0x7faf0405c4c0 2020-10-31T22:49:15.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 -- 172.21.15.60:0/3965711747 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faef0003230 con 0x7faf0405c4c0 2020-10-31T22:49:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 -- 172.21.15.60:0/3965711747 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2348219330 0 0) 0x7faef0003230 con 0x7faf0405c4c0 2020-10-31T22:49:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 -- 172.21.15.60:0/3965711747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf040b4410 msgr2=0x7faf04146020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 --2- 172.21.15.60:0/3965711747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf040b4410 0x7faf04146020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:15.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 -- 172.21.15.60:0/3965711747 >> v2:172.21.15.66:3300/0 conn(0x7faf040b2e20 msgr2=0x7faf0405c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 --2- 172.21.15.60:0/3965711747 >> v2:172.21.15.66:3300/0 conn(0x7faf040b2e20 0x7faf0405c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 -- 172.21.15.60:0/3965711747 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040663d0 con 0x7faf0405c4c0 2020-10-31T22:49:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 -- 172.21.15.60:0/3965711747 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7faef40016d0 con 0x7faf0405c4c0 2020-10-31T22:49:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 -- 172.21.15.60:0/3965711747 >> v1:172.21.15.60:6789/0 conn(0x7faf0405c4c0 legacy=0x7faf0413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 --2- 172.21.15.60:0/3965711747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef0003720 0x7faef0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 --2- 172.21.15.60:0/3965711747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf040b4410 0x7faef00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 --2- 172.21.15.60:0/3965711747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faef00049c0 0x7faef0004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 -- 172.21.15.60:0/3965711747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf04066130 con 0x7faef0003720 2020-10-31T22:49:15.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 -- 172.21.15.60:0/3965711747 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faef00041c0 con 0x7faef00049c0 2020-10-31T22:49:15.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 -- 172.21.15.60:0/3965711747 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faef000b720 con 0x7faf040b4410 2020-10-31T22:49:15.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0a37e700 1 --2- 172.21.15.60:0/3965711747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef0003720 0x7faef0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:15.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0ab7f700 1 --2- 172.21.15.60:0/3965711747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faef00049c0 0x7faef0004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:15.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0a37e700 1 -- 172.21.15.60:0/3965711747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf040b4410 msgr2=0x7faef00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:15.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0a37e700 1 --2- 172.21.15.60:0/3965711747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf040b4410 0x7faef00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-10-31T22:49:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0a37e700 1 -- 172.21.15.60:0/3965711747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faef00049c0 msgr2=0x7faef0004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0a37e700 1 --2- 172.21.15.60:0/3965711747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faef00049c0 0x7faef0004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0a37e700 1 -- 172.21.15.60:0/3965711747 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef0003230 con 0x7faef0003720 2020-10-31T22:49:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0ab7f700 1 --2- 172.21.15.60:0/3965711747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faef00049c0 0x7faef0004e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:49:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0a37e700 1 --2- 172.21.15.60:0/3965711747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef0003720 0x7faef0003b40 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7faef40013e0 tx=0x7faf04066020).ready entity=mon.0 client_cookie=81fa5a97aebc0729 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 -- 172.21.15.60:0/3965711747 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef400ce00 con 0x7faef0003720 2020-10-31T22:49:15.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 -- 172.21.15.60:0/3965711747 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faef40072e0 con 0x7faef0003720 2020-10-31T22:49:15.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0937c700 1 -- 172.21.15.60:0/3965711747 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faef40057d0 con 0x7faef0003720 2020-10-31T22:49:15.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0c5e2700 1 -- 172.21.15.60:0/3965711747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef0003720 msgr2=0x7faef0003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:15.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0c5e2700 1 --2- 172.21.15.60:0/3965711747 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faef0003720 0x7faef0003b40 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 rx=0x7faef40013e0 tx=0x7faf04066020).stop 2020-10-31T22:49:15.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.821+0000 7faf0ab7f700 1 -- 172.21.15.60:0/3965711747 reap_dead start 2020-10-31T22:49:15.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0c5e2700 1 -- 172.21.15.60:0/3965711747 shutdown_connections 2020-10-31T22:49:15.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0c5e2700 1 -- 172.21.15.60:0/3965711747 >> 172.21.15.60:0/3965711747 conn(0x7faf040601e0 msgr2=0x7faf0405b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:15.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0c5e2700 1 -- 172.21.15.60:0/3965711747 shutdown_connections 2020-10-31T22:49:15.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0c5e2700 1 -- 172.21.15.60:0/3965711747 wait complete. 2020-10-31T22:49:15.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0c5e2700 1 Processor -- start 2020-10-31T22:49:15.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0c5e2700 1 -- start start 2020-10-31T22:49:15.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0c5e2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf040a94b0 0x7faf040a9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0c5e2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf04151600 0x7faf040aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0c5e2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf040af010 0x7faf040aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0c5e2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040b8b50 con 0x7faf040af010 2020-10-31T22:49:15.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0c5e2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf040ace10 con 0x7faf040a94b0 2020-10-31T22:49:15.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0c5e2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf040ad0b0 con 0x7faf04151600 2020-10-31T22:49:15.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0ab7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf040af010 0x7faf040aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:15.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0ab7f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf040af010 0x7faf040aa7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47684/0 (socket says 172.21.15.60:47684) 2020-10-31T22:49:15.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0ab7f700 1 -- 172.21.15.60:0/2787222387 learned_addr learned my addr 172.21.15.60:0/2787222387 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:15.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0a37e700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf040a94b0 0x7faf040a9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:15.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf09b7d700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf04151600 0x7faf040aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:15.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0ab7f700 1 -- 172.21.15.60:0/2787222387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf04151600 msgr2=0x7faf040aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:15.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0ab7f700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf04151600 0x7faf040aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:15.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0ab7f700 1 -- 172.21.15.60:0/2787222387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf040a94b0 msgr2=0x7faf040a9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:15.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0ab7f700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf040a94b0 0x7faf040a9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:15.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0ab7f700 1 -- 172.21.15.60:0/2787222387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf040ad350 con 0x7faf040af010 2020-10-31T22:49:15.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf09b7d700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf04151600 0x7faf040aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:15.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0ab7f700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf040af010 0x7faf040aa7a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7faefc00b000 tx=0x7faefc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:15.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf037fe700 1 -- 172.21.15.60:0/2787222387 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faefc017070 con 0x7faf040af010 2020-10-31T22:49:15.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0c5e2700 1 -- 172.21.15.60:0/2787222387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf040ad5f0 con 0x7faf040af010 2020-10-31T22:49:15.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf037fe700 1 -- 172.21.15.60:0/2787222387 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faefc012760 con 0x7faf040af010 2020-10-31T22:49:15.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf037fe700 1 -- 172.21.15.60:0/2787222387 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faefc006c00 con 0x7faf040af010 2020-10-31T22:49:15.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.825+0000 7faf0c5e2700 1 -- 172.21.15.60:0/2787222387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf040af470 con 0x7faf040af010 2020-10-31T22:49:15.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.829+0000 7faf0c5e2700 1 -- 172.21.15.60:0/2787222387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf040ad780 con 0x7faf040af010 2020-10-31T22:49:15.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.829+0000 7faf037fe700 1 -- 172.21.15.60:0/2787222387 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7faefc012b00 con 0x7faf040af010 2020-10-31T22:49:15.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.829+0000 7faf037fe700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faee4054f30 0x7faee40573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:15.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.829+0000 7faf037fe700 1 -- 172.21.15.60:0/2787222387 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faefc06dbf0 con 0x7faf040af010 2020-10-31T22:49:15.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.829+0000 7faf0a37e700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faee4054f30 0x7faee40573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:15.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.829+0000 7faf0a37e700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faee4054f30 0x7faee40573f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7faef401a000 tx=0x7faef4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:15.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:15.837+0000 7faf037fe700 1 -- 172.21.15.60:0/2787222387 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7faefc044070 con 0x7faf040af010 2020-10-31T22:49:16.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:16.029+0000 7faf0c5e2700 1 -- 172.21.15.60:0/2787222387 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]} v 0) v1 -- 0x7faf04057100 con 0x7faf040af010 2020-10-31T22:49:17.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.001+0000 7faf037fe700 1 -- 172.21.15.60:0/2787222387 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_filtered_df"]}]=0 v360) v1 ==== 127+0+0 (secure 0 0 0) 0x7faefc047690 con 0x7faf040af010 2020-10-31T22:49:17.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.005+0000 7faf0c5e2700 1 -- 172.21.15.60:0/2787222387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faee4054f30 msgr2=0x7faee40573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:17.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.005+0000 7faf0c5e2700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faee4054f30 0x7faee40573f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7faef401a000 tx=0x7faef4015000).stop 2020-10-31T22:49:17.013 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.005+0000 7faf0c5e2700 1 -- 172.21.15.60:0/2787222387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf040af010 msgr2=0x7faf040aa7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:17.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.005+0000 7faf0c5e2700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf040af010 0x7faf040aa7a0 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 rx=0x7faefc00b000 tx=0x7faefc008040).stop 2020-10-31T22:49:17.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.005+0000 7faf0c5e2700 1 -- 172.21.15.60:0/2787222387 shutdown_connections 2020-10-31T22:49:17.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.005+0000 7faf0c5e2700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf040af010 0x7faf040aa7a0 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:17.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.005+0000 7faf0c5e2700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faee4054f30 0x7faee40573f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:17.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.005+0000 7faf0c5e2700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf040a94b0 0x7faf040a9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:17.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.005+0000 7faf0c5e2700 1 --2- 172.21.15.60:0/2787222387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf04151600 0x7faf040aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:17.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.005+0000 7faf0c5e2700 1 -- 172.21.15.60:0/2787222387 >> 172.21.15.60:0/2787222387 conn(0x7faf040601e0 msgr2=0x7faf040b4ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:17.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.005+0000 7faf0c5e2700 1 -- 172.21.15.60:0/2787222387 shutdown_connections 2020-10-31T22:49:17.015 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.005+0000 7faf0c5e2700 1 -- 172.21.15.60:0/2787222387 wait complete. 2020-10-31T22:49:17.030 INFO:tasks.cephfs_test_runner:test_filtered_df (tasks.cephfs.test_misc.TestMisc) ... ok 2020-10-31T22:49:17.030 INFO:tasks.cephfs_test_runner:Starting test: test_fs_new (tasks.cephfs.test_misc.TestMisc) 2020-10-31T22:49:17.031 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2020-10-31T22:49:17.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe92359e700 1 Processor -- start 2020-10-31T22:49:17.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe92359e700 1 -- start start 2020-10-31T22:49:17.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe92359e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9240ae8b0 0x7fe9240b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:17.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe92359e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9240acc50 con 0x7fe9240ac870 2020-10-31T22:49:17.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe92359e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9240b5690 con 0x7fe9240b0e20 2020-10-31T22:49:17.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe92359e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9240b14c0 con 0x7fe9240ae8b0 2020-10-31T22:49:17.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe922d9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe9240ae8b0 0x7fe9240b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:17.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe92259c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe9240ac870 0x7fe9240ae1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51828/0 (socket says 172.21.15.60:51828) 2020-10-31T22:49:17.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe92259c700 1 -- 172.21.15.60:0/4020274399 learned_addr learned my addr 172.21.15.60:0/4020274399 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:17.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe922d9d700 1 -- 172.21.15.60:0/4020274399 >> v1:172.21.15.66:6789/0 conn(0x7fe9240b0e20 legacy=0x7fe9241412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:17.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe922d9d700 1 -- 172.21.15.60:0/4020274399 >> v1:172.21.15.60:6789/0 conn(0x7fe9240ac870 legacy=0x7fe9240ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:17.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe921d9b700 1 -- 172.21.15.60:0/4020274399 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843604214 0 0) 0x7fe9240b5690 con 0x7fe9240b0e20 2020-10-31T22:49:17.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe922d9d700 1 -- 172.21.15.60:0/4020274399 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9240afc10 con 0x7fe9240ae8b0 2020-10-31T22:49:17.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe922d9d700 1 --2- 172.21.15.60:0/4020274399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9240ae8b0 0x7fe9240b5060 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fe9140010d0 tx=0x7fe91c0091a0).ready entity=mon.0 client_cookie=beb52e66d720ef95 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:17.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe921d9b700 1 -- 172.21.15.60:0/4020274399 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c00b910 con 0x7fe9240ae8b0 2020-10-31T22:49:17.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe921d9b700 1 -- 172.21.15.60:0/4020274399 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c00ba70 con 0x7fe9240ae8b0 2020-10-31T22:49:17.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe921d9b700 1 -- 172.21.15.60:0/4020274399 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe91c00bbe0 con 0x7fe9240ae8b0 2020-10-31T22:49:17.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe92359e700 1 -- 172.21.15.60:0/4020274399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9240ae8b0 msgr2=0x7fe9240b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:17.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.145+0000 7fe92359e700 1 --2- 172.21.15.60:0/4020274399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9240ae8b0 0x7fe9240b5060 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 rx=0x7fe9140010d0 tx=0x7fe91c0091a0).stop 2020-10-31T22:49:17.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92359e700 1 -- 172.21.15.60:0/4020274399 shutdown_connections 2020-10-31T22:49:17.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92359e700 1 --2- 172.21.15.60:0/4020274399 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9240ae8b0 0x7fe9240b5060 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:17.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92359e700 1 -- 172.21.15.60:0/4020274399 >> 172.21.15.60:0/4020274399 conn(0x7fe92406a600 msgr2=0x7fe924060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:17.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92359e700 1 -- 172.21.15.60:0/4020274399 shutdown_connections 2020-10-31T22:49:17.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92359e700 1 -- 172.21.15.60:0/4020274399 wait complete. 2020-10-31T22:49:17.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92359e700 1 Processor -- start 2020-10-31T22:49:17.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92359e700 1 -- start start 2020-10-31T22:49:17.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9240ac870 0x7fe9240a9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:17.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9240ae8b0 0x7fe924154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:17.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9240b0e20 0x7fe924154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:17.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe924066510 con 0x7fe9240b0e20 2020-10-31T22:49:17.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe924065b30 con 0x7fe9240ae8b0 2020-10-31T22:49:17.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe924065dd0 con 0x7fe9240ac870 2020-10-31T22:49:17.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe922d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9240b0e20 0x7fe924154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:17.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92259c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9240ac870 0x7fe9240a9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:17.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe91bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9240ae8b0 0x7fe924154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:17.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe922d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9240b0e20 0x7fe924154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47700/0 (socket says 172.21.15.60:47700) 2020-10-31T22:49:17.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe922d9d700 1 -- 172.21.15.60:0/3426948434 learned_addr learned my addr 172.21.15.60:0/3426948434 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:17.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92259c700 1 -- 172.21.15.60:0/3426948434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9240ae8b0 msgr2=0x7fe924154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:17.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92259c700 1 --2- 172.21.15.60:0/3426948434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9240ae8b0 0x7fe924154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:17.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92259c700 1 -- 172.21.15.60:0/3426948434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9240b0e20 msgr2=0x7fe924154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:17.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92259c700 1 --2- 172.21.15.60:0/3426948434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9240b0e20 0x7fe924154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:17.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92259c700 1 -- 172.21.15.60:0/3426948434 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe924066070 con 0x7fe9240ac870 2020-10-31T22:49:17.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.149+0000 7fe92259c700 1 --2- 172.21.15.60:0/3426948434 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9240ac870 0x7fe9240a9bc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fe914001190 tx=0x7fe914007a50).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:17.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.153+0000 7fe91b7fe700 1 -- 172.21.15.60:0/3426948434 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9140072e0 con 0x7fe9240ac870 2020-10-31T22:49:17.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.153+0000 7fe91b7fe700 1 -- 172.21.15.60:0/3426948434 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe914007440 con 0x7fe9240ac870 2020-10-31T22:49:17.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.153+0000 7fe91b7fe700 1 -- 172.21.15.60:0/3426948434 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9140057d0 con 0x7fe9240ac870 2020-10-31T22:49:17.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.153+0000 7fe92359e700 1 -- 172.21.15.60:0/3426948434 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe924154b70 con 0x7fe9240ac870 2020-10-31T22:49:17.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.153+0000 7fe92359e700 1 -- 172.21.15.60:0/3426948434 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe924146120 con 0x7fe9240ac870 2020-10-31T22:49:17.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.153+0000 7fe92359e700 1 -- 172.21.15.60:0/3426948434 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe924057100 con 0x7fe9240ac870 2020-10-31T22:49:17.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.153+0000 7fe91b7fe700 1 -- 172.21.15.60:0/3426948434 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe914010070 con 0x7fe9240ac870 2020-10-31T22:49:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.153+0000 7fe91b7fe700 1 --2- 172.21.15.60:0/3426948434 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe908055020 0x7fe9080574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.153+0000 7fe91bfff700 1 --2- 172.21.15.60:0/3426948434 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe908055020 0x7fe9080574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.153+0000 7fe91b7fe700 1 -- 172.21.15.60:0/3426948434 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe91406d3d0 con 0x7fe9240ac870 2020-10-31T22:49:17.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.153+0000 7fe91bfff700 1 --2- 172.21.15.60:0/3426948434 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe908055020 0x7fe9080574e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fe90c00d000 tx=0x7fe90c0079d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:17.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.165+0000 7fe91b7fe700 1 -- 172.21.15.60:0/3426948434 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe9140437e0 con 0x7fe9240ac870 2020-10-31T22:49:17.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:17.357+0000 7fe92359e700 1 -- 172.21.15.60:0/3426948434 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7fe924066200 con 0x7fe9240ac870 2020-10-31T22:49:18.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.013+0000 7fe91b7fe700 1 -- 172.21.15.60:0/3426948434 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v361) v1 ==== 125+0+0 (secure 0 0 0) 0x7fe914018070 con 0x7fe9240ac870 2020-10-31T22:49:18.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.017+0000 7fe92359e700 1 -- 172.21.15.60:0/3426948434 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe908055020 msgr2=0x7fe9080574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:18.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.017+0000 7fe92359e700 1 --2- 172.21.15.60:0/3426948434 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe908055020 0x7fe9080574e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7fe90c00d000 tx=0x7fe90c0079d0).stop 2020-10-31T22:49:18.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.017+0000 7fe92359e700 1 -- 172.21.15.60:0/3426948434 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9240ac870 msgr2=0x7fe9240a9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:18.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.017+0000 7fe92359e700 1 --2- 172.21.15.60:0/3426948434 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9240ac870 0x7fe9240a9bc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fe914001190 tx=0x7fe914007a50).stop 2020-10-31T22:49:18.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.017+0000 7fe92359e700 1 -- 172.21.15.60:0/3426948434 shutdown_connections 2020-10-31T22:49:18.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.017+0000 7fe92359e700 1 --2- 172.21.15.60:0/3426948434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9240b0e20 0x7fe924154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.017+0000 7fe92359e700 1 --2- 172.21.15.60:0/3426948434 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9240ac870 0x7fe9240a9bc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.017+0000 7fe92359e700 1 --2- 172.21.15.60:0/3426948434 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe908055020 0x7fe9080574e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.017+0000 7fe92359e700 1 --2- 172.21.15.60:0/3426948434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9240ae8b0 0x7fe924154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.017+0000 7fe92359e700 1 -- 172.21.15.60:0/3426948434 >> 172.21.15.60:0/3426948434 conn(0x7fe92406a600 msgr2=0x7fe9240b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:18.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.017+0000 7fe92359e700 1 -- 172.21.15.60:0/3426948434 shutdown_connections 2020-10-31T22:49:18.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.017+0000 7fe92359e700 1 -- 172.21.15.60:0/3426948434 wait complete. 2020-10-31T22:49:18.040 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2020-10-31T22:49:18.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f6147700 1 Processor -- start 2020-10-31T22:49:18.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f6147700 1 -- start start 2020-10-31T22:49:18.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f6147700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f54f00b1bb0 0x7f54f005afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:18.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f6147700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f54f00af580 0x7f54f013fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:18.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f6147700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f00b1120 con 0x7f54f00ab150 2020-10-31T22:49:18.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f6147700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f00af9c0 con 0x7f54f00af580 2020-10-31T22:49:18.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f6147700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f00a8850 con 0x7f54f00b1bb0 2020-10-31T22:49:18.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f5946700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f54f00ab150 0x7f54f00adeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51842/0 (socket says 172.21.15.60:51842) 2020-10-31T22:49:18.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f5946700 1 -- 172.21.15.60:0/3061202693 learned_addr learned my addr 172.21.15.60:0/3061202693 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:18.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f5145700 1 --2- 172.21.15.60:0/3061202693 >> v2:172.21.15.66:3300/0 conn(0x7f54f00b1bb0 0x7f54f005afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:18.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f4944700 1 --2- 172.21.15.60:0/3061202693 >> v2:172.21.15.60:3300/0 conn(0x7f54f00af580 0x7f54f013fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:18.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54e7fff700 1 -- 172.21.15.60:0/3061202693 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570893839 0 0) 0x7f54f00b1120 con 0x7f54f00ab150 2020-10-31T22:49:18.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54e7fff700 1 -- 172.21.15.60:0/3061202693 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54d4003230 con 0x7f54f00ab150 2020-10-31T22:49:18.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f4944700 1 -- 172.21.15.60:0/3061202693 >> v2:172.21.15.66:3300/0 conn(0x7f54f00b1bb0 msgr2=0x7f54f005afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:18.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f4944700 1 --2- 172.21.15.60:0/3061202693 >> v2:172.21.15.66:3300/0 conn(0x7f54f00b1bb0 0x7f54f005afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f4944700 1 -- 172.21.15.60:0/3061202693 >> v1:172.21.15.60:6789/0 conn(0x7f54f00ab150 legacy=0x7f54f00adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:18.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54e7fff700 1 -- 172.21.15.60:0/3061202693 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2694471955 0 0) 0x7f54d4003230 con 0x7f54f00ab150 2020-10-31T22:49:18.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f4944700 1 -- 172.21.15.60:0/3061202693 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f00a8af0 con 0x7f54f00af580 2020-10-31T22:49:18.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54f4944700 1 --2- 172.21.15.60:0/3061202693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f00af580 0x7f54f013fb20 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f54e8001bf0 tx=0x7f54e0006dc0).ready entity=mon.0 client_cookie=73cdb61f3daa82a3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:18.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54e7fff700 1 -- 172.21.15.60:0/3061202693 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54e8001a50 con 0x7f54f00af580 2020-10-31T22:49:18.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.157+0000 7f54e7fff700 1 -- 172.21.15.60:0/3061202693 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e000d5c0 con 0x7f54f00af580 2020-10-31T22:49:18.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.161+0000 7f54e7fff700 1 -- 172.21.15.60:0/3061202693 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54e000d730 con 0x7f54f00af580 2020-10-31T22:49:18.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.161+0000 7f54f6147700 1 -- 172.21.15.60:0/3061202693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f00af580 msgr2=0x7f54f013fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:18.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.161+0000 7f54f6147700 1 --2- 172.21.15.60:0/3061202693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f00af580 0x7f54f013fb20 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 rx=0x7f54e8001bf0 tx=0x7f54e0006dc0).stop 2020-10-31T22:49:18.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.161+0000 7f54f6147700 1 -- 172.21.15.60:0/3061202693 shutdown_connections 2020-10-31T22:49:18.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.161+0000 7f54f6147700 1 --2- 172.21.15.60:0/3061202693 >> v2:172.21.15.66:3300/0 conn(0x7f54f00b1bb0 0x7f54f005afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.161+0000 7f54f6147700 1 --2- 172.21.15.60:0/3061202693 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f00af580 0x7f54f013fb20 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.161+0000 7f54f6147700 1 -- 172.21.15.60:0/3061202693 >> 172.21.15.60:0/3061202693 conn(0x7f54f00b5330 msgr2=0x7f54f00b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:18.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.161+0000 7f54f6147700 1 -- 172.21.15.60:0/3061202693 shutdown_connections 2020-10-31T22:49:18.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.161+0000 7f54f6147700 1 -- 172.21.15.60:0/3061202693 wait complete. 2020-10-31T22:49:18.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.161+0000 7f54f6147700 1 Processor -- start 2020-10-31T22:49:18.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.161+0000 7f54f6147700 1 -- start start 2020-10-31T22:49:18.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.161+0000 7f54f6147700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f00ab150 0x7f54f013ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:18.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.161+0000 7f54f6147700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54f00af580 0x7f54f013c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:18.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f6147700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54f00b1bb0 0x7f54f013cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:18.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f6147700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f0143a20 con 0x7f54f00ab150 2020-10-31T22:49:18.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f6147700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f0150d30 con 0x7f54f00b1bb0 2020-10-31T22:49:18.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f6147700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f0150fd0 con 0x7f54f00af580 2020-10-31T22:49:18.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f5145700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f00ab150 0x7f54f013ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:18.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f5145700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f00ab150 0x7f54f013ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47710/0 (socket says 172.21.15.60:47710) 2020-10-31T22:49:18.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f5145700 1 -- 172.21.15.60:0/2955990268 learned_addr learned my addr 172.21.15.60:0/2955990268 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:18.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f4944700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54f00af580 0x7f54f013c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:18.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f5946700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54f00b1bb0 0x7f54f013cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:18.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f5145700 1 -- 172.21.15.60:0/2955990268 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54f00af580 msgr2=0x7f54f013c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:18.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f5145700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54f00af580 0x7f54f013c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f5145700 1 -- 172.21.15.60:0/2955990268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54f00b1bb0 msgr2=0x7f54f013cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:18.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f5145700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54f00b1bb0 0x7f54f013cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f5145700 1 -- 172.21.15.60:0/2955990268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f0151270 con 0x7f54f00ab150 2020-10-31T22:49:18.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f4944700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54f00af580 0x7f54f013c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:18.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f5145700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f00ab150 0x7f54f013ee30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f54ec006910 tx=0x7f54ec008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:18.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54e67fc700 1 -- 172.21.15.60:0/2955990268 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54ec00c890 con 0x7f54f00ab150 2020-10-31T22:49:18.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54e67fc700 1 -- 172.21.15.60:0/2955990268 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54ec00c9f0 con 0x7f54f00ab150 2020-10-31T22:49:18.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f6147700 1 -- 172.21.15.60:0/2955990268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f0151510 con 0x7f54f00ab150 2020-10-31T22:49:18.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54e67fc700 1 -- 172.21.15.60:0/2955990268 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54ec00cd50 con 0x7f54f00ab150 2020-10-31T22:49:18.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f6147700 1 -- 172.21.15.60:0/2955990268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f0151a30 con 0x7f54f00ab150 2020-10-31T22:49:18.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.165+0000 7f54f6147700 1 -- 172.21.15.60:0/2955990268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f01516a0 con 0x7f54f00ab150 2020-10-31T22:49:18.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.169+0000 7f54e67fc700 1 -- 172.21.15.60:0/2955990268 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f54ec022070 con 0x7f54f00ab150 2020-10-31T22:49:18.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.169+0000 7f54e67fc700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54d8054f10 0x7f54d80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:18.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.169+0000 7f54e67fc700 1 -- 172.21.15.60:0/2955990268 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f54ec06ded0 con 0x7f54f00ab150 2020-10-31T22:49:18.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.169+0000 7f54f4944700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54d8054f10 0x7f54d80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:18.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.169+0000 7f54f4944700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54d8054f10 0x7f54d80573d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f54e0018000 tx=0x7f54e0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:18.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.177+0000 7f54e67fc700 1 -- 172.21.15.60:0/2955990268 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f54ec0443f0 con 0x7f54f00ab150 2020-10-31T22:49:18.325 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.321+0000 7f54f6147700 1 -- 172.21.15.60:0/2955990268 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7f54f0057100 con 0x7f54f00ab150 2020-10-31T22:49:18.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.329+0000 7f54e67fc700 1 -- 172.21.15.60:0/2955990268 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f54ec047a10 con 0x7f54f00ab150 2020-10-31T22:49:18.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.329+0000 7f54f6147700 1 -- 172.21.15.60:0/2955990268 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54d8054f10 msgr2=0x7f54d80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:18.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.329+0000 7f54f6147700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54d8054f10 0x7f54d80573d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f54e0018000 tx=0x7f54e0015000).stop 2020-10-31T22:49:18.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.329+0000 7f54f6147700 1 -- 172.21.15.60:0/2955990268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f00ab150 msgr2=0x7f54f013ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.329+0000 7f54f6147700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f00ab150 0x7f54f013ee30 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 rx=0x7f54ec006910 tx=0x7f54ec008040).stop 2020-10-31T22:49:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.329+0000 7f54f6147700 1 -- 172.21.15.60:0/2955990268 shutdown_connections 2020-10-31T22:49:18.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.329+0000 7f54f6147700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54d8054f10 0x7f54d80573d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.329+0000 7f54f6147700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f54f00b1bb0 0x7f54f013cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.329+0000 7f54f6147700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f54f00ab150 0x7f54f013ee30 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.329+0000 7f54f6147700 1 --2- 172.21.15.60:0/2955990268 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f54f00af580 0x7f54f013c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.329+0000 7f54f6147700 1 -- 172.21.15.60:0/2955990268 >> 172.21.15.60:0/2955990268 conn(0x7f54f00b5330 msgr2=0x7f54f00a97a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:18.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.329+0000 7f54f6147700 1 -- 172.21.15.60:0/2955990268 shutdown_connections 2020-10-31T22:49:18.338 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.329+0000 7f54f6147700 1 -- 172.21.15.60:0/2955990268 wait complete. 2020-10-31T22:49:18.350 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:49:18.350 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:49:18.365 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:49:18.381 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:49:18.398 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:49:18.415 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:49:18.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:18.416 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:18.416 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:18.469 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-10-31T22:49:18.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:49:18.470 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2020-10-31T22:49:18.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:18.471 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:18.471 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:18.479 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:49:18.481 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:49:18.482 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:49:18.483 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-10-31T22:49:18.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8226bae700 1 Processor -- start 2020-10-31T22:49:18.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8226bae700 1 -- start start 2020-10-31T22:49:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8226bae700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f822013fbe0 0x7f82200b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:18.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8226bae700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8220066430 0x7f82201437d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8226bae700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f822013d8a0 con 0x7f82200b0dc0 2020-10-31T22:49:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8226bae700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8220066870 con 0x7f822013fbe0 2020-10-31T22:49:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8226bae700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8220140bb0 con 0x7f8220066430 2020-10-31T22:49:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f822494a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f82200b0dc0 0x7f822013d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51854/0 (socket says 172.21.15.60:51854) 2020-10-31T22:49:18.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f822494a700 1 -- 172.21.15.60:0/901521030 learned_addr learned my addr 172.21.15.60:0/901521030 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8217fff700 1 --2- 172.21.15.60:0/901521030 >> v2:172.21.15.60:3300/0 conn(0x7f822013fbe0 0x7f82200b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f82177fe700 1 -- 172.21.15.60:0/901521030 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293497635 0 0) 0x7f822013d8a0 con 0x7f82200b0dc0 2020-10-31T22:49:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f82177fe700 1 -- 172.21.15.60:0/901521030 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f820c003230 con 0x7f82200b0dc0 2020-10-31T22:49:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f822514b700 1 --2- 172.21.15.60:0/901521030 >> v2:172.21.15.66:3300/0 conn(0x7f8220066430 0x7f82201437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:18.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8217fff700 1 -- 172.21.15.60:0/901521030 >> v2:172.21.15.66:3300/0 conn(0x7f8220066430 msgr2=0x7f82201437d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:18.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8217fff700 1 --2- 172.21.15.60:0/901521030 >> v2:172.21.15.66:3300/0 conn(0x7f8220066430 0x7f82201437d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8217fff700 1 -- 172.21.15.60:0/901521030 >> v1:172.21.15.60:6789/0 conn(0x7f82200b0dc0 legacy=0x7f822013d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:18.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8217fff700 1 -- 172.21.15.60:0/901521030 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8220066a60 con 0x7f822013fbe0 2020-10-31T22:49:18.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f822514b700 1 --2- 172.21.15.60:0/901521030 >> v2:172.21.15.66:3300/0 conn(0x7f8220066430 0x7f82201437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:49:18.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8217fff700 1 --2- 172.21.15.60:0/901521030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f822013fbe0 0x7f82200b2d50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f8210002f30 tx=0x7f8210006dc0).ready entity=mon.0 client_cookie=dd561a208a45a26b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:18.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f82177fe700 1 -- 172.21.15.60:0/901521030 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82100097b0 con 0x7f822013fbe0 2020-10-31T22:49:18.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f82177fe700 1 -- 172.21.15.60:0/901521030 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8210009910 con 0x7f822013fbe0 2020-10-31T22:49:18.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f82177fe700 1 -- 172.21.15.60:0/901521030 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8210009c70 con 0x7f822013fbe0 2020-10-31T22:49:18.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8226bae700 1 -- 172.21.15.60:0/901521030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f822013fbe0 msgr2=0x7f82200b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:18.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.601+0000 7f8226bae700 1 --2- 172.21.15.60:0/901521030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f822013fbe0 0x7f82200b2d50 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 rx=0x7f8210002f30 tx=0x7f8210006dc0).stop 2020-10-31T22:49:18.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8226bae700 1 -- 172.21.15.60:0/901521030 shutdown_connections 2020-10-31T22:49:18.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8226bae700 1 --2- 172.21.15.60:0/901521030 >> v2:172.21.15.66:3300/0 conn(0x7f8220066430 0x7f82201437d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8226bae700 1 --2- 172.21.15.60:0/901521030 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f822013fbe0 0x7f82200b2d50 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8226bae700 1 -- 172.21.15.60:0/901521030 >> 172.21.15.60:0/901521030 conn(0x7f822006a260 msgr2=0x7f8220063c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8226bae700 1 -- 172.21.15.60:0/901521030 shutdown_connections 2020-10-31T22:49:18.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8226bae700 1 -- 172.21.15.60:0/901521030 wait complete. 2020-10-31T22:49:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8226bae700 1 Processor -- start 2020-10-31T22:49:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8226bae700 1 -- start start 2020-10-31T22:49:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8226bae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8220066430 0x7f822013cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8226bae700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82200b0dc0 0x7f822014ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:18.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8226bae700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822013fbe0 0x7f822014ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8226bae700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822009ea20 con 0x7f8220066430 2020-10-31T22:49:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8226bae700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8220141390 con 0x7f822013fbe0 2020-10-31T22:49:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8226bae700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f822013ee10 con 0x7f82200b0dc0 2020-10-31T22:49:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f822494a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8220066430 0x7f822013cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f822494a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8220066430 0x7f822013cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47724/0 (socket says 172.21.15.60:47724) 2020-10-31T22:49:18.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f822494a700 1 -- 172.21.15.60:0/1680824701 learned_addr learned my addr 172.21.15.60:0/1680824701 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:18.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f8217fff700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82200b0dc0 0x7f822014ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:18.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.605+0000 7f822514b700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822013fbe0 0x7f822014ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:18.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f822494a700 1 -- 172.21.15.60:0/1680824701 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82200b0dc0 msgr2=0x7f822014ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:18.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f822494a700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82200b0dc0 0x7f822014ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f822494a700 1 -- 172.21.15.60:0/1680824701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822013fbe0 msgr2=0x7f822014ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:18.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f822494a700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822013fbe0 0x7f822014ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f822494a700 1 -- 172.21.15.60:0/1680824701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8220142e60 con 0x7f8220066430 2020-10-31T22:49:18.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f822514b700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822013fbe0 0x7f822014ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:18.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f822494a700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8220066430 0x7f822013cb00 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f821c001250 tx=0x7f821c0027e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:18.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f8215ffb700 1 -- 172.21.15.60:0/1680824701 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f821c0072e0 con 0x7f8220066430 2020-10-31T22:49:18.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f8215ffb700 1 -- 172.21.15.60:0/1680824701 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821c0054b0 con 0x7f8220066430 2020-10-31T22:49:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f8226bae700 1 -- 172.21.15.60:0/1680824701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82201415c0 con 0x7f8220066430 2020-10-31T22:49:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f8215ffb700 1 -- 172.21.15.60:0/1680824701 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f821c005810 con 0x7f8220066430 2020-10-31T22:49:18.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f8226bae700 1 -- 172.21.15.60:0/1680824701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8220142af0 con 0x7f8220066430 2020-10-31T22:49:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f8226bae700 1 -- 172.21.15.60:0/1680824701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8220057100 con 0x7f8220066430 2020-10-31T22:49:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f8215ffb700 1 -- 172.21.15.60:0/1680824701 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f821c010070 con 0x7f8220066430 2020-10-31T22:49:18.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f8215ffb700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8200054f90 0x7f8200057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f8215ffb700 1 -- 172.21.15.60:0/1680824701 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f821c06d0d0 con 0x7f8220066430 2020-10-31T22:49:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f8217fff700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8200054f90 0x7f8200057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.609+0000 7f8217fff700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8200054f90 0x7f8200057450 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f821001a000 tx=0x7f8210015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:18.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.617+0000 7f8215ffb700 1 -- 172.21.15.60:0/1680824701 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f821c0435f0 con 0x7f8220066430 2020-10-31T22:49:18.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.761+0000 7f8226bae700 1 -- 172.21.15.60:0/1680824701 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8220067130 con 0x7f8220066430 2020-10-31T22:49:18.770 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.765+0000 7f8215ffb700 1 -- 172.21.15.60:0/1680824701 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+33659 (secure 0 0 0) 0x7f821c046c10 con 0x7f8220066430 2020-10-31T22:49:18.771 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:18.771 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:49:18.771 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 110, 2020-10-31T22:49:18.772 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "226f905a-1517-4a8c-8009-08779515965c", 2020-10-31T22:49:18.772 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2020-10-31T22:40:51.928572+0000", 2020-10-31T22:49:18.772 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2020-10-31T22:49:04.923755+0000", 2020-10-31T22:49:18.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:49:18.772 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:49:18.773 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-10-31T22:49:18.773 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2020-10-31T22:49:18.773 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2020-10-31T22:49:18.773 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2020-10-31T22:49:18.773 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2020-10-31T22:49:18.773 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2020-10-31T22:49:18.774 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2020-10-31T22:49:18.774 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:49:18.774 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2020-10-31T22:49:18.774 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2020-10-31T22:49:18.774 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-10-31T22:49:18.774 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2020-10-31T22:49:18.774 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2020-10-31T22:49:18.775 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 20, 2020-10-31T22:49:18.775 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2020-10-31T22:49:18.775 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "jewel", 2020-10-31T22:49:18.775 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2020-10-31T22:49:18.775 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "octopus", 2020-10-31T22:49:18.775 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:49:18.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.776 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2020-10-31T22:49:18.776 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "device_health_metrics", 2020-10-31T22:49:18.776 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:40:55.846143+0000", 2020-10-31T22:49:18.776 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:49:18.776 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:49:18.776 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:49:18.776 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:49:18.776 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:49:18.777 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:49:18.777 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:49:18.777 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:49:18.777 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2020-10-31T22:49:18.777 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2020-10-31T22:49:18.777 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2020-10-31T22:49:18.778 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2020-10-31T22:49:18.778 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2020-10-31T22:49:18.778 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:49:18.778 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:49:18.778 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:49:18.778 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:49:18.779 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:49:18.779 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:49:18.779 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:49:18.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.779 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "15", 2020-10-31T22:49:18.779 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:49:18.779 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:49:18.780 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:49:18.780 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:49:18.780 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:49:18.780 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:49:18.780 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:49:18.780 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:49:18.780 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:49:18.780 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:49:18.781 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:49:18.781 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:49:18.781 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:49:18.781 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:49:18.781 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:49:18.781 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:49:18.781 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:49:18.782 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:49:18.782 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:49:18.782 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:49:18.782 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:49:18.782 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:49:18.782 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:49:18.782 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:49:18.783 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:49:18.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:49:18.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.783 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:49:18.783 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:49:18.783 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:49:18.783 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:49:18.783 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:49:18.784 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:49:18.784 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:49:18.784 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:49:18.784 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:49:18.784 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:49:18.784 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:49:18.784 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:49:18.785 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2020-10-31T22:49:18.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.785 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:49:18.785 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_devicehealth": {} 2020-10-31T22:49:18.785 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.786 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2020-10-31T22:49:18.786 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2020-10-31T22:49:18.786 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:05.358501+0000", 2020-10-31T22:49:18.786 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:49:18.786 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:49:18.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:49:18.786 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:49:18.787 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:49:18.787 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:49:18.787 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:49:18.787 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:49:18.787 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:49:18.787 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:49:18.787 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:49:18.787 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:49:18.788 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:49:18.788 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:49:18.788 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:49:18.788 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:49:18.788 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:49:18.788 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:49:18.788 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:49:18.789 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:49:18.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.789 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "18", 2020-10-31T22:49:18.789 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:49:18.789 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:49:18.789 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:49:18.789 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:49:18.790 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:49:18.790 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:49:18.790 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:49:18.790 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:49:18.790 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:49:18.790 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:49:18.790 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:49:18.791 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:49:18.791 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:49:18.791 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:49:18.791 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:49:18.791 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:49:18.791 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:49:18.791 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:49:18.792 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:49:18.792 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:49:18.792 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:49:18.792 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:49:18.792 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:49:18.792 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:49:18.792 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:49:18.793 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:49:18.793 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.793 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:49:18.793 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:49:18.793 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:49:18.793 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:49:18.793 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:49:18.793 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:49:18.794 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:49:18.794 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:49:18.794 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:49:18.794 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:49:18.794 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:49:18.794 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:49:18.795 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:49:18.795 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2020-10-31T22:49:18.795 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.795 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 19, 2020-10-31T22:49:18.795 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2020-10-31T22:49:18.795 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:49:01.432008+0000", 2020-10-31T22:49:18.796 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:49:18.796 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:49:18.796 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:49:18.796 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:49:18.796 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:49:18.796 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:49:18.796 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:49:18.797 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:49:18.797 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:49:18.797 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:49:18.797 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:49:18.797 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:49:18.797 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:49:18.797 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:49:18.797 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:49:18.798 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:49:18.798 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:49:18.798 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:49:18.798 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:49:18.798 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:49:18.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.799 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "109", 2020-10-31T22:49:18.799 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:49:18.799 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:49:18.799 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:49:18.799 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:49:18.799 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:49:18.799 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:49:18.800 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:49:18.800 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:49:18.800 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:49:18.800 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:49:18.800 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:49:18.800 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:49:18.800 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:49:18.801 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:49:18.801 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:49:18.801 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:49:18.801 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:49:18.801 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:49:18.801 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:49:18.801 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:49:18.802 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:49:18.802 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:49:18.802 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:49:18.802 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:49:18.802 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:49:18.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:49:18.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.803 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:49:18.803 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:49:18.803 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:49:18.803 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:49:18.803 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:49:18.803 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:49:18.803 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:49:18.803 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:49:18.804 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:49:18.804 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:49:18.804 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:49:18.804 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:49:18.804 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2020-10-31T22:49:18.804 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2020-10-31T22:49:18.804 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2020-10-31T22:49:18.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.805 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:49:18.805 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:49:18.805 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2020-10-31T22:49:18.805 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.805 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.806 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 20, 2020-10-31T22:49:18.806 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2020-10-31T22:49:18.806 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:49:02.732480+0000", 2020-10-31T22:49:18.806 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:49:18.806 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:49:18.806 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:49:18.807 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:49:18.807 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:49:18.807 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:49:18.807 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:49:18.807 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:49:18.807 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:49:18.807 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:49:18.808 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:49:18.808 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:49:18.808 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:49:18.808 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:49:18.808 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:49:18.808 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:49:18.808 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:49:18.809 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:49:18.809 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:49:18.809 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:49:18.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.809 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "110", 2020-10-31T22:49:18.809 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:49:18.810 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:49:18.810 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:49:18.810 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:49:18.810 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:49:18.810 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:49:18.810 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:49:18.810 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:49:18.811 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:49:18.811 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:49:18.811 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:49:18.811 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:49:18.811 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:49:18.811 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:49:18.812 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:49:18.812 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:49:18.812 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:49:18.812 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:49:18.812 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:49:18.812 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:49:18.812 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:49:18.813 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:49:18.813 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:49:18.813 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:49:18.813 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:49:18.813 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:49:18.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.813 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:49:18.813 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:49:18.814 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:49:18.814 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:49:18.814 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:49:18.814 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:49:18.814 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:49:18.814 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:49:18.814 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:49:18.815 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:49:18.815 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:49:18.815 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:49:18.815 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:49:18.815 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:49:18.815 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2020-10-31T22:49:18.815 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.816 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.816 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.816 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:49:18.816 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2020-10-31T22:49:18.816 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.816 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:49:18.816 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", 2020-10-31T22:49:18.817 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:49:18.817 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:49:18.817 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:49:18.817 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:49:18.817 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:49:18.818 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:49:18.818 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:49:18.818 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 108, 2020-10-31T22:49:18.818 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:49:18.819 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:49:18.819 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:49:18.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.819 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.820 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.820 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2020-10-31T22:49:18.820 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:49:18.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2020-10-31T22:49:18.821 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:49:18.822 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.822 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.822 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:49:18.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2020-10-31T22:49:18.824 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:49:18.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.824 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.824 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.825 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2020-10-31T22:49:18.825 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:49:18.825 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.825 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.826 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:49:18.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2020-10-31T22:49:18.827 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:49:18.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.828 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.828 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.829 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2020-10-31T22:49:18.829 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:49:18.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.829 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.830 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.830 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:49:18.830 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.831 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.831 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2020-10-31T22:49:18.831 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:49:18.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.832 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.832 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2020-10-31T22:49:18.833 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:49:18.833 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.833 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.834 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6803/14302", 2020-10-31T22:49:18.834 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6805/14302", 2020-10-31T22:49:18.834 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6809/14302", 2020-10-31T22:49:18.835 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6807/14302", 2020-10-31T22:49:18.835 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:49:18.835 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:49:18.835 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:49:18.836 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.836 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.836 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:49:18.837 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", 2020-10-31T22:49:18.837 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:49:18.837 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:49:18.838 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:49:18.838 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:49:18.838 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:49:18.838 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:49:18.839 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:49:18.839 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 108, 2020-10-31T22:49:18.839 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:49:18.840 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:49:18.840 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:49:18.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.841 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2020-10-31T22:49:18.841 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:49:18.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.842 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.842 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2020-10-31T22:49:18.843 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:49:18.843 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.843 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.844 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:49:18.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.845 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.845 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2020-10-31T22:49:18.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:49:18.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.846 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.846 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.846 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2020-10-31T22:49:18.847 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:49:18.847 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.847 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.848 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:49:18.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2020-10-31T22:49:18.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:49:18.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2020-10-31T22:49:18.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:49:18.851 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.851 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.851 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:49:18.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2020-10-31T22:49:18.853 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:49:18.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2020-10-31T22:49:18.853 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:49:18.854 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.854 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.854 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/14300", 2020-10-31T22:49:18.854 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6813/14300", 2020-10-31T22:49:18.855 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6817/14300", 2020-10-31T22:49:18.855 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6815/14300", 2020-10-31T22:49:18.855 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:49:18.855 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:49:18.855 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:49:18.855 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.856 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:49:18.856 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", 2020-10-31T22:49:18.856 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:49:18.857 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:49:18.857 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:49:18.857 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:49:18.857 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:49:18.857 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:49:18.857 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:49:18.858 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 106, 2020-10-31T22:49:18.858 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:49:18.858 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:49:18.858 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:49:18.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2020-10-31T22:49:18.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:49:18.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2020-10-31T22:49:18.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:49:18.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.860 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:49:18.860 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2020-10-31T22:49:18.861 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:49:18.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2020-10-31T22:49:18.861 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:49:18.861 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.862 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.862 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:49:18.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6832", 2020-10-31T22:49:18.863 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:49:18.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.863 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6833", 2020-10-31T22:49:18.863 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:49:18.863 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.864 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.864 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:49:18.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2020-10-31T22:49:18.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:49:18.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.865 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2020-10-31T22:49:18.865 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:49:18.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.865 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.866 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6827/14318", 2020-10-31T22:49:18.866 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6829/14318", 2020-10-31T22:49:18.866 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6833/14318", 2020-10-31T22:49:18.866 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6831/14318", 2020-10-31T22:49:18.866 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:49:18.866 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:49:18.867 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:49:18.867 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.867 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:49:18.867 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", 2020-10-31T22:49:18.867 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:49:18.867 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:49:18.868 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:49:18.868 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:49:18.868 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:49:18.868 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:49:18.868 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:49:18.868 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 108, 2020-10-31T22:49:18.868 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:49:18.869 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:49:18.869 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:49:18.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2020-10-31T22:49:18.870 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:49:18.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2020-10-31T22:49:18.871 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:49:18.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.871 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.871 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:49:18.872 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.872 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.872 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2020-10-31T22:49:18.872 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:49:18.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.873 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.873 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2020-10-31T22:49:18.873 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:49:18.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.874 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.874 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:49:18.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2020-10-31T22:49:18.876 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:49:18.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.876 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.876 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.877 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2020-10-31T22:49:18.877 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:49:18.877 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.877 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.878 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:49:18.878 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.878 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2020-10-31T22:49:18.879 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:49:18.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2020-10-31T22:49:18.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:49:18.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.881 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.881 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6819/14301", 2020-10-31T22:49:18.881 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6821/14301", 2020-10-31T22:49:18.881 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/14301", 2020-10-31T22:49:18.881 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6823/14301", 2020-10-31T22:49:18.881 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:49:18.882 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:49:18.882 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:49:18.882 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.882 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:49:18.883 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", 2020-10-31T22:49:18.883 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:49:18.883 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:49:18.883 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:49:18.883 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:49:18.883 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:49:18.883 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:49:18.884 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:49:18.884 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 106, 2020-10-31T22:49:18.884 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:49:18.884 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:49:18.884 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:49:18.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.885 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6816", 2020-10-31T22:49:18.885 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:49:18.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.885 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6817", 2020-10-31T22:49:18.885 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:49:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:49:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.886 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6818", 2020-10-31T22:49:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:49:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6819", 2020-10-31T22:49:18.887 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:49:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:49:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.889 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6822", 2020-10-31T22:49:18.889 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:49:18.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6823", 2020-10-31T22:49:18.890 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:49:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.891 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:49:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.892 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6820", 2020-10-31T22:49:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:49:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.893 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6821", 2020-10-31T22:49:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:49:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6817/14002", 2020-10-31T22:49:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6819/14002", 2020-10-31T22:49:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6823/14002", 2020-10-31T22:49:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6821/14002", 2020-10-31T22:49:18.895 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:49:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:49:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:49:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.897 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:49:18.897 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", 2020-10-31T22:49:18.897 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:49:18.897 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:49:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:49:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:49:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:49:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:49:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:49:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 106, 2020-10-31T22:49:18.898 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:49:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:49:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:49:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6800", 2020-10-31T22:49:18.899 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:49:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6801", 2020-10-31T22:49:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:49:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.900 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:49:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6802", 2020-10-31T22:49:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:49:18.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6803", 2020-10-31T22:49:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:49:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:49:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6806", 2020-10-31T22:49:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:49:18.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6807", 2020-10-31T22:49:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:49:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:49:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.905 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6804", 2020-10-31T22:49:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:49:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6805", 2020-10-31T22:49:18.906 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:49:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.907 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6801/14001", 2020-10-31T22:49:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6803/14001", 2020-10-31T22:49:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6807/14001", 2020-10-31T22:49:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6805/14001", 2020-10-31T22:49:18.908 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:49:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:49:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:49:18.909 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:49:18.910 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", 2020-10-31T22:49:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:49:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:49:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:49:18.911 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:49:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:49:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:49:18.912 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:49:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 108, 2020-10-31T22:49:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:49:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:49:18.913 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:49:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6808", 2020-10-31T22:49:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:49:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6809", 2020-10-31T22:49:18.916 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:49:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.917 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:49:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.918 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6810", 2020-10-31T22:49:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:49:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6811", 2020-10-31T22:49:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:49:18.919 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:49:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.920 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6814", 2020-10-31T22:49:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:49:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6815", 2020-10-31T22:49:18.921 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:49:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:49:18.922 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.923 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6812", 2020-10-31T22:49:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:49:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.924 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6813", 2020-10-31T22:49:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:49:18.925 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6809/14003", 2020-10-31T22:49:18.926 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6811/14003", 2020-10-31T22:49:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6815/14003", 2020-10-31T22:49:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6813/14003", 2020-10-31T22:49:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:49:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:49:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:49:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:49:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", 2020-10-31T22:49:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:49:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:49:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:49:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:49:18.928 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:49:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:49:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:49:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 108, 2020-10-31T22:49:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:49:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:49:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:49:18.929 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6824", 2020-10-31T22:49:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:49:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.930 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6825", 2020-10-31T22:49:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:49:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:49:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.931 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6826", 2020-10-31T22:49:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:49:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6827", 2020-10-31T22:49:18.932 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:49:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:49:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.933 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6830", 2020-10-31T22:49:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:49:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6831", 2020-10-31T22:49:18.934 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:49:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:49:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:49:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:49:18.935 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6828", 2020-10-31T22:49:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:49:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:49:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6829", 2020-10-31T22:49:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:49:18.936 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6825/14046", 2020-10-31T22:49:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6827/14046", 2020-10-31T22:49:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6831/14046", 2020-10-31T22:49:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6829/14046", 2020-10-31T22:49:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:49:18.937 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:49:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:49:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:49:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2020-10-31T22:49:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:49:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:49:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:49:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:49:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:49:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:49:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.314917+0000", 2020-10-31T22:49:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:49:18.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:49:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:49:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:49:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:49:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:49:18.940 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:49:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.643069+0000", 2020-10-31T22:49:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:49:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:49:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:49:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:49:18.941 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:49:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:49:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:49:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.662572+0000", 2020-10-31T22:49:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:49:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.942 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:49:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:49:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:49:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:49:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:49:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:49:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.664868+0000", 2020-10-31T22:49:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:49:18.943 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:49:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:49:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:49:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:49:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:49:18.944 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:49:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551107+0000", 2020-10-31T22:49:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:49:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:49:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:49:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:49:18.945 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:49:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:49:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:49:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.400568+0000", 2020-10-31T22:49:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:49:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.946 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:49:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:49:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:49:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:49:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:49:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:49:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551173+0000", 2020-10-31T22:49:18.947 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:49:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:49:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:49:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:49:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:49:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:49:18.948 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:49:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.604302+0000", 2020-10-31T22:49:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:49:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:49:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2020-10-31T22:49:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2020-10-31T22:49:18.949 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2020-10-31T22:49:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2020-10-31T22:49:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: "blacklist": {}, 2020-10-31T22:49:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2020-10-31T22:49:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2020-10-31T22:49:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2020-10-31T22:49:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2020-10-31T22:49:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2020-10-31T22:49:18.950 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2020-10-31T22:49:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "ruleset-failure-domain": "osd", 2020-10-31T22:49:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2020-10-31T22:49:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2020-10-31T22:49:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2020-10-31T22:49:18.951 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2020-10-31T22:49:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2020-10-31T22:49:18.952 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {} 2020-10-31T22:49:18.952 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:49:18.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.765+0000 7f8226bae700 1 -- 172.21.15.60:0/1680824701 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8200054f90 msgr2=0x7f8200057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:18.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.765+0000 7f8226bae700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8200054f90 0x7f8200057450 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f821001a000 tx=0x7f8210015000).stop 2020-10-31T22:49:18.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.765+0000 7f8226bae700 1 -- 172.21.15.60:0/1680824701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8220066430 msgr2=0x7f822013cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:18.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.765+0000 7f8226bae700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8220066430 0x7f822013cb00 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 rx=0x7f821c001250 tx=0x7f821c0027e0).stop 2020-10-31T22:49:18.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.765+0000 7f8226bae700 1 -- 172.21.15.60:0/1680824701 shutdown_connections 2020-10-31T22:49:18.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.765+0000 7f8226bae700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8200054f90 0x7f8200057450 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.765+0000 7f8226bae700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f822013fbe0 0x7f822014ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.765+0000 7f8226bae700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8220066430 0x7f822013cb00 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.765+0000 7f8226bae700 1 --2- 172.21.15.60:0/1680824701 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f82200b0dc0 0x7f822014ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:18.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.765+0000 7f8226bae700 1 -- 172.21.15.60:0/1680824701 >> 172.21.15.60:0/1680824701 conn(0x7f822006a260 msgr2=0x7f82200b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:18.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.765+0000 7f8226bae700 1 -- 172.21.15.60:0/1680824701 shutdown_connections 2020-10-31T22:49:18.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:18.765+0000 7f8226bae700 1 -- 172.21.15.60:0/1680824701 wait complete. 2020-10-31T22:49:18.956 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:49:19.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52f5bbe700 1 Processor -- start 2020-10-31T22:49:19.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52f5bbe700 1 -- start start 2020-10-31T22:49:19.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52f5bbe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52f00b5440 0x7f52f00af420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52f5bbe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f52f00b0db0 0x7f52f00af910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52f5bbe700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52f00a8320 con 0x7f52f006a260 2020-10-31T22:49:19.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52f5bbe700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52f00afe00 con 0x7f52f00b0db0 2020-10-31T22:49:19.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52f5bbe700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f00b5820 con 0x7f52f00b5440 2020-10-31T22:49:19.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52effff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f52f006a260 0x7f52f0141bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51872/0 (socket says 172.21.15.60:51872) 2020-10-31T22:49:19.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52effff700 1 -- 172.21.15.60:0/3642066721 learned_addr learned my addr 172.21.15.60:0/3642066721 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:19.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52e6ffd700 1 --2- 172.21.15.60:0/3642066721 >> v2:172.21.15.66:3300/0 conn(0x7f52f00b0db0 0x7f52f00af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52ef7fe700 1 --2- 172.21.15.60:0/3642066721 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52f00b5440 0x7f52f00af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52eeffd700 1 -- 172.21.15.60:0/3642066721 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 865183216 0 0) 0x7f52f00a8320 con 0x7f52f006a260 2020-10-31T22:49:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52eeffd700 1 -- 172.21.15.60:0/3642066721 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52d0003230 con 0x7f52f006a260 2020-10-31T22:49:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52ef7fe700 1 -- 172.21.15.60:0/3642066721 >> v2:172.21.15.66:3300/0 conn(0x7f52f00b0db0 msgr2=0x7f52f00af910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52ef7fe700 1 --2- 172.21.15.60:0/3642066721 >> v2:172.21.15.66:3300/0 conn(0x7f52f00b0db0 0x7f52f00af910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52ef7fe700 1 -- 172.21.15.60:0/3642066721 >> v1:172.21.15.60:6789/0 conn(0x7f52f006a260 legacy=0x7f52f0141bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:19.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52ef7fe700 1 -- 172.21.15.60:0/3642066721 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f00ad870 con 0x7f52f00b5440 2020-10-31T22:49:19.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52e6ffd700 1 --2- 172.21.15.60:0/3642066721 >> v2:172.21.15.66:3300/0 conn(0x7f52f00b0db0 0x7f52f00af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:19.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52ef7fe700 1 --2- 172.21.15.60:0/3642066721 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52f00b5440 0x7f52f00af420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f52e0002f30 tx=0x7f52e0006dc0).ready entity=mon.2 client_cookie=ad5f848cfe7336c9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:19.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52eeffd700 1 -- 172.21.15.60:0/3642066721 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52e00096a0 con 0x7f52f00b5440 2020-10-31T22:49:19.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52eeffd700 1 -- 172.21.15.60:0/3642066721 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e0009800 con 0x7f52f00b5440 2020-10-31T22:49:19.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52eeffd700 1 -- 172.21.15.60:0/3642066721 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52e0009b60 con 0x7f52f00b5440 2020-10-31T22:49:19.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52f5bbe700 1 -- 172.21.15.60:0/3642066721 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52f00b5440 msgr2=0x7f52f00af420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:19.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.073+0000 7f52f5bbe700 1 --2- 172.21.15.60:0/3642066721 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52f00b5440 0x7f52f00af420 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f52e0002f30 tx=0x7f52e0006dc0).stop 2020-10-31T22:49:19.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.077+0000 7f52f5bbe700 1 -- 172.21.15.60:0/3642066721 shutdown_connections 2020-10-31T22:49:19.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.077+0000 7f52f5bbe700 1 --2- 172.21.15.60:0/3642066721 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52f00b5440 0x7f52f00af420 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.077+0000 7f52f5bbe700 1 --2- 172.21.15.60:0/3642066721 >> v2:172.21.15.66:3300/0 conn(0x7f52f00b0db0 0x7f52f00af910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.077+0000 7f52f5bbe700 1 -- 172.21.15.60:0/3642066721 >> 172.21.15.60:0/3642066721 conn(0x7f52f0060c10 msgr2=0x7f52f00b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:19.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.077+0000 7f52f5bbe700 1 -- 172.21.15.60:0/3642066721 shutdown_connections 2020-10-31T22:49:19.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.077+0000 7f52f5bbe700 1 -- 172.21.15.60:0/3642066721 wait complete. 2020-10-31T22:49:19.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.077+0000 7f52f5bbe700 1 Processor -- start 2020-10-31T22:49:19.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.077+0000 7f52f5bbe700 1 -- start start 2020-10-31T22:49:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52f5bbe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52f006a260 0x7f52f005b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52f5bbe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f00b0db0 0x7f52f00665d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52f5bbe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52f00b5440 0x7f52f013d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52f5bbe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0065c60 con 0x7f52f00b0db0 2020-10-31T22:49:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52f5bbe700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0066d70 con 0x7f52f006a260 2020-10-31T22:49:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52f5bbe700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52f0065e90 con 0x7f52f00b5440 2020-10-31T22:49:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52e6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f00b0db0 0x7f52f00665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52ef7fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52f006a260 0x7f52f005b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52e6ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f00b0db0 0x7f52f00665d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47740/0 (socket says 172.21.15.60:47740) 2020-10-31T22:49:19.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52e6ffd700 1 -- 172.21.15.60:0/1333501375 learned_addr learned my addr 172.21.15.60:0/1333501375 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:19.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52effff700 1 --2- 172.21.15.60:0/1333501375 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52f00b5440 0x7f52f013d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52e6ffd700 1 -- 172.21.15.60:0/1333501375 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52f00b5440 msgr2=0x7f52f013d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:19.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52e6ffd700 1 --2- 172.21.15.60:0/1333501375 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52f00b5440 0x7f52f013d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52e6ffd700 1 -- 172.21.15.60:0/1333501375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52f006a260 msgr2=0x7f52f005b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:19.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52e6ffd700 1 --2- 172.21.15.60:0/1333501375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52f006a260 0x7f52f005b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52e6ffd700 1 -- 172.21.15.60:0/1333501375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f0066130 con 0x7f52f00b0db0 2020-10-31T22:49:19.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52e6ffd700 1 --2- 172.21.15.60:0/1333501375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f00b0db0 0x7f52f00665d0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f52d800c000 tx=0x7f52d8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:19.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52ed7fa700 1 -- 172.21.15.60:0/1333501375 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d800cb40 con 0x7f52f00b0db0 2020-10-31T22:49:19.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52ed7fa700 1 -- 172.21.15.60:0/1333501375 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52d800cca0 con 0x7f52f00b0db0 2020-10-31T22:49:19.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52f5bbe700 1 -- 172.21.15.60:0/1333501375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52f0067010 con 0x7f52f00b0db0 2020-10-31T22:49:19.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52ed7fa700 1 -- 172.21.15.60:0/1333501375 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52d80123f0 con 0x7f52f00b0db0 2020-10-31T22:49:19.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.081+0000 7f52f5bbe700 1 -- 172.21.15.60:0/1333501375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52f0140800 con 0x7f52f00b0db0 2020-10-31T22:49:19.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.085+0000 7f52f5bbe700 1 -- 172.21.15.60:0/1333501375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52f0057100 con 0x7f52f00b0db0 2020-10-31T22:49:19.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.085+0000 7f52ed7fa700 1 -- 172.21.15.60:0/1333501375 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f52d8012550 con 0x7f52f00b0db0 2020-10-31T22:49:19.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.085+0000 7f52ed7fa700 1 --2- 172.21.15.60:0/1333501375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f52d4054f10 0x7f52d40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.085+0000 7f52ed7fa700 1 -- 172.21.15.60:0/1333501375 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f52d806e000 con 0x7f52f00b0db0 2020-10-31T22:49:19.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.085+0000 7f52ef7fe700 1 --2- 172.21.15.60:0/1333501375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f52d4054f10 0x7f52d40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.085+0000 7f52ef7fe700 1 --2- 172.21.15.60:0/1333501375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f52d4054f10 0x7f52d40573d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f52e001b000 tx=0x7f52e0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:19.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.093+0000 7f52ed7fa700 1 -- 172.21.15.60:0/1333501375 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f52d80444c0 con 0x7f52f00b0db0 2020-10-31T22:49:19.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.277+0000 7f52f5bbe700 1 -- 172.21.15.60:0/1333501375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52f005c990 con 0x7f52f00b0db0 2020-10-31T22:49:19.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.277+0000 7f52ed7fa700 1 -- 172.21.15.60:0/1333501375 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+2493 (secure 0 0 0) 0x7f52d8047ae0 con 0x7f52f00b0db0 2020-10-31T22:49:19.285 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:19.285 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":53,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1212236578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1212236578},{"type":"v1","addr":"172.21.15.60:6835","nonce":1212236578}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3130935285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3130935285},{"type":"v1","addr":"172.21.15.66:6833","nonce":3130935285}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:49:03.919960+0000","modified":"2020-10-31T22:49:04.922872+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7173},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7173":{"gid":7173,"name":"c","rank":0,"incarnation":52,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/1399264415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1399264415},{"type":"v1","addr":"172.21.15.60:6837","nonce":1399264415}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-10-31T22:49:19.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.281+0000 7f52f5bbe700 1 -- 172.21.15.60:0/1333501375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f52d4054f10 msgr2=0x7f52d40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.281+0000 7f52f5bbe700 1 --2- 172.21.15.60:0/1333501375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f52d4054f10 0x7f52d40573d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f52e001b000 tx=0x7f52e0015000).stop 2020-10-31T22:49:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.281+0000 7f52f5bbe700 1 -- 172.21.15.60:0/1333501375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f00b0db0 msgr2=0x7f52f00665d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.281+0000 7f52f5bbe700 1 --2- 172.21.15.60:0/1333501375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f00b0db0 0x7f52f00665d0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 rx=0x7f52d800c000 tx=0x7f52d8006dc0).stop 2020-10-31T22:49:19.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.281+0000 7f52f5bbe700 1 -- 172.21.15.60:0/1333501375 shutdown_connections 2020-10-31T22:49:19.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.281+0000 7f52f5bbe700 1 --2- 172.21.15.60:0/1333501375 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52f00b5440 0x7f52f013d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.281+0000 7f52f5bbe700 1 --2- 172.21.15.60:0/1333501375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f52d4054f10 0x7f52d40573d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.281+0000 7f52f5bbe700 1 --2- 172.21.15.60:0/1333501375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52f006a260 0x7f52f005b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.281+0000 7f52f5bbe700 1 --2- 172.21.15.60:0/1333501375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52f00b0db0 0x7f52f00665d0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.281+0000 7f52f5bbe700 1 -- 172.21.15.60:0/1333501375 >> 172.21.15.60:0/1333501375 conn(0x7f52f0060c10 msgr2=0x7f52f00b4980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:19.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.281+0000 7f52f5bbe700 1 -- 172.21.15.60:0/1333501375 shutdown_connections 2020-10-31T22:49:19.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.281+0000 7f52f5bbe700 1 -- 172.21.15.60:0/1333501375 wait complete. 2020-10-31T22:49:19.295 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 53 2020-10-31T22:49:19.304 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-10-31T22:49:19.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9b41700 1 Processor -- start 2020-10-31T22:49:19.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9b41700 1 -- start start 2020-10-31T22:49:19.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9b41700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdbe40b5570 0x7fdbe40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9b41700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbe4141fe0 0x7fdbe4142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9b41700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe4145180 con 0x7fdbe40b24a0 2020-10-31T22:49:19.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9b41700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe40afae0 con 0x7fdbe40b5570 2020-10-31T22:49:19.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9b41700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe4141bf0 con 0x7fdbe4141fe0 2020-10-31T22:49:19.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe3fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdbe40b24a0 0x7fdbe4145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51884/0 (socket says 172.21.15.60:51884) 2020-10-31T22:49:19.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe3fff700 1 -- 172.21.15.60:0/3752683655 learned_addr learned my addr 172.21.15.60:0/3752683655 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:19.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe8b3f700 1 --2- 172.21.15.60:0/3752683655 >> v2:172.21.15.66:3300/0 conn(0x7fdbe40b5570 0x7fdbe40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9340700 1 --2- 172.21.15.60:0/3752683655 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbe4141fe0 0x7fdbe4142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 -- 172.21.15.60:0/3752683655 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3595034152 0 0) 0x7fdbe4145180 con 0x7fdbe40b24a0 2020-10-31T22:49:19.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 -- 172.21.15.60:0/3752683655 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc8003230 con 0x7fdbe40b24a0 2020-10-31T22:49:19.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 -- 172.21.15.60:0/3752683655 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1975531082 0 0) 0x7fdbc8003230 con 0x7fdbe40b24a0 2020-10-31T22:49:19.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 -- 172.21.15.60:0/3752683655 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbe4141fe0 msgr2=0x7fdbe4142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:19.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 --2- 172.21.15.60:0/3752683655 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbe4141fe0 0x7fdbe4142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 -- 172.21.15.60:0/3752683655 >> v2:172.21.15.66:3300/0 conn(0x7fdbe40b5570 msgr2=0x7fdbe40b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:19.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 --2- 172.21.15.60:0/3752683655 >> v2:172.21.15.66:3300/0 conn(0x7fdbe40b5570 0x7fdbe40b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 -- 172.21.15.60:0/3752683655 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe40b0670 con 0x7fdbe40b24a0 2020-10-31T22:49:19.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 -- 172.21.15.60:0/3752683655 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fdbdc0016d0 con 0x7fdbe40b24a0 2020-10-31T22:49:19.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 -- 172.21.15.60:0/3752683655 >> v1:172.21.15.60:6789/0 conn(0x7fdbe40b24a0 legacy=0x7fdbe4145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:19.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 --2- 172.21.15.60:0/3752683655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbc8003720 0x7fdbc8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 --2- 172.21.15.60:0/3752683655 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbe4141fe0 0x7fdbc80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 --2- 172.21.15.60:0/3752683655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbc80049c0 0x7fdbc8004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 -- 172.21.15.60:0/3752683655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe40afae0 con 0x7fdbc80049c0 2020-10-31T22:49:19.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 -- 172.21.15.60:0/3752683655 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80041c0 con 0x7fdbc8003720 2020-10-31T22:49:19.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe37fe700 1 -- 172.21.15.60:0/3752683655 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc800b720 con 0x7fdbe4141fe0 2020-10-31T22:49:19.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9340700 1 --2- 172.21.15.60:0/3752683655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbc80049c0 0x7fdbc8004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe8b3f700 1 --2- 172.21.15.60:0/3752683655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbc8003720 0x7fdbc8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe3fff700 1 --2- 172.21.15.60:0/3752683655 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbe4141fe0 0x7fdbc80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9340700 1 -- 172.21.15.60:0/3752683655 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbe4141fe0 msgr2=0x7fdbc80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:19.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9340700 1 --2- 172.21.15.60:0/3752683655 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbe4141fe0 0x7fdbc80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9340700 1 -- 172.21.15.60:0/3752683655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbc8003720 msgr2=0x7fdbc8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:19.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9340700 1 --2- 172.21.15.60:0/3752683655 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbc8003720 0x7fdbc8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9340700 1 -- 172.21.15.60:0/3752683655 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8003230 con 0x7fdbc80049c0 2020-10-31T22:49:19.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.417+0000 7fdbe9340700 1 --2- 172.21.15.60:0/3752683655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbc80049c0 0x7fdbc8004e40 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7fdbd400c000 tx=0x7fdbd40091a0).ready entity=mon.0 client_cookie=81c72cefef93dc64 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:19.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe37fe700 1 -- 172.21.15.60:0/3752683655 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbd400ec30 con 0x7fdbc80049c0 2020-10-31T22:49:19.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe37fe700 1 -- 172.21.15.60:0/3752683655 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd400ed90 con 0x7fdbc80049c0 2020-10-31T22:49:19.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe37fe700 1 -- 172.21.15.60:0/3752683655 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbd40125e0 con 0x7fdbc80049c0 2020-10-31T22:49:19.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 -- 172.21.15.60:0/3752683655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbc80049c0 msgr2=0x7fdbc8004e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:19.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 --2- 172.21.15.60:0/3752683655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbc80049c0 0x7fdbc8004e40 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 rx=0x7fdbd400c000 tx=0x7fdbd40091a0).stop 2020-10-31T22:49:19.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9340700 1 -- 172.21.15.60:0/3752683655 reap_dead start 2020-10-31T22:49:19.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 -- 172.21.15.60:0/3752683655 shutdown_connections 2020-10-31T22:49:19.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 -- 172.21.15.60:0/3752683655 >> 172.21.15.60:0/3752683655 conn(0x7fdbe40b8e90 msgr2=0x7fdbe40b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:19.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 -- 172.21.15.60:0/3752683655 shutdown_connections 2020-10-31T22:49:19.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 -- 172.21.15.60:0/3752683655 wait complete. 2020-10-31T22:49:19.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 Processor -- start 2020-10-31T22:49:19.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 -- start start 2020-10-31T22:49:19.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbe413c880 0x7fdbe40b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbe409e7c0 0x7fdbe40b7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbe4144c40 0x7fdbe40ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe413cc60 con 0x7fdbe4144c40 2020-10-31T22:49:19.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe409ecd0 con 0x7fdbe409e7c0 2020-10-31T22:49:19.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe409ef70 con 0x7fdbe413c880 2020-10-31T22:49:19.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9340700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbe4144c40 0x7fdbe40ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9340700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbe4144c40 0x7fdbe40ae7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47762/0 (socket says 172.21.15.60:47762) 2020-10-31T22:49:19.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9340700 1 -- 172.21.15.60:0/1060887060 learned_addr learned my addr 172.21.15.60:0/1060887060 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:19.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe3fff700 1 --2- 172.21.15.60:0/1060887060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbe409e7c0 0x7fdbe40b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe8b3f700 1 --2- 172.21.15.60:0/1060887060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbe413c880 0x7fdbe40b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9340700 1 -- 172.21.15.60:0/1060887060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbe413c880 msgr2=0x7fdbe40b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:19.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9340700 1 --2- 172.21.15.60:0/1060887060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbe413c880 0x7fdbe40b6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9340700 1 -- 172.21.15.60:0/1060887060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbe409e7c0 msgr2=0x7fdbe40b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:19.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9340700 1 --2- 172.21.15.60:0/1060887060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbe409e7c0 0x7fdbe40b7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:19.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9340700 1 -- 172.21.15.60:0/1060887060 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe40b6980 con 0x7fdbe4144c40 2020-10-31T22:49:19.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9340700 1 --2- 172.21.15.60:0/1060887060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbe4144c40 0x7fdbe40ae7e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7fdbe40b01d0 tx=0x7fdbd401a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:19.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe1ffb700 1 -- 172.21.15.60:0/1060887060 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbd40127f0 con 0x7fdbe4144c40 2020-10-31T22:49:19.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe1ffb700 1 -- 172.21.15.60:0/1060887060 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd40095b0 con 0x7fdbe4144c40 2020-10-31T22:49:19.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 -- 172.21.15.60:0/1060887060 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe409f210 con 0x7fdbe4144c40 2020-10-31T22:49:19.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe1ffb700 1 -- 172.21.15.60:0/1060887060 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdbd4012b40 con 0x7fdbe4144c40 2020-10-31T22:49:19.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.421+0000 7fdbe9b41700 1 -- 172.21.15.60:0/1060887060 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe4150540 con 0x7fdbe4144c40 2020-10-31T22:49:19.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.425+0000 7fdbe9b41700 1 -- 172.21.15.60:0/1060887060 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe4057100 con 0x7fdbe4144c40 2020-10-31T22:49:19.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.425+0000 7fdbe1ffb700 1 -- 172.21.15.60:0/1060887060 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fdbd4012ca0 con 0x7fdbe4144c40 2020-10-31T22:49:19.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.425+0000 7fdbe1ffb700 1 --2- 172.21.15.60:0/1060887060 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdbbc055020 0x7fdbbc0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:19.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.425+0000 7fdbe1ffb700 1 -- 172.21.15.60:0/1060887060 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdbd406fa70 con 0x7fdbe4144c40 2020-10-31T22:49:19.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.425+0000 7fdbe8b3f700 1 --2- 172.21.15.60:0/1060887060 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdbbc055020 0x7fdbbc0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:19.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.425+0000 7fdbe8b3f700 1 --2- 172.21.15.60:0/1060887060 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdbbc055020 0x7fdbbc0574e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fdbcc008000 tx=0x7fdbcc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:19.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.433+0000 7fdbe1ffb700 1 -- 172.21.15.60:0/1060887060 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdbd4045fd0 con 0x7fdbe4144c40 2020-10-31T22:49:19.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:19.625+0000 7fdbe9b41700 1 -- 172.21.15.60:0/1060887060 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdbe405a8e0 con 0x7fdbe4144c40 2020-10-31T22:49:20.017 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:49:20.009+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:49:20.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.025+0000 7fdbe1ffb700 1 -- 172.21.15.60:0/1060887060 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdbd406fe60 con 0x7fdbe4144c40 2020-10-31T22:49:20.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.029+0000 7fdbe9b41700 1 -- 172.21.15.60:0/1060887060 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdbbc055020 msgr2=0x7fdbbc0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:20.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.029+0000 7fdbe9b41700 1 --2- 172.21.15.60:0/1060887060 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdbbc055020 0x7fdbbc0574e0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7fdbcc008000 tx=0x7fdbcc008040).stop 2020-10-31T22:49:20.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.029+0000 7fdbe9b41700 1 -- 172.21.15.60:0/1060887060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbe4144c40 msgr2=0x7fdbe40ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:20.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.029+0000 7fdbe9b41700 1 --2- 172.21.15.60:0/1060887060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbe4144c40 0x7fdbe40ae7e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 rx=0x7fdbe40b01d0 tx=0x7fdbd401a000).stop 2020-10-31T22:49:20.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.029+0000 7fdbe9b41700 1 -- 172.21.15.60:0/1060887060 shutdown_connections 2020-10-31T22:49:20.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.029+0000 7fdbe9b41700 1 --2- 172.21.15.60:0/1060887060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdbe4144c40 0x7fdbe40ae7e0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.029+0000 7fdbe9b41700 1 --2- 172.21.15.60:0/1060887060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdbe413c880 0x7fdbe40b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.029+0000 7fdbe9b41700 1 --2- 172.21.15.60:0/1060887060 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdbbc055020 0x7fdbbc0574e0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.029+0000 7fdbe9b41700 1 --2- 172.21.15.60:0/1060887060 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdbe409e7c0 0x7fdbe40b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.029+0000 7fdbe9b41700 1 -- 172.21.15.60:0/1060887060 >> 172.21.15.60:0/1060887060 conn(0x7fdbe40b8e90 msgr2=0x7fdbe40b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:20.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.029+0000 7fdbe9b41700 1 -- 172.21.15.60:0/1060887060 shutdown_connections 2020-10-31T22:49:20.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.029+0000 7fdbe9b41700 1 -- 172.21.15.60:0/1060887060 wait complete. 2020-10-31T22:49:20.037 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-10-31T22:49:20.054 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:49:20.060 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:49:20.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b18a0d700 1 Processor -- start 2020-10-31T22:49:20.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b18a0d700 1 -- start start 2020-10-31T22:49:20.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b18a0d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b140ac990 0x7f5b1413ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:20.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b18a0d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5b140ae030 0x7f5b140a7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b18a0d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b1405bf90 con 0x7f5b1405bbb0 2020-10-31T22:49:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b18a0d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b140ab410 con 0x7f5b140ae030 2020-10-31T22:49:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b18a0d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b140ab600 con 0x7f5b140ac990 2020-10-31T22:49:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b13fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5b140ae030 0x7f5b140a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b137fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5b1405bbb0 0x7f5b140ac280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51914/0 (socket says 172.21.15.60:51914) 2020-10-31T22:49:20.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b13fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5b140ae030 0x7f5b140a7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47780/0 (socket says 172.21.15.60:47780) 2020-10-31T22:49:20.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b137fe700 1 -- 172.21.15.60:0/2317252473 learned_addr learned my addr 172.21.15.60:0/2317252473 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:20.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b0affd700 1 --2- 172.21.15.60:0/2317252473 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b140ac990 0x7f5b1413ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:20.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b13fff700 1 -- 172.21.15.60:0/2317252473 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b140ac990 msgr2=0x7f5b1413ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:20.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b13fff700 1 --2- 172.21.15.60:0/2317252473 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b140ac990 0x7f5b1413ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b13fff700 1 -- 172.21.15.60:0/2317252473 >> v1:172.21.15.60:6789/0 conn(0x7f5b1405bbb0 legacy=0x7f5b140ac280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:20.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b13fff700 1 -- 172.21.15.60:0/2317252473 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b140ab8a0 con 0x7f5b140ae030 2020-10-31T22:49:20.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.161+0000 7f5b0affd700 1 --2- 172.21.15.60:0/2317252473 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b140ac990 0x7f5b1413ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:20.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.165+0000 7f5b13fff700 1 --2- 172.21.15.60:0/2317252473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b140ae030 0x7f5b140a7150 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f5b0c0032b0 tx=0x7f5b0c0091a0).ready entity=mon.0 client_cookie=d0a2eb6ead94fff0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:20.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.165+0000 7f5b12ffd700 1 -- 172.21.15.60:0/2317252473 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b0c00bae0 con 0x7f5b140ae030 2020-10-31T22:49:20.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.165+0000 7f5b12ffd700 1 -- 172.21.15.60:0/2317252473 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0c00bc40 con 0x7f5b140ae030 2020-10-31T22:49:20.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.165+0000 7f5b12ffd700 1 -- 172.21.15.60:0/2317252473 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5b0c00bdb0 con 0x7f5b140ae030 2020-10-31T22:49:20.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.165+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2317252473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b140ae030 msgr2=0x7f5b140a7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:20.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.165+0000 7f5b18a0d700 1 --2- 172.21.15.60:0/2317252473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b140ae030 0x7f5b140a7150 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 rx=0x7f5b0c0032b0 tx=0x7f5b0c0091a0).stop 2020-10-31T22:49:20.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.165+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2317252473 shutdown_connections 2020-10-31T22:49:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.165+0000 7f5b18a0d700 1 --2- 172.21.15.60:0/2317252473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b140ae030 0x7f5b140a7150 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.165+0000 7f5b18a0d700 1 --2- 172.21.15.60:0/2317252473 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b140ac990 0x7f5b1413ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.165+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2317252473 >> 172.21.15.60:0/2317252473 conn(0x7f5b140b3fd0 msgr2=0x7f5b140b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.165+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2317252473 shutdown_connections 2020-10-31T22:49:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.165+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2317252473 wait complete. 2020-10-31T22:49:20.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b18a0d700 1 Processor -- start 2020-10-31T22:49:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b18a0d700 1 -- start start 2020-10-31T22:49:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b18a0d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b1405bbb0 0x7f5b14063980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b18a0d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b140ac990 0x7f5b140a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b18a0d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b140ae030 0x7f5b140a6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b18a0d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b14066a90 con 0x7f5b140ac990 2020-10-31T22:49:20.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b18a0d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b140617a0 con 0x7f5b140ae030 2020-10-31T22:49:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b18a0d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b140667f0 con 0x7f5b1405bbb0 2020-10-31T22:49:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b0affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b140ac990 0x7f5b140a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b0affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b140ac990 0x7f5b140a5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47786/0 (socket says 172.21.15.60:47786) 2020-10-31T22:49:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b0affd700 1 -- 172.21.15.60:0/2007404586 learned_addr learned my addr 172.21.15.60:0/2007404586 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b13fff700 1 --2- 172.21.15.60:0/2007404586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b140ae030 0x7f5b140a6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b137fe700 1 --2- 172.21.15.60:0/2007404586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b1405bbb0 0x7f5b14063980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:20.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b0affd700 1 -- 172.21.15.60:0/2007404586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b1405bbb0 msgr2=0x7f5b14063980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b0affd700 1 --2- 172.21.15.60:0/2007404586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b1405bbb0 0x7f5b14063980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b0affd700 1 -- 172.21.15.60:0/2007404586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b140ae030 msgr2=0x7f5b140a6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b0affd700 1 --2- 172.21.15.60:0/2007404586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b140ae030 0x7f5b140a6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b0affd700 1 -- 172.21.15.60:0/2007404586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b140626c0 con 0x7f5b140ac990 2020-10-31T22:49:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b0affd700 1 --2- 172.21.15.60:0/2007404586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b140ac990 0x7f5b140a5e10 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f5b140663f0 tx=0x7f5afc008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:20.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b117fa700 1 -- 172.21.15.60:0/2007404586 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5afc009980 con 0x7f5b140ac990 2020-10-31T22:49:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b117fa700 1 -- 172.21.15.60:0/2007404586 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5afc009ae0 con 0x7f5b140ac990 2020-10-31T22:49:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2007404586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b14061990 con 0x7f5b140ac990 2020-10-31T22:49:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b117fa700 1 -- 172.21.15.60:0/2007404586 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5afc009e40 con 0x7f5b140ac990 2020-10-31T22:49:20.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.169+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2007404586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b140a67f0 con 0x7f5b140ac990 2020-10-31T22:49:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.173+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2007404586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b1409e7f0 con 0x7f5b140ac990 2020-10-31T22:49:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.173+0000 7f5b117fa700 1 -- 172.21.15.60:0/2007404586 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5afc013480 con 0x7f5b140ac990 2020-10-31T22:49:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.173+0000 7f5b117fa700 1 --2- 172.21.15.60:0/2007404586 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5af8054f10 0x7f5af80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:20.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.173+0000 7f5b117fa700 1 -- 172.21.15.60:0/2007404586 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f5afc06e150 con 0x7f5b140ac990 2020-10-31T22:49:20.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.173+0000 7f5b137fe700 1 --2- 172.21.15.60:0/2007404586 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5af8054f10 0x7f5af80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:20.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.173+0000 7f5b137fe700 1 --2- 172.21.15.60:0/2007404586 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5af8054f10 0x7f5af80573d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f5b0400d000 tx=0x7f5b04009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:20.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.181+0000 7f5b117fa700 1 -- 172.21.15.60:0/2007404586 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5afc0445c0 con 0x7f5b140ac990 2020-10-31T22:49:20.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.365+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2007404586 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b14061b20 con 0x7f5b140ac990 2020-10-31T22:49:20.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.365+0000 7f5b117fa700 1 -- 172.21.15.60:0/2007404586 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+2133 (secure 0 0 0) 0x7f5afc047be0 con 0x7f5b140ac990 2020-10-31T22:49:20.372 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:20.372 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":54,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7164,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/1212236578","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":1212236578},{"type":"v1","addr":"172.21.15.60:6835","nonce":1212236578}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":50},{"gid":7170,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/3130935285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":3130935285},{"type":"v1","addr":"172.21.15.66:6833","nonce":3130935285}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":51}],"filesystems":[{"mdsmap":{"epoch":54,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:49:03.919960+0000","modified":"2020-10-31T22:49:20.016303+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":111,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[20],"metadata_pool":19,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2020-10-31T22:49:20.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.369+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2007404586 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5af8054f10 msgr2=0x7f5af80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:20.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.369+0000 7f5b18a0d700 1 --2- 172.21.15.60:0/2007404586 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5af8054f10 0x7f5af80573d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f5b0400d000 tx=0x7f5b04009040).stop 2020-10-31T22:49:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.369+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2007404586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b140ac990 msgr2=0x7f5b140a5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.369+0000 7f5b18a0d700 1 --2- 172.21.15.60:0/2007404586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b140ac990 0x7f5b140a5e10 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 rx=0x7f5b140663f0 tx=0x7f5afc008040).stop 2020-10-31T22:49:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.369+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2007404586 shutdown_connections 2020-10-31T22:49:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.369+0000 7f5b18a0d700 1 --2- 172.21.15.60:0/2007404586 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5af8054f10 0x7f5af80573d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.369+0000 7f5b18a0d700 1 --2- 172.21.15.60:0/2007404586 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b140ae030 0x7f5b140a6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.369+0000 7f5b18a0d700 1 --2- 172.21.15.60:0/2007404586 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b1405bbb0 0x7f5b14063980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.369+0000 7f5b18a0d700 1 --2- 172.21.15.60:0/2007404586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5b140ac990 0x7f5b140a5e10 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.369+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2007404586 >> 172.21.15.60:0/2007404586 conn(0x7f5b140b3fd0 msgr2=0x7f5b140b3510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.369+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2007404586 shutdown_connections 2020-10-31T22:49:20.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.369+0000 7f5b18a0d700 1 -- 172.21.15.60:0/2007404586 wait complete. 2020-10-31T22:49:20.377 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 54 2020-10-31T22:49:20.386 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:49:20.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.545+0000 7f798ffff700 1 Processor -- start 2020-10-31T22:49:20.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.545+0000 7f798ffff700 1 -- start start 2020-10-31T22:49:20.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.545+0000 7f798ffff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f799005c320 0x7f7990141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:20.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.545+0000 7f798ffff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79900b2130 con 0x7f79900b0000 2020-10-31T22:49:20.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.545+0000 7f798ffff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79900af380 con 0x7f79900b1d50 2020-10-31T22:49:20.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.545+0000 7f798ffff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f799013fab0 con 0x7f799005c320 2020-10-31T22:49:20.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.545+0000 7f798e7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f79900b0000 0x7f799005bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51930/0 (socket says 172.21.15.60:51930) 2020-10-31T22:49:20.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.545+0000 7f798e7fc700 1 -- 172.21.15.60:0/262375479 learned_addr learned my addr 172.21.15.60:0/262375479 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:20.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798f7fe700 1 --2- 172.21.15.60:0/262375479 >> v2:172.21.15.66:3300/0 conn(0x7f799005c320 0x7f7990141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:20.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798dffb700 1 -- 172.21.15.60:0/262375479 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1970080344 0 0) 0x7f79900b2130 con 0x7f79900b0000 2020-10-31T22:49:20.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798dffb700 1 -- 172.21.15.60:0/262375479 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7978003230 con 0x7f79900b0000 2020-10-31T22:49:20.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798dffb700 1 -- 172.21.15.60:0/262375479 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 389245167 0 0) 0x7f79900af380 con 0x7f79900b1d50 2020-10-31T22:49:20.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798dffb700 1 -- 172.21.15.60:0/262375479 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79900b2130 con 0x7f79900b1d50 2020-10-31T22:49:20.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798f7fe700 1 -- 172.21.15.60:0/262375479 >> v1:172.21.15.66:6789/0 conn(0x7f79900b1d50 legacy=0x7f799005afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:20.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798f7fe700 1 -- 172.21.15.60:0/262375479 >> v1:172.21.15.60:6789/0 conn(0x7f79900b0000 legacy=0x7f799005bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:20.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798dffb700 1 -- 172.21.15.60:0/262375479 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2125986489 0 0) 0x7f7978003230 con 0x7f79900b0000 2020-10-31T22:49:20.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798f7fe700 1 -- 172.21.15.60:0/262375479 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79900af620 con 0x7f799005c320 2020-10-31T22:49:20.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798f7fe700 1 --2- 172.21.15.60:0/262375479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f799005c320 0x7f7990141d80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f797c0010d0 tx=0x7f79880091a0).ready entity=mon.1 client_cookie=aba5981bdab7095a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:20.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798dffb700 1 -- 172.21.15.60:0/262375479 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f797c0016d0 con 0x7f799005c320 2020-10-31T22:49:20.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798dffb700 1 -- 172.21.15.60:0/262375479 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798800b800 con 0x7f799005c320 2020-10-31T22:49:20.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798dffb700 1 -- 172.21.15.60:0/262375479 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f798800b970 con 0x7f799005c320 2020-10-31T22:49:20.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798ffff700 1 -- 172.21.15.60:0/262375479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f799005c320 msgr2=0x7f7990141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:20.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798ffff700 1 --2- 172.21.15.60:0/262375479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f799005c320 0x7f7990141d80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f797c0010d0 tx=0x7f79880091a0).stop 2020-10-31T22:49:20.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798ffff700 1 -- 172.21.15.60:0/262375479 shutdown_connections 2020-10-31T22:49:20.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798ffff700 1 --2- 172.21.15.60:0/262375479 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f799005c320 0x7f7990141d80 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798ffff700 1 -- 172.21.15.60:0/262375479 >> 172.21.15.60:0/262375479 conn(0x7f79900b5300 msgr2=0x7f79900b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:20.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798ffff700 1 -- 172.21.15.60:0/262375479 shutdown_connections 2020-10-31T22:49:20.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.549+0000 7f798ffff700 1 -- 172.21.15.60:0/262375479 wait complete. 2020-10-31T22:49:20.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798ffff700 1 Processor -- start 2020-10-31T22:49:20.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798ffff700 1 -- start start 2020-10-31T22:49:20.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798ffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f799005c320 0x7f79900adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:20.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79900b0000 0x7f799013b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:20.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79900b1d50 0x7f799013b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:20.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798ffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7990148550 con 0x7f79900b0000 2020-10-31T22:49:20.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798ffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79901487f0 con 0x7f799005c320 2020-10-31T22:49:20.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798ffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7990148a90 con 0x7f79900b1d50 2020-10-31T22:49:20.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79900b0000 0x7f799013b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:20.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798e7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79900b0000 0x7f799013b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47800/0 (socket says 172.21.15.60:47800) 2020-10-31T22:49:20.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798e7fc700 1 -- 172.21.15.60:0/1744270503 learned_addr learned my addr 172.21.15.60:0/1744270503 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:20.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798effd700 1 --2- 172.21.15.60:0/1744270503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f799005c320 0x7f79900adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:20.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798f7fe700 1 --2- 172.21.15.60:0/1744270503 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79900b1d50 0x7f799013b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798e7fc700 1 -- 172.21.15.60:0/1744270503 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79900b1d50 msgr2=0x7f799013b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798e7fc700 1 --2- 172.21.15.60:0/1744270503 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79900b1d50 0x7f799013b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798e7fc700 1 -- 172.21.15.60:0/1744270503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f799005c320 msgr2=0x7f79900adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798e7fc700 1 --2- 172.21.15.60:0/1744270503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f799005c320 0x7f79900adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798e7fc700 1 -- 172.21.15.60:0/1744270503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7990145560 con 0x7f79900b0000 2020-10-31T22:49:20.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798e7fc700 1 --2- 172.21.15.60:0/1744270503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79900b0000 0x7f799013b1c0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f797c000fa0 tx=0x7f797c001b10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f7987fff700 1 -- 172.21.15.60:0/1744270503 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f797c007170 con 0x7f79900b0000 2020-10-31T22:49:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f7987fff700 1 -- 172.21.15.60:0/1744270503 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c0072d0 con 0x7f79900b0000 2020-10-31T22:49:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f7987fff700 1 -- 172.21.15.60:0/1744270503 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f797c00a750 con 0x7f79900b0000 2020-10-31T22:49:20.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798ffff700 1 -- 172.21.15.60:0/1744270503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79900ae570 con 0x7f79900b0000 2020-10-31T22:49:20.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.553+0000 7f798ffff700 1 -- 172.21.15.60:0/1744270503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799013bba0 con 0x7f79900b0000 2020-10-31T22:49:20.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.557+0000 7f798ffff700 1 -- 172.21.15.60:0/1744270503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7990148c50 con 0x7f79900b0000 2020-10-31T22:49:20.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.557+0000 7f7987fff700 1 -- 172.21.15.60:0/1744270503 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f797c010070 con 0x7f79900b0000 2020-10-31T22:49:20.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.557+0000 7f7987fff700 1 --2- 172.21.15.60:0/1744270503 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f796c054f10 0x7f796c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:20.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.557+0000 7f7987fff700 1 -- 172.21.15.60:0/1744270503 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f797c06d430 con 0x7f79900b0000 2020-10-31T22:49:20.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.557+0000 7f798effd700 1 --2- 172.21.15.60:0/1744270503 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f796c054f10 0x7f796c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:20.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.557+0000 7f798effd700 1 --2- 172.21.15.60:0/1744270503 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f796c054f10 0x7f796c0573d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f798000d000 tx=0x7f7980007960).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:20.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.565+0000 7f7987fff700 1 -- 172.21.15.60:0/1744270503 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f797c043900 con 0x7f79900b0000 2020-10-31T22:49:20.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:20.749+0000 7f798ffff700 1 -- 172.21.15.60:0/1744270503 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7990057100 con 0x7f79900b0000 2020-10-31T22:49:21.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.637+0000 7f7987fff700 1 -- 172.21.15.60:0/1744270503 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 104+0+0 (secure 0 0 0) 0x7f797c019070 con 0x7f79900b0000 2020-10-31T22:49:21.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.641+0000 7f798ffff700 1 -- 172.21.15.60:0/1744270503 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f796c054f10 msgr2=0x7f796c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:21.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.641+0000 7f798ffff700 1 --2- 172.21.15.60:0/1744270503 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f796c054f10 0x7f796c0573d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7f798000d000 tx=0x7f7980007960).stop 2020-10-31T22:49:21.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.641+0000 7f798ffff700 1 -- 172.21.15.60:0/1744270503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79900b0000 msgr2=0x7f799013b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:21.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.641+0000 7f798ffff700 1 --2- 172.21.15.60:0/1744270503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79900b0000 0x7f799013b1c0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 rx=0x7f797c000fa0 tx=0x7f797c001b10).stop 2020-10-31T22:49:21.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.641+0000 7f798ffff700 1 -- 172.21.15.60:0/1744270503 shutdown_connections 2020-10-31T22:49:21.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.641+0000 7f798ffff700 1 --2- 172.21.15.60:0/1744270503 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f79900b1d50 0x7f799013b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:21.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.641+0000 7f798ffff700 1 --2- 172.21.15.60:0/1744270503 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f796c054f10 0x7f796c0573d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:21.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.641+0000 7f798ffff700 1 --2- 172.21.15.60:0/1744270503 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f799005c320 0x7f79900adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:21.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.641+0000 7f798ffff700 1 --2- 172.21.15.60:0/1744270503 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f79900b0000 0x7f799013b1c0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:21.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.641+0000 7f798ffff700 1 -- 172.21.15.60:0/1744270503 >> 172.21.15.60:0/1744270503 conn(0x7f79900b5300 msgr2=0x7f79901422d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:21.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.641+0000 7f798ffff700 1 -- 172.21.15.60:0/1744270503 shutdown_connections 2020-10-31T22:49:21.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.641+0000 7f798ffff700 1 -- 172.21.15.60:0/1744270503 wait complete. 2020-10-31T22:49:21.667 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:49:21.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.789+0000 7fed1e3e5700 1 Processor -- start 2020-10-31T22:49:21.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.789+0000 7fed1e3e5700 1 -- start start 2020-10-31T22:49:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1e3e5700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fed1805b320 0x7fed180b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1e3e5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed180acc60 0x7fed180b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1e3e5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fed180ad610 0x7fed180ada70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1e3e5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed1805b700 con 0x7fed180ad610 2020-10-31T22:49:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1e3e5700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed18140750 con 0x7fed1805b320 2020-10-31T22:49:21.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1e3e5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed180b0340 con 0x7fed180acc60 2020-10-31T22:49:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1dbe4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fed180ad610 0x7fed180ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1d3e3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fed1805b320 0x7fed180b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1cbe2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed180acc60 0x7fed180b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1dbe4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fed180ad610 0x7fed180ada70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47810/0 (socket says 172.21.15.60:47810) 2020-10-31T22:49:21.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1dbe4700 1 -- 172.21.15.60:0/2174490495 learned_addr learned my addr 172.21.15.60:0/2174490495 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:21.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1cbe2700 1 -- 172.21.15.60:0/2174490495 >> v2:172.21.15.66:3300/0 conn(0x7fed1805b320 msgr2=0x7fed180b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:21.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1cbe2700 1 --2- 172.21.15.60:0/2174490495 >> v2:172.21.15.66:3300/0 conn(0x7fed1805b320 0x7fed180b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:21.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1cbe2700 1 -- 172.21.15.60:0/2174490495 >> v2:172.21.15.60:3300/0 conn(0x7fed180ad610 msgr2=0x7fed180ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:21.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1cbe2700 1 --2- 172.21.15.60:0/2174490495 >> v2:172.21.15.60:3300/0 conn(0x7fed180ad610 0x7fed180ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:21.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1cbe2700 1 -- 172.21.15.60:0/2174490495 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed180b05e0 con 0x7fed180acc60 2020-10-31T22:49:21.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1dbe4700 1 --2- 172.21.15.60:0/2174490495 >> v2:172.21.15.60:3300/0 conn(0x7fed180ad610 0x7fed180ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:21.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1cbe2700 1 --2- 172.21.15.60:0/2174490495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed180acc60 0x7fed180b22a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fed08002f30 tx=0x7fed08006dc0).ready entity=mon.2 client_cookie=6730940bafce5fea server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:21.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed0ffff700 1 -- 172.21.15.60:0/2174490495 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed08009650 con 0x7fed180acc60 2020-10-31T22:49:21.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed0ffff700 1 -- 172.21.15.60:0/2174490495 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed080097b0 con 0x7fed180acc60 2020-10-31T22:49:21.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed0ffff700 1 -- 172.21.15.60:0/2174490495 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed08009b10 con 0x7fed180acc60 2020-10-31T22:49:21.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1e3e5700 1 -- 172.21.15.60:0/2174490495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed180acc60 msgr2=0x7fed180b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:21.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.793+0000 7fed1e3e5700 1 --2- 172.21.15.60:0/2174490495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed180acc60 0x7fed180b22a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fed08002f30 tx=0x7fed08006dc0).stop 2020-10-31T22:49:21.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.797+0000 7fed1e3e5700 1 -- 172.21.15.60:0/2174490495 shutdown_connections 2020-10-31T22:49:21.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.797+0000 7fed1e3e5700 1 --2- 172.21.15.60:0/2174490495 >> v2:172.21.15.60:3300/0 conn(0x7fed180ad610 0x7fed180ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:21.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.797+0000 7fed1e3e5700 1 --2- 172.21.15.60:0/2174490495 >> v2:172.21.15.66:3300/0 conn(0x7fed1805b320 0x7fed180b1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:21.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.797+0000 7fed1e3e5700 1 --2- 172.21.15.60:0/2174490495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed180acc60 0x7fed180b22a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:21.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.797+0000 7fed1e3e5700 1 -- 172.21.15.60:0/2174490495 >> 172.21.15.60:0/2174490495 conn(0x7fed180b61d0 msgr2=0x7fed180b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:21.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.797+0000 7fed1e3e5700 1 -- 172.21.15.60:0/2174490495 shutdown_connections 2020-10-31T22:49:21.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.797+0000 7fed1e3e5700 1 -- 172.21.15.60:0/2174490495 wait complete. 2020-10-31T22:49:21.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.797+0000 7fed1e3e5700 1 Processor -- start 2020-10-31T22:49:21.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.797+0000 7fed1e3e5700 1 -- start start 2020-10-31T22:49:21.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1e3e5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1805b320 0x7fed1813b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:21.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1e3e5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed180acc60 0x7fed18065620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:21.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1e3e5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed180ad610 0x7fed18065b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:21.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1e3e5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed18066000 con 0x7fed180ad610 2020-10-31T22:49:21.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1e3e5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed1813d040 con 0x7fed1805b320 2020-10-31T22:49:21.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1e3e5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed18142850 con 0x7fed180acc60 2020-10-31T22:49:21.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1dbe4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed180ad610 0x7fed18065b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:21.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1dbe4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed180ad610 0x7fed18065b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47814/0 (socket says 172.21.15.60:47814) 2020-10-31T22:49:21.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1dbe4700 1 -- 172.21.15.60:0/3378639567 learned_addr learned my addr 172.21.15.60:0/3378639567 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:21.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1d3e3700 1 --2- 172.21.15.60:0/3378639567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1805b320 0x7fed1813b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:21.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1cbe2700 1 --2- 172.21.15.60:0/3378639567 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed180acc60 0x7fed18065620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:21.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1dbe4700 1 -- 172.21.15.60:0/3378639567 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed180acc60 msgr2=0x7fed18065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:21.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1dbe4700 1 --2- 172.21.15.60:0/3378639567 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed180acc60 0x7fed18065620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:21.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1dbe4700 1 -- 172.21.15.60:0/3378639567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1805b320 msgr2=0x7fed1813b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:21.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1dbe4700 1 --2- 172.21.15.60:0/3378639567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1805b320 0x7fed1813b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:21.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1dbe4700 1 -- 172.21.15.60:0/3378639567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed18142af0 con 0x7fed180ad610 2020-10-31T22:49:21.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1dbe4700 1 --2- 172.21.15.60:0/3378639567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed180ad610 0x7fed18065b10 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7fed1000c000 tx=0x7fed10009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:21.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed0e7fc700 1 -- 172.21.15.60:0/3378639567 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed1000cbd0 con 0x7fed180ad610 2020-10-31T22:49:21.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed0e7fc700 1 -- 172.21.15.60:0/3378639567 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1000cd30 con 0x7fed180ad610 2020-10-31T22:49:21.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1e3e5700 1 -- 172.21.15.60:0/3378639567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed18142f90 con 0x7fed180ad610 2020-10-31T22:49:21.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed0e7fc700 1 -- 172.21.15.60:0/3378639567 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed1000cea0 con 0x7fed180ad610 2020-10-31T22:49:21.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.801+0000 7fed1e3e5700 1 -- 172.21.15.60:0/3378639567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed1813cc10 con 0x7fed180ad610 2020-10-31T22:49:21.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.805+0000 7fed0e7fc700 1 -- 172.21.15.60:0/3378639567 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fed10022070 con 0x7fed180ad610 2020-10-31T22:49:21.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.805+0000 7fed1e3e5700 1 -- 172.21.15.60:0/3378639567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed1813c150 con 0x7fed180ad610 2020-10-31T22:49:21.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.805+0000 7fed0e7fc700 1 --2- 172.21.15.60:0/3378639567 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fed00054f90 0x7fed00057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:21.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.805+0000 7fed0e7fc700 1 -- 172.21.15.60:0/3378639567 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fed1006e390 con 0x7fed180ad610 2020-10-31T22:49:21.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.805+0000 7fed1d3e3700 1 --2- 172.21.15.60:0/3378639567 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fed00054f90 0x7fed00057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:21.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.805+0000 7fed1d3e3700 1 --2- 172.21.15.60:0/3378639567 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fed00054f90 0x7fed00057450 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fed1400b000 tx=0x7fed14006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:21.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.809+0000 7fed0e7fc700 1 -- 172.21.15.60:0/3378639567 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fed1813c150 con 0x7fed180ad610 2020-10-31T22:49:21.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:21.949+0000 7fed1e3e5700 1 -- 172.21.15.60:0/3378639567 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fed1813c150 con 0x7fed180ad610 2020-10-31T22:49:22.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.825+0000 7fed0e7fc700 1 -- 172.21.15.60:0/3378639567 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v112) v1 ==== 185+0+0 (secure 0 0 0) 0x7fed1813c150 con 0x7fed180ad610 2020-10-31T22:49:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.833+0000 7fed1e3e5700 1 -- 172.21.15.60:0/3378639567 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fed00054f90 msgr2=0x7fed00057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:22.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.833+0000 7fed1e3e5700 1 --2- 172.21.15.60:0/3378639567 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fed00054f90 0x7fed00057450 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fed1400b000 tx=0x7fed14006dc0).stop 2020-10-31T22:49:22.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.833+0000 7fed1e3e5700 1 -- 172.21.15.60:0/3378639567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed180ad610 msgr2=0x7fed18065b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:22.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.833+0000 7fed1e3e5700 1 --2- 172.21.15.60:0/3378639567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed180ad610 0x7fed18065b10 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 rx=0x7fed1000c000 tx=0x7fed10009270).stop 2020-10-31T22:49:22.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.833+0000 7fed1e3e5700 1 -- 172.21.15.60:0/3378639567 shutdown_connections 2020-10-31T22:49:22.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.833+0000 7fed1e3e5700 1 --2- 172.21.15.60:0/3378639567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fed180ad610 0x7fed18065b10 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:22.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.833+0000 7fed1e3e5700 1 --2- 172.21.15.60:0/3378639567 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fed00054f90 0x7fed00057450 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:22.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.833+0000 7fed1e3e5700 1 --2- 172.21.15.60:0/3378639567 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed1805b320 0x7fed1813b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:22.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.833+0000 7fed1e3e5700 1 --2- 172.21.15.60:0/3378639567 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fed180acc60 0x7fed18065620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:22.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.833+0000 7fed1e3e5700 1 -- 172.21.15.60:0/3378639567 >> 172.21.15.60:0/3378639567 conn(0x7fed180b61d0 msgr2=0x7fed1813e700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:22.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.833+0000 7fed1e3e5700 1 -- 172.21.15.60:0/3378639567 shutdown_connections 2020-10-31T22:49:22.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.833+0000 7fed1e3e5700 1 -- 172.21.15.60:0/3378639567 wait complete. 2020-10-31T22:49:22.842 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:49:22.855 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-10-31T22:49:22.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.969+0000 7f43b326e700 1 Processor -- start 2020-10-31T22:49:22.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.969+0000 7f43b326e700 1 -- start start 2020-10-31T22:49:22.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b326e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac05afe0 0x7f43ac0af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:22.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b326e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f43ac0ab150 0x7f43ac0ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:22.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b326e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac0b1120 con 0x7f43ac0b1bb0 2020-10-31T22:49:22.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b326e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ac140230 con 0x7f43ac0ab150 2020-10-31T22:49:22.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b326e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac0a8850 con 0x7f43ac05afe0 2020-10-31T22:49:22.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b2a6d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f43ac0ab150 0x7f43ac0ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:22.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b2a6d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f43ac0ab150 0x7f43ac0ab5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47824/0 (socket says 172.21.15.60:47824) 2020-10-31T22:49:22.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b2a6d700 1 -- 172.21.15.60:0/3302892338 learned_addr learned my addr 172.21.15.60:0/3302892338 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:22.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b1a6b700 1 --2- 172.21.15.60:0/3302892338 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac05afe0 0x7f43ac0af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:22.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b2a6d700 1 -- 172.21.15.60:0/3302892338 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac05afe0 msgr2=0x7f43ac0af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:22.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b2a6d700 1 --2- 172.21.15.60:0/3302892338 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac05afe0 0x7f43ac0af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:22.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b2a6d700 1 -- 172.21.15.60:0/3302892338 >> v1:172.21.15.66:6789/0 conn(0x7f43ac0b1bb0 legacy=0x7f43ac13fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:22.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b2a6d700 1 -- 172.21.15.60:0/3302892338 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac0a8af0 con 0x7f43ac0ab150 2020-10-31T22:49:22.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b2a6d700 1 --2- 172.21.15.60:0/3302892338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0ab150 0x7f43ac0ab5e0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f43a40032b0 tx=0x7f43a4009270).ready entity=mon.0 client_cookie=ee129026512524f8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:22.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b126a700 1 -- 172.21.15.60:0/3302892338 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43a400bc00 con 0x7f43ac0ab150 2020-10-31T22:49:22.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b126a700 1 -- 172.21.15.60:0/3302892338 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a400bd60 con 0x7f43ac0ab150 2020-10-31T22:49:22.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b126a700 1 -- 172.21.15.60:0/3302892338 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43a4011400 con 0x7f43ac0ab150 2020-10-31T22:49:22.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b326e700 1 -- 172.21.15.60:0/3302892338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0ab150 msgr2=0x7f43ac0ab5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:22.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b326e700 1 --2- 172.21.15.60:0/3302892338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0ab150 0x7f43ac0ab5e0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 rx=0x7f43a40032b0 tx=0x7f43a4009270).stop 2020-10-31T22:49:22.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b326e700 1 -- 172.21.15.60:0/3302892338 shutdown_connections 2020-10-31T22:49:22.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b326e700 1 --2- 172.21.15.60:0/3302892338 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0ab150 0x7f43ac0ab5e0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b326e700 1 --2- 172.21.15.60:0/3302892338 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac05afe0 0x7f43ac0af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b326e700 1 -- 172.21.15.60:0/3302892338 >> 172.21.15.60:0/3302892338 conn(0x7f43ac0b5330 msgr2=0x7f43ac0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b326e700 1 -- 172.21.15.60:0/3302892338 shutdown_connections 2020-10-31T22:49:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.973+0000 7f43b326e700 1 -- 172.21.15.60:0/3302892338 wait complete. 2020-10-31T22:49:22.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b326e700 1 Processor -- start 2020-10-31T22:49:22.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b326e700 1 -- start start 2020-10-31T22:49:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b326e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac05afe0 0x7f43ac13ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b326e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0ab150 0x7f43ac140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b326e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac0b1bb0 0x7f43ac064aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:22.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b326e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac143cf0 con 0x7f43ac0ab150 2020-10-31T22:49:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b326e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac1437b0 con 0x7f43ac0b1bb0 2020-10-31T22:49:22.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b326e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac143a50 con 0x7f43ac05afe0 2020-10-31T22:49:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b1a6b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0ab150 0x7f43ac140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b1a6b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0ab150 0x7f43ac140ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47828/0 (socket says 172.21.15.60:47828) 2020-10-31T22:49:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b1a6b700 1 -- 172.21.15.60:0/4167748936 learned_addr learned my addr 172.21.15.60:0/4167748936 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:22.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b226c700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac05afe0 0x7f43ac13ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b2a6d700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac0b1bb0 0x7f43ac064aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b1a6b700 1 -- 172.21.15.60:0/4167748936 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac05afe0 msgr2=0x7f43ac13ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b1a6b700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac05afe0 0x7f43ac13ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b1a6b700 1 -- 172.21.15.60:0/4167748936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac0b1bb0 msgr2=0x7f43ac064aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b1a6b700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac0b1bb0 0x7f43ac064aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b1a6b700 1 -- 172.21.15.60:0/4167748936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac064600 con 0x7f43ac0ab150 2020-10-31T22:49:22.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.977+0000 7f43b2a6d700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac0b1bb0 0x7f43ac064aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:22.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.981+0000 7f43b1a6b700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0ab150 0x7f43ac140ec0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f439c00a000 tx=0x7f439c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.981+0000 7f439b7fe700 1 -- 172.21.15.60:0/4167748936 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f439c0127e0 con 0x7f43ac0ab150 2020-10-31T22:49:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.981+0000 7f439b7fe700 1 -- 172.21.15.60:0/4167748936 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c012940 con 0x7f43ac0ab150 2020-10-31T22:49:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.981+0000 7f43b326e700 1 -- 172.21.15.60:0/4167748936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac1413b0 con 0x7f43ac0ab150 2020-10-31T22:49:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.981+0000 7f439b7fe700 1 -- 172.21.15.60:0/4167748936 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f439c012ca0 con 0x7f43ac0ab150 2020-10-31T22:49:22.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.981+0000 7f43b326e700 1 -- 172.21.15.60:0/4167748936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac1428a0 con 0x7f43ac0ab150 2020-10-31T22:49:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.981+0000 7f43b326e700 1 -- 172.21.15.60:0/4167748936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ac143600 con 0x7f43ac0ab150 2020-10-31T22:49:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.981+0000 7f439b7fe700 1 -- 172.21.15.60:0/4167748936 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f439c013480 con 0x7f43ac0ab150 2020-10-31T22:49:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.981+0000 7f439b7fe700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f438c054f10 0x7f438c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:22.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.981+0000 7f439b7fe700 1 -- 172.21.15.60:0/4167748936 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f439c06e050 con 0x7f43ac0ab150 2020-10-31T22:49:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.981+0000 7f43b226c700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f438c054f10 0x7f438c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:22.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.981+0000 7f43b226c700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f438c054f10 0x7f438c0573d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f43a800d000 tx=0x7f43a8007a90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:22.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:22.989+0000 7f439b7fe700 1 -- 172.21.15.60:0/4167748936 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f439c0445d0 con 0x7f43ac0ab150 2020-10-31T22:49:23.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:23.133+0000 7f43b326e700 1 -- 172.21.15.60:0/4167748936 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f43ac057100 con 0x7f43ac0ab150 2020-10-31T22:49:24.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.037+0000 7f439b7fe700 1 -- 172.21.15.60:0/4167748936 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v113) v1 ==== 173+0+0 (secure 0 0 0) 0x7f439c047bf0 con 0x7f43ac0ab150 2020-10-31T22:49:24.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.041+0000 7f43b326e700 1 -- 172.21.15.60:0/4167748936 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f438c054f10 msgr2=0x7f438c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:24.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.041+0000 7f43b326e700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f438c054f10 0x7f438c0573d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f43a800d000 tx=0x7f43a8007a90).stop 2020-10-31T22:49:24.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.041+0000 7f43b326e700 1 -- 172.21.15.60:0/4167748936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0ab150 msgr2=0x7f43ac140ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:24.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.041+0000 7f43b326e700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0ab150 0x7f43ac140ec0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 rx=0x7f439c00a000 tx=0x7f439c008040).stop 2020-10-31T22:49:24.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.041+0000 7f43b326e700 1 -- 172.21.15.60:0/4167748936 shutdown_connections 2020-10-31T22:49:24.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.041+0000 7f43b326e700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f438c054f10 0x7f438c0573d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:24.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.041+0000 7f43b326e700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac0b1bb0 0x7f43ac064aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:24.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.041+0000 7f43b326e700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac05afe0 0x7f43ac13ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:24.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.041+0000 7f43b326e700 1 --2- 172.21.15.60:0/4167748936 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0ab150 0x7f43ac140ec0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:24.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.041+0000 7f43b326e700 1 -- 172.21.15.60:0/4167748936 >> 172.21.15.60:0/4167748936 conn(0x7f43ac0b5330 msgr2=0x7f43ac0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:24.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.041+0000 7f43b326e700 1 -- 172.21.15.60:0/4167748936 shutdown_connections 2020-10-31T22:49:24.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.041+0000 7f43b326e700 1 -- 172.21.15.60:0/4167748936 wait complete. 2020-10-31T22:49:24.049 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2020-10-31T22:49:24.062 INFO:tasks.ceph.mds.a:Restarting daemon 2020-10-31T22:49:24.063 INFO:tasks.ceph.mds.a:Stopping old one... 2020-10-31T22:49:24.063 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-10-31T22:49:24.063 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:49:24.063 INFO:tasks.ceph.mds.c:Restarting daemon 2020-10-31T22:49:24.064 INFO:tasks.ceph.mds.c:Stopping old one... 2020-10-31T22:49:24.064 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-10-31T22:49:24.064 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:49:24.064 INFO:tasks.ceph.mds.b:Restarting daemon 2020-10-31T22:49:24.065 INFO:tasks.ceph.mds.b:Stopping old one... 2020-10-31T22:49:24.065 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-10-31T22:49:24.065 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:49:24.078 INFO:tasks.ceph.mds.c:Stopped 2020-10-31T22:49:24.078 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-10-31T22:49:24.079 INFO:tasks.ceph.mds.a:Stopped 2020-10-31T22:49:24.079 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-10-31T22:49:24.080 INFO:tasks.ceph.mds.b:Stopped 2020-10-31T22:49:24.080 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-10-31T22:49:24.122 INFO:tasks.ceph.mds.b:Started 2020-10-31T22:49:24.123 DEBUG:teuthology.parallel:result is None 2020-10-31T22:49:24.124 INFO:tasks.ceph.mds.c:Started 2020-10-31T22:49:24.124 INFO:tasks.ceph.mds.a:Started 2020-10-31T22:49:24.124 DEBUG:teuthology.parallel:result is None 2020-10-31T22:49:24.125 DEBUG:teuthology.parallel:result is None 2020-10-31T22:49:24.125 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-10-31T22:49:24.194 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:49:24.201 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:49:24.206 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:49:24.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faede91c700 1 Processor -- start 2020-10-31T22:49:24.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faede91c700 1 -- start start 2020-10-31T22:49:24.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faede91c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faed80b0db0 0x7faed8141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:24.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faede91c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7faed80afb30 0x7faed81420e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:24.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faede91c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed80a8320 con 0x7faed80b5440 2020-10-31T22:49:24.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faede91c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed80b5820 con 0x7faed80afb30 2020-10-31T22:49:24.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faede91c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed80a8550 con 0x7faed80b0db0 2020-10-31T22:49:24.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faed7fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7faed80b5440 0x7faed80af420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:51994/0 (socket says 172.21.15.60:51994) 2020-10-31T22:49:24.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faed7fff700 1 -- 172.21.15.60:0/1020148440 learned_addr learned my addr 172.21.15.60:0/1020148440 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:24.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faedceb9700 1 --2- 172.21.15.60:0/1020148440 >> v2:172.21.15.66:3300/0 conn(0x7faed80afb30 0x7faed81420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:24.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faed77fe700 1 --2- 172.21.15.60:0/1020148440 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faed80b0db0 0x7faed8141bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:24.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faed6ffd700 1 -- 172.21.15.60:0/1020148440 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925241939 0 0) 0x7faed80a8320 con 0x7faed80b5440 2020-10-31T22:49:24.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faed6ffd700 1 -- 172.21.15.60:0/1020148440 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faec4003230 con 0x7faed80b5440 2020-10-31T22:49:24.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faedceb9700 1 -- 172.21.15.60:0/1020148440 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faed80b0db0 msgr2=0x7faed8141bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:24.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faedceb9700 1 --2- 172.21.15.60:0/1020148440 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faed80b0db0 0x7faed8141bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:24.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faed6ffd700 1 -- 172.21.15.60:0/1020148440 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3276767503 0 0) 0x7faec4003230 con 0x7faed80b5440 2020-10-31T22:49:24.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faedceb9700 1 -- 172.21.15.60:0/1020148440 >> v1:172.21.15.60:6789/0 conn(0x7faed80b5440 legacy=0x7faed80af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:24.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faedceb9700 1 -- 172.21.15.60:0/1020148440 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed80ad870 con 0x7faed80afb30 2020-10-31T22:49:24.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.237+0000 7faed77fe700 1 --2- 172.21.15.60:0/1020148440 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faed80b0db0 0x7faed8141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:24.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faedceb9700 1 --2- 172.21.15.60:0/1020148440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed80afb30 0x7faed81420e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7faed0001bf0 tx=0x7faec8006dc0).ready entity=mon.1 client_cookie=7a95f7c62d25f8de server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:24.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed6ffd700 1 -- 172.21.15.60:0/1020148440 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faed0001a50 con 0x7faed80afb30 2020-10-31T22:49:24.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed6ffd700 1 -- 172.21.15.60:0/1020148440 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec800d570 con 0x7faed80afb30 2020-10-31T22:49:24.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed6ffd700 1 -- 172.21.15.60:0/1020148440 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faec800d6e0 con 0x7faed80afb30 2020-10-31T22:49:24.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 -- 172.21.15.60:0/1020148440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed80afb30 msgr2=0x7faed81420e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:24.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 --2- 172.21.15.60:0/1020148440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed80afb30 0x7faed81420e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7faed0001bf0 tx=0x7faec8006dc0).stop 2020-10-31T22:49:24.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 -- 172.21.15.60:0/1020148440 shutdown_connections 2020-10-31T22:49:24.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 --2- 172.21.15.60:0/1020148440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed80afb30 0x7faed81420e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:24.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 --2- 172.21.15.60:0/1020148440 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faed80b0db0 0x7faed8141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:24.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 -- 172.21.15.60:0/1020148440 >> 172.21.15.60:0/1020148440 conn(0x7faed8060c10 msgr2=0x7faed80b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:24.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 -- 172.21.15.60:0/1020148440 shutdown_connections 2020-10-31T22:49:24.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 -- 172.21.15.60:0/1020148440 wait complete. 2020-10-31T22:49:24.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 Processor -- start 2020-10-31T22:49:24.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 -- start start 2020-10-31T22:49:24.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faed80afb30 0x7faed8067170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:24.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faed80b0db0 0x7faed80646f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:24.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed80b5440 0x7faed8064be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:24.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed8066710 con 0x7faed80afb30 2020-10-31T22:49:24.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed813cee0 con 0x7faed80b5440 2020-10-31T22:49:24.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed813c570 con 0x7faed80b0db0 2020-10-31T22:49:24.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faed80afb30 0x7faed8067170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:24.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faed80afb30 0x7faed8067170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47864/0 (socket says 172.21.15.60:47864) 2020-10-31T22:49:24.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed7fff700 1 -- 172.21.15.60:0/2918174070 learned_addr learned my addr 172.21.15.60:0/2918174070 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:24.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed77fe700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faed80b0db0 0x7faed80646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:24.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faedceb9700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed80b5440 0x7faed8064be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:24.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed7fff700 1 -- 172.21.15.60:0/2918174070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faed80b0db0 msgr2=0x7faed80646f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:24.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed7fff700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faed80b0db0 0x7faed80646f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:24.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed7fff700 1 -- 172.21.15.60:0/2918174070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed80b5440 msgr2=0x7faed8064be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:24.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed7fff700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed80b5440 0x7faed8064be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed7fff700 1 -- 172.21.15.60:0/2918174070 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed813ac70 con 0x7faed80afb30 2020-10-31T22:49:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faedceb9700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed80b5440 0x7faed8064be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed7fff700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faed80afb30 0x7faed8067170 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7faed0001cb0 tx=0x7faed0001570).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed57fa700 1 -- 172.21.15.60:0/2918174070 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faed0004a80 con 0x7faed80afb30 2020-10-31T22:49:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed57fa700 1 -- 172.21.15.60:0/2918174070 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed0004be0 con 0x7faed80afb30 2020-10-31T22:49:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faede91c700 1 -- 172.21.15.60:0/2918174070 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed813af10 con 0x7faed80afb30 2020-10-31T22:49:24.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.241+0000 7faed57fa700 1 -- 172.21.15.60:0/2918174070 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faed0007170 con 0x7faed80afb30 2020-10-31T22:49:24.256 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.245+0000 7faede91c700 1 -- 172.21.15.60:0/2918174070 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed813e3d0 con 0x7faed80afb30 2020-10-31T22:49:24.256 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.245+0000 7faed57fa700 1 -- 172.21.15.60:0/2918174070 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7faed001b060 con 0x7faed80afb30 2020-10-31T22:49:24.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.245+0000 7faede91c700 1 -- 172.21.15.60:0/2918174070 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed8064450 con 0x7faed80afb30 2020-10-31T22:49:24.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.245+0000 7faed57fa700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faeb8054f10 0x7faeb80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:24.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.245+0000 7faed77fe700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faeb8054f10 0x7faeb80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:24.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.245+0000 7faed57fa700 1 -- 172.21.15.60:0/2918174070 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5339+0+0 (secure 0 0 0) 0x7faed006d550 con 0x7faed80afb30 2020-10-31T22:49:24.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.245+0000 7faed77fe700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faeb8054f10 0x7faeb80573d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7faecc008000 tx=0x7faecc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:24.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.249+0000 7faed57fa700 1 -- 172.21.15.60:0/2918174070 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7faed8064450 con 0x7faed80afb30 2020-10-31T22:49:24.282 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2020-10-31T22:49:24.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:24.405+0000 7faede91c700 1 -- 172.21.15.60:0/2918174070 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7faed8064450 con 0x7faed80afb30 2020-10-31T22:49:25.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.241+0000 7faed57fa700 1 -- 172.21.15.60:0/2918174070 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v116) v1 ==== 97+0+0 (secure 0 0 0) 0x7faed8064450 con 0x7faed80afb30 2020-10-31T22:49:25.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.245+0000 7faede91c700 1 -- 172.21.15.60:0/2918174070 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faeb8054f10 msgr2=0x7faeb80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:25.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.245+0000 7faede91c700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faeb8054f10 0x7faeb80573d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7faecc008000 tx=0x7faecc008040).stop 2020-10-31T22:49:25.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.245+0000 7faede91c700 1 -- 172.21.15.60:0/2918174070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faed80afb30 msgr2=0x7faed8067170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:25.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.245+0000 7faede91c700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faed80afb30 0x7faed8067170 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 rx=0x7faed0001cb0 tx=0x7faed0001570).stop 2020-10-31T22:49:25.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.245+0000 7faede91c700 1 -- 172.21.15.60:0/2918174070 shutdown_connections 2020-10-31T22:49:25.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.245+0000 7faede91c700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faeb8054f10 0x7faeb80573d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.245+0000 7faede91c700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faed80b5440 0x7faed8064be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.245+0000 7faede91c700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faed80afb30 0x7faed8067170 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.245+0000 7faede91c700 1 --2- 172.21.15.60:0/2918174070 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faed80b0db0 0x7faed80646f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.245+0000 7faede91c700 1 -- 172.21.15.60:0/2918174070 >> 172.21.15.60:0/2918174070 conn(0x7faed8060c10 msgr2=0x7faed80b1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:25.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.245+0000 7faede91c700 1 -- 172.21.15.60:0/2918174070 shutdown_connections 2020-10-31T22:49:25.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.245+0000 7faede91c700 1 -- 172.21.15.60:0/2918174070 wait complete. 2020-10-31T22:49:25.254 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blacklist entries 2020-10-31T22:49:25.271 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2020-10-31T22:49:25.272 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-10-31T22:49:25.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.381+0000 7f3147fff700 1 Processor -- start 2020-10-31T22:49:25.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.381+0000 7f3147fff700 1 -- start start 2020-10-31T22:49:25.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.381+0000 7f3147fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31480b5570 0x7f31480b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:25.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.381+0000 7f3147fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3148141fe0 0x7f3148142450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:25.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.381+0000 7f3147fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3148145180 con 0x7f31480b24a0 2020-10-31T22:49:25.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.381+0000 7f3147fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31480afae0 con 0x7f3148141fe0 2020-10-31T22:49:25.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.381+0000 7f3147fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3148141bf0 con 0x7f31480b5570 2020-10-31T22:49:25.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f31477fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3148141fe0 0x7f3148142450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:25.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f31467fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f31480b24a0 0x7f3148145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52014/0 (socket says 172.21.15.60:52014) 2020-10-31T22:49:25.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f31477fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3148141fe0 0x7f3148142450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47876/0 (socket says 172.21.15.60:47876) 2020-10-31T22:49:25.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f31467fc700 1 -- 172.21.15.60:0/4021496759 learned_addr learned my addr 172.21.15.60:0/4021496759 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:25.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f3146ffd700 1 --2- 172.21.15.60:0/4021496759 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31480b5570 0x7f31480b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:25.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f31477fe700 1 -- 172.21.15.60:0/4021496759 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31480b5570 msgr2=0x7f31480b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:25.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f31477fe700 1 --2- 172.21.15.60:0/4021496759 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31480b5570 0x7f31480b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f31477fe700 1 -- 172.21.15.60:0/4021496759 >> v1:172.21.15.60:6789/0 conn(0x7f31480b24a0 legacy=0x7f3148145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:25.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f31477fe700 1 -- 172.21.15.60:0/4021496759 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31480b0670 con 0x7f3148141fe0 2020-10-31T22:49:25.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f31477fe700 1 --2- 172.21.15.60:0/4021496759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3148141fe0 0x7f3148142450 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f3148061290 tx=0x7f31400091a0).ready entity=mon.0 client_cookie=e7d5252595a2ad47 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:25.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f3145ffb700 1 -- 172.21.15.60:0/4021496759 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f314000b9b0 con 0x7f3148141fe0 2020-10-31T22:49:25.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f3145ffb700 1 -- 172.21.15.60:0/4021496759 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314000bb10 con 0x7f3148141fe0 2020-10-31T22:49:25.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f3145ffb700 1 -- 172.21.15.60:0/4021496759 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f314000bc80 con 0x7f3148141fe0 2020-10-31T22:49:25.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f3147fff700 1 -- 172.21.15.60:0/4021496759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3148141fe0 msgr2=0x7f3148142450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:25.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f3147fff700 1 --2- 172.21.15.60:0/4021496759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3148141fe0 0x7f3148142450 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 rx=0x7f3148061290 tx=0x7f31400091a0).stop 2020-10-31T22:49:25.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f3147fff700 1 -- 172.21.15.60:0/4021496759 shutdown_connections 2020-10-31T22:49:25.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f3147fff700 1 --2- 172.21.15.60:0/4021496759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3148141fe0 0x7f3148142450 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f3147fff700 1 --2- 172.21.15.60:0/4021496759 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31480b5570 0x7f31480b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f3147fff700 1 -- 172.21.15.60:0/4021496759 >> 172.21.15.60:0/4021496759 conn(0x7f31480b8e90 msgr2=0x7f31480b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:25.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f3147fff700 1 -- 172.21.15.60:0/4021496759 shutdown_connections 2020-10-31T22:49:25.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f3147fff700 1 -- 172.21.15.60:0/4021496759 wait complete. 2020-10-31T22:49:25.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f3147fff700 1 Processor -- start 2020-10-31T22:49:25.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.385+0000 7f3147fff700 1 -- start start 2020-10-31T22:49:25.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f3147fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31480b24a0 0x7f3148139af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:25.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f3147fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31480b5570 0x7f31481373b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:25.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f3147fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3148141fe0 0x7f31481378a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:25.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f3147fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3148151920 con 0x7f31480b5570 2020-10-31T22:49:25.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f3147fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31481465d0 con 0x7f3148141fe0 2020-10-31T22:49:25.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f3147fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3148146830 con 0x7f31480b24a0 2020-10-31T22:49:25.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f31467fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31480b5570 0x7f31481373b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:25.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f31467fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31480b5570 0x7f31481373b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47884/0 (socket says 172.21.15.60:47884) 2020-10-31T22:49:25.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f3146ffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31480b24a0 0x7f3148139af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:25.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f31467fc700 1 -- 172.21.15.60:0/1673461527 learned_addr learned my addr 172.21.15.60:0/1673461527 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:25.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f31477fe700 1 --2- 172.21.15.60:0/1673461527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3148141fe0 0x7f31481378a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:25.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f31467fc700 1 -- 172.21.15.60:0/1673461527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31480b24a0 msgr2=0x7f3148139af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:25.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f31467fc700 1 --2- 172.21.15.60:0/1673461527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31480b24a0 0x7f3148139af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f31467fc700 1 -- 172.21.15.60:0/1673461527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3148141fe0 msgr2=0x7f31481378a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:25.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f31467fc700 1 --2- 172.21.15.60:0/1673461527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3148141fe0 0x7f31481378a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f31467fc700 1 -- 172.21.15.60:0/1673461527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3148146ad0 con 0x7f31480b5570 2020-10-31T22:49:25.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f31467fc700 1 --2- 172.21.15.60:0/1673461527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31480b5570 0x7f31481373b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f31480610d0 tx=0x7f3138007c10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:25.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f313ffff700 1 -- 172.21.15.60:0/1673461527 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31380072e0 con 0x7f31480b5570 2020-10-31T22:49:25.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f313ffff700 1 -- 172.21.15.60:0/1673461527 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3138007440 con 0x7f31480b5570 2020-10-31T22:49:25.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f3147fff700 1 -- 172.21.15.60:0/1673461527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3148137d90 con 0x7f31480b5570 2020-10-31T22:49:25.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f313ffff700 1 -- 172.21.15.60:0/1673461527 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31380057d0 con 0x7f31480b5570 2020-10-31T22:49:25.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f3147fff700 1 -- 172.21.15.60:0/1673461527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3148151410 con 0x7f31480b5570 2020-10-31T22:49:25.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.389+0000 7f3147fff700 1 -- 172.21.15.60:0/1673461527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3148146c60 con 0x7f31480b5570 2020-10-31T22:49:25.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.393+0000 7f313ffff700 1 -- 172.21.15.60:0/1673461527 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3138010070 con 0x7f31480b5570 2020-10-31T22:49:25.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.393+0000 7f313ffff700 1 --2- 172.21.15.60:0/1673461527 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f312c054f90 0x7f312c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:25.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.393+0000 7f3146ffd700 1 --2- 172.21.15.60:0/1673461527 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f312c054f90 0x7f312c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:25.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.393+0000 7f313ffff700 1 -- 172.21.15.60:0/1673461527 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f313806ccd0 con 0x7f31480b5570 2020-10-31T22:49:25.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.393+0000 7f3146ffd700 1 --2- 172.21.15.60:0/1673461527 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f312c054f90 0x7f312c057450 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f313000b000 tx=0x7f3130006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:25.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.397+0000 7f313ffff700 1 -- 172.21.15.60:0/1673461527 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3138043520 con 0x7f31480b5570 2020-10-31T22:49:25.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.593+0000 7f3147fff700 1 -- 172.21.15.60:0/1673461527 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3148151720 con 0x7f31480b5570 2020-10-31T22:49:25.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.593+0000 7f313ffff700 1 -- 172.21.15.60:0/1673461527 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) v1 ==== 80+0+4255 (secure 0 0 0) 0x7f3138018030 con 0x7f31480b5570 2020-10-31T22:49:25.601 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:25.601 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:49:25.601 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2020-10-31T22:49:25.601 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.601 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2020-10-31T22:49:25.602 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f7D/cFRAAHQ9NU7VSs14mi5sC/GwHng==", 2020-10-31T22:49:25.602 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.602 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:49:25.602 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:49:25.602 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:49:25.602 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:49:25.602 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.603 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.603 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2020-10-31T22:49:25.603 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f5SPjJBAAVjFv2PdBZ7j94etJrAT0tA==", 2020-10-31T22:49:25.603 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.603 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:49:25.604 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:49:25.604 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:49:25.604 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:49:25.604 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.606 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.606 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2020-10-31T22:49:25.607 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKpdoHhAAhhlaYqOQoI6tTKexjRpbGA==", 2020-10-31T22:49:25.607 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.607 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:49:25.608 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:49:25.608 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:49:25.608 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:49:25.608 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.609 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.609 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.609 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2020-10-31T22:49:25.610 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDR551f7MwsMRAACZIQlAKm3BdVbDs2gQAfxg==", 2020-10-31T22:49:25.610 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.610 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:49:25.610 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:49:25.611 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:49:25.611 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.611 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.612 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2020-10-31T22:49:25.612 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDU551f07HQFxAAokMFXwsbgKGtJNpnKerdGg==", 2020-10-31T22:49:25.612 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.613 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:49:25.613 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:49:25.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:49:25.615 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.615 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.615 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.616 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2020-10-31T22:49:25.616 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDW551fODyjOhAAJ+j8KITJidSpltSiJaQZGw==", 2020-10-31T22:49:25.616 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.617 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:49:25.617 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:49:25.617 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:49:25.617 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.618 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.618 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.619 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2020-10-31T22:49:25.619 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDZ551fs+aCIhAAwpbmgGQjU05W3hZofTtHdg==", 2020-10-31T22:49:25.619 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.619 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:49:25.620 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:49:25.620 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:49:25.620 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.621 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.621 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2020-10-31T22:49:25.621 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDe551fI5nIMxAAwwNSHQYDPS6G2achKIpwqg==", 2020-10-31T22:49:25.622 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.622 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:49:25.622 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:49:25.623 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:49:25.623 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.623 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.623 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2020-10-31T22:49:25.623 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDh551f68p2GhAAhlGpZLPg8RqouzStqN4tFw==", 2020-10-31T22:49:25.623 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.624 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:49:25.624 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:49:25.624 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:49:25.624 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.624 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.624 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2020-10-31T22:49:25.625 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDk551fUi3kARAAsXPU7HEhqax8Go00CqgdNw==", 2020-10-31T22:49:25.625 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.625 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:49:25.625 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:49:25.625 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:49:25.625 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.625 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.625 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.626 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2020-10-31T22:49:25.626 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDm551fKh4aJRAAj+whV4kueCu2Og7wZ05tNw==", 2020-10-31T22:49:25.626 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.626 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:49:25.626 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:49:25.626 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:49:25.626 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.627 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.627 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.627 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2020-10-31T22:49:25.627 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551flXvBJxAAtD4URDL2NV0zyAympufvVA==", 2020-10-31T22:49:25.627 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.627 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:49:25.627 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:49:25.628 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:49:25.628 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.628 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.628 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.628 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2020-10-31T22:49:25.628 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fQ/OGKhAA/xGrRlUW52pP6E6SWXYAGA==", 2020-10-31T22:49:25.628 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.628 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:49:25.629 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:49:25.629 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:49:25.629 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.629 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.629 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.629 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2020-10-31T22:49:25.629 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDP551fITgCMxAAQy5CQzqda1YjdUtTRxbsPQ==", 2020-10-31T22:49:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:49:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:49:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:49:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:49:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.630 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2020-10-31T22:49:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551feZUgExAAvGt2fUb5GhkkFQ0dbgP5nw==", 2020-10-31T22:49:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:49:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:49:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:49:25.631 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:25.632 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2020-10-31T22:49:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKiN5EBAAhHtXXE4+yydXWOK7agZ14g==", 2020-10-31T22:49:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:49:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:49:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:49:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:49:25.633 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:25.634 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:25.634 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:49:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.597+0000 7f3147fff700 1 -- 172.21.15.60:0/1673461527 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f312c054f90 msgr2=0x7f312c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:25.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.597+0000 7f3147fff700 1 --2- 172.21.15.60:0/1673461527 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f312c054f90 0x7f312c057450 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f313000b000 tx=0x7f3130006dc0).stop 2020-10-31T22:49:25.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.597+0000 7f3147fff700 1 -- 172.21.15.60:0/1673461527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31480b5570 msgr2=0x7f31481373b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:25.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.597+0000 7f3147fff700 1 --2- 172.21.15.60:0/1673461527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31480b5570 0x7f31481373b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 rx=0x7f31480610d0 tx=0x7f3138007c10).stop 2020-10-31T22:49:25.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.597+0000 7f3147fff700 1 -- 172.21.15.60:0/1673461527 shutdown_connections 2020-10-31T22:49:25.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.597+0000 7f3147fff700 1 --2- 172.21.15.60:0/1673461527 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f312c054f90 0x7f312c057450 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.597+0000 7f3147fff700 1 --2- 172.21.15.60:0/1673461527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3148141fe0 0x7f31481378a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.597+0000 7f3147fff700 1 --2- 172.21.15.60:0/1673461527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31480b24a0 0x7f3148139af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.597+0000 7f3147fff700 1 --2- 172.21.15.60:0/1673461527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31480b5570 0x7f31481373b0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.597+0000 7f3147fff700 1 -- 172.21.15.60:0/1673461527 >> 172.21.15.60:0/1673461527 conn(0x7f31480b8e90 msgr2=0x7f31481423f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:25.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.597+0000 7f3147fff700 1 -- 172.21.15.60:0/1673461527 shutdown_connections 2020-10-31T22:49:25.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.597+0000 7f3147fff700 1 -- 172.21.15.60:0/1673461527 wait complete. 2020-10-31T22:49:25.638 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:49:25.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.745+0000 7f613afd9700 1 Processor -- start 2020-10-31T22:49:25.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.745+0000 7f613afd9700 1 -- start start 2020-10-31T22:49:25.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6134063140 0x7f6134140360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:25.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f61340af130 0x7f6134140850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:25.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61340b13c0 0x7f61340b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:25.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6134063520 con 0x7f61340af130 2020-10-31T22:49:25.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61341430e0 con 0x7f6134063140 2020-10-31T22:49:25.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6134143380 con 0x7f61340b13c0 2020-10-31T22:49:25.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f61397d6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f61340af130 0x7f6134140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:25.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f61397d6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f61340af130 0x7f6134140850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47888/0 (socket says 172.21.15.60:47888) 2020-10-31T22:49:25.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f61397d6700 1 -- 172.21.15.60:0/1450055027 learned_addr learned my addr 172.21.15.60:0/1450055027 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:25.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613a7d8700 1 --2- 172.21.15.60:0/1450055027 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61340b13c0 0x7f61340b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:25.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f6139fd7700 1 --2- 172.21.15.60:0/1450055027 >> v2:172.21.15.66:3300/0 conn(0x7f6134063140 0x7f6134140360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:25.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f61397d6700 1 -- 172.21.15.60:0/1450055027 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61340b13c0 msgr2=0x7f61340b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:25.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f61397d6700 1 --2- 172.21.15.60:0/1450055027 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61340b13c0 0x7f61340b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f61397d6700 1 -- 172.21.15.60:0/1450055027 >> v2:172.21.15.66:3300/0 conn(0x7f6134063140 msgr2=0x7f6134140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:25.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f61397d6700 1 --2- 172.21.15.60:0/1450055027 >> v2:172.21.15.66:3300/0 conn(0x7f6134063140 0x7f6134140360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f61397d6700 1 -- 172.21.15.60:0/1450055027 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6134143620 con 0x7f61340af130 2020-10-31T22:49:25.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f6139fd7700 1 --2- 172.21.15.60:0/1450055027 >> v2:172.21.15.66:3300/0 conn(0x7f6134063140 0x7f6134140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:25.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f61397d6700 1 --2- 172.21.15.60:0/1450055027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61340af130 0x7f6134140850 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f6124002f30 tx=0x7f6124006e80).ready entity=mon.0 client_cookie=dd50026dea62714c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:25.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f6138fd5700 1 -- 172.21.15.60:0/1450055027 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61240097f0 con 0x7f61340af130 2020-10-31T22:49:25.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f6138fd5700 1 -- 172.21.15.60:0/1450055027 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6124009950 con 0x7f61340af130 2020-10-31T22:49:25.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f6138fd5700 1 -- 172.21.15.60:0/1450055027 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6124009cb0 con 0x7f61340af130 2020-10-31T22:49:25.765 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 -- 172.21.15.60:0/1450055027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61340af130 msgr2=0x7f6134140850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:25.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 --2- 172.21.15.60:0/1450055027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61340af130 0x7f6134140850 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 rx=0x7f6124002f30 tx=0x7f6124006e80).stop 2020-10-31T22:49:25.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 -- 172.21.15.60:0/1450055027 shutdown_connections 2020-10-31T22:49:25.766 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 --2- 172.21.15.60:0/1450055027 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61340b13c0 0x7f61340b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 --2- 172.21.15.60:0/1450055027 >> v2:172.21.15.66:3300/0 conn(0x7f6134063140 0x7f6134140360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 --2- 172.21.15.60:0/1450055027 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61340af130 0x7f6134140850 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.767 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 -- 172.21.15.60:0/1450055027 >> 172.21.15.60:0/1450055027 conn(0x7f613406a600 msgr2=0x7f6134060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:25.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 -- 172.21.15.60:0/1450055027 shutdown_connections 2020-10-31T22:49:25.768 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.749+0000 7f613afd9700 1 -- 172.21.15.60:0/1450055027 wait complete. 2020-10-31T22:49:25.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f613afd9700 1 Processor -- start 2020-10-31T22:49:25.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f613afd9700 1 -- start start 2020-10-31T22:49:25.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f613afd9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6134063140 0x7f61340ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:25.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f613afd9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61340af130 0x7f6134063ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:25.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f613afd9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61340b13c0 0x7f6134066650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:25.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f613afd9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6134151c30 con 0x7f61340af130 2020-10-31T22:49:25.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f613afd9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61340649a0 con 0x7f61340b13c0 2020-10-31T22:49:25.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f613afd9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61340ac960 con 0x7f6134063140 2020-10-31T22:49:25.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f61397d6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61340af130 0x7f6134063ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:25.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f61397d6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61340af130 0x7f6134063ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47896/0 (socket says 172.21.15.60:47896) 2020-10-31T22:49:25.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f61397d6700 1 -- 172.21.15.60:0/2263433641 learned_addr learned my addr 172.21.15.60:0/2263433641 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:25.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f6139fd7700 1 --2- 172.21.15.60:0/2263433641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6134063140 0x7f61340ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:25.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f613a7d8700 1 --2- 172.21.15.60:0/2263433641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61340b13c0 0x7f6134066650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:25.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f61397d6700 1 -- 172.21.15.60:0/2263433641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6134063140 msgr2=0x7f61340ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:25.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f61397d6700 1 --2- 172.21.15.60:0/2263433641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6134063140 0x7f61340ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f61397d6700 1 -- 172.21.15.60:0/2263433641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61340b13c0 msgr2=0x7f6134066650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:25.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f61397d6700 1 --2- 172.21.15.60:0/2263433641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61340b13c0 0x7f6134066650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f61397d6700 1 -- 172.21.15.60:0/2263433641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61340a8640 con 0x7f61340af130 2020-10-31T22:49:25.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.753+0000 7f61397d6700 1 --2- 172.21.15.60:0/2263433641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61340af130 0x7f6134063ab0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f6124002f30 tx=0x7f6124015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:25.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.757+0000 7f6122ffd700 1 -- 172.21.15.60:0/2263433641 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6124011b80 con 0x7f61340af130 2020-10-31T22:49:25.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.757+0000 7f6122ffd700 1 -- 172.21.15.60:0/2263433641 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6124011ce0 con 0x7f61340af130 2020-10-31T22:49:25.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.757+0000 7f613afd9700 1 -- 172.21.15.60:0/2263433641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61340acbc0 con 0x7f61340af130 2020-10-31T22:49:25.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.757+0000 7f6122ffd700 1 -- 172.21.15.60:0/2263433641 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f612401e650 con 0x7f61340af130 2020-10-31T22:49:25.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.757+0000 7f613afd9700 1 -- 172.21.15.60:0/2263433641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6134151900 con 0x7f61340af130 2020-10-31T22:49:25.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.757+0000 7f613afd9700 1 -- 172.21.15.60:0/2263433641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61340acd50 con 0x7f61340af130 2020-10-31T22:49:25.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.757+0000 7f6122ffd700 1 -- 172.21.15.60:0/2263433641 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6124025030 con 0x7f61340af130 2020-10-31T22:49:25.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.757+0000 7f6122ffd700 1 --2- 172.21.15.60:0/2263433641 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6114055070 0x7f6114057530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:25.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.757+0000 7f6122ffd700 1 -- 172.21.15.60:0/2263433641 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f612406e990 con 0x7f61340af130 2020-10-31T22:49:25.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.757+0000 7f6139fd7700 1 --2- 172.21.15.60:0/2263433641 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6114055070 0x7f6114057530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:25.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.757+0000 7f6139fd7700 1 --2- 172.21.15.60:0/2263433641 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6114055070 0x7f6114057530 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f613000c000 tx=0x7f6130008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:25.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.765+0000 7f6122ffd700 1 -- 172.21.15.60:0/2263433641 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f61240451e0 con 0x7f61340af130 2020-10-31T22:49:25.912 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.905+0000 7f613afd9700 1 -- 172.21.15.60:0/2263433641 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6134057100 con 0x7f61340af130 2020-10-31T22:49:25.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.909+0000 7f6122ffd700 1 -- 172.21.15.60:0/2263433641 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+13191 (secure 0 0 0) 0x7f6124048800 con 0x7f61340af130 2020-10-31T22:49:25.915 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:25.915 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":116,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:49:25.239510+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:49:25.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.909+0000 7f613afd9700 1 -- 172.21.15.60:0/2263433641 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6114055070 msgr2=0x7f6114057530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:25.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.909+0000 7f613afd9700 1 --2- 172.21.15.60:0/2263433641 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6114055070 0x7f6114057530 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f613000c000 tx=0x7f6130008040).stop 2020-10-31T22:49:25.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.909+0000 7f613afd9700 1 -- 172.21.15.60:0/2263433641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61340af130 msgr2=0x7f6134063ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:25.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.909+0000 7f613afd9700 1 --2- 172.21.15.60:0/2263433641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61340af130 0x7f6134063ab0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 rx=0x7f6124002f30 tx=0x7f6124015000).stop 2020-10-31T22:49:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.909+0000 7f613afd9700 1 -- 172.21.15.60:0/2263433641 shutdown_connections 2020-10-31T22:49:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.909+0000 7f613afd9700 1 --2- 172.21.15.60:0/2263433641 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6114055070 0x7f6114057530 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.909+0000 7f613afd9700 1 --2- 172.21.15.60:0/2263433641 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61340b13c0 0x7f6134066650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.909+0000 7f613afd9700 1 --2- 172.21.15.60:0/2263433641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6134063140 0x7f61340ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.909+0000 7f613afd9700 1 --2- 172.21.15.60:0/2263433641 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61340af130 0x7f6134063ab0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.909+0000 7f613afd9700 1 -- 172.21.15.60:0/2263433641 >> 172.21.15.60:0/2263433641 conn(0x7f613406a600 msgr2=0x7f6134141a60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.909+0000 7f613afd9700 1 -- 172.21.15.60:0/2263433641 shutdown_connections 2020-10-31T22:49:25.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:25.909+0000 7f613afd9700 1 -- 172.21.15.60:0/2263433641 wait complete. 2020-10-31T22:49:25.929 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-31T22:49:25.930 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:49:26.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.041+0000 7f422fa77700 1 Processor -- start 2020-10-31T22:49:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.041+0000 7f422fa77700 1 -- start start 2020-10-31T22:49:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422fa77700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f42280b2790 0x7f42280aff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422fa77700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42280af660 0x7f422813bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422fa77700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42280b2b70 con 0x7f422813c140 2020-10-31T22:49:26.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422fa77700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42280b0410 con 0x7f42280af660 2020-10-31T22:49:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422fa77700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42280b0db0 con 0x7f42280b2790 2020-10-31T22:49:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422d012700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42280af660 0x7f422813bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422e014700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f422813c140 0x7f42280ae520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52042/0 (socket says 172.21.15.60:52042) 2020-10-31T22:49:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422e014700 1 -- 172.21.15.60:0/3391294190 learned_addr learned my addr 172.21.15.60:0/3391294190 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:26.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422d813700 1 --2- 172.21.15.60:0/3391294190 >> v2:172.21.15.66:3300/0 conn(0x7f42280b2790 0x7f42280aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422d012700 1 -- 172.21.15.60:0/3391294190 >> v2:172.21.15.66:3300/0 conn(0x7f42280b2790 msgr2=0x7f42280aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:26.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422d012700 1 --2- 172.21.15.60:0/3391294190 >> v2:172.21.15.66:3300/0 conn(0x7f42280b2790 0x7f42280aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422d012700 1 -- 172.21.15.60:0/3391294190 >> v1:172.21.15.60:6789/0 conn(0x7f422813c140 legacy=0x7f42280ae520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422d012700 1 -- 172.21.15.60:0/3391294190 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42280b1050 con 0x7f42280af660 2020-10-31T22:49:26.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422d012700 1 --2- 172.21.15.60:0/3391294190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42280af660 0x7f422813bc50 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f4224002f30 tx=0x7f4224006dc0).ready entity=mon.0 client_cookie=254e9629ff8f8fb5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:26.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422c811700 1 -- 172.21.15.60:0/3391294190 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42240097b0 con 0x7f42280af660 2020-10-31T22:49:26.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422c811700 1 -- 172.21.15.60:0/3391294190 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4224009910 con 0x7f42280af660 2020-10-31T22:49:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422c811700 1 -- 172.21.15.60:0/3391294190 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4224009c70 con 0x7f42280af660 2020-10-31T22:49:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422fa77700 1 -- 172.21.15.60:0/3391294190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42280af660 msgr2=0x7f422813bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422fa77700 1 --2- 172.21.15.60:0/3391294190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42280af660 0x7f422813bc50 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 rx=0x7f4224002f30 tx=0x7f4224006dc0).stop 2020-10-31T22:49:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422fa77700 1 -- 172.21.15.60:0/3391294190 shutdown_connections 2020-10-31T22:49:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422fa77700 1 --2- 172.21.15.60:0/3391294190 >> v2:172.21.15.66:3300/0 conn(0x7f42280b2790 0x7f42280aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422fa77700 1 --2- 172.21.15.60:0/3391294190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42280af660 0x7f422813bc50 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422fa77700 1 -- 172.21.15.60:0/3391294190 >> 172.21.15.60:0/3391294190 conn(0x7f42280b5d30 msgr2=0x7f42280b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422fa77700 1 -- 172.21.15.60:0/3391294190 shutdown_connections 2020-10-31T22:49:26.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422fa77700 1 -- 172.21.15.60:0/3391294190 wait complete. 2020-10-31T22:49:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.045+0000 7f422fa77700 1 Processor -- start 2020-10-31T22:49:26.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422fa77700 1 -- start start 2020-10-31T22:49:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422fa77700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42280af660 0x7f4228147b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422fa77700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42280b2790 0x7f42281417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422fa77700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f422813c140 0x7f422812e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422fa77700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4228142520 con 0x7f42280af660 2020-10-31T22:49:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422fa77700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42281427c0 con 0x7f422813c140 2020-10-31T22:49:26.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422fa77700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4228142a60 con 0x7f42280b2790 2020-10-31T22:49:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422d813700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42280af660 0x7f4228147b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422d813700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42280af660 0x7f4228147b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47908/0 (socket says 172.21.15.60:47908) 2020-10-31T22:49:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422d813700 1 -- 172.21.15.60:0/1861291848 learned_addr learned my addr 172.21.15.60:0/1861291848 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422d012700 1 --2- 172.21.15.60:0/1861291848 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42280b2790 0x7f42281417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422d813700 1 -- 172.21.15.60:0/1861291848 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42280b2790 msgr2=0x7f42281417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422d813700 1 --2- 172.21.15.60:0/1861291848 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42280b2790 0x7f42281417e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422d813700 1 -- 172.21.15.60:0/1861291848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f422813c140 msgr2=0x7f422812e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422d813700 1 --2- 172.21.15.60:0/1861291848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f422813c140 0x7f422812e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-10-31T22:49:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422d813700 1 -- 172.21.15.60:0/1861291848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228148130 con 0x7f42280af660 2020-10-31T22:49:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422d813700 1 --2- 172.21.15.60:0/1861291848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42280af660 0x7f4228147b00 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f421800c000 tx=0x7f4218006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f4216ffd700 1 -- 172.21.15.60:0/1861291848 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4218019070 con 0x7f42280af660 2020-10-31T22:49:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f4216ffd700 1 -- 172.21.15.60:0/1861291848 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421801e610 con 0x7f42280af660 2020-10-31T22:49:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422fa77700 1 -- 172.21.15.60:0/1861291848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4228132560 con 0x7f42280af660 2020-10-31T22:49:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f4216ffd700 1 -- 172.21.15.60:0/1861291848 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f421801e970 con 0x7f42280af660 2020-10-31T22:49:26.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422fa77700 1 -- 172.21.15.60:0/1861291848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42281332c0 con 0x7f42280af660 2020-10-31T22:49:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f422fa77700 1 -- 172.21.15.60:0/1861291848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4228142c20 con 0x7f42280af660 2020-10-31T22:49:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.049+0000 7f4216ffd700 1 -- 172.21.15.60:0/1861291848 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f421801ead0 con 0x7f42280af660 2020-10-31T22:49:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.053+0000 7f4216ffd700 1 --2- 172.21.15.60:0/1861291848 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4208054f60 0x7f4208057420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.053+0000 7f4216ffd700 1 -- 172.21.15.60:0/1861291848 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f4218075ca0 con 0x7f42280af660 2020-10-31T22:49:26.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.053+0000 7f422d012700 1 --2- 172.21.15.60:0/1861291848 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4208054f60 0x7f4208057420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.053+0000 7f422d012700 1 --2- 172.21.15.60:0/1861291848 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4208054f60 0x7f4208057420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f4224018000 tx=0x7f4224015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:26.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.057+0000 7f4216ffd700 1 -- 172.21.15.60:0/1861291848 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f421804c490 con 0x7f42280af660 2020-10-31T22:49:26.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.201+0000 7f422fa77700 1 -- 172.21.15.60:0/1861291848 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4228142e20 con 0x7f42280af660 2020-10-31T22:49:26.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.201+0000 7f4216ffd700 1 -- 172.21.15.60:0/1861291848 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v116) v1 ==== 110+0+10 (secure 0 0 0) 0x7f421804fab0 con 0x7f42280af660 2020-10-31T22:49:26.206 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:49:26.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.201+0000 7f422fa77700 1 -- 172.21.15.60:0/1861291848 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4208054f60 msgr2=0x7f4208057420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.201+0000 7f422fa77700 1 --2- 172.21.15.60:0/1861291848 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4208054f60 0x7f4208057420 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f4224018000 tx=0x7f4224015000).stop 2020-10-31T22:49:26.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.201+0000 7f422fa77700 1 -- 172.21.15.60:0/1861291848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42280af660 msgr2=0x7f4228147b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.201+0000 7f422fa77700 1 --2- 172.21.15.60:0/1861291848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42280af660 0x7f4228147b00 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 rx=0x7f421800c000 tx=0x7f4218006dc0).stop 2020-10-31T22:49:26.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.201+0000 7f422fa77700 1 -- 172.21.15.60:0/1861291848 shutdown_connections 2020-10-31T22:49:26.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.201+0000 7f422fa77700 1 --2- 172.21.15.60:0/1861291848 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4208054f60 0x7f4208057420 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.201+0000 7f422fa77700 1 --2- 172.21.15.60:0/1861291848 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f422813c140 0x7f422812e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-10-31T22:49:26.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.201+0000 7f422fa77700 1 --2- 172.21.15.60:0/1861291848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42280af660 0x7f4228147b00 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.201+0000 7f422fa77700 1 --2- 172.21.15.60:0/1861291848 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42280b2790 0x7f42281417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.201+0000 7f422fa77700 1 -- 172.21.15.60:0/1861291848 >> 172.21.15.60:0/1861291848 conn(0x7f42280b5d30 msgr2=0x7f42280ac610 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:26.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.201+0000 7f422fa77700 1 -- 172.21.15.60:0/1861291848 shutdown_connections 2020-10-31T22:49:26.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.201+0000 7f422fa77700 1 -- 172.21.15.60:0/1861291848 wait complete. 2020-10-31T22:49:26.225 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:49:26.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.341+0000 7f52d2853700 1 Processor -- start 2020-10-31T22:49:26.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.341+0000 7f52d2853700 1 -- start start 2020-10-31T22:49:26.348 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.341+0000 7f52d2853700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52cc05bbb0 0x7f52cc13ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.341+0000 7f52d2853700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f52cc0ae030 0x7f52cc0ac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.341+0000 7f52d2853700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52cc05bf90 con 0x7f52cc0ac770 2020-10-31T22:49:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.341+0000 7f52d2853700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52cc0ab410 con 0x7f52cc0ae030 2020-10-31T22:49:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.341+0000 7f52d2853700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc0acc00 con 0x7f52cc05bbb0 2020-10-31T22:49:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.341+0000 7f52d1050700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f52cc0ae030 0x7f52cc0ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.341+0000 7f52d1851700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52cc05bbb0 0x7f52cc13ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.341+0000 7f52d1050700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f52cc0ae030 0x7f52cc0ac280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:58852/0 (socket says 172.21.15.60:58852) 2020-10-31T22:49:26.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.341+0000 7f52d1050700 1 -- 172.21.15.60:0/679586064 learned_addr learned my addr 172.21.15.60:0/679586064 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:26.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d1050700 1 -- 172.21.15.60:0/679586064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52cc05bbb0 msgr2=0x7f52cc13ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:26.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d1050700 1 --2- 172.21.15.60:0/679586064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52cc05bbb0 0x7f52cc13ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.351 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d1050700 1 -- 172.21.15.60:0/679586064 >> v1:172.21.15.66:6789/0 conn(0x7f52cc0ac770 legacy=0x7f52cc05afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d1050700 1 -- 172.21.15.60:0/679586064 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc0ab600 con 0x7f52cc0ae030 2020-10-31T22:49:26.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d1050700 1 --2- 172.21.15.60:0/679586064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52cc0ae030 0x7f52cc0ac280 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f52c8002f30 tx=0x7f52c8006e80).ready entity=mon.1 client_cookie=8bd5336804f16f0a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:26.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d084f700 1 -- 172.21.15.60:0/679586064 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c8009880 con 0x7f52cc0ae030 2020-10-31T22:49:26.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d084f700 1 -- 172.21.15.60:0/679586064 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c80099e0 con 0x7f52cc0ae030 2020-10-31T22:49:26.352 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d084f700 1 -- 172.21.15.60:0/679586064 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c8009d40 con 0x7f52cc0ae030 2020-10-31T22:49:26.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d2853700 1 -- 172.21.15.60:0/679586064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52cc0ae030 msgr2=0x7f52cc0ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d2853700 1 --2- 172.21.15.60:0/679586064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52cc0ae030 0x7f52cc0ac280 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f52c8002f30 tx=0x7f52c8006e80).stop 2020-10-31T22:49:26.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d2853700 1 -- 172.21.15.60:0/679586064 shutdown_connections 2020-10-31T22:49:26.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d2853700 1 --2- 172.21.15.60:0/679586064 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52cc05bbb0 0x7f52cc13ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d2853700 1 --2- 172.21.15.60:0/679586064 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52cc0ae030 0x7f52cc0ac280 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d2853700 1 -- 172.21.15.60:0/679586064 >> 172.21.15.60:0/679586064 conn(0x7f52cc0b3fd0 msgr2=0x7f52cc0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:26.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d2853700 1 -- 172.21.15.60:0/679586064 shutdown_connections 2020-10-31T22:49:26.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d2853700 1 -- 172.21.15.60:0/679586064 wait complete. 2020-10-31T22:49:26.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d2853700 1 Processor -- start 2020-10-31T22:49:26.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.345+0000 7f52d2853700 1 -- start start 2020-10-31T22:49:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d2853700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52cc05bbb0 0x7f52cc0af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d2853700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52cc0ac770 0x7f52cc13c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d2853700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52cc0ae030 0x7f52cc135fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d2853700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc1343d0 con 0x7f52cc0ac770 2020-10-31T22:49:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d2853700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc13db80 con 0x7f52cc05bbb0 2020-10-31T22:49:26.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d2853700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc1345c0 con 0x7f52cc0ae030 2020-10-31T22:49:26.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d1050700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52cc0ac770 0x7f52cc13c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d1050700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52cc0ac770 0x7f52cc13c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47924/0 (socket says 172.21.15.60:47924) 2020-10-31T22:49:26.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d1050700 1 -- 172.21.15.60:0/1512872608 learned_addr learned my addr 172.21.15.60:0/1512872608 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:26.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d1851700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52cc05bbb0 0x7f52cc0af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d2052700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52cc0ae030 0x7f52cc135fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d1050700 1 -- 172.21.15.60:0/1512872608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52cc0ae030 msgr2=0x7f52cc135fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d1050700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52cc0ae030 0x7f52cc135fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d1050700 1 -- 172.21.15.60:0/1512872608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52cc05bbb0 msgr2=0x7f52cc0af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d1050700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52cc05bbb0 0x7f52cc0af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d1050700 1 -- 172.21.15.60:0/1512872608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52cc13dde0 con 0x7f52cc0ac770 2020-10-31T22:49:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d1851700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52cc05bbb0 0x7f52cc0af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d1050700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52cc0ac770 0x7f52cc13c030 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f52c8002f30 tx=0x7f52c8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:26.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52beffd700 1 -- 172.21.15.60:0/1512872608 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c8011b80 con 0x7f52cc0ac770 2020-10-31T22:49:26.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52beffd700 1 -- 172.21.15.60:0/1512872608 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c8011ce0 con 0x7f52cc0ac770 2020-10-31T22:49:26.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d2853700 1 -- 172.21.15.60:0/1512872608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc135b00 con 0x7f52cc0ac770 2020-10-31T22:49:26.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52beffd700 1 -- 172.21.15.60:0/1512872608 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52c801e650 con 0x7f52cc0ac770 2020-10-31T22:49:26.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.349+0000 7f52d2853700 1 -- 172.21.15.60:0/1512872608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc0a9880 con 0x7f52cc0ac770 2020-10-31T22:49:26.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.353+0000 7f52d2853700 1 -- 172.21.15.60:0/1512872608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52cc057100 con 0x7f52cc0ac770 2020-10-31T22:49:26.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.353+0000 7f52beffd700 1 -- 172.21.15.60:0/1512872608 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f52c8025030 con 0x7f52cc0ac770 2020-10-31T22:49:26.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.353+0000 7f52beffd700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f52ac054f90 0x7f52ac057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.362 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.353+0000 7f52beffd700 1 -- 172.21.15.60:0/1512872608 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f52c806eb50 con 0x7f52cc0ac770 2020-10-31T22:49:26.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.353+0000 7f52d1851700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f52ac054f90 0x7f52ac057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.353+0000 7f52d1851700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f52ac054f90 0x7f52ac057450 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f52c0006000 tx=0x7f52c0006d60).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:26.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.361+0000 7f52beffd700 1 -- 172.21.15.60:0/1512872608 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f52c8045340 con 0x7f52cc0ac770 2020-10-31T22:49:26.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.505+0000 7f52d2853700 1 -- 172.21.15.60:0/1512872608 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f52cc135c90 con 0x7f52cc0ac770 2020-10-31T22:49:26.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.505+0000 7f52beffd700 1 -- 172.21.15.60:0/1512872608 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v116) v1 ==== 92+0+10 (secure 0 0 0) 0x7f52c8048920 con 0x7f52cc0ac770 2020-10-31T22:49:26.511 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:49:26.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.505+0000 7f52d2853700 1 -- 172.21.15.60:0/1512872608 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f52ac054f90 msgr2=0x7f52ac057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.512 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.505+0000 7f52d2853700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f52ac054f90 0x7f52ac057450 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f52c0006000 tx=0x7f52c0006d60).stop 2020-10-31T22:49:26.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.505+0000 7f52d2853700 1 -- 172.21.15.60:0/1512872608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52cc0ac770 msgr2=0x7f52cc13c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.505+0000 7f52d2853700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52cc0ac770 0x7f52cc13c030 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 rx=0x7f52c8002f30 tx=0x7f52c8015000).stop 2020-10-31T22:49:26.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.505+0000 7f52d2853700 1 -- 172.21.15.60:0/1512872608 shutdown_connections 2020-10-31T22:49:26.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.505+0000 7f52d2853700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52cc0ae030 0x7f52cc135fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.505+0000 7f52d2853700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f52ac054f90 0x7f52ac057450 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.505+0000 7f52d2853700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52cc05bbb0 0x7f52cc0af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.505+0000 7f52d2853700 1 --2- 172.21.15.60:0/1512872608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f52cc0ac770 0x7f52cc13c030 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.505+0000 7f52d2853700 1 -- 172.21.15.60:0/1512872608 >> 172.21.15.60:0/1512872608 conn(0x7f52cc0b3fd0 msgr2=0x7f52cc0a7590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:26.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.505+0000 7f52d2853700 1 -- 172.21.15.60:0/1512872608 shutdown_connections 2020-10-31T22:49:26.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.505+0000 7f52d2853700 1 -- 172.21.15.60:0/1512872608 wait complete. 2020-10-31T22:49:26.524 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-10-31T22:49:26.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 Processor -- start 2020-10-31T22:49:26.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 -- start start 2020-10-31T22:49:26.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38d00af520 0x7f38d00ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38d00670f0 0x7f38d0150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38d00af900 con 0x7f38d0066c90 2020-10-31T22:49:26.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38d00afc10 con 0x7f38d00af520 2020-10-31T22:49:26.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d005bb70 con 0x7f38d00670f0 2020-10-31T22:49:26.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38ceffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38d00af520 0x7f38d00ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38ceffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f38d00af520 0x7f38d00ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47930/0 (socket says 172.21.15.60:47930) 2020-10-31T22:49:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38ceffd700 1 -- 172.21.15.60:0/3310073996 learned_addr learned my addr 172.21.15.60:0/3310073996 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cf7fe700 1 --2- 172.21.15.60:0/3310073996 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38d00670f0 0x7f38d0150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38ceffd700 1 -- 172.21.15.60:0/3310073996 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38d00670f0 msgr2=0x7f38d0150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38ceffd700 1 --2- 172.21.15.60:0/3310073996 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38d00670f0 0x7f38d0150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38ceffd700 1 -- 172.21.15.60:0/3310073996 >> v1:172.21.15.66:6789/0 conn(0x7f38d0066c90 legacy=0x7f38d0146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38ceffd700 1 -- 172.21.15.60:0/3310073996 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d00ac130 con 0x7f38d00af520 2020-10-31T22:49:26.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38ceffd700 1 --2- 172.21.15.60:0/3310073996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00af520 0x7f38d00ac870 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f38c80032b0 tx=0x7f38c8009270).ready entity=mon.0 client_cookie=de6524300ac4bc22 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:26.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cdffb700 1 -- 172.21.15.60:0/3310073996 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38c8009e60 con 0x7f38d00af520 2020-10-31T22:49:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cdffb700 1 -- 172.21.15.60:0/3310073996 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c800bc00 con 0x7f38d00af520 2020-10-31T22:49:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cdffb700 1 -- 172.21.15.60:0/3310073996 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38c800bd70 con 0x7f38d00af520 2020-10-31T22:49:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 -- 172.21.15.60:0/3310073996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00af520 msgr2=0x7f38d00ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 --2- 172.21.15.60:0/3310073996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00af520 0x7f38d00ac870 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 rx=0x7f38c80032b0 tx=0x7f38c8009270).stop 2020-10-31T22:49:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 -- 172.21.15.60:0/3310073996 shutdown_connections 2020-10-31T22:49:26.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 --2- 172.21.15.60:0/3310073996 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38d00670f0 0x7f38d0150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 --2- 172.21.15.60:0/3310073996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d00af520 0x7f38d00ac870 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 -- 172.21.15.60:0/3310073996 >> 172.21.15.60:0/3310073996 conn(0x7f38d00b3fd0 msgr2=0x7f38d00b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 -- 172.21.15.60:0/3310073996 shutdown_connections 2020-10-31T22:49:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.637+0000 7f38cffff700 1 -- 172.21.15.60:0/3310073996 wait complete. 2020-10-31T22:49:26.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.641+0000 7f38cffff700 1 Processor -- start 2020-10-31T22:49:26.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.641+0000 7f38cffff700 1 -- start start 2020-10-31T22:49:26.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d0066c90 0x7f38d00aa640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38cffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38d00670f0 0x7f38d0155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38cffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38d00af520 0x7f38d0158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38cffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0155610 con 0x7f38d0066c90 2020-10-31T22:49:26.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38cffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d01495e0 con 0x7f38d00af520 2020-10-31T22:49:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38cffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d0158800 con 0x7f38d00670f0 2020-10-31T22:49:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38ceffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d0066c90 0x7f38d00aa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38ceffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d0066c90 0x7f38d00aa640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47936/0 (socket says 172.21.15.60:47936) 2020-10-31T22:49:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38ceffd700 1 -- 172.21.15.60:0/4038295677 learned_addr learned my addr 172.21.15.60:0/4038295677 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38ce7fc700 1 --2- 172.21.15.60:0/4038295677 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38d00670f0 0x7f38d0155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38cf7fe700 1 --2- 172.21.15.60:0/4038295677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38d00af520 0x7f38d0158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38ceffd700 1 -- 172.21.15.60:0/4038295677 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38d00670f0 msgr2=0x7f38d0155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38ceffd700 1 --2- 172.21.15.60:0/4038295677 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38d00670f0 0x7f38d0155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38ceffd700 1 -- 172.21.15.60:0/4038295677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38d00af520 msgr2=0x7f38d0158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38ceffd700 1 --2- 172.21.15.60:0/4038295677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38d00af520 0x7f38d0158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38ceffd700 1 -- 172.21.15.60:0/4038295677 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d0158aa0 con 0x7f38d0066c90 2020-10-31T22:49:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38ceffd700 1 --2- 172.21.15.60:0/4038295677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d0066c90 0x7f38d00aa640 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f38c80032b0 tx=0x7f38c8016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38c7fff700 1 -- 172.21.15.60:0/4038295677 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38c801f5e0 con 0x7f38d0066c90 2020-10-31T22:49:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38c7fff700 1 -- 172.21.15.60:0/4038295677 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38c801f740 con 0x7f38d0066c90 2020-10-31T22:49:26.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38cffff700 1 -- 172.21.15.60:0/4038295677 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38d0062650 con 0x7f38d0066c90 2020-10-31T22:49:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38c7fff700 1 -- 172.21.15.60:0/4038295677 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f38c801faa0 con 0x7f38d0066c90 2020-10-31T22:49:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38cffff700 1 -- 172.21.15.60:0/4038295677 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38d01595d0 con 0x7f38d0066c90 2020-10-31T22:49:26.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.645+0000 7f38cffff700 1 -- 172.21.15.60:0/4038295677 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38d0158c30 con 0x7f38d0066c90 2020-10-31T22:49:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.649+0000 7f38c7fff700 1 -- 172.21.15.60:0/4038295677 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f38c8026030 con 0x7f38d0066c90 2020-10-31T22:49:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.649+0000 7f38c7fff700 1 --2- 172.21.15.60:0/4038295677 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f38b4054f10 0x7f38b40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.649+0000 7f38c7fff700 1 -- 172.21.15.60:0/4038295677 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f38c806e6f0 con 0x7f38d0066c90 2020-10-31T22:49:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.649+0000 7f38ce7fc700 1 --2- 172.21.15.60:0/4038295677 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f38b4054f10 0x7f38b40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.649+0000 7f38ce7fc700 1 --2- 172.21.15.60:0/4038295677 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f38b4054f10 0x7f38b40573d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f38b800d000 tx=0x7f38b8007b60).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:26.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.653+0000 7f38c7fff700 1 -- 172.21.15.60:0/4038295677 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f38c8044f40 con 0x7f38d0066c90 2020-10-31T22:49:26.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.793+0000 7f38cffff700 1 -- 172.21.15.60:0/4038295677 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f38d01497a0 con 0x7f38d0066c90 2020-10-31T22:49:26.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.793+0000 7f38c7fff700 1 -- 172.21.15.60:0/4038295677 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v116) v1 ==== 84+0+143 (secure 0 0 0) 0x7f38c8024090 con 0x7f38d0066c90 2020-10-31T22:49:26.800 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:26.800 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2020-10-31T22:49:26.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:26.800 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2020-10-31T22:49:26.801 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "device_health_metrics" 2020-10-31T22:49:26.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:26.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:26.801 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2020-10-31T22:49:26.801 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2020-10-31T22:49:26.801 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:26.802 INFO:teuthology.orchestra.run.smithi060.stdout:] 2020-10-31T22:49:26.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.793+0000 7f38cffff700 1 -- 172.21.15.60:0/4038295677 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f38b4054f10 msgr2=0x7f38b40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.793+0000 7f38cffff700 1 --2- 172.21.15.60:0/4038295677 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f38b4054f10 0x7f38b40573d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f38b800d000 tx=0x7f38b8007b60).stop 2020-10-31T22:49:26.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.793+0000 7f38cffff700 1 -- 172.21.15.60:0/4038295677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d0066c90 msgr2=0x7f38d00aa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.793+0000 7f38cffff700 1 --2- 172.21.15.60:0/4038295677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d0066c90 0x7f38d00aa640 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 rx=0x7f38c80032b0 tx=0x7f38c8016000).stop 2020-10-31T22:49:26.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.793+0000 7f38cffff700 1 -- 172.21.15.60:0/4038295677 shutdown_connections 2020-10-31T22:49:26.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.793+0000 7f38cffff700 1 --2- 172.21.15.60:0/4038295677 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f38b4054f10 0x7f38b40573d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.793+0000 7f38cffff700 1 --2- 172.21.15.60:0/4038295677 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38d00af520 0x7f38d0158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.793+0000 7f38cffff700 1 --2- 172.21.15.60:0/4038295677 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38d0066c90 0x7f38d00aa640 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.793+0000 7f38cffff700 1 --2- 172.21.15.60:0/4038295677 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38d00670f0 0x7f38d0155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.793+0000 7f38cffff700 1 -- 172.21.15.60:0/4038295677 >> 172.21.15.60:0/4038295677 conn(0x7f38d00b3fd0 msgr2=0x7f38d0145350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:26.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.797+0000 7f38cffff700 1 -- 172.21.15.60:0/4038295677 shutdown_connections 2020-10-31T22:49:26.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.797+0000 7f38cffff700 1 -- 172.21.15.60:0/4038295677 wait complete. 2020-10-31T22:49:26.813 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-10-31T22:49:26.814 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:49:26.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.929+0000 7fe6f510d700 1 Processor -- start 2020-10-31T22:49:26.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.929+0000 7fe6f510d700 1 -- start start 2020-10-31T22:49:26.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6f0062e00 0x7fe6f00af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe6f013ef60 0x7fe6f013f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6f0141cf0 con 0x7fe6f00af0e0 2020-10-31T22:49:26.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6f0145af0 con 0x7fe6f013ef60 2020-10-31T22:49:26.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0145d90 con 0x7fe6f0062e00 2020-10-31T22:49:26.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f490c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe6f013ef60 0x7fe6f013f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f490c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe6f013ef60 0x7fe6f013f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47948/0 (socket says 172.21.15.60:47948) 2020-10-31T22:49:26.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f490c700 1 -- 172.21.15.60:0/147253100 learned_addr learned my addr 172.21.15.60:0/147253100 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:26.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6ef7fe700 1 --2- 172.21.15.60:0/147253100 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6f0062e00 0x7fe6f00af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f490c700 1 -- 172.21.15.60:0/147253100 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6f0062e00 msgr2=0x7fe6f00af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:26.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f490c700 1 --2- 172.21.15.60:0/147253100 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6f0062e00 0x7fe6f00af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f490c700 1 -- 172.21.15.60:0/147253100 >> v1:172.21.15.66:6789/0 conn(0x7fe6f00af0e0 legacy=0x7fe6f0145330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f490c700 1 -- 172.21.15.60:0/147253100 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f013f880 con 0x7fe6f013ef60 2020-10-31T22:49:26.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6ef7fe700 1 --2- 172.21.15.60:0/147253100 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6f0062e00 0x7fe6f00af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:26.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f490c700 1 --2- 172.21.15.60:0/147253100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f013ef60 0x7fe6f013f390 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7fe6e8002f30 tx=0x7fe6e8006e80).ready entity=mon.0 client_cookie=289cdf9c03c7ae0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:26.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6eeffd700 1 -- 172.21.15.60:0/147253100 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e80097f0 con 0x7fe6f013ef60 2020-10-31T22:49:26.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6eeffd700 1 -- 172.21.15.60:0/147253100 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e8009950 con 0x7fe6f013ef60 2020-10-31T22:49:26.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6eeffd700 1 -- 172.21.15.60:0/147253100 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e8009cf0 con 0x7fe6f013ef60 2020-10-31T22:49:26.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 -- 172.21.15.60:0/147253100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f013ef60 msgr2=0x7fe6f013f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 --2- 172.21.15.60:0/147253100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f013ef60 0x7fe6f013f390 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 rx=0x7fe6e8002f30 tx=0x7fe6e8006e80).stop 2020-10-31T22:49:26.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 -- 172.21.15.60:0/147253100 shutdown_connections 2020-10-31T22:49:26.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 --2- 172.21.15.60:0/147253100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f013ef60 0x7fe6f013f390 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 --2- 172.21.15.60:0/147253100 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6f0062e00 0x7fe6f00af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 -- 172.21.15.60:0/147253100 >> 172.21.15.60:0/147253100 conn(0x7fe6f006a600 msgr2=0x7fe6f0060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:26.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 -- 172.21.15.60:0/147253100 shutdown_connections 2020-10-31T22:49:26.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 -- 172.21.15.60:0/147253100 wait complete. 2020-10-31T22:49:26.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 Processor -- start 2020-10-31T22:49:26.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.933+0000 7fe6f510d700 1 -- start start 2020-10-31T22:49:26.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6f510d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6f0062e00 0x7fe6f00b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6f510d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f00af0e0 0x7fe6f0150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6f510d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f013ef60 0x7fe6f0151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6f510d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0147900 con 0x7fe6f00af0e0 2020-10-31T22:49:26.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6f510d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f0148240 con 0x7fe6f013ef60 2020-10-31T22:49:26.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6f510d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f01484e0 con 0x7fe6f0062e00 2020-10-31T22:49:26.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f00af0e0 0x7fe6f0150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6ef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f00af0e0 0x7fe6f0150f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47954/0 (socket says 172.21.15.60:47954) 2020-10-31T22:49:26.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6ef7fe700 1 -- 172.21.15.60:0/674550665 learned_addr learned my addr 172.21.15.60:0/674550665 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:26.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6f490c700 1 --2- 172.21.15.60:0/674550665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f013ef60 0x7fe6f0151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6effff700 1 --2- 172.21.15.60:0/674550665 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6f0062e00 0x7fe6f00b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6ef7fe700 1 -- 172.21.15.60:0/674550665 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6f0062e00 msgr2=0x7fe6f00b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6ef7fe700 1 --2- 172.21.15.60:0/674550665 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6f0062e00 0x7fe6f00b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6ef7fe700 1 -- 172.21.15.60:0/674550665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f013ef60 msgr2=0x7fe6f0151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:26.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6ef7fe700 1 --2- 172.21.15.60:0/674550665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f013ef60 0x7fe6f0151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:26.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6ef7fe700 1 -- 172.21.15.60:0/674550665 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0150a80 con 0x7fe6f00af0e0 2020-10-31T22:49:26.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6ef7fe700 1 --2- 172.21.15.60:0/674550665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f00af0e0 0x7fe6f0150f20 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fe6e4006910 tx=0x7fe6e4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:26.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6ed7fa700 1 -- 172.21.15.60:0/674550665 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e4009a10 con 0x7fe6f00af0e0 2020-10-31T22:49:26.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6f510d700 1 -- 172.21.15.60:0/674550665 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6f0147580 con 0x7fe6f00af0e0 2020-10-31T22:49:26.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6ed7fa700 1 -- 172.21.15.60:0/674550665 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6e4009b70 con 0x7fe6f00af0e0 2020-10-31T22:49:26.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6ed7fa700 1 -- 172.21.15.60:0/674550665 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6e400de40 con 0x7fe6f00af0e0 2020-10-31T22:49:26.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.937+0000 7fe6f510d700 1 -- 172.21.15.60:0/674550665 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6f0148ae0 con 0x7fe6f00af0e0 2020-10-31T22:49:26.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.941+0000 7fe6ed7fa700 1 -- 172.21.15.60:0/674550665 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe6e4013480 con 0x7fe6f00af0e0 2020-10-31T22:49:26.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.941+0000 7fe6f510d700 1 -- 172.21.15.60:0/674550665 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6f0150c10 con 0x7fe6f00af0e0 2020-10-31T22:49:26.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.941+0000 7fe6ed7fa700 1 --2- 172.21.15.60:0/674550665 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6d0055050 0x7fe6d0057510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:26.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.941+0000 7fe6effff700 1 --2- 172.21.15.60:0/674550665 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6d0055050 0x7fe6d0057510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:26.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.941+0000 7fe6ed7fa700 1 -- 172.21.15.60:0/674550665 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe6e406df10 con 0x7fe6f00af0e0 2020-10-31T22:49:26.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.941+0000 7fe6effff700 1 --2- 172.21.15.60:0/674550665 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6d0055050 0x7fe6d0057510 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fe6e000d000 tx=0x7fe6e0007f90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:26.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:26.949+0000 7fe6ed7fa700 1 -- 172.21.15.60:0/674550665 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe6e40445f0 con 0x7fe6f00af0e0 2020-10-31T22:49:27.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:27.093+0000 7fe6f510d700 1 -- 172.21.15.60:0/674550665 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fe6f0147710 con 0x7fe6f00af0e0 2020-10-31T22:49:28.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.069+0000 7fe6ed7fa700 1 -- 172.21.15.60:0/674550665 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v117) v1 ==== 133+0+0 (secure 0 0 0) 0x7fe6e400b220 con 0x7fe6f00af0e0 2020-10-31T22:49:28.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.073+0000 7fe6f510d700 1 -- 172.21.15.60:0/674550665 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6d0055050 msgr2=0x7fe6d0057510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:28.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.073+0000 7fe6f510d700 1 --2- 172.21.15.60:0/674550665 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6d0055050 0x7fe6d0057510 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7fe6e000d000 tx=0x7fe6e0007f90).stop 2020-10-31T22:49:28.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.073+0000 7fe6f510d700 1 -- 172.21.15.60:0/674550665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f00af0e0 msgr2=0x7fe6f0150f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:28.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.073+0000 7fe6f510d700 1 --2- 172.21.15.60:0/674550665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f00af0e0 0x7fe6f0150f20 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 rx=0x7fe6e4006910 tx=0x7fe6e4008040).stop 2020-10-31T22:49:28.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.073+0000 7fe6f510d700 1 -- 172.21.15.60:0/674550665 shutdown_connections 2020-10-31T22:49:28.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.073+0000 7fe6f510d700 1 --2- 172.21.15.60:0/674550665 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe6d0055050 0x7fe6d0057510 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:28.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.073+0000 7fe6f510d700 1 --2- 172.21.15.60:0/674550665 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe6f013ef60 0x7fe6f0151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.073+0000 7fe6f510d700 1 --2- 172.21.15.60:0/674550665 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe6f0062e00 0x7fe6f00b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.073+0000 7fe6f510d700 1 --2- 172.21.15.60:0/674550665 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe6f00af0e0 0x7fe6f0150f20 secure :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 rx=0x7fe6e4006910 tx=0x7fe6e4008040).stop 2020-10-31T22:49:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.073+0000 7fe6f510d700 1 -- 172.21.15.60:0/674550665 >> 172.21.15.60:0/674550665 conn(0x7fe6f006a600 msgr2=0x7fe6f00ad940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:28.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.073+0000 7fe6f510d700 1 -- 172.21.15.60:0/674550665 shutdown_connections 2020-10-31T22:49:28.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.073+0000 7fe6f510d700 1 -- 172.21.15.60:0/674550665 wait complete. 2020-10-31T22:49:28.086 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:49:28.093 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-10-31T22:49:28.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.205+0000 7f3d7bfff700 1 Processor -- start 2020-10-31T22:49:28.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.205+0000 7f3d7bfff700 1 -- start start 2020-10-31T22:49:28.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.205+0000 7f3d7bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d7c0b1bb0 0x7f3d7c05afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.205+0000 7f3d7bfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3d7c0af580 0x7f3d7c13fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.205+0000 7f3d7bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d7c0ab150 0x7f3d7c0ab5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.205+0000 7f3d7bfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7c0b1120 con 0x7f3d7c0b1bb0 2020-10-31T22:49:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.205+0000 7f3d7bfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d7c0af9c0 con 0x7f3d7c0af580 2020-10-31T22:49:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.205+0000 7f3d7bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c0a8850 con 0x7f3d7c0ab150 2020-10-31T22:49:28.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.205+0000 7f3d7affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d7c0b1bb0 0x7f3d7c05afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.205+0000 7f3d7affd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d7c0b1bb0 0x7f3d7c05afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47958/0 (socket says 172.21.15.60:47958) 2020-10-31T22:49:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.205+0000 7f3d7affd700 1 -- 172.21.15.60:0/4258006322 learned_addr learned my addr 172.21.15.60:0/4258006322 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.205+0000 7f3d7a7fc700 1 --2- 172.21.15.60:0/4258006322 >> v2:172.21.15.66:3300/0 conn(0x7f3d7c0af580 0x7f3d7c13fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:28.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.205+0000 7f3d7b7fe700 1 --2- 172.21.15.60:0/4258006322 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d7c0ab150 0x7f3d7c0ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:28.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.205+0000 7f3d7affd700 1 -- 172.21.15.60:0/4258006322 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d7c0ab150 msgr2=0x7f3d7c0ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7affd700 1 --2- 172.21.15.60:0/4258006322 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d7c0ab150 0x7f3d7c0ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7affd700 1 -- 172.21.15.60:0/4258006322 >> v2:172.21.15.66:3300/0 conn(0x7f3d7c0af580 msgr2=0x7f3d7c13fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7affd700 1 --2- 172.21.15.60:0/4258006322 >> v2:172.21.15.66:3300/0 conn(0x7f3d7c0af580 0x7f3d7c13fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7affd700 1 -- 172.21.15.60:0/4258006322 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c0a8af0 con 0x7f3d7c0b1bb0 2020-10-31T22:49:28.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7affd700 1 --2- 172.21.15.60:0/4258006322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d7c0b1bb0 0x7f3d7c05afe0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f3d6c002f30 tx=0x7f3d6c006e80).ready entity=mon.0 client_cookie=400dd91b9a1b1cc0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d79ffb700 1 -- 172.21.15.60:0/4258006322 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d6c009640 con 0x7f3d7c0b1bb0 2020-10-31T22:49:28.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d79ffb700 1 -- 172.21.15.60:0/4258006322 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c0097a0 con 0x7f3d7c0b1bb0 2020-10-31T22:49:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d79ffb700 1 -- 172.21.15.60:0/4258006322 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d6c009b00 con 0x7f3d7c0b1bb0 2020-10-31T22:49:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7bfff700 1 -- 172.21.15.60:0/4258006322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d7c0b1bb0 msgr2=0x7f3d7c05afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7bfff700 1 --2- 172.21.15.60:0/4258006322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d7c0b1bb0 0x7f3d7c05afe0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 rx=0x7f3d6c002f30 tx=0x7f3d6c006e80).stop 2020-10-31T22:49:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7bfff700 1 -- 172.21.15.60:0/4258006322 shutdown_connections 2020-10-31T22:49:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7bfff700 1 --2- 172.21.15.60:0/4258006322 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d7c0ab150 0x7f3d7c0ab5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7bfff700 1 --2- 172.21.15.60:0/4258006322 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d7c0b1bb0 0x7f3d7c05afe0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:28.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7bfff700 1 --2- 172.21.15.60:0/4258006322 >> v2:172.21.15.66:3300/0 conn(0x7f3d7c0af580 0x7f3d7c13fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7bfff700 1 -- 172.21.15.60:0/4258006322 >> 172.21.15.60:0/4258006322 conn(0x7f3d7c0b5330 msgr2=0x7f3d7c0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7bfff700 1 -- 172.21.15.60:0/4258006322 shutdown_connections 2020-10-31T22:49:28.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7bfff700 1 -- 172.21.15.60:0/4258006322 wait complete. 2020-10-31T22:49:28.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7bfff700 1 Processor -- start 2020-10-31T22:49:28.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.209+0000 7f3d7bfff700 1 -- start start 2020-10-31T22:49:28.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d7c0ab150 0x7f3d7c142a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:28.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d7c0af580 0x7f3d7c13e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:28.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d7c0b1bb0 0x7f3d7c13e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:28.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c13ef80 con 0x7f3d7c0b1bb0 2020-10-31T22:49:28.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7bfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c0668f0 con 0x7f3d7c0af580 2020-10-31T22:49:28.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7c13f1b0 con 0x7f3d7c0ab150 2020-10-31T22:49:28.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7affd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d7c0ab150 0x7f3d7c142a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:28.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d7c0b1bb0 0x7f3d7c13e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:28.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7affd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d7c0ab150 0x7f3d7c142a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:32920/0 (socket says 172.21.15.60:32920) 2020-10-31T22:49:28.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d7c0b1bb0 0x7f3d7c13e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47968/0 (socket says 172.21.15.60:47968) 2020-10-31T22:49:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7affd700 1 -- 172.21.15.60:0/1666521469 learned_addr learned my addr 172.21.15.60:0/1666521469 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7a7fc700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d7c0af580 0x7f3d7c13e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7affd700 1 -- 172.21.15.60:0/1666521469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d7c0af580 msgr2=0x7f3d7c13e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7affd700 1 --2- 172.21.15.60:0/1666521469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d7c0af580 0x7f3d7c13e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7affd700 1 -- 172.21.15.60:0/1666521469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d7c0b1bb0 msgr2=0x7f3d7c13e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7affd700 1 --2- 172.21.15.60:0/1666521469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d7c0b1bb0 0x7f3d7c13e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7affd700 1 -- 172.21.15.60:0/1666521469 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7c066b90 con 0x7f3d7c0ab150 2020-10-31T22:49:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7affd700 1 --2- 172.21.15.60:0/1666521469 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d7c0ab150 0x7f3d7c142a90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f3d7c063980 tx=0x7f3d6c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d6bfff700 1 -- 172.21.15.60:0/1666521469 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d6c011a90 con 0x7f3d7c0ab150 2020-10-31T22:49:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d6bfff700 1 -- 172.21.15.60:0/1666521469 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c011bf0 con 0x7f3d7c0ab150 2020-10-31T22:49:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7bfff700 1 -- 172.21.15.60:0/1666521469 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d7c143960 con 0x7f3d7c0ab150 2020-10-31T22:49:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d6bfff700 1 -- 172.21.15.60:0/1666521469 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d6c01d450 con 0x7f3d7c0ab150 2020-10-31T22:49:28.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.213+0000 7f3d7bfff700 1 -- 172.21.15.60:0/1666521469 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d7c142f80 con 0x7f3d7c0ab150 2020-10-31T22:49:28.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.217+0000 7f3d7bfff700 1 -- 172.21.15.60:0/1666521469 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d7c057100 con 0x7f3d7c0ab150 2020-10-31T22:49:28.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.217+0000 7f3d6bfff700 1 -- 172.21.15.60:0/1666521469 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3d6c00f070 con 0x7f3d7c0ab150 2020-10-31T22:49:28.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.217+0000 7f3d6bfff700 1 --2- 172.21.15.60:0/1666521469 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d580550c0 0x7f3d58057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:28.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.217+0000 7f3d7a7fc700 1 --2- 172.21.15.60:0/1666521469 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d580550c0 0x7f3d58057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:28.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.217+0000 7f3d6bfff700 1 -- 172.21.15.60:0/1666521469 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f3d6c06f1f0 con 0x7f3d7c0ab150 2020-10-31T22:49:28.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.217+0000 7f3d7a7fc700 1 --2- 172.21.15.60:0/1666521469 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d580550c0 0x7f3d58057580 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f3d7000b000 tx=0x7f3d70006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:28.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.229+0000 7f3d6bfff700 1 -- 172.21.15.60:0/1666521469 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3d6c045880 con 0x7f3d7c0ab150 2020-10-31T22:49:28.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:28.369+0000 7f3d7bfff700 1 -- 172.21.15.60:0/1666521469 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f3d7c05ee00 con 0x7f3d7c0ab150 2020-10-31T22:49:29.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.085+0000 7f3d6bfff700 1 -- 172.21.15.60:0/1666521469 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v118) v1 ==== 125+0+0 (secure 0 0 0) 0x7f3d6c048e60 con 0x7f3d7c0ab150 2020-10-31T22:49:29.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.093+0000 7f3d7bfff700 1 -- 172.21.15.60:0/1666521469 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d580550c0 msgr2=0x7f3d58057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.093+0000 7f3d7bfff700 1 --2- 172.21.15.60:0/1666521469 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d580550c0 0x7f3d58057580 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f3d7000b000 tx=0x7f3d70006dc0).stop 2020-10-31T22:49:29.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.093+0000 7f3d7bfff700 1 -- 172.21.15.60:0/1666521469 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d7c0ab150 msgr2=0x7f3d7c142a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.093+0000 7f3d7bfff700 1 --2- 172.21.15.60:0/1666521469 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d7c0ab150 0x7f3d7c142a90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f3d7c063980 tx=0x7f3d6c015000).stop 2020-10-31T22:49:29.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.093+0000 7f3d7bfff700 1 -- 172.21.15.60:0/1666521469 shutdown_connections 2020-10-31T22:49:29.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.093+0000 7f3d7bfff700 1 --2- 172.21.15.60:0/1666521469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d7c0b1bb0 0x7f3d7c13e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.093+0000 7f3d7bfff700 1 --2- 172.21.15.60:0/1666521469 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d7c0ab150 0x7f3d7c142a90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.093+0000 7f3d7bfff700 1 --2- 172.21.15.60:0/1666521469 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d580550c0 0x7f3d58057580 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.093+0000 7f3d7bfff700 1 --2- 172.21.15.60:0/1666521469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d7c0af580 0x7f3d7c13e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.093+0000 7f3d7bfff700 1 -- 172.21.15.60:0/1666521469 >> 172.21.15.60:0/1666521469 conn(0x7f3d7c0b5330 msgr2=0x7f3d7c1462d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:29.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.093+0000 7f3d7bfff700 1 -- 172.21.15.60:0/1666521469 shutdown_connections 2020-10-31T22:49:29.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.093+0000 7f3d7bfff700 1 -- 172.21.15.60:0/1666521469 wait complete. 2020-10-31T22:49:29.100 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2020-10-31T22:49:29.113 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-10-31T22:49:29.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 Processor -- start 2020-10-31T22:49:29.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 -- start start 2020-10-31T22:49:29.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5c840ac010 0x7f5c840662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c840a7580 0x7f5c840667e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c840ac3f0 con 0x7f5c840ae970 2020-10-31T22:49:29.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c84145e50 con 0x7f5c840ac010 2020-10-31T22:49:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c84065e50 con 0x7f5c840a7580 2020-10-31T22:49:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8a200700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5c840ae970 0x7f5c841423b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52114/0 (socket says 172.21.15.60:52114) 2020-10-31T22:49:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c899ff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5c840ac010 0x7f5c840662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8a200700 1 -- 172.21.15.60:0/2874911348 learned_addr learned my addr 172.21.15.60:0/2874911348 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c891fe700 1 --2- 172.21.15.60:0/2874911348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c840a7580 0x7f5c840667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c889fd700 1 -- 172.21.15.60:0/2874911348 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767675961 0 0) 0x7f5c840ac3f0 con 0x7f5c840ae970 2020-10-31T22:49:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c889fd700 1 -- 172.21.15.60:0/2874911348 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c6c003230 con 0x7f5c840ae970 2020-10-31T22:49:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c899ff700 1 -- 172.21.15.60:0/2874911348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c840a7580 msgr2=0x7f5c840667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c899ff700 1 --2- 172.21.15.60:0/2874911348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c840a7580 0x7f5c840667e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c899ff700 1 -- 172.21.15.60:0/2874911348 >> v1:172.21.15.60:6789/0 conn(0x7f5c840ae970 legacy=0x7f5c841423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c899ff700 1 -- 172.21.15.60:0/2874911348 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c84145b50 con 0x7f5c840ac010 2020-10-31T22:49:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c899ff700 1 --2- 172.21.15.60:0/2874911348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c840ac010 0x7f5c840662f0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f5c7c0032b0 tx=0x7f5c7c0091a0).ready entity=mon.0 client_cookie=e9e911ea618def5b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c889fd700 1 -- 172.21.15.60:0/2874911348 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c7c00b9a0 con 0x7f5c840ac010 2020-10-31T22:49:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c889fd700 1 -- 172.21.15.60:0/2874911348 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c7c00bb00 con 0x7f5c840ac010 2020-10-31T22:49:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c889fd700 1 -- 172.21.15.60:0/2874911348 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c7c00bc70 con 0x7f5c840ac010 2020-10-31T22:49:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 -- 172.21.15.60:0/2874911348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c840ac010 msgr2=0x7f5c840662f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 --2- 172.21.15.60:0/2874911348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c840ac010 0x7f5c840662f0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 rx=0x7f5c7c0032b0 tx=0x7f5c7c0091a0).stop 2020-10-31T22:49:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 -- 172.21.15.60:0/2874911348 shutdown_connections 2020-10-31T22:49:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 --2- 172.21.15.60:0/2874911348 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c840ac010 0x7f5c840662f0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 --2- 172.21.15.60:0/2874911348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c840a7580 0x7f5c840667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 -- 172.21.15.60:0/2874911348 >> 172.21.15.60:0/2874911348 conn(0x7f5c840b3fd0 msgr2=0x7f5c840b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:29.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 -- 172.21.15.60:0/2874911348 shutdown_connections 2020-10-31T22:49:29.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.221+0000 7f5c8aa01700 1 -- 172.21.15.60:0/2874911348 wait complete. 2020-10-31T22:49:29.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c8aa01700 1 Processor -- start 2020-10-31T22:49:29.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c8aa01700 1 -- start start 2020-10-31T22:49:29.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c8aa01700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c840a7580 0x7f5c841452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c8aa01700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c840ac010 0x7f5c84150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c8aa01700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c840ae970 0x7f5c84150d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c8aa01700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c840aaeb0 con 0x7f5c840ac010 2020-10-31T22:49:29.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c8aa01700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c84143c90 con 0x7f5c840ae970 2020-10-31T22:49:29.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c8aa01700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c841511f0 con 0x7f5c840a7580 2020-10-31T22:49:29.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c891fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c840ac010 0x7f5c84150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c891fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c840ac010 0x7f5c84150810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47980/0 (socket says 172.21.15.60:47980) 2020-10-31T22:49:29.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c891fe700 1 -- 172.21.15.60:0/3885276349 learned_addr learned my addr 172.21.15.60:0/3885276349 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:29.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c899ff700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c840a7580 0x7f5c841452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c8a200700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c840ae970 0x7f5c84150d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c891fe700 1 -- 172.21.15.60:0/3885276349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c840a7580 msgr2=0x7f5c841452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c891fe700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c840a7580 0x7f5c841452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c891fe700 1 -- 172.21.15.60:0/3885276349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c840ae970 msgr2=0x7f5c84150d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c891fe700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c840ae970 0x7f5c84150d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c891fe700 1 -- 172.21.15.60:0/3885276349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c841439f0 con 0x7f5c840ac010 2020-10-31T22:49:29.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c899ff700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c840a7580 0x7f5c841452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:29.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c891fe700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c840ac010 0x7f5c84150810 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f5c7400a000 tx=0x7f5c74008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:29.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c72ffd700 1 -- 172.21.15.60:0/3885276349 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c740099c0 con 0x7f5c840ac010 2020-10-31T22:49:29.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c72ffd700 1 -- 172.21.15.60:0/3885276349 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c74009b20 con 0x7f5c840ac010 2020-10-31T22:49:29.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c8aa01700 1 -- 172.21.15.60:0/3885276349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c841427f0 con 0x7f5c840ac010 2020-10-31T22:49:29.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c72ffd700 1 -- 172.21.15.60:0/3885276349 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5c74009e80 con 0x7f5c840ac010 2020-10-31T22:49:29.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.225+0000 7f5c8aa01700 1 -- 172.21.15.60:0/3885276349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c840aab10 con 0x7f5c840ac010 2020-10-31T22:49:29.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.229+0000 7f5c8aa01700 1 -- 172.21.15.60:0/3885276349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c841437f0 con 0x7f5c840ac010 2020-10-31T22:49:29.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.229+0000 7f5c72ffd700 1 -- 172.21.15.60:0/3885276349 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5c74013480 con 0x7f5c840ac010 2020-10-31T22:49:29.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.229+0000 7f5c72ffd700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c64054f90 0x7f5c64057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.229+0000 7f5c72ffd700 1 -- 172.21.15.60:0/3885276349 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f5c7406de80 con 0x7f5c840ac010 2020-10-31T22:49:29.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.229+0000 7f5c899ff700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c64054f90 0x7f5c64057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.229+0000 7f5c899ff700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c64054f90 0x7f5c64057450 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f5c7c019000 tx=0x7f5c7c016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:29.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.237+0000 7f5c72ffd700 1 -- 172.21.15.60:0/3885276349 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5c740443b0 con 0x7f5c840ac010 2020-10-31T22:49:29.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.421+0000 7f5c8aa01700 1 -- 172.21.15.60:0/3885276349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f5c84057100 con 0x7f5c840ac010 2020-10-31T22:49:29.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.433+0000 7f5c72ffd700 1 -- 172.21.15.60:0/3885276349 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 21 and data pool 22 v58) v1 ==== 189+0+0 (secure 0 0 0) 0x7f5c740479d0 con 0x7f5c840ac010 2020-10-31T22:49:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.437+0000 7f5c8aa01700 1 -- 172.21.15.60:0/3885276349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c64054f90 msgr2=0x7f5c64057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.437+0000 7f5c8aa01700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c64054f90 0x7f5c64057450 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f5c7c019000 tx=0x7f5c7c016000).stop 2020-10-31T22:49:29.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.437+0000 7f5c8aa01700 1 -- 172.21.15.60:0/3885276349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c840ac010 msgr2=0x7f5c84150810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.437+0000 7f5c8aa01700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c840ac010 0x7f5c84150810 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 rx=0x7f5c7400a000 tx=0x7f5c74008040).stop 2020-10-31T22:49:29.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.437+0000 7f5c8aa01700 1 -- 172.21.15.60:0/3885276349 shutdown_connections 2020-10-31T22:49:29.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.437+0000 7f5c8aa01700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c64054f90 0x7f5c64057450 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.437+0000 7f5c8aa01700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5c840ae970 0x7f5c84150d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.437+0000 7f5c8aa01700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5c840a7580 0x7f5c841452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.437+0000 7f5c8aa01700 1 --2- 172.21.15.60:0/3885276349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5c840ac010 0x7f5c84150810 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.437+0000 7f5c8aa01700 1 -- 172.21.15.60:0/3885276349 >> 172.21.15.60:0/3885276349 conn(0x7f5c840b3fd0 msgr2=0x7f5c840ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.437+0000 7f5c8aa01700 1 -- 172.21.15.60:0/3885276349 shutdown_connections 2020-10-31T22:49:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.437+0000 7f5c8aa01700 1 -- 172.21.15.60:0/3885276349 wait complete. 2020-10-31T22:49:29.448 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 21 and data pool 22 2020-10-31T22:49:29.459 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:49:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.557+0000 7f69c0cf3700 1 Processor -- start 2020-10-31T22:49:29.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.557+0000 7f69c0cf3700 1 -- start start 2020-10-31T22:49:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69c0cf3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f69bc0b1a10 0x7f69bc142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69c0cf3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69bc0abea0 con 0x7f69bc0af200 2020-10-31T22:49:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69c0cf3700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69bc141870 con 0x7f69bc13ebe0 2020-10-31T22:49:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69c0cf3700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69bc141b10 con 0x7f69bc0b1a10 2020-10-31T22:49:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69bbfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f69bc0af200 0x7f69bc0b0850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52128/0 (socket says 172.21.15.60:52128) 2020-10-31T22:49:29.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69bbfff700 1 -- 172.21.15.60:0/3244056619 learned_addr learned my addr 172.21.15.60:0/3244056619 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:29.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69bb7fe700 1 --2- 172.21.15.60:0/3244056619 >> v2:172.21.15.66:3300/0 conn(0x7f69bc0b1a10 0x7f69bc142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69ba7fc700 1 -- 172.21.15.60:0/3244056619 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416166561 0 0) 0x7f69bc0abea0 con 0x7f69bc0af200 2020-10-31T22:49:29.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69ba7fc700 1 -- 172.21.15.60:0/3244056619 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f699c003230 con 0x7f69bc0af200 2020-10-31T22:49:29.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69bb7fe700 1 -- 172.21.15.60:0/3244056619 >> v1:172.21.15.66:6789/0 conn(0x7f69bc13ebe0 legacy=0x7f69bc0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69bb7fe700 1 -- 172.21.15.60:0/3244056619 >> v1:172.21.15.60:6789/0 conn(0x7f69bc0af200 legacy=0x7f69bc0b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69bb7fe700 1 -- 172.21.15.60:0/3244056619 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc141db0 con 0x7f69bc0b1a10 2020-10-31T22:49:29.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69bb7fe700 1 --2- 172.21.15.60:0/3244056619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69bc0b1a10 0x7f69bc142250 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f69ac0032b0 tx=0x7f69ac0091a0).ready entity=mon.1 client_cookie=3175c564900e3295 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:29.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69ba7fc700 1 -- 172.21.15.60:0/3244056619 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69ac00b9a0 con 0x7f69bc0b1a10 2020-10-31T22:49:29.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69ba7fc700 1 -- 172.21.15.60:0/3244056619 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69ac00bb00 con 0x7f69bc0b1a10 2020-10-31T22:49:29.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69ba7fc700 1 -- 172.21.15.60:0/3244056619 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69ac00bc70 con 0x7f69bc0b1a10 2020-10-31T22:49:29.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69c0cf3700 1 -- 172.21.15.60:0/3244056619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69bc0b1a10 msgr2=0x7f69bc142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69c0cf3700 1 --2- 172.21.15.60:0/3244056619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69bc0b1a10 0x7f69bc142250 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f69ac0032b0 tx=0x7f69ac0091a0).stop 2020-10-31T22:49:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69c0cf3700 1 -- 172.21.15.60:0/3244056619 shutdown_connections 2020-10-31T22:49:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69c0cf3700 1 --2- 172.21.15.60:0/3244056619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69bc0b1a10 0x7f69bc142250 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69c0cf3700 1 -- 172.21.15.60:0/3244056619 >> 172.21.15.60:0/3244056619 conn(0x7f69bc0b5300 msgr2=0x7f69bc0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:29.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69c0cf3700 1 -- 172.21.15.60:0/3244056619 shutdown_connections 2020-10-31T22:49:29.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.561+0000 7f69c0cf3700 1 -- 172.21.15.60:0/3244056619 wait complete. 2020-10-31T22:49:29.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.565+0000 7f69c0cf3700 1 Processor -- start 2020-10-31T22:49:29.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.565+0000 7f69c0cf3700 1 -- start start 2020-10-31T22:49:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.565+0000 7f69c0cf3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69bc0af200 0x7f69bc0ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.565+0000 7f69c0cf3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69bc0b1a10 0x7f69bc062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.565+0000 7f69c0cf3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69bc13ebe0 0x7f69bc066740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.565+0000 7f69c0cf3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc065ac0 con 0x7f69bc0b1a10 2020-10-31T22:49:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.565+0000 7f69c0cf3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc065d60 con 0x7f69bc13ebe0 2020-10-31T22:49:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.565+0000 7f69c0cf3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69bc066000 con 0x7f69bc0af200 2020-10-31T22:49:29.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.565+0000 7f69baffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69bc0b1a10 0x7f69bc062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.565+0000 7f69baffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69bc0b1a10 0x7f69bc062e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:47996/0 (socket says 172.21.15.60:47996) 2020-10-31T22:49:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.565+0000 7f69baffd700 1 -- 172.21.15.60:0/621924428 learned_addr learned my addr 172.21.15.60:0/621924428 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.565+0000 7f69bb7fe700 1 --2- 172.21.15.60:0/621924428 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69bc0af200 0x7f69bc0ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69bbfff700 1 --2- 172.21.15.60:0/621924428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69bc13ebe0 0x7f69bc066740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69baffd700 1 -- 172.21.15.60:0/621924428 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69bc0af200 msgr2=0x7f69bc0ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69baffd700 1 --2- 172.21.15.60:0/621924428 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69bc0af200 0x7f69bc0ab150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69baffd700 1 -- 172.21.15.60:0/621924428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69bc13ebe0 msgr2=0x7f69bc066740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.582 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69baffd700 1 --2- 172.21.15.60:0/621924428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69bc13ebe0 0x7f69bc066740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.582 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69baffd700 1 -- 172.21.15.60:0/621924428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69bc0662a0 con 0x7f69bc0b1a10 2020-10-31T22:49:29.582 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69baffd700 1 --2- 172.21.15.60:0/621924428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69bc0b1a10 0x7f69bc062e60 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f69bc062c40 tx=0x7f69a400b200).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:29.582 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69b8ff9700 1 -- 172.21.15.60:0/621924428 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69a400e980 con 0x7f69bc0b1a10 2020-10-31T22:49:29.582 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69b8ff9700 1 -- 172.21.15.60:0/621924428 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a400eae0 con 0x7f69bc0b1a10 2020-10-31T22:49:29.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69b8ff9700 1 -- 172.21.15.60:0/621924428 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f69a400ee40 con 0x7f69bc0b1a10 2020-10-31T22:49:29.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69c0cf3700 1 -- 172.21.15.60:0/621924428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69bc0aa250 con 0x7f69bc0b1a10 2020-10-31T22:49:29.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69c0cf3700 1 -- 172.21.15.60:0/621924428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69bc066dd0 con 0x7f69bc0b1a10 2020-10-31T22:49:29.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69c0cf3700 1 -- 172.21.15.60:0/621924428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69bc066430 con 0x7f69bc0b1a10 2020-10-31T22:49:29.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69b8ff9700 1 -- 172.21.15.60:0/621924428 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f69a401e070 con 0x7f69bc0b1a10 2020-10-31T22:49:29.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69b8ff9700 1 --2- 172.21.15.60:0/621924428 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f69a0054f90 0x7f69a0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69b8ff9700 1 -- 172.21.15.60:0/621924428 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f69a406de40 con 0x7f69bc0b1a10 2020-10-31T22:49:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.569+0000 7f69bb7fe700 1 --2- 172.21.15.60:0/621924428 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f69a0054f90 0x7f69a0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.573+0000 7f69bb7fe700 1 --2- 172.21.15.60:0/621924428 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f69a0054f90 0x7f69a0057450 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f69ac01f000 tx=0x7f69ac016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:29.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.577+0000 7f69b8ff9700 1 -- 172.21.15.60:0/621924428 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f69a4044250 con 0x7f69bc0b1a10 2020-10-31T22:49:29.724 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.717+0000 7f69c0cf3700 1 -- 172.21.15.60:0/621924428 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69bc057100 con 0x7f69bc0b1a10 2020-10-31T22:49:29.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.721+0000 7f69b8ff9700 1 -- 172.21.15.60:0/621924428 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f69a4047870 con 0x7f69bc0b1a10 2020-10-31T22:49:29.727 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:29.727 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":119,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:49:29.429467+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:49:27.152231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-10-31T22:49:28.431362+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:49:29.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.721+0000 7f69c0cf3700 1 -- 172.21.15.60:0/621924428 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f69a0054f90 msgr2=0x7f69a0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.721+0000 7f69c0cf3700 1 --2- 172.21.15.60:0/621924428 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f69a0054f90 0x7f69a0057450 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f69ac01f000 tx=0x7f69ac016000).stop 2020-10-31T22:49:29.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.721+0000 7f69c0cf3700 1 -- 172.21.15.60:0/621924428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69bc0b1a10 msgr2=0x7f69bc062e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.721+0000 7f69c0cf3700 1 --2- 172.21.15.60:0/621924428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69bc0b1a10 0x7f69bc062e60 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 rx=0x7f69bc062c40 tx=0x7f69a400b200).stop 2020-10-31T22:49:29.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.721+0000 7f69c0cf3700 1 -- 172.21.15.60:0/621924428 shutdown_connections 2020-10-31T22:49:29.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.721+0000 7f69c0cf3700 1 --2- 172.21.15.60:0/621924428 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f69a0054f90 0x7f69a0057450 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.721+0000 7f69c0cf3700 1 --2- 172.21.15.60:0/621924428 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f69bc13ebe0 0x7f69bc066740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.721+0000 7f69c0cf3700 1 --2- 172.21.15.60:0/621924428 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69bc0af200 0x7f69bc0ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.721+0000 7f69c0cf3700 1 --2- 172.21.15.60:0/621924428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f69bc0b1a10 0x7f69bc062e60 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.721+0000 7f69c0cf3700 1 -- 172.21.15.60:0/621924428 >> 172.21.15.60:0/621924428 conn(0x7f69bc0b5300 msgr2=0x7f69bc0b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:29.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.721+0000 7f69c0cf3700 1 -- 172.21.15.60:0/621924428 shutdown_connections 2020-10-31T22:49:29.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.721+0000 7f69c0cf3700 1 -- 172.21.15.60:0/621924428 wait complete. 2020-10-31T22:49:29.747 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:49:29.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81e08bd700 1 Processor -- start 2020-10-31T22:49:29.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81e08bd700 1 -- start start 2020-10-31T22:49:29.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81e08bd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f81dc0b5950 0x7f81dc1426f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81e08bd700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc145180 con 0x7f81dc0b5570 2020-10-31T22:49:29.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81e08bd700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc0b0670 con 0x7f81dc0b24a0 2020-10-31T22:49:29.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81e08bd700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81dc0afae0 con 0x7f81dc0b5950 2020-10-31T22:49:29.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81dad9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f81dc0b5570 0x7f81dc145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52140/0 (socket says 172.21.15.60:52140) 2020-10-31T22:49:29.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81dad9d700 1 -- 172.21.15.60:0/4007726592 learned_addr learned my addr 172.21.15.60:0/4007726592 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:29.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81db59e700 1 --2- 172.21.15.60:0/4007726592 >> v2:172.21.15.66:3300/0 conn(0x7f81dc0b5950 0x7f81dc1426f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81d9d9b700 1 -- 172.21.15.60:0/4007726592 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3321550006 0 0) 0x7f81dc145180 con 0x7f81dc0b5570 2020-10-31T22:49:29.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81d9d9b700 1 -- 172.21.15.60:0/4007726592 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81c0003230 con 0x7f81dc0b5570 2020-10-31T22:49:29.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81d9d9b700 1 -- 172.21.15.60:0/4007726592 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3027629607 0 0) 0x7f81dc0b0670 con 0x7f81dc0b24a0 2020-10-31T22:49:29.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81d9d9b700 1 -- 172.21.15.60:0/4007726592 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81dc145180 con 0x7f81dc0b24a0 2020-10-31T22:49:29.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81db59e700 1 -- 172.21.15.60:0/4007726592 >> v1:172.21.15.66:6789/0 conn(0x7f81dc0b24a0 legacy=0x7f81dc141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81db59e700 1 -- 172.21.15.60:0/4007726592 >> v1:172.21.15.60:6789/0 conn(0x7f81dc0b5570 legacy=0x7f81dc145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.853+0000 7f81db59e700 1 -- 172.21.15.60:0/4007726592 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc0b0910 con 0x7f81dc0b5950 2020-10-31T22:49:29.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.857+0000 7f81db59e700 1 --2- 172.21.15.60:0/4007726592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81dc0b5950 0x7f81dc1426f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f81dc05f580 tx=0x7f81d40091a0).ready entity=mon.1 client_cookie=c6208292683a1191 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:29.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.857+0000 7f81d9d9b700 1 -- 172.21.15.60:0/4007726592 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d400b900 con 0x7f81dc0b5950 2020-10-31T22:49:29.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.857+0000 7f81d9d9b700 1 -- 172.21.15.60:0/4007726592 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d400ba60 con 0x7f81dc0b5950 2020-10-31T22:49:29.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.857+0000 7f81d9d9b700 1 -- 172.21.15.60:0/4007726592 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81d400bbd0 con 0x7f81dc0b5950 2020-10-31T22:49:29.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.857+0000 7f81e08bd700 1 -- 172.21.15.60:0/4007726592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81dc0b5950 msgr2=0x7f81dc1426f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.857+0000 7f81e08bd700 1 --2- 172.21.15.60:0/4007726592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81dc0b5950 0x7f81dc1426f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f81dc05f580 tx=0x7f81d40091a0).stop 2020-10-31T22:49:29.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.857+0000 7f81e08bd700 1 -- 172.21.15.60:0/4007726592 shutdown_connections 2020-10-31T22:49:29.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.857+0000 7f81e08bd700 1 --2- 172.21.15.60:0/4007726592 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81dc0b5950 0x7f81dc1426f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.857+0000 7f81e08bd700 1 -- 172.21.15.60:0/4007726592 >> 172.21.15.60:0/4007726592 conn(0x7f81dc0b8e90 msgr2=0x7f81dc0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:29.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.857+0000 7f81e08bd700 1 -- 172.21.15.60:0/4007726592 shutdown_connections 2020-10-31T22:49:29.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.857+0000 7f81e08bd700 1 -- 172.21.15.60:0/4007726592 wait complete. 2020-10-31T22:49:29.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.857+0000 7f81e08bd700 1 Processor -- start 2020-10-31T22:49:29.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.857+0000 7f81e08bd700 1 -- start start 2020-10-31T22:49:29.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81e08bd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81dc0b24a0 0x7f81dc150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81e08bd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81dc0b5570 0x7f81dc0b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81e08bd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81dc0b5950 0x7f81dc0ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81e08bd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0ad790 con 0x7f81dc0b5570 2020-10-31T22:49:29.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81e08bd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0b7a10 con 0x7f81dc0b5950 2020-10-31T22:49:29.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81e08bd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc150d10 con 0x7f81dc0b24a0 2020-10-31T22:49:29.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81da59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81dc0b5570 0x7f81dc0b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81da59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81dc0b5570 0x7f81dc0b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48008/0 (socket says 172.21.15.60:48008) 2020-10-31T22:49:29.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81da59c700 1 -- 172.21.15.60:0/3807316498 learned_addr learned my addr 172.21.15.60:0/3807316498 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:29.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81db59e700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81dc0b5950 0x7f81dc0ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81dad9d700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81dc0b24a0 0x7f81dc150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81da59c700 1 -- 172.21.15.60:0/3807316498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81dc0b24a0 msgr2=0x7f81dc150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81da59c700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81dc0b24a0 0x7f81dc150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81da59c700 1 -- 172.21.15.60:0/3807316498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81dc0b5950 msgr2=0x7f81dc0ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81da59c700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81dc0b5950 0x7f81dc0ae5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81da59c700 1 -- 172.21.15.60:0/3807316498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc0b7c90 con 0x7f81dc0b5570 2020-10-31T22:49:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81dad9d700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81dc0b24a0 0x7f81dc150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81da59c700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81dc0b5570 0x7f81dc0b6b50 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f81cc0010d0 tx=0x7f81cc007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81cbfff700 1 -- 172.21.15.60:0/3807316498 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81cc00e4a0 con 0x7f81dc0b5570 2020-10-31T22:49:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81cbfff700 1 -- 172.21.15.60:0/3807316498 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc00e600 con 0x7f81dc0b5570 2020-10-31T22:49:29.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81e08bd700 1 -- 172.21.15.60:0/3807316498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81dc0b7f30 con 0x7f81dc0b5570 2020-10-31T22:49:29.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81cbfff700 1 -- 172.21.15.60:0/3807316498 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f81cc00e960 con 0x7f81dc0b5570 2020-10-31T22:49:29.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.861+0000 7f81e08bd700 1 -- 172.21.15.60:0/3807316498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc141520 con 0x7f81dc0b5570 2020-10-31T22:49:29.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.865+0000 7f81e08bd700 1 -- 172.21.15.60:0/3807316498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81dc0aec50 con 0x7f81dc0b5570 2020-10-31T22:49:29.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.865+0000 7f81cbfff700 1 -- 172.21.15.60:0/3807316498 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f81cc019030 con 0x7f81dc0b5570 2020-10-31T22:49:29.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.865+0000 7f81cbfff700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f81b8054f30 0x7f81b80573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:29.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.865+0000 7f81dad9d700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f81b8054f30 0x7f81b80573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:29.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.865+0000 7f81cbfff700 1 -- 172.21.15.60:0/3807316498 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f81cc06ce40 con 0x7f81dc0b5570 2020-10-31T22:49:29.872 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.865+0000 7f81dad9d700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f81b8054f30 0x7f81b80573f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f81d000b000 tx=0x7f81d0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:29.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:29.873+0000 7f81cbfff700 1 -- 172.21.15.60:0/3807316498 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f81cc043360 con 0x7f81dc0b5570 2020-10-31T22:49:30.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.009+0000 7f81e08bd700 1 -- 172.21.15.60:0/3807316498 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81dc0b80c0 con 0x7f81dc0b5570 2020-10-31T22:49:30.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.009+0000 7f81cbfff700 1 -- 172.21.15.60:0/3807316498 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f81cc046980 con 0x7f81dc0b5570 2020-10-31T22:49:30.018 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:30.018 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":119,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:49:29.429467+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:49:27.152231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-10-31T22:49:28.431362+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:49:30.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.013+0000 7f81e08bd700 1 -- 172.21.15.60:0/3807316498 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f81b8054f30 msgr2=0x7f81b80573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.013+0000 7f81e08bd700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f81b8054f30 0x7f81b80573f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f81d000b000 tx=0x7f81d0009040).stop 2020-10-31T22:49:30.020 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.013+0000 7f81e08bd700 1 -- 172.21.15.60:0/3807316498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81dc0b5570 msgr2=0x7f81dc0b6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.013+0000 7f81e08bd700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81dc0b5570 0x7f81dc0b6b50 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 rx=0x7f81cc0010d0 tx=0x7f81cc007ab0).stop 2020-10-31T22:49:30.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.013+0000 7f81e08bd700 1 -- 172.21.15.60:0/3807316498 shutdown_connections 2020-10-31T22:49:30.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.013+0000 7f81e08bd700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f81b8054f30 0x7f81b80573f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.013+0000 7f81e08bd700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f81dc0b5950 0x7f81dc0ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.013+0000 7f81e08bd700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f81dc0b24a0 0x7f81dc150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.013+0000 7f81e08bd700 1 --2- 172.21.15.60:0/3807316498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f81dc0b5570 0x7f81dc0b6b50 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.013+0000 7f81e08bd700 1 -- 172.21.15.60:0/3807316498 >> 172.21.15.60:0/3807316498 conn(0x7f81dc0b8e90 msgr2=0x7f81dc05f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:30.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.013+0000 7f81e08bd700 1 -- 172.21.15.60:0/3807316498 shutdown_connections 2020-10-31T22:49:30.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.013+0000 7f81e08bd700 1 -- 172.21.15.60:0/3807316498 wait complete. 2020-10-31T22:49:30.032 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-10-31T22:49:30.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.145+0000 7f31b97f3700 1 Processor -- start 2020-10-31T22:49:30.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.145+0000 7f31b97f3700 1 -- start start 2020-10-31T22:49:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b97f3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f31b40b1d50 0x7f31b40ac020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b97f3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31b413bcc0 0x7f31b413c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b97f3700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b413f630 con 0x7f31b40a8140 2020-10-31T22:49:30.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b97f3700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b40ae220 con 0x7f31b40b1d50 2020-10-31T22:49:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b97f3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40b2130 con 0x7f31b413bcc0 2020-10-31T22:49:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b8ff2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31b413bcc0 0x7f31b413c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b3fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f31b40b1d50 0x7f31b40ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b8ff2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31b413bcc0 0x7f31b413c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:32976/0 (socket says 172.21.15.60:32976) 2020-10-31T22:49:30.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b8ff2700 1 -- 172.21.15.60:0/1501145414 learned_addr learned my addr 172.21.15.60:0/1501145414 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:30.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b8ff2700 1 -- 172.21.15.60:0/1501145414 >> v2:172.21.15.66:3300/0 conn(0x7f31b40b1d50 msgr2=0x7f31b40ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:30.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b8ff2700 1 --2- 172.21.15.60:0/1501145414 >> v2:172.21.15.66:3300/0 conn(0x7f31b40b1d50 0x7f31b40ac020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b8ff2700 1 -- 172.21.15.60:0/1501145414 >> v1:172.21.15.66:6789/0 conn(0x7f31b40a8140 legacy=0x7f31b40adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b8ff2700 1 -- 172.21.15.60:0/1501145414 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b405c0f0 con 0x7f31b413bcc0 2020-10-31T22:49:30.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b8ff2700 1 --2- 172.21.15.60:0/1501145414 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31b413bcc0 0x7f31b413c170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f31ac002f30 tx=0x7f31ac006e80).ready entity=mon.2 client_cookie=23a1cc0a982f0262 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:30.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b2ffd700 1 -- 172.21.15.60:0/1501145414 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31ac0099e0 con 0x7f31b413bcc0 2020-10-31T22:49:30.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b2ffd700 1 -- 172.21.15.60:0/1501145414 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ac009b40 con 0x7f31b413bcc0 2020-10-31T22:49:30.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b2ffd700 1 -- 172.21.15.60:0/1501145414 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31ac009ea0 con 0x7f31b413bcc0 2020-10-31T22:49:30.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b97f3700 1 -- 172.21.15.60:0/1501145414 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31b413bcc0 msgr2=0x7f31b413c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.149+0000 7f31b97f3700 1 --2- 172.21.15.60:0/1501145414 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31b413bcc0 0x7f31b413c170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f31ac002f30 tx=0x7f31ac006e80).stop 2020-10-31T22:49:30.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.153+0000 7f31b97f3700 1 -- 172.21.15.60:0/1501145414 shutdown_connections 2020-10-31T22:49:30.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.153+0000 7f31b97f3700 1 --2- 172.21.15.60:0/1501145414 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31b413bcc0 0x7f31b413c170 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.153+0000 7f31b97f3700 1 --2- 172.21.15.60:0/1501145414 >> v2:172.21.15.66:3300/0 conn(0x7f31b40b1d50 0x7f31b40ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.153+0000 7f31b97f3700 1 -- 172.21.15.60:0/1501145414 >> 172.21.15.60:0/1501145414 conn(0x7f31b40b5330 msgr2=0x7f31b40b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:30.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.153+0000 7f31b97f3700 1 -- 172.21.15.60:0/1501145414 shutdown_connections 2020-10-31T22:49:30.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.153+0000 7f31b97f3700 1 -- 172.21.15.60:0/1501145414 wait complete. 2020-10-31T22:49:30.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.153+0000 7f31b97f3700 1 Processor -- start 2020-10-31T22:49:30.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.153+0000 7f31b97f3700 1 -- start start 2020-10-31T22:49:30.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b97f3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31b40a8140 0x7f31b40b0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b97f3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b40b1d50 0x7f31b414d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b97f3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31b413bcc0 0x7f31b40aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b97f3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40a9fd0 con 0x7f31b40b1d50 2020-10-31T22:49:30.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b97f3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b414d930 con 0x7f31b40a8140 2020-10-31T22:49:30.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b97f3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b40667f0 con 0x7f31b413bcc0 2020-10-31T22:49:30.165 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b40b1d50 0x7f31b414d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b40b1d50 0x7f31b414d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48024/0 (socket says 172.21.15.60:48024) 2020-10-31T22:49:30.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b37fe700 1 -- 172.21.15.60:0/1349891119 learned_addr learned my addr 172.21.15.60:0/1349891119 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:30.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b8ff2700 1 --2- 172.21.15.60:0/1349891119 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31b413bcc0 0x7f31b40aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b3fff700 1 --2- 172.21.15.60:0/1349891119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31b40a8140 0x7f31b40b0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b37fe700 1 -- 172.21.15.60:0/1349891119 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31b413bcc0 msgr2=0x7f31b40aa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b37fe700 1 --2- 172.21.15.60:0/1349891119 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31b413bcc0 0x7f31b40aa3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b37fe700 1 -- 172.21.15.60:0/1349891119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31b40a8140 msgr2=0x7f31b40b0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b37fe700 1 --2- 172.21.15.60:0/1349891119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31b40a8140 0x7f31b40b0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b37fe700 1 -- 172.21.15.60:0/1349891119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b4066a90 con 0x7f31b40b1d50 2020-10-31T22:49:30.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b37fe700 1 --2- 172.21.15.60:0/1349891119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b40b1d50 0x7f31b414d440 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f31b40af0f0 tx=0x7f31a8007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:30.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b17fa700 1 -- 172.21.15.60:0/1349891119 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31a800f470 con 0x7f31b40b1d50 2020-10-31T22:49:30.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b17fa700 1 -- 172.21.15.60:0/1349891119 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31a800f5d0 con 0x7f31b40b1d50 2020-10-31T22:49:30.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b17fa700 1 -- 172.21.15.60:0/1349891119 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f31a800f930 con 0x7f31b40b1d50 2020-10-31T22:49:30.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b97f3700 1 -- 172.21.15.60:0/1349891119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b4066d30 con 0x7f31b40b1d50 2020-10-31T22:49:30.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b97f3700 1 -- 172.21.15.60:0/1349891119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b40ab4f0 con 0x7f31b40b1d50 2020-10-31T22:49:30.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.157+0000 7f31b97f3700 1 -- 172.21.15.60:0/1349891119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b4057100 con 0x7f31b40b1d50 2020-10-31T22:49:30.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.161+0000 7f31b17fa700 1 -- 172.21.15.60:0/1349891119 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f31a8019030 con 0x7f31b40b1d50 2020-10-31T22:49:30.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.161+0000 7f31b17fa700 1 --2- 172.21.15.60:0/1349891119 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3194054f10 0x7f31940573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.161+0000 7f31b17fa700 1 -- 172.21.15.60:0/1349891119 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f31a806ce50 con 0x7f31b40b1d50 2020-10-31T22:49:30.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.161+0000 7f31b3fff700 1 --2- 172.21.15.60:0/1349891119 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3194054f10 0x7f31940573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.161+0000 7f31b3fff700 1 --2- 172.21.15.60:0/1349891119 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3194054f10 0x7f31940573d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f31a400b000 tx=0x7f31a40091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:30.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.165+0000 7f31b17fa700 1 -- 172.21.15.60:0/1349891119 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f31a8043370 con 0x7f31b40b1d50 2020-10-31T22:49:30.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.353+0000 7f31b97f3700 1 -- 172.21.15.60:0/1349891119 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f31b40ac690 con 0x7f31b40b1d50 2020-10-31T22:49:30.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.433+0000 7f31b17fa700 1 -- 172.21.15.60:0/1349891119 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v59) v1 ==== 118+0+0 (secure 0 0 0) 0x7f31a8046990 con 0x7f31b40b1d50 2020-10-31T22:49:30.444 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.437+0000 7f31b97f3700 1 -- 172.21.15.60:0/1349891119 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3194054f10 msgr2=0x7f31940573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.437+0000 7f31b97f3700 1 --2- 172.21.15.60:0/1349891119 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3194054f10 0x7f31940573d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f31a400b000 tx=0x7f31a40091a0).stop 2020-10-31T22:49:30.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.437+0000 7f31b97f3700 1 -- 172.21.15.60:0/1349891119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b40b1d50 msgr2=0x7f31b414d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.437+0000 7f31b97f3700 1 --2- 172.21.15.60:0/1349891119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b40b1d50 0x7f31b414d440 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 rx=0x7f31b40af0f0 tx=0x7f31a8007c20).stop 2020-10-31T22:49:30.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.437+0000 7f31b97f3700 1 -- 172.21.15.60:0/1349891119 shutdown_connections 2020-10-31T22:49:30.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.437+0000 7f31b97f3700 1 --2- 172.21.15.60:0/1349891119 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f31b413bcc0 0x7f31b40aa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.445 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.437+0000 7f31b97f3700 1 --2- 172.21.15.60:0/1349891119 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3194054f10 0x7f31940573d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.437+0000 7f31b97f3700 1 --2- 172.21.15.60:0/1349891119 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f31b40a8140 0x7f31b40b0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.437+0000 7f31b97f3700 1 --2- 172.21.15.60:0/1349891119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f31b40b1d50 0x7f31b414d440 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.437+0000 7f31b97f3700 1 -- 172.21.15.60:0/1349891119 >> 172.21.15.60:0/1349891119 conn(0x7f31b40b5330 msgr2=0x7f31b40ae360 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:30.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.437+0000 7f31b97f3700 1 -- 172.21.15.60:0/1349891119 shutdown_connections 2020-10-31T22:49:30.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.437+0000 7f31b97f3700 1 -- 172.21.15.60:0/1349891119 wait complete. 2020-10-31T22:49:30.464 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:49:30.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.569+0000 7f0a95301700 1 Processor -- start 2020-10-31T22:49:30.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.569+0000 7f0a95301700 1 -- start start 2020-10-31T22:49:30.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.569+0000 7f0a95301700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0a9005b960 0x7f0a9005bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.569+0000 7f0a95301700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a90146790 0x7f0a90146be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.569+0000 7f0a95301700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a900af200 con 0x7f0a900a7850 2020-10-31T22:49:30.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.569+0000 7f0a95301700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a900b0f00 con 0x7f0a9005b960 2020-10-31T22:49:30.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.569+0000 7f0a95301700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900b11a0 con 0x7f0a90146790 2020-10-31T22:49:30.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.569+0000 7f0a8effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0a9005b960 0x7f0a9005bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.569+0000 7f0a8effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0a9005b960 0x7f0a9005bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48030/0 (socket says 172.21.15.60:48030) 2020-10-31T22:49:30.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.569+0000 7f0a8effd700 1 -- 172.21.15.60:0/3987507120 learned_addr learned my addr 172.21.15.60:0/3987507120 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:30.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.569+0000 7f0a8f7fe700 1 --2- 172.21.15.60:0/3987507120 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a90146790 0x7f0a90146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.569+0000 7f0a8effd700 1 -- 172.21.15.60:0/3987507120 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a90146790 msgr2=0x7f0a90146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:30.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.569+0000 7f0a8effd700 1 --2- 172.21.15.60:0/3987507120 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a90146790 0x7f0a90146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.569+0000 7f0a8effd700 1 -- 172.21.15.60:0/3987507120 >> v1:172.21.15.66:6789/0 conn(0x7f0a900a7850 legacy=0x7f0a900aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.573+0000 7f0a8effd700 1 -- 172.21.15.60:0/3987507120 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a900b1440 con 0x7f0a9005b960 2020-10-31T22:49:30.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.573+0000 7f0a8effd700 1 --2- 172.21.15.60:0/3987507120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a9005b960 0x7f0a9005bd40 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f0a84002f30 tx=0x7f0a84006e80).ready entity=mon.0 client_cookie=e39cf02e1a48b2e8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:30.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.573+0000 7f0a8dffb700 1 -- 172.21.15.60:0/3987507120 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a840097f0 con 0x7f0a9005b960 2020-10-31T22:49:30.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.573+0000 7f0a8dffb700 1 -- 172.21.15.60:0/3987507120 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a84009950 con 0x7f0a9005b960 2020-10-31T22:49:30.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.573+0000 7f0a8dffb700 1 -- 172.21.15.60:0/3987507120 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a84009cb0 con 0x7f0a9005b960 2020-10-31T22:49:30.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.573+0000 7f0a95301700 1 -- 172.21.15.60:0/3987507120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a9005b960 msgr2=0x7f0a9005bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.573+0000 7f0a95301700 1 --2- 172.21.15.60:0/3987507120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a9005b960 0x7f0a9005bd40 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 rx=0x7f0a84002f30 tx=0x7f0a84006e80).stop 2020-10-31T22:49:30.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.573+0000 7f0a95301700 1 -- 172.21.15.60:0/3987507120 shutdown_connections 2020-10-31T22:49:30.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.573+0000 7f0a95301700 1 --2- 172.21.15.60:0/3987507120 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a90146790 0x7f0a90146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.573+0000 7f0a95301700 1 --2- 172.21.15.60:0/3987507120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a9005b960 0x7f0a9005bd40 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.573+0000 7f0a95301700 1 -- 172.21.15.60:0/3987507120 >> 172.21.15.60:0/3987507120 conn(0x7f0a9006a260 msgr2=0x7f0a90061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:30.581 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.573+0000 7f0a95301700 1 -- 172.21.15.60:0/3987507120 shutdown_connections 2020-10-31T22:49:30.582 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.573+0000 7f0a95301700 1 -- 172.21.15.60:0/3987507120 wait complete. 2020-10-31T22:49:30.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a95301700 1 Processor -- start 2020-10-31T22:49:30.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a95301700 1 -- start start 2020-10-31T22:49:30.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a95301700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a9005b960 0x7f0a900acbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a95301700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a900a7850 0x7f0a90140710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a95301700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a90146790 0x7f0a900aa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a95301700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900a9f30 con 0x7f0a90146790 2020-10-31T22:49:30.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a95301700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900a9900 con 0x7f0a900a7850 2020-10-31T22:49:30.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a95301700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a900aa160 con 0x7f0a9005b960 2020-10-31T22:49:30.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a8f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a90146790 0x7f0a900aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a8effd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a9005b960 0x7f0a900acbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a8f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a90146790 0x7f0a900aa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48040/0 (socket says 172.21.15.60:48040) 2020-10-31T22:49:30.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a8f7fe700 1 -- 172.21.15.60:0/252858577 learned_addr learned my addr 172.21.15.60:0/252858577 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:30.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a8e7fc700 1 --2- 172.21.15.60:0/252858577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a900a7850 0x7f0a90140710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a8f7fe700 1 -- 172.21.15.60:0/252858577 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a9005b960 msgr2=0x7f0a900acbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a8f7fe700 1 --2- 172.21.15.60:0/252858577 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a9005b960 0x7f0a900acbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a8f7fe700 1 -- 172.21.15.60:0/252858577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a900a7850 msgr2=0x7f0a90140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a8f7fe700 1 --2- 172.21.15.60:0/252858577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a900a7850 0x7f0a90140710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a8f7fe700 1 -- 172.21.15.60:0/252858577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a900a9b60 con 0x7f0a90146790 2020-10-31T22:49:30.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a8f7fe700 1 --2- 172.21.15.60:0/252858577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a90146790 0x7f0a900aa680 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f0a88006dd0 tx=0x7f0a880091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:30.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a7ffff700 1 -- 172.21.15.60:0/252858577 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a8800ee70 con 0x7f0a90146790 2020-10-31T22:49:30.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a7ffff700 1 -- 172.21.15.60:0/252858577 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8800cb00 con 0x7f0a90146790 2020-10-31T22:49:30.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a7ffff700 1 -- 172.21.15.60:0/252858577 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a8800ce60 con 0x7f0a90146790 2020-10-31T22:49:30.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a95301700 1 -- 172.21.15.60:0/252858577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a90143350 con 0x7f0a90146790 2020-10-31T22:49:30.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.577+0000 7f0a95301700 1 -- 172.21.15.60:0/252858577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a900b4d50 con 0x7f0a90146790 2020-10-31T22:49:30.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.581+0000 7f0a7ffff700 1 -- 172.21.15.60:0/252858577 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0a88022070 con 0x7f0a90146790 2020-10-31T22:49:30.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.581+0000 7f0a95301700 1 -- 172.21.15.60:0/252858577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a900a9cf0 con 0x7f0a90146790 2020-10-31T22:49:30.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.581+0000 7f0a7ffff700 1 --2- 172.21.15.60:0/252858577 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0a6c055020 0x7f0a6c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.581+0000 7f0a7ffff700 1 -- 172.21.15.60:0/252858577 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0a8806e210 con 0x7f0a90146790 2020-10-31T22:49:30.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.581+0000 7f0a8effd700 1 --2- 172.21.15.60:0/252858577 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0a6c055020 0x7f0a6c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.581+0000 7f0a8effd700 1 --2- 172.21.15.60:0/252858577 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0a6c055020 0x7f0a6c0574e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f0a8401c000 tx=0x7f0a84015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:30.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.589+0000 7f0a7ffff700 1 -- 172.21.15.60:0/252858577 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0a880445c0 con 0x7f0a90146790 2020-10-31T22:49:30.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.781+0000 7f0a95301700 1 -- 172.21.15.60:0/252858577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a90057100 con 0x7f0a90146790 2020-10-31T22:49:30.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.781+0000 7f0a7ffff700 1 -- 172.21.15.60:0/252858577 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f0a88016020 con 0x7f0a90146790 2020-10-31T22:49:30.788 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:30.789 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":59,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6554,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2152829277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2152829277},{"type":"v1","addr":"172.21.15.60:6835","nonce":2152829277}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":56},{"gid":7285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/1505884738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1505884738},{"type":"v1","addr":"172.21.15.60:6837","nonce":1505884738}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:49:29.429837+0000","modified":"2020-10-31T22:49:30.432586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7476":{"gid":7476,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/805667342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":805667342},{"type":"v1","addr":"172.21.15.66:6833","nonce":805667342}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-10-31T22:49:30.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.785+0000 7f0a95301700 1 -- 172.21.15.60:0/252858577 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0a6c055020 msgr2=0x7f0a6c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.785+0000 7f0a95301700 1 --2- 172.21.15.60:0/252858577 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0a6c055020 0x7f0a6c0574e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f0a8401c000 tx=0x7f0a84015000).stop 2020-10-31T22:49:30.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.785+0000 7f0a95301700 1 -- 172.21.15.60:0/252858577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a90146790 msgr2=0x7f0a900aa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.791 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.785+0000 7f0a95301700 1 --2- 172.21.15.60:0/252858577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a90146790 0x7f0a900aa680 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 rx=0x7f0a88006dd0 tx=0x7f0a880091a0).stop 2020-10-31T22:49:30.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.785+0000 7f0a95301700 1 -- 172.21.15.60:0/252858577 shutdown_connections 2020-10-31T22:49:30.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.785+0000 7f0a95301700 1 --2- 172.21.15.60:0/252858577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a90146790 0x7f0a900aa680 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.785+0000 7f0a95301700 1 --2- 172.21.15.60:0/252858577 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0a9005b960 0x7f0a900acbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.785+0000 7f0a95301700 1 --2- 172.21.15.60:0/252858577 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0a6c055020 0x7f0a6c0574e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.785+0000 7f0a95301700 1 --2- 172.21.15.60:0/252858577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0a900a7850 0x7f0a90140710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.785+0000 7f0a95301700 1 -- 172.21.15.60:0/252858577 >> 172.21.15.60:0/252858577 conn(0x7f0a9006a260 msgr2=0x7f0a90061880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:30.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.785+0000 7f0a95301700 1 -- 172.21.15.60:0/252858577 shutdown_connections 2020-10-31T22:49:30.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.785+0000 7f0a95301700 1 -- 172.21.15.60:0/252858577 wait complete. 2020-10-31T22:49:30.794 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 59 2020-10-31T22:49:30.803 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:49:30.900 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2020-10-31T22:49:30.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f224ef700 1 Processor -- start 2020-10-31T22:49:30.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f224ef700 1 -- start start 2020-10-31T22:49:30.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f224ef700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f1c0a7850 0x7f0f1c05bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f224ef700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1c0af200 con 0x7f0f1c146790 2020-10-31T22:49:30.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f224ef700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1c0b0f00 con 0x7f0f1c05b960 2020-10-31T22:49:30.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f224ef700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0b11a0 con 0x7f0f1c0a7850 2020-10-31T22:49:30.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f20a8c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0f1c146790 0x7f0f1c150b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52184/0 (socket says 172.21.15.60:52184) 2020-10-31T22:49:30.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f20a8c700 1 -- 172.21.15.60:0/2003848929 learned_addr learned my addr 172.21.15.60:0/2003848929 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:30.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f1b7fe700 1 --2- 172.21.15.60:0/2003848929 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f1c0a7850 0x7f0f1c05bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f1affd700 1 -- 172.21.15.60:0/2003848929 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2092819773 0 0) 0x7f0f1c0af200 con 0x7f0f1c146790 2020-10-31T22:49:30.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f1affd700 1 -- 172.21.15.60:0/2003848929 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0efc003230 con 0x7f0f1c146790 2020-10-31T22:49:30.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f1affd700 1 -- 172.21.15.60:0/2003848929 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664328036 0 0) 0x7f0f1c0b0f00 con 0x7f0f1c05b960 2020-10-31T22:49:30.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f1b7fe700 1 -- 172.21.15.60:0/2003848929 >> v1:172.21.15.66:6789/0 conn(0x7f0f1c05b960 legacy=0x7f0f1c0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f1b7fe700 1 -- 172.21.15.60:0/2003848929 >> v1:172.21.15.60:6789/0 conn(0x7f0f1c146790 legacy=0x7f0f1c150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.909+0000 7f0f1b7fe700 1 -- 172.21.15.60:0/2003848929 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c0b1440 con 0x7f0f1c0a7850 2020-10-31T22:49:30.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.913+0000 7f0f1b7fe700 1 --2- 172.21.15.60:0/2003848929 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f1c0a7850 0x7f0f1c05bd40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f0f0c002f30 tx=0x7f0f0c006dc0).ready entity=mon.2 client_cookie=7fd5947abeb9a7ed server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:30.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.913+0000 7f0f1affd700 1 -- 172.21.15.60:0/2003848929 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f0c0097b0 con 0x7f0f1c0a7850 2020-10-31T22:49:30.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.913+0000 7f0f1affd700 1 -- 172.21.15.60:0/2003848929 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0c009910 con 0x7f0f1c0a7850 2020-10-31T22:49:30.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.913+0000 7f0f1affd700 1 -- 172.21.15.60:0/2003848929 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f0c009c70 con 0x7f0f1c0a7850 2020-10-31T22:49:30.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.913+0000 7f0f224ef700 1 -- 172.21.15.60:0/2003848929 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f1c0a7850 msgr2=0x7f0f1c05bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.913+0000 7f0f224ef700 1 --2- 172.21.15.60:0/2003848929 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f1c0a7850 0x7f0f1c05bd40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f0f0c002f30 tx=0x7f0f0c006dc0).stop 2020-10-31T22:49:30.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.913+0000 7f0f224ef700 1 -- 172.21.15.60:0/2003848929 shutdown_connections 2020-10-31T22:49:30.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.913+0000 7f0f224ef700 1 --2- 172.21.15.60:0/2003848929 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f1c0a7850 0x7f0f1c05bd40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.913+0000 7f0f224ef700 1 -- 172.21.15.60:0/2003848929 >> 172.21.15.60:0/2003848929 conn(0x7f0f1c06a260 msgr2=0x7f0f1c061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:30.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.913+0000 7f0f224ef700 1 -- 172.21.15.60:0/2003848929 shutdown_connections 2020-10-31T22:49:30.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.913+0000 7f0f224ef700 1 -- 172.21.15.60:0/2003848929 wait complete. 2020-10-31T22:49:30.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.913+0000 7f0f224ef700 1 Processor -- start 2020-10-31T22:49:30.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.913+0000 7f0f224ef700 1 -- start start 2020-10-31T22:49:30.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.913+0000 7f0f224ef700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f1c05b960 0x7f0f1c0b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f224ef700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f1c0a7850 0x7f0f1c0a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f224ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c146790 0x7f0f1c0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f224ef700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0b2320 con 0x7f0f1c146790 2020-10-31T22:49:30.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f224ef700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0b3130 con 0x7f0f1c05b960 2020-10-31T22:49:30.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f224ef700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0a99a0 con 0x7f0f1c0a7850 2020-10-31T22:49:30.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f20a8c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c146790 0x7f0f1c0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f1bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f1c05b960 0x7f0f1c0b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f20a8c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c146790 0x7f0f1c0b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48054/0 (socket says 172.21.15.60:48054) 2020-10-31T22:49:30.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f20a8c700 1 -- 172.21.15.60:0/238252185 learned_addr learned my addr 172.21.15.60:0/238252185 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:30.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f1b7fe700 1 --2- 172.21.15.60:0/238252185 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f1c0a7850 0x7f0f1c0a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f20a8c700 1 -- 172.21.15.60:0/238252185 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f1c0a7850 msgr2=0x7f0f1c0a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f20a8c700 1 --2- 172.21.15.60:0/238252185 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f1c0a7850 0x7f0f1c0a82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f20a8c700 1 -- 172.21.15.60:0/238252185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f1c05b960 msgr2=0x7f0f1c0b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:30.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f20a8c700 1 --2- 172.21.15.60:0/238252185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f1c05b960 0x7f0f1c0b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:30.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f20a8c700 1 -- 172.21.15.60:0/238252185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c0b3360 con 0x7f0f1c146790 2020-10-31T22:49:30.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f20a8c700 1 --2- 172.21.15.60:0/238252185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c146790 0x7f0f1c0b3980 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f0f1c0b3630 tx=0x7f0f14007cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:30.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f197fa700 1 -- 172.21.15.60:0/238252185 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f1400ce10 con 0x7f0f1c146790 2020-10-31T22:49:30.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f197fa700 1 -- 172.21.15.60:0/238252185 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f14005b70 con 0x7f0f1c146790 2020-10-31T22:49:30.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f224ef700 1 -- 172.21.15.60:0/238252185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1c0a9bd0 con 0x7f0f1c146790 2020-10-31T22:49:30.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f197fa700 1 -- 172.21.15.60:0/238252185 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f14007110 con 0x7f0f1c146790 2020-10-31T22:49:30.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f224ef700 1 -- 172.21.15.60:0/238252185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1c0aa310 con 0x7f0f1c146790 2020-10-31T22:49:30.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.917+0000 7f0f224ef700 1 -- 172.21.15.60:0/238252185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1c057100 con 0x7f0f1c146790 2020-10-31T22:49:30.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.921+0000 7f0f197fa700 1 -- 172.21.15.60:0/238252185 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0f14010030 con 0x7f0f1c146790 2020-10-31T22:49:30.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.921+0000 7f0f197fa700 1 --2- 172.21.15.60:0/238252185 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f00054f10 0x7f0f000573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:30.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.921+0000 7f0f197fa700 1 -- 172.21.15.60:0/238252185 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0f1406da40 con 0x7f0f1c146790 2020-10-31T22:49:30.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.921+0000 7f0f1bfff700 1 --2- 172.21.15.60:0/238252185 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f00054f10 0x7f0f000573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:30.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.921+0000 7f0f1bfff700 1 --2- 172.21.15.60:0/238252185 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f00054f10 0x7f0f000573d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f0f0400d000 tx=0x7f0f04007940).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:30.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:30.925+0000 7f0f197fa700 1 -- 172.21.15.60:0/238252185 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0f14043e50 con 0x7f0f1c146790 2020-10-31T22:49:31.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.069+0000 7f0f224ef700 1 -- 172.21.15.60:0/238252185 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f1c05aa70 con 0x7f0f1c146790 2020-10-31T22:49:31.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.069+0000 7f0f197fa700 1 -- 172.21.15.60:0/238252185 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f0f1406d020 con 0x7f0f1c146790 2020-10-31T22:49:31.076 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:31.076 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":120,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:49:30.433442+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:49:27.152231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-10-31T22:49:28.431362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:49:31.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.069+0000 7f0f224ef700 1 -- 172.21.15.60:0/238252185 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f00054f10 msgr2=0x7f0f000573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.069+0000 7f0f224ef700 1 --2- 172.21.15.60:0/238252185 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f00054f10 0x7f0f000573d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f0f0400d000 tx=0x7f0f04007940).stop 2020-10-31T22:49:31.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.069+0000 7f0f224ef700 1 -- 172.21.15.60:0/238252185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c146790 msgr2=0x7f0f1c0b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.069+0000 7f0f224ef700 1 --2- 172.21.15.60:0/238252185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c146790 0x7f0f1c0b3980 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 rx=0x7f0f1c0b3630 tx=0x7f0f14007cf0).stop 2020-10-31T22:49:31.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.069+0000 7f0f224ef700 1 -- 172.21.15.60:0/238252185 shutdown_connections 2020-10-31T22:49:31.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.069+0000 7f0f224ef700 1 --2- 172.21.15.60:0/238252185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0f1c146790 0x7f0f1c0b3980 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.069+0000 7f0f224ef700 1 --2- 172.21.15.60:0/238252185 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f00054f10 0x7f0f000573d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.069+0000 7f0f224ef700 1 --2- 172.21.15.60:0/238252185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f1c05b960 0x7f0f1c0b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.069+0000 7f0f224ef700 1 --2- 172.21.15.60:0/238252185 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f1c0a7850 0x7f0f1c0a82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.069+0000 7f0f224ef700 1 -- 172.21.15.60:0/238252185 >> 172.21.15.60:0/238252185 conn(0x7f0f1c06a260 msgr2=0x7f0f1c0a67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:31.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.073+0000 7f0f224ef700 1 -- 172.21.15.60:0/238252185 shutdown_connections 2020-10-31T22:49:31.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.073+0000 7f0f224ef700 1 -- 172.21.15.60:0/238252185 wait complete. 2020-10-31T22:49:31.089 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:49:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.201+0000 7f9adf59e700 1 Processor -- start 2020-10-31T22:49:31.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.201+0000 7f9adf59e700 1 -- start start 2020-10-31T22:49:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9adf59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ae00256a0 0x7f9ae007fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9adf59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9ae00801c0 0x7f9ae0159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9adf59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ae00b1950 con 0x7f9ae00b1570 2020-10-31T22:49:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9adf59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae0062720 con 0x7f9ae00256a0 2020-10-31T22:49:31.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9adf59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ae0066cb0 con 0x7f9ae00801c0 2020-10-31T22:49:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9ade59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ae00256a0 0x7f9ae007fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9ade59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9ae00256a0 0x7f9ae007fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48058/0 (socket says 172.21.15.60:48058) 2020-10-31T22:49:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9ade59c700 1 -- 172.21.15.60:0/648105798 learned_addr learned my addr 172.21.15.60:0/648105798 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9aded9d700 1 --1- 172.21.15.60:0/648105798 >> v1:172.21.15.60:6789/0 conn(0x7f9ae00b1570 0x7f9ae0024f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52194/0 (socket says 172.21.15.60:52194) 2020-10-31T22:49:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9ae4c01700 1 --2- 172.21.15.60:0/648105798 >> v2:172.21.15.66:3300/0 conn(0x7f9ae00801c0 0x7f9ae0159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9ade59c700 1 -- 172.21.15.60:0/648105798 >> v2:172.21.15.66:3300/0 conn(0x7f9ae00801c0 msgr2=0x7f9ae0159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9ade59c700 1 --2- 172.21.15.60:0/648105798 >> v2:172.21.15.66:3300/0 conn(0x7f9ae00801c0 0x7f9ae0159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9ade59c700 1 -- 172.21.15.60:0/648105798 >> v1:172.21.15.60:6789/0 conn(0x7f9ae00b1570 legacy=0x7f9ae0024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9ade59c700 1 -- 172.21.15.60:0/648105798 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00aca00 con 0x7f9ae00256a0 2020-10-31T22:49:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9ade59c700 1 --2- 172.21.15.60:0/648105798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ae00256a0 0x7f9ae007fcd0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f9ad4002f30 tx=0x7f9ad4006e80).ready entity=mon.0 client_cookie=b2556cccc3611e60 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9addd9b700 1 -- 172.21.15.60:0/648105798 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad40097f0 con 0x7f9ae00256a0 2020-10-31T22:49:31.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9addd9b700 1 -- 172.21.15.60:0/648105798 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad4009950 con 0x7f9ae00256a0 2020-10-31T22:49:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9addd9b700 1 -- 172.21.15.60:0/648105798 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad4009cb0 con 0x7f9ae00256a0 2020-10-31T22:49:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9adf59e700 1 -- 172.21.15.60:0/648105798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ae00256a0 msgr2=0x7f9ae007fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9adf59e700 1 --2- 172.21.15.60:0/648105798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ae00256a0 0x7f9ae007fcd0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 rx=0x7f9ad4002f30 tx=0x7f9ad4006e80).stop 2020-10-31T22:49:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9adf59e700 1 -- 172.21.15.60:0/648105798 shutdown_connections 2020-10-31T22:49:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9adf59e700 1 --2- 172.21.15.60:0/648105798 >> v2:172.21.15.66:3300/0 conn(0x7f9ae00801c0 0x7f9ae0159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9adf59e700 1 --2- 172.21.15.60:0/648105798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ae00256a0 0x7f9ae007fcd0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9adf59e700 1 -- 172.21.15.60:0/648105798 >> 172.21.15.60:0/648105798 conn(0x7f9ae00b5440 msgr2=0x7f9ae00b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:31.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9adf59e700 1 -- 172.21.15.60:0/648105798 shutdown_connections 2020-10-31T22:49:31.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.205+0000 7f9adf59e700 1 -- 172.21.15.60:0/648105798 wait complete. 2020-10-31T22:49:31.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.209+0000 7f9adf59e700 1 Processor -- start 2020-10-31T22:49:31.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.209+0000 7f9adf59e700 1 -- start start 2020-10-31T22:49:31.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.209+0000 7f9adf59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ae00256a0 0x7f9ae00ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.209+0000 7f9adf59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ae00801c0 0x7f9ae0158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.209+0000 7f9adf59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ae00b1570 0x7f9ae0158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.209+0000 7f9adf59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00a6ee0 con 0x7f9ae00801c0 2020-10-31T22:49:31.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9adf59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00a2510 con 0x7f9ae00256a0 2020-10-31T22:49:31.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9adf59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ae00a7110 con 0x7f9ae00b1570 2020-10-31T22:49:31.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9ade59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ae00801c0 0x7f9ae0158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9ade59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ae00801c0 0x7f9ae0158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48066/0 (socket says 172.21.15.60:48066) 2020-10-31T22:49:31.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9aded9d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ae00256a0 0x7f9ae00ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9ade59c700 1 -- 172.21.15.60:0/230835085 learned_addr learned my addr 172.21.15.60:0/230835085 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:31.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9ae4c01700 1 --2- 172.21.15.60:0/230835085 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ae00b1570 0x7f9ae0158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9ade59c700 1 -- 172.21.15.60:0/230835085 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ae00b1570 msgr2=0x7f9ae0158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9ade59c700 1 --2- 172.21.15.60:0/230835085 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ae00b1570 0x7f9ae0158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9ade59c700 1 -- 172.21.15.60:0/230835085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ae00256a0 msgr2=0x7f9ae00ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9ade59c700 1 --2- 172.21.15.60:0/230835085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ae00256a0 0x7f9ae00ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9ade59c700 1 -- 172.21.15.60:0/230835085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae00a73b0 con 0x7f9ae00801c0 2020-10-31T22:49:31.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9ade59c700 1 --2- 172.21.15.60:0/230835085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ae00801c0 0x7f9ae0158a20 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f9ad4002f30 tx=0x7f9ad4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:31.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9acf7fe700 1 -- 172.21.15.60:0/230835085 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad4011c30 con 0x7f9ae00801c0 2020-10-31T22:49:31.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9acf7fe700 1 -- 172.21.15.60:0/230835085 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad4011d90 con 0x7f9ae00801c0 2020-10-31T22:49:31.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9acf7fe700 1 -- 172.21.15.60:0/230835085 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ad401e650 con 0x7f9ae00801c0 2020-10-31T22:49:31.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9adf59e700 1 -- 172.21.15.60:0/230835085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ae00a7650 con 0x7f9ae00801c0 2020-10-31T22:49:31.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9adf59e700 1 -- 172.21.15.60:0/230835085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ae00a3b70 con 0x7f9ae00801c0 2020-10-31T22:49:31.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9acf7fe700 1 -- 172.21.15.60:0/230835085 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9ad401a040 con 0x7f9ae00801c0 2020-10-31T22:49:31.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9adf59e700 1 -- 172.21.15.60:0/230835085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ae00a77e0 con 0x7f9ae00801c0 2020-10-31T22:49:31.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9acf7fe700 1 --2- 172.21.15.60:0/230835085 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ac4054f00 0x7f9ac40573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9acf7fe700 1 -- 172.21.15.60:0/230835085 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9ad406ea30 con 0x7f9ae00801c0 2020-10-31T22:49:31.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.213+0000 7f9aded9d700 1 --2- 172.21.15.60:0/230835085 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ac4054f00 0x7f9ac40573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.217+0000 7f9aded9d700 1 --2- 172.21.15.60:0/230835085 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ac4054f00 0x7f9ac40573c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f9ad000d000 tx=0x7f9ad0007e40).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:31.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.221+0000 7f9acf7fe700 1 -- 172.21.15.60:0/230835085 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9ad4044f50 con 0x7f9ae00801c0 2020-10-31T22:49:31.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.413+0000 7f9adf59e700 1 -- 172.21.15.60:0/230835085 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9ae0057100 con 0x7f9ae00801c0 2020-10-31T22:49:31.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.421+0000 7f9acf7fe700 1 -- 172.21.15.60:0/230835085 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v27) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9ad4023020 con 0x7f9ae00801c0 2020-10-31T22:49:31.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.421+0000 7f9adf59e700 1 -- 172.21.15.60:0/230835085 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ac4054f00 msgr2=0x7f9ac40573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.421+0000 7f9adf59e700 1 --2- 172.21.15.60:0/230835085 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ac4054f00 0x7f9ac40573c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f9ad000d000 tx=0x7f9ad0007e40).stop 2020-10-31T22:49:31.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.421+0000 7f9adf59e700 1 -- 172.21.15.60:0/230835085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ae00801c0 msgr2=0x7f9ae0158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.421+0000 7f9adf59e700 1 --2- 172.21.15.60:0/230835085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ae00801c0 0x7f9ae0158a20 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 rx=0x7f9ad4002f30 tx=0x7f9ad4015000).stop 2020-10-31T22:49:31.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.421+0000 7f9adf59e700 1 -- 172.21.15.60:0/230835085 shutdown_connections 2020-10-31T22:49:31.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.421+0000 7f9adf59e700 1 --2- 172.21.15.60:0/230835085 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ae00b1570 0x7f9ae0158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.421+0000 7f9adf59e700 1 --2- 172.21.15.60:0/230835085 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ac4054f00 0x7f9ac40573c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.421+0000 7f9adf59e700 1 --2- 172.21.15.60:0/230835085 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ae00256a0 0x7f9ae00ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.421+0000 7f9adf59e700 1 --2- 172.21.15.60:0/230835085 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ae00801c0 0x7f9ae0158a20 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.421+0000 7f9adf59e700 1 -- 172.21.15.60:0/230835085 >> 172.21.15.60:0/230835085 conn(0x7f9ae00b5440 msgr2=0x7f9ae00ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:31.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.421+0000 7f9adf59e700 1 -- 172.21.15.60:0/230835085 shutdown_connections 2020-10-31T22:49:31.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.421+0000 7f9adf59e700 1 -- 172.21.15.60:0/230835085 wait complete. 2020-10-31T22:49:31.431 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2020-10-31T22:49:31.445 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:49:31.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 Processor -- start 2020-10-31T22:49:31.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 -- start start 2020-10-31T22:49:31.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f507805b320 0x7f507807ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50780ae200 0x7f50780a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f50780ac110 0x7f50780ae970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507805b700 con 0x7f507805b320 2020-10-31T22:49:31.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50780807c0 con 0x7f50780ac110 2020-10-31T22:49:31.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50780ab730 con 0x7f50780ae200 2020-10-31T22:49:31.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f5077fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f507805b320 0x7f507807ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f5077fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f507805b320 0x7f507807ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48072/0 (socket says 172.21.15.60:48072) 2020-10-31T22:49:31.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f5077fff700 1 -- 172.21.15.60:0/2850429320 learned_addr learned my addr 172.21.15.60:0/2850429320 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:31.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f50777fe700 1 --2- 172.21.15.60:0/2850429320 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50780ae200 0x7f50780a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507cfbe700 1 --2- 172.21.15.60:0/2850429320 >> v2:172.21.15.66:3300/0 conn(0x7f50780ac110 0x7f50780ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f5077fff700 1 -- 172.21.15.60:0/2850429320 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50780ae200 msgr2=0x7f50780a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:31.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f5077fff700 1 --2- 172.21.15.60:0/2850429320 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50780ae200 0x7f50780a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f5077fff700 1 -- 172.21.15.60:0/2850429320 >> v2:172.21.15.66:3300/0 conn(0x7f50780ac110 msgr2=0x7f50780ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:31.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f5077fff700 1 --2- 172.21.15.60:0/2850429320 >> v2:172.21.15.66:3300/0 conn(0x7f50780ac110 0x7f50780ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f5077fff700 1 -- 172.21.15.60:0/2850429320 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50780ab9d0 con 0x7f507805b320 2020-10-31T22:49:31.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f50777fe700 1 --2- 172.21.15.60:0/2850429320 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50780ae200 0x7f50780a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:31.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f5077fff700 1 --2- 172.21.15.60:0/2850429320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f507805b320 0x7f507807ff20 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f5068002f30 tx=0x7f5068006e80).ready entity=mon.0 client_cookie=39defdf6d66b8d0f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:31.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f5076ffd700 1 -- 172.21.15.60:0/2850429320 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50680097f0 con 0x7f507805b320 2020-10-31T22:49:31.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f5076ffd700 1 -- 172.21.15.60:0/2850429320 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5068009950 con 0x7f507805b320 2020-10-31T22:49:31.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f5076ffd700 1 -- 172.21.15.60:0/2850429320 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5068009cb0 con 0x7f507805b320 2020-10-31T22:49:31.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 -- 172.21.15.60:0/2850429320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f507805b320 msgr2=0x7f507807ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 --2- 172.21.15.60:0/2850429320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f507805b320 0x7f507807ff20 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 rx=0x7f5068002f30 tx=0x7f5068006e80).stop 2020-10-31T22:49:31.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 -- 172.21.15.60:0/2850429320 shutdown_connections 2020-10-31T22:49:31.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 --2- 172.21.15.60:0/2850429320 >> v2:172.21.15.66:3300/0 conn(0x7f50780ac110 0x7f50780ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 --2- 172.21.15.60:0/2850429320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f507805b320 0x7f507807ff20 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 --2- 172.21.15.60:0/2850429320 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50780ae200 0x7f50780a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 -- 172.21.15.60:0/2850429320 >> 172.21.15.60:0/2850429320 conn(0x7f50780b3fd0 msgr2=0x7f50780b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:31.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 -- 172.21.15.60:0/2850429320 shutdown_connections 2020-10-31T22:49:31.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.561+0000 7f507e220700 1 -- 172.21.15.60:0/2850429320 wait complete. 2020-10-31T22:49:31.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507e220700 1 Processor -- start 2020-10-31T22:49:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507e220700 1 -- start start 2020-10-31T22:49:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507e220700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f507805b320 0x7f507812f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507e220700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50780ac110 0x7f5078143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507e220700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50780ae200 0x7f5078143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507e220700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50780aa210 con 0x7f50780ae200 2020-10-31T22:49:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507e220700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50780a9f70 con 0x7f507805b320 2020-10-31T22:49:31.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507e220700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50780a8da0 con 0x7f50780ac110 2020-10-31T22:49:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507cfbe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50780ae200 0x7f5078143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507cfbe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50780ae200 0x7f5078143620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48080/0 (socket says 172.21.15.60:48080) 2020-10-31T22:49:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507cfbe700 1 -- 172.21.15.60:0/2526978909 learned_addr learned my addr 172.21.15.60:0/2526978909 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f50777fe700 1 --2- 172.21.15.60:0/2526978909 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50780ac110 0x7f5078143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f5077fff700 1 --2- 172.21.15.60:0/2526978909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f507805b320 0x7f507812f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507cfbe700 1 -- 172.21.15.60:0/2526978909 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50780ac110 msgr2=0x7f5078143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507cfbe700 1 --2- 172.21.15.60:0/2526978909 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50780ac110 0x7f5078143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507cfbe700 1 -- 172.21.15.60:0/2526978909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f507805b320 msgr2=0x7f507812f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507cfbe700 1 --2- 172.21.15.60:0/2526978909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f507805b320 0x7f507812f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507cfbe700 1 -- 172.21.15.60:0/2526978909 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50781303d0 con 0x7f50780ae200 2020-10-31T22:49:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.565+0000 7f507cfbe700 1 --2- 172.21.15.60:0/2526978909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50780ae200 0x7f5078143620 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f507000a000 tx=0x7f5070008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.569+0000 7f5074ff9700 1 -- 172.21.15.60:0/2526978909 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f507000b9a0 con 0x7f50780ae200 2020-10-31T22:49:31.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.569+0000 7f507e220700 1 -- 172.21.15.60:0/2526978909 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50780a8890 con 0x7f50780ae200 2020-10-31T22:49:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.569+0000 7f5074ff9700 1 -- 172.21.15.60:0/2526978909 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507000bb00 con 0x7f50780ae200 2020-10-31T22:49:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.569+0000 7f5074ff9700 1 -- 172.21.15.60:0/2526978909 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f507000be60 con 0x7f50780ae200 2020-10-31T22:49:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.569+0000 7f507e220700 1 -- 172.21.15.60:0/2526978909 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50780aa480 con 0x7f50780ae200 2020-10-31T22:49:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.569+0000 7f507e220700 1 -- 172.21.15.60:0/2526978909 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50780a97e0 con 0x7f50780ae200 2020-10-31T22:49:31.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.569+0000 7f5074ff9700 1 -- 172.21.15.60:0/2526978909 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f507001c460 con 0x7f50780ae200 2020-10-31T22:49:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.569+0000 7f5074ff9700 1 --2- 172.21.15.60:0/2526978909 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5058054f00 0x7f50580573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.569+0000 7f5074ff9700 1 -- 172.21.15.60:0/2526978909 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f507006e140 con 0x7f50780ae200 2020-10-31T22:49:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.569+0000 7f5077fff700 1 --2- 172.21.15.60:0/2526978909 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5058054f00 0x7f50580573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.569+0000 7f5077fff700 1 --2- 172.21.15.60:0/2526978909 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5058054f00 0x7f50580573c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f506801c000 tx=0x7f5068015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:31.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.577+0000 7f5074ff9700 1 -- 172.21.15.60:0/2526978909 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5070044560 con 0x7f50780ae200 2020-10-31T22:49:31.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.773+0000 7f507e220700 1 -- 172.21.15.60:0/2526978909 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f5078057100 con 0x7f50780ae200 2020-10-31T22:49:31.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.781+0000 7f5074ff9700 1 -- 172.21.15.60:0/2526978909 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v28) v1 ==== 184+0+0 (secure 0 0 0) 0x7f5070047b80 con 0x7f50780ae200 2020-10-31T22:49:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.781+0000 7f507e220700 1 -- 172.21.15.60:0/2526978909 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5058054f00 msgr2=0x7f50580573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.781+0000 7f507e220700 1 --2- 172.21.15.60:0/2526978909 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5058054f00 0x7f50580573c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f506801c000 tx=0x7f5068015000).stop 2020-10-31T22:49:31.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.781+0000 7f507e220700 1 -- 172.21.15.60:0/2526978909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50780ae200 msgr2=0x7f5078143620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.781+0000 7f507e220700 1 --2- 172.21.15.60:0/2526978909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50780ae200 0x7f5078143620 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 rx=0x7f507000a000 tx=0x7f5070008040).stop 2020-10-31T22:49:31.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.781+0000 7f507e220700 1 -- 172.21.15.60:0/2526978909 shutdown_connections 2020-10-31T22:49:31.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.781+0000 7f507e220700 1 --2- 172.21.15.60:0/2526978909 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50780ae200 0x7f5078143620 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.781+0000 7f507e220700 1 --2- 172.21.15.60:0/2526978909 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5058054f00 0x7f50580573c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.781+0000 7f507e220700 1 --2- 172.21.15.60:0/2526978909 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f507805b320 0x7f507812f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.781+0000 7f507e220700 1 --2- 172.21.15.60:0/2526978909 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50780ac110 0x7f5078143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.781+0000 7f507e220700 1 -- 172.21.15.60:0/2526978909 >> 172.21.15.60:0/2526978909 conn(0x7f50780b3fd0 msgr2=0x7f5078066a10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:31.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.781+0000 7f507e220700 1 -- 172.21.15.60:0/2526978909 shutdown_connections 2020-10-31T22:49:31.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.781+0000 7f507e220700 1 -- 172.21.15.60:0/2526978909 wait complete. 2020-10-31T22:49:31.790 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.1 2020-10-31T22:49:31.803 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:49:31.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 Processor -- start 2020-10-31T22:49:31.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 -- start start 2020-10-31T22:49:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf600ac870 0x7faf60146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf60146550 0x7faf60150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf600af900 con 0x7faf600af520 2020-10-31T22:49:31.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf600afc10 con 0x7faf60146550 2020-10-31T22:49:31.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf6005bb70 con 0x7faf600ac870 2020-10-31T22:49:31.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66153700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf60146550 0x7faf60150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66153700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7faf60146550 0x7faf60150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48090/0 (socket says 172.21.15.60:48090) 2020-10-31T22:49:31.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66153700 1 -- 172.21.15.60:0/1412588639 learned_addr learned my addr 172.21.15.60:0/1412588639 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:31.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf65151700 1 --2- 172.21.15.60:0/1412588639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf600ac870 0x7faf60146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf65151700 1 -- 172.21.15.60:0/1412588639 >> v2:172.21.15.60:3300/0 conn(0x7faf60146550 msgr2=0x7faf60150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:31.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf64950700 1 -- 172.21.15.60:0/1412588639 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338806728 0 0) 0x7faf600af900 con 0x7faf600af520 2020-10-31T22:49:31.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf65151700 1 --2- 172.21.15.60:0/1412588639 >> v2:172.21.15.60:3300/0 conn(0x7faf60146550 0x7faf60150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf65151700 1 -- 172.21.15.60:0/1412588639 >> v1:172.21.15.66:6789/0 conn(0x7faf600af520 legacy=0x7faf60066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf65151700 1 -- 172.21.15.60:0/1412588639 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf600ac130 con 0x7faf600ac870 2020-10-31T22:49:31.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf65151700 1 --2- 172.21.15.60:0/1412588639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf600ac870 0x7faf60146060 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7faf50002f30 tx=0x7faf50006dc0).ready entity=mon.2 client_cookie=bae22379bd887c27 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:31.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf64950700 1 -- 172.21.15.60:0/1412588639 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf50009760 con 0x7faf600ac870 2020-10-31T22:49:31.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf64950700 1 -- 172.21.15.60:0/1412588639 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf500098c0 con 0x7faf600ac870 2020-10-31T22:49:31.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf64950700 1 -- 172.21.15.60:0/1412588639 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf50009c20 con 0x7faf600ac870 2020-10-31T22:49:31.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 -- 172.21.15.60:0/1412588639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf600ac870 msgr2=0x7faf60146060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 --2- 172.21.15.60:0/1412588639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf600ac870 0x7faf60146060 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7faf50002f30 tx=0x7faf50006dc0).stop 2020-10-31T22:49:31.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 -- 172.21.15.60:0/1412588639 shutdown_connections 2020-10-31T22:49:31.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 --2- 172.21.15.60:0/1412588639 >> v2:172.21.15.60:3300/0 conn(0x7faf60146550 0x7faf60150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 --2- 172.21.15.60:0/1412588639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf600ac870 0x7faf60146060 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 -- 172.21.15.60:0/1412588639 >> 172.21.15.60:0/1412588639 conn(0x7faf600b3fd0 msgr2=0x7faf600b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:31.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 -- 172.21.15.60:0/1412588639 shutdown_connections 2020-10-31T22:49:31.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.909+0000 7faf66954700 1 -- 172.21.15.60:0/1412588639 wait complete. 2020-10-31T22:49:31.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66954700 1 Processor -- start 2020-10-31T22:49:31.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66954700 1 -- start start 2020-10-31T22:49:31.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66954700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf600ac870 0x7faf60148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66954700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf600af520 0x7faf600631f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66954700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf60146550 0x7faf601582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66954700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf600617e0 con 0x7faf600ac870 2020-10-31T22:49:31.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66954700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf60062b20 con 0x7faf600af520 2020-10-31T22:49:31.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66954700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf600aab30 con 0x7faf60146550 2020-10-31T22:49:31.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf65952700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf600ac870 0x7faf60148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf65952700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf600ac870 0x7faf60148720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48092/0 (socket says 172.21.15.60:48092) 2020-10-31T22:49:31.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf65952700 1 -- 172.21.15.60:0/406793190 learned_addr learned my addr 172.21.15.60:0/406793190 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:31.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66153700 1 --2- 172.21.15.60:0/406793190 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf60146550 0x7faf601582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf65151700 1 --2- 172.21.15.60:0/406793190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf600af520 0x7faf600631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66153700 1 -- 172.21.15.60:0/406793190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf600af520 msgr2=0x7faf600631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66153700 1 --2- 172.21.15.60:0/406793190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf600af520 0x7faf600631f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66153700 1 -- 172.21.15.60:0/406793190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf600ac870 msgr2=0x7faf60148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:31.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66153700 1 --2- 172.21.15.60:0/406793190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf600ac870 0x7faf60148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:31.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66153700 1 -- 172.21.15.60:0/406793190 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf600aadb0 con 0x7faf60146550 2020-10-31T22:49:31.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66153700 1 --2- 172.21.15.60:0/406793190 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf60146550 0x7faf601582d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7faf60061920 tx=0x7faf58009270).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:31.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf56ffd700 1 -- 172.21.15.60:0/406793190 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf5800c8f0 con 0x7faf60146550 2020-10-31T22:49:31.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf56ffd700 1 -- 172.21.15.60:0/406793190 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5800ca50 con 0x7faf60146550 2020-10-31T22:49:31.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66954700 1 -- 172.21.15.60:0/406793190 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf60062d50 con 0x7faf60146550 2020-10-31T22:49:31.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf56ffd700 1 -- 172.21.15.60:0/406793190 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faf5800cdb0 con 0x7faf60146550 2020-10-31T22:49:31.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66954700 1 -- 172.21.15.60:0/406793190 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf601494c0 con 0x7faf60146550 2020-10-31T22:49:31.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.913+0000 7faf66954700 1 -- 172.21.15.60:0/406793190 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf60057100 con 0x7faf60146550 2020-10-31T22:49:31.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.917+0000 7faf56ffd700 1 -- 172.21.15.60:0/406793190 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7faf58022070 con 0x7faf60146550 2020-10-31T22:49:31.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.917+0000 7faf56ffd700 1 --2- 172.21.15.60:0/406793190 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf48054f90 0x7faf48057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:31.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.917+0000 7faf56ffd700 1 -- 172.21.15.60:0/406793190 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7faf5806e160 con 0x7faf60146550 2020-10-31T22:49:31.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.917+0000 7faf65952700 1 --2- 172.21.15.60:0/406793190 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf48054f90 0x7faf48057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:31.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.917+0000 7faf65952700 1 --2- 172.21.15.60:0/406793190 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf48054f90 0x7faf48057450 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7faf5c00d000 tx=0x7faf5c0079b0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:31.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:31.925+0000 7faf56ffd700 1 -- 172.21.15.60:0/406793190 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7faf58044570 con 0x7faf60146550 2020-10-31T22:49:32.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.109+0000 7faf66954700 1 -- 172.21.15.60:0/406793190 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf600afe20 con 0x7faf60146550 2020-10-31T22:49:32.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.109+0000 7faf56ffd700 1 -- 172.21.15.60:0/406793190 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+2492 (secure 0 0 0) 0x7faf58016070 con 0x7faf60146550 2020-10-31T22:49:32.115 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:32.116 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":59,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6554,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2152829277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2152829277},{"type":"v1","addr":"172.21.15.60:6835","nonce":2152829277}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":56},{"gid":7285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/1505884738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1505884738},{"type":"v1","addr":"172.21.15.60:6837","nonce":1505884738}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:49:29.429837+0000","modified":"2020-10-31T22:49:30.432586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7476":{"gid":7476,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/805667342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":805667342},{"type":"v1","addr":"172.21.15.66:6833","nonce":805667342}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-10-31T22:49:32.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.113+0000 7faf66954700 1 -- 172.21.15.60:0/406793190 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf48054f90 msgr2=0x7faf48057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:32.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.113+0000 7faf66954700 1 --2- 172.21.15.60:0/406793190 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf48054f90 0x7faf48057450 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7faf5c00d000 tx=0x7faf5c0079b0).stop 2020-10-31T22:49:32.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.113+0000 7faf66954700 1 -- 172.21.15.60:0/406793190 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf60146550 msgr2=0x7faf601582d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:32.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.113+0000 7faf66954700 1 --2- 172.21.15.60:0/406793190 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf60146550 0x7faf601582d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7faf60061920 tx=0x7faf58009270).stop 2020-10-31T22:49:32.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.113+0000 7faf66954700 1 -- 172.21.15.60:0/406793190 shutdown_connections 2020-10-31T22:49:32.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.113+0000 7faf66954700 1 --2- 172.21.15.60:0/406793190 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7faf60146550 0x7faf601582d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:32.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.113+0000 7faf66954700 1 --2- 172.21.15.60:0/406793190 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf600ac870 0x7faf60148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:32.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.113+0000 7faf66954700 1 --2- 172.21.15.60:0/406793190 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7faf48054f90 0x7faf48057450 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:32.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.113+0000 7faf66954700 1 --2- 172.21.15.60:0/406793190 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faf600af520 0x7faf600631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:32.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.113+0000 7faf66954700 1 -- 172.21.15.60:0/406793190 >> 172.21.15.60:0/406793190 conn(0x7faf600b3fd0 msgr2=0x7faf601499f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:32.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.113+0000 7faf66954700 1 -- 172.21.15.60:0/406793190 shutdown_connections 2020-10-31T22:49:32.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.113+0000 7faf66954700 1 -- 172.21.15.60:0/406793190 wait complete. 2020-10-31T22:49:32.119 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 59 2020-10-31T22:49:32.432 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:49:29.429837+0000', 'modified': '2020-10-31T22:49:30.432586+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7476': {'gid': 7476, 'name': 'b', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6833/805667342', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 805667342}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 805667342}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:49:32.433 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:49:32.433 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-10-31T22:49:32.564 INFO:teuthology.orchestra.run.smithi066.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":7476,"want_state":"up:active","state":"up:active","rank_uptime":3.121394284,"mdsmap_epoch":59,"osdmap_epoch":120,"osdmap_epoch_barrier":119,"uptime":8.3457505669999996} 2020-10-31T22:49:32.565 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 7476, "mdsmap_epoch": 59, "osdmap_epoch": 120, "osdmap_epoch_barrier": 119, "rank_uptime": 3.121394284, "state": "up:active", "uptime": 8.345750567, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:49:32.566 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:49:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.677+0000 7fbb31600700 1 Processor -- start 2020-10-31T22:49:32.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.677+0000 7fbb31600700 1 -- start start 2020-10-31T22:49:32.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb31600700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb2c05c4c0 0x7fbb2c05c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:32.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb31600700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c065e90 con 0x7fbb2c0b2e20 2020-10-31T22:49:32.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb31600700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2c066130 con 0x7fbb2c0b4410 2020-10-31T22:49:32.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb31600700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c141ef0 con 0x7fbb2c05c4c0 2020-10-31T22:49:32.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb2a7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fbb2c0b2e20 0x7fbb2c13f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52236/0 (socket says 172.21.15.60:52236) 2020-10-31T22:49:32.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb2a7fc700 1 -- 172.21.15.60:0/1256976098 learned_addr learned my addr 172.21.15.60:0/1256976098 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:32.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb2affd700 1 --2- 172.21.15.60:0/1256976098 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb2c05c4c0 0x7fbb2c05c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:32.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb29ffb700 1 -- 172.21.15.60:0/1256976098 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142445192 0 0) 0x7fbb2c065e90 con 0x7fbb2c0b2e20 2020-10-31T22:49:32.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb29ffb700 1 -- 172.21.15.60:0/1256976098 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb10003230 con 0x7fbb2c0b2e20 2020-10-31T22:49:32.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb29ffb700 1 -- 172.21.15.60:0/1256976098 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301610770 0 0) 0x7fbb2c066130 con 0x7fbb2c0b4410 2020-10-31T22:49:32.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb29ffb700 1 -- 172.21.15.60:0/1256976098 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb2c065e90 con 0x7fbb2c0b4410 2020-10-31T22:49:32.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb2affd700 1 -- 172.21.15.60:0/1256976098 >> v1:172.21.15.66:6789/0 conn(0x7fbb2c0b4410 legacy=0x7fbb2c142580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:32.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb29ffb700 1 -- 172.21.15.60:0/1256976098 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2210001571 0 0) 0x7fbb10003230 con 0x7fbb2c0b2e20 2020-10-31T22:49:32.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb2affd700 1 -- 172.21.15.60:0/1256976098 >> v1:172.21.15.60:6789/0 conn(0x7fbb2c0b2e20 legacy=0x7fbb2c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb2affd700 1 -- 172.21.15.60:0/1256976098 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c0663d0 con 0x7fbb2c05c4c0 2020-10-31T22:49:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb2affd700 1 --2- 172.21.15.60:0/1256976098 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb2c05c4c0 0x7fbb2c05c8a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fbb200010d0 tx=0x7fbb1c006dc0).ready entity=mon.2 client_cookie=acfaf6f26cec3839 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb29ffb700 1 -- 172.21.15.60:0/1256976098 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb200016d0 con 0x7fbb2c05c4c0 2020-10-31T22:49:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb29ffb700 1 -- 172.21.15.60:0/1256976098 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1c00d5c0 con 0x7fbb2c05c4c0 2020-10-31T22:49:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb29ffb700 1 -- 172.21.15.60:0/1256976098 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb1c00d730 con 0x7fbb2c05c4c0 2020-10-31T22:49:32.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb31600700 1 -- 172.21.15.60:0/1256976098 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb2c05c4c0 msgr2=0x7fbb2c05c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb31600700 1 --2- 172.21.15.60:0/1256976098 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb2c05c4c0 0x7fbb2c05c8a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fbb200010d0 tx=0x7fbb1c006dc0).stop 2020-10-31T22:49:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb31600700 1 -- 172.21.15.60:0/1256976098 shutdown_connections 2020-10-31T22:49:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb31600700 1 --2- 172.21.15.60:0/1256976098 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb2c05c4c0 0x7fbb2c05c8a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb31600700 1 -- 172.21.15.60:0/1256976098 >> 172.21.15.60:0/1256976098 conn(0x7fbb2c0601e0 msgr2=0x7fbb2c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb31600700 1 -- 172.21.15.60:0/1256976098 shutdown_connections 2020-10-31T22:49:32.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.681+0000 7fbb31600700 1 -- 172.21.15.60:0/1256976098 wait complete. 2020-10-31T22:49:32.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb31600700 1 Processor -- start 2020-10-31T22:49:32.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb31600700 1 -- start start 2020-10-31T22:49:32.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb31600700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb2c05c4c0 0x7fbb2c0a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:32.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb31600700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb2c0b4410 0x7fbb2c1445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb31600700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb2c148170 0x7fbb2c0ab7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb31600700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c0a8ec0 con 0x7fbb2c148170 2020-10-31T22:49:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb31600700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c1476f0 con 0x7fbb2c0b4410 2020-10-31T22:49:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb31600700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c147990 con 0x7fbb2c05c4c0 2020-10-31T22:49:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb2b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb2c148170 0x7fbb2c0ab7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb2b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb2c148170 0x7fbb2c0ab7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48108/0 (socket says 172.21.15.60:48108) 2020-10-31T22:49:32.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb2b7fe700 1 -- 172.21.15.60:0/641268685 learned_addr learned my addr 172.21.15.60:0/641268685 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:32.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb2affd700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb2c05c4c0 0x7fbb2c0a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:32.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb2a7fc700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb2c0b4410 0x7fbb2c1445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:32.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb2b7fe700 1 -- 172.21.15.60:0/641268685 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb2c05c4c0 msgr2=0x7fbb2c0a92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:32.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb2b7fe700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb2c05c4c0 0x7fbb2c0a92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:32.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb2b7fe700 1 -- 172.21.15.60:0/641268685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb2c0b4410 msgr2=0x7fbb2c1445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:32.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb2b7fe700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb2c0b4410 0x7fbb2c1445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:32.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb2b7fe700 1 -- 172.21.15.60:0/641268685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c147c30 con 0x7fbb2c148170 2020-10-31T22:49:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb2affd700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb2c05c4c0 0x7fbb2c0a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:49:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb2b7fe700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb2c148170 0x7fbb2c0ab7a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7fbb24001450 tx=0x7fbb24007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb1bfff700 1 -- 172.21.15.60:0/641268685 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb2400a7b0 con 0x7fbb2c148170 2020-10-31T22:49:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb1bfff700 1 -- 172.21.15.60:0/641268685 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2400a910 con 0x7fbb2c148170 2020-10-31T22:49:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb1bfff700 1 -- 172.21.15.60:0/641268685 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbb2400aa80 con 0x7fbb2c148170 2020-10-31T22:49:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb31600700 1 -- 172.21.15.60:0/641268685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb2c0ab490 con 0x7fbb2c148170 2020-10-31T22:49:32.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.685+0000 7fbb31600700 1 -- 172.21.15.60:0/641268685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb2c0abeb0 con 0x7fbb2c148170 2020-10-31T22:49:32.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.689+0000 7fbb31600700 1 -- 172.21.15.60:0/641268685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2c1493c0 con 0x7fbb2c148170 2020-10-31T22:49:32.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.689+0000 7fbb1bfff700 1 -- 172.21.15.60:0/641268685 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbb24010070 con 0x7fbb2c148170 2020-10-31T22:49:32.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.689+0000 7fbb1bfff700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb08055020 0x7fbb080574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:32.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.689+0000 7fbb1bfff700 1 -- 172.21.15.60:0/641268685 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbb2406d630 con 0x7fbb2c148170 2020-10-31T22:49:32.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.689+0000 7fbb2affd700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb08055020 0x7fbb080574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:32.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.689+0000 7fbb2affd700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb08055020 0x7fbb080574e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fbb1c016000 tx=0x7fbb1c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:32.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.697+0000 7fbb1bfff700 1 -- 172.21.15.60:0/641268685 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbb2c1493c0 con 0x7fbb2c148170 2020-10-31T22:49:32.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.841+0000 7fbb31600700 1 -- 172.21.15.60:0/641268685 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb2c0a9050 con 0x7fbb2c148170 2020-10-31T22:49:32.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.841+0000 7fbb1bfff700 1 -- 172.21.15.60:0/641268685 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16052 (secure 0 0 0) 0x7fbb2c0a9050 con 0x7fbb2c148170 2020-10-31T22:49:32.849 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:32.849 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":120,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:49:30.433442+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:49:27.152231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-10-31T22:49:28.431362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:49:32.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.845+0000 7fbb31600700 1 -- 172.21.15.60:0/641268685 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb08055020 msgr2=0x7fbb080574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:32.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.845+0000 7fbb31600700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb08055020 0x7fbb080574e0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fbb1c016000 tx=0x7fbb1c015000).stop 2020-10-31T22:49:32.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.845+0000 7fbb31600700 1 -- 172.21.15.60:0/641268685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb2c148170 msgr2=0x7fbb2c0ab7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:32.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.845+0000 7fbb31600700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb2c148170 0x7fbb2c0ab7a0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 rx=0x7fbb24001450 tx=0x7fbb24007d30).stop 2020-10-31T22:49:32.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.845+0000 7fbb31600700 1 -- 172.21.15.60:0/641268685 shutdown_connections 2020-10-31T22:49:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.845+0000 7fbb31600700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb2c148170 0x7fbb2c0ab7a0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.845+0000 7fbb31600700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbb2c05c4c0 0x7fbb2c0a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.845+0000 7fbb31600700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbb08055020 0x7fbb080574e0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.845+0000 7fbb31600700 1 --2- 172.21.15.60:0/641268685 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbb2c0b4410 0x7fbb2c1445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.845+0000 7fbb31600700 1 -- 172.21.15.60:0/641268685 >> 172.21.15.60:0/641268685 conn(0x7fbb2c0601e0 msgr2=0x7fbb2c13f990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.845+0000 7fbb31600700 1 -- 172.21.15.60:0/641268685 shutdown_connections 2020-10-31T22:49:32.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.845+0000 7fbb31600700 1 -- 172.21.15.60:0/641268685 wait complete. 2020-10-31T22:49:32.863 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:49:27.152231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:49:28.431362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:49:32.865 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:49:32.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.981+0000 7f86ce0c2700 1 Processor -- start 2020-10-31T22:49:32.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.981+0000 7f86ce0c2700 1 -- start start 2020-10-31T22:49:32.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86ce0c2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f86c80b5380 0x7f86c80ac530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:32.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86ce0c2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86c80b0b50 0x7f86c80b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:32.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86ce0c2700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c80acd60 con 0x7f86c80b1b20 2020-10-31T22:49:32.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86ce0c2700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c80ad650 con 0x7f86c80b5380 2020-10-31T22:49:32.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86ce0c2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c80b5760 con 0x7f86c80b0b50 2020-10-31T22:49:32.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86cd0c0700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f86c80b5380 0x7f86c80ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:32.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86cd8c1700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f86c80b1b20 0x7f86c80b1f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:50120/0 (socket says 172.21.15.60:50120) 2020-10-31T22:49:32.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86cd8c1700 1 -- 172.21.15.60:0/3440798824 learned_addr learned my addr 172.21.15.60:0/3440798824 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:32.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86cc8bf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86c80b0b50 0x7f86c80b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:32.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86b7fff700 1 -- 172.21.15.60:0/3440798824 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989578626 0 0) 0x7f86c80acd60 con 0x7f86c80b1b20 2020-10-31T22:49:32.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86b7fff700 1 -- 172.21.15.60:0/3440798824 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86b0003230 con 0x7f86c80b1b20 2020-10-31T22:49:32.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86cc8bf700 1 -- 172.21.15.60:0/3440798824 >> v2:172.21.15.66:3300/0 conn(0x7f86c80b5380 msgr2=0x7f86c80ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:32.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86cc8bf700 1 --2- 172.21.15.60:0/3440798824 >> v2:172.21.15.66:3300/0 conn(0x7f86c80b5380 0x7f86c80ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:32.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86cc8bf700 1 -- 172.21.15.60:0/3440798824 >> v1:172.21.15.66:6789/0 conn(0x7f86c80b1b20 legacy=0x7f86c80b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86cc8bf700 1 -- 172.21.15.60:0/3440798824 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c80b14c0 con 0x7f86c80b0b50 2020-10-31T22:49:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86cc8bf700 1 --2- 172.21.15.60:0/3440798824 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86c80b0b50 0x7f86c80b0fd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f86b8002f30 tx=0x7f86b8006dc0).ready entity=mon.2 client_cookie=3e402d0ad59a6955 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86b7fff700 1 -- 172.21.15.60:0/3440798824 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86b80096a0 con 0x7f86c80b0b50 2020-10-31T22:49:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86b7fff700 1 -- 172.21.15.60:0/3440798824 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b8009800 con 0x7f86c80b0b50 2020-10-31T22:49:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86b7fff700 1 -- 172.21.15.60:0/3440798824 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86b8009b60 con 0x7f86c80b0b50 2020-10-31T22:49:32.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86ce0c2700 1 -- 172.21.15.60:0/3440798824 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86c80b0b50 msgr2=0x7f86c80b0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86ce0c2700 1 --2- 172.21.15.60:0/3440798824 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86c80b0b50 0x7f86c80b0fd0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f86b8002f30 tx=0x7f86b8006dc0).stop 2020-10-31T22:49:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86ce0c2700 1 -- 172.21.15.60:0/3440798824 shutdown_connections 2020-10-31T22:49:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86ce0c2700 1 --2- 172.21.15.60:0/3440798824 >> v2:172.21.15.66:3300/0 conn(0x7f86c80b5380 0x7f86c80ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86ce0c2700 1 --2- 172.21.15.60:0/3440798824 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86c80b0b50 0x7f86c80b0fd0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86ce0c2700 1 -- 172.21.15.60:0/3440798824 >> 172.21.15.60:0/3440798824 conn(0x7f86c806a600 msgr2=0x7f86c8060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86ce0c2700 1 -- 172.21.15.60:0/3440798824 shutdown_connections 2020-10-31T22:49:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.985+0000 7f86ce0c2700 1 -- 172.21.15.60:0/3440798824 wait complete. 2020-10-31T22:49:32.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86ce0c2700 1 Processor -- start 2020-10-31T22:49:33.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86ce0c2700 1 -- start start 2020-10-31T22:49:33.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86ce0c2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86c80b0b50 0x7f86c809e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86ce0c2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86c80b1b20 0x7f86c81484f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86ce0c2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c80b5380 0x7f86c80a7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86ce0c2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c809f100 con 0x7f86c80b1b20 2020-10-31T22:49:33.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86ce0c2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c8148b90 con 0x7f86c80b5380 2020-10-31T22:49:33.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86ce0c2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c809fd30 con 0x7f86c80b0b50 2020-10-31T22:49:33.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86cc8bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86c80b1b20 0x7f86c81484f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86cc8bf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86c80b1b20 0x7f86c81484f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48118/0 (socket says 172.21.15.60:48118) 2020-10-31T22:49:33.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86cc8bf700 1 -- 172.21.15.60:0/1562453636 learned_addr learned my addr 172.21.15.60:0/1562453636 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:33.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86cd0c0700 1 --2- 172.21.15.60:0/1562453636 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86c80b0b50 0x7f86c809e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86cd8c1700 1 --2- 172.21.15.60:0/1562453636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c80b5380 0x7f86c80a7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86cc8bf700 1 -- 172.21.15.60:0/1562453636 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86c80b0b50 msgr2=0x7f86c809e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86cc8bf700 1 --2- 172.21.15.60:0/1562453636 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86c80b0b50 0x7f86c809e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86cc8bf700 1 -- 172.21.15.60:0/1562453636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c80b5380 msgr2=0x7f86c80a7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86cc8bf700 1 --2- 172.21.15.60:0/1562453636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c80b5380 0x7f86c80a7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86cc8bf700 1 -- 172.21.15.60:0/1562453636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c809ffd0 con 0x7f86c80b1b20 2020-10-31T22:49:33.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86cc8bf700 1 --2- 172.21.15.60:0/1562453636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86c80b1b20 0x7f86c81484f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f86b8002f30 tx=0x7f86b8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:33.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86b67fc700 1 -- 172.21.15.60:0/1562453636 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86b8011c30 con 0x7f86c80b1b20 2020-10-31T22:49:33.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86b67fc700 1 -- 172.21.15.60:0/1562453636 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b8011d90 con 0x7f86c80b1b20 2020-10-31T22:49:33.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86ce0c2700 1 -- 172.21.15.60:0/1562453636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c80a0270 con 0x7f86c80b1b20 2020-10-31T22:49:33.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86b67fc700 1 -- 172.21.15.60:0/1562453636 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86b801d640 con 0x7f86c80b1b20 2020-10-31T22:49:33.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.989+0000 7f86ce0c2700 1 -- 172.21.15.60:0/1562453636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c81479a0 con 0x7f86c80b1b20 2020-10-31T22:49:33.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.993+0000 7f86ce0c2700 1 -- 172.21.15.60:0/1562453636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c81489e0 con 0x7f86c80b1b20 2020-10-31T22:49:33.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.993+0000 7f86b67fc700 1 -- 172.21.15.60:0/1562453636 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f86b8024030 con 0x7f86c80b1b20 2020-10-31T22:49:33.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.993+0000 7f86b67fc700 1 --2- 172.21.15.60:0/1562453636 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f86a8054f90 0x7f86a8057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.993+0000 7f86b67fc700 1 -- 172.21.15.60:0/1562453636 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f86b806eb80 con 0x7f86c80b1b20 2020-10-31T22:49:33.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.993+0000 7f86cd0c0700 1 --2- 172.21.15.60:0/1562453636 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f86a8054f90 0x7f86a8057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:32.993+0000 7f86cd0c0700 1 --2- 172.21.15.60:0/1562453636 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f86a8054f90 0x7f86a8057450 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f86c4008000 tx=0x7f86c4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:33.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.001+0000 7f86b67fc700 1 -- 172.21.15.60:0/1562453636 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f86b80450a0 con 0x7f86c80b1b20 2020-10-31T22:49:33.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.141+0000 7f86ce0c2700 1 -- 172.21.15.60:0/1562453636 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f86c80a0400 con 0x7f86c80b1b20 2020-10-31T22:49:33.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.145+0000 7f86b67fc700 1 -- 172.21.15.60:0/1562453636 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v120) v1 ==== 110+0+10 (secure 0 0 0) 0x7f86b8022070 con 0x7f86c80b1b20 2020-10-31T22:49:33.149 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:49:33.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.145+0000 7f86ce0c2700 1 -- 172.21.15.60:0/1562453636 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f86a8054f90 msgr2=0x7f86a8057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.145+0000 7f86ce0c2700 1 --2- 172.21.15.60:0/1562453636 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f86a8054f90 0x7f86a8057450 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7f86c4008000 tx=0x7f86c4008040).stop 2020-10-31T22:49:33.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.145+0000 7f86ce0c2700 1 -- 172.21.15.60:0/1562453636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86c80b1b20 msgr2=0x7f86c81484f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.145+0000 7f86ce0c2700 1 --2- 172.21.15.60:0/1562453636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86c80b1b20 0x7f86c81484f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 rx=0x7f86b8002f30 tx=0x7f86b8015000).stop 2020-10-31T22:49:33.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.145+0000 7f86ce0c2700 1 -- 172.21.15.60:0/1562453636 shutdown_connections 2020-10-31T22:49:33.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.145+0000 7f86ce0c2700 1 --2- 172.21.15.60:0/1562453636 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f86a8054f90 0x7f86a8057450 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.145+0000 7f86ce0c2700 1 --2- 172.21.15.60:0/1562453636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f86c80b5380 0x7f86c80a7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.145+0000 7f86ce0c2700 1 --2- 172.21.15.60:0/1562453636 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86c80b0b50 0x7f86c809e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.145+0000 7f86ce0c2700 1 --2- 172.21.15.60:0/1562453636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86c80b1b20 0x7f86c81484f0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.145+0000 7f86ce0c2700 1 -- 172.21.15.60:0/1562453636 >> 172.21.15.60:0/1562453636 conn(0x7f86c806a600 msgr2=0x7f86c805c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:33.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.145+0000 7f86ce0c2700 1 -- 172.21.15.60:0/1562453636 shutdown_connections 2020-10-31T22:49:33.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.145+0000 7f86ce0c2700 1 -- 172.21.15.60:0/1562453636 wait complete. 2020-10-31T22:49:33.171 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:49:33.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.289+0000 7f6f5703b700 1 Processor -- start 2020-10-31T22:49:33.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.289+0000 7f6f5703b700 1 -- start start 2020-10-31T22:49:33.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.289+0000 7f6f5703b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500b24a0 0x7f6f500b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.289+0000 7f6f5703b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f50141f00 0x7f6f50142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.289+0000 7f6f5703b700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f500b4440 con 0x7f6f500b5570 2020-10-31T22:49:33.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.289+0000 7f6f5703b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5013f930 con 0x7f6f50141f00 2020-10-31T22:49:33.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.289+0000 7f6f5703b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f50146060 con 0x7f6f500b24a0 2020-10-31T22:49:33.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.289+0000 7f6f5683a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f50141f00 0x7f6f50142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.289+0000 7f6f5683a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f50141f00 0x7f6f50142390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48130/0 (socket says 172.21.15.60:48130) 2020-10-31T22:49:33.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.289+0000 7f6f5683a700 1 -- 172.21.15.60:0/696241650 learned_addr learned my addr 172.21.15.60:0/696241650 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:33.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.289+0000 7f6f56039700 1 --1- 172.21.15.60:0/696241650 >> v1:172.21.15.60:6789/0 conn(0x7f6f500b5570 0x7f6f50145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52262/0 (socket says 172.21.15.60:52262) 2020-10-31T22:49:33.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.289+0000 7f6f55838700 1 --2- 172.21.15.60:0/696241650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500b24a0 0x7f6f500b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5683a700 1 -- 172.21.15.60:0/696241650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500b24a0 msgr2=0x7f6f500b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:33.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5683a700 1 --2- 172.21.15.60:0/696241650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500b24a0 0x7f6f500b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5683a700 1 -- 172.21.15.60:0/696241650 >> v1:172.21.15.60:6789/0 conn(0x7f6f500b5570 legacy=0x7f6f50145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5683a700 1 -- 172.21.15.60:0/696241650 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f500b02f0 con 0x7f6f50141f00 2020-10-31T22:49:33.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5683a700 1 --2- 172.21.15.60:0/696241650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f50141f00 0x7f6f50142390 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7f6f480032b0 tx=0x7f6f48009270).ready entity=mon.0 client_cookie=4599d089d430412 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:33.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f55037700 1 -- 172.21.15.60:0/696241650 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f48009e60 con 0x7f6f50141f00 2020-10-31T22:49:33.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f55037700 1 -- 172.21.15.60:0/696241650 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4800bc00 con 0x7f6f50141f00 2020-10-31T22:49:33.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f55037700 1 -- 172.21.15.60:0/696241650 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f4800bd70 con 0x7f6f50141f00 2020-10-31T22:49:33.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 -- 172.21.15.60:0/696241650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f50141f00 msgr2=0x7f6f50142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 --2- 172.21.15.60:0/696241650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f50141f00 0x7f6f50142390 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 rx=0x7f6f480032b0 tx=0x7f6f48009270).stop 2020-10-31T22:49:33.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 -- 172.21.15.60:0/696241650 shutdown_connections 2020-10-31T22:49:33.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 --2- 172.21.15.60:0/696241650 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f50141f00 0x7f6f50142390 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 --2- 172.21.15.60:0/696241650 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500b24a0 0x7f6f500b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 -- 172.21.15.60:0/696241650 >> 172.21.15.60:0/696241650 conn(0x7f6f500b8e90 msgr2=0x7f6f500b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:33.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 -- 172.21.15.60:0/696241650 shutdown_connections 2020-10-31T22:49:33.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 -- 172.21.15.60:0/696241650 wait complete. 2020-10-31T22:49:33.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 Processor -- start 2020-10-31T22:49:33.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 -- start start 2020-10-31T22:49:33.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500b24a0 0x7f6f500af100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f500b5570 0x7f6f50140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.306 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f50141f00 0x7f6f501540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500aea00 con 0x7f6f500b5570 2020-10-31T22:49:33.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f50145020 con 0x7f6f50141f00 2020-10-31T22:49:33.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5703b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f501452c0 con 0x7f6f500b24a0 2020-10-31T22:49:33.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f55838700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f500b5570 0x7f6f50140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f55838700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f500b5570 0x7f6f50140d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48132/0 (socket says 172.21.15.60:48132) 2020-10-31T22:49:33.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f55838700 1 -- 172.21.15.60:0/3536659239 learned_addr learned my addr 172.21.15.60:0/3536659239 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:33.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f56039700 1 --2- 172.21.15.60:0/3536659239 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500b24a0 0x7f6f500af100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f5683a700 1 --2- 172.21.15.60:0/3536659239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f50141f00 0x7f6f501540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f55838700 1 -- 172.21.15.60:0/3536659239 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500b24a0 msgr2=0x7f6f500af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f55838700 1 --2- 172.21.15.60:0/3536659239 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500b24a0 0x7f6f500af100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f55838700 1 -- 172.21.15.60:0/3536659239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f50141f00 msgr2=0x7f6f501540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f55838700 1 --2- 172.21.15.60:0/3536659239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f50141f00 0x7f6f501540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.308 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.293+0000 7f6f55838700 1 -- 172.21.15.60:0/3536659239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f500aec60 con 0x7f6f500b5570 2020-10-31T22:49:33.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.297+0000 7f6f55838700 1 --2- 172.21.15.60:0/3536659239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f500b5570 0x7f6f50140d60 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f6f4400c000 tx=0x7f6f44006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:33.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.297+0000 7f6f437fe700 1 -- 172.21.15.60:0/3536659239 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f4400cae0 con 0x7f6f500b5570 2020-10-31T22:49:33.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.297+0000 7f6f437fe700 1 -- 172.21.15.60:0/3536659239 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4400cc40 con 0x7f6f500b5570 2020-10-31T22:49:33.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.297+0000 7f6f5703b700 1 -- 172.21.15.60:0/3536659239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f50066780 con 0x7f6f500b5570 2020-10-31T22:49:33.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.297+0000 7f6f437fe700 1 -- 172.21.15.60:0/3536659239 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f440123f0 con 0x7f6f500b5570 2020-10-31T22:49:33.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.297+0000 7f6f5703b700 1 -- 172.21.15.60:0/3536659239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f501545d0 con 0x7f6f500b5570 2020-10-31T22:49:33.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.297+0000 7f6f437fe700 1 -- 172.21.15.60:0/3536659239 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6f44012550 con 0x7f6f500b5570 2020-10-31T22:49:33.309 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.297+0000 7f6f5703b700 1 -- 172.21.15.60:0/3536659239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f50144740 con 0x7f6f500b5570 2020-10-31T22:49:33.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.297+0000 7f6f437fe700 1 --2- 172.21.15.60:0/3536659239 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f30054f90 0x7f6f30057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.297+0000 7f6f437fe700 1 -- 172.21.15.60:0/3536659239 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6f4406e000 con 0x7f6f500b5570 2020-10-31T22:49:33.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.297+0000 7f6f56039700 1 --2- 172.21.15.60:0/3536659239 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f30054f90 0x7f6f30057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.297+0000 7f6f56039700 1 --2- 172.21.15.60:0/3536659239 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f30054f90 0x7f6f30057450 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f6f4c00b000 tx=0x7f6f4c007050).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:33.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.305+0000 7f6f437fe700 1 -- 172.21.15.60:0/3536659239 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6f50144740 con 0x7f6f500b5570 2020-10-31T22:49:33.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.445+0000 7f6f5703b700 1 -- 172.21.15.60:0/3536659239 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6f50144740 con 0x7f6f500b5570 2020-10-31T22:49:33.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.445+0000 7f6f437fe700 1 -- 172.21.15.60:0/3536659239 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v120) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6f50144740 con 0x7f6f500b5570 2020-10-31T22:49:33.453 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:49:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.449+0000 7f6f5703b700 1 -- 172.21.15.60:0/3536659239 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f30054f90 msgr2=0x7f6f30057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.449+0000 7f6f5703b700 1 --2- 172.21.15.60:0/3536659239 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f30054f90 0x7f6f30057450 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7f6f4c00b000 tx=0x7f6f4c007050).stop 2020-10-31T22:49:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.449+0000 7f6f5703b700 1 -- 172.21.15.60:0/3536659239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f500b5570 msgr2=0x7f6f50140d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.449+0000 7f6f5703b700 1 --2- 172.21.15.60:0/3536659239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f500b5570 0x7f6f50140d60 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 rx=0x7f6f4400c000 tx=0x7f6f44006dc0).stop 2020-10-31T22:49:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.449+0000 7f6f5703b700 1 -- 172.21.15.60:0/3536659239 shutdown_connections 2020-10-31T22:49:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.449+0000 7f6f5703b700 1 --2- 172.21.15.60:0/3536659239 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f30054f90 0x7f6f30057450 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.449+0000 7f6f5703b700 1 --2- 172.21.15.60:0/3536659239 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f50141f00 0x7f6f501540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.449+0000 7f6f5703b700 1 --2- 172.21.15.60:0/3536659239 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500b24a0 0x7f6f500af100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.449+0000 7f6f5703b700 1 --2- 172.21.15.60:0/3536659239 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f500b5570 0x7f6f50140d60 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.449+0000 7f6f5703b700 1 -- 172.21.15.60:0/3536659239 >> 172.21.15.60:0/3536659239 conn(0x7f6f500b8e90 msgr2=0x7f6f50142310 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.449+0000 7f6f5703b700 1 -- 172.21.15.60:0/3536659239 shutdown_connections 2020-10-31T22:49:33.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.449+0000 7f6f5703b700 1 -- 172.21.15.60:0/3536659239 wait complete. 2020-10-31T22:49:33.467 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:49:33.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d96b0700 1 Processor -- start 2020-10-31T22:49:33.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d96b0700 1 -- start start 2020-10-31T22:49:33.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d96b0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd6d40b13c0 0x7fd6d414a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d96b0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d4063520 con 0x7fd6d40b5040 2020-10-31T22:49:33.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d96b0700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6d40b5550 con 0x7fd6d4063140 2020-10-31T22:49:33.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d96b0700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d40b57f0 con 0x7fd6d40b13c0 2020-10-31T22:49:33.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d37fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd6d40b5040 0x7fd6d40b2310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52276/0 (socket says 172.21.15.60:52276) 2020-10-31T22:49:33.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d37fe700 1 -- 172.21.15.60:0/2516340942 learned_addr learned my addr 172.21.15.60:0/2516340942 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:33.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d8eaf700 1 --2- 172.21.15.60:0/2516340942 >> v2:172.21.15.60:3300/0 conn(0x7fd6d40b13c0 0x7fd6d414a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d2ffd700 1 -- 172.21.15.60:0/2516340942 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3454710105 0 0) 0x7fd6d4063520 con 0x7fd6d40b5040 2020-10-31T22:49:33.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d2ffd700 1 -- 172.21.15.60:0/2516340942 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6b4003230 con 0x7fd6d40b5040 2020-10-31T22:49:33.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d2ffd700 1 -- 172.21.15.60:0/2516340942 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954528834 0 0) 0x7fd6d40b5550 con 0x7fd6d4063140 2020-10-31T22:49:33.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d2ffd700 1 -- 172.21.15.60:0/2516340942 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d4063520 con 0x7fd6d4063140 2020-10-31T22:49:33.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d2ffd700 1 -- 172.21.15.60:0/2516340942 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 842658312 0 0) 0x7fd6b4003230 con 0x7fd6d40b5040 2020-10-31T22:49:33.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d8eaf700 1 -- 172.21.15.60:0/2516340942 >> v1:172.21.15.66:6789/0 conn(0x7fd6d4063140 legacy=0x7fd6d40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d8eaf700 1 -- 172.21.15.60:0/2516340942 >> v1:172.21.15.60:6789/0 conn(0x7fd6d40b5040 legacy=0x7fd6d40b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d8eaf700 1 -- 172.21.15.60:0/2516340942 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d40b5a90 con 0x7fd6d40b13c0 2020-10-31T22:49:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.581+0000 7fd6d8eaf700 1 --2- 172.21.15.60:0/2516340942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d40b13c0 0x7fd6d414a650 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fd6bc0010d0 tx=0x7fd6cc006dc0).ready entity=mon.0 client_cookie=6713a07ad6ccc4e2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.585+0000 7fd6d2ffd700 1 -- 172.21.15.60:0/2516340942 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6bc0016d0 con 0x7fd6d40b13c0 2020-10-31T22:49:33.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.585+0000 7fd6d2ffd700 1 -- 172.21.15.60:0/2516340942 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc00d610 con 0x7fd6d40b13c0 2020-10-31T22:49:33.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.585+0000 7fd6d2ffd700 1 -- 172.21.15.60:0/2516340942 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6cc00d780 con 0x7fd6d40b13c0 2020-10-31T22:49:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.585+0000 7fd6d96b0700 1 -- 172.21.15.60:0/2516340942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d40b13c0 msgr2=0x7fd6d414a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.585+0000 7fd6d96b0700 1 --2- 172.21.15.60:0/2516340942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d40b13c0 0x7fd6d414a650 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 rx=0x7fd6bc0010d0 tx=0x7fd6cc006dc0).stop 2020-10-31T22:49:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.585+0000 7fd6d96b0700 1 -- 172.21.15.60:0/2516340942 shutdown_connections 2020-10-31T22:49:33.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.585+0000 7fd6d96b0700 1 --2- 172.21.15.60:0/2516340942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d40b13c0 0x7fd6d414a650 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.585+0000 7fd6d96b0700 1 -- 172.21.15.60:0/2516340942 >> 172.21.15.60:0/2516340942 conn(0x7fd6d406a600 msgr2=0x7fd6d4060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.585+0000 7fd6d96b0700 1 -- 172.21.15.60:0/2516340942 shutdown_connections 2020-10-31T22:49:33.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.585+0000 7fd6d96b0700 1 -- 172.21.15.60:0/2516340942 wait complete. 2020-10-31T22:49:33.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.585+0000 7fd6d96b0700 1 Processor -- start 2020-10-31T22:49:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.585+0000 7fd6d96b0700 1 -- start start 2020-10-31T22:49:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d96b0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd6d4063140 0x7fd6d40643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d96b0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40b13c0 0x7fd6d40655f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d96b0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d40b5040 0x7fd6d4065ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d96b0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4063c60 con 0x7fd6d40b5040 2020-10-31T22:49:33.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d96b0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d4063720 con 0x7fd6d40b13c0 2020-10-31T22:49:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d96b0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40639c0 con 0x7fd6d4063140 2020-10-31T22:49:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d8eaf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d40b5040 0x7fd6d4065ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d37fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40b13c0 0x7fd6d40655f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d8eaf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d40b5040 0x7fd6d4065ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48150/0 (socket says 172.21.15.60:48150) 2020-10-31T22:49:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd6d4063140 0x7fd6d40643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d8eaf700 1 -- 172.21.15.60:0/1548878548 learned_addr learned my addr 172.21.15.60:0/1548878548 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:33.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d3fff700 1 -- 172.21.15.60:0/1548878548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40b13c0 msgr2=0x7fd6d40655f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d3fff700 1 --2- 172.21.15.60:0/1548878548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40b13c0 0x7fd6d40655f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d3fff700 1 -- 172.21.15.60:0/1548878548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d40b5040 msgr2=0x7fd6d4065ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d3fff700 1 --2- 172.21.15.60:0/1548878548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d40b5040 0x7fd6d4065ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d3fff700 1 -- 172.21.15.60:0/1548878548 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d4064eb0 con 0x7fd6d4063140 2020-10-31T22:49:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d8eaf700 1 --2- 172.21.15.60:0/1548878548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d40b5040 0x7fd6d4065ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d37fe700 1 --2- 172.21.15.60:0/1548878548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40b13c0 0x7fd6d40655f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:33.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d3fff700 1 --2- 172.21.15.60:0/1548878548 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd6d4063140 0x7fd6d40643c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd6c4001450 tx=0x7fd6c4007ce0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d17fa700 1 -- 172.21.15.60:0/1548878548 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6c400ce40 con 0x7fd6d4063140 2020-10-31T22:49:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d17fa700 1 -- 172.21.15.60:0/1548878548 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c400a750 con 0x7fd6d4063140 2020-10-31T22:49:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d96b0700 1 -- 172.21.15.60:0/1548878548 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d4065150 con 0x7fd6d4063140 2020-10-31T22:49:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d17fa700 1 -- 172.21.15.60:0/1548878548 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd6c400a8c0 con 0x7fd6d4063140 2020-10-31T22:49:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d96b0700 1 -- 172.21.15.60:0/1548878548 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d41452b0 con 0x7fd6d4063140 2020-10-31T22:49:33.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.589+0000 7fd6d96b0700 1 -- 172.21.15.60:0/1548878548 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d40652e0 con 0x7fd6d4063140 2020-10-31T22:49:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.593+0000 7fd6d17fa700 1 -- 172.21.15.60:0/1548878548 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd6c4010070 con 0x7fd6d4063140 2020-10-31T22:49:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.593+0000 7fd6d17fa700 1 --2- 172.21.15.60:0/1548878548 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd6b8054fd0 0x7fd6b8057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.593+0000 7fd6d17fa700 1 -- 172.21.15.60:0/1548878548 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fd6c406cfc0 con 0x7fd6d4063140 2020-10-31T22:49:33.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.593+0000 7fd6d37fe700 1 --2- 172.21.15.60:0/1548878548 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd6b8054fd0 0x7fd6b8057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.593+0000 7fd6d37fe700 1 --2- 172.21.15.60:0/1548878548 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd6b8054fd0 0x7fd6b8057490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fd6bc00d000 tx=0x7fd6bc000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:33.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.605+0000 7fd6d17fa700 1 -- 172.21.15.60:0/1548878548 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd6c40434e0 con 0x7fd6d4063140 2020-10-31T22:49:33.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.745+0000 7fd6d96b0700 1 -- 172.21.15.60:0/1548878548 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6d4057100 con 0x7fd6d4063140 2020-10-31T22:49:33.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.749+0000 7fd6d17fa700 1 -- 172.21.15.60:0/1548878548 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v120) v1 ==== 104+0+10 (secure 0 0 0) 0x7fd6c4046b00 con 0x7fd6d4063140 2020-10-31T22:49:33.755 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:49:33.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.749+0000 7fd6d96b0700 1 -- 172.21.15.60:0/1548878548 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd6b8054fd0 msgr2=0x7fd6b8057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.749+0000 7fd6d96b0700 1 --2- 172.21.15.60:0/1548878548 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd6b8054fd0 0x7fd6b8057490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fd6bc00d000 tx=0x7fd6bc000b80).stop 2020-10-31T22:49:33.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.749+0000 7fd6d96b0700 1 -- 172.21.15.60:0/1548878548 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd6d4063140 msgr2=0x7fd6d40643c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.749+0000 7fd6d96b0700 1 --2- 172.21.15.60:0/1548878548 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd6d4063140 0x7fd6d40643c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7fd6c4001450 tx=0x7fd6c4007ce0).stop 2020-10-31T22:49:33.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.749+0000 7fd6d96b0700 1 -- 172.21.15.60:0/1548878548 shutdown_connections 2020-10-31T22:49:33.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.749+0000 7fd6d96b0700 1 --2- 172.21.15.60:0/1548878548 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d40b5040 0x7fd6d4065ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.749+0000 7fd6d96b0700 1 --2- 172.21.15.60:0/1548878548 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd6d4063140 0x7fd6d40643c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.749+0000 7fd6d96b0700 1 --2- 172.21.15.60:0/1548878548 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd6b8054fd0 0x7fd6b8057490 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.749+0000 7fd6d96b0700 1 --2- 172.21.15.60:0/1548878548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd6d40b13c0 0x7fd6d40655f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.749+0000 7fd6d96b0700 1 -- 172.21.15.60:0/1548878548 >> 172.21.15.60:0/1548878548 conn(0x7fd6d406a600 msgr2=0x7fd6d40b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:33.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.749+0000 7fd6d96b0700 1 -- 172.21.15.60:0/1548878548 shutdown_connections 2020-10-31T22:49:33.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.749+0000 7fd6d96b0700 1 -- 172.21.15.60:0/1548878548 wait complete. 2020-10-31T22:49:33.775 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:49:33.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3290d0700 1 Processor -- start 2020-10-31T22:49:33.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3290d0700 1 -- start start 2020-10-31T22:49:33.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3290d0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa32414f980 0x7fa324151d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3290d0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3240af900 con 0x7fa3240ac870 2020-10-31T22:49:33.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3290d0700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3240afc10 con 0x7fa3240af520 2020-10-31T22:49:33.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3290d0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32405bb70 con 0x7fa32414f980 2020-10-31T22:49:33.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3237fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa3240ac870 0x7fa324146060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52292/0 (socket says 172.21.15.60:52292) 2020-10-31T22:49:33.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3237fe700 1 -- 172.21.15.60:0/3432681213 learned_addr learned my addr 172.21.15.60:0/3432681213 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:33.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3288cf700 1 --2- 172.21.15.60:0/3432681213 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa32414f980 0x7fa324151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa322ffd700 1 -- 172.21.15.60:0/3432681213 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511164937 0 0) 0x7fa3240af900 con 0x7fa3240ac870 2020-10-31T22:49:33.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa322ffd700 1 -- 172.21.15.60:0/3432681213 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa310003230 con 0x7fa3240ac870 2020-10-31T22:49:33.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa322ffd700 1 -- 172.21.15.60:0/3432681213 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481925347 0 0) 0x7fa3240afc10 con 0x7fa3240af520 2020-10-31T22:49:33.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa322ffd700 1 -- 172.21.15.60:0/3432681213 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3240af900 con 0x7fa3240af520 2020-10-31T22:49:33.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3288cf700 1 -- 172.21.15.60:0/3432681213 >> v1:172.21.15.66:6789/0 conn(0x7fa3240af520 legacy=0x7fa324066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3288cf700 1 -- 172.21.15.60:0/3432681213 >> v1:172.21.15.60:6789/0 conn(0x7fa3240ac870 legacy=0x7fa324146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.905 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3288cf700 1 -- 172.21.15.60:0/3432681213 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3240ac130 con 0x7fa32414f980 2020-10-31T22:49:33.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3288cf700 1 --2- 172.21.15.60:0/3432681213 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa32414f980 0x7fa324151d70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fa31c0032b0 tx=0x7fa31c0091a0).ready entity=mon.2 client_cookie=8efd2bc8e298e151 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:33.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa322ffd700 1 -- 172.21.15.60:0/3432681213 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa31c00b940 con 0x7fa32414f980 2020-10-31T22:49:33.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa322ffd700 1 -- 172.21.15.60:0/3432681213 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31c00baa0 con 0x7fa32414f980 2020-10-31T22:49:33.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa322ffd700 1 -- 172.21.15.60:0/3432681213 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa31c00bc10 con 0x7fa32414f980 2020-10-31T22:49:33.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3290d0700 1 -- 172.21.15.60:0/3432681213 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa32414f980 msgr2=0x7fa324151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.893+0000 7fa3290d0700 1 --2- 172.21.15.60:0/3432681213 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa32414f980 0x7fa324151d70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fa31c0032b0 tx=0x7fa31c0091a0).stop 2020-10-31T22:49:33.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3290d0700 1 -- 172.21.15.60:0/3432681213 shutdown_connections 2020-10-31T22:49:33.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3290d0700 1 --2- 172.21.15.60:0/3432681213 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa32414f980 0x7fa324151d70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3290d0700 1 -- 172.21.15.60:0/3432681213 >> 172.21.15.60:0/3432681213 conn(0x7fa3240b3fd0 msgr2=0x7fa3240b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:33.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3290d0700 1 -- 172.21.15.60:0/3432681213 shutdown_connections 2020-10-31T22:49:33.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3290d0700 1 -- 172.21.15.60:0/3432681213 wait complete. 2020-10-31T22:49:33.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3290d0700 1 Processor -- start 2020-10-31T22:49:33.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3290d0700 1 -- start start 2020-10-31T22:49:33.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3290d0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3240ac870 0x7fa324142dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3290d0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3240af520 0x7fa3240aa650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3290d0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa32414f980 0x7fa3240aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3290d0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3241557e0 con 0x7fa3240ac870 2020-10-31T22:49:33.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3290d0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa324155a80 con 0x7fa3240af520 2020-10-31T22:49:33.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3290d0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa324155d20 con 0x7fa32414f980 2020-10-31T22:49:33.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa323fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3240ac870 0x7fa324142dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa323fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3240ac870 0x7fa324142dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48160/0 (socket says 172.21.15.60:48160) 2020-10-31T22:49:33.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa323fff700 1 -- 172.21.15.60:0/780026140 learned_addr learned my addr 172.21.15.60:0/780026140 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:33.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3288cf700 1 --2- 172.21.15.60:0/780026140 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa32414f980 0x7fa3240aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa3237fe700 1 --2- 172.21.15.60:0/780026140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3240af520 0x7fa3240aa650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa323fff700 1 -- 172.21.15.60:0/780026140 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa32414f980 msgr2=0x7fa3240aab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa323fff700 1 --2- 172.21.15.60:0/780026140 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa32414f980 0x7fa3240aab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa323fff700 1 -- 172.21.15.60:0/780026140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3240af520 msgr2=0x7fa3240aa650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:33.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.897+0000 7fa323fff700 1 --2- 172.21.15.60:0/780026140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3240af520 0x7fa3240aa650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:33.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.901+0000 7fa323fff700 1 -- 172.21.15.60:0/780026140 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa324155fc0 con 0x7fa3240ac870 2020-10-31T22:49:33.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.901+0000 7fa323fff700 1 --2- 172.21.15.60:0/780026140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3240ac870 0x7fa324142dd0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fa314001120 tx=0x7fa3140079d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:33.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.901+0000 7fa3217fa700 1 -- 172.21.15.60:0/780026140 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa31400f470 con 0x7fa3240ac870 2020-10-31T22:49:33.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.901+0000 7fa3290d0700 1 -- 172.21.15.60:0/780026140 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3240a9210 con 0x7fa3240ac870 2020-10-31T22:49:33.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.901+0000 7fa3217fa700 1 -- 172.21.15.60:0/780026140 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31400f5d0 con 0x7fa3240ac870 2020-10-31T22:49:33.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.901+0000 7fa3217fa700 1 -- 172.21.15.60:0/780026140 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa31400f930 con 0x7fa3240ac870 2020-10-31T22:49:33.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.901+0000 7fa3290d0700 1 -- 172.21.15.60:0/780026140 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa324143460 con 0x7fa3240ac870 2020-10-31T22:49:33.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.901+0000 7fa3290d0700 1 -- 172.21.15.60:0/780026140 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa324155610 con 0x7fa3240ac870 2020-10-31T22:49:33.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.901+0000 7fa3217fa700 1 -- 172.21.15.60:0/780026140 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa314019030 con 0x7fa3240ac870 2020-10-31T22:49:33.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.901+0000 7fa3217fa700 1 --2- 172.21.15.60:0/780026140 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa3040550e0 0x7fa3040575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:33.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.901+0000 7fa3217fa700 1 -- 172.21.15.60:0/780026140 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa31406ce20 con 0x7fa3240ac870 2020-10-31T22:49:33.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.901+0000 7fa3237fe700 1 --2- 172.21.15.60:0/780026140 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa3040550e0 0x7fa3040575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:33.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.905+0000 7fa3237fe700 1 --2- 172.21.15.60:0/780026140 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa3040550e0 0x7fa3040575a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fa31800d000 tx=0x7fa318009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:33.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:33.905+0000 7fa3217fa700 1 -- 172.21.15.60:0/780026140 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa3140432a0 con 0x7fa3240ac870 2020-10-31T22:49:34.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:34.049+0000 7fa3290d0700 1 -- 172.21.15.60:0/780026140 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa324156150 con 0x7fa3240ac870 2020-10-31T22:49:35.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:34.049+0000 7fa3217fa700 1 -- 172.21.15.60:0/780026140 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v120) v1 ==== 100+0+10 (secure 0 0 0) 0x7fa3140468c0 con 0x7fa3240ac870 2020-10-31T22:49:35.329 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:34.053+0000 7fa3290d0700 1 -- 172.21.15.60:0/780026140 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa3040550e0 msgr2=0x7fa3040575a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:34.053+0000 7fa3290d0700 1 --2- 172.21.15.60:0/780026140 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa3040550e0 0x7fa3040575a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fa31800d000 tx=0x7fa318009040).stop 2020-10-31T22:49:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:34.053+0000 7fa3290d0700 1 -- 172.21.15.60:0/780026140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3240ac870 msgr2=0x7fa324142dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:34.053+0000 7fa3290d0700 1 --2- 172.21.15.60:0/780026140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3240ac870 0x7fa324142dd0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 rx=0x7fa314001120 tx=0x7fa3140079d0).stop 2020-10-31T22:49:35.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:34.053+0000 7fa3290d0700 1 -- 172.21.15.60:0/780026140 shutdown_connections 2020-10-31T22:49:35.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:34.053+0000 7fa3290d0700 1 --2- 172.21.15.60:0/780026140 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa32414f980 0x7fa3240aab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:35.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:34.053+0000 7fa3290d0700 1 --2- 172.21.15.60:0/780026140 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3240ac870 0x7fa324142dd0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:35.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:34.053+0000 7fa3290d0700 1 --2- 172.21.15.60:0/780026140 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa3040550e0 0x7fa3040575a0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:35.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:34.053+0000 7fa3290d0700 1 --2- 172.21.15.60:0/780026140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3240af520 0x7fa3240aa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:35.331 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:34.053+0000 7fa3290d0700 1 -- 172.21.15.60:0/780026140 >> 172.21.15.60:0/780026140 conn(0x7fa3240b3fd0 msgr2=0x7fa324141960 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:35.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:34.053+0000 7fa3290d0700 1 -- 172.21.15.60:0/780026140 shutdown_connections 2020-10-31T22:49:35.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:34.053+0000 7fa3290d0700 1 -- 172.21.15.60:0/780026140 wait complete. 2020-10-31T22:49:35.332 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:49:35.333 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:49:35.334 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:49:35.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58da5f700 1 Processor -- start 2020-10-31T22:49:35.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58da5f700 1 -- start start 2020-10-31T22:49:35.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58da5f700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc5880b24a0 0x7fc5880b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:35.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58da5f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc588141fe0 0x7fc588142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:35.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58da5f700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc588145180 con 0x7fc5880b5570 2020-10-31T22:49:35.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58da5f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5880afae0 con 0x7fc588141fe0 2020-10-31T22:49:35.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58da5f700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc588141bf0 con 0x7fc5880b24a0 2020-10-31T22:49:35.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58d25e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc588141fe0 0x7fc588142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:35.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58d25e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc588141fe0 0x7fc588142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48172/0 (socket says 172.21.15.60:48172) 2020-10-31T22:49:35.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58d25e700 1 -- 172.21.15.60:0/436607373 learned_addr learned my addr 172.21.15.60:0/436607373 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:35.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc587fff700 1 --2- 172.21.15.60:0/436607373 >> v2:172.21.15.66:3300/0 conn(0x7fc5880b24a0 0x7fc5880b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:35.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58d25e700 1 -- 172.21.15.60:0/436607373 >> v2:172.21.15.66:3300/0 conn(0x7fc5880b24a0 msgr2=0x7fc5880b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:35.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58d25e700 1 --2- 172.21.15.60:0/436607373 >> v2:172.21.15.66:3300/0 conn(0x7fc5880b24a0 0x7fc5880b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:35.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58d25e700 1 -- 172.21.15.60:0/436607373 >> v1:172.21.15.66:6789/0 conn(0x7fc5880b5570 legacy=0x7fc588145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:35.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58d25e700 1 -- 172.21.15.60:0/436607373 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5880b0670 con 0x7fc588141fe0 2020-10-31T22:49:35.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.445+0000 7fc58d25e700 1 --2- 172.21.15.60:0/436607373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc588141fe0 0x7fc588142490 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fc58805f580 tx=0x7fc580009270).ready entity=mon.0 client_cookie=801a2cdcec881c2e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:35.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.449+0000 7fc5877fe700 1 -- 172.21.15.60:0/436607373 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc58000bbc0 con 0x7fc588141fe0 2020-10-31T22:49:35.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.449+0000 7fc5877fe700 1 -- 172.21.15.60:0/436607373 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58000bd20 con 0x7fc588141fe0 2020-10-31T22:49:35.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.449+0000 7fc5877fe700 1 -- 172.21.15.60:0/436607373 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc58000be90 con 0x7fc588141fe0 2020-10-31T22:49:35.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.449+0000 7fc58da5f700 1 -- 172.21.15.60:0/436607373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc588141fe0 msgr2=0x7fc588142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:35.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.449+0000 7fc58da5f700 1 --2- 172.21.15.60:0/436607373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc588141fe0 0x7fc588142490 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 rx=0x7fc58805f580 tx=0x7fc580009270).stop 2020-10-31T22:49:35.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.449+0000 7fc58da5f700 1 -- 172.21.15.60:0/436607373 shutdown_connections 2020-10-31T22:49:35.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.449+0000 7fc58da5f700 1 --2- 172.21.15.60:0/436607373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc588141fe0 0x7fc588142490 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:35.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.449+0000 7fc58da5f700 1 --2- 172.21.15.60:0/436607373 >> v2:172.21.15.66:3300/0 conn(0x7fc5880b24a0 0x7fc5880b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:35.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.449+0000 7fc58da5f700 1 -- 172.21.15.60:0/436607373 >> 172.21.15.60:0/436607373 conn(0x7fc5880b8e90 msgr2=0x7fc5880b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:35.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.449+0000 7fc58da5f700 1 -- 172.21.15.60:0/436607373 shutdown_connections 2020-10-31T22:49:35.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.449+0000 7fc58da5f700 1 -- 172.21.15.60:0/436607373 wait complete. 2020-10-31T22:49:35.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.449+0000 7fc58da5f700 1 Processor -- start 2020-10-31T22:49:35.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.449+0000 7fc58da5f700 1 -- start start 2020-10-31T22:49:35.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58da5f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5880b24a0 0x7fc588148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:35.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58da5f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5880b5570 0x7fc588153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:35.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58da5f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc588141fe0 0x7fc5881510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:35.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58da5f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5881509f0 con 0x7fc588141fe0 2020-10-31T22:49:35.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58da5f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880b6cc0 con 0x7fc5880b5570 2020-10-31T22:49:35.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58da5f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5880b77d0 con 0x7fc5880b24a0 2020-10-31T22:49:35.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58d25e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc588141fe0 0x7fc5881510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:35.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58d25e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc588141fe0 0x7fc5881510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48178/0 (socket says 172.21.15.60:48178) 2020-10-31T22:49:35.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58d25e700 1 -- 172.21.15.60:0/4279476927 learned_addr learned my addr 172.21.15.60:0/4279476927 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:35.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc587fff700 1 --2- 172.21.15.60:0/4279476927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5880b5570 0x7fc588153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:35.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58ca5d700 1 --2- 172.21.15.60:0/4279476927 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5880b24a0 0x7fc588148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:35.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58d25e700 1 -- 172.21.15.60:0/4279476927 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5880b24a0 msgr2=0x7fc588148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:35.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58d25e700 1 --2- 172.21.15.60:0/4279476927 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5880b24a0 0x7fc588148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:35.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58d25e700 1 -- 172.21.15.60:0/4279476927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5880b5570 msgr2=0x7fc588153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:35.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58d25e700 1 --2- 172.21.15.60:0/4279476927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5880b5570 0x7fc588153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:35.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58d25e700 1 -- 172.21.15.60:0/4279476927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc588150c20 con 0x7fc588141fe0 2020-10-31T22:49:35.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58d25e700 1 --2- 172.21.15.60:0/4279476927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc588141fe0 0x7fc5881510c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fc58805f580 tx=0x7fc580016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:35.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc585ffb700 1 -- 172.21.15.60:0/4279476927 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc58001e610 con 0x7fc588141fe0 2020-10-31T22:49:35.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc585ffb700 1 -- 172.21.15.60:0/4279476927 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58001e770 con 0x7fc588141fe0 2020-10-31T22:49:35.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc585ffb700 1 -- 172.21.15.60:0/4279476927 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc58001ead0 con 0x7fc588141fe0 2020-10-31T22:49:35.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58da5f700 1 -- 172.21.15.60:0/4279476927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5880af300 con 0x7fc588141fe0 2020-10-31T22:49:35.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.453+0000 7fc58da5f700 1 -- 172.21.15.60:0/4279476927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5880b6050 con 0x7fc588141fe0 2020-10-31T22:49:35.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.457+0000 7fc585ffb700 1 -- 172.21.15.60:0/4279476927 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc58000f070 con 0x7fc588141fe0 2020-10-31T22:49:35.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.457+0000 7fc58da5f700 1 -- 172.21.15.60:0/4279476927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc588150db0 con 0x7fc588141fe0 2020-10-31T22:49:35.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.457+0000 7fc585ffb700 1 --2- 172.21.15.60:0/4279476927 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc568054fd0 0x7fc568057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:35.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.457+0000 7fc585ffb700 1 -- 172.21.15.60:0/4279476927 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc58006f000 con 0x7fc588141fe0 2020-10-31T22:49:35.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.457+0000 7fc58ca5d700 1 --2- 172.21.15.60:0/4279476927 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc568054fd0 0x7fc568057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:35.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.457+0000 7fc58ca5d700 1 --2- 172.21.15.60:0/4279476927 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc568054fd0 0x7fc568057490 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fc57800d000 tx=0x7fc578000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:35.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.461+0000 7fc585ffb700 1 -- 172.21.15.60:0/4279476927 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc580045480 con 0x7fc588141fe0 2020-10-31T22:49:35.661 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.657+0000 7fc58da5f700 1 -- 172.21.15.60:0/4279476927 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc588057100 con 0x7fc588141fe0 2020-10-31T22:49:35.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.657+0000 7fc585ffb700 1 -- 172.21.15.60:0/4279476927 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+2492 (secure 0 0 0) 0x7fc580015090 con 0x7fc588141fe0 2020-10-31T22:49:35.662 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:35.663 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":59,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6554,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2152829277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2152829277},{"type":"v1","addr":"172.21.15.60:6835","nonce":2152829277}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":56},{"gid":7285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/1505884738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1505884738},{"type":"v1","addr":"172.21.15.60:6837","nonce":1505884738}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:49:29.429837+0000","modified":"2020-10-31T22:49:30.432586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7476":{"gid":7476,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/805667342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":805667342},{"type":"v1","addr":"172.21.15.66:6833","nonce":805667342}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-10-31T22:49:35.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.657+0000 7fc58da5f700 1 -- 172.21.15.60:0/4279476927 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc568054fd0 msgr2=0x7fc568057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:35.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.657+0000 7fc58da5f700 1 --2- 172.21.15.60:0/4279476927 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc568054fd0 0x7fc568057490 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fc57800d000 tx=0x7fc578000b80).stop 2020-10-31T22:49:35.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.657+0000 7fc58da5f700 1 -- 172.21.15.60:0/4279476927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc588141fe0 msgr2=0x7fc5881510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:35.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.657+0000 7fc58da5f700 1 --2- 172.21.15.60:0/4279476927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc588141fe0 0x7fc5881510c0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 rx=0x7fc58805f580 tx=0x7fc580016000).stop 2020-10-31T22:49:35.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.657+0000 7fc58da5f700 1 -- 172.21.15.60:0/4279476927 shutdown_connections 2020-10-31T22:49:35.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.657+0000 7fc58da5f700 1 --2- 172.21.15.60:0/4279476927 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc588141fe0 0x7fc5881510c0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:35.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.657+0000 7fc58da5f700 1 --2- 172.21.15.60:0/4279476927 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc5880b24a0 0x7fc588148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:35.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.657+0000 7fc58da5f700 1 --2- 172.21.15.60:0/4279476927 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc568054fd0 0x7fc568057490 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:35.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.657+0000 7fc58da5f700 1 --2- 172.21.15.60:0/4279476927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc5880b5570 0x7fc588153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:35.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.657+0000 7fc58da5f700 1 -- 172.21.15.60:0/4279476927 >> 172.21.15.60:0/4279476927 conn(0x7fc5880b8e90 msgr2=0x7fc5880b1530 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:35.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.657+0000 7fc58da5f700 1 -- 172.21.15.60:0/4279476927 shutdown_connections 2020-10-31T22:49:35.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:35.657+0000 7fc58da5f700 1 -- 172.21.15.60:0/4279476927 wait complete. 2020-10-31T22:49:35.667 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 59 2020-10-31T22:49:35.986 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:49:29.429837+0000', 'modified': '2020-10-31T22:49:30.432586+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7476': {'gid': 7476, 'name': 'b', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6833/805667342', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 805667342}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 805667342}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:49:35.986 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:49:35.987 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-10-31T22:49:36.118 INFO:teuthology.orchestra.run.smithi066.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":7476,"want_state":"up:active","state":"up:active","rank_uptime":6.6748772360000004,"mdsmap_epoch":59,"osdmap_epoch":120,"osdmap_epoch_barrier":119,"uptime":11.899239664} 2020-10-31T22:49:36.119 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 7476, "mdsmap_epoch": 59, "osdmap_epoch": 120, "osdmap_epoch_barrier": 119, "rank_uptime": 6.674877236, "state": "up:active", "uptime": 11.899239664, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:49:36.119 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:49:36.119 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:49:36.120 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:49:36.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:36.120 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:36.128 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:49:36.188 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:49:36.189 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:49:36.246 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:49:36.247 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:49:36.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:36.248 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:49:36.293 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:49:36.295 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:36.337 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:49:36.354 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:49:36.354 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:49:36.409 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:49:36.410 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:49:36.411 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:36.411 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:49:36.412 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13984]: starting ceph client2020-10-31T22:49:36.411+0000 7f3cdc0940c0 -1 init, newargv = 0x5635c2e00c10 newargc=9 2020-10-31T22:49:36.413 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr: 2020-10-31T22:49:36.423 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13984]: starting fuse 2020-10-31T22:49:37.521 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:49:37.536 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:49:37.537 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:49:37.594 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:49:37.595 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:49:37.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:37.596 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:49:37.645 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:49:37.645 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:49:37.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:37.646 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:49:37.647 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:49:37.647 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:49:37.647 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:49:37.647 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:49:37.648 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:49:37.648 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:49:37.648 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:49:37.649 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:49:37.649 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:49:37.650 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:49:37.650 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:49:37.651 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:49:37.651 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:49:37.651 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:49:37.652 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:49:37.652 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:49:37.652 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:49:37.653 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:49:37.653 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:49:37.653 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:49:37.654 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:49:37.654 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:49:37.737 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.13984.asok 2020-10-31T22:49:37.741 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.13984.asok 2020-10-31T22:49:37.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:37.742 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.13984.asok status 2020-10-31T22:49:37.838 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:49:37.838 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:49:37.839 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:49:37.839 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:49:37.839 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:49:37.839 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:49:37.840 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:49:37.840 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "13984", 2020-10-31T22:49:37.840 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:49:37.840 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:49:37.840 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:49:37.840 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:49:37.841 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 7629, 2020-10-31T22:49:37.841 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:49:37.841 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:49:37.842 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:49:37.842 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 7629 2020-10-31T22:49:37.842 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:49:37.842 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:49:37.842 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:49:37.842 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:49:37.843 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 923287076 2020-10-31T22:49:37.843 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:49:37.843 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:49:37.843 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:49:37.843 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:49:37.843 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:49:37.843 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 923287076 2020-10-31T22:49:37.844 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:49:37.844 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.7629 172.21.15.152:0/923287076", 2020-10-31T22:49:37.844 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/923287076", 2020-10-31T22:49:37.844 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:49:37.844 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 59, 2020-10-31T22:49:37.844 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 120, 2020-10-31T22:49:37.845 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:49:37.845 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:49:37.845 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:49:37.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:37.847 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:37.848 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:37.854 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:49:37.855 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:49:37.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:37.856 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:37.916 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:49:38.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.037+0000 7f2bd7fff700 1 Processor -- start 2020-10-31T22:49:38.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.037+0000 7f2bd7fff700 1 -- start start 2020-10-31T22:49:38.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2bd813ebe0 0x7f2bd8142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd7fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd80abea0 con 0x7f2bd80af200 2020-10-31T22:49:38.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd7fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd8141870 con 0x7f2bd80b1a10 2020-10-31T22:49:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd7fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd8141b10 con 0x7f2bd813ebe0 2020-10-31T22:49:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd67fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2bd813ebe0 0x7f2bd8142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd77fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2bd80af200 0x7f2bd80b0850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52322/0 (socket says 172.21.15.60:52322) 2020-10-31T22:49:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd67fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2bd813ebe0 0x7f2bd8142250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48184/0 (socket says 172.21.15.60:48184) 2020-10-31T22:49:38.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd77fe700 1 -- 172.21.15.60:0/3354807848 learned_addr learned my addr 172.21.15.60:0/3354807848 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:38.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd67fc700 1 -- 172.21.15.60:0/3354807848 >> v1:172.21.15.66:6789/0 conn(0x7f2bd80b1a10 legacy=0x7f2bd80afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd67fc700 1 -- 172.21.15.60:0/3354807848 >> v1:172.21.15.60:6789/0 conn(0x7f2bd80af200 legacy=0x7f2bd80b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd5ffb700 1 -- 172.21.15.60:0/3354807848 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734214662 0 0) 0x7f2bd8141870 con 0x7f2bd80b1a10 2020-10-31T22:49:38.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd67fc700 1 -- 172.21.15.60:0/3354807848 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd8141db0 con 0x7f2bd813ebe0 2020-10-31T22:49:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd67fc700 1 --2- 172.21.15.60:0/3354807848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bd813ebe0 0x7f2bd8142250 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f2bd0001450 tx=0x7f2bc8006dc0).ready entity=mon.0 client_cookie=b8c4e7c52b87da4f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd5ffb700 1 -- 172.21.15.60:0/3354807848 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bc80096b0 con 0x7f2bd813ebe0 2020-10-31T22:49:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd5ffb700 1 -- 172.21.15.60:0/3354807848 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc8009810 con 0x7f2bd813ebe0 2020-10-31T22:49:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd5ffb700 1 -- 172.21.15.60:0/3354807848 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bc8009b70 con 0x7f2bd813ebe0 2020-10-31T22:49:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd7fff700 1 -- 172.21.15.60:0/3354807848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bd813ebe0 msgr2=0x7f2bd8142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd7fff700 1 --2- 172.21.15.60:0/3354807848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bd813ebe0 0x7f2bd8142250 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 rx=0x7f2bd0001450 tx=0x7f2bc8006dc0).stop 2020-10-31T22:49:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd7fff700 1 -- 172.21.15.60:0/3354807848 shutdown_connections 2020-10-31T22:49:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd7fff700 1 --2- 172.21.15.60:0/3354807848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bd813ebe0 0x7f2bd8142250 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd7fff700 1 -- 172.21.15.60:0/3354807848 >> 172.21.15.60:0/3354807848 conn(0x7f2bd80b5300 msgr2=0x7f2bd80b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd7fff700 1 -- 172.21.15.60:0/3354807848 shutdown_connections 2020-10-31T22:49:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.041+0000 7f2bd7fff700 1 -- 172.21.15.60:0/3354807848 wait complete. 2020-10-31T22:49:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd7fff700 1 Processor -- start 2020-10-31T22:49:38.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd7fff700 1 -- start start 2020-10-31T22:49:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd7fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bd80af200 0x7f2bd8144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd7fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bd80b1a10 0x7f2bd80a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd7fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bd813ebe0 0x7f2bd813a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd7fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd806a920 con 0x7f2bd813ebe0 2020-10-31T22:49:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd7fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd8145150 con 0x7f2bd80af200 2020-10-31T22:49:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd7fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80b56e0 con 0x7f2bd80b1a10 2020-10-31T22:49:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bd813ebe0 0x7f2bd813a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd77fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bd813ebe0 0x7f2bd813a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48192/0 (socket says 172.21.15.60:48192) 2020-10-31T22:49:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd77fe700 1 -- 172.21.15.60:0/1767813258 learned_addr learned my addr 172.21.15.60:0/1767813258 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:38.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd6ffd700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bd80af200 0x7f2bd8144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd67fc700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bd80b1a10 0x7f2bd80a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd77fe700 1 -- 172.21.15.60:0/1767813258 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bd80b1a10 msgr2=0x7f2bd80a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd77fe700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bd80b1a10 0x7f2bd80a93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd77fe700 1 -- 172.21.15.60:0/1767813258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bd80af200 msgr2=0x7f2bd8144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd77fe700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bd80af200 0x7f2bd8144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd77fe700 1 -- 172.21.15.60:0/1767813258 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd806a3e0 con 0x7f2bd813ebe0 2020-10-31T22:49:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd67fc700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bd80b1a10 0x7f2bd80a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd77fe700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bd813ebe0 0x7f2bd813a690 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f2bd0001510 tx=0x7f2bd0007e50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:38.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bcffff700 1 -- 172.21.15.60:0/1767813258 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bd0005b70 con 0x7f2bd813ebe0 2020-10-31T22:49:38.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bcffff700 1 -- 172.21.15.60:0/1767813258 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd0005cd0 con 0x7f2bd813ebe0 2020-10-31T22:49:38.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd7fff700 1 -- 172.21.15.60:0/1767813258 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd806a680 con 0x7f2bd813ebe0 2020-10-31T22:49:38.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bcffff700 1 -- 172.21.15.60:0/1767813258 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2bd0007300 con 0x7f2bd813ebe0 2020-10-31T22:49:38.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.045+0000 7f2bd7fff700 1 -- 172.21.15.60:0/1767813258 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd80ab990 con 0x7f2bd813ebe0 2020-10-31T22:49:38.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.049+0000 7f2bd7fff700 1 -- 172.21.15.60:0/1767813258 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd80abc70 con 0x7f2bd813ebe0 2020-10-31T22:49:38.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.049+0000 7f2bcffff700 1 -- 172.21.15.60:0/1767813258 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2bd0010030 con 0x7f2bd813ebe0 2020-10-31T22:49:38.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.049+0000 7f2bcffff700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2bbc054f10 0x7f2bbc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.049+0000 7f2bcffff700 1 -- 172.21.15.60:0/1767813258 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2bd006db30 con 0x7f2bd813ebe0 2020-10-31T22:49:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.049+0000 7f2bd6ffd700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2bbc054f10 0x7f2bbc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.049+0000 7f2bd6ffd700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2bbc054f10 0x7f2bbc0573d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f2bc000d000 tx=0x7f2bc0007940).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:38.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.053+0000 7f2bcffff700 1 -- 172.21.15.60:0/1767813258 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2bd0044050 con 0x7f2bd813ebe0 2020-10-31T22:49:38.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.197+0000 7f2bd7fff700 1 -- 172.21.15.60:0/1767813258 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2bd813aec0 con 0x7f2bd813ebe0 2020-10-31T22:49:38.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.201+0000 7f2bcffff700 1 -- 172.21.15.60:0/1767813258 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f2bd0047670 con 0x7f2bd813ebe0 2020-10-31T22:49:38.206 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:38.206 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":120,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:49:30.433442+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":22,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":21,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:49:27.152231+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"119","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":22,"pool_name":"cephfs_data","create_time":"2020-10-31T22:49:28.431362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"120","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:49:38.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.201+0000 7f2bd7fff700 1 -- 172.21.15.60:0/1767813258 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2bbc054f10 msgr2=0x7f2bbc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.201+0000 7f2bd7fff700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2bbc054f10 0x7f2bbc0573d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f2bc000d000 tx=0x7f2bc0007940).stop 2020-10-31T22:49:38.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.201+0000 7f2bd7fff700 1 -- 172.21.15.60:0/1767813258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bd813ebe0 msgr2=0x7f2bd813a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.201+0000 7f2bd7fff700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bd813ebe0 0x7f2bd813a690 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 rx=0x7f2bd0001510 tx=0x7f2bd0007e50).stop 2020-10-31T22:49:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.201+0000 7f2bd7fff700 1 -- 172.21.15.60:0/1767813258 shutdown_connections 2020-10-31T22:49:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.201+0000 7f2bd7fff700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bd813ebe0 0x7f2bd813a690 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.201+0000 7f2bd7fff700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2bbc054f10 0x7f2bbc0573d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.201+0000 7f2bd7fff700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bd80af200 0x7f2bd8144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.201+0000 7f2bd7fff700 1 --2- 172.21.15.60:0/1767813258 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bd80b1a10 0x7f2bd80a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.201+0000 7f2bd7fff700 1 -- 172.21.15.60:0/1767813258 >> 172.21.15.60:0/1767813258 conn(0x7f2bd80b5300 msgr2=0x7f2bd80b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.201+0000 7f2bd7fff700 1 -- 172.21.15.60:0/1767813258 shutdown_connections 2020-10-31T22:49:38.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.201+0000 7f2bd7fff700 1 -- 172.21.15.60:0/1767813258 wait complete. 2020-10-31T22:49:38.222 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 21, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:49:27.152231+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '119', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 22, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:49:28.431362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '120', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:49:38.224 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:49:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.357+0000 7f9dadd05700 1 Processor -- start 2020-10-31T22:49:38.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.357+0000 7f9dadd05700 1 -- start start 2020-10-31T22:49:38.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.357+0000 7f9dadd05700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9da80b24a0 0x7f9da80b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.357+0000 7f9dadd05700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9da8141f00 0x7f9da8142360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.357+0000 7f9dadd05700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da80b4440 con 0x7f9da80b5570 2020-10-31T22:49:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.357+0000 7f9dadd05700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da813f930 con 0x7f9da80b24a0 2020-10-31T22:49:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.357+0000 7f9dadd05700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da8146060 con 0x7f9da8141f00 2020-10-31T22:49:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.357+0000 7f9da7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9da80b24a0 0x7f9da80b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.357+0000 7f9da7fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9da80b24a0 0x7f9da80b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48200/0 (socket says 172.21.15.60:48200) 2020-10-31T22:49:38.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.357+0000 7f9da7fff700 1 -- 172.21.15.60:0/2794708728 learned_addr learned my addr 172.21.15.60:0/2794708728 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:38.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.357+0000 7f9dad504700 1 --2- 172.21.15.60:0/2794708728 >> v2:172.21.15.66:3300/0 conn(0x7f9da8141f00 0x7f9da8142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9da7fff700 1 -- 172.21.15.60:0/2794708728 >> v2:172.21.15.66:3300/0 conn(0x7f9da8141f00 msgr2=0x7f9da8142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:38.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9da7fff700 1 --2- 172.21.15.60:0/2794708728 >> v2:172.21.15.66:3300/0 conn(0x7f9da8141f00 0x7f9da8142360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9da7fff700 1 -- 172.21.15.60:0/2794708728 >> v1:172.21.15.66:6789/0 conn(0x7f9da80b5570 legacy=0x7f9da8145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9da7fff700 1 -- 172.21.15.60:0/2794708728 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da80b02f0 con 0x7f9da80b24a0 2020-10-31T22:49:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9da7fff700 1 --2- 172.21.15.60:0/2794708728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da80b24a0 0x7f9da80b5950 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f9d98002f30 tx=0x7f9d98006e80).ready entity=mon.0 client_cookie=6de4d8825ef31631 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9da77fe700 1 -- 172.21.15.60:0/2794708728 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d980097f0 con 0x7f9da80b24a0 2020-10-31T22:49:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9da77fe700 1 -- 172.21.15.60:0/2794708728 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d98009950 con 0x7f9da80b24a0 2020-10-31T22:49:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9da77fe700 1 -- 172.21.15.60:0/2794708728 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d98009cb0 con 0x7f9da80b24a0 2020-10-31T22:49:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9dadd05700 1 -- 172.21.15.60:0/2794708728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da80b24a0 msgr2=0x7f9da80b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9dadd05700 1 --2- 172.21.15.60:0/2794708728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da80b24a0 0x7f9da80b5950 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 rx=0x7f9d98002f30 tx=0x7f9d98006e80).stop 2020-10-31T22:49:38.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9dadd05700 1 -- 172.21.15.60:0/2794708728 shutdown_connections 2020-10-31T22:49:38.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9dadd05700 1 --2- 172.21.15.60:0/2794708728 >> v2:172.21.15.66:3300/0 conn(0x7f9da8141f00 0x7f9da8142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9dadd05700 1 --2- 172.21.15.60:0/2794708728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da80b24a0 0x7f9da80b5950 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9dadd05700 1 -- 172.21.15.60:0/2794708728 >> 172.21.15.60:0/2794708728 conn(0x7f9da80b8e90 msgr2=0x7f9da80b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:38.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9dadd05700 1 -- 172.21.15.60:0/2794708728 shutdown_connections 2020-10-31T22:49:38.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9dadd05700 1 -- 172.21.15.60:0/2794708728 wait complete. 2020-10-31T22:49:38.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9dadd05700 1 Processor -- start 2020-10-31T22:49:38.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.361+0000 7f9dadd05700 1 -- start start 2020-10-31T22:49:38.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dadd05700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da80b24a0 0x7f9da80b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dadd05700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9da80b5570 0x7f9da81510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dadd05700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9da8141f00 0x7f9da8151590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dadd05700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81440f0 con 0x7f9da80b24a0 2020-10-31T22:49:38.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dadd05700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da8144320 con 0x7f9da8141f00 2020-10-31T22:49:38.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dadd05700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da81445c0 con 0x7f9da80b5570 2020-10-31T22:49:38.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dacd03700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da80b24a0 0x7f9da80b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dacd03700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da80b24a0 0x7f9da80b7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48202/0 (socket says 172.21.15.60:48202) 2020-10-31T22:49:38.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9da7fff700 1 --2- 172.21.15.60:0/411530951 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9da80b5570 0x7f9da81510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dacd03700 1 -- 172.21.15.60:0/411530951 learned_addr learned my addr 172.21.15.60:0/411530951 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:38.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dad504700 1 --2- 172.21.15.60:0/411530951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9da8141f00 0x7f9da8151590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dacd03700 1 -- 172.21.15.60:0/411530951 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9da80b5570 msgr2=0x7f9da81510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dacd03700 1 --2- 172.21.15.60:0/411530951 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9da80b5570 0x7f9da81510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dacd03700 1 -- 172.21.15.60:0/411530951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9da8141f00 msgr2=0x7f9da8151590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dacd03700 1 --2- 172.21.15.60:0/411530951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9da8141f00 0x7f9da8151590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dacd03700 1 -- 172.21.15.60:0/411530951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da8150c00 con 0x7f9da80b24a0 2020-10-31T22:49:38.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dacd03700 1 --2- 172.21.15.60:0/411530951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da80b24a0 0x7f9da80b7290 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f9da8141de0 tx=0x7f9d9c007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:38.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9da5ffb700 1 -- 172.21.15.60:0/411530951 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d9c00f470 con 0x7f9da80b24a0 2020-10-31T22:49:38.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9da5ffb700 1 -- 172.21.15.60:0/411530951 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9c00f5d0 con 0x7f9da80b24a0 2020-10-31T22:49:38.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dadd05700 1 -- 172.21.15.60:0/411530951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da80af240 con 0x7f9da80b24a0 2020-10-31T22:49:38.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9da5ffb700 1 -- 172.21.15.60:0/411530951 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d9c00f930 con 0x7f9da80b24a0 2020-10-31T22:49:38.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.365+0000 7f9dadd05700 1 -- 172.21.15.60:0/411530951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da8154010 con 0x7f9da80b24a0 2020-10-31T22:49:38.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.369+0000 7f9da5ffb700 1 -- 172.21.15.60:0/411530951 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9d9c019030 con 0x7f9da80b24a0 2020-10-31T22:49:38.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.369+0000 7f9dadd05700 1 -- 172.21.15.60:0/411530951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da8144f50 con 0x7f9da80b24a0 2020-10-31T22:49:38.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.369+0000 7f9da5ffb700 1 --2- 172.21.15.60:0/411530951 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9d88055020 0x7f9d880574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.369+0000 7f9da7fff700 1 --2- 172.21.15.60:0/411530951 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9d88055020 0x7f9d880574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.369+0000 7f9da5ffb700 1 -- 172.21.15.60:0/411530951 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9d9c06cdc0 con 0x7f9da80b24a0 2020-10-31T22:49:38.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.369+0000 7f9da7fff700 1 --2- 172.21.15.60:0/411530951 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9d88055020 0x7f9d880574e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f9d9801c000 tx=0x7f9d98015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:38.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.373+0000 7f9da5ffb700 1 -- 172.21.15.60:0/411530951 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9da8144f50 con 0x7f9da80b24a0 2020-10-31T22:49:38.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.517+0000 7f9dadd05700 1 -- 172.21.15.60:0/411530951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9da8144f50 con 0x7f9da80b24a0 2020-10-31T22:49:38.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.517+0000 7f9da5ffb700 1 -- 172.21.15.60:0/411530951 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v120) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9da8144f50 con 0x7f9da80b24a0 2020-10-31T22:49:38.529 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:49:38.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.521+0000 7f9dadd05700 1 -- 172.21.15.60:0/411530951 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9d88055020 msgr2=0x7f9d880574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.521+0000 7f9dadd05700 1 --2- 172.21.15.60:0/411530951 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9d88055020 0x7f9d880574e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f9d9801c000 tx=0x7f9d98015000).stop 2020-10-31T22:49:38.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.521+0000 7f9dadd05700 1 -- 172.21.15.60:0/411530951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da80b24a0 msgr2=0x7f9da80b7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.521+0000 7f9dadd05700 1 --2- 172.21.15.60:0/411530951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da80b24a0 0x7f9da80b7290 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 rx=0x7f9da8141de0 tx=0x7f9d9c007b90).stop 2020-10-31T22:49:38.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.521+0000 7f9dadd05700 1 -- 172.21.15.60:0/411530951 shutdown_connections 2020-10-31T22:49:38.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.521+0000 7f9dadd05700 1 --2- 172.21.15.60:0/411530951 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9d88055020 0x7f9d880574e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.521+0000 7f9dadd05700 1 --2- 172.21.15.60:0/411530951 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9da8141f00 0x7f9da8151590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.521+0000 7f9dadd05700 1 --2- 172.21.15.60:0/411530951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9da80b24a0 0x7f9da80b7290 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.521+0000 7f9dadd05700 1 --2- 172.21.15.60:0/411530951 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9da80b5570 0x7f9da81510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.521+0000 7f9dadd05700 1 -- 172.21.15.60:0/411530951 >> 172.21.15.60:0/411530951 conn(0x7f9da80b8e90 msgr2=0x7f9da80b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:38.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.521+0000 7f9dadd05700 1 -- 172.21.15.60:0/411530951 shutdown_connections 2020-10-31T22:49:38.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.521+0000 7f9dadd05700 1 -- 172.21.15.60:0/411530951 wait complete. 2020-10-31T22:49:38.551 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:49:38.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.669+0000 7f88a6c75700 1 Processor -- start 2020-10-31T22:49:38.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.669+0000 7f88a6c75700 1 -- start start 2020-10-31T22:49:38.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.669+0000 7f88a6c75700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88a00b5950 0x7f88a0142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.669+0000 7f88a6c75700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a0142b00 con 0x7f88a00b5570 2020-10-31T22:49:38.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.669+0000 7f88a6c75700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a00b4440 con 0x7f88a00b24a0 2020-10-31T22:49:38.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.669+0000 7f88a6c75700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a013f930 con 0x7f88a00b5950 2020-10-31T22:49:38.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.669+0000 7f88a5c73700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f88a00b5570 0x7f88a0145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52346/0 (socket says 172.21.15.60:52346) 2020-10-31T22:49:38.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.669+0000 7f88a5c73700 1 -- 172.21.15.60:0/2833047498 learned_addr learned my addr 172.21.15.60:0/2833047498 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:38.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.669+0000 7f88a6474700 1 --2- 172.21.15.60:0/2833047498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88a00b5950 0x7f88a0142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a4c71700 1 -- 172.21.15.60:0/2833047498 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039045847 0 0) 0x7f88a0142b00 con 0x7f88a00b5570 2020-10-31T22:49:38.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a4c71700 1 -- 172.21.15.60:0/2833047498 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8888003230 con 0x7f88a00b5570 2020-10-31T22:49:38.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a4c71700 1 -- 172.21.15.60:0/2833047498 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296144275 0 0) 0x7f88a00b4440 con 0x7f88a00b24a0 2020-10-31T22:49:38.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a4c71700 1 -- 172.21.15.60:0/2833047498 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88a0142b00 con 0x7f88a00b24a0 2020-10-31T22:49:38.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a6474700 1 -- 172.21.15.60:0/2833047498 >> v1:172.21.15.66:6789/0 conn(0x7f88a00b24a0 legacy=0x7f88a0141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a6474700 1 -- 172.21.15.60:0/2833047498 >> v1:172.21.15.60:6789/0 conn(0x7f88a00b5570 legacy=0x7f88a0145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a6474700 1 -- 172.21.15.60:0/2833047498 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a0146060 con 0x7f88a00b5950 2020-10-31T22:49:38.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a6474700 1 --2- 172.21.15.60:0/2833047498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88a00b5950 0x7f88a0142610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f88980032b0 tx=0x7f88980091a0).ready entity=mon.2 client_cookie=100c5e96f7faeec3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:38.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a4c71700 1 -- 172.21.15.60:0/2833047498 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f889800b940 con 0x7f88a00b5950 2020-10-31T22:49:38.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a4c71700 1 -- 172.21.15.60:0/2833047498 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889800baa0 con 0x7f88a00b5950 2020-10-31T22:49:38.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a4c71700 1 -- 172.21.15.60:0/2833047498 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f889800bc10 con 0x7f88a00b5950 2020-10-31T22:49:38.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a6c75700 1 -- 172.21.15.60:0/2833047498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88a00b5950 msgr2=0x7f88a0142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a6c75700 1 --2- 172.21.15.60:0/2833047498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88a00b5950 0x7f88a0142610 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f88980032b0 tx=0x7f88980091a0).stop 2020-10-31T22:49:38.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a6c75700 1 -- 172.21.15.60:0/2833047498 shutdown_connections 2020-10-31T22:49:38.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a6c75700 1 --2- 172.21.15.60:0/2833047498 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88a00b5950 0x7f88a0142610 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a6c75700 1 -- 172.21.15.60:0/2833047498 >> 172.21.15.60:0/2833047498 conn(0x7f88a00b8e90 msgr2=0x7f88a00b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:38.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a6c75700 1 -- 172.21.15.60:0/2833047498 shutdown_connections 2020-10-31T22:49:38.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a6c75700 1 -- 172.21.15.60:0/2833047498 wait complete. 2020-10-31T22:49:38.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a6c75700 1 Processor -- start 2020-10-31T22:49:38.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.673+0000 7f88a6c75700 1 -- start start 2020-10-31T22:49:38.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a6c75700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88a00b24a0 0x7f88a0145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a6c75700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88a00b5570 0x7f88a0140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a6c75700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88a00b5950 0x7f88a0150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a6c75700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a0144750 con 0x7f88a00b5950 2020-10-31T22:49:38.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a6c75700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a0144e70 con 0x7f88a00b24a0 2020-10-31T22:49:38.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a6c75700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a0144980 con 0x7f88a00b5570 2020-10-31T22:49:38.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a6474700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88a00b5950 0x7f88a0150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a6474700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88a00b5950 0x7f88a0150e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48220/0 (socket says 172.21.15.60:48220) 2020-10-31T22:49:38.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a6474700 1 -- 172.21.15.60:0/358051922 learned_addr learned my addr 172.21.15.60:0/358051922 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:38.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a5472700 1 --2- 172.21.15.60:0/358051922 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88a00b5570 0x7f88a0140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a5c73700 1 --2- 172.21.15.60:0/358051922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88a00b24a0 0x7f88a0145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a5472700 1 -- 172.21.15.60:0/358051922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88a00b24a0 msgr2=0x7f88a0145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a5472700 1 --2- 172.21.15.60:0/358051922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88a00b24a0 0x7f88a0145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a5472700 1 -- 172.21.15.60:0/358051922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88a00b5950 msgr2=0x7f88a0150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a5472700 1 --2- 172.21.15.60:0/358051922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88a00b5950 0x7f88a0150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a5472700 1 -- 172.21.15.60:0/358051922 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a01450d0 con 0x7f88a00b5570 2020-10-31T22:49:38.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a5472700 1 --2- 172.21.15.60:0/358051922 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88a00b5570 0x7f88a0140d60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f8890001110 tx=0x7f88900079b0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:38.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f888effd700 1 -- 172.21.15.60:0/358051922 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f889000f470 con 0x7f88a00b5570 2020-10-31T22:49:38.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f888effd700 1 -- 172.21.15.60:0/358051922 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889000f5d0 con 0x7f88a00b5570 2020-10-31T22:49:38.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a6c75700 1 -- 172.21.15.60:0/358051922 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a0142fb0 con 0x7f88a00b5570 2020-10-31T22:49:38.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f888effd700 1 -- 172.21.15.60:0/358051922 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f889000f930 con 0x7f88a00b5570 2020-10-31T22:49:38.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a6c75700 1 -- 172.21.15.60:0/358051922 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a0150900 con 0x7f88a00b5570 2020-10-31T22:49:38.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.677+0000 7f88a6c75700 1 -- 172.21.15.60:0/358051922 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a0150b80 con 0x7f88a00b5570 2020-10-31T22:49:38.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.681+0000 7f888effd700 1 -- 172.21.15.60:0/358051922 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8890019030 con 0x7f88a00b5570 2020-10-31T22:49:38.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.681+0000 7f888effd700 1 --2- 172.21.15.60:0/358051922 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8880054f30 0x7f88800573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.681+0000 7f88a5c73700 1 --2- 172.21.15.60:0/358051922 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8880054f30 0x7f88800573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.681+0000 7f888effd700 1 -- 172.21.15.60:0/358051922 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f889006ce00 con 0x7f88a00b5570 2020-10-31T22:49:38.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.681+0000 7f88a5c73700 1 --2- 172.21.15.60:0/358051922 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8880054f30 0x7f88800573f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f889c00d000 tx=0x7f889c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:38.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.689+0000 7f888effd700 1 -- 172.21.15.60:0/358051922 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8890043190 con 0x7f88a00b5570 2020-10-31T22:49:38.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.833+0000 7f88a6c75700 1 -- 172.21.15.60:0/358051922 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f88a0057100 con 0x7f88a00b5570 2020-10-31T22:49:38.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.833+0000 7f888effd700 1 -- 172.21.15.60:0/358051922 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v120) v1 ==== 92+0+10 (secure 0 0 0) 0x7f88900467b0 con 0x7f88a00b5570 2020-10-31T22:49:38.840 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:49:38.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.837+0000 7f88a6c75700 1 -- 172.21.15.60:0/358051922 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8880054f30 msgr2=0x7f88800573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.837+0000 7f88a6c75700 1 --2- 172.21.15.60:0/358051922 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8880054f30 0x7f88800573f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f889c00d000 tx=0x7f889c009040).stop 2020-10-31T22:49:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.837+0000 7f88a6c75700 1 -- 172.21.15.60:0/358051922 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88a00b5570 msgr2=0x7f88a0140d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.837+0000 7f88a6c75700 1 --2- 172.21.15.60:0/358051922 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88a00b5570 0x7f88a0140d60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f8890001110 tx=0x7f88900079b0).stop 2020-10-31T22:49:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.837+0000 7f88a6c75700 1 -- 172.21.15.60:0/358051922 shutdown_connections 2020-10-31T22:49:38.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.837+0000 7f88a6c75700 1 --2- 172.21.15.60:0/358051922 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88a00b5950 0x7f88a0150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.837+0000 7f88a6c75700 1 --2- 172.21.15.60:0/358051922 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8880054f30 0x7f88800573f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.837+0000 7f88a6c75700 1 --2- 172.21.15.60:0/358051922 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88a00b24a0 0x7f88a0145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.837+0000 7f88a6c75700 1 --2- 172.21.15.60:0/358051922 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f88a00b5570 0x7f88a0140d60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.837+0000 7f88a6c75700 1 -- 172.21.15.60:0/358051922 >> 172.21.15.60:0/358051922 conn(0x7f88a00b8e90 msgr2=0x7f88a005f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.837+0000 7f88a6c75700 1 -- 172.21.15.60:0/358051922 shutdown_connections 2020-10-31T22:49:38.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.837+0000 7f88a6c75700 1 -- 172.21.15.60:0/358051922 wait complete. 2020-10-31T22:49:38.862 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:49:38.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.977+0000 7f014759e700 1 Processor -- start 2020-10-31T22:49:38.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.977+0000 7f014759e700 1 -- start start 2020-10-31T22:49:38.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.977+0000 7f014759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f014805b180 0x7f014805fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.977+0000 7f014759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f01480b0b70 0x7f014813f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.977+0000 7f014759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0148060220 0x7f014813f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:38.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.977+0000 7f014759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014805f3c0 con 0x7f01480b0b70 2020-10-31T22:49:38.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.977+0000 7f014759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0148145f70 con 0x7f0148060220 2020-10-31T22:49:38.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.977+0000 7f014759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014805f5f0 con 0x7f014805b180 2020-10-31T22:49:38.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.977+0000 7f0145d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f01480b0b70 0x7f014813f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.977+0000 7f0145d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f01480b0b70 0x7f014813f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48224/0 (socket says 172.21.15.60:48224) 2020-10-31T22:49:38.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.977+0000 7f0145d9b700 1 -- 172.21.15.60:0/2626775530 learned_addr learned my addr 172.21.15.60:0/2626775530 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:38.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.977+0000 7f0146d9d700 1 --2- 172.21.15.60:0/2626775530 >> v2:172.21.15.66:3300/0 conn(0x7f0148060220 0x7f014813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014659c700 1 --2- 172.21.15.60:0/2626775530 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f014805b180 0x7f014805fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:38.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f0145d9b700 1 -- 172.21.15.60:0/2626775530 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f014805b180 msgr2=0x7f014805fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:38.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f0145d9b700 1 --2- 172.21.15.60:0/2626775530 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f014805b180 0x7f014805fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f0145d9b700 1 -- 172.21.15.60:0/2626775530 >> v2:172.21.15.66:3300/0 conn(0x7f0148060220 msgr2=0x7f014813f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:38.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f0145d9b700 1 --2- 172.21.15.60:0/2626775530 >> v2:172.21.15.66:3300/0 conn(0x7f0148060220 0x7f014813f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f0145d9b700 1 -- 172.21.15.60:0/2626775530 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014805f890 con 0x7f01480b0b70 2020-10-31T22:49:38.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f0145d9b700 1 --2- 172.21.15.60:0/2626775530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01480b0b70 0x7f014813f030 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f0138002f30 tx=0x7f0138006e80).ready entity=mon.0 client_cookie=6a291405b5204f3a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:38.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014559a700 1 -- 172.21.15.60:0/2626775530 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01380097f0 con 0x7f01480b0b70 2020-10-31T22:49:38.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014559a700 1 -- 172.21.15.60:0/2626775530 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0138009950 con 0x7f01480b0b70 2020-10-31T22:49:38.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014559a700 1 -- 172.21.15.60:0/2626775530 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0138009cb0 con 0x7f01480b0b70 2020-10-31T22:49:38.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014759e700 1 -- 172.21.15.60:0/2626775530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01480b0b70 msgr2=0x7f014813f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:38.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014759e700 1 --2- 172.21.15.60:0/2626775530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01480b0b70 0x7f014813f030 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 rx=0x7f0138002f30 tx=0x7f0138006e80).stop 2020-10-31T22:49:38.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014759e700 1 -- 172.21.15.60:0/2626775530 shutdown_connections 2020-10-31T22:49:38.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014759e700 1 --2- 172.21.15.60:0/2626775530 >> v2:172.21.15.66:3300/0 conn(0x7f0148060220 0x7f014813f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014759e700 1 --2- 172.21.15.60:0/2626775530 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f014805b180 0x7f014805fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014759e700 1 --2- 172.21.15.60:0/2626775530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01480b0b70 0x7f014813f030 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:38.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014759e700 1 -- 172.21.15.60:0/2626775530 >> 172.21.15.60:0/2626775530 conn(0x7f01480b61d0 msgr2=0x7f01480b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:38.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014759e700 1 -- 172.21.15.60:0/2626775530 shutdown_connections 2020-10-31T22:49:38.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014759e700 1 -- 172.21.15.60:0/2626775530 wait complete. 2020-10-31T22:49:38.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014759e700 1 Processor -- start 2020-10-31T22:49:38.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.981+0000 7f014759e700 1 -- start start 2020-10-31T22:49:39.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f014759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f014805b180 0x7f0148141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f014759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148060220 0x7f01480aa450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f014759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01480b0b70 0x7f0148140fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f014759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01481414b0 con 0x7f0148060220 2020-10-31T22:49:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f014759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0148147a00 con 0x7f01480b0b70 2020-10-31T22:49:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f014759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0148147c30 con 0x7f014805b180 2020-10-31T22:49:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f0145d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148060220 0x7f01480aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f0145d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148060220 0x7f01480aa450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48232/0 (socket says 172.21.15.60:48232) 2020-10-31T22:49:39.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f0145d9b700 1 -- 172.21.15.60:0/1179654728 learned_addr learned my addr 172.21.15.60:0/1179654728 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:39.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f014659c700 1 --2- 172.21.15.60:0/1179654728 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f014805b180 0x7f0148141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f0146d9d700 1 --2- 172.21.15.60:0/1179654728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01480b0b70 0x7f0148140fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f0145d9b700 1 -- 172.21.15.60:0/1179654728 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f014805b180 msgr2=0x7f0148141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f0145d9b700 1 --2- 172.21.15.60:0/1179654728 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f014805b180 0x7f0148141770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f0145d9b700 1 -- 172.21.15.60:0/1179654728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01480b0b70 msgr2=0x7f0148140fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f0145d9b700 1 --2- 172.21.15.60:0/1179654728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01480b0b70 0x7f0148140fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f0145d9b700 1 -- 172.21.15.60:0/1179654728 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0148147ed0 con 0x7f0148060220 2020-10-31T22:49:39.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f0145d9b700 1 --2- 172.21.15.60:0/1179654728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148060220 0x7f01480aa450 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f0138002f30 tx=0x7f0138015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:39.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f013f7fe700 1 -- 172.21.15.60:0/1179654728 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0138011b80 con 0x7f0148060220 2020-10-31T22:49:39.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f013f7fe700 1 -- 172.21.15.60:0/1179654728 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0138011ce0 con 0x7f0148060220 2020-10-31T22:49:39.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f013f7fe700 1 -- 172.21.15.60:0/1179654728 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f013801e650 con 0x7f0148060220 2020-10-31T22:49:39.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f014759e700 1 -- 172.21.15.60:0/1179654728 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0148148170 con 0x7f0148060220 2020-10-31T22:49:39.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.985+0000 7f014759e700 1 -- 172.21.15.60:0/1179654728 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014813e5a0 con 0x7f0148060220 2020-10-31T22:49:39.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.989+0000 7f014759e700 1 -- 172.21.15.60:0/1179654728 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0148057100 con 0x7f0148060220 2020-10-31T22:49:39.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.989+0000 7f013f7fe700 1 -- 172.21.15.60:0/1179654728 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0138025030 con 0x7f0148060220 2020-10-31T22:49:39.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.989+0000 7f013f7fe700 1 --2- 172.21.15.60:0/1179654728 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f012c054f90 0x7f012c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.989+0000 7f014659c700 1 --2- 172.21.15.60:0/1179654728 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f012c054f90 0x7f012c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.989+0000 7f013f7fe700 1 -- 172.21.15.60:0/1179654728 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f013806edc0 con 0x7f0148060220 2020-10-31T22:49:39.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:38.989+0000 7f014659c700 1 --2- 172.21.15.60:0/1179654728 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f012c054f90 0x7f012c057450 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f013000c000 tx=0x7f0130008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:39.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.001+0000 7f013f7fe700 1 -- 172.21.15.60:0/1179654728 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0138045250 con 0x7f0148060220 2020-10-31T22:49:39.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.137+0000 7f014759e700 1 -- 172.21.15.60:0/1179654728 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0148060700 con 0x7f0148060220 2020-10-31T22:49:39.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.141+0000 7f013f7fe700 1 -- 172.21.15.60:0/1179654728 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v120) v1 ==== 104+0+10 (secure 0 0 0) 0x7f01380487f0 con 0x7f0148060220 2020-10-31T22:49:39.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.141+0000 7f014759e700 1 -- 172.21.15.60:0/1179654728 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f012c054f90 msgr2=0x7f012c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.141+0000 7f014759e700 1 --2- 172.21.15.60:0/1179654728 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f012c054f90 0x7f012c057450 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f013000c000 tx=0x7f0130008040).stop 2020-10-31T22:49:39.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.141+0000 7f014759e700 1 -- 172.21.15.60:0/1179654728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148060220 msgr2=0x7f01480aa450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.141+0000 7f014759e700 1 --2- 172.21.15.60:0/1179654728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148060220 0x7f01480aa450 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 rx=0x7f0138002f30 tx=0x7f0138015000).stop 2020-10-31T22:49:39.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.141+0000 7f014759e700 1 -- 172.21.15.60:0/1179654728 shutdown_connections 2020-10-31T22:49:39.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.141+0000 7f014759e700 1 --2- 172.21.15.60:0/1179654728 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f012c054f90 0x7f012c057450 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.141+0000 7f014759e700 1 --2- 172.21.15.60:0/1179654728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01480b0b70 0x7f0148140fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.141+0000 7f014759e700 1 --2- 172.21.15.60:0/1179654728 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f014805b180 0x7f0148141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.141+0000 7f014759e700 1 --2- 172.21.15.60:0/1179654728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0148060220 0x7f01480aa450 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.141+0000 7f014759e700 1 -- 172.21.15.60:0/1179654728 >> 172.21.15.60:0/1179654728 conn(0x7f01480b61d0 msgr2=0x7f01480b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:39.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.141+0000 7f014759e700 1 -- 172.21.15.60:0/1179654728 shutdown_connections 2020-10-31T22:49:39.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.141+0000 7f014759e700 1 -- 172.21.15.60:0/1179654728 wait complete. 2020-10-31T22:49:39.152 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:49:39.159 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:49:39.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.281+0000 7f3abb59e700 1 Processor -- start 2020-10-31T22:49:39.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.281+0000 7f3abb59e700 1 -- start start 2020-10-31T22:49:39.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3abc0b1d50 0x7f3abc0ac020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3abc13bcc0 0x7f3abc13c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3abc13f630 con 0x7f3abc0a8140 2020-10-31T22:49:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3abc0ae220 con 0x7f3abc13bcc0 2020-10-31T22:49:39.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc0b2130 con 0x7f3abc0b1d50 2020-10-31T22:49:39.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3abc13bcc0 0x7f3abc13c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abad9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3abc13bcc0 0x7f3abc13c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48242/0 (socket says 172.21.15.60:48242) 2020-10-31T22:49:39.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abad9d700 1 -- 172.21.15.60:0/146686019 learned_addr learned my addr 172.21.15.60:0/146686019 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3aba59c700 1 --2- 172.21.15.60:0/146686019 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3abc0b1d50 0x7f3abc0ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abad9d700 1 -- 172.21.15.60:0/146686019 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3abc0b1d50 msgr2=0x7f3abc0ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abad9d700 1 --2- 172.21.15.60:0/146686019 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3abc0b1d50 0x7f3abc0ac020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abad9d700 1 -- 172.21.15.60:0/146686019 >> v1:172.21.15.66:6789/0 conn(0x7f3abc0a8140 legacy=0x7f3abc0adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abad9d700 1 -- 172.21.15.60:0/146686019 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc05c0f0 con 0x7f3abc13bcc0 2020-10-31T22:49:39.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3aba59c700 1 --2- 172.21.15.60:0/146686019 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3abc0b1d50 0x7f3abc0ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abad9d700 1 --2- 172.21.15.60:0/146686019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3abc13bcc0 0x7f3abc13c140 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f3ab40032b0 tx=0x7f3ab4009270).ready entity=mon.0 client_cookie=cfb6b8d18b68069c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3ab9d9b700 1 -- 172.21.15.60:0/146686019 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ab400bdf0 con 0x7f3abc13bcc0 2020-10-31T22:49:39.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3ab9d9b700 1 -- 172.21.15.60:0/146686019 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab4010470 con 0x7f3abc13bcc0 2020-10-31T22:49:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3ab9d9b700 1 -- 172.21.15.60:0/146686019 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3ab40107d0 con 0x7f3abc13bcc0 2020-10-31T22:49:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 -- 172.21.15.60:0/146686019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3abc13bcc0 msgr2=0x7f3abc13c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 --2- 172.21.15.60:0/146686019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3abc13bcc0 0x7f3abc13c140 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 rx=0x7f3ab40032b0 tx=0x7f3ab4009270).stop 2020-10-31T22:49:39.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 -- 172.21.15.60:0/146686019 shutdown_connections 2020-10-31T22:49:39.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 --2- 172.21.15.60:0/146686019 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3abc13bcc0 0x7f3abc13c140 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 --2- 172.21.15.60:0/146686019 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3abc0b1d50 0x7f3abc0ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 -- 172.21.15.60:0/146686019 >> 172.21.15.60:0/146686019 conn(0x7f3abc0b5330 msgr2=0x7f3abc0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:39.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 -- 172.21.15.60:0/146686019 shutdown_connections 2020-10-31T22:49:39.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 -- 172.21.15.60:0/146686019 wait complete. 2020-10-31T22:49:39.304 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 Processor -- start 2020-10-31T22:49:39.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 -- start start 2020-10-31T22:49:39.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3abc0a8140 0x7f3abc0af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3abc0b1d50 0x7f3abc143fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3abc13bcc0 0x7f3abc154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.285+0000 7f3abb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc1444d0 con 0x7f3abc0b1d50 2020-10-31T22:49:39.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3abb59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc151720 con 0x7f3abc13bcc0 2020-10-31T22:49:39.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3abb59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3abc1519c0 con 0x7f3abc0a8140 2020-10-31T22:49:39.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3ab3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3abc0b1d50 0x7f3abc143fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3ab3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3abc0b1d50 0x7f3abc143fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48246/0 (socket says 172.21.15.60:48246) 2020-10-31T22:49:39.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3ab3fff700 1 -- 172.21.15.60:0/2950205720 learned_addr learned my addr 172.21.15.60:0/2950205720 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:39.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3aba59c700 1 --2- 172.21.15.60:0/2950205720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3abc0a8140 0x7f3abc0af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3abad9d700 1 --2- 172.21.15.60:0/2950205720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3abc13bcc0 0x7f3abc154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3ab3fff700 1 -- 172.21.15.60:0/2950205720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3abc0a8140 msgr2=0x7f3abc0af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3ab3fff700 1 --2- 172.21.15.60:0/2950205720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3abc0a8140 0x7f3abc0af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3ab3fff700 1 -- 172.21.15.60:0/2950205720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3abc13bcc0 msgr2=0x7f3abc154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3ab3fff700 1 --2- 172.21.15.60:0/2950205720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3abc13bcc0 0x7f3abc154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3ab3fff700 1 -- 172.21.15.60:0/2950205720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3abc154370 con 0x7f3abc0b1d50 2020-10-31T22:49:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3ab3fff700 1 --2- 172.21.15.60:0/2950205720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3abc0b1d50 0x7f3abc143fe0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f3abc062c50 tx=0x7f3aa4007bb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3ab37fe700 1 -- 172.21.15.60:0/2950205720 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aa4007240 con 0x7f3abc0b1d50 2020-10-31T22:49:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3ab37fe700 1 -- 172.21.15.60:0/2950205720 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa40073a0 con 0x7f3abc0b1d50 2020-10-31T22:49:39.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3abb59e700 1 -- 172.21.15.60:0/2950205720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3abc154610 con 0x7f3abc0b1d50 2020-10-31T22:49:39.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3ab37fe700 1 -- 172.21.15.60:0/2950205720 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3aa40066d0 con 0x7f3abc0b1d50 2020-10-31T22:49:39.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3abb59e700 1 -- 172.21.15.60:0/2950205720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3abc143370 con 0x7f3abc0b1d50 2020-10-31T22:49:39.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3abb59e700 1 -- 172.21.15.60:0/2950205720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3abc057100 con 0x7f3abc0b1d50 2020-10-31T22:49:39.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.289+0000 7f3ab37fe700 1 -- 172.21.15.60:0/2950205720 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3aa4010070 con 0x7f3abc0b1d50 2020-10-31T22:49:39.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.293+0000 7f3ab37fe700 1 --2- 172.21.15.60:0/2950205720 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3aa0054f10 0x7f3aa00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.293+0000 7f3ab37fe700 1 -- 172.21.15.60:0/2950205720 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3aa406d090 con 0x7f3abc0b1d50 2020-10-31T22:49:39.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.293+0000 7f3aba59c700 1 --2- 172.21.15.60:0/2950205720 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3aa0054f10 0x7f3aa00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.293+0000 7f3aba59c700 1 --2- 172.21.15.60:0/2950205720 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3aa0054f10 0x7f3aa00573d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f3aac00c000 tx=0x7f3aac008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:39.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.297+0000 7f3ab37fe700 1 -- 172.21.15.60:0/2950205720 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3aa40435b0 con 0x7f3abc0b1d50 2020-10-31T22:49:39.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.445+0000 7f3abb59e700 1 -- 172.21.15.60:0/2950205720 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3abc0ac640 con 0x7f3abc0b1d50 2020-10-31T22:49:39.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.445+0000 7f3ab37fe700 1 -- 172.21.15.60:0/2950205720 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v120) v1 ==== 100+0+10 (secure 0 0 0) 0x7f3aa4018020 con 0x7f3abc0b1d50 2020-10-31T22:49:39.451 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:49:39.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.445+0000 7f3abb59e700 1 -- 172.21.15.60:0/2950205720 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3aa0054f10 msgr2=0x7f3aa00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.445+0000 7f3abb59e700 1 --2- 172.21.15.60:0/2950205720 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3aa0054f10 0x7f3aa00573d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f3aac00c000 tx=0x7f3aac008040).stop 2020-10-31T22:49:39.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.445+0000 7f3abb59e700 1 -- 172.21.15.60:0/2950205720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3abc0b1d50 msgr2=0x7f3abc143fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.445+0000 7f3abb59e700 1 --2- 172.21.15.60:0/2950205720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3abc0b1d50 0x7f3abc143fe0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 rx=0x7f3abc062c50 tx=0x7f3aa4007bb0).stop 2020-10-31T22:49:39.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.445+0000 7f3abb59e700 1 -- 172.21.15.60:0/2950205720 shutdown_connections 2020-10-31T22:49:39.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.445+0000 7f3abb59e700 1 --2- 172.21.15.60:0/2950205720 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3aa0054f10 0x7f3aa00573d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.445+0000 7f3abb59e700 1 --2- 172.21.15.60:0/2950205720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3abc13bcc0 0x7f3abc154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.445+0000 7f3abb59e700 1 --2- 172.21.15.60:0/2950205720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3abc0a8140 0x7f3abc0af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.445+0000 7f3abb59e700 1 --2- 172.21.15.60:0/2950205720 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3abc0b1d50 0x7f3abc143fe0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.445+0000 7f3abb59e700 1 -- 172.21.15.60:0/2950205720 >> 172.21.15.60:0/2950205720 conn(0x7f3abc0b5330 msgr2=0x7f3abc13ebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:39.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.445+0000 7f3abb59e700 1 -- 172.21.15.60:0/2950205720 shutdown_connections 2020-10-31T22:49:39.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.445+0000 7f3abb59e700 1 -- 172.21.15.60:0/2950205720 wait complete. 2020-10-31T22:49:39.465 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:49:39.465 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:49:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f3fff700 1 Processor -- start 2020-10-31T22:49:39.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f3fff700 1 -- start start 2020-10-31T22:49:39.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe0f40b2820 0x7fe0f40af4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f3fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f41459c0 con 0x7fe0f4063140 2020-10-31T22:49:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f3fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0f4063520 con 0x7fe0f40b1000 2020-10-31T22:49:39.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f3fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0f40b2060 con 0x7fe0f40b2820 2020-10-31T22:49:39.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f2ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe0f4063140 0x7fe0f41452b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52388/0 (socket says 172.21.15.60:52388) 2020-10-31T22:49:39.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f2ffd700 1 -- 172.21.15.60:0/1218961755 learned_addr learned my addr 172.21.15.60:0/1218961755 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:39.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f37fe700 1 --2- 172.21.15.60:0/1218961755 >> v2:172.21.15.60:3300/0 conn(0x7fe0f40b2820 0x7fe0f40af4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f1ffb700 1 -- 172.21.15.60:0/1218961755 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408410067 0 0) 0x7fe0f41459c0 con 0x7fe0f4063140 2020-10-31T22:49:39.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f1ffb700 1 -- 172.21.15.60:0/1218961755 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0d4003230 con 0x7fe0f4063140 2020-10-31T22:49:39.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f37fe700 1 -- 172.21.15.60:0/1218961755 >> v1:172.21.15.66:6789/0 conn(0x7fe0f40b1000 legacy=0x7fe0f40aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f37fe700 1 -- 172.21.15.60:0/1218961755 >> v1:172.21.15.60:6789/0 conn(0x7fe0f4063140 legacy=0x7fe0f41452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f37fe700 1 -- 172.21.15.60:0/1218961755 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f40b02e0 con 0x7fe0f40b2820 2020-10-31T22:49:39.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f1ffb700 1 -- 172.21.15.60:0/1218961755 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290866708 0 0) 0x7fe0f4063520 con 0x7fe0f40b1000 2020-10-31T22:49:39.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.577+0000 7fe0f37fe700 1 --2- 172.21.15.60:0/1218961755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b2820 0x7fe0f40af4b0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fe0ec0032b0 tx=0x7fe0ec0091a0).ready entity=mon.0 client_cookie=2dd38c990019a188 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:39.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.581+0000 7fe0f1ffb700 1 -- 172.21.15.60:0/1218961755 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0ec00ba80 con 0x7fe0f40b2820 2020-10-31T22:49:39.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.581+0000 7fe0f1ffb700 1 -- 172.21.15.60:0/1218961755 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ec00bbe0 con 0x7fe0f40b2820 2020-10-31T22:49:39.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.581+0000 7fe0f1ffb700 1 -- 172.21.15.60:0/1218961755 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0ec00bd50 con 0x7fe0f40b2820 2020-10-31T22:49:39.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.581+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1218961755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b2820 msgr2=0x7fe0f40af4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.581+0000 7fe0f3fff700 1 --2- 172.21.15.60:0/1218961755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b2820 0x7fe0f40af4b0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 rx=0x7fe0ec0032b0 tx=0x7fe0ec0091a0).stop 2020-10-31T22:49:39.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.581+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1218961755 shutdown_connections 2020-10-31T22:49:39.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.581+0000 7fe0f3fff700 1 --2- 172.21.15.60:0/1218961755 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b2820 0x7fe0f40af4b0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.581+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1218961755 >> 172.21.15.60:0/1218961755 conn(0x7fe0f406a600 msgr2=0x7fe0f4060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:39.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.581+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1218961755 shutdown_connections 2020-10-31T22:49:39.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.581+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1218961755 wait complete. 2020-10-31T22:49:39.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.581+0000 7fe0f3fff700 1 Processor -- start 2020-10-31T22:49:39.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.581+0000 7fe0f3fff700 1 -- start start 2020-10-31T22:49:39.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f3fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0f4063140 0x7fe0f4154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b1000 0x7fe0f40b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0f40b2820 0x7fe0f40aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f4066c80 con 0x7fe0f40b1000 2020-10-31T22:49:39.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f3fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40ab950 con 0x7fe0f4063140 2020-10-31T22:49:39.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f3fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f40abbf0 con 0x7fe0f40b2820 2020-10-31T22:49:39.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b1000 0x7fe0f40b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f27fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b1000 0x7fe0f40b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48258/0 (socket says 172.21.15.60:48258) 2020-10-31T22:49:39.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f27fc700 1 -- 172.21.15.60:0/1710396353 learned_addr learned my addr 172.21.15.60:0/1710396353 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:39.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f2ffd700 1 --2- 172.21.15.60:0/1710396353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0f4063140 0x7fe0f4154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f37fe700 1 --2- 172.21.15.60:0/1710396353 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0f40b2820 0x7fe0f40aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f27fc700 1 -- 172.21.15.60:0/1710396353 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0f40b2820 msgr2=0x7fe0f40aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f27fc700 1 --2- 172.21.15.60:0/1710396353 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0f40b2820 0x7fe0f40aad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f27fc700 1 -- 172.21.15.60:0/1710396353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0f4063140 msgr2=0x7fe0f4154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f27fc700 1 --2- 172.21.15.60:0/1710396353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0f4063140 0x7fe0f4154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f27fc700 1 -- 172.21.15.60:0/1710396353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f40abe90 con 0x7fe0f40b1000 2020-10-31T22:49:39.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f27fc700 1 --2- 172.21.15.60:0/1710396353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b1000 0x7fe0f40b3c90 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fe0dc000b80 tx=0x7fe0dc007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:39.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0ebfff700 1 -- 172.21.15.60:0/1710396353 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0dc00f470 con 0x7fe0f40b1000 2020-10-31T22:49:39.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0ebfff700 1 -- 172.21.15.60:0/1710396353 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc00f5d0 con 0x7fe0f40b1000 2020-10-31T22:49:39.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0ebfff700 1 -- 172.21.15.60:0/1710396353 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe0dc00f930 con 0x7fe0f40b1000 2020-10-31T22:49:39.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1710396353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f40668b0 con 0x7fe0f40b1000 2020-10-31T22:49:39.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.585+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1710396353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f40ab3b0 con 0x7fe0f40b1000 2020-10-31T22:49:39.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.589+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1710396353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f4057100 con 0x7fe0f40b1000 2020-10-31T22:49:39.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.589+0000 7fe0ebfff700 1 -- 172.21.15.60:0/1710396353 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe0dc019030 con 0x7fe0f40b1000 2020-10-31T22:49:39.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.589+0000 7fe0ebfff700 1 --2- 172.21.15.60:0/1710396353 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0d8054f10 0x7fe0d80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:39.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.589+0000 7fe0ebfff700 1 -- 172.21.15.60:0/1710396353 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe0dc06cd90 con 0x7fe0f40b1000 2020-10-31T22:49:39.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.589+0000 7fe0f2ffd700 1 --2- 172.21.15.60:0/1710396353 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0d8054f10 0x7fe0d80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:39.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.589+0000 7fe0f2ffd700 1 --2- 172.21.15.60:0/1710396353 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0d8054f10 0x7fe0d80573d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fe0e400d000 tx=0x7fe0e4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:39.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.597+0000 7fe0ebfff700 1 -- 172.21.15.60:0/1710396353 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe0dc043300 con 0x7fe0f40b1000 2020-10-31T22:49:39.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.781+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1710396353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe0f4145930 con 0x7fe0f40b1000 2020-10-31T22:49:39.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.781+0000 7fe0ebfff700 1 -- 172.21.15.60:0/1710396353 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+2492 (secure 0 0 0) 0x7fe0dc046920 con 0x7fe0f40b1000 2020-10-31T22:49:39.786 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:39.786 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":59,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6554,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2152829277","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2152829277},{"type":"v1","addr":"172.21.15.60:6835","nonce":2152829277}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":56},{"gid":7285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6837/1505884738","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":1505884738},{"type":"v1","addr":"172.21.15.60:6837","nonce":1505884738}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":57}],"filesystems":[{"mdsmap":{"epoch":59,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:49:29.429837+0000","modified":"2020-10-31T22:49:30.432586+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7476},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7476":{"gid":7476,"name":"b","rank":0,"incarnation":58,"state":"up:active","state_seq":3,"addr":"172.21.15.66:6833/805667342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":805667342},{"type":"v1","addr":"172.21.15.66:6833","nonce":805667342}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[22],"metadata_pool":21,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":10}]} 2020-10-31T22:49:39.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.781+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1710396353 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0d8054f10 msgr2=0x7fe0d80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.781+0000 7fe0f3fff700 1 --2- 172.21.15.60:0/1710396353 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0d8054f10 0x7fe0d80573d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7fe0e400d000 tx=0x7fe0e4009040).stop 2020-10-31T22:49:39.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.781+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1710396353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b1000 msgr2=0x7fe0f40b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:39.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.781+0000 7fe0f3fff700 1 --2- 172.21.15.60:0/1710396353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b1000 0x7fe0f40b3c90 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 rx=0x7fe0dc000b80 tx=0x7fe0dc007a60).stop 2020-10-31T22:49:39.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.781+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1710396353 shutdown_connections 2020-10-31T22:49:39.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.781+0000 7fe0f3fff700 1 --2- 172.21.15.60:0/1710396353 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0f40b2820 0x7fe0f40aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.781+0000 7fe0f3fff700 1 --2- 172.21.15.60:0/1710396353 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe0d8054f10 0x7fe0d80573d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.781+0000 7fe0f3fff700 1 --2- 172.21.15.60:0/1710396353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0f4063140 0x7fe0f4154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.781+0000 7fe0f3fff700 1 --2- 172.21.15.60:0/1710396353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0f40b1000 0x7fe0f40b3c90 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:39.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.781+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1710396353 >> 172.21.15.60:0/1710396353 conn(0x7fe0f406a600 msgr2=0x7fe0f40a84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:39.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.781+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1710396353 shutdown_connections 2020-10-31T22:49:39.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:39.781+0000 7fe0f3fff700 1 -- 172.21.15.60:0/1710396353 wait complete. 2020-10-31T22:49:39.790 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 59 2020-10-31T22:49:40.102 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 59, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:49:29.429837+0000', 'modified': '2020-10-31T22:49:30.432586+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7476}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7476': {'gid': 7476, 'name': 'b', 'rank': 0, 'incarnation': 58, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.66:6833/805667342', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 805667342}, {'type': 'v1', 'addr': '172.21.15.66:6833', 'nonce': 805667342}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [22], 'metadata_pool': 21, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:49:40.103 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:49:40.104 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2020-10-31T22:49:40.238 INFO:teuthology.orchestra.run.smithi066.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":7476,"want_state":"up:active","state":"up:active","rank_uptime":10.795036596999999,"mdsmap_epoch":59,"osdmap_epoch":120,"osdmap_epoch_barrier":119,"uptime":16.019402048} 2020-10-31T22:49:40.242 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 7476, "mdsmap_epoch": 59, "osdmap_epoch": 120, "osdmap_epoch_barrier": 119, "rank_uptime": 10.795036597, "state": "up:active", "uptime": 16.019402048, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:49:40.244 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:49:40.244 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-10-31T22:49:40.245 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi085.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-10-31T22:49:40.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:40.245 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:40.255 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:49:40.311 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:49:40.312 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:49:40.367 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:49:40.369 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:49:40.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:40.370 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:49:40.422 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:49:40.423 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:40.467 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:49:40.484 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:49:40.484 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:49:40.539 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:49:40.540 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:49:40.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:40.542 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:49:40.543 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:2020-10-31T22:49:40.536+0000 7f2150d660c0 -1 init, newargv = 0x5640bf57a3f0 newargc=9 2020-10-31T22:49:40.543 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13464]: starting ceph client 2020-10-31T22:49:40.550 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13464]: starting fuse 2020-10-31T22:49:40.558 INFO:teuthology.orchestra.run.smithi085.stdout:50 2020-10-31T22:49:40.558 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-10-31T22:49:40.559 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:40.560 INFO:teuthology.orchestra.run.smithi085:> sudo python3 -c ' 2020-10-31T22:49:40.561 INFO:teuthology.orchestra.run.smithi085:> import glob 2020-10-31T22:49:40.562 INFO:teuthology.orchestra.run.smithi085:> import re 2020-10-31T22:49:40.562 INFO:teuthology.orchestra.run.smithi085:> import os 2020-10-31T22:49:40.563 INFO:teuthology.orchestra.run.smithi085:> import subprocess 2020-10-31T22:49:40.563 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:49:40.563 INFO:teuthology.orchestra.run.smithi085:> def find_socket(client_name): 2020-10-31T22:49:40.564 INFO:teuthology.orchestra.run.smithi085:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-10-31T22:49:40.564 INFO:teuthology.orchestra.run.smithi085:> files = glob.glob(asok_path) 2020-10-31T22:49:40.565 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:49:40.565 INFO:teuthology.orchestra.run.smithi085:> # Given a non-glob path, it better be there 2020-10-31T22:49:40.566 INFO:teuthology.orchestra.run.smithi085:> if "*" not in asok_path: 2020-10-31T22:49:40.566 INFO:teuthology.orchestra.run.smithi085:> assert(len(files) == 1) 2020-10-31T22:49:40.567 INFO:teuthology.orchestra.run.smithi085:> return files[0] 2020-10-31T22:49:40.567 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:49:40.567 INFO:teuthology.orchestra.run.smithi085:> for f in files: 2020-10-31T22:49:40.568 INFO:teuthology.orchestra.run.smithi085:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:49:40.568 INFO:teuthology.orchestra.run.smithi085:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:49:40.569 INFO:teuthology.orchestra.run.smithi085:> return f 2020-10-31T22:49:40.569 INFO:teuthology.orchestra.run.smithi085:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:49:40.569 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:49:40.570 INFO:teuthology.orchestra.run.smithi085:> print(find_socket("client.1")) 2020-10-31T22:49:40.570 INFO:teuthology.orchestra.run.smithi085:> ' 2020-10-31T22:49:40.654 INFO:teuthology.orchestra.run.smithi085.stdout:/var/run/ceph/ceph-client.1.13464.asok 2020-10-31T22:49:40.658 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13464.asok 2020-10-31T22:49:40.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:40.659 INFO:teuthology.orchestra.run.smithi085:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13464.asok status 2020-10-31T22:49:40.765 INFO:teuthology.orchestra.run.smithi085.stdout:{ 2020-10-31T22:49:40.765 INFO:teuthology.orchestra.run.smithi085.stdout: "metadata": { 2020-10-31T22:49:40.766 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:49:40.766 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:49:40.766 INFO:teuthology.orchestra.run.smithi085.stdout: "entity_id": "1", 2020-10-31T22:49:40.766 INFO:teuthology.orchestra.run.smithi085.stdout: "hostname": "smithi085", 2020-10-31T22:49:40.766 INFO:teuthology.orchestra.run.smithi085.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-10-31T22:49:40.766 INFO:teuthology.orchestra.run.smithi085.stdout: "pid": "13464", 2020-10-31T22:49:40.767 INFO:teuthology.orchestra.run.smithi085.stdout: "root": "/" 2020-10-31T22:49:40.767 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:49:40.767 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_count": 0, 2020-10-31T22:49:40.767 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_pinned_count": 0, 2020-10-31T22:49:40.767 INFO:teuthology.orchestra.run.smithi085.stdout: "id": 7483, 2020-10-31T22:49:40.767 INFO:teuthology.orchestra.run.smithi085.stdout: "inst": { 2020-10-31T22:49:40.768 INFO:teuthology.orchestra.run.smithi085.stdout: "name": { 2020-10-31T22:49:40.768 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "client", 2020-10-31T22:49:40.768 INFO:teuthology.orchestra.run.smithi085.stdout: "num": 7483 2020-10-31T22:49:40.768 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:49:40.768 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:49:40.768 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:49:40.768 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:49:40.769 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 2009941846 2020-10-31T22:49:40.769 INFO:teuthology.orchestra.run.smithi085.stdout: } 2020-10-31T22:49:40.769 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:49:40.769 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:49:40.769 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:49:40.769 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:49:40.769 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 2009941846 2020-10-31T22:49:40.770 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:49:40.770 INFO:teuthology.orchestra.run.smithi085.stdout: "inst_str": "client.7483 172.21.15.85:0/2009941846", 2020-10-31T22:49:40.770 INFO:teuthology.orchestra.run.smithi085.stdout: "addr_str": "172.21.15.85:0/2009941846", 2020-10-31T22:49:40.770 INFO:teuthology.orchestra.run.smithi085.stdout: "inode_count": 1, 2020-10-31T22:49:40.770 INFO:teuthology.orchestra.run.smithi085.stdout: "mds_epoch": 59, 2020-10-31T22:49:40.771 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch": 120, 2020-10-31T22:49:40.771 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:49:40.771 INFO:teuthology.orchestra.run.smithi085.stdout: "blacklisted": false 2020-10-31T22:49:40.771 INFO:teuthology.orchestra.run.smithi085.stdout:} 2020-10-31T22:49:40.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:40.776 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:40.776 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:40.784 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:49:40.796 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:49:40.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:40.798 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:40.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:40.856 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:40.856 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:40.865 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:49:40.865 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:49:40.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:40.867 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:40.868 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:40.914 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:49:40.915 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:49:40.915 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:49:40.916 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:49:40.916 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:40.996 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[13984]: fuse finished with error 0 and tester_r 0 2020-10-31T22:49:40.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:40.999 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:40.999 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:41.045 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:49:41.047 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:49:41.047 INFO:teuthology.orchestra.run:waiting for 900 2020-10-31T22:49:45.318 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:49:45.321 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:49:45.323 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:49:45.326 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:49:47.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:49:47.151 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:49:47.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:47.159 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:47.159 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:47.167 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:49:47.168 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:49:47.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:47.169 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:47.170 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:47.216 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:49:47.217 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:49:47.218 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi085.front.sepia.ceph.com... 2020-10-31T22:49:47.218 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:49:47.218 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:47.290 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13464]: fuse finished with error 0 and tester_r 0 2020-10-31T22:49:47.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:49:47.292 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:49:47.293 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:47.339 INFO:teuthology.orchestra.run.smithi085.stdout:ext2/ext3 2020-10-31T22:49:47.340 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:49:47.341 INFO:teuthology.orchestra.run:waiting for 900 2020-10-31T22:49:47.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:49:47.343 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:49:47.392 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-10-31T22:49:47.392 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:49:47.393 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-10-31T22:49:47.393 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:49:47.394 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-10-31T22:49:47.394 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:49:47.409 INFO:tasks.ceph.mds.c:Stopped 2020-10-31T22:49:47.409 INFO:tasks.ceph.mds.a:Stopped 2020-10-31T22:49:47.410 DEBUG:teuthology.parallel:result is None 2020-10-31T22:49:47.410 DEBUG:teuthology.parallel:result is None 2020-10-31T22:49:47.413 INFO:tasks.ceph.mds.b:Stopped 2020-10-31T22:49:47.413 DEBUG:teuthology.parallel:result is None 2020-10-31T22:49:47.415 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail a 2020-10-31T22:49:47.416 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail c 2020-10-31T22:49:47.416 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mds fail b 2020-10-31T22:49:47.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8e1cee700 1 Processor -- start 2020-10-31T22:49:47.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8e1cee700 1 -- start start 2020-10-31T22:49:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8e1cee700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff8dc13ebe0 0x7ff8dc142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8e1cee700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc0abea0 con 0x7ff8dc0b1a10 2020-10-31T22:49:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8e1cee700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc141870 con 0x7ff8dc0af200 2020-10-31T22:49:47.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8e1cee700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8dc141b10 con 0x7ff8dc13ebe0 2020-10-31T22:49:47.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8e0cec700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff8dc0b1a10 0x7ff8dc0afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52402/0 (socket says 172.21.15.60:52402) 2020-10-31T22:49:47.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8e0cec700 1 -- 172.21.15.60:0/3683843498 learned_addr learned my addr 172.21.15.60:0/3683843498 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:47.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8d3fff700 1 --2- 172.21.15.60:0/3683843498 >> v2:172.21.15.60:3300/0 conn(0x7ff8dc13ebe0 0x7ff8dc142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8d37fe700 1 -- 172.21.15.60:0/3683843498 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 380521321 0 0) 0x7ff8dc0abea0 con 0x7ff8dc0b1a10 2020-10-31T22:49:47.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8d37fe700 1 -- 172.21.15.60:0/3683843498 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c8003230 con 0x7ff8dc0b1a10 2020-10-31T22:49:47.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8d3fff700 1 -- 172.21.15.60:0/3683843498 >> v1:172.21.15.66:6789/0 conn(0x7ff8dc0af200 legacy=0x7ff8dc0b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:47.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8d3fff700 1 -- 172.21.15.60:0/3683843498 >> v1:172.21.15.60:6789/0 conn(0x7ff8dc0b1a10 legacy=0x7ff8dc0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:47.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8d3fff700 1 -- 172.21.15.60:0/3683843498 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc141db0 con 0x7ff8dc13ebe0 2020-10-31T22:49:47.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7f6dbc82b700 1 Processor -- start 2020-10-31T22:49:47.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7f6dbc82b700 1 -- start start 2020-10-31T22:49:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.561+0000 7ff8d3fff700 1 --2- 172.21.15.60:0/3683843498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8dc13ebe0 0x7ff8dc142250 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7ff8cc002f30 tx=0x7ff8cc006e50).ready entity=mon.0 client_cookie=45ca09d80f71ae9f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8d37fe700 1 -- 172.21.15.60:0/3683843498 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8cc014070 con 0x7ff8dc13ebe0 2020-10-31T22:49:47.583 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8d37fe700 1 -- 172.21.15.60:0/3683843498 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc00ab70 con 0x7ff8dc13ebe0 2020-10-31T22:49:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8d37fe700 1 -- 172.21.15.60:0/3683843498 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8cc010410 con 0x7ff8dc13ebe0 2020-10-31T22:49:47.584 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 -- 172.21.15.60:0/3683843498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8dc13ebe0 msgr2=0x7ff8dc142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 --2- 172.21.15.60:0/3683843498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8dc13ebe0 0x7ff8dc142250 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 rx=0x7ff8cc002f30 tx=0x7ff8cc006e50).stop 2020-10-31T22:49:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 -- 172.21.15.60:0/3683843498 shutdown_connections 2020-10-31T22:49:47.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 --2- 172.21.15.60:0/3683843498 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8dc13ebe0 0x7ff8dc142250 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 -- 172.21.15.60:0/3683843498 >> 172.21.15.60:0/3683843498 conn(0x7ff8dc0b5300 msgr2=0x7ff8dc0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 -- 172.21.15.60:0/3683843498 shutdown_connections 2020-10-31T22:49:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 -- 172.21.15.60:0/3683843498 wait complete. 2020-10-31T22:49:47.586 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 Processor -- start 2020-10-31T22:49:47.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 -- start start 2020-10-31T22:49:47.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8dc0af200 0x7ff8dc0aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.587 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8dc0b1a10 0x7ff8dc062e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8dc13ebe0 0x7ff8dc065620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc14f850 con 0x7ff8dc0af200 2020-10-31T22:49:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc064c40 con 0x7ff8dc13ebe0 2020-10-31T22:49:47.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e1cee700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc064ee0 con 0x7ff8dc0b1a10 2020-10-31T22:49:47.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e0cec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8dc0af200 0x7ff8dc0aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e0cec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8dc0af200 0x7ff8dc0aaac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48278/0 (socket says 172.21.15.60:48278) 2020-10-31T22:49:47.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e0cec700 1 -- 172.21.15.60:0/4055068490 learned_addr learned my addr 172.21.15.60:0/4055068490 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:47.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8d3fff700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8dc0b1a10 0x7ff8dc062e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e14ed700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8dc13ebe0 0x7ff8dc065620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e0cec700 1 -- 172.21.15.60:0/4055068490 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8dc0b1a10 msgr2=0x7ff8dc062e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:47.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e0cec700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8dc0b1a10 0x7ff8dc062e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:47.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e0cec700 1 -- 172.21.15.60:0/4055068490 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8dc13ebe0 msgr2=0x7ff8dc065620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:47.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e0cec700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8dc13ebe0 0x7ff8dc065620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:47.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e0cec700 1 -- 172.21.15.60:0/4055068490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc065180 con 0x7ff8dc0af200 2020-10-31T22:49:47.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e14ed700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8dc13ebe0 0x7ff8dc065620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:47.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7ff8e0cec700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8dc0af200 0x7ff8dc0aaac0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7ff8d80010d0 tx=0x7ff8d80079f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:47.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7ff8d1ffb700 1 -- 172.21.15.60:0/4055068490 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8d8011690 con 0x7ff8dc0af200 2020-10-31T22:49:47.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7ff8d1ffb700 1 -- 172.21.15.60:0/4055068490 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d80117f0 con 0x7ff8dc0af200 2020-10-31T22:49:47.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7ff8d1ffb700 1 -- 172.21.15.60:0/4055068490 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff8d8011b50 con 0x7ff8dc0af200 2020-10-31T22:49:47.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7ff8e1cee700 1 -- 172.21.15.60:0/4055068490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc065b10 con 0x7ff8dc0af200 2020-10-31T22:49:47.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7ff8e1cee700 1 -- 172.21.15.60:0/4055068490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc14f3d0 con 0x7ff8dc0af200 2020-10-31T22:49:47.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7ff8e1cee700 1 -- 172.21.15.60:0/4055068490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc065ca0 con 0x7ff8dc0af200 2020-10-31T22:49:47.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7ff8d1ffb700 1 -- 172.21.15.60:0/4055068490 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff8d8021070 con 0x7ff8dc0af200 2020-10-31T22:49:47.593 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7ff8d1ffb700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff8bc054f10 0x7ff8bc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7ff8d1ffb700 1 -- 172.21.15.60:0/4055068490 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff8d80717d0 con 0x7ff8dc0af200 2020-10-31T22:49:47.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7ff8d3fff700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff8bc054f10 0x7ff8bc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7ff8d3fff700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff8bc054f10 0x7ff8bc0573d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7ff8cc01a000 tx=0x7ff8dc13f160).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:47.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.577+0000 7ff8d1ffb700 1 -- 172.21.15.60:0/4055068490 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff8d8047cf0 con 0x7ff8dc0af200 2020-10-31T22:49:47.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6db80af3e0 0x7f6db80af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6db8067070 0x7f6db81423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db8066c20 con 0x7f6db81428a0 2020-10-31T22:49:47.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db8142d30 con 0x7f6db8067070 2020-10-31T22:49:47.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db80afdb0 con 0x7f6db80af3e0 2020-10-31T22:49:47.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6db6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6db8067070 0x7f6db81423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6db6ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6db8067070 0x7f6db81423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48274/0 (socket says 172.21.15.60:48274) 2020-10-31T22:49:47.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6db6ffd700 1 -- 172.21.15.60:0/2464910684 learned_addr learned my addr 172.21.15.60:0/2464910684 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:47.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6db77fe700 1 --2- 172.21.15.60:0/2464910684 >> v2:172.21.15.66:3300/0 conn(0x7f6db80af3e0 0x7f6db80af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6db6ffd700 1 -- 172.21.15.60:0/2464910684 >> v2:172.21.15.66:3300/0 conn(0x7f6db80af3e0 msgr2=0x7f6db80af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:47.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6db6ffd700 1 --2- 172.21.15.60:0/2464910684 >> v2:172.21.15.66:3300/0 conn(0x7f6db80af3e0 0x7f6db80af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:47.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6db6ffd700 1 -- 172.21.15.60:0/2464910684 >> v1:172.21.15.66:6789/0 conn(0x7f6db81428a0 legacy=0x7f6db805b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:47.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6db6ffd700 1 -- 172.21.15.60:0/2464910684 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db8066980 con 0x7f6db8067070 2020-10-31T22:49:47.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6db6ffd700 1 --2- 172.21.15.60:0/2464910684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8067070 0x7f6db81423b0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f6dac002f30 tx=0x7f6dac006e80).ready entity=mon.0 client_cookie=5650a014353ae79 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:47.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6db67fc700 1 -- 172.21.15.60:0/2464910684 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6dac0097f0 con 0x7f6db8067070 2020-10-31T22:49:47.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6db67fc700 1 -- 172.21.15.60:0/2464910684 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac009950 con 0x7f6db8067070 2020-10-31T22:49:47.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6db67fc700 1 -- 172.21.15.60:0/2464910684 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6dac009cb0 con 0x7f6db8067070 2020-10-31T22:49:47.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2464910684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8067070 msgr2=0x7f6db81423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:47.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 --2- 172.21.15.60:0/2464910684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8067070 0x7f6db81423b0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 rx=0x7f6dac002f30 tx=0x7f6dac006e80).stop 2020-10-31T22:49:47.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2464910684 shutdown_connections 2020-10-31T22:49:47.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 --2- 172.21.15.60:0/2464910684 >> v2:172.21.15.66:3300/0 conn(0x7f6db80af3e0 0x7f6db80af7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:47.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 --2- 172.21.15.60:0/2464910684 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db8067070 0x7f6db81423b0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:47.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2464910684 >> 172.21.15.60:0/2464910684 conn(0x7f6db80b3fd0 msgr2=0x7f6db80b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:47.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2464910684 shutdown_connections 2020-10-31T22:49:47.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2464910684 wait complete. 2020-10-31T22:49:47.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 Processor -- start 2020-10-31T22:49:47.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.565+0000 7f6dbc82b700 1 -- start start 2020-10-31T22:49:47.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6dbc82b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6db8067070 0x7f6db8143970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6dbc82b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db80af3e0 0x7f6db8150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6dbc82b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db81428a0 0x7f6db80a9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6dbc82b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db81445e0 con 0x7f6db81428a0 2020-10-31T22:49:47.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6dbc82b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db81511d0 con 0x7f6db8067070 2020-10-31T22:49:47.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6dbc82b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db8151460 con 0x7f6db80af3e0 2020-10-31T22:49:47.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6db77fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6db8067070 0x7f6db8143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6db77fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6db8067070 0x7f6db8143970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:59220/0 (socket says 172.21.15.60:59220) 2020-10-31T22:49:47.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6db77fe700 1 -- 172.21.15.60:0/2120264777 learned_addr learned my addr 172.21.15.60:0/2120264777 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:47.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6db6ffd700 1 --2- 172.21.15.60:0/2120264777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db80af3e0 0x7f6db8150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6db7fff700 1 --2- 172.21.15.60:0/2120264777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db81428a0 0x7f6db80a9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6db77fe700 1 -- 172.21.15.60:0/2120264777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db80af3e0 msgr2=0x7f6db8150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:47.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6db77fe700 1 --2- 172.21.15.60:0/2120264777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db80af3e0 0x7f6db8150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:47.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6db77fe700 1 -- 172.21.15.60:0/2120264777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db81428a0 msgr2=0x7f6db80a9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:47.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6db77fe700 1 --2- 172.21.15.60:0/2120264777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db81428a0 0x7f6db80a9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:47.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6db77fe700 1 -- 172.21.15.60:0/2120264777 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db8151700 con 0x7f6db8067070 2020-10-31T22:49:47.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6db77fe700 1 --2- 172.21.15.60:0/2120264777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6db8067070 0x7f6db8143970 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f6da8006910 tx=0x7f6da8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:47.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6db4ff9700 1 -- 172.21.15.60:0/2120264777 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da800c820 con 0x7f6db8067070 2020-10-31T22:49:47.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2120264777 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db81519a0 con 0x7f6db8067070 2020-10-31T22:49:47.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6db4ff9700 1 -- 172.21.15.60:0/2120264777 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da800c980 con 0x7f6db8067070 2020-10-31T22:49:47.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6db4ff9700 1 -- 172.21.15.60:0/2120264777 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6da800cce0 con 0x7f6db8067070 2020-10-31T22:49:47.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2120264777 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db8147460 con 0x7f6db8067070 2020-10-31T22:49:47.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2120264777 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db8057100 con 0x7f6db8067070 2020-10-31T22:49:47.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f6db4ff9700 1 -- 172.21.15.60:0/2120264777 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6da8022070 con 0x7f6db8067070 2020-10-31T22:49:47.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f6db4ff9700 1 --2- 172.21.15.60:0/2120264777 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6d98054f90 0x7f6d98057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f6db4ff9700 1 -- 172.21.15.60:0/2120264777 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f6da806e120 con 0x7f6db8067070 2020-10-31T22:49:47.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f6db6ffd700 1 --2- 172.21.15.60:0/2120264777 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6d98054f90 0x7f6d98057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f6db6ffd700 1 --2- 172.21.15.60:0/2120264777 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6d98054f90 0x7f6d98057450 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f6dac01c000 tx=0x7f6dac015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:47.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f9eb2a65700 1 Processor -- start 2020-10-31T22:49:47.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.569+0000 7f9eb2a65700 1 -- start start 2020-10-31T22:49:47.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f9eb2a65700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9eac0b1bb0 0x7f9eac05c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f9eb2a65700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac05c800 con 0x7f9eac13f3d0 2020-10-31T22:49:47.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f9eb2a65700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac0adc50 con 0x7f9eac0ae630 2020-10-31T22:49:47.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f9eb2a65700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac0adef0 con 0x7f9eac0b1bb0 2020-10-31T22:49:47.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f9eb2264700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9eac13f3d0 0x7f9eac0b0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52432/0 (socket says 172.21.15.60:52432) 2020-10-31T22:49:47.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f9eb2264700 1 -- 172.21.15.60:0/571015556 learned_addr learned my addr 172.21.15.60:0/571015556 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:47.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f9eb1a63700 1 --2- 172.21.15.60:0/571015556 >> v2:172.21.15.66:3300/0 conn(0x7f9eac0b1bb0 0x7f9eac05c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f9eb1a63700 1 -- 172.21.15.60:0/571015556 >> v1:172.21.15.66:6789/0 conn(0x7f9eac0ae630 legacy=0x7f9eac13ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:47.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f9eb1a63700 1 -- 172.21.15.60:0/571015556 >> v1:172.21.15.60:6789/0 conn(0x7f9eac13f3d0 legacy=0x7f9eac0b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:47.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f9eb1a63700 1 -- 172.21.15.60:0/571015556 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac0ae190 con 0x7f9eac0b1bb0 2020-10-31T22:49:47.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.573+0000 7f9eb1a63700 1 --2- 172.21.15.60:0/571015556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9eac0b1bb0 0x7f9eac05c0f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f9ea40032b0 tx=0x7f9ea40091a0).ready entity=mon.1 client_cookie=583e3d54db619aaf server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:47.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb0a61700 1 -- 172.21.15.60:0/571015556 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ea400ba50 con 0x7f9eac0b1bb0 2020-10-31T22:49:47.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb0a61700 1 -- 172.21.15.60:0/571015556 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea400bbb0 con 0x7f9eac0b1bb0 2020-10-31T22:49:47.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb0a61700 1 -- 172.21.15.60:0/571015556 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ea400bd20 con 0x7f9eac0b1bb0 2020-10-31T22:49:47.614 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 -- 172.21.15.60:0/571015556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9eac0b1bb0 msgr2=0x7f9eac05c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:47.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 --2- 172.21.15.60:0/571015556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9eac0b1bb0 0x7f9eac05c0f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f9ea40032b0 tx=0x7f9ea40091a0).stop 2020-10-31T22:49:47.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 -- 172.21.15.60:0/571015556 shutdown_connections 2020-10-31T22:49:47.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 --2- 172.21.15.60:0/571015556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9eac0b1bb0 0x7f9eac05c0f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:47.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 -- 172.21.15.60:0/571015556 >> 172.21.15.60:0/571015556 conn(0x7f9eac0b5300 msgr2=0x7f9eac0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:47.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 -- 172.21.15.60:0/571015556 shutdown_connections 2020-10-31T22:49:47.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 -- 172.21.15.60:0/571015556 wait complete. 2020-10-31T22:49:47.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 Processor -- start 2020-10-31T22:49:47.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 -- start start 2020-10-31T22:49:47.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9eac0b1bb0 0x7f9eac13e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9eac13f3d0 0x7f9eac141c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9eac142b40 0x7f9eac142180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac065060 con 0x7f9eac142b40 2020-10-31T22:49:47.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac065300 con 0x7f9eac0b1bb0 2020-10-31T22:49:47.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f9eb2a65700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0655a0 con 0x7f9eac13f3d0 2020-10-31T22:49:47.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb2264700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9eac142b40 0x7f9eac142180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb1262700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9eac13f3d0 0x7f9eac141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb2264700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9eac142b40 0x7f9eac142180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48304/0 (socket says 172.21.15.60:48304) 2020-10-31T22:49:47.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb2264700 1 -- 172.21.15.60:0/4086532698 learned_addr learned my addr 172.21.15.60:0/4086532698 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:47.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb1a63700 1 --2- 172.21.15.60:0/4086532698 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9eac0b1bb0 0x7f9eac13e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb2264700 1 -- 172.21.15.60:0/4086532698 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9eac13f3d0 msgr2=0x7f9eac141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:47.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb2264700 1 --2- 172.21.15.60:0/4086532698 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9eac13f3d0 0x7f9eac141c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:47.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb2264700 1 -- 172.21.15.60:0/4086532698 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9eac0b1bb0 msgr2=0x7f9eac13e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:47.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb2264700 1 --2- 172.21.15.60:0/4086532698 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9eac0b1bb0 0x7f9eac13e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:47.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb2264700 1 -- 172.21.15.60:0/4086532698 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac13e750 con 0x7f9eac142b40 2020-10-31T22:49:47.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb2264700 1 --2- 172.21.15.60:0/4086532698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9eac142b40 0x7f9eac142180 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f9eac06a290 tx=0x7f9e9c007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:47.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9e9affd700 1 -- 172.21.15.60:0/4086532698 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e9c0072e0 con 0x7f9eac142b40 2020-10-31T22:49:47.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9e9affd700 1 -- 172.21.15.60:0/4086532698 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9c007440 con 0x7f9eac142b40 2020-10-31T22:49:47.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb2a65700 1 -- 172.21.15.60:0/4086532698 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac13ecd0 con 0x7f9eac142b40 2020-10-31T22:49:47.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9e9affd700 1 -- 172.21.15.60:0/4086532698 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e9c0057d0 con 0x7f9eac142b40 2020-10-31T22:49:47.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb2a65700 1 -- 172.21.15.60:0/4086532698 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac14da70 con 0x7f9eac142b40 2020-10-31T22:49:47.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb2a65700 1 -- 172.21.15.60:0/4086532698 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac064e80 con 0x7f9eac142b40 2020-10-31T22:49:47.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9e9affd700 1 -- 172.21.15.60:0/4086532698 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9e9c010070 con 0x7f9eac142b40 2020-10-31T22:49:47.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9e9affd700 1 --2- 172.21.15.60:0/4086532698 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9e8c054f10 0x7f9e8c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:47.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9e9affd700 1 -- 172.21.15.60:0/4086532698 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9e9c06cff0 con 0x7f9eac142b40 2020-10-31T22:49:47.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.585+0000 7f9eb1a63700 1 --2- 172.21.15.60:0/4086532698 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9e8c054f10 0x7f9e8c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:47.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.589+0000 7f9eb1a63700 1 --2- 172.21.15.60:0/4086532698 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9e8c054f10 0x7f9e8c0573d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f9ea401b000 tx=0x7f9ea4016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:47.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.593+0000 7f9e9affd700 1 -- 172.21.15.60:0/4086532698 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9e9c043470 con 0x7f9eac142b40 2020-10-31T22:49:47.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.581+0000 7f6db4ff9700 1 -- 172.21.15.60:0/2120264777 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6da8044640 con 0x7f6db8067070 2020-10-31T22:49:47.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.773+0000 7ff8e1cee700 1 -- 172.21.15.60:0/4055068490 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "c"} v 0) v1 -- 0x7ff8dc05bd20 con 0x7ff8dc0af200 2020-10-31T22:49:47.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.773+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2120264777 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "a"} v 0) v1 -- 0x7f6db805a8e0 con 0x7f6db8067070 2020-10-31T22:49:47.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:47.793+0000 7f9eb2a65700 1 -- 172.21.15.60:0/4086532698 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "mds fail", "role_or_gid": "b"} v 0) v1 -- 0x7f9eac065760 con 0x7f9eac142b40 2020-10-31T22:49:48.014 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:49:48.009+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:49:48.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.021+0000 7ff8d1ffb700 1 -- 172.21.15.60:0/4055068490 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "c"}]=0 failed mds gid 7285 v60) v1 ==== 95+0+0 (secure 0 0 0) 0x7ff8dc05bd20 con 0x7ff8dc0af200 2020-10-31T22:49:48.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.021+0000 7f9e9affd700 1 -- 172.21.15.60:0/4086532698 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "b"}]=0 failed mds gid 7476 v60) v1 ==== 95+0+0 (secure 0 0 0) 0x7f9e9c046a90 con 0x7f9eac142b40 2020-10-31T22:49:48.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.021+0000 7f6db4ff9700 1 -- 172.21.15.60:0/2120264777 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "mds fail", "role_or_gid": "a"}]=0 failed mds gid 6554 v60) v1 ==== 95+0+0 (secure 0 0 0) 0x7f6da8047c60 con 0x7f6db8067070 2020-10-31T22:49:48.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7f9eb2a65700 1 -- 172.21.15.60:0/4086532698 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9e8c054f10 msgr2=0x7f9e8c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:48.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7f9eb2a65700 1 --2- 172.21.15.60:0/4086532698 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9e8c054f10 0x7f9e8c0573d0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f9ea401b000 tx=0x7f9ea4016000).stop 2020-10-31T22:49:48.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7f9eb2a65700 1 -- 172.21.15.60:0/4086532698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9eac142b40 msgr2=0x7f9eac142180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:48.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7f9eb2a65700 1 --2- 172.21.15.60:0/4086532698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9eac142b40 0x7f9eac142180 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 rx=0x7f9eac06a290 tx=0x7f9e9c007af0).stop 2020-10-31T22:49:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7f9eb2a65700 1 -- 172.21.15.60:0/4086532698 shutdown_connections 2020-10-31T22:49:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7f9eb2a65700 1 --2- 172.21.15.60:0/4086532698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9eac142b40 0x7f9eac142180 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7f9eb2a65700 1 --2- 172.21.15.60:0/4086532698 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9e8c054f10 0x7f9e8c0573d0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7f9eb2a65700 1 --2- 172.21.15.60:0/4086532698 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9eac0b1bb0 0x7f9eac13e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7f9eb2a65700 1 --2- 172.21.15.60:0/4086532698 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9eac13f3d0 0x7f9eac141c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7f9eb2a65700 1 -- 172.21.15.60:0/4086532698 >> 172.21.15.60:0/4086532698 conn(0x7f9eac0b5300 msgr2=0x7f9eac0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:48.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7f9eb2a65700 1 -- 172.21.15.60:0/4086532698 shutdown_connections 2020-10-31T22:49:48.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7f9eb2a65700 1 -- 172.21.15.60:0/4086532698 wait complete. 2020-10-31T22:49:48.035 INFO:teuthology.orchestra.run.smithi060.stderr:failed mds gid 7476 2020-10-31T22:49:48.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7ff8e1cee700 1 -- 172.21.15.60:0/4055068490 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff8bc054f10 msgr2=0x7ff8bc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:48.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7ff8e1cee700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff8bc054f10 0x7ff8bc0573d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7ff8cc01a000 tx=0x7ff8dc13f160).stop 2020-10-31T22:49:48.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7ff8e1cee700 1 -- 172.21.15.60:0/4055068490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8dc0af200 msgr2=0x7ff8dc0aaac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:48.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7ff8e1cee700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8dc0af200 0x7ff8dc0aaac0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 rx=0x7ff8d80010d0 tx=0x7ff8d80079f0).stop 2020-10-31T22:49:48.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7ff8e1cee700 1 -- 172.21.15.60:0/4055068490 shutdown_connections 2020-10-31T22:49:48.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7ff8e1cee700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff8bc054f10 0x7ff8bc0573d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7ff8e1cee700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8dc13ebe0 0x7ff8dc065620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7ff8e1cee700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8dc0af200 0x7ff8dc0aaac0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7ff8e1cee700 1 --2- 172.21.15.60:0/4055068490 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8dc0b1a10 0x7ff8dc062e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7ff8e1cee700 1 -- 172.21.15.60:0/4055068490 >> 172.21.15.60:0/4055068490 conn(0x7ff8dc0b5300 msgr2=0x7ff8dc0aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:48.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.029+0000 7ff8e1cee700 1 -- 172.21.15.60:0/4055068490 shutdown_connections 2020-10-31T22:49:48.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.029+0000 7ff8e1cee700 1 -- 172.21.15.60:0/4055068490 wait complete. 2020-10-31T22:49:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2120264777 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6d98054f90 msgr2=0x7f6d98057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.025+0000 7f6dbc82b700 1 --2- 172.21.15.60:0/2120264777 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6d98054f90 0x7f6d98057450 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f6dac01c000 tx=0x7f6dac015000).stop 2020-10-31T22:49:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.029+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2120264777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6db8067070 msgr2=0x7f6db8143970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.029+0000 7f6dbc82b700 1 --2- 172.21.15.60:0/2120264777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6db8067070 0x7f6db8143970 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f6da8006910 tx=0x7f6da8008040).stop 2020-10-31T22:49:48.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.029+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2120264777 shutdown_connections 2020-10-31T22:49:48.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.029+0000 7f6dbc82b700 1 --2- 172.21.15.60:0/2120264777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6db81428a0 0x7f6db80a9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.029+0000 7f6dbc82b700 1 --2- 172.21.15.60:0/2120264777 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6d98054f90 0x7f6d98057450 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.029+0000 7f6dbc82b700 1 --2- 172.21.15.60:0/2120264777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6db8067070 0x7f6db8143970 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.029+0000 7f6dbc82b700 1 --2- 172.21.15.60:0/2120264777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6db80af3e0 0x7f6db8150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.029+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2120264777 >> 172.21.15.60:0/2120264777 conn(0x7f6db80b3fd0 msgr2=0x7f6db80b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:48.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.029+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2120264777 shutdown_connections 2020-10-31T22:49:48.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.029+0000 7f6dbc82b700 1 -- 172.21.15.60:0/2120264777 wait complete. 2020-10-31T22:49:48.041 INFO:teuthology.orchestra.run.smithi060.stderr:failed mds gid 7285 2020-10-31T22:49:48.041 INFO:teuthology.orchestra.run.smithi060.stderr:failed mds gid 6554 2020-10-31T22:49:48.047 DEBUG:teuthology.parallel:result is '' 2020-10-31T22:49:48.050 DEBUG:teuthology.parallel:result is '' 2020-10-31T22:49:48.051 DEBUG:teuthology.parallel:result is '' 2020-10-31T22:49:48.052 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:49:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.213+0000 7f0faa72c700 1 Processor -- start 2020-10-31T22:49:48.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.213+0000 7f0faa72c700 1 -- start start 2020-10-31T22:49:48.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0faa72c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fa40ae020 0x7f0fa40afb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:48.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0faa72c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0fa40afff0 0x7f0fa40abad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:48.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0faa72c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa40b1030 con 0x7f0fa40b0c50 2020-10-31T22:49:48.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0faa72c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa40b0440 con 0x7f0fa40afff0 2020-10-31T22:49:48.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0faa72c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40aab00 con 0x7f0fa40ae020 2020-10-31T22:49:48.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0fa8cc9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f0fa40afff0 0x7f0fa40abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:48.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0fa3fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0fa40b0c50 0x7f0fa413f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52444/0 (socket says 172.21.15.60:52444) 2020-10-31T22:49:48.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0fa3fff700 1 -- 172.21.15.60:0/3738922668 learned_addr learned my addr 172.21.15.60:0/3738922668 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:48.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0fa37fe700 1 --2- 172.21.15.60:0/3738922668 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fa40ae020 0x7f0fa40afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:48.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0fa8cc9700 1 -- 172.21.15.60:0/3738922668 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fa40ae020 msgr2=0x7f0fa40afb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:48.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0fa8cc9700 1 --2- 172.21.15.60:0/3738922668 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fa40ae020 0x7f0fa40afb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0fa8cc9700 1 -- 172.21.15.60:0/3738922668 >> v1:172.21.15.60:6789/0 conn(0x7f0fa40b0c50 legacy=0x7f0fa413f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:48.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0fa2ffd700 1 -- 172.21.15.60:0/3738922668 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287624879 0 0) 0x7f0fa40b1030 con 0x7f0fa40b0c50 2020-10-31T22:49:48.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0fa8cc9700 1 -- 172.21.15.60:0/3738922668 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa40aada0 con 0x7f0fa40afff0 2020-10-31T22:49:48.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0fa8cc9700 1 --2- 172.21.15.60:0/3738922668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa40afff0 0x7f0fa40abad0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f0f9c0032b0 tx=0x7f0f9c0091a0).ready entity=mon.0 client_cookie=295ce383fd46fde2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:48.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0fa2ffd700 1 -- 172.21.15.60:0/3738922668 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f9c00b9a0 con 0x7f0fa40afff0 2020-10-31T22:49:48.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0fa2ffd700 1 -- 172.21.15.60:0/3738922668 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9c00bb00 con 0x7f0fa40afff0 2020-10-31T22:49:48.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0fa2ffd700 1 -- 172.21.15.60:0/3738922668 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f9c00bc70 con 0x7f0fa40afff0 2020-10-31T22:49:48.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0faa72c700 1 -- 172.21.15.60:0/3738922668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa40afff0 msgr2=0x7f0fa40abad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:48.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0faa72c700 1 --2- 172.21.15.60:0/3738922668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa40afff0 0x7f0fa40abad0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 rx=0x7f0f9c0032b0 tx=0x7f0f9c0091a0).stop 2020-10-31T22:49:48.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0faa72c700 1 -- 172.21.15.60:0/3738922668 shutdown_connections 2020-10-31T22:49:48.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0faa72c700 1 --2- 172.21.15.60:0/3738922668 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa40afff0 0x7f0fa40abad0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0faa72c700 1 --2- 172.21.15.60:0/3738922668 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fa40ae020 0x7f0fa40afb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0faa72c700 1 -- 172.21.15.60:0/3738922668 >> 172.21.15.60:0/3738922668 conn(0x7f0fa406a260 msgr2=0x7f0fa4061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:48.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0faa72c700 1 -- 172.21.15.60:0/3738922668 shutdown_connections 2020-10-31T22:49:48.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.217+0000 7f0faa72c700 1 -- 172.21.15.60:0/3738922668 wait complete. 2020-10-31T22:49:48.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.221+0000 7f0faa72c700 1 Processor -- start 2020-10-31T22:49:48.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.221+0000 7f0faa72c700 1 -- start start 2020-10-31T22:49:48.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.221+0000 7f0faa72c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fa40ae020 0x7f0fa40ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:48.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.221+0000 7f0faa72c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa40afff0 0x7f0fa41526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:48.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.221+0000 7f0faa72c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa40b0c50 0x7f0fa413b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:48.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.221+0000 7f0faa72c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa4151d20 con 0x7f0fa40afff0 2020-10-31T22:49:48.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.221+0000 7f0faa72c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa4141650 con 0x7f0fa40b0c50 2020-10-31T22:49:48.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.221+0000 7f0faa72c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa4152bb0 con 0x7f0fa40ae020 2020-10-31T22:49:48.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.221+0000 7f0fa37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa40afff0 0x7f0fa41526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:48.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.221+0000 7f0fa37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa40afff0 0x7f0fa41526c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48316/0 (socket says 172.21.15.60:48316) 2020-10-31T22:49:48.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.221+0000 7f0fa37fe700 1 -- 172.21.15.60:0/416680465 learned_addr learned my addr 172.21.15.60:0/416680465 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:48.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.221+0000 7f0fa3fff700 1 --2- 172.21.15.60:0/416680465 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fa40ae020 0x7f0fa40ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:48.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.221+0000 7f0fa8cc9700 1 --2- 172.21.15.60:0/416680465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa40b0c50 0x7f0fa413b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:48.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.221+0000 7f0fa37fe700 1 -- 172.21.15.60:0/416680465 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fa40ae020 msgr2=0x7f0fa40ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:48.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.225+0000 7f0fa37fe700 1 --2- 172.21.15.60:0/416680465 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fa40ae020 0x7f0fa40ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.225+0000 7f0fa37fe700 1 -- 172.21.15.60:0/416680465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa40b0c50 msgr2=0x7f0fa413b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:48.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.225+0000 7f0fa37fe700 1 --2- 172.21.15.60:0/416680465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa40b0c50 0x7f0fa413b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:48.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.225+0000 7f0fa37fe700 1 -- 172.21.15.60:0/416680465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa413bb40 con 0x7f0fa40afff0 2020-10-31T22:49:48.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.225+0000 7f0fa37fe700 1 --2- 172.21.15.60:0/416680465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa40afff0 0x7f0fa41526c0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f0fa41417e0 tx=0x7f0f8c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:48.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.225+0000 7f0fa17fa700 1 -- 172.21.15.60:0/416680465 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f8c00ca10 con 0x7f0fa40afff0 2020-10-31T22:49:48.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.225+0000 7f0fa17fa700 1 -- 172.21.15.60:0/416680465 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c00cb70 con 0x7f0fa40afff0 2020-10-31T22:49:48.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.225+0000 7f0faa72c700 1 -- 172.21.15.60:0/416680465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa4151f80 con 0x7f0fa40afff0 2020-10-31T22:49:48.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.225+0000 7f0fa17fa700 1 -- 172.21.15.60:0/416680465 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0f8c00ced0 con 0x7f0fa40afff0 2020-10-31T22:49:48.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.225+0000 7f0faa72c700 1 -- 172.21.15.60:0/416680465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa413b800 con 0x7f0fa40afff0 2020-10-31T22:49:48.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.225+0000 7f0faa72c700 1 -- 172.21.15.60:0/416680465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa4057100 con 0x7f0fa40afff0 2020-10-31T22:49:48.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.225+0000 7f0fa17fa700 1 -- 172.21.15.60:0/416680465 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0f8c01c460 con 0x7f0fa40afff0 2020-10-31T22:49:48.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.229+0000 7f0fa17fa700 1 --2- 172.21.15.60:0/416680465 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f88054f90 0x7f0f88057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:48.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.229+0000 7f0fa3fff700 1 --2- 172.21.15.60:0/416680465 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f88054f90 0x7f0f88057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:48.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.229+0000 7f0fa17fa700 1 -- 172.21.15.60:0/416680465 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f0f8c06de40 con 0x7f0fa40afff0 2020-10-31T22:49:48.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.229+0000 7f0fa3fff700 1 --2- 172.21.15.60:0/416680465 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f88054f90 0x7f0f88057450 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f0f9400d000 tx=0x7f0f94007950).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:48.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.233+0000 7f0fa17fa700 1 -- 172.21.15.60:0/416680465 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0f8c0441a0 con 0x7f0fa40afff0 2020-10-31T22:49:48.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:48.421+0000 7f0faa72c700 1 -- 172.21.15.60:0/416680465 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0fa405aa70 con 0x7f0fa40afff0 2020-10-31T22:49:49.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.025+0000 7f0fa17fa700 1 -- 172.21.15.60:0/416680465 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0f8c0477c0 con 0x7f0fa40afff0 2020-10-31T22:49:49.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.029+0000 7f0faa72c700 1 -- 172.21.15.60:0/416680465 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f88054f90 msgr2=0x7f0f88057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:49.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.029+0000 7f0faa72c700 1 --2- 172.21.15.60:0/416680465 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f88054f90 0x7f0f88057450 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7f0f9400d000 tx=0x7f0f94007950).stop 2020-10-31T22:49:49.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.029+0000 7f0faa72c700 1 -- 172.21.15.60:0/416680465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa40afff0 msgr2=0x7f0fa41526c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:49.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.029+0000 7f0faa72c700 1 --2- 172.21.15.60:0/416680465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa40afff0 0x7f0fa41526c0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 rx=0x7f0fa41417e0 tx=0x7f0f8c006dc0).stop 2020-10-31T22:49:49.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.029+0000 7f0faa72c700 1 -- 172.21.15.60:0/416680465 shutdown_connections 2020-10-31T22:49:49.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.029+0000 7f0faa72c700 1 --2- 172.21.15.60:0/416680465 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0f88054f90 0x7f0f88057450 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:49.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.029+0000 7f0faa72c700 1 --2- 172.21.15.60:0/416680465 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fa40b0c50 0x7f0fa413b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:49.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.029+0000 7f0faa72c700 1 --2- 172.21.15.60:0/416680465 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fa40ae020 0x7f0fa40ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:49.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.029+0000 7f0faa72c700 1 --2- 172.21.15.60:0/416680465 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa40afff0 0x7f0fa41526c0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:49.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.029+0000 7f0faa72c700 1 -- 172.21.15.60:0/416680465 >> 172.21.15.60:0/416680465 conn(0x7f0fa406a260 msgr2=0x7f0fa413f250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:49.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.029+0000 7f0faa72c700 1 -- 172.21.15.60:0/416680465 shutdown_connections 2020-10-31T22:49:49.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.029+0000 7f0faa72c700 1 -- 172.21.15.60:0/416680465 wait complete. 2020-10-31T22:49:49.053 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:49:49.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.173+0000 7fdae22df700 1 Processor -- start 2020-10-31T22:49:49.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.173+0000 7fdae22df700 1 -- start start 2020-10-31T22:49:49.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae22df700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdadc0b5950 0x7fdadc142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:49.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae22df700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc142b00 con 0x7fdadc0b5570 2020-10-31T22:49:49.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae22df700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc0b4440 con 0x7fdadc0b24a0 2020-10-31T22:49:49.182 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae22df700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc13f930 con 0x7fdadc0b5950 2020-10-31T22:49:49.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae1ade700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fdadc0b5950 0x7fdadc142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:49.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae12dd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdadc0b5570 0x7fdadc145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52460/0 (socket says 172.21.15.60:52460) 2020-10-31T22:49:49.183 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae12dd700 1 -- 172.21.15.60:0/4017628610 learned_addr learned my addr 172.21.15.60:0/4017628610 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:49.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae1ade700 1 -- 172.21.15.60:0/4017628610 >> v1:172.21.15.66:6789/0 conn(0x7fdadc0b24a0 legacy=0x7fdadc141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:49.184 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae1ade700 1 -- 172.21.15.60:0/4017628610 >> v1:172.21.15.60:6789/0 conn(0x7fdadc0b5570 legacy=0x7fdadc145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:49.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae1ade700 1 -- 172.21.15.60:0/4017628610 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc146060 con 0x7fdadc0b5950 2020-10-31T22:49:49.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae1ade700 1 --2- 172.21.15.60:0/4017628610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0b5950 0x7fdadc142610 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fdad40032b0 tx=0x7fdad40091a0).ready entity=mon.0 client_cookie=7fa7e4edd0afc1fc server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:49.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdad3fff700 1 -- 172.21.15.60:0/4017628610 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdad400ba50 con 0x7fdadc0b5950 2020-10-31T22:49:49.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdad3fff700 1 -- 172.21.15.60:0/4017628610 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad400bbb0 con 0x7fdadc0b5950 2020-10-31T22:49:49.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdad3fff700 1 -- 172.21.15.60:0/4017628610 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdad400bd20 con 0x7fdadc0b5950 2020-10-31T22:49:49.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae22df700 1 -- 172.21.15.60:0/4017628610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0b5950 msgr2=0x7fdadc142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:49.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae22df700 1 --2- 172.21.15.60:0/4017628610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0b5950 0x7fdadc142610 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 rx=0x7fdad40032b0 tx=0x7fdad40091a0).stop 2020-10-31T22:49:49.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae22df700 1 -- 172.21.15.60:0/4017628610 shutdown_connections 2020-10-31T22:49:49.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae22df700 1 --2- 172.21.15.60:0/4017628610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0b5950 0x7fdadc142610 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:49.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae22df700 1 -- 172.21.15.60:0/4017628610 >> 172.21.15.60:0/4017628610 conn(0x7fdadc0b8e90 msgr2=0x7fdadc0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:49.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae22df700 1 -- 172.21.15.60:0/4017628610 shutdown_connections 2020-10-31T22:49:49.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.177+0000 7fdae22df700 1 -- 172.21.15.60:0/4017628610 wait complete. 2020-10-31T22:49:49.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.181+0000 7fdae22df700 1 Processor -- start 2020-10-31T22:49:49.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.181+0000 7fdae22df700 1 -- start start 2020-10-31T22:49:49.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.181+0000 7fdae22df700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdadc0b24a0 0x7fdadc143480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:49.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.181+0000 7fdae22df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0b5570 0x7fdadc143c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:49.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.181+0000 7fdae22df700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdadc0b5950 0x7fdadc0adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:49.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.181+0000 7fdae22df700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc1541c0 con 0x7fdadc0b5570 2020-10-31T22:49:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.181+0000 7fdae22df700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc154460 con 0x7fdadc0b5950 2020-10-31T22:49:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.181+0000 7fdae22df700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc154700 con 0x7fdadc0b24a0 2020-10-31T22:49:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.181+0000 7fdae0adc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0b5570 0x7fdadc143c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.181+0000 7fdae0adc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0b5570 0x7fdadc143c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48330/0 (socket says 172.21.15.60:48330) 2020-10-31T22:49:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.181+0000 7fdae0adc700 1 -- 172.21.15.60:0/112136299 learned_addr learned my addr 172.21.15.60:0/112136299 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:49.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.181+0000 7fdae12dd700 1 --2- 172.21.15.60:0/112136299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdadc0b24a0 0x7fdadc143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:49.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.181+0000 7fdae1ade700 1 --2- 172.21.15.60:0/112136299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdadc0b5950 0x7fdadc0adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:49.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.185+0000 7fdae0adc700 1 -- 172.21.15.60:0/112136299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdadc0b24a0 msgr2=0x7fdadc143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:49.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.185+0000 7fdae0adc700 1 --2- 172.21.15.60:0/112136299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdadc0b24a0 0x7fdadc143480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:49.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.185+0000 7fdae0adc700 1 -- 172.21.15.60:0/112136299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdadc0b5950 msgr2=0x7fdadc0adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:49.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.185+0000 7fdae0adc700 1 --2- 172.21.15.60:0/112136299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdadc0b5950 0x7fdadc0adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:49.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.185+0000 7fdae0adc700 1 -- 172.21.15.60:0/112136299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc1549a0 con 0x7fdadc0b5570 2020-10-31T22:49:49.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.185+0000 7fdae0adc700 1 --2- 172.21.15.60:0/112136299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0b5570 0x7fdadc143c60 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fdadc0610d0 tx=0x7fdacc007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:49.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.185+0000 7fdad27fc700 1 -- 172.21.15.60:0/112136299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdacc00f470 con 0x7fdadc0b5570 2020-10-31T22:49:49.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.185+0000 7fdad27fc700 1 -- 172.21.15.60:0/112136299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc00f5d0 con 0x7fdadc0b5570 2020-10-31T22:49:49.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.185+0000 7fdad27fc700 1 -- 172.21.15.60:0/112136299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdacc00f930 con 0x7fdadc0b5570 2020-10-31T22:49:49.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.185+0000 7fdae22df700 1 -- 172.21.15.60:0/112136299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc154e40 con 0x7fdadc0b5570 2020-10-31T22:49:49.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.185+0000 7fdae22df700 1 -- 172.21.15.60:0/112136299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc0ac3f0 con 0x7fdadc0b5570 2020-10-31T22:49:49.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.185+0000 7fdae22df700 1 -- 172.21.15.60:0/112136299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc154b30 con 0x7fdadc0b5570 2020-10-31T22:49:49.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.185+0000 7fdad27fc700 1 -- 172.21.15.60:0/112136299 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fdacc019030 con 0x7fdadc0b5570 2020-10-31T22:49:49.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.189+0000 7fdad27fc700 1 --2- 172.21.15.60:0/112136299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdac4055020 0x7fdac40574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:49.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.189+0000 7fdad27fc700 1 -- 172.21.15.60:0/112136299 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fdacc06cea0 con 0x7fdadc0b5570 2020-10-31T22:49:49.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.189+0000 7fdae12dd700 1 --2- 172.21.15.60:0/112136299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdac4055020 0x7fdac40574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:49.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.189+0000 7fdae12dd700 1 --2- 172.21.15.60:0/112136299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdac4055020 0x7fdac40574e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fdad800d000 tx=0x7fdad8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:49.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.193+0000 7fdad27fc700 1 -- 172.21.15.60:0/112136299 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdacc043370 con 0x7fdadc0b5570 2020-10-31T22:49:49.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:49.337+0000 7fdae22df700 1 -- 172.21.15.60:0/112136299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdadc057100 con 0x7fdadc0b5570 2020-10-31T22:49:50.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.033+0000 7fdad27fc700 1 -- 172.21.15.60:0/112136299 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v124) v1 ==== 185+0+0 (secure 0 0 0) 0x7fdacc046990 con 0x7fdadc0b5570 2020-10-31T22:49:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.037+0000 7fdae22df700 1 -- 172.21.15.60:0/112136299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdac4055020 msgr2=0x7fdac40574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:50.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.037+0000 7fdae22df700 1 --2- 172.21.15.60:0/112136299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdac4055020 0x7fdac40574e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fdad800d000 tx=0x7fdad8009040).stop 2020-10-31T22:49:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.037+0000 7fdae22df700 1 -- 172.21.15.60:0/112136299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0b5570 msgr2=0x7fdadc143c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.037+0000 7fdae22df700 1 --2- 172.21.15.60:0/112136299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0b5570 0x7fdadc143c60 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 rx=0x7fdadc0610d0 tx=0x7fdacc007c20).stop 2020-10-31T22:49:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.037+0000 7fdae22df700 1 -- 172.21.15.60:0/112136299 shutdown_connections 2020-10-31T22:49:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.041+0000 7fdae22df700 1 --2- 172.21.15.60:0/112136299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdac4055020 0x7fdac40574e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:50.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.041+0000 7fdae22df700 1 --2- 172.21.15.60:0/112136299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdadc0b5950 0x7fdadc0adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:50.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.041+0000 7fdae22df700 1 --2- 172.21.15.60:0/112136299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdadc0b24a0 0x7fdadc143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:50.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.041+0000 7fdae22df700 1 --2- 172.21.15.60:0/112136299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdadc0b5570 0x7fdadc143c60 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:50.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.041+0000 7fdae22df700 1 -- 172.21.15.60:0/112136299 >> 172.21.15.60:0/112136299 conn(0x7fdadc0b8e90 msgr2=0x7fdadc0b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:50.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.041+0000 7fdae22df700 1 -- 172.21.15.60:0/112136299 shutdown_connections 2020-10-31T22:49:50.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.041+0000 7fdae22df700 1 -- 172.21.15.60:0/112136299 wait complete. 2020-10-31T22:49:50.047 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:49:50.063 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:49:50.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.181+0000 7f7c79af5700 1 Processor -- start 2020-10-31T22:49:50.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.181+0000 7f7c79af5700 1 -- start start 2020-10-31T22:49:50.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.181+0000 7f7c79af5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7c740b52a0 0x7f7c74141d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:50.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.181+0000 7f7c79af5700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7c740af400 0x7f7c740adf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:50.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.181+0000 7f7c79af5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7406a8f0 con 0x7f7c7405c8a0 2020-10-31T22:49:50.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.181+0000 7f7c79af5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7405c4f0 con 0x7f7c740b52a0 2020-10-31T22:49:50.188 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.181+0000 7f7c79af5700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7405b160 con 0x7f7c740af400 2020-10-31T22:49:50.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.181+0000 7f7c737fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7c740b52a0 0x7f7c74141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:50.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.181+0000 7f7c72ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7c7405c8a0 0x7f7c7405bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52474/0 (socket says 172.21.15.60:52474) 2020-10-31T22:49:50.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.181+0000 7f7c737fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7c740b52a0 0x7f7c74141d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48336/0 (socket says 172.21.15.60:48336) 2020-10-31T22:49:50.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.181+0000 7f7c72ffd700 1 -- 172.21.15.60:0/3976551835 learned_addr learned my addr 172.21.15.60:0/3976551835 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:50.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.181+0000 7f7c73fff700 1 --2- 172.21.15.60:0/3976551835 >> v2:172.21.15.66:3300/0 conn(0x7f7c740af400 0x7f7c740adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:50.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c737fe700 1 -- 172.21.15.60:0/3976551835 >> v2:172.21.15.66:3300/0 conn(0x7f7c740af400 msgr2=0x7f7c740adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:50.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c737fe700 1 --2- 172.21.15.60:0/3976551835 >> v2:172.21.15.66:3300/0 conn(0x7f7c740af400 0x7f7c740adf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:50.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c737fe700 1 -- 172.21.15.60:0/3976551835 >> v1:172.21.15.60:6789/0 conn(0x7f7c7405c8a0 legacy=0x7f7c7405bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:50.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c737fe700 1 -- 172.21.15.60:0/3976551835 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7405b400 con 0x7f7c740b52a0 2020-10-31T22:49:50.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c737fe700 1 --2- 172.21.15.60:0/3976551835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c740b52a0 0x7f7c74141d50 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f7c5c002f30 tx=0x7f7c5c006dc0).ready entity=mon.0 client_cookie=7964bdf124534113 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:50.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c727fc700 1 -- 172.21.15.60:0/3976551835 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c5c0097b0 con 0x7f7c740b52a0 2020-10-31T22:49:50.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c727fc700 1 -- 172.21.15.60:0/3976551835 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c009910 con 0x7f7c740b52a0 2020-10-31T22:49:50.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c727fc700 1 -- 172.21.15.60:0/3976551835 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c5c009c70 con 0x7f7c740b52a0 2020-10-31T22:49:50.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 -- 172.21.15.60:0/3976551835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c740b52a0 msgr2=0x7f7c74141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:50.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 --2- 172.21.15.60:0/3976551835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c740b52a0 0x7f7c74141d50 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 rx=0x7f7c5c002f30 tx=0x7f7c5c006dc0).stop 2020-10-31T22:49:50.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 -- 172.21.15.60:0/3976551835 shutdown_connections 2020-10-31T22:49:50.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 --2- 172.21.15.60:0/3976551835 >> v2:172.21.15.66:3300/0 conn(0x7f7c740af400 0x7f7c740adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:50.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 --2- 172.21.15.60:0/3976551835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c740b52a0 0x7f7c74141d50 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:50.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 -- 172.21.15.60:0/3976551835 >> 172.21.15.60:0/3976551835 conn(0x7f7c74060c50 msgr2=0x7f7c740b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:50.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 -- 172.21.15.60:0/3976551835 shutdown_connections 2020-10-31T22:49:50.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 -- 172.21.15.60:0/3976551835 wait complete. 2020-10-31T22:49:50.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 Processor -- start 2020-10-31T22:49:50.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 -- start start 2020-10-31T22:49:50.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c7405c8a0 0x7f7c74140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:50.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c740af400 0x7f7c74154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:50.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c740b52a0 0x7f7c74154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:50.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c74144a60 con 0x7f7c740af400 2020-10-31T22:49:50.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c740a0430 con 0x7f7c740b52a0 2020-10-31T22:49:50.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c79af5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7409fa50 con 0x7f7c7405c8a0 2020-10-31T22:49:50.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c72ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c740af400 0x7f7c74154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:50.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c72ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c740af400 0x7f7c74154360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48344/0 (socket says 172.21.15.60:48344) 2020-10-31T22:49:50.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c72ffd700 1 -- 172.21.15.60:0/2670631375 learned_addr learned my addr 172.21.15.60:0/2670631375 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:50.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c73fff700 1 --2- 172.21.15.60:0/2670631375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c740b52a0 0x7f7c74154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:50.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.185+0000 7f7c737fe700 1 --2- 172.21.15.60:0/2670631375 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c7405c8a0 0x7f7c74140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:50.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c72ffd700 1 -- 172.21.15.60:0/2670631375 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c7405c8a0 msgr2=0x7f7c74140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:50.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c72ffd700 1 --2- 172.21.15.60:0/2670631375 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c7405c8a0 0x7f7c74140ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:50.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c72ffd700 1 -- 172.21.15.60:0/2670631375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c740b52a0 msgr2=0x7f7c74154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:50.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c72ffd700 1 --2- 172.21.15.60:0/2670631375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c740b52a0 0x7f7c74154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:50.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c72ffd700 1 -- 172.21.15.60:0/2670631375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7409fcf0 con 0x7f7c740af400 2020-10-31T22:49:50.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c72ffd700 1 --2- 172.21.15.60:0/2670631375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c740af400 0x7f7c74154360 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f7c740ac090 tx=0x7f7c64007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:50.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c70ff9700 1 -- 172.21.15.60:0/2670631375 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c640072e0 con 0x7f7c740af400 2020-10-31T22:49:50.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c70ff9700 1 -- 172.21.15.60:0/2670631375 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c64007440 con 0x7f7c740af400 2020-10-31T22:49:50.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c79af5700 1 -- 172.21.15.60:0/2670631375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7409ff90 con 0x7f7c740af400 2020-10-31T22:49:50.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c70ff9700 1 -- 172.21.15.60:0/2670631375 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7c640057d0 con 0x7f7c740af400 2020-10-31T22:49:50.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c79af5700 1 -- 172.21.15.60:0/2670631375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c74154d40 con 0x7f7c740af400 2020-10-31T22:49:50.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c79af5700 1 -- 172.21.15.60:0/2670631375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c740a0120 con 0x7f7c740af400 2020-10-31T22:49:50.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c70ff9700 1 -- 172.21.15.60:0/2670631375 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7c6401a060 con 0x7f7c740af400 2020-10-31T22:49:50.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c70ff9700 1 --2- 172.21.15.60:0/2670631375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7c58054f90 0x7f7c58057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:50.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c70ff9700 1 -- 172.21.15.60:0/2670631375 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f7c6406c9e0 con 0x7f7c740af400 2020-10-31T22:49:50.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c737fe700 1 --2- 172.21.15.60:0/2670631375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7c58054f90 0x7f7c58057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:50.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.189+0000 7f7c737fe700 1 --2- 172.21.15.60:0/2670631375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7c58054f90 0x7f7c58057450 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f7c5c01a000 tx=0x7f7c5c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:50.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.197+0000 7f7c70ff9700 1 -- 172.21.15.60:0/2670631375 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7c64043060 con 0x7f7c740af400 2020-10-31T22:49:50.344 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:50.337+0000 7f7c79af5700 1 -- 172.21.15.60:0/2670631375 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f7c7406a8f0 con 0x7f7c740af400 2020-10-31T22:49:51.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:51.045+0000 7f7c70ff9700 1 -- 172.21.15.60:0/2670631375 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v125) v1 ==== 133+0+0 (secure 0 0 0) 0x7f7c7406a8f0 con 0x7f7c740af400 2020-10-31T22:49:51.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:51.053+0000 7f7c79af5700 1 -- 172.21.15.60:0/2670631375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7c58054f90 msgr2=0x7f7c58057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:51.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:51.053+0000 7f7c79af5700 1 --2- 172.21.15.60:0/2670631375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7c58054f90 0x7f7c58057450 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f7c5c01a000 tx=0x7f7c5c015000).stop 2020-10-31T22:49:51.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:51.053+0000 7f7c79af5700 1 -- 172.21.15.60:0/2670631375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c740af400 msgr2=0x7f7c74154360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:51.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:51.053+0000 7f7c79af5700 1 --2- 172.21.15.60:0/2670631375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c740af400 0x7f7c74154360 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 rx=0x7f7c740ac090 tx=0x7f7c64007b80).stop 2020-10-31T22:49:51.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:51.053+0000 7f7c79af5700 1 -- 172.21.15.60:0/2670631375 shutdown_connections 2020-10-31T22:49:51.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:51.053+0000 7f7c79af5700 1 --2- 172.21.15.60:0/2670631375 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7c58054f90 0x7f7c58057450 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:51.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:51.053+0000 7f7c79af5700 1 --2- 172.21.15.60:0/2670631375 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c740b52a0 0x7f7c74154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:51.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:51.053+0000 7f7c79af5700 1 --2- 172.21.15.60:0/2670631375 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7c7405c8a0 0x7f7c74140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:51.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:51.053+0000 7f7c79af5700 1 --2- 172.21.15.60:0/2670631375 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c740af400 0x7f7c74154360 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:51.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:51.053+0000 7f7c79af5700 1 -- 172.21.15.60:0/2670631375 >> 172.21.15.60:0/2670631375 conn(0x7f7c74060c50 msgr2=0x7f7c740ada70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:51.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:51.053+0000 7f7c79af5700 1 -- 172.21.15.60:0/2670631375 shutdown_connections 2020-10-31T22:49:51.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:51.053+0000 7f7c79af5700 1 -- 172.21.15.60:0/2670631375 wait complete. 2020-10-31T22:49:51.063 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:49:51.072 INFO:teuthology.orchestra.run.smithi152:> sudo rados -p cephfs_metadata put key /etc/fstab 2020-10-31T22:49:51.114 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.110+0000 7fa341ff3c00 1 Processor -- start 2020-10-31T22:49:51.115 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.110+0000 7fa341ff3c00 1 -- start start 2020-10-31T22:49:51.115 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.110+0000 7fa341ff3c00 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56026c0fea80 0x56026c10d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:51.115 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.110+0000 7fa341ff3c00 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x56026c0ff420 0x56026c10de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:51.122 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.110+0000 7fa341ff3c00 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56026c104d90 0x56026c107a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:51.123 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.110+0000 7fa341ff3c00 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026c0002f0 con 0x56026c104d90 2020-10-31T22:49:51.123 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.110+0000 7fa341ff3c00 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026bff1450 con 0x56026c0fea80 2020-10-31T22:49:51.123 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.110+0000 7fa341ff3c00 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x56026c108240 con 0x56026c0ff420 2020-10-31T22:49:51.123 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.110+0000 7fa3346ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56026c104d90 0x56026c107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:51.124 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.110+0000 7fa3336ed700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x56026c0ff420 0x56026c10de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:51.124 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.110+0000 7fa333eee700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56026c0fea80 0x56026c10d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:51.124 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.110+0000 7fa3346ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56026c104d90 0x56026c107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.152:60254/0 (socket says 172.21.15.152:60254) 2020-10-31T22:49:51.124 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.110+0000 7fa3346ef700 1 -- 172.21.15.152:0/3942931258 learned_addr learned my addr 172.21.15.152:0/3942931258 (peer_addr_for_me v2:172.21.15.152:0/0) 2020-10-31T22:49:51.124 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa3336ed700 1 -- 172.21.15.152:0/3942931258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56026c0fea80 msgr2=0x56026c10d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:51.124 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa3336ed700 1 --2- 172.21.15.152:0/3942931258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56026c0fea80 0x56026c10d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:51.124 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa3336ed700 1 -- 172.21.15.152:0/3942931258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56026c104d90 msgr2=0x56026c107a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:51.125 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa3336ed700 1 --2- 172.21.15.152:0/3942931258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56026c104d90 0x56026c107a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:51.125 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa3336ed700 1 -- 172.21.15.152:0/3942931258 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56026c0145e0 con 0x56026c0ff420 2020-10-31T22:49:51.125 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa3346ef700 1 --2- 172.21.15.152:0/3942931258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56026c104d90 0x56026c107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:51.125 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa3336ed700 1 --2- 172.21.15.152:0/3942931258 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x56026c0ff420 0x56026c10de30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fa324002f30 tx=0x7fa324013000).ready entity=mon.2 client_cookie=b988c964a09bb1b3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:51.125 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa331eea700 1 -- 172.21.15.152:0/3942931258 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa32401e670 con 0x56026c0ff420 2020-10-31T22:49:51.125 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa331eea700 1 -- 172.21.15.152:0/3942931258 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32401e7d0 con 0x56026c0ff420 2020-10-31T22:49:51.125 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa331eea700 1 -- 172.21.15.152:0/3942931258 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa32401eb30 con 0x56026c0ff420 2020-10-31T22:49:51.126 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3942931258 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x56026c0ff420 msgr2=0x56026c10de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:51.126 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 --2- 172.21.15.152:0/3942931258 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x56026c0ff420 0x56026c10de30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fa324002f30 tx=0x7fa324013000).stop 2020-10-31T22:49:51.126 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3942931258 shutdown_connections 2020-10-31T22:49:51.126 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 --2- 172.21.15.152:0/3942931258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56026c104d90 0x56026c107a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:51.126 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 --2- 172.21.15.152:0/3942931258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56026c0fea80 0x56026c10d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:51.126 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 --2- 172.21.15.152:0/3942931258 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x56026c0ff420 0x56026c10de30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:51.126 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3942931258 >> 172.21.15.152:0/3942931258 conn(0x56026c0724f0 msgr2=0x56026c103fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:51.127 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3942931258 shutdown_connections 2020-10-31T22:49:51.127 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3942931258 wait complete. 2020-10-31T22:49:51.127 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 Processor -- start 2020-10-31T22:49:51.127 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 -- start start 2020-10-31T22:49:51.127 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x56026c0fea80 0x56026c114440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:51.127 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56026c0ff420 0x56026c114a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:51.127 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56026c104d90 0x56026c10e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:51.128 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026c108b00 con 0x56026c0ff420 2020-10-31T22:49:51.128 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026c10ed30 con 0x56026c104d90 2020-10-31T22:49:51.128 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa341ff3c00 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x56026c10eef0 con 0x56026c0fea80 2020-10-31T22:49:51.128 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa333eee700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x56026c0fea80 0x56026c114440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:51.128 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa3336ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56026c0ff420 0x56026c114a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:51.128 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa3346ef700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56026c104d90 0x56026c10e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:51.129 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa333eee700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x56026c0fea80 0x56026c114440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.152:47138/0 (socket says 172.21.15.152:47138) 2020-10-31T22:49:51.129 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa3346ef700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56026c104d90 0x56026c10e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.152:39172/0 (socket says 172.21.15.152:39172) 2020-10-31T22:49:51.129 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa3336ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56026c0ff420 0x56026c114a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.152:60258/0 (socket says 172.21.15.152:60258) 2020-10-31T22:49:51.129 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.114+0000 7fa333eee700 1 -- 172.21.15.152:0/3487904706 learned_addr learned my addr 172.21.15.152:0/3487904706 (peer_addr_for_me v2:172.21.15.152:0/0) 2020-10-31T22:49:51.130 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.118+0000 7fa3336ed700 1 -- 172.21.15.152:0/3487904706 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x56026c0fea80 msgr2=0x56026c114440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:51.130 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.118+0000 7fa3336ed700 1 --2- 172.21.15.152:0/3487904706 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x56026c0fea80 0x56026c114440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:51.130 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.118+0000 7fa3336ed700 1 -- 172.21.15.152:0/3487904706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56026c104d90 msgr2=0x56026c10e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:51.130 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.118+0000 7fa3336ed700 1 --2- 172.21.15.152:0/3487904706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56026c104d90 0x56026c10e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:51.130 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.118+0000 7fa3336ed700 1 -- 172.21.15.152:0/3487904706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56026bfea1e0 con 0x56026c0ff420 2020-10-31T22:49:51.130 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.118+0000 7fa3346ef700 1 --2- 172.21.15.152:0/3487904706 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x56026c104d90 0x56026c10e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:51.131 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.118+0000 7fa333eee700 1 --2- 172.21.15.152:0/3487904706 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x56026c0fea80 0x56026c114440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:49:51.131 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.118+0000 7fa3336ed700 1 --2- 172.21.15.152:0/3487904706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56026c0ff420 0x56026c114a60 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7fa324002f30 tx=0x7fa32401c000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:51.131 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.118+0000 7fa3316e9700 1 -- 172.21.15.152:0/3487904706 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa324027400 con 0x56026c0ff420 2020-10-31T22:49:51.131 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.118+0000 7fa3316e9700 1 -- 172.21.15.152:0/3487904706 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa324027560 con 0x56026c0ff420 2020-10-31T22:49:51.131 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.118+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3487904706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56026c10f110 con 0x56026c0ff420 2020-10-31T22:49:51.131 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.118+0000 7fa3316e9700 1 -- 172.21.15.152:0/3487904706 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa3240278c0 con 0x56026c0ff420 2020-10-31T22:49:51.131 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.118+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3487904706 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56026c11b250 con 0x56026c0ff420 2020-10-31T22:49:51.132 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.118+0000 7fa3316e9700 1 -- 172.21.15.152:0/3487904706 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa324030450 con 0x56026c0ff420 2020-10-31T22:49:51.133 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.122+0000 7fa3316e9700 1 --2- 172.21.15.152:0/3487904706 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa318053c10 0x7fa3180560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:51.133 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.122+0000 7fa3316e9700 1 -- 172.21.15.152:0/3487904706 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6075+0+0 (secure 0 0 0) 0x7fa32400ae40 con 0x56026c0ff420 2020-10-31T22:49:51.133 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.122+0000 7fa341ff3c00 1 --2- 172.21.15.152:0/3487904706 >> [v2:172.21.15.60:6802/14302,v1:172.21.15.60:6803/14302] conn(0x56026c11bf50 0x56026c11e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:51.134 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.122+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3487904706 --> [v2:172.21.15.60:6802/14302,v1:172.21.15.60:6803/14302] -- osd_op(unknown.0.0:1 23.0 23:0620e6f9:::key:head [writefull 0~617 in=617b] snapc 0=[] ondisk+write+known_if_redirected e125) v8 -- 0x56026c11e830 con 0x56026c11bf50 2020-10-31T22:49:51.134 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.122+0000 7fa333eee700 1 --2- 172.21.15.152:0/3487904706 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa318053c10 0x7fa3180560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:51.134 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.122+0000 7fa3346ef700 1 --2- 172.21.15.152:0/3487904706 >> [v2:172.21.15.60:6802/14302,v1:172.21.15.60:6803/14302] conn(0x56026c11bf50 0x56026c11e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:51.134 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.122+0000 7fa333eee700 1 --2- 172.21.15.152:0/3487904706 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa318053c10 0x7fa3180560d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fa31c00a000 tx=0x7fa31c00c040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:51.135 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:51.122+0000 7fa3346ef700 1 --2- 172.21.15.152:0/3487904706 >> [v2:172.21.15.60:6802/14302,v1:172.21.15.60:6803/14302] conn(0x56026c11bf50 0x56026c11e340 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:52.073 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:52.070+0000 7fa3316e9700 1 -- 172.21.15.152:0/3487904706 <== osd.0 v2:172.21.15.60:6802/14302 1 ==== osd_map(126..126 src has 1..126) v4 ==== 320+0+0 (crc 0 0 0) 0x7fa32c001e70 con 0x56026c11bf50 2020-10-31T22:49:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:52.070+0000 7fa3346ef700 1 -- 172.21.15.152:0/3487904706 <== osd.0 v2:172.21.15.60:6802/14302 2 ==== osd_op_reply(1 key [writefull 0~617] v126'1 uv1 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7fa32c0102b0 con 0x56026c11bf50 2020-10-31T22:49:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:52.074+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3487904706 >> [v2:172.21.15.60:6802/14302,v1:172.21.15.60:6803/14302] conn(0x56026c11bf50 msgr2=0x56026c11e340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:52.074+0000 7fa341ff3c00 1 --2- 172.21.15.152:0/3487904706 >> [v2:172.21.15.60:6802/14302,v1:172.21.15.60:6803/14302] conn(0x56026c11bf50 0x56026c11e340 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:52.076 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:52.074+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3487904706 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa318053c10 msgr2=0x7fa3180560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:52.076 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:52.074+0000 7fa341ff3c00 1 --2- 172.21.15.152:0/3487904706 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa318053c10 0x7fa3180560d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7fa31c00a000 tx=0x7fa31c00c040).stop 2020-10-31T22:49:52.076 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:52.074+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3487904706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56026c0ff420 msgr2=0x56026c114a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:52.076 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:52.074+0000 7fa341ff3c00 1 --2- 172.21.15.152:0/3487904706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56026c0ff420 0x56026c114a60 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 rx=0x7fa324002f30 tx=0x7fa32401c000).stop 2020-10-31T22:49:52.076 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:52.074+0000 7fa3346ef700 1 -- 172.21.15.152:0/3487904706 reap_dead start 2020-10-31T22:49:52.077 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:52.074+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3487904706 shutdown_connections 2020-10-31T22:49:52.077 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:52.074+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3487904706 >> 172.21.15.152:0/3487904706 conn(0x56026c0724f0 msgr2=0x56026c101640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:52.077 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:52.074+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3487904706 shutdown_connections 2020-10-31T22:49:52.078 INFO:teuthology.orchestra.run.smithi152.stderr:2020-10-31T22:49:52.074+0000 7fa341ff3c00 1 -- 172.21.15.152:0/3487904706 wait complete. 2020-10-31T22:49:52.080 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2020-10-31T22:49:52.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b25dce700 1 Processor -- start 2020-10-31T22:49:52.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b25dce700 1 -- start start 2020-10-31T22:49:52.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b25dce700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4b200b5570 0x7f4b200b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:52.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b25dce700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b20145180 con 0x7f4b20141fe0 2020-10-31T22:49:52.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b25dce700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b200b0670 con 0x7f4b200b24a0 2020-10-31T22:49:52.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b25dce700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b200afae0 con 0x7f4b200b5570 2020-10-31T22:49:52.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b24dcc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4b200b5570 0x7f4b200b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:52.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b24dcc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4b200b5570 0x7f4b200b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48350/0 (socket says 172.21.15.60:48350) 2020-10-31T22:49:52.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b24dcc700 1 -- 172.21.15.60:0/2180776015 learned_addr learned my addr 172.21.15.60:0/2180776015 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:52.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b24dcc700 1 -- 172.21.15.60:0/2180776015 >> v1:172.21.15.66:6789/0 conn(0x7f4b200b24a0 legacy=0x7f4b20145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:52.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b24dcc700 1 -- 172.21.15.60:0/2180776015 >> v1:172.21.15.60:6789/0 conn(0x7f4b20141fe0 legacy=0x7f4b20142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:52.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b24dcc700 1 -- 172.21.15.60:0/2180776015 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b200b0910 con 0x7f4b200b5570 2020-10-31T22:49:52.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b24dcc700 1 --2- 172.21.15.60:0/2180776015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b200b5570 0x7f4b200b5950 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f4b2005f580 tx=0x7f4b18009270).ready entity=mon.0 client_cookie=4d541af3641bbace server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:52.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b1f7fe700 1 -- 172.21.15.60:0/2180776015 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1800bb80 con 0x7f4b200b5570 2020-10-31T22:49:52.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b1f7fe700 1 -- 172.21.15.60:0/2180776015 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1800bce0 con 0x7f4b200b5570 2020-10-31T22:49:52.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b25dce700 1 -- 172.21.15.60:0/2180776015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b200b5570 msgr2=0x7f4b200b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:52.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b1f7fe700 1 -- 172.21.15.60:0/2180776015 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1800be50 con 0x7f4b200b5570 2020-10-31T22:49:52.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b25dce700 1 --2- 172.21.15.60:0/2180776015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b200b5570 0x7f4b200b5950 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 rx=0x7f4b2005f580 tx=0x7f4b18009270).stop 2020-10-31T22:49:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b25dce700 1 -- 172.21.15.60:0/2180776015 shutdown_connections 2020-10-31T22:49:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b25dce700 1 --2- 172.21.15.60:0/2180776015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b200b5570 0x7f4b200b5950 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b25dce700 1 -- 172.21.15.60:0/2180776015 >> 172.21.15.60:0/2180776015 conn(0x7f4b200b8e90 msgr2=0x7f4b200b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b25dce700 1 -- 172.21.15.60:0/2180776015 shutdown_connections 2020-10-31T22:49:52.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.185+0000 7f4b25dce700 1 -- 172.21.15.60:0/2180776015 wait complete. 2020-10-31T22:49:52.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b25dce700 1 Processor -- start 2020-10-31T22:49:52.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b25dce700 1 -- start start 2020-10-31T22:49:52.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b25dce700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b200b24a0 0x7f4b200b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:52.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b25dce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b200b5570 0x7f4b200ac590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:52.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b25dce700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b20141fe0 0x7f4b2013c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b25dce700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200b6a00 con 0x7f4b200b5570 2020-10-31T22:49:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b25dce700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200adb10 con 0x7f4b200b24a0 2020-10-31T22:49:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b25dce700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b200b7680 con 0x7f4b20141fe0 2020-10-31T22:49:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b200b5570 0x7f4b200ac590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b200b5570 0x7f4b200ac590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48360/0 (socket says 172.21.15.60:48360) 2020-10-31T22:49:52.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b24dcc700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b200b24a0 0x7f4b200b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:52.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b1ffff700 1 -- 172.21.15.60:0/4017514790 learned_addr learned my addr 172.21.15.60:0/4017514790 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:52.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b255cd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b20141fe0 0x7f4b2013c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:52.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b1ffff700 1 -- 172.21.15.60:0/4017514790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b20141fe0 msgr2=0x7f4b2013c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b1ffff700 1 --2- 172.21.15.60:0/4017514790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b20141fe0 0x7f4b2013c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b1ffff700 1 -- 172.21.15.60:0/4017514790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b200b24a0 msgr2=0x7f4b200b7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:52.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b1ffff700 1 --2- 172.21.15.60:0/4017514790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b200b24a0 0x7f4b200b7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:52.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b1ffff700 1 -- 172.21.15.60:0/4017514790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b200add40 con 0x7f4b200b5570 2020-10-31T22:49:52.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b1ffff700 1 --2- 172.21.15.60:0/4017514790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b200b5570 0x7f4b200ac590 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f4b14000b80 tx=0x7f4b14007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:52.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b1dffb700 1 -- 172.21.15.60:0/4017514790 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1400e4a0 con 0x7f4b200b5570 2020-10-31T22:49:52.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b1dffb700 1 -- 172.21.15.60:0/4017514790 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1400e600 con 0x7f4b200b5570 2020-10-31T22:49:52.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b25dce700 1 -- 172.21.15.60:0/4017514790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b200adfe0 con 0x7f4b200b5570 2020-10-31T22:49:52.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b1dffb700 1 -- 172.21.15.60:0/4017514790 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4b1400e770 con 0x7f4b200b5570 2020-10-31T22:49:52.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.189+0000 7f4b25dce700 1 -- 172.21.15.60:0/4017514790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b200ae480 con 0x7f4b200b5570 2020-10-31T22:49:52.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.193+0000 7f4b25dce700 1 -- 172.21.15.60:0/4017514790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b200b74a0 con 0x7f4b200b5570 2020-10-31T22:49:52.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.193+0000 7f4b1dffb700 1 -- 172.21.15.60:0/4017514790 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4b14010030 con 0x7f4b200b5570 2020-10-31T22:49:52.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.193+0000 7f4b1dffb700 1 --2- 172.21.15.60:0/4017514790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4b00055020 0x7f4b000574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:52.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.193+0000 7f4b1dffb700 1 -- 172.21.15.60:0/4017514790 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f4b1406d1e0 con 0x7f4b200b5570 2020-10-31T22:49:52.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.193+0000 7f4b24dcc700 1 --2- 172.21.15.60:0/4017514790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4b00055020 0x7f4b000574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:52.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.193+0000 7f4b24dcc700 1 --2- 172.21.15.60:0/4017514790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4b00055020 0x7f4b000574e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f4b1801a000 tx=0x7f4b18016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:52.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.201+0000 7f4b1dffb700 1 -- 172.21.15.60:0/4017514790 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4b14043700 con 0x7f4b200b5570 2020-10-31T22:49:52.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.389+0000 7f4b25dce700 1 -- 172.21.15.60:0/4017514790 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f4b20057100 con 0x7f4b200b5570 2020-10-31T22:49:52.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.393+0000 7f4b1dffb700 1 -- 172.21.15.60:0/4017514790 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1588 (secure 0 0 0) 0x7f4b14046d20 con 0x7f4b200b5570 2020-10-31T22:49:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:52.399 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:49:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2020-10-31T22:49:52.399 INFO:teuthology.orchestra.run.smithi060.stdout: "total_bytes": 773094113280, 2020-10-31T22:49:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "total_avail_bytes": 764491988992, 2020-10-31T22:49:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_bytes": 12189696, 2020-10-31T22:49:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_bytes": 8602124288, 2020-10-31T22:49:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_ratio": 0.011126878671348095, 2020-10-31T22:49:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "num_osds": 8, 2020-10-31T22:49:52.400 INFO:teuthology.orchestra.run.smithi060.stdout: "num_per_pool_osds": 8, 2020-10-31T22:49:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "num_per_pool_omap_osds": 8 2020-10-31T22:49:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "stats_by_class": { 2020-10-31T22:49:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "ssd": { 2020-10-31T22:49:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "total_bytes": 773094113280, 2020-10-31T22:49:52.401 INFO:teuthology.orchestra.run.smithi060.stdout: "total_avail_bytes": 764491988992, 2020-10-31T22:49:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_bytes": 12189696, 2020-10-31T22:49:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_bytes": 8602124288, 2020-10-31T22:49:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_ratio": 0.011126878671348095 2020-10-31T22:49:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:52.402 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:49:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_health_metrics", 2020-10-31T22:49:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1, 2020-10-31T22:49:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2020-10-31T22:49:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "stored": 0, 2020-10-31T22:49:52.403 INFO:teuthology.orchestra.run.smithi060.stdout: "objects": 2, 2020-10-31T22:49:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "kb_used": 0, 2020-10-31T22:49:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes_used": 0, 2020-10-31T22:49:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "percent_used": 0, 2020-10-31T22:49:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: "max_avail": 362918543360 2020-10-31T22:49:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:52.405 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd", 2020-10-31T22:49:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2, 2020-10-31T22:49:52.406 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2020-10-31T22:49:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "stored": 0, 2020-10-31T22:49:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "objects": 0, 2020-10-31T22:49:52.407 INFO:teuthology.orchestra.run.smithi060.stdout: "kb_used": 0, 2020-10-31T22:49:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes_used": 0, 2020-10-31T22:49:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "percent_used": 0, 2020-10-31T22:49:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: "max_avail": 362918543360 2020-10-31T22:49:52.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephfs_data", 2020-10-31T22:49:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 22, 2020-10-31T22:49:52.409 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2020-10-31T22:49:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: "stored": 0, 2020-10-31T22:49:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: "objects": 0, 2020-10-31T22:49:52.410 INFO:teuthology.orchestra.run.smithi060.stdout: "kb_used": 0, 2020-10-31T22:49:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes_used": 0, 2020-10-31T22:49:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: "percent_used": 0, 2020-10-31T22:49:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: "max_avail": 362918543360 2020-10-31T22:49:52.411 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:52.412 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:52.412 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:49:52.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.393+0000 7f4b25dce700 1 -- 172.21.15.60:0/4017514790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4b00055020 msgr2=0x7f4b000574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:52.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.393+0000 7f4b25dce700 1 --2- 172.21.15.60:0/4017514790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4b00055020 0x7f4b000574e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7f4b1801a000 tx=0x7f4b18016000).stop 2020-10-31T22:49:52.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.393+0000 7f4b25dce700 1 -- 172.21.15.60:0/4017514790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b200b5570 msgr2=0x7f4b200ac590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:52.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.393+0000 7f4b25dce700 1 --2- 172.21.15.60:0/4017514790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b200b5570 0x7f4b200ac590 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 rx=0x7f4b14000b80 tx=0x7f4b14007c00).stop 2020-10-31T22:49:52.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.393+0000 7f4b25dce700 1 -- 172.21.15.60:0/4017514790 shutdown_connections 2020-10-31T22:49:52.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.393+0000 7f4b25dce700 1 --2- 172.21.15.60:0/4017514790 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4b20141fe0 0x7f4b2013c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:52.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.393+0000 7f4b25dce700 1 --2- 172.21.15.60:0/4017514790 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4b00055020 0x7f4b000574e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:52.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.393+0000 7f4b25dce700 1 --2- 172.21.15.60:0/4017514790 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4b200b24a0 0x7f4b200b7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:52.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.393+0000 7f4b25dce700 1 --2- 172.21.15.60:0/4017514790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b200b5570 0x7f4b200ac590 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:52.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.393+0000 7f4b25dce700 1 -- 172.21.15.60:0/4017514790 >> 172.21.15.60:0/4017514790 conn(0x7f4b200b8e90 msgr2=0x7f4b200b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:52.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.393+0000 7f4b25dce700 1 -- 172.21.15.60:0/4017514790 shutdown_connections 2020-10-31T22:49:52.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:52.393+0000 7f4b25dce700 1 -- 172.21.15.60:0/4017514790 wait complete. 2020-10-31T22:49:52.417 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=30)... 2020-10-31T22:49:57.419 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early df --format=json-pretty 2020-10-31T22:49:57.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e759e700 1 Processor -- start 2020-10-31T22:49:57.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e759e700 1 -- start start 2020-10-31T22:49:57.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30e80b0e20 0x7f30e80ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:57.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f30e80b5060 0x7f30e81412e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:57.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30e80acc50 con 0x7f30e80ac870 2020-10-31T22:49:57.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e80b14c0 con 0x7f30e80b0e20 2020-10-31T22:49:57.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30e80b5470 con 0x7f30e80b5060 2020-10-31T22:49:57.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e5d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30e80b0e20 0x7f30e80ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:57.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e5d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f30e80b0e20 0x7f30e80ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48366/0 (socket says 172.21.15.60:48366) 2020-10-31T22:49:57.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e5d9b700 1 -- 172.21.15.60:0/798644226 learned_addr learned my addr 172.21.15.60:0/798644226 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:57.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e6d9d700 1 --2- 172.21.15.60:0/798644226 >> v2:172.21.15.66:3300/0 conn(0x7f30e80b5060 0x7f30e81412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:57.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e5d9b700 1 -- 172.21.15.60:0/798644226 >> v2:172.21.15.66:3300/0 conn(0x7f30e80b5060 msgr2=0x7f30e81412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:57.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e5d9b700 1 --2- 172.21.15.60:0/798644226 >> v2:172.21.15.66:3300/0 conn(0x7f30e80b5060 0x7f30e81412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:57.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e5d9b700 1 -- 172.21.15.60:0/798644226 >> v1:172.21.15.60:6789/0 conn(0x7f30e80ac870 legacy=0x7f30e80ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:57.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e5d9b700 1 -- 172.21.15.60:0/798644226 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e80b5690 con 0x7f30e80b0e20 2020-10-31T22:49:57.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e6d9d700 1 --2- 172.21.15.60:0/798644226 >> v2:172.21.15.66:3300/0 conn(0x7f30e80b5060 0x7f30e81412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:49:57.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.533+0000 7f30e5d9b700 1 --2- 172.21.15.60:0/798644226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e80b0e20 0x7f30e80ae8b0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f30d0002f30 tx=0x7f30d0006e80).ready entity=mon.0 client_cookie=e7274ee16ebdf0ed server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:57.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e559a700 1 -- 172.21.15.60:0/798644226 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30d00097f0 con 0x7f30e80b0e20 2020-10-31T22:49:57.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e559a700 1 -- 172.21.15.60:0/798644226 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d0009950 con 0x7f30e80b0e20 2020-10-31T22:49:57.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 -- 172.21.15.60:0/798644226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e80b0e20 msgr2=0x7f30e80ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:57.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e559a700 1 -- 172.21.15.60:0/798644226 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30d0009cb0 con 0x7f30e80b0e20 2020-10-31T22:49:57.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 --2- 172.21.15.60:0/798644226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e80b0e20 0x7f30e80ae8b0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 rx=0x7f30d0002f30 tx=0x7f30d0006e80).stop 2020-10-31T22:49:57.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 -- 172.21.15.60:0/798644226 shutdown_connections 2020-10-31T22:49:57.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 --2- 172.21.15.60:0/798644226 >> v2:172.21.15.66:3300/0 conn(0x7f30e80b5060 0x7f30e81412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:57.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 --2- 172.21.15.60:0/798644226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e80b0e20 0x7f30e80ae8b0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:57.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 -- 172.21.15.60:0/798644226 >> 172.21.15.60:0/798644226 conn(0x7f30e806a600 msgr2=0x7f30e8060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:57.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 -- 172.21.15.60:0/798644226 shutdown_connections 2020-10-31T22:49:57.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 -- 172.21.15.60:0/798644226 wait complete. 2020-10-31T22:49:57.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 Processor -- start 2020-10-31T22:49:57.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 -- start start 2020-10-31T22:49:57.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30e80ac870 0x7f30e8135890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:57.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30e80b0e20 0x7f30e80aa630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:57.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e80b5060 0x7f30e80aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:57.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e8136d10 con 0x7f30e80b5060 2020-10-31T22:49:57.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e80a99b0 con 0x7f30e80ac870 2020-10-31T22:49:57.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30e80a9c50 con 0x7f30e80b0e20 2020-10-31T22:49:57.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e80b5060 0x7f30e80aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:57.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e80b5060 0x7f30e80aab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48372/0 (socket says 172.21.15.60:48372) 2020-10-31T22:49:57.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e6d9d700 1 -- 172.21.15.60:0/2421198531 learned_addr learned my addr 172.21.15.60:0/2421198531 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:57.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e5d9b700 1 --2- 172.21.15.60:0/2421198531 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30e80b0e20 0x7f30e80aa630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:57.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e659c700 1 --2- 172.21.15.60:0/2421198531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30e80ac870 0x7f30e8135890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:57.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e6d9d700 1 -- 172.21.15.60:0/2421198531 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30e80b0e20 msgr2=0x7f30e80aa630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e6d9d700 1 --2- 172.21.15.60:0/2421198531 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30e80b0e20 0x7f30e80aa630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e6d9d700 1 -- 172.21.15.60:0/2421198531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30e80ac870 msgr2=0x7f30e8135890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e6d9d700 1 --2- 172.21.15.60:0/2421198531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30e80ac870 0x7f30e8135890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.537+0000 7f30e6d9d700 1 -- 172.21.15.60:0/2421198531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e80a9ef0 con 0x7f30e80b5060 2020-10-31T22:49:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.541+0000 7f30e6d9d700 1 --2- 172.21.15.60:0/2421198531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e80b5060 0x7f30e80aab20 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f30e0006dd0 tx=0x7f30e0008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:57.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.541+0000 7f30df7fe700 1 -- 172.21.15.60:0/2421198531 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e000c870 con 0x7f30e80b5060 2020-10-31T22:49:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.541+0000 7f30df7fe700 1 -- 172.21.15.60:0/2421198531 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e000c9d0 con 0x7f30e80b5060 2020-10-31T22:49:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.541+0000 7f30e759e700 1 -- 172.21.15.60:0/2421198531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e80aa190 con 0x7f30e80b5060 2020-10-31T22:49:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.541+0000 7f30df7fe700 1 -- 172.21.15.60:0/2421198531 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30e000cd30 con 0x7f30e80b5060 2020-10-31T22:49:57.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.541+0000 7f30e759e700 1 -- 172.21.15.60:0/2421198531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e8135d80 con 0x7f30e80b5060 2020-10-31T22:49:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.541+0000 7f30e759e700 1 -- 172.21.15.60:0/2421198531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30e80aa320 con 0x7f30e80b5060 2020-10-31T22:49:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.541+0000 7f30df7fe700 1 -- 172.21.15.60:0/2421198531 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f30e001d460 con 0x7f30e80b5060 2020-10-31T22:49:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.541+0000 7f30df7fe700 1 --2- 172.21.15.60:0/2421198531 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30c0055020 0x7f30c00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.541+0000 7f30df7fe700 1 -- 172.21.15.60:0/2421198531 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f30e006df10 con 0x7f30e80b5060 2020-10-31T22:49:57.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.541+0000 7f30e659c700 1 --2- 172.21.15.60:0/2421198531 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30c0055020 0x7f30c00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:57.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.541+0000 7f30e659c700 1 --2- 172.21.15.60:0/2421198531 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30c0055020 0x7f30c00574e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f30d800d000 tx=0x7f30d8007ad0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:57.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.549+0000 7f30df7fe700 1 -- 172.21.15.60:0/2421198531 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f30e00442c0 con 0x7f30e80b5060 2020-10-31T22:49:57.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.733+0000 7f30e759e700 1 -- 172.21.15.60:0/2421198531 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f30e8057100 con 0x7f30e80b5060 2020-10-31T22:49:57.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.733+0000 7f30df7fe700 1 -- 172.21.15.60:0/2421198531 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1932 (secure 0 0 0) 0x7f30e00478e0 con 0x7f30e80b5060 2020-10-31T22:49:57.739 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:49:57.739 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:49:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2020-10-31T22:49:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "total_bytes": 773094113280, 2020-10-31T22:49:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "total_avail_bytes": 764491485184, 2020-10-31T22:49:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_bytes": 12693504, 2020-10-31T22:49:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_bytes": 8602628096, 2020-10-31T22:49:57.740 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_ratio": 0.011127530597150326, 2020-10-31T22:49:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: "num_osds": 8, 2020-10-31T22:49:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: "num_per_pool_osds": 8, 2020-10-31T22:49:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: "num_per_pool_omap_osds": 8 2020-10-31T22:49:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: "stats_by_class": { 2020-10-31T22:49:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: "ssd": { 2020-10-31T22:49:57.741 INFO:teuthology.orchestra.run.smithi060.stdout: "total_bytes": 773094113280, 2020-10-31T22:49:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: "total_avail_bytes": 764491485184, 2020-10-31T22:49:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_bytes": 12693504, 2020-10-31T22:49:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_bytes": 8602628096, 2020-10-31T22:49:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: "total_used_raw_ratio": 0.011127530597150326 2020-10-31T22:49:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:57.742 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:49:57.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:57.743 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "device_health_metrics", 2020-10-31T22:49:57.743 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 1, 2020-10-31T22:49:57.743 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2020-10-31T22:49:57.743 INFO:teuthology.orchestra.run.smithi060.stdout: "stored": 0, 2020-10-31T22:49:57.743 INFO:teuthology.orchestra.run.smithi060.stdout: "objects": 2, 2020-10-31T22:49:57.743 INFO:teuthology.orchestra.run.smithi060.stdout: "kb_used": 0, 2020-10-31T22:49:57.744 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes_used": 0, 2020-10-31T22:49:57.744 INFO:teuthology.orchestra.run.smithi060.stdout: "percent_used": 0, 2020-10-31T22:49:57.744 INFO:teuthology.orchestra.run.smithi060.stdout: "max_avail": 362918346752 2020-10-31T22:49:57.744 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:57.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:57.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:57.744 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "rbd", 2020-10-31T22:49:57.745 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 2, 2020-10-31T22:49:57.745 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2020-10-31T22:49:57.745 INFO:teuthology.orchestra.run.smithi060.stdout: "stored": 0, 2020-10-31T22:49:57.745 INFO:teuthology.orchestra.run.smithi060.stdout: "objects": 0, 2020-10-31T22:49:57.745 INFO:teuthology.orchestra.run.smithi060.stdout: "kb_used": 0, 2020-10-31T22:49:57.745 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes_used": 0, 2020-10-31T22:49:57.745 INFO:teuthology.orchestra.run.smithi060.stdout: "percent_used": 0, 2020-10-31T22:49:57.746 INFO:teuthology.orchestra.run.smithi060.stdout: "max_avail": 362918346752 2020-10-31T22:49:57.746 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:57.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:57.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:57.746 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephfs_data", 2020-10-31T22:49:57.746 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 22, 2020-10-31T22:49:57.747 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2020-10-31T22:49:57.747 INFO:teuthology.orchestra.run.smithi060.stdout: "stored": 0, 2020-10-31T22:49:57.747 INFO:teuthology.orchestra.run.smithi060.stdout: "objects": 0, 2020-10-31T22:49:57.747 INFO:teuthology.orchestra.run.smithi060.stdout: "kb_used": 0, 2020-10-31T22:49:57.747 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes_used": 0, 2020-10-31T22:49:57.747 INFO:teuthology.orchestra.run.smithi060.stdout: "percent_used": 0, 2020-10-31T22:49:57.747 INFO:teuthology.orchestra.run.smithi060.stdout: "max_avail": 362918346752 2020-10-31T22:49:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:49:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:49:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "name": "cephfs_metadata", 2020-10-31T22:49:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "id": 23, 2020-10-31T22:49:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "stats": { 2020-10-31T22:49:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "stored": 617, 2020-10-31T22:49:57.748 INFO:teuthology.orchestra.run.smithi060.stdout: "objects": 1, 2020-10-31T22:49:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "kb_used": 8, 2020-10-31T22:49:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "bytes_used": 8192, 2020-10-31T22:49:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "percent_used": 1.1286285683809183e-08, 2020-10-31T22:49:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: "max_avail": 362918346752 2020-10-31T22:49:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:49:57.749 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:49:57.750 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:49:57.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.733+0000 7f30e759e700 1 -- 172.21.15.60:0/2421198531 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30c0055020 msgr2=0x7f30c00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:57.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.733+0000 7f30e759e700 1 --2- 172.21.15.60:0/2421198531 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30c0055020 0x7f30c00574e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7f30d800d000 tx=0x7f30d8007ad0).stop 2020-10-31T22:49:57.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.737+0000 7f30e759e700 1 -- 172.21.15.60:0/2421198531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e80b5060 msgr2=0x7f30e80aab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:57.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.737+0000 7f30e759e700 1 --2- 172.21.15.60:0/2421198531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e80b5060 0x7f30e80aab20 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 rx=0x7f30e0006dd0 tx=0x7f30e0008040).stop 2020-10-31T22:49:57.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.737+0000 7f30e759e700 1 -- 172.21.15.60:0/2421198531 shutdown_connections 2020-10-31T22:49:57.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.737+0000 7f30e759e700 1 --2- 172.21.15.60:0/2421198531 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e80b5060 0x7f30e80aab20 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:57.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.737+0000 7f30e759e700 1 --2- 172.21.15.60:0/2421198531 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f30c0055020 0x7f30c00574e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:57.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.737+0000 7f30e759e700 1 --2- 172.21.15.60:0/2421198531 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f30e80ac870 0x7f30e8135890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:57.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.737+0000 7f30e759e700 1 --2- 172.21.15.60:0/2421198531 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f30e80b0e20 0x7f30e80aa630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:57.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.737+0000 7f30e759e700 1 -- 172.21.15.60:0/2421198531 >> 172.21.15.60:0/2421198531 conn(0x7f30e806a600 msgr2=0x7f30e80b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:57.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.737+0000 7f30e759e700 1 -- 172.21.15.60:0/2421198531 shutdown_connections 2020-10-31T22:49:57.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.737+0000 7f30e759e700 1 -- 172.21.15.60:0/2421198531 wait complete. 2020-10-31T22:49:57.753 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s 2020-10-31T22:49:57.754 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data 2020-10-31T22:49:57.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba9f0a700 1 Processor -- start 2020-10-31T22:49:57.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba9f0a700 1 -- start start 2020-10-31T22:49:57.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba9f0a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feba40af380 0x7feba4149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:57.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba9f0a700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7feba40aeaf0 0x7feba414a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:57.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba9f0a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba40a6e80 con 0x7feba40a7a40 2020-10-31T22:49:57.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba9f0a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba414a6a0 con 0x7feba40af380 2020-10-31T22:49:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba9f0a700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba40af760 con 0x7feba40aeaf0 2020-10-31T22:49:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba37fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feba40af380 0x7feba4149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba37fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7feba40af380 0x7feba4149cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48378/0 (socket says 172.21.15.60:48378) 2020-10-31T22:49:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba37fe700 1 -- 172.21.15.60:0/1375255726 learned_addr learned my addr 172.21.15.60:0/1375255726 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba3fff700 1 --1- 172.21.15.60:0/1375255726 >> v1:172.21.15.60:6789/0 conn(0x7feba40a7a40 0x7feba405afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52516/0 (socket says 172.21.15.60:52516) 2020-10-31T22:49:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba2ffd700 1 --2- 172.21.15.60:0/1375255726 >> v2:172.21.15.66:3300/0 conn(0x7feba40aeaf0 0x7feba414a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:57.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba37fe700 1 -- 172.21.15.60:0/1375255726 >> v2:172.21.15.66:3300/0 conn(0x7feba40aeaf0 msgr2=0x7feba414a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba37fe700 1 --2- 172.21.15.60:0/1375255726 >> v2:172.21.15.66:3300/0 conn(0x7feba40aeaf0 0x7feba414a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba37fe700 1 -- 172.21.15.60:0/1375255726 >> v1:172.21.15.60:6789/0 conn(0x7feba40a7a40 legacy=0x7feba405afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba37fe700 1 -- 172.21.15.60:0/1375255726 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40a66a0 con 0x7feba40af380 2020-10-31T22:49:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba37fe700 1 --2- 172.21.15.60:0/1375255726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feba40af380 0x7feba4149cc0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7feba40a7ee0 tx=0x7feb9c006e80).ready entity=mon.0 client_cookie=e289f333935761e5 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba27fc700 1 -- 172.21.15.60:0/1375255726 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb9c009770 con 0x7feba40af380 2020-10-31T22:49:57.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba27fc700 1 -- 172.21.15.60:0/1375255726 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c0098d0 con 0x7feba40af380 2020-10-31T22:49:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba27fc700 1 -- 172.21.15.60:0/1375255726 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb9c009c30 con 0x7feba40af380 2020-10-31T22:49:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba9f0a700 1 -- 172.21.15.60:0/1375255726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feba40af380 msgr2=0x7feba4149cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:57.871 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba9f0a700 1 --2- 172.21.15.60:0/1375255726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feba40af380 0x7feba4149cc0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 rx=0x7feba40a7ee0 tx=0x7feb9c006e80).stop 2020-10-31T22:49:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba9f0a700 1 -- 172.21.15.60:0/1375255726 shutdown_connections 2020-10-31T22:49:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba9f0a700 1 --2- 172.21.15.60:0/1375255726 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feba40af380 0x7feba4149cc0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba9f0a700 1 --2- 172.21.15.60:0/1375255726 >> v2:172.21.15.66:3300/0 conn(0x7feba40aeaf0 0x7feba414a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba9f0a700 1 -- 172.21.15.60:0/1375255726 >> 172.21.15.60:0/1375255726 conn(0x7feba406a260 msgr2=0x7feba4061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:57.873 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.861+0000 7feba9f0a700 1 -- 172.21.15.60:0/1375255726 shutdown_connections 2020-10-31T22:49:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba9f0a700 1 -- 172.21.15.60:0/1375255726 wait complete. 2020-10-31T22:49:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba9f0a700 1 Processor -- start 2020-10-31T22:49:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba9f0a700 1 -- start start 2020-10-31T22:49:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba9f0a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feba40a7a40 0x7feba4155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba9f0a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feba40aeaf0 0x7feba40aa590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba9f0a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feba40af380 0x7feba4159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:57.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba9f0a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba40ab090 con 0x7feba40aeaf0 2020-10-31T22:49:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba9f0a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba4155800 con 0x7feba40af380 2020-10-31T22:49:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba9f0a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba40aadf0 con 0x7feba40a7a40 2020-10-31T22:49:57.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feba40aeaf0 0x7feba40aa590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feba40aeaf0 0x7feba40aa590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48384/0 (socket says 172.21.15.60:48384) 2020-10-31T22:49:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba2ffd700 1 -- 172.21.15.60:0/3603431115 learned_addr learned my addr 172.21.15.60:0/3603431115 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba37fe700 1 --2- 172.21.15.60:0/3603431115 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feba40a7a40 0x7feba4155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:57.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba3fff700 1 --2- 172.21.15.60:0/3603431115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feba40af380 0x7feba4159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba2ffd700 1 -- 172.21.15.60:0/3603431115 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feba40a7a40 msgr2=0x7feba4155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba2ffd700 1 --2- 172.21.15.60:0/3603431115 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feba40a7a40 0x7feba4155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba2ffd700 1 -- 172.21.15.60:0/3603431115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feba40af380 msgr2=0x7feba4159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba2ffd700 1 --2- 172.21.15.60:0/3603431115 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feba40af380 0x7feba4159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:57.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba2ffd700 1 -- 172.21.15.60:0/3603431115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba41589f0 con 0x7feba40aeaf0 2020-10-31T22:49:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba2ffd700 1 --2- 172.21.15.60:0/3603431115 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7feba40aeaf0 0x7feba40aa590 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 rx=0x7feb9400c000 tx=0x7feb940091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba0ff9700 1 -- 172.21.15.60:0/3603431115 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb9400cb00 con 0x7feba40aeaf0 2020-10-31T22:49:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba0ff9700 1 -- 172.21.15.60:0/3603431115 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9400cc60 con 0x7feba40aeaf0 2020-10-31T22:49:57.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.865+0000 7feba9f0a700 1 -- 172.21.15.60:0/3603431115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba4158c90 con 0x7feba40aeaf0 2020-10-31T22:49:57.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.869+0000 7feba0ff9700 1 -- 172.21.15.60:0/3603431115 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7feb940123f0 con 0x7feba40aeaf0 2020-10-31T22:49:57.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.869+0000 7feba9f0a700 1 -- 172.21.15.60:0/3603431115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba4145b60 con 0x7feba40aeaf0 2020-10-31T22:49:57.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.869+0000 7feba0ff9700 1 -- 172.21.15.60:0/3603431115 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7feb94022070 con 0x7feba40aeaf0 2020-10-31T22:49:57.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.869+0000 7feba9f0a700 1 -- 172.21.15.60:0/3603431115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba4158e20 con 0x7feba40aeaf0 2020-10-31T22:49:57.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.869+0000 7feba0ff9700 1 --2- 172.21.15.60:0/3603431115 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7feb880550c0 0x7feb88057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:57.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.869+0000 7feba0ff9700 1 -- 172.21.15.60:0/3603431115 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6075+0+0 (secure 0 0 0) 0x7feb9406e060 con 0x7feba40aeaf0 2020-10-31T22:49:57.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.869+0000 7feba37fe700 1 --2- 172.21.15.60:0/3603431115 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7feb880550c0 0x7feb88057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:57.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.869+0000 7feba37fe700 1 --2- 172.21.15.60:0/3603431115 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7feb880550c0 0x7feb88057580 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7feb9c01c000 tx=0x7feb9c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:57.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:57.877+0000 7feba0ff9700 1 -- 172.21.15.60:0/3603431115 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7feb94044580 con 0x7feba40aeaf0 2020-10-31T22:49:58.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.069+0000 7feba9f0a700 1 -- 172.21.15.60:0/3603431115 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7feba4057100 con 0x7feba40aeaf0 2020-10-31T22:49:58.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.069+0000 7feba0ff9700 1 -- 172.21.15.60:0/3603431115 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=-22 pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. v61) v1 ==== 209+0+0 (secure 0 0 0) 0x7feb94047ba0 con 0x7feba40aeaf0 2020-10-31T22:49:58.075 INFO:teuthology.orchestra.run.smithi060.stderr:Error EINVAL: pool 'cephfs_metadata' already contains some objects. Use an empty pool instead. 2020-10-31T22:49:58.079 DEBUG:teuthology.orchestra.run:got remote process result: 22 2020-10-31T22:49:58.079 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-10-31T22:49:58.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.189+0000 7f1d8a9a8700 1 Processor -- start 2020-10-31T22:49:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.189+0000 7f1d8a9a8700 1 -- start start 2020-10-31T22:49:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.189+0000 7f1d8a9a8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d840ac540 0x7f1d840aca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.189+0000 7f1d8a9a8700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1d840b0ac0 0x7f1d8413ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.189+0000 7f1d8a9a8700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d840ae210 con 0x7f1d840b52a0 2020-10-31T22:49:58.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.189+0000 7f1d8a9a8700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d840ae4b0 con 0x7f1d840b0ac0 2020-10-31T22:49:58.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.189+0000 7f1d8a9a8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840ae750 con 0x7f1d840ac540 2020-10-31T22:49:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d88f45700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1d840b0ac0 0x7f1d8413ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d88f45700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1d840b0ac0 0x7f1d8413ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:59330/0 (socket says 172.21.15.60:59330) 2020-10-31T22:49:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d7bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d840ac540 0x7f1d840aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:58.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d88f45700 1 -- 172.21.15.60:0/4248665502 learned_addr learned my addr 172.21.15.60:0/4248665502 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:58.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d88f45700 1 -- 172.21.15.60:0/4248665502 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d840ac540 msgr2=0x7f1d840aca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:58.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d88f45700 1 --2- 172.21.15.60:0/4248665502 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d840ac540 0x7f1d840aca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:58.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d88f45700 1 -- 172.21.15.60:0/4248665502 >> v1:172.21.15.66:6789/0 conn(0x7f1d840b52a0 legacy=0x7f1d840abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d88f45700 1 -- 172.21.15.60:0/4248665502 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d840ae9f0 con 0x7f1d840b0ac0 2020-10-31T22:49:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d88f45700 1 --2- 172.21.15.60:0/4248665502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d840b0ac0 0x7f1d8413ea20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f1d7c0032b0 tx=0x7f1d7c009270).ready entity=mon.1 client_cookie=9a7ec0d005509624 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d837fe700 1 -- 172.21.15.60:0/4248665502 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d7c009e60 con 0x7f1d840b0ac0 2020-10-31T22:49:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d837fe700 1 -- 172.21.15.60:0/4248665502 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c00bc00 con 0x7f1d840b0ac0 2020-10-31T22:49:58.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d837fe700 1 -- 172.21.15.60:0/4248665502 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d7c00bd70 con 0x7f1d840b0ac0 2020-10-31T22:49:58.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/4248665502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d840b0ac0 msgr2=0x7f1d8413ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:58.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d8a9a8700 1 --2- 172.21.15.60:0/4248665502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d840b0ac0 0x7f1d8413ea20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f1d7c0032b0 tx=0x7f1d7c009270).stop 2020-10-31T22:49:58.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/4248665502 shutdown_connections 2020-10-31T22:49:58.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d8a9a8700 1 --2- 172.21.15.60:0/4248665502 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d840b0ac0 0x7f1d8413ea20 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:58.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d8a9a8700 1 --2- 172.21.15.60:0/4248665502 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d840ac540 0x7f1d840aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:58.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/4248665502 >> 172.21.15.60:0/4248665502 conn(0x7f1d84060c50 msgr2=0x7f1d840b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:58.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/4248665502 shutdown_connections 2020-10-31T22:49:58.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.193+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/4248665502 wait complete. 2020-10-31T22:49:58.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d8a9a8700 1 Processor -- start 2020-10-31T22:49:58.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d8a9a8700 1 -- start start 2020-10-31T22:49:58.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d8a9a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d840ac540 0x7f1d840a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:58.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d8a9a8700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d840b0ac0 0x7f1d840b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:58.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d8a9a8700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d840b52a0 0x7f1d84140e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:58.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d8a9a8700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8413e790 con 0x7f1d840ac540 2020-10-31T22:49:58.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d8a9a8700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d840a8e70 con 0x7f1d840b0ac0 2020-10-31T22:49:58.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d8a9a8700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8406a710 con 0x7f1d840b52a0 2020-10-31T22:49:58.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d83fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d840ac540 0x7f1d840a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:58.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d83fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d840ac540 0x7f1d840a9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48396/0 (socket says 172.21.15.60:48396) 2020-10-31T22:49:58.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d83fff700 1 -- 172.21.15.60:0/2632759219 learned_addr learned my addr 172.21.15.60:0/2632759219 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:58.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d7bfff700 1 --2- 172.21.15.60:0/2632759219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d840b0ac0 0x7f1d840b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:58.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d88f45700 1 --2- 172.21.15.60:0/2632759219 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d840b52a0 0x7f1d84140e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:58.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d83fff700 1 -- 172.21.15.60:0/2632759219 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d840b52a0 msgr2=0x7f1d84140e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:58.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d83fff700 1 --2- 172.21.15.60:0/2632759219 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d840b52a0 0x7f1d84140e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:58.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d83fff700 1 -- 172.21.15.60:0/2632759219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d840b0ac0 msgr2=0x7f1d840b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:58.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d83fff700 1 --2- 172.21.15.60:0/2632759219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d840b0ac0 0x7f1d840b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:58.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d83fff700 1 -- 172.21.15.60:0/2632759219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d840aa350 con 0x7f1d840ac540 2020-10-31T22:49:58.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d83fff700 1 --2- 172.21.15.60:0/2632759219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d840ac540 0x7f1d840a9e60 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f1d8405c240 tx=0x7f1d74007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:58.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d81ffb700 1 -- 172.21.15.60:0/2632759219 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d7400e4a0 con 0x7f1d840ac540 2020-10-31T22:49:58.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/2632759219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d84142630 con 0x7f1d840ac540 2020-10-31T22:49:58.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d81ffb700 1 -- 172.21.15.60:0/2632759219 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7400e600 con 0x7f1d840ac540 2020-10-31T22:49:58.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d81ffb700 1 -- 172.21.15.60:0/2632759219 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1d7400e960 con 0x7f1d840ac540 2020-10-31T22:49:58.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/2632759219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d841409d0 con 0x7f1d840ac540 2020-10-31T22:49:58.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.197+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/2632759219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d84057100 con 0x7f1d840ac540 2020-10-31T22:49:58.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.201+0000 7f1d81ffb700 1 -- 172.21.15.60:0/2632759219 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1d74019030 con 0x7f1d840ac540 2020-10-31T22:49:58.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.201+0000 7f1d81ffb700 1 --2- 172.21.15.60:0/2632759219 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1d68054f10 0x7f1d680573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:58.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.201+0000 7f1d7bfff700 1 --2- 172.21.15.60:0/2632759219 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1d68054f10 0x7f1d680573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:58.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.201+0000 7f1d81ffb700 1 -- 172.21.15.60:0/2632759219 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 6075+0+0 (secure 0 0 0) 0x7f1d7406d4f0 con 0x7f1d840ac540 2020-10-31T22:49:58.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.201+0000 7f1d7bfff700 1 --2- 172.21.15.60:0/2632759219 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1d68054f10 0x7f1d680573d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f1d6c00b000 tx=0x7f1d6c006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:58.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.205+0000 7f1d81ffb700 1 -- 172.21.15.60:0/2632759219 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1d74043900 con 0x7f1d840ac540 2020-10-31T22:49:58.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.389+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/2632759219 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f1d840b0650 con 0x7f1d840ac540 2020-10-31T22:49:58.395 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:49:58.389+0000 7f16c922b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:49:58.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.393+0000 7f1d81ffb700 1 -- 172.21.15.60:0/2632759219 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 23 and data pool 22 v62) v1 ==== 189+0+0 (secure 0 0 0) 0x7f1d74017070 con 0x7f1d840ac540 2020-10-31T22:49:58.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.397+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/2632759219 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1d68054f10 msgr2=0x7f1d680573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:58.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.397+0000 7f1d8a9a8700 1 --2- 172.21.15.60:0/2632759219 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1d68054f10 0x7f1d680573d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7f1d6c00b000 tx=0x7f1d6c006dc0).stop 2020-10-31T22:49:58.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.397+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/2632759219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d840ac540 msgr2=0x7f1d840a9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:58.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.397+0000 7f1d8a9a8700 1 --2- 172.21.15.60:0/2632759219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d840ac540 0x7f1d840a9e60 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 rx=0x7f1d8405c240 tx=0x7f1d74007b90).stop 2020-10-31T22:49:58.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.397+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/2632759219 shutdown_connections 2020-10-31T22:49:58.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.397+0000 7f1d8a9a8700 1 --2- 172.21.15.60:0/2632759219 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1d840b52a0 0x7f1d84140e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:58.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.397+0000 7f1d8a9a8700 1 --2- 172.21.15.60:0/2632759219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1d840ac540 0x7f1d840a9e60 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:58.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.397+0000 7f1d8a9a8700 1 --2- 172.21.15.60:0/2632759219 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1d68054f10 0x7f1d680573d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:58.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.397+0000 7f1d8a9a8700 1 --2- 172.21.15.60:0/2632759219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1d840b0ac0 0x7f1d840b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:58.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.397+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/2632759219 >> 172.21.15.60:0/2632759219 conn(0x7f1d84060c50 msgr2=0x7f1d840b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:58.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.397+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/2632759219 shutdown_connections 2020-10-31T22:49:58.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.397+0000 7f1d8a9a8700 1 -- 172.21.15.60:0/2632759219 wait complete. 2020-10-31T22:49:58.407 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 23 and data pool 22 2020-10-31T22:49:58.414 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:49:58.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.525+0000 7fb0f759e700 1 Processor -- start 2020-10-31T22:49:58.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.525+0000 7fb0f759e700 1 -- start start 2020-10-31T22:49:58.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.525+0000 7fb0f759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb0f80af520 0x7fb0f80ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:58.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.525+0000 7fb0f759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f80af900 con 0x7fb0f80670f0 2020-10-31T22:49:58.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.525+0000 7fb0f759e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f80afc10 con 0x7fb0f8066c90 2020-10-31T22:49:58.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.525+0000 7fb0f759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f805bb70 con 0x7fb0f80af520 2020-10-31T22:49:58.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.525+0000 7fb0f6d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb0f80670f0 0x7fb0f8150980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52544/0 (socket says 172.21.15.60:52544) 2020-10-31T22:49:58.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.525+0000 7fb0f6d9d700 1 -- 172.21.15.60:0/937745568 learned_addr learned my addr 172.21.15.60:0/937745568 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:58.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.525+0000 7fb0f659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb0f80af520 0x7fb0f80ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:58.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f559a700 1 -- 172.21.15.60:0/937745568 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2729280290 0 0) 0x7fb0f80af900 con 0x7fb0f80670f0 2020-10-31T22:49:58.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f559a700 1 -- 172.21.15.60:0/937745568 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d8003230 con 0x7fb0f80670f0 2020-10-31T22:49:58.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f659c700 1 -- 172.21.15.60:0/937745568 >> v1:172.21.15.66:6789/0 conn(0x7fb0f8066c90 legacy=0x7fb0f8146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:58.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f559a700 1 -- 172.21.15.60:0/937745568 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3908181336 0 0) 0x7fb0f80afc10 con 0x7fb0f8066c90 2020-10-31T22:49:58.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f659c700 1 -- 172.21.15.60:0/937745568 >> v1:172.21.15.60:6789/0 conn(0x7fb0f80670f0 legacy=0x7fb0f8150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:58.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f659c700 1 -- 172.21.15.60:0/937745568 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f80ac130 con 0x7fb0f80af520 2020-10-31T22:49:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f659c700 1 --2- 172.21.15.60:0/937745568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f80af520 0x7fb0f80ac870 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7fb0e8001870 tx=0x7fb0f00091a0).ready entity=mon.0 client_cookie=d94fca2da5896ab2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f559a700 1 -- 172.21.15.60:0/937745568 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0e80016d0 con 0x7fb0f80af520 2020-10-31T22:49:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f559a700 1 -- 172.21.15.60:0/937745568 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f000b8b0 con 0x7fb0f80af520 2020-10-31T22:49:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f559a700 1 -- 172.21.15.60:0/937745568 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0f000ba20 con 0x7fb0f80af520 2020-10-31T22:49:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f759e700 1 -- 172.21.15.60:0/937745568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f80af520 msgr2=0x7fb0f80ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f759e700 1 --2- 172.21.15.60:0/937745568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f80af520 0x7fb0f80ac870 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 rx=0x7fb0e8001870 tx=0x7fb0f00091a0).stop 2020-10-31T22:49:58.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f759e700 1 -- 172.21.15.60:0/937745568 shutdown_connections 2020-10-31T22:49:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f759e700 1 --2- 172.21.15.60:0/937745568 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f80af520 0x7fb0f80ac870 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f759e700 1 -- 172.21.15.60:0/937745568 >> 172.21.15.60:0/937745568 conn(0x7fb0f80b3fd0 msgr2=0x7fb0f80b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f759e700 1 -- 172.21.15.60:0/937745568 shutdown_connections 2020-10-31T22:49:58.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f759e700 1 -- 172.21.15.60:0/937745568 wait complete. 2020-10-31T22:49:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f759e700 1 Processor -- start 2020-10-31T22:49:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.529+0000 7fb0f759e700 1 -- start start 2020-10-31T22:49:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0f8066c90 0x7fb0f8155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0f80670f0 0x7fb0f814b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f80af520 0x7fb0f8149320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:58.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f8154da0 con 0x7fb0f80af520 2020-10-31T22:49:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f8154f90 con 0x7fb0f8066c90 2020-10-31T22:49:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f8155230 con 0x7fb0f80670f0 2020-10-31T22:49:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f80af520 0x7fb0f8149320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f6d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f80af520 0x7fb0f8149320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48414/0 (socket says 172.21.15.60:48414) 2020-10-31T22:49:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f6d9d700 1 -- 172.21.15.60:0/2770252022 learned_addr learned my addr 172.21.15.60:0/2770252022 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f659c700 1 --2- 172.21.15.60:0/2770252022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0f8066c90 0x7fb0f8155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:58.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f5d9b700 1 --2- 172.21.15.60:0/2770252022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0f80670f0 0x7fb0f814b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:58.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f6d9d700 1 -- 172.21.15.60:0/2770252022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0f80670f0 msgr2=0x7fb0f814b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:58.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f6d9d700 1 --2- 172.21.15.60:0/2770252022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0f80670f0 0x7fb0f814b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:58.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f6d9d700 1 -- 172.21.15.60:0/2770252022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0f8066c90 msgr2=0x7fb0f8155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:58.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f6d9d700 1 --2- 172.21.15.60:0/2770252022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0f8066c90 0x7fb0f8155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:58.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f6d9d700 1 -- 172.21.15.60:0/2770252022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f81554d0 con 0x7fb0f80af520 2020-10-31T22:49:58.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f6d9d700 1 --2- 172.21.15.60:0/2770252022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f80af520 0x7fb0f8149320 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7fb0e80018b0 tx=0x7fb0e8001800).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:58.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0ef7fe700 1 -- 172.21.15.60:0/2770252022 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0e8007170 con 0x7fb0f80af520 2020-10-31T22:49:58.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0ef7fe700 1 -- 172.21.15.60:0/2770252022 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e80072d0 con 0x7fb0f80af520 2020-10-31T22:49:58.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f759e700 1 -- 172.21.15.60:0/2770252022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f8149810 con 0x7fb0f80af520 2020-10-31T22:49:58.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0ef7fe700 1 -- 172.21.15.60:0/2770252022 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0e800a750 con 0x7fb0f80af520 2020-10-31T22:49:58.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f759e700 1 -- 172.21.15.60:0/2770252022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f814bc00 con 0x7fb0f80af520 2020-10-31T22:49:58.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0f759e700 1 -- 172.21.15.60:0/2770252022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f8142520 con 0x7fb0f80af520 2020-10-31T22:49:58.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.533+0000 7fb0ef7fe700 1 -- 172.21.15.60:0/2770252022 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb0e801c030 con 0x7fb0f80af520 2020-10-31T22:49:58.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.537+0000 7fb0ef7fe700 1 --2- 172.21.15.60:0/2770252022 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb0dc0550c0 0x7fb0dc057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:58.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.537+0000 7fb0ef7fe700 1 -- 172.21.15.60:0/2770252022 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb0e806da70 con 0x7fb0f80af520 2020-10-31T22:49:58.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.537+0000 7fb0f659c700 1 --2- 172.21.15.60:0/2770252022 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb0dc0550c0 0x7fb0dc057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:58.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.537+0000 7fb0f659c700 1 --2- 172.21.15.60:0/2770252022 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb0dc0550c0 0x7fb0dc057580 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fb0f001b000 tx=0x7fb0f00091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:58.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.545+0000 7fb0ef7fe700 1 -- 172.21.15.60:0/2770252022 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb0f8142520 con 0x7fb0f80af520 2020-10-31T22:49:58.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:58.721+0000 7fb0f759e700 1 -- 172.21.15.60:0/2770252022 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb0f8142520 con 0x7fb0f80af520 2020-10-31T22:49:59.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.397+0000 7fb0ef7fe700 1 -- 172.21.15.60:0/2770252022 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb0f8142520 con 0x7fb0f80af520 2020-10-31T22:49:59.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.401+0000 7fb0f759e700 1 -- 172.21.15.60:0/2770252022 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb0dc0550c0 msgr2=0x7fb0dc057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:59.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.401+0000 7fb0f759e700 1 --2- 172.21.15.60:0/2770252022 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb0dc0550c0 0x7fb0dc057580 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7fb0f001b000 tx=0x7fb0f00091a0).stop 2020-10-31T22:49:59.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.401+0000 7fb0f759e700 1 -- 172.21.15.60:0/2770252022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f80af520 msgr2=0x7fb0f8149320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:59.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.401+0000 7fb0f759e700 1 --2- 172.21.15.60:0/2770252022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f80af520 0x7fb0f8149320 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 rx=0x7fb0e80018b0 tx=0x7fb0e8001800).stop 2020-10-31T22:49:59.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.401+0000 7fb0f759e700 1 -- 172.21.15.60:0/2770252022 shutdown_connections 2020-10-31T22:49:59.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.401+0000 7fb0f759e700 1 --2- 172.21.15.60:0/2770252022 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0f80af520 0x7fb0f8149320 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:59.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.401+0000 7fb0f759e700 1 --2- 172.21.15.60:0/2770252022 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb0dc0550c0 0x7fb0dc057580 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:59.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.401+0000 7fb0f759e700 1 --2- 172.21.15.60:0/2770252022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb0f8066c90 0x7fb0f8155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:59.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.401+0000 7fb0f759e700 1 --2- 172.21.15.60:0/2770252022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb0f80670f0 0x7fb0f814b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:59.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.401+0000 7fb0f759e700 1 -- 172.21.15.60:0/2770252022 >> 172.21.15.60:0/2770252022 conn(0x7fb0f80b3fd0 msgr2=0x7fb0f8144930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:59.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.401+0000 7fb0f759e700 1 -- 172.21.15.60:0/2770252022 shutdown_connections 2020-10-31T22:49:59.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.401+0000 7fb0f759e700 1 -- 172.21.15.60:0/2770252022 wait complete. 2020-10-31T22:49:59.426 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:49:59.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.549+0000 7fcb7bfff700 1 Processor -- start 2020-10-31T22:49:59.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.549+0000 7fcb7bfff700 1 -- start start 2020-10-31T22:49:59.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.549+0000 7fcb7bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcb7c0b5570 0x7fcb7c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:59.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.549+0000 7fcb7bfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcb7c0b24a0 0x7fcb7c145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:59.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.549+0000 7fcb7bfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb7c0b4440 con 0x7fcb7c145e40 2020-10-31T22:49:59.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.549+0000 7fcb7bfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7c13f930 con 0x7fcb7c0b24a0 2020-10-31T22:49:59.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.549+0000 7fcb7bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0b02f0 con 0x7fcb7c0b5570 2020-10-31T22:49:59.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.549+0000 7fcb7b7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcb7c145e40 0x7fcb7c141f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52558/0 (socket says 172.21.15.60:52558) 2020-10-31T22:49:59.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.549+0000 7fcb7b7fe700 1 -- 172.21.15.60:0/3224338958 learned_addr learned my addr 172.21.15.60:0/3224338958 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:49:59.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7a7fc700 1 --2- 172.21.15.60:0/3224338958 >> v2:172.21.15.66:3300/0 conn(0x7fcb7c0b24a0 0x7fcb7c145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:59.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7affd700 1 --2- 172.21.15.60:0/3224338958 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcb7c0b5570 0x7fcb7c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:59.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb79ffb700 1 -- 172.21.15.60:0/3224338958 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528803706 0 0) 0x7fcb7c0b4440 con 0x7fcb7c145e40 2020-10-31T22:49:59.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb79ffb700 1 -- 172.21.15.60:0/3224338958 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb60003230 con 0x7fcb7c145e40 2020-10-31T22:49:59.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7affd700 1 -- 172.21.15.60:0/3224338958 >> v2:172.21.15.66:3300/0 conn(0x7fcb7c0b24a0 msgr2=0x7fcb7c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:49:59.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7affd700 1 --2- 172.21.15.60:0/3224338958 >> v2:172.21.15.66:3300/0 conn(0x7fcb7c0b24a0 0x7fcb7c145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:59.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7affd700 1 -- 172.21.15.60:0/3224338958 >> v1:172.21.15.60:6789/0 conn(0x7fcb7c145e40 legacy=0x7fcb7c141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:59.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7affd700 1 -- 172.21.15.60:0/3224338958 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c0b0590 con 0x7fcb7c0b5570 2020-10-31T22:49:59.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7affd700 1 --2- 172.21.15.60:0/3224338958 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcb7c0b5570 0x7fcb7c0b5950 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fcb7c141c20 tx=0x7fcb70006dc0).ready entity=mon.2 client_cookie=6ea2cdb74a561746 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:59.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb79ffb700 1 -- 172.21.15.60:0/3224338958 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb700096a0 con 0x7fcb7c0b5570 2020-10-31T22:49:59.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb79ffb700 1 -- 172.21.15.60:0/3224338958 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb70009800 con 0x7fcb7c0b5570 2020-10-31T22:49:59.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb79ffb700 1 -- 172.21.15.60:0/3224338958 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb70009b60 con 0x7fcb7c0b5570 2020-10-31T22:49:59.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7bfff700 1 -- 172.21.15.60:0/3224338958 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcb7c0b5570 msgr2=0x7fcb7c0b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:59.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7bfff700 1 --2- 172.21.15.60:0/3224338958 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcb7c0b5570 0x7fcb7c0b5950 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fcb7c141c20 tx=0x7fcb70006dc0).stop 2020-10-31T22:49:59.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7bfff700 1 -- 172.21.15.60:0/3224338958 shutdown_connections 2020-10-31T22:49:59.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7bfff700 1 --2- 172.21.15.60:0/3224338958 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcb7c0b5570 0x7fcb7c0b5950 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:59.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7bfff700 1 --2- 172.21.15.60:0/3224338958 >> v2:172.21.15.66:3300/0 conn(0x7fcb7c0b24a0 0x7fcb7c145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:59.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7bfff700 1 -- 172.21.15.60:0/3224338958 >> 172.21.15.60:0/3224338958 conn(0x7fcb7c0b8e90 msgr2=0x7fcb7c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:49:59.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7bfff700 1 -- 172.21.15.60:0/3224338958 shutdown_connections 2020-10-31T22:49:59.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.553+0000 7fcb7bfff700 1 -- 172.21.15.60:0/3224338958 wait complete. 2020-10-31T22:49:59.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7bfff700 1 Processor -- start 2020-10-31T22:49:59.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7bfff700 1 -- start start 2020-10-31T22:49:59.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb7c0b24a0 0x7fcb7c0b7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:59.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcb7c0b5570 0x7fcb7c150a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:59.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb7c145e40 0x7fcb7c150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:59.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0af630 con 0x7fcb7c0b24a0 2020-10-31T22:49:59.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7bfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0ad740 con 0x7fcb7c145e40 2020-10-31T22:49:59.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb7c0b24a0 0x7fcb7c0b7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:59.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7c0acac0 con 0x7fcb7c0b5570 2020-10-31T22:49:59.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb7c0b24a0 0x7fcb7c0b7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48424/0 (socket says 172.21.15.60:48424) 2020-10-31T22:49:59.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7affd700 1 -- 172.21.15.60:0/4160725738 learned_addr learned my addr 172.21.15.60:0/4160725738 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:49:59.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7a7fc700 1 --2- 172.21.15.60:0/4160725738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcb7c0b5570 0x7fcb7c150a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:59.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7b7fe700 1 --2- 172.21.15.60:0/4160725738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb7c145e40 0x7fcb7c150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:59.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7affd700 1 -- 172.21.15.60:0/4160725738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcb7c0b5570 msgr2=0x7fcb7c150a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:59.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7affd700 1 --2- 172.21.15.60:0/4160725738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcb7c0b5570 0x7fcb7c150a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:59.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7affd700 1 -- 172.21.15.60:0/4160725738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb7c145e40 msgr2=0x7fcb7c150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:49:59.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7affd700 1 --2- 172.21.15.60:0/4160725738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb7c145e40 0x7fcb7c150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:49:59.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7affd700 1 -- 172.21.15.60:0/4160725738 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7c0acd60 con 0x7fcb7c0b24a0 2020-10-31T22:49:59.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.557+0000 7fcb7affd700 1 --2- 172.21.15.60:0/4160725738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb7c0b24a0 0x7fcb7c0b7570 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fcb7c141c20 tx=0x7fcb70015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:59.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.561+0000 7fcb6bfff700 1 -- 172.21.15.60:0/4160725738 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb70011a90 con 0x7fcb7c0b24a0 2020-10-31T22:49:59.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.561+0000 7fcb7bfff700 1 -- 172.21.15.60:0/4160725738 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb7c0ad000 con 0x7fcb7c0b24a0 2020-10-31T22:49:59.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.561+0000 7fcb6bfff700 1 -- 172.21.15.60:0/4160725738 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb70011bf0 con 0x7fcb7c0b24a0 2020-10-31T22:49:59.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.561+0000 7fcb7bfff700 1 -- 172.21.15.60:0/4160725738 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7c0b80f0 con 0x7fcb7c0b24a0 2020-10-31T22:49:59.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.561+0000 7fcb6bfff700 1 -- 172.21.15.60:0/4160725738 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcb7001d450 con 0x7fcb7c0b24a0 2020-10-31T22:49:59.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.561+0000 7fcb7bfff700 1 -- 172.21.15.60:0/4160725738 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb7c057100 con 0x7fcb7c0b24a0 2020-10-31T22:49:59.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.561+0000 7fcb6bfff700 1 -- 172.21.15.60:0/4160725738 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fcb7000f070 con 0x7fcb7c0b24a0 2020-10-31T22:49:59.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.561+0000 7fcb6bfff700 1 --2- 172.21.15.60:0/4160725738 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcb58055020 0x7fcb580574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:49:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.561+0000 7fcb6bfff700 1 -- 172.21.15.60:0/4160725738 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fcb7006e8c0 con 0x7fcb7c0b24a0 2020-10-31T22:49:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.561+0000 7fcb7a7fc700 1 --2- 172.21.15.60:0/4160725738 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcb58055020 0x7fcb580574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:49:59.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.561+0000 7fcb7a7fc700 1 --2- 172.21.15.60:0/4160725738 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcb58055020 0x7fcb580574e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fcb6c00b000 tx=0x7fcb6c006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:49:59.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.569+0000 7fcb6bfff700 1 -- 172.21.15.60:0/4160725738 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcb70044cf0 con 0x7fcb7c0b24a0 2020-10-31T22:49:59.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:49:59.717+0000 7fcb7bfff700 1 -- 172.21.15.60:0/4160725738 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fcb7c05a8e0 con 0x7fcb7c0b24a0 2020-10-31T22:50:00.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.405+0000 7fcb6bfff700 1 -- 172.21.15.60:0/4160725738 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v129) v1 ==== 185+0+0 (secure 0 0 0) 0x7fcb70022070 con 0x7fcb7c0b24a0 2020-10-31T22:50:00.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.409+0000 7fcb7bfff700 1 -- 172.21.15.60:0/4160725738 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcb58055020 msgr2=0x7fcb580574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:00.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.409+0000 7fcb7bfff700 1 --2- 172.21.15.60:0/4160725738 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcb58055020 0x7fcb580574e0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7fcb6c00b000 tx=0x7fcb6c006dc0).stop 2020-10-31T22:50:00.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.409+0000 7fcb7bfff700 1 -- 172.21.15.60:0/4160725738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb7c0b24a0 msgr2=0x7fcb7c0b7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:00.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.409+0000 7fcb7bfff700 1 --2- 172.21.15.60:0/4160725738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb7c0b24a0 0x7fcb7c0b7570 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 rx=0x7fcb7c141c20 tx=0x7fcb70015000).stop 2020-10-31T22:50:00.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.409+0000 7fcb7bfff700 1 -- 172.21.15.60:0/4160725738 shutdown_connections 2020-10-31T22:50:00.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.409+0000 7fcb7bfff700 1 --2- 172.21.15.60:0/4160725738 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcb58055020 0x7fcb580574e0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:00.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.409+0000 7fcb7bfff700 1 --2- 172.21.15.60:0/4160725738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcb7c145e40 0x7fcb7c150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.409+0000 7fcb7bfff700 1 --2- 172.21.15.60:0/4160725738 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb7c0b24a0 0x7fcb7c0b7570 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.409+0000 7fcb7bfff700 1 --2- 172.21.15.60:0/4160725738 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcb7c0b5570 0x7fcb7c150a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.409+0000 7fcb7bfff700 1 -- 172.21.15.60:0/4160725738 >> 172.21.15.60:0/4160725738 conn(0x7fcb7c0b8e90 msgr2=0x7fcb7c141e20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:00.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.409+0000 7fcb7bfff700 1 -- 172.21.15.60:0/4160725738 shutdown_connections 2020-10-31T22:50:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.409+0000 7fcb7bfff700 1 -- 172.21.15.60:0/4160725738 wait complete. 2020-10-31T22:50:00.418 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:50:00.429 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:50:00.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.545+0000 7f2af08c2700 1 Processor -- start 2020-10-31T22:50:00.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.545+0000 7f2af08c2700 1 -- start start 2020-10-31T22:50:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2af08c2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2aec0afc50 0x7f2aec1420e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2af08c2700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec0b2130 con 0x7f2aec0ae450 2020-10-31T22:50:00.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2af08c2700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec0af3f0 con 0x7f2aec0b1d50 2020-10-31T22:50:00.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2af08c2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0aeff0 con 0x7f2aec0afc50 2020-10-31T22:50:00.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2aebfff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2aec0ae450 0x7f2aec0ae8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52572/0 (socket says 172.21.15.60:52572) 2020-10-31T22:50:00.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2aebfff700 1 -- 172.21.15.60:0/3577359649 learned_addr learned my addr 172.21.15.60:0/3577359649 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:00.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2ae3fff700 1 --2- 172.21.15.60:0/3577359649 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2aec0afc50 0x7f2aec1420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:00.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2aeaffd700 1 -- 172.21.15.60:0/3577359649 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512633178 0 0) 0x7f2aec0b2130 con 0x7f2aec0ae450 2020-10-31T22:50:00.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2aeaffd700 1 -- 172.21.15.60:0/3577359649 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2acc003230 con 0x7f2aec0ae450 2020-10-31T22:50:00.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2aeaffd700 1 -- 172.21.15.60:0/3577359649 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2031589242 0 0) 0x7f2aec0af3f0 con 0x7f2aec0b1d50 2020-10-31T22:50:00.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2aeaffd700 1 -- 172.21.15.60:0/3577359649 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2aec0b2130 con 0x7f2aec0b1d50 2020-10-31T22:50:00.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2ae3fff700 1 -- 172.21.15.60:0/3577359649 >> v1:172.21.15.66:6789/0 conn(0x7f2aec0b1d50 legacy=0x7f2aec13e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:00.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2ae3fff700 1 -- 172.21.15.60:0/3577359649 >> v1:172.21.15.60:6789/0 conn(0x7f2aec0ae450 legacy=0x7f2aec0ae8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:00.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2ae3fff700 1 -- 172.21.15.60:0/3577359649 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec0af690 con 0x7f2aec0afc50 2020-10-31T22:50:00.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2ae3fff700 1 --2- 172.21.15.60:0/3577359649 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2aec0afc50 0x7f2aec1420e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f2aec0ad1d0 tx=0x7f2ad4006dc0).ready entity=mon.2 client_cookie=c6c3802dff1df3ab server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:00.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2aeaffd700 1 -- 172.21.15.60:0/3577359649 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ad40096f0 con 0x7f2aec0afc50 2020-10-31T22:50:00.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2aeaffd700 1 -- 172.21.15.60:0/3577359649 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad4009850 con 0x7f2aec0afc50 2020-10-31T22:50:00.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2aeaffd700 1 -- 172.21.15.60:0/3577359649 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ad4009bb0 con 0x7f2aec0afc50 2020-10-31T22:50:00.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2af08c2700 1 -- 172.21.15.60:0/3577359649 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2aec0afc50 msgr2=0x7f2aec1420e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:00.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2af08c2700 1 --2- 172.21.15.60:0/3577359649 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2aec0afc50 0x7f2aec1420e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f2aec0ad1d0 tx=0x7f2ad4006dc0).stop 2020-10-31T22:50:00.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2af08c2700 1 -- 172.21.15.60:0/3577359649 shutdown_connections 2020-10-31T22:50:00.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2af08c2700 1 --2- 172.21.15.60:0/3577359649 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2aec0afc50 0x7f2aec1420e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:00.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.549+0000 7f2af08c2700 1 -- 172.21.15.60:0/3577359649 >> 172.21.15.60:0/3577359649 conn(0x7f2aec0b5330 msgr2=0x7f2aec0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:00.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2af08c2700 1 -- 172.21.15.60:0/3577359649 shutdown_connections 2020-10-31T22:50:00.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2af08c2700 1 -- 172.21.15.60:0/3577359649 wait complete. 2020-10-31T22:50:00.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2af08c2700 1 Processor -- start 2020-10-31T22:50:00.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2af08c2700 1 -- start start 2020-10-31T22:50:00.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2af08c2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2aec0ae450 0x7f2aec0b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:00.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2af08c2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aec0afc50 0x7f2aec14fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:00.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2af08c2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2aec0b1d50 0x7f2aec150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:00.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2af08c2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec150580 con 0x7f2aec0afc50 2020-10-31T22:50:00.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2af08c2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec139b70 con 0x7f2aec0b1d50 2020-10-31T22:50:00.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2af08c2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec13b090 con 0x7f2aec0ae450 2020-10-31T22:50:00.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2ae3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aec0afc50 0x7f2aec14fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:00.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2ae3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aec0afc50 0x7f2aec14fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48440/0 (socket says 172.21.15.60:48440) 2020-10-31T22:50:00.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2ae3fff700 1 -- 172.21.15.60:0/1313575943 learned_addr learned my addr 172.21.15.60:0/1313575943 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:00.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2aebfff700 1 --2- 172.21.15.60:0/1313575943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2aec0b1d50 0x7f2aec150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:00.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2aeb7fe700 1 --2- 172.21.15.60:0/1313575943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2aec0ae450 0x7f2aec0b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:00.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2ae3fff700 1 -- 172.21.15.60:0/1313575943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2aec0ae450 msgr2=0x7f2aec0b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:00.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2ae3fff700 1 --2- 172.21.15.60:0/1313575943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2aec0ae450 0x7f2aec0b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:00.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2ae3fff700 1 -- 172.21.15.60:0/1313575943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2aec0b1d50 msgr2=0x7f2aec150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:00.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2ae3fff700 1 --2- 172.21.15.60:0/1313575943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2aec0b1d50 0x7f2aec150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:00.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2ae3fff700 1 -- 172.21.15.60:0/1313575943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec13b330 con 0x7f2aec0afc50 2020-10-31T22:50:00.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.553+0000 7f2ae3fff700 1 --2- 172.21.15.60:0/1313575943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aec0afc50 0x7f2aec14fba0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7f2aec0ad1d0 tx=0x7f2ad4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:00.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.557+0000 7f2ae97fa700 1 -- 172.21.15.60:0/1313575943 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ad4011b60 con 0x7f2aec0afc50 2020-10-31T22:50:00.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.557+0000 7f2ae97fa700 1 -- 172.21.15.60:0/1313575943 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad4011cc0 con 0x7f2aec0afc50 2020-10-31T22:50:00.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.557+0000 7f2af08c2700 1 -- 172.21.15.60:0/1313575943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec13b5d0 con 0x7f2aec0afc50 2020-10-31T22:50:00.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.557+0000 7f2ae97fa700 1 -- 172.21.15.60:0/1313575943 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2ad401d640 con 0x7f2aec0afc50 2020-10-31T22:50:00.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.557+0000 7f2af08c2700 1 -- 172.21.15.60:0/1313575943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec0a99f0 con 0x7f2aec0afc50 2020-10-31T22:50:00.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.557+0000 7f2af08c2700 1 -- 172.21.15.60:0/1313575943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec057100 con 0x7f2aec0afc50 2020-10-31T22:50:00.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.557+0000 7f2ae97fa700 1 -- 172.21.15.60:0/1313575943 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2ad4024030 con 0x7f2aec0afc50 2020-10-31T22:50:00.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.557+0000 7f2ae97fa700 1 --2- 172.21.15.60:0/1313575943 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ad0054f90 0x7f2ad0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:00.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.557+0000 7f2ae97fa700 1 -- 172.21.15.60:0/1313575943 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f2ad406e8d0 con 0x7f2aec0afc50 2020-10-31T22:50:00.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.557+0000 7f2aeb7fe700 1 --2- 172.21.15.60:0/1313575943 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ad0054f90 0x7f2ad0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:00.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.557+0000 7f2aeb7fe700 1 --2- 172.21.15.60:0/1313575943 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ad0054f90 0x7f2ad0057450 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f2adc00d000 tx=0x7f2adc007960).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:00.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.565+0000 7f2ae97fa700 1 -- 172.21.15.60:0/1313575943 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2ad4044f90 con 0x7f2aec0afc50 2020-10-31T22:50:00.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:00.709+0000 7f2af08c2700 1 -- 172.21.15.60:0/1313575943 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f2aec05ee00 con 0x7f2aec0afc50 2020-10-31T22:50:01.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.405+0000 7f2ae97fa700 1 -- 172.21.15.60:0/1313575943 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v130) v1 ==== 133+0+0 (secure 0 0 0) 0x7f2ad4022070 con 0x7f2aec0afc50 2020-10-31T22:50:01.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.413+0000 7f2af08c2700 1 -- 172.21.15.60:0/1313575943 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ad0054f90 msgr2=0x7f2ad0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:01.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.413+0000 7f2af08c2700 1 --2- 172.21.15.60:0/1313575943 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ad0054f90 0x7f2ad0057450 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7f2adc00d000 tx=0x7f2adc007960).stop 2020-10-31T22:50:01.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.413+0000 7f2af08c2700 1 -- 172.21.15.60:0/1313575943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aec0afc50 msgr2=0x7f2aec14fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:01.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.413+0000 7f2af08c2700 1 --2- 172.21.15.60:0/1313575943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aec0afc50 0x7f2aec14fba0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 rx=0x7f2aec0ad1d0 tx=0x7f2ad4015000).stop 2020-10-31T22:50:01.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.413+0000 7f2af08c2700 1 -- 172.21.15.60:0/1313575943 shutdown_connections 2020-10-31T22:50:01.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.413+0000 7f2af08c2700 1 --2- 172.21.15.60:0/1313575943 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ad0054f90 0x7f2ad0057450 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:01.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.413+0000 7f2af08c2700 1 --2- 172.21.15.60:0/1313575943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2aec0b1d50 0x7f2aec150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:01.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.413+0000 7f2af08c2700 1 --2- 172.21.15.60:0/1313575943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2aec0ae450 0x7f2aec0b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:01.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.413+0000 7f2af08c2700 1 --2- 172.21.15.60:0/1313575943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2aec0afc50 0x7f2aec14fba0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:01.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.413+0000 7f2af08c2700 1 -- 172.21.15.60:0/1313575943 >> 172.21.15.60:0/1313575943 conn(0x7f2aec0b5330 msgr2=0x7f2aec0b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:01.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.413+0000 7f2af08c2700 1 -- 172.21.15.60:0/1313575943 shutdown_connections 2020-10-31T22:50:01.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.417+0000 7f2af08c2700 1 -- 172.21.15.60:0/1313575943 wait complete. 2020-10-31T22:50:01.421 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:50:01.436 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data 2020-10-31T22:50:01.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb326fb5700 1 Processor -- start 2020-10-31T22:50:01.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb326fb5700 1 -- start start 2020-10-31T22:50:01.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb326fb5700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb32005f900 0x7fb32005fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:01.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb326fb5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb320060260 0x7fb32013f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:01.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb326fb5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3200b0890 con 0x7fb32005b180 2020-10-31T22:50:01.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb326fb5700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3200b0350 con 0x7fb32005f900 2020-10-31T22:50:01.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb326fb5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3200b05f0 con 0x7fb320060260 2020-10-31T22:50:01.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb3257b2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb32005f900 0x7fb32005fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:01.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb3257b2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb32005f900 0x7fb32005fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:59382/0 (socket says 172.21.15.60:59382) 2020-10-31T22:50:01.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb3257b2700 1 -- 172.21.15.60:0/1623225220 learned_addr learned my addr 172.21.15.60:0/1623225220 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:01.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb3267b4700 1 --2- 172.21.15.60:0/1623225220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb320060260 0x7fb32013f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:01.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb3267b4700 1 -- 172.21.15.60:0/1623225220 >> v2:172.21.15.66:3300/0 conn(0x7fb32005f900 msgr2=0x7fb32005fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:01.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb3267b4700 1 --2- 172.21.15.60:0/1623225220 >> v2:172.21.15.66:3300/0 conn(0x7fb32005f900 0x7fb32005fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:01.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb3267b4700 1 -- 172.21.15.60:0/1623225220 >> v1:172.21.15.60:6789/0 conn(0x7fb32005b180 legacy=0x7fb3201469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:01.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb3267b4700 1 -- 172.21.15.60:0/1623225220 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32005f460 con 0x7fb320060260 2020-10-31T22:50:01.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb3257b2700 1 --2- 172.21.15.60:0/1623225220 >> v2:172.21.15.66:3300/0 conn(0x7fb32005f900 0x7fb32005fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:01.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb3267b4700 1 --2- 172.21.15.60:0/1623225220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb320060260 0x7fb32013f7c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fb3200adf00 tx=0x7fb3180091a0).ready entity=mon.2 client_cookie=37a0f751f3173010 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:01.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb324fb1700 1 -- 172.21.15.60:0/1623225220 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31800b9b0 con 0x7fb320060260 2020-10-31T22:50:01.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb324fb1700 1 -- 172.21.15.60:0/1623225220 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31800bb10 con 0x7fb320060260 2020-10-31T22:50:01.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb324fb1700 1 -- 172.21.15.60:0/1623225220 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb31800bc80 con 0x7fb320060260 2020-10-31T22:50:01.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb326fb5700 1 -- 172.21.15.60:0/1623225220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb320060260 msgr2=0x7fb32013f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:01.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.545+0000 7fb326fb5700 1 --2- 172.21.15.60:0/1623225220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb320060260 0x7fb32013f7c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fb3200adf00 tx=0x7fb3180091a0).stop 2020-10-31T22:50:01.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 -- 172.21.15.60:0/1623225220 shutdown_connections 2020-10-31T22:50:01.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 --2- 172.21.15.60:0/1623225220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb320060260 0x7fb32013f7c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:01.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 --2- 172.21.15.60:0/1623225220 >> v2:172.21.15.66:3300/0 conn(0x7fb32005f900 0x7fb32005fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:01.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 -- 172.21.15.60:0/1623225220 >> 172.21.15.60:0/1623225220 conn(0x7fb3200b61d0 msgr2=0x7fb3200b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:01.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 -- 172.21.15.60:0/1623225220 shutdown_connections 2020-10-31T22:50:01.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 -- 172.21.15.60:0/1623225220 wait complete. 2020-10-31T22:50:01.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 Processor -- start 2020-10-31T22:50:01.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 -- start start 2020-10-31T22:50:01.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb32005b180 0x7fb320145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:01.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb32005f900 0x7fb3200af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:01.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb320060260 0x7fb320143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:01.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb320154d60 con 0x7fb32005b180 2020-10-31T22:50:01.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb320155000 con 0x7fb320060260 2020-10-31T22:50:01.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3201552a0 con 0x7fb32005f900 2020-10-31T22:50:01.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb325fb3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb32005b180 0x7fb320145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:01.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb3257b2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb32005f900 0x7fb3200af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:01.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb3257b2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb32005f900 0x7fb3200af720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:33408/0 (socket says 172.21.15.60:33408) 2020-10-31T22:50:01.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb3257b2700 1 -- 172.21.15.60:0/496469297 learned_addr learned my addr 172.21.15.60:0/496469297 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:01.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb3267b4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb320060260 0x7fb320143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:01.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb325fb3700 1 -- 172.21.15.60:0/496469297 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb32005f900 msgr2=0x7fb3200af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:01.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb325fb3700 1 --2- 172.21.15.60:0/496469297 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb32005f900 0x7fb3200af720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:01.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb325fb3700 1 -- 172.21.15.60:0/496469297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb320060260 msgr2=0x7fb320143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:01.562 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb325fb3700 1 --2- 172.21.15.60:0/496469297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb320060260 0x7fb320143ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:01.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb325fb3700 1 -- 172.21.15.60:0/496469297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb320155540 con 0x7fb32005b180 2020-10-31T22:50:01.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb3257b2700 1 --2- 172.21.15.60:0/496469297 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb32005f900 0x7fb3200af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:01.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb325fb3700 1 --2- 172.21.15.60:0/496469297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb32005b180 0x7fb320145b90 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7fb320061590 tx=0x7fb314007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:01.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb312ffd700 1 -- 172.21.15.60:0/496469297 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb314007240 con 0x7fb32005b180 2020-10-31T22:50:01.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 -- 172.21.15.60:0/496469297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3201559e0 con 0x7fb32005b180 2020-10-31T22:50:01.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb326fb5700 1 -- 172.21.15.60:0/496469297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3201475a0 con 0x7fb32005b180 2020-10-31T22:50:01.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb312ffd700 1 -- 172.21.15.60:0/496469297 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3140073a0 con 0x7fb32005b180 2020-10-31T22:50:01.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.549+0000 7fb312ffd700 1 -- 172.21.15.60:0/496469297 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb3140064e0 con 0x7fb32005b180 2020-10-31T22:50:01.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.553+0000 7fb326fb5700 1 -- 172.21.15.60:0/496469297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2fc003340 con 0x7fb32005b180 2020-10-31T22:50:01.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.553+0000 7fb312ffd700 1 -- 172.21.15.60:0/496469297 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb314010070 con 0x7fb32005b180 2020-10-31T22:50:01.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.553+0000 7fb312ffd700 1 --2- 172.21.15.60:0/496469297 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb308054fd0 0x7fb308057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:01.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.553+0000 7fb312ffd700 1 -- 172.21.15.60:0/496469297 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6075+0+0 (secure 0 0 0) 0x7fb31406cfe0 con 0x7fb32005b180 2020-10-31T22:50:01.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.553+0000 7fb3257b2700 1 --2- 172.21.15.60:0/496469297 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb308054fd0 0x7fb308057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:01.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.553+0000 7fb3257b2700 1 --2- 172.21.15.60:0/496469297 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb308054fd0 0x7fb308057490 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fb31c008000 tx=0x7fb31c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:01.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.557+0000 7fb312ffd700 1 -- 172.21.15.60:0/496469297 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb314043400 con 0x7fb32005b180 2020-10-31T22:50:01.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.745+0000 7fb326fb5700 1 -- 172.21.15.60:0/496469297 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb2fc002240 con 0x7fb32005b180 2020-10-31T22:50:01.750 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:50:01.745+0000 7f16c922b700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:50:01.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.753+0000 7fb312ffd700 1 -- 172.21.15.60:0/496469297 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 22 v64) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb314046a20 con 0x7fb32005b180 2020-10-31T22:50:01.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.753+0000 7fb326fb5700 1 -- 172.21.15.60:0/496469297 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb308054fd0 msgr2=0x7fb308057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:01.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.753+0000 7fb326fb5700 1 --2- 172.21.15.60:0/496469297 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb308054fd0 0x7fb308057490 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fb31c008000 tx=0x7fb31c008040).stop 2020-10-31T22:50:01.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.753+0000 7fb326fb5700 1 -- 172.21.15.60:0/496469297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb32005b180 msgr2=0x7fb320145b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:01.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.753+0000 7fb326fb5700 1 --2- 172.21.15.60:0/496469297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb32005b180 0x7fb320145b90 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 rx=0x7fb320061590 tx=0x7fb314007a90).stop 2020-10-31T22:50:01.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.753+0000 7fb326fb5700 1 -- 172.21.15.60:0/496469297 shutdown_connections 2020-10-31T22:50:01.761 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.753+0000 7fb326fb5700 1 --2- 172.21.15.60:0/496469297 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb308054fd0 0x7fb308057490 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:01.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.753+0000 7fb326fb5700 1 --2- 172.21.15.60:0/496469297 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb320060260 0x7fb320143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:01.762 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.753+0000 7fb326fb5700 1 --2- 172.21.15.60:0/496469297 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb32005b180 0x7fb320145b90 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:01.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.753+0000 7fb326fb5700 1 --2- 172.21.15.60:0/496469297 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb32005f900 0x7fb3200af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:01.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.753+0000 7fb326fb5700 1 -- 172.21.15.60:0/496469297 >> 172.21.15.60:0/496469297 conn(0x7fb3200b61d0 msgr2=0x7fb320142da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:01.763 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.753+0000 7fb326fb5700 1 -- 172.21.15.60:0/496469297 shutdown_connections 2020-10-31T22:50:01.764 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:01.753+0000 7fb326fb5700 1 -- 172.21.15.60:0/496469297 wait complete. 2020-10-31T22:50:01.765 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 24 and data pool 22 2020-10-31T22:50:01.776 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:50:01.778 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:01.789 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:01.803 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:01.820 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:01.839 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:50:01.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:01.840 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:01.840 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:01.885 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-10-31T22:50:01.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:50:01.887 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2020-10-31T22:50:01.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:50:01.888 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:01.932 INFO:teuthology.orchestra.run.smithi152.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-10-31T22:50:01.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:50:01.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:01.934 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:01.934 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:01.941 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:50:01.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:50:01.943 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:50:01.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:50:01.944 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:01.990 INFO:teuthology.orchestra.run.smithi085.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:50:01.991 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:50:01.992 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2020-10-31T22:50:02.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 Processor -- start 2020-10-31T22:50:02.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 -- start start 2020-10-31T22:50:02.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4d980ac870 0x7f4d98146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:02.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4d98146550 0x7f4d98150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:02.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d980af900 con 0x7f4d980af520 2020-10-31T22:50:02.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d980afc10 con 0x7f4d980ac870 2020-10-31T22:50:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d9805bb70 con 0x7f4d98146550 2020-10-31T22:50:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9cf1a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4d980af520 0x7f4d98066c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52596/0 (socket says 172.21.15.60:52596) 2020-10-31T22:50:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9cf1a700 1 -- 172.21.15.60:0/4191523114 learned_addr learned my addr 172.21.15.60:0/4191523114 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d97fff700 1 --2- 172.21.15.60:0/4191523114 >> v2:172.21.15.60:3300/0 conn(0x7f4d980ac870 0x7f4d98146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9d71b700 1 --2- 172.21.15.60:0/4191523114 >> v2:172.21.15.66:3300/0 conn(0x7f4d98146550 0x7f4d98150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:02.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d97fff700 1 -- 172.21.15.60:0/4191523114 >> v2:172.21.15.66:3300/0 conn(0x7f4d98146550 msgr2=0x7f4d98150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d97fff700 1 --2- 172.21.15.60:0/4191523114 >> v2:172.21.15.66:3300/0 conn(0x7f4d98146550 0x7f4d98150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d97fff700 1 -- 172.21.15.60:0/4191523114 >> v1:172.21.15.60:6789/0 conn(0x7f4d980af520 legacy=0x7f4d98066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d977fe700 1 -- 172.21.15.60:0/4191523114 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959435904 0 0) 0x7f4d980af900 con 0x7f4d980af520 2020-10-31T22:50:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d97fff700 1 -- 172.21.15.60:0/4191523114 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d980ac130 con 0x7f4d980ac870 2020-10-31T22:50:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d97fff700 1 --2- 172.21.15.60:0/4191523114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d980ac870 0x7f4d98146060 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f4d80002f30 tx=0x7f4d80006dc0).ready entity=mon.0 client_cookie=f5d91adb2983e444 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d977fe700 1 -- 172.21.15.60:0/4191523114 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d800097f0 con 0x7f4d980ac870 2020-10-31T22:50:02.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d977fe700 1 -- 172.21.15.60:0/4191523114 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d80009950 con 0x7f4d980ac870 2020-10-31T22:50:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 -- 172.21.15.60:0/4191523114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d980ac870 msgr2=0x7f4d98146060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d977fe700 1 -- 172.21.15.60:0/4191523114 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d80009cb0 con 0x7f4d980ac870 2020-10-31T22:50:02.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 --2- 172.21.15.60:0/4191523114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d980ac870 0x7f4d98146060 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 rx=0x7f4d80002f30 tx=0x7f4d80006dc0).stop 2020-10-31T22:50:02.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 -- 172.21.15.60:0/4191523114 shutdown_connections 2020-10-31T22:50:02.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 --2- 172.21.15.60:0/4191523114 >> v2:172.21.15.66:3300/0 conn(0x7f4d98146550 0x7f4d98150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 --2- 172.21.15.60:0/4191523114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d980ac870 0x7f4d98146060 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 -- 172.21.15.60:0/4191523114 >> 172.21.15.60:0/4191523114 conn(0x7f4d980b3fd0 msgr2=0x7f4d980b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:02.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 -- 172.21.15.60:0/4191523114 shutdown_connections 2020-10-31T22:50:02.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.117+0000 7f4d9df1c700 1 -- 172.21.15.60:0/4191523114 wait complete. 2020-10-31T22:50:02.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d9df1c700 1 Processor -- start 2020-10-31T22:50:02.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d9df1c700 1 -- start start 2020-10-31T22:50:02.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d9df1c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d980ac870 0x7f4d9814b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:02.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d9df1c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d980af520 0x7f4d981550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d9df1c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d98146550 0x7f4d98155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d9df1c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980a9e50 con 0x7f4d980af520 2020-10-31T22:50:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d9df1c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d98062120 con 0x7f4d980ac870 2020-10-31T22:50:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d9df1c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d980a9bb0 con 0x7f4d98146550 2020-10-31T22:50:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d97fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d980af520 0x7f4d981550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:02.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d97fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d980af520 0x7f4d981550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48468/0 (socket says 172.21.15.60:48468) 2020-10-31T22:50:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d97fff700 1 -- 172.21.15.60:0/1573879892 learned_addr learned my addr 172.21.15.60:0/1573879892 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d9cf1a700 1 --2- 172.21.15.60:0/1573879892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d980ac870 0x7f4d9814b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d9d71b700 1 --2- 172.21.15.60:0/1573879892 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d98146550 0x7f4d98155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d97fff700 1 -- 172.21.15.60:0/1573879892 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d98146550 msgr2=0x7f4d98155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d97fff700 1 --2- 172.21.15.60:0/1573879892 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d98146550 0x7f4d98155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d97fff700 1 -- 172.21.15.60:0/1573879892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d980ac870 msgr2=0x7f4d9814b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d97fff700 1 --2- 172.21.15.60:0/1573879892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d980ac870 0x7f4d9814b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d97fff700 1 -- 172.21.15.60:0/1573879892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d98063060 con 0x7f4d980af520 2020-10-31T22:50:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d97fff700 1 --2- 172.21.15.60:0/1573879892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d980af520 0x7f4d981550a0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f4d80002f30 tx=0x7f4d80015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d95ffb700 1 -- 172.21.15.60:0/1573879892 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d80011ce0 con 0x7f4d980af520 2020-10-31T22:50:02.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d95ffb700 1 -- 172.21.15.60:0/1573879892 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d80011e40 con 0x7f4d980af520 2020-10-31T22:50:02.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d9df1c700 1 -- 172.21.15.60:0/1573879892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d98063300 con 0x7f4d980af520 2020-10-31T22:50:02.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d95ffb700 1 -- 172.21.15.60:0/1573879892 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d8001d640 con 0x7f4d980af520 2020-10-31T22:50:02.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.121+0000 7f4d9df1c700 1 -- 172.21.15.60:0/1573879892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d980ad880 con 0x7f4d980af520 2020-10-31T22:50:02.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.125+0000 7f4d9df1c700 1 -- 172.21.15.60:0/1573879892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d98063490 con 0x7f4d980af520 2020-10-31T22:50:02.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.125+0000 7f4d95ffb700 1 -- 172.21.15.60:0/1573879892 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4d80024030 con 0x7f4d980af520 2020-10-31T22:50:02.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.125+0000 7f4d95ffb700 1 --2- 172.21.15.60:0/1573879892 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d7c054f90 0x7f4d7c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:02.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.125+0000 7f4d9cf1a700 1 --2- 172.21.15.60:0/1573879892 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d7c054f90 0x7f4d7c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:02.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.125+0000 7f4d95ffb700 1 -- 172.21.15.60:0/1573879892 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f4d8006ede0 con 0x7f4d980af520 2020-10-31T22:50:02.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.125+0000 7f4d9cf1a700 1 --2- 172.21.15.60:0/1573879892 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d7c054f90 0x7f4d7c057450 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f4d8800b000 tx=0x7f4d88009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:02.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.129+0000 7f4d95ffb700 1 -- 172.21.15.60:0/1573879892 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4d80045270 con 0x7f4d980af520 2020-10-31T22:50:02.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.265+0000 7f4d9df1c700 1 -- 172.21.15.60:0/1573879892 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4d98057100 con 0x7f4d980af520 2020-10-31T22:50:02.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.273+0000 7f4d95ffb700 1 -- 172.21.15.60:0/1573879892 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4d80022020 con 0x7f4d980af520 2020-10-31T22:50:02.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.277+0000 7f4d9df1c700 1 -- 172.21.15.60:0/1573879892 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d7c054f90 msgr2=0x7f4d7c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:02.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.277+0000 7f4d9df1c700 1 --2- 172.21.15.60:0/1573879892 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d7c054f90 0x7f4d7c057450 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7f4d8800b000 tx=0x7f4d88009040).stop 2020-10-31T22:50:02.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.277+0000 7f4d9df1c700 1 -- 172.21.15.60:0/1573879892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d980af520 msgr2=0x7f4d981550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:02.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.277+0000 7f4d9df1c700 1 --2- 172.21.15.60:0/1573879892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d980af520 0x7f4d981550a0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 rx=0x7f4d80002f30 tx=0x7f4d80015000).stop 2020-10-31T22:50:02.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.277+0000 7f4d9df1c700 1 -- 172.21.15.60:0/1573879892 shutdown_connections 2020-10-31T22:50:02.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.277+0000 7f4d9df1c700 1 --2- 172.21.15.60:0/1573879892 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4d98146550 0x7f4d98155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.277+0000 7f4d9df1c700 1 --2- 172.21.15.60:0/1573879892 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d7c054f90 0x7f4d7c057450 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.277+0000 7f4d9df1c700 1 --2- 172.21.15.60:0/1573879892 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4d980ac870 0x7f4d9814b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.277+0000 7f4d9df1c700 1 --2- 172.21.15.60:0/1573879892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4d980af520 0x7f4d981550a0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.277+0000 7f4d9df1c700 1 -- 172.21.15.60:0/1573879892 >> 172.21.15.60:0/1573879892 conn(0x7f4d980b3fd0 msgr2=0x7f4d980a66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:02.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.277+0000 7f4d9df1c700 1 -- 172.21.15.60:0/1573879892 shutdown_connections 2020-10-31T22:50:02.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.277+0000 7f4d9df1c700 1 -- 172.21.15.60:0/1573879892 wait complete. 2020-10-31T22:50:02.295 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new' 2020-10-31T22:50:02.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.397+0000 7f9b2f1cb700 1 Processor -- start 2020-10-31T22:50:02.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.397+0000 7f9b2f1cb700 1 -- start start 2020-10-31T22:50:02.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.397+0000 7f9b2f1cb700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f9b280b1bb0 0x7f9b2805c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:02.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.397+0000 7f9b2f1cb700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9b280ae630 0x7f9b2813ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:02.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.397+0000 7f9b2f1cb700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2805c800 con 0x7f9b2813f1b0 2020-10-31T22:50:02.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.397+0000 7f9b2f1cb700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2805c5e0 con 0x7f9b280b1bb0 2020-10-31T22:50:02.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.397+0000 7f9b2f1cb700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b280adc50 con 0x7f9b280ae630 2020-10-31T22:50:02.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2e9ca700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9b2813f1b0 0x7f9b280b0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52610/0 (socket says 172.21.15.60:52610) 2020-10-31T22:50:02.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2e9ca700 1 -- 172.21.15.60:0/1581990540 learned_addr learned my addr 172.21.15.60:0/1581990540 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:02.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2e1c9700 1 --2- 172.21.15.60:0/1581990540 >> v2:172.21.15.60:3300/0 conn(0x7f9b280b1bb0 0x7f9b2805c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:02.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2d9c8700 1 --2- 172.21.15.60:0/1581990540 >> v2:172.21.15.66:3300/0 conn(0x7f9b280ae630 0x7f9b2813ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:02.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2d1c7700 1 -- 172.21.15.60:0/1581990540 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334248202 0 0) 0x7f9b2805c800 con 0x7f9b2813f1b0 2020-10-31T22:50:02.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2d1c7700 1 -- 172.21.15.60:0/1581990540 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b10003230 con 0x7f9b2813f1b0 2020-10-31T22:50:02.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2d1c7700 1 -- 172.21.15.60:0/1581990540 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1119212020 0 0) 0x7f9b10003230 con 0x7f9b2813f1b0 2020-10-31T22:50:02.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2e1c9700 1 -- 172.21.15.60:0/1581990540 >> v2:172.21.15.66:3300/0 conn(0x7f9b280ae630 msgr2=0x7f9b2813ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:02.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2e1c9700 1 --2- 172.21.15.60:0/1581990540 >> v2:172.21.15.66:3300/0 conn(0x7f9b280ae630 0x7f9b2813ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2e1c9700 1 -- 172.21.15.60:0/1581990540 >> v1:172.21.15.60:6789/0 conn(0x7f9b2813f1b0 legacy=0x7f9b280b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:02.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2e1c9700 1 -- 172.21.15.60:0/1581990540 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b280adef0 con 0x7f9b280b1bb0 2020-10-31T22:50:02.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2e1c9700 1 --2- 172.21.15.60:0/1581990540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b280b1bb0 0x7f9b2805c0f0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f9b20001bf0 tx=0x7f9b18006dc0).ready entity=mon.0 client_cookie=e3c3e14012e69844 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:02.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2d1c7700 1 -- 172.21.15.60:0/1581990540 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b20001a50 con 0x7f9b280b1bb0 2020-10-31T22:50:02.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2d1c7700 1 -- 172.21.15.60:0/1581990540 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1800d5c0 con 0x7f9b280b1bb0 2020-10-31T22:50:02.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2d1c7700 1 -- 172.21.15.60:0/1581990540 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b1800d730 con 0x7f9b280b1bb0 2020-10-31T22:50:02.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/1581990540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b280b1bb0 msgr2=0x7f9b2805c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:02.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2f1cb700 1 --2- 172.21.15.60:0/1581990540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b280b1bb0 0x7f9b2805c0f0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 rx=0x7f9b20001bf0 tx=0x7f9b18006dc0).stop 2020-10-31T22:50:02.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/1581990540 shutdown_connections 2020-10-31T22:50:02.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2f1cb700 1 --2- 172.21.15.60:0/1581990540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b280b1bb0 0x7f9b2805c0f0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2f1cb700 1 --2- 172.21.15.60:0/1581990540 >> v2:172.21.15.66:3300/0 conn(0x7f9b280ae630 0x7f9b2813ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/1581990540 >> 172.21.15.60:0/1581990540 conn(0x7f9b280b5300 msgr2=0x7f9b280b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:02.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/1581990540 shutdown_connections 2020-10-31T22:50:02.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/1581990540 wait complete. 2020-10-31T22:50:02.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2f1cb700 1 Processor -- start 2020-10-31T22:50:02.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.401+0000 7f9b2f1cb700 1 -- start start 2020-10-31T22:50:02.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2f1cb700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b280b1bb0 0x7f9b280a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:02.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2f1cb700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b2813f1b0 0x7f9b280638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:02.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2f1cb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b280abad0 0x7f9b2813cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:02.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2f1cb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b28154290 con 0x7f9b280abad0 2020-10-31T22:50:02.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2f1cb700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b28062ee0 con 0x7f9b2813f1b0 2020-10-31T22:50:02.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2f1cb700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b28063180 con 0x7f9b280b1bb0 2020-10-31T22:50:02.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2e9ca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b280abad0 0x7f9b2813cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:02.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2e9ca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b280abad0 0x7f9b2813cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48484/0 (socket says 172.21.15.60:48484) 2020-10-31T22:50:02.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2e9ca700 1 -- 172.21.15.60:0/3683274683 learned_addr learned my addr 172.21.15.60:0/3683274683 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:02.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2e1c9700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b280b1bb0 0x7f9b280a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:02.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2d9c8700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b2813f1b0 0x7f9b280638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:02.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2e9ca700 1 -- 172.21.15.60:0/3683274683 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b280b1bb0 msgr2=0x7f9b280a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:02.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2e9ca700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b280b1bb0 0x7f9b280a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2e9ca700 1 -- 172.21.15.60:0/3683274683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b2813f1b0 msgr2=0x7f9b280638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:02.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2e9ca700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b2813f1b0 0x7f9b280638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2e9ca700 1 -- 172.21.15.60:0/3683274683 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b28063420 con 0x7f9b280abad0 2020-10-31T22:50:02.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2d9c8700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b2813f1b0 0x7f9b280638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:02.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2e9ca700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b280abad0 0x7f9b2813cc30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f9b20001cb0 tx=0x7f9b2000cd10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:02.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b177fe700 1 -- 172.21.15.60:0/3683274683 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b20004a80 con 0x7f9b280abad0 2020-10-31T22:50:02.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b177fe700 1 -- 172.21.15.60:0/3683274683 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b20004be0 con 0x7f9b280abad0 2020-10-31T22:50:02.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b177fe700 1 -- 172.21.15.60:0/3683274683 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b20007170 con 0x7f9b280abad0 2020-10-31T22:50:02.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/3683274683 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b28153f10 con 0x7f9b280abad0 2020-10-31T22:50:02.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/3683274683 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2813e880 con 0x7f9b280abad0 2020-10-31T22:50:02.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.405+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/3683274683 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b280635b0 con 0x7f9b280abad0 2020-10-31T22:50:02.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.409+0000 7f9b177fe700 1 -- 172.21.15.60:0/3683274683 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9b20010070 con 0x7f9b280abad0 2020-10-31T22:50:02.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.409+0000 7f9b177fe700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9b08054f10 0x7f9b080573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:02.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.409+0000 7f9b2e1c9700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9b08054f10 0x7f9b080573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:02.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.409+0000 7f9b177fe700 1 -- 172.21.15.60:0/3683274683 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9b2006ddc0 con 0x7f9b280abad0 2020-10-31T22:50:02.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.409+0000 7f9b2e1c9700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9b08054f10 0x7f9b080573d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f9b1801a000 tx=0x7f9b18015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:02.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.413+0000 7f9b177fe700 1 -- 172.21.15.60:0/3683274683 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9b20044290 con 0x7f9b280abad0 2020-10-31T22:50:02.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.605+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/3683274683 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]} v 0) v1 -- 0x7f9b281540a0 con 0x7f9b280abad0 2020-10-31T22:50:02.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.889+0000 7f9b177fe700 1 -- 172.21.15.60:0/3683274683 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_fs_new"]}]=0 v400) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9b200478b0 con 0x7f9b280abad0 2020-10-31T22:50:02.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.893+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/3683274683 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9b08054f10 msgr2=0x7f9b080573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:02.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.893+0000 7f9b2f1cb700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9b08054f10 0x7f9b080573d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7f9b1801a000 tx=0x7f9b18015000).stop 2020-10-31T22:50:02.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.893+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/3683274683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b280abad0 msgr2=0x7f9b2813cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:02.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.893+0000 7f9b2f1cb700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b280abad0 0x7f9b2813cc30 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 rx=0x7f9b20001cb0 tx=0x7f9b2000cd10).stop 2020-10-31T22:50:02.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.893+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/3683274683 shutdown_connections 2020-10-31T22:50:02.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.893+0000 7f9b2f1cb700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9b280abad0 0x7f9b2813cc30 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.893+0000 7f9b2f1cb700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9b280b1bb0 0x7f9b280a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.893+0000 7f9b2f1cb700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9b08054f10 0x7f9b080573d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.893+0000 7f9b2f1cb700 1 --2- 172.21.15.60:0/3683274683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9b2813f1b0 0x7f9b280638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:02.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.893+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/3683274683 >> 172.21.15.60:0/3683274683 conn(0x7f9b280b5300 msgr2=0x7f9b28142050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:02.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.893+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/3683274683 shutdown_connections 2020-10-31T22:50:02.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:02.893+0000 7f9b2f1cb700 1 -- 172.21.15.60:0/3683274683 wait complete. 2020-10-31T22:50:02.917 INFO:tasks.cephfs_test_runner:test_fs_new (tasks.cephfs.test_misc.TestMisc) ... ok 2020-10-31T22:50:02.918 INFO:tasks.cephfs_test_runner:Starting test: test_getattr_caps (tasks.cephfs.test_misc.TestMisc) 2020-10-31T22:50:02.918 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2020-10-31T22:50:03.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.033+0000 7f21ea017700 1 Processor -- start 2020-10-31T22:50:03.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.033+0000 7f21ea017700 1 -- start start 2020-10-31T22:50:03.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21ea017700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21e40b1bb0 0x7f21e405c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:03.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21ea017700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21e40ae630 0x7f21e413ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:03.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21ea017700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e405c800 con 0x7f21e413f1b0 2020-10-31T22:50:03.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21ea017700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e405c5e0 con 0x7f21e40ae630 2020-10-31T22:50:03.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21ea017700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e413f630 con 0x7f21e40b1bb0 2020-10-31T22:50:03.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21e8814700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f21e40ae630 0x7f21e413ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:03.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21e9816700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f21e413f1b0 0x7f21e40b0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52628/0 (socket says 172.21.15.60:52628) 2020-10-31T22:50:03.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21e9816700 1 -- 172.21.15.60:0/1613513983 learned_addr learned my addr 172.21.15.60:0/1613513983 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:03.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21e9015700 1 --2- 172.21.15.60:0/1613513983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21e40b1bb0 0x7f21e405c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:03.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21e8814700 1 -- 172.21.15.60:0/1613513983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21e40b1bb0 msgr2=0x7f21e405c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:03.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21d3fff700 1 -- 172.21.15.60:0/1613513983 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3240475892 0 0) 0x7f21e405c800 con 0x7f21e413f1b0 2020-10-31T22:50:03.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21e8814700 1 --2- 172.21.15.60:0/1613513983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21e40b1bb0 0x7f21e405c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:03.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21e8814700 1 -- 172.21.15.60:0/1613513983 >> v1:172.21.15.60:6789/0 conn(0x7f21e413f1b0 legacy=0x7f21e40b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:03.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21e8814700 1 -- 172.21.15.60:0/1613513983 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e40adc50 con 0x7f21e40ae630 2020-10-31T22:50:03.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21e8814700 1 --2- 172.21.15.60:0/1613513983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21e40ae630 0x7f21e413ecc0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f21d4002f30 tx=0x7f21d4006dc0).ready entity=mon.0 client_cookie=5a1263d3726778a0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:03.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21d3fff700 1 -- 172.21.15.60:0/1613513983 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21d4009760 con 0x7f21e40ae630 2020-10-31T22:50:03.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21d3fff700 1 -- 172.21.15.60:0/1613513983 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d40098c0 con 0x7f21e40ae630 2020-10-31T22:50:03.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21d3fff700 1 -- 172.21.15.60:0/1613513983 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21d4009c20 con 0x7f21e40ae630 2020-10-31T22:50:03.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21ea017700 1 -- 172.21.15.60:0/1613513983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21e40ae630 msgr2=0x7f21e413ecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:03.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.037+0000 7f21ea017700 1 --2- 172.21.15.60:0/1613513983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21e40ae630 0x7f21e413ecc0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 rx=0x7f21d4002f30 tx=0x7f21d4006dc0).stop 2020-10-31T22:50:03.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.041+0000 7f21ea017700 1 -- 172.21.15.60:0/1613513983 shutdown_connections 2020-10-31T22:50:03.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.041+0000 7f21ea017700 1 --2- 172.21.15.60:0/1613513983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21e40b1bb0 0x7f21e405c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:03.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.041+0000 7f21ea017700 1 --2- 172.21.15.60:0/1613513983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21e40ae630 0x7f21e413ecc0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:03.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.041+0000 7f21ea017700 1 -- 172.21.15.60:0/1613513983 >> 172.21.15.60:0/1613513983 conn(0x7f21e40b5300 msgr2=0x7f21e40b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:03.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.041+0000 7f21ea017700 1 -- 172.21.15.60:0/1613513983 shutdown_connections 2020-10-31T22:50:03.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.041+0000 7f21ea017700 1 -- 172.21.15.60:0/1613513983 wait complete. 2020-10-31T22:50:03.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.041+0000 7f21ea017700 1 Processor -- start 2020-10-31T22:50:03.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.041+0000 7f21ea017700 1 -- start start 2020-10-31T22:50:03.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21ea017700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21e40b1bb0 0x7f21e4145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:03.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21ea017700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21e413f1b0 0x7f21e4151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:03.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21ea017700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21e414f180 0x7f21e413b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:03.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21ea017700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e414e850 con 0x7f21e413f1b0 2020-10-31T22:50:03.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21ea017700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e41522d0 con 0x7f21e414f180 2020-10-31T22:50:03.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21ea017700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e4063ea0 con 0x7f21e40b1bb0 2020-10-31T22:50:03.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21e8814700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21e413f1b0 0x7f21e4151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:03.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21e8814700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21e413f1b0 0x7f21e4151de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48496/0 (socket says 172.21.15.60:48496) 2020-10-31T22:50:03.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21e8814700 1 -- 172.21.15.60:0/3033174316 learned_addr learned my addr 172.21.15.60:0/3033174316 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:03.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21e9015700 1 --2- 172.21.15.60:0/3033174316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21e40b1bb0 0x7f21e4145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:03.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21e9816700 1 --2- 172.21.15.60:0/3033174316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21e414f180 0x7f21e413b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:03.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21e8814700 1 -- 172.21.15.60:0/3033174316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21e40b1bb0 msgr2=0x7f21e4145f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:03.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21e8814700 1 --2- 172.21.15.60:0/3033174316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21e40b1bb0 0x7f21e4145f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:03.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21e8814700 1 -- 172.21.15.60:0/3033174316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21e414f180 msgr2=0x7f21e413b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:03.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21e8814700 1 --2- 172.21.15.60:0/3033174316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21e414f180 0x7f21e413b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:03.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21e8814700 1 -- 172.21.15.60:0/3033174316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e414ea40 con 0x7f21e413f1b0 2020-10-31T22:50:03.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21e8814700 1 --2- 172.21.15.60:0/3033174316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21e413f1b0 0x7f21e4151de0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f21e409e320 tx=0x7f21d4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:03.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21d27fc700 1 -- 172.21.15.60:0/3033174316 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21d4011a00 con 0x7f21e413f1b0 2020-10-31T22:50:03.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21d27fc700 1 -- 172.21.15.60:0/3033174316 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d4011b60 con 0x7f21e413f1b0 2020-10-31T22:50:03.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21ea017700 1 -- 172.21.15.60:0/3033174316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e414ece0 con 0x7f21e413f1b0 2020-10-31T22:50:03.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21d27fc700 1 -- 172.21.15.60:0/3033174316 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21d401d440 con 0x7f21e413f1b0 2020-10-31T22:50:03.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21ea017700 1 -- 172.21.15.60:0/3033174316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e4064760 con 0x7f21e413f1b0 2020-10-31T22:50:03.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21ea017700 1 -- 172.21.15.60:0/3033174316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e414eea0 con 0x7f21e413f1b0 2020-10-31T22:50:03.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.045+0000 7f21d27fc700 1 -- 172.21.15.60:0/3033174316 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f21d4024030 con 0x7f21e413f1b0 2020-10-31T22:50:03.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.049+0000 7f21d27fc700 1 --2- 172.21.15.60:0/3033174316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f21c4054f10 0x7f21c40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:03.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.049+0000 7f21e9015700 1 --2- 172.21.15.60:0/3033174316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f21c4054f10 0x7f21c40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:03.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.049+0000 7f21d27fc700 1 -- 172.21.15.60:0/3033174316 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f21d406e990 con 0x7f21e413f1b0 2020-10-31T22:50:03.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.049+0000 7f21e9015700 1 --2- 172.21.15.60:0/3033174316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f21c4054f10 0x7f21c40573d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f21e000b000 tx=0x7f21e0006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:03.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.053+0000 7f21d27fc700 1 -- 172.21.15.60:0/3033174316 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f21d4044e60 con 0x7f21e413f1b0 2020-10-31T22:50:03.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.249+0000 7f21ea017700 1 -- 172.21.15.60:0/3033174316 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f21e4057100 con 0x7f21e413f1b0 2020-10-31T22:50:03.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.893+0000 7f21d27fc700 1 -- 172.21.15.60:0/3033174316 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v401) v1 ==== 131+0+0 (secure 0 0 0) 0x7f21d4022020 con 0x7f21e413f1b0 2020-10-31T22:50:03.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.897+0000 7f21ea017700 1 -- 172.21.15.60:0/3033174316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f21c4054f10 msgr2=0x7f21c40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:03.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.897+0000 7f21ea017700 1 --2- 172.21.15.60:0/3033174316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f21c4054f10 0x7f21c40573d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f21e000b000 tx=0x7f21e0006dc0).stop 2020-10-31T22:50:03.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.897+0000 7f21ea017700 1 -- 172.21.15.60:0/3033174316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21e413f1b0 msgr2=0x7f21e4151de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:03.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.897+0000 7f21ea017700 1 --2- 172.21.15.60:0/3033174316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21e413f1b0 0x7f21e4151de0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 rx=0x7f21e409e320 tx=0x7f21d4015000).stop 2020-10-31T22:50:03.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.897+0000 7f21ea017700 1 -- 172.21.15.60:0/3033174316 shutdown_connections 2020-10-31T22:50:03.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.897+0000 7f21ea017700 1 --2- 172.21.15.60:0/3033174316 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f21c4054f10 0x7f21c40573d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:03.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.897+0000 7f21ea017700 1 --2- 172.21.15.60:0/3033174316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21e414f180 0x7f21e413b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:03.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.897+0000 7f21ea017700 1 --2- 172.21.15.60:0/3033174316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21e40b1bb0 0x7f21e4145f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:03.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.897+0000 7f21ea017700 1 --2- 172.21.15.60:0/3033174316 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21e413f1b0 0x7f21e4151de0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:03.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.897+0000 7f21ea017700 1 -- 172.21.15.60:0/3033174316 >> 172.21.15.60:0/3033174316 conn(0x7f21e40b5300 msgr2=0x7f21e40b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:03.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.897+0000 7f21ea017700 1 -- 172.21.15.60:0/3033174316 shutdown_connections 2020-10-31T22:50:03.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:03.897+0000 7f21ea017700 1 -- 172.21.15.60:0/3033174316 wait complete. 2020-10-31T22:50:03.919 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2020-10-31T22:50:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.037+0000 7f9e4221d700 1 Processor -- start 2020-10-31T22:50:04.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.037+0000 7f9e4221d700 1 -- start start 2020-10-31T22:50:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.037+0000 7f9e4221d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9e3c05c660 0x7f9e3c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:04.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.037+0000 7f9e4221d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3c065f70 0x7f9e3c13f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:04.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.037+0000 7f9e4221d700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3c066410 con 0x7f9e3c13f880 2020-10-31T22:50:04.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.037+0000 7f9e4221d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c066d60 con 0x7f9e3c05c660 2020-10-31T22:50:04.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.037+0000 7f9e4221d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0b5e80 con 0x7f9e3c065f70 2020-10-31T22:50:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e32ffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3c065f70 0x7f9e3c13f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e3b7fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9e3c05c660 0x7f9e3c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e32ffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3c065f70 0x7f9e3c13f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:33460/0 (socket says 172.21.15.60:33460) 2020-10-31T22:50:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e32ffd700 1 -- 172.21.15.60:0/538977113 learned_addr learned my addr 172.21.15.60:0/538977113 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e3bfff700 1 --1- 172.21.15.60:0/538977113 >> v1:172.21.15.66:6789/0 conn(0x7f9e3c13f880 0x7f9e3c142610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:50510/0 (socket says 172.21.15.60:50510) 2020-10-31T22:50:04.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e32ffd700 1 -- 172.21.15.60:0/538977113 >> v2:172.21.15.66:3300/0 conn(0x7f9e3c05c660 msgr2=0x7f9e3c0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:04.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e32ffd700 1 --2- 172.21.15.60:0/538977113 >> v2:172.21.15.66:3300/0 conn(0x7f9e3c05c660 0x7f9e3c0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e32ffd700 1 -- 172.21.15.60:0/538977113 >> v1:172.21.15.66:6789/0 conn(0x7f9e3c13f880 legacy=0x7f9e3c142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:04.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e3affd700 1 -- 172.21.15.60:0/538977113 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3853347584 0 0) 0x7f9e3c066410 con 0x7f9e3c13f880 2020-10-31T22:50:04.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e32ffd700 1 -- 172.21.15.60:0/538977113 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c0666b0 con 0x7f9e3c065f70 2020-10-31T22:50:04.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e3b7fe700 1 --2- 172.21.15.60:0/538977113 >> v2:172.21.15.66:3300/0 conn(0x7f9e3c05c660 0x7f9e3c0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:04.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e32ffd700 1 --2- 172.21.15.60:0/538977113 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3c065f70 0x7f9e3c13f390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f9e24002f30 tx=0x7f9e24006e80).ready entity=mon.2 client_cookie=7d0028c736eba8a2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:04.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e3affd700 1 -- 172.21.15.60:0/538977113 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e240097f0 con 0x7f9e3c065f70 2020-10-31T22:50:04.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e3affd700 1 -- 172.21.15.60:0/538977113 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e24009950 con 0x7f9e3c065f70 2020-10-31T22:50:04.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e3affd700 1 -- 172.21.15.60:0/538977113 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e24009cb0 con 0x7f9e3c065f70 2020-10-31T22:50:04.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e4221d700 1 -- 172.21.15.60:0/538977113 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3c065f70 msgr2=0x7f9e3c13f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:04.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e4221d700 1 --2- 172.21.15.60:0/538977113 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3c065f70 0x7f9e3c13f390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f9e24002f30 tx=0x7f9e24006e80).stop 2020-10-31T22:50:04.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e4221d700 1 -- 172.21.15.60:0/538977113 shutdown_connections 2020-10-31T22:50:04.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e4221d700 1 --2- 172.21.15.60:0/538977113 >> v2:172.21.15.66:3300/0 conn(0x7f9e3c05c660 0x7f9e3c0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e4221d700 1 --2- 172.21.15.60:0/538977113 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3c065f70 0x7f9e3c13f390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e4221d700 1 -- 172.21.15.60:0/538977113 >> 172.21.15.60:0/538977113 conn(0x7f9e3c0601e0 msgr2=0x7f9e3c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:04.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e4221d700 1 -- 172.21.15.60:0/538977113 shutdown_connections 2020-10-31T22:50:04.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.041+0000 7f9e4221d700 1 -- 172.21.15.60:0/538977113 wait complete. 2020-10-31T22:50:04.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e4221d700 1 Processor -- start 2020-10-31T22:50:04.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e4221d700 1 -- start start 2020-10-31T22:50:04.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e4221d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3c05c660 0x7f9e3c0b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:04.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e4221d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e3c065f70 0x7f9e3c147ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:04.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e4221d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e3c13f880 0x7f9e3c148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:04.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e4221d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c141fe0 con 0x7f9e3c13f880 2020-10-31T22:50:04.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e4221d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c13e940 con 0x7f9e3c065f70 2020-10-31T22:50:04.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e4221d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c0ae540 con 0x7f9e3c05c660 2020-10-31T22:50:04.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e3bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e3c13f880 0x7f9e3c148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:04.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e3bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e3c13f880 0x7f9e3c148090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48512/0 (socket says 172.21.15.60:48512) 2020-10-31T22:50:04.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e3bfff700 1 -- 172.21.15.60:0/3319235181 learned_addr learned my addr 172.21.15.60:0/3319235181 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:04.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e32ffd700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e3c065f70 0x7f9e3c147ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:04.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e3b7fe700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3c05c660 0x7f9e3c0b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:04.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e3bfff700 1 -- 172.21.15.60:0/3319235181 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3c05c660 msgr2=0x7f9e3c0b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:04.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e3bfff700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3c05c660 0x7f9e3c0b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e3bfff700 1 -- 172.21.15.60:0/3319235181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e3c065f70 msgr2=0x7f9e3c147ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:04.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e3bfff700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e3c065f70 0x7f9e3c147ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e3bfff700 1 -- 172.21.15.60:0/3319235181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c0ae7e0 con 0x7f9e3c13f880 2020-10-31T22:50:04.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e32ffd700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e3c065f70 0x7f9e3c147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:04.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.045+0000 7f9e3b7fe700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3c05c660 0x7f9e3c0b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:04.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.049+0000 7f9e3bfff700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e3c13f880 0x7f9e3c148090 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7f9e34000f00 tx=0x7f9e34007c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:04.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.049+0000 7f9e397fa700 1 -- 172.21.15.60:0/3319235181 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e340058a0 con 0x7f9e3c13f880 2020-10-31T22:50:04.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.049+0000 7f9e397fa700 1 -- 172.21.15.60:0/3319235181 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e34005a00 con 0x7f9e3c13f880 2020-10-31T22:50:04.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.049+0000 7f9e4221d700 1 -- 172.21.15.60:0/3319235181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3c147700 con 0x7f9e3c13f880 2020-10-31T22:50:04.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.049+0000 7f9e397fa700 1 -- 172.21.15.60:0/3319235181 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9e34005d60 con 0x7f9e3c13f880 2020-10-31T22:50:04.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.049+0000 7f9e4221d700 1 -- 172.21.15.60:0/3319235181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c148580 con 0x7f9e3c13f880 2020-10-31T22:50:04.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.049+0000 7f9e4221d700 1 -- 172.21.15.60:0/3319235181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3c0b23c0 con 0x7f9e3c13f880 2020-10-31T22:50:04.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.049+0000 7f9e397fa700 1 -- 172.21.15.60:0/3319235181 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9e34010030 con 0x7f9e3c13f880 2020-10-31T22:50:04.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.049+0000 7f9e397fa700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9e20054f10 0x7f9e200573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:04.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.049+0000 7f9e397fa700 1 -- 172.21.15.60:0/3319235181 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f9e3406d950 con 0x7f9e3c13f880 2020-10-31T22:50:04.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.049+0000 7f9e3b7fe700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9e20054f10 0x7f9e200573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:04.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.049+0000 7f9e3b7fe700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9e20054f10 0x7f9e200573d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f9e2c00b000 tx=0x7f9e2c006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:04.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.057+0000 7f9e397fa700 1 -- 172.21.15.60:0/3319235181 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9e3c0b23c0 con 0x7f9e3c13f880 2020-10-31T22:50:04.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.201+0000 7f9e4221d700 1 -- 172.21.15.60:0/3319235181 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7f9e3c0ae3a0 con 0x7f9e3c13f880 2020-10-31T22:50:04.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.209+0000 7f9e397fa700 1 -- 172.21.15.60:0/3319235181 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9e3c0ae3a0 con 0x7f9e3c13f880 2020-10-31T22:50:04.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.209+0000 7f9e4221d700 1 -- 172.21.15.60:0/3319235181 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9e20054f10 msgr2=0x7f9e200573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:04.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.209+0000 7f9e4221d700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9e20054f10 0x7f9e200573d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f9e2c00b000 tx=0x7f9e2c006dc0).stop 2020-10-31T22:50:04.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.209+0000 7f9e4221d700 1 -- 172.21.15.60:0/3319235181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e3c13f880 msgr2=0x7f9e3c148090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:04.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.209+0000 7f9e4221d700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e3c13f880 0x7f9e3c148090 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 rx=0x7f9e34000f00 tx=0x7f9e34007c50).stop 2020-10-31T22:50:04.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.209+0000 7f9e4221d700 1 -- 172.21.15.60:0/3319235181 shutdown_connections 2020-10-31T22:50:04.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.209+0000 7f9e4221d700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e3c13f880 0x7f9e3c148090 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.209+0000 7f9e4221d700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3c05c660 0x7f9e3c0b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.209+0000 7f9e4221d700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9e20054f10 0x7f9e200573d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.209+0000 7f9e4221d700 1 --2- 172.21.15.60:0/3319235181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e3c065f70 0x7f9e3c147ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.209+0000 7f9e4221d700 1 -- 172.21.15.60:0/3319235181 >> 172.21.15.60:0/3319235181 conn(0x7f9e3c0601e0 msgr2=0x7f9e3c0b7470 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:04.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.209+0000 7f9e4221d700 1 -- 172.21.15.60:0/3319235181 shutdown_connections 2020-10-31T22:50:04.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.213+0000 7f9e4221d700 1 -- 172.21.15.60:0/3319235181 wait complete. 2020-10-31T22:50:04.230 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:50:04.231 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:04.255 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:04.275 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:04.312 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:04.334 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:50:04.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:04.335 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:04.336 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:04.389 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-10-31T22:50:04.390 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:50:04.391 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2020-10-31T22:50:04.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:04.393 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:04.396 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:04.424 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:50:04.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:50:04.426 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:50:04.426 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-10-31T22:50:04.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.545+0000 7f8b4bfff700 1 Processor -- start 2020-10-31T22:50:04.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.545+0000 7f8b4bfff700 1 -- start start 2020-10-31T22:50:04.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4bfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8b4c063140 0x7f8b4c0b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:04.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b4c0b2820 0x7f8b4c0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:04.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4bfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c1459c0 con 0x7f8b4c0b1000 2020-10-31T22:50:04.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4bfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c0b2060 con 0x7f8b4c0b2820 2020-10-31T22:50:04.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4bfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c063520 con 0x7f8b4c063140 2020-10-31T22:50:04.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4b7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b4c0b2820 0x7f8b4c0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:04.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4a7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8b4c0b1000 0x7f8b4c1452b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52654/0 (socket says 172.21.15.60:52654) 2020-10-31T22:50:04.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4a7fc700 1 -- 172.21.15.60:0/3711725651 learned_addr learned my addr 172.21.15.60:0/3711725651 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:04.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4affd700 1 --2- 172.21.15.60:0/3711725651 >> v2:172.21.15.66:3300/0 conn(0x7f8b4c063140 0x7f8b4c0b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:04.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b49ffb700 1 -- 172.21.15.60:0/3711725651 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293397119 0 0) 0x7f8b4c1459c0 con 0x7f8b4c0b1000 2020-10-31T22:50:04.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b49ffb700 1 -- 172.21.15.60:0/3711725651 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b30003230 con 0x7f8b4c0b1000 2020-10-31T22:50:04.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4b7fe700 1 -- 172.21.15.60:0/3711725651 >> v2:172.21.15.66:3300/0 conn(0x7f8b4c063140 msgr2=0x7f8b4c0b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:04.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4b7fe700 1 --2- 172.21.15.60:0/3711725651 >> v2:172.21.15.66:3300/0 conn(0x7f8b4c063140 0x7f8b4c0b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4b7fe700 1 -- 172.21.15.60:0/3711725651 >> v1:172.21.15.60:6789/0 conn(0x7f8b4c0b1000 legacy=0x7f8b4c1452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:04.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b49ffb700 1 -- 172.21.15.60:0/3711725651 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 824612030 0 0) 0x7f8b30003230 con 0x7f8b4c0b1000 2020-10-31T22:50:04.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4b7fe700 1 -- 172.21.15.60:0/3711725651 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c0b02e0 con 0x7f8b4c0b2820 2020-10-31T22:50:04.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4affd700 1 --2- 172.21.15.60:0/3711725651 >> v2:172.21.15.66:3300/0 conn(0x7f8b4c063140 0x7f8b4c0b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:04.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4b7fe700 1 --2- 172.21.15.60:0/3711725651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4c0b2820 0x7f8b4c0aeda0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f8b40001870 tx=0x7f8b440091a0).ready entity=mon.0 client_cookie=7804837e8099816b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:04.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b49ffb700 1 -- 172.21.15.60:0/3711725651 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b400016d0 con 0x7f8b4c0b2820 2020-10-31T22:50:04.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b49ffb700 1 -- 172.21.15.60:0/3711725651 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4400b890 con 0x7f8b4c0b2820 2020-10-31T22:50:04.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b49ffb700 1 -- 172.21.15.60:0/3711725651 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b4400ba00 con 0x7f8b4c0b2820 2020-10-31T22:50:04.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4bfff700 1 -- 172.21.15.60:0/3711725651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4c0b2820 msgr2=0x7f8b4c0aeda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:04.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4bfff700 1 --2- 172.21.15.60:0/3711725651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4c0b2820 0x7f8b4c0aeda0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 rx=0x7f8b40001870 tx=0x7f8b440091a0).stop 2020-10-31T22:50:04.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4bfff700 1 -- 172.21.15.60:0/3711725651 shutdown_connections 2020-10-31T22:50:04.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4bfff700 1 --2- 172.21.15.60:0/3711725651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4c0b2820 0x7f8b4c0aeda0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4bfff700 1 --2- 172.21.15.60:0/3711725651 >> v2:172.21.15.66:3300/0 conn(0x7f8b4c063140 0x7f8b4c0b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4bfff700 1 -- 172.21.15.60:0/3711725651 >> 172.21.15.60:0/3711725651 conn(0x7f8b4c06a600 msgr2=0x7f8b4c060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4bfff700 1 -- 172.21.15.60:0/3711725651 shutdown_connections 2020-10-31T22:50:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.549+0000 7f8b4bfff700 1 -- 172.21.15.60:0/3711725651 wait complete. 2020-10-31T22:50:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4bfff700 1 Processor -- start 2020-10-31T22:50:04.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4bfff700 1 -- start start 2020-10-31T22:50:04.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b4c063140 0x7f8b4c150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:04.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4c0b1000 0x7f8b4c0a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:04.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c0b2820 0x7f8b4c0aa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:04.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c064490 con 0x7f8b4c0b1000 2020-10-31T22:50:04.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4bfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0aa440 con 0x7f8b4c063140 2020-10-31T22:50:04.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0aa6e0 con 0x7f8b4c0b2820 2020-10-31T22:50:04.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4c0b1000 0x7f8b4c0a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:04.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4a7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4c0b1000 0x7f8b4c0a98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48524/0 (socket says 172.21.15.60:48524) 2020-10-31T22:50:04.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4a7fc700 1 -- 172.21.15.60:0/2912332697 learned_addr learned my addr 172.21.15.60:0/2912332697 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:04.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4b7fe700 1 --2- 172.21.15.60:0/2912332697 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c0b2820 0x7f8b4c0aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:04.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4affd700 1 --2- 172.21.15.60:0/2912332697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b4c063140 0x7f8b4c150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:04.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4a7fc700 1 -- 172.21.15.60:0/2912332697 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c0b2820 msgr2=0x7f8b4c0aa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:04.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4a7fc700 1 --2- 172.21.15.60:0/2912332697 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c0b2820 0x7f8b4c0aa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4a7fc700 1 -- 172.21.15.60:0/2912332697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b4c063140 msgr2=0x7f8b4c150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:04.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4a7fc700 1 --2- 172.21.15.60:0/2912332697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b4c063140 0x7f8b4c150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4a7fc700 1 -- 172.21.15.60:0/2912332697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c150e50 con 0x7f8b4c0b1000 2020-10-31T22:50:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4a7fc700 1 --2- 172.21.15.60:0/2912332697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4c0b1000 0x7f8b4c0a98a0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f8b400014a0 tx=0x7f8b40001ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b3bfff700 1 -- 172.21.15.60:0/2912332697 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b40007170 con 0x7f8b4c0b1000 2020-10-31T22:50:04.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b3bfff700 1 -- 172.21.15.60:0/2912332697 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b400072d0 con 0x7f8b4c0b1000 2020-10-31T22:50:04.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4bfff700 1 -- 172.21.15.60:0/2912332697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c0a9d90 con 0x7f8b4c0b1000 2020-10-31T22:50:04.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b3bfff700 1 -- 172.21.15.60:0/2912332697 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b4000a9a0 con 0x7f8b4c0b1000 2020-10-31T22:50:04.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4bfff700 1 -- 172.21.15.60:0/2912332697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c0aae70 con 0x7f8b4c0b1000 2020-10-31T22:50:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.553+0000 7f8b4bfff700 1 -- 172.21.15.60:0/2912332697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c0645d0 con 0x7f8b4c0b1000 2020-10-31T22:50:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.557+0000 7f8b3bfff700 1 -- 172.21.15.60:0/2912332697 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8b40010070 con 0x7f8b4c0b1000 2020-10-31T22:50:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.557+0000 7f8b3bfff700 1 --2- 172.21.15.60:0/2912332697 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b28054f10 0x7f8b280573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:04.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.557+0000 7f8b3bfff700 1 -- 172.21.15.60:0/2912332697 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8b4006d8b0 con 0x7f8b4c0b1000 2020-10-31T22:50:04.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.557+0000 7f8b4affd700 1 --2- 172.21.15.60:0/2912332697 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b28054f10 0x7f8b280573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:04.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.557+0000 7f8b4affd700 1 --2- 172.21.15.60:0/2912332697 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b28054f10 0x7f8b280573d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f8b3c00b000 tx=0x7f8b3c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:04.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.565+0000 7f8b3bfff700 1 -- 172.21.15.60:0/2912332697 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8b40043d80 con 0x7f8b4c0b1000 2020-10-31T22:50:04.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.709+0000 7f8b4bfff700 1 -- 172.21.15.60:0/2912332697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8b4c057100 con 0x7f8b4c0b1000 2020-10-31T22:50:04.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.713+0000 7f8b3bfff700 1 -- 172.21.15.60:0/2912332697 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v132) v1 ==== 81+0+33811 (secure 0 0 0) 0x7f8b400473a0 con 0x7f8b4c0b1000 2020-10-31T22:50:04.718 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:04.718 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:50:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 132, 2020-10-31T22:50:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "226f905a-1517-4a8c-8009-08779515965c", 2020-10-31T22:50:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2020-10-31T22:40:51.928572+0000", 2020-10-31T22:50:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2020-10-31T22:50:02.753359+0000", 2020-10-31T22:50:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:50:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:50:04.719 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-10-31T22:50:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2020-10-31T22:50:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2020-10-31T22:50:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2020-10-31T22:50:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2020-10-31T22:50:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2020-10-31T22:50:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2020-10-31T22:50:04.720 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:50:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2020-10-31T22:50:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2020-10-31T22:50:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-10-31T22:50:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2020-10-31T22:50:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2020-10-31T22:50:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 24, 2020-10-31T22:50:04.721 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2020-10-31T22:50:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "jewel", 2020-10-31T22:50:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2020-10-31T22:50:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "octopus", 2020-10-31T22:50:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:50:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2020-10-31T22:50:04.722 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "device_health_metrics", 2020-10-31T22:50:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:40:55.846143+0000", 2020-10-31T22:50:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:50:04.723 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:50:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:50:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:50:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:50:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:50:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:50:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:50:04.724 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2020-10-31T22:50:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2020-10-31T22:50:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2020-10-31T22:50:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2020-10-31T22:50:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2020-10-31T22:50:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:50:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:50:04.725 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:50:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:50:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:50:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:50:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:50:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "15", 2020-10-31T22:50:04.726 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:50:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:50:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:50:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:50:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:50:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:50:04.727 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:50:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:50:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:50:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:50:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:50:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:50:04.728 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:50:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:50:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:50:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:50:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:50:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:50:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:50:04.729 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:50:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:50:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:50:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:50:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:50:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:50:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:50:04.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:50:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:50:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:50:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:50:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:50:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:50:04.731 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:50:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:50:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:50:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:50:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:50:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:50:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2020-10-31T22:50:04.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:50:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_devicehealth": {} 2020-10-31T22:50:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2020-10-31T22:50:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2020-10-31T22:50:04.733 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:05.358501+0000", 2020-10-31T22:50:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:50:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:50:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:50:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:50:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:50:04.734 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:50:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:50:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:50:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:50:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:50:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:50:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:50:04.735 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:50:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:50:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:50:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:50:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:50:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:50:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:50:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:50:04.736 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "18", 2020-10-31T22:50:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:50:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:50:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:50:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:50:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:50:04.737 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:50:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:50:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:50:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:50:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:50:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:50:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:50:04.738 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:50:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:50:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:50:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:50:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:50:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:50:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:50:04.739 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:50:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:50:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:50:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:50:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:50:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:50:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:50:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.740 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:50:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:50:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:50:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:50:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:50:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:50:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:50:04.741 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:50:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:50:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:50:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:50:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:50:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:50:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2020-10-31T22:50:04.742 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 22, 2020-10-31T22:50:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2020-10-31T22:50:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:49:28.431362+0000", 2020-10-31T22:50:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:50:04.743 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:50:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:50:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:50:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:50:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:50:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:50:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:50:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:50:04.744 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:50:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:50:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:50:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:50:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:50:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:50:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:50:04.745 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:50:04.746 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:50:04.746 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:50:04.746 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:50:04.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.746 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "131", 2020-10-31T22:50:04.746 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:50:04.746 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:50:04.747 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:50:04.747 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:50:04.747 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:50:04.747 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:50:04.747 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:50:04.747 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:50:04.747 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:50:04.748 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:50:04.748 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:50:04.748 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:50:04.748 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:50:04.748 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:50:04.749 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:50:04.749 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:50:04.749 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:50:04.749 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:50:04.749 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:50:04.749 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:50:04.749 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:50:04.750 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:50:04.750 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:50:04.750 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:50:04.750 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:50:04.750 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:50:04.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.750 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:50:04.750 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:50:04.751 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:50:04.751 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:50:04.751 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:50:04.751 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:50:04.751 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:50:04.751 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:50:04.751 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:50:04.752 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:50:04.752 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:50:04.752 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:50:04.752 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:50:04.752 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:50:04.752 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2020-10-31T22:50:04.752 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 24, 2020-10-31T22:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2020-10-31T22:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:50:00.768736+0000", 2020-10-31T22:50:04.753 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:50:04.754 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:50:04.755 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "132", 2020-10-31T22:50:04.756 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:50:04.757 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:50:04.758 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:50:04.759 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.760 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:50:04.761 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:50:04.761 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:50:04.761 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:50:04.762 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:50:04.762 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:50:04.762 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:50:04.762 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:50:04.762 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:50:04.762 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:50:04.762 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:50:04.763 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:50:04.763 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2020-10-31T22:50:04.763 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2020-10-31T22:50:04.763 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2020-10-31T22:50:04.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.763 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:50:04.763 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:50:04.764 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2020-10-31T22:50:04.764 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.764 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.764 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.764 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:50:04.764 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2020-10-31T22:50:04.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.765 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:50:04.765 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", 2020-10-31T22:50:04.765 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:04.765 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:04.765 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:04.765 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:04.765 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:04.766 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:04.766 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:04.766 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2020-10-31T22:50:04.766 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:04.766 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:04.767 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:04.767 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.768 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.768 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.768 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2020-10-31T22:50:04.768 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:04.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.769 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.769 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.769 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2020-10-31T22:50:04.769 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:04.769 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.769 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.770 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:04.770 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.770 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.770 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2020-10-31T22:50:04.770 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:04.770 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.771 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.771 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.771 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2020-10-31T22:50:04.771 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:04.771 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.771 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.771 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.772 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:04.772 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.772 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2020-10-31T22:50:04.772 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:04.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.773 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.773 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.773 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2020-10-31T22:50:04.773 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:04.773 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.773 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.774 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:04.774 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.774 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.774 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2020-10-31T22:50:04.775 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:04.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.775 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2020-10-31T22:50:04.775 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:04.775 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.776 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.776 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6803/14302", 2020-10-31T22:50:04.776 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6805/14302", 2020-10-31T22:50:04.776 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6809/14302", 2020-10-31T22:50:04.776 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6807/14302", 2020-10-31T22:50:04.776 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:04.777 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:04.777 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:04.777 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.777 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.777 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:50:04.777 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", 2020-10-31T22:50:04.777 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:04.778 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:04.778 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:04.778 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:04.778 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:04.778 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:04.779 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:04.779 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2020-10-31T22:50:04.779 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:04.779 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:04.779 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:04.779 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.779 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.780 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.780 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2020-10-31T22:50:04.780 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:04.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.780 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.780 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.780 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2020-10-31T22:50:04.781 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:04.781 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.781 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.781 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.781 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:04.781 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.781 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.782 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2020-10-31T22:50:04.782 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:04.782 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.782 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.782 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.782 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2020-10-31T22:50:04.782 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:04.783 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.783 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.783 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:04.783 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2020-10-31T22:50:04.784 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:04.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.784 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2020-10-31T22:50:04.784 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:04.785 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.785 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.785 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:04.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2020-10-31T22:50:04.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:04.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.786 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2020-10-31T22:50:04.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:04.786 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.787 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.787 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/14300", 2020-10-31T22:50:04.787 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6813/14300", 2020-10-31T22:50:04.787 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6817/14300", 2020-10-31T22:50:04.787 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6815/14300", 2020-10-31T22:50:04.787 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:04.788 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:04.788 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:04.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.788 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.788 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:50:04.788 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", 2020-10-31T22:50:04.788 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:04.789 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:04.789 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:04.789 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:04.789 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:04.789 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:04.789 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:04.789 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 125, 2020-10-31T22:50:04.790 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:04.790 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:04.790 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:04.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.790 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2020-10-31T22:50:04.790 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:04.791 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.791 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.791 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.791 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2020-10-31T22:50:04.791 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:04.791 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.791 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.792 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:04.792 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.792 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.793 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2020-10-31T22:50:04.793 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:04.794 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.794 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.795 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2020-10-31T22:50:04.795 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:04.795 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.796 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.796 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:04.796 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.797 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6832", 2020-10-31T22:50:04.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:04.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6833", 2020-10-31T22:50:04.799 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:04.800 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.800 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.801 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:04.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2020-10-31T22:50:04.803 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:04.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.803 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.804 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.804 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2020-10-31T22:50:04.804 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:04.805 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.805 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.805 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.806 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6827/14318", 2020-10-31T22:50:04.806 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6829/14318", 2020-10-31T22:50:04.806 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6833/14318", 2020-10-31T22:50:04.806 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6831/14318", 2020-10-31T22:50:04.807 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:04.807 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:04.807 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:04.808 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.808 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.808 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:50:04.809 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", 2020-10-31T22:50:04.809 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:04.809 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:04.810 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:04.810 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:04.810 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:04.811 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:04.811 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:04.811 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2020-10-31T22:50:04.811 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:04.812 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:04.812 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:04.812 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.813 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.813 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2020-10-31T22:50:04.813 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:04.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.814 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.815 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2020-10-31T22:50:04.815 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:04.815 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.815 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.816 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.816 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:04.816 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.817 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.817 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.817 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2020-10-31T22:50:04.818 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:04.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.818 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.818 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.819 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2020-10-31T22:50:04.819 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:04.819 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.820 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.820 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.820 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:04.821 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.821 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.821 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.822 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2020-10-31T22:50:04.822 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:04.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.823 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.823 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.823 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2020-10-31T22:50:04.824 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:04.824 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.824 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.824 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.825 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:04.825 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.826 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2020-10-31T22:50:04.826 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:04.826 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.827 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.827 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.827 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2020-10-31T22:50:04.828 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:04.828 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.828 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.829 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6819/14301", 2020-10-31T22:50:04.829 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6821/14301", 2020-10-31T22:50:04.829 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/14301", 2020-10-31T22:50:04.830 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6823/14301", 2020-10-31T22:50:04.830 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:04.830 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:04.831 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:04.831 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.831 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.831 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.832 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:50:04.832 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", 2020-10-31T22:50:04.832 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:04.833 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:04.833 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:04.833 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:04.833 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:04.834 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:04.834 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:04.834 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 125, 2020-10-31T22:50:04.835 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:04.835 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:04.835 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:04.835 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.836 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.836 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.836 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6816", 2020-10-31T22:50:04.837 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:04.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.837 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.837 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.838 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6817", 2020-10-31T22:50:04.838 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:04.838 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.839 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.839 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:04.839 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.840 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.840 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.840 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6818", 2020-10-31T22:50:04.841 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:04.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.841 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.841 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.842 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6819", 2020-10-31T22:50:04.842 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:04.842 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.843 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.843 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:04.843 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.844 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.844 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.844 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6822", 2020-10-31T22:50:04.845 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:04.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.846 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.846 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6823", 2020-10-31T22:50:04.846 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:04.847 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.847 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.847 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:04.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6820", 2020-10-31T22:50:04.849 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:04.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6821", 2020-10-31T22:50:04.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:04.851 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.851 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.851 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6817/14002", 2020-10-31T22:50:04.852 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6819/14002", 2020-10-31T22:50:04.852 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6823/14002", 2020-10-31T22:50:04.852 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6821/14002", 2020-10-31T22:50:04.852 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:04.853 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:04.853 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:04.853 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.854 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:50:04.854 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", 2020-10-31T22:50:04.854 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:04.854 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:04.855 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:04.855 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:04.855 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:04.855 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:04.856 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:04.856 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2020-10-31T22:50:04.856 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:04.857 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:04.857 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:04.857 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6800", 2020-10-31T22:50:04.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:04.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.859 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6801", 2020-10-31T22:50:04.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:04.860 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.860 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.860 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:04.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.861 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.861 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6802", 2020-10-31T22:50:04.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:04.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.863 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.863 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6803", 2020-10-31T22:50:04.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:04.864 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.864 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.865 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:04.865 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.865 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.866 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.866 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6806", 2020-10-31T22:50:04.866 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:04.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.867 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.867 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.867 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6807", 2020-10-31T22:50:04.868 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:04.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.868 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.869 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:04.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6804", 2020-10-31T22:50:04.870 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:04.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.871 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6805", 2020-10-31T22:50:04.872 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:04.872 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.872 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.873 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6801/14001", 2020-10-31T22:50:04.873 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6803/14001", 2020-10-31T22:50:04.873 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6807/14001", 2020-10-31T22:50:04.873 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6805/14001", 2020-10-31T22:50:04.874 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:04.874 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:04.874 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:04.875 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.875 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:50:04.876 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", 2020-10-31T22:50:04.876 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:04.876 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:04.876 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:04.877 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:04.877 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:04.877 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:04.878 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:04.878 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2020-10-31T22:50:04.878 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:04.878 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:04.879 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:04.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6808", 2020-10-31T22:50:04.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:04.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6809", 2020-10-31T22:50:04.881 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:04.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.882 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.883 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:04.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6810", 2020-10-31T22:50:04.884 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:04.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.885 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6811", 2020-10-31T22:50:04.886 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:04.886 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.886 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.887 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:04.887 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.887 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.888 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.888 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6814", 2020-10-31T22:50:04.888 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:04.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.889 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.889 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6815", 2020-10-31T22:50:04.890 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:04.890 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.891 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.891 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:04.891 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.891 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.892 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6812", 2020-10-31T22:50:04.892 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:04.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.893 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.893 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6813", 2020-10-31T22:50:04.893 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:04.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.894 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.894 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6809/14003", 2020-10-31T22:50:04.894 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6811/14003", 2020-10-31T22:50:04.895 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6815/14003", 2020-10-31T22:50:04.895 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6813/14003", 2020-10-31T22:50:04.895 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:04.895 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:04.895 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:04.895 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.896 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:50:04.896 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", 2020-10-31T22:50:04.897 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:04.897 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:04.897 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:04.897 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:04.898 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:04.898 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:04.898 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:04.898 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2020-10-31T22:50:04.899 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:04.899 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:04.899 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:04.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.900 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6824", 2020-10-31T22:50:04.901 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:04.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.902 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6825", 2020-10-31T22:50:04.902 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:04.902 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.903 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.903 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:04.903 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.904 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.904 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6826", 2020-10-31T22:50:04.905 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:04.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.906 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6827", 2020-10-31T22:50:04.906 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:04.906 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.907 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.907 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:04.907 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.908 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.908 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.908 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6830", 2020-10-31T22:50:04.909 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:04.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.909 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.910 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6831", 2020-10-31T22:50:04.910 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:04.910 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.911 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.911 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.912 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:04.912 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:04.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.913 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:04.913 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6828", 2020-10-31T22:50:04.913 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:04.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:04.915 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6829", 2020-10-31T22:50:04.915 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:04.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.916 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.917 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6825/14046", 2020-10-31T22:50:04.917 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6827/14046", 2020-10-31T22:50:04.917 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6831/14046", 2020-10-31T22:50:04.918 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6829/14046", 2020-10-31T22:50:04.918 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:04.919 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:04.919 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:04.919 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:04.920 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.920 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:50:04.921 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2020-10-31T22:50:04.921 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.921 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:50:04.922 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:04.922 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:04.922 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:04.923 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:04.923 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:04.924 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.314917+0000", 2020-10-31T22:50:04.924 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:04.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.925 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:50:04.925 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:04.925 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:04.926 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:04.926 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:04.926 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:04.926 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.643069+0000", 2020-10-31T22:50:04.927 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:04.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.927 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:50:04.928 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:04.928 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:04.928 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:04.929 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:04.929 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:04.929 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.662572+0000", 2020-10-31T22:50:04.929 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:04.930 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.930 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:50:04.931 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:04.931 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:04.931 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:04.931 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:04.932 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:04.932 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.664868+0000", 2020-10-31T22:50:04.932 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:04.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.933 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:50:04.933 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:04.934 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:04.934 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:04.934 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:04.934 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:04.935 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551107+0000", 2020-10-31T22:50:04.935 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:04.935 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.936 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:50:04.936 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:04.936 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:04.937 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:04.937 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:04.937 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:04.937 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.400568+0000", 2020-10-31T22:50:04.938 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:04.938 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.938 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:50:04.939 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:04.939 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:04.939 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:04.939 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:04.940 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:04.940 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551173+0000", 2020-10-31T22:50:04.940 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:04.941 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.941 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:04.941 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:50:04.942 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:04.942 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:04.942 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:04.942 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:04.943 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:04.943 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.604302+0000", 2020-10-31T22:50:04.943 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:04.943 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.943 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:50:04.944 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2020-10-31T22:50:04.944 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2020-10-31T22:50:04.944 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2020-10-31T22:50:04.944 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2020-10-31T22:50:04.945 INFO:teuthology.orchestra.run.smithi060.stdout: "blacklist": { 2020-10-31T22:50:04.945 INFO:teuthology.orchestra.run.smithi060.stdout: "172.21.15.66:6833/805667342": "2020-11-01T22:49:47.799115+0000", 2020-10-31T22:50:04.945 INFO:teuthology.orchestra.run.smithi060.stdout: "172.21.15.66:6832/805667342": "2020-11-01T22:49:47.799115+0000" 2020-10-31T22:50:04.946 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.946 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2020-10-31T22:50:04.946 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2020-10-31T22:50:04.946 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2020-10-31T22:50:04.947 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2020-10-31T22:50:04.947 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2020-10-31T22:50:04.947 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2020-10-31T22:50:04.947 INFO:teuthology.orchestra.run.smithi060.stdout: "ruleset-failure-domain": "osd", 2020-10-31T22:50:04.948 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2020-10-31T22:50:04.948 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:04.948 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:04.949 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2020-10-31T22:50:04.949 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2020-10-31T22:50:04.949 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2020-10-31T22:50:04.949 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2020-10-31T22:50:04.950 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {} 2020-10-31T22:50:04.950 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:50:04.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.713+0000 7f8b4bfff700 1 -- 172.21.15.60:0/2912332697 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b28054f10 msgr2=0x7f8b280573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:04.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.713+0000 7f8b4bfff700 1 --2- 172.21.15.60:0/2912332697 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b28054f10 0x7f8b280573d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f8b3c00b000 tx=0x7f8b3c008040).stop 2020-10-31T22:50:04.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.713+0000 7f8b4bfff700 1 -- 172.21.15.60:0/2912332697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4c0b1000 msgr2=0x7f8b4c0a98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:04.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.713+0000 7f8b4bfff700 1 --2- 172.21.15.60:0/2912332697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4c0b1000 0x7f8b4c0a98a0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 rx=0x7f8b400014a0 tx=0x7f8b40001ac0).stop 2020-10-31T22:50:04.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.713+0000 7f8b4bfff700 1 -- 172.21.15.60:0/2912332697 shutdown_connections 2020-10-31T22:50:04.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.713+0000 7f8b4bfff700 1 --2- 172.21.15.60:0/2912332697 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b4c0b2820 0x7f8b4c0aa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.713+0000 7f8b4bfff700 1 --2- 172.21.15.60:0/2912332697 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b28054f10 0x7f8b280573d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.713+0000 7f8b4bfff700 1 --2- 172.21.15.60:0/2912332697 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b4c063140 0x7f8b4c150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.713+0000 7f8b4bfff700 1 --2- 172.21.15.60:0/2912332697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b4c0b1000 0x7f8b4c0a98a0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:04.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.713+0000 7f8b4bfff700 1 -- 172.21.15.60:0/2912332697 >> 172.21.15.60:0/2912332697 conn(0x7f8b4c06a600 msgr2=0x7f8b4c144690 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:04.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.713+0000 7f8b4bfff700 1 -- 172.21.15.60:0/2912332697 shutdown_connections 2020-10-31T22:50:04.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:04.713+0000 7f8b4bfff700 1 -- 172.21.15.60:0/2912332697 wait complete. 2020-10-31T22:50:04.957 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:50:05.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.081+0000 7f01ad761700 1 Processor -- start 2020-10-31T22:50:05.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01ad761700 1 -- start start 2020-10-31T22:50:05.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01ad761700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f01a80a99c0 0x7f01a8066f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:05.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01ad761700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a80a75d0 con 0x7f01a805bb50 2020-10-31T22:50:05.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01ad761700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a805afe0 con 0x7f01a80a95e0 2020-10-31T22:50:05.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01ad761700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a80a9e30 con 0x7f01a80a99c0 2020-10-31T22:50:05.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f019ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f01a805bb50 0x7f01a8066830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52666/0 (socket says 172.21.15.60:52666) 2020-10-31T22:50:05.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f019ffff700 1 -- 172.21.15.60:0/434167156 learned_addr learned my addr 172.21.15.60:0/434167156 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:05.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01acf60700 1 --2- 172.21.15.60:0/434167156 >> v2:172.21.15.66:3300/0 conn(0x7f01a80a99c0 0x7f01a8066f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 -- 172.21.15.60:0/434167156 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909688688 0 0) 0x7f01a80a75d0 con 0x7f01a805bb50 2020-10-31T22:50:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 -- 172.21.15.60:0/434167156 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0188003230 con 0x7f01a805bb50 2020-10-31T22:50:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 -- 172.21.15.60:0/434167156 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2134955741 0 0) 0x7f0188003230 con 0x7f01a805bb50 2020-10-31T22:50:05.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 -- 172.21.15.60:0/434167156 >> v2:172.21.15.66:3300/0 conn(0x7f01a80a99c0 msgr2=0x7f01a8066f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:05.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 --2- 172.21.15.60:0/434167156 >> v2:172.21.15.66:3300/0 conn(0x7f01a80a99c0 0x7f01a8066f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 -- 172.21.15.60:0/434167156 >> v1:172.21.15.66:6789/0 conn(0x7f01a80a95e0 legacy=0x7f01a805b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:05.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 -- 172.21.15.60:0/434167156 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a80a8e00 con 0x7f01a805bb50 2020-10-31T22:50:05.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 -- 172.21.15.60:0/434167156 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f01900016d0 con 0x7f01a805bb50 2020-10-31T22:50:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 -- 172.21.15.60:0/434167156 >> v1:172.21.15.60:6789/0 conn(0x7f01a805bb50 legacy=0x7f01a8066830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 --2- 172.21.15.60:0/434167156 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0188003720 0x7f0188003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 --2- 172.21.15.60:0/434167156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01880044d0 0x7f0188004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:05.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 --2- 172.21.15.60:0/434167156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0188004e40 0x7f018800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 -- 172.21.15.60:0/434167156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0188004310 con 0x7f0188004e40 2020-10-31T22:50:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 -- 172.21.15.60:0/434167156 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018800bc10 con 0x7f01880044d0 2020-10-31T22:50:05.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 -- 172.21.15.60:0/434167156 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018800bd80 con 0x7f0188003720 2020-10-31T22:50:05.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a7fff700 1 --2- 172.21.15.60:0/434167156 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0188003720 0x7f0188003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:05.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01acf60700 1 --2- 172.21.15.60:0/434167156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0188004e40 0x7f018800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:05.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f019ffff700 1 --2- 172.21.15.60:0/434167156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01880044d0 0x7f0188004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:05.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01acf60700 1 -- 172.21.15.60:0/434167156 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0188003720 msgr2=0x7f0188003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:05.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01acf60700 1 --2- 172.21.15.60:0/434167156 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0188003720 0x7f0188003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01acf60700 1 -- 172.21.15.60:0/434167156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01880044d0 msgr2=0x7f0188004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:05.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01acf60700 1 --2- 172.21.15.60:0/434167156 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01880044d0 0x7f0188004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01acf60700 1 -- 172.21.15.60:0/434167156 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0188003230 con 0x7f0188004e40 2020-10-31T22:50:05.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01acf60700 1 -- 172.21.15.60:0/434167156 reap_dead start 2020-10-31T22:50:05.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01acf60700 1 --2- 172.21.15.60:0/434167156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0188004e40 0x7f018800b720 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f01a000c000 tx=0x7f01a00091a0).ready entity=mon.0 client_cookie=5f2504d6722e91b2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:05.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 -- 172.21.15.60:0/434167156 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01a000eb80 con 0x7f0188004e40 2020-10-31T22:50:05.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 -- 172.21.15.60:0/434167156 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a000ece0 con 0x7f0188004e40 2020-10-31T22:50:05.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01a77fe700 1 -- 172.21.15.60:0/434167156 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01a00125e0 con 0x7f0188004e40 2020-10-31T22:50:05.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01ad761700 1 -- 172.21.15.60:0/434167156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0188004e40 msgr2=0x7f018800b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:05.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.085+0000 7f01ad761700 1 --2- 172.21.15.60:0/434167156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0188004e40 0x7f018800b720 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 rx=0x7f01a000c000 tx=0x7f01a00091a0).stop 2020-10-31T22:50:05.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01ad761700 1 -- 172.21.15.60:0/434167156 shutdown_connections 2020-10-31T22:50:05.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01ad761700 1 --2- 172.21.15.60:0/434167156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0188004e40 0x7f018800b720 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01ad761700 1 -- 172.21.15.60:0/434167156 >> 172.21.15.60:0/434167156 conn(0x7f01a80b3fd0 msgr2=0x7f01a80b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:05.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01ad761700 1 -- 172.21.15.60:0/434167156 shutdown_connections 2020-10-31T22:50:05.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01ad761700 1 -- 172.21.15.60:0/434167156 wait complete. 2020-10-31T22:50:05.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01ad761700 1 Processor -- start 2020-10-31T22:50:05.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01ad761700 1 -- start start 2020-10-31T22:50:05.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01ad761700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0188004e40 0x7f01a8144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:05.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01ad761700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a80ace60 0x7f01a8065e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:05.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01ad761700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a81507f0 0x7f01a8150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:05.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01ad761700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a8144580 con 0x7f01a80ace60 2020-10-31T22:50:05.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01ad761700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81425f0 con 0x7f01a81507f0 2020-10-31T22:50:05.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01ad761700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a81447e0 con 0x7f0188004e40 2020-10-31T22:50:05.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f019ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a80ace60 0x7f01a8065e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:05.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f019ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a80ace60 0x7f01a8065e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48544/0 (socket says 172.21.15.60:48544) 2020-10-31T22:50:05.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f019ffff700 1 -- 172.21.15.60:0/2185826203 learned_addr learned my addr 172.21.15.60:0/2185826203 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:05.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01a7fff700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0188004e40 0x7f01a8144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:05.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.089+0000 7f01acf60700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a81507f0 0x7f01a8150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:05.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f019ffff700 1 -- 172.21.15.60:0/2185826203 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0188004e40 msgr2=0x7f01a8144c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:05.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f019ffff700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0188004e40 0x7f01a8144c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f019ffff700 1 -- 172.21.15.60:0/2185826203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a81507f0 msgr2=0x7f01a8150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:05.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f019ffff700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a81507f0 0x7f01a8150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f019ffff700 1 -- 172.21.15.60:0/2185826203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a8142890 con 0x7f01a80ace60 2020-10-31T22:50:05.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f01acf60700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a81507f0 0x7f01a8150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:05.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f019ffff700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a80ace60 0x7f01a8065e10 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f019000d000 tx=0x7f01a80aed90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:05.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f01a5ffb700 1 -- 172.21.15.60:0/2185826203 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f019000fa90 con 0x7f01a80ace60 2020-10-31T22:50:05.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f01a5ffb700 1 -- 172.21.15.60:0/2185826203 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019000fbf0 con 0x7f01a80ace60 2020-10-31T22:50:05.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f01a5ffb700 1 -- 172.21.15.60:0/2185826203 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0190012350 con 0x7f01a80ace60 2020-10-31T22:50:05.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f01ad761700 1 -- 172.21.15.60:0/2185826203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a80ad280 con 0x7f01a80ace60 2020-10-31T22:50:05.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f01ad761700 1 -- 172.21.15.60:0/2185826203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a8141840 con 0x7f01a80ace60 2020-10-31T22:50:05.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f01ad761700 1 -- 172.21.15.60:0/2185826203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a8142440 con 0x7f01a80ace60 2020-10-31T22:50:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f01a5ffb700 1 -- 172.21.15.60:0/2185826203 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f01900124b0 con 0x7f01a80ace60 2020-10-31T22:50:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f01a5ffb700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f018c054f90 0x7f018c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f01a5ffb700 1 -- 172.21.15.60:0/2185826203 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f019006d1d0 con 0x7f01a80ace60 2020-10-31T22:50:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.093+0000 7f01a7fff700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f018c054f90 0x7f018c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.097+0000 7f01a7fff700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f018c054f90 0x7f018c057450 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f0198003000 tx=0x7f0198007ad0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:05.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.101+0000 7f01a5ffb700 1 -- 172.21.15.60:0/2185826203 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0190043640 con 0x7f01a80ace60 2020-10-31T22:50:05.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.289+0000 7f01ad761700 1 -- 172.21.15.60:0/2185826203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01a81449a0 con 0x7f01a80ace60 2020-10-31T22:50:05.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.289+0000 7f01a5ffb700 1 -- 172.21.15.60:0/2185826203 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f0190019020 con 0x7f01a80ace60 2020-10-31T22:50:05.295 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:05.295 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":64,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:01.750708+0000","modified":"2020-10-31T22:50:01.750846+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-10-31T22:50:05.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.289+0000 7f01ad761700 1 -- 172.21.15.60:0/2185826203 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f018c054f90 msgr2=0x7f018c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:05.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.289+0000 7f01ad761700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f018c054f90 0x7f018c057450 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f0198003000 tx=0x7f0198007ad0).stop 2020-10-31T22:50:05.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.289+0000 7f01ad761700 1 -- 172.21.15.60:0/2185826203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a80ace60 msgr2=0x7f01a8065e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:05.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.289+0000 7f01ad761700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a80ace60 0x7f01a8065e10 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 rx=0x7f019000d000 tx=0x7f01a80aed90).stop 2020-10-31T22:50:05.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.289+0000 7f01ad761700 1 -- 172.21.15.60:0/2185826203 shutdown_connections 2020-10-31T22:50:05.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.289+0000 7f01ad761700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f018c054f90 0x7f018c057450 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.289+0000 7f01ad761700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01a81507f0 0x7f01a8150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.289+0000 7f01ad761700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0188004e40 0x7f01a8144c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.289+0000 7f01ad761700 1 --2- 172.21.15.60:0/2185826203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01a80ace60 0x7f01a8065e10 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.289+0000 7f01ad761700 1 -- 172.21.15.60:0/2185826203 >> 172.21.15.60:0/2185826203 conn(0x7f01a80b3fd0 msgr2=0x7f01a80ad620 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:05.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.289+0000 7f01ad761700 1 -- 172.21.15.60:0/2185826203 shutdown_connections 2020-10-31T22:50:05.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.289+0000 7f01ad761700 1 -- 172.21.15.60:0/2185826203 wait complete. 2020-10-31T22:50:05.298 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 64 2020-10-31T22:50:05.307 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-10-31T22:50:05.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50bbfff700 1 Processor -- start 2020-10-31T22:50:05.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50bbfff700 1 -- start start 2020-10-31T22:50:05.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50bbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f50bc0af130 0x7f50bc140a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:05.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50bbfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50bc0b13c0 0x7f50bc0b1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:05.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50bbfff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50bc063520 con 0x7f50bc063140 2020-10-31T22:50:05.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50bbfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50bc1430e0 con 0x7f50bc0af130 2020-10-31T22:50:05.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50bbfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc143380 con 0x7f50bc0b13c0 2020-10-31T22:50:05.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50ba7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f50bc0af130 0x7f50bc140a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:05.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50ba7fc700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f50bc0af130 0x7f50bc140a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48552/0 (socket says 172.21.15.60:48552) 2020-10-31T22:50:05.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50ba7fc700 1 -- 172.21.15.60:0/1407069939 learned_addr learned my addr 172.21.15.60:0/1407069939 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:05.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50bb7fe700 1 --2- 172.21.15.60:0/1407069939 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50bc0b13c0 0x7f50bc0b1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:05.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50ba7fc700 1 -- 172.21.15.60:0/1407069939 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50bc0b13c0 msgr2=0x7f50bc0b1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:05.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50ba7fc700 1 --2- 172.21.15.60:0/1407069939 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50bc0b13c0 0x7f50bc0b1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50ba7fc700 1 -- 172.21.15.60:0/1407069939 >> v1:172.21.15.66:6789/0 conn(0x7f50bc063140 legacy=0x7f50bc140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:05.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50ba7fc700 1 -- 172.21.15.60:0/1407069939 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc143620 con 0x7f50bc0af130 2020-10-31T22:50:05.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50ba7fc700 1 --2- 172.21.15.60:0/1407069939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0af130 0x7f50bc140a70 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f50ac002f30 tx=0x7f50ac006e80).ready entity=mon.0 client_cookie=51ba4e81f6089202 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:05.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50b9ffb700 1 -- 172.21.15.60:0/1407069939 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50ac0097f0 con 0x7f50bc0af130 2020-10-31T22:50:05.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50b9ffb700 1 -- 172.21.15.60:0/1407069939 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac009950 con 0x7f50bc0af130 2020-10-31T22:50:05.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50b9ffb700 1 -- 172.21.15.60:0/1407069939 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50ac009cb0 con 0x7f50bc0af130 2020-10-31T22:50:05.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50bbfff700 1 -- 172.21.15.60:0/1407069939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0af130 msgr2=0x7f50bc140a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:05.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.433+0000 7f50bbfff700 1 --2- 172.21.15.60:0/1407069939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0af130 0x7f50bc140a70 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 rx=0x7f50ac002f30 tx=0x7f50ac006e80).stop 2020-10-31T22:50:05.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bbfff700 1 -- 172.21.15.60:0/1407069939 shutdown_connections 2020-10-31T22:50:05.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bbfff700 1 --2- 172.21.15.60:0/1407069939 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50bc0b13c0 0x7f50bc0b1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bbfff700 1 --2- 172.21.15.60:0/1407069939 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0af130 0x7f50bc140a70 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bbfff700 1 -- 172.21.15.60:0/1407069939 >> 172.21.15.60:0/1407069939 conn(0x7f50bc06a600 msgr2=0x7f50bc060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:05.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bbfff700 1 -- 172.21.15.60:0/1407069939 shutdown_connections 2020-10-31T22:50:05.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bbfff700 1 -- 172.21.15.60:0/1407069939 wait complete. 2020-10-31T22:50:05.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bbfff700 1 Processor -- start 2020-10-31T22:50:05.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bbfff700 1 -- start start 2020-10-31T22:50:05.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bbfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50bc063140 0x7f50bc063ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:05.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0af130 0x7f50bc066680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:05.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bbfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50bc0b13c0 0x7f50bc066b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:05.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc150dd0 con 0x7f50bc0af130 2020-10-31T22:50:05.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bbfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc150fc0 con 0x7f50bc0b13c0 2020-10-31T22:50:05.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bbfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc0ac8f0 con 0x7f50bc063140 2020-10-31T22:50:05.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50ba7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0af130 0x7f50bc066680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:05.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50ba7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0af130 0x7f50bc066680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48560/0 (socket says 172.21.15.60:48560) 2020-10-31T22:50:05.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50ba7fc700 1 -- 172.21.15.60:0/2882405774 learned_addr learned my addr 172.21.15.60:0/2882405774 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:05.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50bb7fe700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50bc0b13c0 0x7f50bc066b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:05.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50baffd700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50bc063140 0x7f50bc063ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:05.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50ba7fc700 1 -- 172.21.15.60:0/2882405774 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50bc063140 msgr2=0x7f50bc063ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:05.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50ba7fc700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50bc063140 0x7f50bc063ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50ba7fc700 1 -- 172.21.15.60:0/2882405774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50bc0b13c0 msgr2=0x7f50bc066b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:05.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50ba7fc700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50bc0b13c0 0x7f50bc066b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50ba7fc700 1 -- 172.21.15.60:0/2882405774 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc0acb90 con 0x7f50bc0af130 2020-10-31T22:50:05.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50baffd700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50bc063140 0x7f50bc063ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:05.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.437+0000 7f50ba7fc700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0af130 0x7f50bc066680 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f50ac002f30 tx=0x7f50ac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:05.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.441+0000 7f50abfff700 1 -- 172.21.15.60:0/2882405774 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50ac011bf0 con 0x7f50bc0af130 2020-10-31T22:50:05.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.441+0000 7f50abfff700 1 -- 172.21.15.60:0/2882405774 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ac011d50 con 0x7f50bc0af130 2020-10-31T22:50:05.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.441+0000 7f50bbfff700 1 -- 172.21.15.60:0/2882405774 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50bc0a85b0 con 0x7f50bc0af130 2020-10-31T22:50:05.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.441+0000 7f50abfff700 1 -- 172.21.15.60:0/2882405774 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50ac01e650 con 0x7f50bc0af130 2020-10-31T22:50:05.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.441+0000 7f50bbfff700 1 -- 172.21.15.60:0/2882405774 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50bc0adfd0 con 0x7f50bc0af130 2020-10-31T22:50:05.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.441+0000 7f50bbfff700 1 -- 172.21.15.60:0/2882405774 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50bc0acd20 con 0x7f50bc0af130 2020-10-31T22:50:05.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.441+0000 7f50abfff700 1 -- 172.21.15.60:0/2882405774 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f50ac025030 con 0x7f50bc0af130 2020-10-31T22:50:05.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.441+0000 7f50abfff700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5098054f10 0x7f50980573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:05.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.441+0000 7f50abfff700 1 -- 172.21.15.60:0/2882405774 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f50ac06eee0 con 0x7f50bc0af130 2020-10-31T22:50:05.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.441+0000 7f50baffd700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5098054f10 0x7f50980573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:05.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.441+0000 7f50baffd700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5098054f10 0x7f50980573d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f50b000b000 tx=0x7f50b0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:05.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.445+0000 7f50abfff700 1 -- 172.21.15.60:0/2882405774 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f50ac0453b0 con 0x7f50bc0af130 2020-10-31T22:50:05.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.629+0000 7f50bbfff700 1 -- 172.21.15.60:0/2882405774 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f50bc057100 con 0x7f50bc0af130 2020-10-31T22:50:05.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.905+0000 7f50abfff700 1 -- 172.21.15.60:0/2882405774 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v65) v1 ==== 161+0+0 (secure 0 0 0) 0x7f50ac0489d0 con 0x7f50bc0af130 2020-10-31T22:50:05.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.909+0000 7f50bbfff700 1 -- 172.21.15.60:0/2882405774 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5098054f10 msgr2=0x7f50980573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:05.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.909+0000 7f50bbfff700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5098054f10 0x7f50980573d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f50b000b000 tx=0x7f50b0009040).stop 2020-10-31T22:50:05.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.909+0000 7f50bbfff700 1 -- 172.21.15.60:0/2882405774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0af130 msgr2=0x7f50bc066680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:05.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.909+0000 7f50bbfff700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0af130 0x7f50bc066680 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 rx=0x7f50ac002f30 tx=0x7f50ac015000).stop 2020-10-31T22:50:05.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.909+0000 7f50bbfff700 1 -- 172.21.15.60:0/2882405774 shutdown_connections 2020-10-31T22:50:05.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.909+0000 7f50bbfff700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5098054f10 0x7f50980573d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.909+0000 7f50bbfff700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f50bc0b13c0 0x7f50bc066b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.909+0000 7f50bbfff700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f50bc063140 0x7f50bc063ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.909+0000 7f50bbfff700 1 --2- 172.21.15.60:0/2882405774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f50bc0af130 0x7f50bc066680 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:05.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.909+0000 7f50bbfff700 1 -- 172.21.15.60:0/2882405774 >> 172.21.15.60:0/2882405774 conn(0x7f50bc06a600 msgr2=0x7f50bc140130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:05.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.909+0000 7f50bbfff700 1 -- 172.21.15.60:0/2882405774 shutdown_connections 2020-10-31T22:50:05.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:05.909+0000 7f50bbfff700 1 -- 172.21.15.60:0/2882405774 wait complete. 2020-10-31T22:50:05.916 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-10-31T22:50:05.932 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:50:06.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.045+0000 7f99ebfff700 1 Processor -- start 2020-10-31T22:50:06.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.045+0000 7f99ebfff700 1 -- start start 2020-10-31T22:50:06.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.045+0000 7f99ebfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f99ec0b01a0 0x7f99ec0aa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:06.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.045+0000 7f99ebfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ec1429d0 con 0x7f99ec0a7530 2020-10-31T22:50:06.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.045+0000 7f99ebfff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99ec142c70 con 0x7f99ec0afdc0 2020-10-31T22:50:06.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.045+0000 7f99ebfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99ec13c530 con 0x7f99ec0b01a0 2020-10-31T22:50:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.045+0000 7f99e27fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f99ec0a7530 0x7f99ec13edf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52700/0 (socket says 172.21.15.60:52700) 2020-10-31T22:50:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.045+0000 7f99e27fc700 1 -- 172.21.15.60:0/2815697408 learned_addr learned my addr 172.21.15.60:0/2815697408 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:06.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.045+0000 7f99eb7fe700 1 --2- 172.21.15.60:0/2815697408 >> v2:172.21.15.66:3300/0 conn(0x7f99ec0b01a0 0x7f99ec0aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ea7fc700 1 -- 172.21.15.60:0/2815697408 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566484264 0 0) 0x7f99ec1429d0 con 0x7f99ec0a7530 2020-10-31T22:50:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ea7fc700 1 -- 172.21.15.60:0/2815697408 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99cc003230 con 0x7f99ec0a7530 2020-10-31T22:50:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99eb7fe700 1 -- 172.21.15.60:0/2815697408 >> v1:172.21.15.66:6789/0 conn(0x7f99ec0afdc0 legacy=0x7f99ec13be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:06.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99eb7fe700 1 -- 172.21.15.60:0/2815697408 >> v1:172.21.15.60:6789/0 conn(0x7f99ec0a7530 legacy=0x7f99ec13edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ea7fc700 1 -- 172.21.15.60:0/2815697408 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735949045 0 0) 0x7f99ec142c70 con 0x7f99ec0afdc0 2020-10-31T22:50:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99eb7fe700 1 -- 172.21.15.60:0/2815697408 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec13e8e0 con 0x7f99ec0b01a0 2020-10-31T22:50:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99eb7fe700 1 --2- 172.21.15.60:0/2815697408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99ec0b01a0 0x7f99ec0aa100 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f99d40017f0 tx=0x7f99e40091a0).ready entity=mon.1 client_cookie=479cd73ff57d488e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ea7fc700 1 -- 172.21.15.60:0/2815697408 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99d4001650 con 0x7f99ec0b01a0 2020-10-31T22:50:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ea7fc700 1 -- 172.21.15.60:0/2815697408 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e400b8b0 con 0x7f99ec0b01a0 2020-10-31T22:50:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ea7fc700 1 -- 172.21.15.60:0/2815697408 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e400ba20 con 0x7f99ec0b01a0 2020-10-31T22:50:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 -- 172.21.15.60:0/2815697408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99ec0b01a0 msgr2=0x7f99ec0aa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:06.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 --2- 172.21.15.60:0/2815697408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99ec0b01a0 0x7f99ec0aa100 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f99d40017f0 tx=0x7f99e40091a0).stop 2020-10-31T22:50:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 -- 172.21.15.60:0/2815697408 shutdown_connections 2020-10-31T22:50:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 --2- 172.21.15.60:0/2815697408 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99ec0b01a0 0x7f99ec0aa100 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 -- 172.21.15.60:0/2815697408 >> 172.21.15.60:0/2815697408 conn(0x7f99ec0b3fd0 msgr2=0x7f99ec0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 -- 172.21.15.60:0/2815697408 shutdown_connections 2020-10-31T22:50:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 -- 172.21.15.60:0/2815697408 wait complete. 2020-10-31T22:50:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 Processor -- start 2020-10-31T22:50:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 -- start start 2020-10-31T22:50:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99ec0afdc0 0x7f99ec065d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:06.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99ec0b01a0 0x7f99ec1410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f99ec13fce0 0x7f99ec0aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec140bb0 con 0x7f99ec0afdc0 2020-10-31T22:50:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec140e50 con 0x7f99ec0b01a0 2020-10-31T22:50:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.049+0000 7f99ebfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99ec0aa310 con 0x7f99ec13fce0 2020-10-31T22:50:06.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99e27fc700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99ec0b01a0 0x7f99ec1410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99eaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99ec0afdc0 0x7f99ec065d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99e27fc700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99ec0b01a0 0x7f99ec1410d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:59506/0 (socket says 172.21.15.60:59506) 2020-10-31T22:50:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99e27fc700 1 -- 172.21.15.60:0/3526013530 learned_addr learned my addr 172.21.15.60:0/3526013530 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99eb7fe700 1 --2- 172.21.15.60:0/3526013530 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f99ec13fce0 0x7f99ec0aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99eaffd700 1 -- 172.21.15.60:0/3526013530 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f99ec13fce0 msgr2=0x7f99ec0aa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99eaffd700 1 --2- 172.21.15.60:0/3526013530 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f99ec13fce0 0x7f99ec0aa7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99eaffd700 1 -- 172.21.15.60:0/3526013530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99ec0b01a0 msgr2=0x7f99ec1410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:06.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99eaffd700 1 --2- 172.21.15.60:0/3526013530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99ec0b01a0 0x7f99ec1410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99eaffd700 1 -- 172.21.15.60:0/3526013530 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ec1408c0 con 0x7f99ec0afdc0 2020-10-31T22:50:06.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99eaffd700 1 --2- 172.21.15.60:0/3526013530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99ec0afdc0 0x7f99ec065d30 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f99dc001190 tx=0x7f99dc0079a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:06.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99e8ff9700 1 -- 172.21.15.60:0/3526013530 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99dc013410 con 0x7f99ec0afdc0 2020-10-31T22:50:06.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99ebfff700 1 -- 172.21.15.60:0/3526013530 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99ec0b3a70 con 0x7f99ec0afdc0 2020-10-31T22:50:06.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99e8ff9700 1 -- 172.21.15.60:0/3526013530 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc013570 con 0x7f99ec0afdc0 2020-10-31T22:50:06.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99e8ff9700 1 -- 172.21.15.60:0/3526013530 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99dc0138d0 con 0x7f99ec0afdc0 2020-10-31T22:50:06.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99ebfff700 1 -- 172.21.15.60:0/3526013530 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99ec0a80e0 con 0x7f99ec0afdc0 2020-10-31T22:50:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99ebfff700 1 -- 172.21.15.60:0/3526013530 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99ec057100 con 0x7f99ec0afdc0 2020-10-31T22:50:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99e8ff9700 1 -- 172.21.15.60:0/3526013530 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f99dc010030 con 0x7f99ec0afdc0 2020-10-31T22:50:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99e8ff9700 1 --2- 172.21.15.60:0/3526013530 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f99d0054f90 0x7f99d0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99e8ff9700 1 -- 172.21.15.60:0/3526013530 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f99dc06d900 con 0x7f99ec0afdc0 2020-10-31T22:50:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.053+0000 7f99e27fc700 1 --2- 172.21.15.60:0/3526013530 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f99d0054f90 0x7f99d0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:06.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.057+0000 7f99e27fc700 1 --2- 172.21.15.60:0/3526013530 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f99d0054f90 0x7f99d0057450 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f99d400d000 tx=0x7f99d4000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:06.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.061+0000 7f99e8ff9700 1 -- 172.21.15.60:0/3526013530 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f99dc043d30 con 0x7f99ec0afdc0 2020-10-31T22:50:06.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.245+0000 7f99ebfff700 1 -- 172.21.15.60:0/3526013530 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99ec0b3d30 con 0x7f99ec0afdc0 2020-10-31T22:50:06.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.245+0000 7f99e8ff9700 1 -- 172.21.15.60:0/3526013530 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+1426 (secure 0 0 0) 0x7f99dc047350 con 0x7f99ec0afdc0 2020-10-31T22:50:06.251 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:06.251 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":65,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":65,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:01.750708+0000","modified":"2020-10-31T22:50:05.903005+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[22],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2020-10-31T22:50:06.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.245+0000 7f99ebfff700 1 -- 172.21.15.60:0/3526013530 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f99d0054f90 msgr2=0x7f99d0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:06.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.245+0000 7f99ebfff700 1 --2- 172.21.15.60:0/3526013530 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f99d0054f90 0x7f99d0057450 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f99d400d000 tx=0x7f99d4000b80).stop 2020-10-31T22:50:06.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.245+0000 7f99ebfff700 1 -- 172.21.15.60:0/3526013530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99ec0afdc0 msgr2=0x7f99ec065d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:06.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.245+0000 7f99ebfff700 1 --2- 172.21.15.60:0/3526013530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99ec0afdc0 0x7f99ec065d30 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 rx=0x7f99dc001190 tx=0x7f99dc0079a0).stop 2020-10-31T22:50:06.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.245+0000 7f99ebfff700 1 -- 172.21.15.60:0/3526013530 shutdown_connections 2020-10-31T22:50:06.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.245+0000 7f99ebfff700 1 --2- 172.21.15.60:0/3526013530 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f99ec13fce0 0x7f99ec0aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.245+0000 7f99ebfff700 1 --2- 172.21.15.60:0/3526013530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f99ec0afdc0 0x7f99ec065d30 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.245+0000 7f99ebfff700 1 --2- 172.21.15.60:0/3526013530 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f99d0054f90 0x7f99d0057450 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.245+0000 7f99ebfff700 1 --2- 172.21.15.60:0/3526013530 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f99ec0b01a0 0x7f99ec1410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.245+0000 7f99ebfff700 1 -- 172.21.15.60:0/3526013530 >> 172.21.15.60:0/3526013530 conn(0x7f99ec0b3fd0 msgr2=0x7f99ec141fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:06.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.245+0000 7f99ebfff700 1 -- 172.21.15.60:0/3526013530 shutdown_connections 2020-10-31T22:50:06.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.245+0000 7f99ebfff700 1 -- 172.21.15.60:0/3526013530 wait complete. 2020-10-31T22:50:06.256 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 65 2020-10-31T22:50:06.263 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:50:06.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.377+0000 7fc07359e700 1 Processor -- start 2020-10-31T22:50:06.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.377+0000 7fc07359e700 1 -- start start 2020-10-31T22:50:06.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc07359e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc0740b5570 0x7fc0740b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:06.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc07359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc074141fe0 0x7fc074142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:06.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc07359e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc074145180 con 0x7fc0740b24a0 2020-10-31T22:50:06.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc07359e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0740afae0 con 0x7fc0740b5570 2020-10-31T22:50:06.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc07359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc074141bf0 con 0x7fc074141fe0 2020-10-31T22:50:06.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc072d9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc074141fe0 0x7fc074142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc07259c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc0740b5570 0x7fc0740b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc072d9d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc074141fe0 0x7fc074142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:33538/0 (socket says 172.21.15.60:33538) 2020-10-31T22:50:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc072d9d700 1 -- 172.21.15.60:0/1520815432 learned_addr learned my addr 172.21.15.60:0/1520815432 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc06bfff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc0740b24a0 0x7fc074145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:50582/0 (socket says 172.21.15.60:50582) 2020-10-31T22:50:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc072d9d700 1 -- 172.21.15.60:0/1520815432 >> v2:172.21.15.66:3300/0 conn(0x7fc0740b5570 msgr2=0x7fc0740b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc072d9d700 1 --2- 172.21.15.60:0/1520815432 >> v2:172.21.15.66:3300/0 conn(0x7fc0740b5570 0x7fc0740b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc072d9d700 1 -- 172.21.15.60:0/1520815432 >> v1:172.21.15.66:6789/0 conn(0x7fc0740b24a0 legacy=0x7fc074145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:06.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc072d9d700 1 -- 172.21.15.60:0/1520815432 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0740b0670 con 0x7fc074141fe0 2020-10-31T22:50:06.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc072d9d700 1 --2- 172.21.15.60:0/1520815432 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc074141fe0 0x7fc074142490 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fc07405f580 tx=0x7fc06c009270).ready entity=mon.2 client_cookie=ba8c5e3240c9dea4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:06.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc071d9b700 1 -- 172.21.15.60:0/1520815432 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc06c009e90 con 0x7fc074141fe0 2020-10-31T22:50:06.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc071d9b700 1 -- 172.21.15.60:0/1520815432 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c00bbc0 con 0x7fc074141fe0 2020-10-31T22:50:06.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc071d9b700 1 -- 172.21.15.60:0/1520815432 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc06c00bd30 con 0x7fc074141fe0 2020-10-31T22:50:06.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc07359e700 1 -- 172.21.15.60:0/1520815432 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc074141fe0 msgr2=0x7fc074142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:06.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc07359e700 1 --2- 172.21.15.60:0/1520815432 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc074141fe0 0x7fc074142490 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fc07405f580 tx=0x7fc06c009270).stop 2020-10-31T22:50:06.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc07359e700 1 -- 172.21.15.60:0/1520815432 shutdown_connections 2020-10-31T22:50:06.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc07359e700 1 --2- 172.21.15.60:0/1520815432 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc074141fe0 0x7fc074142490 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc07359e700 1 --2- 172.21.15.60:0/1520815432 >> v2:172.21.15.66:3300/0 conn(0x7fc0740b5570 0x7fc0740b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc07359e700 1 -- 172.21.15.60:0/1520815432 >> 172.21.15.60:0/1520815432 conn(0x7fc0740b8e90 msgr2=0x7fc0740b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:06.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc07359e700 1 -- 172.21.15.60:0/1520815432 shutdown_connections 2020-10-31T22:50:06.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.381+0000 7fc07359e700 1 -- 172.21.15.60:0/1520815432 wait complete. 2020-10-31T22:50:06.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc07359e700 1 Processor -- start 2020-10-31T22:50:06.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc07359e700 1 -- start start 2020-10-31T22:50:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc07359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0740b24a0 0x7fc074065d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc07359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0740b5570 0x7fc074140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:06.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc07359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc074141fe0 0x7fc074153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc07359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc074140550 con 0x7fc074141fe0 2020-10-31T22:50:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc07359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc074140770 con 0x7fc0740b5570 2020-10-31T22:50:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc07359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc074143980 con 0x7fc0740b24a0 2020-10-31T22:50:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc072d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc074141fe0 0x7fc074153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc072d9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc074141fe0 0x7fc074153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48588/0 (socket says 172.21.15.60:48588) 2020-10-31T22:50:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc072d9d700 1 -- 172.21.15.60:0/2853847147 learned_addr learned my addr 172.21.15.60:0/2853847147 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:06.395 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc06bfff700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0740b5570 0x7fc074140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc07259c700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0740b24a0 0x7fc074065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc072d9d700 1 -- 172.21.15.60:0/2853847147 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0740b24a0 msgr2=0x7fc074065d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc072d9d700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0740b24a0 0x7fc074065d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc072d9d700 1 -- 172.21.15.60:0/2853847147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0740b5570 msgr2=0x7fc074140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc072d9d700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0740b5570 0x7fc074140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc072d9d700 1 -- 172.21.15.60:0/2853847147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc074143c20 con 0x7fc074141fe0 2020-10-31T22:50:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc07259c700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0740b24a0 0x7fc074065d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc072d9d700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc074141fe0 0x7fc074153f20 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7fc07405f580 tx=0x7fc06c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc06b7fe700 1 -- 172.21.15.60:0/2853847147 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc06c01f5e0 con 0x7fc074141fe0 2020-10-31T22:50:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc06b7fe700 1 -- 172.21.15.60:0/2853847147 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06c01f740 con 0x7fc074141fe0 2020-10-31T22:50:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc07359e700 1 -- 172.21.15.60:0/2853847147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0741440c0 con 0x7fc074141fe0 2020-10-31T22:50:06.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc06b7fe700 1 -- 172.21.15.60:0/2853847147 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc06c01faa0 con 0x7fc074141fe0 2020-10-31T22:50:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.385+0000 7fc07359e700 1 -- 172.21.15.60:0/2853847147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc074140eb0 con 0x7fc074141fe0 2020-10-31T22:50:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.389+0000 7fc07359e700 1 -- 172.21.15.60:0/2853847147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc074140930 con 0x7fc074141fe0 2020-10-31T22:50:06.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.389+0000 7fc06b7fe700 1 -- 172.21.15.60:0/2853847147 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc06c026030 con 0x7fc074141fe0 2020-10-31T22:50:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.389+0000 7fc06b7fe700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc04c0550c0 0x7fc04c057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.389+0000 7fc06b7fe700 1 -- 172.21.15.60:0/2853847147 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fc06c06ea10 con 0x7fc074141fe0 2020-10-31T22:50:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.389+0000 7fc07259c700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc04c0550c0 0x7fc04c057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:06.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.389+0000 7fc07259c700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc04c0550c0 0x7fc04c057580 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fc05c00b000 tx=0x7fc05c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:06.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.393+0000 7fc06b7fe700 1 -- 172.21.15.60:0/2853847147 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc06c044ee0 con 0x7fc074141fe0 2020-10-31T22:50:06.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.585+0000 7fc07359e700 1 -- 172.21.15.60:0/2853847147 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc074057100 con 0x7fc074141fe0 2020-10-31T22:50:06.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.921+0000 7fc06b7fe700 1 -- 172.21.15.60:0/2853847147 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v66) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc06c048500 con 0x7fc074141fe0 2020-10-31T22:50:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.925+0000 7fc07359e700 1 -- 172.21.15.60:0/2853847147 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc04c0550c0 msgr2=0x7fc04c057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:06.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.925+0000 7fc07359e700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc04c0550c0 0x7fc04c057580 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7fc05c00b000 tx=0x7fc05c008040).stop 2020-10-31T22:50:06.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.925+0000 7fc07359e700 1 -- 172.21.15.60:0/2853847147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc074141fe0 msgr2=0x7fc074153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:06.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.925+0000 7fc07359e700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc074141fe0 0x7fc074153f20 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 rx=0x7fc07405f580 tx=0x7fc06c016000).stop 2020-10-31T22:50:06.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.925+0000 7fc07359e700 1 -- 172.21.15.60:0/2853847147 shutdown_connections 2020-10-31T22:50:06.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.925+0000 7fc07359e700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc074141fe0 0x7fc074153f20 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.925+0000 7fc07359e700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc0740b24a0 0x7fc074065d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.925+0000 7fc07359e700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc04c0550c0 0x7fc04c057580 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.925+0000 7fc07359e700 1 --2- 172.21.15.60:0/2853847147 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0740b5570 0x7fc074140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:06.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.925+0000 7fc07359e700 1 -- 172.21.15.60:0/2853847147 >> 172.21.15.60:0/2853847147 conn(0x7fc0740b8e90 msgr2=0x7fc074066320 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:06.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.925+0000 7fc07359e700 1 -- 172.21.15.60:0/2853847147 shutdown_connections 2020-10-31T22:50:06.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:06.925+0000 7fc07359e700 1 -- 172.21.15.60:0/2853847147 wait complete. 2020-10-31T22:50:06.951 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:50:07.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.069+0000 7f04210c9700 1 Processor -- start 2020-10-31T22:50:07.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.069+0000 7f04210c9700 1 -- start start 2020-10-31T22:50:07.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f04210c9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f041c0acc60 0x7f041c0b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:07.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f04210c9700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f041c0ad610 0x7f041c0ada80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:07.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f04210c9700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c05b700 con 0x7f041c05b320 2020-10-31T22:50:07.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f04210c9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c140750 con 0x7f041c0acc60 2020-10-31T22:50:07.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f04210c9700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c0b0340 con 0x7f041c0ad610 2020-10-31T22:50:07.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f041b7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f041c0acc60 0x7f041c0b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:07.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f041b7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f041c0acc60 0x7f041c0b24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48594/0 (socket says 172.21.15.60:48594) 2020-10-31T22:50:07.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f041b7fe700 1 -- 172.21.15.60:0/2800585644 learned_addr learned my addr 172.21.15.60:0/2800585644 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:07.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f04208c8700 1 --2- 172.21.15.60:0/2800585644 >> v2:172.21.15.66:3300/0 conn(0x7f041c0ad610 0x7f041c0ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:07.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f041b7fe700 1 -- 172.21.15.60:0/2800585644 >> v2:172.21.15.66:3300/0 conn(0x7f041c0ad610 msgr2=0x7f041c0ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:07.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f041b7fe700 1 --2- 172.21.15.60:0/2800585644 >> v2:172.21.15.66:3300/0 conn(0x7f041c0ad610 0x7f041c0ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:07.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f041b7fe700 1 -- 172.21.15.60:0/2800585644 >> v1:172.21.15.66:6789/0 conn(0x7f041c05b320 legacy=0x7f041c0b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:07.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f041b7fe700 1 -- 172.21.15.60:0/2800585644 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0b05e0 con 0x7f041c0acc60 2020-10-31T22:50:07.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f041b7fe700 1 --2- 172.21.15.60:0/2800585644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f041c0acc60 0x7f041c0b24c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f040c002f30 tx=0x7f040c006e80).ready entity=mon.0 client_cookie=afaf1ae7e3654076 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:07.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f041affd700 1 -- 172.21.15.60:0/2800585644 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f040c0097f0 con 0x7f041c0acc60 2020-10-31T22:50:07.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f041affd700 1 -- 172.21.15.60:0/2800585644 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c009950 con 0x7f041c0acc60 2020-10-31T22:50:07.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f04210c9700 1 -- 172.21.15.60:0/2800585644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f041c0acc60 msgr2=0x7f041c0b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:07.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f041affd700 1 -- 172.21.15.60:0/2800585644 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f040c009cb0 con 0x7f041c0acc60 2020-10-31T22:50:07.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f04210c9700 1 --2- 172.21.15.60:0/2800585644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f041c0acc60 0x7f041c0b24c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 rx=0x7f040c002f30 tx=0x7f040c006e80).stop 2020-10-31T22:50:07.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f04210c9700 1 -- 172.21.15.60:0/2800585644 shutdown_connections 2020-10-31T22:50:07.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f04210c9700 1 --2- 172.21.15.60:0/2800585644 >> v2:172.21.15.66:3300/0 conn(0x7f041c0ad610 0x7f041c0ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:07.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f04210c9700 1 --2- 172.21.15.60:0/2800585644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f041c0acc60 0x7f041c0b24c0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:07.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f04210c9700 1 -- 172.21.15.60:0/2800585644 >> 172.21.15.60:0/2800585644 conn(0x7f041c0b61d0 msgr2=0x7f041c0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:07.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f04210c9700 1 -- 172.21.15.60:0/2800585644 shutdown_connections 2020-10-31T22:50:07.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.073+0000 7f04210c9700 1 -- 172.21.15.60:0/2800585644 wait complete. 2020-10-31T22:50:07.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f04210c9700 1 Processor -- start 2020-10-31T22:50:07.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f04210c9700 1 -- start start 2020-10-31T22:50:07.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f04210c9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f041c05b320 0x7f041c143920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:07.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f04210c9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0acc60 0x7f041c139490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:07.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f04210c9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f041c0ad610 0x7f041c139980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:07.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f04210c9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c139e70 con 0x7f041c05b320 2020-10-31T22:50:07.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f04210c9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c143360 con 0x7f041c0acc60 2020-10-31T22:50:07.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f04210c9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c13c240 con 0x7f041c0ad610 2020-10-31T22:50:07.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f041bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f041c05b320 0x7f041c143920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:07.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f041bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f041c05b320 0x7f041c143920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48598/0 (socket says 172.21.15.60:48598) 2020-10-31T22:50:07.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f041bfff700 1 -- 172.21.15.60:0/2772251311 learned_addr learned my addr 172.21.15.60:0/2772251311 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:07.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f04208c8700 1 --2- 172.21.15.60:0/2772251311 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f041c0ad610 0x7f041c139980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:07.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f041b7fe700 1 --2- 172.21.15.60:0/2772251311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0acc60 0x7f041c139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:07.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f041bfff700 1 -- 172.21.15.60:0/2772251311 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f041c0ad610 msgr2=0x7f041c139980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:07.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f041bfff700 1 --2- 172.21.15.60:0/2772251311 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f041c0ad610 0x7f041c139980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:07.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f041bfff700 1 -- 172.21.15.60:0/2772251311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0acc60 msgr2=0x7f041c139490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:07.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f041bfff700 1 --2- 172.21.15.60:0/2772251311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0acc60 0x7f041c139490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:07.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f041bfff700 1 -- 172.21.15.60:0/2772251311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c13c4e0 con 0x7f041c05b320 2020-10-31T22:50:07.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f041bfff700 1 --2- 172.21.15.60:0/2772251311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f041c05b320 0x7f041c143920 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f041c0b6d90 tx=0x7f0404007b90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:07.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f04197fa700 1 -- 172.21.15.60:0/2772251311 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f040400f470 con 0x7f041c05b320 2020-10-31T22:50:07.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f04197fa700 1 -- 172.21.15.60:0/2772251311 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040400f5d0 con 0x7f041c05b320 2020-10-31T22:50:07.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f04210c9700 1 -- 172.21.15.60:0/2772251311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c13c780 con 0x7f041c05b320 2020-10-31T22:50:07.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f04197fa700 1 -- 172.21.15.60:0/2772251311 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f040400f930 con 0x7f041c05b320 2020-10-31T22:50:07.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.077+0000 7f04210c9700 1 -- 172.21.15.60:0/2772251311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c061090 con 0x7f041c05b320 2020-10-31T22:50:07.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.081+0000 7f04210c9700 1 -- 172.21.15.60:0/2772251311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041c1431a0 con 0x7f041c05b320 2020-10-31T22:50:07.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.081+0000 7f04197fa700 1 -- 172.21.15.60:0/2772251311 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0404019030 con 0x7f041c05b320 2020-10-31T22:50:07.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.081+0000 7f04197fa700 1 --2- 172.21.15.60:0/2772251311 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0400054f30 0x7f04000573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:07.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.081+0000 7f04197fa700 1 -- 172.21.15.60:0/2772251311 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f040406cec0 con 0x7f041c05b320 2020-10-31T22:50:07.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.081+0000 7f041b7fe700 1 --2- 172.21.15.60:0/2772251311 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0400054f30 0x7f04000573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:07.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.081+0000 7f041b7fe700 1 --2- 172.21.15.60:0/2772251311 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0400054f30 0x7f04000573f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f040c01c000 tx=0x7f040c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:07.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.089+0000 7f04197fa700 1 -- 172.21.15.60:0/2772251311 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0404043280 con 0x7f041c05b320 2020-10-31T22:50:07.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.233+0000 7f04210c9700 1 -- 172.21.15.60:0/2772251311 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f041c057100 con 0x7f041c05b320 2020-10-31T22:50:07.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.929+0000 7f04197fa700 1 -- 172.21.15.60:0/2772251311 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v133) v1 ==== 185+0+0 (secure 0 0 0) 0x7f0404017070 con 0x7f041c05b320 2020-10-31T22:50:07.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.937+0000 7f04210c9700 1 -- 172.21.15.60:0/2772251311 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0400054f30 msgr2=0x7f04000573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:07.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.937+0000 7f04210c9700 1 --2- 172.21.15.60:0/2772251311 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0400054f30 0x7f04000573f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7f040c01c000 tx=0x7f040c015000).stop 2020-10-31T22:50:07.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.937+0000 7f04210c9700 1 -- 172.21.15.60:0/2772251311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f041c05b320 msgr2=0x7f041c143920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:07.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.937+0000 7f04210c9700 1 --2- 172.21.15.60:0/2772251311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f041c05b320 0x7f041c143920 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 rx=0x7f041c0b6d90 tx=0x7f0404007b90).stop 2020-10-31T22:50:07.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.937+0000 7f04210c9700 1 -- 172.21.15.60:0/2772251311 shutdown_connections 2020-10-31T22:50:07.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.937+0000 7f04210c9700 1 --2- 172.21.15.60:0/2772251311 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f041c0ad610 0x7f041c139980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:07.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.937+0000 7f04210c9700 1 --2- 172.21.15.60:0/2772251311 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f041c05b320 0x7f041c143920 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:07.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.937+0000 7f04210c9700 1 --2- 172.21.15.60:0/2772251311 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0400054f30 0x7f04000573f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:07.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.937+0000 7f04210c9700 1 --2- 172.21.15.60:0/2772251311 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f041c0acc60 0x7f041c139490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:07.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.937+0000 7f04210c9700 1 -- 172.21.15.60:0/2772251311 >> 172.21.15.60:0/2772251311 conn(0x7f041c0b61d0 msgr2=0x7f041c1463e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:07.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.937+0000 7f04210c9700 1 -- 172.21.15.60:0/2772251311 shutdown_connections 2020-10-31T22:50:07.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:07.937+0000 7f04210c9700 1 -- 172.21.15.60:0/2772251311 wait complete. 2020-10-31T22:50:07.943 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:50:07.957 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-10-31T22:50:08.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 Processor -- start 2020-10-31T22:50:08.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 -- start start 2020-10-31T22:50:08.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f809c0afdc0 0x7f809c13be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:08.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f809c13c310 0x7f809c0aa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:08.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f809c1429d0 con 0x7f809c0a7530 2020-10-31T22:50:08.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809c142c70 con 0x7f809c13c310 2020-10-31T22:50:08.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c13e8e0 con 0x7f809c0afdc0 2020-10-31T22:50:08.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f809bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f809c13c310 0x7f809c0aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:08.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f8092ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f809c0a7530 0x7f809c13edf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52744/0 (socket says 172.21.15.60:52744) 2020-10-31T22:50:08.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f809bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f809c13c310 0x7f809c0aa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48610/0 (socket says 172.21.15.60:48610) 2020-10-31T22:50:08.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f809b7fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f809c0afdc0 0x7f809c13be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:08.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f8092ffd700 1 -- 172.21.15.60:0/1356082999 learned_addr learned my addr 172.21.15.60:0/1356082999 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:08.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f809bfff700 1 -- 172.21.15.60:0/1356082999 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f809c0afdc0 msgr2=0x7f809c13be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:08.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f809bfff700 1 --2- 172.21.15.60:0/1356082999 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f809c0afdc0 0x7f809c13be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:08.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f809bfff700 1 -- 172.21.15.60:0/1356082999 >> v1:172.21.15.60:6789/0 conn(0x7f809c0a7530 legacy=0x7f809c13edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:08.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f809bfff700 1 -- 172.21.15.60:0/1356082999 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c0abb30 con 0x7f809c13c310 2020-10-31T22:50:08.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f809bfff700 1 --2- 172.21.15.60:0/1356082999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f809c13c310 0x7f809c0aa100 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f80940032b0 tx=0x7f80940091a0).ready entity=mon.0 client_cookie=901b5598a4b626f1 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:08.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f809affd700 1 -- 172.21.15.60:0/1356082999 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f809400b9a0 con 0x7f809c13c310 2020-10-31T22:50:08.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f809affd700 1 -- 172.21.15.60:0/1356082999 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809400bb00 con 0x7f809c13c310 2020-10-31T22:50:08.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f809affd700 1 -- 172.21.15.60:0/1356082999 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f809400bc70 con 0x7f809c13c310 2020-10-31T22:50:08.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 -- 172.21.15.60:0/1356082999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f809c13c310 msgr2=0x7f809c0aa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:08.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 --2- 172.21.15.60:0/1356082999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f809c13c310 0x7f809c0aa100 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 rx=0x7f80940032b0 tx=0x7f80940091a0).stop 2020-10-31T22:50:08.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 -- 172.21.15.60:0/1356082999 shutdown_connections 2020-10-31T22:50:08.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 --2- 172.21.15.60:0/1356082999 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f809c13c310 0x7f809c0aa100 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:08.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 --2- 172.21.15.60:0/1356082999 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f809c0afdc0 0x7f809c13be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 -- 172.21.15.60:0/1356082999 >> 172.21.15.60:0/1356082999 conn(0x7f809c0b3fd0 msgr2=0x7f809c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 -- 172.21.15.60:0/1356082999 shutdown_connections 2020-10-31T22:50:08.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.073+0000 7f80a0cdd700 1 -- 172.21.15.60:0/1356082999 wait complete. 2020-10-31T22:50:08.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f80a0cdd700 1 Processor -- start 2020-10-31T22:50:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f80a0cdd700 1 -- start start 2020-10-31T22:50:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f80a0cdd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f809c0afdc0 0x7f809c132230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:08.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f80a0cdd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f809c13c310 0x7f809c131140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:08.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f80a0cdd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f809c0b2f20 0x7f809c12f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:08.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f80a0cdd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c13ffc0 con 0x7f809c0afdc0 2020-10-31T22:50:08.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f80a0cdd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809c0b2d30 con 0x7f809c0b2f20 2020-10-31T22:50:08.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f80a0cdd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f809c0b2120 con 0x7f809c13c310 2020-10-31T22:50:08.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f809b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f809c0afdc0 0x7f809c132230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:08.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f809b7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f809c0afdc0 0x7f809c132230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48612/0 (socket says 172.21.15.60:48612) 2020-10-31T22:50:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f809b7fe700 1 -- 172.21.15.60:0/3970632821 learned_addr learned my addr 172.21.15.60:0/3970632821 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f8092ffd700 1 --2- 172.21.15.60:0/3970632821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f809c13c310 0x7f809c131140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:08.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f809bfff700 1 --2- 172.21.15.60:0/3970632821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f809c0b2f20 0x7f809c12f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f809b7fe700 1 -- 172.21.15.60:0/3970632821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f809c13c310 msgr2=0x7f809c131140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f809b7fe700 1 --2- 172.21.15.60:0/3970632821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f809c13c310 0x7f809c131140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f809b7fe700 1 -- 172.21.15.60:0/3970632821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f809c0b2f20 msgr2=0x7f809c12f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:08.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f809b7fe700 1 --2- 172.21.15.60:0/3970632821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f809c0b2f20 0x7f809c12f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:08.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f809b7fe700 1 -- 172.21.15.60:0/3970632821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809c141b20 con 0x7f809c0afdc0 2020-10-31T22:50:08.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f809b7fe700 1 --2- 172.21.15.60:0/3970632821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f809c0afdc0 0x7f809c132230 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f809c0b2e70 tx=0x7f808c006d60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:08.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f80997fa700 1 -- 172.21.15.60:0/3970632821 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f808c00eee0 con 0x7f809c0afdc0 2020-10-31T22:50:08.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f80997fa700 1 -- 172.21.15.60:0/3970632821 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c00ba80 con 0x7f809c0afdc0 2020-10-31T22:50:08.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f80a0cdd700 1 -- 172.21.15.60:0/3970632821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f809c141dc0 con 0x7f809c0afdc0 2020-10-31T22:50:08.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f80997fa700 1 -- 172.21.15.60:0/3970632821 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f808c00bde0 con 0x7f809c0afdc0 2020-10-31T22:50:08.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.077+0000 7f80a0cdd700 1 -- 172.21.15.60:0/3970632821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c141750 con 0x7f809c0afdc0 2020-10-31T22:50:08.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.081+0000 7f80a0cdd700 1 -- 172.21.15.60:0/3970632821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809c1317d0 con 0x7f809c0afdc0 2020-10-31T22:50:08.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.081+0000 7f80997fa700 1 -- 172.21.15.60:0/3970632821 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f808c01c460 con 0x7f809c0afdc0 2020-10-31T22:50:08.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.081+0000 7f80997fa700 1 --2- 172.21.15.60:0/3970632821 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8080054f30 0x7f80800573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:08.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.081+0000 7f8092ffd700 1 --2- 172.21.15.60:0/3970632821 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8080054f30 0x7f80800573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:08.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.081+0000 7f80997fa700 1 -- 172.21.15.60:0/3970632821 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f808c06dcb0 con 0x7f809c0afdc0 2020-10-31T22:50:08.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.081+0000 7f8092ffd700 1 --2- 172.21.15.60:0/3970632821 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8080054f30 0x7f80800573f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f808400b000 tx=0x7f8084009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:08.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.089+0000 7f80997fa700 1 -- 172.21.15.60:0/3970632821 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f808c0441c0 con 0x7f809c0afdc0 2020-10-31T22:50:08.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.233+0000 7f80a0cdd700 1 -- 172.21.15.60:0/3970632821 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f809c057100 con 0x7f809c0afdc0 2020-10-31T22:50:08.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.941+0000 7f80997fa700 1 -- 172.21.15.60:0/3970632821 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v134) v1 ==== 173+0+0 (secure 0 0 0) 0x7f808c0477e0 con 0x7f809c0afdc0 2020-10-31T22:50:08.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.945+0000 7f80a0cdd700 1 -- 172.21.15.60:0/3970632821 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8080054f30 msgr2=0x7f80800573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:08.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.945+0000 7f80a0cdd700 1 --2- 172.21.15.60:0/3970632821 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8080054f30 0x7f80800573f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f808400b000 tx=0x7f8084009040).stop 2020-10-31T22:50:08.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.945+0000 7f80a0cdd700 1 -- 172.21.15.60:0/3970632821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f809c0afdc0 msgr2=0x7f809c132230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:08.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.945+0000 7f80a0cdd700 1 --2- 172.21.15.60:0/3970632821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f809c0afdc0 0x7f809c132230 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 rx=0x7f809c0b2e70 tx=0x7f808c006d60).stop 2020-10-31T22:50:08.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.945+0000 7f80a0cdd700 1 -- 172.21.15.60:0/3970632821 shutdown_connections 2020-10-31T22:50:08.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.945+0000 7f80a0cdd700 1 --2- 172.21.15.60:0/3970632821 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8080054f30 0x7f80800573f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:08.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.945+0000 7f80a0cdd700 1 --2- 172.21.15.60:0/3970632821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f809c0b2f20 0x7f809c12f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:08.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.945+0000 7f80a0cdd700 1 --2- 172.21.15.60:0/3970632821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f809c0afdc0 0x7f809c132230 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:08.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.945+0000 7f80a0cdd700 1 --2- 172.21.15.60:0/3970632821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f809c13c310 0x7f809c131140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:08.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.945+0000 7f80a0cdd700 1 -- 172.21.15.60:0/3970632821 >> 172.21.15.60:0/3970632821 conn(0x7f809c0b3fd0 msgr2=0x7f809c0ae740 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:08.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.945+0000 7f80a0cdd700 1 -- 172.21.15.60:0/3970632821 shutdown_connections 2020-10-31T22:50:08.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:08.945+0000 7f80a0cdd700 1 -- 172.21.15.60:0/3970632821 wait complete. 2020-10-31T22:50:08.952 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2020-10-31T22:50:08.963 INFO:tasks.ceph.mds.a:Restarting daemon 2020-10-31T22:50:08.964 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-10-31T22:50:08.964 INFO:tasks.ceph.mds.c:Restarting daemon 2020-10-31T22:50:08.965 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-10-31T22:50:08.965 INFO:tasks.ceph.mds.b:Restarting daemon 2020-10-31T22:50:08.965 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-10-31T22:50:08.967 INFO:tasks.ceph.mds.a:Started 2020-10-31T22:50:08.967 DEBUG:teuthology.parallel:result is None 2020-10-31T22:50:08.968 INFO:tasks.ceph.mds.b:Started 2020-10-31T22:50:08.968 INFO:tasks.ceph.mds.c:Started 2020-10-31T22:50:08.969 DEBUG:teuthology.parallel:result is None 2020-10-31T22:50:08.969 DEBUG:teuthology.parallel:result is None 2020-10-31T22:50:08.969 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-10-31T22:50:09.041 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:50:09.041 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:50:09.061 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:50:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.089+0000 7f0fe1927700 1 Processor -- start 2020-10-31T22:50:09.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.089+0000 7f0fe1927700 1 -- start start 2020-10-31T22:50:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fe1927700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0fdc0b52a0 0x7f0fdc141d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:09.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fe1927700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fdc0aead0 0x7f0fdc0af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:09.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fe1927700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc05b160 con 0x7f0fdc05bde0 2020-10-31T22:50:09.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fe1927700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fdc06a430 con 0x7f0fdc0b52a0 2020-10-31T22:50:09.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fe1927700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc05b400 con 0x7f0fdc0aead0 2020-10-31T22:50:09.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fdaffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0fdc0b52a0 0x7f0fdc141d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:09.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fda7fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fdc0aead0 0x7f0fdc0af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:09.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fda7fc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fdc0aead0 0x7f0fdc0af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:33606/0 (socket says 172.21.15.60:33606) 2020-10-31T22:50:09.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fdaffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0fdc0b52a0 0x7f0fdc141d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:59586/0 (socket says 172.21.15.60:59586) 2020-10-31T22:50:09.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fda7fc700 1 -- 172.21.15.60:0/44930239 learned_addr learned my addr 172.21.15.60:0/44930239 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:09.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fdb7fe700 1 --1- 172.21.15.60:0/44930239 >> v1:172.21.15.66:6789/0 conn(0x7f0fdc05bde0 0x7f0fdc13b830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:50656/0 (socket says 172.21.15.60:50656) 2020-10-31T22:50:09.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fd9ffb700 1 -- 172.21.15.60:0/44930239 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869967748 0 0) 0x7f0fdc05b160 con 0x7f0fdc05bde0 2020-10-31T22:50:09.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fd9ffb700 1 -- 172.21.15.60:0/44930239 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc0003230 con 0x7f0fdc05bde0 2020-10-31T22:50:09.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fda7fc700 1 -- 172.21.15.60:0/44930239 >> v2:172.21.15.66:3300/0 conn(0x7f0fdc0b52a0 msgr2=0x7f0fdc141d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:09.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fda7fc700 1 --2- 172.21.15.60:0/44930239 >> v2:172.21.15.66:3300/0 conn(0x7f0fdc0b52a0 0x7f0fdc141d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:09.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fda7fc700 1 -- 172.21.15.60:0/44930239 >> v1:172.21.15.66:6789/0 conn(0x7f0fdc05bde0 legacy=0x7f0fdc13b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:09.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fda7fc700 1 -- 172.21.15.60:0/44930239 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc05b6a0 con 0x7f0fdc0aead0 2020-10-31T22:50:09.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fdaffd700 1 --2- 172.21.15.60:0/44930239 >> v2:172.21.15.66:3300/0 conn(0x7f0fdc0b52a0 0x7f0fdc141d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:09.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fda7fc700 1 --2- 172.21.15.60:0/44930239 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fdc0aead0 0x7f0fdc0af390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0fd0002f30 tx=0x7f0fd0006e80).ready entity=mon.2 client_cookie=3dface9f423c1b7b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:09.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fd9ffb700 1 -- 172.21.15.60:0/44930239 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fd0009640 con 0x7f0fdc0aead0 2020-10-31T22:50:09.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fd9ffb700 1 -- 172.21.15.60:0/44930239 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd00097a0 con 0x7f0fdc0aead0 2020-10-31T22:50:09.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fd9ffb700 1 -- 172.21.15.60:0/44930239 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fd0009b00 con 0x7f0fdc0aead0 2020-10-31T22:50:09.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fe1927700 1 -- 172.21.15.60:0/44930239 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fdc0aead0 msgr2=0x7f0fdc0af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:09.104 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fe1927700 1 --2- 172.21.15.60:0/44930239 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fdc0aead0 0x7f0fdc0af390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0fd0002f30 tx=0x7f0fd0006e80).stop 2020-10-31T22:50:09.110 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fe1927700 1 -- 172.21.15.60:0/44930239 shutdown_connections 2020-10-31T22:50:09.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fe1927700 1 --2- 172.21.15.60:0/44930239 >> v2:172.21.15.66:3300/0 conn(0x7f0fdc0b52a0 0x7f0fdc141d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:09.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fe1927700 1 --2- 172.21.15.60:0/44930239 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fdc0aead0 0x7f0fdc0af390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:09.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fe1927700 1 -- 172.21.15.60:0/44930239 >> 172.21.15.60:0/44930239 conn(0x7f0fdc060c10 msgr2=0x7f0fdc0b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:09.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fe1927700 1 -- 172.21.15.60:0/44930239 shutdown_connections 2020-10-31T22:50:09.111 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.093+0000 7f0fe1927700 1 -- 172.21.15.60:0/44930239 wait complete. 2020-10-31T22:50:09.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fe1927700 1 Processor -- start 2020-10-31T22:50:09.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fe1927700 1 -- start start 2020-10-31T22:50:09.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fe1927700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fdc05bde0 0x7f0fdc1433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:09.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fe1927700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fdc0aead0 0x7f0fdc0b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:09.112 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fe1927700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fdc0b52a0 0x7f0fdc1415f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fe1927700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc154d70 con 0x7f0fdc0aead0 2020-10-31T22:50:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fe1927700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc140c10 con 0x7f0fdc05bde0 2020-10-31T22:50:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fe1927700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc140eb0 con 0x7f0fdc0b52a0 2020-10-31T22:50:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fda7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fdc0aead0 0x7f0fdc0b3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fda7fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fdc0aead0 0x7f0fdc0b3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48658/0 (socket says 172.21.15.60:48658) 2020-10-31T22:50:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fda7fc700 1 -- 172.21.15.60:0/2442591583 learned_addr learned my addr 172.21.15.60:0/2442591583 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:09.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fdb7fe700 1 --2- 172.21.15.60:0/2442591583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fdc0b52a0 0x7f0fdc1415f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fdaffd700 1 --2- 172.21.15.60:0/2442591583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fdc05bde0 0x7f0fdc1433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fda7fc700 1 -- 172.21.15.60:0/2442591583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fdc0b52a0 msgr2=0x7f0fdc1415f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fda7fc700 1 --2- 172.21.15.60:0/2442591583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fdc0b52a0 0x7f0fdc1415f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fda7fc700 1 -- 172.21.15.60:0/2442591583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fdc05bde0 msgr2=0x7f0fdc1433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fda7fc700 1 --2- 172.21.15.60:0/2442591583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fdc05bde0 0x7f0fdc1433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fda7fc700 1 -- 172.21.15.60:0/2442591583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc141150 con 0x7f0fdc0aead0 2020-10-31T22:50:09.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fda7fc700 1 --2- 172.21.15.60:0/2442591583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fdc0aead0 0x7f0fdc0b3ef0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f0fd0002f30 tx=0x7f0fd0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fcbfff700 1 -- 172.21.15.60:0/2442591583 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fd0011b40 con 0x7f0fdc0aead0 2020-10-31T22:50:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fe1927700 1 -- 172.21.15.60:0/2442591583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fdc1439d0 con 0x7f0fdc0aead0 2020-10-31T22:50:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fe1927700 1 -- 172.21.15.60:0/2442591583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fdc154b10 con 0x7f0fdc0aead0 2020-10-31T22:50:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fcbfff700 1 -- 172.21.15.60:0/2442591583 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd0011ca0 con 0x7f0fdc0aead0 2020-10-31T22:50:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.097+0000 7f0fcbfff700 1 -- 172.21.15.60:0/2442591583 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0fd0027460 con 0x7f0fdc0aead0 2020-10-31T22:50:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.101+0000 7f0fe1927700 1 -- 172.21.15.60:0/2442591583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fdc1412e0 con 0x7f0fdc0aead0 2020-10-31T22:50:09.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.101+0000 7f0fcbfff700 1 -- 172.21.15.60:0/2442591583 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0fd000f070 con 0x7f0fdc0aead0 2020-10-31T22:50:09.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.101+0000 7f0fcbfff700 1 --2- 172.21.15.60:0/2442591583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0fb8054f10 0x7f0fb80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:09.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.101+0000 7f0fcbfff700 1 -- 172.21.15.60:0/2442591583 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f0fd006ee90 con 0x7f0fdc0aead0 2020-10-31T22:50:09.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.101+0000 7f0fdaffd700 1 --2- 172.21.15.60:0/2442591583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0fb8054f10 0x7f0fb80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:09.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.101+0000 7f0fdaffd700 1 --2- 172.21.15.60:0/2442591583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0fb8054f10 0x7f0fb80573d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f0fd400b000 tx=0x7f0fd40091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:09.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.109+0000 7f0fcbfff700 1 -- 172.21.15.60:0/2442591583 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0fd00456a0 con 0x7f0fdc0aead0 2020-10-31T22:50:09.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:09.269+0000 7f0fe1927700 1 -- 172.21.15.60:0/2442591583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f0fdc057100 con 0x7f0fdc0aead0 2020-10-31T22:50:10.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.069+0000 7f0fcbfff700 1 -- 172.21.15.60:0/2442591583 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v135) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0fd0048cc0 con 0x7f0fdc0aead0 2020-10-31T22:50:10.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.073+0000 7f0fe1927700 1 -- 172.21.15.60:0/2442591583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0fb8054f10 msgr2=0x7f0fb80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.073+0000 7f0fe1927700 1 --2- 172.21.15.60:0/2442591583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0fb8054f10 0x7f0fb80573d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f0fd400b000 tx=0x7f0fd40091a0).stop 2020-10-31T22:50:10.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.073+0000 7f0fe1927700 1 -- 172.21.15.60:0/2442591583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fdc0aead0 msgr2=0x7f0fdc0b3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.073+0000 7f0fe1927700 1 --2- 172.21.15.60:0/2442591583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fdc0aead0 0x7f0fdc0b3ef0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 rx=0x7f0fd0002f30 tx=0x7f0fd0015000).stop 2020-10-31T22:50:10.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.073+0000 7f0fe1927700 1 -- 172.21.15.60:0/2442591583 shutdown_connections 2020-10-31T22:50:10.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.073+0000 7f0fe1927700 1 --2- 172.21.15.60:0/2442591583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0fdc0b52a0 0x7f0fdc1415f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.073+0000 7f0fe1927700 1 --2- 172.21.15.60:0/2442591583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0fb8054f10 0x7f0fb80573d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.073+0000 7f0fe1927700 1 --2- 172.21.15.60:0/2442591583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0fdc05bde0 0x7f0fdc1433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.073+0000 7f0fe1927700 1 --2- 172.21.15.60:0/2442591583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fdc0aead0 0x7f0fdc0b3ef0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.073+0000 7f0fe1927700 1 -- 172.21.15.60:0/2442591583 >> 172.21.15.60:0/2442591583 conn(0x7f0fdc060c10 msgr2=0x7f0fdc0add30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:10.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.073+0000 7f0fe1927700 1 -- 172.21.15.60:0/2442591583 shutdown_connections 2020-10-31T22:50:10.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.073+0000 7f0fe1927700 1 -- 172.21.15.60:0/2442591583 wait complete. 2020-10-31T22:50:10.081 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blacklist entries 2020-10-31T22:50:10.094 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2020-10-31T22:50:10.095 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-10-31T22:50:10.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba63121700 1 Processor -- start 2020-10-31T22:50:10.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba63121700 1 -- start start 2020-10-31T22:50:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba63121700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fba5c0a7850 0x7fba5c05bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba63121700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5c0af200 con 0x7fba5c05b960 2020-10-31T22:50:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba63121700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5c0b0f00 con 0x7fba5c146790 2020-10-31T22:50:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba63121700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5c0b11a0 con 0x7fba5c0a7850 2020-10-31T22:50:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba60ebd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fba5c05b960 0x7fba5c0aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52802/0 (socket says 172.21.15.60:52802) 2020-10-31T22:50:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba60ebd700 1 -- 172.21.15.60:0/3126615945 learned_addr learned my addr 172.21.15.60:0/3126615945 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:10.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5bfff700 1 --2- 172.21.15.60:0/3126615945 >> v2:172.21.15.66:3300/0 conn(0x7fba5c0a7850 0x7fba5c05bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935102116 0 0) 0x7fba5c0af200 con 0x7fba5c05b960 2020-10-31T22:50:10.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba40003230 con 0x7fba5c05b960 2020-10-31T22:50:10.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2630305278 0 0) 0x7fba5c0b0f00 con 0x7fba5c146790 2020-10-31T22:50:10.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba5c0af200 con 0x7fba5c146790 2020-10-31T22:50:10.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 158503056 0 0) 0x7fba40003230 con 0x7fba5c05b960 2020-10-31T22:50:10.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 >> v2:172.21.15.66:3300/0 conn(0x7fba5c0a7850 msgr2=0x7fba5c05bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 --2- 172.21.15.60:0/3126615945 >> v2:172.21.15.66:3300/0 conn(0x7fba5c0a7850 0x7fba5c05bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 >> v1:172.21.15.66:6789/0 conn(0x7fba5c146790 legacy=0x7fba5c146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c0b1440 con 0x7fba5c05b960 2020-10-31T22:50:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fba440016d0 con 0x7fba5c05b960 2020-10-31T22:50:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 >> v1:172.21.15.60:6789/0 conn(0x7fba5c05b960 legacy=0x7fba5c0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 --2- 172.21.15.60:0/3126615945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba400038b0 0x7fba40003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 --2- 172.21.15.60:0/3126615945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400044d0 0x7fba40004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 --2- 172.21.15.60:0/3126615945 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba40004e40 0x7fba4000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0b11a0 con 0x7fba400044d0 2020-10-31T22:50:10.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4000bc10 con 0x7fba400038b0 2020-10-31T22:50:10.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4000bda0 con 0x7fba40004e40 2020-10-31T22:50:10.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba5bfff700 1 --2- 172.21.15.60:0/3126615945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400044d0 0x7fba40004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba60ebd700 1 --2- 172.21.15.60:0/3126615945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba400038b0 0x7fba40003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.209+0000 7fba616be700 1 --2- 172.21.15.60:0/3126615945 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba40004e40 0x7fba4000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba5bfff700 1 -- 172.21.15.60:0/3126615945 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba40004e40 msgr2=0x7fba4000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba5bfff700 1 --2- 172.21.15.60:0/3126615945 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba40004e40 0x7fba4000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba5bfff700 1 -- 172.21.15.60:0/3126615945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba400038b0 msgr2=0x7fba40003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba5bfff700 1 --2- 172.21.15.60:0/3126615945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba400038b0 0x7fba40003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba616be700 1 -- 172.21.15.60:0/3126615945 reap_dead start 2020-10-31T22:50:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba5bfff700 1 -- 172.21.15.60:0/3126615945 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba40003230 con 0x7fba400044d0 2020-10-31T22:50:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba5bfff700 1 --2- 172.21.15.60:0/3126615945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400044d0 0x7fba40004950 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7fba4c00c000 tx=0x7fba4c008040).ready entity=mon.0 client_cookie=737fb6ba3d6e0021 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:10.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba4c00e8a0 con 0x7fba400044d0 2020-10-31T22:50:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c00ea00 con 0x7fba400044d0 2020-10-31T22:50:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba5b7fe700 1 -- 172.21.15.60:0/3126615945 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba4c00ed60 con 0x7fba400044d0 2020-10-31T22:50:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba63121700 1 -- 172.21.15.60:0/3126615945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400044d0 msgr2=0x7fba40004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba63121700 1 --2- 172.21.15.60:0/3126615945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400044d0 0x7fba40004950 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 rx=0x7fba4c00c000 tx=0x7fba4c008040).stop 2020-10-31T22:50:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba63121700 1 -- 172.21.15.60:0/3126615945 shutdown_connections 2020-10-31T22:50:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba63121700 1 --2- 172.21.15.60:0/3126615945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba400044d0 0x7fba40004950 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba63121700 1 -- 172.21.15.60:0/3126615945 >> 172.21.15.60:0/3126615945 conn(0x7fba5c06a260 msgr2=0x7fba5c061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba63121700 1 -- 172.21.15.60:0/3126615945 shutdown_connections 2020-10-31T22:50:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba63121700 1 -- 172.21.15.60:0/3126615945 wait complete. 2020-10-31T22:50:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba63121700 1 Processor -- start 2020-10-31T22:50:10.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.213+0000 7fba63121700 1 -- start start 2020-10-31T22:50:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba63121700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba400044d0 0x7fba5c14a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba63121700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba5c140a50 0x7fba5c143400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba63121700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba5c154ce0 0x7fba5c13f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba63121700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0b4f00 con 0x7fba5c140a50 2020-10-31T22:50:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba63121700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0a91b0 con 0x7fba5c154ce0 2020-10-31T22:50:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba63121700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5c0a9450 con 0x7fba400044d0 2020-10-31T22:50:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba5bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba5c140a50 0x7fba5c143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba5bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba5c140a50 0x7fba5c143400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48678/0 (socket says 172.21.15.60:48678) 2020-10-31T22:50:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba5bfff700 1 -- 172.21.15.60:0/2652222458 learned_addr learned my addr 172.21.15.60:0/2652222458 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba60ebd700 1 --2- 172.21.15.60:0/2652222458 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba400044d0 0x7fba5c14a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba616be700 1 --2- 172.21.15.60:0/2652222458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba5c154ce0 0x7fba5c13f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba5bfff700 1 -- 172.21.15.60:0/2652222458 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba400044d0 msgr2=0x7fba5c14a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba5bfff700 1 --2- 172.21.15.60:0/2652222458 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba400044d0 0x7fba5c14a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba5bfff700 1 -- 172.21.15.60:0/2652222458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba5c154ce0 msgr2=0x7fba5c13f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba5bfff700 1 --2- 172.21.15.60:0/2652222458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba5c154ce0 0x7fba5c13f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba5bfff700 1 -- 172.21.15.60:0/2652222458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba5c0a96f0 con 0x7fba5c140a50 2020-10-31T22:50:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba5bfff700 1 --2- 172.21.15.60:0/2652222458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba5c140a50 0x7fba5c143400 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7fba4c00c000 tx=0x7fba4c01a000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:10.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba59ffb700 1 -- 172.21.15.60:0/2652222458 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba4c0127f0 con 0x7fba5c140a50 2020-10-31T22:50:10.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba63121700 1 -- 172.21.15.60:0/2652222458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba5c142d90 con 0x7fba5c140a50 2020-10-31T22:50:10.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba59ffb700 1 -- 172.21.15.60:0/2652222458 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c012950 con 0x7fba5c140a50 2020-10-31T22:50:10.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba59ffb700 1 -- 172.21.15.60:0/2652222458 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fba4c012cb0 con 0x7fba5c140a50 2020-10-31T22:50:10.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba63121700 1 -- 172.21.15.60:0/2652222458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba5c155170 con 0x7fba5c140a50 2020-10-31T22:50:10.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.217+0000 7fba63121700 1 -- 172.21.15.60:0/2652222458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba5c155480 con 0x7fba5c140a50 2020-10-31T22:50:10.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.221+0000 7fba59ffb700 1 -- 172.21.15.60:0/2652222458 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fba4c02d420 con 0x7fba5c140a50 2020-10-31T22:50:10.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.221+0000 7fba59ffb700 1 --2- 172.21.15.60:0/2652222458 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fba340550c0 0x7fba34057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.221+0000 7fba59ffb700 1 -- 172.21.15.60:0/2652222458 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fba4c06f8d0 con 0x7fba5c140a50 2020-10-31T22:50:10.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.221+0000 7fba60ebd700 1 --2- 172.21.15.60:0/2652222458 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fba340550c0 0x7fba34057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.221+0000 7fba60ebd700 1 --2- 172.21.15.60:0/2652222458 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fba340550c0 0x7fba34057580 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fba44005000 tx=0x7fba44007690).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:10.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.225+0000 7fba59ffb700 1 -- 172.21.15.60:0/2652222458 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fba4c0460c0 con 0x7fba5c140a50 2020-10-31T22:50:10.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.417+0000 7fba63121700 1 -- 172.21.15.60:0/2652222458 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fba5c0a9880 con 0x7fba5c140a50 2020-10-31T22:50:10.425 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.421+0000 7fba59ffb700 1 -- 172.21.15.60:0/2652222458 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v28) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fba4c016070 con 0x7fba5c140a50 2020-10-31T22:50:10.425 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:10.426 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:50:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2020-10-31T22:50:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2020-10-31T22:50:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f7D/cFRAAHQ9NU7VSs14mi5sC/GwHng==", 2020-10-31T22:50:10.426 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:50:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2020-10-31T22:50:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f5SPjJBAAVjFv2PdBZ7j94etJrAT0tA==", 2020-10-31T22:50:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:50:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:10.428 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2020-10-31T22:50:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKpdoHhAAhhlaYqOQoI6tTKexjRpbGA==", 2020-10-31T22:50:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:50:10.429 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2020-10-31T22:50:10.430 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDR551f7MwsMRAACZIQlAKm3BdVbDs2gQAfxg==", 2020-10-31T22:50:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2020-10-31T22:50:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDU551f07HQFxAAokMFXwsbgKGtJNpnKerdGg==", 2020-10-31T22:50:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:10.432 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2020-10-31T22:50:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDW551fODyjOhAAJ+j8KITJidSpltSiJaQZGw==", 2020-10-31T22:50:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.433 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.434 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2020-10-31T22:50:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDZ551fs+aCIhAAwpbmgGQjU05W3hZofTtHdg==", 2020-10-31T22:50:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:10.435 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2020-10-31T22:50:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDe551fI5nIMxAAwwNSHQYDPS6G2achKIpwqg==", 2020-10-31T22:50:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:10.436 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2020-10-31T22:50:10.437 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDh551f68p2GhAAhlGpZLPg8RqouzStqN4tFw==", 2020-10-31T22:50:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2020-10-31T22:50:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDk551fUi3kARAAsXPU7HEhqax8Go00CqgdNw==", 2020-10-31T22:50:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:10.439 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2020-10-31T22:50:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDm551fKh4aJRAAj+whV4kueCu2Og7wZ05tNw==", 2020-10-31T22:50:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.440 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2020-10-31T22:50:10.441 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551flXvBJxAAtD4URDL2NV0zyAympufvVA==", 2020-10-31T22:50:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:50:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:50:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:50:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2020-10-31T22:50:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fQ/OGKhAA/xGrRlUW52pP6E6SWXYAGA==", 2020-10-31T22:50:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:50:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:50:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:50:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2020-10-31T22:50:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDP551fITgCMxAAQy5CQzqda1YjdUtTRxbsPQ==", 2020-10-31T22:50:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:50:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:10.444 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2020-10-31T22:50:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551feZUgExAAvGt2fUb5GhkkFQ0dbgP5nw==", 2020-10-31T22:50:10.445 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:50:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:50:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:10.446 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2020-10-31T22:50:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKiN5EBAAhHtXXE4+yydXWOK7agZ14g==", 2020-10-31T22:50:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:50:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:50:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.447 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:10.448 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:10.448 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:50:10.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.421+0000 7fba63121700 1 -- 172.21.15.60:0/2652222458 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fba340550c0 msgr2=0x7fba34057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.421+0000 7fba63121700 1 --2- 172.21.15.60:0/2652222458 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fba340550c0 0x7fba34057580 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7fba44005000 tx=0x7fba44007690).stop 2020-10-31T22:50:10.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.421+0000 7fba63121700 1 -- 172.21.15.60:0/2652222458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba5c140a50 msgr2=0x7fba5c143400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.421+0000 7fba63121700 1 --2- 172.21.15.60:0/2652222458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba5c140a50 0x7fba5c143400 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 rx=0x7fba4c00c000 tx=0x7fba4c01a000).stop 2020-10-31T22:50:10.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.421+0000 7fba63121700 1 -- 172.21.15.60:0/2652222458 shutdown_connections 2020-10-31T22:50:10.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.421+0000 7fba63121700 1 --2- 172.21.15.60:0/2652222458 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fba340550c0 0x7fba34057580 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.421+0000 7fba63121700 1 --2- 172.21.15.60:0/2652222458 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba5c154ce0 0x7fba5c13f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.421+0000 7fba63121700 1 --2- 172.21.15.60:0/2652222458 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba400044d0 0x7fba5c14a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.421+0000 7fba63121700 1 --2- 172.21.15.60:0/2652222458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fba5c140a50 0x7fba5c143400 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.421+0000 7fba63121700 1 -- 172.21.15.60:0/2652222458 >> 172.21.15.60:0/2652222458 conn(0x7fba5c06a260 msgr2=0x7fba5c147c20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:10.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.421+0000 7fba63121700 1 -- 172.21.15.60:0/2652222458 shutdown_connections 2020-10-31T22:50:10.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.421+0000 7fba63121700 1 -- 172.21.15.60:0/2652222458 wait complete. 2020-10-31T22:50:10.452 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:50:10.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.557+0000 7f3707868700 1 Processor -- start 2020-10-31T22:50:10.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.557+0000 7f3707868700 1 -- start start 2020-10-31T22:50:10.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.557+0000 7f3707868700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f370005b960 0x7f370005bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.557+0000 7f3707868700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37000af200 con 0x7f3700146790 2020-10-31T22:50:10.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.557+0000 7f3707868700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37000b0f00 con 0x7f37000a7850 2020-10-31T22:50:10.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.557+0000 7f3707868700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37000b11a0 con 0x7f370005b960 2020-10-31T22:50:10.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.557+0000 7f3705e05700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3700146790 0x7f3700146ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52824/0 (socket says 172.21.15.60:52824) 2020-10-31T22:50:10.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.557+0000 7f3705e05700 1 -- 172.21.15.60:0/1078016577 learned_addr learned my addr 172.21.15.60:0/1078016577 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:10.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3705604700 1 --2- 172.21.15.60:0/1078016577 >> v2:172.21.15.66:3300/0 conn(0x7f370005b960 0x7f370005bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 -- 172.21.15.60:0/1078016577 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3309186458 0 0) 0x7f37000af200 con 0x7f3700146790 2020-10-31T22:50:10.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 -- 172.21.15.60:0/1078016577 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36e4003230 con 0x7f3700146790 2020-10-31T22:50:10.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 -- 172.21.15.60:0/1078016577 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3243987145 0 0) 0x7f36e4003230 con 0x7f3700146790 2020-10-31T22:50:10.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 -- 172.21.15.60:0/1078016577 >> v2:172.21.15.66:3300/0 conn(0x7f370005b960 msgr2=0x7f370005bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:10.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 --2- 172.21.15.60:0/1078016577 >> v2:172.21.15.66:3300/0 conn(0x7f370005b960 0x7f370005bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 -- 172.21.15.60:0/1078016577 >> v1:172.21.15.66:6789/0 conn(0x7f37000a7850 legacy=0x7f37000aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 -- 172.21.15.60:0/1078016577 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37000b1440 con 0x7f3700146790 2020-10-31T22:50:10.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 -- 172.21.15.60:0/1078016577 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f36f8001a50 con 0x7f3700146790 2020-10-31T22:50:10.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3705604700 1 --2- 172.21.15.60:0/1078016577 >> v2:172.21.15.66:3300/0 conn(0x7f370005b960 0x7f370005bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:10.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 -- 172.21.15.60:0/1078016577 >> v1:172.21.15.60:6789/0 conn(0x7f3700146790 legacy=0x7f3700146ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 --2- 172.21.15.60:0/1078016577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36e4003720 0x7f36e4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 --2- 172.21.15.60:0/1078016577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36e40044d0 0x7f36e4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 --2- 172.21.15.60:0/1078016577 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36e4004e40 0x7f36e400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 -- 172.21.15.60:0/1078016577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37000b11a0 con 0x7f36e40044d0 2020-10-31T22:50:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 -- 172.21.15.60:0/1078016577 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36e4004340 con 0x7f36e4003720 2020-10-31T22:50:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 -- 172.21.15.60:0/1078016577 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36e400bc40 con 0x7f36e4004e40 2020-10-31T22:50:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3704e03700 1 --2- 172.21.15.60:0/1078016577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36e40044d0 0x7f36e4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3705604700 1 --2- 172.21.15.60:0/1078016577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36e4003720 0x7f36e4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3705e05700 1 --2- 172.21.15.60:0/1078016577 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36e4004e40 0x7f36e400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3704e03700 1 -- 172.21.15.60:0/1078016577 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36e4004e40 msgr2=0x7f36e400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:10.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3704e03700 1 --2- 172.21.15.60:0/1078016577 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f36e4004e40 0x7f36e400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3704e03700 1 -- 172.21.15.60:0/1078016577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36e4003720 msgr2=0x7f36e4003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3704e03700 1 --2- 172.21.15.60:0/1078016577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36e4003720 0x7f36e4003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3705e05700 1 -- 172.21.15.60:0/1078016577 reap_dead start 2020-10-31T22:50:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3704e03700 1 -- 172.21.15.60:0/1078016577 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e4003230 con 0x7f36e40044d0 2020-10-31T22:50:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3705604700 1 --2- 172.21.15.60:0/1078016577 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36e4003720 0x7f36e4003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3704e03700 1 --2- 172.21.15.60:0/1078016577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36e40044d0 0x7f36e4004950 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f36fc001000 tx=0x7f36fc007b60).ready entity=mon.0 client_cookie=2eecac512c97f5d8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:10.571 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 -- 172.21.15.60:0/1078016577 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36fc00c660 con 0x7f36e40044d0 2020-10-31T22:50:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 -- 172.21.15.60:0/1078016577 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36fc00c7c0 con 0x7f36e40044d0 2020-10-31T22:50:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f36f3fff700 1 -- 172.21.15.60:0/1078016577 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36fc00cb20 con 0x7f36e40044d0 2020-10-31T22:50:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3707868700 1 -- 172.21.15.60:0/1078016577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36e40044d0 msgr2=0x7f36e4004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3707868700 1 --2- 172.21.15.60:0/1078016577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36e40044d0 0x7f36e4004950 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 rx=0x7f36fc001000 tx=0x7f36fc007b60).stop 2020-10-31T22:50:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3707868700 1 -- 172.21.15.60:0/1078016577 shutdown_connections 2020-10-31T22:50:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3707868700 1 --2- 172.21.15.60:0/1078016577 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f36e40044d0 0x7f36e4004950 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3707868700 1 -- 172.21.15.60:0/1078016577 >> 172.21.15.60:0/1078016577 conn(0x7f370006a260 msgr2=0x7f3700061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:10.572 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3707868700 1 -- 172.21.15.60:0/1078016577 shutdown_connections 2020-10-31T22:50:10.573 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.561+0000 7f3707868700 1 -- 172.21.15.60:0/1078016577 wait complete. 2020-10-31T22:50:10.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3707868700 1 Processor -- start 2020-10-31T22:50:10.574 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3707868700 1 -- start start 2020-10-31T22:50:10.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3707868700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36e40044d0 0x7f370014c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3707868700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37000ae020 0x7f37000b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3707868700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370013f330 0x7f370013f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3707868700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37000adbc0 con 0x7f370013f330 2020-10-31T22:50:10.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3707868700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37000addf0 con 0x7f36e40044d0 2020-10-31T22:50:10.575 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3707868700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37000acd40 con 0x7f37000ae020 2020-10-31T22:50:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3705e05700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370013f330 0x7f370013f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3705e05700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370013f330 0x7f370013f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48700/0 (socket says 172.21.15.60:48700) 2020-10-31T22:50:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3705e05700 1 -- 172.21.15.60:0/1517056741 learned_addr learned my addr 172.21.15.60:0/1517056741 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3704e03700 1 --2- 172.21.15.60:0/1517056741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37000ae020 0x7f37000b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3705604700 1 --2- 172.21.15.60:0/1517056741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36e40044d0 0x7f370014c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.576 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3705e05700 1 -- 172.21.15.60:0/1517056741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37000ae020 msgr2=0x7f37000b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3705e05700 1 --2- 172.21.15.60:0/1517056741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37000ae020 0x7f37000b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3705e05700 1 -- 172.21.15.60:0/1517056741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36e40044d0 msgr2=0x7f370014c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3705e05700 1 --2- 172.21.15.60:0/1517056741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36e40044d0 0x7f370014c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3705e05700 1 -- 172.21.15.60:0/1517056741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370014ce40 con 0x7f370013f330 2020-10-31T22:50:10.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3705e05700 1 --2- 172.21.15.60:0/1517056741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370013f330 0x7f370013f7b0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f37000ac660 tx=0x7f36f8007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:10.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f36f2ffd700 1 -- 172.21.15.60:0/1517056741 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36f800fb60 con 0x7f370013f330 2020-10-31T22:50:10.577 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f36f2ffd700 1 -- 172.21.15.60:0/1517056741 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f800fcc0 con 0x7f370013f330 2020-10-31T22:50:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3707868700 1 -- 172.21.15.60:0/1517056741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37000b2380 con 0x7f370013f330 2020-10-31T22:50:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f36f2ffd700 1 -- 172.21.15.60:0/1517056741 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f36f8012350 con 0x7f370013f330 2020-10-31T22:50:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.565+0000 7f3707868700 1 -- 172.21.15.60:0/1517056741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37000b1980 con 0x7f370013f330 2020-10-31T22:50:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.569+0000 7f3707868700 1 -- 172.21.15.60:0/1517056741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3700057100 con 0x7f370013f330 2020-10-31T22:50:10.578 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.569+0000 7f36f2ffd700 1 -- 172.21.15.60:0/1517056741 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f36f801b030 con 0x7f370013f330 2020-10-31T22:50:10.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.569+0000 7f36f2ffd700 1 --2- 172.21.15.60:0/1517056741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f36dc055020 0x7f36dc0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.569+0000 7f36f2ffd700 1 -- 172.21.15.60:0/1517056741 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f36f806d1b0 con 0x7f370013f330 2020-10-31T22:50:10.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.569+0000 7f3705604700 1 --2- 172.21.15.60:0/1517056741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f36dc055020 0x7f36dc0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.569+0000 7f3705604700 1 --2- 172.21.15.60:0/1517056741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f36dc055020 0x7f36dc0574e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f36f4008000 tx=0x7f36f4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:10.580 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.577+0000 7f36f2ffd700 1 -- 172.21.15.60:0/1517056741 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f36f80438f0 con 0x7f370013f330 2020-10-31T22:50:10.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.717+0000 7f3707868700 1 -- 172.21.15.60:0/1517056741 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f370005aa70 con 0x7f370013f330 2020-10-31T22:50:10.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.721+0000 7f36f2ffd700 1 -- 172.21.15.60:0/1517056741 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v135) v1 ==== 74+0+13191 (secure 0 0 0) 0x7f36f8019030 con 0x7f370013f330 2020-10-31T22:50:10.725 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:10.725 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":135,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:50:10.066986+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":24,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":125,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:50:10.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.721+0000 7f3707868700 1 -- 172.21.15.60:0/1517056741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f36dc055020 msgr2=0x7f36dc0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.721+0000 7f3707868700 1 --2- 172.21.15.60:0/1517056741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f36dc055020 0x7f36dc0574e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f36f4008000 tx=0x7f36f4008040).stop 2020-10-31T22:50:10.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.721+0000 7f3707868700 1 -- 172.21.15.60:0/1517056741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370013f330 msgr2=0x7f370013f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.721+0000 7f3707868700 1 --2- 172.21.15.60:0/1517056741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370013f330 0x7f370013f7b0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 rx=0x7f37000ac660 tx=0x7f36f8007a40).stop 2020-10-31T22:50:10.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.721+0000 7f3707868700 1 -- 172.21.15.60:0/1517056741 shutdown_connections 2020-10-31T22:50:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.721+0000 7f3707868700 1 --2- 172.21.15.60:0/1517056741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f370013f330 0x7f370013f7b0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.721+0000 7f3707868700 1 --2- 172.21.15.60:0/1517056741 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f36dc055020 0x7f36dc0574e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.721+0000 7f3707868700 1 --2- 172.21.15.60:0/1517056741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f36e40044d0 0x7f370014c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.721+0000 7f3707868700 1 --2- 172.21.15.60:0/1517056741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37000ae020 0x7f37000b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.721+0000 7f3707868700 1 -- 172.21.15.60:0/1517056741 >> 172.21.15.60:0/1517056741 conn(0x7f370006a260 msgr2=0x7f3700148290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.721+0000 7f3707868700 1 -- 172.21.15.60:0/1517056741 shutdown_connections 2020-10-31T22:50:10.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.721+0000 7f3707868700 1 -- 172.21.15.60:0/1517056741 wait complete. 2020-10-31T22:50:10.739 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-31T22:50:10.740 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:50:10.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.849+0000 7f9bee830700 1 Processor -- start 2020-10-31T22:50:10.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.849+0000 7f9bee830700 1 -- start start 2020-10-31T22:50:10.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee830700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be805c2d0 0x7f9be8145c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee830700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9be805bc60 0x7f9be813f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee830700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be80aef60 con 0x7f9be80b1d50 2020-10-31T22:50:10.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee830700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be80afb20 con 0x7f9be805bc60 2020-10-31T22:50:10.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee830700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be80b2130 con 0x7f9be805c2d0 2020-10-31T22:50:10.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee02f700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9be805bc60 0x7f9be813f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bed02d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be805c2d0 0x7f9be8145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee02f700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9be805bc60 0x7f9be813f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:59644/0 (socket says 172.21.15.60:59644) 2020-10-31T22:50:10.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee02f700 1 -- 172.21.15.60:0/4280480916 learned_addr learned my addr 172.21.15.60:0/4280480916 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:10.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee02f700 1 -- 172.21.15.60:0/4280480916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be805c2d0 msgr2=0x7f9be8145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:10.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee02f700 1 --2- 172.21.15.60:0/4280480916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be805c2d0 0x7f9be8145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee02f700 1 -- 172.21.15.60:0/4280480916 >> v1:172.21.15.66:6789/0 conn(0x7f9be80b1d50 legacy=0x7f9be80af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee02f700 1 -- 172.21.15.60:0/4280480916 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be805c0b0 con 0x7f9be805bc60 2020-10-31T22:50:10.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee02f700 1 --2- 172.21.15.60:0/4280480916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9be805bc60 0x7f9be813f1b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f9be00032b0 tx=0x7f9be0009270).ready entity=mon.1 client_cookie=bc01c52040656aef server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:10.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bec82c700 1 -- 172.21.15.60:0/4280480916 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9be0009e60 con 0x7f9be805bc60 2020-10-31T22:50:10.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bec82c700 1 -- 172.21.15.60:0/4280480916 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be000bc00 con 0x7f9be805bc60 2020-10-31T22:50:10.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bec82c700 1 -- 172.21.15.60:0/4280480916 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9be000bd70 con 0x7f9be805bc60 2020-10-31T22:50:10.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee830700 1 -- 172.21.15.60:0/4280480916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9be805bc60 msgr2=0x7f9be813f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee830700 1 --2- 172.21.15.60:0/4280480916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9be805bc60 0x7f9be813f1b0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f9be00032b0 tx=0x7f9be0009270).stop 2020-10-31T22:50:10.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee830700 1 -- 172.21.15.60:0/4280480916 shutdown_connections 2020-10-31T22:50:10.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee830700 1 --2- 172.21.15.60:0/4280480916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9be805bc60 0x7f9be813f1b0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee830700 1 --2- 172.21.15.60:0/4280480916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be805c2d0 0x7f9be8145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee830700 1 -- 172.21.15.60:0/4280480916 >> 172.21.15.60:0/4280480916 conn(0x7f9be80b5330 msgr2=0x7f9be80b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:10.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee830700 1 -- 172.21.15.60:0/4280480916 shutdown_connections 2020-10-31T22:50:10.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.853+0000 7f9bee830700 1 -- 172.21.15.60:0/4280480916 wait complete. 2020-10-31T22:50:10.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bee830700 1 Processor -- start 2020-10-31T22:50:10.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bee830700 1 -- start start 2020-10-31T22:50:10.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bee830700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be805bc60 0x7f9be8148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bee830700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805c2d0 0x7f9be80aae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bee830700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9be80b1d50 0x7f9be80ad950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bee830700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be80a8c00 con 0x7f9be805c2d0 2020-10-31T22:50:10.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bee830700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be8150f40 con 0x7f9be80b1d50 2020-10-31T22:50:10.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bee830700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be81511e0 con 0x7f9be805bc60 2020-10-31T22:50:10.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bed02d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805c2d0 0x7f9be80aae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bed02d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805c2d0 0x7f9be80aae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48710/0 (socket says 172.21.15.60:48710) 2020-10-31T22:50:10.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bed02d700 1 -- 172.21.15.60:0/3052267941 learned_addr learned my addr 172.21.15.60:0/3052267941 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:10.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bee02f700 1 --2- 172.21.15.60:0/3052267941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9be80b1d50 0x7f9be80ad950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bed82e700 1 --2- 172.21.15.60:0/3052267941 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be805bc60 0x7f9be8148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bed02d700 1 -- 172.21.15.60:0/3052267941 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be805bc60 msgr2=0x7f9be8148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bed02d700 1 --2- 172.21.15.60:0/3052267941 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be805bc60 0x7f9be8148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bed02d700 1 -- 172.21.15.60:0/3052267941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9be80b1d50 msgr2=0x7f9be80ad950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:10.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bed02d700 1 --2- 172.21.15.60:0/3052267941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9be80b1d50 0x7f9be80ad950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:10.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.857+0000 7f9bed02d700 1 -- 172.21.15.60:0/3052267941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be8151480 con 0x7f9be805c2d0 2020-10-31T22:50:10.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.861+0000 7f9bed02d700 1 --2- 172.21.15.60:0/3052267941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805c2d0 0x7f9be80aae90 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f9be400c000 tx=0x7f9be4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:10.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.861+0000 7f9bd6ffd700 1 -- 172.21.15.60:0/3052267941 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9be400c820 con 0x7f9be805c2d0 2020-10-31T22:50:10.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.861+0000 7f9bd6ffd700 1 -- 172.21.15.60:0/3052267941 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be400c980 con 0x7f9be805c2d0 2020-10-31T22:50:10.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.861+0000 7f9bee830700 1 -- 172.21.15.60:0/3052267941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be8150c70 con 0x7f9be805c2d0 2020-10-31T22:50:10.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.861+0000 7f9bd6ffd700 1 -- 172.21.15.60:0/3052267941 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9be400cce0 con 0x7f9be805c2d0 2020-10-31T22:50:10.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.861+0000 7f9bee830700 1 -- 172.21.15.60:0/3052267941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be8151b40 con 0x7f9be805c2d0 2020-10-31T22:50:10.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.861+0000 7f9bee830700 1 -- 172.21.15.60:0/3052267941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be8057100 con 0x7f9be805c2d0 2020-10-31T22:50:10.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.861+0000 7f9bd6ffd700 1 -- 172.21.15.60:0/3052267941 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9be4022070 con 0x7f9be805c2d0 2020-10-31T22:50:10.868 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.861+0000 7f9bd6ffd700 1 --2- 172.21.15.60:0/3052267941 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bc8054fd0 0x7f9bc8057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:10.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.861+0000 7f9bd6ffd700 1 -- 172.21.15.60:0/3052267941 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9be406dab0 con 0x7f9be805c2d0 2020-10-31T22:50:10.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.861+0000 7f9bed82e700 1 --2- 172.21.15.60:0/3052267941 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bc8054fd0 0x7f9bc8057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:10.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.865+0000 7f9bed82e700 1 --2- 172.21.15.60:0/3052267941 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bc8054fd0 0x7f9bc8057490 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f9bd800d000 tx=0x7f9bd8007a90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:10.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:10.869+0000 7f9bd6ffd700 1 -- 172.21.15.60:0/3052267941 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9be4044260 con 0x7f9be805c2d0 2020-10-31T22:50:11.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.017+0000 7f9bee830700 1 -- 172.21.15.60:0/3052267941 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f9be8066f50 con 0x7f9be805c2d0 2020-10-31T22:50:11.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.021+0000 7f9bd6ffd700 1 -- 172.21.15.60:0/3052267941 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v135) v1 ==== 110+0+10 (secure 0 0 0) 0x7f9be4047880 con 0x7f9be805c2d0 2020-10-31T22:50:11.025 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:50:11.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.021+0000 7f9bee830700 1 -- 172.21.15.60:0/3052267941 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bc8054fd0 msgr2=0x7f9bc8057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.021+0000 7f9bee830700 1 --2- 172.21.15.60:0/3052267941 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bc8054fd0 0x7f9bc8057490 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f9bd800d000 tx=0x7f9bd8007a90).stop 2020-10-31T22:50:11.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.021+0000 7f9bee830700 1 -- 172.21.15.60:0/3052267941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805c2d0 msgr2=0x7f9be80aae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.021+0000 7f9bee830700 1 --2- 172.21.15.60:0/3052267941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805c2d0 0x7f9be80aae90 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 rx=0x7f9be400c000 tx=0x7f9be4008040).stop 2020-10-31T22:50:11.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.021+0000 7f9bee830700 1 -- 172.21.15.60:0/3052267941 shutdown_connections 2020-10-31T22:50:11.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.021+0000 7f9bee830700 1 --2- 172.21.15.60:0/3052267941 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9bc8054fd0 0x7f9bc8057490 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.021+0000 7f9bee830700 1 --2- 172.21.15.60:0/3052267941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9be80b1d50 0x7f9be80ad950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.021+0000 7f9bee830700 1 --2- 172.21.15.60:0/3052267941 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9be805bc60 0x7f9be8148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.021+0000 7f9bee830700 1 --2- 172.21.15.60:0/3052267941 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9be805c2d0 0x7f9be80aae90 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.021+0000 7f9bee830700 1 -- 172.21.15.60:0/3052267941 >> 172.21.15.60:0/3052267941 conn(0x7f9be80b5330 msgr2=0x7f9be80afc60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.021+0000 7f9bee830700 1 -- 172.21.15.60:0/3052267941 shutdown_connections 2020-10-31T22:50:11.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.021+0000 7f9bee830700 1 -- 172.21.15.60:0/3052267941 wait complete. 2020-10-31T22:50:11.039 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:50:11.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f14957d9700 1 Processor -- start 2020-10-31T22:50:11.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f14957d9700 1 -- start start 2020-10-31T22:50:11.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f14957d9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f14900af380 0x7f1490149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f14957d9700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14900a6e80 con 0x7f14900aeaf0 2020-10-31T22:50:11.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f14957d9700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14900af760 con 0x7f14900a7a40 2020-10-31T22:50:11.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f14957d9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149005be00 con 0x7f14900af380 2020-10-31T22:50:11.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f148effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f14900af380 0x7f1490149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f148e7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f14900aeaf0 0x7f149005afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52858/0 (socket says 172.21.15.60:52858) 2020-10-31T22:50:11.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f148e7fc700 1 -- 172.21.15.60:0/1772464725 learned_addr learned my addr 172.21.15.60:0/1772464725 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:11.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f148effd700 1 -- 172.21.15.60:0/1772464725 >> v1:172.21.15.66:6789/0 conn(0x7f14900a7a40 legacy=0x7f149005b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f148effd700 1 -- 172.21.15.60:0/1772464725 >> v1:172.21.15.60:6789/0 conn(0x7f14900aeaf0 legacy=0x7f149005afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f148dffb700 1 -- 172.21.15.60:0/1772464725 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 586223539 0 0) 0x7f14900a6e80 con 0x7f14900aeaf0 2020-10-31T22:50:11.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f148effd700 1 -- 172.21.15.60:0/1772464725 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14900a66a0 con 0x7f14900af380 2020-10-31T22:50:11.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f148effd700 1 --2- 172.21.15.60:0/1772464725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900af380 0x7f1490149cc0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f14900ab5c0 tx=0x7f1480006dc0).ready entity=mon.0 client_cookie=712d7d87fe649da6 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:11.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f148dffb700 1 -- 172.21.15.60:0/1772464725 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1480009770 con 0x7f14900af380 2020-10-31T22:50:11.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f148dffb700 1 -- 172.21.15.60:0/1772464725 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14800098d0 con 0x7f14900af380 2020-10-31T22:50:11.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f148dffb700 1 -- 172.21.15.60:0/1772464725 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1480009c30 con 0x7f14900af380 2020-10-31T22:50:11.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f14957d9700 1 -- 172.21.15.60:0/1772464725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900af380 msgr2=0x7f1490149cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f14957d9700 1 --2- 172.21.15.60:0/1772464725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900af380 0x7f1490149cc0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 rx=0x7f14900ab5c0 tx=0x7f1480006dc0).stop 2020-10-31T22:50:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f14957d9700 1 -- 172.21.15.60:0/1772464725 shutdown_connections 2020-10-31T22:50:11.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f14957d9700 1 --2- 172.21.15.60:0/1772464725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900af380 0x7f1490149cc0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f14957d9700 1 -- 172.21.15.60:0/1772464725 >> 172.21.15.60:0/1772464725 conn(0x7f149006a260 msgr2=0x7f1490061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:11.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f14957d9700 1 -- 172.21.15.60:0/1772464725 shutdown_connections 2020-10-31T22:50:11.164 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.149+0000 7f14957d9700 1 -- 172.21.15.60:0/1772464725 wait complete. 2020-10-31T22:50:11.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.153+0000 7f14957d9700 1 Processor -- start 2020-10-31T22:50:11.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.153+0000 7f14957d9700 1 -- start start 2020-10-31T22:50:11.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f14957d9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14900a7a40 0x7f149014ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f14957d9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14900aeaf0 0x7f1490145ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f14957d9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900af380 0x7f14901463d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f14957d9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1490156030 con 0x7f14900af380 2020-10-31T22:50:11.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f14957d9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14900ac590 con 0x7f14900a7a40 2020-10-31T22:50:11.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f14957d9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14900adfd0 con 0x7f14900aeaf0 2020-10-31T22:50:11.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f148f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900af380 0x7f14901463d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f148effd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14900a7a40 0x7f149014ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.171 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f148f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900af380 0x7f14901463d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48728/0 (socket says 172.21.15.60:48728) 2020-10-31T22:50:11.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f148f7fe700 1 -- 172.21.15.60:0/2794514944 learned_addr learned my addr 172.21.15.60:0/2794514944 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:11.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f148e7fc700 1 --2- 172.21.15.60:0/2794514944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14900aeaf0 0x7f1490145ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f148f7fe700 1 -- 172.21.15.60:0/2794514944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14900aeaf0 msgr2=0x7f1490145ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f148f7fe700 1 --2- 172.21.15.60:0/2794514944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14900aeaf0 0x7f1490145ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f148f7fe700 1 -- 172.21.15.60:0/2794514944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14900a7a40 msgr2=0x7f149014ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f148f7fe700 1 --2- 172.21.15.60:0/2794514944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14900a7a40 0x7f149014ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f148f7fe700 1 -- 172.21.15.60:0/2794514944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14900ae230 con 0x7f14900af380 2020-10-31T22:50:11.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f148e7fc700 1 --2- 172.21.15.60:0/2794514944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14900aeaf0 0x7f1490145ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:11.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f148f7fe700 1 --2- 172.21.15.60:0/2794514944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900af380 0x7f14901463d0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f1490060570 tx=0x7f1488007e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:11.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f1487fff700 1 -- 172.21.15.60:0/2794514944 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f148800ce20 con 0x7f14900af380 2020-10-31T22:50:11.174 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f1487fff700 1 -- 172.21.15.60:0/2794514944 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148800a840 con 0x7f14900af380 2020-10-31T22:50:11.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f14957d9700 1 -- 172.21.15.60:0/2794514944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14901468c0 con 0x7f14900af380 2020-10-31T22:50:11.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f1487fff700 1 -- 172.21.15.60:0/2794514944 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f148800aba0 con 0x7f14900af380 2020-10-31T22:50:11.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f14957d9700 1 -- 172.21.15.60:0/2794514944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1490155ae0 con 0x7f14900af380 2020-10-31T22:50:11.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.157+0000 7f14957d9700 1 -- 172.21.15.60:0/2794514944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14900ae3c0 con 0x7f14900af380 2020-10-31T22:50:11.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.161+0000 7f1487fff700 1 -- 172.21.15.60:0/2794514944 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1488019030 con 0x7f14900af380 2020-10-31T22:50:11.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.161+0000 7f1487fff700 1 --2- 172.21.15.60:0/2794514944 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1474054f90 0x7f1474057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.161+0000 7f1487fff700 1 -- 172.21.15.60:0/2794514944 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f148806d180 con 0x7f14900af380 2020-10-31T22:50:11.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.161+0000 7f148effd700 1 --2- 172.21.15.60:0/2794514944 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1474054f90 0x7f1474057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.161+0000 7f148effd700 1 --2- 172.21.15.60:0/2794514944 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1474054f90 0x7f1474057450 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f148001b000 tx=0x7f1480015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:11.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.165+0000 7f1487fff700 1 -- 172.21.15.60:0/2794514944 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f14880438c0 con 0x7f14900af380 2020-10-31T22:50:11.314 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.309+0000 7f14957d9700 1 -- 172.21.15.60:0/2794514944 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1490057100 con 0x7f14900af380 2020-10-31T22:50:11.315 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.309+0000 7f1487fff700 1 -- 172.21.15.60:0/2794514944 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v135) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1488046ee0 con 0x7f14900af380 2020-10-31T22:50:11.315 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:11.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.313+0000 7f14957d9700 1 -- 172.21.15.60:0/2794514944 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1474054f90 msgr2=0x7f1474057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.313+0000 7f14957d9700 1 --2- 172.21.15.60:0/2794514944 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1474054f90 0x7f1474057450 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f148001b000 tx=0x7f1480015000).stop 2020-10-31T22:50:11.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.313+0000 7f14957d9700 1 -- 172.21.15.60:0/2794514944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900af380 msgr2=0x7f14901463d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.317 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.313+0000 7f14957d9700 1 --2- 172.21.15.60:0/2794514944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900af380 0x7f14901463d0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 rx=0x7f1490060570 tx=0x7f1488007e80).stop 2020-10-31T22:50:11.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.313+0000 7f14957d9700 1 -- 172.21.15.60:0/2794514944 shutdown_connections 2020-10-31T22:50:11.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.313+0000 7f14957d9700 1 --2- 172.21.15.60:0/2794514944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f14900af380 0x7f14901463d0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.313+0000 7f14957d9700 1 --2- 172.21.15.60:0/2794514944 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1474054f90 0x7f1474057450 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.313+0000 7f14957d9700 1 --2- 172.21.15.60:0/2794514944 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14900a7a40 0x7f149014ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.318 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.313+0000 7f14957d9700 1 --2- 172.21.15.60:0/2794514944 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14900aeaf0 0x7f1490145ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.313+0000 7f14957d9700 1 -- 172.21.15.60:0/2794514944 >> 172.21.15.60:0/2794514944 conn(0x7f149006a260 msgr2=0x7f149014be00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:11.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.313+0000 7f14957d9700 1 -- 172.21.15.60:0/2794514944 shutdown_connections 2020-10-31T22:50:11.319 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.313+0000 7f14957d9700 1 -- 172.21.15.60:0/2794514944 wait complete. 2020-10-31T22:50:11.329 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-10-31T22:50:11.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.437+0000 7f8754c50700 1 Processor -- start 2020-10-31T22:50:11.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.437+0000 7f8754c50700 1 -- start start 2020-10-31T22:50:11.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.437+0000 7f8754c50700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f87500b1a10 0x7f8750142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f8754c50700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f87500af200 0x7f87500b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f8754c50700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87500abea0 con 0x7f875013ebe0 2020-10-31T22:50:11.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f8754c50700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8750141870 con 0x7f87500af200 2020-10-31T22:50:11.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f8754c50700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8750141b10 con 0x7f87500b1a10 2020-10-31T22:50:11.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f8747fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f875013ebe0 0x7f87500afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52868/0 (socket says 172.21.15.60:52868) 2020-10-31T22:50:11.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f8747fff700 1 -- 172.21.15.60:0/3761967434 learned_addr learned my addr 172.21.15.60:0/3761967434 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:11.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f874f7fe700 1 --2- 172.21.15.60:0/3761967434 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f87500b1a10 0x7f8750142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f874ffff700 1 --2- 172.21.15.60:0/3761967434 >> v2:172.21.15.66:3300/0 conn(0x7f87500af200 0x7f87500b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f874effd700 1 -- 172.21.15.60:0/3761967434 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090767368 0 0) 0x7f87500abea0 con 0x7f875013ebe0 2020-10-31T22:50:11.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f874effd700 1 -- 172.21.15.60:0/3761967434 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8734003230 con 0x7f875013ebe0 2020-10-31T22:50:11.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f874ffff700 1 -- 172.21.15.60:0/3761967434 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f87500b1a10 msgr2=0x7f8750142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:11.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f874ffff700 1 --2- 172.21.15.60:0/3761967434 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f87500b1a10 0x7f8750142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f874ffff700 1 -- 172.21.15.60:0/3761967434 >> v1:172.21.15.60:6789/0 conn(0x7f875013ebe0 legacy=0x7f87500afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f874ffff700 1 -- 172.21.15.60:0/3761967434 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8750141db0 con 0x7f87500af200 2020-10-31T22:50:11.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f874ffff700 1 --2- 172.21.15.60:0/3761967434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87500af200 0x7f87500b1df0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f87480032b0 tx=0x7f87480091a0).ready entity=mon.1 client_cookie=72710c536dfe0845 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:11.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f874effd700 1 -- 172.21.15.60:0/3761967434 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f874800b940 con 0x7f87500af200 2020-10-31T22:50:11.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f874effd700 1 -- 172.21.15.60:0/3761967434 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874800baa0 con 0x7f87500af200 2020-10-31T22:50:11.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f874effd700 1 -- 172.21.15.60:0/3761967434 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f874800bc10 con 0x7f87500af200 2020-10-31T22:50:11.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f8754c50700 1 -- 172.21.15.60:0/3761967434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87500af200 msgr2=0x7f87500b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f8754c50700 1 --2- 172.21.15.60:0/3761967434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87500af200 0x7f87500b1df0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f87480032b0 tx=0x7f87480091a0).stop 2020-10-31T22:50:11.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f8754c50700 1 -- 172.21.15.60:0/3761967434 shutdown_connections 2020-10-31T22:50:11.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f8754c50700 1 --2- 172.21.15.60:0/3761967434 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f87500af200 0x7f87500b1df0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f8754c50700 1 --2- 172.21.15.60:0/3761967434 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f87500b1a10 0x7f8750142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f8754c50700 1 -- 172.21.15.60:0/3761967434 >> 172.21.15.60:0/3761967434 conn(0x7f87500b5300 msgr2=0x7f87500b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:11.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f8754c50700 1 -- 172.21.15.60:0/3761967434 shutdown_connections 2020-10-31T22:50:11.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.441+0000 7f8754c50700 1 -- 172.21.15.60:0/3761967434 wait complete. 2020-10-31T22:50:11.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f8754c50700 1 Processor -- start 2020-10-31T22:50:11.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f8754c50700 1 -- start start 2020-10-31T22:50:11.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f8754c50700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87500af200 0x7f87500b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f8754c50700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f87500b1a10 0x7f875013fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f8754c50700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f875013ebe0 0x7f875013aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f8754c50700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8750140c40 con 0x7f87500af200 2020-10-31T22:50:11.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f8754c50700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8750140ee0 con 0x7f875013ebe0 2020-10-31T22:50:11.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f8754c50700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8750141180 con 0x7f87500b1a10 2020-10-31T22:50:11.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f874f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87500af200 0x7f87500b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f874f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87500af200 0x7f87500b3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48740/0 (socket says 172.21.15.60:48740) 2020-10-31T22:50:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f874f7fe700 1 -- 172.21.15.60:0/3314816579 learned_addr learned my addr 172.21.15.60:0/3314816579 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f8747fff700 1 --2- 172.21.15.60:0/3314816579 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f87500b1a10 0x7f875013fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f874ffff700 1 --2- 172.21.15.60:0/3314816579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f875013ebe0 0x7f875013aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f874f7fe700 1 -- 172.21.15.60:0/3314816579 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f87500b1a10 msgr2=0x7f875013fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f874f7fe700 1 --2- 172.21.15.60:0/3314816579 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f87500b1a10 0x7f875013fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f874f7fe700 1 -- 172.21.15.60:0/3314816579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f875013ebe0 msgr2=0x7f875013aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f874f7fe700 1 --2- 172.21.15.60:0/3314816579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f875013ebe0 0x7f875013aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f874f7fe700 1 -- 172.21.15.60:0/3314816579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87500aba90 con 0x7f87500af200 2020-10-31T22:50:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f874f7fe700 1 --2- 172.21.15.60:0/3314816579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87500af200 0x7f87500b3020 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f873800d000 tx=0x7f8738008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:11.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f874d7fa700 1 -- 172.21.15.60:0/3314816579 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f873800ab90 con 0x7f87500af200 2020-10-31T22:50:11.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f874d7fa700 1 -- 172.21.15.60:0/3314816579 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873800acf0 con 0x7f87500af200 2020-10-31T22:50:11.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f8754c50700 1 -- 172.21.15.60:0/3314816579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8750140120 con 0x7f87500af200 2020-10-31T22:50:11.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f874d7fa700 1 -- 172.21.15.60:0/3314816579 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f87380115e0 con 0x7f87500af200 2020-10-31T22:50:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.445+0000 7f8754c50700 1 -- 172.21.15.60:0/3314816579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875013b0f0 con 0x7f87500af200 2020-10-31T22:50:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.449+0000 7f8754c50700 1 -- 172.21.15.60:0/3314816579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8750141340 con 0x7f87500af200 2020-10-31T22:50:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.449+0000 7f874d7fa700 1 -- 172.21.15.60:0/3314816579 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8738017030 con 0x7f87500af200 2020-10-31T22:50:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.449+0000 7f874d7fa700 1 --2- 172.21.15.60:0/3314816579 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8728054f90 0x7f8728057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.449+0000 7f874d7fa700 1 -- 172.21.15.60:0/3314816579 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f873806d720 con 0x7f87500af200 2020-10-31T22:50:11.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.449+0000 7f8747fff700 1 --2- 172.21.15.60:0/3314816579 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8728054f90 0x7f8728057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.461 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.449+0000 7f8747fff700 1 --2- 172.21.15.60:0/3314816579 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8728054f90 0x7f8728057450 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f874000d000 tx=0x7f8740009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:11.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.457+0000 7f874d7fa700 1 -- 172.21.15.60:0/3314816579 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8738043f70 con 0x7f87500af200 2020-10-31T22:50:11.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.601+0000 7f8754c50700 1 -- 172.21.15.60:0/3314816579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8750141540 con 0x7f87500af200 2020-10-31T22:50:11.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.601+0000 7f874d7fa700 1 -- 172.21.15.60:0/3314816579 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v135) v1 ==== 84+0+143 (secure 0 0 0) 0x7f8738047590 con 0x7f87500af200 2020-10-31T22:50:11.607 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:11.607 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2020-10-31T22:50:11.607 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:11.607 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2020-10-31T22:50:11.608 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "device_health_metrics" 2020-10-31T22:50:11.608 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:11.608 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:11.608 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2020-10-31T22:50:11.608 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2020-10-31T22:50:11.608 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:11.608 INFO:teuthology.orchestra.run.smithi060.stdout:] 2020-10-31T22:50:11.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.601+0000 7f8754c50700 1 -- 172.21.15.60:0/3314816579 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8728054f90 msgr2=0x7f8728057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.601+0000 7f8754c50700 1 --2- 172.21.15.60:0/3314816579 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8728054f90 0x7f8728057450 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f874000d000 tx=0x7f8740009040).stop 2020-10-31T22:50:11.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.601+0000 7f8754c50700 1 -- 172.21.15.60:0/3314816579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87500af200 msgr2=0x7f87500b3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.601+0000 7f8754c50700 1 --2- 172.21.15.60:0/3314816579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87500af200 0x7f87500b3020 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 rx=0x7f873800d000 tx=0x7f8738008040).stop 2020-10-31T22:50:11.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.601+0000 7f8754c50700 1 -- 172.21.15.60:0/3314816579 shutdown_connections 2020-10-31T22:50:11.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.601+0000 7f8754c50700 1 --2- 172.21.15.60:0/3314816579 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8728054f90 0x7f8728057450 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.601+0000 7f8754c50700 1 --2- 172.21.15.60:0/3314816579 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f875013ebe0 0x7f875013aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.601+0000 7f8754c50700 1 --2- 172.21.15.60:0/3314816579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87500af200 0x7f87500b3020 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.601+0000 7f8754c50700 1 --2- 172.21.15.60:0/3314816579 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f87500b1a10 0x7f875013fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.601+0000 7f8754c50700 1 -- 172.21.15.60:0/3314816579 >> 172.21.15.60:0/3314816579 conn(0x7f87500b5300 msgr2=0x7f875013d990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:11.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.601+0000 7f8754c50700 1 -- 172.21.15.60:0/3314816579 shutdown_connections 2020-10-31T22:50:11.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.601+0000 7f8754c50700 1 -- 172.21.15.60:0/3314816579 wait complete. 2020-10-31T22:50:11.619 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-10-31T22:50:11.620 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:50:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.737+0000 7f02aa4cf700 1 Processor -- start 2020-10-31T22:50:11.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.737+0000 7f02aa4cf700 1 -- start start 2020-10-31T22:50:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.737+0000 7f02aa4cf700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f02a40b5570 0x7f02a40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.737+0000 7f02aa4cf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02a4141f00 0x7f02a4142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.737+0000 7f02aa4cf700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a40b4440 con 0x7f02a40b24a0 2020-10-31T22:50:11.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.737+0000 7f02aa4cf700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a413f930 con 0x7f02a40b5570 2020-10-31T22:50:11.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.737+0000 7f02aa4cf700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a4146060 con 0x7f02a4141f00 2020-10-31T22:50:11.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.737+0000 7f02a9cce700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02a4141f00 0x7f02a4142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.746 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.737+0000 7f02a94cd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f02a40b5570 0x7f02a40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.737+0000 7f02a8ccc700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f02a40b24a0 0x7f02a4145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:50750/0 (socket says 172.21.15.60:50750) 2020-10-31T22:50:11.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.737+0000 7f02a8ccc700 1 -- 172.21.15.60:0/182229616 learned_addr learned my addr 172.21.15.60:0/182229616 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:11.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.737+0000 7f029bfff700 1 -- 172.21.15.60:0/182229616 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205095139 0 0) 0x7f02a40b4440 con 0x7f02a40b24a0 2020-10-31T22:50:11.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02a9cce700 1 -- 172.21.15.60:0/182229616 >> v2:172.21.15.66:3300/0 conn(0x7f02a40b5570 msgr2=0x7f02a40b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:11.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02a9cce700 1 --2- 172.21.15.60:0/182229616 >> v2:172.21.15.66:3300/0 conn(0x7f02a40b5570 0x7f02a40b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02a9cce700 1 -- 172.21.15.60:0/182229616 >> v1:172.21.15.66:6789/0 conn(0x7f02a40b24a0 legacy=0x7f02a4145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02a9cce700 1 -- 172.21.15.60:0/182229616 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a40b02f0 con 0x7f02a4141f00 2020-10-31T22:50:11.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02a9cce700 1 --2- 172.21.15.60:0/182229616 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02a4141f00 0x7f02a4142390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f029c0032b0 tx=0x7f029c0091a0).ready entity=mon.2 client_cookie=61d8b9d82fc0ed0c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:11.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f029bfff700 1 -- 172.21.15.60:0/182229616 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029c00b9a0 con 0x7f02a4141f00 2020-10-31T22:50:11.748 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f029bfff700 1 -- 172.21.15.60:0/182229616 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c00bb00 con 0x7f02a4141f00 2020-10-31T22:50:11.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02aa4cf700 1 -- 172.21.15.60:0/182229616 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02a4141f00 msgr2=0x7f02a4142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02aa4cf700 1 --2- 172.21.15.60:0/182229616 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02a4141f00 0x7f02a4142390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f029c0032b0 tx=0x7f029c0091a0).stop 2020-10-31T22:50:11.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f029bfff700 1 -- 172.21.15.60:0/182229616 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029c00bc70 con 0x7f02a4141f00 2020-10-31T22:50:11.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02aa4cf700 1 -- 172.21.15.60:0/182229616 shutdown_connections 2020-10-31T22:50:11.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02aa4cf700 1 --2- 172.21.15.60:0/182229616 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02a4141f00 0x7f02a4142390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02aa4cf700 1 --2- 172.21.15.60:0/182229616 >> v2:172.21.15.66:3300/0 conn(0x7f02a40b5570 0x7f02a40b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02aa4cf700 1 -- 172.21.15.60:0/182229616 >> 172.21.15.60:0/182229616 conn(0x7f02a40b8e90 msgr2=0x7f02a40b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:11.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02aa4cf700 1 -- 172.21.15.60:0/182229616 shutdown_connections 2020-10-31T22:50:11.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02aa4cf700 1 -- 172.21.15.60:0/182229616 wait complete. 2020-10-31T22:50:11.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02aa4cf700 1 Processor -- start 2020-10-31T22:50:11.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.741+0000 7f02aa4cf700 1 -- start start 2020-10-31T22:50:11.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02aa4cf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02a40b24a0 0x7f02a4143150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02aa4cf700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02a40b5570 0x7f02a4150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02aa4cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02a4141f00 0x7f02a4150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02aa4cf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a40b6df0 con 0x7f02a4141f00 2020-10-31T22:50:11.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02aa4cf700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a4146b70 con 0x7f02a40b5570 2020-10-31T22:50:11.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02aa4cf700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a413b380 con 0x7f02a40b24a0 2020-10-31T22:50:11.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02a9cce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02a4141f00 0x7f02a4150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02a94cd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02a40b24a0 0x7f02a4143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02a9cce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02a4141f00 0x7f02a4150e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48756/0 (socket says 172.21.15.60:48756) 2020-10-31T22:50:11.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02a9cce700 1 -- 172.21.15.60:0/4151366299 learned_addr learned my addr 172.21.15.60:0/4151366299 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:11.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02a8ccc700 1 --2- 172.21.15.60:0/4151366299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02a40b5570 0x7f02a4150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02a9cce700 1 -- 172.21.15.60:0/4151366299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02a40b24a0 msgr2=0x7f02a4143150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02a9cce700 1 --2- 172.21.15.60:0/4151366299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02a40b24a0 0x7f02a4143150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02a9cce700 1 -- 172.21.15.60:0/4151366299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02a40b5570 msgr2=0x7f02a4150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02a9cce700 1 --2- 172.21.15.60:0/4151366299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02a40b5570 0x7f02a4150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02a9cce700 1 -- 172.21.15.60:0/4151366299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a40b6b50 con 0x7f02a4141f00 2020-10-31T22:50:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02a9cce700 1 --2- 172.21.15.60:0/4151366299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02a4141f00 0x7f02a4150e30 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f029c0032b0 tx=0x7f029c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f029a7fc700 1 -- 172.21.15.60:0/4151366299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029c0205f0 con 0x7f02a4141f00 2020-10-31T22:50:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f029a7fc700 1 -- 172.21.15.60:0/4151366299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f029c020750 con 0x7f02a4141f00 2020-10-31T22:50:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02aa4cf700 1 -- 172.21.15.60:0/4151366299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a4146d60 con 0x7f02a4141f00 2020-10-31T22:50:11.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f029a7fc700 1 -- 172.21.15.60:0/4151366299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f029c020ab0 con 0x7f02a4141f00 2020-10-31T22:50:11.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02aa4cf700 1 -- 172.21.15.60:0/4151366299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a4147fb0 con 0x7f02a4141f00 2020-10-31T22:50:11.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f02aa4cf700 1 -- 172.21.15.60:0/4151366299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a4057100 con 0x7f02a4141f00 2020-10-31T22:50:11.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f029a7fc700 1 -- 172.21.15.60:0/4151366299 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f029c027030 con 0x7f02a4141f00 2020-10-31T22:50:11.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f029a7fc700 1 --2- 172.21.15.60:0/4151366299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f028c054fd0 0x7f028c057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:11.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.745+0000 7f029a7fc700 1 -- 172.21.15.60:0/4151366299 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f029c06eb00 con 0x7f02a4141f00 2020-10-31T22:50:11.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.749+0000 7f02a94cd700 1 --2- 172.21.15.60:0/4151366299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f028c054fd0 0x7f028c057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:11.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.749+0000 7f02a94cd700 1 --2- 172.21.15.60:0/4151366299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f028c054fd0 0x7f028c057490 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f02a000b000 tx=0x7f02a0006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:11.760 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.753+0000 7f029a7fc700 1 -- 172.21.15.60:0/4151366299 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f029c045350 con 0x7f02a4141f00 2020-10-31T22:50:11.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:11.897+0000 7f02aa4cf700 1 -- 172.21.15.60:0/4151366299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f02a405a8e0 con 0x7f02a4141f00 2020-10-31T22:50:12.870 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:12.865+0000 7f029a7fc700 1 -- 172.21.15.60:0/4151366299 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v136) v1 ==== 133+0+0 (secure 0 0 0) 0x7f029c0250a0 con 0x7f02a4141f00 2020-10-31T22:50:12.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:12.869+0000 7f02aa4cf700 1 -- 172.21.15.60:0/4151366299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f028c054fd0 msgr2=0x7f028c057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:12.874 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:12.869+0000 7f02aa4cf700 1 --2- 172.21.15.60:0/4151366299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f028c054fd0 0x7f028c057490 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f02a000b000 tx=0x7f02a0006dc0).stop 2020-10-31T22:50:12.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:12.869+0000 7f02aa4cf700 1 -- 172.21.15.60:0/4151366299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02a4141f00 msgr2=0x7f02a4150e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:12.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:12.869+0000 7f02aa4cf700 1 --2- 172.21.15.60:0/4151366299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02a4141f00 0x7f02a4150e30 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 rx=0x7f029c0032b0 tx=0x7f029c016000).stop 2020-10-31T22:50:12.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:12.869+0000 7f02aa4cf700 1 -- 172.21.15.60:0/4151366299 shutdown_connections 2020-10-31T22:50:12.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:12.869+0000 7f02aa4cf700 1 --2- 172.21.15.60:0/4151366299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02a4141f00 0x7f02a4150e30 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:12.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:12.869+0000 7f02aa4cf700 1 --2- 172.21.15.60:0/4151366299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f02a40b24a0 0x7f02a4143150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:12.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:12.869+0000 7f02aa4cf700 1 --2- 172.21.15.60:0/4151366299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f028c054fd0 0x7f028c057490 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:12.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:12.869+0000 7f02aa4cf700 1 --2- 172.21.15.60:0/4151366299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f02a40b5570 0x7f02a4150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:12.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:12.869+0000 7f02aa4cf700 1 -- 172.21.15.60:0/4151366299 >> 172.21.15.60:0/4151366299 conn(0x7f02a40b8e90 msgr2=0x7f02a405f780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:12.876 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:12.869+0000 7f02aa4cf700 1 -- 172.21.15.60:0/4151366299 shutdown_connections 2020-10-31T22:50:12.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:12.869+0000 7f02aa4cf700 1 -- 172.21.15.60:0/4151366299 wait complete. 2020-10-31T22:50:12.878 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:50:12.890 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-10-31T22:50:13.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc6959700 1 Processor -- start 2020-10-31T22:50:13.014 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc6959700 1 -- start start 2020-10-31T22:50:13.016 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc6959700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fadc00afdc0 0x7fadc013be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:13.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc6959700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fadc00a7530 0x7fadc013edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:13.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc6959700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadc01429d0 con 0x7fadc013c310 2020-10-31T22:50:13.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc6959700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadc0142c70 con 0x7fadc00a7530 2020-10-31T22:50:13.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc6959700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc013e8e0 con 0x7fadc00afdc0 2020-10-31T22:50:13.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc5156700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fadc00a7530 0x7fadc013edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:13.017 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc6158700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fadc013c310 0x7fadc00aa100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52898/0 (socket says 172.21.15.60:52898) 2020-10-31T22:50:13.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc6158700 1 -- 172.21.15.60:0/1197471156 learned_addr learned my addr 172.21.15.60:0/1197471156 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:13.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc5957700 1 --2- 172.21.15.60:0/1197471156 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fadc00afdc0 0x7fadc013be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:13.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc5156700 1 -- 172.21.15.60:0/1197471156 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fadc00afdc0 msgr2=0x7fadc013be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:13.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc5156700 1 --2- 172.21.15.60:0/1197471156 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fadc00afdc0 0x7fadc013be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:13.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc5156700 1 -- 172.21.15.60:0/1197471156 >> v1:172.21.15.60:6789/0 conn(0x7fadc013c310 legacy=0x7fadc00aa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:13.018 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc4955700 1 -- 172.21.15.60:0/1197471156 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824928401 0 0) 0x7fadc01429d0 con 0x7fadc013c310 2020-10-31T22:50:13.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc5156700 1 -- 172.21.15.60:0/1197471156 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc00abb30 con 0x7fadc00a7530 2020-10-31T22:50:13.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc5156700 1 --2- 172.21.15.60:0/1197471156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadc00a7530 0x7fadc013edf0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7fadb0002f30 tx=0x7fadb0006dc0).ready entity=mon.0 client_cookie=3d35e548c5e96430 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:13.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc4955700 1 -- 172.21.15.60:0/1197471156 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadb0009760 con 0x7fadc00a7530 2020-10-31T22:50:13.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc4955700 1 -- 172.21.15.60:0/1197471156 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb00098c0 con 0x7fadc00a7530 2020-10-31T22:50:13.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc4955700 1 -- 172.21.15.60:0/1197471156 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadb0009c20 con 0x7fadc00a7530 2020-10-31T22:50:13.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc6959700 1 -- 172.21.15.60:0/1197471156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadc00a7530 msgr2=0x7fadc013edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:13.019 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.009+0000 7fadc6959700 1 --2- 172.21.15.60:0/1197471156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadc00a7530 0x7fadc013edf0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 rx=0x7fadb0002f30 tx=0x7fadb0006dc0).stop 2020-10-31T22:50:13.021 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6959700 1 -- 172.21.15.60:0/1197471156 shutdown_connections 2020-10-31T22:50:13.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6959700 1 --2- 172.21.15.60:0/1197471156 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fadc00afdc0 0x7fadc013be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:13.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6959700 1 --2- 172.21.15.60:0/1197471156 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadc00a7530 0x7fadc013edf0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:13.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6959700 1 -- 172.21.15.60:0/1197471156 >> 172.21.15.60:0/1197471156 conn(0x7fadc00b3fd0 msgr2=0x7fadc00b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:13.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6959700 1 -- 172.21.15.60:0/1197471156 shutdown_connections 2020-10-31T22:50:13.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6959700 1 -- 172.21.15.60:0/1197471156 wait complete. 2020-10-31T22:50:13.022 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6959700 1 Processor -- start 2020-10-31T22:50:13.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6959700 1 -- start start 2020-10-31T22:50:13.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6959700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fadc00afdc0 0x7fadc0135530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:13.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6959700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadc013c310 0x7fadc00a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:13.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6959700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadc0153ee0 0x7fadc00a9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:13.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6959700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc0062230 con 0x7fadc0153ee0 2020-10-31T22:50:13.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6959700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadc00636c0 con 0x7fadc013c310 2020-10-31T22:50:13.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6959700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadc0063960 con 0x7fadc00afdc0 2020-10-31T22:50:13.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6158700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadc0153ee0 0x7fadc00a9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:13.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6158700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadc0153ee0 0x7fadc00a9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48770/0 (socket says 172.21.15.60:48770) 2020-10-31T22:50:13.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc6158700 1 -- 172.21.15.60:0/2346309870 learned_addr learned my addr 172.21.15.60:0/2346309870 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:13.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc5156700 1 --2- 172.21.15.60:0/2346309870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadc013c310 0x7fadc00a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:13.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.013+0000 7fadc5957700 1 --2- 172.21.15.60:0/2346309870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fadc00afdc0 0x7fadc0135530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:13.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadc6158700 1 -- 172.21.15.60:0/2346309870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fadc00afdc0 msgr2=0x7fadc0135530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:13.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadc6158700 1 --2- 172.21.15.60:0/2346309870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fadc00afdc0 0x7fadc0135530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:13.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadc6158700 1 -- 172.21.15.60:0/2346309870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadc013c310 msgr2=0x7fadc00a95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:13.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadc6158700 1 --2- 172.21.15.60:0/2346309870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadc013c310 0x7fadc00a95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:13.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadc6158700 1 -- 172.21.15.60:0/2346309870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadc0063c00 con 0x7fadc0153ee0 2020-10-31T22:50:13.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadc6158700 1 --2- 172.21.15.60:0/2346309870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadc0153ee0 0x7fadc00a9ae0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7fadb8001210 tx=0x7fadb8007cf0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:13.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadaeffd700 1 -- 172.21.15.60:0/2346309870 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadb800ce40 con 0x7fadc0153ee0 2020-10-31T22:50:13.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadaeffd700 1 -- 172.21.15.60:0/2346309870 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadb8005b70 con 0x7fadc0153ee0 2020-10-31T22:50:13.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadc6959700 1 -- 172.21.15.60:0/2346309870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadc0135a20 con 0x7fadc0153ee0 2020-10-31T22:50:13.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadaeffd700 1 -- 172.21.15.60:0/2346309870 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fadb8004870 con 0x7fadc0153ee0 2020-10-31T22:50:13.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadc6959700 1 -- 172.21.15.60:0/2346309870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadc00a83b0 con 0x7fadc0153ee0 2020-10-31T22:50:13.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadc6959700 1 -- 172.21.15.60:0/2346309870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadc00aaab0 con 0x7fadc0153ee0 2020-10-31T22:50:13.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadaeffd700 1 -- 172.21.15.60:0/2346309870 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fadb801b060 con 0x7fadc0153ee0 2020-10-31T22:50:13.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadaeffd700 1 --2- 172.21.15.60:0/2346309870 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fada0054f10 0x7fada00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:13.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadaeffd700 1 -- 172.21.15.60:0/2346309870 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5607+0+0 (secure 0 0 0) 0x7fadb806d2d0 con 0x7fadc0153ee0 2020-10-31T22:50:13.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.017+0000 7fadc5957700 1 --2- 172.21.15.60:0/2346309870 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fada0054f10 0x7fada00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:13.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.021+0000 7fadc5957700 1 --2- 172.21.15.60:0/2346309870 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fada0054f10 0x7fada00573d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fadbc006000 tx=0x7fadbc006d60).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:13.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.029+0000 7fadaeffd700 1 -- 172.21.15.60:0/2346309870 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fadb80439c0 con 0x7fadc0153ee0 2020-10-31T22:50:13.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.177+0000 7fadc6959700 1 -- 172.21.15.60:0/2346309870 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7fadc0057100 con 0x7fadc0153ee0 2020-10-31T22:50:13.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.869+0000 7fadaeffd700 1 -- 172.21.15.60:0/2346309870 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v137) v1 ==== 125+0+0 (secure 0 0 0) 0x7fadb8019070 con 0x7fadc0153ee0 2020-10-31T22:50:13.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.877+0000 7fadc6959700 1 -- 172.21.15.60:0/2346309870 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fada0054f10 msgr2=0x7fada00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:13.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.877+0000 7fadc6959700 1 --2- 172.21.15.60:0/2346309870 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fada0054f10 0x7fada00573d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7fadbc006000 tx=0x7fadbc006d60).stop 2020-10-31T22:50:13.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.877+0000 7fadc6959700 1 -- 172.21.15.60:0/2346309870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadc0153ee0 msgr2=0x7fadc00a9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:13.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.877+0000 7fadc6959700 1 --2- 172.21.15.60:0/2346309870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadc0153ee0 0x7fadc00a9ae0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 rx=0x7fadb8001210 tx=0x7fadb8007cf0).stop 2020-10-31T22:50:13.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.877+0000 7fadc6959700 1 -- 172.21.15.60:0/2346309870 shutdown_connections 2020-10-31T22:50:13.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.877+0000 7fadc6959700 1 --2- 172.21.15.60:0/2346309870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadc0153ee0 0x7fadc00a9ae0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:13.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.877+0000 7fadc6959700 1 --2- 172.21.15.60:0/2346309870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fadc00afdc0 0x7fadc0135530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:13.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.877+0000 7fadc6959700 1 --2- 172.21.15.60:0/2346309870 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fada0054f10 0x7fada00573d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:13.884 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.877+0000 7fadc6959700 1 --2- 172.21.15.60:0/2346309870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fadc013c310 0x7fadc00a95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:13.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.877+0000 7fadc6959700 1 -- 172.21.15.60:0/2346309870 >> 172.21.15.60:0/2346309870 conn(0x7fadc00b3fd0 msgr2=0x7fadc00abcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:13.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.877+0000 7fadc6959700 1 -- 172.21.15.60:0/2346309870 shutdown_connections 2020-10-31T22:50:13.885 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:13.881+0000 7fadc6959700 1 -- 172.21.15.60:0/2346309870 wait complete. 2020-10-31T22:50:13.888 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2020-10-31T22:50:13.901 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-10-31T22:50:14.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe96b07c700 1 Processor -- start 2020-10-31T22:50:14.023 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe96b07c700 1 -- start start 2020-10-31T22:50:14.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe96b07c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9640b2790 0x7fe9640aff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe96b07c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe96413c360 0x7fe9640ae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe96b07c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9640b2b70 con 0x7fe9640af660 2020-10-31T22:50:14.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe96b07c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96413c7f0 con 0x7fe96413c360 2020-10-31T22:50:14.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe96b07c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640b0410 con 0x7fe9640b2790 2020-10-31T22:50:14.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe969619700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe96413c360 0x7fe9640ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe969619700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe96413c360 0x7fe9640ae520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48780/0 (socket says 172.21.15.60:48780) 2020-10-31T22:50:14.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe969619700 1 -- 172.21.15.60:0/1884702612 learned_addr learned my addr 172.21.15.60:0/1884702612 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:14.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe963fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe9640af660 0x7fe96413bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52914/0 (socket says 172.21.15.60:52914) 2020-10-31T22:50:14.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe968e18700 1 --2- 172.21.15.60:0/1884702612 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9640b2790 0x7fe9640aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe969619700 1 -- 172.21.15.60:0/1884702612 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9640b2790 msgr2=0x7fe9640aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:14.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe969619700 1 --2- 172.21.15.60:0/1884702612 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9640b2790 0x7fe9640aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe969619700 1 -- 172.21.15.60:0/1884702612 >> v1:172.21.15.60:6789/0 conn(0x7fe9640af660 legacy=0x7fe96413bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe9637fe700 1 -- 172.21.15.60:0/1884702612 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3743313561 0 0) 0x7fe9640b2b70 con 0x7fe9640af660 2020-10-31T22:50:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.017+0000 7fe969619700 1 -- 172.21.15.60:0/1884702612 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9640b0db0 con 0x7fe96413c360 2020-10-31T22:50:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.021+0000 7fe969619700 1 --2- 172.21.15.60:0/1884702612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe96413c360 0x7fe9640ae520 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7fe95c002f30 tx=0x7fe95c006e80).ready entity=mon.0 client_cookie=a5538dd88bbf80db server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.021+0000 7fe9637fe700 1 -- 172.21.15.60:0/1884702612 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe95c0097f0 con 0x7fe96413c360 2020-10-31T22:50:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.021+0000 7fe9637fe700 1 -- 172.21.15.60:0/1884702612 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c009950 con 0x7fe96413c360 2020-10-31T22:50:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.021+0000 7fe9637fe700 1 -- 172.21.15.60:0/1884702612 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe95c009cb0 con 0x7fe96413c360 2020-10-31T22:50:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.021+0000 7fe96b07c700 1 -- 172.21.15.60:0/1884702612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe96413c360 msgr2=0x7fe9640ae520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.021+0000 7fe96b07c700 1 --2- 172.21.15.60:0/1884702612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe96413c360 0x7fe9640ae520 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 rx=0x7fe95c002f30 tx=0x7fe95c006e80).stop 2020-10-31T22:50:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.021+0000 7fe96b07c700 1 -- 172.21.15.60:0/1884702612 shutdown_connections 2020-10-31T22:50:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.021+0000 7fe96b07c700 1 --2- 172.21.15.60:0/1884702612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe96413c360 0x7fe9640ae520 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.021+0000 7fe96b07c700 1 --2- 172.21.15.60:0/1884702612 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9640b2790 0x7fe9640aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.021+0000 7fe96b07c700 1 -- 172.21.15.60:0/1884702612 >> 172.21.15.60:0/1884702612 conn(0x7fe9640b5d30 msgr2=0x7fe9640b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.021+0000 7fe96b07c700 1 -- 172.21.15.60:0/1884702612 shutdown_connections 2020-10-31T22:50:14.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.021+0000 7fe96b07c700 1 -- 172.21.15.60:0/1884702612 wait complete. 2020-10-31T22:50:14.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.021+0000 7fe96b07c700 1 Processor -- start 2020-10-31T22:50:14.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.021+0000 7fe96b07c700 1 -- start start 2020-10-31T22:50:14.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe96b07c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9640af660 0x7fe9641415c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe96b07c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9640b2790 0x7fe9640ab710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe96b07c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe96413c360 0x7fe96413f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe96b07c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96413dbf0 con 0x7fe9640af660 2020-10-31T22:50:14.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe96b07c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640aae60 con 0x7fe9640b2790 2020-10-31T22:50:14.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe96b07c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9640ab100 con 0x7fe96413c360 2020-10-31T22:50:14.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe968e18700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9640af660 0x7fe9641415c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe968e18700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9640af660 0x7fe9641415c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48782/0 (socket says 172.21.15.60:48782) 2020-10-31T22:50:14.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe968e18700 1 -- 172.21.15.60:0/1312256565 learned_addr learned my addr 172.21.15.60:0/1312256565 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:14.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe969619700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe96413c360 0x7fe96413f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe968e18700 1 -- 172.21.15.60:0/1312256565 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe96413c360 msgr2=0x7fe96413f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe963fff700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9640b2790 0x7fe9640ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe968e18700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe96413c360 0x7fe96413f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe968e18700 1 -- 172.21.15.60:0/1312256565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9640b2790 msgr2=0x7fe9640ab710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe968e18700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9640b2790 0x7fe9640ab710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe968e18700 1 -- 172.21.15.60:0/1312256565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9640ab3a0 con 0x7fe9640af660 2020-10-31T22:50:14.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe969619700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe96413c360 0x7fe96413f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:50:14.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe963fff700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9640b2790 0x7fe9640ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:50:14.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe968e18700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9640af660 0x7fe9641415c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7fe954006a50 tx=0x7fe954006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:14.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe961ffb700 1 -- 172.21.15.60:0/1312256565 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe95400cae0 con 0x7fe9640af660 2020-10-31T22:50:14.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe961ffb700 1 -- 172.21.15.60:0/1312256565 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95400cc40 con 0x7fe9640af660 2020-10-31T22:50:14.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe96b07c700 1 -- 172.21.15.60:0/1312256565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96413f510 con 0x7fe9640af660 2020-10-31T22:50:14.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe961ffb700 1 -- 172.21.15.60:0/1312256565 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9540123f0 con 0x7fe9640af660 2020-10-31T22:50:14.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe96b07c700 1 -- 172.21.15.60:0/1312256565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9640aabd0 con 0x7fe9640af660 2020-10-31T22:50:14.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe961ffb700 1 -- 172.21.15.60:0/1312256565 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe954012550 con 0x7fe9640af660 2020-10-31T22:50:14.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe96b07c700 1 -- 172.21.15.60:0/1312256565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe964057100 con 0x7fe9640af660 2020-10-31T22:50:14.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe961ffb700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe944054f10 0x7fe9440573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe963fff700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe944054f10 0x7fe9440573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.025+0000 7fe961ffb700 1 -- 172.21.15.60:0/1312256565 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5957+0+0 (secure 0 0 0) 0x7fe95406dff0 con 0x7fe9640af660 2020-10-31T22:50:14.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.029+0000 7fe963fff700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe944054f10 0x7fe9440573d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fe958008000 tx=0x7fe958009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:14.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.033+0000 7fe961ffb700 1 -- 172.21.15.60:0/1312256565 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe9540444a0 con 0x7fe9640af660 2020-10-31T22:50:14.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.225+0000 7fe96b07c700 1 -- 172.21.15.60:0/1312256565 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fe9640605e0 con 0x7fe9640af660 2020-10-31T22:50:14.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.237+0000 7fe961ffb700 1 -- 172.21.15.60:0/1312256565 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 25 and data pool 26 v69) v1 ==== 189+0+0 (secure 0 0 0) 0x7fe954047ac0 con 0x7fe9640af660 2020-10-31T22:50:14.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.245+0000 7fe96b07c700 1 -- 172.21.15.60:0/1312256565 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe944054f10 msgr2=0x7fe9440573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.245+0000 7fe96b07c700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe944054f10 0x7fe9440573d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7fe958008000 tx=0x7fe958009040).stop 2020-10-31T22:50:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.245+0000 7fe96b07c700 1 -- 172.21.15.60:0/1312256565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9640af660 msgr2=0x7fe9641415c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.245+0000 7fe96b07c700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9640af660 0x7fe9641415c0 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 rx=0x7fe954006a50 tx=0x7fe954006dc0).stop 2020-10-31T22:50:14.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.249+0000 7fe96b07c700 1 -- 172.21.15.60:0/1312256565 shutdown_connections 2020-10-31T22:50:14.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.249+0000 7fe96b07c700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe96413c360 0x7fe96413f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.249+0000 7fe96b07c700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe9640af660 0x7fe9641415c0 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.249+0000 7fe96b07c700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe944054f10 0x7fe9440573d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.249+0000 7fe96b07c700 1 --2- 172.21.15.60:0/1312256565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9640b2790 0x7fe9640ab710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.249+0000 7fe96b07c700 1 -- 172.21.15.60:0/1312256565 >> 172.21.15.60:0/1312256565 conn(0x7fe9640b5d30 msgr2=0x7fe9640b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:14.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.249+0000 7fe96b07c700 1 -- 172.21.15.60:0/1312256565 shutdown_connections 2020-10-31T22:50:14.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.249+0000 7fe96b07c700 1 -- 172.21.15.60:0/1312256565 wait complete. 2020-10-31T22:50:14.256 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 25 and data pool 26 2020-10-31T22:50:14.270 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:50:14.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98ead86700 1 Processor -- start 2020-10-31T22:50:14.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98ead86700 1 -- start start 2020-10-31T22:50:14.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98ead86700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98e40b24a0 0x7f98e40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98ead86700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e4145180 con 0x7f98e40b5570 2020-10-31T22:50:14.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98ead86700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98e40b0670 con 0x7f98e4141fe0 2020-10-31T22:50:14.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98ead86700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98e40afae0 con 0x7f98e40b24a0 2020-10-31T22:50:14.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98e9583700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98e40b24a0 0x7f98e40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98e9583700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98e40b24a0 0x7f98e40b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48802/0 (socket says 172.21.15.60:48802) 2020-10-31T22:50:14.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98e9d84700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f98e40b5570 0x7f98e4145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52936/0 (socket says 172.21.15.60:52936) 2020-10-31T22:50:14.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98e9583700 1 -- 172.21.15.60:0/2774791891 learned_addr learned my addr 172.21.15.60:0/2774791891 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:14.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98e9583700 1 -- 172.21.15.60:0/2774791891 >> v1:172.21.15.66:6789/0 conn(0x7f98e4141fe0 legacy=0x7f98e4142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98e9583700 1 -- 172.21.15.60:0/2774791891 >> v1:172.21.15.60:6789/0 conn(0x7f98e40b5570 legacy=0x7f98e4145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98e9583700 1 -- 172.21.15.60:0/2774791891 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e40b0910 con 0x7f98e40b24a0 2020-10-31T22:50:14.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98e9583700 1 --2- 172.21.15.60:0/2774791891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e40b24a0 0x7f98e40b5950 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f98e405f580 tx=0x7f98d4006e80).ready entity=mon.0 client_cookie=444161c62fefe1d8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:14.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98e8d82700 1 -- 172.21.15.60:0/2774791891 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98d4009800 con 0x7f98e40b24a0 2020-10-31T22:50:14.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98e8d82700 1 -- 172.21.15.60:0/2774791891 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d4009960 con 0x7f98e40b24a0 2020-10-31T22:50:14.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98e8d82700 1 -- 172.21.15.60:0/2774791891 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98d4009cc0 con 0x7f98e40b24a0 2020-10-31T22:50:14.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98ead86700 1 -- 172.21.15.60:0/2774791891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e40b24a0 msgr2=0x7f98e40b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98ead86700 1 --2- 172.21.15.60:0/2774791891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e40b24a0 0x7f98e40b5950 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 rx=0x7f98e405f580 tx=0x7f98d4006e80).stop 2020-10-31T22:50:14.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98ead86700 1 -- 172.21.15.60:0/2774791891 shutdown_connections 2020-10-31T22:50:14.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98ead86700 1 --2- 172.21.15.60:0/2774791891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e40b24a0 0x7f98e40b5950 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98ead86700 1 -- 172.21.15.60:0/2774791891 >> 172.21.15.60:0/2774791891 conn(0x7f98e40b8e90 msgr2=0x7f98e40b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:14.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98ead86700 1 -- 172.21.15.60:0/2774791891 shutdown_connections 2020-10-31T22:50:14.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.369+0000 7f98ead86700 1 -- 172.21.15.60:0/2774791891 wait complete. 2020-10-31T22:50:14.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98ead86700 1 Processor -- start 2020-10-31T22:50:14.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98ead86700 1 -- start start 2020-10-31T22:50:14.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98ead86700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e40b24a0 0x7f98e40b6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98ead86700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e40b5570 0x7f98e4150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98ead86700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e4141fe0 0x7f98e4150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98ead86700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e4141bf0 con 0x7f98e40b24a0 2020-10-31T22:50:14.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98ead86700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e40ac4d0 con 0x7f98e4141fe0 2020-10-31T22:50:14.382 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98ead86700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e40ac770 con 0x7f98e40b5570 2020-10-31T22:50:14.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98e9d84700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e40b24a0 0x7f98e40b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98e9d84700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e40b24a0 0x7f98e40b6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48806/0 (socket says 172.21.15.60:48806) 2020-10-31T22:50:14.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98e9d84700 1 -- 172.21.15.60:0/1194869688 learned_addr learned my addr 172.21.15.60:0/1194869688 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:14.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98e9583700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e40b5570 0x7f98e4150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98ea585700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e4141fe0 0x7f98e4150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98e9d84700 1 -- 172.21.15.60:0/1194869688 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e40b5570 msgr2=0x7f98e4150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98e9d84700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e40b5570 0x7f98e4150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98e9d84700 1 -- 172.21.15.60:0/1194869688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e4141fe0 msgr2=0x7f98e4150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98e9d84700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e4141fe0 0x7f98e4150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98e9d84700 1 -- 172.21.15.60:0/1194869688 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e40aca10 con 0x7f98e40b24a0 2020-10-31T22:50:14.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98ea585700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e4141fe0 0x7f98e4150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:50:14.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98e9d84700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e40b24a0 0x7f98e40b6550 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f98e40b0240 tx=0x7f98e0007b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:14.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98daffd700 1 -- 172.21.15.60:0/1194869688 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e00072e0 con 0x7f98e40b24a0 2020-10-31T22:50:14.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98daffd700 1 -- 172.21.15.60:0/1194869688 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98e0005520 con 0x7f98e40b24a0 2020-10-31T22:50:14.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98ead86700 1 -- 172.21.15.60:0/1194869688 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e40af040 con 0x7f98e40b24a0 2020-10-31T22:50:14.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98daffd700 1 -- 172.21.15.60:0/1194869688 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98e0005880 con 0x7f98e40b24a0 2020-10-31T22:50:14.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.373+0000 7f98ead86700 1 -- 172.21.15.60:0/1194869688 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e40b7050 con 0x7f98e40b24a0 2020-10-31T22:50:14.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.377+0000 7f98ead86700 1 -- 172.21.15.60:0/1194869688 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e4057100 con 0x7f98e40b24a0 2020-10-31T22:50:14.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.377+0000 7f98daffd700 1 -- 172.21.15.60:0/1194869688 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f98e0010070 con 0x7f98e40b24a0 2020-10-31T22:50:14.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.377+0000 7f98daffd700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f98cc054f10 0x7f98cc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.377+0000 7f98daffd700 1 -- 172.21.15.60:0/1194869688 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f98e006d9a0 con 0x7f98e40b24a0 2020-10-31T22:50:14.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.377+0000 7f98e9583700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f98cc054f10 0x7f98cc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.377+0000 7f98e9583700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f98cc054f10 0x7f98cc0573d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f98d401a000 tx=0x7f98d4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:14.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.381+0000 7f98daffd700 1 -- 172.21.15.60:0/1194869688 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f98e0043e60 con 0x7f98e40b24a0 2020-10-31T22:50:14.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.525+0000 7f98ead86700 1 -- 172.21.15.60:0/1194869688 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f98e405a8e0 con 0x7f98e40b24a0 2020-10-31T22:50:14.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.529+0000 7f98daffd700 1 -- 172.21.15.60:0/1194869688 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f98e0047480 con 0x7f98e40b24a0 2020-10-31T22:50:14.534 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:14.534 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":138,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:50:14.231348+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:50:11.956893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-10-31T22:50:13.235442+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:50:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.529+0000 7f98ead86700 1 -- 172.21.15.60:0/1194869688 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f98cc054f10 msgr2=0x7f98cc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.529+0000 7f98ead86700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f98cc054f10 0x7f98cc0573d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f98d401a000 tx=0x7f98d4015000).stop 2020-10-31T22:50:14.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.533+0000 7f98ead86700 1 -- 172.21.15.60:0/1194869688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e40b24a0 msgr2=0x7f98e40b6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.533+0000 7f98ead86700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e40b24a0 0x7f98e40b6550 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 rx=0x7f98e40b0240 tx=0x7f98e0007b40).stop 2020-10-31T22:50:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.533+0000 7f98ead86700 1 -- 172.21.15.60:0/1194869688 shutdown_connections 2020-10-31T22:50:14.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.533+0000 7f98ead86700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f98cc054f10 0x7f98cc0573d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.533+0000 7f98ead86700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98e4141fe0 0x7f98e4150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.533+0000 7f98ead86700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98e40b24a0 0x7f98e40b6550 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.533+0000 7f98ead86700 1 --2- 172.21.15.60:0/1194869688 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98e40b5570 0x7f98e4150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.533+0000 7f98ead86700 1 -- 172.21.15.60:0/1194869688 >> 172.21.15.60:0/1194869688 conn(0x7f98e40b8e90 msgr2=0x7f98e405ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:14.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.533+0000 7f98ead86700 1 -- 172.21.15.60:0/1194869688 shutdown_connections 2020-10-31T22:50:14.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.533+0000 7f98ead86700 1 -- 172.21.15.60:0/1194869688 wait complete. 2020-10-31T22:50:14.555 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:50:14.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c8088f700 1 Processor -- start 2020-10-31T22:50:14.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c8088f700 1 -- start start 2020-10-31T22:50:14.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c8088f700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4c7c0ae5b0 0x7f4c7c05afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c8088f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4c7c13f740 0x7f4c7c0a9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c8088f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c7c1424b0 con 0x7f4c7c05b4d0 2020-10-31T22:50:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c8088f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7c142750 con 0x7f4c7c13f740 2020-10-31T22:50:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c8088f700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c7c1429f0 con 0x7f4c7c0ae5b0 2020-10-31T22:50:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7affd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4c7c05b4d0 0x7f4c7c13f030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52950/0 (socket says 172.21.15.60:52950) 2020-10-31T22:50:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7affd700 1 -- 172.21.15.60:0/1264161689 learned_addr learned my addr 172.21.15.60:0/1264161689 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7bfff700 1 --2- 172.21.15.60:0/1264161689 >> v2:172.21.15.60:3300/0 conn(0x7f4c7c13f740 0x7f4c7c0a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7b7fe700 1 --2- 172.21.15.60:0/1264161689 >> v2:172.21.15.66:3300/0 conn(0x7f4c7c0ae5b0 0x7f4c7c05afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7a7fc700 1 -- 172.21.15.60:0/1264161689 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150488875 0 0) 0x7f4c7c1424b0 con 0x7f4c7c05b4d0 2020-10-31T22:50:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7a7fc700 1 -- 172.21.15.60:0/1264161689 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c5c003230 con 0x7f4c7c05b4d0 2020-10-31T22:50:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7bfff700 1 -- 172.21.15.60:0/1264161689 >> v2:172.21.15.66:3300/0 conn(0x7f4c7c0ae5b0 msgr2=0x7f4c7c05afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7a7fc700 1 -- 172.21.15.60:0/1264161689 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2958514824 0 0) 0x7f4c5c003230 con 0x7f4c7c05b4d0 2020-10-31T22:50:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7bfff700 1 --2- 172.21.15.60:0/1264161689 >> v2:172.21.15.66:3300/0 conn(0x7f4c7c0ae5b0 0x7f4c7c05afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7bfff700 1 -- 172.21.15.60:0/1264161689 >> v1:172.21.15.60:6789/0 conn(0x7f4c7c05b4d0 legacy=0x7f4c7c13f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7bfff700 1 -- 172.21.15.60:0/1264161689 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c0ae990 con 0x7f4c7c13f740 2020-10-31T22:50:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7bfff700 1 --2- 172.21.15.60:0/1264161689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c7c13f740 0x7f4c7c0a9310 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f4c64001870 tx=0x7f4c740091a0).ready entity=mon.0 client_cookie=df562d82a836a672 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:14.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7a7fc700 1 -- 172.21.15.60:0/1264161689 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c640016d0 con 0x7f4c7c13f740 2020-10-31T22:50:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7a7fc700 1 -- 172.21.15.60:0/1264161689 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7400b800 con 0x7f4c7c13f740 2020-10-31T22:50:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c8088f700 1 -- 172.21.15.60:0/1264161689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c7c13f740 msgr2=0x7f4c7c0a9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c7a7fc700 1 -- 172.21.15.60:0/1264161689 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c7400b970 con 0x7f4c7c13f740 2020-10-31T22:50:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c8088f700 1 --2- 172.21.15.60:0/1264161689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c7c13f740 0x7f4c7c0a9310 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 rx=0x7f4c64001870 tx=0x7f4c740091a0).stop 2020-10-31T22:50:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c8088f700 1 -- 172.21.15.60:0/1264161689 shutdown_connections 2020-10-31T22:50:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c8088f700 1 --2- 172.21.15.60:0/1264161689 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c7c13f740 0x7f4c7c0a9310 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c8088f700 1 --2- 172.21.15.60:0/1264161689 >> v2:172.21.15.66:3300/0 conn(0x7f4c7c0ae5b0 0x7f4c7c05afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.661+0000 7f4c8088f700 1 -- 172.21.15.60:0/1264161689 >> 172.21.15.60:0/1264161689 conn(0x7f4c7c0b61d0 msgr2=0x7f4c7c0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:14.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c8088f700 1 -- 172.21.15.60:0/1264161689 shutdown_connections 2020-10-31T22:50:14.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c8088f700 1 -- 172.21.15.60:0/1264161689 wait complete. 2020-10-31T22:50:14.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c8088f700 1 Processor -- start 2020-10-31T22:50:14.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c8088f700 1 -- start start 2020-10-31T22:50:14.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c8088f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c7c0ae5b0 0x7f4c7c140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c8088f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c7c154600 0x7f4c7c13aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c8088f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c7c13af30 0x7f4c7c065040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c8088f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c143dd0 con 0x7f4c7c154600 2020-10-31T22:50:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c8088f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c144000 con 0x7f4c7c13af30 2020-10-31T22:50:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c8088f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c7c1442a0 con 0x7f4c7c0ae5b0 2020-10-31T22:50:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c7affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c7c154600 0x7f4c7c13aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c7affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c7c154600 0x7f4c7c13aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48822/0 (socket says 172.21.15.60:48822) 2020-10-31T22:50:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c7affd700 1 -- 172.21.15.60:0/1123165079 learned_addr learned my addr 172.21.15.60:0/1123165079 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c7b7fe700 1 --2- 172.21.15.60:0/1123165079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c7c0ae5b0 0x7f4c7c140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c7bfff700 1 --2- 172.21.15.60:0/1123165079 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c7c13af30 0x7f4c7c065040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c7affd700 1 -- 172.21.15.60:0/1123165079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c7c0ae5b0 msgr2=0x7f4c7c140e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c7affd700 1 --2- 172.21.15.60:0/1123165079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c7c0ae5b0 0x7f4c7c140e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c7affd700 1 -- 172.21.15.60:0/1123165079 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c7c13af30 msgr2=0x7f4c7c065040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c7affd700 1 --2- 172.21.15.60:0/1123165079 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c7c13af30 0x7f4c7c065040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c7affd700 1 -- 172.21.15.60:0/1123165079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c144540 con 0x7f4c7c154600 2020-10-31T22:50:14.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c7affd700 1 --2- 172.21.15.60:0/1123165079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c7c154600 0x7f4c7c13aa40 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f4c64001930 tx=0x7f4c64001ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:14.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c78ff9700 1 -- 172.21.15.60:0/1123165079 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c64007170 con 0x7f4c7c154600 2020-10-31T22:50:14.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c78ff9700 1 -- 172.21.15.60:0/1123165079 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c640072d0 con 0x7f4c7c154600 2020-10-31T22:50:14.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c8088f700 1 -- 172.21.15.60:0/1123165079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c7c1419e0 con 0x7f4c7c154600 2020-10-31T22:50:14.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c78ff9700 1 -- 172.21.15.60:0/1123165079 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c6400a9e0 con 0x7f4c7c154600 2020-10-31T22:50:14.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.665+0000 7f4c8088f700 1 -- 172.21.15.60:0/1123165079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c7c13b3c0 con 0x7f4c7c154600 2020-10-31T22:50:14.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.669+0000 7f4c8088f700 1 -- 172.21.15.60:0/1123165079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c7c1446d0 con 0x7f4c7c154600 2020-10-31T22:50:14.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.669+0000 7f4c78ff9700 1 -- 172.21.15.60:0/1123165079 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4c6401b060 con 0x7f4c7c154600 2020-10-31T22:50:14.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.669+0000 7f4c78ff9700 1 --2- 172.21.15.60:0/1123165079 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4c60054f10 0x7f4c600573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.669+0000 7f4c7b7fe700 1 --2- 172.21.15.60:0/1123165079 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4c60054f10 0x7f4c600573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.669+0000 7f4c78ff9700 1 -- 172.21.15.60:0/1123165079 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4c6406d6c0 con 0x7f4c7c154600 2020-10-31T22:50:14.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.669+0000 7f4c7b7fe700 1 --2- 172.21.15.60:0/1123165079 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4c60054f10 0x7f4c600573d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f4c6c00b000 tx=0x7f4c6c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:14.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.673+0000 7f4c78ff9700 1 -- 172.21.15.60:0/1123165079 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4c64043ad0 con 0x7f4c7c154600 2020-10-31T22:50:14.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.813+0000 7f4c8088f700 1 -- 172.21.15.60:0/1123165079 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c7c057100 con 0x7f4c7c154600 2020-10-31T22:50:14.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.813+0000 7f4c78ff9700 1 -- 172.21.15.60:0/1123165079 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f4c64019070 con 0x7f4c7c154600 2020-10-31T22:50:14.821 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:14.821 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":138,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:50:14.231348+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:50:11.956893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-10-31T22:50:13.235442+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:50:14.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.817+0000 7f4c8088f700 1 -- 172.21.15.60:0/1123165079 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4c60054f10 msgr2=0x7f4c600573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.817+0000 7f4c8088f700 1 --2- 172.21.15.60:0/1123165079 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4c60054f10 0x7f4c600573d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f4c6c00b000 tx=0x7f4c6c008040).stop 2020-10-31T22:50:14.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.817+0000 7f4c8088f700 1 -- 172.21.15.60:0/1123165079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c7c154600 msgr2=0x7f4c7c13aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.817+0000 7f4c8088f700 1 --2- 172.21.15.60:0/1123165079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c7c154600 0x7f4c7c13aa40 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 rx=0x7f4c64001930 tx=0x7f4c64001ae0).stop 2020-10-31T22:50:14.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.817+0000 7f4c8088f700 1 -- 172.21.15.60:0/1123165079 shutdown_connections 2020-10-31T22:50:14.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.817+0000 7f4c8088f700 1 --2- 172.21.15.60:0/1123165079 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4c60054f10 0x7f4c600573d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.817+0000 7f4c8088f700 1 --2- 172.21.15.60:0/1123165079 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c7c13af30 0x7f4c7c065040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.817+0000 7f4c8088f700 1 --2- 172.21.15.60:0/1123165079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c7c0ae5b0 0x7f4c7c140e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.817+0000 7f4c8088f700 1 --2- 172.21.15.60:0/1123165079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4c7c154600 0x7f4c7c13aa40 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.817+0000 7f4c8088f700 1 -- 172.21.15.60:0/1123165079 >> 172.21.15.60:0/1123165079 conn(0x7f4c7c0b61d0 msgr2=0x7f4c7c0b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:14.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.817+0000 7f4c8088f700 1 -- 172.21.15.60:0/1123165079 shutdown_connections 2020-10-31T22:50:14.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.817+0000 7f4c8088f700 1 -- 172.21.15.60:0/1123165079 wait complete. 2020-10-31T22:50:14.836 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-10-31T22:50:14.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f0038919700 1 Processor -- start 2020-10-31T22:50:14.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f0038919700 1 -- start start 2020-10-31T22:50:14.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f0038919700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f00340b5570 0x7f00340b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f0038919700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0034141f00 0x7f0034142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f0038919700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00340b4440 con 0x7f00340b24a0 2020-10-31T22:50:14.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f0038919700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003413f930 con 0x7f00340b5570 2020-10-31T22:50:14.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f0038919700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0034146060 con 0x7f0034141f00 2020-10-31T22:50:14.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f0032ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f00340b24a0 0x7f0034145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52964/0 (socket says 172.21.15.60:52964) 2020-10-31T22:50:14.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f0032ffd700 1 -- 172.21.15.60:0/3330290613 learned_addr learned my addr 172.21.15.60:0/3330290613 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:14.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f00337fe700 1 --2- 172.21.15.60:0/3330290613 >> v2:172.21.15.66:3300/0 conn(0x7f00340b5570 0x7f00340b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f0033fff700 1 --2- 172.21.15.60:0/3330290613 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0034141f00 0x7f0034142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f00327fc700 1 -- 172.21.15.60:0/3330290613 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441357339 0 0) 0x7f00340b4440 con 0x7f00340b24a0 2020-10-31T22:50:14.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f00327fc700 1 -- 172.21.15.60:0/3330290613 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f001c003230 con 0x7f00340b24a0 2020-10-31T22:50:14.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f00337fe700 1 -- 172.21.15.60:0/3330290613 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0034141f00 msgr2=0x7f0034142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:14.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f00337fe700 1 --2- 172.21.15.60:0/3330290613 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0034141f00 0x7f0034142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f00337fe700 1 -- 172.21.15.60:0/3330290613 >> v1:172.21.15.60:6789/0 conn(0x7f00340b24a0 legacy=0x7f0034145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.961+0000 7f00337fe700 1 -- 172.21.15.60:0/3330290613 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00340b02f0 con 0x7f00340b5570 2020-10-31T22:50:14.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f0033fff700 1 --2- 172.21.15.60:0/3330290613 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0034141f00 0x7f0034142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:14.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f00337fe700 1 --2- 172.21.15.60:0/3330290613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00340b5570 0x7f00340b5950 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f0020002f30 tx=0x7f0020006dc0).ready entity=mon.1 client_cookie=af2a357d3b952dff server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:14.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f00327fc700 1 -- 172.21.15.60:0/3330290613 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00200096a0 con 0x7f00340b5570 2020-10-31T22:50:14.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f00327fc700 1 -- 172.21.15.60:0/3330290613 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0020009800 con 0x7f00340b5570 2020-10-31T22:50:14.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f00327fc700 1 -- 172.21.15.60:0/3330290613 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0020009b60 con 0x7f00340b5570 2020-10-31T22:50:14.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f0038919700 1 -- 172.21.15.60:0/3330290613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00340b5570 msgr2=0x7f00340b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f0038919700 1 --2- 172.21.15.60:0/3330290613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00340b5570 0x7f00340b5950 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f0020002f30 tx=0x7f0020006dc0).stop 2020-10-31T22:50:14.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f0038919700 1 -- 172.21.15.60:0/3330290613 shutdown_connections 2020-10-31T22:50:14.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f0038919700 1 --2- 172.21.15.60:0/3330290613 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0034141f00 0x7f0034142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f0038919700 1 --2- 172.21.15.60:0/3330290613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00340b5570 0x7f00340b5950 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f0038919700 1 -- 172.21.15.60:0/3330290613 >> 172.21.15.60:0/3330290613 conn(0x7f00340b8e90 msgr2=0x7f00340b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:14.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f0038919700 1 -- 172.21.15.60:0/3330290613 shutdown_connections 2020-10-31T22:50:14.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f0038919700 1 -- 172.21.15.60:0/3330290613 wait complete. 2020-10-31T22:50:14.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f0038919700 1 Processor -- start 2020-10-31T22:50:14.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.965+0000 7f0038919700 1 -- start start 2020-10-31T22:50:14.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0038919700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00340b24a0 0x7f0034148180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0038919700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00340b5570 0x7f0034144a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0038919700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0034141f00 0x7f0034151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0038919700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0034150a80 con 0x7f0034141f00 2020-10-31T22:50:14.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0038919700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00341489e0 con 0x7f00340b5570 2020-10-31T22:50:14.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0038919700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0034148c80 con 0x7f00340b24a0 2020-10-31T22:50:14.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0033fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0034141f00 0x7f0034151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0033fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0034141f00 0x7f0034151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48834/0 (socket says 172.21.15.60:48834) 2020-10-31T22:50:14.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0033fff700 1 -- 172.21.15.60:0/2898506911 learned_addr learned my addr 172.21.15.60:0/2898506911 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:14.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f00337fe700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00340b24a0 0x7f0034148180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0032ffd700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00340b5570 0x7f0034144a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0033fff700 1 -- 172.21.15.60:0/2898506911 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00340b24a0 msgr2=0x7f0034148180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0033fff700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00340b24a0 0x7f0034148180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0033fff700 1 -- 172.21.15.60:0/2898506911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00340b5570 msgr2=0x7f0034144a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:14.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0033fff700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00340b5570 0x7f0034144a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0033fff700 1 -- 172.21.15.60:0/2898506911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0034150c70 con 0x7f0034141f00 2020-10-31T22:50:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0032ffd700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00340b5570 0x7f0034144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:50:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0033fff700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0034141f00 0x7f0034151110 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f002c00c000 tx=0x7f002c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0030ff9700 1 -- 172.21.15.60:0/2898506911 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f002c00cce0 con 0x7f0034141f00 2020-10-31T22:50:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0030ff9700 1 -- 172.21.15.60:0/2898506911 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c00ce40 con 0x7f0034141f00 2020-10-31T22:50:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0038919700 1 -- 172.21.15.60:0/2898506911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00340af1b0 con 0x7f0034141f00 2020-10-31T22:50:14.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0030ff9700 1 -- 172.21.15.60:0/2898506911 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f002c0125e0 con 0x7f0034141f00 2020-10-31T22:50:14.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0038919700 1 -- 172.21.15.60:0/2898506911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0034147fc0 con 0x7f0034141f00 2020-10-31T22:50:14.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0030ff9700 1 -- 172.21.15.60:0/2898506911 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f002c022070 con 0x7f0034141f00 2020-10-31T22:50:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0038919700 1 -- 172.21.15.60:0/2898506911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0034148e80 con 0x7f0034141f00 2020-10-31T22:50:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0030ff9700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0010054f10 0x7f00100573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f0030ff9700 1 -- 172.21.15.60:0/2898506911 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f002c06e3c0 con 0x7f0034141f00 2020-10-31T22:50:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f00337fe700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0010054f10 0x7f00100573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:14.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.969+0000 7f00337fe700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0010054f10 0x7f00100573d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f0020019000 tx=0x7f0020015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:14.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:14.977+0000 7f0030ff9700 1 -- 172.21.15.60:0/2898506911 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f002c044750 con 0x7f0034141f00 2020-10-31T22:50:15.170 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.165+0000 7f0038919700 1 -- 172.21.15.60:0/2898506911 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0034147fc0 con 0x7f0034141f00 2020-10-31T22:50:15.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.237+0000 7f0030ff9700 1 -- 172.21.15.60:0/2898506911 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v70) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0034147fc0 con 0x7f0034141f00 2020-10-31T22:50:15.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.241+0000 7f0038919700 1 -- 172.21.15.60:0/2898506911 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0010054f10 msgr2=0x7f00100573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:15.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.241+0000 7f0038919700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0010054f10 0x7f00100573d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f0020019000 tx=0x7f0020015000).stop 2020-10-31T22:50:15.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.241+0000 7f0038919700 1 -- 172.21.15.60:0/2898506911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0034141f00 msgr2=0x7f0034151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:15.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.241+0000 7f0038919700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0034141f00 0x7f0034151110 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 rx=0x7f002c00c000 tx=0x7f002c0091a0).stop 2020-10-31T22:50:15.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.241+0000 7f0038919700 1 -- 172.21.15.60:0/2898506911 shutdown_connections 2020-10-31T22:50:15.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.241+0000 7f0038919700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0034141f00 0x7f0034151110 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.241+0000 7f0038919700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00340b24a0 0x7f0034148180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.241+0000 7f0038919700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0010054f10 0x7f00100573d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.241+0000 7f0038919700 1 --2- 172.21.15.60:0/2898506911 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00340b5570 0x7f0034144a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.241+0000 7f0038919700 1 -- 172.21.15.60:0/2898506911 >> 172.21.15.60:0/2898506911 conn(0x7f00340b8e90 msgr2=0x7f0034142390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:15.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.241+0000 7f0038919700 1 -- 172.21.15.60:0/2898506911 shutdown_connections 2020-10-31T22:50:15.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.241+0000 7f0038919700 1 -- 172.21.15.60:0/2898506911 wait complete. 2020-10-31T22:50:15.265 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:50:15.367 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:50:15.370 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:50:15.374 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:50:15.376 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:50:15.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 Processor -- start 2020-10-31T22:50:15.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 -- start start 2020-10-31T22:50:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8b8813ebe0 0x7f8b88142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b880af200 0x7f8b880b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:15.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b880abea0 con 0x7f8b880b1a10 2020-10-31T22:50:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b88141870 con 0x7f8b880af200 2020-10-31T22:50:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b88141b10 con 0x7f8b8813ebe0 2020-10-31T22:50:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e16d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8b880af200 0x7f8b880b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8d96c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8b880b1a10 0x7f8b880afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:52976/0 (socket says 172.21.15.60:52976) 2020-10-31T22:50:15.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8d96c700 1 -- 172.21.15.60:0/4027652125 learned_addr learned my addr 172.21.15.60:0/4027652125 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8d16b700 1 --2- 172.21.15.60:0/4027652125 >> v2:172.21.15.66:3300/0 conn(0x7f8b8813ebe0 0x7f8b88142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e16d700 1 -- 172.21.15.60:0/4027652125 >> v2:172.21.15.66:3300/0 conn(0x7f8b8813ebe0 msgr2=0x7f8b88142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e16d700 1 --2- 172.21.15.60:0/4027652125 >> v2:172.21.15.66:3300/0 conn(0x7f8b8813ebe0 0x7f8b88142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e16d700 1 -- 172.21.15.60:0/4027652125 >> v1:172.21.15.60:6789/0 conn(0x7f8b880b1a10 legacy=0x7f8b880afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e16d700 1 -- 172.21.15.60:0/4027652125 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b88141db0 con 0x7f8b880af200 2020-10-31T22:50:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e16d700 1 --2- 172.21.15.60:0/4027652125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b880af200 0x7f8b880b1df0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f8b7c002f30 tx=0x7f8b7c006dc0).ready entity=mon.0 client_cookie=745c01e73793c305 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8c96a700 1 -- 172.21.15.60:0/4027652125 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b7c0097b0 con 0x7f8b880af200 2020-10-31T22:50:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8c96a700 1 -- 172.21.15.60:0/4027652125 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7c009910 con 0x7f8b880af200 2020-10-31T22:50:15.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8c96a700 1 -- 172.21.15.60:0/4027652125 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b7c009c70 con 0x7f8b880af200 2020-10-31T22:50:15.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 -- 172.21.15.60:0/4027652125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b880af200 msgr2=0x7f8b880b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:15.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 --2- 172.21.15.60:0/4027652125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b880af200 0x7f8b880b1df0 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 rx=0x7f8b7c002f30 tx=0x7f8b7c006dc0).stop 2020-10-31T22:50:15.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 -- 172.21.15.60:0/4027652125 shutdown_connections 2020-10-31T22:50:15.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 --2- 172.21.15.60:0/4027652125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b880af200 0x7f8b880b1df0 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 --2- 172.21.15.60:0/4027652125 >> v2:172.21.15.66:3300/0 conn(0x7f8b8813ebe0 0x7f8b88142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 -- 172.21.15.60:0/4027652125 >> 172.21.15.60:0/4027652125 conn(0x7f8b880b5300 msgr2=0x7f8b880b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:15.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 -- 172.21.15.60:0/4027652125 shutdown_connections 2020-10-31T22:50:15.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.381+0000 7f8b8e96e700 1 -- 172.21.15.60:0/4027652125 wait complete. 2020-10-31T22:50:15.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.385+0000 7f8b8e96e700 1 Processor -- start 2020-10-31T22:50:15.396 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.385+0000 7f8b8e96e700 1 -- start start 2020-10-31T22:50:15.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.385+0000 7f8b8e96e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b880af200 0x7f8b8814e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:15.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.385+0000 7f8b8e96e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b880b1a10 0x7f8b880ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:15.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.385+0000 7f8b8e96e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b8813ebe0 0x7f8b880aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:15.397 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.385+0000 7f8b8e96e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b88065a30 con 0x7f8b880af200 2020-10-31T22:50:15.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.385+0000 7f8b8e96e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8814b1d0 con 0x7f8b8813ebe0 2020-10-31T22:50:15.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.385+0000 7f8b8e96e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b88063150 con 0x7f8b880b1a10 2020-10-31T22:50:15.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.385+0000 7f8b8d96c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b880af200 0x7f8b8814e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:15.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b8d96c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b880af200 0x7f8b8814e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48848/0 (socket says 172.21.15.60:48848) 2020-10-31T22:50:15.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b8d96c700 1 -- 172.21.15.60:0/1096183215 learned_addr learned my addr 172.21.15.60:0/1096183215 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:15.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b8e16d700 1 --2- 172.21.15.60:0/1096183215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b8813ebe0 0x7f8b880aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:15.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b8d16b700 1 --2- 172.21.15.60:0/1096183215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b880b1a10 0x7f8b880ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:15.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b8d96c700 1 -- 172.21.15.60:0/1096183215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b880b1a10 msgr2=0x7f8b880ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:15.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b8d96c700 1 --2- 172.21.15.60:0/1096183215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b880b1a10 0x7f8b880ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b8d96c700 1 -- 172.21.15.60:0/1096183215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b8813ebe0 msgr2=0x7f8b880aa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:15.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b8d96c700 1 --2- 172.21.15.60:0/1096183215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b8813ebe0 0x7f8b880aa710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b8d96c700 1 -- 172.21.15.60:0/1096183215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8814d810 con 0x7f8b880af200 2020-10-31T22:50:15.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b8d96c700 1 --2- 172.21.15.60:0/1096183215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b880af200 0x7f8b8814e1f0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f8b8814b310 tx=0x7f8b84007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:15.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b7b7fe700 1 -- 172.21.15.60:0/1096183215 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b840072e0 con 0x7f8b880af200 2020-10-31T22:50:15.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b7b7fe700 1 -- 172.21.15.60:0/1096183215 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b84007440 con 0x7f8b880af200 2020-10-31T22:50:15.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b7b7fe700 1 -- 172.21.15.60:0/1096183215 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b840057d0 con 0x7f8b880af200 2020-10-31T22:50:15.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b8e96e700 1 -- 172.21.15.60:0/1096183215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8814dd50 con 0x7f8b880af200 2020-10-31T22:50:15.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b8e96e700 1 -- 172.21.15.60:0/1096183215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8814b3f0 con 0x7f8b880af200 2020-10-31T22:50:15.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b8e96e700 1 -- 172.21.15.60:0/1096183215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b880aada0 con 0x7f8b880af200 2020-10-31T22:50:15.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b7b7fe700 1 -- 172.21.15.60:0/1096183215 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8b84005930 con 0x7f8b880af200 2020-10-31T22:50:15.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b7b7fe700 1 --2- 172.21.15.60:0/1096183215 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b64054f10 0x7f8b640573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:15.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b8d16b700 1 --2- 172.21.15.60:0/1096183215 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b64054f10 0x7f8b640573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:15.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.389+0000 7f8b7b7fe700 1 -- 172.21.15.60:0/1096183215 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8b8406f410 con 0x7f8b880af200 2020-10-31T22:50:15.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.393+0000 7f8b8d16b700 1 --2- 172.21.15.60:0/1096183215 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b64054f10 0x7f8b640573d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f8b8000b000 tx=0x7f8b800091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:15.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.397+0000 7f8b7b7fe700 1 -- 172.21.15.60:0/1096183215 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8b84045930 con 0x7f8b880af200 2020-10-31T22:50:15.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.585+0000 7f8b8e96e700 1 -- 172.21.15.60:0/1096183215 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b8814dee0 con 0x7f8b880af200 2020-10-31T22:50:15.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.585+0000 7f8b7b7fe700 1 -- 172.21.15.60:0/1096183215 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f8b84048f50 con 0x7f8b880af200 2020-10-31T22:50:15.592 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:15.592 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1094853447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1094853447},{"type":"v1","addr":"172.21.15.66:6833","nonce":1094853447}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68},{"gid":7875,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3767660505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3767660505},{"type":"v1","addr":"172.21.15.60:6835","nonce":3767660505}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:14.231864+0000","modified":"2020-10-31T22:50:15.234744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7884":{"gid":7884,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/936802064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":936802064},{"type":"v1","addr":"172.21.15.60:6837","nonce":936802064}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-10-31T22:50:15.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.585+0000 7f8b8e96e700 1 -- 172.21.15.60:0/1096183215 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b64054f10 msgr2=0x7f8b640573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:15.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.589+0000 7f8b8e96e700 1 --2- 172.21.15.60:0/1096183215 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b64054f10 0x7f8b640573d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f8b8000b000 tx=0x7f8b800091a0).stop 2020-10-31T22:50:15.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.589+0000 7f8b8e96e700 1 -- 172.21.15.60:0/1096183215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b880af200 msgr2=0x7f8b8814e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:15.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.589+0000 7f8b8e96e700 1 --2- 172.21.15.60:0/1096183215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b880af200 0x7f8b8814e1f0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 rx=0x7f8b8814b310 tx=0x7f8b84007b80).stop 2020-10-31T22:50:15.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.589+0000 7f8b8e96e700 1 -- 172.21.15.60:0/1096183215 shutdown_connections 2020-10-31T22:50:15.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.589+0000 7f8b8e96e700 1 --2- 172.21.15.60:0/1096183215 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8b64054f10 0x7f8b640573d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.589+0000 7f8b8e96e700 1 --2- 172.21.15.60:0/1096183215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b8813ebe0 0x7f8b880aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.589+0000 7f8b8e96e700 1 --2- 172.21.15.60:0/1096183215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b880af200 0x7f8b8814e1f0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.589+0000 7f8b8e96e700 1 --2- 172.21.15.60:0/1096183215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b880b1a10 0x7f8b880ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.589+0000 7f8b8e96e700 1 -- 172.21.15.60:0/1096183215 >> 172.21.15.60:0/1096183215 conn(0x7f8b880b5300 msgr2=0x7f8b88141060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:15.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.589+0000 7f8b8e96e700 1 -- 172.21.15.60:0/1096183215 shutdown_connections 2020-10-31T22:50:15.598 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.589+0000 7f8b8e96e700 1 -- 172.21.15.60:0/1096183215 wait complete. 2020-10-31T22:50:15.598 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 70 2020-10-31T22:50:15.606 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:50:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.709+0000 7f47bb59e700 1 Processor -- start 2020-10-31T22:50:15.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.709+0000 7f47bb59e700 1 -- start start 2020-10-31T22:50:15.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47bb59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47bc0af520 0x7f47bc0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47bb59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47bc066c90 0x7f47bc0670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47bb59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc0af900 con 0x7f47bc146060 2020-10-31T22:50:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47bb59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47bc0afc10 con 0x7f47bc0af520 2020-10-31T22:50:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47bb59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc05bb70 con 0x7f47bc066c90 2020-10-31T22:50:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47ba59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47bc0af520 0x7f47bc0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:15.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47b9d9b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47bc066c90 0x7f47bc0670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47ba59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f47bc0af520 0x7f47bc0ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48854/0 (socket says 172.21.15.60:48854) 2020-10-31T22:50:15.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47bad9d700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f47bc146060 0x7f47bc149620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:50860/0 (socket says 172.21.15.60:50860) 2020-10-31T22:50:15.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47ba59c700 1 -- 172.21.15.60:0/1500899395 learned_addr learned my addr 172.21.15.60:0/1500899395 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:15.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47ba59c700 1 -- 172.21.15.60:0/1500899395 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47bc066c90 msgr2=0x7f47bc0670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:15.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47b959a700 1 -- 172.21.15.60:0/1500899395 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982349101 0 0) 0x7f47bc0af900 con 0x7f47bc146060 2020-10-31T22:50:15.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47ba59c700 1 --2- 172.21.15.60:0/1500899395 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47bc066c90 0x7f47bc0670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47ba59c700 1 -- 172.21.15.60:0/1500899395 >> v1:172.21.15.66:6789/0 conn(0x7f47bc146060 legacy=0x7f47bc149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:15.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47ba59c700 1 -- 172.21.15.60:0/1500899395 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc0ac130 con 0x7f47bc0af520 2020-10-31T22:50:15.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47b9d9b700 1 --2- 172.21.15.60:0/1500899395 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47bc066c90 0x7f47bc0670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:15.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47ba59c700 1 --2- 172.21.15.60:0/1500899395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc0af520 0x7f47bc0ac870 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f47ac002f30 tx=0x7f47ac006e80).ready entity=mon.0 client_cookie=4cd5534b5f4b0bbc server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:15.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47b959a700 1 -- 172.21.15.60:0/1500899395 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47ac0097f0 con 0x7f47bc0af520 2020-10-31T22:50:15.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47b959a700 1 -- 172.21.15.60:0/1500899395 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac009950 con 0x7f47bc0af520 2020-10-31T22:50:15.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47bb59e700 1 -- 172.21.15.60:0/1500899395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc0af520 msgr2=0x7f47bc0ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:15.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47b959a700 1 -- 172.21.15.60:0/1500899395 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47ac009cb0 con 0x7f47bc0af520 2020-10-31T22:50:15.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47bb59e700 1 --2- 172.21.15.60:0/1500899395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc0af520 0x7f47bc0ac870 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 rx=0x7f47ac002f30 tx=0x7f47ac006e80).stop 2020-10-31T22:50:15.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47bb59e700 1 -- 172.21.15.60:0/1500899395 shutdown_connections 2020-10-31T22:50:15.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47bb59e700 1 --2- 172.21.15.60:0/1500899395 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc0af520 0x7f47bc0ac870 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47bb59e700 1 --2- 172.21.15.60:0/1500899395 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47bc066c90 0x7f47bc0670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47bb59e700 1 -- 172.21.15.60:0/1500899395 >> 172.21.15.60:0/1500899395 conn(0x7f47bc0b3fd0 msgr2=0x7f47bc0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:15.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47bb59e700 1 -- 172.21.15.60:0/1500899395 shutdown_connections 2020-10-31T22:50:15.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.713+0000 7f47bb59e700 1 -- 172.21.15.60:0/1500899395 wait complete. 2020-10-31T22:50:15.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47bb59e700 1 Processor -- start 2020-10-31T22:50:15.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47bb59e700 1 -- start start 2020-10-31T22:50:15.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47bb59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc066c90 0x7f47bc141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:15.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47bb59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47bc0af520 0x7f47bc158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:15.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47bb59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47bc146060 0x7f47bc0a8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:15.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47bb59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc159260 con 0x7f47bc066c90 2020-10-31T22:50:15.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47bb59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc158bf0 con 0x7f47bc146060 2020-10-31T22:50:15.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47bb59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc141100 con 0x7f47bc0af520 2020-10-31T22:50:15.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47ba59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc066c90 0x7f47bc141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:15.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47ba59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc066c90 0x7f47bc141ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48860/0 (socket says 172.21.15.60:48860) 2020-10-31T22:50:15.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47ba59c700 1 -- 172.21.15.60:0/779173499 learned_addr learned my addr 172.21.15.60:0/779173499 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:15.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47bad9d700 1 --2- 172.21.15.60:0/779173499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47bc146060 0x7f47bc0a8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:15.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47b9d9b700 1 --2- 172.21.15.60:0/779173499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47bc0af520 0x7f47bc158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:15.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47ba59c700 1 -- 172.21.15.60:0/779173499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47bc0af520 msgr2=0x7f47bc158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:15.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47ba59c700 1 --2- 172.21.15.60:0/779173499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47bc0af520 0x7f47bc158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47ba59c700 1 -- 172.21.15.60:0/779173499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47bc146060 msgr2=0x7f47bc0a8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:15.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47ba59c700 1 --2- 172.21.15.60:0/779173499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47bc146060 0x7f47bc0a8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47ba59c700 1 -- 172.21.15.60:0/779173499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc158e20 con 0x7f47bc066c90 2020-10-31T22:50:15.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47ba59c700 1 --2- 172.21.15.60:0/779173499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc066c90 0x7f47bc141ab0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f47bc1593a0 tx=0x7f47ac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:15.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47b37fe700 1 -- 172.21.15.60:0/779173499 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47ac00bee0 con 0x7f47bc066c90 2020-10-31T22:50:15.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47b37fe700 1 -- 172.21.15.60:0/779173499 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac011b20 con 0x7f47bc066c90 2020-10-31T22:50:15.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47bb59e700 1 -- 172.21.15.60:0/779173499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc141370 con 0x7f47bc066c90 2020-10-31T22:50:15.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47b37fe700 1 -- 172.21.15.60:0/779173499 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f47ac011e80 con 0x7f47bc066c90 2020-10-31T22:50:15.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.717+0000 7f47bb59e700 1 -- 172.21.15.60:0/779173499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc1423d0 con 0x7f47bc066c90 2020-10-31T22:50:15.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.721+0000 7f47bb59e700 1 -- 172.21.15.60:0/779173499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc0a86a0 con 0x7f47bc066c90 2020-10-31T22:50:15.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.721+0000 7f47b37fe700 1 -- 172.21.15.60:0/779173499 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f47ac025030 con 0x7f47bc066c90 2020-10-31T22:50:15.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.721+0000 7f47b37fe700 1 --2- 172.21.15.60:0/779173499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47a0055020 0x7f47a00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:15.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.721+0000 7f47b37fe700 1 -- 172.21.15.60:0/779173499 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f47ac06eb40 con 0x7f47bc066c90 2020-10-31T22:50:15.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.721+0000 7f47b9d9b700 1 --2- 172.21.15.60:0/779173499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47a0055020 0x7f47a00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:15.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.721+0000 7f47b9d9b700 1 --2- 172.21.15.60:0/779173499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47a0055020 0x7f47a00574e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f47a400b000 tx=0x7f47a40091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:15.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.729+0000 7f47b37fe700 1 -- 172.21.15.60:0/779173499 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f47bc0a86a0 con 0x7f47bc066c90 2020-10-31T22:50:15.875 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.869+0000 7f47bb59e700 1 -- 172.21.15.60:0/779173499 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47bc141810 con 0x7f47bc066c90 2020-10-31T22:50:15.877 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.873+0000 7f47b37fe700 1 -- 172.21.15.60:0/779173499 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f47bc141810 con 0x7f47bc066c90 2020-10-31T22:50:15.877 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:15.878 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":139,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:50:15.235473+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:50:11.956893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-10-31T22:50:13.235442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:50:15.878 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.873+0000 7f47bb59e700 1 -- 172.21.15.60:0/779173499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47a0055020 msgr2=0x7f47a00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:15.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.873+0000 7f47bb59e700 1 --2- 172.21.15.60:0/779173499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47a0055020 0x7f47a00574e0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f47a400b000 tx=0x7f47a40091a0).stop 2020-10-31T22:50:15.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.873+0000 7f47bb59e700 1 -- 172.21.15.60:0/779173499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc066c90 msgr2=0x7f47bc141ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:15.879 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.873+0000 7f47bb59e700 1 --2- 172.21.15.60:0/779173499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc066c90 0x7f47bc141ab0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 rx=0x7f47bc1593a0 tx=0x7f47ac015000).stop 2020-10-31T22:50:15.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.873+0000 7f47bb59e700 1 -- 172.21.15.60:0/779173499 shutdown_connections 2020-10-31T22:50:15.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.873+0000 7f47bb59e700 1 --2- 172.21.15.60:0/779173499 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f47a0055020 0x7f47a00574e0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.873+0000 7f47bb59e700 1 --2- 172.21.15.60:0/779173499 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f47bc146060 0x7f47bc0a8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.880 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.873+0000 7f47bb59e700 1 --2- 172.21.15.60:0/779173499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47bc066c90 0x7f47bc141ab0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.873+0000 7f47bb59e700 1 --2- 172.21.15.60:0/779173499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f47bc0af520 0x7f47bc158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:15.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.873+0000 7f47bb59e700 1 -- 172.21.15.60:0/779173499 >> 172.21.15.60:0/779173499 conn(0x7f47bc0b3fd0 msgr2=0x7f47bc14c950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:15.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.873+0000 7f47bb59e700 1 -- 172.21.15.60:0/779173499 shutdown_connections 2020-10-31T22:50:15.881 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:15.873+0000 7f47bb59e700 1 -- 172.21.15.60:0/779173499 wait complete. 2020-10-31T22:50:15.892 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:50:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.013+0000 7f3d25cd9700 1 Processor -- start 2020-10-31T22:50:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.013+0000 7f3d25cd9700 1 -- start start 2020-10-31T22:50:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.013+0000 7f3d25cd9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d2005b320 0x7f3d2007ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.024 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.013+0000 7f3d25cd9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d200ac110 0x7f3d200af980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.013+0000 7f3d25cd9700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2005b700 con 0x7f3d200ae200 2020-10-31T22:50:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.013+0000 7f3d25cd9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d200807c0 con 0x7f3d200ac110 2020-10-31T22:50:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d25cd9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d200ab730 con 0x7f3d2005b320 2020-10-31T22:50:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d24a77700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f3d200ac110 0x7f3d200af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d1f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3d200ae200 0x7f3d200a74b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53006/0 (socket says 172.21.15.60:53006) 2020-10-31T22:50:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d1f7fe700 1 -- 172.21.15.60:0/1067954727 learned_addr learned my addr 172.21.15.60:0/1067954727 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:16.025 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d1ffff700 1 --2- 172.21.15.60:0/1067954727 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d2005b320 0x7f3d2007ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d1ffff700 1 -- 172.21.15.60:0/1067954727 >> v2:172.21.15.60:3300/0 conn(0x7f3d200ac110 msgr2=0x7f3d200af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:16.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d1ffff700 1 --2- 172.21.15.60:0/1067954727 >> v2:172.21.15.60:3300/0 conn(0x7f3d200ac110 0x7f3d200af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d1ffff700 1 -- 172.21.15.60:0/1067954727 >> v1:172.21.15.60:6789/0 conn(0x7f3d200ae200 legacy=0x7f3d200a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d1ffff700 1 -- 172.21.15.60:0/1067954727 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d200ab9d0 con 0x7f3d2005b320 2020-10-31T22:50:16.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d24a77700 1 --2- 172.21.15.60:0/1067954727 >> v2:172.21.15.60:3300/0 conn(0x7f3d200ac110 0x7f3d200af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:16.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d1ffff700 1 --2- 172.21.15.60:0/1067954727 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d2005b320 0x7f3d2007ff20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f3d10002f30 tx=0x7f3d10006dc0).ready entity=mon.2 client_cookie=5be474a2f7ba84f9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:16.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d1effd700 1 -- 172.21.15.60:0/1067954727 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d10009760 con 0x7f3d2005b320 2020-10-31T22:50:16.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d1effd700 1 -- 172.21.15.60:0/1067954727 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d100098c0 con 0x7f3d2005b320 2020-10-31T22:50:16.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d1effd700 1 -- 172.21.15.60:0/1067954727 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d10009c20 con 0x7f3d2005b320 2020-10-31T22:50:16.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d25cd9700 1 -- 172.21.15.60:0/1067954727 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d2005b320 msgr2=0x7f3d2007ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d25cd9700 1 --2- 172.21.15.60:0/1067954727 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d2005b320 0x7f3d2007ff20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f3d10002f30 tx=0x7f3d10006dc0).stop 2020-10-31T22:50:16.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d25cd9700 1 -- 172.21.15.60:0/1067954727 shutdown_connections 2020-10-31T22:50:16.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d25cd9700 1 --2- 172.21.15.60:0/1067954727 >> v2:172.21.15.60:3300/0 conn(0x7f3d200ac110 0x7f3d200af980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d25cd9700 1 --2- 172.21.15.60:0/1067954727 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d2005b320 0x7f3d2007ff20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d25cd9700 1 -- 172.21.15.60:0/1067954727 >> 172.21.15.60:0/1067954727 conn(0x7f3d200b3fd0 msgr2=0x7f3d200b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:16.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d25cd9700 1 -- 172.21.15.60:0/1067954727 shutdown_connections 2020-10-31T22:50:16.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.017+0000 7f3d25cd9700 1 -- 172.21.15.60:0/1067954727 wait complete. 2020-10-31T22:50:16.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.021+0000 7f3d25cd9700 1 Processor -- start 2020-10-31T22:50:16.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.021+0000 7f3d25cd9700 1 -- start start 2020-10-31T22:50:16.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.021+0000 7f3d25cd9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d2005b320 0x7f3d200b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.021+0000 7f3d25cd9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d200ac110 0x7f3d20065d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.021+0000 7f3d25cd9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d200ae200 0x7f3d2009e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.021+0000 7f3d25cd9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d200651c0 con 0x7f3d2005b320 2020-10-31T22:50:16.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.021+0000 7f3d25cd9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d20065460 con 0x7f3d200ac110 2020-10-31T22:50:16.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.021+0000 7f3d25cd9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d20065700 con 0x7f3d200ae200 2020-10-31T22:50:16.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.021+0000 7f3d1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d2005b320 0x7f3d200b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.021+0000 7f3d1ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d2005b320 0x7f3d200b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48874/0 (socket says 172.21.15.60:48874) 2020-10-31T22:50:16.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.021+0000 7f3d1ffff700 1 -- 172.21.15.60:0/2685350822 learned_addr learned my addr 172.21.15.60:0/2685350822 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:16.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1f7fe700 1 --2- 172.21.15.60:0/2685350822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d200ac110 0x7f3d20065d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d24a77700 1 --2- 172.21.15.60:0/2685350822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d200ae200 0x7f3d2009e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1ffff700 1 -- 172.21.15.60:0/2685350822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d200ae200 msgr2=0x7f3d2009e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1ffff700 1 --2- 172.21.15.60:0/2685350822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d200ae200 0x7f3d2009e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1ffff700 1 -- 172.21.15.60:0/2685350822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d200ac110 msgr2=0x7f3d20065d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1ffff700 1 --2- 172.21.15.60:0/2685350822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d200ac110 0x7f3d20065d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1ffff700 1 -- 172.21.15.60:0/2685350822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2009e1e0 con 0x7f3d2005b320 2020-10-31T22:50:16.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1ffff700 1 --2- 172.21.15.60:0/2685350822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d2005b320 0x7f3d200b2210 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f3d10002f30 tx=0x7f3d10015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:16.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1cff9700 1 -- 172.21.15.60:0/2685350822 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d10011b80 con 0x7f3d2005b320 2020-10-31T22:50:16.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1cff9700 1 -- 172.21.15.60:0/2685350822 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d10011ce0 con 0x7f3d2005b320 2020-10-31T22:50:16.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d25cd9700 1 -- 172.21.15.60:0/2685350822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d200a0d30 con 0x7f3d2005b320 2020-10-31T22:50:16.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1cff9700 1 -- 172.21.15.60:0/2685350822 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3d1001d630 con 0x7f3d2005b320 2020-10-31T22:50:16.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d25cd9700 1 -- 172.21.15.60:0/2685350822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d20140ee0 con 0x7f3d2005b320 2020-10-31T22:50:16.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1cff9700 1 -- 172.21.15.60:0/2685350822 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3d10024030 con 0x7f3d2005b320 2020-10-31T22:50:16.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d25cd9700 1 -- 172.21.15.60:0/2685350822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d20057100 con 0x7f3d2005b320 2020-10-31T22:50:16.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1cff9700 1 --2- 172.21.15.60:0/2685350822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d00055020 0x7f3d000574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1cff9700 1 -- 172.21.15.60:0/2685350822 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3d1006e730 con 0x7f3d2005b320 2020-10-31T22:50:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1f7fe700 1 --2- 172.21.15.60:0/2685350822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d00055020 0x7f3d000574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.025+0000 7f3d1f7fe700 1 --2- 172.21.15.60:0/2685350822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d00055020 0x7f3d000574e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f3d1400b000 tx=0x7f3d14009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:16.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.033+0000 7f3d1cff9700 1 -- 172.21.15.60:0/2685350822 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3d10044c50 con 0x7f3d2005b320 2020-10-31T22:50:16.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.221+0000 7f3d25cd9700 1 -- 172.21.15.60:0/2685350822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f3d2005a8e0 con 0x7f3d2005b320 2020-10-31T22:50:16.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.225+0000 7f3d1cff9700 1 -- 172.21.15.60:0/2685350822 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v29) v1 ==== 184+0+0 (secure 0 0 0) 0x7f3d100220e0 con 0x7f3d2005b320 2020-10-31T22:50:16.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.229+0000 7f3d25cd9700 1 -- 172.21.15.60:0/2685350822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d00055020 msgr2=0x7f3d000574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.229+0000 7f3d25cd9700 1 --2- 172.21.15.60:0/2685350822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d00055020 0x7f3d000574e0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7f3d1400b000 tx=0x7f3d14009040).stop 2020-10-31T22:50:16.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.229+0000 7f3d25cd9700 1 -- 172.21.15.60:0/2685350822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d2005b320 msgr2=0x7f3d200b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.229+0000 7f3d25cd9700 1 --2- 172.21.15.60:0/2685350822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d2005b320 0x7f3d200b2210 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 rx=0x7f3d10002f30 tx=0x7f3d10015000).stop 2020-10-31T22:50:16.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.229+0000 7f3d25cd9700 1 -- 172.21.15.60:0/2685350822 shutdown_connections 2020-10-31T22:50:16.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.229+0000 7f3d25cd9700 1 --2- 172.21.15.60:0/2685350822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3d200ae200 0x7f3d2009e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.229+0000 7f3d25cd9700 1 --2- 172.21.15.60:0/2685350822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3d2005b320 0x7f3d200b2210 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.229+0000 7f3d25cd9700 1 --2- 172.21.15.60:0/2685350822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3d00055020 0x7f3d000574e0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.229+0000 7f3d25cd9700 1 --2- 172.21.15.60:0/2685350822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d200ac110 0x7f3d20065d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.229+0000 7f3d25cd9700 1 -- 172.21.15.60:0/2685350822 >> 172.21.15.60:0/2685350822 conn(0x7f3d200b3fd0 msgr2=0x7f3d20066a40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:16.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.229+0000 7f3d25cd9700 1 -- 172.21.15.60:0/2685350822 shutdown_connections 2020-10-31T22:50:16.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.229+0000 7f3d25cd9700 1 -- 172.21.15.60:0/2685350822 wait complete. 2020-10-31T22:50:16.237 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2020-10-31T22:50:16.246 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:50:16.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.365+0000 7fae3d66d700 1 Processor -- start 2020-10-31T22:50:16.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.365+0000 7fae3d66d700 1 -- start start 2020-10-31T22:50:16.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.365+0000 7fae3d66d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae380b1570 0x7fae38024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.365+0000 7fae3d66d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fae380803e0 0x7fae38159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.365+0000 7fae3d66d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae380b1950 con 0x7fae38025480 2020-10-31T22:50:16.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.365+0000 7fae3d66d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae38080870 con 0x7fae380803e0 2020-10-31T22:50:16.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.365+0000 7fae3d66d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae38062720 con 0x7fae380b1570 2020-10-31T22:50:16.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.365+0000 7fae37fff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fae38025480 0x7fae3807fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53020/0 (socket says 172.21.15.60:53020) 2020-10-31T22:50:16.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.365+0000 7fae37fff700 1 -- 172.21.15.60:0/3172903415 learned_addr learned my addr 172.21.15.60:0/3172903415 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:16.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.365+0000 7fae3e8cf700 1 --2- 172.21.15.60:0/3172903415 >> v2:172.21.15.60:3300/0 conn(0x7fae380803e0 0x7fae38159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.365+0000 7fae3ce6c700 1 --2- 172.21.15.60:0/3172903415 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae380b1570 0x7fae38024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae377fe700 1 -- 172.21.15.60:0/3172903415 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1478466508 0 0) 0x7fae380b1950 con 0x7fae38025480 2020-10-31T22:50:16.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae377fe700 1 -- 172.21.15.60:0/3172903415 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae20003230 con 0x7fae38025480 2020-10-31T22:50:16.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae377fe700 1 -- 172.21.15.60:0/3172903415 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 13323236 0 0) 0x7fae20003230 con 0x7fae38025480 2020-10-31T22:50:16.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae3e8cf700 1 -- 172.21.15.60:0/3172903415 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae380b1570 msgr2=0x7fae38024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:16.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae3e8cf700 1 --2- 172.21.15.60:0/3172903415 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae380b1570 0x7fae38024f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae3e8cf700 1 -- 172.21.15.60:0/3172903415 >> v1:172.21.15.60:6789/0 conn(0x7fae38025480 legacy=0x7fae3807fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae3e8cf700 1 -- 172.21.15.60:0/3172903415 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae38066cb0 con 0x7fae380803e0 2020-10-31T22:50:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae3e8cf700 1 --2- 172.21.15.60:0/3172903415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae380803e0 0x7fae38159210 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7fae2c001bf0 tx=0x7fae30006dc0).ready entity=mon.0 client_cookie=39873f555681cd86 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae377fe700 1 -- 172.21.15.60:0/3172903415 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae2c001a50 con 0x7fae380803e0 2020-10-31T22:50:16.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae377fe700 1 -- 172.21.15.60:0/3172903415 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3000d570 con 0x7fae380803e0 2020-10-31T22:50:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae377fe700 1 -- 172.21.15.60:0/3172903415 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3000d6e0 con 0x7fae380803e0 2020-10-31T22:50:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae3d66d700 1 -- 172.21.15.60:0/3172903415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae380803e0 msgr2=0x7fae38159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae3d66d700 1 --2- 172.21.15.60:0/3172903415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae380803e0 0x7fae38159210 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 rx=0x7fae2c001bf0 tx=0x7fae30006dc0).stop 2020-10-31T22:50:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae3d66d700 1 -- 172.21.15.60:0/3172903415 shutdown_connections 2020-10-31T22:50:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae3d66d700 1 --2- 172.21.15.60:0/3172903415 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae380803e0 0x7fae38159210 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae3d66d700 1 --2- 172.21.15.60:0/3172903415 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae380b1570 0x7fae38024f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae3d66d700 1 -- 172.21.15.60:0/3172903415 >> 172.21.15.60:0/3172903415 conn(0x7fae380b5440 msgr2=0x7fae380b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:16.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae3d66d700 1 -- 172.21.15.60:0/3172903415 shutdown_connections 2020-10-31T22:50:16.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.369+0000 7fae3d66d700 1 -- 172.21.15.60:0/3172903415 wait complete. 2020-10-31T22:50:16.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae3d66d700 1 Processor -- start 2020-10-31T22:50:16.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae3d66d700 1 -- start start 2020-10-31T22:50:16.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae3d66d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae38025480 0x7fae380b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae3d66d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae380803e0 0x7fae3813df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae3d66d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae380b1570 0x7fae3813e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae3d66d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3813d8a0 con 0x7fae380803e0 2020-10-31T22:50:16.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae3d66d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae380a5cf0 con 0x7fae38025480 2020-10-31T22:50:16.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae3d66d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae380a5f90 con 0x7fae380b1570 2020-10-31T22:50:16.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae37fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae380803e0 0x7fae3813df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae37fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae380803e0 0x7fae3813df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48890/0 (socket says 172.21.15.60:48890) 2020-10-31T22:50:16.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae37fff700 1 -- 172.21.15.60:0/252398822 learned_addr learned my addr 172.21.15.60:0/252398822 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:16.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae3ce6c700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae38025480 0x7fae380b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae3e8cf700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae380b1570 0x7fae3813e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae37fff700 1 -- 172.21.15.60:0/252398822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae380b1570 msgr2=0x7fae3813e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae37fff700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae380b1570 0x7fae3813e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae37fff700 1 -- 172.21.15.60:0/252398822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae38025480 msgr2=0x7fae380b4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae37fff700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae38025480 0x7fae380b4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae37fff700 1 -- 172.21.15.60:0/252398822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3813da90 con 0x7fae380803e0 2020-10-31T22:50:16.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae3e8cf700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae380b1570 0x7fae3813e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:16.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae37fff700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae380803e0 0x7fae3813df30 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7fae2c001cb0 tx=0x7fae2c001600).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:16.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae357fa700 1 -- 172.21.15.60:0/252398822 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae2c004a80 con 0x7fae380803e0 2020-10-31T22:50:16.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae357fa700 1 -- 172.21.15.60:0/252398822 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c004be0 con 0x7fae380803e0 2020-10-31T22:50:16.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae3d66d700 1 -- 172.21.15.60:0/252398822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae380aa990 con 0x7fae380803e0 2020-10-31T22:50:16.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae357fa700 1 -- 172.21.15.60:0/252398822 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae2c007170 con 0x7fae380803e0 2020-10-31T22:50:16.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.373+0000 7fae3d66d700 1 -- 172.21.15.60:0/252398822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae380b4a70 con 0x7fae380803e0 2020-10-31T22:50:16.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.377+0000 7fae3d66d700 1 -- 172.21.15.60:0/252398822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae38057100 con 0x7fae380803e0 2020-10-31T22:50:16.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.377+0000 7fae357fa700 1 -- 172.21.15.60:0/252398822 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fae2c01b060 con 0x7fae380803e0 2020-10-31T22:50:16.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.377+0000 7fae357fa700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fae18054f00 0x7fae180573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.377+0000 7fae3ce6c700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fae18054f00 0x7fae180573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.377+0000 7fae357fa700 1 -- 172.21.15.60:0/252398822 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fae2c06da40 con 0x7fae380803e0 2020-10-31T22:50:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.377+0000 7fae3ce6c700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fae18054f00 0x7fae180573c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fae28008000 tx=0x7fae28008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:16.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.381+0000 7fae357fa700 1 -- 172.21.15.60:0/252398822 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fae2c043e50 con 0x7fae380803e0 2020-10-31T22:50:16.579 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.573+0000 7fae3d66d700 1 -- 172.21.15.60:0/252398822 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7fae38062920 con 0x7fae380803e0 2020-10-31T22:50:16.585 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.581+0000 7fae357fa700 1 -- 172.21.15.60:0/252398822 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v30) v1 ==== 184+0+0 (secure 0 0 0) 0x7fae2c019070 con 0x7fae380803e0 2020-10-31T22:50:16.588 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.585+0000 7fae3d66d700 1 -- 172.21.15.60:0/252398822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fae18054f00 msgr2=0x7fae180573c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.585+0000 7fae3d66d700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fae18054f00 0x7fae180573c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fae28008000 tx=0x7fae28008040).stop 2020-10-31T22:50:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.585+0000 7fae3d66d700 1 -- 172.21.15.60:0/252398822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae380803e0 msgr2=0x7fae3813df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.585+0000 7fae3d66d700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae380803e0 0x7fae3813df30 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 rx=0x7fae2c001cb0 tx=0x7fae2c001600).stop 2020-10-31T22:50:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.585+0000 7fae3d66d700 1 -- 172.21.15.60:0/252398822 shutdown_connections 2020-10-31T22:50:16.589 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.585+0000 7fae3d66d700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae380b1570 0x7fae3813e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.585+0000 7fae3d66d700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fae18054f00 0x7fae180573c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.585+0000 7fae3d66d700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae38025480 0x7fae380b4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.585+0000 7fae3d66d700 1 --2- 172.21.15.60:0/252398822 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae380803e0 0x7fae3813df30 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.585+0000 7fae3d66d700 1 -- 172.21.15.60:0/252398822 >> 172.21.15.60:0/252398822 conn(0x7fae380b5440 msgr2=0x7fae38132ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.585+0000 7fae3d66d700 1 -- 172.21.15.60:0/252398822 shutdown_connections 2020-10-31T22:50:16.590 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.585+0000 7fae3d66d700 1 -- 172.21.15.60:0/252398822 wait complete. 2020-10-31T22:50:16.591 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.1 2020-10-31T22:50:16.604 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:50:16.717 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.709+0000 7fe49887d700 1 Processor -- start 2020-10-31T22:50:16.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.709+0000 7fe49887d700 1 -- start start 2020-10-31T22:50:16.718 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.709+0000 7fe49887d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe4940b5570 0x7fe4940b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.709+0000 7fe49887d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe4940b24a0 0x7fe494145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.709+0000 7fe49887d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe494145d10 0x7fe494141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.709+0000 7fe49887d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4940afae0 con 0x7fe4940b24a0 2020-10-31T22:50:16.719 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.709+0000 7fe49887d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe494141bf0 con 0x7fe4940b5570 2020-10-31T22:50:16.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.709+0000 7fe49887d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49413f930 con 0x7fe494145d10 2020-10-31T22:50:16.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.709+0000 7fe492ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe4940b24a0 0x7fe494145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.720 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.709+0000 7fe492ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe4940b24a0 0x7fe494145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48896/0 (socket says 172.21.15.60:48896) 2020-10-31T22:50:16.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.709+0000 7fe492ffd700 1 -- 172.21.15.60:0/60778499 learned_addr learned my addr 172.21.15.60:0/60778499 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:16.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.709+0000 7fe493fff700 1 --2- 172.21.15.60:0/60778499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe494145d10 0x7fe494141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.721 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.709+0000 7fe4937fe700 1 --2- 172.21.15.60:0/60778499 >> v2:172.21.15.66:3300/0 conn(0x7fe4940b5570 0x7fe4940b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe492ffd700 1 -- 172.21.15.60:0/60778499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe494145d10 msgr2=0x7fe494141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:16.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe492ffd700 1 --2- 172.21.15.60:0/60778499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe494145d10 0x7fe494141fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.722 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe492ffd700 1 -- 172.21.15.60:0/60778499 >> v2:172.21.15.66:3300/0 conn(0x7fe4940b5570 msgr2=0x7fe4940b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:16.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe492ffd700 1 --2- 172.21.15.60:0/60778499 >> v2:172.21.15.66:3300/0 conn(0x7fe4940b5570 0x7fe4940b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.723 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe492ffd700 1 -- 172.21.15.60:0/60778499 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe494145180 con 0x7fe4940b24a0 2020-10-31T22:50:16.725 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe493fff700 1 --2- 172.21.15.60:0/60778499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe494145d10 0x7fe494141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:16.726 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe492ffd700 1 --2- 172.21.15.60:0/60778499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4940b24a0 0x7fe494145820 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fe49405f580 tx=0x7fe484006e80).ready entity=mon.0 client_cookie=4b1304a0eedf0d25 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:16.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe4927fc700 1 -- 172.21.15.60:0/60778499 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe484009600 con 0x7fe4940b24a0 2020-10-31T22:50:16.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe4927fc700 1 -- 172.21.15.60:0/60778499 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484009760 con 0x7fe4940b24a0 2020-10-31T22:50:16.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe4927fc700 1 -- 172.21.15.60:0/60778499 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe484009ac0 con 0x7fe4940b24a0 2020-10-31T22:50:16.727 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe49887d700 1 -- 172.21.15.60:0/60778499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4940b24a0 msgr2=0x7fe494145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.728 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe49887d700 1 --2- 172.21.15.60:0/60778499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4940b24a0 0x7fe494145820 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 rx=0x7fe49405f580 tx=0x7fe484006e80).stop 2020-10-31T22:50:16.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe49887d700 1 -- 172.21.15.60:0/60778499 shutdown_connections 2020-10-31T22:50:16.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe49887d700 1 --2- 172.21.15.60:0/60778499 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe494145d10 0x7fe494141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe49887d700 1 --2- 172.21.15.60:0/60778499 >> v2:172.21.15.66:3300/0 conn(0x7fe4940b5570 0x7fe4940b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe49887d700 1 --2- 172.21.15.60:0/60778499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4940b24a0 0x7fe494145820 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe49887d700 1 -- 172.21.15.60:0/60778499 >> 172.21.15.60:0/60778499 conn(0x7fe4940b8e90 msgr2=0x7fe4940b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe49887d700 1 -- 172.21.15.60:0/60778499 shutdown_connections 2020-10-31T22:50:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe49887d700 1 -- 172.21.15.60:0/60778499 wait complete. 2020-10-31T22:50:16.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe49887d700 1 Processor -- start 2020-10-31T22:50:16.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.713+0000 7fe49887d700 1 -- start start 2020-10-31T22:50:16.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe49887d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4940b24a0 0x7fe494153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe49887d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4940b5570 0x7fe49413de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe49887d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe494145d10 0x7fe494141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe49887d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe494147dc0 con 0x7fe4940b5570 2020-10-31T22:50:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe49887d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe494140dd0 con 0x7fe494145d10 2020-10-31T22:50:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe49887d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4941477c0 con 0x7fe4940b24a0 2020-10-31T22:50:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe492ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4940b5570 0x7fe49413de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.737 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe492ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4940b5570 0x7fe49413de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48904/0 (socket says 172.21.15.60:48904) 2020-10-31T22:50:16.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe492ffd700 1 -- 172.21.15.60:0/735410295 learned_addr learned my addr 172.21.15.60:0/735410295 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:16.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe4937fe700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4940b24a0 0x7fe494153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe493fff700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe494145d10 0x7fe494141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe492ffd700 1 -- 172.21.15.60:0/735410295 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4940b24a0 msgr2=0x7fe494153e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe492ffd700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4940b24a0 0x7fe494153e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe492ffd700 1 -- 172.21.15.60:0/735410295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe494145d10 msgr2=0x7fe494141230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe492ffd700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe494145d10 0x7fe494141230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe492ffd700 1 -- 172.21.15.60:0/735410295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe494140a10 con 0x7fe4940b5570 2020-10-31T22:50:16.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe493fff700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe494145d10 0x7fe494141230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:16.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe492ffd700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4940b5570 0x7fe49413de90 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fe49405f580 tx=0x7fe484015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:16.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe490ff9700 1 -- 172.21.15.60:0/735410295 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe484011ca0 con 0x7fe4940b5570 2020-10-31T22:50:16.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe490ff9700 1 -- 172.21.15.60:0/735410295 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484011e00 con 0x7fe4940b5570 2020-10-31T22:50:16.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe49887d700 1 -- 172.21.15.60:0/735410295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe494147ff0 con 0x7fe4940b5570 2020-10-31T22:50:16.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe490ff9700 1 -- 172.21.15.60:0/735410295 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe48401e650 con 0x7fe4940b5570 2020-10-31T22:50:16.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe49887d700 1 -- 172.21.15.60:0/735410295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4941418c0 con 0x7fe4940b5570 2020-10-31T22:50:16.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe49887d700 1 -- 172.21.15.60:0/735410295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe494057100 con 0x7fe4940b5570 2020-10-31T22:50:16.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.717+0000 7fe490ff9700 1 -- 172.21.15.60:0/735410295 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe484025030 con 0x7fe4940b5570 2020-10-31T22:50:16.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.721+0000 7fe490ff9700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe474054f90 0x7fe474057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:16.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.721+0000 7fe4937fe700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe474054f90 0x7fe474057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:16.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.721+0000 7fe490ff9700 1 -- 172.21.15.60:0/735410295 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe48406eb40 con 0x7fe4940b5570 2020-10-31T22:50:16.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.721+0000 7fe4937fe700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe474054f90 0x7fe474057450 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fe48800b000 tx=0x7fe488006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:16.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.725+0000 7fe490ff9700 1 -- 172.21.15.60:0/735410295 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe484045060 con 0x7fe4940b5570 2020-10-31T22:50:16.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.913+0000 7fe49887d700 1 -- 172.21.15.60:0/735410295 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe49405a8e0 con 0x7fe4940b5570 2020-10-31T22:50:16.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.913+0000 7fe490ff9700 1 -- 172.21.15.60:0/735410295 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2492 (secure 0 0 0) 0x7fe484023020 con 0x7fe4940b5570 2020-10-31T22:50:16.919 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:16.920 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1094853447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1094853447},{"type":"v1","addr":"172.21.15.66:6833","nonce":1094853447}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68},{"gid":7875,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3767660505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3767660505},{"type":"v1","addr":"172.21.15.60:6835","nonce":3767660505}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:14.231864+0000","modified":"2020-10-31T22:50:15.234744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7884":{"gid":7884,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/936802064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":936802064},{"type":"v1","addr":"172.21.15.60:6837","nonce":936802064}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-10-31T22:50:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.917+0000 7fe49887d700 1 -- 172.21.15.60:0/735410295 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe474054f90 msgr2=0x7fe474057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.917+0000 7fe49887d700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe474054f90 0x7fe474057450 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fe48800b000 tx=0x7fe488006dc0).stop 2020-10-31T22:50:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.917+0000 7fe49887d700 1 -- 172.21.15.60:0/735410295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4940b5570 msgr2=0x7fe49413de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:16.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.917+0000 7fe49887d700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4940b5570 0x7fe49413de90 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 rx=0x7fe49405f580 tx=0x7fe484015000).stop 2020-10-31T22:50:16.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.917+0000 7fe49887d700 1 -- 172.21.15.60:0/735410295 shutdown_connections 2020-10-31T22:50:16.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.917+0000 7fe49887d700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe474054f90 0x7fe474057450 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.917+0000 7fe49887d700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe494145d10 0x7fe494141230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.917+0000 7fe49887d700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe4940b24a0 0x7fe494153e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.917+0000 7fe49887d700 1 --2- 172.21.15.60:0/735410295 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe4940b5570 0x7fe49413de90 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:16.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.917+0000 7fe49887d700 1 -- 172.21.15.60:0/735410295 >> 172.21.15.60:0/735410295 conn(0x7fe4940b8e90 msgr2=0x7fe49405f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:16.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.917+0000 7fe49887d700 1 -- 172.21.15.60:0/735410295 shutdown_connections 2020-10-31T22:50:16.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:16.917+0000 7fe49887d700 1 -- 172.21.15.60:0/735410295 wait complete. 2020-10-31T22:50:16.925 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 70 2020-10-31T22:50:17.239 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:50:14.231864+0000', 'modified': '2020-10-31T22:50:15.234744+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7884}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7884': {'gid': 7884, 'name': 'a', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/936802064', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 936802064}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 936802064}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:50:17.240 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:50:17.241 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-10-31T22:50:17.372 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":7884,"want_state":"up:active","state":"up:active","rank_uptime":3.126903268,"mdsmap_epoch":70,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":8.2996939730000001} 2020-10-31T22:50:17.373 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 7884, "mdsmap_epoch": 70, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 3.126903268, "state": "up:active", "uptime": 8.299693973, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:50:17.373 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:50:17.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 Processor -- start 2020-10-31T22:50:17.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 -- start start 2020-10-31T22:50:17.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff51005b960 0x7ff51005bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:17.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5100a7850 0x7ff5100aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:17.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5100b0f00 con 0x7ff5100aefe0 2020-10-31T22:50:17.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5100b11a0 con 0x7ff51005b960 2020-10-31T22:50:17.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100b1440 con 0x7ff5100a7850 2020-10-31T22:50:17.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50ed9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7ff5100aefe0 0x7ff510146790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53050/0 (socket says 172.21.15.60:53050) 2020-10-31T22:50:17.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50ed9d700 1 -- 172.21.15.60:0/3264395814 learned_addr learned my addr 172.21.15.60:0/3264395814 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:17.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50dd9b700 1 --2- 172.21.15.60:0/3264395814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5100a7850 0x7ff5100aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:17.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50e59c700 1 --2- 172.21.15.60:0/3264395814 >> v2:172.21.15.66:3300/0 conn(0x7ff51005b960 0x7ff51005bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:17.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50d59a700 1 -- 172.21.15.60:0/3264395814 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290857589 0 0) 0x7ff5100b0f00 con 0x7ff5100aefe0 2020-10-31T22:50:17.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50d59a700 1 -- 172.21.15.60:0/3264395814 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4f0003230 con 0x7ff5100aefe0 2020-10-31T22:50:17.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50dd9b700 1 -- 172.21.15.60:0/3264395814 >> v2:172.21.15.66:3300/0 conn(0x7ff51005b960 msgr2=0x7ff51005bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:17.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50dd9b700 1 --2- 172.21.15.60:0/3264395814 >> v2:172.21.15.66:3300/0 conn(0x7ff51005b960 0x7ff51005bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50dd9b700 1 -- 172.21.15.60:0/3264395814 >> v1:172.21.15.60:6789/0 conn(0x7ff5100aefe0 legacy=0x7ff510146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:17.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50dd9b700 1 -- 172.21.15.60:0/3264395814 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5101462f0 con 0x7ff5100a7850 2020-10-31T22:50:17.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50e59c700 1 --2- 172.21.15.60:0/3264395814 >> v2:172.21.15.66:3300/0 conn(0x7ff51005b960 0x7ff51005bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:17.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50dd9b700 1 --2- 172.21.15.60:0/3264395814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5100a7850 0x7ff5100aeaf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff5080032b0 tx=0x7ff5080091a0).ready entity=mon.2 client_cookie=ff4364a2c5fe5817 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:17.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50d59a700 1 -- 172.21.15.60:0/3264395814 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff50800b940 con 0x7ff5100a7850 2020-10-31T22:50:17.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50d59a700 1 -- 172.21.15.60:0/3264395814 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50800baa0 con 0x7ff5100a7850 2020-10-31T22:50:17.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff50d59a700 1 -- 172.21.15.60:0/3264395814 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff50800bc10 con 0x7ff5100a7850 2020-10-31T22:50:17.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 -- 172.21.15.60:0/3264395814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5100a7850 msgr2=0x7ff5100aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:17.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 --2- 172.21.15.60:0/3264395814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5100a7850 0x7ff5100aeaf0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7ff5080032b0 tx=0x7ff5080091a0).stop 2020-10-31T22:50:17.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 -- 172.21.15.60:0/3264395814 shutdown_connections 2020-10-31T22:50:17.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 --2- 172.21.15.60:0/3264395814 >> v2:172.21.15.66:3300/0 conn(0x7ff51005b960 0x7ff51005bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 --2- 172.21.15.60:0/3264395814 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5100a7850 0x7ff5100aeaf0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 -- 172.21.15.60:0/3264395814 >> 172.21.15.60:0/3264395814 conn(0x7ff51006a260 msgr2=0x7ff510061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:17.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 -- 172.21.15.60:0/3264395814 shutdown_connections 2020-10-31T22:50:17.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.481+0000 7ff514a26700 1 -- 172.21.15.60:0/3264395814 wait complete. 2020-10-31T22:50:17.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff514a26700 1 Processor -- start 2020-10-31T22:50:17.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff514a26700 1 -- start start 2020-10-31T22:50:17.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff514a26700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51005b960 0x7ff5100a9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:17.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff514a26700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5100a7850 0x7ff51014c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:17.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff514a26700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5100ade10 0x7ff51014cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:17.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff514a26700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100ac3b0 con 0x7ff5100ade10 2020-10-31T22:50:17.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff514a26700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51014bda0 con 0x7ff51005b960 2020-10-31T22:50:17.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff514a26700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100ae2d0 con 0x7ff5100a7850 2020-10-31T22:50:17.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff50ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5100ade10 0x7ff51014cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:17.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff50dd9b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5100a7850 0x7ff51014c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:17.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff50ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5100ade10 0x7ff51014cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48920/0 (socket says 172.21.15.60:48920) 2020-10-31T22:50:17.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff50ed9d700 1 -- 172.21.15.60:0/1117444210 learned_addr learned my addr 172.21.15.60:0/1117444210 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:17.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff50e59c700 1 --2- 172.21.15.60:0/1117444210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51005b960 0x7ff5100a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:17.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff50ed9d700 1 -- 172.21.15.60:0/1117444210 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5100a7850 msgr2=0x7ff51014c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:17.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff50ed9d700 1 --2- 172.21.15.60:0/1117444210 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5100a7850 0x7ff51014c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff50ed9d700 1 -- 172.21.15.60:0/1117444210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51005b960 msgr2=0x7ff5100a9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:17.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff50ed9d700 1 --2- 172.21.15.60:0/1117444210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51005b960 0x7ff5100a9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff50ed9d700 1 -- 172.21.15.60:0/1117444210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51014bfd0 con 0x7ff5100ade10 2020-10-31T22:50:17.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.485+0000 7ff50ed9d700 1 --2- 172.21.15.60:0/1117444210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5100ade10 0x7ff51014cc00 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7ff5100ac1d0 tx=0x7ff4f80079b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:17.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.489+0000 7ff5077fe700 1 -- 172.21.15.60:0/1117444210 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4f80072e0 con 0x7ff5100ade10 2020-10-31T22:50:17.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.489+0000 7ff5077fe700 1 -- 172.21.15.60:0/1117444210 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f8007440 con 0x7ff5100ade10 2020-10-31T22:50:17.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.489+0000 7ff514a26700 1 -- 172.21.15.60:0/1117444210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff51014c270 con 0x7ff5100ade10 2020-10-31T22:50:17.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.489+0000 7ff5077fe700 1 -- 172.21.15.60:0/1117444210 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff4f80057d0 con 0x7ff5100ade10 2020-10-31T22:50:17.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.489+0000 7ff514a26700 1 -- 172.21.15.60:0/1117444210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51014b9a0 con 0x7ff5100ade10 2020-10-31T22:50:17.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.489+0000 7ff514a26700 1 -- 172.21.15.60:0/1117444210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff510057100 con 0x7ff5100ade10 2020-10-31T22:50:17.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.489+0000 7ff5077fe700 1 -- 172.21.15.60:0/1117444210 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff4f801a060 con 0x7ff5100ade10 2020-10-31T22:50:17.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.489+0000 7ff5077fe700 1 --2- 172.21.15.60:0/1117444210 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff4f4054f90 0x7ff4f4057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:17.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.489+0000 7ff5077fe700 1 -- 172.21.15.60:0/1117444210 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff4f806ccf0 con 0x7ff5100ade10 2020-10-31T22:50:17.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.489+0000 7ff50e59c700 1 --2- 172.21.15.60:0/1117444210 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff4f4054f90 0x7ff4f4057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:17.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.489+0000 7ff50e59c700 1 --2- 172.21.15.60:0/1117444210 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff4f4054f90 0x7ff4f4057450 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7ff50000b000 tx=0x7ff500006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:17.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.497+0000 7ff5077fe700 1 -- 172.21.15.60:0/1117444210 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff4f8043210 con 0x7ff5100ade10 2020-10-31T22:50:17.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.641+0000 7ff514a26700 1 -- 172.21.15.60:0/1117444210 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff51014c400 con 0x7ff5100ade10 2020-10-31T22:50:17.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.645+0000 7ff5077fe700 1 -- 172.21.15.60:0/1117444210 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16052 (secure 0 0 0) 0x7ff4f8018070 con 0x7ff5100ade10 2020-10-31T22:50:17.650 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:17.651 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":139,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:50:15.235473+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:50:11.956893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-10-31T22:50:13.235442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:50:17.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.645+0000 7ff514a26700 1 -- 172.21.15.60:0/1117444210 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff4f4054f90 msgr2=0x7ff4f4057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:17.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.645+0000 7ff514a26700 1 --2- 172.21.15.60:0/1117444210 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff4f4054f90 0x7ff4f4057450 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7ff50000b000 tx=0x7ff500006dc0).stop 2020-10-31T22:50:17.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.645+0000 7ff514a26700 1 -- 172.21.15.60:0/1117444210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5100ade10 msgr2=0x7ff51014cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:17.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.645+0000 7ff514a26700 1 --2- 172.21.15.60:0/1117444210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5100ade10 0x7ff51014cc00 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 rx=0x7ff5100ac1d0 tx=0x7ff4f80079b0).stop 2020-10-31T22:50:17.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.645+0000 7ff514a26700 1 -- 172.21.15.60:0/1117444210 shutdown_connections 2020-10-31T22:50:17.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.645+0000 7ff514a26700 1 --2- 172.21.15.60:0/1117444210 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff5100ade10 0x7ff51014cc00 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.645+0000 7ff514a26700 1 --2- 172.21.15.60:0/1117444210 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff4f4054f90 0x7ff4f4057450 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.645+0000 7ff514a26700 1 --2- 172.21.15.60:0/1117444210 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff51005b960 0x7ff5100a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.645+0000 7ff514a26700 1 --2- 172.21.15.60:0/1117444210 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff5100a7850 0x7ff51014c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.645+0000 7ff514a26700 1 -- 172.21.15.60:0/1117444210 >> 172.21.15.60:0/1117444210 conn(0x7ff51006a260 msgr2=0x7ff510148020 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:17.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.645+0000 7ff514a26700 1 -- 172.21.15.60:0/1117444210 shutdown_connections 2020-10-31T22:50:17.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.645+0000 7ff514a26700 1 -- 172.21.15.60:0/1117444210 wait complete. 2020-10-31T22:50:17.664 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:50:11.956893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:50:13.235442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:50:17.665 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:50:17.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd9124700 1 Processor -- start 2020-10-31T22:50:17.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd9124700 1 -- start start 2020-10-31T22:50:17.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd9124700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4fd40ac010 0x7f4fd40662f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:17.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd9124700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4fd40a7580 0x7f4fd40667e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:17.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd9124700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd40ae970 0x7f4fd41423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:17.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd9124700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd40ac3f0 con 0x7f4fd40ac010 2020-10-31T22:50:17.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd9124700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fd4145e50 con 0x7f4fd40a7580 2020-10-31T22:50:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd9124700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4065e50 con 0x7f4fd40ae970 2020-10-31T22:50:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4fd40ac010 0x7f4fd40662f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4fd40ac010 0x7f4fd40662f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48924/0 (socket says 172.21.15.60:48924) 2020-10-31T22:50:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd3fff700 1 -- 172.21.15.60:0/4125151186 learned_addr learned my addr 172.21.15.60:0/4125151186 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd8923700 1 --2- 172.21.15.60:0/4125151186 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd40ae970 0x7f4fd41423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd37fe700 1 --2- 172.21.15.60:0/4125151186 >> v2:172.21.15.66:3300/0 conn(0x7f4fd40a7580 0x7f4fd40667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:17.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd3fff700 1 -- 172.21.15.60:0/4125151186 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd40ae970 msgr2=0x7f4fd41423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:17.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd3fff700 1 --2- 172.21.15.60:0/4125151186 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd40ae970 0x7f4fd41423b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd3fff700 1 -- 172.21.15.60:0/4125151186 >> v2:172.21.15.66:3300/0 conn(0x7f4fd40a7580 msgr2=0x7f4fd40667e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:17.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd3fff700 1 --2- 172.21.15.60:0/4125151186 >> v2:172.21.15.66:3300/0 conn(0x7f4fd40a7580 0x7f4fd40667e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd3fff700 1 -- 172.21.15.60:0/4125151186 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd4145b50 con 0x7f4fd40ac010 2020-10-31T22:50:17.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd3fff700 1 --2- 172.21.15.60:0/4125151186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd40ac010 0x7f4fd40662f0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f4fc40032b0 tx=0x7f4fc4009220).ready entity=mon.0 client_cookie=73e6d2e39ea51f64 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:17.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd2ffd700 1 -- 172.21.15.60:0/4125151186 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fc400ba50 con 0x7f4fd40ac010 2020-10-31T22:50:17.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd2ffd700 1 -- 172.21.15.60:0/4125151186 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc400bbb0 con 0x7f4fd40ac010 2020-10-31T22:50:17.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd2ffd700 1 -- 172.21.15.60:0/4125151186 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fc400bd20 con 0x7f4fd40ac010 2020-10-31T22:50:17.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd9124700 1 -- 172.21.15.60:0/4125151186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd40ac010 msgr2=0x7f4fd40662f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:17.787 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.777+0000 7f4fd9124700 1 --2- 172.21.15.60:0/4125151186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd40ac010 0x7f4fd40662f0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 rx=0x7f4fc40032b0 tx=0x7f4fc4009220).stop 2020-10-31T22:50:17.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.781+0000 7f4fd9124700 1 -- 172.21.15.60:0/4125151186 shutdown_connections 2020-10-31T22:50:17.788 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.781+0000 7f4fd9124700 1 --2- 172.21.15.60:0/4125151186 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd40ae970 0x7f4fd41423b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.781+0000 7f4fd9124700 1 --2- 172.21.15.60:0/4125151186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd40ac010 0x7f4fd40662f0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.781+0000 7f4fd9124700 1 --2- 172.21.15.60:0/4125151186 >> v2:172.21.15.66:3300/0 conn(0x7f4fd40a7580 0x7f4fd40667e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.781+0000 7f4fd9124700 1 -- 172.21.15.60:0/4125151186 >> 172.21.15.60:0/4125151186 conn(0x7f4fd40b3fd0 msgr2=0x7f4fd40b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:17.789 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.781+0000 7f4fd9124700 1 -- 172.21.15.60:0/4125151186 shutdown_connections 2020-10-31T22:50:17.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.781+0000 7f4fd9124700 1 -- 172.21.15.60:0/4125151186 wait complete. 2020-10-31T22:50:17.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.781+0000 7f4fd9124700 1 Processor -- start 2020-10-31T22:50:17.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.781+0000 7f4fd9124700 1 -- start start 2020-10-31T22:50:17.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd9124700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd40a7580 0x7f4fd4141930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:17.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd9124700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fd40ac010 0x7f4fd40a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:17.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd9124700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd40ae970 0x7f4fd4154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:17.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd9124700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd4142bc0 con 0x7f4fd40a7580 2020-10-31T22:50:17.792 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd9124700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd40a9c90 con 0x7f4fd40ac010 2020-10-31T22:50:17.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd9124700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fd41513d0 con 0x7f4fd40ae970 2020-10-31T22:50:17.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd40a7580 0x7f4fd4141930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:17.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd40a7580 0x7f4fd4141930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48930/0 (socket says 172.21.15.60:48930) 2020-10-31T22:50:17.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd3fff700 1 -- 172.21.15.60:0/3723602373 learned_addr learned my addr 172.21.15.60:0/3723602373 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:17.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd8923700 1 --2- 172.21.15.60:0/3723602373 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd40ae970 0x7f4fd4154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:17.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd37fe700 1 --2- 172.21.15.60:0/3723602373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fd40ac010 0x7f4fd40a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:17.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd3fff700 1 -- 172.21.15.60:0/3723602373 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd40ae970 msgr2=0x7f4fd4154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:17.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd3fff700 1 --2- 172.21.15.60:0/3723602373 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd40ae970 0x7f4fd4154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd3fff700 1 -- 172.21.15.60:0/3723602373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fd40ac010 msgr2=0x7f4fd40a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:17.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd3fff700 1 --2- 172.21.15.60:0/3723602373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fd40ac010 0x7f4fd40a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd3fff700 1 -- 172.21.15.60:0/3723602373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd4151670 con 0x7f4fd40a7580 2020-10-31T22:50:17.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd3fff700 1 --2- 172.21.15.60:0/3723602373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd40a7580 0x7f4fd4141930 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f4fc40032b0 tx=0x7f4fc4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:17.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd17fa700 1 -- 172.21.15.60:0/3723602373 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fc4006890 con 0x7f4fd40a7580 2020-10-31T22:50:17.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd17fa700 1 -- 172.21.15.60:0/3723602373 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc401f420 con 0x7f4fd40a7580 2020-10-31T22:50:17.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd9124700 1 -- 172.21.15.60:0/3723602373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fd4154040 con 0x7f4fd40a7580 2020-10-31T22:50:17.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd17fa700 1 -- 172.21.15.60:0/3723602373 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4fc401f780 con 0x7f4fd40a7580 2020-10-31T22:50:17.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.785+0000 7f4fd9124700 1 -- 172.21.15.60:0/3723602373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fd4154c70 con 0x7f4fd40a7580 2020-10-31T22:50:17.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.789+0000 7f4fd9124700 1 -- 172.21.15.60:0/3723602373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fd4151800 con 0x7f4fd40a7580 2020-10-31T22:50:17.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.789+0000 7f4fd17fa700 1 -- 172.21.15.60:0/3723602373 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4fc4026030 con 0x7f4fd40a7580 2020-10-31T22:50:17.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.789+0000 7f4fd17fa700 1 --2- 172.21.15.60:0/3723602373 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4fb8054fd0 0x7f4fb8057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:17.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.789+0000 7f4fd17fa700 1 -- 172.21.15.60:0/3723602373 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4fc406e620 con 0x7f4fd40a7580 2020-10-31T22:50:17.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.789+0000 7f4fd37fe700 1 --2- 172.21.15.60:0/3723602373 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4fb8054fd0 0x7f4fb8057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:17.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.789+0000 7f4fd37fe700 1 --2- 172.21.15.60:0/3723602373 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4fb8054fd0 0x7f4fb8057490 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f4fbc00c000 tx=0x7f4fbc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:17.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.797+0000 7f4fd17fa700 1 -- 172.21.15.60:0/3723602373 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4fc4044bf0 con 0x7f4fd40a7580 2020-10-31T22:50:17.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.937+0000 7f4fd9124700 1 -- 172.21.15.60:0/3723602373 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4fd4057100 con 0x7f4fd40a7580 2020-10-31T22:50:17.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.937+0000 7f4fd17fa700 1 -- 172.21.15.60:0/3723602373 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v139) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4fc4024020 con 0x7f4fd40a7580 2020-10-31T22:50:17.944 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:50:17.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.941+0000 7f4fd9124700 1 -- 172.21.15.60:0/3723602373 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4fb8054fd0 msgr2=0x7f4fb8057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:17.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.941+0000 7f4fd9124700 1 --2- 172.21.15.60:0/3723602373 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4fb8054fd0 0x7f4fb8057490 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f4fbc00c000 tx=0x7f4fbc008040).stop 2020-10-31T22:50:17.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.941+0000 7f4fd9124700 1 -- 172.21.15.60:0/3723602373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd40a7580 msgr2=0x7f4fd4141930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:17.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.941+0000 7f4fd9124700 1 --2- 172.21.15.60:0/3723602373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd40a7580 0x7f4fd4141930 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 rx=0x7f4fc40032b0 tx=0x7f4fc4016000).stop 2020-10-31T22:50:17.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.941+0000 7f4fd9124700 1 -- 172.21.15.60:0/3723602373 shutdown_connections 2020-10-31T22:50:17.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.941+0000 7f4fd9124700 1 --2- 172.21.15.60:0/3723602373 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4fd40ae970 0x7f4fd4154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.941+0000 7f4fd9124700 1 --2- 172.21.15.60:0/3723602373 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4fd40a7580 0x7f4fd4141930 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.941+0000 7f4fd9124700 1 --2- 172.21.15.60:0/3723602373 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4fb8054fd0 0x7f4fb8057490 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.941+0000 7f4fd9124700 1 --2- 172.21.15.60:0/3723602373 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4fd40ac010 0x7f4fd40a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.941+0000 7f4fd9124700 1 -- 172.21.15.60:0/3723602373 >> 172.21.15.60:0/3723602373 conn(0x7f4fd40b3fd0 msgr2=0x7f4fd40acda0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.941+0000 7f4fd9124700 1 -- 172.21.15.60:0/3723602373 shutdown_connections 2020-10-31T22:50:17.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:17.941+0000 7f4fd9124700 1 -- 172.21.15.60:0/3723602373 wait complete. 2020-10-31T22:50:17.958 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:50:18.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.069+0000 7f5db759e700 1 Processor -- start 2020-10-31T22:50:18.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.069+0000 7f5db759e700 1 -- start start 2020-10-31T22:50:18.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5db80b5570 0x7f5db80b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5db80b24a0 0x7f5db8145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5db80b4440 con 0x7f5db8145e40 2020-10-31T22:50:18.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5db813f930 con 0x7f5db80b24a0 2020-10-31T22:50:18.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db80b02f0 con 0x7f5db80b5570 2020-10-31T22:50:18.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db5d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5db80b24a0 0x7f5db8145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db6d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5db8145e40 0x7f5db8141f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53078/0 (socket says 172.21.15.60:53078) 2020-10-31T22:50:18.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db6d9d700 1 -- 172.21.15.60:0/2218703343 learned_addr learned my addr 172.21.15.60:0/2218703343 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:18.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db659c700 1 --2- 172.21.15.60:0/2218703343 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5db80b5570 0x7f5db80b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db559a700 1 -- 172.21.15.60:0/2218703343 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076299565 0 0) 0x7f5db80b4440 con 0x7f5db8145e40 2020-10-31T22:50:18.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db559a700 1 -- 172.21.15.60:0/2218703343 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d9c003230 con 0x7f5db8145e40 2020-10-31T22:50:18.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db5d9b700 1 -- 172.21.15.60:0/2218703343 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5db80b5570 msgr2=0x7f5db80b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:18.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db5d9b700 1 --2- 172.21.15.60:0/2218703343 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5db80b5570 0x7f5db80b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db5d9b700 1 -- 172.21.15.60:0/2218703343 >> v1:172.21.15.60:6789/0 conn(0x7f5db8145e40 legacy=0x7f5db8141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db5d9b700 1 -- 172.21.15.60:0/2218703343 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db80b0590 con 0x7f5db80b24a0 2020-10-31T22:50:18.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db659c700 1 --2- 172.21.15.60:0/2218703343 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5db80b5570 0x7f5db80b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:18.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db5d9b700 1 --2- 172.21.15.60:0/2218703343 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db80b24a0 0x7f5db8145950 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f5db8141c20 tx=0x7f5dac006dc0).ready entity=mon.0 client_cookie=7a6046ec24214ba3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:18.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db559a700 1 -- 172.21.15.60:0/2218703343 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dac009720 con 0x7f5db80b24a0 2020-10-31T22:50:18.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db559a700 1 -- 172.21.15.60:0/2218703343 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dac009880 con 0x7f5db80b24a0 2020-10-31T22:50:18.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db559a700 1 -- 172.21.15.60:0/2218703343 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5dac009be0 con 0x7f5db80b24a0 2020-10-31T22:50:18.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db759e700 1 -- 172.21.15.60:0/2218703343 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db80b24a0 msgr2=0x7f5db8145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db759e700 1 --2- 172.21.15.60:0/2218703343 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db80b24a0 0x7f5db8145950 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 rx=0x7f5db8141c20 tx=0x7f5dac006dc0).stop 2020-10-31T22:50:18.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db759e700 1 -- 172.21.15.60:0/2218703343 shutdown_connections 2020-10-31T22:50:18.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db759e700 1 --2- 172.21.15.60:0/2218703343 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5db80b5570 0x7f5db80b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db759e700 1 --2- 172.21.15.60:0/2218703343 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db80b24a0 0x7f5db8145950 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db759e700 1 -- 172.21.15.60:0/2218703343 >> 172.21.15.60:0/2218703343 conn(0x7f5db80b8e90 msgr2=0x7f5db80b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db759e700 1 -- 172.21.15.60:0/2218703343 shutdown_connections 2020-10-31T22:50:18.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.073+0000 7f5db759e700 1 -- 172.21.15.60:0/2218703343 wait complete. 2020-10-31T22:50:18.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db759e700 1 Processor -- start 2020-10-31T22:50:18.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db759e700 1 -- start start 2020-10-31T22:50:18.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db80b24a0 0x7f5db8144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5db80b5570 0x7f5db8150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db8145e40 0x7f5db81513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db81490e0 con 0x7f5db80b24a0 2020-10-31T22:50:18.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db8146f10 con 0x7f5db8145e40 2020-10-31T22:50:18.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5db81471b0 con 0x7f5db80b5570 2020-10-31T22:50:18.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db80b24a0 0x7f5db8144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db80b24a0 0x7f5db8144aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48944/0 (socket says 172.21.15.60:48944) 2020-10-31T22:50:18.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db659c700 1 -- 172.21.15.60:0/1335133629 learned_addr learned my addr 172.21.15.60:0/1335133629 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:18.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db6d9d700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db8145e40 0x7f5db81513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db5d9b700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5db80b5570 0x7f5db8150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db659c700 1 -- 172.21.15.60:0/1335133629 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5db80b5570 msgr2=0x7f5db8150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db659c700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5db80b5570 0x7f5db8150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db659c700 1 -- 172.21.15.60:0/1335133629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db8145e40 msgr2=0x7f5db81513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db659c700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db8145e40 0x7f5db81513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db659c700 1 -- 172.21.15.60:0/1335133629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db8146c10 con 0x7f5db80b24a0 2020-10-31T22:50:18.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db6d9d700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db8145e40 0x7f5db81513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:18.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db659c700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db80b24a0 0x7f5db8144aa0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f5da8006dd0 tx=0x7f5da8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:18.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5da77fe700 1 -- 172.21.15.60:0/1335133629 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5da800cad0 con 0x7f5db80b24a0 2020-10-31T22:50:18.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db759e700 1 -- 172.21.15.60:0/1335133629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db8148d60 con 0x7f5db80b24a0 2020-10-31T22:50:18.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5da77fe700 1 -- 172.21.15.60:0/1335133629 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5da800cc30 con 0x7f5db80b24a0 2020-10-31T22:50:18.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5da77fe700 1 -- 172.21.15.60:0/1335133629 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5da8013430 con 0x7f5db80b24a0 2020-10-31T22:50:18.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.077+0000 7f5db759e700 1 -- 172.21.15.60:0/1335133629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db80af030 con 0x7f5db80b24a0 2020-10-31T22:50:18.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.081+0000 7f5db759e700 1 -- 172.21.15.60:0/1335133629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5db8147370 con 0x7f5db80b24a0 2020-10-31T22:50:18.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.081+0000 7f5da77fe700 1 -- 172.21.15.60:0/1335133629 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5da8013590 con 0x7f5db80b24a0 2020-10-31T22:50:18.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.081+0000 7f5da77fe700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5d94054f10 0x7f5d940573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.081+0000 7f5da77fe700 1 -- 172.21.15.60:0/1335133629 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5da806e060 con 0x7f5db80b24a0 2020-10-31T22:50:18.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.081+0000 7f5db5d9b700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5d94054f10 0x7f5d940573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.081+0000 7f5db5d9b700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5d94054f10 0x7f5d940573d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f5dac019000 tx=0x7f5dac015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:18.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.089+0000 7f5da77fe700 1 -- 172.21.15.60:0/1335133629 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5da8044480 con 0x7f5db80b24a0 2020-10-31T22:50:18.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.233+0000 7f5db759e700 1 -- 172.21.15.60:0/1335133629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5db8057100 con 0x7f5db80b24a0 2020-10-31T22:50:18.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.233+0000 7f5da77fe700 1 -- 172.21.15.60:0/1335133629 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5da8047aa0 con 0x7f5db80b24a0 2020-10-31T22:50:18.239 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:18.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.233+0000 7f5db759e700 1 -- 172.21.15.60:0/1335133629 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5d94054f10 msgr2=0x7f5d940573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.233+0000 7f5db759e700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5d94054f10 0x7f5d940573d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f5dac019000 tx=0x7f5dac015000).stop 2020-10-31T22:50:18.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.233+0000 7f5db759e700 1 -- 172.21.15.60:0/1335133629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db80b24a0 msgr2=0x7f5db8144aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.233+0000 7f5db759e700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db80b24a0 0x7f5db8144aa0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 rx=0x7f5da8006dd0 tx=0x7f5da8008040).stop 2020-10-31T22:50:18.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.233+0000 7f5db759e700 1 -- 172.21.15.60:0/1335133629 shutdown_connections 2020-10-31T22:50:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.233+0000 7f5db759e700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5d94054f10 0x7f5d940573d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.233+0000 7f5db759e700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5db8145e40 0x7f5db81513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.233+0000 7f5db759e700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5db80b24a0 0x7f5db8144aa0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.233+0000 7f5db759e700 1 --2- 172.21.15.60:0/1335133629 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5db80b5570 0x7f5db8150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.233+0000 7f5db759e700 1 -- 172.21.15.60:0/1335133629 >> 172.21.15.60:0/1335133629 conn(0x7f5db80b8e90 msgr2=0x7f5db80659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:18.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.233+0000 7f5db759e700 1 -- 172.21.15.60:0/1335133629 shutdown_connections 2020-10-31T22:50:18.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.233+0000 7f5db759e700 1 -- 172.21.15.60:0/1335133629 wait complete. 2020-10-31T22:50:18.251 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:50:18.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e8eebd700 1 Processor -- start 2020-10-31T22:50:18.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e8eebd700 1 -- start start 2020-10-31T22:50:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e8eebd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e8805afe0 0x7f4e880aead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e8eebd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4e880aefc0 0x7f4e8814c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e8eebd700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e880631f0 con 0x7f4e88062e10 2020-10-31T22:50:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e8eebd700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e880b1840 con 0x7f4e880aefc0 2020-10-31T22:50:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e8eebd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e881454d0 con 0x7f4e8805afe0 2020-10-31T22:50:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e8cc59700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f4e88062e10 0x7f4e880afbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53088/0 (socket says 172.21.15.60:53088) 2020-10-31T22:50:18.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e8cc59700 1 -- 172.21.15.60:0/440217826 learned_addr learned my addr 172.21.15.60:0/440217826 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e8d45a700 1 --2- 172.21.15.60:0/440217826 >> v2:172.21.15.66:3300/0 conn(0x7f4e880aefc0 0x7f4e8814c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e87fff700 1 --2- 172.21.15.60:0/440217826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e8805afe0 0x7f4e880aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e877fe700 1 -- 172.21.15.60:0/440217826 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223829386 0 0) 0x7f4e880631f0 con 0x7f4e88062e10 2020-10-31T22:50:18.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e877fe700 1 -- 172.21.15.60:0/440217826 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e6c003230 con 0x7f4e88062e10 2020-10-31T22:50:18.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e877fe700 1 -- 172.21.15.60:0/440217826 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 667125588 0 0) 0x7f4e6c003230 con 0x7f4e88062e10 2020-10-31T22:50:18.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e87fff700 1 -- 172.21.15.60:0/440217826 >> v2:172.21.15.66:3300/0 conn(0x7f4e880aefc0 msgr2=0x7f4e8814c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:18.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e87fff700 1 --2- 172.21.15.60:0/440217826 >> v2:172.21.15.66:3300/0 conn(0x7f4e880aefc0 0x7f4e8814c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e87fff700 1 -- 172.21.15.60:0/440217826 >> v1:172.21.15.60:6789/0 conn(0x7f4e88062e10 legacy=0x7f4e880afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e87fff700 1 -- 172.21.15.60:0/440217826 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e88145770 con 0x7f4e8805afe0 2020-10-31T22:50:18.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e8d45a700 1 --2- 172.21.15.60:0/440217826 >> v2:172.21.15.66:3300/0 conn(0x7f4e880aefc0 0x7f4e8814c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:18.378 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.369+0000 7f4e87fff700 1 --2- 172.21.15.60:0/440217826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e8805afe0 0x7f4e880aead0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f4e7c001870 tx=0x7f4e74006dc0).ready entity=mon.2 client_cookie=6fd20f7fd0a8b5f2 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:18.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.373+0000 7f4e877fe700 1 -- 172.21.15.60:0/440217826 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7c0016d0 con 0x7f4e8805afe0 2020-10-31T22:50:18.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.373+0000 7f4e877fe700 1 -- 172.21.15.60:0/440217826 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7400d570 con 0x7f4e8805afe0 2020-10-31T22:50:18.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.373+0000 7f4e877fe700 1 -- 172.21.15.60:0/440217826 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7400d6e0 con 0x7f4e8805afe0 2020-10-31T22:50:18.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.373+0000 7f4e8eebd700 1 -- 172.21.15.60:0/440217826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e8805afe0 msgr2=0x7f4e880aead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.373+0000 7f4e8eebd700 1 --2- 172.21.15.60:0/440217826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e8805afe0 0x7f4e880aead0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f4e7c001870 tx=0x7f4e74006dc0).stop 2020-10-31T22:50:18.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.373+0000 7f4e8eebd700 1 -- 172.21.15.60:0/440217826 shutdown_connections 2020-10-31T22:50:18.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.373+0000 7f4e8eebd700 1 --2- 172.21.15.60:0/440217826 >> v2:172.21.15.66:3300/0 conn(0x7f4e880aefc0 0x7f4e8814c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.373+0000 7f4e8eebd700 1 --2- 172.21.15.60:0/440217826 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e8805afe0 0x7f4e880aead0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.373+0000 7f4e8eebd700 1 -- 172.21.15.60:0/440217826 >> 172.21.15.60:0/440217826 conn(0x7f4e8805fae0 msgr2=0x7f4e8805fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:18.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.373+0000 7f4e8eebd700 1 -- 172.21.15.60:0/440217826 shutdown_connections 2020-10-31T22:50:18.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.373+0000 7f4e8eebd700 1 -- 172.21.15.60:0/440217826 wait complete. 2020-10-31T22:50:18.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.373+0000 7f4e8eebd700 1 Processor -- start 2020-10-31T22:50:18.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.373+0000 7f4e8eebd700 1 -- start start 2020-10-31T22:50:18.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e8eebd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e8805afe0 0x7f4e88148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e8eebd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e88062e10 0x7f4e88154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e8eebd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e880aefc0 0x7f4e88154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e8eebd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e88063970 con 0x7f4e88062e10 2020-10-31T22:50:18.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e8eebd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e88063c10 con 0x7f4e8805afe0 2020-10-31T22:50:18.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e8eebd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e881543b0 con 0x7f4e880aefc0 2020-10-31T22:50:18.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e87fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e88062e10 0x7f4e88154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e8cc59700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e8805afe0 0x7f4e88148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e87fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e88062e10 0x7f4e88154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48960/0 (socket says 172.21.15.60:48960) 2020-10-31T22:50:18.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e87fff700 1 -- 172.21.15.60:0/1539950096 learned_addr learned my addr 172.21.15.60:0/1539950096 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:18.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e8cc59700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e8805afe0 0x7f4e88148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:59894/0 (socket says 172.21.15.60:59894) 2020-10-31T22:50:18.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e8d45a700 1 --2- 172.21.15.60:0/1539950096 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e880aefc0 0x7f4e88154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e87fff700 1 -- 172.21.15.60:0/1539950096 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e880aefc0 msgr2=0x7f4e88154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e87fff700 1 --2- 172.21.15.60:0/1539950096 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e880aefc0 0x7f4e88154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e87fff700 1 -- 172.21.15.60:0/1539950096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e8805afe0 msgr2=0x7f4e88148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e87fff700 1 --2- 172.21.15.60:0/1539950096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e8805afe0 0x7f4e88148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e87fff700 1 -- 172.21.15.60:0/1539950096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e88066e30 con 0x7f4e88062e10 2020-10-31T22:50:18.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e8d45a700 1 --2- 172.21.15.60:0/1539950096 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e880aefc0 0x7f4e88154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:18.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e87fff700 1 --2- 172.21.15.60:0/1539950096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e88062e10 0x7f4e88154850 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f4e7c001870 tx=0x7f4e74015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:18.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e85ffb700 1 -- 172.21.15.60:0/1539950096 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e74011a10 con 0x7f4e88062e10 2020-10-31T22:50:18.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e85ffb700 1 -- 172.21.15.60:0/1539950096 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e74011b70 con 0x7f4e88062e10 2020-10-31T22:50:18.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e8eebd700 1 -- 172.21.15.60:0/1539950096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e88067130 con 0x7f4e88062e10 2020-10-31T22:50:18.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e85ffb700 1 -- 172.21.15.60:0/1539950096 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4e7401d480 con 0x7f4e88062e10 2020-10-31T22:50:18.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e8eebd700 1 -- 172.21.15.60:0/1539950096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e88149290 con 0x7f4e88062e10 2020-10-31T22:50:18.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.377+0000 7f4e8eebd700 1 -- 172.21.15.60:0/1539950096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e8805a870 con 0x7f4e88062e10 2020-10-31T22:50:18.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.381+0000 7f4e85ffb700 1 -- 172.21.15.60:0/1539950096 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4e74024030 con 0x7f4e88062e10 2020-10-31T22:50:18.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.381+0000 7f4e85ffb700 1 --2- 172.21.15.60:0/1539950096 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4e70054f10 0x7f4e700573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.381+0000 7f4e8cc59700 1 --2- 172.21.15.60:0/1539950096 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4e70054f10 0x7f4e700573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.381+0000 7f4e85ffb700 1 -- 172.21.15.60:0/1539950096 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4e7406e530 con 0x7f4e88062e10 2020-10-31T22:50:18.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.381+0000 7f4e8cc59700 1 --2- 172.21.15.60:0/1539950096 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4e70054f10 0x7f4e700573d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f4e7c00d000 tx=0x7f4e7c001e50).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:18.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.385+0000 7f4e85ffb700 1 -- 172.21.15.60:0/1539950096 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4e8805a870 con 0x7f4e88062e10 2020-10-31T22:50:18.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.529+0000 7f4e8eebd700 1 -- 172.21.15.60:0/1539950096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e8805a870 con 0x7f4e88062e10 2020-10-31T22:50:18.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.529+0000 7f4e85ffb700 1 -- 172.21.15.60:0/1539950096 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v139) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4e8805a870 con 0x7f4e88062e10 2020-10-31T22:50:18.536 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:18.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.529+0000 7f4e8eebd700 1 -- 172.21.15.60:0/1539950096 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4e70054f10 msgr2=0x7f4e700573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.529+0000 7f4e8eebd700 1 --2- 172.21.15.60:0/1539950096 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4e70054f10 0x7f4e700573d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f4e7c00d000 tx=0x7f4e7c001e50).stop 2020-10-31T22:50:18.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.529+0000 7f4e8eebd700 1 -- 172.21.15.60:0/1539950096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e88062e10 msgr2=0x7f4e88154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.529+0000 7f4e8eebd700 1 --2- 172.21.15.60:0/1539950096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e88062e10 0x7f4e88154850 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 rx=0x7f4e7c001870 tx=0x7f4e74015000).stop 2020-10-31T22:50:18.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.529+0000 7f4e8eebd700 1 -- 172.21.15.60:0/1539950096 shutdown_connections 2020-10-31T22:50:18.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.529+0000 7f4e8eebd700 1 --2- 172.21.15.60:0/1539950096 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4e880aefc0 0x7f4e88154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.529+0000 7f4e8eebd700 1 --2- 172.21.15.60:0/1539950096 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4e70054f10 0x7f4e700573d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.529+0000 7f4e8eebd700 1 --2- 172.21.15.60:0/1539950096 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4e8805afe0 0x7f4e88148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.529+0000 7f4e8eebd700 1 --2- 172.21.15.60:0/1539950096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4e88062e10 0x7f4e88154850 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.529+0000 7f4e8eebd700 1 -- 172.21.15.60:0/1539950096 >> 172.21.15.60:0/1539950096 conn(0x7f4e8805fae0 msgr2=0x7f4e880ab060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.533+0000 7f4e8eebd700 1 -- 172.21.15.60:0/1539950096 shutdown_connections 2020-10-31T22:50:18.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.533+0000 7f4e8eebd700 1 -- 172.21.15.60:0/1539950096 wait complete. 2020-10-31T22:50:18.548 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:50:18.668 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe818ed0700 1 Processor -- start 2020-10-31T22:50:18.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe818ed0700 1 -- start start 2020-10-31T22:50:18.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe818ed0700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe8140af520 0x7fe8140ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe818ed0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8140670f0 0x7fe814150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe818ed0700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8140af900 con 0x7fe814066c90 2020-10-31T22:50:18.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe818ed0700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8140afc10 con 0x7fe8140af520 2020-10-31T22:50:18.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe818ed0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81405bb70 con 0x7fe8140670f0 2020-10-31T22:50:18.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe812ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe814066c90 0x7fe814146060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53102/0 (socket says 172.21.15.60:53102) 2020-10-31T22:50:18.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe812ffd700 1 -- 172.21.15.60:0/2381339021 learned_addr learned my addr 172.21.15.60:0/2381339021 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:18.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe813fff700 1 --2- 172.21.15.60:0/2381339021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8140670f0 0x7fe814150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8137fe700 1 --2- 172.21.15.60:0/2381339021 >> v2:172.21.15.66:3300/0 conn(0x7fe8140af520 0x7fe8140ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 -- 172.21.15.60:0/2381339021 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714627484 0 0) 0x7fe8140af900 con 0x7fe814066c90 2020-10-31T22:50:18.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 -- 172.21.15.60:0/2381339021 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f4003230 con 0x7fe814066c90 2020-10-31T22:50:18.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 -- 172.21.15.60:0/2381339021 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4181040004 0 0) 0x7fe7f4003230 con 0x7fe814066c90 2020-10-31T22:50:18.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 -- 172.21.15.60:0/2381339021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8140670f0 msgr2=0x7fe814150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:18.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 --2- 172.21.15.60:0/2381339021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8140670f0 0x7fe814150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 -- 172.21.15.60:0/2381339021 >> v2:172.21.15.66:3300/0 conn(0x7fe8140af520 msgr2=0x7fe8140ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:18.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 --2- 172.21.15.60:0/2381339021 >> v2:172.21.15.66:3300/0 conn(0x7fe8140af520 0x7fe8140ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 -- 172.21.15.60:0/2381339021 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8140ac130 con 0x7fe814066c90 2020-10-31T22:50:18.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 -- 172.21.15.60:0/2381339021 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7fe804001a50 con 0x7fe814066c90 2020-10-31T22:50:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 -- 172.21.15.60:0/2381339021 >> v1:172.21.15.60:6789/0 conn(0x7fe814066c90 legacy=0x7fe814146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 --2- 172.21.15.60:0/2381339021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f4003720 0x7fe7f4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 --2- 172.21.15.60:0/2381339021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f40044d0 0x7fe7f4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 --2- 172.21.15.60:0/2381339021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8140670f0 0x7fe7f4004e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 -- 172.21.15.60:0/2381339021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8140afc10 con 0x7fe7f4003720 2020-10-31T22:50:18.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 -- 172.21.15.60:0/2381339021 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81405bb70 con 0x7fe7f40044d0 2020-10-31T22:50:18.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 -- 172.21.15.60:0/2381339021 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f4004260 con 0x7fe8140670f0 2020-10-31T22:50:18.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8137fe700 1 --2- 172.21.15.60:0/2381339021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f4003720 0x7fe7f4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe812ffd700 1 --2- 172.21.15.60:0/2381339021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f40044d0 0x7fe7f4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe813fff700 1 --2- 172.21.15.60:0/2381339021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8140670f0 0x7fe7f4004e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8137fe700 1 -- 172.21.15.60:0/2381339021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8140670f0 msgr2=0x7fe7f4004e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:18.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8137fe700 1 --2- 172.21.15.60:0/2381339021 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe8140670f0 0x7fe7f4004e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8137fe700 1 -- 172.21.15.60:0/2381339021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f40044d0 msgr2=0x7fe7f4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:18.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8137fe700 1 --2- 172.21.15.60:0/2381339021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f40044d0 0x7fe7f4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8137fe700 1 -- 172.21.15.60:0/2381339021 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f4003230 con 0x7fe7f4003720 2020-10-31T22:50:18.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe812ffd700 1 --2- 172.21.15.60:0/2381339021 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7f40044d0 0x7fe7f4004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:18.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8137fe700 1 --2- 172.21.15.60:0/2381339021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f4003720 0x7fe7f4003b40 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fe7fc00c000 tx=0x7fe7fc006d60).ready entity=mon.0 client_cookie=fc1cafe18e4f106c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:18.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 -- 172.21.15.60:0/2381339021 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7fc00ea90 con 0x7fe7f4003720 2020-10-31T22:50:18.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 -- 172.21.15.60:0/2381339021 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc00ebf0 con 0x7fe7f4003720 2020-10-31T22:50:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe8127fc700 1 -- 172.21.15.60:0/2381339021 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7fc0123f0 con 0x7fe7f4003720 2020-10-31T22:50:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe818ed0700 1 -- 172.21.15.60:0/2381339021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f4003720 msgr2=0x7fe7f4003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe818ed0700 1 --2- 172.21.15.60:0/2381339021 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7f4003720 0x7fe7f4003b40 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 rx=0x7fe7fc00c000 tx=0x7fe7fc006d60).stop 2020-10-31T22:50:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.665+0000 7fe813fff700 1 -- 172.21.15.60:0/2381339021 reap_dead start 2020-10-31T22:50:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe818ed0700 1 -- 172.21.15.60:0/2381339021 shutdown_connections 2020-10-31T22:50:18.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe818ed0700 1 -- 172.21.15.60:0/2381339021 >> 172.21.15.60:0/2381339021 conn(0x7fe8140b3fd0 msgr2=0x7fe8140b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:18.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe818ed0700 1 -- 172.21.15.60:0/2381339021 shutdown_connections 2020-10-31T22:50:18.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe818ed0700 1 -- 172.21.15.60:0/2381339021 wait complete. 2020-10-31T22:50:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe818ed0700 1 Processor -- start 2020-10-31T22:50:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe818ed0700 1 -- start start 2020-10-31T22:50:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe818ed0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe814145160 0x7fe8140a9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe818ed0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe814154f70 0x7fe814148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe818ed0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe814158d10 0x7fe814141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe818ed0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe814148da0 con 0x7fe814154f70 2020-10-31T22:50:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe818ed0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe814148b00 con 0x7fe814158d10 2020-10-31T22:50:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe818ed0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8141585d0 con 0x7fe814145160 2020-10-31T22:50:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe812ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe814154f70 0x7fe814148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe812ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe814154f70 0x7fe814148330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48980/0 (socket says 172.21.15.60:48980) 2020-10-31T22:50:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe812ffd700 1 -- 172.21.15.60:0/2646338201 learned_addr learned my addr 172.21.15.60:0/2646338201 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:18.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe813fff700 1 --2- 172.21.15.60:0/2646338201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe814158d10 0x7fe814141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.669+0000 7fe8137fe700 1 --2- 172.21.15.60:0/2646338201 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe814145160 0x7fe8140a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe812ffd700 1 -- 172.21.15.60:0/2646338201 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe814145160 msgr2=0x7fe8140a9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe812ffd700 1 --2- 172.21.15.60:0/2646338201 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe814145160 0x7fe8140a9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe812ffd700 1 -- 172.21.15.60:0/2646338201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe814158d10 msgr2=0x7fe814141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe812ffd700 1 --2- 172.21.15.60:0/2646338201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe814158d10 0x7fe814141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe812ffd700 1 -- 172.21.15.60:0/2646338201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe814158870 con 0x7fe814154f70 2020-10-31T22:50:18.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe812ffd700 1 --2- 172.21.15.60:0/2646338201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe814154f70 0x7fe814148330 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fe804001cb0 tx=0x7fe804001310).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:18.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe810ff9700 1 -- 172.21.15.60:0/2646338201 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe80400eca0 con 0x7fe814154f70 2020-10-31T22:50:18.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe810ff9700 1 -- 172.21.15.60:0/2646338201 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe804010040 con 0x7fe814154f70 2020-10-31T22:50:18.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe810ff9700 1 -- 172.21.15.60:0/2646338201 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe8040077d0 con 0x7fe814154f70 2020-10-31T22:50:18.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe818ed0700 1 -- 172.21.15.60:0/2646338201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8141553f0 con 0x7fe814154f70 2020-10-31T22:50:18.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe818ed0700 1 -- 172.21.15.60:0/2646338201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe814159190 con 0x7fe814154f70 2020-10-31T22:50:18.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe810ff9700 1 -- 172.21.15.60:0/2646338201 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe804015400 con 0x7fe814154f70 2020-10-31T22:50:18.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe818ed0700 1 -- 172.21.15.60:0/2646338201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe814158a00 con 0x7fe814154f70 2020-10-31T22:50:18.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe810ff9700 1 --2- 172.21.15.60:0/2646338201 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7f80550c0 0x7fe7f8057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe810ff9700 1 -- 172.21.15.60:0/2646338201 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe80406de00 con 0x7fe814154f70 2020-10-31T22:50:18.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.673+0000 7fe8137fe700 1 --2- 172.21.15.60:0/2646338201 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7f80550c0 0x7fe7f8057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.677+0000 7fe8137fe700 1 --2- 172.21.15.60:0/2646338201 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7f80550c0 0x7fe7f8057580 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fe7fc006fc0 tx=0x7fe7fc019000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:18.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.681+0000 7fe810ff9700 1 -- 172.21.15.60:0/2646338201 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe8040442c0 con 0x7fe814154f70 2020-10-31T22:50:18.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.821+0000 7fe818ed0700 1 -- 172.21.15.60:0/2646338201 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe814057100 con 0x7fe814154f70 2020-10-31T22:50:18.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.821+0000 7fe810ff9700 1 -- 172.21.15.60:0/2646338201 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v139) v1 ==== 100+0+10 (secure 0 0 0) 0x7fe8040478e0 con 0x7fe814154f70 2020-10-31T22:50:18.826 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:18.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.821+0000 7fe818ed0700 1 -- 172.21.15.60:0/2646338201 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7f80550c0 msgr2=0x7fe7f8057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.821+0000 7fe818ed0700 1 --2- 172.21.15.60:0/2646338201 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7f80550c0 0x7fe7f8057580 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7fe7fc006fc0 tx=0x7fe7fc019000).stop 2020-10-31T22:50:18.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.821+0000 7fe818ed0700 1 -- 172.21.15.60:0/2646338201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe814154f70 msgr2=0x7fe814148330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.821+0000 7fe818ed0700 1 --2- 172.21.15.60:0/2646338201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe814154f70 0x7fe814148330 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 rx=0x7fe804001cb0 tx=0x7fe804001310).stop 2020-10-31T22:50:18.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.821+0000 7fe818ed0700 1 -- 172.21.15.60:0/2646338201 shutdown_connections 2020-10-31T22:50:18.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.821+0000 7fe818ed0700 1 --2- 172.21.15.60:0/2646338201 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7f80550c0 0x7fe7f8057580 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.821+0000 7fe818ed0700 1 --2- 172.21.15.60:0/2646338201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe814158d10 0x7fe814141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.821+0000 7fe818ed0700 1 --2- 172.21.15.60:0/2646338201 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe814145160 0x7fe8140a9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.821+0000 7fe818ed0700 1 --2- 172.21.15.60:0/2646338201 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe814154f70 0x7fe814148330 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.821+0000 7fe818ed0700 1 -- 172.21.15.60:0/2646338201 >> 172.21.15.60:0/2646338201 conn(0x7fe8140b3fd0 msgr2=0x7fe8140ace30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:18.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.821+0000 7fe818ed0700 1 -- 172.21.15.60:0/2646338201 shutdown_connections 2020-10-31T22:50:18.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.821+0000 7fe818ed0700 1 -- 172.21.15.60:0/2646338201 wait complete. 2020-10-31T22:50:18.845 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:50:18.846 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:50:18.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb128be1700 1 Processor -- start 2020-10-31T22:50:18.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb128be1700 1 -- start start 2020-10-31T22:50:18.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb128be1700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb1240af520 0x7fb1240ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb128be1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb124066c90 0x7fb1240670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb128be1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb124146060 0x7fb1241464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb128be1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1240af900 con 0x7fb124066c90 2020-10-31T22:50:18.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb128be1700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1240afc10 con 0x7fb1240af520 2020-10-31T22:50:18.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb128be1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12405bb70 con 0x7fb124146060 2020-10-31T22:50:18.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb122ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb124066c90 0x7fb1240670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb122ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fb124066c90 0x7fb1240670f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48988/0 (socket says 172.21.15.60:48988) 2020-10-31T22:50:18.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb122ffd700 1 -- 172.21.15.60:0/3925320933 learned_addr learned my addr 172.21.15.60:0/3925320933 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:18.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb1237fe700 1 --2- 172.21.15.60:0/3925320933 >> v2:172.21.15.66:3300/0 conn(0x7fb1240af520 0x7fb1240ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb123fff700 1 --2- 172.21.15.60:0/3925320933 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb124146060 0x7fb1241464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb122ffd700 1 -- 172.21.15.60:0/3925320933 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb124146060 msgr2=0x7fb1241464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:18.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb122ffd700 1 --2- 172.21.15.60:0/3925320933 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb124146060 0x7fb1241464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb122ffd700 1 -- 172.21.15.60:0/3925320933 >> v2:172.21.15.66:3300/0 conn(0x7fb1240af520 msgr2=0x7fb1240ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:18.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb122ffd700 1 --2- 172.21.15.60:0/3925320933 >> v2:172.21.15.66:3300/0 conn(0x7fb1240af520 0x7fb1240ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb122ffd700 1 -- 172.21.15.60:0/3925320933 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1240ac130 con 0x7fb124066c90 2020-10-31T22:50:18.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb1237fe700 1 --2- 172.21.15.60:0/3925320933 >> v2:172.21.15.66:3300/0 conn(0x7fb1240af520 0x7fb1240ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:18.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb122ffd700 1 --2- 172.21.15.60:0/3925320933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb124066c90 0x7fb1240670f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fb1140032b0 tx=0x7fb114009270).ready entity=mon.0 client_cookie=c9bb7d7bc16bd79d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:18.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb1227fc700 1 -- 172.21.15.60:0/3925320933 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb11400bc00 con 0x7fb124066c90 2020-10-31T22:50:18.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb1227fc700 1 -- 172.21.15.60:0/3925320933 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11400bd60 con 0x7fb124066c90 2020-10-31T22:50:18.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb128be1700 1 -- 172.21.15.60:0/3925320933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb124066c90 msgr2=0x7fb1240670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb1227fc700 1 -- 172.21.15.60:0/3925320933 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb114011400 con 0x7fb124066c90 2020-10-31T22:50:18.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.953+0000 7fb128be1700 1 --2- 172.21.15.60:0/3925320933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb124066c90 0x7fb1240670f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 rx=0x7fb1140032b0 tx=0x7fb114009270).stop 2020-10-31T22:50:18.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 -- 172.21.15.60:0/3925320933 shutdown_connections 2020-10-31T22:50:18.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 --2- 172.21.15.60:0/3925320933 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb124146060 0x7fb1241464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 --2- 172.21.15.60:0/3925320933 >> v2:172.21.15.66:3300/0 conn(0x7fb1240af520 0x7fb1240ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 --2- 172.21.15.60:0/3925320933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb124066c90 0x7fb1240670f0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 -- 172.21.15.60:0/3925320933 >> 172.21.15.60:0/3925320933 conn(0x7fb1240b3fd0 msgr2=0x7fb1240b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:18.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 -- 172.21.15.60:0/3925320933 shutdown_connections 2020-10-31T22:50:18.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 -- 172.21.15.60:0/3925320933 wait complete. 2020-10-31T22:50:18.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 Processor -- start 2020-10-31T22:50:18.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 -- start start 2020-10-31T22:50:18.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb124066c90 0x7fb124141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1240af520 0x7fb124142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb124146060 0x7fb1240a91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb124154e80 con 0x7fb124146060 2020-10-31T22:50:18.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1241488b0 con 0x7fb1240af520 2020-10-31T22:50:18.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb124148ae0 con 0x7fb124066c90 2020-10-31T22:50:18.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb123fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb124146060 0x7fb1240a91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb123fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb124146060 0x7fb1240a91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:48996/0 (socket says 172.21.15.60:48996) 2020-10-31T22:50:18.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb123fff700 1 -- 172.21.15.60:0/2215252809 learned_addr learned my addr 172.21.15.60:0/2215252809 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:18.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb1237fe700 1 --2- 172.21.15.60:0/2215252809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb124066c90 0x7fb124141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb122ffd700 1 --2- 172.21.15.60:0/2215252809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1240af520 0x7fb124142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb123fff700 1 -- 172.21.15.60:0/2215252809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb124066c90 msgr2=0x7fb124141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb123fff700 1 --2- 172.21.15.60:0/2215252809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb124066c90 0x7fb124141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb123fff700 1 -- 172.21.15.60:0/2215252809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1240af520 msgr2=0x7fb124142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:18.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb123fff700 1 --2- 172.21.15.60:0/2215252809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1240af520 0x7fb124142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:18.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb123fff700 1 -- 172.21.15.60:0/2215252809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1241482f0 con 0x7fb124146060 2020-10-31T22:50:18.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb123fff700 1 --2- 172.21.15.60:0/2215252809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb124146060 0x7fb1240a91d0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fb124147680 tx=0x7fb11c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:18.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb120ff9700 1 -- 172.21.15.60:0/2215252809 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb11c00f7e0 con 0x7fb124146060 2020-10-31T22:50:18.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb120ff9700 1 -- 172.21.15.60:0/2215252809 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb11c00f940 con 0x7fb124146060 2020-10-31T22:50:18.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 -- 172.21.15.60:0/2215252809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1241448b0 con 0x7fb124146060 2020-10-31T22:50:18.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb120ff9700 1 -- 172.21.15.60:0/2215252809 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb11c00fca0 con 0x7fb124146060 2020-10-31T22:50:18.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.957+0000 7fb128be1700 1 -- 172.21.15.60:0/2215252809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb124147de0 con 0x7fb124146060 2020-10-31T22:50:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.961+0000 7fb128be1700 1 -- 172.21.15.60:0/2215252809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb124155190 con 0x7fb124146060 2020-10-31T22:50:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.961+0000 7fb120ff9700 1 -- 172.21.15.60:0/2215252809 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb11c01a030 con 0x7fb124146060 2020-10-31T22:50:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.961+0000 7fb120ff9700 1 --2- 172.21.15.60:0/2215252809 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb0fc054f90 0x7fb0fc057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.961+0000 7fb120ff9700 1 -- 172.21.15.60:0/2215252809 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb11c06d7b0 con 0x7fb124146060 2020-10-31T22:50:18.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.961+0000 7fb1237fe700 1 --2- 172.21.15.60:0/2215252809 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb0fc054f90 0x7fb0fc057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:18.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.961+0000 7fb1237fe700 1 --2- 172.21.15.60:0/2215252809 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb0fc054f90 0x7fb0fc057450 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fb10c00c000 tx=0x7fb10c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:18.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:18.969+0000 7fb120ff9700 1 -- 172.21.15.60:0/2215252809 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb11c043bc0 con 0x7fb124146060 2020-10-31T22:50:19.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:19.157+0000 7fb128be1700 1 -- 172.21.15.60:0/2215252809 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb124148480 con 0x7fb124146060 2020-10-31T22:50:19.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:19.157+0000 7fb120ff9700 1 -- 172.21.15.60:0/2215252809 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2492 (secure 0 0 0) 0x7fb11c0471e0 con 0x7fb124146060 2020-10-31T22:50:19.164 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:19.164 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1094853447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1094853447},{"type":"v1","addr":"172.21.15.66:6833","nonce":1094853447}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68},{"gid":7875,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3767660505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3767660505},{"type":"v1","addr":"172.21.15.60:6835","nonce":3767660505}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:14.231864+0000","modified":"2020-10-31T22:50:15.234744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7884":{"gid":7884,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/936802064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":936802064},{"type":"v1","addr":"172.21.15.60:6837","nonce":936802064}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-10-31T22:50:19.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:19.161+0000 7fb128be1700 1 -- 172.21.15.60:0/2215252809 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb0fc054f90 msgr2=0x7fb0fc057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:19.166 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:19.161+0000 7fb128be1700 1 --2- 172.21.15.60:0/2215252809 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb0fc054f90 0x7fb0fc057450 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fb10c00c000 tx=0x7fb10c008040).stop 2020-10-31T22:50:19.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:19.161+0000 7fb128be1700 1 -- 172.21.15.60:0/2215252809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb124146060 msgr2=0x7fb1240a91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:19.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:19.161+0000 7fb128be1700 1 --2- 172.21.15.60:0/2215252809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb124146060 0x7fb1240a91d0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 rx=0x7fb124147680 tx=0x7fb11c008040).stop 2020-10-31T22:50:19.167 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:19.161+0000 7fb128be1700 1 -- 172.21.15.60:0/2215252809 shutdown_connections 2020-10-31T22:50:19.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:19.161+0000 7fb128be1700 1 --2- 172.21.15.60:0/2215252809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb124146060 0x7fb1240a91d0 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:19.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:19.161+0000 7fb128be1700 1 --2- 172.21.15.60:0/2215252809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb124066c90 0x7fb124141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:19.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:19.161+0000 7fb128be1700 1 --2- 172.21.15.60:0/2215252809 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb0fc054f90 0x7fb0fc057450 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:19.168 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:19.161+0000 7fb128be1700 1 --2- 172.21.15.60:0/2215252809 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb1240af520 0x7fb124142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:19.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:19.161+0000 7fb128be1700 1 -- 172.21.15.60:0/2215252809 >> 172.21.15.60:0/2215252809 conn(0x7fb1240b3fd0 msgr2=0x7fb12414c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:19.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:19.161+0000 7fb128be1700 1 -- 172.21.15.60:0/2215252809 shutdown_connections 2020-10-31T22:50:19.169 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:19.161+0000 7fb128be1700 1 -- 172.21.15.60:0/2215252809 wait complete. 2020-10-31T22:50:19.170 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 70 2020-10-31T22:50:19.479 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:50:14.231864+0000', 'modified': '2020-10-31T22:50:15.234744+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7884}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7884': {'gid': 7884, 'name': 'a', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/936802064', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 936802064}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 936802064}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:50:19.482 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:50:19.482 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-10-31T22:50:19.614 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":7884,"want_state":"up:active","state":"up:active","rank_uptime":5.3681025629999999,"mdsmap_epoch":70,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":10.540886215} 2020-10-31T22:50:19.614 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 7884, "mdsmap_epoch": 70, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 5.368102563, "state": "up:active", "uptime": 10.540886215, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:50:19.615 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:50:19.615 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:50:19.616 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:50:19.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:19.617 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:19.625 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:50:19.684 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:50:19.685 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:50:19.740 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:50:19.741 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:50:19.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:19.743 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:50:19.789 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:50:19.789 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:19.832 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:50:19.847 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:50:19.847 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:50:19.904 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:50:19.905 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:50:19.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:19.906 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:50:19.908 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:50:19.906+0000 7fce881af0c0 -1 init, newargv = 0x556163157ac0 newargc=9ceph-fuse[14102 2020-10-31T22:50:19.909 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:]: starting ceph client 2020-10-31T22:50:19.919 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[14102]: starting fuse 2020-10-31T22:50:21.015 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:50:21.031 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:50:21.032 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:50:21.089 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:50:21.090 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:50:21.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:21.091 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:50:21.137 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:50:21.138 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:50:21.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:21.139 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:50:21.142 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:50:21.142 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:50:21.142 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:50:21.143 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:50:21.143 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:50:21.143 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:50:21.143 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:50:21.144 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:50:21.144 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:50:21.144 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:50:21.145 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:50:21.146 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:50:21.146 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:50:21.147 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:50:21.147 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:50:21.148 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:50:21.148 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:50:21.148 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:50:21.149 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:50:21.149 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:50:21.149 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:50:21.150 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:50:21.228 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.14102.asok 2020-10-31T22:50:21.233 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14102.asok 2020-10-31T22:50:21.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:21.234 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14102.asok status 2020-10-31T22:50:21.330 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:50:21.331 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:50:21.331 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:50:21.331 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:50:21.331 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:50:21.332 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:50:21.332 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:50:21.332 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "14102", 2020-10-31T22:50:21.332 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:50:21.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:50:21.332 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:50:21.332 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:50:21.333 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 7807, 2020-10-31T22:50:21.333 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:50:21.333 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:50:21.333 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:50:21.333 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 7807 2020-10-31T22:50:21.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:50:21.333 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:50:21.333 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:50:21.334 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:50:21.334 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 402923961 2020-10-31T22:50:21.334 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:50:21.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:50:21.334 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:50:21.334 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:50:21.335 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:50:21.335 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 402923961 2020-10-31T22:50:21.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:50:21.335 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.7807 172.21.15.152:0/402923961", 2020-10-31T22:50:21.335 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/402923961", 2020-10-31T22:50:21.335 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:50:21.335 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 70, 2020-10-31T22:50:21.336 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 139, 2020-10-31T22:50:21.336 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:50:21.336 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:50:21.336 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:50:21.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:21.341 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:21.341 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:21.349 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:50:21.349 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:50:21.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:21.350 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:21.409 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:50:21.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0197fff700 1 Processor -- start 2020-10-31T22:50:21.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0197fff700 1 -- start start 2020-10-31T22:50:21.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0197fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f01900472d0 0x7f01900d2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:21.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0197fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01900d2b00 con 0x7f01900065b0 2020-10-31T22:50:21.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0197fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0190005930 con 0x7f019003d1d0 2020-10-31T22:50:21.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0197fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0190005bd0 con 0x7f01900472d0 2020-10-31T22:50:21.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0196ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f01900472d0 0x7f01900d2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:21.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f01967fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f01900065b0 0x7f01900413c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53136/0 (socket says 172.21.15.60:53136) 2020-10-31T22:50:21.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f01967fc700 1 -- 172.21.15.60:0/2600542960 learned_addr learned my addr 172.21.15.60:0/2600542960 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:21.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0195ffb700 1 -- 172.21.15.60:0/2600542960 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354205499 0 0) 0x7f01900d2b00 con 0x7f01900065b0 2020-10-31T22:50:21.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0195ffb700 1 -- 172.21.15.60:0/2600542960 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f017c003230 con 0x7f01900065b0 2020-10-31T22:50:21.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0196ffd700 1 -- 172.21.15.60:0/2600542960 >> v1:172.21.15.66:6789/0 conn(0x7f019003d1d0 legacy=0x7f01900cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:21.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0196ffd700 1 -- 172.21.15.60:0/2600542960 >> v1:172.21.15.60:6789/0 conn(0x7f01900065b0 legacy=0x7f01900413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:21.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0196ffd700 1 -- 172.21.15.60:0/2600542960 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0190005e70 con 0x7f01900472d0 2020-10-31T22:50:21.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0196ffd700 1 --2- 172.21.15.60:0/2600542960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01900472d0 0x7f01900d2610 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f0198069480 tx=0x7f0198069330).ready entity=mon.0 client_cookie=d6e0cc73259d5f3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:21.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0195ffb700 1 -- 172.21.15.60:0/2600542960 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f019805ed50 con 0x7f01900472d0 2020-10-31T22:50:21.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0195ffb700 1 -- 172.21.15.60:0/2600542960 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0198084070 con 0x7f01900472d0 2020-10-31T22:50:21.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0195ffb700 1 -- 172.21.15.60:0/2600542960 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f019805f0a0 con 0x7f01900472d0 2020-10-31T22:50:21.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0197fff700 1 -- 172.21.15.60:0/2600542960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01900472d0 msgr2=0x7f01900d2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:21.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.529+0000 7f0197fff700 1 --2- 172.21.15.60:0/2600542960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01900472d0 0x7f01900d2610 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 rx=0x7f0198069480 tx=0x7f0198069330).stop 2020-10-31T22:50:21.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0197fff700 1 -- 172.21.15.60:0/2600542960 shutdown_connections 2020-10-31T22:50:21.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0197fff700 1 --2- 172.21.15.60:0/2600542960 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01900472d0 0x7f01900d2610 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:21.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0197fff700 1 -- 172.21.15.60:0/2600542960 >> 172.21.15.60:0/2600542960 conn(0x7f019000a610 msgr2=0x7f0190046a20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:21.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0197fff700 1 -- 172.21.15.60:0/2600542960 shutdown_connections 2020-10-31T22:50:21.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0197fff700 1 -- 172.21.15.60:0/2600542960 wait complete. 2020-10-31T22:50:21.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0197fff700 1 Processor -- start 2020-10-31T22:50:21.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0197fff700 1 -- start start 2020-10-31T22:50:21.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0197fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01900065b0 0x7f0190045680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:21.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0197fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f019003d1d0 0x7f01900429c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:21.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0197fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01900472d0 0x7f0190042eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:21.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0197fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900d51d0 con 0x7f019003d1d0 2020-10-31T22:50:21.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0197fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900d5470 con 0x7f01900472d0 2020-10-31T22:50:21.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0197fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01900d5710 con 0x7f01900065b0 2020-10-31T22:50:21.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f01967fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f019003d1d0 0x7f01900429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:21.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0196ffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01900065b0 0x7f0190045680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:21.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f01967fc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f019003d1d0 0x7f01900429c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49008/0 (socket says 172.21.15.60:49008) 2020-10-31T22:50:21.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f01967fc700 1 -- 172.21.15.60:0/1324508189 learned_addr learned my addr 172.21.15.60:0/1324508189 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:21.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f01977fe700 1 --2- 172.21.15.60:0/1324508189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01900472d0 0x7f0190042eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:21.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0196ffd700 1 -- 172.21.15.60:0/1324508189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01900472d0 msgr2=0x7f0190042eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:21.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0196ffd700 1 --2- 172.21.15.60:0/1324508189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01900472d0 0x7f0190042eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:21.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0196ffd700 1 -- 172.21.15.60:0/1324508189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f019003d1d0 msgr2=0x7f01900429c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:21.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0196ffd700 1 --2- 172.21.15.60:0/1324508189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f019003d1d0 0x7f01900429c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:21.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.533+0000 7f0196ffd700 1 -- 172.21.15.60:0/1324508189 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01900d59b0 con 0x7f01900065b0 2020-10-31T22:50:21.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.537+0000 7f01967fc700 1 --2- 172.21.15.60:0/1324508189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f019003d1d0 0x7f01900429c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:21.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.537+0000 7f0196ffd700 1 --2- 172.21.15.60:0/1324508189 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01900065b0 0x7f0190045680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f0198069480 tx=0x7f0198066000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:21.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.537+0000 7f0187fff700 1 -- 172.21.15.60:0/1324508189 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0198069610 con 0x7f01900065b0 2020-10-31T22:50:21.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.537+0000 7f0187fff700 1 -- 172.21.15.60:0/1324508189 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0198084040 con 0x7f01900065b0 2020-10-31T22:50:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.537+0000 7f0197fff700 1 -- 172.21.15.60:0/1324508189 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0190043eb0 con 0x7f01900065b0 2020-10-31T22:50:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.537+0000 7f0187fff700 1 -- 172.21.15.60:0/1324508189 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0198069960 con 0x7f01900065b0 2020-10-31T22:50:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.537+0000 7f0197fff700 1 -- 172.21.15.60:0/1324508189 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01900d1460 con 0x7f01900065b0 2020-10-31T22:50:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.537+0000 7f0197fff700 1 -- 172.21.15.60:0/1324508189 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0190044040 con 0x7f01900065b0 2020-10-31T22:50:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.537+0000 7f0187fff700 1 -- 172.21.15.60:0/1324508189 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0198069ac0 con 0x7f01900065b0 2020-10-31T22:50:21.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.537+0000 7f0187fff700 1 --2- 172.21.15.60:0/1324508189 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0174054f10 0x7f01740573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:21.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.537+0000 7f01967fc700 1 --2- 172.21.15.60:0/1324508189 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0174054f10 0x7f01740573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:21.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.537+0000 7f0187fff700 1 -- 172.21.15.60:0/1324508189 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f01980dba50 con 0x7f01900065b0 2020-10-31T22:50:21.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.537+0000 7f01967fc700 1 --2- 172.21.15.60:0/1324508189 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0174054f10 0x7f01740573d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f018c00d000 tx=0x7f018c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:21.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.549+0000 7f0187fff700 1 -- 172.21.15.60:0/1324508189 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f01980b1de0 con 0x7f01900065b0 2020-10-31T22:50:21.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.693+0000 7f0197fff700 1 -- 172.21.15.60:0/1324508189 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01900d5b40 con 0x7f01900065b0 2020-10-31T22:50:21.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.693+0000 7f0187fff700 1 -- 172.21.15.60:0/1324508189 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f019808e030 con 0x7f01900065b0 2020-10-31T22:50:21.700 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:21.700 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":139,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:50:15.235473+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:50:11.956893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-10-31T22:50:13.235442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:50:21.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.697+0000 7f0197fff700 1 -- 172.21.15.60:0/1324508189 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0174054f10 msgr2=0x7f01740573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:21.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.697+0000 7f0197fff700 1 --2- 172.21.15.60:0/1324508189 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0174054f10 0x7f01740573d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7f018c00d000 tx=0x7f018c009040).stop 2020-10-31T22:50:21.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.697+0000 7f0197fff700 1 -- 172.21.15.60:0/1324508189 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01900065b0 msgr2=0x7f0190045680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:21.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.697+0000 7f0197fff700 1 --2- 172.21.15.60:0/1324508189 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01900065b0 0x7f0190045680 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f0198069480 tx=0x7f0198066000).stop 2020-10-31T22:50:21.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.697+0000 7f0197fff700 1 -- 172.21.15.60:0/1324508189 shutdown_connections 2020-10-31T22:50:21.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.697+0000 7f0197fff700 1 --2- 172.21.15.60:0/1324508189 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0174054f10 0x7f01740573d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:21.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.697+0000 7f0197fff700 1 --2- 172.21.15.60:0/1324508189 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01900472d0 0x7f0190042eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:21.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.697+0000 7f0197fff700 1 --2- 172.21.15.60:0/1324508189 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01900065b0 0x7f0190045680 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.697+0000 7f0197fff700 1 --2- 172.21.15.60:0/1324508189 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f019003d1d0 0x7f01900429c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.697+0000 7f0197fff700 1 -- 172.21.15.60:0/1324508189 >> 172.21.15.60:0/1324508189 conn(0x7f019000a610 msgr2=0x7f01900cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.697+0000 7f0197fff700 1 -- 172.21.15.60:0/1324508189 shutdown_connections 2020-10-31T22:50:21.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.697+0000 7f0197fff700 1 -- 172.21.15.60:0/1324508189 wait complete. 2020-10-31T22:50:21.714 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:50:11.956893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:50:13.235442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:50:21.715 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:50:21.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8af07700 1 Processor -- start 2020-10-31T22:50:21.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8af07700 1 -- start start 2020-10-31T22:50:21.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8af07700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3e840b5570 0x7f3e840b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:21.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8af07700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e84141f00 0x7f3e84142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:21.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8af07700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e840b4440 con 0x7f3e840b24a0 2020-10-31T22:50:21.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8af07700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8413f930 con 0x7f3e840b5570 2020-10-31T22:50:21.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8af07700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e84146060 con 0x7f3e84141f00 2020-10-31T22:50:21.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e89704700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f3e840b24a0 0x7f3e84145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53154/0 (socket says 172.21.15.60:53154) 2020-10-31T22:50:21.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e89704700 1 -- 172.21.15.60:0/2086482313 learned_addr learned my addr 172.21.15.60:0/2086482313 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:21.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8a706700 1 --2- 172.21.15.60:0/2086482313 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e84141f00 0x7f3e84142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:21.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e89f05700 1 --2- 172.21.15.60:0/2086482313 >> v2:172.21.15.66:3300/0 conn(0x7f3e840b5570 0x7f3e840b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:21.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e88f03700 1 -- 172.21.15.60:0/2086482313 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580171372 0 0) 0x7f3e840b4440 con 0x7f3e840b24a0 2020-10-31T22:50:21.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e88f03700 1 -- 172.21.15.60:0/2086482313 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e6c003230 con 0x7f3e840b24a0 2020-10-31T22:50:21.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8a706700 1 -- 172.21.15.60:0/2086482313 >> v2:172.21.15.66:3300/0 conn(0x7f3e840b5570 msgr2=0x7f3e840b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8a706700 1 --2- 172.21.15.60:0/2086482313 >> v2:172.21.15.66:3300/0 conn(0x7f3e840b5570 0x7f3e840b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8a706700 1 -- 172.21.15.60:0/2086482313 >> v1:172.21.15.60:6789/0 conn(0x7f3e840b24a0 legacy=0x7f3e84145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e88f03700 1 -- 172.21.15.60:0/2086482313 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3735757081 0 0) 0x7f3e6c003230 con 0x7f3e840b24a0 2020-10-31T22:50:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8a706700 1 -- 172.21.15.60:0/2086482313 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e840b02f0 con 0x7f3e84141f00 2020-10-31T22:50:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8a706700 1 --2- 172.21.15.60:0/2086482313 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e84141f00 0x7f3e84142390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f3e74001870 tx=0x7f3e7c0091a0).ready entity=mon.2 client_cookie=cb6e31b2b14c1641 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e88f03700 1 -- 172.21.15.60:0/2086482313 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e740016d0 con 0x7f3e84141f00 2020-10-31T22:50:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e88f03700 1 -- 172.21.15.60:0/2086482313 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c00b800 con 0x7f3e84141f00 2020-10-31T22:50:21.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e88f03700 1 -- 172.21.15.60:0/2086482313 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e7c00b970 con 0x7f3e84141f00 2020-10-31T22:50:21.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8af07700 1 -- 172.21.15.60:0/2086482313 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e84141f00 msgr2=0x7f3e84142390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:21.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.837+0000 7f3e8af07700 1 --2- 172.21.15.60:0/2086482313 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e84141f00 0x7f3e84142390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f3e74001870 tx=0x7f3e7c0091a0).stop 2020-10-31T22:50:21.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.841+0000 7f3e8af07700 1 -- 172.21.15.60:0/2086482313 shutdown_connections 2020-10-31T22:50:21.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.841+0000 7f3e8af07700 1 --2- 172.21.15.60:0/2086482313 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e84141f00 0x7f3e84142390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:21.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.841+0000 7f3e8af07700 1 --2- 172.21.15.60:0/2086482313 >> v2:172.21.15.66:3300/0 conn(0x7f3e840b5570 0x7f3e840b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:21.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.841+0000 7f3e8af07700 1 -- 172.21.15.60:0/2086482313 >> 172.21.15.60:0/2086482313 conn(0x7f3e840b8e90 msgr2=0x7f3e840b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:21.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.841+0000 7f3e8af07700 1 -- 172.21.15.60:0/2086482313 shutdown_connections 2020-10-31T22:50:21.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.841+0000 7f3e8af07700 1 -- 172.21.15.60:0/2086482313 wait complete. 2020-10-31T22:50:21.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.841+0000 7f3e8af07700 1 Processor -- start 2020-10-31T22:50:21.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.841+0000 7f3e8af07700 1 -- start start 2020-10-31T22:50:21.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8af07700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e840b24a0 0x7f3e840b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:21.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8af07700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e840b5570 0x7f3e84144200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:21.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8af07700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e84141f00 0x7f3e84142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:21.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8af07700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840af140 con 0x7f3e84141f00 2020-10-31T22:50:21.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8af07700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e84154ce0 con 0x7f3e840b5570 2020-10-31T22:50:21.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8af07700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e84154f80 con 0x7f3e840b24a0 2020-10-31T22:50:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8a706700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e84141f00 0x7f3e84142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8a706700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e84141f00 0x7f3e84142fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49024/0 (socket says 172.21.15.60:49024) 2020-10-31T22:50:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8a706700 1 -- 172.21.15.60:0/2312823376 learned_addr learned my addr 172.21.15.60:0/2312823376 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e89f05700 1 --2- 172.21.15.60:0/2312823376 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e840b24a0 0x7f3e840b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e89704700 1 --2- 172.21.15.60:0/2312823376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e840b5570 0x7f3e84144200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8a706700 1 -- 172.21.15.60:0/2312823376 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e840b24a0 msgr2=0x7f3e840b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:21.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8a706700 1 --2- 172.21.15.60:0/2312823376 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e840b24a0 0x7f3e840b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8a706700 1 -- 172.21.15.60:0/2312823376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e840b5570 msgr2=0x7f3e84144200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8a706700 1 --2- 172.21.15.60:0/2312823376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e840b5570 0x7f3e84144200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8a706700 1 -- 172.21.15.60:0/2312823376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e840aeca0 con 0x7f3e84141f00 2020-10-31T22:50:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8a706700 1 --2- 172.21.15.60:0/2312823376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e84141f00 0x7f3e84142fb0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f3e74001870 tx=0x7f3e7c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e72ffd700 1 -- 172.21.15.60:0/2312823376 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e7c011b80 con 0x7f3e84141f00 2020-10-31T22:50:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e72ffd700 1 -- 172.21.15.60:0/2312823376 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c011ce0 con 0x7f3e84141f00 2020-10-31T22:50:21.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8af07700 1 -- 172.21.15.60:0/2312823376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e84145270 con 0x7f3e84141f00 2020-10-31T22:50:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e72ffd700 1 -- 172.21.15.60:0/2312823376 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3e7c0205f0 con 0x7f3e84141f00 2020-10-31T22:50:21.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.845+0000 7f3e8af07700 1 -- 172.21.15.60:0/2312823376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e84144910 con 0x7f3e84141f00 2020-10-31T22:50:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.849+0000 7f3e8af07700 1 -- 172.21.15.60:0/2312823376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e840aee30 con 0x7f3e84141f00 2020-10-31T22:50:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.849+0000 7f3e72ffd700 1 -- 172.21.15.60:0/2312823376 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3e7c027030 con 0x7f3e84141f00 2020-10-31T22:50:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.849+0000 7f3e72ffd700 1 --2- 172.21.15.60:0/2312823376 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3e64054f10 0x7f3e640573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.849+0000 7f3e72ffd700 1 -- 172.21.15.60:0/2312823376 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f3e7c06e690 con 0x7f3e84141f00 2020-10-31T22:50:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.849+0000 7f3e89f05700 1 --2- 172.21.15.60:0/2312823376 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3e64054f10 0x7f3e640573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:21.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.849+0000 7f3e89f05700 1 --2- 172.21.15.60:0/2312823376 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3e64054f10 0x7f3e640573d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f3e8000b000 tx=0x7f3e80006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:21.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:21.853+0000 7f3e72ffd700 1 -- 172.21.15.60:0/2312823376 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3e7c044bb0 con 0x7f3e84141f00 2020-10-31T22:50:22.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.001+0000 7f3e8af07700 1 -- 172.21.15.60:0/2312823376 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3e84057100 con 0x7f3e84141f00 2020-10-31T22:50:22.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.001+0000 7f3e72ffd700 1 -- 172.21.15.60:0/2312823376 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v139) v1 ==== 110+0+10 (secure 0 0 0) 0x7f3e7c025020 con 0x7f3e84141f00 2020-10-31T22:50:22.006 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:50:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.001+0000 7f3e8af07700 1 -- 172.21.15.60:0/2312823376 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3e64054f10 msgr2=0x7f3e640573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.001+0000 7f3e8af07700 1 --2- 172.21.15.60:0/2312823376 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3e64054f10 0x7f3e640573d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7f3e8000b000 tx=0x7f3e80006dc0).stop 2020-10-31T22:50:22.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.001+0000 7f3e8af07700 1 -- 172.21.15.60:0/2312823376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e84141f00 msgr2=0x7f3e84142fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.001+0000 7f3e8af07700 1 --2- 172.21.15.60:0/2312823376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e84141f00 0x7f3e84142fb0 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 rx=0x7f3e74001870 tx=0x7f3e7c016000).stop 2020-10-31T22:50:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.001+0000 7f3e8af07700 1 -- 172.21.15.60:0/2312823376 shutdown_connections 2020-10-31T22:50:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.001+0000 7f3e8af07700 1 --2- 172.21.15.60:0/2312823376 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e84141f00 0x7f3e84142fb0 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.001+0000 7f3e8af07700 1 --2- 172.21.15.60:0/2312823376 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3e840b24a0 0x7f3e840b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.001+0000 7f3e8af07700 1 --2- 172.21.15.60:0/2312823376 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3e64054f10 0x7f3e640573d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.001+0000 7f3e8af07700 1 --2- 172.21.15.60:0/2312823376 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e840b5570 0x7f3e84144200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.001+0000 7f3e8af07700 1 -- 172.21.15.60:0/2312823376 >> 172.21.15.60:0/2312823376 conn(0x7f3e840b8e90 msgr2=0x7f3e840b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.001+0000 7f3e8af07700 1 -- 172.21.15.60:0/2312823376 shutdown_connections 2020-10-31T22:50:22.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.005+0000 7f3e8af07700 1 -- 172.21.15.60:0/2312823376 wait complete. 2020-10-31T22:50:22.019 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:50:22.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.129+0000 7fcf0f6cf700 1 Processor -- start 2020-10-31T22:50:22.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.129+0000 7fcf0f6cf700 1 -- start start 2020-10-31T22:50:22.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.129+0000 7fcf0f6cf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcf0805c660 0x7fcf080b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.129+0000 7fcf0f6cf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcf080b2e20 0x7fcf08142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0f6cf700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf08066410 con 0x7fcf08065f70 2020-10-31T22:50:22.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0f6cf700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf08066d60 con 0x7fcf080b2e20 2020-10-31T22:50:22.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0f6cf700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080b5e80 con 0x7fcf0805c660 2020-10-31T22:50:22.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0dc6c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcf080b2e20 0x7fcf08142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0dc6c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcf080b2e20 0x7fcf08142610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49032/0 (socket says 172.21.15.60:49032) 2020-10-31T22:50:22.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0dc6c700 1 -- 172.21.15.60:0/3456295202 learned_addr learned my addr 172.21.15.60:0/3456295202 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:22.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0d46b700 1 --2- 172.21.15.60:0/3456295202 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcf0805c660 0x7fcf080b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0dc6c700 1 -- 172.21.15.60:0/3456295202 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcf0805c660 msgr2=0x7fcf080b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:22.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0dc6c700 1 --2- 172.21.15.60:0/3456295202 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcf0805c660 0x7fcf080b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0dc6c700 1 -- 172.21.15.60:0/3456295202 >> v1:172.21.15.66:6789/0 conn(0x7fcf08065f70 legacy=0x7fcf0813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0dc6c700 1 -- 172.21.15.60:0/3456295202 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf080666b0 con 0x7fcf080b2e20 2020-10-31T22:50:22.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0dc6c700 1 --2- 172.21.15.60:0/3456295202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf080b2e20 0x7fcf08142610 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7fcf080afe90 tx=0x7fcf00009270).ready entity=mon.0 client_cookie=e9840e5d9389c131 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:22.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcefffff700 1 -- 172.21.15.60:0/3456295202 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf00009e90 con 0x7fcf080b2e20 2020-10-31T22:50:22.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcefffff700 1 -- 172.21.15.60:0/3456295202 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0000bbc0 con 0x7fcf080b2e20 2020-10-31T22:50:22.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcefffff700 1 -- 172.21.15.60:0/3456295202 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0000bd30 con 0x7fcf080b2e20 2020-10-31T22:50:22.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3456295202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf080b2e20 msgr2=0x7fcf08142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0f6cf700 1 --2- 172.21.15.60:0/3456295202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf080b2e20 0x7fcf08142610 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 rx=0x7fcf080afe90 tx=0x7fcf00009270).stop 2020-10-31T22:50:22.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3456295202 shutdown_connections 2020-10-31T22:50:22.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0f6cf700 1 --2- 172.21.15.60:0/3456295202 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf080b2e20 0x7fcf08142610 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0f6cf700 1 --2- 172.21.15.60:0/3456295202 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcf0805c660 0x7fcf080b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3456295202 >> 172.21.15.60:0/3456295202 conn(0x7fcf080601e0 msgr2=0x7fcf0805b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:22.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3456295202 shutdown_connections 2020-10-31T22:50:22.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.133+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3456295202 wait complete. 2020-10-31T22:50:22.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0f6cf700 1 Processor -- start 2020-10-31T22:50:22.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0f6cf700 1 -- start start 2020-10-31T22:50:22.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0f6cf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcf0805c660 0x7fcf080b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0f6cf700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf08065f70 0x7fcf0813a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0f6cf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf080b2e20 0x7fcf0813ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0f6cf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080b1460 con 0x7fcf080b2e20 2020-10-31T22:50:22.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0f6cf700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080b2040 con 0x7fcf08065f70 2020-10-31T22:50:22.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0f6cf700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf080b22e0 con 0x7fcf0805c660 2020-10-31T22:50:22.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0dc6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf080b2e20 0x7fcf0813ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0dc6c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf080b2e20 0x7fcf0813ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49038/0 (socket says 172.21.15.60:49038) 2020-10-31T22:50:22.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0dc6c700 1 -- 172.21.15.60:0/3047537416 learned_addr learned my addr 172.21.15.60:0/3047537416 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:22.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0d46b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcf0805c660 0x7fcf080b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0cc6a700 1 --2- 172.21.15.60:0/3047537416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf08065f70 0x7fcf0813a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0dc6c700 1 -- 172.21.15.60:0/3047537416 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcf0805c660 msgr2=0x7fcf080b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0dc6c700 1 --2- 172.21.15.60:0/3047537416 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcf0805c660 0x7fcf080b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0dc6c700 1 -- 172.21.15.60:0/3047537416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf08065f70 msgr2=0x7fcf0813a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0dc6c700 1 --2- 172.21.15.60:0/3047537416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf08065f70 0x7fcf0813a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0dc6c700 1 -- 172.21.15.60:0/3047537416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf080b2580 con 0x7fcf080b2e20 2020-10-31T22:50:22.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0cc6a700 1 --2- 172.21.15.60:0/3047537416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf08065f70 0x7fcf0813a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:22.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0dc6c700 1 --2- 172.21.15.60:0/3047537416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf080b2e20 0x7fcf0813ab90 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fcf080afe90 tx=0x7fcf00016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:22.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcefe7fc700 1 -- 172.21.15.60:0/3047537416 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0001f5e0 con 0x7fcf080b2e20 2020-10-31T22:50:22.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcefe7fc700 1 -- 172.21.15.60:0/3047537416 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0001f740 con 0x7fcf080b2e20 2020-10-31T22:50:22.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcefe7fc700 1 -- 172.21.15.60:0/3047537416 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcf0001faa0 con 0x7fcf080b2e20 2020-10-31T22:50:22.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3047537416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf080b2820 con 0x7fcf080b2e20 2020-10-31T22:50:22.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.137+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3047537416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf080b1b30 con 0x7fcf080b2e20 2020-10-31T22:50:22.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.141+0000 7fcefe7fc700 1 -- 172.21.15.60:0/3047537416 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fcf0000f070 con 0x7fcf080b2e20 2020-10-31T22:50:22.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.141+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3047537416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf080a9200 con 0x7fcf080b2e20 2020-10-31T22:50:22.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.141+0000 7fcefe7fc700 1 --2- 172.21.15.60:0/3047537416 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcef0054f10 0x7fcef00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.141+0000 7fcefe7fc700 1 -- 172.21.15.60:0/3047537416 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcf0006e780 con 0x7fcf080b2e20 2020-10-31T22:50:22.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.141+0000 7fcf0d46b700 1 --2- 172.21.15.60:0/3047537416 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcef0054f10 0x7fcef00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.141+0000 7fcf0d46b700 1 --2- 172.21.15.60:0/3047537416 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcef0054f10 0x7fcef00573d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fcf0400b000 tx=0x7fcf04006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:22.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.149+0000 7fcefe7fc700 1 -- 172.21.15.60:0/3047537416 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcf080a9200 con 0x7fcf080b2e20 2020-10-31T22:50:22.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.285+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3047537416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fcf080a9200 con 0x7fcf080b2e20 2020-10-31T22:50:22.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.289+0000 7fcefe7fc700 1 -- 172.21.15.60:0/3047537416 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7fcf080a9200 con 0x7fcf080b2e20 2020-10-31T22:50:22.293 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:22.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.289+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3047537416 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcef0054f10 msgr2=0x7fcef00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.293+0000 7fcf0f6cf700 1 --2- 172.21.15.60:0/3047537416 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcef0054f10 0x7fcef00573d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fcf0400b000 tx=0x7fcf04006dc0).stop 2020-10-31T22:50:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.293+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3047537416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf080b2e20 msgr2=0x7fcf0813ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.293+0000 7fcf0f6cf700 1 --2- 172.21.15.60:0/3047537416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf080b2e20 0x7fcf0813ab90 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 rx=0x7fcf080afe90 tx=0x7fcf00016000).stop 2020-10-31T22:50:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.293+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3047537416 shutdown_connections 2020-10-31T22:50:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.293+0000 7fcf0f6cf700 1 --2- 172.21.15.60:0/3047537416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcf080b2e20 0x7fcf0813ab90 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.293+0000 7fcf0f6cf700 1 --2- 172.21.15.60:0/3047537416 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcf0805c660 0x7fcf080b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.293+0000 7fcf0f6cf700 1 --2- 172.21.15.60:0/3047537416 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcef0054f10 0x7fcef00573d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.293+0000 7fcf0f6cf700 1 --2- 172.21.15.60:0/3047537416 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcf08065f70 0x7fcf0813a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.293+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3047537416 >> 172.21.15.60:0/3047537416 conn(0x7fcf080601e0 msgr2=0x7fcf080b6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.293+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3047537416 shutdown_connections 2020-10-31T22:50:22.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.293+0000 7fcf0f6cf700 1 -- 172.21.15.60:0/3047537416 wait complete. 2020-10-31T22:50:22.312 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:50:22.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc29351e700 1 Processor -- start 2020-10-31T22:50:22.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc29351e700 1 -- start start 2020-10-31T22:50:22.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc29351e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc28c05c660 0x7fc28c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc29351e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc28c065f70 0x7fc28c13f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc29351e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc28c066410 con 0x7fc28c13f880 2020-10-31T22:50:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc29351e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc28c066d60 con 0x7fc28c05c660 2020-10-31T22:50:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc29351e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c0b5e80 con 0x7fc28c065f70 2020-10-31T22:50:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc2912ba700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc28c05c660 0x7fc28c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc2912ba700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc28c05c660 0x7fc28c0b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49042/0 (socket says 172.21.15.60:49042) 2020-10-31T22:50:22.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc2912ba700 1 -- 172.21.15.60:0/3805623972 learned_addr learned my addr 172.21.15.60:0/3805623972 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc290ab9700 1 --2- 172.21.15.60:0/3805623972 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc28c065f70 0x7fc28c13f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc2912ba700 1 -- 172.21.15.60:0/3805623972 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc28c065f70 msgr2=0x7fc28c13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc2912ba700 1 --2- 172.21.15.60:0/3805623972 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc28c065f70 0x7fc28c13f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc2912ba700 1 -- 172.21.15.60:0/3805623972 >> v1:172.21.15.66:6789/0 conn(0x7fc28c13f880 legacy=0x7fc28c142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc2912ba700 1 -- 172.21.15.60:0/3805623972 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c0666b0 con 0x7fc28c05c660 2020-10-31T22:50:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc2912ba700 1 --2- 172.21.15.60:0/3805623972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc28c05c660 0x7fc28c0b5990 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fc28c0b5fc0 tx=0x7fc288006e80).ready entity=mon.0 client_cookie=1a85fa4639ccc8bd server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:22.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc283fff700 1 -- 172.21.15.60:0/3805623972 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2880097b0 con 0x7fc28c05c660 2020-10-31T22:50:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc283fff700 1 -- 172.21.15.60:0/3805623972 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc288009910 con 0x7fc28c05c660 2020-10-31T22:50:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc29351e700 1 -- 172.21.15.60:0/3805623972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc28c05c660 msgr2=0x7fc28c0b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc283fff700 1 -- 172.21.15.60:0/3805623972 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc288009c70 con 0x7fc28c05c660 2020-10-31T22:50:22.443 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.433+0000 7fc29351e700 1 --2- 172.21.15.60:0/3805623972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc28c05c660 0x7fc28c0b5990 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 rx=0x7fc28c0b5fc0 tx=0x7fc288006e80).stop 2020-10-31T22:50:22.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc29351e700 1 -- 172.21.15.60:0/3805623972 shutdown_connections 2020-10-31T22:50:22.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc29351e700 1 --2- 172.21.15.60:0/3805623972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc28c05c660 0x7fc28c0b5990 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc29351e700 1 --2- 172.21.15.60:0/3805623972 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc28c065f70 0x7fc28c13f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc29351e700 1 -- 172.21.15.60:0/3805623972 >> 172.21.15.60:0/3805623972 conn(0x7fc28c0601e0 msgr2=0x7fc28c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc29351e700 1 -- 172.21.15.60:0/3805623972 shutdown_connections 2020-10-31T22:50:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc29351e700 1 -- 172.21.15.60:0/3805623972 wait complete. 2020-10-31T22:50:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc29351e700 1 Processor -- start 2020-10-31T22:50:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc29351e700 1 -- start start 2020-10-31T22:50:22.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc29351e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc28c05c660 0x7fc28c0ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc29351e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc28c065f70 0x7fc28c0b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc29351e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc28c13f880 0x7fc28c0b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc29351e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c1516f0 con 0x7fc28c065f70 2020-10-31T22:50:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc29351e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c151bc0 con 0x7fc28c13f880 2020-10-31T22:50:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc29351e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c151920 con 0x7fc28c05c660 2020-10-31T22:50:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc290ab9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc28c065f70 0x7fc28c0b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc2912ba700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc28c05c660 0x7fc28c0ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc2912ba700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc28c05c660 0x7fc28c0ac630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:34004/0 (socket says 172.21.15.60:34004) 2020-10-31T22:50:22.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc290ab9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc28c065f70 0x7fc28c0b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49050/0 (socket says 172.21.15.60:49050) 2020-10-31T22:50:22.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc2912ba700 1 -- 172.21.15.60:0/1012236887 learned_addr learned my addr 172.21.15.60:0/1012236887 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:22.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.437+0000 7fc291abb700 1 --2- 172.21.15.60:0/1012236887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc28c13f880 0x7fc28c0b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc290ab9700 1 -- 172.21.15.60:0/1012236887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc28c05c660 msgr2=0x7fc28c0ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc290ab9700 1 --2- 172.21.15.60:0/1012236887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc28c05c660 0x7fc28c0ac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc290ab9700 1 -- 172.21.15.60:0/1012236887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc28c13f880 msgr2=0x7fc28c0b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc290ab9700 1 --2- 172.21.15.60:0/1012236887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc28c13f880 0x7fc28c0b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc290ab9700 1 -- 172.21.15.60:0/1012236887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c0ad520 con 0x7fc28c065f70 2020-10-31T22:50:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc291abb700 1 --2- 172.21.15.60:0/1012236887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc28c13f880 0x7fc28c0b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc290ab9700 1 --2- 172.21.15.60:0/1012236887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc28c065f70 0x7fc28c0b0560 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fc28c0aead0 tx=0x7fc27c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc2827fc700 1 -- 172.21.15.60:0/1012236887 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc27c00ca10 con 0x7fc28c065f70 2020-10-31T22:50:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc2827fc700 1 -- 172.21.15.60:0/1012236887 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27c00cb70 con 0x7fc28c065f70 2020-10-31T22:50:22.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc29351e700 1 -- 172.21.15.60:0/1012236887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28c0ad7c0 con 0x7fc28c065f70 2020-10-31T22:50:22.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc2827fc700 1 -- 172.21.15.60:0/1012236887 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc27c0123f0 con 0x7fc28c065f70 2020-10-31T22:50:22.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc29351e700 1 -- 172.21.15.60:0/1012236887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c0ae140 con 0x7fc28c065f70 2020-10-31T22:50:22.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc2827fc700 1 -- 172.21.15.60:0/1012236887 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc27c012550 con 0x7fc28c065f70 2020-10-31T22:50:22.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc2827fc700 1 --2- 172.21.15.60:0/1012236887 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc274054f90 0x7fc274057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc2827fc700 1 -- 172.21.15.60:0/1012236887 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc27c06df10 con 0x7fc28c065f70 2020-10-31T22:50:22.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc2912ba700 1 --2- 172.21.15.60:0/1012236887 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc274054f90 0x7fc274057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc29351e700 1 -- 172.21.15.60:0/1012236887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28c0ad950 con 0x7fc28c065f70 2020-10-31T22:50:22.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.441+0000 7fc2912ba700 1 --2- 172.21.15.60:0/1012236887 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc274054f90 0x7fc274057450 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fc28801c000 tx=0x7fc288015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:22.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.449+0000 7fc2827fc700 1 -- 172.21.15.60:0/1012236887 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc27c0442c0 con 0x7fc28c065f70 2020-10-31T22:50:22.591 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.585+0000 7fc29351e700 1 -- 172.21.15.60:0/1012236887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc28c057100 con 0x7fc28c065f70 2020-10-31T22:50:22.592 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.585+0000 7fc2827fc700 1 -- 172.21.15.60:0/1012236887 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v139) v1 ==== 104+0+10 (secure 0 0 0) 0x7fc27c0478e0 con 0x7fc28c065f70 2020-10-31T22:50:22.592 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:22.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.589+0000 7fc29351e700 1 -- 172.21.15.60:0/1012236887 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc274054f90 msgr2=0x7fc274057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.589+0000 7fc29351e700 1 --2- 172.21.15.60:0/1012236887 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc274054f90 0x7fc274057450 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7fc28801c000 tx=0x7fc288015000).stop 2020-10-31T22:50:22.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.589+0000 7fc29351e700 1 -- 172.21.15.60:0/1012236887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc28c065f70 msgr2=0x7fc28c0b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.589+0000 7fc29351e700 1 --2- 172.21.15.60:0/1012236887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc28c065f70 0x7fc28c0b0560 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 rx=0x7fc28c0aead0 tx=0x7fc27c006dc0).stop 2020-10-31T22:50:22.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.589+0000 7fc29351e700 1 -- 172.21.15.60:0/1012236887 shutdown_connections 2020-10-31T22:50:22.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.589+0000 7fc29351e700 1 --2- 172.21.15.60:0/1012236887 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc274054f90 0x7fc274057450 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.589+0000 7fc29351e700 1 --2- 172.21.15.60:0/1012236887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc28c13f880 0x7fc28c0b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.589+0000 7fc29351e700 1 --2- 172.21.15.60:0/1012236887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc28c05c660 0x7fc28c0ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.589+0000 7fc29351e700 1 --2- 172.21.15.60:0/1012236887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc28c065f70 0x7fc28c0b0560 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.589+0000 7fc29351e700 1 -- 172.21.15.60:0/1012236887 >> 172.21.15.60:0/1012236887 conn(0x7fc28c0601e0 msgr2=0x7fc28c0b3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:22.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.589+0000 7fc29351e700 1 -- 172.21.15.60:0/1012236887 shutdown_connections 2020-10-31T22:50:22.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.589+0000 7fc29351e700 1 -- 172.21.15.60:0/1012236887 wait complete. 2020-10-31T22:50:22.611 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:50:22.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f989585b700 1 Processor -- start 2020-10-31T22:50:22.729 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f989585b700 1 -- start start 2020-10-31T22:50:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f989585b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f98900b1d50 0x7f98900ac020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f989585b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98900a8140 0x7f98900adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f989585b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f989013bcc0 0x7f989013c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f989585b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f989013f630 con 0x7f98900a8140 2020-10-31T22:50:22.731 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f989585b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98900b2130 con 0x7f98900b1d50 2020-10-31T22:50:22.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f989585b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989005c0f0 con 0x7f989013bcc0 2020-10-31T22:50:22.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f988ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98900a8140 0x7f98900adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f988ffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98900a8140 0x7f98900adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49058/0 (socket says 172.21.15.60:49058) 2020-10-31T22:50:22.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f988ffff700 1 -- 172.21.15.60:0/4286838621 learned_addr learned my addr 172.21.15.60:0/4286838621 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:22.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f9894859700 1 --2- 172.21.15.60:0/4286838621 >> v2:172.21.15.66:3300/0 conn(0x7f98900b1d50 0x7f98900ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.732 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f989505a700 1 --2- 172.21.15.60:0/4286838621 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f989013bcc0 0x7f989013c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.733 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f988ffff700 1 -- 172.21.15.60:0/4286838621 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f989013bcc0 msgr2=0x7f989013c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:22.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f988ffff700 1 --2- 172.21.15.60:0/4286838621 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f989013bcc0 0x7f989013c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f988ffff700 1 -- 172.21.15.60:0/4286838621 >> v2:172.21.15.66:3300/0 conn(0x7f98900b1d50 msgr2=0x7f98900ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:22.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f988ffff700 1 --2- 172.21.15.60:0/4286838621 >> v2:172.21.15.66:3300/0 conn(0x7f98900b1d50 0x7f98900ac020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.734 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f988ffff700 1 -- 172.21.15.60:0/4286838621 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989013f860 con 0x7f98900a8140 2020-10-31T22:50:22.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f988ffff700 1 --2- 172.21.15.60:0/4286838621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98900a8140 0x7f98900adb10 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f9880002f30 tx=0x7f9880006e80).ready entity=mon.0 client_cookie=e380c2fd27038fa1 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:22.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f988f7fe700 1 -- 172.21.15.60:0/4286838621 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9880009640 con 0x7f98900a8140 2020-10-31T22:50:22.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f988f7fe700 1 -- 172.21.15.60:0/4286838621 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98800097a0 con 0x7f98900a8140 2020-10-31T22:50:22.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f988f7fe700 1 -- 172.21.15.60:0/4286838621 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9880009b00 con 0x7f98900a8140 2020-10-31T22:50:22.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f989585b700 1 -- 172.21.15.60:0/4286838621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98900a8140 msgr2=0x7f98900adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.725+0000 7f989585b700 1 --2- 172.21.15.60:0/4286838621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98900a8140 0x7f98900adb10 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 rx=0x7f9880002f30 tx=0x7f9880006e80).stop 2020-10-31T22:50:22.735 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.729+0000 7f989585b700 1 -- 172.21.15.60:0/4286838621 shutdown_connections 2020-10-31T22:50:22.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.729+0000 7f989585b700 1 --2- 172.21.15.60:0/4286838621 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f989013bcc0 0x7f989013c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.729+0000 7f989585b700 1 --2- 172.21.15.60:0/4286838621 >> v2:172.21.15.66:3300/0 conn(0x7f98900b1d50 0x7f98900ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.729+0000 7f989585b700 1 --2- 172.21.15.60:0/4286838621 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98900a8140 0x7f98900adb10 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.729+0000 7f989585b700 1 -- 172.21.15.60:0/4286838621 >> 172.21.15.60:0/4286838621 conn(0x7f98900b5330 msgr2=0x7f98900b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:22.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.729+0000 7f989585b700 1 -- 172.21.15.60:0/4286838621 shutdown_connections 2020-10-31T22:50:22.736 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.729+0000 7f989585b700 1 -- 172.21.15.60:0/4286838621 wait complete. 2020-10-31T22:50:22.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.729+0000 7f989585b700 1 Processor -- start 2020-10-31T22:50:22.738 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.729+0000 7f989585b700 1 -- start start 2020-10-31T22:50:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989585b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98900a8140 0x7f98900a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989585b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98900b1d50 0x7f98900a8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989585b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f989013bcc0 0x7f9890066670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989585b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9890154490 con 0x7f989013bcc0 2020-10-31T22:50:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989585b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9890154670 con 0x7f98900b1d50 2020-10-31T22:50:22.739 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989585b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9890154910 con 0x7f98900a8140 2020-10-31T22:50:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989505a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f989013bcc0 0x7f9890066670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989505a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f989013bcc0 0x7f9890066670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49064/0 (socket says 172.21.15.60:49064) 2020-10-31T22:50:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989505a700 1 -- 172.21.15.60:0/1597000694 learned_addr learned my addr 172.21.15.60:0/1597000694 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f9894859700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98900a8140 0x7f98900a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f988ffff700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98900b1d50 0x7f98900a8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989505a700 1 -- 172.21.15.60:0/1597000694 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98900a8140 msgr2=0x7f98900a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.740 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989505a700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98900a8140 0x7f98900a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989505a700 1 -- 172.21.15.60:0/1597000694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98900b1d50 msgr2=0x7f98900a8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989505a700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98900b1d50 0x7f98900a8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989505a700 1 -- 172.21.15.60:0/1597000694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98900a8d00 con 0x7f989013bcc0 2020-10-31T22:50:22.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f988ffff700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98900b1d50 0x7f98900a8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:22.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989505a700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f989013bcc0 0x7f9890066670 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f988800c000 tx=0x7f98880091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:22.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f988dffb700 1 -- 172.21.15.60:0/1597000694 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f988800eea0 con 0x7f989013bcc0 2020-10-31T22:50:22.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f988dffb700 1 -- 172.21.15.60:0/1597000694 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988800cbb0 con 0x7f989013bcc0 2020-10-31T22:50:22.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f988dffb700 1 -- 172.21.15.60:0/1597000694 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98880123f0 con 0x7f989013bcc0 2020-10-31T22:50:22.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989585b700 1 -- 172.21.15.60:0/1597000694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9890064320 con 0x7f989013bcc0 2020-10-31T22:50:22.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989585b700 1 -- 172.21.15.60:0/1597000694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98900ab4a0 con 0x7f989013bcc0 2020-10-31T22:50:22.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.733+0000 7f989585b700 1 -- 172.21.15.60:0/1597000694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9890154ad0 con 0x7f989013bcc0 2020-10-31T22:50:22.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.737+0000 7f988dffb700 1 -- 172.21.15.60:0/1597000694 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9888022070 con 0x7f989013bcc0 2020-10-31T22:50:22.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.737+0000 7f988dffb700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9870054f10 0x7f98700573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:22.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.737+0000 7f988dffb700 1 -- 172.21.15.60:0/1597000694 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f988806e100 con 0x7f989013bcc0 2020-10-31T22:50:22.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.737+0000 7f9894859700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9870054f10 0x7f98700573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:22.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.737+0000 7f9894859700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9870054f10 0x7f98700573d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f988400b000 tx=0x7f9884006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:22.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.741+0000 7f988dffb700 1 -- 172.21.15.60:0/1597000694 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9888044620 con 0x7f989013bcc0 2020-10-31T22:50:22.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.885+0000 7f989585b700 1 -- 172.21.15.60:0/1597000694 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9890057100 con 0x7f989013bcc0 2020-10-31T22:50:22.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.885+0000 7f988dffb700 1 -- 172.21.15.60:0/1597000694 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v139) v1 ==== 100+0+10 (secure 0 0 0) 0x7f9888016020 con 0x7f989013bcc0 2020-10-31T22:50:22.891 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:22.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.889+0000 7f989585b700 1 -- 172.21.15.60:0/1597000694 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9870054f10 msgr2=0x7f98700573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.889+0000 7f989585b700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9870054f10 0x7f98700573d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f988400b000 tx=0x7f9884006dc0).stop 2020-10-31T22:50:22.894 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.889+0000 7f989585b700 1 -- 172.21.15.60:0/1597000694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f989013bcc0 msgr2=0x7f9890066670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:22.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.889+0000 7f989585b700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f989013bcc0 0x7f9890066670 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 rx=0x7f988800c000 tx=0x7f98880091a0).stop 2020-10-31T22:50:22.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.889+0000 7f989585b700 1 -- 172.21.15.60:0/1597000694 shutdown_connections 2020-10-31T22:50:22.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.889+0000 7f989585b700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f989013bcc0 0x7f9890066670 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.889+0000 7f989585b700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98900a8140 0x7f98900a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.889+0000 7f989585b700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9870054f10 0x7f98700573d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.889+0000 7f989585b700 1 --2- 172.21.15.60:0/1597000694 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98900b1d50 0x7f98900a8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:22.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.889+0000 7f989585b700 1 -- 172.21.15.60:0/1597000694 >> 172.21.15.60:0/1597000694 conn(0x7f98900b5330 msgr2=0x7f9890141ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:22.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.889+0000 7f989585b700 1 -- 172.21.15.60:0/1597000694 shutdown_connections 2020-10-31T22:50:22.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:22.889+0000 7f989585b700 1 -- 172.21.15.60:0/1597000694 wait complete. 2020-10-31T22:50:22.911 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:50:22.912 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:50:23.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab3305a700 1 Processor -- start 2020-10-31T22:50:23.026 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab3305a700 1 -- start start 2020-10-31T22:50:23.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab3305a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab2c05c320 0x7fab2c141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:23.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab3305a700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2c0b2130 con 0x7fab2c0b1d50 2020-10-31T22:50:23.027 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab3305a700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab2c0af380 con 0x7fab2c0b0000 2020-10-31T22:50:23.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab3305a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c13fab0 con 0x7fab2c05c320 2020-10-31T22:50:23.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab32058700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fab2c0b1d50 0x7fab2c05afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53206/0 (socket says 172.21.15.60:53206) 2020-10-31T22:50:23.028 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab32058700 1 -- 172.21.15.60:0/969090565 learned_addr learned my addr 172.21.15.60:0/969090565 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:23.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab32859700 1 --2- 172.21.15.60:0/969090565 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab2c05c320 0x7fab2c141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:23.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab31056700 1 -- 172.21.15.60:0/969090565 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493660351 0 0) 0x7fab2c0b2130 con 0x7fab2c0b1d50 2020-10-31T22:50:23.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab31056700 1 -- 172.21.15.60:0/969090565 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab14003230 con 0x7fab2c0b1d50 2020-10-31T22:50:23.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab31056700 1 -- 172.21.15.60:0/969090565 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507463414 0 0) 0x7fab2c0af380 con 0x7fab2c0b0000 2020-10-31T22:50:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab31056700 1 -- 172.21.15.60:0/969090565 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab2c0b2130 con 0x7fab2c0b0000 2020-10-31T22:50:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab32859700 1 -- 172.21.15.60:0/969090565 >> v1:172.21.15.66:6789/0 conn(0x7fab2c0b0000 legacy=0x7fab2c05bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab32859700 1 -- 172.21.15.60:0/969090565 >> v1:172.21.15.60:6789/0 conn(0x7fab2c0b1d50 legacy=0x7fab2c05afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.021+0000 7fab32859700 1 -- 172.21.15.60:0/969090565 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c0af620 con 0x7fab2c05c320 2020-10-31T22:50:23.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.025+0000 7fab32859700 1 --2- 172.21.15.60:0/969090565 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab2c05c320 0x7fab2c141d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fab24002f30 tx=0x7fab24006dc0).ready entity=mon.2 client_cookie=211a333579c79192 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.025+0000 7fab31056700 1 -- 172.21.15.60:0/969090565 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab24009730 con 0x7fab2c05c320 2020-10-31T22:50:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.025+0000 7fab31056700 1 -- 172.21.15.60:0/969090565 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab24009890 con 0x7fab2c05c320 2020-10-31T22:50:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.025+0000 7fab31056700 1 -- 172.21.15.60:0/969090565 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab24009bf0 con 0x7fab2c05c320 2020-10-31T22:50:23.031 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.025+0000 7fab3305a700 1 -- 172.21.15.60:0/969090565 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab2c05c320 msgr2=0x7fab2c141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:23.032 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.025+0000 7fab3305a700 1 --2- 172.21.15.60:0/969090565 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab2c05c320 0x7fab2c141d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7fab24002f30 tx=0x7fab24006dc0).stop 2020-10-31T22:50:23.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.025+0000 7fab3305a700 1 -- 172.21.15.60:0/969090565 shutdown_connections 2020-10-31T22:50:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.025+0000 7fab3305a700 1 --2- 172.21.15.60:0/969090565 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab2c05c320 0x7fab2c141d80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.025+0000 7fab3305a700 1 -- 172.21.15.60:0/969090565 >> 172.21.15.60:0/969090565 conn(0x7fab2c0b5300 msgr2=0x7fab2c0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.025+0000 7fab3305a700 1 -- 172.21.15.60:0/969090565 shutdown_connections 2020-10-31T22:50:23.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.025+0000 7fab3305a700 1 -- 172.21.15.60:0/969090565 wait complete. 2020-10-31T22:50:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.025+0000 7fab3305a700 1 Processor -- start 2020-10-31T22:50:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.025+0000 7fab3305a700 1 -- start start 2020-10-31T22:50:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab3305a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab2c05c320 0x7fab2c0ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:23.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab3305a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2c0b0000 0x7fab2c150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab3305a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab2c0b1d50 0x7fab2c154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab3305a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c1540a0 con 0x7fab2c0b0000 2020-10-31T22:50:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab3305a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c146160 con 0x7fab2c05c320 2020-10-31T22:50:23.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab3305a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2c0aa220 con 0x7fab2c0b1d50 2020-10-31T22:50:23.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab31857700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2c0b0000 0x7fab2c150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:23.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab32058700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab2c05c320 0x7fab2c0ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:23.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab31857700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2c0b0000 0x7fab2c150b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49080/0 (socket says 172.21.15.60:49080) 2020-10-31T22:50:23.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab32859700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab2c0b1d50 0x7fab2c154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:23.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab31857700 1 -- 172.21.15.60:0/52650459 learned_addr learned my addr 172.21.15.60:0/52650459 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab31857700 1 -- 172.21.15.60:0/52650459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab2c0b1d50 msgr2=0x7fab2c154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab31857700 1 --2- 172.21.15.60:0/52650459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab2c0b1d50 0x7fab2c154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab31857700 1 -- 172.21.15.60:0/52650459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab2c05c320 msgr2=0x7fab2c0ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:23.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab31857700 1 --2- 172.21.15.60:0/52650459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab2c05c320 0x7fab2c0ae1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab31857700 1 -- 172.21.15.60:0/52650459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab2c0aa4c0 con 0x7fab2c0b0000 2020-10-31T22:50:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab31857700 1 --2- 172.21.15.60:0/52650459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2c0b0000 0x7fab2c150b50 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7fab1c0010d0 tx=0x7fab1c007ab0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:23.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab1b7fe700 1 -- 172.21.15.60:0/52650459 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab1c00f470 con 0x7fab2c0b0000 2020-10-31T22:50:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab1b7fe700 1 -- 172.21.15.60:0/52650459 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab1c00f5d0 con 0x7fab2c0b0000 2020-10-31T22:50:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab3305a700 1 -- 172.21.15.60:0/52650459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2c1542d0 con 0x7fab2c0b0000 2020-10-31T22:50:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab1b7fe700 1 -- 172.21.15.60:0/52650459 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab1c00f930 con 0x7fab2c0b0000 2020-10-31T22:50:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.029+0000 7fab3305a700 1 -- 172.21.15.60:0/52650459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2c05b660 con 0x7fab2c0b0000 2020-10-31T22:50:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.033+0000 7fab3305a700 1 -- 172.21.15.60:0/52650459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2c154460 con 0x7fab2c0b0000 2020-10-31T22:50:23.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.033+0000 7fab1b7fe700 1 -- 172.21.15.60:0/52650459 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fab1c019030 con 0x7fab2c0b0000 2020-10-31T22:50:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.033+0000 7fab1b7fe700 1 --2- 172.21.15.60:0/52650459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab0c054f10 0x7fab0c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.033+0000 7fab1b7fe700 1 -- 172.21.15.60:0/52650459 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fab1c06cef0 con 0x7fab2c0b0000 2020-10-31T22:50:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.033+0000 7fab32058700 1 --2- 172.21.15.60:0/52650459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab0c054f10 0x7fab0c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.033+0000 7fab32058700 1 --2- 172.21.15.60:0/52650459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab0c054f10 0x7fab0c0573d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fab2800d000 tx=0x7fab28009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:23.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.037+0000 7fab1b7fe700 1 -- 172.21.15.60:0/52650459 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fab1c043300 con 0x7fab2c0b0000 2020-10-31T22:50:23.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.229+0000 7fab3305a700 1 -- 172.21.15.60:0/52650459 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab2c057100 con 0x7fab2c0b0000 2020-10-31T22:50:23.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.229+0000 7fab1b7fe700 1 -- 172.21.15.60:0/52650459 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2492 (secure 0 0 0) 0x7fab1c046920 con 0x7fab2c0b0000 2020-10-31T22:50:23.234 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:23.234 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1094853447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1094853447},{"type":"v1","addr":"172.21.15.66:6833","nonce":1094853447}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68},{"gid":7875,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3767660505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3767660505},{"type":"v1","addr":"172.21.15.60:6835","nonce":3767660505}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:14.231864+0000","modified":"2020-10-31T22:50:15.234744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7884":{"gid":7884,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/936802064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":936802064},{"type":"v1","addr":"172.21.15.60:6837","nonce":936802064}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-10-31T22:50:23.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.229+0000 7fab3305a700 1 -- 172.21.15.60:0/52650459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab0c054f10 msgr2=0x7fab0c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:23.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.229+0000 7fab3305a700 1 --2- 172.21.15.60:0/52650459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab0c054f10 0x7fab0c0573d0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fab2800d000 tx=0x7fab28009040).stop 2020-10-31T22:50:23.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.229+0000 7fab3305a700 1 -- 172.21.15.60:0/52650459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2c0b0000 msgr2=0x7fab2c150b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:23.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.229+0000 7fab3305a700 1 --2- 172.21.15.60:0/52650459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2c0b0000 0x7fab2c150b50 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 rx=0x7fab1c0010d0 tx=0x7fab1c007ab0).stop 2020-10-31T22:50:23.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.229+0000 7fab3305a700 1 -- 172.21.15.60:0/52650459 shutdown_connections 2020-10-31T22:50:23.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.229+0000 7fab3305a700 1 --2- 172.21.15.60:0/52650459 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab2c0b1d50 0x7fab2c154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:23.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.229+0000 7fab3305a700 1 --2- 172.21.15.60:0/52650459 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab0c054f10 0x7fab0c0573d0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:23.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.229+0000 7fab3305a700 1 --2- 172.21.15.60:0/52650459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab2c05c320 0x7fab2c0ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:23.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.229+0000 7fab3305a700 1 --2- 172.21.15.60:0/52650459 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab2c0b0000 0x7fab2c150b50 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:23.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.229+0000 7fab3305a700 1 -- 172.21.15.60:0/52650459 >> 172.21.15.60:0/52650459 conn(0x7fab2c0b5300 msgr2=0x7fab2c13fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:23.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.229+0000 7fab3305a700 1 -- 172.21.15.60:0/52650459 shutdown_connections 2020-10-31T22:50:23.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:23.229+0000 7fab3305a700 1 -- 172.21.15.60:0/52650459 wait complete. 2020-10-31T22:50:23.238 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 70 2020-10-31T22:50:23.550 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:50:14.231864+0000', 'modified': '2020-10-31T22:50:15.234744+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7884}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7884': {'gid': 7884, 'name': 'a', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/936802064', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 936802064}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 936802064}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:50:23.551 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:50:23.551 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-10-31T22:50:23.684 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":7884,"want_state":"up:active","state":"up:active","rank_uptime":9.4389092590000008,"mdsmap_epoch":70,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":14.611693105000001} 2020-10-31T22:50:23.684 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 7884, "mdsmap_epoch": 70, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 9.438909259, "state": "up:active", "uptime": 14.611693105, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:50:23.685 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:50:23.685 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-10-31T22:50:23.686 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi085.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-10-31T22:50:23.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:23.687 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:23.695 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:50:23.751 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:50:23.752 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:50:23.807 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:50:23.808 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:50:23.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:23.809 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:50:23.854 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:50:23.855 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:23.899 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:50:23.914 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:50:23.915 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:50:23.971 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:50:23.972 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:50:23.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:23.973 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:50:23.975 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:2020-10-31T22:50:23.973+0000 7f40d8c250c0 -1 init, newargv = 0x560a1cfaf930 newargc=9 2020-10-31T22:50:23.976 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13553]: starting ceph client 2020-10-31T22:50:23.986 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13553]: starting fuse 2020-10-31T22:50:25.081 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:50:25.097 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:50:25.097 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:50:25.155 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:50:25.155 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:50:25.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:25.157 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:50:25.202 INFO:teuthology.orchestra.run.smithi085.stdout:50 2020-10-31T22:50:25.203 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-10-31T22:50:25.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:25.205 INFO:teuthology.orchestra.run.smithi085:> sudo python3 -c ' 2020-10-31T22:50:25.205 INFO:teuthology.orchestra.run.smithi085:> import glob 2020-10-31T22:50:25.205 INFO:teuthology.orchestra.run.smithi085:> import re 2020-10-31T22:50:25.206 INFO:teuthology.orchestra.run.smithi085:> import os 2020-10-31T22:50:25.206 INFO:teuthology.orchestra.run.smithi085:> import subprocess 2020-10-31T22:50:25.206 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:50:25.207 INFO:teuthology.orchestra.run.smithi085:> def find_socket(client_name): 2020-10-31T22:50:25.207 INFO:teuthology.orchestra.run.smithi085:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-10-31T22:50:25.207 INFO:teuthology.orchestra.run.smithi085:> files = glob.glob(asok_path) 2020-10-31T22:50:25.207 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:50:25.208 INFO:teuthology.orchestra.run.smithi085:> # Given a non-glob path, it better be there 2020-10-31T22:50:25.208 INFO:teuthology.orchestra.run.smithi085:> if "*" not in asok_path: 2020-10-31T22:50:25.208 INFO:teuthology.orchestra.run.smithi085:> assert(len(files) == 1) 2020-10-31T22:50:25.209 INFO:teuthology.orchestra.run.smithi085:> return files[0] 2020-10-31T22:50:25.209 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:50:25.209 INFO:teuthology.orchestra.run.smithi085:> for f in files: 2020-10-31T22:50:25.210 INFO:teuthology.orchestra.run.smithi085:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:50:25.210 INFO:teuthology.orchestra.run.smithi085:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:50:25.210 INFO:teuthology.orchestra.run.smithi085:> return f 2020-10-31T22:50:25.211 INFO:teuthology.orchestra.run.smithi085:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:50:25.211 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:50:25.211 INFO:teuthology.orchestra.run.smithi085:> print(find_socket("client.1")) 2020-10-31T22:50:25.211 INFO:teuthology.orchestra.run.smithi085:> ' 2020-10-31T22:50:25.285 INFO:teuthology.orchestra.run.smithi085.stdout:/var/run/ceph/ceph-client.1.13553.asok 2020-10-31T22:50:25.289 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13553.asok 2020-10-31T22:50:25.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:25.290 INFO:teuthology.orchestra.run.smithi085:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13553.asok status 2020-10-31T22:50:25.428 INFO:teuthology.orchestra.run.smithi085.stdout:{ 2020-10-31T22:50:25.428 INFO:teuthology.orchestra.run.smithi085.stdout: "metadata": { 2020-10-31T22:50:25.428 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:50:25.428 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:50:25.428 INFO:teuthology.orchestra.run.smithi085.stdout: "entity_id": "1", 2020-10-31T22:50:25.429 INFO:teuthology.orchestra.run.smithi085.stdout: "hostname": "smithi085", 2020-10-31T22:50:25.429 INFO:teuthology.orchestra.run.smithi085.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-10-31T22:50:25.429 INFO:teuthology.orchestra.run.smithi085.stdout: "pid": "13553", 2020-10-31T22:50:25.429 INFO:teuthology.orchestra.run.smithi085.stdout: "root": "/" 2020-10-31T22:50:25.429 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:50:25.429 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_count": 0, 2020-10-31T22:50:25.429 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_pinned_count": 0, 2020-10-31T22:50:25.430 INFO:teuthology.orchestra.run.smithi085.stdout: "id": 8088, 2020-10-31T22:50:25.430 INFO:teuthology.orchestra.run.smithi085.stdout: "inst": { 2020-10-31T22:50:25.430 INFO:teuthology.orchestra.run.smithi085.stdout: "name": { 2020-10-31T22:50:25.430 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "client", 2020-10-31T22:50:25.430 INFO:teuthology.orchestra.run.smithi085.stdout: "num": 8088 2020-10-31T22:50:25.430 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:50:25.430 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:50:25.431 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:50:25.431 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:50:25.431 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 2273804278 2020-10-31T22:50:25.431 INFO:teuthology.orchestra.run.smithi085.stdout: } 2020-10-31T22:50:25.431 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:50:25.431 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:50:25.431 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:50:25.431 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:50:25.432 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 2273804278 2020-10-31T22:50:25.432 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:50:25.432 INFO:teuthology.orchestra.run.smithi085.stdout: "inst_str": "client.8088 172.21.15.85:0/2273804278", 2020-10-31T22:50:25.432 INFO:teuthology.orchestra.run.smithi085.stdout: "addr_str": "172.21.15.85:0/2273804278", 2020-10-31T22:50:25.432 INFO:teuthology.orchestra.run.smithi085.stdout: "inode_count": 1, 2020-10-31T22:50:25.432 INFO:teuthology.orchestra.run.smithi085.stdout: "mds_epoch": 70, 2020-10-31T22:50:25.432 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch": 139, 2020-10-31T22:50:25.433 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:50:25.433 INFO:teuthology.orchestra.run.smithi085.stdout: "blacklisted": false 2020-10-31T22:50:25.433 INFO:teuthology.orchestra.run.smithi085.stdout:} 2020-10-31T22:50:25.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:25.437 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:25.438 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:25.445 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:50:25.446 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:50:25.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:25.447 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:25.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:25.507 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:25.507 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:25.555 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:50:25.556 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:50:25.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:25.557 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:25.557 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:25.603 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:50:25.604 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:50:25.605 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi085.front.sepia.ceph.com... 2020-10-31T22:50:25.605 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:50:25.606 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:25.677 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13553]: fuse finished with error 0 and tester_r 0 2020-10-31T22:50:25.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:25.679 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:25.679 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:25.727 INFO:teuthology.orchestra.run.smithi085.stdout:ext2/ext3 2020-10-31T22:50:25.728 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:50:25.729 INFO:teuthology.orchestra.run:waiting for 900 2020-10-31T22:50:25.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:50:25.772 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:25.822 INFO:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-10-31T22:50:25.827 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-10-31T22:50:25.831 INFO:teuthology.orchestra.run.smithi085:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-10-31T22:50:25.863 INFO:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-10-31T22:50:25.868 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2020-10-31T22:50:25.869 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2020-10-31T22:50:25.869 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-31T22:50:25.869 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2020-10-31T22:50:25.869 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.869 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2020-10-31T22:50:25.870 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.870 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2020-10-31T22:50:25.870 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.870 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2020-10-31T22:50:25.870 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2020-10-31T22:50:25.870 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.871 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2020-10-31T22:50:25.871 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2020-10-31T22:50:25.871 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.871 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-31T22:50:25.871 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2020-10-31T22:50:25.871 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.871 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2020-10-31T22:50:25.872 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-31T22:50:25.872 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.872 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2020-10-31T22:50:25.872 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.872 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2020-10-31T22:50:25.872 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2020-10-31T22:50:25.873 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2020-10-31T22:50:25.873 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2020-10-31T22:50:25.873 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2020-10-31T22:50:25.873 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2020-10-31T22:50:25.873 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2020-10-31T22:50:25.873 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-31T22:50:25.873 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-31T22:50:25.874 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.874 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-31T22:50:25.874 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.874 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2020-10-31T22:50:25.874 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.874 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2020-10-31T22:50:25.875 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.875 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2020-10-31T22:50:25.875 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2020-10-31T22:50:25.876 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.60,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2020-10-31T22:50:25.876 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 226f905a-1517-4a8c-8009-08779515965c 2020-10-31T22:50:25.876 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.877 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2020-10-31T22:50:25.877 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2020-10-31T22:50:25.877 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.877 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2020-10-31T22:50:25.877 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2020-10-31T22:50:25.877 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.878 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2020-10-31T22:50:25.878 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2020-10-31T22:50:25.878 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.878 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2020-10-31T22:50:25.878 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2020-10-31T22:50:25.878 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2020-10-31T22:50:25.878 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.879 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2020-10-31T22:50:25.879 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2020-10-31T22:50:25.879 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.879 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2020-10-31T22:50:25.879 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.879 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2020-10-31T22:50:25.880 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.880 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2020-10-31T22:50:25.880 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.880 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2020-10-31T22:50:25.880 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2020-10-31T22:50:25.880 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.881 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2020-10-31T22:50:25.881 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2020-10-31T22:50:25.881 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2020-10-31T22:50:25.881 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore compression mode = aggressive 2020-10-31T22:50:25.881 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2020-10-31T22:50:25.882 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 20 2020-10-31T22:50:25.882 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 20 2020-10-31T22:50:25.882 INFO:teuthology.orchestra.run.smithi066.stdout: debug filestore = 20 2020-10-31T22:50:25.882 INFO:teuthology.orchestra.run.smithi066.stdout: debug journal = 20 2020-10-31T22:50:25.882 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 20 2020-10-31T22:50:25.882 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 25 2020-10-31T22:50:25.882 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 10 2020-10-31T22:50:25.883 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2020-10-31T22:50:25.883 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2020-10-31T22:50:25.883 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2020-10-31T22:50:25.883 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2020-10-31T22:50:25.883 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2020-10-31T22:50:25.883 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2020-10-31T22:50:25.883 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.884 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2020-10-31T22:50:25.884 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-10-31T22:50:25.884 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2020-10-31T22:50:25.884 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2020-10-31T22:50:25.884 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2020-10-31T22:50:25.884 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:25.884 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:25.885 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2020-10-31T22:50:25.885 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.885 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2020-10-31T22:50:25.885 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-10-31T22:50:25.885 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2020-10-31T22:50:25.885 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2020-10-31T22:50:25.886 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2020-10-31T22:50:25.886 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2020-10-31T22:50:25.886 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2020-10-31T22:50:25.886 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:25.886 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2020-10-31T22:50:25.886 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2020-10-31T22:50:25.886 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:25.887 INFO:teuthology.orchestra.run.smithi066.stdout: mon op complaint time = 120 2020-10-31T22:50:25.887 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:25.888 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2020-10-31T22:50:25.888 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2020-10-31T22:50:25.888 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2020-10-31T22:50:25.889 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2020-10-31T22:50:25.889 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-31T22:50:25.889 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-31T22:50:25.889 INFO:teuthology.orchestra.run.smithi066.stdout: client mount timeout = 600 2020-10-31T22:50:25.890 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2020-10-31T22:50:25.890 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-10-31T22:50:25.890 INFO:teuthology.orchestra.run.smithi066.stdout: client debug getattr caps = true 2020-10-31T22:50:25.890 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2020-10-31T22:50:25.890 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2020-10-31T22:50:25.890 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2020-10-31T22:50:25.891 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2020-10-31T22:50:25.891 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2020-10-31T22:50:25.891 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2020-10-31T22:50:25.891 INFO:teuthology.orchestra.run.smithi066.stdout:[mds] 2020-10-31T22:50:25.891 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds = 20 2020-10-31T22:50:25.891 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-10-31T22:50:25.891 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal frag = True 2020-10-31T22:50:25.892 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal fragment size max = 10000 2020-10-31T22:50:25.892 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal merge size = 5 2020-10-31T22:50:25.892 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal split bits = 3 2020-10-31T22:50:25.892 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal split size = 100 2020-10-31T22:50:25.892 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug frag = True 2020-10-31T22:50:25.892 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug scatterstat = True 2020-10-31T22:50:25.892 INFO:teuthology.orchestra.run.smithi066.stdout: mds op complaint time = 180 2020-10-31T22:50:25.893 INFO:teuthology.orchestra.run.smithi066.stdout: mds verify scatter = True 2020-10-31T22:50:25.893 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2020-10-31T22:50:25.893 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2020-10-31T22:50:25.893 INFO:teuthology.orchestra.run.smithi060.stdout: chdir = "" 2020-10-31T22:50:25.893 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-31T22:50:25.893 INFO:teuthology.orchestra.run.smithi060.stdout: auth supported = cephx 2020-10-31T22:50:25.894 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.894 INFO:teuthology.orchestra.run.smithi060.stdout: filestore xattr use omap = true 2020-10-31T22:50:25.894 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.894 INFO:teuthology.orchestra.run.smithi060.stdout: mon clock drift allowed = 1.000 2020-10-31T22:50:25.894 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.894 INFO:teuthology.orchestra.run.smithi060.stdout: osd crush chooseleaf type = 0 2020-10-31T22:50:25.894 INFO:teuthology.orchestra.run.smithi060.stdout: auth debug = true 2020-10-31T22:50:25.895 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.895 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on old message = true 2020-10-31T22:50:25.895 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on bug = true 2020-10-31T22:50:25.895 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.895 INFO:teuthology.orchestra.run.smithi060.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-31T22:50:25.895 INFO:teuthology.orchestra.run.smithi060.stdout: mon pg warn max object skew = 0 2020-10-31T22:50:25.895 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.896 INFO:teuthology.orchestra.run.smithi060.stdout: # disable pg_autoscaler by default for new pools 2020-10-31T22:50:25.896 INFO:teuthology.orchestra.run.smithi060.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-31T22:50:25.896 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.896 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default size = 2 2020-10-31T22:50:25.896 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.898 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow primary affinity = true 2020-10-31T22:50:25.898 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow pg remap = true 2020-10-31T22:50:25.898 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on legacy crush tunables = false 2020-10-31T22:50:25.898 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on crush straw calc version zero = false 2020-10-31T22:50:25.898 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on no sortbitwise = false 2020-10-31T22:50:25.898 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on osd down out interval zero = false 2020-10-31T22:50:25.899 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on too few osds = false 2020-10-31T22:50:25.899 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-31T22:50:25.899 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-31T22:50:25.899 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.899 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-31T22:50:25.899 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.899 INFO:teuthology.orchestra.run.smithi060.stdout: osd default data pool replay window = 5 2020-10-31T22:50:25.900 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.900 INFO:teuthology.orchestra.run.smithi060.stdout: mon allow pool delete = true 2020-10-31T22:50:25.900 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.900 INFO:teuthology.orchestra.run.smithi060.stdout: mon cluster log file level = debug 2020-10-31T22:50:25.900 INFO:teuthology.orchestra.run.smithi060.stdout: debug asserts on shutdown = true 2020-10-31T22:50:25.900 INFO:teuthology.orchestra.run.smithi060.stdout: mon host = "172.21.15.60,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2020-10-31T22:50:25.900 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = 226f905a-1517-4a8c-8009-08779515965c 2020-10-31T22:50:25.901 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.901 INFO:teuthology.orchestra.run.smithi060.stdout:[osd] 2020-10-31T22:50:25.901 INFO:teuthology.orchestra.run.smithi060.stdout: osd journal size = 100 2020-10-31T22:50:25.901 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.901 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub load threshold = 5.0 2020-10-31T22:50:25.901 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub max interval = 600 2020-10-31T22:50:25.901 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.902 INFO:teuthology.orchestra.run.smithi060.stdout: osd recover clone overlap = true 2020-10-31T22:50:25.902 INFO:teuthology.orchestra.run.smithi060.stdout: osd recovery max chunk = 1048576 2020-10-31T22:50:25.902 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.902 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug shutdown = true 2020-10-31T22:50:25.902 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug op order = true 2020-10-31T22:50:25.902 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug verify stray on activate = true 2020-10-31T22:50:25.903 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.903 INFO:teuthology.orchestra.run.smithi060.stdout: osd open classes on start = true 2020-10-31T22:50:25.903 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug pg log writeout = true 2020-10-31T22:50:25.903 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.903 INFO:teuthology.orchestra.run.smithi060.stdout: osd deep scrub update digest min age = 30 2020-10-31T22:50:25.903 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.903 INFO:teuthology.orchestra.run.smithi060.stdout: osd map max advance = 10 2020-10-31T22:50:25.904 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.904 INFO:teuthology.orchestra.run.smithi060.stdout: journal zero on create = true 2020-10-31T22:50:25.904 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.904 INFO:teuthology.orchestra.run.smithi060.stdout: filestore ondisk finisher threads = 3 2020-10-31T22:50:25.904 INFO:teuthology.orchestra.run.smithi060.stdout: filestore apply finisher threads = 3 2020-10-31T22:50:25.904 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.904 INFO:teuthology.orchestra.run.smithi060.stdout: bdev debug aio = true 2020-10-31T22:50:25.905 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug misdirected ops = true 2020-10-31T22:50:25.905 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore block size = 96636764160 2020-10-31T22:50:25.905 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore compression mode = aggressive 2020-10-31T22:50:25.905 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore fsck on mount = True 2020-10-31T22:50:25.905 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluefs = 20 2020-10-31T22:50:25.905 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluestore = 20 2020-10-31T22:50:25.905 INFO:teuthology.orchestra.run.smithi060.stdout: debug filestore = 20 2020-10-31T22:50:25.906 INFO:teuthology.orchestra.run.smithi060.stdout: debug journal = 20 2020-10-31T22:50:25.906 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 20 2020-10-31T22:50:25.906 INFO:teuthology.orchestra.run.smithi060.stdout: debug osd = 25 2020-10-31T22:50:25.906 INFO:teuthology.orchestra.run.smithi060.stdout: debug rocksdb = 10 2020-10-31T22:50:25.906 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd backfillfull_ratio = 0.85 2020-10-31T22:50:25.906 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd full ratio = 0.9 2020-10-31T22:50:25.906 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd nearfull ratio = 0.8 2020-10-31T22:50:25.907 INFO:teuthology.orchestra.run.smithi060.stdout: osd failsafe full ratio = 0.95 2020-10-31T22:50:25.907 INFO:teuthology.orchestra.run.smithi060.stdout: osd objectstore = bluestore 2020-10-31T22:50:25.907 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2020-10-31T22:50:25.907 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.907 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr] 2020-10-31T22:50:25.907 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2020-10-31T22:50:25.907 INFO:teuthology.orchestra.run.smithi060.stdout: debug mgr = 20 2020-10-31T22:50:25.908 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2020-10-31T22:50:25.908 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2020-10-31T22:50:25.908 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:25.909 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:25.909 INFO:teuthology.orchestra.run.smithi060.stdout: mgr/telemetry/nag = false 2020-10-31T22:50:25.909 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.909 INFO:teuthology.orchestra.run.smithi060.stdout:[mon] 2020-10-31T22:50:25.910 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2020-10-31T22:50:25.910 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2020-10-31T22:50:25.910 INFO:teuthology.orchestra.run.smithi060.stdout: debug paxos = 20 2020-10-31T22:50:25.910 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2020-10-31T22:50:25.910 INFO:teuthology.orchestra.run.smithi060.stdout: mon data avail warn = 5 2020-10-31T22:50:25.911 INFO:teuthology.orchestra.run.smithi060.stdout: mon mgr mkfs grace = 240 2020-10-31T22:50:25.911 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:25.911 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd reporter subtree level = osd 2020-10-31T22:50:25.911 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd prime pg temp = true 2020-10-31T22:50:25.911 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:25.911 INFO:teuthology.orchestra.run.smithi060.stdout: mon op complaint time = 120 2020-10-31T22:50:25.912 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:25.912 INFO:teuthology.orchestra.run.smithi060.stdout:[client] 2020-10-31T22:50:25.912 INFO:teuthology.orchestra.run.smithi060.stdout: rgw cache enabled = true 2020-10-31T22:50:25.912 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable ops log = true 2020-10-31T22:50:25.912 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable usage log = true 2020-10-31T22:50:25.912 INFO:teuthology.orchestra.run.smithi060.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-31T22:50:25.912 INFO:teuthology.orchestra.run.smithi060.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-31T22:50:25.913 INFO:teuthology.orchestra.run.smithi060.stdout: client mount timeout = 600 2020-10-31T22:50:25.913 INFO:teuthology.orchestra.run.smithi060.stdout: debug client = 20 2020-10-31T22:50:25.913 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2020-10-31T22:50:25.913 INFO:teuthology.orchestra.run.smithi060.stdout: client debug getattr caps = true 2020-10-31T22:50:25.913 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.a] 2020-10-31T22:50:25.913 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.b] 2020-10-31T22:50:25.913 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.c] 2020-10-31T22:50:25.914 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2020-10-31T22:50:25.914 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2020-10-31T22:50:25.914 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2020-10-31T22:50:25.914 INFO:teuthology.orchestra.run.smithi060.stdout:[mds] 2020-10-31T22:50:25.915 INFO:teuthology.orchestra.run.smithi060.stdout: debug mds = 20 2020-10-31T22:50:25.915 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2020-10-31T22:50:25.915 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal frag = True 2020-10-31T22:50:25.915 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal fragment size max = 10000 2020-10-31T22:50:25.915 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal merge size = 5 2020-10-31T22:50:25.915 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal split bits = 3 2020-10-31T22:50:25.915 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal split size = 100 2020-10-31T22:50:25.916 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug frag = True 2020-10-31T22:50:25.916 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug scatterstat = True 2020-10-31T22:50:25.918 INFO:teuthology.orchestra.run.smithi060.stdout: mds op complaint time = 180 2020-10-31T22:50:25.918 INFO:teuthology.orchestra.run.smithi060.stdout: mds verify scatter = True 2020-10-31T22:50:25.918 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2020-10-31T22:50:25.920 INFO:teuthology.orchestra.run.smithi085.stdout:[global] 2020-10-31T22:50:25.921 INFO:teuthology.orchestra.run.smithi085.stdout: chdir = "" 2020-10-31T22:50:25.921 INFO:teuthology.orchestra.run.smithi085.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-31T22:50:25.921 INFO:teuthology.orchestra.run.smithi085.stdout: auth supported = cephx 2020-10-31T22:50:25.921 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.921 INFO:teuthology.orchestra.run.smithi085.stdout: filestore xattr use omap = true 2020-10-31T22:50:25.922 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.922 INFO:teuthology.orchestra.run.smithi085.stdout: mon clock drift allowed = 1.000 2020-10-31T22:50:25.922 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.922 INFO:teuthology.orchestra.run.smithi085.stdout: osd crush chooseleaf type = 0 2020-10-31T22:50:25.922 INFO:teuthology.orchestra.run.smithi085.stdout: auth debug = true 2020-10-31T22:50:25.922 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.923 INFO:teuthology.orchestra.run.smithi085.stdout: ms die on old message = true 2020-10-31T22:50:25.923 INFO:teuthology.orchestra.run.smithi085.stdout: ms die on bug = true 2020-10-31T22:50:25.923 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.923 INFO:teuthology.orchestra.run.smithi085.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-31T22:50:25.923 INFO:teuthology.orchestra.run.smithi085.stdout: mon pg warn max object skew = 0 2020-10-31T22:50:25.923 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.923 INFO:teuthology.orchestra.run.smithi085.stdout: # disable pg_autoscaler by default for new pools 2020-10-31T22:50:25.924 INFO:teuthology.orchestra.run.smithi085.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-31T22:50:25.924 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.924 INFO:teuthology.orchestra.run.smithi085.stdout: osd pool default size = 2 2020-10-31T22:50:25.924 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.924 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd allow primary affinity = true 2020-10-31T22:50:25.924 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd allow pg remap = true 2020-10-31T22:50:25.924 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on legacy crush tunables = false 2020-10-31T22:50:25.925 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on crush straw calc version zero = false 2020-10-31T22:50:25.925 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on no sortbitwise = false 2020-10-31T22:50:25.925 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on osd down out interval zero = false 2020-10-31T22:50:25.925 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on too few osds = false 2020-10-31T22:50:25.925 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-31T22:50:25.925 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-31T22:50:25.925 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.925 INFO:teuthology.orchestra.run.smithi085.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-31T22:50:25.926 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.926 INFO:teuthology.orchestra.run.smithi085.stdout: osd default data pool replay window = 5 2020-10-31T22:50:25.926 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.926 INFO:teuthology.orchestra.run.smithi085.stdout: mon allow pool delete = true 2020-10-31T22:50:25.926 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.926 INFO:teuthology.orchestra.run.smithi085.stdout: mon cluster log file level = debug 2020-10-31T22:50:25.927 INFO:teuthology.orchestra.run.smithi085.stdout: debug asserts on shutdown = true 2020-10-31T22:50:25.927 INFO:teuthology.orchestra.run.smithi085.stdout: mon host = "172.21.15.60,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2020-10-31T22:50:25.927 INFO:teuthology.orchestra.run.smithi085.stdout: fsid = 226f905a-1517-4a8c-8009-08779515965c 2020-10-31T22:50:25.927 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.927 INFO:teuthology.orchestra.run.smithi085.stdout:[osd] 2020-10-31T22:50:25.927 INFO:teuthology.orchestra.run.smithi085.stdout: osd journal size = 100 2020-10-31T22:50:25.928 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.928 INFO:teuthology.orchestra.run.smithi085.stdout: osd scrub load threshold = 5.0 2020-10-31T22:50:25.928 INFO:teuthology.orchestra.run.smithi085.stdout: osd scrub max interval = 600 2020-10-31T22:50:25.928 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.928 INFO:teuthology.orchestra.run.smithi085.stdout: osd recover clone overlap = true 2020-10-31T22:50:25.928 INFO:teuthology.orchestra.run.smithi085.stdout: osd recovery max chunk = 1048576 2020-10-31T22:50:25.928 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.929 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug shutdown = true 2020-10-31T22:50:25.929 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug op order = true 2020-10-31T22:50:25.929 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug verify stray on activate = true 2020-10-31T22:50:25.929 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.929 INFO:teuthology.orchestra.run.smithi085.stdout: osd open classes on start = true 2020-10-31T22:50:25.929 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug pg log writeout = true 2020-10-31T22:50:25.929 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.930 INFO:teuthology.orchestra.run.smithi085.stdout: osd deep scrub update digest min age = 30 2020-10-31T22:50:25.930 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.930 INFO:teuthology.orchestra.run.smithi085.stdout: osd map max advance = 10 2020-10-31T22:50:25.930 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.930 INFO:teuthology.orchestra.run.smithi085.stdout: journal zero on create = true 2020-10-31T22:50:25.931 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.931 INFO:teuthology.orchestra.run.smithi085.stdout: filestore ondisk finisher threads = 3 2020-10-31T22:50:25.931 INFO:teuthology.orchestra.run.smithi085.stdout: filestore apply finisher threads = 3 2020-10-31T22:50:25.931 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.931 INFO:teuthology.orchestra.run.smithi085.stdout: bdev debug aio = true 2020-10-31T22:50:25.931 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug misdirected ops = true 2020-10-31T22:50:25.932 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore block size = 96636764160 2020-10-31T22:50:25.932 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore compression mode = aggressive 2020-10-31T22:50:25.932 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore fsck on mount = True 2020-10-31T22:50:25.932 INFO:teuthology.orchestra.run.smithi085.stdout: debug bluefs = 20 2020-10-31T22:50:25.932 INFO:teuthology.orchestra.run.smithi085.stdout: debug bluestore = 20 2020-10-31T22:50:25.932 INFO:teuthology.orchestra.run.smithi085.stdout: debug filestore = 20 2020-10-31T22:50:25.933 INFO:teuthology.orchestra.run.smithi085.stdout: debug journal = 20 2020-10-31T22:50:25.933 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 20 2020-10-31T22:50:25.933 INFO:teuthology.orchestra.run.smithi085.stdout: debug osd = 25 2020-10-31T22:50:25.933 INFO:teuthology.orchestra.run.smithi085.stdout: debug rocksdb = 10 2020-10-31T22:50:25.933 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd backfillfull_ratio = 0.85 2020-10-31T22:50:25.933 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd full ratio = 0.9 2020-10-31T22:50:25.933 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd nearfull ratio = 0.8 2020-10-31T22:50:25.933 INFO:teuthology.orchestra.run.smithi085.stdout: osd failsafe full ratio = 0.95 2020-10-31T22:50:25.934 INFO:teuthology.orchestra.run.smithi085.stdout: osd objectstore = bluestore 2020-10-31T22:50:25.934 INFO:teuthology.orchestra.run.smithi085.stdout: osd op complaint time = 180 2020-10-31T22:50:25.934 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.934 INFO:teuthology.orchestra.run.smithi085.stdout:[mgr] 2020-10-31T22:50:25.934 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2020-10-31T22:50:25.934 INFO:teuthology.orchestra.run.smithi085.stdout: debug mgr = 20 2020-10-31T22:50:25.935 INFO:teuthology.orchestra.run.smithi085.stdout: debug mon = 20 2020-10-31T22:50:25.935 INFO:teuthology.orchestra.run.smithi085.stdout: debug auth = 20 2020-10-31T22:50:25.935 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:25.935 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:25.935 INFO:teuthology.orchestra.run.smithi085.stdout: mgr/telemetry/nag = false 2020-10-31T22:50:25.935 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.935 INFO:teuthology.orchestra.run.smithi085.stdout:[mon] 2020-10-31T22:50:25.935 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2020-10-31T22:50:25.936 INFO:teuthology.orchestra.run.smithi085.stdout: debug mon = 20 2020-10-31T22:50:25.936 INFO:teuthology.orchestra.run.smithi085.stdout: debug paxos = 20 2020-10-31T22:50:25.936 INFO:teuthology.orchestra.run.smithi085.stdout: debug auth = 20 2020-10-31T22:50:25.936 INFO:teuthology.orchestra.run.smithi085.stdout: mon data avail warn = 5 2020-10-31T22:50:25.936 INFO:teuthology.orchestra.run.smithi085.stdout: mon mgr mkfs grace = 240 2020-10-31T22:50:25.937 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:25.937 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd reporter subtree level = osd 2020-10-31T22:50:25.937 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd prime pg temp = true 2020-10-31T22:50:25.937 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:25.937 INFO:teuthology.orchestra.run.smithi085.stdout: mon op complaint time = 120 2020-10-31T22:50:25.937 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:25.937 INFO:teuthology.orchestra.run.smithi085.stdout:[client] 2020-10-31T22:50:25.938 INFO:teuthology.orchestra.run.smithi085.stdout: rgw cache enabled = true 2020-10-31T22:50:25.938 INFO:teuthology.orchestra.run.smithi085.stdout: rgw enable ops log = true 2020-10-31T22:50:25.938 INFO:teuthology.orchestra.run.smithi085.stdout: rgw enable usage log = true 2020-10-31T22:50:25.938 INFO:teuthology.orchestra.run.smithi085.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-31T22:50:25.938 INFO:teuthology.orchestra.run.smithi085.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-31T22:50:25.938 INFO:teuthology.orchestra.run.smithi085.stdout: client mount timeout = 600 2020-10-31T22:50:25.939 INFO:teuthology.orchestra.run.smithi085.stdout: debug client = 20 2020-10-31T22:50:25.939 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2020-10-31T22:50:25.939 INFO:teuthology.orchestra.run.smithi085.stdout: client debug getattr caps = true 2020-10-31T22:50:25.939 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.a] 2020-10-31T22:50:25.939 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.b] 2020-10-31T22:50:25.939 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.c] 2020-10-31T22:50:25.939 INFO:teuthology.orchestra.run.smithi085.stdout:[mds.a] 2020-10-31T22:50:25.940 INFO:teuthology.orchestra.run.smithi085.stdout:[mds.c] 2020-10-31T22:50:25.940 INFO:teuthology.orchestra.run.smithi085.stdout:[mds.b] 2020-10-31T22:50:25.940 INFO:teuthology.orchestra.run.smithi085.stdout:[mds] 2020-10-31T22:50:25.940 INFO:teuthology.orchestra.run.smithi085.stdout: debug mds = 20 2020-10-31T22:50:25.940 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2020-10-31T22:50:25.941 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal frag = True 2020-10-31T22:50:25.941 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal fragment size max = 10000 2020-10-31T22:50:25.941 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal merge size = 5 2020-10-31T22:50:25.941 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal split bits = 3 2020-10-31T22:50:25.941 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal split size = 100 2020-10-31T22:50:25.942 INFO:teuthology.orchestra.run.smithi085.stdout: mds debug frag = True 2020-10-31T22:50:25.942 INFO:teuthology.orchestra.run.smithi085.stdout: mds debug scatterstat = True 2020-10-31T22:50:25.942 INFO:teuthology.orchestra.run.smithi085.stdout: mds op complaint time = 180 2020-10-31T22:50:25.942 INFO:teuthology.orchestra.run.smithi085.stdout: mds verify scatter = True 2020-10-31T22:50:25.943 INFO:teuthology.orchestra.run.smithi085.stdout: osd op complaint time = 180 2020-10-31T22:50:25.943 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2020-10-31T22:50:25.943 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2020-10-31T22:50:25.944 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-31T22:50:25.944 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2020-10-31T22:50:25.944 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.944 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2020-10-31T22:50:25.945 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.945 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2020-10-31T22:50:25.945 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.946 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2020-10-31T22:50:25.946 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2020-10-31T22:50:25.946 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.946 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2020-10-31T22:50:25.946 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2020-10-31T22:50:25.947 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.947 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-31T22:50:25.947 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2020-10-31T22:50:25.947 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.947 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2020-10-31T22:50:25.947 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-31T22:50:25.947 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.948 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2020-10-31T22:50:25.948 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.948 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2020-10-31T22:50:25.948 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2020-10-31T22:50:25.948 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2020-10-31T22:50:25.948 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2020-10-31T22:50:25.948 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2020-10-31T22:50:25.949 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2020-10-31T22:50:25.949 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2020-10-31T22:50:25.949 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-31T22:50:25.949 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-31T22:50:25.949 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.949 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-31T22:50:25.949 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.950 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2020-10-31T22:50:25.950 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.950 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2020-10-31T22:50:25.950 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.950 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2020-10-31T22:50:25.950 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2020-10-31T22:50:25.950 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "172.21.15.60,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2020-10-31T22:50:25.951 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = 226f905a-1517-4a8c-8009-08779515965c 2020-10-31T22:50:25.951 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.951 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2020-10-31T22:50:25.951 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2020-10-31T22:50:25.951 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.951 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2020-10-31T22:50:25.952 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2020-10-31T22:50:25.952 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.952 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2020-10-31T22:50:25.952 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2020-10-31T22:50:25.953 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.953 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2020-10-31T22:50:25.953 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2020-10-31T22:50:25.953 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2020-10-31T22:50:25.954 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.954 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2020-10-31T22:50:25.954 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2020-10-31T22:50:25.954 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.955 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2020-10-31T22:50:25.955 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.955 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2020-10-31T22:50:25.955 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.955 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2020-10-31T22:50:25.955 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.956 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2020-10-31T22:50:25.956 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2020-10-31T22:50:25.956 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.956 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2020-10-31T22:50:25.956 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2020-10-31T22:50:25.956 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2020-10-31T22:50:25.956 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore compression mode = aggressive 2020-10-31T22:50:25.956 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2020-10-31T22:50:25.957 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 20 2020-10-31T22:50:25.957 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 20 2020-10-31T22:50:25.957 INFO:teuthology.orchestra.run.smithi152.stdout: debug filestore = 20 2020-10-31T22:50:25.957 INFO:teuthology.orchestra.run.smithi152.stdout: debug journal = 20 2020-10-31T22:50:25.957 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 20 2020-10-31T22:50:25.957 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 25 2020-10-31T22:50:25.957 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 10 2020-10-31T22:50:25.958 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2020-10-31T22:50:25.958 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2020-10-31T22:50:25.958 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2020-10-31T22:50:25.958 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2020-10-31T22:50:25.958 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2020-10-31T22:50:25.958 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2020-10-31T22:50:25.958 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.959 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2020-10-31T22:50:25.959 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2020-10-31T22:50:25.959 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2020-10-31T22:50:25.959 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2020-10-31T22:50:25.959 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2020-10-31T22:50:25.959 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:25.959 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:25.959 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2020-10-31T22:50:25.960 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.960 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2020-10-31T22:50:25.960 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2020-10-31T22:50:25.960 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2020-10-31T22:50:25.960 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2020-10-31T22:50:25.960 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2020-10-31T22:50:25.960 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2020-10-31T22:50:25.961 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2020-10-31T22:50:25.961 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:25.961 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2020-10-31T22:50:25.961 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2020-10-31T22:50:25.961 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:25.961 INFO:teuthology.orchestra.run.smithi152.stdout: mon op complaint time = 120 2020-10-31T22:50:25.961 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:25.962 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2020-10-31T22:50:25.962 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2020-10-31T22:50:25.962 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2020-10-31T22:50:25.962 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2020-10-31T22:50:25.962 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-31T22:50:25.963 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-31T22:50:25.963 INFO:teuthology.orchestra.run.smithi152.stdout: client mount timeout = 600 2020-10-31T22:50:25.963 INFO:teuthology.orchestra.run.smithi152.stdout: debug client = 20 2020-10-31T22:50:25.963 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2020-10-31T22:50:25.963 INFO:teuthology.orchestra.run.smithi152.stdout: client debug getattr caps = true 2020-10-31T22:50:25.963 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2020-10-31T22:50:25.963 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2020-10-31T22:50:25.964 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2020-10-31T22:50:25.964 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2020-10-31T22:50:25.964 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2020-10-31T22:50:25.964 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2020-10-31T22:50:25.964 INFO:teuthology.orchestra.run.smithi152.stdout:[mds] 2020-10-31T22:50:25.964 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds = 20 2020-10-31T22:50:25.964 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2020-10-31T22:50:25.964 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal frag = True 2020-10-31T22:50:25.965 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal fragment size max = 10000 2020-10-31T22:50:25.965 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal merge size = 5 2020-10-31T22:50:25.965 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal split bits = 3 2020-10-31T22:50:25.966 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal split size = 100 2020-10-31T22:50:25.966 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug frag = True 2020-10-31T22:50:25.966 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug scatterstat = True 2020-10-31T22:50:25.966 INFO:teuthology.orchestra.run.smithi152.stdout: mds op complaint time = 180 2020-10-31T22:50:25.966 INFO:teuthology.orchestra.run.smithi152.stdout: mds verify scatter = True 2020-10-31T22:50:25.967 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2020-10-31T22:50:25.967 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:50:26.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119359e700 1 Processor -- start 2020-10-31T22:50:26.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119359e700 1 -- start start 2020-10-31T22:50:26.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119359e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f11940af970 0x7f11940aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119359e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11940afd50 con 0x7f11940aee60 2020-10-31T22:50:26.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119359e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11940aae50 con 0x7f11940ad6f0 2020-10-31T22:50:26.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119359e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11940ab3a0 con 0x7f11940af970 2020-10-31T22:50:26.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f1191d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f11940aee60 0x7f11940acfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53222/0 (socket says 172.21.15.60:53222) 2020-10-31T22:50:26.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f1191d9b700 1 -- 172.21.15.60:0/2282063613 learned_addr learned my addr 172.21.15.60:0/2282063613 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:26.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119259c700 1 --2- 172.21.15.60:0/2282063613 >> v2:172.21.15.66:3300/0 conn(0x7f11940af970 0x7f11940aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119159a700 1 -- 172.21.15.60:0/2282063613 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 729523984 0 0) 0x7f11940afd50 con 0x7f11940aee60 2020-10-31T22:50:26.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119159a700 1 -- 172.21.15.60:0/2282063613 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1178003230 con 0x7f11940aee60 2020-10-31T22:50:26.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119259c700 1 -- 172.21.15.60:0/2282063613 >> v1:172.21.15.66:6789/0 conn(0x7f11940ad6f0 legacy=0x7f1194142fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119259c700 1 -- 172.21.15.60:0/2282063613 >> v1:172.21.15.60:6789/0 conn(0x7f11940aee60 legacy=0x7f11940acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119159a700 1 -- 172.21.15.60:0/2282063613 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 40878100 0 0) 0x7f1178003230 con 0x7f11940aee60 2020-10-31T22:50:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119259c700 1 -- 172.21.15.60:0/2282063613 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11940ab640 con 0x7f11940af970 2020-10-31T22:50:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119259c700 1 --2- 172.21.15.60:0/2282063613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11940af970 0x7f11940aa960 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f1188001870 tx=0x7f118c0091a0).ready entity=mon.1 client_cookie=9802686a2c2315c1 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119159a700 1 -- 172.21.15.60:0/2282063613 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f11880016d0 con 0x7f11940af970 2020-10-31T22:50:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119159a700 1 -- 172.21.15.60:0/2282063613 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118c00b860 con 0x7f11940af970 2020-10-31T22:50:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119159a700 1 -- 172.21.15.60:0/2282063613 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118c00b9d0 con 0x7f11940af970 2020-10-31T22:50:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119359e700 1 -- 172.21.15.60:0/2282063613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11940af970 msgr2=0x7f11940aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119359e700 1 --2- 172.21.15.60:0/2282063613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11940af970 0x7f11940aa960 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f1188001870 tx=0x7f118c0091a0).stop 2020-10-31T22:50:26.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119359e700 1 -- 172.21.15.60:0/2282063613 shutdown_connections 2020-10-31T22:50:26.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119359e700 1 --2- 172.21.15.60:0/2282063613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11940af970 0x7f11940aa960 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119359e700 1 -- 172.21.15.60:0/2282063613 >> 172.21.15.60:0/2282063613 conn(0x7f1194061ae0 msgr2=0x7f1194061ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:26.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119359e700 1 -- 172.21.15.60:0/2282063613 shutdown_connections 2020-10-31T22:50:26.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.085+0000 7f119359e700 1 -- 172.21.15.60:0/2282063613 wait complete. 2020-10-31T22:50:26.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119359e700 1 Processor -- start 2020-10-31T22:50:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119359e700 1 -- start start 2020-10-31T22:50:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119359e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940ad6f0 0x7f11940aa6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11940aee60 0x7f11940b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119359e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11940af970 0x7f1194155230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119359e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1194064120 con 0x7f11940ad6f0 2020-10-31T22:50:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11940a7980 con 0x7f11940aee60 2020-10-31T22:50:26.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119359e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11940a8390 con 0x7f11940af970 2020-10-31T22:50:26.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940ad6f0 0x7f11940aa6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119259c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940ad6f0 0x7f11940aa6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49090/0 (socket says 172.21.15.60:49090) 2020-10-31T22:50:26.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119259c700 1 -- 172.21.15.60:0/507550860 learned_addr learned my addr 172.21.15.60:0/507550860 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:26.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f1191d9b700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11940aee60 0x7f11940b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f1192d9d700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11940af970 0x7f1194155230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119259c700 1 -- 172.21.15.60:0/507550860 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11940af970 msgr2=0x7f1194155230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119259c700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11940af970 0x7f1194155230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119259c700 1 -- 172.21.15.60:0/507550860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11940aee60 msgr2=0x7f11940b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119259c700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11940aee60 0x7f11940b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119259c700 1 -- 172.21.15.60:0/507550860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11940a7bb0 con 0x7f11940ad6f0 2020-10-31T22:50:26.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f1192d9d700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11940af970 0x7f1194155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:50:26.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f1191d9b700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11940aee60 0x7f11940b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:50:26.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119259c700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940ad6f0 0x7f11940aa6a0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f1194062f20 tx=0x7f118c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:26.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f11837fe700 1 -- 172.21.15.60:0/507550860 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118c0203f0 con 0x7f11940ad6f0 2020-10-31T22:50:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f11837fe700 1 -- 172.21.15.60:0/507550860 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118c020550 con 0x7f11940ad6f0 2020-10-31T22:50:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f11837fe700 1 -- 172.21.15.60:0/507550860 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f118c0208b0 con 0x7f11940ad6f0 2020-10-31T22:50:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119359e700 1 -- 172.21.15.60:0/507550860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11940a7e50 con 0x7f11940ad6f0 2020-10-31T22:50:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.089+0000 7f119359e700 1 -- 172.21.15.60:0/507550860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11940a86f0 con 0x7f11940ad6f0 2020-10-31T22:50:26.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.093+0000 7f119359e700 1 -- 172.21.15.60:0/507550860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1194154f70 con 0x7f11940ad6f0 2020-10-31T22:50:26.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.093+0000 7f11837fe700 1 -- 172.21.15.60:0/507550860 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f118c01e070 con 0x7f11940ad6f0 2020-10-31T22:50:26.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.093+0000 7f11837fe700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1170055020 0x7f11700574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.093+0000 7f11837fe700 1 -- 172.21.15.60:0/507550860 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f118c06e9b0 con 0x7f11940ad6f0 2020-10-31T22:50:26.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.093+0000 7f1191d9b700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1170055020 0x7f11700574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.102 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.093+0000 7f1191d9b700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1170055020 0x7f11700574e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f1188008000 tx=0x7f1188009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:26.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.097+0000 7f11837fe700 1 -- 172.21.15.60:0/507550860 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1194154f70 con 0x7f11940ad6f0 2020-10-31T22:50:26.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.245+0000 7f119359e700 1 -- 172.21.15.60:0/507550860 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1194057100 con 0x7f11940ad6f0 2020-10-31T22:50:26.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.245+0000 7f11837fe700 1 -- 172.21.15.60:0/507550860 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f118c031ed0 con 0x7f11940ad6f0 2020-10-31T22:50:26.251 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:26.251 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":139,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:50:15.235473+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":25,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:50:11.956893+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":26,"pool_name":"cephfs_data","create_time":"2020-10-31T22:50:13.235442+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:50:26.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.245+0000 7f119359e700 1 -- 172.21.15.60:0/507550860 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1170055020 msgr2=0x7f11700574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.245+0000 7f119359e700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1170055020 0x7f11700574e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7f1188008000 tx=0x7f1188009040).stop 2020-10-31T22:50:26.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.245+0000 7f119359e700 1 -- 172.21.15.60:0/507550860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940ad6f0 msgr2=0x7f11940aa6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.245+0000 7f119359e700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940ad6f0 0x7f11940aa6a0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 rx=0x7f1194062f20 tx=0x7f118c016000).stop 2020-10-31T22:50:26.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.249+0000 7f119359e700 1 -- 172.21.15.60:0/507550860 shutdown_connections 2020-10-31T22:50:26.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.249+0000 7f119359e700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f11940af970 0x7f1194155230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.249+0000 7f119359e700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11940ad6f0 0x7f11940aa6a0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.249+0000 7f119359e700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1170055020 0x7f11700574e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.249+0000 7f119359e700 1 --2- 172.21.15.60:0/507550860 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11940aee60 0x7f11940b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.249+0000 7f119359e700 1 -- 172.21.15.60:0/507550860 >> 172.21.15.60:0/507550860 conn(0x7f1194061ae0 msgr2=0x7f119405ba90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:26.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.249+0000 7f119359e700 1 -- 172.21.15.60:0/507550860 shutdown_connections 2020-10-31T22:50:26.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.249+0000 7f119359e700 1 -- 172.21.15.60:0/507550860 wait complete. 2020-10-31T22:50:26.265 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 25, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:50:11.956893+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '138', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 26, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:50:13.235442+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '139', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:50:26.266 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:50:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.373+0000 7f2f1a8f2700 1 Processor -- start 2020-10-31T22:50:26.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.373+0000 7f2f1a8f2700 1 -- start start 2020-10-31T22:50:26.384 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f14062de0 0x7f2f140631c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f140b1c50 0x7f2f14145df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2f1413f090 0x7f2f1413f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f141462e0 con 0x7f2f140b1c50 2020-10-31T22:50:26.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f1413fa10 con 0x7f2f1413f090 2020-10-31T22:50:26.386 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f140a8e50 con 0x7f2f14062de0 2020-10-31T22:50:26.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f190ef700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f140b1c50 0x7f2f14145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f190ef700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2f140b1c50 0x7f2f14145df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49098/0 (socket says 172.21.15.60:49098) 2020-10-31T22:50:26.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f190ef700 1 -- 172.21.15.60:0/512055417 learned_addr learned my addr 172.21.15.60:0/512055417 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:26.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f198f0700 1 --2- 172.21.15.60:0/512055417 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f14062de0 0x7f2f140631c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a0f1700 1 --2- 172.21.15.60:0/512055417 >> v2:172.21.15.66:3300/0 conn(0x7f2f1413f090 0x7f2f1413f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f190ef700 1 -- 172.21.15.60:0/512055417 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f14062de0 msgr2=0x7f2f140631c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:26.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f190ef700 1 --2- 172.21.15.60:0/512055417 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f14062de0 0x7f2f140631c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f190ef700 1 -- 172.21.15.60:0/512055417 >> v2:172.21.15.66:3300/0 conn(0x7f2f1413f090 msgr2=0x7f2f1413f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:26.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f190ef700 1 --2- 172.21.15.60:0/512055417 >> v2:172.21.15.66:3300/0 conn(0x7f2f1413f090 0x7f2f1413f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f190ef700 1 -- 172.21.15.60:0/512055417 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f14141f20 con 0x7f2f140b1c50 2020-10-31T22:50:26.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a0f1700 1 --2- 172.21.15.60:0/512055417 >> v2:172.21.15.66:3300/0 conn(0x7f2f1413f090 0x7f2f1413f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:50:26.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f190ef700 1 --2- 172.21.15.60:0/512055417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f140b1c50 0x7f2f14145df0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f2f08002f30 tx=0x7f2f08006e80).ready entity=mon.0 client_cookie=5b9846546602f67a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:26.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f188ee700 1 -- 172.21.15.60:0/512055417 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f080097f0 con 0x7f2f140b1c50 2020-10-31T22:50:26.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f188ee700 1 -- 172.21.15.60:0/512055417 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f08009950 con 0x7f2f140b1c50 2020-10-31T22:50:26.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f188ee700 1 -- 172.21.15.60:0/512055417 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f08009cb0 con 0x7f2f140b1c50 2020-10-31T22:50:26.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/512055417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f140b1c50 msgr2=0x7f2f14145df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 --2- 172.21.15.60:0/512055417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f140b1c50 0x7f2f14145df0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 rx=0x7f2f08002f30 tx=0x7f2f08006e80).stop 2020-10-31T22:50:26.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/512055417 shutdown_connections 2020-10-31T22:50:26.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 --2- 172.21.15.60:0/512055417 >> v2:172.21.15.66:3300/0 conn(0x7f2f1413f090 0x7f2f1413f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 --2- 172.21.15.60:0/512055417 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f14062de0 0x7f2f140631c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 --2- 172.21.15.60:0/512055417 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f140b1c50 0x7f2f14145df0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/512055417 >> 172.21.15.60:0/512055417 conn(0x7f2f1405fc80 msgr2=0x7f2f1406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:26.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/512055417 shutdown_connections 2020-10-31T22:50:26.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/512055417 wait complete. 2020-10-31T22:50:26.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 Processor -- start 2020-10-31T22:50:26.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.377+0000 7f2f1a8f2700 1 -- start start 2020-10-31T22:50:26.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f1a8f2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f14062de0 0x7f2f140a9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f1a8f2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f140b1c50 0x7f2f14147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f1a8f2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f1413f090 0x7f2f140aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f1a8f2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f14150d00 con 0x7f2f140b1c50 2020-10-31T22:50:26.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f1a8f2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f14150fa0 con 0x7f2f14062de0 2020-10-31T22:50:26.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f1a8f2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f14151240 con 0x7f2f1413f090 2020-10-31T22:50:26.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f190ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f140b1c50 0x7f2f14147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f198f0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f14062de0 0x7f2f140a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f198f0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f14062de0 0x7f2f140a9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:60040/0 (socket says 172.21.15.60:60040) 2020-10-31T22:50:26.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f190ef700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f140b1c50 0x7f2f14147790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49106/0 (socket says 172.21.15.60:49106) 2020-10-31T22:50:26.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f198f0700 1 -- 172.21.15.60:0/3413111604 learned_addr learned my addr 172.21.15.60:0/3413111604 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:26.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f1a0f1700 1 --2- 172.21.15.60:0/3413111604 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f1413f090 0x7f2f140aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f190ef700 1 -- 172.21.15.60:0/3413111604 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f1413f090 msgr2=0x7f2f140aa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f190ef700 1 --2- 172.21.15.60:0/3413111604 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f1413f090 0x7f2f140aa7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f190ef700 1 -- 172.21.15.60:0/3413111604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f14062de0 msgr2=0x7f2f140a9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f190ef700 1 --2- 172.21.15.60:0/3413111604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f14062de0 0x7f2f140a9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f190ef700 1 -- 172.21.15.60:0/3413111604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f141514e0 con 0x7f2f140b1c50 2020-10-31T22:50:26.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f190ef700 1 --2- 172.21.15.60:0/3413111604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f140b1c50 0x7f2f14147790 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f2f08002f30 tx=0x7f2f08015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:26.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f06ffd700 1 -- 172.21.15.60:0/3413111604 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f08011c50 con 0x7f2f140b1c50 2020-10-31T22:50:26.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/3413111604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f14148370 con 0x7f2f140b1c50 2020-10-31T22:50:26.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f06ffd700 1 -- 172.21.15.60:0/3413111604 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f08011db0 con 0x7f2f140b1c50 2020-10-31T22:50:26.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f06ffd700 1 -- 172.21.15.60:0/3413111604 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2f0801e650 con 0x7f2f140b1c50 2020-10-31T22:50:26.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.381+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/3413111604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f14148ff0 con 0x7f2f140b1c50 2020-10-31T22:50:26.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.385+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/3413111604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f14057100 con 0x7f2f140b1c50 2020-10-31T22:50:26.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.385+0000 7f2f06ffd700 1 -- 172.21.15.60:0/3413111604 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2f0801a040 con 0x7f2f140b1c50 2020-10-31T22:50:26.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.385+0000 7f2f06ffd700 1 --2- 172.21.15.60:0/3413111604 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ef4054fd0 0x7f2ef4057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.385+0000 7f2f06ffd700 1 -- 172.21.15.60:0/3413111604 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2f0806e980 con 0x7f2f140b1c50 2020-10-31T22:50:26.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.385+0000 7f2f198f0700 1 --2- 172.21.15.60:0/3413111604 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ef4054fd0 0x7f2ef4057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.385+0000 7f2f198f0700 1 --2- 172.21.15.60:0/3413111604 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ef4054fd0 0x7f2ef4057490 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f2f10008000 tx=0x7f2f10008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:26.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.393+0000 7f2f06ffd700 1 -- 172.21.15.60:0/3413111604 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2f08044dc0 con 0x7f2f140b1c50 2020-10-31T22:50:26.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.537+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/3413111604 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2f14151670 con 0x7f2f140b1c50 2020-10-31T22:50:26.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.537+0000 7f2f06ffd700 1 -- 172.21.15.60:0/3413111604 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v139) v1 ==== 110+0+10 (secure 0 0 0) 0x7f2f080230b0 con 0x7f2f140b1c50 2020-10-31T22:50:26.543 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:50:26.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.541+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/3413111604 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ef4054fd0 msgr2=0x7f2ef4057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.541+0000 7f2f1a8f2700 1 --2- 172.21.15.60:0/3413111604 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ef4054fd0 0x7f2ef4057490 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f2f10008000 tx=0x7f2f10008040).stop 2020-10-31T22:50:26.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.541+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/3413111604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f140b1c50 msgr2=0x7f2f14147790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.541+0000 7f2f1a8f2700 1 --2- 172.21.15.60:0/3413111604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f140b1c50 0x7f2f14147790 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 rx=0x7f2f08002f30 tx=0x7f2f08015000).stop 2020-10-31T22:50:26.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.541+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/3413111604 shutdown_connections 2020-10-31T22:50:26.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.541+0000 7f2f1a8f2700 1 --2- 172.21.15.60:0/3413111604 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f1413f090 0x7f2f140aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.541+0000 7f2f1a8f2700 1 --2- 172.21.15.60:0/3413111604 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2ef4054fd0 0x7f2ef4057490 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.541+0000 7f2f1a8f2700 1 --2- 172.21.15.60:0/3413111604 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f14062de0 0x7f2f140a9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.541+0000 7f2f1a8f2700 1 --2- 172.21.15.60:0/3413111604 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2f140b1c50 0x7f2f14147790 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.541+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/3413111604 >> 172.21.15.60:0/3413111604 conn(0x7f2f1405fc80 msgr2=0x7f2f140b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:26.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.541+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/3413111604 shutdown_connections 2020-10-31T22:50:26.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.541+0000 7f2f1a8f2700 1 -- 172.21.15.60:0/3413111604 wait complete. 2020-10-31T22:50:26.562 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:50:26.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.677+0000 7fa9d57ed700 1 Processor -- start 2020-10-31T22:50:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.677+0000 7fa9d57ed700 1 -- start start 2020-10-31T22:50:26.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.677+0000 7fa9d57ed700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa9d00b0c90 0x7fa9d00b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.677+0000 7fa9d57ed700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9d00b2260 0x7fa9d013cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.677+0000 7fa9d57ed700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d00ade50 con 0x7fa9d00ada70 2020-10-31T22:50:26.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.677+0000 7fa9d57ed700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d00ae0a0 con 0x7fa9d00b0c90 2020-10-31T22:50:26.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.677+0000 7fa9d57ed700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d00b26d0 con 0x7fa9d00b2260 2020-10-31T22:50:26.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.677+0000 7fa9cffff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa9d00ada70 0x7fa9d00af100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:51116/0 (socket says 172.21.15.60:51116) 2020-10-31T22:50:26.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.677+0000 7fa9cffff700 1 -- 172.21.15.60:0/256025878 learned_addr learned my addr 172.21.15.60:0/256025878 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:26.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.677+0000 7fa9cf7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa9d00b0c90 0x7fa9d00b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.677+0000 7fa9d4fec700 1 --2- 172.21.15.60:0/256025878 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9d00b2260 0x7fa9d013cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.677+0000 7fa9ceffd700 1 -- 172.21.15.60:0/256025878 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470857870 0 0) 0x7fa9d00ade50 con 0x7fa9d00ada70 2020-10-31T22:50:26.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.677+0000 7fa9ceffd700 1 -- 172.21.15.60:0/256025878 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9b4003230 con 0x7fa9d00ada70 2020-10-31T22:50:26.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9cf7fe700 1 -- 172.21.15.60:0/256025878 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9d00b2260 msgr2=0x7fa9d013cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:26.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9cf7fe700 1 --2- 172.21.15.60:0/256025878 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9d00b2260 0x7fa9d013cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9cf7fe700 1 -- 172.21.15.60:0/256025878 >> v1:172.21.15.66:6789/0 conn(0x7fa9d00ada70 legacy=0x7fa9d00af100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9cf7fe700 1 -- 172.21.15.60:0/256025878 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d00b16c0 con 0x7fa9d00b0c90 2020-10-31T22:50:26.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9d4fec700 1 --2- 172.21.15.60:0/256025878 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9d00b2260 0x7fa9d013cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:26.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9cf7fe700 1 --2- 172.21.15.60:0/256025878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d00b0c90 0x7fa9d00b0400 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7fa9c0002f30 tx=0x7fa9c0006dc0).ready entity=mon.0 client_cookie=b76ab1459d9097eb server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:26.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9ceffd700 1 -- 172.21.15.60:0/256025878 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c00096a0 con 0x7fa9d00b0c90 2020-10-31T22:50:26.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9ceffd700 1 -- 172.21.15.60:0/256025878 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c0009800 con 0x7fa9d00b0c90 2020-10-31T22:50:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9ceffd700 1 -- 172.21.15.60:0/256025878 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9c0009b60 con 0x7fa9d00b0c90 2020-10-31T22:50:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9d57ed700 1 -- 172.21.15.60:0/256025878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d00b0c90 msgr2=0x7fa9d00b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9d57ed700 1 --2- 172.21.15.60:0/256025878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d00b0c90 0x7fa9d00b0400 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 rx=0x7fa9c0002f30 tx=0x7fa9c0006dc0).stop 2020-10-31T22:50:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9d57ed700 1 -- 172.21.15.60:0/256025878 shutdown_connections 2020-10-31T22:50:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9d57ed700 1 --2- 172.21.15.60:0/256025878 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9d00b2260 0x7fa9d013cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9d57ed700 1 --2- 172.21.15.60:0/256025878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d00b0c90 0x7fa9d00b0400 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9d57ed700 1 -- 172.21.15.60:0/256025878 >> 172.21.15.60:0/256025878 conn(0x7fa9d0062180 msgr2=0x7fa9d0063cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:26.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9d57ed700 1 -- 172.21.15.60:0/256025878 shutdown_connections 2020-10-31T22:50:26.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9d57ed700 1 -- 172.21.15.60:0/256025878 wait complete. 2020-10-31T22:50:26.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9d57ed700 1 Processor -- start 2020-10-31T22:50:26.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.681+0000 7fa9d57ed700 1 -- start start 2020-10-31T22:50:26.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9d57ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d00ada70 0x7fa9d00b6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9d57ed700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d00b0c90 0x7fa9d0064f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9d57ed700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9d00b2260 0x7fa9d0065420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9d57ed700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d0066840 con 0x7fa9d00ada70 2020-10-31T22:50:26.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9d57ed700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d0134b50 con 0x7fa9d00b0c90 2020-10-31T22:50:26.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9d57ed700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d00665a0 con 0x7fa9d00b2260 2020-10-31T22:50:26.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d00ada70 0x7fa9d00b6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d00ada70 0x7fa9d00b6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49118/0 (socket says 172.21.15.60:49118) 2020-10-31T22:50:26.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9cffff700 1 -- 172.21.15.60:0/2725894958 learned_addr learned my addr 172.21.15.60:0/2725894958 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:26.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9cf7fe700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d00b0c90 0x7fa9d0064f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9d4fec700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9d00b2260 0x7fa9d0065420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9cffff700 1 -- 172.21.15.60:0/2725894958 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9d00b2260 msgr2=0x7fa9d0065420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9cffff700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9d00b2260 0x7fa9d0065420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9cffff700 1 -- 172.21.15.60:0/2725894958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d00b0c90 msgr2=0x7fa9d0064f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9cffff700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d00b0c90 0x7fa9d0064f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9cffff700 1 -- 172.21.15.60:0/2725894958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d0134db0 con 0x7fa9d00ada70 2020-10-31T22:50:26.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9d4fec700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9d00b2260 0x7fa9d0065420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:26.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9cf7fe700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d00b0c90 0x7fa9d0064f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:26.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9cffff700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d00ada70 0x7fa9d00b6b20 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7fa9b80010d0 tx=0x7fa9b8007a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:26.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9cd7fa700 1 -- 172.21.15.60:0/2725894958 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b80072e0 con 0x7fa9d00ada70 2020-10-31T22:50:26.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9cd7fa700 1 -- 172.21.15.60:0/2725894958 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b8007440 con 0x7fa9d00ada70 2020-10-31T22:50:26.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9cd7fa700 1 -- 172.21.15.60:0/2725894958 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa9b80057d0 con 0x7fa9d00ada70 2020-10-31T22:50:26.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9d57ed700 1 -- 172.21.15.60:0/2725894958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d00ad430 con 0x7fa9d00ada70 2020-10-31T22:50:26.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.685+0000 7fa9d57ed700 1 -- 172.21.15.60:0/2725894958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d0067360 con 0x7fa9d00ada70 2020-10-31T22:50:26.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.689+0000 7fa9d57ed700 1 -- 172.21.15.60:0/2725894958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d00663b0 con 0x7fa9d00ada70 2020-10-31T22:50:26.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.689+0000 7fa9cd7fa700 1 -- 172.21.15.60:0/2725894958 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa9b8010070 con 0x7fa9d00ada70 2020-10-31T22:50:26.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.689+0000 7fa9cd7fa700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa9a8054f10 0x7fa9a80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.689+0000 7fa9cd7fa700 1 -- 172.21.15.60:0/2725894958 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa9b806d450 con 0x7fa9d00ada70 2020-10-31T22:50:26.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.689+0000 7fa9cf7fe700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa9a8054f10 0x7fa9a80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.689+0000 7fa9cf7fe700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa9a8054f10 0x7fa9a80573d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fa9c0019000 tx=0x7fa9c0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:26.700 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.697+0000 7fa9cd7fa700 1 -- 172.21.15.60:0/2725894958 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa9b8043780 con 0x7fa9d00ada70 2020-10-31T22:50:26.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.841+0000 7fa9d57ed700 1 -- 172.21.15.60:0/2725894958 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa9d0057100 con 0x7fa9d00ada70 2020-10-31T22:50:26.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.841+0000 7fa9cd7fa700 1 -- 172.21.15.60:0/2725894958 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v139) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa9b8046da0 con 0x7fa9d00ada70 2020-10-31T22:50:26.847 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:26.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.845+0000 7fa9d57ed700 1 -- 172.21.15.60:0/2725894958 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa9a8054f10 msgr2=0x7fa9a80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.845+0000 7fa9d57ed700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa9a8054f10 0x7fa9a80573d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7fa9c0019000 tx=0x7fa9c0015000).stop 2020-10-31T22:50:26.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.845+0000 7fa9d57ed700 1 -- 172.21.15.60:0/2725894958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d00ada70 msgr2=0x7fa9d00b6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.845+0000 7fa9d57ed700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d00ada70 0x7fa9d00b6b20 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 rx=0x7fa9b80010d0 tx=0x7fa9b8007a10).stop 2020-10-31T22:50:26.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.845+0000 7fa9d57ed700 1 -- 172.21.15.60:0/2725894958 shutdown_connections 2020-10-31T22:50:26.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.845+0000 7fa9d57ed700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9d00b2260 0x7fa9d0065420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.845+0000 7fa9d57ed700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9d00ada70 0x7fa9d00b6b20 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.845+0000 7fa9d57ed700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa9a8054f10 0x7fa9a80573d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.845+0000 7fa9d57ed700 1 --2- 172.21.15.60:0/2725894958 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa9d00b0c90 0x7fa9d0064f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.845+0000 7fa9d57ed700 1 -- 172.21.15.60:0/2725894958 >> 172.21.15.60:0/2725894958 conn(0x7fa9d0062180 msgr2=0x7fa9d013b250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.845+0000 7fa9d57ed700 1 -- 172.21.15.60:0/2725894958 shutdown_connections 2020-10-31T22:50:26.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.845+0000 7fa9d57ed700 1 -- 172.21.15.60:0/2725894958 wait complete. 2020-10-31T22:50:26.862 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:50:26.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.981+0000 7f4ab095a700 1 Processor -- start 2020-10-31T22:50:26.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.981+0000 7f4ab095a700 1 -- start start 2020-10-31T22:50:26.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4ab095a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4aac0b07f0 0x7f4aac0a8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4ab095a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4aac0a8b60 0x7f4aac14c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4ab095a700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aac0b2460 con 0x7f4aac0adc90 2020-10-31T22:50:26.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4ab095a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aac0ad550 con 0x7f4aac0a8b60 2020-10-31T22:50:26.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4ab095a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac0ad7f0 con 0x7f4aac0b07f0 2020-10-31T22:50:26.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4aabfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4aac0a8b60 0x7f4aac14c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4aab7fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4aac0b07f0 0x7f4aac0a8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4aabfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4aac0a8b60 0x7f4aac14c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49130/0 (socket says 172.21.15.60:49130) 2020-10-31T22:50:26.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4aabfff700 1 -- 172.21.15.60:0/4272916152 learned_addr learned my addr 172.21.15.60:0/4272916152 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:26.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4aabfff700 1 -- 172.21.15.60:0/4272916152 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4aac0b07f0 msgr2=0x7f4aac0a8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:26.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4aabfff700 1 --2- 172.21.15.60:0/4272916152 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4aac0b07f0 0x7f4aac0a8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4aabfff700 1 -- 172.21.15.60:0/4272916152 >> v1:172.21.15.66:6789/0 conn(0x7f4aac0adc90 legacy=0x7f4aac1453c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4aabfff700 1 -- 172.21.15.60:0/4272916152 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac0b2070 con 0x7f4aac0a8b60 2020-10-31T22:50:26.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4aabfff700 1 --2- 172.21.15.60:0/4272916152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aac0a8b60 0x7f4aac14c700 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f4aa4002f30 tx=0x7f4aa4006e80).ready entity=mon.0 client_cookie=728a0a883f4ca2b1 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:26.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4aaa7fc700 1 -- 172.21.15.60:0/4272916152 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa40097f0 con 0x7f4aac0a8b60 2020-10-31T22:50:26.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4aaa7fc700 1 -- 172.21.15.60:0/4272916152 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4aa4009950 con 0x7f4aac0a8b60 2020-10-31T22:50:26.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4aaa7fc700 1 -- 172.21.15.60:0/4272916152 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4aa4009cb0 con 0x7f4aac0a8b60 2020-10-31T22:50:26.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4ab095a700 1 -- 172.21.15.60:0/4272916152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aac0a8b60 msgr2=0x7f4aac14c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4ab095a700 1 --2- 172.21.15.60:0/4272916152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aac0a8b60 0x7f4aac14c700 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 rx=0x7f4aa4002f30 tx=0x7f4aa4006e80).stop 2020-10-31T22:50:26.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4ab095a700 1 -- 172.21.15.60:0/4272916152 shutdown_connections 2020-10-31T22:50:26.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4ab095a700 1 --2- 172.21.15.60:0/4272916152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aac0a8b60 0x7f4aac14c700 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4ab095a700 1 --2- 172.21.15.60:0/4272916152 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4aac0b07f0 0x7f4aac0a8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4ab095a700 1 -- 172.21.15.60:0/4272916152 >> 172.21.15.60:0/4272916152 conn(0x7f4aac0614b0 msgr2=0x7f4aac06aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:26.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4ab095a700 1 -- 172.21.15.60:0/4272916152 shutdown_connections 2020-10-31T22:50:26.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.985+0000 7f4ab095a700 1 -- 172.21.15.60:0/4272916152 wait complete. 2020-10-31T22:50:26.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4ab095a700 1 Processor -- start 2020-10-31T22:50:26.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4ab095a700 1 -- start start 2020-10-31T22:50:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4ab095a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aac0a8b60 0x7f4aac0ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4ab095a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4aac0adc90 0x7f4aac063860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4ab095a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4aac0b07f0 0x7f4aac151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4ab095a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac150e70 con 0x7f4aac0a8b60 2020-10-31T22:50:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4ab095a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac065980 con 0x7f4aac0b07f0 2020-10-31T22:50:26.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4ab095a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aac0656e0 con 0x7f4aac0adc90 2020-10-31T22:50:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aab7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aac0a8b60 0x7f4aac0ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aab7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aac0a8b60 0x7f4aac0ab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49132/0 (socket says 172.21.15.60:49132) 2020-10-31T22:50:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aab7fe700 1 -- 172.21.15.60:0/977286135 learned_addr learned my addr 172.21.15.60:0/977286135 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aabfff700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4aac0b07f0 0x7f4aac151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aaaffd700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4aac0adc90 0x7f4aac063860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aab7fe700 1 -- 172.21.15.60:0/977286135 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4aac0adc90 msgr2=0x7f4aac063860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aab7fe700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4aac0adc90 0x7f4aac063860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aab7fe700 1 -- 172.21.15.60:0/977286135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4aac0b07f0 msgr2=0x7f4aac151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aab7fe700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4aac0b07f0 0x7f4aac151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aab7fe700 1 -- 172.21.15.60:0/977286135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac1510d0 con 0x7f4aac0a8b60 2020-10-31T22:50:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aaaffd700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4aac0adc90 0x7f4aac063860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:50:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aab7fe700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aac0a8b60 0x7f4aac0ab460 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f4a9c00c000 tx=0x7f4a9c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aa8ff9700 1 -- 172.21.15.60:0/977286135 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a9c00cc40 con 0x7f4aac0a8b60 2020-10-31T22:50:26.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aa8ff9700 1 -- 172.21.15.60:0/977286135 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c00cda0 con 0x7f4aac0a8b60 2020-10-31T22:50:26.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4ab095a700 1 -- 172.21.15.60:0/977286135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aac066100 con 0x7f4aac0a8b60 2020-10-31T22:50:26.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4aa8ff9700 1 -- 172.21.15.60:0/977286135 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a9c0125e0 con 0x7f4aac0a8b60 2020-10-31T22:50:26.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.989+0000 7f4ab095a700 1 -- 172.21.15.60:0/977286135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aac0652e0 con 0x7f4aac0a8b60 2020-10-31T22:50:27.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.993+0000 7f4ab095a700 1 -- 172.21.15.60:0/977286135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aac057100 con 0x7f4aac0a8b60 2020-10-31T22:50:27.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.993+0000 7f4aa8ff9700 1 -- 172.21.15.60:0/977286135 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4a9c022070 con 0x7f4aac0a8b60 2020-10-31T22:50:27.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.993+0000 7f4aa8ff9700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4a8c0550c0 0x7f4a8c057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:27.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.993+0000 7f4aa8ff9700 1 -- 172.21.15.60:0/977286135 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4a9c06e3c0 con 0x7f4aac0a8b60 2020-10-31T22:50:27.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.993+0000 7f4aaaffd700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4a8c0550c0 0x7f4a8c057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:27.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.993+0000 7f4aaaffd700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4a8c0550c0 0x7f4a8c057580 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f4aa0008000 tx=0x7f4aa0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:27.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:26.997+0000 7f4aa8ff9700 1 -- 172.21.15.60:0/977286135 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4a9c0447d0 con 0x7f4aac0a8b60 2020-10-31T22:50:27.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.141+0000 7f4ab095a700 1 -- 172.21.15.60:0/977286135 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4aac0a2580 con 0x7f4aac0a8b60 2020-10-31T22:50:27.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.141+0000 7f4aa8ff9700 1 -- 172.21.15.60:0/977286135 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v139) v1 ==== 104+0+10 (secure 0 0 0) 0x7f4a9c047df0 con 0x7f4aac0a8b60 2020-10-31T22:50:27.149 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:27.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.145+0000 7f4ab095a700 1 -- 172.21.15.60:0/977286135 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4a8c0550c0 msgr2=0x7f4a8c057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.145+0000 7f4ab095a700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4a8c0550c0 0x7f4a8c057580 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f4aa0008000 tx=0x7f4aa0009040).stop 2020-10-31T22:50:27.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.145+0000 7f4ab095a700 1 -- 172.21.15.60:0/977286135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aac0a8b60 msgr2=0x7f4aac0ab460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.145+0000 7f4ab095a700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aac0a8b60 0x7f4aac0ab460 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 rx=0x7f4a9c00c000 tx=0x7f4a9c0091a0).stop 2020-10-31T22:50:27.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.145+0000 7f4ab095a700 1 -- 172.21.15.60:0/977286135 shutdown_connections 2020-10-31T22:50:27.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.145+0000 7f4ab095a700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4a8c0550c0 0x7f4a8c057580 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.145+0000 7f4ab095a700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4aac0b07f0 0x7f4aac151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.145+0000 7f4ab095a700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aac0a8b60 0x7f4aac0ab460 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.145+0000 7f4ab095a700 1 --2- 172.21.15.60:0/977286135 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4aac0adc90 0x7f4aac063860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.145+0000 7f4ab095a700 1 -- 172.21.15.60:0/977286135 >> 172.21.15.60:0/977286135 conn(0x7f4aac0614b0 msgr2=0x7f4aac0b4000 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:27.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.145+0000 7f4ab095a700 1 -- 172.21.15.60:0/977286135 shutdown_connections 2020-10-31T22:50:27.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.145+0000 7f4ab095a700 1 -- 172.21.15.60:0/977286135 wait complete. 2020-10-31T22:50:27.167 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:50:27.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1efa900700 1 Processor -- start 2020-10-31T22:50:27.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1efa900700 1 -- start start 2020-10-31T22:50:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1efa900700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1ef41422e0 0x7f1ef4138080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1efa900700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef40b59a0 con 0x7f1ef413f000 2020-10-31T22:50:27.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1efa900700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ef405c7e0 con 0x7f1ef40b55c0 2020-10-31T22:50:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1efa900700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ef405ca80 con 0x7f1ef41422e0 2020-10-31T22:50:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1ef8e9d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1ef41422e0 0x7f1ef4138080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1ef37fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1ef413f000 0x7f1ef4137970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53280/0 (socket says 172.21.15.60:53280) 2020-10-31T22:50:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1ef37fe700 1 -- 172.21.15.60:0/125404990 learned_addr learned my addr 172.21.15.60:0/125404990 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1ef8e9d700 1 -- 172.21.15.60:0/125404990 >> v1:172.21.15.66:6789/0 conn(0x7f1ef40b55c0 legacy=0x7f1ef413e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1ef8e9d700 1 -- 172.21.15.60:0/125404990 >> v1:172.21.15.60:6789/0 conn(0x7f1ef413f000 legacy=0x7f1ef4137970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1ef2ffd700 1 -- 172.21.15.60:0/125404990 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741453228 0 0) 0x7f1ef40b59a0 con 0x7f1ef413f000 2020-10-31T22:50:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1ef8e9d700 1 -- 172.21.15.60:0/125404990 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef405cd20 con 0x7f1ef41422e0 2020-10-31T22:50:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1ef8e9d700 1 --2- 172.21.15.60:0/125404990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef41422e0 0x7f1ef4138080 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f1ee40010d0 tx=0x7f1eec0091a0).ready entity=mon.0 client_cookie=7819d451ef1f1924 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1ef2ffd700 1 -- 172.21.15.60:0/125404990 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eec00b930 con 0x7f1ef41422e0 2020-10-31T22:50:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1ef2ffd700 1 -- 172.21.15.60:0/125404990 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1eec00ba90 con 0x7f1ef41422e0 2020-10-31T22:50:27.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1ef2ffd700 1 -- 172.21.15.60:0/125404990 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1eec00bc00 con 0x7f1ef41422e0 2020-10-31T22:50:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1efa900700 1 -- 172.21.15.60:0/125404990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef41422e0 msgr2=0x7f1ef4138080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.281+0000 7f1efa900700 1 --2- 172.21.15.60:0/125404990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef41422e0 0x7f1ef4138080 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 rx=0x7f1ee40010d0 tx=0x7f1eec0091a0).stop 2020-10-31T22:50:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 -- 172.21.15.60:0/125404990 shutdown_connections 2020-10-31T22:50:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 --2- 172.21.15.60:0/125404990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef41422e0 0x7f1ef4138080 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 -- 172.21.15.60:0/125404990 >> 172.21.15.60:0/125404990 conn(0x7f1ef4060d50 msgr2=0x7f1ef40b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 -- 172.21.15.60:0/125404990 shutdown_connections 2020-10-31T22:50:27.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 -- 172.21.15.60:0/125404990 wait complete. 2020-10-31T22:50:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 Processor -- start 2020-10-31T22:50:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 -- start start 2020-10-31T22:50:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef40b55c0 0x7f1ef4140fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ef413f000 0x7f1ef4066010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ef41422e0 0x7f1ef4152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:27.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef413bda0 con 0x7f1ef40b55c0 2020-10-31T22:50:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef4065910 con 0x7f1ef413f000 2020-10-31T22:50:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ef4065bb0 con 0x7f1ef41422e0 2020-10-31T22:50:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1ef3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef40b55c0 0x7f1ef4140fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1ef3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef40b55c0 0x7f1ef4140fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49146/0 (socket says 172.21.15.60:49146) 2020-10-31T22:50:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1ef3fff700 1 -- 172.21.15.60:0/4224759291 learned_addr learned my addr 172.21.15.60:0/4224759291 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:27.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1ef37fe700 1 --2- 172.21.15.60:0/4224759291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ef413f000 0x7f1ef4066010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:27.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1ef8e9d700 1 --2- 172.21.15.60:0/4224759291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ef41422e0 0x7f1ef4152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:27.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1ef3fff700 1 -- 172.21.15.60:0/4224759291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ef41422e0 msgr2=0x7f1ef4152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1ef3fff700 1 --2- 172.21.15.60:0/4224759291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ef41422e0 0x7f1ef4152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1ef3fff700 1 -- 172.21.15.60:0/4224759291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ef413f000 msgr2=0x7f1ef4066010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1ef3fff700 1 --2- 172.21.15.60:0/4224759291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ef413f000 0x7f1ef4066010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1ef3fff700 1 -- 172.21.15.60:0/4224759291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef4064b90 con 0x7f1ef40b55c0 2020-10-31T22:50:27.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1ef3fff700 1 --2- 172.21.15.60:0/4224759291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef40b55c0 0x7f1ef4140fa0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f1ee4001190 tx=0x7f1ee4007af0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:27.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1ef17fa700 1 -- 172.21.15.60:0/4224759291 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ee400e4a0 con 0x7f1ef40b55c0 2020-10-31T22:50:27.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1ef17fa700 1 -- 172.21.15.60:0/4224759291 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee400e600 con 0x7f1ef40b55c0 2020-10-31T22:50:27.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 -- 172.21.15.60:0/4224759291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ef4065030 con 0x7f1ef40b55c0 2020-10-31T22:50:27.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1ef17fa700 1 -- 172.21.15.60:0/4224759291 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ee400e960 con 0x7f1ef40b55c0 2020-10-31T22:50:27.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.285+0000 7f1efa900700 1 -- 172.21.15.60:0/4224759291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ef409f490 con 0x7f1ef40b55c0 2020-10-31T22:50:27.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.289+0000 7f1ef17fa700 1 -- 172.21.15.60:0/4224759291 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1ee4019030 con 0x7f1ef40b55c0 2020-10-31T22:50:27.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.289+0000 7f1efa900700 1 -- 172.21.15.60:0/4224759291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ef4057100 con 0x7f1ef40b55c0 2020-10-31T22:50:27.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.289+0000 7f1ef17fa700 1 --2- 172.21.15.60:0/4224759291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ed8054f10 0x7f1ed80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:27.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.289+0000 7f1ef17fa700 1 -- 172.21.15.60:0/4224759291 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1ee406cf20 con 0x7f1ef40b55c0 2020-10-31T22:50:27.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.289+0000 7f1ef37fe700 1 --2- 172.21.15.60:0/4224759291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ed8054f10 0x7f1ed80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:27.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.289+0000 7f1ef37fe700 1 --2- 172.21.15.60:0/4224759291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ed8054f10 0x7f1ed80573d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f1edc00d000 tx=0x7f1edc001160).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:27.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.297+0000 7f1ef17fa700 1 -- 172.21.15.60:0/4224759291 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1ee4041df0 con 0x7f1ef40b55c0 2020-10-31T22:50:27.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.445+0000 7f1efa900700 1 -- 172.21.15.60:0/4224759291 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1ef4064d20 con 0x7f1ef40b55c0 2020-10-31T22:50:27.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.445+0000 7f1ef17fa700 1 -- 172.21.15.60:0/4224759291 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v139) v1 ==== 100+0+10 (secure 0 0 0) 0x7f1ee40433e0 con 0x7f1ef40b55c0 2020-10-31T22:50:27.552 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:27.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.445+0000 7f1efa900700 1 -- 172.21.15.60:0/4224759291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ed8054f10 msgr2=0x7f1ed80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.445+0000 7f1efa900700 1 --2- 172.21.15.60:0/4224759291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ed8054f10 0x7f1ed80573d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f1edc00d000 tx=0x7f1edc001160).stop 2020-10-31T22:50:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.445+0000 7f1efa900700 1 -- 172.21.15.60:0/4224759291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef40b55c0 msgr2=0x7f1ef4140fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.445+0000 7f1efa900700 1 --2- 172.21.15.60:0/4224759291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef40b55c0 0x7f1ef4140fa0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 rx=0x7f1ee4001190 tx=0x7f1ee4007af0).stop 2020-10-31T22:50:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.445+0000 7f1efa900700 1 -- 172.21.15.60:0/4224759291 shutdown_connections 2020-10-31T22:50:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.445+0000 7f1efa900700 1 --2- 172.21.15.60:0/4224759291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ef41422e0 0x7f1ef4152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.445+0000 7f1efa900700 1 --2- 172.21.15.60:0/4224759291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ef40b55c0 0x7f1ef4140fa0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.445+0000 7f1efa900700 1 --2- 172.21.15.60:0/4224759291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ed8054f10 0x7f1ed80573d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.445+0000 7f1efa900700 1 --2- 172.21.15.60:0/4224759291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ef413f000 0x7f1ef4066010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.445+0000 7f1efa900700 1 -- 172.21.15.60:0/4224759291 >> 172.21.15.60:0/4224759291 conn(0x7f1ef4060d50 msgr2=0x7f1ef40b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:27.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.445+0000 7f1efa900700 1 -- 172.21.15.60:0/4224759291 shutdown_connections 2020-10-31T22:50:27.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.445+0000 7f1efa900700 1 -- 172.21.15.60:0/4224759291 wait complete. 2020-10-31T22:50:27.558 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:50:27.559 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:50:27.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc22b0700 1 Processor -- start 2020-10-31T22:50:27.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc22b0700 1 -- start start 2020-10-31T22:50:27.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc22b0700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5cbc0af970 0x7f5cbc0aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:27.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc22b0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5cbc0ad6f0 0x7f5cbc142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:27.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc22b0700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cbc0afd50 con 0x7f5cbc0aee60 2020-10-31T22:50:27.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc22b0700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cbc0aae50 con 0x7f5cbc0af970 2020-10-31T22:50:27.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc22b0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc0ab3a0 con 0x7f5cbc0ad6f0 2020-10-31T22:50:27.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc12ae700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5cbc0af970 0x7f5cbc0aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:27.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc0aad700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f5cbc0aee60 0x7f5cbc0acfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:51158/0 (socket says 172.21.15.60:51158) 2020-10-31T22:50:27.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc0aad700 1 -- 172.21.15.60:0/2585729307 learned_addr learned my addr 172.21.15.60:0/2585729307 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:27.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc1aaf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5cbc0ad6f0 0x7f5cbc142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:27.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cb3fff700 1 -- 172.21.15.60:0/2585729307 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3507540793 0 0) 0x7f5cbc0afd50 con 0x7f5cbc0aee60 2020-10-31T22:50:27.684 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cb3fff700 1 -- 172.21.15.60:0/2585729307 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ca8003230 con 0x7f5cbc0aee60 2020-10-31T22:50:27.685 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc12ae700 1 -- 172.21.15.60:0/2585729307 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5cbc0ad6f0 msgr2=0x7f5cbc142fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:27.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc12ae700 1 --2- 172.21.15.60:0/2585729307 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5cbc0ad6f0 0x7f5cbc142fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc12ae700 1 -- 172.21.15.60:0/2585729307 >> v1:172.21.15.66:6789/0 conn(0x7f5cbc0aee60 legacy=0x7f5cbc0acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc12ae700 1 -- 172.21.15.60:0/2585729307 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc0ab640 con 0x7f5cbc0af970 2020-10-31T22:50:27.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc1aaf700 1 --2- 172.21.15.60:0/2585729307 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5cbc0ad6f0 0x7f5cbc142fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:27.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc12ae700 1 --2- 172.21.15.60:0/2585729307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cbc0af970 0x7f5cbc0aa960 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f5cac002f30 tx=0x7f5cac006dc0).ready entity=mon.1 client_cookie=fd62285a7909cfb4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:27.686 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cb3fff700 1 -- 172.21.15.60:0/2585729307 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cac0096a0 con 0x7f5cbc0af970 2020-10-31T22:50:27.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cb3fff700 1 -- 172.21.15.60:0/2585729307 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac009800 con 0x7f5cbc0af970 2020-10-31T22:50:27.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cb3fff700 1 -- 172.21.15.60:0/2585729307 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cac009b60 con 0x7f5cbc0af970 2020-10-31T22:50:27.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc22b0700 1 -- 172.21.15.60:0/2585729307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cbc0af970 msgr2=0x7f5cbc0aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.677+0000 7f5cc22b0700 1 --2- 172.21.15.60:0/2585729307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cbc0af970 0x7f5cbc0aa960 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7f5cac002f30 tx=0x7f5cac006dc0).stop 2020-10-31T22:50:27.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc22b0700 1 -- 172.21.15.60:0/2585729307 shutdown_connections 2020-10-31T22:50:27.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc22b0700 1 --2- 172.21.15.60:0/2585729307 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5cbc0ad6f0 0x7f5cbc142fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc22b0700 1 --2- 172.21.15.60:0/2585729307 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cbc0af970 0x7f5cbc0aa960 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc22b0700 1 -- 172.21.15.60:0/2585729307 >> 172.21.15.60:0/2585729307 conn(0x7f5cbc061ae0 msgr2=0x7f5cbc061ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:27.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc22b0700 1 -- 172.21.15.60:0/2585729307 shutdown_connections 2020-10-31T22:50:27.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc22b0700 1 -- 172.21.15.60:0/2585729307 wait complete. 2020-10-31T22:50:27.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc22b0700 1 Processor -- start 2020-10-31T22:50:27.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc22b0700 1 -- start start 2020-10-31T22:50:27.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc22b0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc0ad6f0 0x7f5cbc14c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:27.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc22b0700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5cbc0aee60 0x7f5cbc145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:27.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc22b0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cbc0af970 0x7f5cbc145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:27.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc22b0700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc155b30 con 0x7f5cbc0ad6f0 2020-10-31T22:50:27.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc22b0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc155dd0 con 0x7f5cbc0af970 2020-10-31T22:50:27.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc22b0700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cbc0a67e0 con 0x7f5cbc0aee60 2020-10-31T22:50:27.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc12ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc0ad6f0 0x7f5cbc14c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:27.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc12ae700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc0ad6f0 0x7f5cbc14c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49162/0 (socket says 172.21.15.60:49162) 2020-10-31T22:50:27.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc0aad700 1 --2- 172.21.15.60:0/132708039 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5cbc0aee60 0x7f5cbc145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:27.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc12ae700 1 -- 172.21.15.60:0/132708039 learned_addr learned my addr 172.21.15.60:0/132708039 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:27.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc1aaf700 1 --2- 172.21.15.60:0/132708039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cbc0af970 0x7f5cbc145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:27.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc12ae700 1 -- 172.21.15.60:0/132708039 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5cbc0aee60 msgr2=0x7f5cbc145040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc12ae700 1 --2- 172.21.15.60:0/132708039 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5cbc0aee60 0x7f5cbc145040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc12ae700 1 -- 172.21.15.60:0/132708039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cbc0af970 msgr2=0x7f5cbc145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc12ae700 1 --2- 172.21.15.60:0/132708039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cbc0af970 0x7f5cbc145530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc12ae700 1 -- 172.21.15.60:0/132708039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cbc0a6c80 con 0x7f5cbc0ad6f0 2020-10-31T22:50:27.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.681+0000 7f5cc12ae700 1 --2- 172.21.15.60:0/132708039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc0ad6f0 0x7f5cbc14c960 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f5cac002f30 tx=0x7f5cac015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:27.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.685+0000 7f5cb27fc700 1 -- 172.21.15.60:0/132708039 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cac011b90 con 0x7f5cbc0ad6f0 2020-10-31T22:50:27.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.685+0000 7f5cb27fc700 1 -- 172.21.15.60:0/132708039 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac011cf0 con 0x7f5cbc0ad6f0 2020-10-31T22:50:27.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.685+0000 7f5cb27fc700 1 -- 172.21.15.60:0/132708039 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5cac01c5a0 con 0x7f5cbc0ad6f0 2020-10-31T22:50:27.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.685+0000 7f5cc22b0700 1 -- 172.21.15.60:0/132708039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cbc143e60 con 0x7f5cbc0ad6f0 2020-10-31T22:50:27.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.685+0000 7f5cc22b0700 1 -- 172.21.15.60:0/132708039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cbc0aa580 con 0x7f5cbc0ad6f0 2020-10-31T22:50:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.685+0000 7f5cc22b0700 1 -- 172.21.15.60:0/132708039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cbc0a69a0 con 0x7f5cbc0ad6f0 2020-10-31T22:50:27.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.685+0000 7f5cb27fc700 1 -- 172.21.15.60:0/132708039 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5cac00f070 con 0x7f5cbc0ad6f0 2020-10-31T22:50:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.685+0000 7f5cb27fc700 1 --2- 172.21.15.60:0/132708039 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c9c054f90 0x7f5c9c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.685+0000 7f5cb27fc700 1 -- 172.21.15.60:0/132708039 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5cac06e6d0 con 0x7f5cbc0ad6f0 2020-10-31T22:50:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.685+0000 7f5cc0aad700 1 --2- 172.21.15.60:0/132708039 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c9c054f90 0x7f5c9c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:27.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.685+0000 7f5cc0aad700 1 --2- 172.21.15.60:0/132708039 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c9c054f90 0x7f5c9c057450 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f5cb800d000 tx=0x7f5cb8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:27.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.693+0000 7f5cb27fc700 1 -- 172.21.15.60:0/132708039 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5cac044b50 con 0x7f5cbc0ad6f0 2020-10-31T22:50:27.886 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.881+0000 7f5cc22b0700 1 -- 172.21.15.60:0/132708039 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cbc057100 con 0x7f5cbc0ad6f0 2020-10-31T22:50:27.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.881+0000 7f5cb27fc700 1 -- 172.21.15.60:0/132708039 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2492 (secure 0 0 0) 0x7f5cac023030 con 0x7f5cbc0ad6f0 2020-10-31T22:50:27.887 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:27.887 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1094853447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1094853447},{"type":"v1","addr":"172.21.15.66:6833","nonce":1094853447}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68},{"gid":7875,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3767660505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3767660505},{"type":"v1","addr":"172.21.15.60:6835","nonce":3767660505}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:14.231864+0000","modified":"2020-10-31T22:50:15.234744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7884":{"gid":7884,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/936802064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":936802064},{"type":"v1","addr":"172.21.15.60:6837","nonce":936802064}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-10-31T22:50:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.885+0000 7f5cc22b0700 1 -- 172.21.15.60:0/132708039 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c9c054f90 msgr2=0x7f5c9c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.885+0000 7f5cc22b0700 1 --2- 172.21.15.60:0/132708039 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c9c054f90 0x7f5c9c057450 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f5cb800d000 tx=0x7f5cb8009040).stop 2020-10-31T22:50:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.885+0000 7f5cc22b0700 1 -- 172.21.15.60:0/132708039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc0ad6f0 msgr2=0x7f5cbc14c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.885+0000 7f5cc22b0700 1 --2- 172.21.15.60:0/132708039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc0ad6f0 0x7f5cbc14c960 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 rx=0x7f5cac002f30 tx=0x7f5cac015000).stop 2020-10-31T22:50:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.885+0000 7f5cc22b0700 1 -- 172.21.15.60:0/132708039 shutdown_connections 2020-10-31T22:50:27.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.885+0000 7f5cc22b0700 1 --2- 172.21.15.60:0/132708039 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5c9c054f90 0x7f5c9c057450 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.885+0000 7f5cc22b0700 1 --2- 172.21.15.60:0/132708039 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5cbc0af970 0x7f5cbc145530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.885+0000 7f5cc22b0700 1 --2- 172.21.15.60:0/132708039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5cbc0ad6f0 0x7f5cbc14c960 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.885+0000 7f5cc22b0700 1 --2- 172.21.15.60:0/132708039 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5cbc0aee60 0x7f5cbc145040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:27.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.885+0000 7f5cc22b0700 1 -- 172.21.15.60:0/132708039 >> 172.21.15.60:0/132708039 conn(0x7f5cbc061ae0 msgr2=0x7f5cbc147fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:27.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.885+0000 7f5cc22b0700 1 -- 172.21.15.60:0/132708039 shutdown_connections 2020-10-31T22:50:27.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:27.885+0000 7f5cc22b0700 1 -- 172.21.15.60:0/132708039 wait complete. 2020-10-31T22:50:27.891 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 70 2020-10-31T22:50:28.202 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:50:14.231864+0000', 'modified': '2020-10-31T22:50:15.234744+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7884}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7884': {'gid': 7884, 'name': 'a', 'rank': 0, 'incarnation': 69, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/936802064', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 936802064}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 936802064}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [26], 'metadata_pool': 25, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:50:28.203 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:50:28.204 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2020-10-31T22:50:28.333 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":7884,"want_state":"up:active","state":"up:active","rank_uptime":14.088296655000001,"mdsmap_epoch":70,"osdmap_epoch":139,"osdmap_epoch_barrier":138,"uptime":19.261082443999999} 2020-10-31T22:50:28.334 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 7884, "mdsmap_epoch": 70, "osdmap_epoch": 139, "osdmap_epoch_barrier": 138, "rank_uptime": 14.088296655, "state": "up:active", "uptime": 19.261082444, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:50:28.334 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:50:28.334 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-10-31T22:50:28.335 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi085.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-10-31T22:50:28.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:28.335 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:28.343 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:50:28.398 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:50:28.399 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:50:28.454 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:50:28.455 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:50:28.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:28.456 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:50:28.502 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:50:28.504 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:28.546 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:50:28.561 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:50:28.561 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:50:28.616 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:50:28.617 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:50:28.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:28.618 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:50:28.623 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:2020-10-31T22:50:28.621+0000 7f07e4bb20c0 -1 init, newargv = 0x5600c2f4bc30 newargc=9 2020-10-31T22:50:28.624 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13636]: starting ceph client 2020-10-31T22:50:28.634 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13636]: starting fuse 2020-10-31T22:50:29.728 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:50:29.745 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:50:29.750 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:50:29.801 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:50:29.803 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:50:29.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:29.805 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:50:29.850 INFO:teuthology.orchestra.run.smithi085.stdout:50 2020-10-31T22:50:29.851 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-10-31T22:50:29.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:29.852 INFO:teuthology.orchestra.run.smithi085:> sudo python3 -c ' 2020-10-31T22:50:29.853 INFO:teuthology.orchestra.run.smithi085:> import glob 2020-10-31T22:50:29.853 INFO:teuthology.orchestra.run.smithi085:> import re 2020-10-31T22:50:29.853 INFO:teuthology.orchestra.run.smithi085:> import os 2020-10-31T22:50:29.854 INFO:teuthology.orchestra.run.smithi085:> import subprocess 2020-10-31T22:50:29.854 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:50:29.854 INFO:teuthology.orchestra.run.smithi085:> def find_socket(client_name): 2020-10-31T22:50:29.855 INFO:teuthology.orchestra.run.smithi085:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-10-31T22:50:29.856 INFO:teuthology.orchestra.run.smithi085:> files = glob.glob(asok_path) 2020-10-31T22:50:29.856 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:50:29.856 INFO:teuthology.orchestra.run.smithi085:> # Given a non-glob path, it better be there 2020-10-31T22:50:29.857 INFO:teuthology.orchestra.run.smithi085:> if "*" not in asok_path: 2020-10-31T22:50:29.857 INFO:teuthology.orchestra.run.smithi085:> assert(len(files) == 1) 2020-10-31T22:50:29.857 INFO:teuthology.orchestra.run.smithi085:> return files[0] 2020-10-31T22:50:29.858 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:50:29.858 INFO:teuthology.orchestra.run.smithi085:> for f in files: 2020-10-31T22:50:29.858 INFO:teuthology.orchestra.run.smithi085:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:50:29.859 INFO:teuthology.orchestra.run.smithi085:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:50:29.859 INFO:teuthology.orchestra.run.smithi085:> return f 2020-10-31T22:50:29.859 INFO:teuthology.orchestra.run.smithi085:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:50:29.860 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:50:29.860 INFO:teuthology.orchestra.run.smithi085:> print(find_socket("client.1")) 2020-10-31T22:50:29.860 INFO:teuthology.orchestra.run.smithi085:> ' 2020-10-31T22:50:29.932 INFO:teuthology.orchestra.run.smithi085.stdout:/var/run/ceph/ceph-client.1.13636.asok 2020-10-31T22:50:29.938 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13636.asok 2020-10-31T22:50:29.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:29.939 INFO:teuthology.orchestra.run.smithi085:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13636.asok status 2020-10-31T22:50:30.077 INFO:teuthology.orchestra.run.smithi085.stdout:{ 2020-10-31T22:50:30.077 INFO:teuthology.orchestra.run.smithi085.stdout: "metadata": { 2020-10-31T22:50:30.077 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:50:30.077 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:50:30.078 INFO:teuthology.orchestra.run.smithi085.stdout: "entity_id": "1", 2020-10-31T22:50:30.078 INFO:teuthology.orchestra.run.smithi085.stdout: "hostname": "smithi085", 2020-10-31T22:50:30.078 INFO:teuthology.orchestra.run.smithi085.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-10-31T22:50:30.078 INFO:teuthology.orchestra.run.smithi085.stdout: "pid": "13636", 2020-10-31T22:50:30.078 INFO:teuthology.orchestra.run.smithi085.stdout: "root": "/" 2020-10-31T22:50:30.078 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:50:30.079 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_count": 0, 2020-10-31T22:50:30.079 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_pinned_count": 0, 2020-10-31T22:50:30.079 INFO:teuthology.orchestra.run.smithi085.stdout: "id": 7034, 2020-10-31T22:50:30.079 INFO:teuthology.orchestra.run.smithi085.stdout: "inst": { 2020-10-31T22:50:30.079 INFO:teuthology.orchestra.run.smithi085.stdout: "name": { 2020-10-31T22:50:30.079 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "client", 2020-10-31T22:50:30.079 INFO:teuthology.orchestra.run.smithi085.stdout: "num": 7034 2020-10-31T22:50:30.080 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:50:30.080 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:50:30.080 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:50:30.080 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:50:30.080 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 133098360 2020-10-31T22:50:30.080 INFO:teuthology.orchestra.run.smithi085.stdout: } 2020-10-31T22:50:30.080 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:50:30.080 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:50:30.081 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:50:30.081 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:50:30.081 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 133098360 2020-10-31T22:50:30.081 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:50:30.081 INFO:teuthology.orchestra.run.smithi085.stdout: "inst_str": "client.7034 172.21.15.85:0/133098360", 2020-10-31T22:50:30.082 INFO:teuthology.orchestra.run.smithi085.stdout: "addr_str": "172.21.15.85:0/133098360", 2020-10-31T22:50:30.082 INFO:teuthology.orchestra.run.smithi085.stdout: "inode_count": 1, 2020-10-31T22:50:30.082 INFO:teuthology.orchestra.run.smithi085.stdout: "mds_epoch": 70, 2020-10-31T22:50:30.082 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch": 139, 2020-10-31T22:50:30.082 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:50:30.082 INFO:teuthology.orchestra.run.smithi085.stdout: "blacklisted": false 2020-10-31T22:50:30.082 INFO:teuthology.orchestra.run.smithi085.stdout:} 2020-10-31T22:50:30.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:30.087 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:30.087 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:30.095 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:50:30.096 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:50:30.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:30.097 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:30.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:30.153 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:30.154 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:30.163 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:50:30.164 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:50:30.165 INFO:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2020-10-31T22:50:30.166 INFO:teuthology.orchestra.run.smithi152:> import time 2020-10-31T22:50:30.166 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:50:30.167 INFO:teuthology.orchestra.run.smithi152:> with open("/home/ubuntu/cephtest/mnt.0/testfile", '"'"'w'"'"') as f: 2020-10-31T22:50:30.167 INFO:teuthology.orchestra.run.smithi152:> f.write('"'"'content'"'"') 2020-10-31T22:50:30.168 INFO:teuthology.orchestra.run.smithi152:> f.flush() 2020-10-31T22:50:30.169 INFO:teuthology.orchestra.run.smithi152:> f.write('"'"'content2'"'"') 2020-10-31T22:50:30.169 INFO:teuthology.orchestra.run.smithi152:> while True: 2020-10-31T22:50:30.170 INFO:teuthology.orchestra.run.smithi152:> time.sleep(1) 2020-10-31T22:50:30.170 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:50:30.208 INFO:teuthology.orchestra.run.smithi152:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2020-10-31T22:50:30.231 INFO:teuthology.orchestra.run.smithi152.stderr:ls: cannot access '/home/ubuntu/cephtest/mnt.0/testfile': No such file or directory 2020-10-31T22:50:30.232 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-10-31T22:50:31.233 INFO:teuthology.orchestra.run.smithi152:> sudo ls /home/ubuntu/cephtest/mnt.0/testfile 2020-10-31T22:50:31.263 INFO:teuthology.orchestra.run.smithi152.stdout:/home/ubuntu/cephtest/mnt.0/testfile 2020-10-31T22:50:31.264 DEBUG:tasks.cephfs.mount:File testfile became visible from 0 after 1s 2020-10-31T22:50:31.264 INFO:teuthology.orchestra.run.smithi085:> sudo ls /home/ubuntu/cephtest/mnt.1/testfile 2020-10-31T22:50:31.308 INFO:teuthology.orchestra.run.smithi085.stdout:/home/ubuntu/cephtest/mnt.1/testfile 2020-10-31T22:50:31.309 DEBUG:tasks.cephfs.mount:File testfile became visible from 1 after 0s 2020-10-31T22:50:31.309 INFO:teuthology.orchestra.run.smithi085:> cd /home/ubuntu/cephtest/mnt.1 && sudo cat testfile 2020-10-31T22:50:31.416 INFO:teuthology.orchestra.run.smithi085.stdout:content 2020-10-31T22:50:31.444 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:50:31.445 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:31.469 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:31.507 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:31.528 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:31.559 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:50:31.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:31.560 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:31.560 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:31.618 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:50:31.619 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:50:31.620 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:50:31.620 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:50:31.621 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:31.704 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[14102]: fuse finished with error 0 and tester_r 0 2020-10-31T22:50:31.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:31.707 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:31.707 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:31.719 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:50:31.720 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:50:31.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:50:31.841 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:31.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:31.904 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:31.905 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:31.917 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:50:31.918 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:50:31.919 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi085.front.sepia.ceph.com... 2020-10-31T22:50:31.919 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:50:31.920 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:31.997 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13636]: fuse finished with error 0 and tester_r 0 2020-10-31T22:50:31.998 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:31.999 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:31.999 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:32.060 INFO:teuthology.orchestra.run.smithi085.stdout:ext2/ext3 2020-10-31T22:50:32.061 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:50:32.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:50:32.179 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:32.247 INFO:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-10-31T22:50:32.259 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-10-31T22:50:32.272 INFO:teuthology.orchestra.run.smithi085:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-10-31T22:50:32.291 INFO:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-10-31T22:50:32.308 INFO:teuthology.orchestra.run.smithi060.stdout:[global] 2020-10-31T22:50:32.308 INFO:teuthology.orchestra.run.smithi060.stdout: chdir = "" 2020-10-31T22:50:32.308 INFO:teuthology.orchestra.run.smithi060.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-31T22:50:32.308 INFO:teuthology.orchestra.run.smithi060.stdout: auth supported = cephx 2020-10-31T22:50:32.309 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.309 INFO:teuthology.orchestra.run.smithi060.stdout: filestore xattr use omap = true 2020-10-31T22:50:32.309 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.309 INFO:teuthology.orchestra.run.smithi060.stdout: mon clock drift allowed = 1.000 2020-10-31T22:50:32.309 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.310 INFO:teuthology.orchestra.run.smithi060.stdout: osd crush chooseleaf type = 0 2020-10-31T22:50:32.311 INFO:teuthology.orchestra.run.smithi060.stdout: auth debug = true 2020-10-31T22:50:32.311 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.312 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on old message = true 2020-10-31T22:50:32.312 INFO:teuthology.orchestra.run.smithi060.stdout: ms die on bug = true 2020-10-31T22:50:32.312 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.313 INFO:teuthology.orchestra.run.smithi060.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-31T22:50:32.314 INFO:teuthology.orchestra.run.smithi060.stdout: mon pg warn max object skew = 0 2020-10-31T22:50:32.314 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.315 INFO:teuthology.orchestra.run.smithi060.stdout: # disable pg_autoscaler by default for new pools 2020-10-31T22:50:32.315 INFO:teuthology.orchestra.run.smithi060.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-31T22:50:32.315 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.315 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default size = 2 2020-10-31T22:50:32.316 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.316 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow primary affinity = true 2020-10-31T22:50:32.316 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd allow pg remap = true 2020-10-31T22:50:32.317 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on legacy crush tunables = false 2020-10-31T22:50:32.317 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on crush straw calc version zero = false 2020-10-31T22:50:32.317 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on no sortbitwise = false 2020-10-31T22:50:32.317 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on osd down out interval zero = false 2020-10-31T22:50:32.318 INFO:teuthology.orchestra.run.smithi060.stdout: mon warn on too few osds = false 2020-10-31T22:50:32.319 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-31T22:50:32.319 INFO:teuthology.orchestra.run.smithi060.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-31T22:50:32.319 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.320 INFO:teuthology.orchestra.run.smithi060.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-31T22:50:32.320 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.320 INFO:teuthology.orchestra.run.smithi060.stdout: osd default data pool replay window = 5 2020-10-31T22:50:32.320 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.321 INFO:teuthology.orchestra.run.smithi060.stdout: mon allow pool delete = true 2020-10-31T22:50:32.321 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.321 INFO:teuthology.orchestra.run.smithi060.stdout: mon cluster log file level = debug 2020-10-31T22:50:32.321 INFO:teuthology.orchestra.run.smithi060.stdout: debug asserts on shutdown = true 2020-10-31T22:50:32.322 INFO:teuthology.orchestra.run.smithi060.stdout: mon host = "172.21.15.60,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2020-10-31T22:50:32.322 INFO:teuthology.orchestra.run.smithi060.stdout: fsid = 226f905a-1517-4a8c-8009-08779515965c 2020-10-31T22:50:32.322 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.323 INFO:teuthology.orchestra.run.smithi060.stdout:[osd] 2020-10-31T22:50:32.323 INFO:teuthology.orchestra.run.smithi060.stdout: osd journal size = 100 2020-10-31T22:50:32.323 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.323 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub load threshold = 5.0 2020-10-31T22:50:32.324 INFO:teuthology.orchestra.run.smithi060.stdout: osd scrub max interval = 600 2020-10-31T22:50:32.324 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.324 INFO:teuthology.orchestra.run.smithi060.stdout: osd recover clone overlap = true 2020-10-31T22:50:32.325 INFO:teuthology.orchestra.run.smithi060.stdout: osd recovery max chunk = 1048576 2020-10-31T22:50:32.325 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.325 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug shutdown = true 2020-10-31T22:50:32.325 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug op order = true 2020-10-31T22:50:32.326 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug verify stray on activate = true 2020-10-31T22:50:32.326 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.326 INFO:teuthology.orchestra.run.smithi060.stdout: osd open classes on start = true 2020-10-31T22:50:32.326 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug pg log writeout = true 2020-10-31T22:50:32.329 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.330 INFO:teuthology.orchestra.run.smithi060.stdout: osd deep scrub update digest min age = 30 2020-10-31T22:50:32.330 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.330 INFO:teuthology.orchestra.run.smithi060.stdout: osd map max advance = 10 2020-10-31T22:50:32.330 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.330 INFO:teuthology.orchestra.run.smithi060.stdout: journal zero on create = true 2020-10-31T22:50:32.330 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.331 INFO:teuthology.orchestra.run.smithi060.stdout: filestore ondisk finisher threads = 3 2020-10-31T22:50:32.331 INFO:teuthology.orchestra.run.smithi060.stdout: filestore apply finisher threads = 3 2020-10-31T22:50:32.331 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.331 INFO:teuthology.orchestra.run.smithi060.stdout: bdev debug aio = true 2020-10-31T22:50:32.331 INFO:teuthology.orchestra.run.smithi060.stdout: osd debug misdirected ops = true 2020-10-31T22:50:32.331 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore block size = 96636764160 2020-10-31T22:50:32.331 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore compression mode = aggressive 2020-10-31T22:50:32.332 INFO:teuthology.orchestra.run.smithi060.stdout: bluestore fsck on mount = True 2020-10-31T22:50:32.332 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluefs = 20 2020-10-31T22:50:32.332 INFO:teuthology.orchestra.run.smithi060.stdout: debug bluestore = 20 2020-10-31T22:50:32.332 INFO:teuthology.orchestra.run.smithi060.stdout: debug filestore = 20 2020-10-31T22:50:32.332 INFO:teuthology.orchestra.run.smithi060.stdout: debug journal = 20 2020-10-31T22:50:32.332 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 20 2020-10-31T22:50:32.332 INFO:teuthology.orchestra.run.smithi060.stdout: debug osd = 25 2020-10-31T22:50:32.333 INFO:teuthology.orchestra.run.smithi060.stdout: debug rocksdb = 10 2020-10-31T22:50:32.333 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd backfillfull_ratio = 0.85 2020-10-31T22:50:32.333 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd full ratio = 0.9 2020-10-31T22:50:32.333 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd nearfull ratio = 0.8 2020-10-31T22:50:32.333 INFO:teuthology.orchestra.run.smithi060.stdout: osd failsafe full ratio = 0.95 2020-10-31T22:50:32.333 INFO:teuthology.orchestra.run.smithi060.stdout: osd objectstore = bluestore 2020-10-31T22:50:32.333 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2020-10-31T22:50:32.334 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.334 INFO:teuthology.orchestra.run.smithi060.stdout:[mgr] 2020-10-31T22:50:32.334 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2020-10-31T22:50:32.334 INFO:teuthology.orchestra.run.smithi060.stdout: debug mgr = 20 2020-10-31T22:50:32.334 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2020-10-31T22:50:32.334 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2020-10-31T22:50:32.334 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:32.335 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:32.335 INFO:teuthology.orchestra.run.smithi060.stdout: mgr/telemetry/nag = false 2020-10-31T22:50:32.335 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.335 INFO:teuthology.orchestra.run.smithi060.stdout:[mon] 2020-10-31T22:50:32.337 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2020-10-31T22:50:32.339 INFO:teuthology.orchestra.run.smithi060.stdout: debug mon = 20 2020-10-31T22:50:32.339 INFO:teuthology.orchestra.run.smithi060.stdout: debug paxos = 20 2020-10-31T22:50:32.339 INFO:teuthology.orchestra.run.smithi060.stdout: debug auth = 20 2020-10-31T22:50:32.340 INFO:teuthology.orchestra.run.smithi060.stdout: mon data avail warn = 5 2020-10-31T22:50:32.340 INFO:teuthology.orchestra.run.smithi060.stdout: mon mgr mkfs grace = 240 2020-10-31T22:50:32.340 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:32.341 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd reporter subtree level = osd 2020-10-31T22:50:32.341 INFO:teuthology.orchestra.run.smithi060.stdout: mon osd prime pg temp = true 2020-10-31T22:50:32.341 INFO:teuthology.orchestra.run.smithi060.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:32.342 INFO:teuthology.orchestra.run.smithi060.stdout: mon op complaint time = 120 2020-10-31T22:50:32.342 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:32.342 INFO:teuthology.orchestra.run.smithi060.stdout:[client] 2020-10-31T22:50:32.343 INFO:teuthology.orchestra.run.smithi060.stdout: rgw cache enabled = true 2020-10-31T22:50:32.343 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable ops log = true 2020-10-31T22:50:32.343 INFO:teuthology.orchestra.run.smithi060.stdout: rgw enable usage log = true 2020-10-31T22:50:32.343 INFO:teuthology.orchestra.run.smithi060.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-31T22:50:32.343 INFO:teuthology.orchestra.run.smithi060.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-31T22:50:32.343 INFO:teuthology.orchestra.run.smithi060.stdout: client mount timeout = 600 2020-10-31T22:50:32.343 INFO:teuthology.orchestra.run.smithi060.stdout: debug client = 20 2020-10-31T22:50:32.344 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2020-10-31T22:50:32.344 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.a] 2020-10-31T22:50:32.344 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.b] 2020-10-31T22:50:32.344 INFO:teuthology.orchestra.run.smithi060.stdout:[mon.c] 2020-10-31T22:50:32.344 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.a] 2020-10-31T22:50:32.344 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.c] 2020-10-31T22:50:32.345 INFO:teuthology.orchestra.run.smithi060.stdout:[mds.b] 2020-10-31T22:50:32.345 INFO:teuthology.orchestra.run.smithi060.stdout:[mds] 2020-10-31T22:50:32.345 INFO:teuthology.orchestra.run.smithi060.stdout: debug mds = 20 2020-10-31T22:50:32.345 INFO:teuthology.orchestra.run.smithi060.stdout: debug ms = 1 2020-10-31T22:50:32.345 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal frag = True 2020-10-31T22:50:32.345 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal fragment size max = 10000 2020-10-31T22:50:32.345 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal merge size = 5 2020-10-31T22:50:32.346 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal split bits = 3 2020-10-31T22:50:32.346 INFO:teuthology.orchestra.run.smithi060.stdout: mds bal split size = 100 2020-10-31T22:50:32.346 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug frag = True 2020-10-31T22:50:32.346 INFO:teuthology.orchestra.run.smithi060.stdout: mds debug scatterstat = True 2020-10-31T22:50:32.346 INFO:teuthology.orchestra.run.smithi060.stdout: mds op complaint time = 180 2020-10-31T22:50:32.346 INFO:teuthology.orchestra.run.smithi060.stdout: mds verify scatter = True 2020-10-31T22:50:32.347 INFO:teuthology.orchestra.run.smithi060.stdout: osd op complaint time = 180 2020-10-31T22:50:32.349 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2020-10-31T22:50:32.349 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2020-10-31T22:50:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-31T22:50:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2020-10-31T22:50:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2020-10-31T22:50:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.350 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2020-10-31T22:50:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2020-10-31T22:50:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2020-10-31T22:50:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2020-10-31T22:50:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2020-10-31T22:50:32.351 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-31T22:50:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2020-10-31T22:50:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2020-10-31T22:50:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-31T22:50:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.352 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2020-10-31T22:50:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2020-10-31T22:50:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2020-10-31T22:50:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2020-10-31T22:50:32.353 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2020-10-31T22:50:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2020-10-31T22:50:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2020-10-31T22:50:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2020-10-31T22:50:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-31T22:50:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-31T22:50:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-31T22:50:32.354 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2020-10-31T22:50:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2020-10-31T22:50:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2020-10-31T22:50:32.355 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2020-10-31T22:50:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "172.21.15.60,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2020-10-31T22:50:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = 226f905a-1517-4a8c-8009-08779515965c 2020-10-31T22:50:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.356 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2020-10-31T22:50:32.356 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2020-10-31T22:50:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2020-10-31T22:50:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2020-10-31T22:50:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2020-10-31T22:50:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2020-10-31T22:50:32.357 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2020-10-31T22:50:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2020-10-31T22:50:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2020-10-31T22:50:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2020-10-31T22:50:32.358 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2020-10-31T22:50:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2020-10-31T22:50:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.359 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2020-10-31T22:50:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2020-10-31T22:50:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2020-10-31T22:50:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2020-10-31T22:50:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.360 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2020-10-31T22:50:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2020-10-31T22:50:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2020-10-31T22:50:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore compression mode = aggressive 2020-10-31T22:50:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2020-10-31T22:50:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 20 2020-10-31T22:50:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 20 2020-10-31T22:50:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: debug filestore = 20 2020-10-31T22:50:32.361 INFO:teuthology.orchestra.run.smithi152.stdout: debug journal = 20 2020-10-31T22:50:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 20 2020-10-31T22:50:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 25 2020-10-31T22:50:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 10 2020-10-31T22:50:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2020-10-31T22:50:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2020-10-31T22:50:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2020-10-31T22:50:32.362 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2020-10-31T22:50:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2020-10-31T22:50:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2020-10-31T22:50:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.363 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2020-10-31T22:50:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2020-10-31T22:50:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2020-10-31T22:50:32.363 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2020-10-31T22:50:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2020-10-31T22:50:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2020-10-31T22:50:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.364 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2020-10-31T22:50:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2020-10-31T22:50:32.364 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2020-10-31T22:50:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2020-10-31T22:50:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2020-10-31T22:50:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2020-10-31T22:50:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2020-10-31T22:50:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2020-10-31T22:50:32.365 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2020-10-31T22:50:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: mon op complaint time = 120 2020-10-31T22:50:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: 2020-10-31T22:50:32.366 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2020-10-31T22:50:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2020-10-31T22:50:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2020-10-31T22:50:32.366 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2020-10-31T22:50:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-31T22:50:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-31T22:50:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: client mount timeout = 600 2020-10-31T22:50:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: debug client = 20 2020-10-31T22:50:32.367 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2020-10-31T22:50:32.367 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2020-10-31T22:50:32.367 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2020-10-31T22:50:32.368 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2020-10-31T22:50:32.368 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2020-10-31T22:50:32.368 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2020-10-31T22:50:32.368 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2020-10-31T22:50:32.368 INFO:teuthology.orchestra.run.smithi152.stdout:[mds] 2020-10-31T22:50:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds = 20 2020-10-31T22:50:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2020-10-31T22:50:32.368 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal frag = True 2020-10-31T22:50:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal fragment size max = 10000 2020-10-31T22:50:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal merge size = 5 2020-10-31T22:50:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal split bits = 3 2020-10-31T22:50:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: mds bal split size = 100 2020-10-31T22:50:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug frag = True 2020-10-31T22:50:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug scatterstat = True 2020-10-31T22:50:32.369 INFO:teuthology.orchestra.run.smithi152.stdout: mds op complaint time = 180 2020-10-31T22:50:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: mds verify scatter = True 2020-10-31T22:50:32.370 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2020-10-31T22:50:32.370 INFO:teuthology.orchestra.run.smithi085.stdout:[global] 2020-10-31T22:50:32.370 INFO:teuthology.orchestra.run.smithi085.stdout: chdir = "" 2020-10-31T22:50:32.370 INFO:teuthology.orchestra.run.smithi085.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-31T22:50:32.370 INFO:teuthology.orchestra.run.smithi085.stdout: auth supported = cephx 2020-10-31T22:50:32.371 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.371 INFO:teuthology.orchestra.run.smithi085.stdout: filestore xattr use omap = true 2020-10-31T22:50:32.371 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.371 INFO:teuthology.orchestra.run.smithi085.stdout: mon clock drift allowed = 1.000 2020-10-31T22:50:32.371 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.371 INFO:teuthology.orchestra.run.smithi085.stdout: osd crush chooseleaf type = 0 2020-10-31T22:50:32.371 INFO:teuthology.orchestra.run.smithi085.stdout: auth debug = true 2020-10-31T22:50:32.371 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.372 INFO:teuthology.orchestra.run.smithi085.stdout: ms die on old message = true 2020-10-31T22:50:32.372 INFO:teuthology.orchestra.run.smithi085.stdout: ms die on bug = true 2020-10-31T22:50:32.372 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.372 INFO:teuthology.orchestra.run.smithi085.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-31T22:50:32.372 INFO:teuthology.orchestra.run.smithi085.stdout: mon pg warn max object skew = 0 2020-10-31T22:50:32.372 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.373 INFO:teuthology.orchestra.run.smithi085.stdout: # disable pg_autoscaler by default for new pools 2020-10-31T22:50:32.373 INFO:teuthology.orchestra.run.smithi085.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-31T22:50:32.373 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.373 INFO:teuthology.orchestra.run.smithi085.stdout: osd pool default size = 2 2020-10-31T22:50:32.373 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.373 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd allow primary affinity = true 2020-10-31T22:50:32.373 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd allow pg remap = true 2020-10-31T22:50:32.374 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on legacy crush tunables = false 2020-10-31T22:50:32.374 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on crush straw calc version zero = false 2020-10-31T22:50:32.374 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on no sortbitwise = false 2020-10-31T22:50:32.374 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on osd down out interval zero = false 2020-10-31T22:50:32.374 INFO:teuthology.orchestra.run.smithi085.stdout: mon warn on too few osds = false 2020-10-31T22:50:32.374 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-31T22:50:32.374 INFO:teuthology.orchestra.run.smithi085.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-31T22:50:32.375 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.375 INFO:teuthology.orchestra.run.smithi085.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-31T22:50:32.375 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.375 INFO:teuthology.orchestra.run.smithi085.stdout: osd default data pool replay window = 5 2020-10-31T22:50:32.375 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.375 INFO:teuthology.orchestra.run.smithi085.stdout: mon allow pool delete = true 2020-10-31T22:50:32.375 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.376 INFO:teuthology.orchestra.run.smithi085.stdout: mon cluster log file level = debug 2020-10-31T22:50:32.376 INFO:teuthology.orchestra.run.smithi085.stdout: debug asserts on shutdown = true 2020-10-31T22:50:32.376 INFO:teuthology.orchestra.run.smithi085.stdout: mon host = "172.21.15.60,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2020-10-31T22:50:32.376 INFO:teuthology.orchestra.run.smithi085.stdout: fsid = 226f905a-1517-4a8c-8009-08779515965c 2020-10-31T22:50:32.376 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.376 INFO:teuthology.orchestra.run.smithi085.stdout:[osd] 2020-10-31T22:50:32.376 INFO:teuthology.orchestra.run.smithi085.stdout: osd journal size = 100 2020-10-31T22:50:32.377 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.377 INFO:teuthology.orchestra.run.smithi085.stdout: osd scrub load threshold = 5.0 2020-10-31T22:50:32.377 INFO:teuthology.orchestra.run.smithi085.stdout: osd scrub max interval = 600 2020-10-31T22:50:32.377 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.377 INFO:teuthology.orchestra.run.smithi085.stdout: osd recover clone overlap = true 2020-10-31T22:50:32.377 INFO:teuthology.orchestra.run.smithi085.stdout: osd recovery max chunk = 1048576 2020-10-31T22:50:32.377 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.378 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug shutdown = true 2020-10-31T22:50:32.378 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug op order = true 2020-10-31T22:50:32.378 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug verify stray on activate = true 2020-10-31T22:50:32.378 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.378 INFO:teuthology.orchestra.run.smithi085.stdout: osd open classes on start = true 2020-10-31T22:50:32.378 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug pg log writeout = true 2020-10-31T22:50:32.378 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.379 INFO:teuthology.orchestra.run.smithi085.stdout: osd deep scrub update digest min age = 30 2020-10-31T22:50:32.379 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.379 INFO:teuthology.orchestra.run.smithi085.stdout: osd map max advance = 10 2020-10-31T22:50:32.379 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.379 INFO:teuthology.orchestra.run.smithi085.stdout: journal zero on create = true 2020-10-31T22:50:32.379 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.379 INFO:teuthology.orchestra.run.smithi085.stdout: filestore ondisk finisher threads = 3 2020-10-31T22:50:32.380 INFO:teuthology.orchestra.run.smithi085.stdout: filestore apply finisher threads = 3 2020-10-31T22:50:32.380 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.380 INFO:teuthology.orchestra.run.smithi085.stdout: bdev debug aio = true 2020-10-31T22:50:32.380 INFO:teuthology.orchestra.run.smithi085.stdout: osd debug misdirected ops = true 2020-10-31T22:50:32.380 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore block size = 96636764160 2020-10-31T22:50:32.380 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore compression mode = aggressive 2020-10-31T22:50:32.380 INFO:teuthology.orchestra.run.smithi085.stdout: bluestore fsck on mount = True 2020-10-31T22:50:32.381 INFO:teuthology.orchestra.run.smithi085.stdout: debug bluefs = 20 2020-10-31T22:50:32.381 INFO:teuthology.orchestra.run.smithi085.stdout: debug bluestore = 20 2020-10-31T22:50:32.381 INFO:teuthology.orchestra.run.smithi085.stdout: debug filestore = 20 2020-10-31T22:50:32.381 INFO:teuthology.orchestra.run.smithi085.stdout: debug journal = 20 2020-10-31T22:50:32.381 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 20 2020-10-31T22:50:32.381 INFO:teuthology.orchestra.run.smithi085.stdout: debug osd = 25 2020-10-31T22:50:32.381 INFO:teuthology.orchestra.run.smithi085.stdout: debug rocksdb = 10 2020-10-31T22:50:32.382 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd backfillfull_ratio = 0.85 2020-10-31T22:50:32.382 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd full ratio = 0.9 2020-10-31T22:50:32.382 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd nearfull ratio = 0.8 2020-10-31T22:50:32.382 INFO:teuthology.orchestra.run.smithi085.stdout: osd failsafe full ratio = 0.95 2020-10-31T22:50:32.382 INFO:teuthology.orchestra.run.smithi085.stdout: osd objectstore = bluestore 2020-10-31T22:50:32.382 INFO:teuthology.orchestra.run.smithi085.stdout: osd op complaint time = 180 2020-10-31T22:50:32.383 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.383 INFO:teuthology.orchestra.run.smithi085.stdout:[mgr] 2020-10-31T22:50:32.383 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2020-10-31T22:50:32.383 INFO:teuthology.orchestra.run.smithi085.stdout: debug mgr = 20 2020-10-31T22:50:32.383 INFO:teuthology.orchestra.run.smithi085.stdout: debug mon = 20 2020-10-31T22:50:32.384 INFO:teuthology.orchestra.run.smithi085.stdout: debug auth = 20 2020-10-31T22:50:32.384 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:32.384 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:32.384 INFO:teuthology.orchestra.run.smithi085.stdout: mgr/telemetry/nag = false 2020-10-31T22:50:32.384 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.384 INFO:teuthology.orchestra.run.smithi085.stdout:[mon] 2020-10-31T22:50:32.384 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2020-10-31T22:50:32.385 INFO:teuthology.orchestra.run.smithi085.stdout: debug mon = 20 2020-10-31T22:50:32.385 INFO:teuthology.orchestra.run.smithi085.stdout: debug paxos = 20 2020-10-31T22:50:32.385 INFO:teuthology.orchestra.run.smithi085.stdout: debug auth = 20 2020-10-31T22:50:32.385 INFO:teuthology.orchestra.run.smithi085.stdout: mon data avail warn = 5 2020-10-31T22:50:32.385 INFO:teuthology.orchestra.run.smithi085.stdout: mon mgr mkfs grace = 240 2020-10-31T22:50:32.385 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:32.385 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd reporter subtree level = osd 2020-10-31T22:50:32.386 INFO:teuthology.orchestra.run.smithi085.stdout: mon osd prime pg temp = true 2020-10-31T22:50:32.386 INFO:teuthology.orchestra.run.smithi085.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:32.386 INFO:teuthology.orchestra.run.smithi085.stdout: mon op complaint time = 120 2020-10-31T22:50:32.386 INFO:teuthology.orchestra.run.smithi085.stdout: 2020-10-31T22:50:32.386 INFO:teuthology.orchestra.run.smithi085.stdout:[client] 2020-10-31T22:50:32.386 INFO:teuthology.orchestra.run.smithi085.stdout: rgw cache enabled = true 2020-10-31T22:50:32.386 INFO:teuthology.orchestra.run.smithi085.stdout: rgw enable ops log = true 2020-10-31T22:50:32.387 INFO:teuthology.orchestra.run.smithi085.stdout: rgw enable usage log = true 2020-10-31T22:50:32.387 INFO:teuthology.orchestra.run.smithi085.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-31T22:50:32.387 INFO:teuthology.orchestra.run.smithi085.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-31T22:50:32.387 INFO:teuthology.orchestra.run.smithi085.stdout: client mount timeout = 600 2020-10-31T22:50:32.387 INFO:teuthology.orchestra.run.smithi085.stdout: debug client = 20 2020-10-31T22:50:32.387 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2020-10-31T22:50:32.387 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.a] 2020-10-31T22:50:32.388 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.b] 2020-10-31T22:50:32.388 INFO:teuthology.orchestra.run.smithi085.stdout:[mon.c] 2020-10-31T22:50:32.388 INFO:teuthology.orchestra.run.smithi085.stdout:[mds.a] 2020-10-31T22:50:32.388 INFO:teuthology.orchestra.run.smithi085.stdout:[mds.c] 2020-10-31T22:50:32.388 INFO:teuthology.orchestra.run.smithi085.stdout:[mds.b] 2020-10-31T22:50:32.388 INFO:teuthology.orchestra.run.smithi085.stdout:[mds] 2020-10-31T22:50:32.388 INFO:teuthology.orchestra.run.smithi085.stdout: debug mds = 20 2020-10-31T22:50:32.389 INFO:teuthology.orchestra.run.smithi085.stdout: debug ms = 1 2020-10-31T22:50:32.389 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal frag = True 2020-10-31T22:50:32.389 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal fragment size max = 10000 2020-10-31T22:50:32.389 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal merge size = 5 2020-10-31T22:50:32.389 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal split bits = 3 2020-10-31T22:50:32.389 INFO:teuthology.orchestra.run.smithi085.stdout: mds bal split size = 100 2020-10-31T22:50:32.389 INFO:teuthology.orchestra.run.smithi085.stdout: mds debug frag = True 2020-10-31T22:50:32.389 INFO:teuthology.orchestra.run.smithi085.stdout: mds debug scatterstat = True 2020-10-31T22:50:32.390 INFO:teuthology.orchestra.run.smithi085.stdout: mds op complaint time = 180 2020-10-31T22:50:32.390 INFO:teuthology.orchestra.run.smithi085.stdout: mds verify scatter = True 2020-10-31T22:50:32.390 INFO:teuthology.orchestra.run.smithi085.stdout: osd op complaint time = 180 2020-10-31T22:50:32.390 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2020-10-31T22:50:32.390 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2020-10-31T22:50:32.390 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-10-31T22:50:32.391 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2020-10-31T22:50:32.391 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.391 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2020-10-31T22:50:32.391 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.391 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2020-10-31T22:50:32.391 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.392 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2020-10-31T22:50:32.392 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2020-10-31T22:50:32.392 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.392 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2020-10-31T22:50:32.392 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2020-10-31T22:50:32.392 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.392 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2020-10-31T22:50:32.393 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2020-10-31T22:50:32.393 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.393 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2020-10-31T22:50:32.393 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2020-10-31T22:50:32.393 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.393 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2020-10-31T22:50:32.394 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.394 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2020-10-31T22:50:32.394 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2020-10-31T22:50:32.394 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2020-10-31T22:50:32.394 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2020-10-31T22:50:32.394 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2020-10-31T22:50:32.394 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2020-10-31T22:50:32.395 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2020-10-31T22:50:32.395 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-10-31T22:50:32.395 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2020-10-31T22:50:32.395 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.395 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-10-31T22:50:32.395 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.395 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2020-10-31T22:50:32.395 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.396 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2020-10-31T22:50:32.396 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.396 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2020-10-31T22:50:32.396 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2020-10-31T22:50:32.396 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.60,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2020-10-31T22:50:32.396 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 226f905a-1517-4a8c-8009-08779515965c 2020-10-31T22:50:32.396 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.397 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2020-10-31T22:50:32.397 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2020-10-31T22:50:32.397 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.397 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2020-10-31T22:50:32.397 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2020-10-31T22:50:32.397 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.397 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2020-10-31T22:50:32.398 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2020-10-31T22:50:32.399 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.399 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2020-10-31T22:50:32.399 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2020-10-31T22:50:32.399 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2020-10-31T22:50:32.399 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.399 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2020-10-31T22:50:32.400 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2020-10-31T22:50:32.400 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.400 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2020-10-31T22:50:32.400 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.400 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2020-10-31T22:50:32.400 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.400 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2020-10-31T22:50:32.401 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.401 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2020-10-31T22:50:32.401 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2020-10-31T22:50:32.401 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.401 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2020-10-31T22:50:32.401 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2020-10-31T22:50:32.401 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2020-10-31T22:50:32.402 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore compression mode = aggressive 2020-10-31T22:50:32.402 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2020-10-31T22:50:32.402 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 20 2020-10-31T22:50:32.402 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 20 2020-10-31T22:50:32.402 INFO:teuthology.orchestra.run.smithi066.stdout: debug filestore = 20 2020-10-31T22:50:32.402 INFO:teuthology.orchestra.run.smithi066.stdout: debug journal = 20 2020-10-31T22:50:32.402 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 20 2020-10-31T22:50:32.403 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 25 2020-10-31T22:50:32.403 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 10 2020-10-31T22:50:32.403 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2020-10-31T22:50:32.403 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2020-10-31T22:50:32.403 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2020-10-31T22:50:32.403 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2020-10-31T22:50:32.403 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2020-10-31T22:50:32.404 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2020-10-31T22:50:32.404 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.404 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2020-10-31T22:50:32.404 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-10-31T22:50:32.404 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2020-10-31T22:50:32.404 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2020-10-31T22:50:32.404 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2020-10-31T22:50:32.405 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:32.405 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:32.405 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2020-10-31T22:50:32.406 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.406 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2020-10-31T22:50:32.406 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-10-31T22:50:32.406 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2020-10-31T22:50:32.406 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2020-10-31T22:50:32.406 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2020-10-31T22:50:32.406 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2020-10-31T22:50:32.407 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2020-10-31T22:50:32.407 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2020-10-31T22:50:32.407 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2020-10-31T22:50:32.407 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2020-10-31T22:50:32.407 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2020-10-31T22:50:32.407 INFO:teuthology.orchestra.run.smithi066.stdout: mon op complaint time = 120 2020-10-31T22:50:32.407 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-10-31T22:50:32.408 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2020-10-31T22:50:32.408 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2020-10-31T22:50:32.408 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2020-10-31T22:50:32.408 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2020-10-31T22:50:32.408 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-10-31T22:50:32.408 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-10-31T22:50:32.408 INFO:teuthology.orchestra.run.smithi066.stdout: client mount timeout = 600 2020-10-31T22:50:32.409 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2020-10-31T22:50:32.409 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-10-31T22:50:32.409 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2020-10-31T22:50:32.409 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2020-10-31T22:50:32.409 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2020-10-31T22:50:32.409 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2020-10-31T22:50:32.409 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2020-10-31T22:50:32.410 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2020-10-31T22:50:32.410 INFO:teuthology.orchestra.run.smithi066.stdout:[mds] 2020-10-31T22:50:32.410 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds = 20 2020-10-31T22:50:32.410 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-10-31T22:50:32.410 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal frag = True 2020-10-31T22:50:32.410 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal fragment size max = 10000 2020-10-31T22:50:32.410 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal merge size = 5 2020-10-31T22:50:32.410 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal split bits = 3 2020-10-31T22:50:32.411 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal split size = 100 2020-10-31T22:50:32.411 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug frag = True 2020-10-31T22:50:32.411 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug scatterstat = True 2020-10-31T22:50:32.411 INFO:teuthology.orchestra.run.smithi066.stdout: mds op complaint time = 180 2020-10-31T22:50:32.411 INFO:teuthology.orchestra.run.smithi066.stdout: mds verify scatter = True 2020-10-31T22:50:32.411 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2020-10-31T22:50:32.412 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2020-10-31T22:50:32.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.533+0000 7fbf893db700 1 Processor -- start 2020-10-31T22:50:32.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf893db700 1 -- start start 2020-10-31T22:50:32.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf893db700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf840b1d50 0x7fbf8405bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf893db700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbf8405c2d0 0x7fbf84146c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf893db700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8405b080 con 0x7fbf84149740 2020-10-31T22:50:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf893db700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf84147130 con 0x7fbf840b1d50 2020-10-31T22:50:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf893db700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf840b2130 con 0x7fbf8405c2d0 2020-10-31T22:50:32.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf83fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf840b1d50 0x7fbf8405bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf83fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fbf840b1d50 0x7fbf8405bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49172/0 (socket says 172.21.15.60:49172) 2020-10-31T22:50:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf7b7fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbf8405c2d0 0x7fbf84146c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf83fff700 1 -- 172.21.15.60:0/3819601675 learned_addr learned my addr 172.21.15.60:0/3819601675 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf83fff700 1 -- 172.21.15.60:0/3819601675 >> v2:172.21.15.66:3300/0 conn(0x7fbf8405c2d0 msgr2=0x7fbf84146c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf83fff700 1 --2- 172.21.15.60:0/3819601675 >> v2:172.21.15.66:3300/0 conn(0x7fbf8405c2d0 0x7fbf84146c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf83fff700 1 -- 172.21.15.60:0/3819601675 >> v1:172.21.15.66:6789/0 conn(0x7fbf84149740 legacy=0x7fbf84149bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:32.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf83fff700 1 -- 172.21.15.60:0/3819601675 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8405b2b0 con 0x7fbf840b1d50 2020-10-31T22:50:32.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf83fff700 1 --2- 172.21.15.60:0/3819601675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf840b1d50 0x7fbf8405bc90 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7fbf74002f30 tx=0x7fbf74006e80).ready entity=mon.0 client_cookie=cf481690ce661e06 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:32.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf837fe700 1 -- 172.21.15.60:0/3819601675 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf740097f0 con 0x7fbf840b1d50 2020-10-31T22:50:32.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf837fe700 1 -- 172.21.15.60:0/3819601675 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf74009950 con 0x7fbf840b1d50 2020-10-31T22:50:32.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf837fe700 1 -- 172.21.15.60:0/3819601675 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf74009cb0 con 0x7fbf840b1d50 2020-10-31T22:50:32.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf893db700 1 -- 172.21.15.60:0/3819601675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf840b1d50 msgr2=0x7fbf8405bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:32.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf893db700 1 --2- 172.21.15.60:0/3819601675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf840b1d50 0x7fbf8405bc90 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 rx=0x7fbf74002f30 tx=0x7fbf74006e80).stop 2020-10-31T22:50:32.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf893db700 1 -- 172.21.15.60:0/3819601675 shutdown_connections 2020-10-31T22:50:32.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf893db700 1 --2- 172.21.15.60:0/3819601675 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf840b1d50 0x7fbf8405bc90 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:32.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf893db700 1 --2- 172.21.15.60:0/3819601675 >> v2:172.21.15.66:3300/0 conn(0x7fbf8405c2d0 0x7fbf84146c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf893db700 1 -- 172.21.15.60:0/3819601675 >> 172.21.15.60:0/3819601675 conn(0x7fbf840b5300 msgr2=0x7fbf840b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf893db700 1 -- 172.21.15.60:0/3819601675 shutdown_connections 2020-10-31T22:50:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.537+0000 7fbf893db700 1 -- 172.21.15.60:0/3819601675 wait complete. 2020-10-31T22:50:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf893db700 1 Processor -- start 2020-10-31T22:50:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf893db700 1 -- start start 2020-10-31T22:50:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf893db700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf8405c2d0 0x7fbf84148c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:32.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf893db700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf840b1d50 0x7fbf8414ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:32.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf893db700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf84149740 0x7fbf8414a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:32.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf893db700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84062e60 con 0x7fbf8405c2d0 2020-10-31T22:50:32.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf893db700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84159540 con 0x7fbf84149740 2020-10-31T22:50:32.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf893db700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf84063090 con 0x7fbf840b1d50 2020-10-31T22:50:32.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf83fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf8405c2d0 0x7fbf84148c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:32.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf83fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf8405c2d0 0x7fbf84148c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49178/0 (socket says 172.21.15.60:49178) 2020-10-31T22:50:32.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf83fff700 1 -- 172.21.15.60:0/2636679834 learned_addr learned my addr 172.21.15.60:0/2636679834 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:32.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf7b7fe700 1 --2- 172.21.15.60:0/2636679834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf840b1d50 0x7fbf8414ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:32.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf88bda700 1 --2- 172.21.15.60:0/2636679834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf84149740 0x7fbf8414a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:32.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf83fff700 1 -- 172.21.15.60:0/2636679834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf840b1d50 msgr2=0x7fbf8414ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:32.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf83fff700 1 --2- 172.21.15.60:0/2636679834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf840b1d50 0x7fbf8414ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:32.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf83fff700 1 -- 172.21.15.60:0/2636679834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf84149740 msgr2=0x7fbf8414a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:32.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf83fff700 1 --2- 172.21.15.60:0/2636679834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf84149740 0x7fbf8414a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf83fff700 1 -- 172.21.15.60:0/2636679834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf84159000 con 0x7fbf8405c2d0 2020-10-31T22:50:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf83fff700 1 --2- 172.21.15.60:0/2636679834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf8405c2d0 0x7fbf84148c20 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7fbf74002f30 tx=0x7fbf74015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf81ffb700 1 -- 172.21.15.60:0/2636679834 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf74011c30 con 0x7fbf8405c2d0 2020-10-31T22:50:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf81ffb700 1 -- 172.21.15.60:0/2636679834 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf74011d90 con 0x7fbf8405c2d0 2020-10-31T22:50:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf893db700 1 -- 172.21.15.60:0/2636679834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf841592a0 con 0x7fbf8405c2d0 2020-10-31T22:50:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf81ffb700 1 -- 172.21.15.60:0/2636679834 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbf7401e650 con 0x7fbf8405c2d0 2020-10-31T22:50:32.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.541+0000 7fbf893db700 1 -- 172.21.15.60:0/2636679834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8414d5a0 con 0x7fbf8405c2d0 2020-10-31T22:50:32.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.545+0000 7fbf893db700 1 -- 172.21.15.60:0/2636679834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf840ab320 con 0x7fbf8405c2d0 2020-10-31T22:50:32.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.545+0000 7fbf81ffb700 1 -- 172.21.15.60:0/2636679834 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbf74025030 con 0x7fbf8405c2d0 2020-10-31T22:50:32.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.545+0000 7fbf81ffb700 1 --2- 172.21.15.60:0/2636679834 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbf68054f10 0x7fbf680573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:32.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.545+0000 7fbf81ffb700 1 -- 172.21.15.60:0/2636679834 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fbf7406ecb0 con 0x7fbf8405c2d0 2020-10-31T22:50:32.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.545+0000 7fbf7b7fe700 1 --2- 172.21.15.60:0/2636679834 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbf68054f10 0x7fbf680573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:32.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.545+0000 7fbf7b7fe700 1 --2- 172.21.15.60:0/2636679834 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbf68054f10 0x7fbf680573d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fbf6c00b000 tx=0x7fbf6c006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:32.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.553+0000 7fbf81ffb700 1 -- 172.21.15.60:0/2636679834 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbf74045150 con 0x7fbf8405c2d0 2020-10-31T22:50:32.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.697+0000 7fbf893db700 1 -- 172.21.15.60:0/2636679834 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fbf84057100 con 0x7fbf8405c2d0 2020-10-31T22:50:32.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.705+0000 7fbf81ffb700 1 -- 172.21.15.60:0/2636679834 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbf74023020 con 0x7fbf8405c2d0 2020-10-31T22:50:32.711 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.705+0000 7fbf893db700 1 -- 172.21.15.60:0/2636679834 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbf68054f10 msgr2=0x7fbf680573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:32.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.705+0000 7fbf893db700 1 --2- 172.21.15.60:0/2636679834 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbf68054f10 0x7fbf680573d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7fbf6c00b000 tx=0x7fbf6c006dc0).stop 2020-10-31T22:50:32.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.705+0000 7fbf893db700 1 -- 172.21.15.60:0/2636679834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf8405c2d0 msgr2=0x7fbf84148c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:32.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.705+0000 7fbf893db700 1 --2- 172.21.15.60:0/2636679834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf8405c2d0 0x7fbf84148c20 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 rx=0x7fbf74002f30 tx=0x7fbf74015000).stop 2020-10-31T22:50:32.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.705+0000 7fbf893db700 1 -- 172.21.15.60:0/2636679834 shutdown_connections 2020-10-31T22:50:32.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.705+0000 7fbf893db700 1 --2- 172.21.15.60:0/2636679834 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbf68054f10 0x7fbf680573d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:32.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.705+0000 7fbf893db700 1 --2- 172.21.15.60:0/2636679834 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf84149740 0x7fbf8414a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.705+0000 7fbf893db700 1 --2- 172.21.15.60:0/2636679834 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbf8405c2d0 0x7fbf84148c20 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.705+0000 7fbf893db700 1 --2- 172.21.15.60:0/2636679834 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbf840b1d50 0x7fbf8414ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.705+0000 7fbf893db700 1 -- 172.21.15.60:0/2636679834 >> 172.21.15.60:0/2636679834 conn(0x7fbf840b5300 msgr2=0x7fbf84149bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:32.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.705+0000 7fbf893db700 1 -- 172.21.15.60:0/2636679834 shutdown_connections 2020-10-31T22:50:32.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.705+0000 7fbf893db700 1 -- 172.21.15.60:0/2636679834 wait complete. 2020-10-31T22:50:32.724 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps' 2020-10-31T22:50:32.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.837+0000 7f195759e700 1 Processor -- start 2020-10-31T22:50:32.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.837+0000 7f195759e700 1 -- start start 2020-10-31T22:50:32.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.837+0000 7f195759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f19580b5570 0x7f19580b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:32.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.837+0000 7f195759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1958145180 con 0x7f19580b24a0 2020-10-31T22:50:32.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.837+0000 7f195759e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19580b0670 con 0x7f1958141fe0 2020-10-31T22:50:32.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.837+0000 7f195759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19580afae0 con 0x7f19580b5570 2020-10-31T22:50:32.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.837+0000 7f194ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f19580b24a0 0x7f1958145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53320/0 (socket says 172.21.15.60:53320) 2020-10-31T22:50:32.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.837+0000 7f194ffff700 1 -- 172.21.15.60:0/4063656435 learned_addr learned my addr 172.21.15.60:0/4063656435 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:32.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.837+0000 7f195659c700 1 --2- 172.21.15.60:0/4063656435 >> v2:172.21.15.66:3300/0 conn(0x7f19580b5570 0x7f19580b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:32.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.837+0000 7f1955d9b700 1 -- 172.21.15.60:0/4063656435 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359514679 0 0) 0x7f1958145180 con 0x7f19580b24a0 2020-10-31T22:50:32.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.837+0000 7f1955d9b700 1 -- 172.21.15.60:0/4063656435 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1938003230 con 0x7f19580b24a0 2020-10-31T22:50:32.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.837+0000 7f195659c700 1 -- 172.21.15.60:0/4063656435 >> v1:172.21.15.66:6789/0 conn(0x7f1958141fe0 legacy=0x7f1958142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:32.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.837+0000 7f195659c700 1 -- 172.21.15.60:0/4063656435 >> v1:172.21.15.60:6789/0 conn(0x7f19580b24a0 legacy=0x7f1958145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:32.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.837+0000 7f195659c700 1 -- 172.21.15.60:0/4063656435 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19580b0910 con 0x7f19580b5570 2020-10-31T22:50:32.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.841+0000 7f195659c700 1 --2- 172.21.15.60:0/4063656435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19580b5570 0x7f19580b5950 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f195805f580 tx=0x7f1948006dc0).ready entity=mon.1 client_cookie=50348c1c12e42cf6 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:32.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.841+0000 7f1955d9b700 1 -- 172.21.15.60:0/4063656435 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19480097c0 con 0x7f19580b5570 2020-10-31T22:50:32.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.841+0000 7f1955d9b700 1 -- 172.21.15.60:0/4063656435 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1948009920 con 0x7f19580b5570 2020-10-31T22:50:32.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.841+0000 7f1955d9b700 1 -- 172.21.15.60:0/4063656435 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1948009c80 con 0x7f19580b5570 2020-10-31T22:50:32.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.841+0000 7f195759e700 1 -- 172.21.15.60:0/4063656435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19580b5570 msgr2=0x7f19580b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:32.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.841+0000 7f195759e700 1 --2- 172.21.15.60:0/4063656435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19580b5570 0x7f19580b5950 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f195805f580 tx=0x7f1948006dc0).stop 2020-10-31T22:50:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.841+0000 7f195759e700 1 -- 172.21.15.60:0/4063656435 shutdown_connections 2020-10-31T22:50:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.841+0000 7f195759e700 1 --2- 172.21.15.60:0/4063656435 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19580b5570 0x7f19580b5950 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:32.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.841+0000 7f195759e700 1 -- 172.21.15.60:0/4063656435 >> 172.21.15.60:0/4063656435 conn(0x7f19580b8e90 msgr2=0x7f19580b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:32.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.841+0000 7f195759e700 1 -- 172.21.15.60:0/4063656435 shutdown_connections 2020-10-31T22:50:32.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.841+0000 7f195759e700 1 -- 172.21.15.60:0/4063656435 wait complete. 2020-10-31T22:50:32.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.841+0000 7f195759e700 1 Processor -- start 2020-10-31T22:50:32.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.841+0000 7f195759e700 1 -- start start 2020-10-31T22:50:32.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19580b24a0 0x7f19580b7200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:32.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19580b5570 0x7f1958150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1958141fe0 0x7f19580ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19580af280 con 0x7f19580b24a0 2020-10-31T22:50:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19580b76f0 con 0x7f1958141fe0 2020-10-31T22:50:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19580acb70 con 0x7f19580b5570 2020-10-31T22:50:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19580b24a0 0x7f19580b7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19580b24a0 0x7f19580b7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49188/0 (socket says 172.21.15.60:49188) 2020-10-31T22:50:32.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195659c700 1 -- 172.21.15.60:0/306786087 learned_addr learned my addr 172.21.15.60:0/306786087 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f194ffff700 1 --2- 172.21.15.60:0/306786087 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19580b5570 0x7f1958150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f1956d9d700 1 --2- 172.21.15.60:0/306786087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1958141fe0 0x7f19580ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195659c700 1 -- 172.21.15.60:0/306786087 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19580b5570 msgr2=0x7f1958150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195659c700 1 --2- 172.21.15.60:0/306786087 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19580b5570 0x7f1958150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195659c700 1 -- 172.21.15.60:0/306786087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1958141fe0 msgr2=0x7f19580ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:32.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195659c700 1 --2- 172.21.15.60:0/306786087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1958141fe0 0x7f19580ae660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:32.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195659c700 1 -- 172.21.15.60:0/306786087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19580acde0 con 0x7f19580b24a0 2020-10-31T22:50:32.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195659c700 1 --2- 172.21.15.60:0/306786087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19580b24a0 0x7f19580b7200 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f19580acd00 tx=0x7f1948015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:32.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f194f7fe700 1 -- 172.21.15.60:0/306786087 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1948011b40 con 0x7f19580b24a0 2020-10-31T22:50:32.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f194f7fe700 1 -- 172.21.15.60:0/306786087 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1948011ca0 con 0x7f19580b24a0 2020-10-31T22:50:32.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f194f7fe700 1 -- 172.21.15.60:0/306786087 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f194801d450 con 0x7f19580b24a0 2020-10-31T22:50:32.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195759e700 1 -- 172.21.15.60:0/306786087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19580b6b10 con 0x7f19580b24a0 2020-10-31T22:50:32.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.845+0000 7f195759e700 1 -- 172.21.15.60:0/306786087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1958150fe0 con 0x7f19580b24a0 2020-10-31T22:50:32.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.849+0000 7f195759e700 1 -- 172.21.15.60:0/306786087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19580b6ca0 con 0x7f19580b24a0 2020-10-31T22:50:32.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.849+0000 7f194f7fe700 1 -- 172.21.15.60:0/306786087 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1948024030 con 0x7f19580b24a0 2020-10-31T22:50:32.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.849+0000 7f194f7fe700 1 --2- 172.21.15.60:0/306786087 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f193c054f10 0x7f193c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:32.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.849+0000 7f194f7fe700 1 -- 172.21.15.60:0/306786087 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f194806eb30 con 0x7f19580b24a0 2020-10-31T22:50:32.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.849+0000 7f194ffff700 1 --2- 172.21.15.60:0/306786087 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f193c054f10 0x7f193c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:32.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.849+0000 7f194ffff700 1 --2- 172.21.15.60:0/306786087 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f193c054f10 0x7f193c0573d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f194000d000 tx=0x7f1940009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:32.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:32.857+0000 7f194f7fe700 1 -- 172.21.15.60:0/306786087 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1948045050 con 0x7f19580b24a0 2020-10-31T22:50:33.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:33.045+0000 7f195759e700 1 -- 172.21.15.60:0/306786087 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]} v 0) v1 -- 0x7f1958057100 con 0x7f19580b24a0 2020-10-31T22:50:33.883 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:33.877+0000 7f194f7fe700 1 -- 172.21.15.60:0/306786087 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_getattr_caps"]}]=0 v427) v1 ==== 128+0+0 (secure 0 0 0) 0x7f1948022070 con 0x7f19580b24a0 2020-10-31T22:50:33.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:33.881+0000 7f195759e700 1 -- 172.21.15.60:0/306786087 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f193c054f10 msgr2=0x7f193c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:33.887 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:33.881+0000 7f195759e700 1 --2- 172.21.15.60:0/306786087 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f193c054f10 0x7f193c0573d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f194000d000 tx=0x7f1940009040).stop 2020-10-31T22:50:33.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:33.881+0000 7f195759e700 1 -- 172.21.15.60:0/306786087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19580b24a0 msgr2=0x7f19580b7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:33.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:33.881+0000 7f195759e700 1 --2- 172.21.15.60:0/306786087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19580b24a0 0x7f19580b7200 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 rx=0x7f19580acd00 tx=0x7f1948015000).stop 2020-10-31T22:50:33.888 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:33.881+0000 7f195759e700 1 -- 172.21.15.60:0/306786087 shutdown_connections 2020-10-31T22:50:33.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:33.881+0000 7f195759e700 1 --2- 172.21.15.60:0/306786087 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f193c054f10 0x7f193c0573d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:33.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:33.881+0000 7f195759e700 1 --2- 172.21.15.60:0/306786087 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1958141fe0 0x7f19580ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:33.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:33.881+0000 7f195759e700 1 --2- 172.21.15.60:0/306786087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19580b24a0 0x7f19580b7200 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:33.889 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:33.881+0000 7f195759e700 1 --2- 172.21.15.60:0/306786087 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19580b5570 0x7f1958150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:33.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:33.881+0000 7f195759e700 1 -- 172.21.15.60:0/306786087 >> 172.21.15.60:0/306786087 conn(0x7f19580b8e90 msgr2=0x7f1958066380 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:33.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:33.881+0000 7f195759e700 1 -- 172.21.15.60:0/306786087 shutdown_connections 2020-10-31T22:50:33.890 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:33.881+0000 7f195759e700 1 -- 172.21.15.60:0/306786087 wait complete. 2020-10-31T22:50:33.905 INFO:tasks.cephfs_test_runner:test_getattr_caps (tasks.cephfs.test_misc.TestMisc) ... ok 2020-10-31T22:50:33.906 INFO:tasks.cephfs_test_runner:Starting test: test_root_rctime (tasks.cephfs.test_misc.TestMisc) 2020-10-31T22:50:33.906 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2020-10-31T22:50:34.029 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19e2e58700 1 Processor -- start 2020-10-31T22:50:34.030 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19e2e58700 1 -- start start 2020-10-31T22:50:34.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19e2e58700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f19dc064a20 0x7f19dc0b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:34.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19e2e58700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19dc0b0d20 con 0x7f19dc0b18e0 2020-10-31T22:50:34.033 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19e2e58700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19dc146cf0 con 0x7f19dc05b180 2020-10-31T22:50:34.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19e2e58700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19dc146f90 con 0x7f19dc064a20 2020-10-31T22:50:34.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19e13f5700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f19dc0b18e0 0x7f19dc150b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53336/0 (socket says 172.21.15.60:53336) 2020-10-31T22:50:34.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19e13f5700 1 -- 172.21.15.60:0/1545146875 learned_addr learned my addr 172.21.15.60:0/1545146875 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:34.034 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19dbfff700 1 --2- 172.21.15.60:0/1545146875 >> v2:172.21.15.66:3300/0 conn(0x7f19dc064a20 0x7f19dc0b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19db7fe700 1 -- 172.21.15.60:0/1545146875 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273134142 0 0) 0x7f19dc0b0d20 con 0x7f19dc0b18e0 2020-10-31T22:50:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19db7fe700 1 -- 172.21.15.60:0/1545146875 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c0003230 con 0x7f19dc0b18e0 2020-10-31T22:50:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19db7fe700 1 -- 172.21.15.60:0/1545146875 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2650415042 0 0) 0x7f19dc146cf0 con 0x7f19dc05b180 2020-10-31T22:50:34.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19db7fe700 1 -- 172.21.15.60:0/1545146875 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19dc0b0d20 con 0x7f19dc05b180 2020-10-31T22:50:34.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19dbfff700 1 -- 172.21.15.60:0/1545146875 >> v1:172.21.15.66:6789/0 conn(0x7f19dc05b180 legacy=0x7f19dc1461d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:34.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19dbfff700 1 -- 172.21.15.60:0/1545146875 >> v1:172.21.15.60:6789/0 conn(0x7f19dc0b18e0 legacy=0x7f19dc150b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:34.036 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19dbfff700 1 -- 172.21.15.60:0/1545146875 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc0b0f50 con 0x7f19dc064a20 2020-10-31T22:50:34.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19dbfff700 1 --2- 172.21.15.60:0/1545146875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19dc064a20 0x7f19dc0b13f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f19c40032b0 tx=0x7f19c40091a0).ready entity=mon.1 client_cookie=b89a16e9b6472830 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:34.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19db7fe700 1 -- 172.21.15.60:0/1545146875 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19c400b940 con 0x7f19dc064a20 2020-10-31T22:50:34.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19db7fe700 1 -- 172.21.15.60:0/1545146875 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c400baa0 con 0x7f19dc064a20 2020-10-31T22:50:34.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19db7fe700 1 -- 172.21.15.60:0/1545146875 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19c400bc10 con 0x7f19dc064a20 2020-10-31T22:50:34.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19e2e58700 1 -- 172.21.15.60:0/1545146875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19dc064a20 msgr2=0x7f19dc0b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:34.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.025+0000 7f19e2e58700 1 --2- 172.21.15.60:0/1545146875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19dc064a20 0x7f19dc0b13f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f19c40032b0 tx=0x7f19c40091a0).stop 2020-10-31T22:50:34.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e2e58700 1 -- 172.21.15.60:0/1545146875 shutdown_connections 2020-10-31T22:50:34.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e2e58700 1 --2- 172.21.15.60:0/1545146875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19dc064a20 0x7f19dc0b13f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:34.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e2e58700 1 -- 172.21.15.60:0/1545146875 >> 172.21.15.60:0/1545146875 conn(0x7f19dc0b6380 msgr2=0x7f19dc0b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:34.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e2e58700 1 -- 172.21.15.60:0/1545146875 shutdown_connections 2020-10-31T22:50:34.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e2e58700 1 -- 172.21.15.60:0/1545146875 wait complete. 2020-10-31T22:50:34.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e2e58700 1 Processor -- start 2020-10-31T22:50:34.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e2e58700 1 -- start start 2020-10-31T22:50:34.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e2e58700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19dc05b180 0x7f19dc0aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:34.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e2e58700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19dc064a20 0x7f19dc142e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:34.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e2e58700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19dc0b18e0 0x7f19dc143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:34.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e2e58700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc143840 con 0x7f19dc05b180 2020-10-31T22:50:34.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e2e58700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc148da0 con 0x7f19dc0b18e0 2020-10-31T22:50:34.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e2e58700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19dc149040 con 0x7f19dc064a20 2020-10-31T22:50:34.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e0bf4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19dc05b180 0x7f19dc0aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:34.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e0bf4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19dc05b180 0x7f19dc0aea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49202/0 (socket says 172.21.15.60:49202) 2020-10-31T22:50:34.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.029+0000 7f19e0bf4700 1 -- 172.21.15.60:0/72555919 learned_addr learned my addr 172.21.15.60:0/72555919 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:34.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19dbfff700 1 --2- 172.21.15.60:0/72555919 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19dc064a20 0x7f19dc142e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:34.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19e13f5700 1 --2- 172.21.15.60:0/72555919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19dc0b18e0 0x7f19dc143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:34.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19e0bf4700 1 -- 172.21.15.60:0/72555919 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19dc064a20 msgr2=0x7f19dc142e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:34.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19e0bf4700 1 --2- 172.21.15.60:0/72555919 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19dc064a20 0x7f19dc142e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:34.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19e0bf4700 1 -- 172.21.15.60:0/72555919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19dc0b18e0 msgr2=0x7f19dc143350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:34.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19e0bf4700 1 --2- 172.21.15.60:0/72555919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19dc0b18e0 0x7f19dc143350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:34.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19e0bf4700 1 -- 172.21.15.60:0/72555919 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc1492e0 con 0x7f19dc05b180 2020-10-31T22:50:34.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19e0bf4700 1 --2- 172.21.15.60:0/72555919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19dc05b180 0x7f19dc0aea40 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f19d40010d0 tx=0x7f19d4007a20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:34.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19d9ffb700 1 -- 172.21.15.60:0/72555919 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d400f470 con 0x7f19dc05b180 2020-10-31T22:50:34.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19d9ffb700 1 -- 172.21.15.60:0/72555919 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d400f5d0 con 0x7f19dc05b180 2020-10-31T22:50:34.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19e2e58700 1 -- 172.21.15.60:0/72555919 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19dc149580 con 0x7f19dc05b180 2020-10-31T22:50:34.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19d9ffb700 1 -- 172.21.15.60:0/72555919 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19d400f930 con 0x7f19dc05b180 2020-10-31T22:50:34.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19e2e58700 1 -- 172.21.15.60:0/72555919 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19dc0b05e0 con 0x7f19dc05b180 2020-10-31T22:50:34.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19e2e58700 1 -- 172.21.15.60:0/72555919 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19dc069610 con 0x7f19dc05b180 2020-10-31T22:50:34.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19d9ffb700 1 -- 172.21.15.60:0/72555919 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f19d4019030 con 0x7f19dc05b180 2020-10-31T22:50:34.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19d9ffb700 1 --2- 172.21.15.60:0/72555919 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f19b4054fd0 0x7f19b4057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:34.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19d9ffb700 1 -- 172.21.15.60:0/72555919 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f19d406cdf0 con 0x7f19dc05b180 2020-10-31T22:50:34.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.033+0000 7f19dbfff700 1 --2- 172.21.15.60:0/72555919 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f19b4054fd0 0x7f19b4057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:34.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.037+0000 7f19dbfff700 1 --2- 172.21.15.60:0/72555919 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f19b4054fd0 0x7f19b4057490 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f19c401b000 tx=0x7f19c4016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:34.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.041+0000 7f19d9ffb700 1 -- 172.21.15.60:0/72555919 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f19dc069610 con 0x7f19dc05b180 2020-10-31T22:50:34.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.249+0000 7f19e2e58700 1 -- 172.21.15.60:0/72555919 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7f19dc069610 con 0x7f19dc05b180 2020-10-31T22:50:34.891 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.885+0000 7f19d9ffb700 1 -- 172.21.15.60:0/72555919 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v428) v1 ==== 130+0+0 (secure 0 0 0) 0x7f19dc069610 con 0x7f19dc05b180 2020-10-31T22:50:34.895 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.889+0000 7f19e2e58700 1 -- 172.21.15.60:0/72555919 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f19b4054fd0 msgr2=0x7f19b4057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:34.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.889+0000 7f19e2e58700 1 --2- 172.21.15.60:0/72555919 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f19b4054fd0 0x7f19b4057490 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f19c401b000 tx=0x7f19c4016000).stop 2020-10-31T22:50:34.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.889+0000 7f19e2e58700 1 -- 172.21.15.60:0/72555919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19dc05b180 msgr2=0x7f19dc0aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:34.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.889+0000 7f19e2e58700 1 --2- 172.21.15.60:0/72555919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19dc05b180 0x7f19dc0aea40 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 rx=0x7f19d40010d0 tx=0x7f19d4007a20).stop 2020-10-31T22:50:34.896 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.889+0000 7f19e2e58700 1 -- 172.21.15.60:0/72555919 shutdown_connections 2020-10-31T22:50:34.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.889+0000 7f19e2e58700 1 --2- 172.21.15.60:0/72555919 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f19b4054fd0 0x7f19b4057490 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:34.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.889+0000 7f19e2e58700 1 --2- 172.21.15.60:0/72555919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19dc0b18e0 0x7f19dc143350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:34.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.889+0000 7f19e2e58700 1 --2- 172.21.15.60:0/72555919 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19dc05b180 0x7f19dc0aea40 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:34.898 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.889+0000 7f19e2e58700 1 --2- 172.21.15.60:0/72555919 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19dc064a20 0x7f19dc142e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:34.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.889+0000 7f19e2e58700 1 -- 172.21.15.60:0/72555919 >> 172.21.15.60:0/72555919 conn(0x7f19dc0b6380 msgr2=0x7f19dc0b4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:34.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.889+0000 7f19e2e58700 1 -- 172.21.15.60:0/72555919 shutdown_connections 2020-10-31T22:50:34.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:34.889+0000 7f19e2e58700 1 -- 172.21.15.60:0/72555919 wait complete. 2020-10-31T22:50:34.912 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2020-10-31T22:50:35.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdff3fff700 1 Processor -- start 2020-10-31T22:50:35.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdff3fff700 1 -- start start 2020-10-31T22:50:35.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdff3fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdff40b5040 0x7fdff40b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdff3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdff40b13c0 0x7fdff4141f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdff3fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdff4063520 con 0x7fdff4063140 2020-10-31T22:50:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdff3fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdff40b5550 con 0x7fdff40b5040 2020-10-31T22:50:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdff3fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff40b57f0 con 0x7fdff40b13c0 2020-10-31T22:50:35.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdff2ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fdff4063140 0x7fdff40b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53346/0 (socket says 172.21.15.60:53346) 2020-10-31T22:50:35.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdff2ffd700 1 -- 172.21.15.60:0/667591821 learned_addr learned my addr 172.21.15.60:0/667591821 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:35.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdfea7fc700 1 --2- 172.21.15.60:0/667591821 >> v2:172.21.15.66:3300/0 conn(0x7fdff40b5040 0x7fdff40b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.044 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdff37fe700 1 --2- 172.21.15.60:0/667591821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdff40b13c0 0x7fdff4141f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdff27fc700 1 -- 172.21.15.60:0/667591821 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245059831 0 0) 0x7fdff4063520 con 0x7fdff4063140 2020-10-31T22:50:35.045 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdff27fc700 1 -- 172.21.15.60:0/667591821 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfd4003230 con 0x7fdff4063140 2020-10-31T22:50:35.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdfea7fc700 1 -- 172.21.15.60:0/667591821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdff40b13c0 msgr2=0x7fdff4141f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:35.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdfea7fc700 1 --2- 172.21.15.60:0/667591821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdff40b13c0 0x7fdff4141f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdfea7fc700 1 -- 172.21.15.60:0/667591821 >> v1:172.21.15.60:6789/0 conn(0x7fdff4063140 legacy=0x7fdff40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.046 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdfea7fc700 1 -- 172.21.15.60:0/667591821 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff40b5a90 con 0x7fdff40b5040 2020-10-31T22:50:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdfea7fc700 1 --2- 172.21.15.60:0/667591821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdff40b5040 0x7fdff40b2310 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fdfdc002f30 tx=0x7fdfdc006dc0).ready entity=mon.1 client_cookie=a076ef153ebb8cdb server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdff27fc700 1 -- 172.21.15.60:0/667591821 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfdc0096a0 con 0x7fdff40b5040 2020-10-31T22:50:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.037+0000 7fdff27fc700 1 -- 172.21.15.60:0/667591821 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfdc009800 con 0x7fdff40b5040 2020-10-31T22:50:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.041+0000 7fdff27fc700 1 -- 172.21.15.60:0/667591821 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfdc009b60 con 0x7fdff40b5040 2020-10-31T22:50:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.041+0000 7fdff3fff700 1 -- 172.21.15.60:0/667591821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdff40b5040 msgr2=0x7fdff40b2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.041+0000 7fdff3fff700 1 --2- 172.21.15.60:0/667591821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdff40b5040 0x7fdff40b2310 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7fdfdc002f30 tx=0x7fdfdc006dc0).stop 2020-10-31T22:50:35.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.041+0000 7fdff3fff700 1 -- 172.21.15.60:0/667591821 shutdown_connections 2020-10-31T22:50:35.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.041+0000 7fdff3fff700 1 --2- 172.21.15.60:0/667591821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdff40b13c0 0x7fdff4141f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.041+0000 7fdff3fff700 1 --2- 172.21.15.60:0/667591821 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdff40b5040 0x7fdff40b2310 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.041+0000 7fdff3fff700 1 -- 172.21.15.60:0/667591821 >> 172.21.15.60:0/667591821 conn(0x7fdff406a600 msgr2=0x7fdff4060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:35.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.041+0000 7fdff3fff700 1 -- 172.21.15.60:0/667591821 shutdown_connections 2020-10-31T22:50:35.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.041+0000 7fdff3fff700 1 -- 172.21.15.60:0/667591821 wait complete. 2020-10-31T22:50:35.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.041+0000 7fdff3fff700 1 Processor -- start 2020-10-31T22:50:35.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff3fff700 1 -- start start 2020-10-31T22:50:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff4063140 0x7fdff40a1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff3fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdff40b13c0 0x7fdff4151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdff40b5040 0x7fdff4152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff41526f0 con 0x7fdff4063140 2020-10-31T22:50:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff3fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff40a2030 con 0x7fdff40b13c0 2020-10-31T22:50:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff3fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff409e9a0 con 0x7fdff40b5040 2020-10-31T22:50:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff4063140 0x7fdff40a1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff2ffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff4063140 0x7fdff40a1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49216/0 (socket says 172.21.15.60:49216) 2020-10-31T22:50:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff2ffd700 1 -- 172.21.15.60:0/274007977 learned_addr learned my addr 172.21.15.60:0/274007977 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdfea7fc700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdff40b13c0 0x7fdff4151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff37fe700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdff40b5040 0x7fdff4152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff2ffd700 1 -- 172.21.15.60:0/274007977 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdff40b5040 msgr2=0x7fdff4152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff2ffd700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdff40b5040 0x7fdff4152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff2ffd700 1 -- 172.21.15.60:0/274007977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdff40b13c0 msgr2=0x7fdff4151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff2ffd700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdff40b13c0 0x7fdff4151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff2ffd700 1 -- 172.21.15.60:0/274007977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff40a01b0 con 0x7fdff4063140 2020-10-31T22:50:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff37fe700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdff40b5040 0x7fdff4152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:50:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff2ffd700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff4063140 0x7fdff40a1b40 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7fdff4152830 tx=0x7fdfe40079f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff0ff9700 1 -- 172.21.15.60:0/274007977 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfe40072e0 con 0x7fdff4063140 2020-10-31T22:50:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff0ff9700 1 -- 172.21.15.60:0/274007977 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4007440 con 0x7fdff4063140 2020-10-31T22:50:35.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff3fff700 1 -- 172.21.15.60:0/274007977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff40a2260 con 0x7fdff4063140 2020-10-31T22:50:35.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff0ff9700 1 -- 172.21.15.60:0/274007977 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfe40057d0 con 0x7fdff4063140 2020-10-31T22:50:35.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.045+0000 7fdff3fff700 1 -- 172.21.15.60:0/274007977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff4066a00 con 0x7fdff4063140 2020-10-31T22:50:35.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.049+0000 7fdff3fff700 1 -- 172.21.15.60:0/274007977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdff409ffc0 con 0x7fdff4063140 2020-10-31T22:50:35.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.049+0000 7fdff0ff9700 1 -- 172.21.15.60:0/274007977 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fdfe4010070 con 0x7fdff4063140 2020-10-31T22:50:35.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.049+0000 7fdff0ff9700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdfd8054f10 0x7fdfd80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.049+0000 7fdff0ff9700 1 -- 172.21.15.60:0/274007977 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fdfe406d120 con 0x7fdff4063140 2020-10-31T22:50:35.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.049+0000 7fdfea7fc700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdfd8054f10 0x7fdfd80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.049+0000 7fdfea7fc700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdfd8054f10 0x7fdfd80573d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fdfdc019000 tx=0x7fdfdc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:35.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.057+0000 7fdff0ff9700 1 -- 172.21.15.60:0/274007977 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fdfe4043640 con 0x7fdff4063140 2020-10-31T22:50:35.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.201+0000 7fdff3fff700 1 -- 172.21.15.60:0/274007977 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7fdff4057100 con 0x7fdff4063140 2020-10-31T22:50:35.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.209+0000 7fdff0ff9700 1 -- 172.21.15.60:0/274007977 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fdfe4018070 con 0x7fdff4063140 2020-10-31T22:50:35.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.213+0000 7fdff3fff700 1 -- 172.21.15.60:0/274007977 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdfd8054f10 msgr2=0x7fdfd80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.213+0000 7fdff3fff700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdfd8054f10 0x7fdfd80573d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7fdfdc019000 tx=0x7fdfdc015000).stop 2020-10-31T22:50:35.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.213+0000 7fdff3fff700 1 -- 172.21.15.60:0/274007977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff4063140 msgr2=0x7fdff40a1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.213+0000 7fdff3fff700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff4063140 0x7fdff40a1b40 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 rx=0x7fdff4152830 tx=0x7fdfe40079f0).stop 2020-10-31T22:50:35.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.213+0000 7fdff3fff700 1 -- 172.21.15.60:0/274007977 shutdown_connections 2020-10-31T22:50:35.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.213+0000 7fdff3fff700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdff40b5040 0x7fdff4152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.213+0000 7fdff3fff700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdff4063140 0x7fdff40a1b40 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.213+0000 7fdff3fff700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fdfd8054f10 0x7fdfd80573d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.213+0000 7fdff3fff700 1 --2- 172.21.15.60:0/274007977 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdff40b13c0 0x7fdff4151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.213+0000 7fdff3fff700 1 -- 172.21.15.60:0/274007977 >> 172.21.15.60:0/274007977 conn(0x7fdff406a600 msgr2=0x7fdff40a9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:35.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.213+0000 7fdff3fff700 1 -- 172.21.15.60:0/274007977 shutdown_connections 2020-10-31T22:50:35.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.213+0000 7fdff3fff700 1 -- 172.21.15.60:0/274007977 wait complete. 2020-10-31T22:50:35.232 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:50:35.233 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:35.248 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:35.266 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:35.284 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:35.302 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:50:35.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:35.303 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:35.303 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:35.349 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-10-31T22:50:35.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:50:35.350 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2020-10-31T22:50:35.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:35.351 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:35.352 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:35.359 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:50:35.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:50:35.361 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:50:35.362 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-10-31T22:50:35.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.477+0000 7f1fae11d700 1 Processor -- start 2020-10-31T22:50:35.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.477+0000 7f1fae11d700 1 -- start start 2020-10-31T22:50:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fae11d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fa80ac870 0x7f1fa80b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fae11d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1fa80b0e20 0x7f1fa80ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fae11d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa80acc50 con 0x7f1fa80ae690 2020-10-31T22:50:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fae11d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa80b14c0 con 0x7f1fa80b0e20 2020-10-31T22:50:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fae11d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80b5690 con 0x7f1fa80ac870 2020-10-31T22:50:35.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fad91c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1fa80ae690 0x7f1fa81412e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53364/0 (socket says 172.21.15.60:53364) 2020-10-31T22:50:35.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fad91c700 1 -- 172.21.15.60:0/3287717935 learned_addr learned my addr 172.21.15.60:0/3287717935 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:35.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fac91a700 1 --2- 172.21.15.60:0/3287717935 >> v2:172.21.15.66:3300/0 conn(0x7f1fa80b0e20 0x7f1fa80ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fad11b700 1 --2- 172.21.15.60:0/3287717935 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fa80ac870 0x7f1fa80b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1f9ffff700 1 -- 172.21.15.60:0/3287717935 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508678338 0 0) 0x7f1fa80acc50 con 0x7f1fa80ae690 2020-10-31T22:50:35.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1f9ffff700 1 -- 172.21.15.60:0/3287717935 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f8c003230 con 0x7f1fa80ae690 2020-10-31T22:50:35.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1f9ffff700 1 -- 172.21.15.60:0/3287717935 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3814193923 0 0) 0x7f1f8c003230 con 0x7f1fa80ae690 2020-10-31T22:50:35.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fac91a700 1 -- 172.21.15.60:0/3287717935 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fa80ac870 msgr2=0x7f1fa80b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:35.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fac91a700 1 --2- 172.21.15.60:0/3287717935 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fa80ac870 0x7f1fa80b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fac91a700 1 -- 172.21.15.60:0/3287717935 >> v1:172.21.15.60:6789/0 conn(0x7f1fa80ae690 legacy=0x7f1fa81412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fac91a700 1 -- 172.21.15.60:0/3287717935 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa80afc10 con 0x7f1fa80b0e20 2020-10-31T22:50:35.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fac91a700 1 --2- 172.21.15.60:0/3287717935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fa80b0e20 0x7f1fa80ae1a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f1fa0001870 tx=0x7f1f98006dc0).ready entity=mon.1 client_cookie=98e4aef937a832f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:35.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1f9ffff700 1 -- 172.21.15.60:0/3287717935 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa00016d0 con 0x7f1fa80b0e20 2020-10-31T22:50:35.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1f9ffff700 1 -- 172.21.15.60:0/3287717935 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f98009580 con 0x7f1fa80b0e20 2020-10-31T22:50:35.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1f9ffff700 1 -- 172.21.15.60:0/3287717935 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1f980096f0 con 0x7f1fa80b0e20 2020-10-31T22:50:35.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fae11d700 1 -- 172.21.15.60:0/3287717935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fa80b0e20 msgr2=0x7f1fa80ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fae11d700 1 --2- 172.21.15.60:0/3287717935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fa80b0e20 0x7f1fa80ae1a0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f1fa0001870 tx=0x7f1f98006dc0).stop 2020-10-31T22:50:35.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fae11d700 1 -- 172.21.15.60:0/3287717935 shutdown_connections 2020-10-31T22:50:35.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fae11d700 1 --2- 172.21.15.60:0/3287717935 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fa80ac870 0x7f1fa80b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fae11d700 1 --2- 172.21.15.60:0/3287717935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fa80b0e20 0x7f1fa80ae1a0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fae11d700 1 -- 172.21.15.60:0/3287717935 >> 172.21.15.60:0/3287717935 conn(0x7f1fa806a600 msgr2=0x7f1fa8060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:35.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fae11d700 1 -- 172.21.15.60:0/3287717935 shutdown_connections 2020-10-31T22:50:35.496 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.481+0000 7f1fae11d700 1 -- 172.21.15.60:0/3287717935 wait complete. 2020-10-31T22:50:35.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fae11d700 1 Processor -- start 2020-10-31T22:50:35.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fae11d700 1 -- start start 2020-10-31T22:50:35.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fae11d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fa80ac870 0x7f1fa80abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fae11d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fa80ae690 0x7f1fa80a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fae11d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fa80b0e20 0x7f1fa813c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fae11d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80aa370 con 0x7f1fa80ae690 2020-10-31T22:50:35.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fae11d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80aa840 con 0x7f1fa80ac870 2020-10-31T22:50:35.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fae11d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa80aa5a0 con 0x7f1fa80b0e20 2020-10-31T22:50:35.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fac91a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fa80ae690 0x7f1fa80a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fac91a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fa80ae690 0x7f1fa80a98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49232/0 (socket says 172.21.15.60:49232) 2020-10-31T22:50:35.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fac91a700 1 -- 172.21.15.60:0/537742291 learned_addr learned my addr 172.21.15.60:0/537742291 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:35.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fad11b700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fa80ac870 0x7f1fa80abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fad91c700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fa80b0e20 0x7f1fa813c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fad91c700 1 -- 172.21.15.60:0/537742291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fa80ac870 msgr2=0x7f1fa80abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fad91c700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fa80ac870 0x7f1fa80abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fad91c700 1 -- 172.21.15.60:0/537742291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fa80ae690 msgr2=0x7f1fa80a98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fad91c700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fa80ae690 0x7f1fa80a98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fad91c700 1 -- 172.21.15.60:0/537742291 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa80a9d90 con 0x7f1fa80b0e20 2020-10-31T22:50:35.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fac91a700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fa80ae690 0x7f1fa80a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:35.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fad91c700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fa80b0e20 0x7f1fa813c200 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f1fa80ab830 tx=0x7f1fa0001e10).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:35.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1f9e7fc700 1 -- 172.21.15.60:0/537742291 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa0007170 con 0x7f1fa80b0e20 2020-10-31T22:50:35.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fae11d700 1 -- 172.21.15.60:0/537742291 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa80ab040 con 0x7f1fa80b0e20 2020-10-31T22:50:35.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1f9e7fc700 1 -- 172.21.15.60:0/537742291 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa00072d0 con 0x7f1fa80b0e20 2020-10-31T22:50:35.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1f9e7fc700 1 -- 172.21.15.60:0/537742291 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fa00048f0 con 0x7f1fa80b0e20 2020-10-31T22:50:35.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.485+0000 7f1fae11d700 1 -- 172.21.15.60:0/537742291 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa80aacc0 con 0x7f1fa80b0e20 2020-10-31T22:50:35.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.489+0000 7f1fae11d700 1 -- 172.21.15.60:0/537742291 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa80ab610 con 0x7f1fa80b0e20 2020-10-31T22:50:35.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.489+0000 7f1f9e7fc700 1 -- 172.21.15.60:0/537742291 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1fa0004a50 con 0x7f1fa80b0e20 2020-10-31T22:50:35.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.489+0000 7f1f9e7fc700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1f90055020 0x7f1f900574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.489+0000 7f1f9e7fc700 1 -- 172.21.15.60:0/537742291 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1fa006d400 con 0x7f1fa80b0e20 2020-10-31T22:50:35.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.489+0000 7f1fad11b700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1f90055020 0x7f1f900574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.489+0000 7f1fad11b700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1f90055020 0x7f1f900574e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f1fa400b000 tx=0x7f1fa40091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:35.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.497+0000 7f1f9e7fc700 1 -- 172.21.15.60:0/537742291 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1fa80ab610 con 0x7f1fa80b0e20 2020-10-31T22:50:35.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.641+0000 7f1fae11d700 1 -- 172.21.15.60:0/537742291 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1fa80ab610 con 0x7f1fa80b0e20 2020-10-31T22:50:35.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.649+0000 7f1f9e7fc700 1 -- 172.21.15.60:0/537742291 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+33659 (secure 0 0 0) 0x7f1fa80ab610 con 0x7f1fa80b0e20 2020-10-31T22:50:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:35.651 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:50:35.651 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 139, 2020-10-31T22:50:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "226f905a-1517-4a8c-8009-08779515965c", 2020-10-31T22:50:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2020-10-31T22:40:51.928572+0000", 2020-10-31T22:50:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2020-10-31T22:50:15.235473+0000", 2020-10-31T22:50:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:50:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:50:35.652 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-10-31T22:50:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2020-10-31T22:50:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2020-10-31T22:50:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2020-10-31T22:50:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2020-10-31T22:50:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2020-10-31T22:50:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2020-10-31T22:50:35.653 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:50:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2020-10-31T22:50:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2020-10-31T22:50:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-10-31T22:50:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2020-10-31T22:50:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2020-10-31T22:50:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 26, 2020-10-31T22:50:35.654 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2020-10-31T22:50:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "jewel", 2020-10-31T22:50:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2020-10-31T22:50:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "octopus", 2020-10-31T22:50:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:50:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.655 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2020-10-31T22:50:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "device_health_metrics", 2020-10-31T22:50:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:40:55.846143+0000", 2020-10-31T22:50:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:50:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:50:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:50:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:50:35.656 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:50:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:50:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:50:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:50:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2020-10-31T22:50:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2020-10-31T22:50:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2020-10-31T22:50:35.657 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2020-10-31T22:50:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2020-10-31T22:50:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:50:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:50:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:50:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:50:35.658 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:50:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:50:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:50:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "15", 2020-10-31T22:50:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:50:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:50:35.659 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:50:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:50:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:50:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:50:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:50:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:50:35.660 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:50:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:50:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:50:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:50:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:50:35.661 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:50:35.662 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:50:35.662 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:50:35.662 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:50:35.662 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:50:35.662 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:50:35.662 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:50:35.663 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:50:35.663 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:50:35.663 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:50:35.663 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:50:35.663 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:50:35.663 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:50:35.663 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.664 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:50:35.664 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:50:35.664 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:50:35.664 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:50:35.664 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:50:35.664 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:50:35.665 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:50:35.665 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:50:35.665 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:50:35.665 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:50:35.665 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:50:35.665 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:50:35.666 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2020-10-31T22:50:35.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.666 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:50:35.667 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_devicehealth": {} 2020-10-31T22:50:35.667 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.669 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2020-10-31T22:50:35.670 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2020-10-31T22:50:35.670 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:05.358501+0000", 2020-10-31T22:50:35.671 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:50:35.671 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:50:35.672 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:50:35.672 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:50:35.672 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:50:35.673 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:50:35.673 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:50:35.673 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:50:35.674 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:50:35.674 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:50:35.674 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:50:35.675 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:50:35.675 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:50:35.675 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:50:35.676 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:50:35.676 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:50:35.676 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:50:35.676 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:50:35.676 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:50:35.677 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:50:35.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.677 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "18", 2020-10-31T22:50:35.677 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:50:35.677 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:50:35.678 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:50:35.678 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:50:35.678 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:50:35.678 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:50:35.679 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:50:35.679 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:50:35.679 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:50:35.679 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:50:35.679 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:50:35.679 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:50:35.680 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:50:35.680 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:50:35.680 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:50:35.680 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:50:35.680 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:50:35.680 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:50:35.681 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:50:35.681 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:50:35.681 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:50:35.681 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:50:35.682 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:50:35.682 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:50:35.682 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:50:35.682 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:50:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:50:35.684 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:50:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:50:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:50:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:50:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:50:35.685 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:50:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:50:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:50:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:50:35.686 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:50:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:50:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:50:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2020-10-31T22:50:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.687 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 25, 2020-10-31T22:50:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2020-10-31T22:50:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:50:11.956893+0000", 2020-10-31T22:50:35.688 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:50:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:50:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:50:35.689 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:50:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:50:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:50:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:50:35.690 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:50:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:50:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:50:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:50:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:50:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:50:35.691 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:50:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:50:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:50:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:50:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:50:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:50:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:50:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.692 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "138", 2020-10-31T22:50:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:50:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:50:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:50:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:50:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:50:35.693 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:50:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:50:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:50:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:50:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:50:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:50:35.694 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:50:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:50:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:50:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:50:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:50:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:50:35.695 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:50:35.696 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:50:35.696 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:50:35.696 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:50:35.696 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:50:35.696 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:50:35.696 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:50:35.697 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:50:35.697 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:50:35.697 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.697 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:50:35.697 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:50:35.697 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:50:35.697 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:50:35.698 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:50:35.698 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:50:35.698 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:50:35.698 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:50:35.698 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:50:35.698 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:50:35.699 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:50:35.699 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:50:35.699 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2020-10-31T22:50:35.699 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2020-10-31T22:50:35.699 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2020-10-31T22:50:35.699 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.700 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:50:35.700 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:50:35.700 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2020-10-31T22:50:35.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.700 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.700 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.700 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.701 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 26, 2020-10-31T22:50:35.701 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2020-10-31T22:50:35.701 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:50:13.235442+0000", 2020-10-31T22:50:35.701 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:50:35.701 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:50:35.701 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:50:35.701 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:50:35.702 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:50:35.702 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:50:35.702 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:50:35.702 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:50:35.702 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:50:35.702 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:50:35.702 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:50:35.703 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:50:35.703 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:50:35.703 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:50:35.703 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:50:35.703 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:50:35.703 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:50:35.704 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:50:35.704 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:50:35.704 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:50:35.704 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.704 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "139", 2020-10-31T22:50:35.704 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:50:35.705 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:50:35.705 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:50:35.705 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:50:35.705 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:50:35.705 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:50:35.705 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:50:35.705 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:50:35.706 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:50:35.706 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:50:35.706 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:50:35.706 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:50:35.706 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:50:35.706 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:50:35.706 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:50:35.707 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:50:35.707 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:50:35.707 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:50:35.707 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:50:35.707 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:50:35.707 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:50:35.708 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:50:35.708 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:50:35.708 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:50:35.708 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:50:35.708 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:50:35.708 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.708 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:50:35.709 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:50:35.709 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:50:35.709 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:50:35.709 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:50:35.709 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:50:35.709 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:50:35.709 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:50:35.710 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:50:35.710 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:50:35.710 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:50:35.710 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:50:35.710 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:50:35.710 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:50:35.710 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2020-10-31T22:50:35.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.711 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.711 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:50:35.711 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2020-10-31T22:50:35.711 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.712 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:50:35.712 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", 2020-10-31T22:50:35.712 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:35.712 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:35.712 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:35.712 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:35.712 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:35.713 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:35.713 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:35.713 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 136, 2020-10-31T22:50:35.713 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:35.713 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:35.713 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:35.713 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.714 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2020-10-31T22:50:35.714 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:35.714 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.714 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.714 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.715 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2020-10-31T22:50:35.715 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:35.715 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.715 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.715 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.715 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:35.716 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.716 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.716 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.716 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2020-10-31T22:50:35.717 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:35.717 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.717 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.717 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.717 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2020-10-31T22:50:35.717 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:35.717 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.718 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.718 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.718 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:35.718 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.718 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.718 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.718 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2020-10-31T22:50:35.719 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:35.719 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.719 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.719 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.719 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2020-10-31T22:50:35.719 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:35.719 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.719 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.720 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.720 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:35.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.720 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.720 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.720 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2020-10-31T22:50:35.721 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:35.721 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.721 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.721 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.721 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2020-10-31T22:50:35.721 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:35.721 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.721 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.722 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.722 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6803/14302", 2020-10-31T22:50:35.722 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6805/14302", 2020-10-31T22:50:35.722 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6809/14302", 2020-10-31T22:50:35.722 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6807/14302", 2020-10-31T22:50:35.722 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:35.722 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:35.723 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:35.723 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.723 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.723 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.723 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:50:35.723 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", 2020-10-31T22:50:35.723 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:35.724 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:35.724 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:35.724 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:35.724 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:35.724 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:35.724 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:35.725 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 137, 2020-10-31T22:50:35.725 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:35.725 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:35.725 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:35.725 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.725 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.725 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.725 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2020-10-31T22:50:35.726 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:35.726 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.726 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.726 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.726 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2020-10-31T22:50:35.726 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:35.727 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.727 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.727 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.727 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:35.727 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.727 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.727 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.728 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2020-10-31T22:50:35.728 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:35.728 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.728 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.728 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.728 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2020-10-31T22:50:35.728 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:35.729 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.729 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.729 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.729 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:35.729 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.729 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.729 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.729 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2020-10-31T22:50:35.730 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:35.730 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.730 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.730 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.731 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2020-10-31T22:50:35.731 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:35.731 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.731 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.731 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.731 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:35.731 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.731 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.732 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.732 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2020-10-31T22:50:35.732 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:35.732 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.732 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.732 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.733 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2020-10-31T22:50:35.733 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:35.733 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.733 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.733 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.733 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/14300", 2020-10-31T22:50:35.734 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6813/14300", 2020-10-31T22:50:35.734 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6817/14300", 2020-10-31T22:50:35.734 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6815/14300", 2020-10-31T22:50:35.734 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:35.734 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:35.735 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:35.735 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.735 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.735 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.735 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:50:35.735 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", 2020-10-31T22:50:35.735 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:35.736 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:35.736 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:35.736 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:35.736 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:35.736 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:35.736 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:35.737 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 137, 2020-10-31T22:50:35.737 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:35.737 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:35.737 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:35.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.737 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.737 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.737 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2020-10-31T22:50:35.738 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:35.738 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.738 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.738 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.738 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2020-10-31T22:50:35.738 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:35.739 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.739 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.739 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.739 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:35.739 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.739 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.739 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2020-10-31T22:50:35.740 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:35.740 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.740 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.740 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.740 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2020-10-31T22:50:35.740 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:35.741 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.741 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.741 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.741 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:35.741 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.741 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.741 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.742 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6832", 2020-10-31T22:50:35.742 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:35.742 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.742 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.742 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.742 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6833", 2020-10-31T22:50:35.742 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:35.743 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.743 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.743 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.743 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:35.743 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.743 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.743 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.744 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2020-10-31T22:50:35.744 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:35.744 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.744 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.744 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.744 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2020-10-31T22:50:35.744 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:35.745 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.745 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.745 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.745 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6827/14318", 2020-10-31T22:50:35.745 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6829/14318", 2020-10-31T22:50:35.745 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6833/14318", 2020-10-31T22:50:35.745 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6831/14318", 2020-10-31T22:50:35.746 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:35.746 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:35.746 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:35.746 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.746 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.746 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.747 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:50:35.747 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", 2020-10-31T22:50:35.747 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:35.747 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:35.747 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:35.748 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:35.748 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:35.748 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:35.748 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:35.748 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 136, 2020-10-31T22:50:35.748 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:35.749 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:35.749 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:35.749 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.749 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.749 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.749 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2020-10-31T22:50:35.749 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:35.750 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.750 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.750 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.750 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2020-10-31T22:50:35.750 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:35.750 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.750 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.751 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.751 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:35.751 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.751 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.751 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.751 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2020-10-31T22:50:35.751 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:35.752 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.752 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.752 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.752 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2020-10-31T22:50:35.752 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:35.752 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.752 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.753 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:35.753 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.753 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.753 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.753 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2020-10-31T22:50:35.753 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:35.753 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.754 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.754 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.754 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2020-10-31T22:50:35.754 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:35.754 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.754 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.755 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.755 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:35.755 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.755 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.755 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.755 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2020-10-31T22:50:35.755 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:35.756 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.756 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.756 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.756 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2020-10-31T22:50:35.756 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:35.756 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.756 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.757 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.757 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6819/14301", 2020-10-31T22:50:35.757 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6821/14301", 2020-10-31T22:50:35.757 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/14301", 2020-10-31T22:50:35.757 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6823/14301", 2020-10-31T22:50:35.757 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:35.758 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:35.758 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:35.758 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.758 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.758 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.758 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:50:35.758 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", 2020-10-31T22:50:35.758 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:35.759 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:35.759 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:35.759 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:35.759 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:35.759 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:35.759 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:35.759 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 137, 2020-10-31T22:50:35.760 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:35.760 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:35.760 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:35.760 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.760 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.760 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.760 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6816", 2020-10-31T22:50:35.761 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:35.761 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.761 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.761 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.761 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6817", 2020-10-31T22:50:35.761 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:35.761 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.762 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.762 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.762 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:35.762 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.762 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.762 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.762 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6818", 2020-10-31T22:50:35.763 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:35.763 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.763 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.763 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.763 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6819", 2020-10-31T22:50:35.763 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:35.763 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.764 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.764 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.764 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:35.764 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.764 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.764 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.765 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6822", 2020-10-31T22:50:35.765 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:35.765 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.765 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.765 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.766 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6823", 2020-10-31T22:50:35.766 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:35.766 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.766 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.766 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.766 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:35.766 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.767 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.767 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6820", 2020-10-31T22:50:35.767 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:35.767 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.767 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.767 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.768 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6821", 2020-10-31T22:50:35.768 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:35.768 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.768 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.768 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.768 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6817/14002", 2020-10-31T22:50:35.768 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6819/14002", 2020-10-31T22:50:35.769 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6823/14002", 2020-10-31T22:50:35.769 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6821/14002", 2020-10-31T22:50:35.769 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:35.769 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:35.769 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:35.769 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.769 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.770 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.770 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:50:35.770 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", 2020-10-31T22:50:35.770 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:35.770 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:35.770 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:35.770 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:35.771 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:35.771 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:35.771 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:35.771 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 130, 2020-10-31T22:50:35.771 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:35.771 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:35.771 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:35.771 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.772 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6800", 2020-10-31T22:50:35.772 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:35.772 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.772 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.772 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.773 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6801", 2020-10-31T22:50:35.773 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:35.773 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.773 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.773 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.773 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:35.773 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.774 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.774 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6802", 2020-10-31T22:50:35.774 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:35.774 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.774 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.774 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6803", 2020-10-31T22:50:35.775 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:35.775 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.775 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.775 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.775 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:35.775 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.775 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.776 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.776 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6806", 2020-10-31T22:50:35.776 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:35.776 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.776 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.776 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.777 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6807", 2020-10-31T22:50:35.777 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:35.777 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.777 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.777 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.777 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:35.777 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.778 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6804", 2020-10-31T22:50:35.778 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:35.778 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.778 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.778 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.779 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6805", 2020-10-31T22:50:35.779 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:35.779 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.779 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.779 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.779 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6801/14001", 2020-10-31T22:50:35.779 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6803/14001", 2020-10-31T22:50:35.780 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6807/14001", 2020-10-31T22:50:35.780 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6805/14001", 2020-10-31T22:50:35.780 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:35.780 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:35.780 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:35.780 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.780 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.781 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.781 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:50:35.781 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", 2020-10-31T22:50:35.781 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:35.781 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:35.781 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:35.781 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:35.782 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:35.782 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:35.782 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:35.782 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 137, 2020-10-31T22:50:35.782 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:35.782 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:35.782 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:35.783 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.783 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.783 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6808", 2020-10-31T22:50:35.783 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:35.783 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.783 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.784 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.784 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6809", 2020-10-31T22:50:35.784 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:35.784 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.784 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.784 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.784 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:35.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.785 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.785 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6810", 2020-10-31T22:50:35.785 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:35.785 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.785 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.786 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.786 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6811", 2020-10-31T22:50:35.786 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:35.786 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.786 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.786 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.786 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:35.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.787 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.787 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.787 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6814", 2020-10-31T22:50:35.787 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:35.787 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.788 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.788 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.788 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6815", 2020-10-31T22:50:35.788 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:35.788 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.788 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.789 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:35.789 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.789 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.789 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.789 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6812", 2020-10-31T22:50:35.789 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:35.789 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.790 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.790 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.790 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6813", 2020-10-31T22:50:35.790 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:35.790 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.790 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.790 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.791 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6809/14003", 2020-10-31T22:50:35.791 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6811/14003", 2020-10-31T22:50:35.791 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6815/14003", 2020-10-31T22:50:35.791 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6813/14003", 2020-10-31T22:50:35.791 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:35.791 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:35.791 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:35.792 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.792 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.792 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.792 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:50:35.792 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", 2020-10-31T22:50:35.792 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:35.793 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:35.793 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:35.793 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:35.793 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:35.793 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:35.793 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:35.793 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 137, 2020-10-31T22:50:35.793 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:35.794 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:35.794 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:35.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.794 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.794 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.794 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6824", 2020-10-31T22:50:35.794 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:35.795 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.795 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.795 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.795 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6825", 2020-10-31T22:50:35.795 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:35.795 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.795 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:35.796 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.797 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6826", 2020-10-31T22:50:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6827", 2020-10-31T22:50:35.798 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.799 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6830", 2020-10-31T22:50:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6831", 2020-10-31T22:50:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:35.800 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:35.801 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6828", 2020-10-31T22:50:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6829", 2020-10-31T22:50:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:35.802 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6825/14046", 2020-10-31T22:50:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6827/14046", 2020-10-31T22:50:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6831/14046", 2020-10-31T22:50:35.803 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6829/14046", 2020-10-31T22:50:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:50:35.804 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2020-10-31T22:50:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:50:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:35.805 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.314917+0000", 2020-10-31T22:50:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:50:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:35.806 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.643069+0000", 2020-10-31T22:50:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:35.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:50:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:35.808 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.662572+0000", 2020-10-31T22:50:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:50:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:35.809 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.664868+0000", 2020-10-31T22:50:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.810 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:50:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551107+0000", 2020-10-31T22:50:35.811 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:50:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:35.812 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:35.813 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.400568+0000", 2020-10-31T22:50:35.813 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:35.813 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.813 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.813 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:50:35.813 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551173+0000", 2020-10-31T22:50:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:35.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:50:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:35.815 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.604302+0000", 2020-10-31T22:50:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:50:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2020-10-31T22:50:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2020-10-31T22:50:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2020-10-31T22:50:35.816 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2020-10-31T22:50:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "blacklist": {}, 2020-10-31T22:50:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2020-10-31T22:50:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2020-10-31T22:50:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2020-10-31T22:50:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2020-10-31T22:50:35.817 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2020-10-31T22:50:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2020-10-31T22:50:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: "ruleset-failure-domain": "osd", 2020-10-31T22:50:35.818 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2020-10-31T22:50:35.819 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:35.819 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:35.819 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2020-10-31T22:50:35.819 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2020-10-31T22:50:35.819 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2020-10-31T22:50:35.819 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2020-10-31T22:50:35.820 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {} 2020-10-31T22:50:35.820 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:50:35.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.649+0000 7f1fae11d700 1 -- 172.21.15.60:0/537742291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1f90055020 msgr2=0x7f1f900574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.649+0000 7f1fae11d700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1f90055020 0x7f1f900574e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7f1fa400b000 tx=0x7f1fa40091a0).stop 2020-10-31T22:50:35.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.649+0000 7f1fae11d700 1 -- 172.21.15.60:0/537742291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fa80b0e20 msgr2=0x7f1fa813c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.649+0000 7f1fae11d700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fa80b0e20 0x7f1fa813c200 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f1fa80ab830 tx=0x7f1fa0001e10).stop 2020-10-31T22:50:35.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.649+0000 7f1fae11d700 1 -- 172.21.15.60:0/537742291 shutdown_connections 2020-10-31T22:50:35.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.649+0000 7f1fae11d700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fa80b0e20 0x7f1fa813c200 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.649+0000 7f1fae11d700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1f90055020 0x7f1f900574e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.649+0000 7f1fae11d700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fa80ac870 0x7f1fa80abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.649+0000 7f1fae11d700 1 --2- 172.21.15.60:0/537742291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fa80ae690 0x7f1fa80a98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.649+0000 7f1fae11d700 1 -- 172.21.15.60:0/537742291 >> 172.21.15.60:0/537742291 conn(0x7f1fa806a600 msgr2=0x7f1fa805bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:35.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.649+0000 7f1fae11d700 1 -- 172.21.15.60:0/537742291 shutdown_connections 2020-10-31T22:50:35.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.649+0000 7f1fae11d700 1 -- 172.21.15.60:0/537742291 wait complete. 2020-10-31T22:50:35.824 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:50:35.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.941+0000 7eff04ced700 1 Processor -- start 2020-10-31T22:50:35.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.941+0000 7eff04ced700 1 -- start start 2020-10-31T22:50:35.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff000b1bb0 0x7eff0005c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7eff000ae630 0x7eff0013ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7eff0013f1b0 0x7eff000b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0005c5e0 con 0x7eff0013f1b0 2020-10-31T22:50:35.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0013f630 con 0x7eff000ae630 2020-10-31T22:50:35.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0005c800 con 0x7eff000b1bb0 2020-10-31T22:50:35.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7efefffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7eff0013f1b0 0x7eff000b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7efef7fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7eff000ae630 0x7eff0013ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7efefffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7eff0013f1b0 0x7eff000b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49242/0 (socket says 172.21.15.60:49242) 2020-10-31T22:50:35.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7efeff7fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff000b1bb0 0x7eff0005c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7efefffff700 1 -- 172.21.15.60:0/1758164178 learned_addr learned my addr 172.21.15.60:0/1758164178 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:35.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7efefffff700 1 -- 172.21.15.60:0/1758164178 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff000b1bb0 msgr2=0x7eff0005c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:35.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7efefffff700 1 --2- 172.21.15.60:0/1758164178 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff000b1bb0 0x7eff0005c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7efefffff700 1 -- 172.21.15.60:0/1758164178 >> v2:172.21.15.66:3300/0 conn(0x7eff000ae630 msgr2=0x7eff0013ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:35.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7efefffff700 1 --2- 172.21.15.60:0/1758164178 >> v2:172.21.15.66:3300/0 conn(0x7eff000ae630 0x7eff0013ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7efefffff700 1 -- 172.21.15.60:0/1758164178 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff000adc50 con 0x7eff0013f1b0 2020-10-31T22:50:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7efefffff700 1 --2- 172.21.15.60:0/1758164178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff0013f1b0 0x7eff000b0210 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7eff0005c720 tx=0x7efef8009270).ready entity=mon.0 client_cookie=aed88a6b596fc61d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7efefeffd700 1 -- 172.21.15.60:0/1758164178 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efef8009e90 con 0x7eff0013f1b0 2020-10-31T22:50:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7efefeffd700 1 -- 172.21.15.60:0/1758164178 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef800bb10 con 0x7eff0013f1b0 2020-10-31T22:50:35.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7efefeffd700 1 -- 172.21.15.60:0/1758164178 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efef800bc80 con 0x7eff0013f1b0 2020-10-31T22:50:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 -- 172.21.15.60:0/1758164178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff0013f1b0 msgr2=0x7eff000b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 --2- 172.21.15.60:0/1758164178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff0013f1b0 0x7eff000b0210 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 rx=0x7eff0005c720 tx=0x7efef8009270).stop 2020-10-31T22:50:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 -- 172.21.15.60:0/1758164178 shutdown_connections 2020-10-31T22:50:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 --2- 172.21.15.60:0/1758164178 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff0013f1b0 0x7eff000b0210 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 --2- 172.21.15.60:0/1758164178 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff000b1bb0 0x7eff0005c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 --2- 172.21.15.60:0/1758164178 >> v2:172.21.15.66:3300/0 conn(0x7eff000ae630 0x7eff0013ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 -- 172.21.15.60:0/1758164178 >> 172.21.15.60:0/1758164178 conn(0x7eff000b5300 msgr2=0x7eff000b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:35.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 -- 172.21.15.60:0/1758164178 shutdown_connections 2020-10-31T22:50:35.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.945+0000 7eff04ced700 1 -- 172.21.15.60:0/1758164178 wait complete. 2020-10-31T22:50:35.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.949+0000 7eff04ced700 1 Processor -- start 2020-10-31T22:50:35.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.949+0000 7eff04ced700 1 -- start start 2020-10-31T22:50:35.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7eff04ced700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff000b1bb0 0x7eff00140410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7eff04ced700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff0013f1b0 0x7eff0013e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7eff04ced700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff00140f30 0x7eff00141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7eff04ced700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff00139b80 con 0x7eff000b1bb0 2020-10-31T22:50:35.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7eff04ced700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0013daf0 con 0x7eff00140f30 2020-10-31T22:50:35.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7eff04ced700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff000a9e60 con 0x7eff0013f1b0 2020-10-31T22:50:35.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efeff7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff000b1bb0 0x7eff00140410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efeff7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff000b1bb0 0x7eff00140410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49244/0 (socket says 172.21.15.60:49244) 2020-10-31T22:50:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efeff7fe700 1 -- 172.21.15.60:0/3555854583 learned_addr learned my addr 172.21.15.60:0/3555854583 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efef7fff700 1 --2- 172.21.15.60:0/3555854583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff0013f1b0 0x7eff0013e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efefffff700 1 --2- 172.21.15.60:0/3555854583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff00140f30 0x7eff00141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efeff7fe700 1 -- 172.21.15.60:0/3555854583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff0013f1b0 msgr2=0x7eff0013e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efeff7fe700 1 --2- 172.21.15.60:0/3555854583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff0013f1b0 0x7eff0013e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efeff7fe700 1 -- 172.21.15.60:0/3555854583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff00140f30 msgr2=0x7eff00141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:35.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efeff7fe700 1 --2- 172.21.15.60:0/3555854583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff00140f30 0x7eff00141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:35.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efeff7fe700 1 -- 172.21.15.60:0/3555854583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff00140a00 con 0x7eff000b1bb0 2020-10-31T22:50:35.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efeff7fe700 1 --2- 172.21.15.60:0/3555854583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff000b1bb0 0x7eff00140410 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7efef000c000 tx=0x7efef0006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:35.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efefd7fa700 1 -- 172.21.15.60:0/3555854583 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efef000ca10 con 0x7eff000b1bb0 2020-10-31T22:50:35.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efefd7fa700 1 -- 172.21.15.60:0/3555854583 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef000cb70 con 0x7eff000b1bb0 2020-10-31T22:50:35.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efefd7fa700 1 -- 172.21.15.60:0/3555854583 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efef00123f0 con 0x7eff000b1bb0 2020-10-31T22:50:35.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7eff04ced700 1 -- 172.21.15.60:0/3555854583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0013dd20 con 0x7eff000b1bb0 2020-10-31T22:50:35.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7eff04ced700 1 -- 172.21.15.60:0/3555854583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0013e950 con 0x7eff000b1bb0 2020-10-31T22:50:35.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7eff04ced700 1 -- 172.21.15.60:0/3555854583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff00057100 con 0x7eff000b1bb0 2020-10-31T22:50:35.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.953+0000 7efefd7fa700 1 -- 172.21.15.60:0/3555854583 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7efef0012550 con 0x7eff000b1bb0 2020-10-31T22:50:35.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.957+0000 7efefd7fa700 1 --2- 172.21.15.60:0/3555854583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efee4054f10 0x7efee40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:35.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.957+0000 7efefd7fa700 1 -- 172.21.15.60:0/3555854583 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efef006dea0 con 0x7eff000b1bb0 2020-10-31T22:50:35.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.957+0000 7efef7fff700 1 --2- 172.21.15.60:0/3555854583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efee4054f10 0x7efee40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:35.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.957+0000 7efef7fff700 1 --2- 172.21.15.60:0/3555854583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efee4054f10 0x7efee40573d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7efee800a000 tx=0x7efee8006e50).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:35.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:35.961+0000 7efefd7fa700 1 -- 172.21.15.60:0/3555854583 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7efef0044360 con 0x7eff000b1bb0 2020-10-31T22:50:36.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.153+0000 7eff04ced700 1 -- 172.21.15.60:0/3555854583 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff000b10e0 con 0x7eff000b1bb0 2020-10-31T22:50:36.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.153+0000 7efefd7fa700 1 -- 172.21.15.60:0/3555854583 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+2492 (secure 0 0 0) 0x7efef0047980 con 0x7eff000b1bb0 2020-10-31T22:50:36.159 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:36.159 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":70,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1094853447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1094853447},{"type":"v1","addr":"172.21.15.66:6833","nonce":1094853447}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68},{"gid":7875,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3767660505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3767660505},{"type":"v1","addr":"172.21.15.60:6835","nonce":3767660505}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:14.231864+0000","modified":"2020-10-31T22:50:15.234744+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7884":{"gid":7884,"name":"a","rank":0,"incarnation":69,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/936802064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":936802064},{"type":"v1","addr":"172.21.15.60:6837","nonce":936802064}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-10-31T22:50:36.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.157+0000 7eff04ced700 1 -- 172.21.15.60:0/3555854583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efee4054f10 msgr2=0x7efee40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:36.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.157+0000 7eff04ced700 1 --2- 172.21.15.60:0/3555854583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efee4054f10 0x7efee40573d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7efee800a000 tx=0x7efee8006e50).stop 2020-10-31T22:50:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.157+0000 7eff04ced700 1 -- 172.21.15.60:0/3555854583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff000b1bb0 msgr2=0x7eff00140410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:36.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.157+0000 7eff04ced700 1 --2- 172.21.15.60:0/3555854583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff000b1bb0 0x7eff00140410 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 rx=0x7efef000c000 tx=0x7efef0006dc0).stop 2020-10-31T22:50:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.157+0000 7eff04ced700 1 -- 172.21.15.60:0/3555854583 shutdown_connections 2020-10-31T22:50:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.157+0000 7eff04ced700 1 --2- 172.21.15.60:0/3555854583 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efee4054f10 0x7efee40573d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.157+0000 7eff04ced700 1 --2- 172.21.15.60:0/3555854583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff00140f30 0x7eff00141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.157+0000 7eff04ced700 1 --2- 172.21.15.60:0/3555854583 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7eff000b1bb0 0x7eff00140410 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:36.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.157+0000 7eff04ced700 1 --2- 172.21.15.60:0/3555854583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff0013f1b0 0x7eff0013e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:36.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.157+0000 7eff04ced700 1 -- 172.21.15.60:0/3555854583 >> 172.21.15.60:0/3555854583 conn(0x7eff000b5300 msgr2=0x7eff0013f770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:36.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.157+0000 7eff04ced700 1 -- 172.21.15.60:0/3555854583 shutdown_connections 2020-10-31T22:50:36.163 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.157+0000 7eff04ced700 1 -- 172.21.15.60:0/3555854583 wait complete. 2020-10-31T22:50:36.163 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 70 2020-10-31T22:50:36.173 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-10-31T22:50:36.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.281+0000 7f1f0759e700 1 Processor -- start 2020-10-31T22:50:36.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.281+0000 7f1f0759e700 1 -- start start 2020-10-31T22:50:36.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.281+0000 7f1f0759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1f080b1bb0 0x7f1f0805c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:36.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.281+0000 7f1f0759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1f0813f3d0 0x7f1f080b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:36.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.281+0000 7f1f0759e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f0805c800 con 0x7f1f080ae630 2020-10-31T22:50:36.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.281+0000 7f1f0759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f080adc50 con 0x7f1f080b1bb0 2020-10-31T22:50:36.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.281+0000 7f1f0759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f080adef0 con 0x7f1f0813f3d0 2020-10-31T22:50:36.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0659c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1f080b1bb0 0x7f1f0805c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:36.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f05d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1f080ae630 0x7f1f0813ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53390/0 (socket says 172.21.15.60:53390) 2020-10-31T22:50:36.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f05d9b700 1 -- 172.21.15.60:0/4273220860 learned_addr learned my addr 172.21.15.60:0/4273220860 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:36.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f06d9d700 1 --2- 172.21.15.60:0/4273220860 >> v2:172.21.15.66:3300/0 conn(0x7f1f0813f3d0 0x7f1f080b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:36.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0559a700 1 -- 172.21.15.60:0/4273220860 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4008078472 0 0) 0x7f1f0805c800 con 0x7f1f080ae630 2020-10-31T22:50:36.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0559a700 1 -- 172.21.15.60:0/4273220860 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ef0003230 con 0x7f1f080ae630 2020-10-31T22:50:36.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0659c700 1 -- 172.21.15.60:0/4273220860 >> v2:172.21.15.66:3300/0 conn(0x7f1f0813f3d0 msgr2=0x7f1f080b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:36.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0659c700 1 --2- 172.21.15.60:0/4273220860 >> v2:172.21.15.66:3300/0 conn(0x7f1f0813f3d0 0x7f1f080b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:36.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0659c700 1 -- 172.21.15.60:0/4273220860 >> v1:172.21.15.60:6789/0 conn(0x7f1f080ae630 legacy=0x7f1f0813ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:36.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0659c700 1 -- 172.21.15.60:0/4273220860 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080ae190 con 0x7f1f080b1bb0 2020-10-31T22:50:36.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f06d9d700 1 --2- 172.21.15.60:0/4273220860 >> v2:172.21.15.66:3300/0 conn(0x7f1f0813f3d0 0x7f1f080b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:36.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0659c700 1 --2- 172.21.15.60:0/4273220860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f080b1bb0 0x7f1f0805c0f0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f1ef8002f30 tx=0x7f1ef8006dc0).ready entity=mon.0 client_cookie=a4f26827b961084d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:36.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0559a700 1 -- 172.21.15.60:0/4273220860 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ef800fa10 con 0x7f1f080b1bb0 2020-10-31T22:50:36.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0559a700 1 -- 172.21.15.60:0/4273220860 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef800fb70 con 0x7f1f080b1bb0 2020-10-31T22:50:36.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0559a700 1 -- 172.21.15.60:0/4273220860 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ef8010470 con 0x7f1f080b1bb0 2020-10-31T22:50:36.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0759e700 1 -- 172.21.15.60:0/4273220860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f080b1bb0 msgr2=0x7f1f0805c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:36.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0759e700 1 --2- 172.21.15.60:0/4273220860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f080b1bb0 0x7f1f0805c0f0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 rx=0x7f1ef8002f30 tx=0x7f1ef8006dc0).stop 2020-10-31T22:50:36.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0759e700 1 -- 172.21.15.60:0/4273220860 shutdown_connections 2020-10-31T22:50:36.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0759e700 1 --2- 172.21.15.60:0/4273220860 >> v2:172.21.15.66:3300/0 conn(0x7f1f0813f3d0 0x7f1f080b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:36.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0759e700 1 --2- 172.21.15.60:0/4273220860 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f080b1bb0 0x7f1f0805c0f0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:36.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0759e700 1 -- 172.21.15.60:0/4273220860 >> 172.21.15.60:0/4273220860 conn(0x7f1f080b5300 msgr2=0x7f1f080b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:36.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0759e700 1 -- 172.21.15.60:0/4273220860 shutdown_connections 2020-10-31T22:50:36.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.285+0000 7f1f0759e700 1 -- 172.21.15.60:0/4273220860 wait complete. 2020-10-31T22:50:36.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f0759e700 1 Processor -- start 2020-10-31T22:50:36.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f0759e700 1 -- start start 2020-10-31T22:50:36.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f0759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f080b1bb0 0x7f1f080654f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f0759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f0813f3d0 0x7f1f080659e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f0759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f080aa8f0 0x7f1f0813b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f0759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f08065ed0 con 0x7f1f0813f3d0 2020-10-31T22:50:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f0759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0814d1f0 con 0x7f1f080b1bb0 2020-10-31T22:50:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f0759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f080ab030 con 0x7f1f080aa8f0 2020-10-31T22:50:36.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f05d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f0813f3d0 0x7f1f080659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f05d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f0813f3d0 0x7f1f080659e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49260/0 (socket says 172.21.15.60:49260) 2020-10-31T22:50:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f05d9b700 1 -- 172.21.15.60:0/948328191 learned_addr learned my addr 172.21.15.60:0/948328191 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f06d9d700 1 --2- 172.21.15.60:0/948328191 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f080aa8f0 0x7f1f0813b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f0659c700 1 --2- 172.21.15.60:0/948328191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f080b1bb0 0x7f1f080654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f05d9b700 1 -- 172.21.15.60:0/948328191 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f080aa8f0 msgr2=0x7f1f0813b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f05d9b700 1 --2- 172.21.15.60:0/948328191 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f080aa8f0 0x7f1f0813b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:36.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f05d9b700 1 -- 172.21.15.60:0/948328191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f080b1bb0 msgr2=0x7f1f080654f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f05d9b700 1 --2- 172.21.15.60:0/948328191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f080b1bb0 0x7f1f080654f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f05d9b700 1 -- 172.21.15.60:0/948328191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f080ab2d0 con 0x7f1f0813f3d0 2020-10-31T22:50:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f05d9b700 1 --2- 172.21.15.60:0/948328191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f0813f3d0 0x7f1f080659e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f1ef40010d0 tx=0x7f1ef4007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1eff7fe700 1 -- 172.21.15.60:0/948328191 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ef40072e0 con 0x7f1f0813f3d0 2020-10-31T22:50:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1eff7fe700 1 -- 172.21.15.60:0/948328191 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef4007440 con 0x7f1f0813f3d0 2020-10-31T22:50:36.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f0759e700 1 -- 172.21.15.60:0/948328191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f0814d470 con 0x7f1f0813f3d0 2020-10-31T22:50:36.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1eff7fe700 1 -- 172.21.15.60:0/948328191 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ef40057d0 con 0x7f1f0813f3d0 2020-10-31T22:50:36.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.289+0000 7f1f0759e700 1 -- 172.21.15.60:0/948328191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0813bdc0 con 0x7f1f0813f3d0 2020-10-31T22:50:36.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.293+0000 7f1f0759e700 1 -- 172.21.15.60:0/948328191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f08057100 con 0x7f1f0813f3d0 2020-10-31T22:50:36.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.293+0000 7f1eff7fe700 1 -- 172.21.15.60:0/948328191 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1ef4010070 con 0x7f1f0813f3d0 2020-10-31T22:50:36.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.293+0000 7f1eff7fe700 1 --2- 172.21.15.60:0/948328191 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ee4054f10 0x7f1ee40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:36.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.293+0000 7f1eff7fe700 1 -- 172.21.15.60:0/948328191 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1ef406d010 con 0x7f1f0813f3d0 2020-10-31T22:50:36.302 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.293+0000 7f1f0659c700 1 --2- 172.21.15.60:0/948328191 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ee4054f10 0x7f1ee40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:36.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.293+0000 7f1f0659c700 1 --2- 172.21.15.60:0/948328191 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ee4054f10 0x7f1ee40573d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f1ef801d000 tx=0x7f1ef8017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:36.305 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.301+0000 7f1eff7fe700 1 -- 172.21.15.60:0/948328191 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1ef4043530 con 0x7f1f0813f3d0 2020-10-31T22:50:36.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.481+0000 7f1f0759e700 1 -- 172.21.15.60:0/948328191 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1f080b10c0 con 0x7f1f0813f3d0 2020-10-31T22:50:36.890 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:50:36.889+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:50:36.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.897+0000 7f1eff7fe700 1 -- 172.21.15.60:0/948328191 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1ef4046b50 con 0x7f1f0813f3d0 2020-10-31T22:50:36.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.901+0000 7f1f0759e700 1 -- 172.21.15.60:0/948328191 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ee4054f10 msgr2=0x7f1ee40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.901+0000 7f1f0759e700 1 --2- 172.21.15.60:0/948328191 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ee4054f10 0x7f1ee40573d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f1ef801d000 tx=0x7f1ef8017000).stop 2020-10-31T22:50:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.901+0000 7f1f0759e700 1 -- 172.21.15.60:0/948328191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f0813f3d0 msgr2=0x7f1f080659e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.901+0000 7f1f0759e700 1 --2- 172.21.15.60:0/948328191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f0813f3d0 0x7f1f080659e0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 rx=0x7f1ef40010d0 tx=0x7f1ef4007a70).stop 2020-10-31T22:50:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.901+0000 7f1f0759e700 1 -- 172.21.15.60:0/948328191 shutdown_connections 2020-10-31T22:50:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.901+0000 7f1f0759e700 1 --2- 172.21.15.60:0/948328191 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1f080aa8f0 0x7f1f0813b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:36.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.901+0000 7f1f0759e700 1 --2- 172.21.15.60:0/948328191 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ee4054f10 0x7f1ee40573d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:36.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.901+0000 7f1f0759e700 1 --2- 172.21.15.60:0/948328191 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1f080b1bb0 0x7f1f080654f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:36.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.901+0000 7f1f0759e700 1 --2- 172.21.15.60:0/948328191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1f0813f3d0 0x7f1f080659e0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:36.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.901+0000 7f1f0759e700 1 -- 172.21.15.60:0/948328191 >> 172.21.15.60:0/948328191 conn(0x7f1f080b5300 msgr2=0x7f1f080b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:36.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.901+0000 7f1f0759e700 1 -- 172.21.15.60:0/948328191 shutdown_connections 2020-10-31T22:50:36.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:36.901+0000 7f1f0759e700 1 -- 172.21.15.60:0/948328191 wait complete. 2020-10-31T22:50:36.911 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-10-31T22:50:36.923 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:50:36.939 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:50:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.029+0000 7f85aed4d700 1 Processor -- start 2020-10-31T22:50:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.029+0000 7f85aed4d700 1 -- start start 2020-10-31T22:50:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85aed4d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f85a8140420 0x7f85a80ad7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85aed4d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a805b700 con 0x7f85a805b320 2020-10-31T22:50:37.037 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85aed4d700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a81408a0 con 0x7f85a80b2560 2020-10-31T22:50:37.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85aed4d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80b0220 con 0x7f85a8140420 2020-10-31T22:50:37.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85ad54a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f85a8140420 0x7f85a80ad7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:37.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85ad54a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f85a8140420 0x7f85a80ad7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49280/0 (socket says 172.21.15.60:49280) 2020-10-31T22:50:37.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85ad54a700 1 -- 172.21.15.60:0/4272957428 learned_addr learned my addr 172.21.15.60:0/4272957428 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:37.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85ad54a700 1 -- 172.21.15.60:0/4272957428 >> v1:172.21.15.66:6789/0 conn(0x7f85a80b2560 legacy=0x7f85a80adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:37.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85ad54a700 1 -- 172.21.15.60:0/4272957428 >> v1:172.21.15.60:6789/0 conn(0x7f85a805b320 legacy=0x7f85a80b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:37.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85ad54a700 1 -- 172.21.15.60:0/4272957428 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a80b04c0 con 0x7f85a8140420 2020-10-31T22:50:37.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85ad54a700 1 --2- 172.21.15.60:0/4272957428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a8140420 0x7f85a80ad7a0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f8598002f30 tx=0x7f8598006e80).ready entity=mon.0 client_cookie=a1b57ec49e57e55d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:37.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85acd49700 1 -- 172.21.15.60:0/4272957428 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85980097f0 con 0x7f85a8140420 2020-10-31T22:50:37.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85acd49700 1 -- 172.21.15.60:0/4272957428 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8598009950 con 0x7f85a8140420 2020-10-31T22:50:37.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85acd49700 1 -- 172.21.15.60:0/4272957428 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8598009cb0 con 0x7f85a8140420 2020-10-31T22:50:37.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85aed4d700 1 -- 172.21.15.60:0/4272957428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a8140420 msgr2=0x7f85a80ad7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:37.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85aed4d700 1 --2- 172.21.15.60:0/4272957428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a8140420 0x7f85a80ad7a0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 rx=0x7f8598002f30 tx=0x7f8598006e80).stop 2020-10-31T22:50:37.041 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85aed4d700 1 -- 172.21.15.60:0/4272957428 shutdown_connections 2020-10-31T22:50:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85aed4d700 1 --2- 172.21.15.60:0/4272957428 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a8140420 0x7f85a80ad7a0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85aed4d700 1 -- 172.21.15.60:0/4272957428 >> 172.21.15.60:0/4272957428 conn(0x7f85a80b61d0 msgr2=0x7f85a80b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85aed4d700 1 -- 172.21.15.60:0/4272957428 shutdown_connections 2020-10-31T22:50:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85aed4d700 1 -- 172.21.15.60:0/4272957428 wait complete. 2020-10-31T22:50:37.042 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85aed4d700 1 Processor -- start 2020-10-31T22:50:37.043 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.033+0000 7f85aed4d700 1 -- start start 2020-10-31T22:50:37.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85aed4d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85a805b320 0x7f85a80ab220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:37.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85aed4d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a80b2560 0x7f85a80b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:37.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85aed4d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a8140420 0x7f85a80b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85aed4d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80b56f0 con 0x7f85a80b2560 2020-10-31T22:50:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85aed4d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a8146c40 con 0x7f85a805b320 2020-10-31T22:50:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85aed4d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a8146ee0 con 0x7f85a8140420 2020-10-31T22:50:37.048 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85ad54a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a80b2560 0x7f85a80b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85ad54a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a80b2560 0x7f85a80b3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49286/0 (socket says 172.21.15.60:49286) 2020-10-31T22:50:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85ad54a700 1 -- 172.21.15.60:0/90917214 learned_addr learned my addr 172.21.15.60:0/90917214 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85add4b700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85a805b320 0x7f85a80ab220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85ae54c700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a8140420 0x7f85a80b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:37.049 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85ad54a700 1 -- 172.21.15.60:0/90917214 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a8140420 msgr2=0x7f85a80b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85ad54a700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a8140420 0x7f85a80b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85ad54a700 1 -- 172.21.15.60:0/90917214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85a805b320 msgr2=0x7f85a80ab220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:37.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85ad54a700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85a805b320 0x7f85a80ab220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85ad54a700 1 -- 172.21.15.60:0/90917214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8154d20 con 0x7f85a80b2560 2020-10-31T22:50:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85ae54c700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a8140420 0x7f85a80b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:37.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85ad54a700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a80b2560 0x7f85a80b3dd0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f8598002f30 tx=0x7f8598015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f859effd700 1 -- 172.21.15.60:0/90917214 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f859801e460 con 0x7f85a80b2560 2020-10-31T22:50:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85aed4d700 1 -- 172.21.15.60:0/90917214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a80abd90 con 0x7f85a80b2560 2020-10-31T22:50:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f859effd700 1 -- 172.21.15.60:0/90917214 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859801e5c0 con 0x7f85a80b2560 2020-10-31T22:50:37.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f859effd700 1 -- 172.21.15.60:0/90917214 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f859801e920 con 0x7f85a80b2560 2020-10-31T22:50:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.037+0000 7f85aed4d700 1 -- 172.21.15.60:0/90917214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a80b5de0 con 0x7f85a80b2560 2020-10-31T22:50:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.041+0000 7f85aed4d700 1 -- 172.21.15.60:0/90917214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a80b5510 con 0x7f85a80b2560 2020-10-31T22:50:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.041+0000 7f859effd700 1 -- 172.21.15.60:0/90917214 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f859801a040 con 0x7f85a80b2560 2020-10-31T22:50:37.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.041+0000 7f859effd700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8590054f10 0x7f85900573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:37.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.041+0000 7f859effd700 1 -- 172.21.15.60:0/90917214 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f859806eee0 con 0x7f85a80b2560 2020-10-31T22:50:37.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.041+0000 7f85add4b700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8590054f10 0x7f85900573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:37.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.041+0000 7f85add4b700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8590054f10 0x7f85900573d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f85a400b000 tx=0x7f85a4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:37.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.049+0000 7f859effd700 1 -- 172.21.15.60:0/90917214 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8598045220 con 0x7f85a80b2560 2020-10-31T22:50:37.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.237+0000 7f85aed4d700 1 -- 172.21.15.60:0/90917214 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85a8154eb0 con 0x7f85a80b2560 2020-10-31T22:50:37.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.237+0000 7f859effd700 1 -- 172.21.15.60:0/90917214 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f8598023070 con 0x7f85a80b2560 2020-10-31T22:50:37.243 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:37.243 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":71,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":6839,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.66:6833/1094853447","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":1094853447},{"type":"v1","addr":"172.21.15.66:6833","nonce":1094853447}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":68},{"gid":7875,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/3767660505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":3767660505},{"type":"v1","addr":"172.21.15.60:6835","nonce":3767660505}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":67}],"filesystems":[{"mdsmap":{"epoch":71,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:14.231864+0000","modified":"2020-10-31T22:50:36.890994+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":140,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[26],"metadata_pool":25,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2020-10-31T22:50:37.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.241+0000 7f85aed4d700 1 -- 172.21.15.60:0/90917214 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8590054f10 msgr2=0x7f85900573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:37.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.241+0000 7f85aed4d700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8590054f10 0x7f85900573d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f85a400b000 tx=0x7f85a4009040).stop 2020-10-31T22:50:37.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.241+0000 7f85aed4d700 1 -- 172.21.15.60:0/90917214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a80b2560 msgr2=0x7f85a80b3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:37.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.241+0000 7f85aed4d700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a80b2560 0x7f85a80b3dd0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 rx=0x7f8598002f30 tx=0x7f8598015000).stop 2020-10-31T22:50:37.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.241+0000 7f85aed4d700 1 -- 172.21.15.60:0/90917214 shutdown_connections 2020-10-31T22:50:37.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.241+0000 7f85aed4d700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f85a8140420 0x7f85a80b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.241+0000 7f85aed4d700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8590054f10 0x7f85900573d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.241+0000 7f85aed4d700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85a805b320 0x7f85a80ab220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.241+0000 7f85aed4d700 1 --2- 172.21.15.60:0/90917214 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f85a80b2560 0x7f85a80b3dd0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.241+0000 7f85aed4d700 1 -- 172.21.15.60:0/90917214 >> 172.21.15.60:0/90917214 conn(0x7f85a80b61d0 msgr2=0x7f85a813f060 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:37.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.241+0000 7f85aed4d700 1 -- 172.21.15.60:0/90917214 shutdown_connections 2020-10-31T22:50:37.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.241+0000 7f85aed4d700 1 -- 172.21.15.60:0/90917214 wait complete. 2020-10-31T22:50:37.247 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 71 2020-10-31T22:50:37.265 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:50:37.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5506d93700 1 Processor -- start 2020-10-31T22:50:37.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5506d93700 1 -- start start 2020-10-31T22:50:37.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5506d93700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f55000ac870 0x7f55000b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:37.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5506d93700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55000b0e20 0x7f55000ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:37.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5506d93700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55000acc50 con 0x7f55000ae690 2020-10-31T22:50:37.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5506d93700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55000b14c0 con 0x7f55000b0e20 2020-10-31T22:50:37.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5506d93700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55000b5690 con 0x7f55000ac870 2020-10-31T22:50:37.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5505590700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55000b0e20 0x7f55000ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:37.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5505590700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f55000b0e20 0x7f55000ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49292/0 (socket says 172.21.15.60:49292) 2020-10-31T22:50:37.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5506592700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f55000ae690 0x7f55001412e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53432/0 (socket says 172.21.15.60:53432) 2020-10-31T22:50:37.436 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5505590700 1 -- 172.21.15.60:0/1214084453 learned_addr learned my addr 172.21.15.60:0/1214084453 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:37.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5505d91700 1 --2- 172.21.15.60:0/1214084453 >> v2:172.21.15.66:3300/0 conn(0x7f55000ac870 0x7f55000b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:37.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5505590700 1 -- 172.21.15.60:0/1214084453 >> v2:172.21.15.66:3300/0 conn(0x7f55000ac870 msgr2=0x7f55000b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:37.437 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5505590700 1 --2- 172.21.15.60:0/1214084453 >> v2:172.21.15.66:3300/0 conn(0x7f55000ac870 0x7f55000b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5505590700 1 -- 172.21.15.60:0/1214084453 >> v1:172.21.15.60:6789/0 conn(0x7f55000ae690 legacy=0x7f55001412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:37.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5505590700 1 -- 172.21.15.60:0/1214084453 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55000afc10 con 0x7f55000b0e20 2020-10-31T22:50:37.438 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5504d8f700 1 -- 172.21.15.60:0/1214084453 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326320369 0 0) 0x7f55000acc50 con 0x7f55000ae690 2020-10-31T22:50:37.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.425+0000 7f5505590700 1 --2- 172.21.15.60:0/1214084453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000b0e20 0x7f55000ae1a0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f54f4002f30 tx=0x7f54f4006e80).ready entity=mon.0 client_cookie=c8d1666a33f3371e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:37.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.429+0000 7f5504d8f700 1 -- 172.21.15.60:0/1214084453 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54f4009880 con 0x7f55000b0e20 2020-10-31T22:50:37.439 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.429+0000 7f5504d8f700 1 -- 172.21.15.60:0/1214084453 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f40099e0 con 0x7f55000b0e20 2020-10-31T22:50:37.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.429+0000 7f5504d8f700 1 -- 172.21.15.60:0/1214084453 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54f4009d40 con 0x7f55000b0e20 2020-10-31T22:50:37.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.429+0000 7f5506d93700 1 -- 172.21.15.60:0/1214084453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000b0e20 msgr2=0x7f55000ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:37.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.429+0000 7f5506d93700 1 --2- 172.21.15.60:0/1214084453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000b0e20 0x7f55000ae1a0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 rx=0x7f54f4002f30 tx=0x7f54f4006e80).stop 2020-10-31T22:50:37.440 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.429+0000 7f5506d93700 1 -- 172.21.15.60:0/1214084453 shutdown_connections 2020-10-31T22:50:37.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.429+0000 7f5506d93700 1 --2- 172.21.15.60:0/1214084453 >> v2:172.21.15.66:3300/0 conn(0x7f55000ac870 0x7f55000b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.441 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.429+0000 7f5506d93700 1 --2- 172.21.15.60:0/1214084453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000b0e20 0x7f55000ae1a0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.429+0000 7f5506d93700 1 -- 172.21.15.60:0/1214084453 >> 172.21.15.60:0/1214084453 conn(0x7f550006a600 msgr2=0x7f5500060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:37.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.429+0000 7f5506d93700 1 -- 172.21.15.60:0/1214084453 shutdown_connections 2020-10-31T22:50:37.442 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.429+0000 7f5506d93700 1 -- 172.21.15.60:0/1214084453 wait complete. 2020-10-31T22:50:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.429+0000 7f5506d93700 1 Processor -- start 2020-10-31T22:50:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.429+0000 7f5506d93700 1 -- start start 2020-10-31T22:50:37.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5506d93700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55000ac870 0x7f55000a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5506d93700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000ae690 0x7f55000aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5506d93700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000b0e20 0x7f55000ab450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:37.447 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5506d93700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5500135290 con 0x7f55000ae690 2020-10-31T22:50:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5506d93700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55000649e0 con 0x7f55000b0e20 2020-10-31T22:50:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5506d93700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55000aa740 con 0x7f55000ac870 2020-10-31T22:50:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5505590700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000ae690 0x7f55000aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:37.448 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5505590700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000ae690 0x7f55000aaf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49300/0 (socket says 172.21.15.60:49300) 2020-10-31T22:50:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5505590700 1 -- 172.21.15.60:0/3275858218 learned_addr learned my addr 172.21.15.60:0/3275858218 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5506592700 1 --2- 172.21.15.60:0/3275858218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000b0e20 0x7f55000ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5505d91700 1 --2- 172.21.15.60:0/3275858218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55000ac870 0x7f55000a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:37.449 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5505590700 1 -- 172.21.15.60:0/3275858218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55000ac870 msgr2=0x7f55000a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5505590700 1 --2- 172.21.15.60:0/3275858218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55000ac870 0x7f55000a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5505590700 1 -- 172.21.15.60:0/3275858218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000b0e20 msgr2=0x7f55000ab450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:37.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5505590700 1 --2- 172.21.15.60:0/3275858218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000b0e20 0x7f55000ab450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5505590700 1 -- 172.21.15.60:0/3275858218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5500064c10 con 0x7f55000ae690 2020-10-31T22:50:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5505590700 1 --2- 172.21.15.60:0/3275858218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000ae690 0x7f55000aaf60 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f54f4002f30 tx=0x7f54f4015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:37.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f54f37fe700 1 -- 172.21.15.60:0/3275858218 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54f4011b40 con 0x7f55000ae690 2020-10-31T22:50:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f54f37fe700 1 -- 172.21.15.60:0/3275858218 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f4011ca0 con 0x7f55000ae690 2020-10-31T22:50:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5506d93700 1 -- 172.21.15.60:0/3275858218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5500064eb0 con 0x7f55000ae690 2020-10-31T22:50:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f54f37fe700 1 -- 172.21.15.60:0/3275858218 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54f401e460 con 0x7f55000ae690 2020-10-31T22:50:37.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5506d93700 1 -- 172.21.15.60:0/3275858218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55000aab40 con 0x7f55000ae690 2020-10-31T22:50:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.433+0000 7f5506d93700 1 -- 172.21.15.60:0/3275858218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5500057100 con 0x7f55000ae690 2020-10-31T22:50:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.437+0000 7f54f37fe700 1 -- 172.21.15.60:0/3275858218 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f54f4025030 con 0x7f55000ae690 2020-10-31T22:50:37.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.437+0000 7f54f37fe700 1 --2- 172.21.15.60:0/3275858218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54dc054f10 0x7f54dc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.437+0000 7f54f37fe700 1 -- 172.21.15.60:0/3275858218 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f54f406edb0 con 0x7f55000ae690 2020-10-31T22:50:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.437+0000 7f5505d91700 1 --2- 172.21.15.60:0/3275858218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54dc054f10 0x7f54dc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:37.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.437+0000 7f5505d91700 1 --2- 172.21.15.60:0/3275858218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54dc054f10 0x7f54dc0573d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f54fc00b000 tx=0x7f54fc0091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:37.455 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.441+0000 7f54f37fe700 1 -- 172.21.15.60:0/3275858218 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f54f4045220 con 0x7f55000ae690 2020-10-31T22:50:37.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.629+0000 7f5506d93700 1 -- 172.21.15.60:0/3275858218 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f550005ed50 con 0x7f55000ae690 2020-10-31T22:50:37.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.909+0000 7f54f37fe700 1 -- 172.21.15.60:0/3275858218 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7f54f40230a0 con 0x7f55000ae690 2020-10-31T22:50:37.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.913+0000 7f5506d93700 1 -- 172.21.15.60:0/3275858218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54dc054f10 msgr2=0x7f54dc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.913+0000 7f5506d93700 1 --2- 172.21.15.60:0/3275858218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54dc054f10 0x7f54dc0573d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f54fc00b000 tx=0x7f54fc0091a0).stop 2020-10-31T22:50:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.913+0000 7f5506d93700 1 -- 172.21.15.60:0/3275858218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000ae690 msgr2=0x7f55000aaf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.913+0000 7f5506d93700 1 --2- 172.21.15.60:0/3275858218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000ae690 0x7f55000aaf60 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 rx=0x7f54f4002f30 tx=0x7f54f4015000).stop 2020-10-31T22:50:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.913+0000 7f5506d93700 1 -- 172.21.15.60:0/3275858218 shutdown_connections 2020-10-31T22:50:37.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.913+0000 7f5506d93700 1 --2- 172.21.15.60:0/3275858218 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f54dc054f10 0x7f54dc0573d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.913+0000 7f5506d93700 1 --2- 172.21.15.60:0/3275858218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55000b0e20 0x7f55000ab450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.913+0000 7f5506d93700 1 --2- 172.21.15.60:0/3275858218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55000ac870 0x7f55000a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.913+0000 7f5506d93700 1 --2- 172.21.15.60:0/3275858218 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55000ae690 0x7f55000aaf60 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:37.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.913+0000 7f5506d93700 1 -- 172.21.15.60:0/3275858218 >> 172.21.15.60:0/3275858218 conn(0x7f550006a600 msgr2=0x7f55000b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:37.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.913+0000 7f5506d93700 1 -- 172.21.15.60:0/3275858218 shutdown_connections 2020-10-31T22:50:37.919 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:37.913+0000 7f5506d93700 1 -- 172.21.15.60:0/3275858218 wait complete. 2020-10-31T22:50:37.935 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:50:38.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.057+0000 7fbce759e700 1 Processor -- start 2020-10-31T22:50:38.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.057+0000 7fbce759e700 1 -- start start 2020-10-31T22:50:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbce80b1d50 0x7fbce80ac020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbce80a8140 0x7fbce80adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce759e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce813f630 con 0x7fbce813bcc0 2020-10-31T22:50:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce813c830 con 0x7fbce80b1d50 2020-10-31T22:50:38.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce80b2130 con 0x7fbce80a8140 2020-10-31T22:50:38.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce5d9b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbce80a8140 0x7fbce80adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:38.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce659c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbce80b1d50 0x7fbce80ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:38.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce5d9b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbce80a8140 0x7fbce80adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:34264/0 (socket says 172.21.15.60:34264) 2020-10-31T22:50:38.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce659c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbce80b1d50 0x7fbce80ac020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:60242/0 (socket says 172.21.15.60:60242) 2020-10-31T22:50:38.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce5d9b700 1 -- 172.21.15.60:0/1457028639 learned_addr learned my addr 172.21.15.60:0/1457028639 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:38.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce5d9b700 1 -- 172.21.15.60:0/1457028639 >> v2:172.21.15.66:3300/0 conn(0x7fbce80b1d50 msgr2=0x7fbce80ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:38.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce5d9b700 1 --2- 172.21.15.60:0/1457028639 >> v2:172.21.15.66:3300/0 conn(0x7fbce80b1d50 0x7fbce80ac020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:38.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce5d9b700 1 -- 172.21.15.60:0/1457028639 >> v1:172.21.15.66:6789/0 conn(0x7fbce813bcc0 legacy=0x7fbce813c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:38.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce5d9b700 1 -- 172.21.15.60:0/1457028639 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce805c0f0 con 0x7fbce80a8140 2020-10-31T22:50:38.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce5d9b700 1 --2- 172.21.15.60:0/1457028639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbce80a8140 0x7fbce80adb10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fbcd0002f30 tx=0x7fbcd0006e80).ready entity=mon.2 client_cookie=6918a7faff17b39a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:38.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce559a700 1 -- 172.21.15.60:0/1457028639 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd00097f0 con 0x7fbce80a8140 2020-10-31T22:50:38.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce559a700 1 -- 172.21.15.60:0/1457028639 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd0009950 con 0x7fbce80a8140 2020-10-31T22:50:38.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce559a700 1 -- 172.21.15.60:0/1457028639 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd0009cb0 con 0x7fbce80a8140 2020-10-31T22:50:38.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce759e700 1 -- 172.21.15.60:0/1457028639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbce80a8140 msgr2=0x7fbce80adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:38.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce759e700 1 --2- 172.21.15.60:0/1457028639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbce80a8140 0x7fbce80adb10 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fbcd0002f30 tx=0x7fbcd0006e80).stop 2020-10-31T22:50:38.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce759e700 1 -- 172.21.15.60:0/1457028639 shutdown_connections 2020-10-31T22:50:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce759e700 1 --2- 172.21.15.60:0/1457028639 >> v2:172.21.15.66:3300/0 conn(0x7fbce80b1d50 0x7fbce80ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce759e700 1 --2- 172.21.15.60:0/1457028639 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbce80a8140 0x7fbce80adb10 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce759e700 1 -- 172.21.15.60:0/1457028639 >> 172.21.15.60:0/1457028639 conn(0x7fbce80b5330 msgr2=0x7fbce80b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce759e700 1 -- 172.21.15.60:0/1457028639 shutdown_connections 2020-10-31T22:50:38.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.061+0000 7fbce759e700 1 -- 172.21.15.60:0/1457028639 wait complete. 2020-10-31T22:50:38.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce759e700 1 Processor -- start 2020-10-31T22:50:38.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce759e700 1 -- start start 2020-10-31T22:50:38.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbce80a8140 0x7fbce805b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:38.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbce80b1d50 0x7fbce814eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:38.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbce813bcc0 0x7fbce81528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:38.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce8063d10 con 0x7fbce80a8140 2020-10-31T22:50:38.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce81521f0 con 0x7fbce813bcc0 2020-10-31T22:50:38.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce813ddf0 con 0x7fbce80b1d50 2020-10-31T22:50:38.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbce80a8140 0x7fbce805b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:38.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce5d9b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbce80b1d50 0x7fbce814eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:38.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce6d9d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbce813bcc0 0x7fbce81528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:38.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbce80a8140 0x7fbce805b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49312/0 (socket says 172.21.15.60:49312) 2020-10-31T22:50:38.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce5d9b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbce80b1d50 0x7fbce814eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:34270/0 (socket says 172.21.15.60:34270) 2020-10-31T22:50:38.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce659c700 1 -- 172.21.15.60:0/2235918798 learned_addr learned my addr 172.21.15.60:0/2235918798 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:38.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce659c700 1 -- 172.21.15.60:0/2235918798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbce80b1d50 msgr2=0x7fbce814eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:38.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce659c700 1 --2- 172.21.15.60:0/2235918798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbce80b1d50 0x7fbce814eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:38.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce659c700 1 -- 172.21.15.60:0/2235918798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbce813bcc0 msgr2=0x7fbce81528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:38.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce659c700 1 --2- 172.21.15.60:0/2235918798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbce813bcc0 0x7fbce81528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:38.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce659c700 1 -- 172.21.15.60:0/2235918798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce813e090 con 0x7fbce80a8140 2020-10-31T22:50:38.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce6d9d700 1 --2- 172.21.15.60:0/2235918798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbce813bcc0 0x7fbce81528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:38.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce659c700 1 --2- 172.21.15.60:0/2235918798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbce80a8140 0x7fbce805b320 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7fbcd800c000 tx=0x7fbcd8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:38.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbcdf7fe700 1 -- 172.21.15.60:0/2235918798 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd800ca10 con 0x7fbce80a8140 2020-10-31T22:50:38.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbcdf7fe700 1 -- 172.21.15.60:0/2235918798 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd800cb70 con 0x7fbce80a8140 2020-10-31T22:50:38.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.065+0000 7fbce759e700 1 -- 172.21.15.60:0/2235918798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce813e330 con 0x7fbce80a8140 2020-10-31T22:50:38.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.069+0000 7fbcdf7fe700 1 -- 172.21.15.60:0/2235918798 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd80123f0 con 0x7fbce80a8140 2020-10-31T22:50:38.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.069+0000 7fbce759e700 1 -- 172.21.15.60:0/2235918798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce813d2d0 con 0x7fbce80a8140 2020-10-31T22:50:38.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.069+0000 7fbcdf7fe700 1 -- 172.21.15.60:0/2235918798 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fbcd8012550 con 0x7fbce80a8140 2020-10-31T22:50:38.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.069+0000 7fbce759e700 1 -- 172.21.15.60:0/2235918798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce8057100 con 0x7fbce80a8140 2020-10-31T22:50:38.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.069+0000 7fbcdf7fe700 1 --2- 172.21.15.60:0/2235918798 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbccc055050 0x7fbccc057510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:38.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.069+0000 7fbcdf7fe700 1 -- 172.21.15.60:0/2235918798 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fbcd806de20 con 0x7fbce80a8140 2020-10-31T22:50:38.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.069+0000 7fbce5d9b700 1 --2- 172.21.15.60:0/2235918798 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbccc055050 0x7fbccc057510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:38.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.069+0000 7fbce5d9b700 1 --2- 172.21.15.60:0/2235918798 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbccc055050 0x7fbccc057510 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fbcd001c000 tx=0x7fbcd0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:38.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.077+0000 7fbcdf7fe700 1 -- 172.21.15.60:0/2235918798 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fbcd8044290 con 0x7fbce80a8140 2020-10-31T22:50:38.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.221+0000 7fbce759e700 1 -- 172.21.15.60:0/2235918798 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbce805ee00 con 0x7fbce80a8140 2020-10-31T22:50:38.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.921+0000 7fbcdf7fe700 1 -- 172.21.15.60:0/2235918798 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v141) v1 ==== 185+0+0 (secure 0 0 0) 0x7fbcd80478b0 con 0x7fbce80a8140 2020-10-31T22:50:38.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.921+0000 7fbce759e700 1 -- 172.21.15.60:0/2235918798 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbccc055050 msgr2=0x7fbccc057510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:38.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.921+0000 7fbce759e700 1 --2- 172.21.15.60:0/2235918798 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbccc055050 0x7fbccc057510 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fbcd001c000 tx=0x7fbcd0015000).stop 2020-10-31T22:50:38.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.921+0000 7fbce759e700 1 -- 172.21.15.60:0/2235918798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbce80a8140 msgr2=0x7fbce805b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:38.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.921+0000 7fbce759e700 1 --2- 172.21.15.60:0/2235918798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbce80a8140 0x7fbce805b320 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 rx=0x7fbcd800c000 tx=0x7fbcd8006dc0).stop 2020-10-31T22:50:38.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.921+0000 7fbce759e700 1 -- 172.21.15.60:0/2235918798 shutdown_connections 2020-10-31T22:50:38.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.921+0000 7fbce759e700 1 --2- 172.21.15.60:0/2235918798 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fbccc055050 0x7fbccc057510 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:38.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.921+0000 7fbce759e700 1 --2- 172.21.15.60:0/2235918798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbce813bcc0 0x7fbce81528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:38.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.921+0000 7fbce759e700 1 --2- 172.21.15.60:0/2235918798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbce80a8140 0x7fbce805b320 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:38.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.921+0000 7fbce759e700 1 --2- 172.21.15.60:0/2235918798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbce80b1d50 0x7fbce814eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:38.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.921+0000 7fbce759e700 1 -- 172.21.15.60:0/2235918798 >> 172.21.15.60:0/2235918798 conn(0x7fbce80b5330 msgr2=0x7fbce80b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:38.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.925+0000 7fbce759e700 1 -- 172.21.15.60:0/2235918798 shutdown_connections 2020-10-31T22:50:38.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:38.925+0000 7fbce759e700 1 -- 172.21.15.60:0/2235918798 wait complete. 2020-10-31T22:50:38.933 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:50:38.944 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-10-31T22:50:39.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.061+0000 7f1fdbfff700 1 Processor -- start 2020-10-31T22:50:39.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.061+0000 7f1fdbfff700 1 -- start start 2020-10-31T22:50:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdbfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1fdc0ac870 0x7f1fdc146060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdbfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1fdc146550 0x7f1fdc150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:39.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdbfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc0af900 con 0x7f1fdc0af520 2020-10-31T22:50:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdbfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc0afc10 con 0x7f1fdc146550 2020-10-31T22:50:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdbfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc05bb70 con 0x7f1fdc0ac870 2020-10-31T22:50:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdb7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1fdc146550 0x7f1fdc150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:39.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdb7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1fdc146550 0x7f1fdc150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49322/0 (socket says 172.21.15.60:49322) 2020-10-31T22:50:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdb7fe700 1 -- 172.21.15.60:0/265722895 learned_addr learned my addr 172.21.15.60:0/265722895 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:39.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdaffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f1fdc0af520 0x7f1fdc066c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53456/0 (socket says 172.21.15.60:53456) 2020-10-31T22:50:39.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fda7fc700 1 --2- 172.21.15.60:0/265722895 >> v2:172.21.15.66:3300/0 conn(0x7f1fdc0ac870 0x7f1fdc146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdb7fe700 1 -- 172.21.15.60:0/265722895 >> v2:172.21.15.66:3300/0 conn(0x7f1fdc0ac870 msgr2=0x7f1fdc146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdb7fe700 1 --2- 172.21.15.60:0/265722895 >> v2:172.21.15.66:3300/0 conn(0x7f1fdc0ac870 0x7f1fdc146060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:39.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdb7fe700 1 -- 172.21.15.60:0/265722895 >> v1:172.21.15.60:6789/0 conn(0x7f1fdc0af520 legacy=0x7f1fdc066c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fd9ffb700 1 -- 172.21.15.60:0/265722895 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1207068125 0 0) 0x7f1fdc0af900 con 0x7f1fdc0af520 2020-10-31T22:50:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdb7fe700 1 -- 172.21.15.60:0/265722895 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0ac130 con 0x7f1fdc146550 2020-10-31T22:50:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdb7fe700 1 --2- 172.21.15.60:0/265722895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc146550 0x7f1fdc150980 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f1fd40032b0 tx=0x7f1fd4009270).ready entity=mon.0 client_cookie=f48c16b2601fb414 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:39.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fd9ffb700 1 -- 172.21.15.60:0/265722895 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd4009e60 con 0x7f1fdc146550 2020-10-31T22:50:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fd9ffb700 1 -- 172.21.15.60:0/265722895 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd400bc00 con 0x7f1fdc146550 2020-10-31T22:50:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fd9ffb700 1 -- 172.21.15.60:0/265722895 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fd400bd70 con 0x7f1fdc146550 2020-10-31T22:50:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdbfff700 1 -- 172.21.15.60:0/265722895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc146550 msgr2=0x7f1fdc150980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdbfff700 1 --2- 172.21.15.60:0/265722895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc146550 0x7f1fdc150980 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 rx=0x7f1fd40032b0 tx=0x7f1fd4009270).stop 2020-10-31T22:50:39.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdbfff700 1 -- 172.21.15.60:0/265722895 shutdown_connections 2020-10-31T22:50:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdbfff700 1 --2- 172.21.15.60:0/265722895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc146550 0x7f1fdc150980 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdbfff700 1 --2- 172.21.15.60:0/265722895 >> v2:172.21.15.66:3300/0 conn(0x7f1fdc0ac870 0x7f1fdc146060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdbfff700 1 -- 172.21.15.60:0/265722895 >> 172.21.15.60:0/265722895 conn(0x7f1fdc0b3fd0 msgr2=0x7f1fdc0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdbfff700 1 -- 172.21.15.60:0/265722895 shutdown_connections 2020-10-31T22:50:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.065+0000 7f1fdbfff700 1 -- 172.21.15.60:0/265722895 wait complete. 2020-10-31T22:50:39.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdbfff700 1 Processor -- start 2020-10-31T22:50:39.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdbfff700 1 -- start start 2020-10-31T22:50:39.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdbfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc0ac870 0x7f1fdc0a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:39.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdbfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fdc0af520 0x7f1fdc141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:39.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdbfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fdc146550 0x7f1fdc142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:39.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdbfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0a92f0 con 0x7f1fdc0ac870 2020-10-31T22:50:39.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdbfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0a87e0 con 0x7f1fdc0af520 2020-10-31T22:50:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdbfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc0aa3f0 con 0x7f1fdc146550 2020-10-31T22:50:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc0ac870 0x7f1fdc0a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdaffd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc0ac870 0x7f1fdc0a9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49326/0 (socket says 172.21.15.60:49326) 2020-10-31T22:50:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdaffd700 1 -- 172.21.15.60:0/4156383020 learned_addr learned my addr 172.21.15.60:0/4156383020 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fda7fc700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fdc0af520 0x7f1fdc141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdb7fe700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fdc146550 0x7f1fdc142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:39.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdaffd700 1 -- 172.21.15.60:0/4156383020 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fdc146550 msgr2=0x7f1fdc142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdaffd700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fdc146550 0x7f1fdc142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdaffd700 1 -- 172.21.15.60:0/4156383020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fdc0af520 msgr2=0x7f1fdc141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdaffd700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fdc0af520 0x7f1fdc141e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdaffd700 1 -- 172.21.15.60:0/4156383020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc0a8a80 con 0x7f1fdc0ac870 2020-10-31T22:50:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fda7fc700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fdc0af520 0x7f1fdc141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdaffd700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc0ac870 0x7f1fdc0a9f00 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f1fc40010a0 tx=0x7f1fc4007920).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:39.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fd3fff700 1 -- 172.21.15.60:0/4156383020 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fc40072e0 con 0x7f1fdc0ac870 2020-10-31T22:50:39.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fd3fff700 1 -- 172.21.15.60:0/4156383020 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fc40054b0 con 0x7f1fdc0ac870 2020-10-31T22:50:39.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fd3fff700 1 -- 172.21.15.60:0/4156383020 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1fc4005810 con 0x7f1fdc0ac870 2020-10-31T22:50:39.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdbfff700 1 -- 172.21.15.60:0/4156383020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc0a9520 con 0x7f1fdc0ac870 2020-10-31T22:50:39.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.069+0000 7f1fdbfff700 1 -- 172.21.15.60:0/4156383020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc148bf0 con 0x7f1fdc0ac870 2020-10-31T22:50:39.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.073+0000 7f1fdbfff700 1 -- 172.21.15.60:0/4156383020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc0a8580 con 0x7f1fdc0ac870 2020-10-31T22:50:39.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.073+0000 7f1fd3fff700 1 -- 172.21.15.60:0/4156383020 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1fc4010070 con 0x7f1fdc0ac870 2020-10-31T22:50:39.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.073+0000 7f1fd3fff700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fc0054f30 0x7f1fc00573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:39.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.073+0000 7f1fd3fff700 1 -- 172.21.15.60:0/4156383020 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f1fc406cef0 con 0x7f1fdc0ac870 2020-10-31T22:50:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.073+0000 7f1fda7fc700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fc0054f30 0x7f1fc00573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.073+0000 7f1fda7fc700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fc0054f30 0x7f1fc00573f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f1fcc00b000 tx=0x7f1fcc008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:39.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.077+0000 7f1fd3fff700 1 -- 172.21.15.60:0/4156383020 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1fc4043570 con 0x7f1fdc0ac870 2020-10-31T22:50:39.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.221+0000 7f1fdbfff700 1 -- 172.21.15.60:0/4156383020 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1fdc057100 con 0x7f1fdc0ac870 2020-10-31T22:50:39.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.929+0000 7f1fd3fff700 1 -- 172.21.15.60:0/4156383020 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v142) v1 ==== 173+0+0 (secure 0 0 0) 0x7f1fc4018070 con 0x7f1fdc0ac870 2020-10-31T22:50:39.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.933+0000 7f1fdbfff700 1 -- 172.21.15.60:0/4156383020 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fc0054f30 msgr2=0x7f1fc00573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:39.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.933+0000 7f1fdbfff700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fc0054f30 0x7f1fc00573f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7f1fcc00b000 tx=0x7f1fcc008040).stop 2020-10-31T22:50:39.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.933+0000 7f1fdbfff700 1 -- 172.21.15.60:0/4156383020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc0ac870 msgr2=0x7f1fdc0a9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:39.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.933+0000 7f1fdbfff700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc0ac870 0x7f1fdc0a9f00 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 rx=0x7f1fc40010a0 tx=0x7f1fc4007920).stop 2020-10-31T22:50:39.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.937+0000 7f1fdbfff700 1 -- 172.21.15.60:0/4156383020 shutdown_connections 2020-10-31T22:50:39.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.937+0000 7f1fdbfff700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1fdc146550 0x7f1fdc142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:39.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.937+0000 7f1fdbfff700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fdc0ac870 0x7f1fdc0a9f00 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:39.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.937+0000 7f1fdbfff700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fc0054f30 0x7f1fc00573f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:39.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.937+0000 7f1fdbfff700 1 --2- 172.21.15.60:0/4156383020 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1fdc0af520 0x7f1fdc141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:39.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.937+0000 7f1fdbfff700 1 -- 172.21.15.60:0/4156383020 >> 172.21.15.60:0/4156383020 conn(0x7f1fdc0b3fd0 msgr2=0x7f1fdc0b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:39.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.937+0000 7f1fdbfff700 1 -- 172.21.15.60:0/4156383020 shutdown_connections 2020-10-31T22:50:39.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:39.937+0000 7f1fdbfff700 1 -- 172.21.15.60:0/4156383020 wait complete. 2020-10-31T22:50:39.943 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2020-10-31T22:50:39.957 INFO:tasks.ceph.mds.a:Restarting daemon 2020-10-31T22:50:39.957 INFO:tasks.ceph.mds.a:Stopping old one... 2020-10-31T22:50:39.957 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-10-31T22:50:39.958 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:50:39.958 INFO:tasks.ceph.mds.c:Restarting daemon 2020-10-31T22:50:39.959 INFO:tasks.ceph.mds.c:Stopping old one... 2020-10-31T22:50:39.959 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-10-31T22:50:39.959 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:50:39.960 INFO:tasks.ceph.mds.b:Restarting daemon 2020-10-31T22:50:39.960 INFO:tasks.ceph.mds.b:Stopping old one... 2020-10-31T22:50:39.960 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-10-31T22:50:39.961 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:50:39.971 INFO:tasks.ceph.mds.a:Stopped 2020-10-31T22:50:39.972 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-10-31T22:50:39.973 INFO:tasks.ceph.mds.b:Stopped 2020-10-31T22:50:39.974 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-10-31T22:50:39.977 INFO:tasks.ceph.mds.c:Stopped 2020-10-31T22:50:39.978 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-10-31T22:50:40.018 INFO:tasks.ceph.mds.b:Started 2020-10-31T22:50:40.019 DEBUG:teuthology.parallel:result is None 2020-10-31T22:50:40.021 INFO:tasks.ceph.mds.a:Started 2020-10-31T22:50:40.022 DEBUG:teuthology.parallel:result is None 2020-10-31T22:50:40.023 INFO:tasks.ceph.mds.c:Started 2020-10-31T22:50:40.024 DEBUG:teuthology.parallel:result is None 2020-10-31T22:50:40.024 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-10-31T22:50:40.097 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:50:40.098 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:50:40.102 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:50:40.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 Processor -- start 2020-10-31T22:50:40.145 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 -- start start 2020-10-31T22:50:40.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fab380ab410 0x7fab380a78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:40.146 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3813e9b0 0x7fab3805b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:40.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab380675d0 con 0x7fab380a7500 2020-10-31T22:50:40.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab3813f0c0 con 0x7fab380ab410 2020-10-31T22:50:40.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab3813f360 con 0x7fab3813e9b0 2020-10-31T22:50:40.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3d3a0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fab380ab410 0x7fab380a78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:40.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3d3a0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fab380ab410 0x7fab380a78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49360/0 (socket says 172.21.15.60:49360) 2020-10-31T22:50:40.147 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3d3a0700 1 -- 172.21.15.60:0/2103149133 learned_addr learned my addr 172.21.15.60:0/2103149133 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:40.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3e3a2700 1 --2- 172.21.15.60:0/2103149133 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3813e9b0 0x7fab3805b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:40.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3d3a0700 1 -- 172.21.15.60:0/2103149133 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3813e9b0 msgr2=0x7fab3805b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:40.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3d3a0700 1 --2- 172.21.15.60:0/2103149133 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3813e9b0 0x7fab3805b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:40.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3d3a0700 1 -- 172.21.15.60:0/2103149133 >> v1:172.21.15.66:6789/0 conn(0x7fab380a7500 legacy=0x7fab3813be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:40.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3d3a0700 1 -- 172.21.15.60:0/2103149133 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab3813f600 con 0x7fab380ab410 2020-10-31T22:50:40.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3d3a0700 1 --2- 172.21.15.60:0/2103149133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab380ab410 0x7fab380a78e0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7fab28002f30 tx=0x7fab28006e80).ready entity=mon.0 client_cookie=2eaa19c7885d3d55 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:40.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3cb9f700 1 -- 172.21.15.60:0/2103149133 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab280097f0 con 0x7fab380ab410 2020-10-31T22:50:40.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3cb9f700 1 -- 172.21.15.60:0/2103149133 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab28009950 con 0x7fab380ab410 2020-10-31T22:50:40.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3cb9f700 1 -- 172.21.15.60:0/2103149133 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab28009cb0 con 0x7fab380ab410 2020-10-31T22:50:40.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 -- 172.21.15.60:0/2103149133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab380ab410 msgr2=0x7fab380a78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:40.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 --2- 172.21.15.60:0/2103149133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab380ab410 0x7fab380a78e0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 rx=0x7fab28002f30 tx=0x7fab28006e80).stop 2020-10-31T22:50:40.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 -- 172.21.15.60:0/2103149133 shutdown_connections 2020-10-31T22:50:40.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 --2- 172.21.15.60:0/2103149133 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab3813e9b0 0x7fab3805b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:40.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 --2- 172.21.15.60:0/2103149133 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab380ab410 0x7fab380a78e0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:40.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 -- 172.21.15.60:0/2103149133 >> 172.21.15.60:0/2103149133 conn(0x7fab380b3fd0 msgr2=0x7fab380b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:40.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 -- 172.21.15.60:0/2103149133 shutdown_connections 2020-10-31T22:50:40.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.141+0000 7fab3eba3700 1 -- 172.21.15.60:0/2103149133 wait complete. 2020-10-31T22:50:40.153 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.145+0000 7fab3eba3700 1 Processor -- start 2020-10-31T22:50:40.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.145+0000 7fab3eba3700 1 -- start start 2020-10-31T22:50:40.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.145+0000 7fab3eba3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab380a7500 0x7fab380b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:40.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.145+0000 7fab3eba3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab380ab410 0x7fab380a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:40.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.145+0000 7fab3eba3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab3813e9b0 0x7fab380a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:40.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.145+0000 7fab3eba3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab380aaf80 con 0x7fab380ab410 2020-10-31T22:50:40.154 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.145+0000 7fab3eba3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab380aace0 con 0x7fab3813e9b0 2020-10-31T22:50:40.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.145+0000 7fab3eba3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab380b3b50 con 0x7fab380a7500 2020-10-31T22:50:40.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.145+0000 7fab3d3a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab380ab410 0x7fab380a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:40.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.145+0000 7fab3d3a0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab380ab410 0x7fab380a83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49366/0 (socket says 172.21.15.60:49366) 2020-10-31T22:50:40.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.145+0000 7fab3d3a0700 1 -- 172.21.15.60:0/1521742500 learned_addr learned my addr 172.21.15.60:0/1521742500 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:40.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.145+0000 7fab3e3a2700 1 --2- 172.21.15.60:0/1521742500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab3813e9b0 0x7fab380a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:40.155 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.145+0000 7fab3dba1700 1 --2- 172.21.15.60:0/1521742500 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab380a7500 0x7fab380b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:40.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab3d3a0700 1 -- 172.21.15.60:0/1521742500 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab380a7500 msgr2=0x7fab380b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:40.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab3d3a0700 1 --2- 172.21.15.60:0/1521742500 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab380a7500 0x7fab380b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:40.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab3d3a0700 1 -- 172.21.15.60:0/1521742500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab3813e9b0 msgr2=0x7fab380a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:40.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab3d3a0700 1 --2- 172.21.15.60:0/1521742500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab3813e9b0 0x7fab380a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:40.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab3d3a0700 1 -- 172.21.15.60:0/1521742500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab380b2ee0 con 0x7fab380ab410 2020-10-31T22:50:40.156 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab3d3a0700 1 --2- 172.21.15.60:0/1521742500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab380ab410 0x7fab380a83e0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fab28002f30 tx=0x7fab28015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:40.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab26ffd700 1 -- 172.21.15.60:0/1521742500 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab28009e60 con 0x7fab380ab410 2020-10-31T22:50:40.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab26ffd700 1 -- 172.21.15.60:0/1521742500 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab28011e50 con 0x7fab380ab410 2020-10-31T22:50:40.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab26ffd700 1 -- 172.21.15.60:0/1521742500 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fab2801e650 con 0x7fab380ab410 2020-10-31T22:50:40.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab3eba3700 1 -- 172.21.15.60:0/1521742500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3814c7b0 con 0x7fab380ab410 2020-10-31T22:50:40.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab3eba3700 1 -- 172.21.15.60:0/1521742500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab380b1bd0 con 0x7fab380ab410 2020-10-31T22:50:40.158 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab3eba3700 1 -- 172.21.15.60:0/1521742500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab380b2d20 con 0x7fab380ab410 2020-10-31T22:50:40.159 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab26ffd700 1 -- 172.21.15.60:0/1521742500 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fab28025030 con 0x7fab380ab410 2020-10-31T22:50:40.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab26ffd700 1 --2- 172.21.15.60:0/1521742500 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab18054f10 0x7fab180573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:40.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab26ffd700 1 -- 172.21.15.60:0/1521742500 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5339+0+0 (secure 0 0 0) 0x7fab2806eac0 con 0x7fab380ab410 2020-10-31T22:50:40.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab3dba1700 1 --2- 172.21.15.60:0/1521742500 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab18054f10 0x7fab180573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:40.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.149+0000 7fab3dba1700 1 --2- 172.21.15.60:0/1521742500 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab18054f10 0x7fab180573d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fab3400d000 tx=0x7fab34009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:40.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.157+0000 7fab26ffd700 1 -- 172.21.15.60:0/1521742500 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fab280452c0 con 0x7fab380ab410 2020-10-31T22:50:40.316 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:40.309+0000 7fab3eba3700 1 -- 172.21.15.60:0/1521742500 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7fab38057100 con 0x7fab380ab410 2020-10-31T22:50:41.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.125+0000 7fab26ffd700 1 -- 172.21.15.60:0/1521742500 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v145) v1 ==== 97+0+0 (secure 0 0 0) 0x7fab280488e0 con 0x7fab380ab410 2020-10-31T22:50:41.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.129+0000 7fab3eba3700 1 -- 172.21.15.60:0/1521742500 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab18054f10 msgr2=0x7fab180573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.129+0000 7fab3eba3700 1 --2- 172.21.15.60:0/1521742500 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab18054f10 0x7fab180573d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7fab3400d000 tx=0x7fab34009040).stop 2020-10-31T22:50:41.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.129+0000 7fab3eba3700 1 -- 172.21.15.60:0/1521742500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab380ab410 msgr2=0x7fab380a83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.129+0000 7fab3eba3700 1 --2- 172.21.15.60:0/1521742500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab380ab410 0x7fab380a83e0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 rx=0x7fab28002f30 tx=0x7fab28015000).stop 2020-10-31T22:50:41.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.129+0000 7fab3eba3700 1 -- 172.21.15.60:0/1521742500 shutdown_connections 2020-10-31T22:50:41.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.129+0000 7fab3eba3700 1 --2- 172.21.15.60:0/1521742500 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fab18054f10 0x7fab180573d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.129+0000 7fab3eba3700 1 --2- 172.21.15.60:0/1521742500 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fab3813e9b0 0x7fab380a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.129+0000 7fab3eba3700 1 --2- 172.21.15.60:0/1521742500 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fab380a7500 0x7fab380b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.129+0000 7fab3eba3700 1 --2- 172.21.15.60:0/1521742500 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab380ab410 0x7fab380a83e0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.129+0000 7fab3eba3700 1 -- 172.21.15.60:0/1521742500 >> 172.21.15.60:0/1521742500 conn(0x7fab380b3fd0 msgr2=0x7fab380afbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:41.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.129+0000 7fab3eba3700 1 -- 172.21.15.60:0/1521742500 shutdown_connections 2020-10-31T22:50:41.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.129+0000 7fab3eba3700 1 -- 172.21.15.60:0/1521742500 wait complete. 2020-10-31T22:50:41.139 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blacklist entries 2020-10-31T22:50:41.155 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2020-10-31T22:50:41.157 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-10-31T22:50:41.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.269+0000 7fe081390700 1 Processor -- start 2020-10-31T22:50:41.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.269+0000 7fe081390700 1 -- start start 2020-10-31T22:50:41.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.269+0000 7fe081390700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe07c0b5570 0x7fe07c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.269+0000 7fe081390700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe07c0b24a0 0x7fe07c145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.269+0000 7fe081390700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe07c145d10 0x7fe07c141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.269+0000 7fe081390700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07c0afae0 con 0x7fe07c0b24a0 2020-10-31T22:50:41.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.269+0000 7fe081390700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07c141bf0 con 0x7fe07c145d10 2020-10-31T22:50:41.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.269+0000 7fe081390700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c13f930 con 0x7fe07c0b5570 2020-10-31T22:50:41.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.269+0000 7fe07b7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe07c0b24a0 0x7fe07c145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.269+0000 7fe07b7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe07c0b24a0 0x7fe07c145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49376/0 (socket says 172.21.15.60:49376) 2020-10-31T22:50:41.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.269+0000 7fe07b7fe700 1 -- 172.21.15.60:0/1701929821 learned_addr learned my addr 172.21.15.60:0/1701929821 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:41.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.269+0000 7fe080b8f700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe07c145d10 0x7fe07c141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.269+0000 7fe07bfff700 1 --2- 172.21.15.60:0/1701929821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe07c0b5570 0x7fe07c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe07b7fe700 1 -- 172.21.15.60:0/1701929821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe07c0b5570 msgr2=0x7fe07c0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:41.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe07b7fe700 1 --2- 172.21.15.60:0/1701929821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe07c0b5570 0x7fe07c0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe07b7fe700 1 -- 172.21.15.60:0/1701929821 >> v2:172.21.15.66:3300/0 conn(0x7fe07c145d10 msgr2=0x7fe07c141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:41.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe07b7fe700 1 --2- 172.21.15.60:0/1701929821 >> v2:172.21.15.66:3300/0 conn(0x7fe07c145d10 0x7fe07c141fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe07b7fe700 1 -- 172.21.15.60:0/1701929821 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c145180 con 0x7fe07c0b24a0 2020-10-31T22:50:41.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe07bfff700 1 --2- 172.21.15.60:0/1701929821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe07c0b5570 0x7fe07c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:41.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe07b7fe700 1 --2- 172.21.15.60:0/1701929821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07c0b24a0 0x7fe07c145820 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fe07c061290 tx=0x7fe070009270).ready entity=mon.0 client_cookie=da5a1f713c279bc6 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:41.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe07affd700 1 -- 172.21.15.60:0/1701929821 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe070009e90 con 0x7fe07c0b24a0 2020-10-31T22:50:41.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe07affd700 1 -- 172.21.15.60:0/1701929821 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07000bb10 con 0x7fe07c0b24a0 2020-10-31T22:50:41.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe07affd700 1 -- 172.21.15.60:0/1701929821 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe07000bc80 con 0x7fe07c0b24a0 2020-10-31T22:50:41.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe081390700 1 -- 172.21.15.60:0/1701929821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07c0b24a0 msgr2=0x7fe07c145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe081390700 1 --2- 172.21.15.60:0/1701929821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07c0b24a0 0x7fe07c145820 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 rx=0x7fe07c061290 tx=0x7fe070009270).stop 2020-10-31T22:50:41.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe081390700 1 -- 172.21.15.60:0/1701929821 shutdown_connections 2020-10-31T22:50:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe081390700 1 --2- 172.21.15.60:0/1701929821 >> v2:172.21.15.66:3300/0 conn(0x7fe07c145d10 0x7fe07c141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe081390700 1 --2- 172.21.15.60:0/1701929821 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe07c0b5570 0x7fe07c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe081390700 1 --2- 172.21.15.60:0/1701929821 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07c0b24a0 0x7fe07c145820 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe081390700 1 -- 172.21.15.60:0/1701929821 >> 172.21.15.60:0/1701929821 conn(0x7fe07c0b8e90 msgr2=0x7fe07c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe081390700 1 -- 172.21.15.60:0/1701929821 shutdown_connections 2020-10-31T22:50:41.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe081390700 1 -- 172.21.15.60:0/1701929821 wait complete. 2020-10-31T22:50:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe081390700 1 Processor -- start 2020-10-31T22:50:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.273+0000 7fe081390700 1 -- start start 2020-10-31T22:50:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe081390700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07c0b24a0 0x7fe07c13bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe081390700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe07c0b5570 0x7fe07c13cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe081390700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe07c145d10 0x7fe07c1379d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe081390700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c1362b0 con 0x7fe07c0b24a0 2020-10-31T22:50:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe081390700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c137110 con 0x7fe07c0b5570 2020-10-31T22:50:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe081390700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c1352d0 con 0x7fe07c145d10 2020-10-31T22:50:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe07bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07c0b24a0 0x7fe07c13bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe07bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07c0b24a0 0x7fe07c13bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49380/0 (socket says 172.21.15.60:49380) 2020-10-31T22:50:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe07bfff700 1 -- 172.21.15.60:0/941417497 learned_addr learned my addr 172.21.15.60:0/941417497 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:41.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe080b8f700 1 --2- 172.21.15.60:0/941417497 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe07c145d10 0x7fe07c1379d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe07b7fe700 1 --2- 172.21.15.60:0/941417497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe07c0b5570 0x7fe07c13cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe07bfff700 1 -- 172.21.15.60:0/941417497 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe07c145d10 msgr2=0x7fe07c1379d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe07bfff700 1 --2- 172.21.15.60:0/941417497 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe07c145d10 0x7fe07c1379d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe07bfff700 1 -- 172.21.15.60:0/941417497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe07c0b5570 msgr2=0x7fe07c13cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe07bfff700 1 --2- 172.21.15.60:0/941417497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe07c0b5570 0x7fe07c13cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe07bfff700 1 -- 172.21.15.60:0/941417497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c135a40 con 0x7fe07c0b24a0 2020-10-31T22:50:41.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe07bfff700 1 --2- 172.21.15.60:0/941417497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07c0b24a0 0x7fe07c13bd60 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7fe06c00c000 tx=0x7fe06c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:41.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe0797fa700 1 -- 172.21.15.60:0/941417497 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe06c00cb90 con 0x7fe07c0b24a0 2020-10-31T22:50:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe0797fa700 1 -- 172.21.15.60:0/941417497 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06c00ccf0 con 0x7fe07c0b24a0 2020-10-31T22:50:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe081390700 1 -- 172.21.15.60:0/941417497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c135500 con 0x7fe07c0b24a0 2020-10-31T22:50:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe0797fa700 1 -- 172.21.15.60:0/941417497 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe06c0125e0 con 0x7fe07c0b24a0 2020-10-31T22:50:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe081390700 1 -- 172.21.15.60:0/941417497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c13d850 con 0x7fe07c0b24a0 2020-10-31T22:50:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe081390700 1 -- 172.21.15.60:0/941417497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07c154390 con 0x7fe07c0b24a0 2020-10-31T22:50:41.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe0797fa700 1 -- 172.21.15.60:0/941417497 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe06c012740 con 0x7fe07c0b24a0 2020-10-31T22:50:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe0797fa700 1 --2- 172.21.15.60:0/941417497 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe05c054f10 0x7fe05c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe0797fa700 1 -- 172.21.15.60:0/941417497 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fe06c06dd90 con 0x7fe07c0b24a0 2020-10-31T22:50:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.277+0000 7fe07b7fe700 1 --2- 172.21.15.60:0/941417497 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe05c054f10 0x7fe05c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.281+0000 7fe07b7fe700 1 --2- 172.21.15.60:0/941417497 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe05c054f10 0x7fe05c0573d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fe07001a000 tx=0x7fe070016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:41.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.285+0000 7fe0797fa700 1 -- 172.21.15.60:0/941417497 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe06c0445e0 con 0x7fe07c0b24a0 2020-10-31T22:50:41.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.477+0000 7fe081390700 1 -- 172.21.15.60:0/941417497 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe07c1376c0 con 0x7fe07c0b24a0 2020-10-31T22:50:41.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.477+0000 7fe0797fa700 1 -- 172.21.15.60:0/941417497 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v30) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fe06c00ce60 con 0x7fe07c0b24a0 2020-10-31T22:50:41.482 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:41.482 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:50:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2020-10-31T22:50:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.483 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2020-10-31T22:50:41.484 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f7D/cFRAAHQ9NU7VSs14mi5sC/GwHng==", 2020-10-31T22:50:41.484 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.484 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:50:41.484 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:41.484 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:41.484 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:41.485 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.485 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.485 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.485 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2020-10-31T22:50:41.485 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f5SPjJBAAVjFv2PdBZ7j94etJrAT0tA==", 2020-10-31T22:50:41.485 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.485 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:50:41.486 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:41.486 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:41.486 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:41.486 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.486 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.487 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.487 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2020-10-31T22:50:41.487 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKpdoHhAAhhlaYqOQoI6tTKexjRpbGA==", 2020-10-31T22:50:41.487 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.487 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:50:41.487 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:41.487 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:41.488 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:41.488 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.488 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.488 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.488 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2020-10-31T22:50:41.488 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDR551f7MwsMRAACZIQlAKm3BdVbDs2gQAfxg==", 2020-10-31T22:50:41.488 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.489 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:41.489 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:41.489 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:41.489 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.489 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.489 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.489 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2020-10-31T22:50:41.490 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDU551f07HQFxAAokMFXwsbgKGtJNpnKerdGg==", 2020-10-31T22:50:41.490 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.490 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:41.490 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:41.490 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:41.490 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.490 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.491 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.491 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2020-10-31T22:50:41.491 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDW551fODyjOhAAJ+j8KITJidSpltSiJaQZGw==", 2020-10-31T22:50:41.491 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.491 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:41.491 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:41.492 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:41.492 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.492 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.492 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.492 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2020-10-31T22:50:41.492 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDZ551fs+aCIhAAwpbmgGQjU05W3hZofTtHdg==", 2020-10-31T22:50:41.492 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.493 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:41.493 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:41.493 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:41.493 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.493 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.493 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.493 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2020-10-31T22:50:41.494 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDe551fI5nIMxAAwwNSHQYDPS6G2achKIpwqg==", 2020-10-31T22:50:41.494 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.494 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:41.494 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:41.494 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:41.494 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.494 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.495 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.495 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2020-10-31T22:50:41.495 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDh551f68p2GhAAhlGpZLPg8RqouzStqN4tFw==", 2020-10-31T22:50:41.495 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.495 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:41.495 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:41.495 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:41.496 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.496 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.496 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.496 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2020-10-31T22:50:41.496 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDk551fUi3kARAAsXPU7HEhqax8Go00CqgdNw==", 2020-10-31T22:50:41.496 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.496 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2020-10-31T22:50:41.497 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDm551fKh4aJRAAj+whV4kueCu2Og7wZ05tNw==", 2020-10-31T22:50:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.498 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.499 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2020-10-31T22:50:41.499 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551flXvBJxAAtD4URDL2NV0zyAympufvVA==", 2020-10-31T22:50:41.499 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.499 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:50:41.499 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:50:41.499 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:50:41.500 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.500 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.500 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.500 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2020-10-31T22:50:41.500 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fQ/OGKhAA/xGrRlUW52pP6E6SWXYAGA==", 2020-10-31T22:50:41.500 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.500 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:50:41.501 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:50:41.501 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:50:41.501 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.501 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.501 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.501 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2020-10-31T22:50:41.501 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDP551fITgCMxAAQy5CQzqda1YjdUtTRxbsPQ==", 2020-10-31T22:50:41.502 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.502 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:50:41.502 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:50:41.502 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:50:41.502 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:41.502 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.502 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.503 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.503 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2020-10-31T22:50:41.503 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551feZUgExAAvGt2fUb5GhkkFQ0dbgP5nw==", 2020-10-31T22:50:41.503 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.503 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:50:41.503 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:50:41.503 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:41.504 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:41.504 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:41.504 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2020-10-31T22:50:41.504 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKiN5EBAAhHtXXE4+yydXWOK7agZ14g==", 2020-10-31T22:50:41.504 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:50:41.504 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:50:41.505 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:50:41.505 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:50:41.505 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.505 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:41.505 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:41.505 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:50:41.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.477+0000 7fe081390700 1 -- 172.21.15.60:0/941417497 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe05c054f10 msgr2=0x7fe05c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.477+0000 7fe081390700 1 --2- 172.21.15.60:0/941417497 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe05c054f10 0x7fe05c0573d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7fe07001a000 tx=0x7fe070016000).stop 2020-10-31T22:50:41.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.477+0000 7fe081390700 1 -- 172.21.15.60:0/941417497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07c0b24a0 msgr2=0x7fe07c13bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.477+0000 7fe081390700 1 --2- 172.21.15.60:0/941417497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07c0b24a0 0x7fe07c13bd60 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 rx=0x7fe06c00c000 tx=0x7fe06c006dc0).stop 2020-10-31T22:50:41.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.477+0000 7fe081390700 1 -- 172.21.15.60:0/941417497 shutdown_connections 2020-10-31T22:50:41.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.477+0000 7fe081390700 1 --2- 172.21.15.60:0/941417497 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe07c145d10 0x7fe07c1379d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.477+0000 7fe081390700 1 --2- 172.21.15.60:0/941417497 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe07c0b24a0 0x7fe07c13bd60 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.477+0000 7fe081390700 1 --2- 172.21.15.60:0/941417497 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe05c054f10 0x7fe05c0573d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.477+0000 7fe081390700 1 --2- 172.21.15.60:0/941417497 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe07c0b5570 0x7fe07c13cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.477+0000 7fe081390700 1 -- 172.21.15.60:0/941417497 >> 172.21.15.60:0/941417497 conn(0x7fe07c0b8e90 msgr2=0x7fe07c0659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:41.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.477+0000 7fe081390700 1 -- 172.21.15.60:0/941417497 shutdown_connections 2020-10-31T22:50:41.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.477+0000 7fe081390700 1 -- 172.21.15.60:0/941417497 wait complete. 2020-10-31T22:50:41.509 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:50:41.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.613+0000 7fef34cbe700 1 Processor -- start 2020-10-31T22:50:41.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.613+0000 7fef34cbe700 1 -- start start 2020-10-31T22:50:41.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef34cbe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fef300ae8b0 0x7fef300b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef34cbe700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef300acc50 con 0x7fef300b0e20 2020-10-31T22:50:41.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef34cbe700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef300b5690 con 0x7fef300ac870 2020-10-31T22:50:41.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef34cbe700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef300b14c0 con 0x7fef300ae8b0 2020-10-31T22:50:41.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef2effd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fef300b0e20 0x7fef301412e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53524/0 (socket says 172.21.15.60:53524) 2020-10-31T22:50:41.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef2effd700 1 -- 172.21.15.60:0/3315262079 learned_addr learned my addr 172.21.15.60:0/3315262079 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:41.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef2ffff700 1 --2- 172.21.15.60:0/3315262079 >> v2:172.21.15.60:3300/0 conn(0x7fef300ae8b0 0x7fef300b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef2e7fc700 1 -- 172.21.15.60:0/3315262079 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1800681534 0 0) 0x7fef300acc50 con 0x7fef300b0e20 2020-10-31T22:50:41.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef2e7fc700 1 -- 172.21.15.60:0/3315262079 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef1c003230 con 0x7fef300b0e20 2020-10-31T22:50:41.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef2ffff700 1 -- 172.21.15.60:0/3315262079 >> v1:172.21.15.66:6789/0 conn(0x7fef300ac870 legacy=0x7fef300ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:41.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef2ffff700 1 -- 172.21.15.60:0/3315262079 >> v1:172.21.15.60:6789/0 conn(0x7fef300b0e20 legacy=0x7fef301412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef2e7fc700 1 -- 172.21.15.60:0/3315262079 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1042991023 0 0) 0x7fef1c003230 con 0x7fef300b0e20 2020-10-31T22:50:41.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef2ffff700 1 -- 172.21.15.60:0/3315262079 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef300afc10 con 0x7fef300ae8b0 2020-10-31T22:50:41.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef2ffff700 1 --2- 172.21.15.60:0/3315262079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef300ae8b0 0x7fef300b5060 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fef20001870 tx=0x7fef280091a0).ready entity=mon.0 client_cookie=a93f016ca9f3a9a8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:41.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef2e7fc700 1 -- 172.21.15.60:0/3315262079 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef200016d0 con 0x7fef300ae8b0 2020-10-31T22:50:41.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef2e7fc700 1 -- 172.21.15.60:0/3315262079 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2800b8f0 con 0x7fef300ae8b0 2020-10-31T22:50:41.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef2e7fc700 1 -- 172.21.15.60:0/3315262079 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef2800ba60 con 0x7fef300ae8b0 2020-10-31T22:50:41.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef34cbe700 1 -- 172.21.15.60:0/3315262079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef300ae8b0 msgr2=0x7fef300b5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef34cbe700 1 --2- 172.21.15.60:0/3315262079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef300ae8b0 0x7fef300b5060 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 rx=0x7fef20001870 tx=0x7fef280091a0).stop 2020-10-31T22:50:41.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef34cbe700 1 -- 172.21.15.60:0/3315262079 shutdown_connections 2020-10-31T22:50:41.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef34cbe700 1 --2- 172.21.15.60:0/3315262079 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef300ae8b0 0x7fef300b5060 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef34cbe700 1 -- 172.21.15.60:0/3315262079 >> 172.21.15.60:0/3315262079 conn(0x7fef3006a600 msgr2=0x7fef30060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:41.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef34cbe700 1 -- 172.21.15.60:0/3315262079 shutdown_connections 2020-10-31T22:50:41.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.617+0000 7fef34cbe700 1 -- 172.21.15.60:0/3315262079 wait complete. 2020-10-31T22:50:41.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef34cbe700 1 Processor -- start 2020-10-31T22:50:41.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef34cbe700 1 -- start start 2020-10-31T22:50:41.634 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef34cbe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef300ac870 0x7fef30065a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef34cbe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef300ae8b0 0x7fef300abb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef34cbe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef300b0e20 0x7fef30143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef34cbe700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef30066fc0 con 0x7fef300ae8b0 2020-10-31T22:50:41.635 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef34cbe700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef30067260 con 0x7fef300b0e20 2020-10-31T22:50:41.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef34cbe700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef30067500 con 0x7fef300ac870 2020-10-31T22:50:41.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef2effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef300ae8b0 0x7fef300abb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef2effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef300ae8b0 0x7fef300abb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49396/0 (socket says 172.21.15.60:49396) 2020-10-31T22:50:41.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef2effd700 1 -- 172.21.15.60:0/2355692363 learned_addr learned my addr 172.21.15.60:0/2355692363 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:41.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef2f7fe700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef300ac870 0x7fef30065a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef2ffff700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef300b0e20 0x7fef30143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef2effd700 1 -- 172.21.15.60:0/2355692363 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef300ac870 msgr2=0x7fef30065a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef2effd700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef300ac870 0x7fef30065a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef2effd700 1 -- 172.21.15.60:0/2355692363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef300b0e20 msgr2=0x7fef30143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef2effd700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef300b0e20 0x7fef30143f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef2effd700 1 -- 172.21.15.60:0/2355692363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef300657c0 con 0x7fef300ae8b0 2020-10-31T22:50:41.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef2f7fe700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef300ac870 0x7fef30065a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:41.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.621+0000 7fef2effd700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef300ae8b0 0x7fef300abb90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7fef20001930 tx=0x7fef20001ae0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:41.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.625+0000 7fef2cff9700 1 -- 172.21.15.60:0/2355692363 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef20007170 con 0x7fef300ae8b0 2020-10-31T22:50:41.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.625+0000 7fef2cff9700 1 -- 172.21.15.60:0/2355692363 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef200072d0 con 0x7fef300ae8b0 2020-10-31T22:50:41.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.625+0000 7fef34cbe700 1 -- 172.21.15.60:0/2355692363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef30066a00 con 0x7fef300ae8b0 2020-10-31T22:50:41.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.625+0000 7fef2cff9700 1 -- 172.21.15.60:0/2355692363 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fef2000a9e0 con 0x7fef300ae8b0 2020-10-31T22:50:41.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.625+0000 7fef34cbe700 1 -- 172.21.15.60:0/2355692363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef301445d0 con 0x7fef300ae8b0 2020-10-31T22:50:41.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.625+0000 7fef2cff9700 1 -- 172.21.15.60:0/2355692363 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fef2001b060 con 0x7fef300ae8b0 2020-10-31T22:50:41.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.625+0000 7fef34cbe700 1 -- 172.21.15.60:0/2355692363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef300676c0 con 0x7fef300ae8b0 2020-10-31T22:50:41.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.625+0000 7fef2cff9700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fef10054f90 0x7fef10057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.625+0000 7fef2f7fe700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fef10054f90 0x7fef10057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.625+0000 7fef2cff9700 1 -- 172.21.15.60:0/2355692363 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fef2006d360 con 0x7fef300ae8b0 2020-10-31T22:50:41.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.625+0000 7fef2f7fe700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fef10054f90 0x7fef10057450 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fef2400b000 tx=0x7fef24009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:41.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.633+0000 7fef2cff9700 1 -- 172.21.15.60:0/2355692363 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fef20043bb0 con 0x7fef300ae8b0 2020-10-31T22:50:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.773+0000 7fef34cbe700 1 -- 172.21.15.60:0/2355692363 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef30057100 con 0x7fef300ae8b0 2020-10-31T22:50:41.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.773+0000 7fef2cff9700 1 -- 172.21.15.60:0/2355692363 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+13191 (secure 0 0 0) 0x7fef20019070 con 0x7fef300ae8b0 2020-10-31T22:50:41.778 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:41.778 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":145,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:50:41.124814+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":26,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":130,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":137,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:50:41.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.773+0000 7fef34cbe700 1 -- 172.21.15.60:0/2355692363 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fef10054f90 msgr2=0x7fef10057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.773+0000 7fef34cbe700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fef10054f90 0x7fef10057450 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7fef2400b000 tx=0x7fef24009040).stop 2020-10-31T22:50:41.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.773+0000 7fef34cbe700 1 -- 172.21.15.60:0/2355692363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef300ae8b0 msgr2=0x7fef300abb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.773+0000 7fef34cbe700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef300ae8b0 0x7fef300abb90 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 rx=0x7fef20001930 tx=0x7fef20001ae0).stop 2020-10-31T22:50:41.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.773+0000 7fef34cbe700 1 -- 172.21.15.60:0/2355692363 shutdown_connections 2020-10-31T22:50:41.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.773+0000 7fef34cbe700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fef10054f90 0x7fef10057450 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.773+0000 7fef34cbe700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef300b0e20 0x7fef30143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.773+0000 7fef34cbe700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef300ac870 0x7fef30065a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.773+0000 7fef34cbe700 1 --2- 172.21.15.60:0/2355692363 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fef300ae8b0 0x7fef300abb90 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.773+0000 7fef34cbe700 1 -- 172.21.15.60:0/2355692363 >> 172.21.15.60:0/2355692363 conn(0x7fef3006a600 msgr2=0x7fef30060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:41.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.773+0000 7fef34cbe700 1 -- 172.21.15.60:0/2355692363 shutdown_connections 2020-10-31T22:50:41.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.773+0000 7fef34cbe700 1 -- 172.21.15.60:0/2355692363 wait complete. 2020-10-31T22:50:41.792 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-31T22:50:41.793 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:50:41.914 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.909+0000 7f200d172700 1 Processor -- start 2020-10-31T22:50:41.915 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.909+0000 7f200d172700 1 -- start start 2020-10-31T22:50:41.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.909+0000 7f200d172700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f20080aeaf0 0x7f2008143720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.909+0000 7f200d172700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20080a6e80 con 0x7f20080af380 2020-10-31T22:50:41.916 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.909+0000 7f200d172700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20080af760 con 0x7f200814a3d0 2020-10-31T22:50:41.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.909+0000 7f200d172700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20080a66a0 con 0x7f20080aeaf0 2020-10-31T22:50:41.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.909+0000 7f200759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f20080aeaf0 0x7f2008143720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.909+0000 7f2006d9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f20080af380 0x7f2008149cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53538/0 (socket says 172.21.15.60:53538) 2020-10-31T22:50:41.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.909+0000 7f2006d9d700 1 -- 172.21.15.60:0/3483864052 learned_addr learned my addr 172.21.15.60:0/3483864052 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:41.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.909+0000 7f2005d9b700 1 -- 172.21.15.60:0/3483864052 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129081470 0 0) 0x7f20080a6e80 con 0x7f20080af380 2020-10-31T22:50:41.917 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.909+0000 7f2005d9b700 1 -- 172.21.15.60:0/3483864052 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fe8003230 con 0x7f20080af380 2020-10-31T22:50:41.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.909+0000 7f2005d9b700 1 -- 172.21.15.60:0/3483864052 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034012376 0 0) 0x7f20080af760 con 0x7f200814a3d0 2020-10-31T22:50:41.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.909+0000 7f2005d9b700 1 -- 172.21.15.60:0/3483864052 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20080a6e80 con 0x7f200814a3d0 2020-10-31T22:50:41.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f2005d9b700 1 -- 172.21.15.60:0/3483864052 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1198893238 0 0) 0x7f1fe8003230 con 0x7f20080af380 2020-10-31T22:50:41.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200759e700 1 -- 172.21.15.60:0/3483864052 >> v1:172.21.15.66:6789/0 conn(0x7f200814a3d0 legacy=0x7f2008143010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200759e700 1 -- 172.21.15.60:0/3483864052 >> v1:172.21.15.60:6789/0 conn(0x7f20080af380 legacy=0x7f2008149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.918 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200759e700 1 -- 172.21.15.60:0/3483864052 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20080a6940 con 0x7f20080aeaf0 2020-10-31T22:50:41.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200759e700 1 --2- 172.21.15.60:0/3483864052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20080aeaf0 0x7f2008143720 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f1ff00010d0 tx=0x7f1ff8006dc0).ready entity=mon.0 client_cookie=a878d754892135ed server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:41.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f2005d9b700 1 -- 172.21.15.60:0/3483864052 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ff00016d0 con 0x7f20080aeaf0 2020-10-31T22:50:41.920 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f2005d9b700 1 -- 172.21.15.60:0/3483864052 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff800d610 con 0x7f20080aeaf0 2020-10-31T22:50:41.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f2005d9b700 1 -- 172.21.15.60:0/3483864052 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ff800d780 con 0x7f20080aeaf0 2020-10-31T22:50:41.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 -- 172.21.15.60:0/3483864052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20080aeaf0 msgr2=0x7f2008143720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 --2- 172.21.15.60:0/3483864052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20080aeaf0 0x7f2008143720 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 rx=0x7f1ff00010d0 tx=0x7f1ff8006dc0).stop 2020-10-31T22:50:41.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 -- 172.21.15.60:0/3483864052 shutdown_connections 2020-10-31T22:50:41.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 --2- 172.21.15.60:0/3483864052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20080aeaf0 0x7f2008143720 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.921 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 -- 172.21.15.60:0/3483864052 >> 172.21.15.60:0/3483864052 conn(0x7f200806a260 msgr2=0x7f2008061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:41.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 -- 172.21.15.60:0/3483864052 shutdown_connections 2020-10-31T22:50:41.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 -- 172.21.15.60:0/3483864052 wait complete. 2020-10-31T22:50:41.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 Processor -- start 2020-10-31T22:50:41.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 -- start start 2020-10-31T22:50:41.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20080aeaf0 0x7f20080adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.922 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20080af380 0x7f2008062a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f200814a3d0 0x7f2008155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2008063960 con 0x7f200814a3d0 2020-10-31T22:50:41.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20080ae5a0 con 0x7f20080aeaf0 2020-10-31T22:50:41.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200d172700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20080ae300 con 0x7f20080af380 2020-10-31T22:50:41.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f200814a3d0 0x7f2008155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f2006d9d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20080aeaf0 0x7f20080adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.923 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f200814a3d0 0x7f2008155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49412/0 (socket says 172.21.15.60:49412) 2020-10-31T22:50:41.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200759e700 1 -- 172.21.15.60:0/3018221349 learned_addr learned my addr 172.21.15.60:0/3018221349 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:41.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.913+0000 7f200659c700 1 --2- 172.21.15.60:0/3018221349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20080af380 0x7f2008062a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f200759e700 1 -- 172.21.15.60:0/3018221349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20080af380 msgr2=0x7f2008062a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f200759e700 1 --2- 172.21.15.60:0/3018221349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20080af380 0x7f2008062a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f200759e700 1 -- 172.21.15.60:0/3018221349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20080aeaf0 msgr2=0x7f20080adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:41.924 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f200759e700 1 --2- 172.21.15.60:0/3018221349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20080aeaf0 0x7f20080adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:41.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f200759e700 1 -- 172.21.15.60:0/3018221349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2008064280 con 0x7f200814a3d0 2020-10-31T22:50:41.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f200759e700 1 --2- 172.21.15.60:0/3018221349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f200814a3d0 0x7f2008155240 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f1ff00010d0 tx=0x7f1ff8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:41.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f1ffffff700 1 -- 172.21.15.60:0/3018221349 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ff800de10 con 0x7f200814a3d0 2020-10-31T22:50:41.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f1ffffff700 1 -- 172.21.15.60:0/3018221349 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff8011b00 con 0x7f200814a3d0 2020-10-31T22:50:41.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f200d172700 1 -- 172.21.15.60:0/3018221349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2008064520 con 0x7f200814a3d0 2020-10-31T22:50:41.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f1ffffff700 1 -- 172.21.15.60:0/3018221349 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ff8011e60 con 0x7f200814a3d0 2020-10-31T22:50:41.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f200d172700 1 -- 172.21.15.60:0/3018221349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2008146420 con 0x7f200814a3d0 2020-10-31T22:50:41.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f200d172700 1 -- 172.21.15.60:0/3018221349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20080646b0 con 0x7f200814a3d0 2020-10-31T22:50:41.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f1ffffff700 1 -- 172.21.15.60:0/3018221349 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1ff8025030 con 0x7f200814a3d0 2020-10-31T22:50:41.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f1ffffff700 1 --2- 172.21.15.60:0/3018221349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fec054f10 0x7f1fec0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:41.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.917+0000 7f1ffffff700 1 -- 172.21.15.60:0/3018221349 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f1ff806e9b0 con 0x7f200814a3d0 2020-10-31T22:50:41.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.921+0000 7f2006d9d700 1 --2- 172.21.15.60:0/3018221349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fec054f10 0x7f1fec0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:41.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.921+0000 7f2006d9d700 1 --2- 172.21.15.60:0/3018221349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fec054f10 0x7f1fec0573d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f1ff000d000 tx=0x7f1ff0001e50).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:41.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:41.925+0000 7f1ffffff700 1 -- 172.21.15.60:0/3018221349 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1ff8045090 con 0x7f200814a3d0 2020-10-31T22:50:42.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.073+0000 7f200d172700 1 -- 172.21.15.60:0/3018221349 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f2008057100 con 0x7f200814a3d0 2020-10-31T22:50:42.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.073+0000 7f1ffffff700 1 -- 172.21.15.60:0/3018221349 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v145) v1 ==== 110+0+10 (secure 0 0 0) 0x7f1ff8023070 con 0x7f200814a3d0 2020-10-31T22:50:42.080 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:50:42.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.077+0000 7f200d172700 1 -- 172.21.15.60:0/3018221349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fec054f10 msgr2=0x7f1fec0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.077+0000 7f200d172700 1 --2- 172.21.15.60:0/3018221349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fec054f10 0x7f1fec0573d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f1ff000d000 tx=0x7f1ff0001e50).stop 2020-10-31T22:50:42.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.077+0000 7f200d172700 1 -- 172.21.15.60:0/3018221349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f200814a3d0 msgr2=0x7f2008155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.077+0000 7f200d172700 1 --2- 172.21.15.60:0/3018221349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f200814a3d0 0x7f2008155240 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 rx=0x7f1ff00010d0 tx=0x7f1ff8015000).stop 2020-10-31T22:50:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.077+0000 7f200d172700 1 -- 172.21.15.60:0/3018221349 shutdown_connections 2020-10-31T22:50:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.077+0000 7f200d172700 1 --2- 172.21.15.60:0/3018221349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f200814a3d0 0x7f2008155240 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.077+0000 7f200d172700 1 --2- 172.21.15.60:0/3018221349 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1fec054f10 0x7f1fec0573d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.077+0000 7f200d172700 1 --2- 172.21.15.60:0/3018221349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f20080aeaf0 0x7f20080adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.077+0000 7f200d172700 1 --2- 172.21.15.60:0/3018221349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f20080af380 0x7f2008062a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.077+0000 7f200d172700 1 -- 172.21.15.60:0/3018221349 >> 172.21.15.60:0/3018221349 conn(0x7f200806a260 msgr2=0x7f20080b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:42.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.077+0000 7f200d172700 1 -- 172.21.15.60:0/3018221349 shutdown_connections 2020-10-31T22:50:42.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.077+0000 7f200d172700 1 -- 172.21.15.60:0/3018221349 wait complete. 2020-10-31T22:50:42.094 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:50:42.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.205+0000 7f677759e700 1 Processor -- start 2020-10-31T22:50:42.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.205+0000 7f677759e700 1 -- start start 2020-10-31T22:50:42.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.205+0000 7f677759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f67780b5570 0x7f67780b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.205+0000 7f677759e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67780b24a0 0x7f6778145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.205+0000 7f677759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6778145e40 0x7f6778141f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.205+0000 7f677759e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f677813f930 con 0x7f67780b24a0 2020-10-31T22:50:42.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.205+0000 7f677759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67780b4440 con 0x7f67780b5570 2020-10-31T22:50:42.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.205+0000 7f677759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67780b02f0 con 0x7f6778145e40 2020-10-31T22:50:42.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.205+0000 7f6775d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67780b24a0 0x7f6778145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.205+0000 7f6775d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f67780b24a0 0x7f6778145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49420/0 (socket says 172.21.15.60:49420) 2020-10-31T22:50:42.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.205+0000 7f6775d9b700 1 -- 172.21.15.60:0/2735189086 learned_addr learned my addr 172.21.15.60:0/2735189086 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:42.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.205+0000 7f677659c700 1 --2- 172.21.15.60:0/2735189086 >> v2:172.21.15.66:3300/0 conn(0x7f67780b5570 0x7f67780b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.205+0000 7f6776d9d700 1 --2- 172.21.15.60:0/2735189086 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6778145e40 0x7f6778141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f6775d9b700 1 -- 172.21.15.60:0/2735189086 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6778145e40 msgr2=0x7f6778141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:42.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f6775d9b700 1 --2- 172.21.15.60:0/2735189086 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6778145e40 0x7f6778141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f6775d9b700 1 -- 172.21.15.60:0/2735189086 >> v2:172.21.15.66:3300/0 conn(0x7f67780b5570 msgr2=0x7f67780b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f6775d9b700 1 --2- 172.21.15.60:0/2735189086 >> v2:172.21.15.66:3300/0 conn(0x7f67780b5570 0x7f67780b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f6775d9b700 1 -- 172.21.15.60:0/2735189086 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67780b0590 con 0x7f67780b24a0 2020-10-31T22:50:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f6775d9b700 1 --2- 172.21.15.60:0/2735189086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67780b24a0 0x7f6778145950 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f6760002f30 tx=0x7f6760006e80).ready entity=mon.0 client_cookie=b3066dc68a0b13b4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f677559a700 1 -- 172.21.15.60:0/2735189086 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6760009640 con 0x7f67780b24a0 2020-10-31T22:50:42.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f677559a700 1 -- 172.21.15.60:0/2735189086 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67600097a0 con 0x7f67780b24a0 2020-10-31T22:50:42.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f677559a700 1 -- 172.21.15.60:0/2735189086 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6760009b00 con 0x7f67780b24a0 2020-10-31T22:50:42.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f677759e700 1 -- 172.21.15.60:0/2735189086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67780b24a0 msgr2=0x7f6778145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f677759e700 1 --2- 172.21.15.60:0/2735189086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67780b24a0 0x7f6778145950 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 rx=0x7f6760002f30 tx=0x7f6760006e80).stop 2020-10-31T22:50:42.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f677759e700 1 -- 172.21.15.60:0/2735189086 shutdown_connections 2020-10-31T22:50:42.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f677759e700 1 --2- 172.21.15.60:0/2735189086 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6778145e40 0x7f6778141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f677759e700 1 --2- 172.21.15.60:0/2735189086 >> v2:172.21.15.66:3300/0 conn(0x7f67780b5570 0x7f67780b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f677759e700 1 --2- 172.21.15.60:0/2735189086 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67780b24a0 0x7f6778145950 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f677759e700 1 -- 172.21.15.60:0/2735189086 >> 172.21.15.60:0/2735189086 conn(0x7f67780b8e90 msgr2=0x7f67780b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:42.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f677759e700 1 -- 172.21.15.60:0/2735189086 shutdown_connections 2020-10-31T22:50:42.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.209+0000 7f677759e700 1 -- 172.21.15.60:0/2735189086 wait complete. 2020-10-31T22:50:42.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677759e700 1 Processor -- start 2020-10-31T22:50:42.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677759e700 1 -- start start 2020-10-31T22:50:42.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677759e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67780b24a0 0x7f67781432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677759e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67780b5570 0x7f6778150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778145e40 0x7f67780aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677759e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67780ad3a0 con 0x7f67780b24a0 2020-10-31T22:50:42.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6778144d30 con 0x7f6778145e40 2020-10-31T22:50:42.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677759e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67780ad100 con 0x7f67780b5570 2020-10-31T22:50:42.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67780b24a0 0x7f67781432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677659c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67780b24a0 0x7f67781432f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49422/0 (socket says 172.21.15.60:49422) 2020-10-31T22:50:42.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677659c700 1 -- 172.21.15.60:0/2844454793 learned_addr learned my addr 172.21.15.60:0/2844454793 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:42.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f6775d9b700 1 --2- 172.21.15.60:0/2844454793 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67780b5570 0x7f6778150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f6776d9d700 1 --2- 172.21.15.60:0/2844454793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778145e40 0x7f67780aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677659c700 1 -- 172.21.15.60:0/2844454793 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67780b5570 msgr2=0x7f6778150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677659c700 1 --2- 172.21.15.60:0/2844454793 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67780b5570 0x7f6778150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677659c700 1 -- 172.21.15.60:0/2844454793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778145e40 msgr2=0x7f67780aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677659c700 1 --2- 172.21.15.60:0/2844454793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778145e40 0x7f67780aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677659c700 1 -- 172.21.15.60:0/2844454793 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6778067860 con 0x7f67780b24a0 2020-10-31T22:50:42.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677659c700 1 --2- 172.21.15.60:0/2844454793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67780b24a0 0x7f67781432f0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f676800c000 tx=0x7f6768006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:42.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f676f7fe700 1 -- 172.21.15.60:0/2844454793 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f676800ca10 con 0x7f67780b24a0 2020-10-31T22:50:42.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f676f7fe700 1 -- 172.21.15.60:0/2844454793 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f676800cb70 con 0x7f67780b24a0 2020-10-31T22:50:42.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f677759e700 1 -- 172.21.15.60:0/2844454793 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67780b7980 con 0x7f67780b24a0 2020-10-31T22:50:42.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.213+0000 7f676f7fe700 1 -- 172.21.15.60:0/2844454793 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f67680123f0 con 0x7f67780b24a0 2020-10-31T22:50:42.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.217+0000 7f677759e700 1 -- 172.21.15.60:0/2844454793 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67780b7da0 con 0x7f67780b24a0 2020-10-31T22:50:42.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.217+0000 7f677759e700 1 -- 172.21.15.60:0/2844454793 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6778144ec0 con 0x7f67780b24a0 2020-10-31T22:50:42.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.217+0000 7f676f7fe700 1 -- 172.21.15.60:0/2844454793 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6768012550 con 0x7f67780b24a0 2020-10-31T22:50:42.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.217+0000 7f676f7fe700 1 --2- 172.21.15.60:0/2844454793 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f675c054f90 0x7f675c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.217+0000 7f676f7fe700 1 -- 172.21.15.60:0/2844454793 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f676806d9d0 con 0x7f67780b24a0 2020-10-31T22:50:42.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.217+0000 7f6775d9b700 1 --2- 172.21.15.60:0/2844454793 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f675c054f90 0x7f675c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.217+0000 7f6775d9b700 1 --2- 172.21.15.60:0/2844454793 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f675c054f90 0x7f675c057450 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f676001b000 tx=0x7f6760015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:42.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.225+0000 7f676f7fe700 1 -- 172.21.15.60:0/2844454793 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f67680441c0 con 0x7f67780b24a0 2020-10-31T22:50:42.376 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.369+0000 7f677759e700 1 -- 172.21.15.60:0/2844454793 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6778057100 con 0x7f67780b24a0 2020-10-31T22:50:42.377 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.369+0000 7f676f7fe700 1 -- 172.21.15.60:0/2844454793 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v145) v1 ==== 92+0+10 (secure 0 0 0) 0x7f67680477e0 con 0x7f67780b24a0 2020-10-31T22:50:42.377 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:42.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.373+0000 7f677759e700 1 -- 172.21.15.60:0/2844454793 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f675c054f90 msgr2=0x7f675c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.373+0000 7f677759e700 1 --2- 172.21.15.60:0/2844454793 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f675c054f90 0x7f675c057450 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7f676001b000 tx=0x7f6760015000).stop 2020-10-31T22:50:42.379 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.373+0000 7f677759e700 1 -- 172.21.15.60:0/2844454793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67780b24a0 msgr2=0x7f67781432f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.373+0000 7f677759e700 1 --2- 172.21.15.60:0/2844454793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67780b24a0 0x7f67781432f0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 rx=0x7f676800c000 tx=0x7f6768006dc0).stop 2020-10-31T22:50:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.373+0000 7f677759e700 1 -- 172.21.15.60:0/2844454793 shutdown_connections 2020-10-31T22:50:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.373+0000 7f677759e700 1 --2- 172.21.15.60:0/2844454793 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f675c054f90 0x7f675c057450 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.373+0000 7f677759e700 1 --2- 172.21.15.60:0/2844454793 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6778145e40 0x7f67780aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.373+0000 7f677759e700 1 --2- 172.21.15.60:0/2844454793 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67780b24a0 0x7f67781432f0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.373+0000 7f677759e700 1 --2- 172.21.15.60:0/2844454793 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67780b5570 0x7f6778150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.373+0000 7f677759e700 1 -- 172.21.15.60:0/2844454793 >> 172.21.15.60:0/2844454793 conn(0x7f67780b8e90 msgr2=0x7f67780b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.373+0000 7f677759e700 1 -- 172.21.15.60:0/2844454793 shutdown_connections 2020-10-31T22:50:42.381 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.373+0000 7f677759e700 1 -- 172.21.15.60:0/2844454793 wait complete. 2020-10-31T22:50:42.388 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-10-31T22:50:42.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f9cdaf700 1 Processor -- start 2020-10-31T22:50:42.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f9cdaf700 1 -- start start 2020-10-31T22:50:42.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f9cdaf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f980b2cc0 0x7f6f9805f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f9cdaf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f98141d50 0x7f6f980659e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f9cdaf700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f980b31d0 con 0x7f6f9805f3c0 2020-10-31T22:50:42.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f9cdaf700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f980b3e50 con 0x7f6f980b2cc0 2020-10-31T22:50:42.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f9cdaf700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f980b3470 con 0x7f6f98141d50 2020-10-31T22:50:42.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f96ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f980b2cc0 0x7f6f9805f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f96ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6f980b2cc0 0x7f6f9805f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49430/0 (socket says 172.21.15.60:49430) 2020-10-31T22:50:42.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f96ffd700 1 -- 172.21.15.60:0/652835221 learned_addr learned my addr 172.21.15.60:0/652835221 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:42.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f977fe700 1 --1- 172.21.15.60:0/652835221 >> v1:172.21.15.60:6789/0 conn(0x7f6f9805f3c0 0x7f6f9813f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53568/0 (socket says 172.21.15.60:53568) 2020-10-31T22:50:42.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f97fff700 1 --2- 172.21.15.60:0/652835221 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f98141d50 0x7f6f980659e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f96ffd700 1 -- 172.21.15.60:0/652835221 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f98141d50 msgr2=0x7f6f980659e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:42.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f96ffd700 1 --2- 172.21.15.60:0/652835221 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f98141d50 0x7f6f980659e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.509 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f96ffd700 1 -- 172.21.15.60:0/652835221 >> v1:172.21.15.60:6789/0 conn(0x7f6f9805f3c0 legacy=0x7f6f9813f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f96ffd700 1 -- 172.21.15.60:0/652835221 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f980b3710 con 0x7f6f980b2cc0 2020-10-31T22:50:42.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f97fff700 1 --2- 172.21.15.60:0/652835221 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f98141d50 0x7f6f980659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:50:42.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f96ffd700 1 --2- 172.21.15.60:0/652835221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f980b2cc0 0x7f6f9805f7a0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f6f800032b0 tx=0x7f6f80009270).ready entity=mon.0 client_cookie=dd7c026a7b18a5f6 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:42.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f967fc700 1 -- 172.21.15.60:0/652835221 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f8000bc00 con 0x7f6f980b2cc0 2020-10-31T22:50:42.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f967fc700 1 -- 172.21.15.60:0/652835221 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8000bd60 con 0x7f6f980b2cc0 2020-10-31T22:50:42.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/652835221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f980b2cc0 msgr2=0x7f6f9805f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.510 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f9cdaf700 1 --2- 172.21.15.60:0/652835221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f980b2cc0 0x7f6f9805f7a0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 rx=0x7f6f800032b0 tx=0x7f6f80009270).stop 2020-10-31T22:50:42.511 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.501+0000 7f6f967fc700 1 -- 172.21.15.60:0/652835221 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f80011400 con 0x7f6f980b2cc0 2020-10-31T22:50:42.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/652835221 shutdown_connections 2020-10-31T22:50:42.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 --2- 172.21.15.60:0/652835221 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f98141d50 0x7f6f980659e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 --2- 172.21.15.60:0/652835221 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f980b2cc0 0x7f6f9805f7a0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.513 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/652835221 >> 172.21.15.60:0/652835221 conn(0x7f6f980b83f0 msgr2=0x7f6f980b8800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/652835221 shutdown_connections 2020-10-31T22:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/652835221 wait complete. 2020-10-31T22:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 Processor -- start 2020-10-31T22:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 -- start start 2020-10-31T22:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f9805f3c0 0x7f6f980b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f980b2cc0 0x7f6f98150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.514 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f98141d50 0x7f6f981514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f980a9c30 con 0x7f6f98141d50 2020-10-31T22:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f98150b80 con 0x7f6f980b2cc0 2020-10-31T22:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f98144d10 con 0x7f6f9805f3c0 2020-10-31T22:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f97fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f98141d50 0x7f6f981514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f97fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f98141d50 0x7f6f981514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49440/0 (socket says 172.21.15.60:49440) 2020-10-31T22:50:42.515 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f97fff700 1 -- 172.21.15.60:0/4183120981 learned_addr learned my addr 172.21.15.60:0/4183120981 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:42.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f96ffd700 1 --2- 172.21.15.60:0/4183120981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f980b2cc0 0x7f6f98150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f977fe700 1 --2- 172.21.15.60:0/4183120981 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f9805f3c0 0x7f6f980b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f97fff700 1 -- 172.21.15.60:0/4183120981 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f9805f3c0 msgr2=0x7f6f980b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f97fff700 1 --2- 172.21.15.60:0/4183120981 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f9805f3c0 0x7f6f980b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f97fff700 1 -- 172.21.15.60:0/4183120981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f980b2cc0 msgr2=0x7f6f98150fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f97fff700 1 --2- 172.21.15.60:0/4183120981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f980b2cc0 0x7f6f98150fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.516 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f97fff700 1 -- 172.21.15.60:0/4183120981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f980ab830 con 0x7f6f98141d50 2020-10-31T22:50:42.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f97fff700 1 --2- 172.21.15.60:0/4183120981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f98141d50 0x7f6f981514a0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f6f90007000 tx=0x7f6f90008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:42.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f94ff9700 1 -- 172.21.15.60:0/4183120981 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f9000e510 con 0x7f6f98141d50 2020-10-31T22:50:42.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f94ff9700 1 -- 172.21.15.60:0/4183120981 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f9000e670 con 0x7f6f98141d50 2020-10-31T22:50:42.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/4183120981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f980af240 con 0x7f6f98141d50 2020-10-31T22:50:42.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f94ff9700 1 -- 172.21.15.60:0/4183120981 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6f9000e9d0 con 0x7f6f98141d50 2020-10-31T22:50:42.517 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.505+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/4183120981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f980ab2b0 con 0x7f6f98141d50 2020-10-31T22:50:42.518 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.509+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/4183120981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f98150cf0 con 0x7f6f98141d50 2020-10-31T22:50:42.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.509+0000 7f6f94ff9700 1 -- 172.21.15.60:0/4183120981 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6f90019030 con 0x7f6f98141d50 2020-10-31T22:50:42.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.509+0000 7f6f94ff9700 1 --2- 172.21.15.60:0/4183120981 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f70055020 0x7f6f700574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.509+0000 7f6f94ff9700 1 -- 172.21.15.60:0/4183120981 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f6f9006d030 con 0x7f6f98141d50 2020-10-31T22:50:42.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.509+0000 7f6f977fe700 1 --2- 172.21.15.60:0/4183120981 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f70055020 0x7f6f700574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.519 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.509+0000 7f6f977fe700 1 --2- 172.21.15.60:0/4183120981 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f70055020 0x7f6f700574e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f6f8800d000 tx=0x7f6f88007a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:42.522 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.517+0000 7f6f94ff9700 1 -- 172.21.15.60:0/4183120981 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6f90043820 con 0x7f6f98141d50 2020-10-31T22:50:42.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.661+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/4183120981 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6f98057100 con 0x7f6f98141d50 2020-10-31T22:50:42.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.661+0000 7f6f94ff9700 1 -- 172.21.15.60:0/4183120981 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v145) v1 ==== 84+0+143 (secure 0 0 0) 0x7f6f90046e40 con 0x7f6f98141d50 2020-10-31T22:50:42.670 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:42.671 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2020-10-31T22:50:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:42.671 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2020-10-31T22:50:42.672 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "device_health_metrics" 2020-10-31T22:50:42.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:42.673 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:42.673 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2020-10-31T22:50:42.674 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2020-10-31T22:50:42.674 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:42.674 INFO:teuthology.orchestra.run.smithi060.stdout:] 2020-10-31T22:50:42.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.665+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/4183120981 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f70055020 msgr2=0x7f6f700574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.665+0000 7f6f9cdaf700 1 --2- 172.21.15.60:0/4183120981 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f70055020 0x7f6f700574e0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7f6f8800d000 tx=0x7f6f88007a80).stop 2020-10-31T22:50:42.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.665+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/4183120981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f98141d50 msgr2=0x7f6f981514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.665+0000 7f6f9cdaf700 1 --2- 172.21.15.60:0/4183120981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f98141d50 0x7f6f981514a0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 rx=0x7f6f90007000 tx=0x7f6f90008040).stop 2020-10-31T22:50:42.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.665+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/4183120981 shutdown_connections 2020-10-31T22:50:42.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.665+0000 7f6f9cdaf700 1 --2- 172.21.15.60:0/4183120981 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6f98141d50 0x7f6f981514a0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.665+0000 7f6f9cdaf700 1 --2- 172.21.15.60:0/4183120981 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f9805f3c0 0x7f6f980b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.665+0000 7f6f9cdaf700 1 --2- 172.21.15.60:0/4183120981 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6f70055020 0x7f6f700574e0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.665+0000 7f6f9cdaf700 1 --2- 172.21.15.60:0/4183120981 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f980b2cc0 0x7f6f98150fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.665+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/4183120981 >> 172.21.15.60:0/4183120981 conn(0x7f6f980b83f0 msgr2=0x7f6f980b7760 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.665+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/4183120981 shutdown_connections 2020-10-31T22:50:42.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.665+0000 7f6f9cdaf700 1 -- 172.21.15.60:0/4183120981 wait complete. 2020-10-31T22:50:42.682 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-10-31T22:50:42.683 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:50:42.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.801+0000 7f9f76a7c700 1 Processor -- start 2020-10-31T22:50:42.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.801+0000 7f9f76a7c700 1 -- start start 2020-10-31T22:50:42.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.801+0000 7f9f76a7c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f700acc60 0x7f9f700b24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.801+0000 7f9f76a7c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f7005b700 con 0x7f9f7005b320 2020-10-31T22:50:42.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.801+0000 7f9f76a7c700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f70140750 con 0x7f9f700ad610 2020-10-31T22:50:42.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.801+0000 7f9f76a7c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700b0340 con 0x7f9f700acc60 2020-10-31T22:50:42.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.801+0000 7f9f75a7a700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9f7005b320 0x7f9f700b1db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53580/0 (socket says 172.21.15.60:53580) 2020-10-31T22:50:42.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.801+0000 7f9f75a7a700 1 -- 172.21.15.60:0/2450375755 learned_addr learned my addr 172.21.15.60:0/2450375755 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:42.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.801+0000 7f9f75279700 1 --2- 172.21.15.60:0/2450375755 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f700acc60 0x7f9f700b24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.801+0000 7f9f74a78700 1 -- 172.21.15.60:0/2450375755 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892292147 0 0) 0x7f9f7005b700 con 0x7f9f7005b320 2020-10-31T22:50:42.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f74a78700 1 -- 172.21.15.60:0/2450375755 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f58003230 con 0x7f9f7005b320 2020-10-31T22:50:42.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f74a78700 1 -- 172.21.15.60:0/2450375755 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186066075 0 0) 0x7f9f70140750 con 0x7f9f700ad610 2020-10-31T22:50:42.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f74a78700 1 -- 172.21.15.60:0/2450375755 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f7005b700 con 0x7f9f700ad610 2020-10-31T22:50:42.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f74a78700 1 -- 172.21.15.60:0/2450375755 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2038960497 0 0) 0x7f9f58003230 con 0x7f9f7005b320 2020-10-31T22:50:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f75279700 1 -- 172.21.15.60:0/2450375755 >> v1:172.21.15.66:6789/0 conn(0x7f9f700ad610 legacy=0x7f9f700ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f75279700 1 -- 172.21.15.60:0/2450375755 >> v1:172.21.15.60:6789/0 conn(0x7f9f7005b320 legacy=0x7f9f700b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f75279700 1 -- 172.21.15.60:0/2450375755 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700b05e0 con 0x7f9f700acc60 2020-10-31T22:50:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f75279700 1 --2- 172.21.15.60:0/2450375755 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f700acc60 0x7f9f700b24c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f9f6c0010d0 tx=0x7f9f60006dc0).ready entity=mon.2 client_cookie=fcb45882d5707437 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f74a78700 1 -- 172.21.15.60:0/2450375755 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f6c0016d0 con 0x7f9f700acc60 2020-10-31T22:50:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f74a78700 1 -- 172.21.15.60:0/2450375755 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6000d5c0 con 0x7f9f700acc60 2020-10-31T22:50:42.812 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f74a78700 1 -- 172.21.15.60:0/2450375755 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f6000d730 con 0x7f9f700acc60 2020-10-31T22:50:42.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2450375755 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f700acc60 msgr2=0x7f9f700b24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.813 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f76a7c700 1 --2- 172.21.15.60:0/2450375755 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f700acc60 0x7f9f700b24c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f9f6c0010d0 tx=0x7f9f60006dc0).stop 2020-10-31T22:50:42.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2450375755 shutdown_connections 2020-10-31T22:50:42.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f76a7c700 1 --2- 172.21.15.60:0/2450375755 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f700acc60 0x7f9f700b24c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2450375755 >> 172.21.15.60:0/2450375755 conn(0x7f9f700b61d0 msgr2=0x7f9f700b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:42.814 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2450375755 shutdown_connections 2020-10-31T22:50:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2450375755 wait complete. 2020-10-31T22:50:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.805+0000 7f9f76a7c700 1 Processor -- start 2020-10-31T22:50:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f76a7c700 1 -- start start 2020-10-31T22:50:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f76a7c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f7005b320 0x7f9f70143280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f76a7c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f700acc60 0x7f9f70139410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.815 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f76a7c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f700ad610 0x7f9f70139900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f76a7c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700639f0 con 0x7f9f700ad610 2020-10-31T22:50:42.816 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f76a7c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f70063c20 con 0x7f9f700acc60 2020-10-31T22:50:42.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f76a7c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f70063ec0 con 0x7f9f7005b320 2020-10-31T22:50:42.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f7627b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f700ad610 0x7f9f70139900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f7627b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f700ad610 0x7f9f70139900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49454/0 (socket says 172.21.15.60:49454) 2020-10-31T22:50:42.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f75279700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f700acc60 0x7f9f70139410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f7627b700 1 -- 172.21.15.60:0/2827445820 learned_addr learned my addr 172.21.15.60:0/2827445820 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:42.817 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f75a7a700 1 --2- 172.21.15.60:0/2827445820 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f7005b320 0x7f9f70143280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f7627b700 1 -- 172.21.15.60:0/2827445820 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f7005b320 msgr2=0x7f9f70143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f7627b700 1 --2- 172.21.15.60:0/2827445820 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f7005b320 0x7f9f70143280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f7627b700 1 -- 172.21.15.60:0/2827445820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f700acc60 msgr2=0x7f9f70139410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:42.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f7627b700 1 --2- 172.21.15.60:0/2827445820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f700acc60 0x7f9f70139410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:42.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f7627b700 1 -- 172.21.15.60:0/2827445820 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f70064160 con 0x7f9f700ad610 2020-10-31T22:50:42.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f7627b700 1 --2- 172.21.15.60:0/2827445820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f700ad610 0x7f9f70139900 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f9f68001450 tx=0x7f9f68007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:42.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f5effd700 1 -- 172.21.15.60:0/2827445820 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f6800ce10 con 0x7f9f700ad610 2020-10-31T22:50:42.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f5effd700 1 -- 172.21.15.60:0/2827445820 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6800a7b0 con 0x7f9f700ad610 2020-10-31T22:50:42.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2827445820 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f70139df0 con 0x7f9f700ad610 2020-10-31T22:50:42.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f5effd700 1 -- 172.21.15.60:0/2827445820 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f6800a920 con 0x7f9f700ad610 2020-10-31T22:50:42.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.809+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2827445820 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f7013cdf0 con 0x7f9f700ad610 2020-10-31T22:50:42.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.813+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2827445820 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f7013d100 con 0x7f9f700ad610 2020-10-31T22:50:42.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.813+0000 7f9f5effd700 1 -- 172.21.15.60:0/2827445820 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9f68010070 con 0x7f9f700ad610 2020-10-31T22:50:42.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.813+0000 7f9f5effd700 1 --2- 172.21.15.60:0/2827445820 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9f50054f10 0x7f9f500573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:42.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.813+0000 7f9f5effd700 1 -- 172.21.15.60:0/2827445820 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f9f6806d280 con 0x7f9f700ad610 2020-10-31T22:50:42.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.813+0000 7f9f75a7a700 1 --2- 172.21.15.60:0/2827445820 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9f50054f10 0x7f9f500573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:42.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.813+0000 7f9f75a7a700 1 --2- 172.21.15.60:0/2827445820 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9f50054f10 0x7f9f500573d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f9f6c00d000 tx=0x7f9f6c000b80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:42.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.821+0000 7f9f5effd700 1 -- 172.21.15.60:0/2827445820 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9f68043ad0 con 0x7f9f700ad610 2020-10-31T22:50:42.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:42.965+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2827445820 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f9f70057100 con 0x7f9f700ad610 2020-10-31T22:50:43.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:43.973+0000 7f9f5effd700 1 -- 172.21.15.60:0/2827445820 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v146) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9f680470f0 con 0x7f9f700ad610 2020-10-31T22:50:43.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:43.977+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2827445820 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9f50054f10 msgr2=0x7f9f500573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:43.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:43.977+0000 7f9f76a7c700 1 --2- 172.21.15.60:0/2827445820 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9f50054f10 0x7f9f500573d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f9f6c00d000 tx=0x7f9f6c000b80).stop 2020-10-31T22:50:43.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:43.977+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2827445820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f700ad610 msgr2=0x7f9f70139900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:43.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:43.977+0000 7f9f76a7c700 1 --2- 172.21.15.60:0/2827445820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f700ad610 0x7f9f70139900 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 rx=0x7f9f68001450 tx=0x7f9f68007d30).stop 2020-10-31T22:50:43.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:43.977+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2827445820 shutdown_connections 2020-10-31T22:50:43.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:43.977+0000 7f9f76a7c700 1 --2- 172.21.15.60:0/2827445820 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f700ad610 0x7f9f70139900 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:43.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:43.977+0000 7f9f76a7c700 1 --2- 172.21.15.60:0/2827445820 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f7005b320 0x7f9f70143280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:43.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:43.977+0000 7f9f76a7c700 1 --2- 172.21.15.60:0/2827445820 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9f50054f10 0x7f9f500573d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:43.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:43.977+0000 7f9f76a7c700 1 --2- 172.21.15.60:0/2827445820 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f700acc60 0x7f9f70139410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:43.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:43.977+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2827445820 >> 172.21.15.60:0/2827445820 conn(0x7f9f700b61d0 msgr2=0x7f9f7013e250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:43.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:43.981+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2827445820 shutdown_connections 2020-10-31T22:50:43.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:43.981+0000 7f9f76a7c700 1 -- 172.21.15.60:0/2827445820 wait complete. 2020-10-31T22:50:43.988 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:50:43.999 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-10-31T22:50:44.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.109+0000 7f6c523a7700 1 Processor -- start 2020-10-31T22:50:44.115 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.109+0000 7f6c523a7700 1 -- start start 2020-10-31T22:50:44.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.109+0000 7f6c523a7700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6c4c0b5570 0x7f6c4c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.109+0000 7f6c523a7700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c4c0b24a0 0x7f6c4c145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c523a7700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c4c0b4440 con 0x7f6c4c145e40 2020-10-31T22:50:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c523a7700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c13f930 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c523a7700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c4c0b02f0 con 0x7f6c4c0b5570 2020-10-31T22:50:44.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c50ba4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c4c0b24a0 0x7f6c4c145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:44.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c50ba4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f6c4c0b24a0 0x7f6c4c145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49458/0 (socket says 172.21.15.60:49458) 2020-10-31T22:50:44.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c50ba4700 1 -- 172.21.15.60:0/2313666329 learned_addr learned my addr 172.21.15.60:0/2313666329 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:44.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c513a5700 1 --2- 172.21.15.60:0/2313666329 >> v2:172.21.15.66:3300/0 conn(0x7f6c4c0b5570 0x7f6c4c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:44.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c50ba4700 1 -- 172.21.15.60:0/2313666329 >> v2:172.21.15.66:3300/0 conn(0x7f6c4c0b5570 msgr2=0x7f6c4c0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:44.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c50ba4700 1 --2- 172.21.15.60:0/2313666329 >> v2:172.21.15.66:3300/0 conn(0x7f6c4c0b5570 0x7f6c4c0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:44.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c50ba4700 1 -- 172.21.15.60:0/2313666329 >> v1:172.21.15.66:6789/0 conn(0x7f6c4c145e40 legacy=0x7f6c4c141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:44.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c43fff700 1 -- 172.21.15.60:0/2313666329 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169819578 0 0) 0x7f6c4c0b4440 con 0x7f6c4c145e40 2020-10-31T22:50:44.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c50ba4700 1 -- 172.21.15.60:0/2313666329 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c0b0590 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c50ba4700 1 --2- 172.21.15.60:0/2313666329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4c0b24a0 0x7f6c4c145950 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f6c3c002f30 tx=0x7f6c3c006e80).ready entity=mon.0 client_cookie=53a262ee459200d4 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:44.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c43fff700 1 -- 172.21.15.60:0/2313666329 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c3c0097f0 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c43fff700 1 -- 172.21.15.60:0/2313666329 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3c009950 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c43fff700 1 -- 172.21.15.60:0/2313666329 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c3c009cb0 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c523a7700 1 -- 172.21.15.60:0/2313666329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4c0b24a0 msgr2=0x7f6c4c145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:44.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c523a7700 1 --2- 172.21.15.60:0/2313666329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4c0b24a0 0x7f6c4c145950 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 rx=0x7f6c3c002f30 tx=0x7f6c3c006e80).stop 2020-10-31T22:50:44.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c523a7700 1 -- 172.21.15.60:0/2313666329 shutdown_connections 2020-10-31T22:50:44.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c523a7700 1 --2- 172.21.15.60:0/2313666329 >> v2:172.21.15.66:3300/0 conn(0x7f6c4c0b5570 0x7f6c4c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:44.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c523a7700 1 --2- 172.21.15.60:0/2313666329 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4c0b24a0 0x7f6c4c145950 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:44.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c523a7700 1 -- 172.21.15.60:0/2313666329 >> 172.21.15.60:0/2313666329 conn(0x7f6c4c0b8e90 msgr2=0x7f6c4c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:44.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c523a7700 1 -- 172.21.15.60:0/2313666329 shutdown_connections 2020-10-31T22:50:44.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.113+0000 7f6c523a7700 1 -- 172.21.15.60:0/2313666329 wait complete. 2020-10-31T22:50:44.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c523a7700 1 Processor -- start 2020-10-31T22:50:44.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c523a7700 1 -- start start 2020-10-31T22:50:44.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c523a7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4c0b24a0 0x7f6c4c154c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:44.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c523a7700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c4c0b5570 0x7f6c4c0b7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:44.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c523a7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c4c145e40 0x7f6c4c150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:44.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c523a7700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c144e40 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c523a7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c154290 con 0x7f6c4c145e40 2020-10-31T22:50:44.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c523a7700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4c154530 con 0x7f6c4c0b5570 2020-10-31T22:50:44.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c513a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4c0b24a0 0x7f6c4c154c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:44.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c513a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4c0b24a0 0x7f6c4c154c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49464/0 (socket says 172.21.15.60:49464) 2020-10-31T22:50:44.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c513a5700 1 -- 172.21.15.60:0/3621962018 learned_addr learned my addr 172.21.15.60:0/3621962018 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:44.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c51ba6700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c4c145e40 0x7f6c4c150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:44.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c50ba4700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c4c0b5570 0x7f6c4c0b7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:44.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c513a5700 1 -- 172.21.15.60:0/3621962018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c4c0b5570 msgr2=0x7f6c4c0b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:44.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c513a5700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c4c0b5570 0x7f6c4c0b7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:44.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c513a5700 1 -- 172.21.15.60:0/3621962018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c4c145e40 msgr2=0x7f6c4c150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:44.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c513a5700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c4c145e40 0x7f6c4c150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:44.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c513a5700 1 -- 172.21.15.60:0/3621962018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c1547d0 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c51ba6700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c4c145e40 0x7f6c4c150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:44.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c513a5700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4c0b24a0 0x7f6c4c154c70 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f6c4800c000 tx=0x7f6c48006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:44.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c427fc700 1 -- 172.21.15.60:0/3621962018 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c4800ca10 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c427fc700 1 -- 172.21.15.60:0/3621962018 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4800cb70 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c523a7700 1 -- 172.21.15.60:0/3621962018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4c142ce0 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c427fc700 1 -- 172.21.15.60:0/3621962018 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6c480123f0 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.117+0000 7f6c523a7700 1 -- 172.21.15.60:0/3621962018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4c144ac0 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.121+0000 7f6c523a7700 1 -- 172.21.15.60:0/3621962018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4c057100 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.121+0000 7f6c427fc700 1 -- 172.21.15.60:0/3621962018 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6c48012550 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.121+0000 7f6c427fc700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6c34054f10 0x7f6c340573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:44.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.121+0000 7f6c427fc700 1 -- 172.21.15.60:0/3621962018 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f6c4806dba0 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.121+0000 7f6c50ba4700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6c34054f10 0x7f6c340573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:44.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.121+0000 7f6c50ba4700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6c34054f10 0x7f6c340573d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f6c3c01c000 tx=0x7f6c3c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:44.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.129+0000 7f6c427fc700 1 -- 172.21.15.60:0/3621962018 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6c48044230 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.269+0000 7f6c523a7700 1 -- 172.21.15.60:0/3621962018 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f6c4c154960 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.981+0000 7f6c427fc700 1 -- 172.21.15.60:0/3621962018 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v147) v1 ==== 125+0+0 (secure 0 0 0) 0x7f6c48047850 con 0x7f6c4c0b24a0 2020-10-31T22:50:44.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.985+0000 7f6c523a7700 1 -- 172.21.15.60:0/3621962018 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6c34054f10 msgr2=0x7f6c340573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:44.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.985+0000 7f6c523a7700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6c34054f10 0x7f6c340573d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f6c3c01c000 tx=0x7f6c3c015000).stop 2020-10-31T22:50:44.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.985+0000 7f6c523a7700 1 -- 172.21.15.60:0/3621962018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4c0b24a0 msgr2=0x7f6c4c154c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:44.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.985+0000 7f6c523a7700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4c0b24a0 0x7f6c4c154c70 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 rx=0x7f6c4800c000 tx=0x7f6c48006dc0).stop 2020-10-31T22:50:44.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.985+0000 7f6c523a7700 1 -- 172.21.15.60:0/3621962018 shutdown_connections 2020-10-31T22:50:44.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.985+0000 7f6c523a7700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6c34054f10 0x7f6c340573d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:44.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.985+0000 7f6c523a7700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c4c145e40 0x7f6c4c150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:44.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.985+0000 7f6c523a7700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c4c0b24a0 0x7f6c4c154c70 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:44.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.985+0000 7f6c523a7700 1 --2- 172.21.15.60:0/3621962018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c4c0b5570 0x7f6c4c0b7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:44.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.985+0000 7f6c523a7700 1 -- 172.21.15.60:0/3621962018 >> 172.21.15.60:0/3621962018 conn(0x7f6c4c0b8e90 msgr2=0x7f6c4c0b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:44.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.985+0000 7f6c523a7700 1 -- 172.21.15.60:0/3621962018 shutdown_connections 2020-10-31T22:50:44.996 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:44.985+0000 7f6c523a7700 1 -- 172.21.15.60:0/3621962018 wait complete. 2020-10-31T22:50:44.996 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2020-10-31T22:50:45.007 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-10-31T22:50:45.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.117+0000 7f92ef4b5700 1 Processor -- start 2020-10-31T22:50:45.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.117+0000 7f92ef4b5700 1 -- start start 2020-10-31T22:50:45.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.117+0000 7f92ef4b5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f92e805b180 0x7f92e805fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.117+0000 7f92ef4b5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92e80b0b70 0x7f92e813f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.117+0000 7f92ef4b5700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f92e8060220 0x7f92e813f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.117+0000 7f92ef4b5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e805f3c0 con 0x7f92e805b180 2020-10-31T22:50:45.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.117+0000 7f92ef4b5700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92e8145f70 con 0x7f92e8060220 2020-10-31T22:50:45.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.117+0000 7f92ef4b5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e805f5f0 con 0x7f92e80b0b70 2020-10-31T22:50:45.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.117+0000 7f92ee4b3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f92e805b180 0x7f92e805fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.117+0000 7f92ee4b3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f92e805b180 0x7f92e805fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49474/0 (socket says 172.21.15.60:49474) 2020-10-31T22:50:45.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.117+0000 7f92ee4b3700 1 -- 172.21.15.60:0/3985757215 learned_addr learned my addr 172.21.15.60:0/3985757215 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:45.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.117+0000 7f92edcb2700 1 --2- 172.21.15.60:0/3985757215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92e80b0b70 0x7f92e813f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.117+0000 7f92eecb4700 1 --2- 172.21.15.60:0/3985757215 >> v2:172.21.15.66:3300/0 conn(0x7f92e8060220 0x7f92e813f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ee4b3700 1 -- 172.21.15.60:0/3985757215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92e80b0b70 msgr2=0x7f92e813f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:45.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ee4b3700 1 --2- 172.21.15.60:0/3985757215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92e80b0b70 0x7f92e813f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ee4b3700 1 -- 172.21.15.60:0/3985757215 >> v2:172.21.15.66:3300/0 conn(0x7f92e8060220 msgr2=0x7f92e813f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:45.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ee4b3700 1 --2- 172.21.15.60:0/3985757215 >> v2:172.21.15.66:3300/0 conn(0x7f92e8060220 0x7f92e813f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ee4b3700 1 -- 172.21.15.60:0/3985757215 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e805f890 con 0x7f92e805b180 2020-10-31T22:50:45.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ee4b3700 1 --2- 172.21.15.60:0/3985757215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92e805b180 0x7f92e805fd30 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f92dc002f30 tx=0x7f92dc006e80).ready entity=mon.0 client_cookie=f2d636464fb58f1b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:45.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ed4b1700 1 -- 172.21.15.60:0/3985757215 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92dc009640 con 0x7f92e805b180 2020-10-31T22:50:45.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ed4b1700 1 -- 172.21.15.60:0/3985757215 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92dc0097a0 con 0x7f92e805b180 2020-10-31T22:50:45.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ed4b1700 1 -- 172.21.15.60:0/3985757215 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92dc009b00 con 0x7f92e805b180 2020-10-31T22:50:45.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3985757215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92e805b180 msgr2=0x7f92e805fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ef4b5700 1 --2- 172.21.15.60:0/3985757215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92e805b180 0x7f92e805fd30 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 rx=0x7f92dc002f30 tx=0x7f92dc006e80).stop 2020-10-31T22:50:45.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3985757215 shutdown_connections 2020-10-31T22:50:45.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ef4b5700 1 --2- 172.21.15.60:0/3985757215 >> v2:172.21.15.66:3300/0 conn(0x7f92e8060220 0x7f92e813f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ef4b5700 1 --2- 172.21.15.60:0/3985757215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92e805b180 0x7f92e805fd30 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ef4b5700 1 --2- 172.21.15.60:0/3985757215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92e80b0b70 0x7f92e813f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3985757215 >> 172.21.15.60:0/3985757215 conn(0x7f92e80b61d0 msgr2=0x7f92e80b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:45.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3985757215 shutdown_connections 2020-10-31T22:50:45.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.121+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3985757215 wait complete. 2020-10-31T22:50:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92ef4b5700 1 Processor -- start 2020-10-31T22:50:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92ef4b5700 1 -- start start 2020-10-31T22:50:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92ef4b5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92e805b180 0x7f92e81445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92ef4b5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92e8060220 0x7f92e8151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92ef4b5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92e80b0b70 0x7f92e813fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92ef4b5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e80aa2f0 con 0x7f92e80b0b70 2020-10-31T22:50:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92ef4b5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8150d40 con 0x7f92e8060220 2020-10-31T22:50:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92ef4b5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92e8150fe0 con 0x7f92e805b180 2020-10-31T22:50:45.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92eecb4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92e80b0b70 0x7f92e813fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92eecb4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92e80b0b70 0x7f92e813fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49484/0 (socket says 172.21.15.60:49484) 2020-10-31T22:50:45.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92eecb4700 1 -- 172.21.15.60:0/3310492437 learned_addr learned my addr 172.21.15.60:0/3310492437 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:45.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92ee4b3700 1 --2- 172.21.15.60:0/3310492437 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92e805b180 0x7f92e81445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92edcb2700 1 --2- 172.21.15.60:0/3310492437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92e8060220 0x7f92e8151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92eecb4700 1 -- 172.21.15.60:0/3310492437 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92e805b180 msgr2=0x7f92e81445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92eecb4700 1 --2- 172.21.15.60:0/3310492437 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92e805b180 0x7f92e81445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92eecb4700 1 -- 172.21.15.60:0/3310492437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92e8060220 msgr2=0x7f92e8151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92eecb4700 1 --2- 172.21.15.60:0/3310492437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92e8060220 0x7f92e8151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92eecb4700 1 -- 172.21.15.60:0/3310492437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e8151280 con 0x7f92e80b0b70 2020-10-31T22:50:45.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.125+0000 7f92eecb4700 1 --2- 172.21.15.60:0/3310492437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92e80b0b70 0x7f92e813fad0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f92e000c000 tx=0x7f92e00091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:45.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.129+0000 7f92db7fe700 1 -- 172.21.15.60:0/3310492437 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92e000c9a0 con 0x7f92e80b0b70 2020-10-31T22:50:45.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.129+0000 7f92db7fe700 1 -- 172.21.15.60:0/3310492437 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e000cb00 con 0x7f92e80b0b70 2020-10-31T22:50:45.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.129+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3310492437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92e81451c0 con 0x7f92e80b0b70 2020-10-31T22:50:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.129+0000 7f92db7fe700 1 -- 172.21.15.60:0/3310492437 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f92e000ce60 con 0x7f92e80b0b70 2020-10-31T22:50:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.129+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3310492437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92e8142a40 con 0x7f92e80b0b70 2020-10-31T22:50:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.129+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3310492437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92e8151410 con 0x7f92e80b0b70 2020-10-31T22:50:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.129+0000 7f92db7fe700 1 -- 172.21.15.60:0/3310492437 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f92e0022070 con 0x7f92e80b0b70 2020-10-31T22:50:45.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.129+0000 7f92db7fe700 1 --2- 172.21.15.60:0/3310492437 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f92c8054f30 0x7f92c80573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.129+0000 7f92db7fe700 1 -- 172.21.15.60:0/3310492437 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f92e006dfe0 con 0x7f92e80b0b70 2020-10-31T22:50:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.129+0000 7f92ee4b3700 1 --2- 172.21.15.60:0/3310492437 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f92c8054f30 0x7f92c80573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.133+0000 7f92ee4b3700 1 --2- 172.21.15.60:0/3310492437 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f92c8054f30 0x7f92c80573f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f92dc01b000 tx=0x7f92dc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:45.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.137+0000 7f92db7fe700 1 -- 172.21.15.60:0/3310492437 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f92e0044570 con 0x7f92e80b0b70 2020-10-31T22:50:45.330 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.325+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3310492437 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f92e8057100 con 0x7f92e80b0b70 2020-10-31T22:50:45.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.337+0000 7f92db7fe700 1 -- 172.21.15.60:0/3310492437 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 27 and data pool 28 v75) v1 ==== 189+0+0 (secure 0 0 0) 0x7f92e0016030 con 0x7f92e80b0b70 2020-10-31T22:50:45.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.341+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3310492437 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f92c8054f30 msgr2=0x7f92c80573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.341+0000 7f92ef4b5700 1 --2- 172.21.15.60:0/3310492437 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f92c8054f30 0x7f92c80573f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7f92dc01b000 tx=0x7f92dc015000).stop 2020-10-31T22:50:45.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.341+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3310492437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92e80b0b70 msgr2=0x7f92e813fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.347 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.341+0000 7f92ef4b5700 1 --2- 172.21.15.60:0/3310492437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92e80b0b70 0x7f92e813fad0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 rx=0x7f92e000c000 tx=0x7f92e00091a0).stop 2020-10-31T22:50:45.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.345+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3310492437 shutdown_connections 2020-10-31T22:50:45.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.345+0000 7f92ef4b5700 1 --2- 172.21.15.60:0/3310492437 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f92e80b0b70 0x7f92e813fad0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.345+0000 7f92ef4b5700 1 --2- 172.21.15.60:0/3310492437 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92e805b180 0x7f92e81445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.345+0000 7f92ef4b5700 1 --2- 172.21.15.60:0/3310492437 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f92c8054f30 0x7f92c80573f0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.349 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.345+0000 7f92ef4b5700 1 --2- 172.21.15.60:0/3310492437 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92e8060220 0x7f92e8151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.345+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3310492437 >> 172.21.15.60:0/3310492437 conn(0x7f92e80b61d0 msgr2=0x7f92e80b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:45.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.345+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3310492437 shutdown_connections 2020-10-31T22:50:45.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.345+0000 7f92ef4b5700 1 -- 172.21.15.60:0/3310492437 wait complete. 2020-10-31T22:50:45.351 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 27 and data pool 28 2020-10-31T22:50:45.366 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:50:45.422 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:50:45.424 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:50:45.428 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:50:45.430 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:50:45.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.457+0000 7f42548b1700 1 Processor -- start 2020-10-31T22:50:45.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f42548b1700 1 -- start start 2020-10-31T22:50:45.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f42548b1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42500ac870 0x7f42500b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f42548b1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42500b0e20 0x7f42500ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f42548b1700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42500acc50 con 0x7f42500ae690 2020-10-31T22:50:45.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f42548b1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42500b14c0 con 0x7f42500b0e20 2020-10-31T22:50:45.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f42548b1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42500b5690 con 0x7f42500ac870 2020-10-31T22:50:45.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f424e59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42500b0e20 0x7f42500ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f424e59c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f42500b0e20 0x7f42500ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49500/0 (socket says 172.21.15.60:49500) 2020-10-31T22:50:45.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f424e59c700 1 -- 172.21.15.60:0/1186451393 learned_addr learned my addr 172.21.15.60:0/1186451393 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:45.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f424ed9d700 1 --2- 172.21.15.60:0/1186451393 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42500ac870 0x7f42500b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f424e59c700 1 -- 172.21.15.60:0/1186451393 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42500ac870 msgr2=0x7f42500b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:45.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f424e59c700 1 --2- 172.21.15.60:0/1186451393 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42500ac870 0x7f42500b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f424e59c700 1 -- 172.21.15.60:0/1186451393 >> v1:172.21.15.66:6789/0 conn(0x7f42500ae690 legacy=0x7f42501412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.469 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f424e59c700 1 -- 172.21.15.60:0/1186451393 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42500afc10 con 0x7f42500b0e20 2020-10-31T22:50:45.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f424e59c700 1 --2- 172.21.15.60:0/1186451393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42500b0e20 0x7f42500ae1a0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f4244002f30 tx=0x7f4244006e80).ready entity=mon.0 client_cookie=88ca8e3cb1586ad8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:45.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f424dd9b700 1 -- 172.21.15.60:0/1186451393 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4244009880 con 0x7f42500b0e20 2020-10-31T22:50:45.470 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f424dd9b700 1 -- 172.21.15.60:0/1186451393 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42440099e0 con 0x7f42500b0e20 2020-10-31T22:50:45.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f424dd9b700 1 -- 172.21.15.60:0/1186451393 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4244009d40 con 0x7f42500b0e20 2020-10-31T22:50:45.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f42548b1700 1 -- 172.21.15.60:0/1186451393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42500b0e20 msgr2=0x7f42500ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.461+0000 7f42548b1700 1 --2- 172.21.15.60:0/1186451393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42500b0e20 0x7f42500ae1a0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 rx=0x7f4244002f30 tx=0x7f4244006e80).stop 2020-10-31T22:50:45.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f42548b1700 1 -- 172.21.15.60:0/1186451393 shutdown_connections 2020-10-31T22:50:45.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f42548b1700 1 --2- 172.21.15.60:0/1186451393 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42500ac870 0x7f42500b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.471 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f42548b1700 1 --2- 172.21.15.60:0/1186451393 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42500b0e20 0x7f42500ae1a0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f42548b1700 1 -- 172.21.15.60:0/1186451393 >> 172.21.15.60:0/1186451393 conn(0x7f425006a600 msgr2=0x7f4250060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:45.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f42548b1700 1 -- 172.21.15.60:0/1186451393 shutdown_connections 2020-10-31T22:50:45.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f42548b1700 1 -- 172.21.15.60:0/1186451393 wait complete. 2020-10-31T22:50:45.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f42548b1700 1 Processor -- start 2020-10-31T22:50:45.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f42548b1700 1 -- start start 2020-10-31T22:50:45.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f42548b1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42500ac870 0x7f42500aa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f42548b1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42500ae690 0x7f42500a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f42548b1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42500b0e20 0x7f42500ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f42548b1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4250067660 con 0x7f42500b0e20 2020-10-31T22:50:45.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f42548b1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42500a9650 con 0x7f42500ae690 2020-10-31T22:50:45.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f42548b1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4250067400 con 0x7f42500ac870 2020-10-31T22:50:45.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f424f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42500b0e20 0x7f42500ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f424f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42500b0e20 0x7f42500ab150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49508/0 (socket says 172.21.15.60:49508) 2020-10-31T22:50:45.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.465+0000 7f424f59e700 1 -- 172.21.15.60:0/3361456906 learned_addr learned my addr 172.21.15.60:0/3361456906 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:45.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f424e59c700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42500ae690 0x7f42500a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f424ed9d700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42500ac870 0x7f42500aa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f424f59e700 1 -- 172.21.15.60:0/3361456906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42500ac870 msgr2=0x7f42500aa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f424f59e700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42500ac870 0x7f42500aa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f424f59e700 1 -- 172.21.15.60:0/3361456906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42500ae690 msgr2=0x7f42500a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f424f59e700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42500ae690 0x7f42500a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f424f59e700 1 -- 172.21.15.60:0/3361456906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42500abd30 con 0x7f42500b0e20 2020-10-31T22:50:45.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f424ed9d700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42500ac870 0x7f42500aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:45.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f424f59e700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42500b0e20 0x7f42500ab150 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f4250062fc0 tx=0x7f4248007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:45.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f423ffff700 1 -- 172.21.15.60:0/3361456906 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f424800ce20 con 0x7f42500b0e20 2020-10-31T22:50:45.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f423ffff700 1 -- 172.21.15.60:0/3361456906 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424800a7b0 con 0x7f42500b0e20 2020-10-31T22:50:45.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f42548b1700 1 -- 172.21.15.60:0/3361456906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4250065450 con 0x7f42500b0e20 2020-10-31T22:50:45.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f423ffff700 1 -- 172.21.15.60:0/3361456906 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f424800ab10 con 0x7f42500b0e20 2020-10-31T22:50:45.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f42548b1700 1 -- 172.21.15.60:0/3361456906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4250148e90 con 0x7f42500b0e20 2020-10-31T22:50:45.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f42548b1700 1 -- 172.21.15.60:0/3361456906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4250066970 con 0x7f42500b0e20 2020-10-31T22:50:45.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f423ffff700 1 -- 172.21.15.60:0/3361456906 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4248019030 con 0x7f42500b0e20 2020-10-31T22:50:45.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f423ffff700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f422c054f10 0x7f422c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.478 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f424ed9d700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f422c054f10 0x7f422c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.469+0000 7f423ffff700 1 -- 172.21.15.60:0/3361456906 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f424806d270 con 0x7f42500b0e20 2020-10-31T22:50:45.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.473+0000 7f424ed9d700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f422c054f10 0x7f422c0573d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f424000c000 tx=0x7f4240008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:45.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.477+0000 7f423ffff700 1 -- 172.21.15.60:0/3361456906 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4248043790 con 0x7f42500b0e20 2020-10-31T22:50:45.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.609+0000 7f42548b1700 1 -- 172.21.15.60:0/3361456906 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4250057100 con 0x7f42500b0e20 2020-10-31T22:50:45.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.613+0000 7f423ffff700 1 -- 172.21.15.60:0/3361456906 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f4248046db0 con 0x7f42500b0e20 2020-10-31T22:50:45.619 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:45.619 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":148,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:50:45.331499+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:50:43.020680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2020-10-31T22:50:44.329474+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:50:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.617+0000 7f42548b1700 1 -- 172.21.15.60:0/3361456906 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f422c054f10 msgr2=0x7f422c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.617+0000 7f42548b1700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f422c054f10 0x7f422c0573d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f424000c000 tx=0x7f4240008040).stop 2020-10-31T22:50:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.617+0000 7f42548b1700 1 -- 172.21.15.60:0/3361456906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42500b0e20 msgr2=0x7f42500ab150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.617+0000 7f42548b1700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42500b0e20 0x7f42500ab150 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 rx=0x7f4250062fc0 tx=0x7f4248007e40).stop 2020-10-31T22:50:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.617+0000 7f42548b1700 1 -- 172.21.15.60:0/3361456906 shutdown_connections 2020-10-31T22:50:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.617+0000 7f42548b1700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42500b0e20 0x7f42500ab150 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.617+0000 7f42548b1700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42500ac870 0x7f42500aa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.617+0000 7f42548b1700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f422c054f10 0x7f422c0573d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.617+0000 7f42548b1700 1 --2- 172.21.15.60:0/3361456906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42500ae690 0x7f42500a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.617+0000 7f42548b1700 1 -- 172.21.15.60:0/3361456906 >> 172.21.15.60:0/3361456906 conn(0x7f425006a600 msgr2=0x7f4250141850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:45.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.617+0000 7f42548b1700 1 -- 172.21.15.60:0/3361456906 shutdown_connections 2020-10-31T22:50:45.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.617+0000 7f42548b1700 1 -- 172.21.15.60:0/3361456906 wait complete. 2020-10-31T22:50:45.638 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:50:45.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f19258ed700 1 Processor -- start 2020-10-31T22:50:45.793 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f19258ed700 1 -- start start 2020-10-31T22:50:45.794 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f19258ed700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f19200b2790 0x7f1920145a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f19258ed700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19200b2b70 con 0x7f19200aee40 2020-10-31T22:50:45.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f19258ed700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f192005fed0 con 0x7f192005fa30 2020-10-31T22:50:45.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f19258ed700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1920060170 con 0x7f19200b2790 2020-10-31T22:50:45.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f191effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f19200b2790 0x7f1920145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f191effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f19200b2790 0x7f1920145a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49512/0 (socket says 172.21.15.60:49512) 2020-10-31T22:50:45.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f191effd700 1 -- 172.21.15.60:0/3766074244 learned_addr learned my addr 172.21.15.60:0/3766074244 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:45.795 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f191f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f19200aee40 0x7f192014c830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53652/0 (socket says 172.21.15.60:53652) 2020-10-31T22:50:45.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f191effd700 1 -- 172.21.15.60:0/3766074244 >> v1:172.21.15.66:6789/0 conn(0x7f192005fa30 legacy=0x7f19200ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:45.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f191effd700 1 -- 172.21.15.60:0/3766074244 >> v1:172.21.15.60:6789/0 conn(0x7f19200aee40 legacy=0x7f192014c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f191dffb700 1 -- 172.21.15.60:0/3766074244 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785859816 0 0) 0x7f19200b2b70 con 0x7f19200aee40 2020-10-31T22:50:45.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f191effd700 1 -- 172.21.15.60:0/3766074244 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1920060410 con 0x7f19200b2790 2020-10-31T22:50:45.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f191effd700 1 --2- 172.21.15.60:0/3766074244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19200b2790 0x7f1920145a30 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7f1910002f30 tx=0x7f1910006e80).ready entity=mon.0 client_cookie=3608d5ba23ecb07d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:45.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f191dffb700 1 -- 172.21.15.60:0/3766074244 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19100097f0 con 0x7f19200b2790 2020-10-31T22:50:45.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f191dffb700 1 -- 172.21.15.60:0/3766074244 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1910009950 con 0x7f19200b2790 2020-10-31T22:50:45.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f191dffb700 1 -- 172.21.15.60:0/3766074244 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1910009ac0 con 0x7f19200b2790 2020-10-31T22:50:45.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f19258ed700 1 -- 172.21.15.60:0/3766074244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19200b2790 msgr2=0x7f1920145a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.789+0000 7f19258ed700 1 --2- 172.21.15.60:0/3766074244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19200b2790 0x7f1920145a30 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 rx=0x7f1910002f30 tx=0x7f1910006e80).stop 2020-10-31T22:50:45.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f19258ed700 1 -- 172.21.15.60:0/3766074244 shutdown_connections 2020-10-31T22:50:45.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f19258ed700 1 --2- 172.21.15.60:0/3766074244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19200b2790 0x7f1920145a30 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f19258ed700 1 -- 172.21.15.60:0/3766074244 >> 172.21.15.60:0/3766074244 conn(0x7f19200b5d30 msgr2=0x7f19200b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:45.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f19258ed700 1 -- 172.21.15.60:0/3766074244 shutdown_connections 2020-10-31T22:50:45.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f19258ed700 1 -- 172.21.15.60:0/3766074244 wait complete. 2020-10-31T22:50:45.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f19258ed700 1 Processor -- start 2020-10-31T22:50:45.804 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f19258ed700 1 -- start start 2020-10-31T22:50:45.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f19258ed700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f192005fa30 0x7f19201483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f19258ed700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19200aee40 0x7f1920141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f19258ed700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19200b2790 0x7f19200ab020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f19258ed700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19200abea0 con 0x7f19200b2790 2020-10-31T22:50:45.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f19258ed700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19201490f0 con 0x7f192005fa30 2020-10-31T22:50:45.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f19258ed700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1920149390 con 0x7f19200aee40 2020-10-31T22:50:45.805 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f191f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19200b2790 0x7f19200ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.806 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f191f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19200b2790 0x7f19200ab020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49522/0 (socket says 172.21.15.60:49522) 2020-10-31T22:50:45.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f191f7fe700 1 -- 172.21.15.60:0/507617121 learned_addr learned my addr 172.21.15.60:0/507617121 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:45.807 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f191effd700 1 --2- 172.21.15.60:0/507617121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f192005fa30 0x7f19201483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f191e7fc700 1 --2- 172.21.15.60:0/507617121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19200aee40 0x7f1920141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f191f7fe700 1 -- 172.21.15.60:0/507617121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19200aee40 msgr2=0x7f1920141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f191f7fe700 1 --2- 172.21.15.60:0/507617121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19200aee40 0x7f1920141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f191f7fe700 1 -- 172.21.15.60:0/507617121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f192005fa30 msgr2=0x7f19201483e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.808 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f191f7fe700 1 --2- 172.21.15.60:0/507617121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f192005fa30 0x7f19201483e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.793+0000 7f191f7fe700 1 -- 172.21.15.60:0/507617121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19200ac310 con 0x7f19200b2790 2020-10-31T22:50:45.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.797+0000 7f191f7fe700 1 --2- 172.21.15.60:0/507617121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19200b2790 0x7f19200ab020 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f1918000f00 tx=0x7f1918007cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:45.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.797+0000 7f1917fff700 1 -- 172.21.15.60:0/507617121 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f19180058a0 con 0x7f19200b2790 2020-10-31T22:50:45.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.797+0000 7f1917fff700 1 -- 172.21.15.60:0/507617121 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1918005a00 con 0x7f19200b2790 2020-10-31T22:50:45.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.797+0000 7f19258ed700 1 -- 172.21.15.60:0/507617121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1920147830 con 0x7f19200b2790 2020-10-31T22:50:45.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.797+0000 7f1917fff700 1 -- 172.21.15.60:0/507617121 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1918005d60 con 0x7f19200b2790 2020-10-31T22:50:45.809 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.797+0000 7f19258ed700 1 -- 172.21.15.60:0/507617121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19200ab6b0 con 0x7f19200b2790 2020-10-31T22:50:45.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.797+0000 7f19258ed700 1 -- 172.21.15.60:0/507617121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19200abd00 con 0x7f19200b2790 2020-10-31T22:50:45.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.797+0000 7f1917fff700 1 -- 172.21.15.60:0/507617121 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1918010030 con 0x7f19200b2790 2020-10-31T22:50:45.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.797+0000 7f1917fff700 1 --2- 172.21.15.60:0/507617121 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1904054f30 0x7f19040573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:45.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.797+0000 7f1917fff700 1 -- 172.21.15.60:0/507617121 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f191806d930 con 0x7f19200b2790 2020-10-31T22:50:45.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.797+0000 7f191effd700 1 --2- 172.21.15.60:0/507617121 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1904054f30 0x7f19040573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:45.810 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.797+0000 7f191effd700 1 --2- 172.21.15.60:0/507617121 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1904054f30 0x7f19040573f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f191001c000 tx=0x7f1910016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:45.811 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.801+0000 7f1917fff700 1 -- 172.21.15.60:0/507617121 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f19200abd00 con 0x7f19200b2790 2020-10-31T22:50:45.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.945+0000 7f19258ed700 1 -- 172.21.15.60:0/507617121 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19200abd00 con 0x7f19200b2790 2020-10-31T22:50:45.953 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.949+0000 7f1917fff700 1 -- 172.21.15.60:0/507617121 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f19200abd00 con 0x7f19200b2790 2020-10-31T22:50:45.954 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:45.954 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":148,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:50:45.331499+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:50:43.020680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2020-10-31T22:50:44.329474+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:50:45.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.949+0000 7f19258ed700 1 -- 172.21.15.60:0/507617121 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1904054f30 msgr2=0x7f19040573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.949+0000 7f19258ed700 1 --2- 172.21.15.60:0/507617121 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1904054f30 0x7f19040573f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f191001c000 tx=0x7f1910016000).stop 2020-10-31T22:50:45.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.949+0000 7f19258ed700 1 -- 172.21.15.60:0/507617121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19200b2790 msgr2=0x7f19200ab020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:45.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.949+0000 7f19258ed700 1 --2- 172.21.15.60:0/507617121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19200b2790 0x7f19200ab020 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 rx=0x7f1918000f00 tx=0x7f1918007cb0).stop 2020-10-31T22:50:45.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.949+0000 7f19258ed700 1 -- 172.21.15.60:0/507617121 shutdown_connections 2020-10-31T22:50:45.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.949+0000 7f19258ed700 1 --2- 172.21.15.60:0/507617121 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19200b2790 0x7f19200ab020 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.949+0000 7f19258ed700 1 --2- 172.21.15.60:0/507617121 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1904054f30 0x7f19040573f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.949+0000 7f19258ed700 1 --2- 172.21.15.60:0/507617121 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f192005fa30 0x7f19201483e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.949+0000 7f19258ed700 1 --2- 172.21.15.60:0/507617121 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19200aee40 0x7f1920141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:45.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.949+0000 7f19258ed700 1 -- 172.21.15.60:0/507617121 >> 172.21.15.60:0/507617121 conn(0x7f19200b5d30 msgr2=0x7f19200b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:45.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.949+0000 7f19258ed700 1 -- 172.21.15.60:0/507617121 shutdown_connections 2020-10-31T22:50:45.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:45.949+0000 7f19258ed700 1 -- 172.21.15.60:0/507617121 wait complete. 2020-10-31T22:50:45.970 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-10-31T22:50:46.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.081+0000 7f8e108f2700 1 Processor -- start 2020-10-31T22:50:46.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.081+0000 7f8e108f2700 1 -- start start 2020-10-31T22:50:46.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8e0c0b24a0 0x7f8e0c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8e0c141f00 0x7f8e0c142360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c0b4440 con 0x7f8e0c0b5570 2020-10-31T22:50:46.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0c13f930 con 0x7f8e0c141f00 2020-10-31T22:50:46.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0c146060 con 0x7f8e0c0b24a0 2020-10-31T22:50:46.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e0b59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8e0c141f00 0x7f8e0c142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e0b59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8e0c141f00 0x7f8e0c142360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49528/0 (socket says 172.21.15.60:49528) 2020-10-31T22:50:46.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e0b59e700 1 -- 172.21.15.60:0/813006926 learned_addr learned my addr 172.21.15.60:0/813006926 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:46.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e0ad9d700 1 --1- 172.21.15.60:0/813006926 >> v1:172.21.15.60:6789/0 conn(0x7f8e0c0b5570 0x7f8e0c145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53662/0 (socket says 172.21.15.60:53662) 2020-10-31T22:50:46.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e0a59c700 1 --2- 172.21.15.60:0/813006926 >> v2:172.21.15.66:3300/0 conn(0x7f8e0c0b24a0 0x7f8e0c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e0b59e700 1 -- 172.21.15.60:0/813006926 >> v2:172.21.15.66:3300/0 conn(0x7f8e0c0b24a0 msgr2=0x7f8e0c0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:46.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e0b59e700 1 --2- 172.21.15.60:0/813006926 >> v2:172.21.15.66:3300/0 conn(0x7f8e0c0b24a0 0x7f8e0c0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e0b59e700 1 -- 172.21.15.60:0/813006926 >> v1:172.21.15.60:6789/0 conn(0x7f8e0c0b5570 legacy=0x7f8e0c145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e0b59e700 1 -- 172.21.15.60:0/813006926 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c0b02f0 con 0x7f8e0c141f00 2020-10-31T22:50:46.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e0b59e700 1 --2- 172.21.15.60:0/813006926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e0c141f00 0x7f8e0c142360 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f8e040032b0 tx=0x7f8e04009270).ready entity=mon.0 client_cookie=6be9ffdd6f940577 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:46.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e09d9b700 1 -- 172.21.15.60:0/813006926 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e0400bc00 con 0x7f8e0c141f00 2020-10-31T22:50:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e09d9b700 1 -- 172.21.15.60:0/813006926 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0400bd60 con 0x7f8e0c141f00 2020-10-31T22:50:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e09d9b700 1 -- 172.21.15.60:0/813006926 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e04011400 con 0x7f8e0c141f00 2020-10-31T22:50:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 -- 172.21.15.60:0/813006926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e0c141f00 msgr2=0x7f8e0c142360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 --2- 172.21.15.60:0/813006926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e0c141f00 0x7f8e0c142360 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 rx=0x7f8e040032b0 tx=0x7f8e04009270).stop 2020-10-31T22:50:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 -- 172.21.15.60:0/813006926 shutdown_connections 2020-10-31T22:50:46.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 --2- 172.21.15.60:0/813006926 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e0c141f00 0x7f8e0c142360 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 --2- 172.21.15.60:0/813006926 >> v2:172.21.15.66:3300/0 conn(0x7f8e0c0b24a0 0x7f8e0c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 -- 172.21.15.60:0/813006926 >> 172.21.15.60:0/813006926 conn(0x7f8e0c0b8e90 msgr2=0x7f8e0c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:46.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 -- 172.21.15.60:0/813006926 shutdown_connections 2020-10-31T22:50:46.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 -- 172.21.15.60:0/813006926 wait complete. 2020-10-31T22:50:46.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 Processor -- start 2020-10-31T22:50:46.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 -- start start 2020-10-31T22:50:46.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e0c0b24a0 0x7f8e0c1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e0c0b5570 0x7f8e0c1412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.085+0000 7f8e108f2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e0c141f00 0x7f8e0c0ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e108f2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0acd90 con 0x7f8e0c141f00 2020-10-31T22:50:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e108f2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0acaf0 con 0x7f8e0c0b24a0 2020-10-31T22:50:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e108f2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c150c60 con 0x7f8e0c0b5570 2020-10-31T22:50:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e0b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e0c141f00 0x7f8e0c0ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e0b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e0c141f00 0x7f8e0c0ac2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49534/0 (socket says 172.21.15.60:49534) 2020-10-31T22:50:46.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e0b59e700 1 -- 172.21.15.60:0/3626131427 learned_addr learned my addr 172.21.15.60:0/3626131427 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:46.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e0a59c700 1 --2- 172.21.15.60:0/3626131427 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e0c0b5570 0x7f8e0c1412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e0ad9d700 1 --2- 172.21.15.60:0/3626131427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e0c0b24a0 0x7f8e0c1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e0b59e700 1 -- 172.21.15.60:0/3626131427 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e0c0b5570 msgr2=0x7f8e0c1412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e0b59e700 1 --2- 172.21.15.60:0/3626131427 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e0c0b5570 0x7f8e0c1412c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e0b59e700 1 -- 172.21.15.60:0/3626131427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e0c0b24a0 msgr2=0x7f8e0c1540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e0b59e700 1 --2- 172.21.15.60:0/3626131427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e0c0b24a0 0x7f8e0c1540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e0b59e700 1 -- 172.21.15.60:0/3626131427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c150f00 con 0x7f8e0c141f00 2020-10-31T22:50:46.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e0b59e700 1 --2- 172.21.15.60:0/3626131427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e0c141f00 0x7f8e0c0ac2c0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f8e040032b0 tx=0x7f8e04016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:46.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e03fff700 1 -- 172.21.15.60:0/3626131427 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e04011e90 con 0x7f8e0c141f00 2020-10-31T22:50:46.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e108f2700 1 -- 172.21.15.60:0/3626131427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0c1417b0 con 0x7f8e0c141f00 2020-10-31T22:50:46.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e03fff700 1 -- 172.21.15.60:0/3626131427 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0401f3f0 con 0x7f8e0c141f00 2020-10-31T22:50:46.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e03fff700 1 -- 172.21.15.60:0/3626131427 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8e0401f750 con 0x7f8e0c141f00 2020-10-31T22:50:46.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e108f2700 1 -- 172.21.15.60:0/3626131427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0c0b7a80 con 0x7f8e0c141f00 2020-10-31T22:50:46.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e108f2700 1 -- 172.21.15.60:0/3626131427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0c0ac950 con 0x7f8e0c141f00 2020-10-31T22:50:46.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.089+0000 7f8e03fff700 1 -- 172.21.15.60:0/3626131427 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8e04026030 con 0x7f8e0c141f00 2020-10-31T22:50:46.099 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.093+0000 7f8e03fff700 1 --2- 172.21.15.60:0/3626131427 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8df0054f10 0x7f8df00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.093+0000 7f8e03fff700 1 -- 172.21.15.60:0/3626131427 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8e0406e5e0 con 0x7f8e0c141f00 2020-10-31T22:50:46.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.093+0000 7f8e0ad9d700 1 --2- 172.21.15.60:0/3626131427 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8df0054f10 0x7f8df00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.100 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.093+0000 7f8e0ad9d700 1 --2- 172.21.15.60:0/3626131427 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8df0054f10 0x7f8df00573d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f8df400d000 tx=0x7f8df4007a80).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:46.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.101+0000 7f8e03fff700 1 -- 172.21.15.60:0/3626131427 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8e0c0ac950 con 0x7f8e0c141f00 2020-10-31T22:50:46.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.285+0000 7f8e108f2700 1 -- 172.21.15.60:0/3626131427 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8e0c0ac950 con 0x7f8e0c141f00 2020-10-31T22:50:46.350 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.345+0000 7f8e03fff700 1 -- 172.21.15.60:0/3626131427 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v76) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8e0c0ac950 con 0x7f8e0c141f00 2020-10-31T22:50:46.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.349+0000 7f8e108f2700 1 -- 172.21.15.60:0/3626131427 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8df0054f10 msgr2=0x7f8df00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.353 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.349+0000 7f8e108f2700 1 --2- 172.21.15.60:0/3626131427 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8df0054f10 0x7f8df00573d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f8df400d000 tx=0x7f8df4007a80).stop 2020-10-31T22:50:46.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.349+0000 7f8e108f2700 1 -- 172.21.15.60:0/3626131427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e0c141f00 msgr2=0x7f8e0c0ac2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.349+0000 7f8e108f2700 1 --2- 172.21.15.60:0/3626131427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e0c141f00 0x7f8e0c0ac2c0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 rx=0x7f8e040032b0 tx=0x7f8e04016000).stop 2020-10-31T22:50:46.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.349+0000 7f8e108f2700 1 -- 172.21.15.60:0/3626131427 shutdown_connections 2020-10-31T22:50:46.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.349+0000 7f8e108f2700 1 --2- 172.21.15.60:0/3626131427 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8e0c141f00 0x7f8e0c0ac2c0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.349+0000 7f8e108f2700 1 --2- 172.21.15.60:0/3626131427 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8df0054f10 0x7f8df00573d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.349+0000 7f8e108f2700 1 --2- 172.21.15.60:0/3626131427 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e0c0b24a0 0x7f8e0c1540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.349+0000 7f8e108f2700 1 --2- 172.21.15.60:0/3626131427 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e0c0b5570 0x7f8e0c1412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.349+0000 7f8e108f2700 1 -- 172.21.15.60:0/3626131427 >> 172.21.15.60:0/3626131427 conn(0x7f8e0c0b8e90 msgr2=0x7f8e0c146700 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:46.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.349+0000 7f8e108f2700 1 -- 172.21.15.60:0/3626131427 shutdown_connections 2020-10-31T22:50:46.355 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.349+0000 7f8e108f2700 1 -- 172.21.15.60:0/3626131427 wait complete. 2020-10-31T22:50:46.368 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:50:46.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.481+0000 7fa194af6700 1 Processor -- start 2020-10-31T22:50:46.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.481+0000 7fa194af6700 1 -- start start 2020-10-31T22:50:46.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa194af6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa1900ae5b0 0x7fa19005afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa194af6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa19005b4d0 0x7fa19013f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa194af6700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa190142210 con 0x7fa190141c90 2020-10-31T22:50:46.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa194af6700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1901424b0 con 0x7fa1900ae5b0 2020-10-31T22:50:46.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa194af6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa190142750 con 0x7fa19005b4d0 2020-10-31T22:50:46.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa18f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa1900ae5b0 0x7fa19005afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa18f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa1900ae5b0 0x7fa19005afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49540/0 (socket says 172.21.15.60:49540) 2020-10-31T22:50:46.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa18f7fe700 1 -- 172.21.15.60:0/3133751672 learned_addr learned my addr 172.21.15.60:0/3133751672 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:46.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa186ffd700 1 --2- 172.21.15.60:0/3133751672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa19005b4d0 0x7fa19013f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa18f7fe700 1 -- 172.21.15.60:0/3133751672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa19005b4d0 msgr2=0x7fa19013f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:46.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa18f7fe700 1 --2- 172.21.15.60:0/3133751672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa19005b4d0 0x7fa19013f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa18f7fe700 1 -- 172.21.15.60:0/3133751672 >> v1:172.21.15.66:6789/0 conn(0x7fa190141c90 legacy=0x7fa1900a9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa18f7fe700 1 -- 172.21.15.60:0/3133751672 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1901429f0 con 0x7fa1900ae5b0 2020-10-31T22:50:46.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa18f7fe700 1 --2- 172.21.15.60:0/3133751672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1900ae5b0 0x7fa19005afe0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fa180002f30 tx=0x7fa180006e80).ready entity=mon.0 client_cookie=9116f87cb1cde9db server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:46.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa18effd700 1 -- 172.21.15.60:0/3133751672 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1800097f0 con 0x7fa1900ae5b0 2020-10-31T22:50:46.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa18effd700 1 -- 172.21.15.60:0/3133751672 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa180009950 con 0x7fa1900ae5b0 2020-10-31T22:50:46.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa194af6700 1 -- 172.21.15.60:0/3133751672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1900ae5b0 msgr2=0x7fa19005afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa18effd700 1 -- 172.21.15.60:0/3133751672 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa180009cb0 con 0x7fa1900ae5b0 2020-10-31T22:50:46.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa194af6700 1 --2- 172.21.15.60:0/3133751672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1900ae5b0 0x7fa19005afe0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 rx=0x7fa180002f30 tx=0x7fa180006e80).stop 2020-10-31T22:50:46.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa194af6700 1 -- 172.21.15.60:0/3133751672 shutdown_connections 2020-10-31T22:50:46.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa194af6700 1 --2- 172.21.15.60:0/3133751672 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1900ae5b0 0x7fa19005afe0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa194af6700 1 --2- 172.21.15.60:0/3133751672 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa19005b4d0 0x7fa19013f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa194af6700 1 -- 172.21.15.60:0/3133751672 >> 172.21.15.60:0/3133751672 conn(0x7fa1900b61d0 msgr2=0x7fa1900b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:46.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa194af6700 1 -- 172.21.15.60:0/3133751672 shutdown_connections 2020-10-31T22:50:46.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.485+0000 7fa194af6700 1 -- 172.21.15.60:0/3133751672 wait complete. 2020-10-31T22:50:46.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa194af6700 1 Processor -- start 2020-10-31T22:50:46.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa194af6700 1 -- start start 2020-10-31T22:50:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa194af6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1900ae5b0 0x7fa190145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa194af6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa190141c90 0x7fa190140d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa194af6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa190067600 0x7fa190065430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa194af6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa190147a60 con 0x7fa190067600 2020-10-31T22:50:46.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa194af6700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa190144040 con 0x7fa1900ae5b0 2020-10-31T22:50:46.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa194af6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900ac3b0 con 0x7fa190141c90 2020-10-31T22:50:46.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa18ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa190067600 0x7fa190065430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa186ffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa190141c90 0x7fa190140d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa18ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa190067600 0x7fa190065430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49548/0 (socket says 172.21.15.60:49548) 2020-10-31T22:50:46.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa18ffff700 1 -- 172.21.15.60:0/1671521392 learned_addr learned my addr 172.21.15.60:0/1671521392 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:46.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa18f7fe700 1 --2- 172.21.15.60:0/1671521392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1900ae5b0 0x7fa190145bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa18ffff700 1 -- 172.21.15.60:0/1671521392 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa190141c90 msgr2=0x7fa190140d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa18ffff700 1 --2- 172.21.15.60:0/1671521392 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa190141c90 0x7fa190140d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa18ffff700 1 -- 172.21.15.60:0/1671521392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1900ae5b0 msgr2=0x7fa190145bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa18ffff700 1 --2- 172.21.15.60:0/1671521392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1900ae5b0 0x7fa190145bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.504 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa18ffff700 1 -- 172.21.15.60:0/1671521392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1900639f0 con 0x7fa190067600 2020-10-31T22:50:46.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa18ffff700 1 --2- 172.21.15.60:0/1671521392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa190067600 0x7fa190065430 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7fa1900b6e30 tx=0x7fa188007e10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:46.505 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa18d7fa700 1 -- 172.21.15.60:0/1671521392 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa18800a5a0 con 0x7fa190067600 2020-10-31T22:50:46.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa18d7fa700 1 -- 172.21.15.60:0/1671521392 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18800a700 con 0x7fa190067600 2020-10-31T22:50:46.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa194af6700 1 -- 172.21.15.60:0/1671521392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1900ac600 con 0x7fa190067600 2020-10-31T22:50:46.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa18d7fa700 1 -- 172.21.15.60:0/1671521392 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa18800aa60 con 0x7fa190067600 2020-10-31T22:50:46.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa194af6700 1 -- 172.21.15.60:0/1671521392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa190065920 con 0x7fa190067600 2020-10-31T22:50:46.506 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.489+0000 7fa194af6700 1 -- 172.21.15.60:0/1671521392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa190063bb0 con 0x7fa190067600 2020-10-31T22:50:46.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.493+0000 7fa18d7fa700 1 -- 172.21.15.60:0/1671521392 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa188019030 con 0x7fa190067600 2020-10-31T22:50:46.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.493+0000 7fa18d7fa700 1 --2- 172.21.15.60:0/1671521392 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa174054f90 0x7fa174057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.507 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.493+0000 7fa18f7fe700 1 --2- 172.21.15.60:0/1671521392 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa174054f90 0x7fa174057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.493+0000 7fa18d7fa700 1 -- 172.21.15.60:0/1671521392 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa18806d350 con 0x7fa190067600 2020-10-31T22:50:46.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.493+0000 7fa18f7fe700 1 --2- 172.21.15.60:0/1671521392 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa174054f90 0x7fa174057450 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fa18001c000 tx=0x7fa180015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:46.508 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.501+0000 7fa18d7fa700 1 -- 172.21.15.60:0/1671521392 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa188043760 con 0x7fa190067600 2020-10-31T22:50:46.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.685+0000 7fa194af6700 1 -- 172.21.15.60:0/1671521392 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa190057100 con 0x7fa190067600 2020-10-31T22:50:46.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.685+0000 7fa18d7fa700 1 -- 172.21.15.60:0/1671521392 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fa188046d80 con 0x7fa190067600 2020-10-31T22:50:46.691 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:46.691 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":76,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7085,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/2329273308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2329273308},{"type":"v1","addr":"172.21.15.66:6833","nonce":2329273308}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6835/4086841612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":4086841612},{"type":"v1","addr":"172.21.15.60:6835","nonce":4086841612}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:45.331860+0000","modified":"2020-10-31T22:50:46.335175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8232":{"gid":8232,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2095394176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2095394176},{"type":"v1","addr":"172.21.15.60:6837","nonce":2095394176}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-10-31T22:50:46.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.689+0000 7fa194af6700 1 -- 172.21.15.60:0/1671521392 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa174054f90 msgr2=0x7fa174057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.689+0000 7fa194af6700 1 --2- 172.21.15.60:0/1671521392 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa174054f90 0x7fa174057450 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7fa18001c000 tx=0x7fa180015000).stop 2020-10-31T22:50:46.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.689+0000 7fa194af6700 1 -- 172.21.15.60:0/1671521392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa190067600 msgr2=0x7fa190065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.689+0000 7fa194af6700 1 --2- 172.21.15.60:0/1671521392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa190067600 0x7fa190065430 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 rx=0x7fa1900b6e30 tx=0x7fa188007e10).stop 2020-10-31T22:50:46.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.689+0000 7fa194af6700 1 -- 172.21.15.60:0/1671521392 shutdown_connections 2020-10-31T22:50:46.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.689+0000 7fa194af6700 1 --2- 172.21.15.60:0/1671521392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa190067600 0x7fa190065430 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.689+0000 7fa194af6700 1 --2- 172.21.15.60:0/1671521392 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa174054f90 0x7fa174057450 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.689+0000 7fa194af6700 1 --2- 172.21.15.60:0/1671521392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1900ae5b0 0x7fa190145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.689+0000 7fa194af6700 1 --2- 172.21.15.60:0/1671521392 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa190141c90 0x7fa190140d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.689+0000 7fa194af6700 1 -- 172.21.15.60:0/1671521392 >> 172.21.15.60:0/1671521392 conn(0x7fa1900b61d0 msgr2=0x7fa190060500 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:46.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.689+0000 7fa194af6700 1 -- 172.21.15.60:0/1671521392 shutdown_connections 2020-10-31T22:50:46.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.689+0000 7fa194af6700 1 -- 172.21.15.60:0/1671521392 wait complete. 2020-10-31T22:50:46.696 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 76 2020-10-31T22:50:46.705 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:50:46.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.813+0000 7f9eeffff700 1 Processor -- start 2020-10-31T22:50:46.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.813+0000 7f9eeffff700 1 -- start start 2020-10-31T22:50:46.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.813+0000 7f9eeffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ef00b1000 0x7f9ef00b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.813+0000 7f9eeffff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef01459c0 con 0x7f9ef0063140 2020-10-31T22:50:46.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.813+0000 7f9eeffff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef0063520 con 0x7f9ef00b2820 2020-10-31T22:50:46.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.813+0000 7f9eeffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00b2060 con 0x7f9ef00b1000 2020-10-31T22:50:46.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eeeffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9ef0063140 0x7f9ef01452b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53688/0 (socket says 172.21.15.60:53688) 2020-10-31T22:50:46.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eeeffd700 1 -- 172.21.15.60:0/3820593442 learned_addr learned my addr 172.21.15.60:0/3820593442 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:46.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9ee7fff700 1 --2- 172.21.15.60:0/3820593442 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ef00b1000 0x7f9ef00b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eee7fc700 1 -- 172.21.15.60:0/3820593442 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491250537 0 0) 0x7f9ef01459c0 con 0x7f9ef0063140 2020-10-31T22:50:46.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eee7fc700 1 -- 172.21.15.60:0/3820593442 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ed0003230 con 0x7f9ef0063140 2020-10-31T22:50:46.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eee7fc700 1 -- 172.21.15.60:0/3820593442 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4254207315 0 0) 0x7f9ef0063520 con 0x7f9ef00b2820 2020-10-31T22:50:46.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eee7fc700 1 -- 172.21.15.60:0/3820593442 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ef01459c0 con 0x7f9ef00b2820 2020-10-31T22:50:46.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9ee7fff700 1 -- 172.21.15.60:0/3820593442 >> v1:172.21.15.66:6789/0 conn(0x7f9ef00b2820 legacy=0x7f9ef00aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9ee7fff700 1 -- 172.21.15.60:0/3820593442 >> v1:172.21.15.60:6789/0 conn(0x7f9ef0063140 legacy=0x7f9ef01452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9ee7fff700 1 -- 172.21.15.60:0/3820593442 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef00b02e0 con 0x7f9ef00b1000 2020-10-31T22:50:46.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9ee7fff700 1 --2- 172.21.15.60:0/3820593442 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ef00b1000 0x7f9ef00b09e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f9ed8002f30 tx=0x7f9ed8006dc0).ready entity=mon.2 client_cookie=bf4516afa4997d8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:46.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eee7fc700 1 -- 172.21.15.60:0/3820593442 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed8009730 con 0x7f9ef00b1000 2020-10-31T22:50:46.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eee7fc700 1 -- 172.21.15.60:0/3820593442 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed8009890 con 0x7f9ef00b1000 2020-10-31T22:50:46.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eee7fc700 1 -- 172.21.15.60:0/3820593442 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed8009bf0 con 0x7f9ef00b1000 2020-10-31T22:50:46.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eeffff700 1 -- 172.21.15.60:0/3820593442 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ef00b1000 msgr2=0x7f9ef00b09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eeffff700 1 --2- 172.21.15.60:0/3820593442 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ef00b1000 0x7f9ef00b09e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f9ed8002f30 tx=0x7f9ed8006dc0).stop 2020-10-31T22:50:46.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eeffff700 1 -- 172.21.15.60:0/3820593442 shutdown_connections 2020-10-31T22:50:46.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eeffff700 1 --2- 172.21.15.60:0/3820593442 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ef00b1000 0x7f9ef00b09e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eeffff700 1 -- 172.21.15.60:0/3820593442 >> 172.21.15.60:0/3820593442 conn(0x7f9ef006a600 msgr2=0x7f9ef0060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:46.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eeffff700 1 -- 172.21.15.60:0/3820593442 shutdown_connections 2020-10-31T22:50:46.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eeffff700 1 -- 172.21.15.60:0/3820593442 wait complete. 2020-10-31T22:50:46.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eeffff700 1 Processor -- start 2020-10-31T22:50:46.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.817+0000 7f9eeffff700 1 -- start start 2020-10-31T22:50:46.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eeffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ef0063140 0x7f9ef01542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eeffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ef00b1000 0x7f9ef0140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eeffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef00b2820 0x7f9ef0151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eeffff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0150d40 con 0x7f9ef00b2820 2020-10-31T22:50:46.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eeffff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00ac3d0 con 0x7f9ef0063140 2020-10-31T22:50:46.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eeffff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00660e0 con 0x7f9ef00b1000 2020-10-31T22:50:46.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef00b2820 0x7f9ef0151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eef7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef00b2820 0x7f9ef0151670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49562/0 (socket says 172.21.15.60:49562) 2020-10-31T22:50:46.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eef7fe700 1 -- 172.21.15.60:0/1495120431 learned_addr learned my addr 172.21.15.60:0/1495120431 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:46.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eeeffd700 1 --2- 172.21.15.60:0/1495120431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ef0063140 0x7f9ef01542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9ee7fff700 1 --2- 172.21.15.60:0/1495120431 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ef00b1000 0x7f9ef0140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eef7fe700 1 -- 172.21.15.60:0/1495120431 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ef00b1000 msgr2=0x7f9ef0140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eef7fe700 1 --2- 172.21.15.60:0/1495120431 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ef00b1000 0x7f9ef0140320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eef7fe700 1 -- 172.21.15.60:0/1495120431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ef0063140 msgr2=0x7f9ef01542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eef7fe700 1 --2- 172.21.15.60:0/1495120431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ef0063140 0x7f9ef01542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eef7fe700 1 -- 172.21.15.60:0/1495120431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef00ac130 con 0x7f9ef00b2820 2020-10-31T22:50:46.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eef7fe700 1 --2- 172.21.15.60:0/1495120431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef00b2820 0x7f9ef0151670 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f9ee8001450 tx=0x7f9ee8007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:46.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eecff9700 1 -- 172.21.15.60:0/1495120431 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ee800ce10 con 0x7f9ef00b2820 2020-10-31T22:50:46.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eecff9700 1 -- 172.21.15.60:0/1495120431 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee800a750 con 0x7f9ef00b2820 2020-10-31T22:50:46.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eeffff700 1 -- 172.21.15.60:0/1495120431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef0150f30 con 0x7f9ef00b2820 2020-10-31T22:50:46.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eecff9700 1 -- 172.21.15.60:0/1495120431 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ee800a8c0 con 0x7f9ef00b2820 2020-10-31T22:50:46.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eeffff700 1 -- 172.21.15.60:0/1495120431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef0140890 con 0x7f9ef00b2820 2020-10-31T22:50:46.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.821+0000 7f9eeffff700 1 -- 172.21.15.60:0/1495120431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef01513d0 con 0x7f9ef00b2820 2020-10-31T22:50:46.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.825+0000 7f9eecff9700 1 -- 172.21.15.60:0/1495120431 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9ee8010070 con 0x7f9ef00b2820 2020-10-31T22:50:46.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.825+0000 7f9eecff9700 1 --2- 172.21.15.60:0/1495120431 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ed4054f10 0x7f9ed40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:46.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.825+0000 7f9eecff9700 1 -- 172.21.15.60:0/1495120431 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9ee806d4d0 con 0x7f9ef00b2820 2020-10-31T22:50:46.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.825+0000 7f9eeeffd700 1 --2- 172.21.15.60:0/1495120431 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ed4054f10 0x7f9ed40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:46.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.825+0000 7f9eeeffd700 1 --2- 172.21.15.60:0/1495120431 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ed4054f10 0x7f9ed40573d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f9ee000d000 tx=0x7f9ee0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:46.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.829+0000 7f9eecff9700 1 -- 172.21.15.60:0/1495120431 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9ef01513d0 con 0x7f9ef00b2820 2020-10-31T22:50:46.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.969+0000 7f9eeffff700 1 -- 172.21.15.60:0/1495120431 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ef01513d0 con 0x7f9ef00b2820 2020-10-31T22:50:46.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.973+0000 7f9eecff9700 1 -- 172.21.15.60:0/1495120431 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f9ef01513d0 con 0x7f9ef00b2820 2020-10-31T22:50:46.977 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:46.978 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":149,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:50:46.335277+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:50:43.020680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2020-10-31T22:50:44.329474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:50:46.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.973+0000 7f9eeffff700 1 -- 172.21.15.60:0/1495120431 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ed4054f10 msgr2=0x7f9ed40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.973+0000 7f9eeffff700 1 --2- 172.21.15.60:0/1495120431 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ed4054f10 0x7f9ed40573d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f9ee000d000 tx=0x7f9ee0009040).stop 2020-10-31T22:50:46.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.973+0000 7f9eeffff700 1 -- 172.21.15.60:0/1495120431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef00b2820 msgr2=0x7f9ef0151670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:46.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.973+0000 7f9eeffff700 1 --2- 172.21.15.60:0/1495120431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef00b2820 0x7f9ef0151670 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 rx=0x7f9ee8001450 tx=0x7f9ee8007d30).stop 2020-10-31T22:50:46.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.973+0000 7f9eeffff700 1 -- 172.21.15.60:0/1495120431 shutdown_connections 2020-10-31T22:50:46.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.973+0000 7f9eeffff700 1 --2- 172.21.15.60:0/1495120431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9ef00b2820 0x7f9ef0151670 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.973+0000 7f9eeffff700 1 --2- 172.21.15.60:0/1495120431 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ed4054f10 0x7f9ed40573d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.973+0000 7f9eeffff700 1 --2- 172.21.15.60:0/1495120431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9ef0063140 0x7f9ef01542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.973+0000 7f9eeffff700 1 --2- 172.21.15.60:0/1495120431 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9ef00b1000 0x7f9ef0140320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:46.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.973+0000 7f9eeffff700 1 -- 172.21.15.60:0/1495120431 >> 172.21.15.60:0/1495120431 conn(0x7f9ef006a600 msgr2=0x7f9ef00b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:46.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.973+0000 7f9eeffff700 1 -- 172.21.15.60:0/1495120431 shutdown_connections 2020-10-31T22:50:46.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:46.973+0000 7f9eeffff700 1 -- 172.21.15.60:0/1495120431 wait complete. 2020-10-31T22:50:46.993 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:50:47.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a07fff700 1 Processor -- start 2020-10-31T22:50:47.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a07fff700 1 -- start start 2020-10-31T22:50:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a07fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7a080b1570 0x7f7a08024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a07fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a080803e0 0x7f7a08159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a07fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a080b1950 con 0x7f7a08025480 2020-10-31T22:50:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a07fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a08080870 con 0x7f7a080b1570 2020-10-31T22:50:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a07fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a08025910 con 0x7f7a080803e0 2020-10-31T22:50:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a06ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f7a08025480 0x7f7a0807fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53704/0 (socket says 172.21.15.60:53704) 2020-10-31T22:50:47.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a06ffd700 1 -- 172.21.15.60:0/3515636354 learned_addr learned my addr 172.21.15.60:0/3515636354 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:47.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a0d8b7700 1 --2- 172.21.15.60:0/3515636354 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a080803e0 0x7f7a08159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a077fe700 1 --2- 172.21.15.60:0/3515636354 >> v2:172.21.15.66:3300/0 conn(0x7f7a080b1570 0x7f7a08024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a067fc700 1 -- 172.21.15.60:0/3515636354 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81604751 0 0) 0x7f7a080b1950 con 0x7f7a08025480 2020-10-31T22:50:47.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a067fc700 1 -- 172.21.15.60:0/3515636354 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79f0003230 con 0x7f7a08025480 2020-10-31T22:50:47.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a067fc700 1 -- 172.21.15.60:0/3515636354 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 949154805 0 0) 0x7f79f0003230 con 0x7f7a08025480 2020-10-31T22:50:47.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a0d8b7700 1 -- 172.21.15.60:0/3515636354 >> v2:172.21.15.66:3300/0 conn(0x7f7a080b1570 msgr2=0x7f7a08024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:47.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a0d8b7700 1 --2- 172.21.15.60:0/3515636354 >> v2:172.21.15.66:3300/0 conn(0x7f7a080b1570 0x7f7a08024f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a0d8b7700 1 -- 172.21.15.60:0/3515636354 >> v1:172.21.15.60:6789/0 conn(0x7f7a08025480 legacy=0x7f7a0807fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a0d8b7700 1 -- 172.21.15.60:0/3515636354 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a08062720 con 0x7f7a080803e0 2020-10-31T22:50:47.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a0d8b7700 1 --2- 172.21.15.60:0/3515636354 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a080803e0 0x7f7a08159210 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f79fc001870 tx=0x7f7a000091a0).ready entity=mon.2 client_cookie=6a82ed4249431093 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:47.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a067fc700 1 -- 172.21.15.60:0/3515636354 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79fc0016d0 con 0x7f7a080803e0 2020-10-31T22:50:47.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a067fc700 1 -- 172.21.15.60:0/3515636354 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0000b800 con 0x7f7a080803e0 2020-10-31T22:50:47.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a067fc700 1 -- 172.21.15.60:0/3515636354 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a0000b970 con 0x7f7a080803e0 2020-10-31T22:50:47.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a07fff700 1 -- 172.21.15.60:0/3515636354 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a080803e0 msgr2=0x7f7a08159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.113+0000 7f7a07fff700 1 --2- 172.21.15.60:0/3515636354 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a080803e0 0x7f7a08159210 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7f79fc001870 tx=0x7f7a000091a0).stop 2020-10-31T22:50:47.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.117+0000 7f7a07fff700 1 -- 172.21.15.60:0/3515636354 shutdown_connections 2020-10-31T22:50:47.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.117+0000 7f7a07fff700 1 --2- 172.21.15.60:0/3515636354 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a080803e0 0x7f7a08159210 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.117+0000 7f7a07fff700 1 --2- 172.21.15.60:0/3515636354 >> v2:172.21.15.66:3300/0 conn(0x7f7a080b1570 0x7f7a08024f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.117+0000 7f7a07fff700 1 -- 172.21.15.60:0/3515636354 >> 172.21.15.60:0/3515636354 conn(0x7f7a080b5440 msgr2=0x7f7a080b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:47.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.117+0000 7f7a07fff700 1 -- 172.21.15.60:0/3515636354 shutdown_connections 2020-10-31T22:50:47.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.117+0000 7f7a07fff700 1 -- 172.21.15.60:0/3515636354 wait complete. 2020-10-31T22:50:47.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.117+0000 7f7a07fff700 1 Processor -- start 2020-10-31T22:50:47.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.117+0000 7f7a07fff700 1 -- start start 2020-10-31T22:50:47.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a07fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a08025480 0x7f7a0807ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a07fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a080803e0 0x7f7a080b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a07fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a080b1570 0x7f7a0812ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a07fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a080a43f0 con 0x7f7a08025480 2020-10-31T22:50:47.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a07fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0807ba40 con 0x7f7a080803e0 2020-10-31T22:50:47.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a07fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0807bce0 con 0x7f7a080b1570 2020-10-31T22:50:47.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a077fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a08025480 0x7f7a0807ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a077fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a08025480 0x7f7a0807ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49572/0 (socket says 172.21.15.60:49572) 2020-10-31T22:50:47.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a077fe700 1 -- 172.21.15.60:0/1493584839 learned_addr learned my addr 172.21.15.60:0/1493584839 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:47.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a06ffd700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a080803e0 0x7f7a080b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a0d8b7700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a080b1570 0x7f7a0812ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a077fe700 1 -- 172.21.15.60:0/1493584839 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a080b1570 msgr2=0x7f7a0812ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a077fe700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a080b1570 0x7f7a0812ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a077fe700 1 -- 172.21.15.60:0/1493584839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a080803e0 msgr2=0x7f7a080b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a077fe700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a080803e0 0x7f7a080b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a077fe700 1 -- 172.21.15.60:0/1493584839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a080a4620 con 0x7f7a08025480 2020-10-31T22:50:47.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a06ffd700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a080803e0 0x7f7a080b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:47.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a077fe700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a08025480 0x7f7a0807ca80 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f79f800c000 tx=0x7f79f8008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:47.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f79effff700 1 -- 172.21.15.60:0/1493584839 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79f800c820 con 0x7f7a08025480 2020-10-31T22:50:47.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f79effff700 1 -- 172.21.15.60:0/1493584839 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f800c980 con 0x7f7a08025480 2020-10-31T22:50:47.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a07fff700 1 -- 172.21.15.60:0/1493584839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a0812e210 con 0x7f7a08025480 2020-10-31T22:50:47.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f79effff700 1 -- 172.21.15.60:0/1493584839 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79f800cce0 con 0x7f7a08025480 2020-10-31T22:50:47.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.121+0000 7f7a07fff700 1 -- 172.21.15.60:0/1493584839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a0812f230 con 0x7f7a08025480 2020-10-31T22:50:47.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.125+0000 7f79effff700 1 -- 172.21.15.60:0/1493584839 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f79f8022070 con 0x7f7a08025480 2020-10-31T22:50:47.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.125+0000 7f7a07fff700 1 -- 172.21.15.60:0/1493584839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0807c4a0 con 0x7f7a08025480 2020-10-31T22:50:47.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.125+0000 7f79effff700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f79e8054fc0 0x7f79e8057480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.125+0000 7f79effff700 1 -- 172.21.15.60:0/1493584839 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f79f806de00 con 0x7f7a08025480 2020-10-31T22:50:47.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.125+0000 7f7a06ffd700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f79e8054fc0 0x7f79e8057480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.125+0000 7f7a06ffd700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f79e8054fc0 0x7f79e8057480 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f79fc00b000 tx=0x7f79fc001450).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:47.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.129+0000 7f79effff700 1 -- 172.21.15.60:0/1493584839 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7a0807c4a0 con 0x7f7a08025480 2020-10-31T22:50:47.324 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.321+0000 7f7a07fff700 1 -- 172.21.15.60:0/1493584839 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f7a0807c4a0 con 0x7f7a08025480 2020-10-31T22:50:47.332 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.325+0000 7f79effff700 1 -- 172.21.15.60:0/1493584839 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v31) v1 ==== 184+0+0 (secure 0 0 0) 0x7f7a0807c4a0 con 0x7f7a08025480 2020-10-31T22:50:47.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.329+0000 7f7a07fff700 1 -- 172.21.15.60:0/1493584839 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f79e8054fc0 msgr2=0x7f79e8057480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.334 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.329+0000 7f7a07fff700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f79e8054fc0 0x7f79e8057480 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f79fc00b000 tx=0x7f79fc001450).stop 2020-10-31T22:50:47.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.329+0000 7f7a07fff700 1 -- 172.21.15.60:0/1493584839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a08025480 msgr2=0x7f7a0807ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.329+0000 7f7a07fff700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a08025480 0x7f7a0807ca80 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 rx=0x7f79f800c000 tx=0x7f79f8008040).stop 2020-10-31T22:50:47.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.329+0000 7f7a07fff700 1 -- 172.21.15.60:0/1493584839 shutdown_connections 2020-10-31T22:50:47.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.329+0000 7f7a07fff700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7a080b1570 0x7f7a0812ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.329+0000 7f7a07fff700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a08025480 0x7f7a0807ca80 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.335 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.329+0000 7f7a07fff700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f79e8054fc0 0x7f79e8057480 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.329+0000 7f7a07fff700 1 --2- 172.21.15.60:0/1493584839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7a080803e0 0x7f7a080b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.329+0000 7f7a07fff700 1 -- 172.21.15.60:0/1493584839 >> 172.21.15.60:0/1493584839 conn(0x7f7a080b5440 msgr2=0x7f7a0807f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:47.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.329+0000 7f7a07fff700 1 -- 172.21.15.60:0/1493584839 shutdown_connections 2020-10-31T22:50:47.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.329+0000 7f7a07fff700 1 -- 172.21.15.60:0/1493584839 wait complete. 2020-10-31T22:50:47.336 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2020-10-31T22:50:47.347 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:50:47.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a46dd4700 1 Processor -- start 2020-10-31T22:50:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a46dd4700 1 -- start start 2020-10-31T22:50:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a46dd4700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9a4005b320 0x7f9a4007ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a46dd4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4005b700 con 0x7f9a400ae200 2020-10-31T22:50:47.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a46dd4700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a400807c0 con 0x7f9a400ac110 2020-10-31T22:50:47.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a46dd4700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a400ab730 con 0x7f9a4005b320 2020-10-31T22:50:47.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a44b70700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f9a400ae200 0x7f9a400a74b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53716/0 (socket says 172.21.15.60:53716) 2020-10-31T22:50:47.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a44b70700 1 -- 172.21.15.60:0/1345533231 learned_addr learned my addr 172.21.15.60:0/1345533231 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:47.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a45371700 1 --2- 172.21.15.60:0/1345533231 >> v2:172.21.15.66:3300/0 conn(0x7f9a4005b320 0x7f9a4007ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 -- 172.21.15.60:0/1345533231 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3991154677 0 0) 0x7f9a4005b700 con 0x7f9a400ae200 2020-10-31T22:50:47.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 -- 172.21.15.60:0/1345533231 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a2c003230 con 0x7f9a400ae200 2020-10-31T22:50:47.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 -- 172.21.15.60:0/1345533231 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3565589240 0 0) 0x7f9a2c003230 con 0x7f9a400ae200 2020-10-31T22:50:47.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 -- 172.21.15.60:0/1345533231 >> v2:172.21.15.66:3300/0 conn(0x7f9a4005b320 msgr2=0x7f9a4007ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:47.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 --2- 172.21.15.60:0/1345533231 >> v2:172.21.15.66:3300/0 conn(0x7f9a4005b320 0x7f9a4007ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 -- 172.21.15.60:0/1345533231 >> v1:172.21.15.66:6789/0 conn(0x7f9a400ac110 legacy=0x7f9a400af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 -- 172.21.15.60:0/1345533231 --> v1:172.21.15.60:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400ab9d0 con 0x7f9a400ae200 2020-10-31T22:50:47.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 -- 172.21.15.60:0/1345533231 <== mon.0 v1:172.21.15.60:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 429557001 0 0) 0x7f9a300016d0 con 0x7f9a400ae200 2020-10-31T22:50:47.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 -- 172.21.15.60:0/1345533231 >> v1:172.21.15.60:6789/0 conn(0x7f9a400ae200 legacy=0x7f9a400a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 --2- 172.21.15.60:0/1345533231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a2c003720 0x7f9a2c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 --2- 172.21.15.60:0/1345533231 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a2c0044d0 0x7f9a2c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 --2- 172.21.15.60:0/1345533231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a2c004e40 0x7f9a2c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 -- 172.21.15.60:0/1345533231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400ab730 con 0x7f9a2c004e40 2020-10-31T22:50:47.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a45b72700 1 --2- 172.21.15.60:0/1345533231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a2c004e40 0x7f9a2c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 -- 172.21.15.60:0/1345533231 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c004310 con 0x7f9a2c003720 2020-10-31T22:50:47.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a37fff700 1 -- 172.21.15.60:0/1345533231 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c04fc70 con 0x7f9a2c0044d0 2020-10-31T22:50:47.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a44b70700 1 --2- 172.21.15.60:0/1345533231 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a2c0044d0 0x7f9a2c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a45371700 1 --2- 172.21.15.60:0/1345533231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a2c003720 0x7f9a2c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a45b72700 1 -- 172.21.15.60:0/1345533231 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a2c0044d0 msgr2=0x7f9a2c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:47.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a45b72700 1 --2- 172.21.15.60:0/1345533231 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a2c0044d0 0x7f9a2c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a45b72700 1 -- 172.21.15.60:0/1345533231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a2c003720 msgr2=0x7f9a2c003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:47.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a45b72700 1 --2- 172.21.15.60:0/1345533231 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a2c003720 0x7f9a2c003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.477+0000 7f9a45b72700 1 -- 172.21.15.60:0/1345533231 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c003230 con 0x7f9a2c004e40 2020-10-31T22:50:47.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.481+0000 7f9a45b72700 1 -- 172.21.15.60:0/1345533231 reap_dead start 2020-10-31T22:50:47.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.481+0000 7f9a45b72700 1 --2- 172.21.15.60:0/1345533231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a2c004e40 0x7f9a2c00b720 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f9a2c0054a0 tx=0x7f9a38007e30).ready entity=mon.0 client_cookie=31bba614663b35bd server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:47.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.481+0000 7f9a37fff700 1 -- 172.21.15.60:0/1345533231 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a3800c900 con 0x7f9a2c004e40 2020-10-31T22:50:47.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.481+0000 7f9a37fff700 1 -- 172.21.15.60:0/1345533231 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3800ca60 con 0x7f9a2c004e40 2020-10-31T22:50:47.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.481+0000 7f9a37fff700 1 -- 172.21.15.60:0/1345533231 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a3800cdc0 con 0x7f9a2c004e40 2020-10-31T22:50:47.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.481+0000 7f9a46dd4700 1 -- 172.21.15.60:0/1345533231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a2c004e40 msgr2=0x7f9a2c00b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.481+0000 7f9a46dd4700 1 --2- 172.21.15.60:0/1345533231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a2c004e40 0x7f9a2c00b720 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 rx=0x7f9a2c0054a0 tx=0x7f9a38007e30).stop 2020-10-31T22:50:47.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.481+0000 7f9a46dd4700 1 -- 172.21.15.60:0/1345533231 shutdown_connections 2020-10-31T22:50:47.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.481+0000 7f9a46dd4700 1 --2- 172.21.15.60:0/1345533231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a2c004e40 0x7f9a2c00b720 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.481+0000 7f9a46dd4700 1 -- 172.21.15.60:0/1345533231 >> 172.21.15.60:0/1345533231 conn(0x7f9a400b3fd0 msgr2=0x7f9a400b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:47.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.481+0000 7f9a46dd4700 1 -- 172.21.15.60:0/1345533231 shutdown_connections 2020-10-31T22:50:47.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.481+0000 7f9a46dd4700 1 -- 172.21.15.60:0/1345533231 wait complete. 2020-10-31T22:50:47.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.481+0000 7f9a46dd4700 1 Processor -- start 2020-10-31T22:50:47.497 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.481+0000 7f9a46dd4700 1 -- start start 2020-10-31T22:50:47.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a46dd4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a2c004e40 0x7f9a400b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a46dd4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a40066d00 0x7f9a40141150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a46dd4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a40141640 0x7f9a40065f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.498 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a46dd4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400a2fb0 con 0x7f9a40141640 2020-10-31T22:50:47.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a46dd4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a40140cf0 con 0x7f9a40066d00 2020-10-31T22:50:47.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a46dd4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a400a1020 con 0x7f9a2c004e40 2020-10-31T22:50:47.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a45b72700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a40141640 0x7f9a40065f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a45b72700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a40141640 0x7f9a40065f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49596/0 (socket says 172.21.15.60:49596) 2020-10-31T22:50:47.499 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a45b72700 1 -- 172.21.15.60:0/2148014384 learned_addr learned my addr 172.21.15.60:0/2148014384 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:47.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a44b70700 1 --2- 172.21.15.60:0/2148014384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a40066d00 0x7f9a40141150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a45371700 1 --2- 172.21.15.60:0/2148014384 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a2c004e40 0x7f9a400b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a45b72700 1 -- 172.21.15.60:0/2148014384 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a2c004e40 msgr2=0x7f9a400b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a45b72700 1 --2- 172.21.15.60:0/2148014384 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a2c004e40 0x7f9a400b2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a45b72700 1 -- 172.21.15.60:0/2148014384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a40066d00 msgr2=0x7f9a40141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.500 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a45b72700 1 --2- 172.21.15.60:0/2148014384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a40066d00 0x7f9a40141150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a45b72700 1 -- 172.21.15.60:0/2148014384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a40141aa0 con 0x7f9a40141640 2020-10-31T22:50:47.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a45b72700 1 --2- 172.21.15.60:0/2148014384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a40141640 0x7f9a40065f80 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f9a2c0054a0 tx=0x7f9a38016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:47.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a35ffb700 1 -- 172.21.15.60:0/2148014384 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a38006860 con 0x7f9a40141640 2020-10-31T22:50:47.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a35ffb700 1 -- 172.21.15.60:0/2148014384 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a380069c0 con 0x7f9a40141640 2020-10-31T22:50:47.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a46dd4700 1 -- 172.21.15.60:0/2148014384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a400a12c0 con 0x7f9a40141640 2020-10-31T22:50:47.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a35ffb700 1 -- 172.21.15.60:0/2148014384 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9a38006d20 con 0x7f9a40141640 2020-10-31T22:50:47.501 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a46dd4700 1 -- 172.21.15.60:0/2148014384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a40065a40 con 0x7f9a40141640 2020-10-31T22:50:47.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.485+0000 7f9a46dd4700 1 -- 172.21.15.60:0/2148014384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a400a03e0 con 0x7f9a40141640 2020-10-31T22:50:47.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.489+0000 7f9a35ffb700 1 -- 172.21.15.60:0/2148014384 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9a38025030 con 0x7f9a40141640 2020-10-31T22:50:47.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.489+0000 7f9a35ffb700 1 --2- 172.21.15.60:0/2148014384 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a20054f90 0x7f9a20057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.489+0000 7f9a45371700 1 --2- 172.21.15.60:0/2148014384 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a20054f90 0x7f9a20057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.489+0000 7f9a35ffb700 1 -- 172.21.15.60:0/2148014384 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9a3806ef50 con 0x7f9a40141640 2020-10-31T22:50:47.502 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.489+0000 7f9a45371700 1 --2- 172.21.15.60:0/2148014384 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a20054f90 0x7f9a20057450 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f9a3c008000 tx=0x7f9a3c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:47.503 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.493+0000 7f9a35ffb700 1 -- 172.21.15.60:0/2148014384 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9a38045470 con 0x7f9a40141640 2020-10-31T22:50:47.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.685+0000 7f9a46dd4700 1 -- 172.21.15.60:0/2148014384 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f9a40057100 con 0x7f9a40141640 2020-10-31T22:50:47.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.697+0000 7f9a35ffb700 1 -- 172.21.15.60:0/2148014384 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v32) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9a38023070 con 0x7f9a40141640 2020-10-31T22:50:47.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.701+0000 7f9a46dd4700 1 -- 172.21.15.60:0/2148014384 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a20054f90 msgr2=0x7f9a20057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.701+0000 7f9a46dd4700 1 --2- 172.21.15.60:0/2148014384 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a20054f90 0x7f9a20057450 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7f9a3c008000 tx=0x7f9a3c008040).stop 2020-10-31T22:50:47.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.701+0000 7f9a46dd4700 1 -- 172.21.15.60:0/2148014384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a40141640 msgr2=0x7f9a40065f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.701+0000 7f9a46dd4700 1 --2- 172.21.15.60:0/2148014384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a40141640 0x7f9a40065f80 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 rx=0x7f9a2c0054a0 tx=0x7f9a38016000).stop 2020-10-31T22:50:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.701+0000 7f9a46dd4700 1 -- 172.21.15.60:0/2148014384 shutdown_connections 2020-10-31T22:50:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.701+0000 7f9a46dd4700 1 --2- 172.21.15.60:0/2148014384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a40141640 0x7f9a40065f80 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.701+0000 7f9a46dd4700 1 --2- 172.21.15.60:0/2148014384 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a2c004e40 0x7f9a400b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.701+0000 7f9a46dd4700 1 --2- 172.21.15.60:0/2148014384 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9a20054f90 0x7f9a20057450 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.701+0000 7f9a46dd4700 1 --2- 172.21.15.60:0/2148014384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a40066d00 0x7f9a40141150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.701+0000 7f9a46dd4700 1 -- 172.21.15.60:0/2148014384 >> 172.21.15.60:0/2148014384 conn(0x7f9a400b3fd0 msgr2=0x7f9a400b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:47.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.701+0000 7f9a46dd4700 1 -- 172.21.15.60:0/2148014384 shutdown_connections 2020-10-31T22:50:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.701+0000 7f9a46dd4700 1 -- 172.21.15.60:0/2148014384 wait complete. 2020-10-31T22:50:47.708 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.1 2020-10-31T22:50:47.724 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:50:47.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 Processor -- start 2020-10-31T22:50:47.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 -- start start 2020-10-31T22:50:47.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fefd00b24a0 0x7fefd00b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fefd0141fe0 0x7fefd0142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefd0145180 con 0x7fefd00b5570 2020-10-31T22:50:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd00afae0 con 0x7fefd0141fe0 2020-10-31T22:50:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefd0141bf0 con 0x7fefd00b24a0 2020-10-31T22:50:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd4ca8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fefd0141fe0 0x7fefd0142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd4ca8700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fefd0141fe0 0x7fefd0142490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49604/0 (socket says 172.21.15.60:49604) 2020-10-31T22:50:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd4ca8700 1 -- 172.21.15.60:0/3394500562 learned_addr learned my addr 172.21.15.60:0/3394500562 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefcf7fe700 1 --2- 172.21.15.60:0/3394500562 >> v2:172.21.15.66:3300/0 conn(0x7fefd00b24a0 0x7fefd00b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd4ca8700 1 -- 172.21.15.60:0/3394500562 >> v2:172.21.15.66:3300/0 conn(0x7fefd00b24a0 msgr2=0x7fefd00b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:47.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd4ca8700 1 --2- 172.21.15.60:0/3394500562 >> v2:172.21.15.66:3300/0 conn(0x7fefd00b24a0 0x7fefd00b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd4ca8700 1 -- 172.21.15.60:0/3394500562 >> v1:172.21.15.66:6789/0 conn(0x7fefd00b5570 legacy=0x7fefd0145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd4ca8700 1 -- 172.21.15.60:0/3394500562 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd00b0670 con 0x7fefd0141fe0 2020-10-31T22:50:47.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefcf7fe700 1 --2- 172.21.15.60:0/3394500562 >> v2:172.21.15.66:3300/0 conn(0x7fefd00b24a0 0x7fefd00b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:47.849 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd4ca8700 1 --2- 172.21.15.60:0/3394500562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefd0141fe0 0x7fefd0142490 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fefd005f580 tx=0x7fefc8006e80).ready entity=mon.0 client_cookie=fa930f5caf62db0c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:47.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefceffd700 1 -- 172.21.15.60:0/3394500562 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc80097b0 con 0x7fefd0141fe0 2020-10-31T22:50:47.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefceffd700 1 -- 172.21.15.60:0/3394500562 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc8009910 con 0x7fefd0141fe0 2020-10-31T22:50:47.852 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefceffd700 1 -- 172.21.15.60:0/3394500562 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc8009c70 con 0x7fefd0141fe0 2020-10-31T22:50:47.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 -- 172.21.15.60:0/3394500562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefd0141fe0 msgr2=0x7fefd0142490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 --2- 172.21.15.60:0/3394500562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefd0141fe0 0x7fefd0142490 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 rx=0x7fefd005f580 tx=0x7fefc8006e80).stop 2020-10-31T22:50:47.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 -- 172.21.15.60:0/3394500562 shutdown_connections 2020-10-31T22:50:47.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 --2- 172.21.15.60:0/3394500562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefd0141fe0 0x7fefd0142490 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 --2- 172.21.15.60:0/3394500562 >> v2:172.21.15.66:3300/0 conn(0x7fefd00b24a0 0x7fefd00b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 -- 172.21.15.60:0/3394500562 >> 172.21.15.60:0/3394500562 conn(0x7fefd00b8e90 msgr2=0x7fefd00b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:47.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 -- 172.21.15.60:0/3394500562 shutdown_connections 2020-10-31T22:50:47.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.841+0000 7fefd54a9700 1 -- 172.21.15.60:0/3394500562 wait complete. 2020-10-31T22:50:47.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.845+0000 7fefd54a9700 1 Processor -- start 2020-10-31T22:50:47.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.845+0000 7fefd54a9700 1 -- start start 2020-10-31T22:50:47.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd54a9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefd00b24a0 0x7fefd0144320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.861 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd54a9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefd00b5570 0x7fefd0150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd54a9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefd0141fe0 0x7fefd0151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd54a9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0146830 con 0x7fefd00b5570 2020-10-31T22:50:47.862 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd54a9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0154bc0 con 0x7fefd00b24a0 2020-10-31T22:50:47.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd54a9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0154e60 con 0x7fefd0141fe0 2020-10-31T22:50:47.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefcf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefd00b5570 0x7fefd0150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.863 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefcf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefd00b5570 0x7fefd0150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49608/0 (socket says 172.21.15.60:49608) 2020-10-31T22:50:47.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefcf7fe700 1 -- 172.21.15.60:0/708714100 learned_addr learned my addr 172.21.15.60:0/708714100 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:47.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd4ca8700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefd0141fe0 0x7fefd0151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefcffff700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefd00b24a0 0x7fefd0144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.864 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd4ca8700 1 -- 172.21.15.60:0/708714100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefd00b24a0 msgr2=0x7fefd0144320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd4ca8700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefd00b24a0 0x7fefd0144320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd4ca8700 1 -- 172.21.15.60:0/708714100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefd00b5570 msgr2=0x7fefd0150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:47.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd4ca8700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefd00b5570 0x7fefd0150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:47.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd4ca8700 1 -- 172.21.15.60:0/708714100 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd0146a60 con 0x7fefd0141fe0 2020-10-31T22:50:47.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefcffff700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefd00b24a0 0x7fefd0144320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:47.865 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefcf7fe700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefd00b5570 0x7fefd0150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:47.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd4ca8700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefd0141fe0 0x7fefd0151190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fefd005f580 tx=0x7fefc8015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:47.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefcd7fa700 1 -- 172.21.15.60:0/708714100 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc8011b80 con 0x7fefd0141fe0 2020-10-31T22:50:47.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefcd7fa700 1 -- 172.21.15.60:0/708714100 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefc8011ce0 con 0x7fefd0141fe0 2020-10-31T22:50:47.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd54a9700 1 -- 172.21.15.60:0/708714100 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd0144a80 con 0x7fefd0141fe0 2020-10-31T22:50:47.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefcd7fa700 1 -- 172.21.15.60:0/708714100 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fefc801e650 con 0x7fefd0141fe0 2020-10-31T22:50:47.866 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd54a9700 1 -- 172.21.15.60:0/708714100 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd01518a0 con 0x7fefd0141fe0 2020-10-31T22:50:47.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.849+0000 7fefd54a9700 1 -- 172.21.15.60:0/708714100 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd0146bf0 con 0x7fefd0141fe0 2020-10-31T22:50:47.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.853+0000 7fefcd7fa700 1 -- 172.21.15.60:0/708714100 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fefc801a040 con 0x7fefd0141fe0 2020-10-31T22:50:47.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.853+0000 7fefcd7fa700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fefb4054f30 0x7fefb40573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:47.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.853+0000 7fefcd7fa700 1 -- 172.21.15.60:0/708714100 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fefc806e830 con 0x7fefd0141fe0 2020-10-31T22:50:47.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.853+0000 7fefcffff700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fefb4054f30 0x7fefb40573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:47.867 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.853+0000 7fefcffff700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fefb4054f30 0x7fefb40573f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fefc000d000 tx=0x7fefc0009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:47.869 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:47.865+0000 7fefcd7fa700 1 -- 172.21.15.60:0/708714100 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fefc8044bc0 con 0x7fefd0141fe0 2020-10-31T22:50:48.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.053+0000 7fefd54a9700 1 -- 172.21.15.60:0/708714100 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefd0057100 con 0x7fefd0141fe0 2020-10-31T22:50:48.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.053+0000 7fefcd7fa700 1 -- 172.21.15.60:0/708714100 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2495 (secure 0 0 0) 0x7fefc80239d0 con 0x7fefd0141fe0 2020-10-31T22:50:48.058 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:48.059 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":76,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7085,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/2329273308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2329273308},{"type":"v1","addr":"172.21.15.66:6833","nonce":2329273308}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6835/4086841612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":4086841612},{"type":"v1","addr":"172.21.15.60:6835","nonce":4086841612}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:45.331860+0000","modified":"2020-10-31T22:50:46.335175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8232":{"gid":8232,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2095394176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2095394176},{"type":"v1","addr":"172.21.15.60:6837","nonce":2095394176}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-10-31T22:50:48.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.053+0000 7fefd54a9700 1 -- 172.21.15.60:0/708714100 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fefb4054f30 msgr2=0x7fefb40573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:48.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.053+0000 7fefd54a9700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fefb4054f30 0x7fefb40573f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fefc000d000 tx=0x7fefc0009040).stop 2020-10-31T22:50:48.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.053+0000 7fefd54a9700 1 -- 172.21.15.60:0/708714100 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefd0141fe0 msgr2=0x7fefd0151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:48.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.053+0000 7fefd54a9700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefd0141fe0 0x7fefd0151190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fefd005f580 tx=0x7fefc8015000).stop 2020-10-31T22:50:48.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.053+0000 7fefd54a9700 1 -- 172.21.15.60:0/708714100 shutdown_connections 2020-10-31T22:50:48.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.053+0000 7fefd54a9700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefd0141fe0 0x7fefd0151190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.053+0000 7fefd54a9700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fefb4054f30 0x7fefb40573f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.053+0000 7fefd54a9700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefd00b24a0 0x7fefd0144320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.053+0000 7fefd54a9700 1 --2- 172.21.15.60:0/708714100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefd00b5570 0x7fefd0150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.061 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.053+0000 7fefd54a9700 1 -- 172.21.15.60:0/708714100 >> 172.21.15.60:0/708714100 conn(0x7fefd00b8e90 msgr2=0x7fefd00b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:48.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.053+0000 7fefd54a9700 1 -- 172.21.15.60:0/708714100 shutdown_connections 2020-10-31T22:50:48.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.057+0000 7fefd54a9700 1 -- 172.21.15.60:0/708714100 wait complete. 2020-10-31T22:50:48.062 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 76 2020-10-31T22:50:48.377 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:50:45.331860+0000', 'modified': '2020-10-31T22:50:46.335175+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8232}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8232': {'gid': 8232, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/2095394176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 2095394176}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 2095394176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:50:48.378 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:50:48.379 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:50:48.518 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":8232,"want_state":"up:active","state":"up:active","rank_uptime":3.173671701,"mdsmap_epoch":76,"osdmap_epoch":149,"osdmap_epoch_barrier":148,"uptime":8.4040205459999999} 2020-10-31T22:50:48.519 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 8232, "mdsmap_epoch": 76, "osdmap_epoch": 149, "osdmap_epoch_barrier": 148, "rank_uptime": 3.173671701, "state": "up:active", "uptime": 8.404020546, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:50:48.520 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:50:48.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d1e50700 1 Processor -- start 2020-10-31T22:50:48.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d1e50700 1 -- start start 2020-10-31T22:50:48.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d1e50700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f53cc0af520 0x7f53cc0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:48.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d1e50700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f53cc066c90 0x7f53cc0670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:48.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d1e50700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f53cc146060 0x7f53cc1464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:48.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d1e50700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc0af900 con 0x7f53cc0af520 2020-10-31T22:50:48.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d1e50700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc0afc10 con 0x7f53cc066c90 2020-10-31T22:50:48.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d1e50700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc05bb70 con 0x7f53cc146060 2020-10-31T22:50:48.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d0e4e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f53cc0af520 0x7f53cc0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:48.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53cbfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f53cc066c90 0x7f53cc0670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:48.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d0e4e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f53cc0af520 0x7f53cc0ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49616/0 (socket says 172.21.15.60:49616) 2020-10-31T22:50:48.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d0e4e700 1 -- 172.21.15.60:0/2824798278 learned_addr learned my addr 172.21.15.60:0/2824798278 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:48.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d164f700 1 --2- 172.21.15.60:0/2824798278 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f53cc146060 0x7f53cc1464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:48.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d0e4e700 1 -- 172.21.15.60:0/2824798278 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f53cc146060 msgr2=0x7f53cc1464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:48.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d0e4e700 1 --2- 172.21.15.60:0/2824798278 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f53cc146060 0x7f53cc1464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d0e4e700 1 -- 172.21.15.60:0/2824798278 >> v2:172.21.15.66:3300/0 conn(0x7f53cc066c90 msgr2=0x7f53cc0670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:48.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d0e4e700 1 --2- 172.21.15.60:0/2824798278 >> v2:172.21.15.66:3300/0 conn(0x7f53cc066c90 0x7f53cc0670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d0e4e700 1 -- 172.21.15.60:0/2824798278 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc0ac130 con 0x7f53cc0af520 2020-10-31T22:50:48.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53d0e4e700 1 --2- 172.21.15.60:0/2824798278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc0af520 0x7f53cc0ac870 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f53c0002f30 tx=0x7f53c0006e80).ready entity=mon.0 client_cookie=db47c9e99f168d0f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:48.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53cb7fe700 1 -- 172.21.15.60:0/2824798278 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c0009640 con 0x7f53cc0af520 2020-10-31T22:50:48.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.633+0000 7f53cb7fe700 1 -- 172.21.15.60:0/2824798278 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c00097a0 con 0x7f53cc0af520 2020-10-31T22:50:48.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.637+0000 7f53cb7fe700 1 -- 172.21.15.60:0/2824798278 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c0009b00 con 0x7f53cc0af520 2020-10-31T22:50:48.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.637+0000 7f53d1e50700 1 -- 172.21.15.60:0/2824798278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc0af520 msgr2=0x7f53cc0ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:48.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.637+0000 7f53d1e50700 1 --2- 172.21.15.60:0/2824798278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc0af520 0x7f53cc0ac870 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 rx=0x7f53c0002f30 tx=0x7f53c0006e80).stop 2020-10-31T22:50:48.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.637+0000 7f53d1e50700 1 -- 172.21.15.60:0/2824798278 shutdown_connections 2020-10-31T22:50:48.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.637+0000 7f53d1e50700 1 --2- 172.21.15.60:0/2824798278 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f53cc146060 0x7f53cc1464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.637+0000 7f53d1e50700 1 --2- 172.21.15.60:0/2824798278 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc0af520 0x7f53cc0ac870 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.637+0000 7f53d1e50700 1 --2- 172.21.15.60:0/2824798278 >> v2:172.21.15.66:3300/0 conn(0x7f53cc066c90 0x7f53cc0670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.637+0000 7f53d1e50700 1 -- 172.21.15.60:0/2824798278 >> 172.21.15.60:0/2824798278 conn(0x7f53cc0b3fd0 msgr2=0x7f53cc0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:48.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.637+0000 7f53d1e50700 1 -- 172.21.15.60:0/2824798278 shutdown_connections 2020-10-31T22:50:48.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.637+0000 7f53d1e50700 1 -- 172.21.15.60:0/2824798278 wait complete. 2020-10-31T22:50:48.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.637+0000 7f53d1e50700 1 Processor -- start 2020-10-31T22:50:48.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.637+0000 7f53d1e50700 1 -- start start 2020-10-31T22:50:48.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d1e50700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53cc066c90 0x7f53cc061620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:48.646 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d1e50700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f53cc0af520 0x7f53cc0ada60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:48.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d1e50700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc146060 0x7f53cc061dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:48.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d1e50700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc064690 con 0x7f53cc146060 2020-10-31T22:50:48.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d1e50700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0aa530 con 0x7f53cc066c90 2020-10-31T22:50:48.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d1e50700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc0aa7d0 con 0x7f53cc0af520 2020-10-31T22:50:48.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d164f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc146060 0x7f53cc061dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:48.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d164f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc146060 0x7f53cc061dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49624/0 (socket says 172.21.15.60:49624) 2020-10-31T22:50:48.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d164f700 1 -- 172.21.15.60:0/4068364576 learned_addr learned my addr 172.21.15.60:0/4068364576 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:48.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d0e4e700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53cc066c90 0x7f53cc061620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:48.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53cbfff700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f53cc0af520 0x7f53cc0ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:48.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d164f700 1 -- 172.21.15.60:0/4068364576 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f53cc0af520 msgr2=0x7f53cc0ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:48.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d164f700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f53cc0af520 0x7f53cc0ada60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d164f700 1 -- 172.21.15.60:0/4068364576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53cc066c90 msgr2=0x7f53cc061620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:48.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d164f700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53cc066c90 0x7f53cc061620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d164f700 1 -- 172.21.15.60:0/4068364576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc0a97f0 con 0x7f53cc146060 2020-10-31T22:50:48.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53cbfff700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f53cc0af520 0x7f53cc0ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:48.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d0e4e700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53cc066c90 0x7f53cc061620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:48.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d164f700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc146060 0x7f53cc061dc0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f53c4006a50 tx=0x7f53c4006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:48.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53c9ffb700 1 -- 172.21.15.60:0/4068364576 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c400ca60 con 0x7f53cc146060 2020-10-31T22:50:48.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53c9ffb700 1 -- 172.21.15.60:0/4068364576 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c400cbc0 con 0x7f53cc146060 2020-10-31T22:50:48.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d1e50700 1 -- 172.21.15.60:0/4068364576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc0a9b50 con 0x7f53cc146060 2020-10-31T22:50:48.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53c9ffb700 1 -- 172.21.15.60:0/4068364576 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53c40123f0 con 0x7f53cc146060 2020-10-31T22:50:48.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d1e50700 1 -- 172.21.15.60:0/4068364576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc155160 con 0x7f53cc146060 2020-10-31T22:50:48.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.641+0000 7f53d1e50700 1 -- 172.21.15.60:0/4068364576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc0aa990 con 0x7f53cc146060 2020-10-31T22:50:48.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.645+0000 7f53c9ffb700 1 -- 172.21.15.60:0/4068364576 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f53c4012550 con 0x7f53cc146060 2020-10-31T22:50:48.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.645+0000 7f53c9ffb700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f53ac055020 0x7f53ac0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:48.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.645+0000 7f53c9ffb700 1 -- 172.21.15.60:0/4068364576 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f53c406dff0 con 0x7f53cc146060 2020-10-31T22:50:48.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.645+0000 7f53d0e4e700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f53ac055020 0x7f53ac0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:48.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.645+0000 7f53d0e4e700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f53ac055020 0x7f53ac0574e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f53c0019000 tx=0x7f53c0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:48.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.649+0000 7f53c9ffb700 1 -- 172.21.15.60:0/4068364576 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f53c4044400 con 0x7f53cc146060 2020-10-31T22:50:48.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.793+0000 7f53d1e50700 1 -- 172.21.15.60:0/4068364576 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53cc057100 con 0x7f53cc146060 2020-10-31T22:50:48.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.793+0000 7f53c9ffb700 1 -- 172.21.15.60:0/4068364576 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f53c4047a20 con 0x7f53cc146060 2020-10-31T22:50:48.800 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:48.801 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":149,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:50:46.335277+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:50:43.020680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2020-10-31T22:50:44.329474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:50:48.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.797+0000 7f53d1e50700 1 -- 172.21.15.60:0/4068364576 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f53ac055020 msgr2=0x7f53ac0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:48.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.797+0000 7f53d1e50700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f53ac055020 0x7f53ac0574e0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f53c0019000 tx=0x7f53c0015000).stop 2020-10-31T22:50:48.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.797+0000 7f53d1e50700 1 -- 172.21.15.60:0/4068364576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc146060 msgr2=0x7f53cc061dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:48.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.797+0000 7f53d1e50700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc146060 0x7f53cc061dc0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 rx=0x7f53c4006a50 tx=0x7f53c4006dc0).stop 2020-10-31T22:50:48.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.797+0000 7f53d1e50700 1 -- 172.21.15.60:0/4068364576 shutdown_connections 2020-10-31T22:50:48.802 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.797+0000 7f53d1e50700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f53cc146060 0x7f53cc061dc0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.797+0000 7f53d1e50700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f53ac055020 0x7f53ac0574e0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.797+0000 7f53d1e50700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f53cc066c90 0x7f53cc061620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.797+0000 7f53d1e50700 1 --2- 172.21.15.60:0/4068364576 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f53cc0af520 0x7f53cc0ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.797+0000 7f53d1e50700 1 -- 172.21.15.60:0/4068364576 >> 172.21.15.60:0/4068364576 conn(0x7f53cc0b3fd0 msgr2=0x7f53cc0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:48.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.797+0000 7f53d1e50700 1 -- 172.21.15.60:0/4068364576 shutdown_connections 2020-10-31T22:50:48.803 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.797+0000 7f53d1e50700 1 -- 172.21.15.60:0/4068364576 wait complete. 2020-10-31T22:50:48.815 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:50:43.020680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:50:44.329474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '149', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:50:48.816 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:50:48.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e80d700 1 Processor -- start 2020-10-31T22:50:48.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e80d700 1 -- start start 2020-10-31T22:50:48.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e80d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff3280b5570 0x7ff3280b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:48.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e80d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3280b24a0 0x7ff328145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:48.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e80d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff328145e40 0x7ff328141f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:48.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e80d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32813f930 con 0x7ff328145e40 2020-10-31T22:50:48.949 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e80d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3280b4440 con 0x7ff3280b5570 2020-10-31T22:50:48.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e80d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3280b02f0 con 0x7ff3280b24a0 2020-10-31T22:50:48.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e00c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff328145e40 0x7ff328141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:48.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e00c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff328145e40 0x7ff328141f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49632/0 (socket says 172.21.15.60:49632) 2020-10-31T22:50:48.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e00c700 1 -- 172.21.15.60:0/2085407663 learned_addr learned my addr 172.21.15.60:0/2085407663 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:48.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32d80b700 1 --2- 172.21.15.60:0/2085407663 >> v2:172.21.15.66:3300/0 conn(0x7ff3280b5570 0x7ff3280b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:48.950 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32d00a700 1 --2- 172.21.15.60:0/2085407663 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3280b24a0 0x7ff328145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:48.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e00c700 1 -- 172.21.15.60:0/2085407663 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3280b24a0 msgr2=0x7ff328145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:48.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e00c700 1 --2- 172.21.15.60:0/2085407663 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3280b24a0 0x7ff328145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e00c700 1 -- 172.21.15.60:0/2085407663 >> v2:172.21.15.66:3300/0 conn(0x7ff3280b5570 msgr2=0x7ff3280b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:48.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e00c700 1 --2- 172.21.15.60:0/2085407663 >> v2:172.21.15.66:3300/0 conn(0x7ff3280b5570 0x7ff3280b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e00c700 1 -- 172.21.15.60:0/2085407663 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3280b0590 con 0x7ff328145e40 2020-10-31T22:50:48.951 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32d80b700 1 --2- 172.21.15.60:0/2085407663 >> v2:172.21.15.66:3300/0 conn(0x7ff3280b5570 0x7ff3280b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:48.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.941+0000 7ff32e00c700 1 --2- 172.21.15.60:0/2085407663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff328145e40 0x7ff328141f00 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7ff328141c20 tx=0x7ff320009270).ready entity=mon.0 client_cookie=4fabcefff2982e52 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:48.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32c809700 1 -- 172.21.15.60:0/2085407663 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff32000bbc0 con 0x7ff328145e40 2020-10-31T22:50:48.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32c809700 1 -- 172.21.15.60:0/2085407663 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff32000bd20 con 0x7ff328145e40 2020-10-31T22:50:48.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32c809700 1 -- 172.21.15.60:0/2085407663 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff32000be90 con 0x7ff328145e40 2020-10-31T22:50:48.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 -- 172.21.15.60:0/2085407663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff328145e40 msgr2=0x7ff328141f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:48.952 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 --2- 172.21.15.60:0/2085407663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff328145e40 0x7ff328141f00 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 rx=0x7ff328141c20 tx=0x7ff320009270).stop 2020-10-31T22:50:48.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 -- 172.21.15.60:0/2085407663 shutdown_connections 2020-10-31T22:50:48.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 --2- 172.21.15.60:0/2085407663 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff328145e40 0x7ff328141f00 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 --2- 172.21.15.60:0/2085407663 >> v2:172.21.15.66:3300/0 conn(0x7ff3280b5570 0x7ff3280b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 --2- 172.21.15.60:0/2085407663 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3280b24a0 0x7ff328145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 -- 172.21.15.60:0/2085407663 >> 172.21.15.60:0/2085407663 conn(0x7ff3280b8e90 msgr2=0x7ff3280b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:48.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 -- 172.21.15.60:0/2085407663 shutdown_connections 2020-10-31T22:50:48.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 -- 172.21.15.60:0/2085407663 wait complete. 2020-10-31T22:50:48.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 Processor -- start 2020-10-31T22:50:48.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 -- start start 2020-10-31T22:50:48.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3280b24a0 0x7ff3281391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:48.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3280b5570 0x7ff328150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:48.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff328145e40 0x7ff3280ac250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:48.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32813ed40 con 0x7ff3280b24a0 2020-10-31T22:50:48.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32813a780 con 0x7ff3280b5570 2020-10-31T22:50:48.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e80d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3280b6420 con 0x7ff328145e40 2020-10-31T22:50:48.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32d80b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3280b24a0 0x7ff3281391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:48.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32d80b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3280b24a0 0x7ff3281391a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49634/0 (socket says 172.21.15.60:49634) 2020-10-31T22:50:48.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32d80b700 1 -- 172.21.15.60:0/1712505965 learned_addr learned my addr 172.21.15.60:0/1712505965 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:48.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32e00c700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff328145e40 0x7ff3280ac250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:48.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.945+0000 7ff32d00a700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3280b5570 0x7ff328150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:48.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff32d80b700 1 -- 172.21.15.60:0/1712505965 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff328145e40 msgr2=0x7ff3280ac250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:48.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff32d80b700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff328145e40 0x7ff3280ac250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff32d80b700 1 -- 172.21.15.60:0/1712505965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3280b5570 msgr2=0x7ff328150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:48.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff32d80b700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3280b5570 0x7ff328150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:48.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff32d80b700 1 -- 172.21.15.60:0/1712505965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32813a4e0 con 0x7ff3280b24a0 2020-10-31T22:50:48.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff32d00a700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3280b5570 0x7ff328150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:48.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff32e00c700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff328145e40 0x7ff3280ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:48.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff32d80b700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3280b24a0 0x7ff3281391a0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7ff324006910 tx=0x7ff324008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:48.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff31affd700 1 -- 172.21.15.60:0/1712505965 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff324009920 con 0x7ff3280b24a0 2020-10-31T22:50:48.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff31affd700 1 -- 172.21.15.60:0/1712505965 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff324009a80 con 0x7ff3280b24a0 2020-10-31T22:50:48.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff32e80d700 1 -- 172.21.15.60:0/1712505965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3280b6680 con 0x7ff3280b24a0 2020-10-31T22:50:48.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff31affd700 1 -- 172.21.15.60:0/1712505965 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff324009de0 con 0x7ff3280b24a0 2020-10-31T22:50:48.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff32e80d700 1 -- 172.21.15.60:0/1712505965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3280b6b20 con 0x7ff3280b24a0 2020-10-31T22:50:48.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff31affd700 1 -- 172.21.15.60:0/1712505965 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff324013480 con 0x7ff3280b24a0 2020-10-31T22:50:48.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff32e80d700 1 -- 172.21.15.60:0/1712505965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff328057100 con 0x7ff3280b24a0 2020-10-31T22:50:48.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff31affd700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff308054f10 0x7ff3080573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:48.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff31affd700 1 -- 172.21.15.60:0/1712505965 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff32406e110 con 0x7ff3280b24a0 2020-10-31T22:50:48.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff32d00a700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff308054f10 0x7ff3080573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:48.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.949+0000 7ff32d00a700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff308054f10 0x7ff3080573d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7ff31c00c000 tx=0x7ff31c008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:48.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:48.953+0000 7ff31affd700 1 -- 172.21.15.60:0/1712505965 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff3240445d0 con 0x7ff3280b24a0 2020-10-31T22:50:49.101 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.097+0000 7ff32e80d700 1 -- 172.21.15.60:0/1712505965 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff32805a8e0 con 0x7ff3280b24a0 2020-10-31T22:50:49.103 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.097+0000 7ff31affd700 1 -- 172.21.15.60:0/1712505965 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v149) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff324047bf0 con 0x7ff3280b24a0 2020-10-31T22:50:49.103 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:50:49.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.097+0000 7ff32e80d700 1 -- 172.21.15.60:0/1712505965 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff308054f10 msgr2=0x7ff3080573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.097+0000 7ff32e80d700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff308054f10 0x7ff3080573d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7ff31c00c000 tx=0x7ff31c008040).stop 2020-10-31T22:50:49.105 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.097+0000 7ff32e80d700 1 -- 172.21.15.60:0/1712505965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3280b24a0 msgr2=0x7ff3281391a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.097+0000 7ff32e80d700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3280b24a0 0x7ff3281391a0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 rx=0x7ff324006910 tx=0x7ff324008040).stop 2020-10-31T22:50:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.097+0000 7ff32e80d700 1 -- 172.21.15.60:0/1712505965 shutdown_connections 2020-10-31T22:50:49.106 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.097+0000 7ff32e80d700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff328145e40 0x7ff3280ac250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.097+0000 7ff32e80d700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3280b24a0 0x7ff3281391a0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.097+0000 7ff32e80d700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff308054f10 0x7ff3080573d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.097+0000 7ff32e80d700 1 --2- 172.21.15.60:0/1712505965 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3280b5570 0x7ff328150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.097+0000 7ff32e80d700 1 -- 172.21.15.60:0/1712505965 >> 172.21.15.60:0/1712505965 conn(0x7ff3280b8e90 msgr2=0x7ff3280659e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:49.107 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.097+0000 7ff32e80d700 1 -- 172.21.15.60:0/1712505965 shutdown_connections 2020-10-31T22:50:49.108 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.097+0000 7ff32e80d700 1 -- 172.21.15.60:0/1712505965 wait complete. 2020-10-31T22:50:49.119 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:50:49.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.241+0000 7fa695f5c700 1 Processor -- start 2020-10-31T22:50:49.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.241+0000 7fa695f5c700 1 -- start start 2020-10-31T22:50:49.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.241+0000 7fa695f5c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa6900b24c0 0x7fa6900add20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.241+0000 7fa695f5c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69005b700 con 0x7fa6900acc60 2020-10-31T22:50:49.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.241+0000 7fa695f5c700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa690140750 con 0x7fa69005b320 2020-10-31T22:50:49.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.241+0000 7fa695f5c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6900b0340 con 0x7fa6900b24c0 2020-10-31T22:50:49.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.241+0000 7fa68ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa6900acc60 0x7fa6900ad610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53778/0 (socket says 172.21.15.60:53778) 2020-10-31T22:50:49.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.241+0000 7fa68ffff700 1 -- 172.21.15.60:0/3960013876 learned_addr learned my addr 172.21.15.60:0/3960013876 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:49.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.241+0000 7fa69575b700 1 --2- 172.21.15.60:0/3960013876 >> v2:172.21.15.66:3300/0 conn(0x7fa6900b24c0 0x7fa6900add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa68f7fe700 1 -- 172.21.15.60:0/3960013876 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1875904451 0 0) 0x7fa69005b700 con 0x7fa6900acc60 2020-10-31T22:50:49.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa68f7fe700 1 -- 172.21.15.60:0/3960013876 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa67c003230 con 0x7fa6900acc60 2020-10-31T22:50:49.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa68f7fe700 1 -- 172.21.15.60:0/3960013876 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939403555 0 0) 0x7fa690140750 con 0x7fa69005b320 2020-10-31T22:50:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa68f7fe700 1 -- 172.21.15.60:0/3960013876 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa69005b700 con 0x7fa69005b320 2020-10-31T22:50:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa69575b700 1 -- 172.21.15.60:0/3960013876 >> v1:172.21.15.66:6789/0 conn(0x7fa69005b320 legacy=0x7fa6900b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa69575b700 1 -- 172.21.15.60:0/3960013876 >> v1:172.21.15.60:6789/0 conn(0x7fa6900acc60 legacy=0x7fa6900ad610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa69575b700 1 -- 172.21.15.60:0/3960013876 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6900b05e0 con 0x7fa6900b24c0 2020-10-31T22:50:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa69575b700 1 --2- 172.21.15.60:0/3960013876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6900b24c0 0x7fa6900add20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fa6880032b0 tx=0x7fa6880091a0).ready entity=mon.1 client_cookie=d8ead0985ca1c493 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa68f7fe700 1 -- 172.21.15.60:0/3960013876 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa68800b940 con 0x7fa6900b24c0 2020-10-31T22:50:49.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa68f7fe700 1 -- 172.21.15.60:0/3960013876 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68800baa0 con 0x7fa6900b24c0 2020-10-31T22:50:49.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa68f7fe700 1 -- 172.21.15.60:0/3960013876 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa68800bc10 con 0x7fa6900b24c0 2020-10-31T22:50:49.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa695f5c700 1 -- 172.21.15.60:0/3960013876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6900b24c0 msgr2=0x7fa6900add20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.252 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa695f5c700 1 --2- 172.21.15.60:0/3960013876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6900b24c0 0x7fa6900add20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7fa6880032b0 tx=0x7fa6880091a0).stop 2020-10-31T22:50:49.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa695f5c700 1 -- 172.21.15.60:0/3960013876 shutdown_connections 2020-10-31T22:50:49.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa695f5c700 1 --2- 172.21.15.60:0/3960013876 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6900b24c0 0x7fa6900add20 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa695f5c700 1 -- 172.21.15.60:0/3960013876 >> 172.21.15.60:0/3960013876 conn(0x7fa6900b61d0 msgr2=0x7fa6900b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:49.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa695f5c700 1 -- 172.21.15.60:0/3960013876 shutdown_connections 2020-10-31T22:50:49.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.245+0000 7fa695f5c700 1 -- 172.21.15.60:0/3960013876 wait complete. 2020-10-31T22:50:49.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa695f5c700 1 Processor -- start 2020-10-31T22:50:49.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa695f5c700 1 -- start start 2020-10-31T22:50:49.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa695f5c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa69005b320 0x7fa6900b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.255 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa695f5c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6900acc60 0x7fa6901527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.256 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa695f5c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6900b24c0 0x7fa69014ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.256 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa695f5c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69013be00 con 0x7fa6900acc60 2020-10-31T22:50:49.256 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa695f5c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69014e8a0 con 0x7fa6900b24c0 2020-10-31T22:50:49.256 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa695f5c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69013a860 con 0x7fa69005b320 2020-10-31T22:50:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa68ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6900acc60 0x7fa6901527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa68ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6900acc60 0x7fa6901527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49650/0 (socket says 172.21.15.60:49650) 2020-10-31T22:50:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa68ffff700 1 -- 172.21.15.60:0/821509361 learned_addr learned my addr 172.21.15.60:0/821509361 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa69575b700 1 --2- 172.21.15.60:0/821509361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6900b24c0 0x7fa69014ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa694f5a700 1 --2- 172.21.15.60:0/821509361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa69005b320 0x7fa6900b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.257 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa68ffff700 1 -- 172.21.15.60:0/821509361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa69005b320 msgr2=0x7fa6900b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa68ffff700 1 --2- 172.21.15.60:0/821509361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa69005b320 0x7fa6900b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa68ffff700 1 -- 172.21.15.60:0/821509361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6900b24c0 msgr2=0x7fa69014ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa68ffff700 1 --2- 172.21.15.60:0/821509361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6900b24c0 0x7fa69014ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa68ffff700 1 -- 172.21.15.60:0/821509361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69013ab00 con 0x7fa6900acc60 2020-10-31T22:50:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa68ffff700 1 --2- 172.21.15.60:0/821509361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6900acc60 0x7fa6901527d0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fa684001190 tx=0x7fa684007b20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa68dffb700 1 -- 172.21.15.60:0/821509361 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa6840073b0 con 0x7fa6900acc60 2020-10-31T22:50:49.258 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa695f5c700 1 -- 172.21.15.60:0/821509361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69013ada0 con 0x7fa6900acc60 2020-10-31T22:50:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa695f5c700 1 -- 172.21.15.60:0/821509361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69013b380 con 0x7fa6900acc60 2020-10-31T22:50:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa68dffb700 1 -- 172.21.15.60:0/821509361 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6840055e0 con 0x7fa6900acc60 2020-10-31T22:50:49.259 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.249+0000 7fa68dffb700 1 -- 172.21.15.60:0/821509361 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa684005940 con 0x7fa6900acc60 2020-10-31T22:50:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.253+0000 7fa695f5c700 1 -- 172.21.15.60:0/821509361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa690057100 con 0x7fa6900acc60 2020-10-31T22:50:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.253+0000 7fa68dffb700 1 -- 172.21.15.60:0/821509361 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa684010070 con 0x7fa6900acc60 2020-10-31T22:50:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.253+0000 7fa68dffb700 1 --2- 172.21.15.60:0/821509361 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa670054f30 0x7fa6700573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.253+0000 7fa68dffb700 1 -- 172.21.15.60:0/821509361 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa68406d170 con 0x7fa6900acc60 2020-10-31T22:50:49.260 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.253+0000 7fa694f5a700 1 --2- 172.21.15.60:0/821509361 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa670054f30 0x7fa6700573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.261 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.253+0000 7fa694f5a700 1 --2- 172.21.15.60:0/821509361 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa670054f30 0x7fa6700573f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fa68000d000 tx=0x7fa680007960).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:49.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.261+0000 7fa68dffb700 1 -- 172.21.15.60:0/821509361 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa6840436a0 con 0x7fa6900acc60 2020-10-31T22:50:49.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.405+0000 7fa695f5c700 1 -- 172.21.15.60:0/821509361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa6900ae950 con 0x7fa6900acc60 2020-10-31T22:50:49.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.405+0000 7fa68dffb700 1 -- 172.21.15.60:0/821509361 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v149) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa684046cc0 con 0x7fa6900acc60 2020-10-31T22:50:49.411 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:49.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.409+0000 7fa695f5c700 1 -- 172.21.15.60:0/821509361 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa670054f30 msgr2=0x7fa6700573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.409+0000 7fa695f5c700 1 --2- 172.21.15.60:0/821509361 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa670054f30 0x7fa6700573f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7fa68000d000 tx=0x7fa680007960).stop 2020-10-31T22:50:49.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.409+0000 7fa695f5c700 1 -- 172.21.15.60:0/821509361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6900acc60 msgr2=0x7fa6901527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.409+0000 7fa695f5c700 1 --2- 172.21.15.60:0/821509361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6900acc60 0x7fa6901527d0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 rx=0x7fa684001190 tx=0x7fa684007b20).stop 2020-10-31T22:50:49.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.409+0000 7fa695f5c700 1 -- 172.21.15.60:0/821509361 shutdown_connections 2020-10-31T22:50:49.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.409+0000 7fa695f5c700 1 --2- 172.21.15.60:0/821509361 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa670054f30 0x7fa6700573f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.409+0000 7fa695f5c700 1 --2- 172.21.15.60:0/821509361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6900b24c0 0x7fa69014ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.409+0000 7fa695f5c700 1 --2- 172.21.15.60:0/821509361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa69005b320 0x7fa6900b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.409+0000 7fa695f5c700 1 --2- 172.21.15.60:0/821509361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6900acc60 0x7fa6901527d0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.409+0000 7fa695f5c700 1 -- 172.21.15.60:0/821509361 >> 172.21.15.60:0/821509361 conn(0x7fa6900b61d0 msgr2=0x7fa6900b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:49.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.409+0000 7fa695f5c700 1 -- 172.21.15.60:0/821509361 shutdown_connections 2020-10-31T22:50:49.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.409+0000 7fa695f5c700 1 -- 172.21.15.60:0/821509361 wait complete. 2020-10-31T22:50:49.431 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:50:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.545+0000 7f657bfff700 1 Processor -- start 2020-10-31T22:50:49.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.545+0000 7f657bfff700 1 -- start start 2020-10-31T22:50:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f657c0a8140 0x7f657c0ac020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657bfff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f657c13bcc0 0x7f657c13c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657bfff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f657c13f630 con 0x7f657c0b1d50 2020-10-31T22:50:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657bfff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657c0ae220 con 0x7f657c0a8140 2020-10-31T22:50:49.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657bfff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657c0b2130 con 0x7f657c13bcc0 2020-10-31T22:50:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657affd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f657c0b1d50 0x7f657c0adb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53792/0 (socket says 172.21.15.60:53792) 2020-10-31T22:50:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657affd700 1 -- 172.21.15.60:0/2135252352 learned_addr learned my addr 172.21.15.60:0/2135252352 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f6573fff700 1 --2- 172.21.15.60:0/2135252352 >> v2:172.21.15.60:3300/0 conn(0x7f657c0a8140 0x7f657c0ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657b7fe700 1 --2- 172.21.15.60:0/2135252352 >> v2:172.21.15.66:3300/0 conn(0x7f657c13bcc0 0x7f657c13c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657a7fc700 1 -- 172.21.15.60:0/2135252352 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3735299189 0 0) 0x7f657c13f630 con 0x7f657c0b1d50 2020-10-31T22:50:49.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657a7fc700 1 -- 172.21.15.60:0/2135252352 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f655c003230 con 0x7f657c0b1d50 2020-10-31T22:50:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f6573fff700 1 -- 172.21.15.60:0/2135252352 >> v2:172.21.15.66:3300/0 conn(0x7f657c13bcc0 msgr2=0x7f657c13c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f6573fff700 1 --2- 172.21.15.60:0/2135252352 >> v2:172.21.15.66:3300/0 conn(0x7f657c13bcc0 0x7f657c13c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f6573fff700 1 -- 172.21.15.60:0/2135252352 >> v1:172.21.15.60:6789/0 conn(0x7f657c0b1d50 legacy=0x7f657c0adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f6573fff700 1 -- 172.21.15.60:0/2135252352 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c05c0f0 con 0x7f657c0a8140 2020-10-31T22:50:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657b7fe700 1 --2- 172.21.15.60:0/2135252352 >> v2:172.21.15.66:3300/0 conn(0x7f657c13bcc0 0x7f657c13c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:49.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f6573fff700 1 --2- 172.21.15.60:0/2135252352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0a8140 0x7f657c0ac020 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f657c0ada60 tx=0x7f6564006dc0).ready entity=mon.0 client_cookie=a1d58ea48fbc1c3e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657a7fc700 1 -- 172.21.15.60:0/2135252352 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6564009be0 con 0x7f657c0a8140 2020-10-31T22:50:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657a7fc700 1 -- 172.21.15.60:0/2135252352 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6564009d40 con 0x7f657c0a8140 2020-10-31T22:50:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657a7fc700 1 -- 172.21.15.60:0/2135252352 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6564010660 con 0x7f657c0a8140 2020-10-31T22:50:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657bfff700 1 -- 172.21.15.60:0/2135252352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0a8140 msgr2=0x7f657c0ac020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.560 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.549+0000 7f657bfff700 1 --2- 172.21.15.60:0/2135252352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0a8140 0x7f657c0ac020 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 rx=0x7f657c0ada60 tx=0x7f6564006dc0).stop 2020-10-31T22:50:49.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.553+0000 7f657bfff700 1 -- 172.21.15.60:0/2135252352 shutdown_connections 2020-10-31T22:50:49.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.553+0000 7f657bfff700 1 --2- 172.21.15.60:0/2135252352 >> v2:172.21.15.66:3300/0 conn(0x7f657c13bcc0 0x7f657c13c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.553+0000 7f657bfff700 1 --2- 172.21.15.60:0/2135252352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0a8140 0x7f657c0ac020 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.553+0000 7f657bfff700 1 -- 172.21.15.60:0/2135252352 >> 172.21.15.60:0/2135252352 conn(0x7f657c0b5330 msgr2=0x7f657c0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:49.563 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.553+0000 7f657bfff700 1 -- 172.21.15.60:0/2135252352 shutdown_connections 2020-10-31T22:50:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.553+0000 7f657bfff700 1 -- 172.21.15.60:0/2135252352 wait complete. 2020-10-31T22:50:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.553+0000 7f657bfff700 1 Processor -- start 2020-10-31T22:50:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.553+0000 7f657bfff700 1 -- start start 2020-10-31T22:50:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0a8140 0x7f657c0a8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657bfff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f657c0b1d50 0x7f657c144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657bfff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f657c13bcc0 0x7f657c14c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.564 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657bfff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c142800 con 0x7f657c0a8140 2020-10-31T22:50:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657bfff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c0ab3a0 con 0x7f657c0b1d50 2020-10-31T22:50:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657bfff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657c0ab610 con 0x7f657c13bcc0 2020-10-31T22:50:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0a8140 0x7f657c0a8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657affd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0a8140 0x7f657c0a8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49662/0 (socket says 172.21.15.60:49662) 2020-10-31T22:50:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657affd700 1 -- 172.21.15.60:0/2197962529 learned_addr learned my addr 172.21.15.60:0/2197962529 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f6573fff700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f657c0b1d50 0x7f657c144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.565 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657b7fe700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f657c13bcc0 0x7f657c14c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657affd700 1 -- 172.21.15.60:0/2197962529 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f657c13bcc0 msgr2=0x7f657c14c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657affd700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f657c13bcc0 0x7f657c14c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657affd700 1 -- 172.21.15.60:0/2197962529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f657c0b1d50 msgr2=0x7f657c144f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657affd700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f657c0b1d50 0x7f657c144f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657affd700 1 -- 172.21.15.60:0/2197962529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c0a8670 con 0x7f657c0a8140 2020-10-31T22:50:49.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f6573fff700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f657c0b1d50 0x7f657c144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657b7fe700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f657c13bcc0 0x7f657c14c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657affd700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0a8140 0x7f657c0a8db0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f656c0010d0 tx=0x7f656c007a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f6578ff9700 1 -- 172.21.15.60:0/2197962529 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f656c0072e0 con 0x7f657c0a8140 2020-10-31T22:50:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f6578ff9700 1 -- 172.21.15.60:0/2197962529 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f656c007440 con 0x7f657c0a8140 2020-10-31T22:50:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657bfff700 1 -- 172.21.15.60:0/2197962529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657c0a8910 con 0x7f657c0a8140 2020-10-31T22:50:49.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f6578ff9700 1 -- 172.21.15.60:0/2197962529 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f656c0057d0 con 0x7f657c0a8140 2020-10-31T22:50:49.568 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657bfff700 1 -- 172.21.15.60:0/2197962529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657c142310 con 0x7f657c0a8140 2020-10-31T22:50:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f657bfff700 1 -- 172.21.15.60:0/2197962529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657c0a8aa0 con 0x7f657c0a8140 2020-10-31T22:50:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.557+0000 7f6578ff9700 1 -- 172.21.15.60:0/2197962529 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f656c010070 con 0x7f657c0a8140 2020-10-31T22:50:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.561+0000 7f6578ff9700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6560054f10 0x7f65600573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.561+0000 7f6578ff9700 1 -- 172.21.15.60:0/2197962529 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f656c06d2d0 con 0x7f657c0a8140 2020-10-31T22:50:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.561+0000 7f6573fff700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6560054f10 0x7f65600573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.561+0000 7f6573fff700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6560054f10 0x7f65600573d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f656401b000 tx=0x7f6564017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:49.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.561+0000 7f6578ff9700 1 -- 172.21.15.60:0/2197962529 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f656c043750 con 0x7f657c0a8140 2020-10-31T22:50:49.709 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.705+0000 7f657bfff700 1 -- 172.21.15.60:0/2197962529 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f657c057100 con 0x7f657c0a8140 2020-10-31T22:50:49.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.705+0000 7f6578ff9700 1 -- 172.21.15.60:0/2197962529 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v149) v1 ==== 104+0+10 (secure 0 0 0) 0x7f656c046d70 con 0x7f657c0a8140 2020-10-31T22:50:49.711 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:49.712 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.705+0000 7f657bfff700 1 -- 172.21.15.60:0/2197962529 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6560054f10 msgr2=0x7f65600573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.705+0000 7f657bfff700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6560054f10 0x7f65600573d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7f656401b000 tx=0x7f6564017000).stop 2020-10-31T22:50:49.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.705+0000 7f657bfff700 1 -- 172.21.15.60:0/2197962529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0a8140 msgr2=0x7f657c0a8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.713 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.705+0000 7f657bfff700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0a8140 0x7f657c0a8db0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 rx=0x7f656c0010d0 tx=0x7f656c007a10).stop 2020-10-31T22:50:49.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.705+0000 7f657bfff700 1 -- 172.21.15.60:0/2197962529 shutdown_connections 2020-10-31T22:50:49.714 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.705+0000 7f657bfff700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f657c13bcc0 0x7f657c14c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.705+0000 7f657bfff700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f657c0a8140 0x7f657c0a8db0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.705+0000 7f657bfff700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6560054f10 0x7f65600573d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.715 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.705+0000 7f657bfff700 1 --2- 172.21.15.60:0/2197962529 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f657c0b1d50 0x7f657c144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.705+0000 7f657bfff700 1 -- 172.21.15.60:0/2197962529 >> 172.21.15.60:0/2197962529 conn(0x7f657c0b5330 msgr2=0x7f657c05b790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:49.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.705+0000 7f657bfff700 1 -- 172.21.15.60:0/2197962529 shutdown_connections 2020-10-31T22:50:49.716 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.705+0000 7f657bfff700 1 -- 172.21.15.60:0/2197962529 wait complete. 2020-10-31T22:50:49.724 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:50:49.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.833+0000 7f8dd443c700 1 Processor -- start 2020-10-31T22:50:49.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.833+0000 7f8dd443c700 1 -- start start 2020-10-31T22:50:49.844 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd443c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8dcc05c660 0x7f8dcc0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd443c700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8dcc0b2e20 0x7f8dcc142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd443c700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dcc066410 con 0x7f8dcc065f70 2020-10-31T22:50:49.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd443c700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dcc066d60 con 0x7f8dcc0b2e20 2020-10-31T22:50:49.845 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd443c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dcc0b5e80 con 0x7f8dcc05c660 2020-10-31T22:50:49.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd29d9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8dcc0b2e20 0x7f8dcc142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd19d7700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8dcc065f70 0x7f8dcc13f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53808/0 (socket says 172.21.15.60:53808) 2020-10-31T22:50:49.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd19d7700 1 -- 172.21.15.60:0/2080963314 learned_addr learned my addr 172.21.15.60:0/2080963314 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:49.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd21d8700 1 --2- 172.21.15.60:0/2080963314 >> v2:172.21.15.66:3300/0 conn(0x7f8dcc05c660 0x7f8dcc0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.846 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd29d9700 1 -- 172.21.15.60:0/2080963314 >> v2:172.21.15.66:3300/0 conn(0x7f8dcc05c660 msgr2=0x7f8dcc0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:49.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd29d9700 1 --2- 172.21.15.60:0/2080963314 >> v2:172.21.15.66:3300/0 conn(0x7f8dcc05c660 0x7f8dcc0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd29d9700 1 -- 172.21.15.60:0/2080963314 >> v1:172.21.15.60:6789/0 conn(0x7f8dcc065f70 legacy=0x7f8dcc13f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd11d6700 1 -- 172.21.15.60:0/2080963314 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186488061 0 0) 0x7f8dcc066410 con 0x7f8dcc065f70 2020-10-31T22:50:49.847 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd29d9700 1 -- 172.21.15.60:0/2080963314 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc0666b0 con 0x7f8dcc0b2e20 2020-10-31T22:50:49.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd29d9700 1 --2- 172.21.15.60:0/2080963314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dcc0b2e20 0x7f8dcc142610 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f8dc40032b0 tx=0x7f8dc40091a0).ready entity=mon.0 client_cookie=75955f3d6cebc122 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:49.848 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd11d6700 1 -- 172.21.15.60:0/2080963314 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dc400b9a0 con 0x7f8dcc0b2e20 2020-10-31T22:50:49.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd11d6700 1 -- 172.21.15.60:0/2080963314 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc400bb00 con 0x7f8dcc0b2e20 2020-10-31T22:50:49.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd11d6700 1 -- 172.21.15.60:0/2080963314 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dc400bc70 con 0x7f8dcc0b2e20 2020-10-31T22:50:49.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd443c700 1 -- 172.21.15.60:0/2080963314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dcc0b2e20 msgr2=0x7f8dcc142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd443c700 1 --2- 172.21.15.60:0/2080963314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dcc0b2e20 0x7f8dcc142610 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 rx=0x7f8dc40032b0 tx=0x7f8dc40091a0).stop 2020-10-31T22:50:49.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd443c700 1 -- 172.21.15.60:0/2080963314 shutdown_connections 2020-10-31T22:50:49.850 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd443c700 1 --2- 172.21.15.60:0/2080963314 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dcc0b2e20 0x7f8dcc142610 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd443c700 1 --2- 172.21.15.60:0/2080963314 >> v2:172.21.15.66:3300/0 conn(0x7f8dcc05c660 0x7f8dcc0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd443c700 1 -- 172.21.15.60:0/2080963314 >> 172.21.15.60:0/2080963314 conn(0x7f8dcc0601e0 msgr2=0x7f8dcc05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:49.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd443c700 1 -- 172.21.15.60:0/2080963314 shutdown_connections 2020-10-31T22:50:49.851 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.837+0000 7f8dd443c700 1 -- 172.21.15.60:0/2080963314 wait complete. 2020-10-31T22:50:49.853 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd443c700 1 Processor -- start 2020-10-31T22:50:49.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd443c700 1 -- start start 2020-10-31T22:50:49.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd443c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8dcc05c660 0x7f8dcc0b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd443c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dcc065f70 0x7f8dcc13e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd443c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dcc0b2e20 0x7f8dcc13ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd443c700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc13f1a0 con 0x7f8dcc065f70 2020-10-31T22:50:49.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd443c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc0aa5e0 con 0x7f8dcc0b2e20 2020-10-31T22:50:49.854 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd443c700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dcc1433e0 con 0x7f8dcc05c660 2020-10-31T22:50:49.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd19d7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dcc065f70 0x7f8dcc13e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd19d7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dcc065f70 0x7f8dcc13e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49676/0 (socket says 172.21.15.60:49676) 2020-10-31T22:50:49.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd19d7700 1 -- 172.21.15.60:0/2231999071 learned_addr learned my addr 172.21.15.60:0/2231999071 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:49.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd21d8700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8dcc05c660 0x7f8dcc0b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd29d9700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dcc0b2e20 0x7f8dcc13ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd19d7700 1 -- 172.21.15.60:0/2231999071 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8dcc05c660 msgr2=0x7f8dcc0b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd19d7700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8dcc05c660 0x7f8dcc0b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd19d7700 1 -- 172.21.15.60:0/2231999071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dcc0b2e20 msgr2=0x7f8dcc13ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:49.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd19d7700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dcc0b2e20 0x7f8dcc13ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:49.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd19d7700 1 -- 172.21.15.60:0/2231999071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc143680 con 0x7f8dcc065f70 2020-10-31T22:50:49.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd29d9700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dcc0b2e20 0x7f8dcc13ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:49.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd19d7700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dcc065f70 0x7f8dcc13e7c0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f8dc8000e90 tx=0x7f8dc8007a90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:49.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dbb7fe700 1 -- 172.21.15.60:0/2231999071 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dc8007320 con 0x7f8dcc065f70 2020-10-31T22:50:49.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dbb7fe700 1 -- 172.21.15.60:0/2231999071 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc8007480 con 0x7f8dcc065f70 2020-10-31T22:50:49.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dd443c700 1 -- 172.21.15.60:0/2231999071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dcc0a81e0 con 0x7f8dcc065f70 2020-10-31T22:50:49.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.841+0000 7f8dbb7fe700 1 -- 172.21.15.60:0/2231999071 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8dc80057d0 con 0x7f8dcc065f70 2020-10-31T22:50:49.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.845+0000 7f8dd443c700 1 -- 172.21.15.60:0/2231999071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dcc143cc0 con 0x7f8dcc065f70 2020-10-31T22:50:49.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.845+0000 7f8dd443c700 1 -- 172.21.15.60:0/2231999071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dcc057100 con 0x7f8dcc065f70 2020-10-31T22:50:49.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.845+0000 7f8dbb7fe700 1 -- 172.21.15.60:0/2231999071 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8dc8010030 con 0x7f8dcc065f70 2020-10-31T22:50:49.857 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.845+0000 7f8dbb7fe700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8dac054f10 0x7f8dac0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:49.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.845+0000 7f8dbb7fe700 1 -- 172.21.15.60:0/2231999071 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f8dc806d6b0 con 0x7f8dcc065f70 2020-10-31T22:50:49.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.845+0000 7f8dd21d8700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8dac054f10 0x7f8dac0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:49.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.845+0000 7f8dd21d8700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8dac054f10 0x7f8dac0573d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f8dbc00b000 tx=0x7f8dbc006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:49.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.853+0000 7f8dbb7fe700 1 -- 172.21.15.60:0/2231999071 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8dc8043bd0 con 0x7f8dcc065f70 2020-10-31T22:50:49.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.993+0000 7f8dd443c700 1 -- 172.21.15.60:0/2231999071 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8dcc0a8370 con 0x7f8dcc065f70 2020-10-31T22:50:50.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.997+0000 7f8dbb7fe700 1 -- 172.21.15.60:0/2231999071 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v149) v1 ==== 100+0+10 (secure 0 0 0) 0x7f8dc80471f0 con 0x7f8dcc065f70 2020-10-31T22:50:50.000 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:50.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.997+0000 7f8dd443c700 1 -- 172.21.15.60:0/2231999071 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8dac054f10 msgr2=0x7f8dac0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:50.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.997+0000 7f8dd443c700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8dac054f10 0x7f8dac0573d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f8dbc00b000 tx=0x7f8dbc006dc0).stop 2020-10-31T22:50:50.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.997+0000 7f8dd443c700 1 -- 172.21.15.60:0/2231999071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dcc065f70 msgr2=0x7f8dcc13e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:50.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.997+0000 7f8dd443c700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dcc065f70 0x7f8dcc13e7c0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 rx=0x7f8dc8000e90 tx=0x7f8dc8007a90).stop 2020-10-31T22:50:50.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.997+0000 7f8dd443c700 1 -- 172.21.15.60:0/2231999071 shutdown_connections 2020-10-31T22:50:50.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.997+0000 7f8dd443c700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8dac054f10 0x7f8dac0573d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:50.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.997+0000 7f8dd443c700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8dcc0b2e20 0x7f8dcc13ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:50.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.997+0000 7f8dd443c700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8dcc05c660 0x7f8dcc0b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:50.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.997+0000 7f8dd443c700 1 --2- 172.21.15.60:0/2231999071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8dcc065f70 0x7f8dcc13e7c0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:50.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.997+0000 7f8dd443c700 1 -- 172.21.15.60:0/2231999071 >> 172.21.15.60:0/2231999071 conn(0x7f8dcc0601e0 msgr2=0x7f8dcc0b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:50.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.997+0000 7f8dd443c700 1 -- 172.21.15.60:0/2231999071 shutdown_connections 2020-10-31T22:50:50.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:49.997+0000 7f8dd443c700 1 -- 172.21.15.60:0/2231999071 wait complete. 2020-10-31T22:50:50.021 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:50:50.022 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:50:50.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.121+0000 7f5f62e0f700 1 Processor -- start 2020-10-31T22:50:50.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.121+0000 7f5f62e0f700 1 -- start start 2020-10-31T22:50:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f62e0f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5f5c0ae630 0x7f5f5c05c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f62e0f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5c05c800 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f62e0f700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5c0adc50 con 0x7f5f5c0b1bb0 2020-10-31T22:50:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f62e0f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f5c0adef0 con 0x7f5f5c0ae630 2020-10-31T22:50:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f6260e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5f5c0ae630 0x7f5f5c05c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f6160c700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f5f5c13f3d0 0x7f5f5c0b0210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53822/0 (socket says 172.21.15.60:53822) 2020-10-31T22:50:50.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f6260e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f5f5c0ae630 0x7f5f5c05c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49688/0 (socket says 172.21.15.60:49688) 2020-10-31T22:50:50.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f6160c700 1 -- 172.21.15.60:0/1137966550 learned_addr learned my addr 172.21.15.60:0/1137966550 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:50.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f6260e700 1 -- 172.21.15.60:0/1137966550 >> v1:172.21.15.66:6789/0 conn(0x7f5f5c0b1bb0 legacy=0x7f5f5c13ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:50.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f6260e700 1 -- 172.21.15.60:0/1137966550 >> v1:172.21.15.60:6789/0 conn(0x7f5f5c13f3d0 legacy=0x7f5f5c0b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:50.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f60e0b700 1 -- 172.21.15.60:0/1137966550 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678736804 0 0) 0x7f5f5c05c800 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f6260e700 1 -- 172.21.15.60:0/1137966550 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c0ae190 con 0x7f5f5c0ae630 2020-10-31T22:50:50.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f6260e700 1 --2- 172.21.15.60:0/1137966550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f5c0ae630 0x7f5f5c05c0f0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f5f54002f30 tx=0x7f5f54006dc0).ready entity=mon.0 client_cookie=836af322b75741d1 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:50.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f60e0b700 1 -- 172.21.15.60:0/1137966550 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f540099e0 con 0x7f5f5c0ae630 2020-10-31T22:50:50.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f60e0b700 1 -- 172.21.15.60:0/1137966550 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f54009b40 con 0x7f5f5c0ae630 2020-10-31T22:50:50.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f60e0b700 1 -- 172.21.15.60:0/1137966550 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f54009ea0 con 0x7f5f5c0ae630 2020-10-31T22:50:50.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f62e0f700 1 -- 172.21.15.60:0/1137966550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f5c0ae630 msgr2=0x7f5f5c05c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:50.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f62e0f700 1 --2- 172.21.15.60:0/1137966550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f5c0ae630 0x7f5f5c05c0f0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 rx=0x7f5f54002f30 tx=0x7f5f54006dc0).stop 2020-10-31T22:50:50.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f62e0f700 1 -- 172.21.15.60:0/1137966550 shutdown_connections 2020-10-31T22:50:50.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f62e0f700 1 --2- 172.21.15.60:0/1137966550 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f5c0ae630 0x7f5f5c05c0f0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:50.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.125+0000 7f5f62e0f700 1 -- 172.21.15.60:0/1137966550 >> 172.21.15.60:0/1137966550 conn(0x7f5f5c0b5300 msgr2=0x7f5f5c0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:50.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.129+0000 7f5f62e0f700 1 -- 172.21.15.60:0/1137966550 shutdown_connections 2020-10-31T22:50:50.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.129+0000 7f5f62e0f700 1 -- 172.21.15.60:0/1137966550 wait complete. 2020-10-31T22:50:50.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.129+0000 7f5f62e0f700 1 Processor -- start 2020-10-31T22:50:50.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.129+0000 7f5f62e0f700 1 -- start start 2020-10-31T22:50:50.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f62e0f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5f5c0b1bb0 0x7f5f5c1502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:50.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f62e0f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f5c13f3d0 0x7f5f5c0638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:50.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f62e0f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f5c0ab410 0x7f5f5c063db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:50.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f62e0f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c1507c0 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f62e0f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c0aae20 con 0x7f5f5c0ab410 2020-10-31T22:50:50.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f62e0f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5c1509f0 con 0x7f5f5c0b1bb0 2020-10-31T22:50:50.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f6160c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f5c13f3d0 0x7f5f5c0638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:50.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f6160c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f5c13f3d0 0x7f5f5c0638c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49692/0 (socket says 172.21.15.60:49692) 2020-10-31T22:50:50.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f6160c700 1 -- 172.21.15.60:0/2322387345 learned_addr learned my addr 172.21.15.60:0/2322387345 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:50.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f61e0d700 1 --2- 172.21.15.60:0/2322387345 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5f5c0b1bb0 0x7f5f5c1502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:50.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f6260e700 1 --2- 172.21.15.60:0/2322387345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f5c0ab410 0x7f5f5c063db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:50.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f6160c700 1 -- 172.21.15.60:0/2322387345 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5f5c0b1bb0 msgr2=0x7f5f5c1502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:50.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f6160c700 1 --2- 172.21.15.60:0/2322387345 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5f5c0b1bb0 0x7f5f5c1502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:50.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f6160c700 1 -- 172.21.15.60:0/2322387345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f5c0ab410 msgr2=0x7f5f5c063db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:50.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f6160c700 1 --2- 172.21.15.60:0/2322387345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f5c0ab410 0x7f5f5c063db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:50.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f6160c700 1 -- 172.21.15.60:0/2322387345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f5c150c90 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f6160c700 1 --2- 172.21.15.60:0/2322387345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f5c13f3d0 0x7f5f5c0638c0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f5f4c000b80 tx=0x7f5f4c007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:50.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f4affd700 1 -- 172.21.15.60:0/2322387345 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f4c0073b0 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f4affd700 1 -- 172.21.15.60:0/2322387345 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4c0055e0 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f62e0f700 1 -- 172.21.15.60:0/2322387345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f5c0aa8f0 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f4affd700 1 -- 172.21.15.60:0/2322387345 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f4c005940 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f62e0f700 1 -- 172.21.15.60:0/2322387345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f5c0a82e0 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.133+0000 7f5f62e0f700 1 -- 172.21.15.60:0/2322387345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f5c057100 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.137+0000 7f5f4affd700 1 -- 172.21.15.60:0/2322387345 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f5f4c01a060 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.137+0000 7f5f4affd700 1 --2- 172.21.15.60:0/2322387345 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5f3c054f90 0x7f5f3c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:50.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.137+0000 7f5f4affd700 1 -- 172.21.15.60:0/2322387345 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f5f4c06d2b0 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.137+0000 7f5f61e0d700 1 --2- 172.21.15.60:0/2322387345 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5f3c054f90 0x7f5f3c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:50.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.137+0000 7f5f61e0d700 1 --2- 172.21.15.60:0/2322387345 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5f3c054f90 0x7f5f3c057450 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f5f5800d000 tx=0x7f5f58007f90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:50.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.145+0000 7f5f4affd700 1 -- 172.21.15.60:0/2322387345 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f5f4c0436c0 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.336 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.329+0000 7f5f62e0f700 1 -- 172.21.15.60:0/2322387345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f5c13f120 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.337 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.333+0000 7f5f4affd700 1 -- 172.21.15.60:0/2322387345 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f5f4c018070 con 0x7f5f5c13f3d0 2020-10-31T22:50:50.337 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:50.338 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":76,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7085,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/2329273308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2329273308},{"type":"v1","addr":"172.21.15.66:6833","nonce":2329273308}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6835/4086841612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":4086841612},{"type":"v1","addr":"172.21.15.60:6835","nonce":4086841612}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:45.331860+0000","modified":"2020-10-31T22:50:46.335175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8232":{"gid":8232,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2095394176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2095394176},{"type":"v1","addr":"172.21.15.60:6837","nonce":2095394176}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-10-31T22:50:50.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.333+0000 7f5f62e0f700 1 -- 172.21.15.60:0/2322387345 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5f3c054f90 msgr2=0x7f5f3c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:50.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.333+0000 7f5f62e0f700 1 --2- 172.21.15.60:0/2322387345 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5f3c054f90 0x7f5f3c057450 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f5f5800d000 tx=0x7f5f58007f90).stop 2020-10-31T22:50:50.340 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.333+0000 7f5f62e0f700 1 -- 172.21.15.60:0/2322387345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f5c13f3d0 msgr2=0x7f5f5c0638c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:50.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.333+0000 7f5f62e0f700 1 --2- 172.21.15.60:0/2322387345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f5c13f3d0 0x7f5f5c0638c0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 rx=0x7f5f4c000b80 tx=0x7f5f4c007a30).stop 2020-10-31T22:50:50.341 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.333+0000 7f5f62e0f700 1 -- 172.21.15.60:0/2322387345 shutdown_connections 2020-10-31T22:50:50.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.333+0000 7f5f62e0f700 1 --2- 172.21.15.60:0/2322387345 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5f3c054f90 0x7f5f3c057450 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:50.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.333+0000 7f5f62e0f700 1 --2- 172.21.15.60:0/2322387345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5f5c0ab410 0x7f5f5c063db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:50.342 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.333+0000 7f5f62e0f700 1 --2- 172.21.15.60:0/2322387345 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5f5c0b1bb0 0x7f5f5c1502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:50.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.333+0000 7f5f62e0f700 1 --2- 172.21.15.60:0/2322387345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5f5c13f3d0 0x7f5f5c0638c0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:50.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.333+0000 7f5f62e0f700 1 -- 172.21.15.60:0/2322387345 >> 172.21.15.60:0/2322387345 conn(0x7f5f5c0b5300 msgr2=0x7f5f5c05ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:50.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.333+0000 7f5f62e0f700 1 -- 172.21.15.60:0/2322387345 shutdown_connections 2020-10-31T22:50:50.343 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:50.333+0000 7f5f62e0f700 1 -- 172.21.15.60:0/2322387345 wait complete. 2020-10-31T22:50:50.344 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 76 2020-10-31T22:50:50.654 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:50:45.331860+0000', 'modified': '2020-10-31T22:50:46.335175+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8232}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8232': {'gid': 8232, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/2095394176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 2095394176}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 2095394176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:50:50.655 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:50:50.655 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:50:50.784 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":8232,"want_state":"up:active","state":"up:active","rank_uptime":5.4391273709999997,"mdsmap_epoch":76,"osdmap_epoch":149,"osdmap_epoch_barrier":148,"uptime":10.669468339} 2020-10-31T22:50:50.784 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 8232, "mdsmap_epoch": 76, "osdmap_epoch": 149, "osdmap_epoch_barrier": 148, "rank_uptime": 5.439127371, "state": "up:active", "uptime": 10.669468339, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:50:50.785 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:50:50.785 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:50:50.785 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:50:50.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:50.786 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:50.794 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:50:50.850 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:50:50.851 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:50:50.905 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:50:50.905 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:50:50.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:50.907 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:50:50.952 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:50:50.953 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:50.996 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:50:51.010 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:50:51.011 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:50:51.067 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:50:51.066+0000 7fc9351200c0 -1 init, newargv = 0x5603ca2c01c0 newargc=9ceph-fuse[ 2020-10-31T22:50:51.068 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:14217]: starting ceph client 2020-10-31T22:50:51.068 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:50:51.069 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:50:51.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:51.070 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:50:51.078 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[14217]: starting fuse 2020-10-31T22:50:51.083 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:50:51.084 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:50:51.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:51.084 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:50:51.085 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:50:51.085 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:50:51.085 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:50:51.086 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:50:51.086 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:50:51.086 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:50:51.087 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:50:51.087 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:50:51.087 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:50:51.088 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:50:51.088 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:50:51.088 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:50:51.088 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:50:51.089 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:50:51.089 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:50:51.089 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:50:51.090 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:50:51.091 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:50:51.091 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:50:51.091 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:50:51.092 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:50:51.093 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:50:51.174 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.14217.asok 2020-10-31T22:50:51.179 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14217.asok 2020-10-31T22:50:51.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:51.180 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14217.asok status 2020-10-31T22:50:51.275 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:50:51.275 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:50:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:50:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:50:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:50:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:50:51.276 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:50:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "14217", 2020-10-31T22:50:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:50:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:50:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:50:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:50:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 8400, 2020-10-31T22:50:51.277 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:50:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:50:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:50:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 8400 2020-10-31T22:50:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:50:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:50:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:50:51.278 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:50:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 3872865040 2020-10-31T22:50:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:50:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:50:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:50:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:50:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:50:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 3872865040 2020-10-31T22:50:51.279 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:50:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.8400 172.21.15.152:0/3872865040", 2020-10-31T22:50:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/3872865040", 2020-10-31T22:50:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:50:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 76, 2020-10-31T22:50:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 149, 2020-10-31T22:50:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:50:51.280 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:50:51.281 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:50:51.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:51.285 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:51.285 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:51.291 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:50:51.292 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:50:51.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:51.293 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:51.353 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:50:51.475 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.469+0000 7f6893f16700 1 Processor -- start 2020-10-31T22:50:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.469+0000 7f6893f16700 1 -- start start 2020-10-31T22:50:51.476 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6893f16700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f688c0b30c0 0x7f688c0b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6893f16700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f688c067440 0x7f688c1421e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6893f16700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f688c0613f0 con 0x7f688c060e70 2020-10-31T22:50:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6893f16700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688c0a9ce0 con 0x7f688c067440 2020-10-31T22:50:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6893f16700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688c0b34a0 con 0x7f688c0b30c0 2020-10-31T22:50:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f68914b1700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f688c060e70 0x7f688c0b23d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53834/0 (socket says 172.21.15.60:53834) 2020-10-31T22:50:51.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f68914b1700 1 -- 172.21.15.60:0/2617297264 learned_addr learned my addr 172.21.15.60:0/2617297264 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f68924b3700 1 --2- 172.21.15.60:0/2617297264 >> v2:172.21.15.60:3300/0 conn(0x7f688c067440 0x7f688c1421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6891cb2700 1 --2- 172.21.15.60:0/2617297264 >> v2:172.21.15.66:3300/0 conn(0x7f688c0b30c0 0x7f688c0b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6890cb0700 1 -- 172.21.15.60:0/2617297264 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099006986 0 0) 0x7f688c0613f0 con 0x7f688c060e70 2020-10-31T22:50:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6890cb0700 1 -- 172.21.15.60:0/2617297264 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6874003230 con 0x7f688c060e70 2020-10-31T22:50:51.479 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f68924b3700 1 -- 172.21.15.60:0/2617297264 >> v2:172.21.15.66:3300/0 conn(0x7f688c0b30c0 msgr2=0x7f688c0b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f68924b3700 1 --2- 172.21.15.60:0/2617297264 >> v2:172.21.15.66:3300/0 conn(0x7f688c0b30c0 0x7f688c0b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f68924b3700 1 -- 172.21.15.60:0/2617297264 >> v1:172.21.15.60:6789/0 conn(0x7f688c060e70 legacy=0x7f688c0b23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f68924b3700 1 -- 172.21.15.60:0/2617297264 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0b2ae0 con 0x7f688c067440 2020-10-31T22:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f68924b3700 1 --2- 172.21.15.60:0/2617297264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c067440 0x7f688c1421e0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f68840032b0 tx=0x7f68840091a0).ready entity=mon.0 client_cookie=2f565a8edf4e0e31 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6890cb0700 1 -- 172.21.15.60:0/2617297264 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688400b940 con 0x7f688c067440 2020-10-31T22:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6890cb0700 1 -- 172.21.15.60:0/2617297264 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688400baa0 con 0x7f688c067440 2020-10-31T22:50:51.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6890cb0700 1 -- 172.21.15.60:0/2617297264 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f688400bc10 con 0x7f688c067440 2020-10-31T22:50:51.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6893f16700 1 -- 172.21.15.60:0/2617297264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c067440 msgr2=0x7f688c1421e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:51.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6893f16700 1 --2- 172.21.15.60:0/2617297264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c067440 0x7f688c1421e0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 rx=0x7f68840032b0 tx=0x7f68840091a0).stop 2020-10-31T22:50:51.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6893f16700 1 -- 172.21.15.60:0/2617297264 shutdown_connections 2020-10-31T22:50:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6893f16700 1 --2- 172.21.15.60:0/2617297264 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c067440 0x7f688c1421e0 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6893f16700 1 --2- 172.21.15.60:0/2617297264 >> v2:172.21.15.66:3300/0 conn(0x7f688c0b30c0 0x7f688c0b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6893f16700 1 -- 172.21.15.60:0/2617297264 >> 172.21.15.60:0/2617297264 conn(0x7f688c06a260 msgr2=0x7f688c063c80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6893f16700 1 -- 172.21.15.60:0/2617297264 shutdown_connections 2020-10-31T22:50:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.473+0000 7f6893f16700 1 -- 172.21.15.60:0/2617297264 wait complete. 2020-10-31T22:50:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f6893f16700 1 Processor -- start 2020-10-31T22:50:51.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f6893f16700 1 -- start start 2020-10-31T22:50:51.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f6893f16700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f688c060e70 0x7f688c0afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:51.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f6893f16700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c067440 0x7f688c0acad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:51.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f6893f16700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f688c0b30c0 0x7f688c0acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:51.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f6893f16700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c143160 con 0x7f688c067440 2020-10-31T22:50:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f6893f16700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0ad4b0 con 0x7f688c0b30c0 2020-10-31T22:50:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f6893f16700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688c151bd0 con 0x7f688c060e70 2020-10-31T22:50:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f68914b1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c067440 0x7f688c0acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f68914b1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c067440 0x7f688c0acad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49706/0 (socket says 172.21.15.60:49706) 2020-10-31T22:50:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f68914b1700 1 -- 172.21.15.60:0/4152563997 learned_addr learned my addr 172.21.15.60:0/4152563997 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f68924b3700 1 --2- 172.21.15.60:0/4152563997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f688c0b30c0 0x7f688c0acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:51.485 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f6891cb2700 1 --2- 172.21.15.60:0/4152563997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f688c060e70 0x7f688c0afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:51.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f68914b1700 1 -- 172.21.15.60:0/4152563997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f688c060e70 msgr2=0x7f688c0afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:51.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f68914b1700 1 --2- 172.21.15.60:0/4152563997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f688c060e70 0x7f688c0afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f68914b1700 1 -- 172.21.15.60:0/4152563997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f688c0b30c0 msgr2=0x7f688c0acfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:51.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f68914b1700 1 --2- 172.21.15.60:0/4152563997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f688c0b30c0 0x7f688c0acfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f68914b1700 1 -- 172.21.15.60:0/4152563997 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c151e70 con 0x7f688c067440 2020-10-31T22:50:51.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f68914b1700 1 --2- 172.21.15.60:0/4152563997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c067440 0x7f688c0acad0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f68800010d0 tx=0x7f6880007a70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:51.486 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f687effd700 1 -- 172.21.15.60:0/4152563997 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68800072e0 con 0x7f688c067440 2020-10-31T22:50:51.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f687effd700 1 -- 172.21.15.60:0/4152563997 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6880007440 con 0x7f688c067440 2020-10-31T22:50:51.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f6893f16700 1 -- 172.21.15.60:0/4152563997 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c0aa160 con 0x7f688c067440 2020-10-31T22:50:51.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.477+0000 7f687effd700 1 -- 172.21.15.60:0/4152563997 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f68800057d0 con 0x7f688c067440 2020-10-31T22:50:51.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.481+0000 7f6893f16700 1 -- 172.21.15.60:0/4152563997 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c144950 con 0x7f688c067440 2020-10-31T22:50:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.481+0000 7f6893f16700 1 -- 172.21.15.60:0/4152563997 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688c146370 con 0x7f688c067440 2020-10-31T22:50:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.481+0000 7f687effd700 1 -- 172.21.15.60:0/4152563997 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6880010070 con 0x7f688c067440 2020-10-31T22:50:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.481+0000 7f687effd700 1 --2- 172.21.15.60:0/4152563997 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f686c054f10 0x7f686c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.481+0000 7f6891cb2700 1 --2- 172.21.15.60:0/4152563997 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f686c054f10 0x7f686c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:51.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.481+0000 7f687effd700 1 -- 172.21.15.60:0/4152563997 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f688006d0d0 con 0x7f688c067440 2020-10-31T22:50:51.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.481+0000 7f6891cb2700 1 --2- 172.21.15.60:0/4152563997 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f686c054f10 0x7f686c0573d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f6888006000 tx=0x7f6888008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:51.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.489+0000 7f687effd700 1 -- 172.21.15.60:0/4152563997 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f688c146370 con 0x7f688c067440 2020-10-31T22:50:51.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.633+0000 7f6893f16700 1 -- 172.21.15.60:0/4152563997 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f688c146370 con 0x7f688c067440 2020-10-31T22:50:51.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.637+0000 7f687effd700 1 -- 172.21.15.60:0/4152563997 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f688c146370 con 0x7f688c067440 2020-10-31T22:50:51.642 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:51.642 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":149,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:50:46.335277+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":27,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:50:43.020680+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":28,"pool_name":"cephfs_data","create_time":"2020-10-31T22:50:44.329474+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:50:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.637+0000 7f6893f16700 1 -- 172.21.15.60:0/4152563997 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f686c054f10 msgr2=0x7f686c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.637+0000 7f6893f16700 1 --2- 172.21.15.60:0/4152563997 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f686c054f10 0x7f686c0573d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f6888006000 tx=0x7f6888008040).stop 2020-10-31T22:50:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.637+0000 7f6893f16700 1 -- 172.21.15.60:0/4152563997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c067440 msgr2=0x7f688c0acad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.637+0000 7f6893f16700 1 --2- 172.21.15.60:0/4152563997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c067440 0x7f688c0acad0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 rx=0x7f68800010d0 tx=0x7f6880007a70).stop 2020-10-31T22:50:51.644 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.637+0000 7f6893f16700 1 -- 172.21.15.60:0/4152563997 shutdown_connections 2020-10-31T22:50:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.637+0000 7f6893f16700 1 --2- 172.21.15.60:0/4152563997 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f686c054f10 0x7f686c0573d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.637+0000 7f6893f16700 1 --2- 172.21.15.60:0/4152563997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f688c0b30c0 0x7f688c0acfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.637+0000 7f6893f16700 1 --2- 172.21.15.60:0/4152563997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f688c060e70 0x7f688c0afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.637+0000 7f6893f16700 1 --2- 172.21.15.60:0/4152563997 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f688c067440 0x7f688c0acad0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.637+0000 7f6893f16700 1 -- 172.21.15.60:0/4152563997 >> 172.21.15.60:0/4152563997 conn(0x7f688c06a260 msgr2=0x7f688c0639c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.637+0000 7f6893f16700 1 -- 172.21.15.60:0/4152563997 shutdown_connections 2020-10-31T22:50:51.645 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.637+0000 7f6893f16700 1 -- 172.21.15.60:0/4152563997 wait complete. 2020-10-31T22:50:51.656 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 27, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:50:43.020680+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 28, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:50:44.329474+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '149', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:50:51.657 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:50:51.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.765+0000 7f4f1184a700 1 Processor -- start 2020-10-31T22:50:51.772 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.765+0000 7f4f1184a700 1 -- start start 2020-10-31T22:50:51.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f1184a700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4f0c0b5570 0x7f4f0c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:51.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f1184a700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f0c0b24a0 0x7f4f0c145950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:51.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f1184a700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f0c0b4440 con 0x7f4f0c145e40 2020-10-31T22:50:51.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f1184a700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c13f930 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f1184a700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0c0b02f0 con 0x7f4f0c0b5570 2020-10-31T22:50:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f0bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f0c0b24a0 0x7f4f0c145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f0bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4f0c0b24a0 0x7f4f0c145950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49714/0 (socket says 172.21.15.60:49714) 2020-10-31T22:50:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f0bfff700 1 -- 172.21.15.60:0/393460441 learned_addr learned my addr 172.21.15.60:0/393460441 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f10848700 1 --2- 172.21.15.60:0/393460441 >> v2:172.21.15.66:3300/0 conn(0x7f4f0c0b5570 0x7f4f0c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f0bfff700 1 -- 172.21.15.60:0/393460441 >> v2:172.21.15.66:3300/0 conn(0x7f4f0c0b5570 msgr2=0x7f4f0c0b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:51.776 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f0bfff700 1 --2- 172.21.15.60:0/393460441 >> v2:172.21.15.66:3300/0 conn(0x7f4f0c0b5570 0x7f4f0c0b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f0bfff700 1 -- 172.21.15.60:0/393460441 >> v1:172.21.15.66:6789/0 conn(0x7f4f0c145e40 legacy=0x7f4f0c141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f0bfff700 1 -- 172.21.15.60:0/393460441 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c0b0590 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f0bfff700 1 --2- 172.21.15.60:0/393460441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f0c0b24a0 0x7f4f0c145950 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f4efc002f30 tx=0x7f4efc006e80).ready entity=mon.0 client_cookie=7235020da3613dcb server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f0b7fe700 1 -- 172.21.15.60:0/393460441 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4efc0097f0 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f0b7fe700 1 -- 172.21.15.60:0/393460441 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc009950 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.777 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f0b7fe700 1 -- 172.21.15.60:0/393460441 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4efc009cb0 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f1184a700 1 -- 172.21.15.60:0/393460441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f0c0b24a0 msgr2=0x7f4f0c145950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f1184a700 1 --2- 172.21.15.60:0/393460441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f0c0b24a0 0x7f4f0c145950 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 rx=0x7f4efc002f30 tx=0x7f4efc006e80).stop 2020-10-31T22:50:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f1184a700 1 -- 172.21.15.60:0/393460441 shutdown_connections 2020-10-31T22:50:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f1184a700 1 --2- 172.21.15.60:0/393460441 >> v2:172.21.15.66:3300/0 conn(0x7f4f0c0b5570 0x7f4f0c0b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f1184a700 1 --2- 172.21.15.60:0/393460441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f0c0b24a0 0x7f4f0c145950 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f1184a700 1 -- 172.21.15.60:0/393460441 >> 172.21.15.60:0/393460441 conn(0x7f4f0c0b8e90 msgr2=0x7f4f0c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:51.778 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f1184a700 1 -- 172.21.15.60:0/393460441 shutdown_connections 2020-10-31T22:50:51.779 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.769+0000 7f4f1184a700 1 -- 172.21.15.60:0/393460441 wait complete. 2020-10-31T22:50:51.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f1184a700 1 Processor -- start 2020-10-31T22:50:51.780 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f1184a700 1 -- start start 2020-10-31T22:50:51.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f1184a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f0c0b24a0 0x7f4f0c142210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:51.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f1184a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f0c0b5570 0x7f4f0c143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:51.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f1184a700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4f0c145e40 0x7f4f0c143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:51.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f1184a700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c0aca80 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f1184a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c151a20 con 0x7f4f0c0b5570 2020-10-31T22:50:51.781 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f1184a700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0c142ce0 con 0x7f4f0c145e40 2020-10-31T22:50:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f10848700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f0c0b24a0 0x7f4f0c142210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f10848700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f0c0b24a0 0x7f4f0c142210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49718/0 (socket says 172.21.15.60:49718) 2020-10-31T22:50:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f10848700 1 -- 172.21.15.60:0/2979931345 learned_addr learned my addr 172.21.15.60:0/2979931345 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f0bfff700 1 --2- 172.21.15.60:0/2979931345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f0c0b5570 0x7f4f0c143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f11049700 1 --2- 172.21.15.60:0/2979931345 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4f0c145e40 0x7f4f0c143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:51.782 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f10848700 1 -- 172.21.15.60:0/2979931345 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4f0c145e40 msgr2=0x7f4f0c143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:51.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f10848700 1 --2- 172.21.15.60:0/2979931345 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4f0c145e40 0x7f4f0c143600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f10848700 1 -- 172.21.15.60:0/2979931345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f0c0b5570 msgr2=0x7f4f0c143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:51.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f10848700 1 --2- 172.21.15.60:0/2979931345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f0c0b5570 0x7f4f0c143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f10848700 1 -- 172.21.15.60:0/2979931345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f0c0b6140 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.783 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f10848700 1 --2- 172.21.15.60:0/2979931345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f0c0b24a0 0x7f4f0c142210 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f4f0c0ad480 tx=0x7f4ef4008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:51.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f09ffb700 1 -- 172.21.15.60:0/2979931345 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef4009980 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f09ffb700 1 -- 172.21.15.60:0/2979931345 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef4009ae0 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f1184a700 1 -- 172.21.15.60:0/2979931345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f0c143af0 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f09ffb700 1 -- 172.21.15.60:0/2979931345 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ef4009e40 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.784 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.773+0000 7f4f1184a700 1 -- 172.21.15.60:0/2979931345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f0c0b6f10 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.777+0000 7f4f1184a700 1 -- 172.21.15.60:0/2979931345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f0c142e20 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.777+0000 7f4f09ffb700 1 -- 172.21.15.60:0/2979931345 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4ef4013480 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.785 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.777+0000 7f4f09ffb700 1 --2- 172.21.15.60:0/2979931345 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4ef0055020 0x7f4ef00574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:51.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.777+0000 7f4f09ffb700 1 -- 172.21.15.60:0/2979931345 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4ef406e100 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.777+0000 7f4f0bfff700 1 --2- 172.21.15.60:0/2979931345 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4ef0055020 0x7f4ef00574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:51.786 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.777+0000 7f4f0bfff700 1 --2- 172.21.15.60:0/2979931345 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4ef0055020 0x7f4ef00574e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f4efc01a000 tx=0x7f4efc015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:51.790 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.785+0000 7f4f09ffb700 1 -- 172.21.15.60:0/2979931345 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4ef40445c0 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.929+0000 7f4f1184a700 1 -- 172.21.15.60:0/2979931345 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f4f0c0b64c0 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.929+0000 7f4f09ffb700 1 -- 172.21.15.60:0/2979931345 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v149) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4ef4047be0 con 0x7f4f0c0b24a0 2020-10-31T22:50:51.934 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:50:51.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.929+0000 7f4f1184a700 1 -- 172.21.15.60:0/2979931345 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4ef0055020 msgr2=0x7f4ef00574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:51.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.929+0000 7f4f1184a700 1 --2- 172.21.15.60:0/2979931345 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4ef0055020 0x7f4ef00574e0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f4efc01a000 tx=0x7f4efc015000).stop 2020-10-31T22:50:51.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.929+0000 7f4f1184a700 1 -- 172.21.15.60:0/2979931345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f0c0b24a0 msgr2=0x7f4f0c142210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:51.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.929+0000 7f4f1184a700 1 --2- 172.21.15.60:0/2979931345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f0c0b24a0 0x7f4f0c142210 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 rx=0x7f4f0c0ad480 tx=0x7f4ef4008040).stop 2020-10-31T22:50:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.929+0000 7f4f1184a700 1 -- 172.21.15.60:0/2979931345 shutdown_connections 2020-10-31T22:50:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.929+0000 7f4f1184a700 1 --2- 172.21.15.60:0/2979931345 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4f0c145e40 0x7f4f0c143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.929+0000 7f4f1184a700 1 --2- 172.21.15.60:0/2979931345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4f0c0b24a0 0x7f4f0c142210 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.929+0000 7f4f1184a700 1 --2- 172.21.15.60:0/2979931345 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4ef0055020 0x7f4ef00574e0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.929+0000 7f4f1184a700 1 --2- 172.21.15.60:0/2979931345 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f0c0b5570 0x7f4f0c143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:51.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.929+0000 7f4f1184a700 1 -- 172.21.15.60:0/2979931345 >> 172.21.15.60:0/2979931345 conn(0x7f4f0c0b8e90 msgr2=0x7f4f0c0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:51.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.929+0000 7f4f1184a700 1 -- 172.21.15.60:0/2979931345 shutdown_connections 2020-10-31T22:50:51.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:51.929+0000 7f4f1184a700 1 -- 172.21.15.60:0/2979931345 wait complete. 2020-10-31T22:50:51.948 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:50:52.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f415e3df700 1 Processor -- start 2020-10-31T22:50:52.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f415e3df700 1 -- start start 2020-10-31T22:50:52.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f415e3df700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f415805c660 0x7f41580b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f415e3df700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4158065f70 0x7f415813f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f415e3df700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f415813f880 0x7f4158142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f415e3df700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4158066d60 con 0x7f4158065f70 2020-10-31T22:50:52.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f415e3df700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41580b5e80 con 0x7f415805c660 2020-10-31T22:50:52.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f415e3df700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4158066410 con 0x7f415813f880 2020-10-31T22:50:52.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f41577fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4158065f70 0x7f415813f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f41577fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4158065f70 0x7f415813f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49728/0 (socket says 172.21.15.60:49728) 2020-10-31T22:50:52.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f415c97c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f415813f880 0x7f4158142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f4157fff700 1 --2- 172.21.15.60:0/3470675757 >> v2:172.21.15.66:3300/0 conn(0x7f415805c660 0x7f41580b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f41577fe700 1 -- 172.21.15.60:0/3470675757 learned_addr learned my addr 172.21.15.60:0/3470675757 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:52.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f41577fe700 1 -- 172.21.15.60:0/3470675757 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f415813f880 msgr2=0x7f4158142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:52.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f41577fe700 1 --2- 172.21.15.60:0/3470675757 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f415813f880 0x7f4158142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f41577fe700 1 -- 172.21.15.60:0/3470675757 >> v2:172.21.15.66:3300/0 conn(0x7f415805c660 msgr2=0x7f41580b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:52.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f41577fe700 1 --2- 172.21.15.60:0/3470675757 >> v2:172.21.15.66:3300/0 conn(0x7f415805c660 0x7f41580b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f41577fe700 1 -- 172.21.15.60:0/3470675757 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41580666b0 con 0x7f4158065f70 2020-10-31T22:50:52.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.061+0000 7f41577fe700 1 --2- 172.21.15.60:0/3470675757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4158065f70 0x7f415813f390 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f414c002f30 tx=0x7f414c006e80).ready entity=mon.0 client_cookie=2a030a4ab325c76d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:52.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.065+0000 7f4156ffd700 1 -- 172.21.15.60:0/3470675757 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414c009640 con 0x7f4158065f70 2020-10-31T22:50:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.065+0000 7f4156ffd700 1 -- 172.21.15.60:0/3470675757 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414c0097a0 con 0x7f4158065f70 2020-10-31T22:50:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.065+0000 7f4156ffd700 1 -- 172.21.15.60:0/3470675757 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414c009b00 con 0x7f4158065f70 2020-10-31T22:50:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.065+0000 7f415e3df700 1 -- 172.21.15.60:0/3470675757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4158065f70 msgr2=0x7f415813f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.065+0000 7f415e3df700 1 --2- 172.21.15.60:0/3470675757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4158065f70 0x7f415813f390 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 rx=0x7f414c002f30 tx=0x7f414c006e80).stop 2020-10-31T22:50:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.065+0000 7f415e3df700 1 -- 172.21.15.60:0/3470675757 shutdown_connections 2020-10-31T22:50:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.065+0000 7f415e3df700 1 --2- 172.21.15.60:0/3470675757 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f415813f880 0x7f4158142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.065+0000 7f415e3df700 1 --2- 172.21.15.60:0/3470675757 >> v2:172.21.15.66:3300/0 conn(0x7f415805c660 0x7f41580b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.065+0000 7f415e3df700 1 --2- 172.21.15.60:0/3470675757 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4158065f70 0x7f415813f390 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.065+0000 7f415e3df700 1 -- 172.21.15.60:0/3470675757 >> 172.21.15.60:0/3470675757 conn(0x7f41580601e0 msgr2=0x7f415805b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:52.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.065+0000 7f415e3df700 1 -- 172.21.15.60:0/3470675757 shutdown_connections 2020-10-31T22:50:52.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.065+0000 7f415e3df700 1 -- 172.21.15.60:0/3470675757 wait complete. 2020-10-31T22:50:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.065+0000 7f415e3df700 1 Processor -- start 2020-10-31T22:50:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.065+0000 7f415e3df700 1 -- start start 2020-10-31T22:50:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f415e3df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f415805c660 0x7f41580aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f415e3df700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158065f70 0x7f41581519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f415e3df700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f415813f880 0x7f4158148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f415e3df700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41580af080 con 0x7f415805c660 2020-10-31T22:50:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f415e3df700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41580aeb90 con 0x7f4158065f70 2020-10-31T22:50:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f415e3df700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4158151010 con 0x7f415813f880 2020-10-31T22:50:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f4157fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f415805c660 0x7f41580aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f4157fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f415805c660 0x7f41580aa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49730/0 (socket says 172.21.15.60:49730) 2020-10-31T22:50:52.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f4157fff700 1 -- 172.21.15.60:0/720824107 learned_addr learned my addr 172.21.15.60:0/720824107 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:52.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f41577fe700 1 --2- 172.21.15.60:0/720824107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158065f70 0x7f41581519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f415c97c700 1 --2- 172.21.15.60:0/720824107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f415813f880 0x7f4158148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f4157fff700 1 -- 172.21.15.60:0/720824107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f415813f880 msgr2=0x7f4158148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f4157fff700 1 --2- 172.21.15.60:0/720824107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f415813f880 0x7f4158148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f4157fff700 1 -- 172.21.15.60:0/720824107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158065f70 msgr2=0x7f41581519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f4157fff700 1 --2- 172.21.15.60:0/720824107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158065f70 0x7f41581519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f4157fff700 1 -- 172.21.15.60:0/720824107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41581512b0 con 0x7f415805c660 2020-10-31T22:50:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f4157fff700 1 --2- 172.21.15.60:0/720824107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f415805c660 0x7f41580aa5c0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f414800c000 tx=0x7f4148006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f41557fa700 1 -- 172.21.15.60:0/720824107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f414800ca10 con 0x7f415805c660 2020-10-31T22:50:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f41557fa700 1 -- 172.21.15.60:0/720824107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414800cb70 con 0x7f415805c660 2020-10-31T22:50:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f415e3df700 1 -- 172.21.15.60:0/720824107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4158151550 con 0x7f415805c660 2020-10-31T22:50:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f41557fa700 1 -- 172.21.15.60:0/720824107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f41480123f0 con 0x7f415805c660 2020-10-31T22:50:52.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.069+0000 7f415e3df700 1 -- 172.21.15.60:0/720824107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41580ab150 con 0x7f415805c660 2020-10-31T22:50:52.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.073+0000 7f41557fa700 1 -- 172.21.15.60:0/720824107 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4148012550 con 0x7f415805c660 2020-10-31T22:50:52.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.073+0000 7f415e3df700 1 -- 172.21.15.60:0/720824107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41581516e0 con 0x7f415805c660 2020-10-31T22:50:52.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.073+0000 7f41557fa700 1 --2- 172.21.15.60:0/720824107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4138054f10 0x7f41380573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.073+0000 7f41577fe700 1 --2- 172.21.15.60:0/720824107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4138054f10 0x7f41380573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.073+0000 7f41557fa700 1 -- 172.21.15.60:0/720824107 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f414806dd70 con 0x7f415805c660 2020-10-31T22:50:52.080 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.073+0000 7f41577fe700 1 --2- 172.21.15.60:0/720824107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4138054f10 0x7f41380573d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f414c01b000 tx=0x7f414c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:52.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.077+0000 7f41557fa700 1 -- 172.21.15.60:0/720824107 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4148044230 con 0x7f415805c660 2020-10-31T22:50:52.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.225+0000 7f415e3df700 1 -- 172.21.15.60:0/720824107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4158057100 con 0x7f415805c660 2020-10-31T22:50:52.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.225+0000 7f41557fa700 1 -- 172.21.15.60:0/720824107 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v149) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4148047850 con 0x7f415805c660 2020-10-31T22:50:52.229 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:52.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.225+0000 7f415e3df700 1 -- 172.21.15.60:0/720824107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4138054f10 msgr2=0x7f41380573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.225+0000 7f415e3df700 1 --2- 172.21.15.60:0/720824107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4138054f10 0x7f41380573d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f414c01b000 tx=0x7f414c015000).stop 2020-10-31T22:50:52.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.225+0000 7f415e3df700 1 -- 172.21.15.60:0/720824107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f415805c660 msgr2=0x7f41580aa5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.225+0000 7f415e3df700 1 --2- 172.21.15.60:0/720824107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f415805c660 0x7f41580aa5c0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 rx=0x7f414800c000 tx=0x7f4148006dc0).stop 2020-10-31T22:50:52.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.225+0000 7f415e3df700 1 -- 172.21.15.60:0/720824107 shutdown_connections 2020-10-31T22:50:52.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.225+0000 7f415e3df700 1 --2- 172.21.15.60:0/720824107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f415813f880 0x7f4158148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.225+0000 7f415e3df700 1 --2- 172.21.15.60:0/720824107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f415805c660 0x7f41580aa5c0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.225+0000 7f415e3df700 1 --2- 172.21.15.60:0/720824107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4138054f10 0x7f41380573d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.225+0000 7f415e3df700 1 --2- 172.21.15.60:0/720824107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4158065f70 0x7f41581519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.225+0000 7f415e3df700 1 -- 172.21.15.60:0/720824107 >> 172.21.15.60:0/720824107 conn(0x7f41580601e0 msgr2=0x7f41580b84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:52.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.225+0000 7f415e3df700 1 -- 172.21.15.60:0/720824107 shutdown_connections 2020-10-31T22:50:52.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.225+0000 7f415e3df700 1 -- 172.21.15.60:0/720824107 wait complete. 2020-10-31T22:50:52.243 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:50:52.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.357+0000 7f1835475700 1 Processor -- start 2020-10-31T22:50:52.363 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.357+0000 7f1835475700 1 -- start start 2020-10-31T22:50:52.364 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.357+0000 7f1835475700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18300b24a0 0x7f18300b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.357+0000 7f1835475700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1830141f00 0x7f1830142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.357+0000 7f1835475700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18300b4440 con 0x7f18300b5570 2020-10-31T22:50:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.357+0000 7f1835475700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183013f930 con 0x7f18300b24a0 2020-10-31T22:50:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.357+0000 7f1835475700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1830146060 con 0x7f1830141f00 2020-10-31T22:50:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.357+0000 7f182f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18300b24a0 0x7f18300b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.357+0000 7f182f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f18300b24a0 0x7f18300b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49740/0 (socket says 172.21.15.60:49740) 2020-10-31T22:50:52.365 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.357+0000 7f182ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f18300b5570 0x7f1830145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53874/0 (socket says 172.21.15.60:53874) 2020-10-31T22:50:52.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.357+0000 7f182f7fe700 1 -- 172.21.15.60:0/1139812585 learned_addr learned my addr 172.21.15.60:0/1139812585 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:52.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f1834c74700 1 --2- 172.21.15.60:0/1139812585 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1830141f00 0x7f1830142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f182f7fe700 1 -- 172.21.15.60:0/1139812585 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1830141f00 msgr2=0x7f1830142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:52.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f182f7fe700 1 --2- 172.21.15.60:0/1139812585 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1830141f00 0x7f1830142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f182f7fe700 1 -- 172.21.15.60:0/1139812585 >> v1:172.21.15.60:6789/0 conn(0x7f18300b5570 legacy=0x7f1830145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.366 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f182f7fe700 1 -- 172.21.15.60:0/1139812585 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300b02f0 con 0x7f18300b24a0 2020-10-31T22:50:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f182f7fe700 1 --2- 172.21.15.60:0/1139812585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18300b24a0 0x7f18300b5950 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f1818002f30 tx=0x7f1818006e80).ready entity=mon.0 client_cookie=db5c766bb956f0b8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:52.367 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f182effd700 1 -- 172.21.15.60:0/1139812585 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1818009910 con 0x7f18300b24a0 2020-10-31T22:50:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f182effd700 1 -- 172.21.15.60:0/1139812585 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1818009a70 con 0x7f18300b24a0 2020-10-31T22:50:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f182effd700 1 -- 172.21.15.60:0/1139812585 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1818009dd0 con 0x7f18300b24a0 2020-10-31T22:50:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f1835475700 1 -- 172.21.15.60:0/1139812585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18300b24a0 msgr2=0x7f18300b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f1835475700 1 --2- 172.21.15.60:0/1139812585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18300b24a0 0x7f18300b5950 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 rx=0x7f1818002f30 tx=0x7f1818006e80).stop 2020-10-31T22:50:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f1835475700 1 -- 172.21.15.60:0/1139812585 shutdown_connections 2020-10-31T22:50:52.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f1835475700 1 --2- 172.21.15.60:0/1139812585 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1830141f00 0x7f1830142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f1835475700 1 --2- 172.21.15.60:0/1139812585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18300b24a0 0x7f18300b5950 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f1835475700 1 -- 172.21.15.60:0/1139812585 >> 172.21.15.60:0/1139812585 conn(0x7f18300b8e90 msgr2=0x7f18300b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f1835475700 1 -- 172.21.15.60:0/1139812585 shutdown_connections 2020-10-31T22:50:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f1835475700 1 -- 172.21.15.60:0/1139812585 wait complete. 2020-10-31T22:50:52.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f1835475700 1 Processor -- start 2020-10-31T22:50:52.370 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.361+0000 7f1835475700 1 -- start start 2020-10-31T22:50:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f1835475700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18300b24a0 0x7f183013d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f1835475700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18300b5570 0x7f18300b5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f1835475700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1830141f00 0x7f18300b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f1835475700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1830154360 con 0x7f18300b24a0 2020-10-31T22:50:52.371 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f1835475700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18300b80e0 con 0x7f1830141f00 2020-10-31T22:50:52.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f1835475700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1830154590 con 0x7f18300b5570 2020-10-31T22:50:52.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f182ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18300b24a0 0x7f183013d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f182ffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18300b24a0 0x7f183013d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49744/0 (socket says 172.21.15.60:49744) 2020-10-31T22:50:52.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f182ffff700 1 -- 172.21.15.60:0/2189720478 learned_addr learned my addr 172.21.15.60:0/2189720478 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:52.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f182f7fe700 1 --2- 172.21.15.60:0/2189720478 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18300b5570 0x7f18300b5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.372 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f1834c74700 1 --2- 172.21.15.60:0/2189720478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1830141f00 0x7f18300b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f182ffff700 1 -- 172.21.15.60:0/2189720478 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18300b5570 msgr2=0x7f18300b5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f182ffff700 1 --2- 172.21.15.60:0/2189720478 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18300b5570 0x7f18300b5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f182ffff700 1 -- 172.21.15.60:0/2189720478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1830141f00 msgr2=0x7f18300b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f182ffff700 1 --2- 172.21.15.60:0/2189720478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1830141f00 0x7f18300b64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f182ffff700 1 -- 172.21.15.60:0/2189720478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1830154830 con 0x7f18300b24a0 2020-10-31T22:50:52.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f182ffff700 1 --2- 172.21.15.60:0/2189720478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18300b24a0 0x7f183013d700 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f18300610d0 tx=0x7f1820007b80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:52.373 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f182d7fa700 1 -- 172.21.15.60:0/2189720478 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1820007320 con 0x7f18300b24a0 2020-10-31T22:50:52.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f182d7fa700 1 -- 172.21.15.60:0/2189720478 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1820005520 con 0x7f18300b24a0 2020-10-31T22:50:52.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f1835475700 1 -- 172.21.15.60:0/2189720478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1830154ad0 con 0x7f18300b24a0 2020-10-31T22:50:52.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f182d7fa700 1 -- 172.21.15.60:0/2189720478 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1820005880 con 0x7f18300b24a0 2020-10-31T22:50:52.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f1835475700 1 -- 172.21.15.60:0/2189720478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18300ad0f0 con 0x7f18300b24a0 2020-10-31T22:50:52.374 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.365+0000 7f1835475700 1 -- 172.21.15.60:0/2189720478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1830154c60 con 0x7f18300b24a0 2020-10-31T22:50:52.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.369+0000 7f182d7fa700 1 -- 172.21.15.60:0/2189720478 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1820010030 con 0x7f18300b24a0 2020-10-31T22:50:52.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.369+0000 7f182d7fa700 1 --2- 172.21.15.60:0/2189720478 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1814054f90 0x7f1814057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.369+0000 7f182d7fa700 1 -- 172.21.15.60:0/2189720478 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f182006d690 con 0x7f18300b24a0 2020-10-31T22:50:52.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.369+0000 7f182f7fe700 1 --2- 172.21.15.60:0/2189720478 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1814054f90 0x7f1814057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.375 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.369+0000 7f182f7fe700 1 --2- 172.21.15.60:0/2189720478 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1814054f90 0x7f1814057450 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f1818019000 tx=0x7f1818015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:52.380 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.373+0000 7f182d7fa700 1 -- 172.21.15.60:0/2189720478 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1820043bb0 con 0x7f18300b24a0 2020-10-31T22:50:52.523 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.517+0000 7f1835475700 1 -- 172.21.15.60:0/2189720478 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1830057100 con 0x7f18300b24a0 2020-10-31T22:50:52.524 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.517+0000 7f182d7fa700 1 -- 172.21.15.60:0/2189720478 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v149) v1 ==== 104+0+10 (secure 0 0 0) 0x7f18200471d0 con 0x7f18300b24a0 2020-10-31T22:50:52.524 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:52.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.521+0000 7f1835475700 1 -- 172.21.15.60:0/2189720478 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1814054f90 msgr2=0x7f1814057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.521+0000 7f1835475700 1 --2- 172.21.15.60:0/2189720478 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1814054f90 0x7f1814057450 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f1818019000 tx=0x7f1818015000).stop 2020-10-31T22:50:52.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.521+0000 7f1835475700 1 -- 172.21.15.60:0/2189720478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18300b24a0 msgr2=0x7f183013d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.521+0000 7f1835475700 1 --2- 172.21.15.60:0/2189720478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18300b24a0 0x7f183013d700 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 rx=0x7f18300610d0 tx=0x7f1820007b80).stop 2020-10-31T22:50:52.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.521+0000 7f1835475700 1 -- 172.21.15.60:0/2189720478 shutdown_connections 2020-10-31T22:50:52.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.521+0000 7f1835475700 1 --2- 172.21.15.60:0/2189720478 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1814054f90 0x7f1814057450 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.521+0000 7f1835475700 1 --2- 172.21.15.60:0/2189720478 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1830141f00 0x7f18300b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.521+0000 7f1835475700 1 --2- 172.21.15.60:0/2189720478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18300b24a0 0x7f183013d700 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.521+0000 7f1835475700 1 --2- 172.21.15.60:0/2189720478 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18300b5570 0x7f18300b5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.521+0000 7f1835475700 1 -- 172.21.15.60:0/2189720478 >> 172.21.15.60:0/2189720478 conn(0x7f18300b8e90 msgr2=0x7f1830142390 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:52.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.521+0000 7f1835475700 1 -- 172.21.15.60:0/2189720478 shutdown_connections 2020-10-31T22:50:52.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.521+0000 7f1835475700 1 -- 172.21.15.60:0/2189720478 wait complete. 2020-10-31T22:50:52.539 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:50:52.662 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfc4aa3700 1 Processor -- start 2020-10-31T22:50:52.663 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfc4aa3700 1 -- start start 2020-10-31T22:50:52.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfc4aa3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfc00b1d50 0x7fcfc0145c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.664 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfc4aa3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcfc005bc60 0x7fcfc013f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfc4aa3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc00aef60 con 0x7fcfc005c2d0 2020-10-31T22:50:52.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfc4aa3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc00afb20 con 0x7fcfc005bc60 2020-10-31T22:50:52.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfc4aa3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc00b2130 con 0x7fcfc00b1d50 2020-10-31T22:50:52.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfbffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fcfc005bc60 0x7fcfc013f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfbeffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fcfc005c2d0 0x7fcfc00af410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53890/0 (socket says 172.21.15.60:53890) 2020-10-31T22:50:52.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfbeffd700 1 -- 172.21.15.60:0/4070345245 learned_addr learned my addr 172.21.15.60:0/4070345245 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:52.665 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfbf7fe700 1 --2- 172.21.15.60:0/4070345245 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfc00b1d50 0x7fcfc0145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfbe7fc700 1 -- 172.21.15.60:0/4070345245 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512913632 0 0) 0x7fcfb40010d0 con 0x7fcfc005c2d0 2020-10-31T22:50:52.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfbe7fc700 1 -- 172.21.15.60:0/4070345245 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfac003230 con 0x7fcfc005c2d0 2020-10-31T22:50:52.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfbffff700 1 -- 172.21.15.60:0/4070345245 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfc00b1d50 msgr2=0x7fcfc0145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:52.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfbffff700 1 --2- 172.21.15.60:0/4070345245 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfc00b1d50 0x7fcfc0145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfbffff700 1 -- 172.21.15.60:0/4070345245 >> v1:172.21.15.60:6789/0 conn(0x7fcfc005c2d0 legacy=0x7fcfc00af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfbffff700 1 -- 172.21.15.60:0/4070345245 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc005c0b0 con 0x7fcfc005bc60 2020-10-31T22:50:52.666 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.657+0000 7fcfbffff700 1 --2- 172.21.15.60:0/4070345245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc005bc60 0x7fcfc013f1b0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fcfb80032b0 tx=0x7fcfb80091a0).ready entity=mon.0 client_cookie=8c949bacaea0a11b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:52.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfbe7fc700 1 -- 172.21.15.60:0/4070345245 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfb800b940 con 0x7fcfc005bc60 2020-10-31T22:50:52.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfbe7fc700 1 -- 172.21.15.60:0/4070345245 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb800baa0 con 0x7fcfc005bc60 2020-10-31T22:50:52.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfbe7fc700 1 -- 172.21.15.60:0/4070345245 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfb800bc10 con 0x7fcfc005bc60 2020-10-31T22:50:52.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/4070345245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc005bc60 msgr2=0x7fcfc013f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.667 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 --2- 172.21.15.60:0/4070345245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc005bc60 0x7fcfc013f1b0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 rx=0x7fcfb80032b0 tx=0x7fcfb80091a0).stop 2020-10-31T22:50:52.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/4070345245 shutdown_connections 2020-10-31T22:50:52.669 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 --2- 172.21.15.60:0/4070345245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc005bc60 0x7fcfc013f1b0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 --2- 172.21.15.60:0/4070345245 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfc00b1d50 0x7fcfc0145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/4070345245 >> 172.21.15.60:0/4070345245 conn(0x7fcfc00b5330 msgr2=0x7fcfc00b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/4070345245 shutdown_connections 2020-10-31T22:50:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/4070345245 wait complete. 2020-10-31T22:50:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 Processor -- start 2020-10-31T22:50:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 -- start start 2020-10-31T22:50:52.670 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc005bc60 0x7fcfc013ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfc005c2d0 0x7fcfc0151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfc00b1d50 0x7fcfc0151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc00ae8b0 con 0x7fcfc005bc60 2020-10-31T22:50:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc0150c00 con 0x7fcfc005c2d0 2020-10-31T22:50:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfc4aa3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc01415c0 con 0x7fcfc00b1d50 2020-10-31T22:50:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.661+0000 7fcfbf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc005bc60 0x7fcfc013ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbf7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc005bc60 0x7fcfc013ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49758/0 (socket says 172.21.15.60:49758) 2020-10-31T22:50:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbf7fe700 1 -- 172.21.15.60:0/2680926931 learned_addr learned my addr 172.21.15.60:0/2680926931 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbeffd700 1 --2- 172.21.15.60:0/2680926931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfc005c2d0 0x7fcfc0151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbffff700 1 --2- 172.21.15.60:0/2680926931 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfc00b1d50 0x7fcfc0151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbf7fe700 1 -- 172.21.15.60:0/2680926931 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfc00b1d50 msgr2=0x7fcfc0151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbf7fe700 1 --2- 172.21.15.60:0/2680926931 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfc00b1d50 0x7fcfc0151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbf7fe700 1 -- 172.21.15.60:0/2680926931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfc005c2d0 msgr2=0x7fcfc0151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbf7fe700 1 --2- 172.21.15.60:0/2680926931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfc005c2d0 0x7fcfc0151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbf7fe700 1 -- 172.21.15.60:0/2680926931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc0141860 con 0x7fcfc005bc60 2020-10-31T22:50:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbf7fe700 1 --2- 172.21.15.60:0/2680926931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc005bc60 0x7fcfc013ff30 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fcfb000c000 tx=0x7fcfb0006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbcff9700 1 -- 172.21.15.60:0/2680926931 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfb000ca10 con 0x7fcfc005bc60 2020-10-31T22:50:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbcff9700 1 -- 172.21.15.60:0/2680926931 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb000cb70 con 0x7fcfc005bc60 2020-10-31T22:50:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/2680926931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc0141b00 con 0x7fcfc005bc60 2020-10-31T22:50:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbcff9700 1 -- 172.21.15.60:0/2680926931 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcfb00123f0 con 0x7fcfc005bc60 2020-10-31T22:50:52.673 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/2680926931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc0151a00 con 0x7fcfc005bc60 2020-10-31T22:50:52.674 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbcff9700 1 -- 172.21.15.60:0/2680926931 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fcfb0012550 con 0x7fcfc005bc60 2020-10-31T22:50:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/2680926931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc0141eb0 con 0x7fcfc005bc60 2020-10-31T22:50:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbcff9700 1 --2- 172.21.15.60:0/2680926931 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcfa0054f90 0x7fcfa0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbeffd700 1 --2- 172.21.15.60:0/2680926931 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcfa0054f90 0x7fcfa0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.665+0000 7fcfbcff9700 1 -- 172.21.15.60:0/2680926931 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fcfb006dff0 con 0x7fcfc005bc60 2020-10-31T22:50:52.675 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.669+0000 7fcfbeffd700 1 --2- 172.21.15.60:0/2680926931 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcfa0054f90 0x7fcfa0057450 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fcfb400d000 tx=0x7fcfb4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:52.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.673+0000 7fcfbcff9700 1 -- 172.21.15.60:0/2680926931 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fcfb00443a0 con 0x7fcfc005bc60 2020-10-31T22:50:52.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.813+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/2680926931 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcfc0057100 con 0x7fcfc005bc60 2020-10-31T22:50:52.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.813+0000 7fcfbcff9700 1 -- 172.21.15.60:0/2680926931 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v149) v1 ==== 100+0+10 (secure 0 0 0) 0x7fcfb00479c0 con 0x7fcfc005bc60 2020-10-31T22:50:52.819 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:50:52.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.817+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/2680926931 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcfa0054f90 msgr2=0x7fcfa0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.817+0000 7fcfc4aa3700 1 --2- 172.21.15.60:0/2680926931 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcfa0054f90 0x7fcfa0057450 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7fcfb400d000 tx=0x7fcfb4009040).stop 2020-10-31T22:50:52.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.817+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/2680926931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc005bc60 msgr2=0x7fcfc013ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.817+0000 7fcfc4aa3700 1 --2- 172.21.15.60:0/2680926931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc005bc60 0x7fcfc013ff30 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 rx=0x7fcfb000c000 tx=0x7fcfb0006dc0).stop 2020-10-31T22:50:52.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.817+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/2680926931 shutdown_connections 2020-10-31T22:50:52.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.817+0000 7fcfc4aa3700 1 --2- 172.21.15.60:0/2680926931 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfc00b1d50 0x7fcfc0151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.817+0000 7fcfc4aa3700 1 --2- 172.21.15.60:0/2680926931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcfc005bc60 0x7fcfc013ff30 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.817+0000 7fcfc4aa3700 1 --2- 172.21.15.60:0/2680926931 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fcfa0054f90 0x7fcfa0057450 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.817+0000 7fcfc4aa3700 1 --2- 172.21.15.60:0/2680926931 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfc005c2d0 0x7fcfc0151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.817+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/2680926931 >> 172.21.15.60:0/2680926931 conn(0x7fcfc00b5330 msgr2=0x7fcfc013e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:52.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.817+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/2680926931 shutdown_connections 2020-10-31T22:50:52.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.817+0000 7fcfc4aa3700 1 -- 172.21.15.60:0/2680926931 wait complete. 2020-10-31T22:50:52.839 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:50:52.840 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:50:52.957 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d742be700 1 Processor -- start 2020-10-31T22:50:52.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d742be700 1 -- start start 2020-10-31T22:50:52.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d742be700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0d6c0a7850 0x7f0d6c05bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d742be700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6c0af200 con 0x7f0d6c146790 2020-10-31T22:50:52.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d742be700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6c0b0f00 con 0x7f0d6c05b960 2020-10-31T22:50:52.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d742be700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6c0b11a0 con 0x7f0d6c0a7850 2020-10-31T22:50:52.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d7285b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f0d6c146790 0x7f0d6c146b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53904/0 (socket says 172.21.15.60:53904) 2020-10-31T22:50:52.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d7285b700 1 -- 172.21.15.60:0/3798842390 learned_addr learned my addr 172.21.15.60:0/3798842390 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:52.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d71859700 1 --2- 172.21.15.60:0/3798842390 >> v2:172.21.15.66:3300/0 conn(0x7f0d6c0a7850 0x7f0d6c05bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d71058700 1 -- 172.21.15.60:0/3798842390 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908025813 0 0) 0x7f0d6c0af200 con 0x7f0d6c146790 2020-10-31T22:50:52.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d71058700 1 -- 172.21.15.60:0/3798842390 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d54003230 con 0x7f0d6c146790 2020-10-31T22:50:52.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d71058700 1 -- 172.21.15.60:0/3798842390 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889987915 0 0) 0x7f0d6c0b0f00 con 0x7f0d6c05b960 2020-10-31T22:50:52.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d71058700 1 -- 172.21.15.60:0/3798842390 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0d6c0af200 con 0x7f0d6c05b960 2020-10-31T22:50:52.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d71058700 1 -- 172.21.15.60:0/3798842390 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1814997578 0 0) 0x7f0d54003230 con 0x7f0d6c146790 2020-10-31T22:50:52.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d71859700 1 -- 172.21.15.60:0/3798842390 >> v1:172.21.15.66:6789/0 conn(0x7f0d6c05b960 legacy=0x7f0d6c0aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d71859700 1 -- 172.21.15.60:0/3798842390 >> v1:172.21.15.60:6789/0 conn(0x7f0d6c146790 legacy=0x7f0d6c146b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d71859700 1 -- 172.21.15.60:0/3798842390 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c0b1440 con 0x7f0d6c0a7850 2020-10-31T22:50:52.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d71859700 1 --2- 172.21.15.60:0/3798842390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d6c0a7850 0x7f0d6c05bd40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f0d640010d0 tx=0x7f0d5c006dc0).ready entity=mon.1 client_cookie=1f042f0c9b49a23a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:52.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d71058700 1 -- 172.21.15.60:0/3798842390 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d640016d0 con 0x7f0d6c0a7850 2020-10-31T22:50:52.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d71058700 1 -- 172.21.15.60:0/3798842390 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5c00d610 con 0x7f0d6c0a7850 2020-10-31T22:50:52.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d742be700 1 -- 172.21.15.60:0/3798842390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d6c0a7850 msgr2=0x7f0d6c05bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.962 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d71058700 1 -- 172.21.15.60:0/3798842390 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d5c00d780 con 0x7f0d6c0a7850 2020-10-31T22:50:52.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d742be700 1 --2- 172.21.15.60:0/3798842390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d6c0a7850 0x7f0d6c05bd40 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f0d640010d0 tx=0x7f0d5c006dc0).stop 2020-10-31T22:50:52.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d742be700 1 -- 172.21.15.60:0/3798842390 shutdown_connections 2020-10-31T22:50:52.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d742be700 1 --2- 172.21.15.60:0/3798842390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d6c0a7850 0x7f0d6c05bd40 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d742be700 1 -- 172.21.15.60:0/3798842390 >> 172.21.15.60:0/3798842390 conn(0x7f0d6c06a260 msgr2=0x7f0d6c061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:52.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d742be700 1 -- 172.21.15.60:0/3798842390 shutdown_connections 2020-10-31T22:50:52.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.953+0000 7f0d742be700 1 -- 172.21.15.60:0/3798842390 wait complete. 2020-10-31T22:50:52.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d742be700 1 Processor -- start 2020-10-31T22:50:52.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d742be700 1 -- start start 2020-10-31T22:50:52.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d742be700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0d6c05b960 0x7f0d6c0ac850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d742be700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d6c0a7850 0x7f0d6c13ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d742be700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d6c146790 0x7f0d6c14b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d742be700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c0a82e0 con 0x7f0d6c0a7850 2020-10-31T22:50:52.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d742be700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c0ab040 con 0x7f0d6c146790 2020-10-31T22:50:52.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d742be700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c0ae110 con 0x7f0d6c05b960 2020-10-31T22:50:52.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d71859700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d6c0a7850 0x7f0d6c13ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d71859700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d6c0a7850 0x7f0d6c13ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49774/0 (socket says 172.21.15.60:49774) 2020-10-31T22:50:52.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d71859700 1 -- 172.21.15.60:0/2092540107 learned_addr learned my addr 172.21.15.60:0/2092540107 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:52.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d7205a700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0d6c05b960 0x7f0d6c0ac850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d7285b700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d6c146790 0x7f0d6c14b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d71859700 1 -- 172.21.15.60:0/2092540107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0d6c05b960 msgr2=0x7f0d6c0ac850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d71859700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0d6c05b960 0x7f0d6c0ac850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d71859700 1 -- 172.21.15.60:0/2092540107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d6c146790 msgr2=0x7f0d6c14b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:52.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d71859700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d6c146790 0x7f0d6c14b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:52.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d71859700 1 -- 172.21.15.60:0/2092540107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c0ae3b0 con 0x7f0d6c0a7850 2020-10-31T22:50:52.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d7285b700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d6c146790 0x7f0d6c14b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:50:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d71859700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d6c0a7850 0x7f0d6c13ad20 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f0d640010d0 tx=0x7f0d5c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d5b7fe700 1 -- 172.21.15.60:0/2092540107 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d5c011900 con 0x7f0d6c0a7850 2020-10-31T22:50:52.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d5b7fe700 1 -- 172.21.15.60:0/2092540107 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d5c011a60 con 0x7f0d6c0a7850 2020-10-31T22:50:52.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d5b7fe700 1 -- 172.21.15.60:0/2092540107 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0d5c011dc0 con 0x7f0d6c0a7850 2020-10-31T22:50:52.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d742be700 1 -- 172.21.15.60:0/2092540107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d6c13b210 con 0x7f0d6c0a7850 2020-10-31T22:50:52.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.957+0000 7f0d742be700 1 -- 172.21.15.60:0/2092540107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6c0a7f60 con 0x7f0d6c0a7850 2020-10-31T22:50:52.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.961+0000 7f0d742be700 1 -- 172.21.15.60:0/2092540107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6c0a8120 con 0x7f0d6c0a7850 2020-10-31T22:50:52.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.961+0000 7f0d5b7fe700 1 -- 172.21.15.60:0/2092540107 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f0d5c024030 con 0x7f0d6c0a7850 2020-10-31T22:50:52.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.961+0000 7f0d5b7fe700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0d4c054f10 0x7f0d4c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:52.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.961+0000 7f0d5b7fe700 1 -- 172.21.15.60:0/2092540107 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f0d5c06e830 con 0x7f0d6c0a7850 2020-10-31T22:50:52.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.961+0000 7f0d7205a700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0d4c054f10 0x7f0d4c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:52.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.961+0000 7f0d7205a700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0d4c054f10 0x7f0d4c0573d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f0d6800d000 tx=0x7f0d68007cc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:52.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:52.969+0000 7f0d5b7fe700 1 -- 172.21.15.60:0/2092540107 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f0d5c044d30 con 0x7f0d6c0a7850 2020-10-31T22:50:53.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:53.153+0000 7f0d742be700 1 -- 172.21.15.60:0/2092540107 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d6c057100 con 0x7f0d6c0a7850 2020-10-31T22:50:53.157 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:53.153+0000 7f0d5b7fe700 1 -- 172.21.15.60:0/2092540107 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f0d5c022020 con 0x7f0d6c0a7850 2020-10-31T22:50:53.158 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:53.158 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":76,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7085,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/2329273308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2329273308},{"type":"v1","addr":"172.21.15.66:6833","nonce":2329273308}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6835/4086841612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":4086841612},{"type":"v1","addr":"172.21.15.60:6835","nonce":4086841612}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:45.331860+0000","modified":"2020-10-31T22:50:46.335175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8232":{"gid":8232,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2095394176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2095394176},{"type":"v1","addr":"172.21.15.60:6837","nonce":2095394176}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-10-31T22:50:53.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:53.157+0000 7f0d742be700 1 -- 172.21.15.60:0/2092540107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0d4c054f10 msgr2=0x7f0d4c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:53.160 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:53.157+0000 7f0d742be700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0d4c054f10 0x7f0d4c0573d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f0d6800d000 tx=0x7f0d68007cc0).stop 2020-10-31T22:50:53.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:53.157+0000 7f0d742be700 1 -- 172.21.15.60:0/2092540107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d6c0a7850 msgr2=0x7f0d6c13ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:53.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:53.157+0000 7f0d742be700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d6c0a7850 0x7f0d6c13ad20 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 rx=0x7f0d640010d0 tx=0x7f0d5c015000).stop 2020-10-31T22:50:53.161 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:53.157+0000 7f0d742be700 1 -- 172.21.15.60:0/2092540107 shutdown_connections 2020-10-31T22:50:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:53.157+0000 7f0d742be700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f0d4c054f10 0x7f0d4c0573d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:53.157+0000 7f0d742be700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0d6c146790 0x7f0d6c14b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:53.157+0000 7f0d742be700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0d6c05b960 0x7f0d6c0ac850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:53.157+0000 7f0d742be700 1 --2- 172.21.15.60:0/2092540107 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0d6c0a7850 0x7f0d6c13ad20 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:53.157+0000 7f0d742be700 1 -- 172.21.15.60:0/2092540107 >> 172.21.15.60:0/2092540107 conn(0x7f0d6c06a260 msgr2=0x7f0d6c146b70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:53.157+0000 7f0d742be700 1 -- 172.21.15.60:0/2092540107 shutdown_connections 2020-10-31T22:50:53.162 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:53.157+0000 7f0d742be700 1 -- 172.21.15.60:0/2092540107 wait complete. 2020-10-31T22:50:53.163 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 76 2020-10-31T22:50:53.479 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:50:45.331860+0000', 'modified': '2020-10-31T22:50:46.335175+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8232}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8232': {'gid': 8232, 'name': 'c', 'rank': 0, 'incarnation': 75, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/2095394176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 2095394176}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 2095394176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [28], 'metadata_pool': 27, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:50:53.480 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:50:53.480 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:50:53.613 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":8232,"want_state":"up:active","state":"up:active","rank_uptime":8.2682104479999996,"mdsmap_epoch":76,"osdmap_epoch":149,"osdmap_epoch_barrier":148,"uptime":13.498552031999999} 2020-10-31T22:50:53.614 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 8232, "mdsmap_epoch": 76, "osdmap_epoch": 149, "osdmap_epoch_barrier": 148, "rank_uptime": 8.268210448, "state": "up:active", "uptime": 13.498552032, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:50:53.614 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:50:53.615 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-10-31T22:50:53.615 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi085.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-10-31T22:50:53.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:53.616 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:53.623 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:50:53.679 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:50:53.679 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:50:53.732 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:50:53.733 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:50:53.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:53.734 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:50:53.782 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:50:53.783 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:53.826 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:50:53.841 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:50:53.841 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:50:53.899 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:50:53.900 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:50:53.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:53.901 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:50:53.902 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:2020-10-31T22:50:53.901+0000 7fd9087990c0 -1 init, newargv = 0x55ca536d5f90 newargc=9ceph-fuse[13736]: starting ceph client 2020-10-31T22:50:53.902 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr: 2020-10-31T22:50:53.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13736]: starting fuse 2020-10-31T22:50:55.010 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:50:55.026 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:50:55.027 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:50:55.083 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:50:55.084 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:50:55.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:55.085 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:50:55.130 INFO:teuthology.orchestra.run.smithi085.stdout:50 2020-10-31T22:50:55.131 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-10-31T22:50:55.131 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:55.132 INFO:teuthology.orchestra.run.smithi085:> sudo python3 -c ' 2020-10-31T22:50:55.132 INFO:teuthology.orchestra.run.smithi085:> import glob 2020-10-31T22:50:55.132 INFO:teuthology.orchestra.run.smithi085:> import re 2020-10-31T22:50:55.132 INFO:teuthology.orchestra.run.smithi085:> import os 2020-10-31T22:50:55.133 INFO:teuthology.orchestra.run.smithi085:> import subprocess 2020-10-31T22:50:55.133 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:50:55.133 INFO:teuthology.orchestra.run.smithi085:> def find_socket(client_name): 2020-10-31T22:50:55.134 INFO:teuthology.orchestra.run.smithi085:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-10-31T22:50:55.134 INFO:teuthology.orchestra.run.smithi085:> files = glob.glob(asok_path) 2020-10-31T22:50:55.134 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:50:55.135 INFO:teuthology.orchestra.run.smithi085:> # Given a non-glob path, it better be there 2020-10-31T22:50:55.135 INFO:teuthology.orchestra.run.smithi085:> if "*" not in asok_path: 2020-10-31T22:50:55.135 INFO:teuthology.orchestra.run.smithi085:> assert(len(files) == 1) 2020-10-31T22:50:55.136 INFO:teuthology.orchestra.run.smithi085:> return files[0] 2020-10-31T22:50:55.136 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:50:55.136 INFO:teuthology.orchestra.run.smithi085:> for f in files: 2020-10-31T22:50:55.137 INFO:teuthology.orchestra.run.smithi085:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:50:55.137 INFO:teuthology.orchestra.run.smithi085:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:50:55.137 INFO:teuthology.orchestra.run.smithi085:> return f 2020-10-31T22:50:55.138 INFO:teuthology.orchestra.run.smithi085:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:50:55.139 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:50:55.141 INFO:teuthology.orchestra.run.smithi085:> print(find_socket("client.1")) 2020-10-31T22:50:55.141 INFO:teuthology.orchestra.run.smithi085:> ' 2020-10-31T22:50:55.222 INFO:teuthology.orchestra.run.smithi085.stdout:/var/run/ceph/ceph-client.1.13736.asok 2020-10-31T22:50:55.228 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13736.asok 2020-10-31T22:50:55.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:55.229 INFO:teuthology.orchestra.run.smithi085:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13736.asok status 2020-10-31T22:50:55.326 INFO:teuthology.orchestra.run.smithi085.stdout:{ 2020-10-31T22:50:55.327 INFO:teuthology.orchestra.run.smithi085.stdout: "metadata": { 2020-10-31T22:50:55.327 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:50:55.327 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:50:55.327 INFO:teuthology.orchestra.run.smithi085.stdout: "entity_id": "1", 2020-10-31T22:50:55.327 INFO:teuthology.orchestra.run.smithi085.stdout: "hostname": "smithi085", 2020-10-31T22:50:55.328 INFO:teuthology.orchestra.run.smithi085.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-10-31T22:50:55.328 INFO:teuthology.orchestra.run.smithi085.stdout: "pid": "13736", 2020-10-31T22:50:55.328 INFO:teuthology.orchestra.run.smithi085.stdout: "root": "/" 2020-10-31T22:50:55.328 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:50:55.328 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_count": 0, 2020-10-31T22:50:55.328 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_pinned_count": 0, 2020-10-31T22:50:55.328 INFO:teuthology.orchestra.run.smithi085.stdout: "id": 7229, 2020-10-31T22:50:55.329 INFO:teuthology.orchestra.run.smithi085.stdout: "inst": { 2020-10-31T22:50:55.329 INFO:teuthology.orchestra.run.smithi085.stdout: "name": { 2020-10-31T22:50:55.329 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "client", 2020-10-31T22:50:55.329 INFO:teuthology.orchestra.run.smithi085.stdout: "num": 7229 2020-10-31T22:50:55.329 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:50:55.329 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:50:55.329 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:50:55.330 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:50:55.330 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 2331476940 2020-10-31T22:50:55.330 INFO:teuthology.orchestra.run.smithi085.stdout: } 2020-10-31T22:50:55.330 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:50:55.330 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:50:55.330 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:50:55.330 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:50:55.331 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 2331476940 2020-10-31T22:50:55.331 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:50:55.331 INFO:teuthology.orchestra.run.smithi085.stdout: "inst_str": "client.7229 172.21.15.85:0/2331476940", 2020-10-31T22:50:55.331 INFO:teuthology.orchestra.run.smithi085.stdout: "addr_str": "172.21.15.85:0/2331476940", 2020-10-31T22:50:55.331 INFO:teuthology.orchestra.run.smithi085.stdout: "inode_count": 1, 2020-10-31T22:50:55.331 INFO:teuthology.orchestra.run.smithi085.stdout: "mds_epoch": 76, 2020-10-31T22:50:55.331 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch": 149, 2020-10-31T22:50:55.331 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:50:55.332 INFO:teuthology.orchestra.run.smithi085.stdout: "blacklisted": false 2020-10-31T22:50:55.332 INFO:teuthology.orchestra.run.smithi085.stdout:} 2020-10-31T22:50:55.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:55.336 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:55.337 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:55.343 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:50:55.344 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:50:55.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:55.345 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:55.404 INFO:teuthology.orchestra.run.smithi152:> cd /home/ubuntu/cephtest/mnt.0 && sudo getfattr --only-values -n ceph.dir.rctime . 2020-10-31T22:50:55.446 INFO:teuthology.orchestra.run.smithi152.stdout:1604184655.401991410 2020-10-31T22:50:55.447 INFO:tasks.cephfs.test_misc:rctime = 1604184655.401991410 2020-10-31T22:50:55.447 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:50:55.447 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:55.463 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:55.482 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:55.499 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:55.519 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:50:55.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:55.520 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:55.520 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:55.570 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:50:55.571 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:50:55.572 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi152.front.sepia.ceph.com... 2020-10-31T22:50:55.572 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:50:55.573 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:55.647 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[14217]: fuse finished with error 0 and tester_r 0 2020-10-31T22:50:55.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:55.649 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:55.650 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:55.702 INFO:teuthology.orchestra.run.smithi152.stdout:ext2/ext3 2020-10-31T22:50:55.703 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:50:55.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:50:55.820 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:55.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:55.869 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:55.870 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:55.880 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:50:55.881 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:50:55.882 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi085.front.sepia.ceph.com... 2020-10-31T22:50:55.882 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:50:55.883 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:55.961 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13736]: fuse finished with error 0 and tester_r 0 2020-10-31T22:50:55.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:55.963 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:55.964 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:56.011 INFO:teuthology.orchestra.run.smithi085.stdout:ext2/ext3 2020-10-31T22:50:56.012 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:50:56.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:50:56.099 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:56.109 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config rm mon mon_allow_pool_delete 2020-10-31T22:50:56.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc3fff700 1 Processor -- start 2020-10-31T22:50:56.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc3fff700 1 -- start start 2020-10-31T22:50:56.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc3fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fafc40b5570 0x7fafc40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:56.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc3fff700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc4145180 con 0x7fafc40b24a0 2020-10-31T22:50:56.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc3fff700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc40b0670 con 0x7fafc4141fe0 2020-10-31T22:50:56.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc3fff700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc40afae0 con 0x7fafc40b5570 2020-10-31T22:50:56.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc2ffd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fafc40b5570 0x7fafc40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:56.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafba7fc700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fafc40b24a0 0x7fafc4145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53916/0 (socket says 172.21.15.60:53916) 2020-10-31T22:50:56.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafba7fc700 1 -- 172.21.15.60:0/543695979 learned_addr learned my addr 172.21.15.60:0/543695979 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:56.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc27fc700 1 -- 172.21.15.60:0/543695979 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311018598 0 0) 0x7fafc4145180 con 0x7fafc40b24a0 2020-10-31T22:50:56.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc27fc700 1 -- 172.21.15.60:0/543695979 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafa4003230 con 0x7fafc40b24a0 2020-10-31T22:50:56.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc2ffd700 1 -- 172.21.15.60:0/543695979 >> v1:172.21.15.66:6789/0 conn(0x7fafc4141fe0 legacy=0x7fafc4142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:56.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc2ffd700 1 -- 172.21.15.60:0/543695979 >> v1:172.21.15.60:6789/0 conn(0x7fafc40b24a0 legacy=0x7fafc4145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:56.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc2ffd700 1 -- 172.21.15.60:0/543695979 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40b0910 con 0x7fafc40b5570 2020-10-31T22:50:56.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc2ffd700 1 --2- 172.21.15.60:0/543695979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafc40b5570 0x7fafc40b5950 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7fafc405f580 tx=0x7fafb4006dc0).ready entity=mon.0 client_cookie=95307072698d7d2c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:56.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc27fc700 1 -- 172.21.15.60:0/543695979 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafb40097c0 con 0x7fafc40b5570 2020-10-31T22:50:56.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc27fc700 1 -- 172.21.15.60:0/543695979 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb4009920 con 0x7fafc40b5570 2020-10-31T22:50:56.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc27fc700 1 -- 172.21.15.60:0/543695979 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafb4009c80 con 0x7fafc40b5570 2020-10-31T22:50:56.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc3fff700 1 -- 172.21.15.60:0/543695979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafc40b5570 msgr2=0x7fafc40b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:56.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.233+0000 7fafc3fff700 1 --2- 172.21.15.60:0/543695979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafc40b5570 0x7fafc40b5950 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 rx=0x7fafc405f580 tx=0x7fafb4006dc0).stop 2020-10-31T22:50:56.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.237+0000 7fafc3fff700 1 -- 172.21.15.60:0/543695979 shutdown_connections 2020-10-31T22:50:56.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.237+0000 7fafc3fff700 1 --2- 172.21.15.60:0/543695979 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafc40b5570 0x7fafc40b5950 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:56.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.237+0000 7fafc3fff700 1 -- 172.21.15.60:0/543695979 >> 172.21.15.60:0/543695979 conn(0x7fafc40b8e90 msgr2=0x7fafc40b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:56.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.237+0000 7fafc3fff700 1 -- 172.21.15.60:0/543695979 shutdown_connections 2020-10-31T22:50:56.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.237+0000 7fafc3fff700 1 -- 172.21.15.60:0/543695979 wait complete. 2020-10-31T22:50:56.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.237+0000 7fafc3fff700 1 Processor -- start 2020-10-31T22:50:56.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.237+0000 7fafc3fff700 1 -- start start 2020-10-31T22:50:56.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.237+0000 7fafc3fff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafc40b24a0 0x7fafc40b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:56.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.237+0000 7fafc3fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafc40b5570 0x7fafc4148700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:56.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.237+0000 7fafc3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafc4141fe0 0x7fafc4154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:56.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.237+0000 7fafc3fff700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc4149030 con 0x7fafc4141fe0 2020-10-31T22:50:56.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc3fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc413fba0 con 0x7fafc40b5570 2020-10-31T22:50:56.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc3fff700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc413fe40 con 0x7fafc40b24a0 2020-10-31T22:50:56.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafc4141fe0 0x7fafc4154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:56.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc37fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafc4141fe0 0x7fafc4154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49790/0 (socket says 172.21.15.60:49790) 2020-10-31T22:50:56.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc37fe700 1 -- 172.21.15.60:0/1214551974 learned_addr learned my addr 172.21.15.60:0/1214551974 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:56.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafba7fc700 1 --2- 172.21.15.60:0/1214551974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafc40b5570 0x7fafc4148700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:56.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc2ffd700 1 --2- 172.21.15.60:0/1214551974 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafc40b24a0 0x7fafc40b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:56.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc37fe700 1 -- 172.21.15.60:0/1214551974 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafc40b24a0 msgr2=0x7fafc40b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:56.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc37fe700 1 --2- 172.21.15.60:0/1214551974 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafc40b24a0 0x7fafc40b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:56.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc37fe700 1 -- 172.21.15.60:0/1214551974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafc40b5570 msgr2=0x7fafc4148700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:56.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc37fe700 1 --2- 172.21.15.60:0/1214551974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafc40b5570 0x7fafc4148700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:56.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc37fe700 1 -- 172.21.15.60:0/1214551974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc41400e0 con 0x7fafc4141fe0 2020-10-31T22:50:56.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc37fe700 1 --2- 172.21.15.60:0/1214551974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafc4141fe0 0x7fafc4154210 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7fafc405c9f0 tx=0x7fafbc007e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:56.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc0ff9700 1 -- 172.21.15.60:0/1214551974 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafbc00a7b0 con 0x7fafc4141fe0 2020-10-31T22:50:56.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc0ff9700 1 -- 172.21.15.60:0/1214551974 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc00a910 con 0x7fafc4141fe0 2020-10-31T22:50:56.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc3fff700 1 -- 172.21.15.60:0/1214551974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc4140380 con 0x7fafc4141fe0 2020-10-31T22:50:56.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc0ff9700 1 -- 172.21.15.60:0/1214551974 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fafbc00ac70 con 0x7fafc4141fe0 2020-10-31T22:50:56.251 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc3fff700 1 -- 172.21.15.60:0/1214551974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc4141be0 con 0x7fafc4141fe0 2020-10-31T22:50:56.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc0ff9700 1 -- 172.21.15.60:0/1214551974 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fafbc019030 con 0x7fafc4141fe0 2020-10-31T22:50:56.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc3fff700 1 -- 172.21.15.60:0/1214551974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc4057100 con 0x7fafc4141fe0 2020-10-31T22:50:56.253 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc0ff9700 1 --2- 172.21.15.60:0/1214551974 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fafa8054f10 0x7fafa80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:56.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc2ffd700 1 --2- 172.21.15.60:0/1214551974 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fafa8054f10 0x7fafa80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:56.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc0ff9700 1 -- 172.21.15.60:0/1214551974 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fafbc06d2a0 con 0x7fafc4141fe0 2020-10-31T22:50:56.254 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.241+0000 7fafc2ffd700 1 --2- 172.21.15.60:0/1214551974 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fafa8054f10 0x7fafa80573d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fafb4019000 tx=0x7fafb4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:56.256 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.249+0000 7fafc0ff9700 1 -- 172.21.15.60:0/1214551974 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fafbc0437c0 con 0x7fafc4141fe0 2020-10-31T22:50:56.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.397+0000 7fafc3fff700 1 -- 172.21.15.60:0/1214551974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fafc405a8e0 con 0x7fafc4141fe0 2020-10-31T22:50:56.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.401+0000 7fafc0ff9700 1 -- 172.21.15.60:0/1214551974 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fafbc046de0 con 0x7fafc4141fe0 2020-10-31T22:50:56.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.405+0000 7fafc3fff700 1 -- 172.21.15.60:0/1214551974 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fafa8054f10 msgr2=0x7fafa80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:56.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.405+0000 7fafc3fff700 1 --2- 172.21.15.60:0/1214551974 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fafa8054f10 0x7fafa80573d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7fafb4019000 tx=0x7fafb4015000).stop 2020-10-31T22:50:56.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.405+0000 7fafc3fff700 1 -- 172.21.15.60:0/1214551974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafc4141fe0 msgr2=0x7fafc4154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:56.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.405+0000 7fafc3fff700 1 --2- 172.21.15.60:0/1214551974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafc4141fe0 0x7fafc4154210 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 rx=0x7fafc405c9f0 tx=0x7fafbc007e80).stop 2020-10-31T22:50:56.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.405+0000 7fafc3fff700 1 -- 172.21.15.60:0/1214551974 shutdown_connections 2020-10-31T22:50:56.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.405+0000 7fafc3fff700 1 --2- 172.21.15.60:0/1214551974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fafc4141fe0 0x7fafc4154210 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:56.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.405+0000 7fafc3fff700 1 --2- 172.21.15.60:0/1214551974 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fafc40b24a0 0x7fafc40b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:56.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.405+0000 7fafc3fff700 1 --2- 172.21.15.60:0/1214551974 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fafa8054f10 0x7fafa80573d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:56.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.405+0000 7fafc3fff700 1 --2- 172.21.15.60:0/1214551974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fafc40b5570 0x7fafc4148700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:56.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.405+0000 7fafc3fff700 1 -- 172.21.15.60:0/1214551974 >> 172.21.15.60:0/1214551974 conn(0x7fafc40b8e90 msgr2=0x7fafc40b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:56.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.405+0000 7fafc3fff700 1 -- 172.21.15.60:0/1214551974 shutdown_connections 2020-10-31T22:50:56.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.405+0000 7fafc3fff700 1 -- 172.21.15.60:0/1214551974 wait complete. 2020-10-31T22:50:56.426 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime' 2020-10-31T22:50:56.541 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc753de700 1 Processor -- start 2020-10-31T22:50:56.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc753de700 1 -- start start 2020-10-31T22:50:56.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc753de700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efc700b0000 0x7efc70141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:56.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc753de700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efc700b0950 0x7efc7005bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:56.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc753de700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc700b2130 con 0x7efc700b1d50 2020-10-31T22:50:56.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc753de700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7013fab0 con 0x7efc700b0000 2020-10-31T22:50:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc753de700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc700af380 con 0x7efc700b0950 2020-10-31T22:50:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc6f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efc700b0000 0x7efc70141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc6f7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7efc700b0000 0x7efc70141d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49796/0 (socket says 172.21.15.60:49796) 2020-10-31T22:50:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc6f7fe700 1 -- 172.21.15.60:0/1958388970 learned_addr learned my addr 172.21.15.60:0/1958388970 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc74bdd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efc700b0950 0x7efc7005bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:56.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc6f7fe700 1 -- 172.21.15.60:0/1958388970 >> v2:172.21.15.66:3300/0 conn(0x7efc700b0950 msgr2=0x7efc7005bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc6f7fe700 1 --2- 172.21.15.60:0/1958388970 >> v2:172.21.15.66:3300/0 conn(0x7efc700b0950 0x7efc7005bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc6f7fe700 1 -- 172.21.15.60:0/1958388970 >> v1:172.21.15.66:6789/0 conn(0x7efc700b1d50 legacy=0x7efc7005afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc6f7fe700 1 -- 172.21.15.60:0/1958388970 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc700af620 con 0x7efc700b0000 2020-10-31T22:50:56.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.537+0000 7efc6f7fe700 1 --2- 172.21.15.60:0/1958388970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc700b0000 0x7efc70141d80 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7efc64002f30 tx=0x7efc64006e80).ready entity=mon.0 client_cookie=947d31b77ca3a966 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:56.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.541+0000 7efc6effd700 1 -- 172.21.15.60:0/1958388970 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc640097f0 con 0x7efc700b0000 2020-10-31T22:50:56.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.541+0000 7efc6effd700 1 -- 172.21.15.60:0/1958388970 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc64009950 con 0x7efc700b0000 2020-10-31T22:50:56.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.541+0000 7efc6effd700 1 -- 172.21.15.60:0/1958388970 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc64009cf0 con 0x7efc700b0000 2020-10-31T22:50:56.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.541+0000 7efc753de700 1 -- 172.21.15.60:0/1958388970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc700b0000 msgr2=0x7efc70141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:56.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.541+0000 7efc753de700 1 --2- 172.21.15.60:0/1958388970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc700b0000 0x7efc70141d80 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 rx=0x7efc64002f30 tx=0x7efc64006e80).stop 2020-10-31T22:50:56.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.541+0000 7efc753de700 1 -- 172.21.15.60:0/1958388970 shutdown_connections 2020-10-31T22:50:56.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.541+0000 7efc753de700 1 --2- 172.21.15.60:0/1958388970 >> v2:172.21.15.66:3300/0 conn(0x7efc700b0950 0x7efc7005bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:56.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.541+0000 7efc753de700 1 --2- 172.21.15.60:0/1958388970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc700b0000 0x7efc70141d80 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:56.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.541+0000 7efc753de700 1 -- 172.21.15.60:0/1958388970 >> 172.21.15.60:0/1958388970 conn(0x7efc700b5300 msgr2=0x7efc700b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:56.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.541+0000 7efc753de700 1 -- 172.21.15.60:0/1958388970 shutdown_connections 2020-10-31T22:50:56.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.541+0000 7efc753de700 1 -- 172.21.15.60:0/1958388970 wait complete. 2020-10-31T22:50:56.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.541+0000 7efc753de700 1 Processor -- start 2020-10-31T22:50:56.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.541+0000 7efc753de700 1 -- start start 2020-10-31T22:50:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc753de700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc700b0000 0x7efc70140470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc753de700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc700b0950 0x7efc70143630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc753de700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc700b1d50 0x7efc70143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc753de700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc70144ee0 con 0x7efc700b0950 2020-10-31T22:50:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc753de700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc701431d0 con 0x7efc700b0000 2020-10-31T22:50:56.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc753de700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc700aa750 con 0x7efc700b1d50 2020-10-31T22:50:56.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc6f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc700b0950 0x7efc70143630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:56.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc6f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc700b0950 0x7efc70143630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49804/0 (socket says 172.21.15.60:49804) 2020-10-31T22:50:56.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc6f7fe700 1 -- 172.21.15.60:0/1894129220 learned_addr learned my addr 172.21.15.60:0/1894129220 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:56.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc6ffff700 1 --2- 172.21.15.60:0/1894129220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc700b0000 0x7efc70140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:56.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc74bdd700 1 --2- 172.21.15.60:0/1894129220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc700b1d50 0x7efc70143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:56.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc6f7fe700 1 -- 172.21.15.60:0/1894129220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc700b1d50 msgr2=0x7efc70143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:56.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc6f7fe700 1 --2- 172.21.15.60:0/1894129220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc700b1d50 0x7efc70143b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:56.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc6f7fe700 1 -- 172.21.15.60:0/1894129220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc700b0000 msgr2=0x7efc70140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:56.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc6f7fe700 1 --2- 172.21.15.60:0/1894129220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc700b0000 0x7efc70140470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:56.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc6f7fe700 1 -- 172.21.15.60:0/1894129220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc700aabc0 con 0x7efc700b0950 2020-10-31T22:50:56.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc6f7fe700 1 --2- 172.21.15.60:0/1894129220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc700b0950 0x7efc70143630 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7efc700aa8e0 tx=0x7efc64015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:56.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc6d7fa700 1 -- 172.21.15.60:0/1894129220 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc64011b70 con 0x7efc700b0950 2020-10-31T22:50:56.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc6d7fa700 1 -- 172.21.15.60:0/1894129220 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc64011cd0 con 0x7efc700b0950 2020-10-31T22:50:56.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc6d7fa700 1 -- 172.21.15.60:0/1894129220 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc6401e650 con 0x7efc700b0950 2020-10-31T22:50:56.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc753de700 1 -- 172.21.15.60:0/1894129220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc700aae60 con 0x7efc700b0950 2020-10-31T22:50:56.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.545+0000 7efc753de700 1 -- 172.21.15.60:0/1894129220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc700ab640 con 0x7efc700b0950 2020-10-31T22:50:56.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.549+0000 7efc753de700 1 -- 172.21.15.60:0/1894129220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc70144230 con 0x7efc700b0950 2020-10-31T22:50:56.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.549+0000 7efc6d7fa700 1 -- 172.21.15.60:0/1894129220 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7efc6401a040 con 0x7efc700b0950 2020-10-31T22:50:56.557 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.549+0000 7efc6d7fa700 1 --2- 172.21.15.60:0/1894129220 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efc50054f10 0x7efc500573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:56.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.549+0000 7efc6d7fa700 1 -- 172.21.15.60:0/1894129220 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7efc6406ea40 con 0x7efc700b0950 2020-10-31T22:50:56.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.549+0000 7efc6ffff700 1 --2- 172.21.15.60:0/1894129220 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efc50054f10 0x7efc500573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:56.558 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.549+0000 7efc6ffff700 1 --2- 172.21.15.60:0/1894129220 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efc50054f10 0x7efc500573d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7efc6000d000 tx=0x7efc60007f90).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:56.559 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.553+0000 7efc6d7fa700 1 -- 172.21.15.60:0/1894129220 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7efc64044f60 con 0x7efc700b0950 2020-10-31T22:50:56.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:56.745+0000 7efc753de700 1 -- 172.21.15.60:0/1894129220 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]} v 0) v1 -- 0x7efc70057100 con 0x7efc700b0950 2020-10-31T22:50:57.035 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.029+0000 7efc6d7fa700 1 -- 172.21.15.60:0/1894129220 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_misc.TestMisc.test_root_rctime"]}]=0 v449) v1 ==== 127+0+0 (secure 0 0 0) 0x7efc64023020 con 0x7efc700b0950 2020-10-31T22:50:57.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.033+0000 7efc753de700 1 -- 172.21.15.60:0/1894129220 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efc50054f10 msgr2=0x7efc500573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:57.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.033+0000 7efc753de700 1 --2- 172.21.15.60:0/1894129220 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efc50054f10 0x7efc500573d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7efc6000d000 tx=0x7efc60007f90).stop 2020-10-31T22:50:57.038 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.033+0000 7efc753de700 1 -- 172.21.15.60:0/1894129220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc700b0950 msgr2=0x7efc70143630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:57.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.033+0000 7efc753de700 1 --2- 172.21.15.60:0/1894129220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc700b0950 0x7efc70143630 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 rx=0x7efc700aa8e0 tx=0x7efc64015000).stop 2020-10-31T22:50:57.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.033+0000 7efc753de700 1 -- 172.21.15.60:0/1894129220 shutdown_connections 2020-10-31T22:50:57.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.033+0000 7efc753de700 1 --2- 172.21.15.60:0/1894129220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efc700b1d50 0x7efc70143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:57.039 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.033+0000 7efc753de700 1 --2- 172.21.15.60:0/1894129220 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7efc50054f10 0x7efc500573d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:57.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.033+0000 7efc753de700 1 --2- 172.21.15.60:0/1894129220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efc700b0000 0x7efc70140470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:57.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.033+0000 7efc753de700 1 --2- 172.21.15.60:0/1894129220 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7efc700b0950 0x7efc70143630 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:57.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.033+0000 7efc753de700 1 -- 172.21.15.60:0/1894129220 >> 172.21.15.60:0/1894129220 conn(0x7efc700b5300 msgr2=0x7efc700ae9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:57.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.033+0000 7efc753de700 1 -- 172.21.15.60:0/1894129220 shutdown_connections 2020-10-31T22:50:57.040 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.033+0000 7efc753de700 1 -- 172.21.15.60:0/1894129220 wait complete. 2020-10-31T22:50:57.053 INFO:tasks.cephfs_test_runner:test_root_rctime (tasks.cephfs.test_misc.TestMisc) ... ok 2020-10-31T22:50:57.053 INFO:tasks.cephfs_test_runner:Starting test: test_statfs_on_deleted_fs (tasks.cephfs.test_misc.TestMisc) 2020-10-31T22:50:57.054 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early log 'Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs' 2020-10-31T22:50:57.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.169+0000 7f1eb33ee700 1 Processor -- start 2020-10-31T22:50:57.175 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.169+0000 7f1eb33ee700 1 -- start start 2020-10-31T22:50:57.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.169+0000 7f1eb33ee700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1eac0b1a10 0x7f1eac142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:57.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.169+0000 7f1eb33ee700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1eac13ebe0 0x7f1eac0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:57.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.169+0000 7f1eb33ee700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1eac0af200 0x7f1eac06a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.169+0000 7f1eb33ee700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eac0abea0 con 0x7f1eac13ebe0 2020-10-31T22:50:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.169+0000 7f1eb33ee700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1eac141870 con 0x7f1eac0af200 2020-10-31T22:50:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.169+0000 7f1eb33ee700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac141b10 con 0x7f1eac0b1a10 2020-10-31T22:50:57.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.169+0000 7f1eb1beb700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1eac13ebe0 0x7f1eac0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:57.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.169+0000 7f1eb1beb700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1eac13ebe0 0x7f1eac0b1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49812/0 (socket says 172.21.15.60:49812) 2020-10-31T22:50:57.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.169+0000 7f1eb1beb700 1 -- 172.21.15.60:0/1759149532 learned_addr learned my addr 172.21.15.60:0/1759149532 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:57.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.169+0000 7f1eb2bed700 1 --2- 172.21.15.60:0/1759149532 >> v2:172.21.15.66:3300/0 conn(0x7f1eac0af200 0x7f1eac06a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:57.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.169+0000 7f1eb23ec700 1 --2- 172.21.15.60:0/1759149532 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1eac0b1a10 0x7f1eac142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:57.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb1beb700 1 -- 172.21.15.60:0/1759149532 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1eac0b1a10 msgr2=0x7f1eac142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:57.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb1beb700 1 --2- 172.21.15.60:0/1759149532 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1eac0b1a10 0x7f1eac142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:57.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb1beb700 1 -- 172.21.15.60:0/1759149532 >> v2:172.21.15.66:3300/0 conn(0x7f1eac0af200 msgr2=0x7f1eac06a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:57.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb1beb700 1 --2- 172.21.15.60:0/1759149532 >> v2:172.21.15.66:3300/0 conn(0x7f1eac0af200 0x7f1eac06a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:57.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb1beb700 1 -- 172.21.15.60:0/1759149532 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac141db0 con 0x7f1eac13ebe0 2020-10-31T22:50:57.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb2bed700 1 --2- 172.21.15.60:0/1759149532 >> v2:172.21.15.66:3300/0 conn(0x7f1eac0af200 0x7f1eac06a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:57.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb1beb700 1 --2- 172.21.15.60:0/1759149532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eac13ebe0 0x7f1eac0b1df0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f1ea8002f30 tx=0x7f1ea8006e80).ready entity=mon.0 client_cookie=585ced639857ea7f server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:57.180 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb13ea700 1 -- 172.21.15.60:0/1759149532 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ea8009640 con 0x7f1eac13ebe0 2020-10-31T22:50:57.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb13ea700 1 -- 172.21.15.60:0/1759149532 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ea80097a0 con 0x7f1eac13ebe0 2020-10-31T22:50:57.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb13ea700 1 -- 172.21.15.60:0/1759149532 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ea8009b00 con 0x7f1eac13ebe0 2020-10-31T22:50:57.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb33ee700 1 -- 172.21.15.60:0/1759149532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eac13ebe0 msgr2=0x7f1eac0b1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:57.181 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb33ee700 1 --2- 172.21.15.60:0/1759149532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eac13ebe0 0x7f1eac0b1df0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 rx=0x7f1ea8002f30 tx=0x7f1ea8006e80).stop 2020-10-31T22:50:57.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb33ee700 1 -- 172.21.15.60:0/1759149532 shutdown_connections 2020-10-31T22:50:57.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb33ee700 1 --2- 172.21.15.60:0/1759149532 >> v2:172.21.15.66:3300/0 conn(0x7f1eac0af200 0x7f1eac06a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb33ee700 1 --2- 172.21.15.60:0/1759149532 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1eac0b1a10 0x7f1eac142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb33ee700 1 --2- 172.21.15.60:0/1759149532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eac13ebe0 0x7f1eac0b1df0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb33ee700 1 -- 172.21.15.60:0/1759149532 >> 172.21.15.60:0/1759149532 conn(0x7f1eac0b5300 msgr2=0x7f1eac0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb33ee700 1 -- 172.21.15.60:0/1759149532 shutdown_connections 2020-10-31T22:50:57.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb33ee700 1 -- 172.21.15.60:0/1759149532 wait complete. 2020-10-31T22:50:57.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb33ee700 1 Processor -- start 2020-10-31T22:50:57.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.173+0000 7f1eb33ee700 1 -- start start 2020-10-31T22:50:57.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb33ee700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eac0af200 0x7f1eac13d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:57.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb33ee700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1eac0b1a10 0x7f1eac13f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:57.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb33ee700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1eac13ebe0 0x7f1eac13fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:57.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb33ee700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac1414e0 con 0x7f1eac0af200 2020-10-31T22:50:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb33ee700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0a87f0 con 0x7f1eac0b1a10 2020-10-31T22:50:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb33ee700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1eac0a8a90 con 0x7f1eac13ebe0 2020-10-31T22:50:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb23ec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eac0af200 0x7f1eac13d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb23ec700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eac0af200 0x7f1eac13d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49814/0 (socket says 172.21.15.60:49814) 2020-10-31T22:50:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb23ec700 1 -- 172.21.15.60:0/2213793652 learned_addr learned my addr 172.21.15.60:0/2213793652 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb2bed700 1 --2- 172.21.15.60:0/2213793652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1eac13ebe0 0x7f1eac13fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:57.192 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb1beb700 1 --2- 172.21.15.60:0/2213793652 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1eac0b1a10 0x7f1eac13f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:57.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb23ec700 1 -- 172.21.15.60:0/2213793652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1eac13ebe0 msgr2=0x7f1eac13fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:57.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb23ec700 1 --2- 172.21.15.60:0/2213793652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1eac13ebe0 0x7f1eac13fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:57.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb23ec700 1 -- 172.21.15.60:0/2213793652 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1eac0b1a10 msgr2=0x7f1eac13f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:57.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb23ec700 1 --2- 172.21.15.60:0/2213793652 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1eac0b1a10 0x7f1eac13f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:57.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb23ec700 1 -- 172.21.15.60:0/2213793652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eac063b10 con 0x7f1eac0af200 2020-10-31T22:50:57.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb23ec700 1 --2- 172.21.15.60:0/2213793652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eac0af200 0x7f1eac13d2b0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f1e9c00c000 tx=0x7f1e9c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1ea37fe700 1 -- 172.21.15.60:0/2213793652 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e9c00cb00 con 0x7f1eac0af200 2020-10-31T22:50:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1ea37fe700 1 -- 172.21.15.60:0/2213793652 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9c00cc60 con 0x7f1eac0af200 2020-10-31T22:50:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb33ee700 1 -- 172.21.15.60:0/2213793652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1eac140fd0 con 0x7f1eac0af200 2020-10-31T22:50:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1ea37fe700 1 -- 172.21.15.60:0/2213793652 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e9c0123f0 con 0x7f1eac0af200 2020-10-31T22:50:57.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb33ee700 1 -- 172.21.15.60:0/2213793652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1eac0a92c0 con 0x7f1eac0af200 2020-10-31T22:50:57.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.177+0000 7f1eb33ee700 1 -- 172.21.15.60:0/2213793652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1eac141330 con 0x7f1eac0af200 2020-10-31T22:50:57.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.181+0000 7f1ea37fe700 1 -- 172.21.15.60:0/2213793652 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1e9c022070 con 0x7f1eac0af200 2020-10-31T22:50:57.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.181+0000 7f1ea37fe700 1 --2- 172.21.15.60:0/2213793652 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1e8c054f10 0x7f1e8c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:57.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.181+0000 7f1ea37fe700 1 -- 172.21.15.60:0/2213793652 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1e9c06e010 con 0x7f1eac0af200 2020-10-31T22:50:57.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.181+0000 7f1eb1beb700 1 --2- 172.21.15.60:0/2213793652 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1e8c054f10 0x7f1e8c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:57.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.181+0000 7f1eb1beb700 1 --2- 172.21.15.60:0/2213793652 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1e8c054f10 0x7f1e8c0573d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f1ea801b000 tx=0x7f1ea8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:57.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.189+0000 7f1ea37fe700 1 -- 172.21.15.60:0/2213793652 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1e9c044530 con 0x7f1eac0af200 2020-10-31T22:50:57.383 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:57.377+0000 7f1eb33ee700 1 -- 172.21.15.60:0/2213793652 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]} v 0) v1 -- 0x7f1eac057100 con 0x7f1eac0af200 2020-10-31T22:50:58.047 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.041+0000 7f1ea37fe700 1 -- 172.21.15.60:0/2213793652 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_misc.TestMisc.test_statfs_on_deleted_fs"]}]=0 v450) v1 ==== 139+0+0 (secure 0 0 0) 0x7f1e9c047b50 con 0x7f1eac0af200 2020-10-31T22:50:58.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.045+0000 7f1eb33ee700 1 -- 172.21.15.60:0/2213793652 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1e8c054f10 msgr2=0x7f1e8c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:58.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.045+0000 7f1eb33ee700 1 --2- 172.21.15.60:0/2213793652 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1e8c054f10 0x7f1e8c0573d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7f1ea801b000 tx=0x7f1ea8015000).stop 2020-10-31T22:50:58.050 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.045+0000 7f1eb33ee700 1 -- 172.21.15.60:0/2213793652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eac0af200 msgr2=0x7f1eac13d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:58.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.045+0000 7f1eb33ee700 1 --2- 172.21.15.60:0/2213793652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eac0af200 0x7f1eac13d2b0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 rx=0x7f1e9c00c000 tx=0x7f1e9c0091a0).stop 2020-10-31T22:50:58.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.045+0000 7f1eb33ee700 1 -- 172.21.15.60:0/2213793652 shutdown_connections 2020-10-31T22:50:58.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.045+0000 7f1eb33ee700 1 --2- 172.21.15.60:0/2213793652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1eac13ebe0 0x7f1eac13fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.045+0000 7f1eb33ee700 1 --2- 172.21.15.60:0/2213793652 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1eac0af200 0x7f1eac13d2b0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.045+0000 7f1eb33ee700 1 --2- 172.21.15.60:0/2213793652 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1e8c054f10 0x7f1e8c0573d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.045+0000 7f1eb33ee700 1 --2- 172.21.15.60:0/2213793652 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1eac0b1a10 0x7f1eac13f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.045+0000 7f1eb33ee700 1 -- 172.21.15.60:0/2213793652 >> 172.21.15.60:0/2213793652 conn(0x7f1eac0b5300 msgr2=0x7f1eac133e90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:58.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.045+0000 7f1eb33ee700 1 -- 172.21.15.60:0/2213793652 shutdown_connections 2020-10-31T22:50:58.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.045+0000 7f1eb33ee700 1 -- 172.21.15.60:0/2213793652 wait complete. 2020-10-31T22:50:58.066 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early config set mon mon_allow_pool_delete True 2020-10-31T22:50:58.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 Processor -- start 2020-10-31T22:50:58.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 -- start start 2020-10-31T22:50:58.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f86540b5570 0x7f86540b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:58.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8654141f00 0x7f8654142360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:58.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86540b4440 con 0x7f86540b24a0 2020-10-31T22:50:58.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f865413f930 con 0x7f86540b5570 2020-10-31T22:50:58.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8654146060 con 0x7f8654141f00 2020-10-31T22:50:58.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f8653fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f86540b5570 0x7f86540b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:58.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f8653fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f86540b5570 0x7f86540b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49822/0 (socket says 172.21.15.60:49822) 2020-10-31T22:50:58.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f8653fff700 1 -- 172.21.15.60:0/2390193978 learned_addr learned my addr 172.21.15.60:0/2390193978 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:58.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f8658afc700 1 --2- 172.21.15.60:0/2390193978 >> v2:172.21.15.66:3300/0 conn(0x7f8654141f00 0x7f8654142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:58.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f8653fff700 1 -- 172.21.15.60:0/2390193978 >> v2:172.21.15.66:3300/0 conn(0x7f8654141f00 msgr2=0x7f8654142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:58.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f8653fff700 1 --2- 172.21.15.60:0/2390193978 >> v2:172.21.15.66:3300/0 conn(0x7f8654141f00 0x7f8654142360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f8653fff700 1 -- 172.21.15.60:0/2390193978 >> v1:172.21.15.66:6789/0 conn(0x7f86540b24a0 legacy=0x7f8654145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:58.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f8653fff700 1 -- 172.21.15.60:0/2390193978 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86540b02f0 con 0x7f86540b5570 2020-10-31T22:50:58.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f8653fff700 1 --2- 172.21.15.60:0/2390193978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86540b5570 0x7f86540b5950 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f8644002f30 tx=0x7f8644006e80).ready entity=mon.0 client_cookie=1852b4215a1590c9 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:58.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f8652ffd700 1 -- 172.21.15.60:0/2390193978 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86440097f0 con 0x7f86540b5570 2020-10-31T22:50:58.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f8652ffd700 1 -- 172.21.15.60:0/2390193978 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8644009950 con 0x7f86540b5570 2020-10-31T22:50:58.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f8652ffd700 1 -- 172.21.15.60:0/2390193978 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8644009cb0 con 0x7f86540b5570 2020-10-31T22:50:58.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 -- 172.21.15.60:0/2390193978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86540b5570 msgr2=0x7f86540b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:58.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 --2- 172.21.15.60:0/2390193978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86540b5570 0x7f86540b5950 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 rx=0x7f8644002f30 tx=0x7f8644006e80).stop 2020-10-31T22:50:58.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 -- 172.21.15.60:0/2390193978 shutdown_connections 2020-10-31T22:50:58.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 --2- 172.21.15.60:0/2390193978 >> v2:172.21.15.66:3300/0 conn(0x7f8654141f00 0x7f8654142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 --2- 172.21.15.60:0/2390193978 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86540b5570 0x7f86540b5950 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 -- 172.21.15.60:0/2390193978 >> 172.21.15.60:0/2390193978 conn(0x7f86540b8e90 msgr2=0x7f86540b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:58.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 -- 172.21.15.60:0/2390193978 shutdown_connections 2020-10-31T22:50:58.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.189+0000 7f86592fd700 1 -- 172.21.15.60:0/2390193978 wait complete. 2020-10-31T22:50:58.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86592fd700 1 Processor -- start 2020-10-31T22:50:58.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86592fd700 1 -- start start 2020-10-31T22:50:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86592fd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86540b24a0 0x7f86541439a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86592fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86540b5570 0x7f86540adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86592fd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8654141f00 0x7f865413c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86592fd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8654144ad0 con 0x7f86540b5570 2020-10-31T22:50:58.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86592fd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86540ac440 con 0x7f8654141f00 2020-10-31T22:50:58.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86592fd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8654144d30 con 0x7f86540b24a0 2020-10-31T22:50:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86540b5570 0x7f86540adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86537fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86540b5570 0x7f86540adcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49830/0 (socket says 172.21.15.60:49830) 2020-10-31T22:50:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86537fe700 1 -- 172.21.15.60:0/1215649495 learned_addr learned my addr 172.21.15.60:0/1215649495 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f8653fff700 1 --2- 172.21.15.60:0/1215649495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86540b24a0 0x7f86541439a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f8658afc700 1 --2- 172.21.15.60:0/1215649495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8654141f00 0x7f865413c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86537fe700 1 -- 172.21.15.60:0/1215649495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86540b24a0 msgr2=0x7f86541439a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:58.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86537fe700 1 --2- 172.21.15.60:0/1215649495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86540b24a0 0x7f86541439a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86537fe700 1 -- 172.21.15.60:0/1215649495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8654141f00 msgr2=0x7f865413c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:58.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86537fe700 1 --2- 172.21.15.60:0/1215649495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8654141f00 0x7f865413c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86537fe700 1 -- 172.21.15.60:0/1215649495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8654143500 con 0x7f86540b5570 2020-10-31T22:50:58.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86537fe700 1 --2- 172.21.15.60:0/1215649495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86540b5570 0x7f86540adcc0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f8654141de0 tx=0x7f8648007c20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:58.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.193+0000 7f86517fa700 1 -- 172.21.15.60:0/1215649495 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f864800f470 con 0x7f86540b5570 2020-10-31T22:50:58.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.197+0000 7f86517fa700 1 -- 172.21.15.60:0/1215649495 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864800f5d0 con 0x7f86540b5570 2020-10-31T22:50:58.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.197+0000 7f86592fd700 1 -- 172.21.15.60:0/1215649495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86540b7be0 con 0x7f86540b5570 2020-10-31T22:50:58.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.197+0000 7f86517fa700 1 -- 172.21.15.60:0/1215649495 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f864800f930 con 0x7f86540b5570 2020-10-31T22:50:58.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.197+0000 7f86592fd700 1 -- 172.21.15.60:0/1215649495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86540af280 con 0x7f86540b5570 2020-10-31T22:50:58.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.197+0000 7f86592fd700 1 -- 172.21.15.60:0/1215649495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8654143690 con 0x7f86540b5570 2020-10-31T22:50:58.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.197+0000 7f86517fa700 1 -- 172.21.15.60:0/1215649495 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8648019030 con 0x7f86540b5570 2020-10-31T22:50:58.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.197+0000 7f86517fa700 1 --2- 172.21.15.60:0/1215649495 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8634054f10 0x7f86340573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:58.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.197+0000 7f86517fa700 1 -- 172.21.15.60:0/1215649495 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f864806cf50 con 0x7f86540b5570 2020-10-31T22:50:58.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.197+0000 7f8653fff700 1 --2- 172.21.15.60:0/1215649495 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8634054f10 0x7f86340573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:58.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.197+0000 7f8653fff700 1 --2- 172.21.15.60:0/1215649495 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8634054f10 0x7f86340573d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f864401c000 tx=0x7f8644015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:58.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.201+0000 7f86517fa700 1 -- 172.21.15.60:0/1215649495 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8648043360 con 0x7f86540b5570 2020-10-31T22:50:58.345 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.341+0000 7f86592fd700 1 -- 172.21.15.60:0/1215649495 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"} v 0) v1 -- 0x7f8654057100 con 0x7f86540b5570 2020-10-31T22:50:58.354 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.349+0000 7f86517fa700 1 -- 172.21.15.60:0/1215649495 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "config set", "who": "mon", "name": "mon_allow_pool_delete", "value": "True"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8648046980 con 0x7f86540b5570 2020-10-31T22:50:58.356 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.349+0000 7f86592fd700 1 -- 172.21.15.60:0/1215649495 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8634054f10 msgr2=0x7f86340573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:58.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.349+0000 7f86592fd700 1 --2- 172.21.15.60:0/1215649495 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8634054f10 0x7f86340573d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7f864401c000 tx=0x7f8644015000).stop 2020-10-31T22:50:58.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.349+0000 7f86592fd700 1 -- 172.21.15.60:0/1215649495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86540b5570 msgr2=0x7f86540adcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:58.357 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.349+0000 7f86592fd700 1 --2- 172.21.15.60:0/1215649495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86540b5570 0x7f86540adcc0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 rx=0x7f8654141de0 tx=0x7f8648007c20).stop 2020-10-31T22:50:58.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.349+0000 7f86592fd700 1 -- 172.21.15.60:0/1215649495 shutdown_connections 2020-10-31T22:50:58.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.349+0000 7f86592fd700 1 --2- 172.21.15.60:0/1215649495 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8634054f10 0x7f86340573d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.358 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.349+0000 7f86592fd700 1 --2- 172.21.15.60:0/1215649495 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8654141f00 0x7f865413c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.349+0000 7f86592fd700 1 --2- 172.21.15.60:0/1215649495 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f86540b24a0 0x7f86541439a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.349+0000 7f86592fd700 1 --2- 172.21.15.60:0/1215649495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f86540b5570 0x7f86540adcc0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.359 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.349+0000 7f86592fd700 1 -- 172.21.15.60:0/1215649495 >> 172.21.15.60:0/1215649495 conn(0x7f86540b8e90 msgr2=0x7f865405f780 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:58.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.349+0000 7f86592fd700 1 -- 172.21.15.60:0/1215649495 shutdown_connections 2020-10-31T22:50:58.360 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.353+0000 7f86592fd700 1 -- 172.21.15.60:0/1215649495 wait complete. 2020-10-31T22:50:58.369 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:50:58.370 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:58.385 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:58.403 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:58.420 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:50:58.439 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:50:58.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:58.440 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:58.440 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:50:58.493 INFO:teuthology.orchestra.run.smithi152.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.0': No such file or directory 2020-10-31T22:50:58.494 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:50:58.494 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.0 2020-10-31T22:50:58.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:50:58.495 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:50:58.496 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:50:58.502 INFO:teuthology.orchestra.run.smithi085.stderr:stat: cannot read file system information for '/home/ubuntu/cephtest/mnt.1': No such file or directory 2020-10-31T22:50:58.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-10-31T22:50:58.504 INFO:tasks.cephfs.fuse_mount:mount point does not exist: /home/ubuntu/cephtest/mnt.1 2020-10-31T22:50:58.504 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-10-31T22:50:58.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1eeb0d9700 1 Processor -- start 2020-10-31T22:50:58.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1eeb0d9700 1 -- start start 2020-10-31T22:50:58.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1eeb0d9700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1ee413ebe0 0x7f1ee4142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:58.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1eeb0d9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ee40af200 0x7f1ee40b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:58.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1eeb0d9700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ee40abea0 con 0x7f1ee40b1a10 2020-10-31T22:50:58.638 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1eeb0d9700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ee4141870 con 0x7f1ee413ebe0 2020-10-31T22:50:58.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1eeb0d9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee4141b10 con 0x7f1ee40af200 2020-10-31T22:50:58.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1ee98d6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1ee413ebe0 0x7f1ee4142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:58.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1ee98d6700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f1ee413ebe0 0x7f1ee4142250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49838/0 (socket says 172.21.15.60:49838) 2020-10-31T22:50:58.639 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1ee98d6700 1 -- 172.21.15.60:0/1290564539 learned_addr learned my addr 172.21.15.60:0/1290564539 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1eea8d8700 1 --2- 172.21.15.60:0/1290564539 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ee40af200 0x7f1ee40b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1ee98d6700 1 -- 172.21.15.60:0/1290564539 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ee40af200 msgr2=0x7f1ee40b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1ee98d6700 1 --2- 172.21.15.60:0/1290564539 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ee40af200 0x7f1ee40b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.640 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1ee98d6700 1 -- 172.21.15.60:0/1290564539 >> v1:172.21.15.66:6789/0 conn(0x7f1ee40b1a10 legacy=0x7f1ee40afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:58.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1ee98d6700 1 -- 172.21.15.60:0/1290564539 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee4141db0 con 0x7f1ee413ebe0 2020-10-31T22:50:58.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.629+0000 7f1ee98d6700 1 --2- 172.21.15.60:0/1290564539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee413ebe0 0x7f1ee4142250 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f1ed4002f30 tx=0x7f1ed4006e80).ready entity=mon.0 client_cookie=699a063757b5a576 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:58.641 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1ee90d5700 1 -- 172.21.15.60:0/1290564539 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ed40099e0 con 0x7f1ee413ebe0 2020-10-31T22:50:58.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1ee90d5700 1 -- 172.21.15.60:0/1290564539 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ed4009b40 con 0x7f1ee413ebe0 2020-10-31T22:50:58.642 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1ee90d5700 1 -- 172.21.15.60:0/1290564539 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ed4009ea0 con 0x7f1ee413ebe0 2020-10-31T22:50:58.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/1290564539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee413ebe0 msgr2=0x7f1ee4142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:58.643 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 --2- 172.21.15.60:0/1290564539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee413ebe0 0x7f1ee4142250 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 rx=0x7f1ed4002f30 tx=0x7f1ed4006e80).stop 2020-10-31T22:50:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/1290564539 shutdown_connections 2020-10-31T22:50:58.647 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 --2- 172.21.15.60:0/1290564539 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ee40af200 0x7f1ee40b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 --2- 172.21.15.60:0/1290564539 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee413ebe0 0x7f1ee4142250 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/1290564539 >> 172.21.15.60:0/1290564539 conn(0x7f1ee40b5300 msgr2=0x7f1ee40b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/1290564539 shutdown_connections 2020-10-31T22:50:58.648 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/1290564539 wait complete. 2020-10-31T22:50:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 Processor -- start 2020-10-31T22:50:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 -- start start 2020-10-31T22:50:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee40af200 0x7f1ee40b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:58.649 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ee40b1a10 0x7f1ee4064cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:58.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ee413ebe0 0x7f1ee40651c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:58.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee40aa8b0 con 0x7f1ee40af200 2020-10-31T22:50:58.650 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee40ab520 con 0x7f1ee413ebe0 2020-10-31T22:50:58.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eeb0d9700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ee40aaae0 con 0x7f1ee40b1a10 2020-10-31T22:50:58.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eea0d7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee40af200 0x7f1ee40b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:58.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eea0d7700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee40af200 0x7f1ee40b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49842/0 (socket says 172.21.15.60:49842) 2020-10-31T22:50:58.651 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.633+0000 7f1eea0d7700 1 -- 172.21.15.60:0/3706782299 learned_addr learned my addr 172.21.15.60:0/3706782299 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1eea8d8700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ee413ebe0 0x7f1ee40651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1ee98d6700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ee40b1a10 0x7f1ee4064cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:58.652 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1eea0d7700 1 -- 172.21.15.60:0/3706782299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ee40b1a10 msgr2=0x7f1ee4064cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1eea0d7700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ee40b1a10 0x7f1ee4064cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1eea0d7700 1 -- 172.21.15.60:0/3706782299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ee413ebe0 msgr2=0x7f1ee40651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1eea0d7700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ee413ebe0 0x7f1ee40651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.653 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1eea0d7700 1 -- 172.21.15.60:0/3706782299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ee40ab780 con 0x7f1ee40af200 2020-10-31T22:50:58.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1eea8d8700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ee413ebe0 0x7f1ee40651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:58.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1ee98d6700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ee40b1a10 0x7f1ee4064cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:50:58.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1eea0d7700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee40af200 0x7f1ee40b3b30 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f1ee4062ba0 tx=0x7f1ee0007b50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:58.654 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1ed37fe700 1 -- 172.21.15.60:0/3706782299 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ee0007030 con 0x7f1ee40af200 2020-10-31T22:50:58.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1ed37fe700 1 -- 172.21.15.60:0/3706782299 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ee0007190 con 0x7f1ee40af200 2020-10-31T22:50:58.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1ed37fe700 1 -- 172.21.15.60:0/3706782299 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1ee00064e0 con 0x7f1ee40af200 2020-10-31T22:50:58.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/3706782299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ee40aba20 con 0x7f1ee40af200 2020-10-31T22:50:58.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/3706782299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ee40a9fa0 con 0x7f1ee40af200 2020-10-31T22:50:58.655 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/3706782299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ee4057100 con 0x7f1ee40af200 2020-10-31T22:50:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.637+0000 7f1ed37fe700 1 -- 172.21.15.60:0/3706782299 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f1ee0010070 con 0x7f1ee40af200 2020-10-31T22:50:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.641+0000 7f1ed37fe700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ec4054f10 0x7f1ec40573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.641+0000 7f1ed37fe700 1 -- 172.21.15.60:0/3706782299 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f1ee006cf20 con 0x7f1ee40af200 2020-10-31T22:50:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.641+0000 7f1ee98d6700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ec4054f10 0x7f1ec40573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:58.656 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.641+0000 7f1ee98d6700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ec4054f10 0x7f1ec40573d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f1ed401e000 tx=0x7f1ed4017000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:58.657 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.645+0000 7f1ed37fe700 1 -- 172.21.15.60:0/3706782299 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f1ee00434f0 con 0x7f1ee40af200 2020-10-31T22:50:58.796 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.789+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/3706782299 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1ee40abbb0 con 0x7f1ee40af200 2020-10-31T22:50:58.798 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.793+0000 7f1ed37fe700 1 -- 172.21.15.60:0/3706782299 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v149) v1 ==== 81+0+33659 (secure 0 0 0) 0x7f1ee0018020 con 0x7f1ee40af200 2020-10-31T22:50:58.799 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:58.800 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:50:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 149, 2020-10-31T22:50:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "226f905a-1517-4a8c-8009-08779515965c", 2020-10-31T22:50:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2020-10-31T22:40:51.928572+0000", 2020-10-31T22:50:58.800 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2020-10-31T22:50:46.335277+0000", 2020-10-31T22:50:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:50:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:50:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-10-31T22:50:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2020-10-31T22:50:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2020-10-31T22:50:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2020-10-31T22:50:58.801 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2020-10-31T22:50:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2020-10-31T22:50:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2020-10-31T22:50:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:50:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2020-10-31T22:50:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2020-10-31T22:50:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-10-31T22:50:58.802 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2020-10-31T22:50:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2020-10-31T22:50:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 28, 2020-10-31T22:50:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2020-10-31T22:50:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "jewel", 2020-10-31T22:50:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2020-10-31T22:50:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "octopus", 2020-10-31T22:50:58.803 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:50:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2020-10-31T22:50:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "device_health_metrics", 2020-10-31T22:50:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:40:55.846143+0000", 2020-10-31T22:50:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:50:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:50:58.804 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:50:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:50:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:50:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:50:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:50:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:50:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2020-10-31T22:50:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2020-10-31T22:50:58.805 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2020-10-31T22:50:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2020-10-31T22:50:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2020-10-31T22:50:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:50:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:50:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:50:58.806 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:50:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:50:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:50:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:50:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "15", 2020-10-31T22:50:58.807 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:50:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:50:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:50:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:50:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:50:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:50:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:50:58.808 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:50:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:50:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:50:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:50:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:50:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:50:58.809 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:50:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:50:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:50:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:50:58.810 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:50:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:50:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:50:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:50:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:50:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:50:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:50:58.811 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:50:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:50:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:50:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:50:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:50:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:50:58.812 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:50:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:50:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:50:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:50:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:50:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:50:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:50:58.813 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:50:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2020-10-31T22:50:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:50:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_devicehealth": {} 2020-10-31T22:50:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.814 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2020-10-31T22:50:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2020-10-31T22:50:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:05.358501+0000", 2020-10-31T22:50:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:50:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:50:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:50:58.815 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:50:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:50:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:50:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:50:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:50:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:50:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:50:58.816 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:50:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:50:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:50:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:50:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:50:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:50:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:50:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:50:58.817 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:50:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:50:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "18", 2020-10-31T22:50:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:50:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:50:58.818 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:50:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:50:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:50:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:50:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:50:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:50:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:50:58.819 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:50:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:50:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:50:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:50:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:50:58.820 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:50:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:50:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:50:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:50:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:50:58.821 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:50:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:50:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:50:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:50:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:50:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:50:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:50:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:50:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:50:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:50:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:50:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:50:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:50:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:50:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:50:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:50:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:50:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:50:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:50:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:50:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2020-10-31T22:50:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 27, 2020-10-31T22:50:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2020-10-31T22:50:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:50:43.020680+0000", 2020-10-31T22:50:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:50:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:50:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:50:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:50:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:50:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:50:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:50:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:50:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:50:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:50:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:50:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:50:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:50:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:50:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:50:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:50:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:50:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:50:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:50:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:50:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "148", 2020-10-31T22:50:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:50:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:50:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:50:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:50:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:50:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:50:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:50:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:50:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:50:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:50:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:50:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:50:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:50:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:50:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:50:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:50:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:50:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:50:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:50:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:50:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:50:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:50:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:50:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:50:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:50:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:50:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:50:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:50:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:50:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:50:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:50:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:50:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:50:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:50:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:50:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:50:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:50:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:50:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2020-10-31T22:50:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2020-10-31T22:50:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2020-10-31T22:50:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:50:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:50:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2020-10-31T22:50:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 28, 2020-10-31T22:50:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2020-10-31T22:50:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:50:44.329474+0000", 2020-10-31T22:50:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:50:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:50:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:50:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:50:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:50:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:50:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:50:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:50:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:50:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:50:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:50:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:50:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:50:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:50:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:50:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:50:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:50:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:50:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:50:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:50:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "149", 2020-10-31T22:50:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:50:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:50:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:50:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:50:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:50:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:50:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:50:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:50:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:50:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:50:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:50:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:50:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:50:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:50:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:50:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:50:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:50:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:50:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:50:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:50:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:50:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:50:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:50:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:50:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:50:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:50:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:50:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:50:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:50:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:50:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:50:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:50:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:50:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:50:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:50:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:50:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:50:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:50:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:50:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:50:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2020-10-31T22:50:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:50:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2020-10-31T22:50:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:50:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", 2020-10-31T22:50:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 147, 2020-10-31T22:50:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2020-10-31T22:50:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2020-10-31T22:50:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2020-10-31T22:50:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2020-10-31T22:50:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2020-10-31T22:50:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2020-10-31T22:50:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2020-10-31T22:50:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2020-10-31T22:50:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:50:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6803/14302", 2020-10-31T22:50:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6805/14302", 2020-10-31T22:50:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6809/14302", 2020-10-31T22:50:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6807/14302", 2020-10-31T22:50:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:50:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", 2020-10-31T22:50:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 147, 2020-10-31T22:50:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2020-10-31T22:50:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2020-10-31T22:50:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2020-10-31T22:50:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2020-10-31T22:50:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2020-10-31T22:50:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2020-10-31T22:50:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2020-10-31T22:50:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2020-10-31T22:50:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:50:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/14300", 2020-10-31T22:50:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6813/14300", 2020-10-31T22:50:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6817/14300", 2020-10-31T22:50:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6815/14300", 2020-10-31T22:50:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:50:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", 2020-10-31T22:50:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 146, 2020-10-31T22:50:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2020-10-31T22:50:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2020-10-31T22:50:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.870 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.870 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:58.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.870 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.870 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.870 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2020-10-31T22:50:58.871 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:58.871 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.871 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.871 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.871 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2020-10-31T22:50:58.871 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:58.871 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.872 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.872 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.872 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:58.872 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.872 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.872 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.872 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6832", 2020-10-31T22:50:58.872 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:58.873 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.873 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.873 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.873 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6833", 2020-10-31T22:50:58.873 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:58.873 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.873 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.874 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:58.874 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.874 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.874 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.874 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2020-10-31T22:50:58.874 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:58.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.875 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.875 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.875 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2020-10-31T22:50:58.875 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:50:58.875 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.875 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.875 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.876 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6827/14318", 2020-10-31T22:50:58.876 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6829/14318", 2020-10-31T22:50:58.876 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6833/14318", 2020-10-31T22:50:58.876 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6831/14318", 2020-10-31T22:50:58.876 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:58.876 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:58.876 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:58.877 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.877 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.877 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.877 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:50:58.877 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", 2020-10-31T22:50:58.877 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:58.877 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:58.878 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:58.878 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:58.878 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:58.878 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:58.878 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:58.878 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 136, 2020-10-31T22:50:58.878 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:58.878 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:58.879 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:58.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.879 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.879 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.879 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2020-10-31T22:50:58.879 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:58.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.880 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.880 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.880 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2020-10-31T22:50:58.880 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:58.880 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.880 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.881 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:58.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.881 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.881 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.881 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2020-10-31T22:50:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2020-10-31T22:50:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:58.882 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2020-10-31T22:50:58.883 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2020-10-31T22:50:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.884 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2020-10-31T22:50:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:58.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2020-10-31T22:50:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:50:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6819/14301", 2020-10-31T22:50:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6821/14301", 2020-10-31T22:50:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/14301", 2020-10-31T22:50:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6823/14301", 2020-10-31T22:50:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:58.887 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:50:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", 2020-10-31T22:50:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:58.888 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 146, 2020-10-31T22:50:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:58.889 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6816", 2020-10-31T22:50:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6817", 2020-10-31T22:50:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.891 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6818", 2020-10-31T22:50:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.892 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6819", 2020-10-31T22:50:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.893 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:58.894 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.894 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.894 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6822", 2020-10-31T22:50:58.894 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:58.894 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.894 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.894 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.895 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6823", 2020-10-31T22:50:58.895 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:58.895 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.895 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.895 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.895 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:58.895 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.896 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.896 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6820", 2020-10-31T22:50:58.896 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:58.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.896 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.896 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.896 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6821", 2020-10-31T22:50:58.897 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:50:58.897 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.897 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.897 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6817/14002", 2020-10-31T22:50:58.897 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6819/14002", 2020-10-31T22:50:58.897 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6823/14002", 2020-10-31T22:50:58.898 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6821/14002", 2020-10-31T22:50:58.898 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:58.898 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:58.898 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:58.898 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.898 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:50:58.899 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", 2020-10-31T22:50:58.899 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:58.899 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:58.899 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:58.899 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:58.899 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:58.899 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:58.900 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:58.900 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 147, 2020-10-31T22:50:58.900 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:58.900 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:58.900 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:58.900 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.900 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6800", 2020-10-31T22:50:58.901 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:58.901 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.901 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.901 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.901 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6801", 2020-10-31T22:50:58.901 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:58.902 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.902 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.902 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:58.902 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.902 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.902 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.903 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6802", 2020-10-31T22:50:58.903 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:58.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.903 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.903 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.903 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6803", 2020-10-31T22:50:58.903 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:58.904 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.904 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.904 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:58.904 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.904 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.904 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.904 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6806", 2020-10-31T22:50:58.905 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:58.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.905 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.905 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.905 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6807", 2020-10-31T22:50:58.905 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:58.905 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.906 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6804", 2020-10-31T22:50:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6805", 2020-10-31T22:50:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:50:58.907 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6801/14001", 2020-10-31T22:50:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6803/14001", 2020-10-31T22:50:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6807/14001", 2020-10-31T22:50:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6805/14001", 2020-10-31T22:50:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:58.908 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:50:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", 2020-10-31T22:50:58.909 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:58.910 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:58.910 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:58.910 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:58.910 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:58.910 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:58.910 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:58.910 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 147, 2020-10-31T22:50:58.911 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:58.911 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:58.911 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:58.911 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.911 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.911 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.911 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6808", 2020-10-31T22:50:58.911 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:58.912 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.912 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.912 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.912 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6809", 2020-10-31T22:50:58.912 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:58.912 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.912 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.913 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:58.913 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.913 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.913 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.913 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6810", 2020-10-31T22:50:58.913 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:58.913 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.914 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.914 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.914 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6811", 2020-10-31T22:50:58.914 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:58.914 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.914 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.914 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.915 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:58.915 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.915 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.915 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.915 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6814", 2020-10-31T22:50:58.915 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:58.915 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.916 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.916 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.916 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6815", 2020-10-31T22:50:58.916 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:58.916 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.916 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.916 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.916 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:58.917 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.917 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.917 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6812", 2020-10-31T22:50:58.917 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:58.917 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.917 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.918 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.918 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6813", 2020-10-31T22:50:58.918 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:50:58.918 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.918 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.918 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.918 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6809/14003", 2020-10-31T22:50:58.919 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6811/14003", 2020-10-31T22:50:58.919 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6815/14003", 2020-10-31T22:50:58.919 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6813/14003", 2020-10-31T22:50:58.919 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:58.919 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:58.919 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:58.919 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.919 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.920 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.920 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:50:58.920 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", 2020-10-31T22:50:58.920 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:50:58.920 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:50:58.920 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:50:58.920 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:50:58.921 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:50:58.921 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:50:58.921 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:50:58.921 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 147, 2020-10-31T22:50:58.921 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:50:58.921 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:50:58.921 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:50:58.922 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.922 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.922 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6824", 2020-10-31T22:50:58.922 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:58.922 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.922 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.922 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.923 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6825", 2020-10-31T22:50:58.923 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:58.923 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.923 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.923 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.923 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:50:58.923 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.924 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.924 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6826", 2020-10-31T22:50:58.924 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:58.924 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.924 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.924 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.925 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6827", 2020-10-31T22:50:58.925 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:58.925 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.925 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.925 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.925 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:50:58.925 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.925 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.926 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.926 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6830", 2020-10-31T22:50:58.926 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:58.926 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.926 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.926 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.926 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6831", 2020-10-31T22:50:58.927 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:58.927 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.927 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.927 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.927 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:50:58.927 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:50:58.927 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.928 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:50:58.928 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6828", 2020-10-31T22:50:58.928 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:58.928 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.928 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.928 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:50:58.928 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6829", 2020-10-31T22:50:58.928 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:50:58.929 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.929 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.929 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.929 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6825/14046", 2020-10-31T22:50:58.929 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6827/14046", 2020-10-31T22:50:58.929 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6831/14046", 2020-10-31T22:50:58.929 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6829/14046", 2020-10-31T22:50:58.930 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:50:58.930 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:50:58.930 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:50:58.930 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:50:58.930 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.930 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:50:58.930 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2020-10-31T22:50:58.930 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.931 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:50:58.931 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:58.931 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:58.931 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:58.931 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:58.931 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:58.931 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.314917+0000", 2020-10-31T22:50:58.932 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:58.932 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.932 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.932 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:50:58.932 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:58.932 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:58.932 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:58.933 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:58.933 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:58.933 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.643069+0000", 2020-10-31T22:50:58.933 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:58.933 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.933 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.933 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:50:58.934 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:58.934 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:58.934 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:58.934 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:58.934 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:58.934 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.662572+0000", 2020-10-31T22:50:58.934 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:58.934 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.935 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.935 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:50:58.935 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:58.935 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:58.935 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:58.935 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:58.935 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:58.936 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.664868+0000", 2020-10-31T22:50:58.936 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:58.936 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.936 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.936 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:50:58.936 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:58.936 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:58.937 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:58.937 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:58.937 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:58.937 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551107+0000", 2020-10-31T22:50:58.937 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:58.937 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.937 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.938 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:50:58.938 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:58.938 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:58.938 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:58.938 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:58.938 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:58.939 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.400568+0000", 2020-10-31T22:50:58.939 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:58.939 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.939 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.939 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:50:58.939 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:58.939 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:58.940 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:58.940 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:58.940 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:58.940 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551173+0000", 2020-10-31T22:50:58.940 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:58.940 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.940 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:50:58.941 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:50:58.941 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:50:58.941 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:50:58.941 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:50:58.941 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:50:58.941 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:50:58.941 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.604302+0000", 2020-10-31T22:50:58.942 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:50:58.942 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.942 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:50:58.942 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2020-10-31T22:50:58.942 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2020-10-31T22:50:58.942 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2020-10-31T22:50:58.942 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2020-10-31T22:50:58.943 INFO:teuthology.orchestra.run.smithi060.stdout: "blacklist": {}, 2020-10-31T22:50:58.943 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2020-10-31T22:50:58.943 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2020-10-31T22:50:58.943 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2020-10-31T22:50:58.943 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2020-10-31T22:50:58.943 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2020-10-31T22:50:58.943 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2020-10-31T22:50:58.943 INFO:teuthology.orchestra.run.smithi060.stdout: "ruleset-failure-domain": "osd", 2020-10-31T22:50:58.944 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2020-10-31T22:50:58.944 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:50:58.944 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:50:58.944 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2020-10-31T22:50:58.944 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2020-10-31T22:50:58.944 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2020-10-31T22:50:58.944 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2020-10-31T22:50:58.945 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {} 2020-10-31T22:50:58.945 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:50:58.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.793+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/3706782299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ec4054f10 msgr2=0x7f1ec40573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:58.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.793+0000 7f1eeb0d9700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ec4054f10 0x7f1ec40573d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7f1ed401e000 tx=0x7f1ed4017000).stop 2020-10-31T22:50:58.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.793+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/3706782299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee40af200 msgr2=0x7f1ee40b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:58.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.793+0000 7f1eeb0d9700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee40af200 0x7f1ee40b3b30 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 rx=0x7f1ee4062ba0 tx=0x7f1ee0007b50).stop 2020-10-31T22:50:58.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.793+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/3706782299 shutdown_connections 2020-10-31T22:50:58.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.793+0000 7f1eeb0d9700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1ec4054f10 0x7f1ec40573d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.793+0000 7f1eeb0d9700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ee413ebe0 0x7f1ee40651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.793+0000 7f1eeb0d9700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1ee40af200 0x7f1ee40b3b30 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.793+0000 7f1eeb0d9700 1 --2- 172.21.15.60:0/3706782299 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ee40b1a10 0x7f1ee4064cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:58.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.793+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/3706782299 >> 172.21.15.60:0/3706782299 conn(0x7f1ee40b5300 msgr2=0x7f1ee40afc20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:58.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.793+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/3706782299 shutdown_connections 2020-10-31T22:50:58.948 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:58.797+0000 7f1eeb0d9700 1 -- 172.21.15.60:0/3706782299 wait complete. 2020-10-31T22:50:58.948 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:50:59.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f466d931700 1 Processor -- start 2020-10-31T22:50:59.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f466d931700 1 -- start start 2020-10-31T22:50:59.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f466d931700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f46680b1a10 0x7f4668142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:59.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f466d931700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46680abea0 con 0x7f466813ebe0 2020-10-31T22:50:59.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f466d931700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4668141870 con 0x7f46680af200 2020-10-31T22:50:59.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f466d931700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4668141b10 con 0x7f46680b1a10 2020-10-31T22:50:59.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f465ffff700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f466813ebe0 0x7f46680afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:53988/0 (socket says 172.21.15.60:53988) 2020-10-31T22:50:59.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f465ffff700 1 -- 172.21.15.60:0/1032420835 learned_addr learned my addr 172.21.15.60:0/1032420835 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:59.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f466c92f700 1 --2- 172.21.15.60:0/1032420835 >> v2:172.21.15.66:3300/0 conn(0x7f46680b1a10 0x7f4668142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:59.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f465f7fe700 1 -- 172.21.15.60:0/1032420835 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1264373199 0 0) 0x7f46680abea0 con 0x7f466813ebe0 2020-10-31T22:50:59.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f465f7fe700 1 -- 172.21.15.60:0/1032420835 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4654004340 con 0x7f466813ebe0 2020-10-31T22:50:59.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f465f7fe700 1 -- 172.21.15.60:0/1032420835 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1089057013 0 0) 0x7f4668141870 con 0x7f46680af200 2020-10-31T22:50:59.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f465f7fe700 1 -- 172.21.15.60:0/1032420835 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46680abea0 con 0x7f46680af200 2020-10-31T22:50:59.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f466c92f700 1 -- 172.21.15.60:0/1032420835 >> v1:172.21.15.66:6789/0 conn(0x7f46680af200 legacy=0x7f46680b0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:59.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f466c92f700 1 -- 172.21.15.60:0/1032420835 >> v1:172.21.15.60:6789/0 conn(0x7f466813ebe0 legacy=0x7f46680afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:59.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f466c92f700 1 -- 172.21.15.60:0/1032420835 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4668141db0 con 0x7f46680b1a10 2020-10-31T22:50:59.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.065+0000 7f466c92f700 1 --2- 172.21.15.60:0/1032420835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680b1a10 0x7f4668142250 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f4664002f30 tx=0x7f4664006dc0).ready entity=mon.1 client_cookie=4fe0211ec7bdc87e server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:59.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.069+0000 7f465f7fe700 1 -- 172.21.15.60:0/1032420835 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4664009740 con 0x7f46680b1a10 2020-10-31T22:50:59.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.069+0000 7f465f7fe700 1 -- 172.21.15.60:0/1032420835 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46640098a0 con 0x7f46680b1a10 2020-10-31T22:50:59.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.069+0000 7f465f7fe700 1 -- 172.21.15.60:0/1032420835 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4664009c00 con 0x7f46680b1a10 2020-10-31T22:50:59.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.069+0000 7f466d931700 1 -- 172.21.15.60:0/1032420835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680b1a10 msgr2=0x7f4668142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:59.077 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.069+0000 7f466d931700 1 --2- 172.21.15.60:0/1032420835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680b1a10 0x7f4668142250 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f4664002f30 tx=0x7f4664006dc0).stop 2020-10-31T22:50:59.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.069+0000 7f466d931700 1 -- 172.21.15.60:0/1032420835 shutdown_connections 2020-10-31T22:50:59.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.069+0000 7f466d931700 1 --2- 172.21.15.60:0/1032420835 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680b1a10 0x7f4668142250 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:59.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.069+0000 7f466d931700 1 -- 172.21.15.60:0/1032420835 >> 172.21.15.60:0/1032420835 conn(0x7f46680b5300 msgr2=0x7f46680b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:59.078 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.069+0000 7f466d931700 1 -- 172.21.15.60:0/1032420835 shutdown_connections 2020-10-31T22:50:59.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.069+0000 7f466d931700 1 -- 172.21.15.60:0/1032420835 wait complete. 2020-10-31T22:50:59.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.069+0000 7f466d931700 1 Processor -- start 2020-10-31T22:50:59.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.069+0000 7f466d931700 1 -- start start 2020-10-31T22:50:59.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d931700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46680af200 0x7f466813dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:59.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d931700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680b1a10 0x7f466813abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:59.081 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d931700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f466813ebe0 0x7f466813b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:59.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d931700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466813b5a0 con 0x7f466813ebe0 2020-10-31T22:50:59.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d931700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4668063a90 con 0x7f46680b1a10 2020-10-31T22:50:59.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d931700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46680641b0 con 0x7f46680af200 2020-10-31T22:50:59.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d130700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f466813ebe0 0x7f466813b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:59.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d130700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f466813ebe0 0x7f466813b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49860/0 (socket says 172.21.15.60:49860) 2020-10-31T22:50:59.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d130700 1 -- 172.21.15.60:0/1869582810 learned_addr learned my addr 172.21.15.60:0/1869582810 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:59.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466c92f700 1 --2- 172.21.15.60:0/1869582810 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46680af200 0x7f466813dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:59.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f465ffff700 1 --2- 172.21.15.60:0/1869582810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680b1a10 0x7f466813abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:59.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d130700 1 -- 172.21.15.60:0/1869582810 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46680af200 msgr2=0x7f466813dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:59.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d130700 1 --2- 172.21.15.60:0/1869582810 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46680af200 0x7f466813dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:59.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d130700 1 -- 172.21.15.60:0/1869582810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680b1a10 msgr2=0x7f466813abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:59.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d130700 1 --2- 172.21.15.60:0/1869582810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680b1a10 0x7f466813abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:59.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d130700 1 -- 172.21.15.60:0/1869582810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4668064450 con 0x7f466813ebe0 2020-10-31T22:50:59.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d130700 1 --2- 172.21.15.60:0/1869582810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f466813ebe0 0x7f466813b0b0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f4660001450 tx=0x7f4660007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:59.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f465dffb700 1 -- 172.21.15.60:0/1869582810 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f466000ce10 con 0x7f466813ebe0 2020-10-31T22:50:59.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f465dffb700 1 -- 172.21.15.60:0/1869582810 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466000a7b0 con 0x7f466813ebe0 2020-10-31T22:50:59.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d931700 1 -- 172.21.15.60:0/1869582810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4668065750 con 0x7f466813ebe0 2020-10-31T22:50:59.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f465dffb700 1 -- 172.21.15.60:0/1869582810 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f466000a920 con 0x7f466813ebe0 2020-10-31T22:50:59.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d931700 1 -- 172.21.15.60:0/1869582810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46680636b0 con 0x7f466813ebe0 2020-10-31T22:50:59.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f466d931700 1 -- 172.21.15.60:0/1869582810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4668065d80 con 0x7f466813ebe0 2020-10-31T22:50:59.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.073+0000 7f465dffb700 1 -- 172.21.15.60:0/1869582810 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4660010070 con 0x7f466813ebe0 2020-10-31T22:50:59.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.077+0000 7f465dffb700 1 --2- 172.21.15.60:0/1869582810 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4648054f10 0x7f46480573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:59.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.077+0000 7f465dffb700 1 -- 172.21.15.60:0/1869582810 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f466006d6a0 con 0x7f466813ebe0 2020-10-31T22:50:59.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.077+0000 7f466c92f700 1 --2- 172.21.15.60:0/1869582810 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4648054f10 0x7f46480573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:59.088 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.077+0000 7f466c92f700 1 --2- 172.21.15.60:0/1869582810 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4648054f10 0x7f46480573d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f466401b000 tx=0x7f4664015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:59.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.085+0000 7f465dffb700 1 -- 172.21.15.60:0/1869582810 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4660043a30 con 0x7f466813ebe0 2020-10-31T22:50:59.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.273+0000 7f466d931700 1 -- 172.21.15.60:0/1869582810 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4668057100 con 0x7f466813ebe0 2020-10-31T22:50:59.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.273+0000 7f465dffb700 1 -- 172.21.15.60:0/1869582810 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) v1 ==== 94+0+2495 (secure 0 0 0) 0x7f4660047050 con 0x7f466813ebe0 2020-10-31T22:50:59.278 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:50:59.278 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":76,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7085,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/2329273308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2329273308},{"type":"v1","addr":"172.21.15.66:6833","nonce":2329273308}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6835/4086841612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":4086841612},{"type":"v1","addr":"172.21.15.60:6835","nonce":4086841612}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:45.331860+0000","modified":"2020-10-31T22:50:46.335175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8232},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8232":{"gid":8232,"name":"c","rank":0,"incarnation":75,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/2095394176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":2095394176},{"type":"v1","addr":"172.21.15.60:6837","nonce":2095394176}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-10-31T22:50:59.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.273+0000 7f466d931700 1 -- 172.21.15.60:0/1869582810 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4648054f10 msgr2=0x7f46480573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:59.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.273+0000 7f466d931700 1 --2- 172.21.15.60:0/1869582810 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4648054f10 0x7f46480573d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7f466401b000 tx=0x7f4664015000).stop 2020-10-31T22:50:59.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.273+0000 7f466d931700 1 -- 172.21.15.60:0/1869582810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f466813ebe0 msgr2=0x7f466813b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:59.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.273+0000 7f466d931700 1 --2- 172.21.15.60:0/1869582810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f466813ebe0 0x7f466813b0b0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 rx=0x7f4660001450 tx=0x7f4660007d30).stop 2020-10-31T22:50:59.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.273+0000 7f466d931700 1 -- 172.21.15.60:0/1869582810 shutdown_connections 2020-10-31T22:50:59.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.273+0000 7f466d931700 1 --2- 172.21.15.60:0/1869582810 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f466813ebe0 0x7f466813b0b0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:59.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.273+0000 7f466d931700 1 --2- 172.21.15.60:0/1869582810 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f46680af200 0x7f466813dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:59.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.273+0000 7f466d931700 1 --2- 172.21.15.60:0/1869582810 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4648054f10 0x7f46480573d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:59.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.273+0000 7f466d931700 1 --2- 172.21.15.60:0/1869582810 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f46680b1a10 0x7f466813abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:59.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.273+0000 7f466d931700 1 -- 172.21.15.60:0/1869582810 >> 172.21.15.60:0/1869582810 conn(0x7f46680b5300 msgr2=0x7f46680b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:59.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.273+0000 7f466d931700 1 -- 172.21.15.60:0/1869582810 shutdown_connections 2020-10-31T22:50:59.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.273+0000 7f466d931700 1 -- 172.21.15.60:0/1869582810 wait complete. 2020-10-31T22:50:59.281 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 76 2020-10-31T22:50:59.292 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-10-31T22:50:59.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d2eb6700 1 Processor -- start 2020-10-31T22:50:59.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d2eb6700 1 -- start start 2020-10-31T22:50:59.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d2eb6700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe7cc13f3d0 0x7fe7cc05c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:59.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d2eb6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7cc0ae630 0x7fe7cc0b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:59.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d2eb6700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7cc05c800 con 0x7fe7cc0b1bb0 2020-10-31T22:50:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d2eb6700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7cc0adc50 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d2eb6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc0adef0 con 0x7fe7cc0ae630 2020-10-31T22:50:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d1eb4700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe7cc0b1bb0 0x7fe7cc13ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54000/0 (socket says 172.21.15.60:54000) 2020-10-31T22:50:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d1eb4700 1 -- 172.21.15.60:0/763816563 learned_addr learned my addr 172.21.15.60:0/763816563 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:50:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d16b3700 1 --2- 172.21.15.60:0/763816563 >> v2:172.21.15.66:3300/0 conn(0x7fe7cc13f3d0 0x7fe7cc05c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:59.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d26b5700 1 --2- 172.21.15.60:0/763816563 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7cc0ae630 0x7fe7cc0b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:59.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d0eb2700 1 -- 172.21.15.60:0/763816563 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3635292782 0 0) 0x7fe7cc05c800 con 0x7fe7cc0b1bb0 2020-10-31T22:50:59.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d0eb2700 1 -- 172.21.15.60:0/763816563 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b0003230 con 0x7fe7cc0b1bb0 2020-10-31T22:50:59.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d16b3700 1 -- 172.21.15.60:0/763816563 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7cc0ae630 msgr2=0x7fe7cc0b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:50:59.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d16b3700 1 --2- 172.21.15.60:0/763816563 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7cc0ae630 0x7fe7cc0b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:59.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d16b3700 1 -- 172.21.15.60:0/763816563 >> v1:172.21.15.60:6789/0 conn(0x7fe7cc0b1bb0 legacy=0x7fe7cc13ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:59.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.405+0000 7fe7d16b3700 1 -- 172.21.15.60:0/763816563 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc0ae190 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.409+0000 7fe7d16b3700 1 --2- 172.21.15.60:0/763816563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc13f3d0 0x7fe7cc05c0f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fe7b8002f30 tx=0x7fe7b8006dc0).ready entity=mon.1 client_cookie=6854472448c5afaa server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:59.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.409+0000 7fe7d0eb2700 1 -- 172.21.15.60:0/763816563 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b80096a0 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.409+0000 7fe7d0eb2700 1 -- 172.21.15.60:0/763816563 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b8009800 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.409+0000 7fe7d0eb2700 1 -- 172.21.15.60:0/763816563 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b8009b60 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.409+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/763816563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc13f3d0 msgr2=0x7fe7cc05c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:59.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.409+0000 7fe7d2eb6700 1 --2- 172.21.15.60:0/763816563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc13f3d0 0x7fe7cc05c0f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7fe7b8002f30 tx=0x7fe7b8006dc0).stop 2020-10-31T22:50:59.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.409+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/763816563 shutdown_connections 2020-10-31T22:50:59.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.409+0000 7fe7d2eb6700 1 --2- 172.21.15.60:0/763816563 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7cc0ae630 0x7fe7cc0b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:59.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.409+0000 7fe7d2eb6700 1 --2- 172.21.15.60:0/763816563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc13f3d0 0x7fe7cc05c0f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:59.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.409+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/763816563 >> 172.21.15.60:0/763816563 conn(0x7fe7cc0b5300 msgr2=0x7fe7cc0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:50:59.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.409+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/763816563 shutdown_connections 2020-10-31T22:50:59.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.409+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/763816563 wait complete. 2020-10-31T22:50:59.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.409+0000 7fe7d2eb6700 1 Processor -- start 2020-10-31T22:50:59.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d2eb6700 1 -- start start 2020-10-31T22:50:59.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d2eb6700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc0b1bb0 0x7fe7cc05b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:59.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d2eb6700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7cc13f3d0 0x7fe7cc14f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:59.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d2eb6700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7cc09fc50 0x7fe7cc09eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:59.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d2eb6700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc133850 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d2eb6700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc14f710 con 0x7fe7cc0b1bb0 2020-10-31T22:50:59.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d16b3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7cc13f3d0 0x7fe7cc14f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:59.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d2eb6700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7cc0a1380 con 0x7fe7cc09fc50 2020-10-31T22:50:59.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d1eb4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc0b1bb0 0x7fe7cc05b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:59.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d16b3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7cc13f3d0 0x7fe7cc14f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49872/0 (socket says 172.21.15.60:49872) 2020-10-31T22:50:59.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d16b3700 1 -- 172.21.15.60:0/4116086052 learned_addr learned my addr 172.21.15.60:0/4116086052 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:50:59.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d26b5700 1 --2- 172.21.15.60:0/4116086052 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7cc09fc50 0x7fe7cc09eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:59.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d16b3700 1 -- 172.21.15.60:0/4116086052 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7cc09fc50 msgr2=0x7fe7cc09eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:59.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d16b3700 1 --2- 172.21.15.60:0/4116086052 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7cc09fc50 0x7fe7cc09eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:59.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d16b3700 1 -- 172.21.15.60:0/4116086052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc0b1bb0 msgr2=0x7fe7cc05b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:50:59.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d16b3700 1 --2- 172.21.15.60:0/4116086052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc0b1bb0 0x7fe7cc05b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:50:59.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d16b3700 1 -- 172.21.15.60:0/4116086052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc0a1620 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d16b3700 1 --2- 172.21.15.60:0/4116086052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7cc13f3d0 0x7fe7cc14f220 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7fe7b8002f30 tx=0x7fe7b8015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:59.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7caffd700 1 -- 172.21.15.60:0/4116086052 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b8011c30 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7caffd700 1 -- 172.21.15.60:0/4116086052 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7b8011d90 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7caffd700 1 -- 172.21.15.60:0/4116086052 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe7b801d640 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/4116086052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7cc0a18c0 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.413+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/4116086052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7cc09f390 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.417+0000 7fe7caffd700 1 -- 172.21.15.60:0/4116086052 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe7b8024030 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.417+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/4116086052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7cc057100 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.417+0000 7fe7caffd700 1 --2- 172.21.15.60:0/4116086052 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7b4055020 0x7fe7b40574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:50:59.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.417+0000 7fe7caffd700 1 -- 172.21.15.60:0/4116086052 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe7b806eb90 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.417+0000 7fe7d1eb4700 1 --2- 172.21.15.60:0/4116086052 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7b4055020 0x7fe7b40574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:50:59.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.417+0000 7fe7d1eb4700 1 --2- 172.21.15.60:0/4116086052 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7b4055020 0x7fe7b40574e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fe7c000d000 tx=0x7fe7c0007cf0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:50:59.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.425+0000 7fe7caffd700 1 -- 172.21.15.60:0/4116086052 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe7b80450f0 con 0x7fe7cc13f3d0 2020-10-31T22:50:59.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:50:59.617+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/4116086052 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe7cc0b10c0 con 0x7fe7cc13f3d0 2020-10-31T22:51:00.045 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:51:00.041+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:51:00.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.049+0000 7fe7caffd700 1 -- 172.21.15.60:0/4116086052 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v77) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe7b8022070 con 0x7fe7cc13f3d0 2020-10-31T22:51:00.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.053+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/4116086052 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7b4055020 msgr2=0x7fe7b40574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:00.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.053+0000 7fe7d2eb6700 1 --2- 172.21.15.60:0/4116086052 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7b4055020 0x7fe7b40574e0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fe7c000d000 tx=0x7fe7c0007cf0).stop 2020-10-31T22:51:00.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.053+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/4116086052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7cc13f3d0 msgr2=0x7fe7cc14f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:00.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.053+0000 7fe7d2eb6700 1 --2- 172.21.15.60:0/4116086052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7cc13f3d0 0x7fe7cc14f220 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 rx=0x7fe7b8002f30 tx=0x7fe7b8015000).stop 2020-10-31T22:51:00.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.053+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/4116086052 shutdown_connections 2020-10-31T22:51:00.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.053+0000 7fe7d2eb6700 1 --2- 172.21.15.60:0/4116086052 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe7cc09fc50 0x7fe7cc09eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.053+0000 7fe7d2eb6700 1 --2- 172.21.15.60:0/4116086052 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe7b4055020 0x7fe7b40574e0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.053+0000 7fe7d2eb6700 1 --2- 172.21.15.60:0/4116086052 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe7cc0b1bb0 0x7fe7cc05b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.053+0000 7fe7d2eb6700 1 --2- 172.21.15.60:0/4116086052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7cc13f3d0 0x7fe7cc14f220 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.053+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/4116086052 >> 172.21.15.60:0/4116086052 conn(0x7fe7cc0b5300 msgr2=0x7fe7cc0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:00.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.053+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/4116086052 shutdown_connections 2020-10-31T22:51:00.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.053+0000 7fe7d2eb6700 1 -- 172.21.15.60:0/4116086052 wait complete. 2020-10-31T22:51:00.060 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-10-31T22:51:00.074 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:51:00.076 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:51:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c2b61700 1 Processor -- start 2020-10-31T22:51:00.185 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c2b61700 1 -- start start 2020-10-31T22:51:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c2b61700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f60bc0b0000 0x7f60bc141d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c2b61700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60bc0b2130 con 0x7f60bc0b1d50 2020-10-31T22:51:00.186 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c2b61700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60bc0af380 con 0x7f60bc0b0950 2020-10-31T22:51:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c2b61700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60bc13fab0 con 0x7f60bc0b0000 2020-10-31T22:51:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c135e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f60bc0b0000 0x7f60bc141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c1b5f700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f60bc0b1d50 0x7f60bc05afe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54026/0 (socket says 172.21.15.60:54026) 2020-10-31T22:51:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c135e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f60bc0b0000 0x7f60bc141d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49892/0 (socket says 172.21.15.60:49892) 2020-10-31T22:51:00.187 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c1b5f700 1 -- 172.21.15.60:0/866299126 learned_addr learned my addr 172.21.15.60:0/866299126 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c135e700 1 -- 172.21.15.60:0/866299126 >> v1:172.21.15.66:6789/0 conn(0x7f60bc0b0950 legacy=0x7f60bc05bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c135e700 1 -- 172.21.15.60:0/866299126 >> v1:172.21.15.60:6789/0 conn(0x7f60bc0b1d50 legacy=0x7f60bc05afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c0b5d700 1 -- 172.21.15.60:0/866299126 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3633542158 0 0) 0x7f60bc0b2130 con 0x7f60bc0b1d50 2020-10-31T22:51:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c135e700 1 -- 172.21.15.60:0/866299126 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc0af620 con 0x7f60bc0b0000 2020-10-31T22:51:00.189 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c135e700 1 --2- 172.21.15.60:0/866299126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60bc0b0000 0x7f60bc141d80 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f60b0002f30 tx=0x7f60b0006dc0).ready entity=mon.0 client_cookie=f2db56577099870a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c0b5d700 1 -- 172.21.15.60:0/866299126 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60b00097f0 con 0x7f60bc0b0000 2020-10-31T22:51:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c0b5d700 1 -- 172.21.15.60:0/866299126 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b0009950 con 0x7f60bc0b0000 2020-10-31T22:51:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c0b5d700 1 -- 172.21.15.60:0/866299126 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60b0009cb0 con 0x7f60bc0b0000 2020-10-31T22:51:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c2b61700 1 -- 172.21.15.60:0/866299126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60bc0b0000 msgr2=0x7f60bc141d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.181+0000 7f60c2b61700 1 --2- 172.21.15.60:0/866299126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60bc0b0000 0x7f60bc141d80 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 rx=0x7f60b0002f30 tx=0x7f60b0006dc0).stop 2020-10-31T22:51:00.190 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c2b61700 1 -- 172.21.15.60:0/866299126 shutdown_connections 2020-10-31T22:51:00.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c2b61700 1 --2- 172.21.15.60:0/866299126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60bc0b0000 0x7f60bc141d80 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c2b61700 1 -- 172.21.15.60:0/866299126 >> 172.21.15.60:0/866299126 conn(0x7f60bc0b5300 msgr2=0x7f60bc0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:00.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c2b61700 1 -- 172.21.15.60:0/866299126 shutdown_connections 2020-10-31T22:51:00.191 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c2b61700 1 -- 172.21.15.60:0/866299126 wait complete. 2020-10-31T22:51:00.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c2b61700 1 Processor -- start 2020-10-31T22:51:00.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c2b61700 1 -- start start 2020-10-31T22:51:00.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c2b61700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60bc0b0000 0x7f60bc0a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:00.193 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c2b61700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60bc0b0950 0x7f60bc0ae270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:00.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c2b61700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60bc0b1d50 0x7f60bc151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:00.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c2b61700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0aaa10 con 0x7f60bc0b0000 2020-10-31T22:51:00.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c2b61700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0ab3c0 con 0x7f60bc0b0950 2020-10-31T22:51:00.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c2b61700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60bc0ab660 con 0x7f60bc0b1d50 2020-10-31T22:51:00.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c1b5f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60bc0b0000 0x7f60bc0a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:00.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c1b5f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60bc0b0000 0x7f60bc0a8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49896/0 (socket says 172.21.15.60:49896) 2020-10-31T22:51:00.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c1b5f700 1 -- 172.21.15.60:0/1995588773 learned_addr learned my addr 172.21.15.60:0/1995588773 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:00.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c135e700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60bc0b0950 0x7f60bc0ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:00.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.185+0000 7f60c2360700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60bc0b1d50 0x7f60bc151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:00.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.189+0000 7f60c135e700 1 -- 172.21.15.60:0/1995588773 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60bc0b1d50 msgr2=0x7f60bc151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:00.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.189+0000 7f60c135e700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60bc0b1d50 0x7f60bc151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.189+0000 7f60c135e700 1 -- 172.21.15.60:0/1995588773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60bc0b0000 msgr2=0x7f60bc0a8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:00.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.189+0000 7f60c135e700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60bc0b0000 0x7f60bc0a8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.189+0000 7f60c135e700 1 -- 172.21.15.60:0/1995588773 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60bc150df0 con 0x7f60bc0b0950 2020-10-31T22:51:00.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.189+0000 7f60c1b5f700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60bc0b0000 0x7f60bc0a8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:00.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.189+0000 7f60c135e700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60bc0b0950 0x7f60bc0ae270 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f60b0002f30 tx=0x7f60b0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:00.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.189+0000 7f60aeffd700 1 -- 172.21.15.60:0/1995588773 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60b0011e30 con 0x7f60bc0b0950 2020-10-31T22:51:00.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.189+0000 7f60aeffd700 1 -- 172.21.15.60:0/1995588773 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b001d450 con 0x7f60bc0b0950 2020-10-31T22:51:00.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.189+0000 7f60c2b61700 1 -- 172.21.15.60:0/1995588773 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60bc150ae0 con 0x7f60bc0b0950 2020-10-31T22:51:00.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.189+0000 7f60aeffd700 1 -- 172.21.15.60:0/1995588773 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60b001d7b0 con 0x7f60bc0b0950 2020-10-31T22:51:00.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.189+0000 7f60c2b61700 1 -- 172.21.15.60:0/1995588773 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60bc145280 con 0x7f60bc0b0950 2020-10-31T22:51:00.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.189+0000 7f60c2b61700 1 -- 172.21.15.60:0/1995588773 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60bc057100 con 0x7f60bc0b0950 2020-10-31T22:51:00.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.189+0000 7f60aeffd700 1 -- 172.21.15.60:0/1995588773 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f60b0024030 con 0x7f60bc0b0950 2020-10-31T22:51:00.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.193+0000 7f60aeffd700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f609c054f10 0x7f609c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:00.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.193+0000 7f60aeffd700 1 -- 172.21.15.60:0/1995588773 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f60b006ed10 con 0x7f60bc0b0950 2020-10-31T22:51:00.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.193+0000 7f60c1b5f700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f609c054f10 0x7f609c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:00.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.193+0000 7f60c1b5f700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f609c054f10 0x7f609c0573d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f60b800d000 tx=0x7f60b8009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:00.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.201+0000 7f60aeffd700 1 -- 172.21.15.60:0/1995588773 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f60b00451e0 con 0x7f60bc0b0950 2020-10-31T22:51:00.393 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.389+0000 7f60c2b61700 1 -- 172.21.15.60:0/1995588773 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60bc0a8bf0 con 0x7f60bc0b0950 2020-10-31T22:51:00.394 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.389+0000 7f60aeffd700 1 -- 172.21.15.60:0/1995588773 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) v1 ==== 94+0+2135 (secure 0 0 0) 0x7f60b0022070 con 0x7f60bc0b0950 2020-10-31T22:51:00.394 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:00.395 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":77,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7085,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/2329273308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":2329273308},{"type":"v1","addr":"172.21.15.66:6833","nonce":2329273308}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":73},{"gid":8229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.60:6835/4086841612","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":4086841612},{"type":"v1","addr":"172.21.15.60:6835","nonce":4086841612}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":74}],"filesystems":[{"mdsmap":{"epoch":77,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:50:45.331860+0000","modified":"2020-10-31T22:51:00.045574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":150,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[28],"metadata_pool":27,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2020-10-31T22:51:00.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.393+0000 7f60c2b61700 1 -- 172.21.15.60:0/1995588773 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f609c054f10 msgr2=0x7f609c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:00.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.393+0000 7f60c2b61700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f609c054f10 0x7f609c0573d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7f60b800d000 tx=0x7f60b8009040).stop 2020-10-31T22:51:00.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.393+0000 7f60c2b61700 1 -- 172.21.15.60:0/1995588773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60bc0b0950 msgr2=0x7f60bc0ae270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:00.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.393+0000 7f60c2b61700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60bc0b0950 0x7f60bc0ae270 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f60b0002f30 tx=0x7f60b0015000).stop 2020-10-31T22:51:00.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.393+0000 7f60c2b61700 1 -- 172.21.15.60:0/1995588773 shutdown_connections 2020-10-31T22:51:00.398 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.393+0000 7f60c2b61700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60bc0b1d50 0x7f60bc151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.393+0000 7f60c2b61700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f60bc0b0000 0x7f60bc0a8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.393+0000 7f60c2b61700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f609c054f10 0x7f609c0573d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.393+0000 7f60c2b61700 1 --2- 172.21.15.60:0/1995588773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60bc0b0950 0x7f60bc0ae270 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.393+0000 7f60c2b61700 1 -- 172.21.15.60:0/1995588773 >> 172.21.15.60:0/1995588773 conn(0x7f60bc0b5300 msgr2=0x7f60bc13fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:00.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.393+0000 7f60c2b61700 1 -- 172.21.15.60:0/1995588773 shutdown_connections 2020-10-31T22:51:00.399 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.393+0000 7f60c2b61700 1 -- 172.21.15.60:0/1995588773 wait complete. 2020-10-31T22:51:00.400 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 77 2020-10-31T22:51:00.413 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:51:00.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9af59e700 1 Processor -- start 2020-10-31T22:51:00.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9af59e700 1 -- start start 2020-10-31T22:51:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9af59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9b005b320 0x7fb9b00b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9af59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb9b0140420 0x7fb9b00b2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9af59e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9b005b700 con 0x7fb9b00acc80 2020-10-31T22:51:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9af59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9b00b2830 con 0x7fb9b0140420 2020-10-31T22:51:00.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9af59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b01408a0 con 0x7fb9b005b320 2020-10-31T22:51:00.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9a5d9b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb9b0140420 0x7fb9b00b2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:00.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9ae59c700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9b005b320 0x7fb9b00b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:00.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9a5d9b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb9b0140420 0x7fb9b00b2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:60842/0 (socket says 172.21.15.60:60842) 2020-10-31T22:51:00.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9aed9d700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fb9b00acc80 0x7fb9b00ad7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:51912/0 (socket says 172.21.15.60:51912) 2020-10-31T22:51:00.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9a5d9b700 1 -- 172.21.15.60:0/3513195905 learned_addr learned my addr 172.21.15.60:0/3513195905 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:00.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9a5d9b700 1 -- 172.21.15.60:0/3513195905 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9b005b320 msgr2=0x7fb9b00b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:00.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9a5d9b700 1 --2- 172.21.15.60:0/3513195905 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9b005b320 0x7fb9b00b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9a5d9b700 1 -- 172.21.15.60:0/3513195905 >> v1:172.21.15.66:6789/0 conn(0x7fb9b00acc80 legacy=0x7fb9b00ad7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:00.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9a5d9b700 1 -- 172.21.15.60:0/3513195905 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b00b0220 con 0x7fb9b0140420 2020-10-31T22:51:00.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9add9b700 1 -- 172.21.15.60:0/3513195905 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855650592 0 0) 0x7fb9b005b700 con 0x7fb9b00acc80 2020-10-31T22:51:00.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9a5d9b700 1 --2- 172.21.15.60:0/3513195905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9b0140420 0x7fb9b00b2340 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fb998002f30 tx=0x7fb998006e80).ready entity=mon.1 client_cookie=cfcbb3cecde84c79 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:00.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9add9b700 1 -- 172.21.15.60:0/3513195905 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb9980097f0 con 0x7fb9b0140420 2020-10-31T22:51:00.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9add9b700 1 -- 172.21.15.60:0/3513195905 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb998009950 con 0x7fb9b0140420 2020-10-31T22:51:00.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9add9b700 1 -- 172.21.15.60:0/3513195905 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb998009cb0 con 0x7fb9b0140420 2020-10-31T22:51:00.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9af59e700 1 -- 172.21.15.60:0/3513195905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9b0140420 msgr2=0x7fb9b00b2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:00.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9af59e700 1 --2- 172.21.15.60:0/3513195905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9b0140420 0x7fb9b00b2340 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fb998002f30 tx=0x7fb998006e80).stop 2020-10-31T22:51:00.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.521+0000 7fb9af59e700 1 -- 172.21.15.60:0/3513195905 shutdown_connections 2020-10-31T22:51:00.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9af59e700 1 --2- 172.21.15.60:0/3513195905 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9b005b320 0x7fb9b00b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9af59e700 1 --2- 172.21.15.60:0/3513195905 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9b0140420 0x7fb9b00b2340 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9af59e700 1 -- 172.21.15.60:0/3513195905 >> 172.21.15.60:0/3513195905 conn(0x7fb9b00b61d0 msgr2=0x7fb9b00b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:00.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9af59e700 1 -- 172.21.15.60:0/3513195905 shutdown_connections 2020-10-31T22:51:00.534 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9af59e700 1 -- 172.21.15.60:0/3513195905 wait complete. 2020-10-31T22:51:00.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9af59e700 1 Processor -- start 2020-10-31T22:51:00.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9af59e700 1 -- start start 2020-10-31T22:51:00.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9af59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9b005b320 0x7fb9b013cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:00.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9af59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9b00acc80 0x7fb9b013bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:00.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9af59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9b0140420 0x7fb9b013c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:00.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9af59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0138fb0 con 0x7fb9b00acc80 2020-10-31T22:51:00.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9af59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b0152c40 con 0x7fb9b0140420 2020-10-31T22:51:00.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9af59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b01418d0 con 0x7fb9b005b320 2020-10-31T22:51:00.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9a5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9b00acc80 0x7fb9b013bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:00.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9a5d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9b00acc80 0x7fb9b013bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49912/0 (socket says 172.21.15.60:49912) 2020-10-31T22:51:00.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9a5d9b700 1 -- 172.21.15.60:0/3622705643 learned_addr learned my addr 172.21.15.60:0/3622705643 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:00.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9ae59c700 1 --2- 172.21.15.60:0/3622705643 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9b005b320 0x7fb9b013cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:00.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9aed9d700 1 --2- 172.21.15.60:0/3622705643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9b0140420 0x7fb9b013c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:00.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9a5d9b700 1 -- 172.21.15.60:0/3622705643 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9b005b320 msgr2=0x7fb9b013cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:00.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9a5d9b700 1 --2- 172.21.15.60:0/3622705643 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9b005b320 0x7fb9b013cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9a5d9b700 1 -- 172.21.15.60:0/3622705643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9b0140420 msgr2=0x7fb9b013c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:00.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9a5d9b700 1 --2- 172.21.15.60:0/3622705643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9b0140420 0x7fb9b013c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:00.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9a5d9b700 1 -- 172.21.15.60:0/3622705643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b0141b70 con 0x7fb9b00acc80 2020-10-31T22:51:00.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9a5d9b700 1 --2- 172.21.15.60:0/3622705643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9b00acc80 0x7fb9b013bb70 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fb998002f30 tx=0x7fb998015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:00.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9a7fff700 1 -- 172.21.15.60:0/3622705643 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb998009e60 con 0x7fb9b00acc80 2020-10-31T22:51:00.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9a7fff700 1 -- 172.21.15.60:0/3622705643 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb998009c50 con 0x7fb9b00acc80 2020-10-31T22:51:00.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.525+0000 7fb9af59e700 1 -- 172.21.15.60:0/3622705643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b0152970 con 0x7fb9b00acc80 2020-10-31T22:51:00.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.529+0000 7fb9a7fff700 1 -- 172.21.15.60:0/3622705643 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb99801e650 con 0x7fb9b00acc80 2020-10-31T22:51:00.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.529+0000 7fb9af59e700 1 -- 172.21.15.60:0/3622705643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b013d050 con 0x7fb9b00acc80 2020-10-31T22:51:00.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.529+0000 7fb9af59e700 1 -- 172.21.15.60:0/3622705643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b0141130 con 0x7fb9b00acc80 2020-10-31T22:51:00.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.529+0000 7fb9a7fff700 1 -- 172.21.15.60:0/3622705643 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb998025030 con 0x7fb9b00acc80 2020-10-31T22:51:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.529+0000 7fb9a7fff700 1 --2- 172.21.15.60:0/3622705643 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb994054f10 0x7fb9940573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.529+0000 7fb9ae59c700 1 --2- 172.21.15.60:0/3622705643 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb994054f10 0x7fb9940573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.529+0000 7fb9a7fff700 1 -- 172.21.15.60:0/3622705643 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fb99806ee90 con 0x7fb9b00acc80 2020-10-31T22:51:00.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.529+0000 7fb9ae59c700 1 --2- 172.21.15.60:0/3622705643 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb994054f10 0x7fb9940573d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7fb9a000b000 tx=0x7fb9a0006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:00.542 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.537+0000 7fb9a7fff700 1 -- 172.21.15.60:0/3622705643 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb9b0141130 con 0x7fb9b00acc80 2020-10-31T22:51:00.730 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:00.725+0000 7fb9af59e700 1 -- 172.21.15.60:0/3622705643 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb9b0141130 con 0x7fb9b00acc80 2020-10-31T22:51:01.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.057+0000 7fb9a7fff700 1 -- 172.21.15.60:0/3622705643 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v78) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb9b0141130 con 0x7fb9b00acc80 2020-10-31T22:51:01.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.061+0000 7fb9af59e700 1 -- 172.21.15.60:0/3622705643 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb994054f10 msgr2=0x7fb9940573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.061+0000 7fb9af59e700 1 --2- 172.21.15.60:0/3622705643 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb994054f10 0x7fb9940573d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7fb9a000b000 tx=0x7fb9a0006dc0).stop 2020-10-31T22:51:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.061+0000 7fb9af59e700 1 -- 172.21.15.60:0/3622705643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9b00acc80 msgr2=0x7fb9b013bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:01.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.061+0000 7fb9af59e700 1 --2- 172.21.15.60:0/3622705643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9b00acc80 0x7fb9b013bb70 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 rx=0x7fb998002f30 tx=0x7fb998015000).stop 2020-10-31T22:51:01.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.061+0000 7fb9af59e700 1 -- 172.21.15.60:0/3622705643 shutdown_connections 2020-10-31T22:51:01.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.061+0000 7fb9af59e700 1 --2- 172.21.15.60:0/3622705643 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb994054f10 0x7fb9940573d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:01.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.061+0000 7fb9af59e700 1 --2- 172.21.15.60:0/3622705643 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb9b0140420 0x7fb9b013c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:01.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.061+0000 7fb9af59e700 1 --2- 172.21.15.60:0/3622705643 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb9b005b320 0x7fb9b013cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:01.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.061+0000 7fb9af59e700 1 --2- 172.21.15.60:0/3622705643 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb9b00acc80 0x7fb9b013bb70 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:01.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.061+0000 7fb9af59e700 1 -- 172.21.15.60:0/3622705643 >> 172.21.15.60:0/3622705643 conn(0x7fb9b00b61d0 msgr2=0x7fb9b00ae770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:01.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.061+0000 7fb9af59e700 1 -- 172.21.15.60:0/3622705643 shutdown_connections 2020-10-31T22:51:01.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.061+0000 7fb9af59e700 1 -- 172.21.15.60:0/3622705643 wait complete. 2020-10-31T22:51:01.085 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:51:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.201+0000 7fd87b004700 1 Processor -- start 2020-10-31T22:51:01.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.201+0000 7fd87b004700 1 -- start start 2020-10-31T22:51:01.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87b004700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8740b5570 0x7fd8740b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:01.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87b004700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8740b4440 con 0x7fd8740b24a0 2020-10-31T22:51:01.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87b004700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd874146060 con 0x7fd874141f00 2020-10-31T22:51:01.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87b004700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87413f930 con 0x7fd8740b5570 2020-10-31T22:51:01.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87a002700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fd8740b5570 0x7fd8740b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:01.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd879801700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fd8740b24a0 0x7fd874145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54056/0 (socket says 172.21.15.60:54056) 2020-10-31T22:51:01.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd879801700 1 -- 172.21.15.60:0/3823032555 learned_addr learned my addr 172.21.15.60:0/3823032555 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:01.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd879000700 1 -- 172.21.15.60:0/3823032555 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072737308 0 0) 0x7fd8740b4440 con 0x7fd8740b24a0 2020-10-31T22:51:01.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd879000700 1 -- 172.21.15.60:0/3823032555 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd85c003230 con 0x7fd8740b24a0 2020-10-31T22:51:01.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87a002700 1 -- 172.21.15.60:0/3823032555 >> v1:172.21.15.66:6789/0 conn(0x7fd874141f00 legacy=0x7fd874142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:01.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd879000700 1 -- 172.21.15.60:0/3823032555 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4058858635 0 0) 0x7fd874146060 con 0x7fd874141f00 2020-10-31T22:51:01.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87a002700 1 -- 172.21.15.60:0/3823032555 >> v1:172.21.15.60:6789/0 conn(0x7fd8740b24a0 legacy=0x7fd874145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:01.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87a002700 1 -- 172.21.15.60:0/3823032555 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8740b02f0 con 0x7fd8740b5570 2020-10-31T22:51:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87a002700 1 --2- 172.21.15.60:0/3823032555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8740b5570 0x7fd8740b5950 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7fd864002f30 tx=0x7fd864006dc0).ready entity=mon.0 client_cookie=c3ad588a446e127 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd879000700 1 -- 172.21.15.60:0/3823032555 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd864009800 con 0x7fd8740b5570 2020-10-31T22:51:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd879000700 1 -- 172.21.15.60:0/3823032555 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd864009960 con 0x7fd8740b5570 2020-10-31T22:51:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd879000700 1 -- 172.21.15.60:0/3823032555 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd864009cc0 con 0x7fd8740b5570 2020-10-31T22:51:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87b004700 1 -- 172.21.15.60:0/3823032555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8740b5570 msgr2=0x7fd8740b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87b004700 1 --2- 172.21.15.60:0/3823032555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8740b5570 0x7fd8740b5950 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 rx=0x7fd864002f30 tx=0x7fd864006dc0).stop 2020-10-31T22:51:01.216 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87b004700 1 -- 172.21.15.60:0/3823032555 shutdown_connections 2020-10-31T22:51:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87b004700 1 --2- 172.21.15.60:0/3823032555 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8740b5570 0x7fd8740b5950 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87b004700 1 -- 172.21.15.60:0/3823032555 >> 172.21.15.60:0/3823032555 conn(0x7fd8740b8e90 msgr2=0x7fd8740b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87b004700 1 -- 172.21.15.60:0/3823032555 shutdown_connections 2020-10-31T22:51:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.205+0000 7fd87b004700 1 -- 172.21.15.60:0/3823032555 wait complete. 2020-10-31T22:51:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87b004700 1 Processor -- start 2020-10-31T22:51:01.217 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87b004700 1 -- start start 2020-10-31T22:51:01.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87b004700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8740b24a0 0x7fd8741402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:01.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87b004700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8740b5570 0x7fd874146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:01.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87b004700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd874141f00 0x7fd874146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:01.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87b004700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740adf50 con 0x7fd8740b24a0 2020-10-31T22:51:01.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87b004700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740ae1f0 con 0x7fd874141f00 2020-10-31T22:51:01.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87b004700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8740ae490 con 0x7fd8740b5570 2020-10-31T22:51:01.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87a002700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8740b24a0 0x7fd8741402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:01.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87a002700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8740b24a0 0x7fd8741402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49926/0 (socket says 172.21.15.60:49926) 2020-10-31T22:51:01.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87a002700 1 -- 172.21.15.60:0/844371110 learned_addr learned my addr 172.21.15.60:0/844371110 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:01.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd879801700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8740b5570 0x7fd874146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:01.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87a803700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd874141f00 0x7fd874146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:01.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87a002700 1 -- 172.21.15.60:0/844371110 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8740b5570 msgr2=0x7fd874146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:01.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87a002700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8740b5570 0x7fd874146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:01.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87a002700 1 -- 172.21.15.60:0/844371110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd874141f00 msgr2=0x7fd874146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:01.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87a002700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd874141f00 0x7fd874146a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:01.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87a002700 1 -- 172.21.15.60:0/844371110 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8740ad400 con 0x7fd8740b24a0 2020-10-31T22:51:01.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87a803700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd874141f00 0x7fd874146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:51:01.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87a002700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8740b24a0 0x7fd8741402e0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7fd864002f30 tx=0x7fd864015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:01.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd862ffd700 1 -- 172.21.15.60:0/844371110 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd864011c30 con 0x7fd8740b24a0 2020-10-31T22:51:01.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd862ffd700 1 -- 172.21.15.60:0/844371110 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd864011d90 con 0x7fd8740b24a0 2020-10-31T22:51:01.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87b004700 1 -- 172.21.15.60:0/844371110 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd874154050 con 0x7fd8740b24a0 2020-10-31T22:51:01.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd862ffd700 1 -- 172.21.15.60:0/844371110 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd86401d630 con 0x7fd8740b24a0 2020-10-31T22:51:01.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.209+0000 7fd87b004700 1 -- 172.21.15.60:0/844371110 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8740aecb0 con 0x7fd8740b24a0 2020-10-31T22:51:01.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.213+0000 7fd87b004700 1 -- 172.21.15.60:0/844371110 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd874057100 con 0x7fd8740b24a0 2020-10-31T22:51:01.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.213+0000 7fd862ffd700 1 -- 172.21.15.60:0/844371110 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fd864024030 con 0x7fd8740b24a0 2020-10-31T22:51:01.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.213+0000 7fd862ffd700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd854054f10 0x7fd8540573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:01.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.213+0000 7fd862ffd700 1 -- 172.21.15.60:0/844371110 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fd86406e7e0 con 0x7fd8740b24a0 2020-10-31T22:51:01.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.213+0000 7fd879801700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd854054f10 0x7fd8540573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:01.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.213+0000 7fd879801700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd854054f10 0x7fd8540573d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fd87000d000 tx=0x7fd870009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:01.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.217+0000 7fd862ffd700 1 -- 172.21.15.60:0/844371110 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fd864044cb0 con 0x7fd8740b24a0 2020-10-31T22:51:01.368 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:01.361+0000 7fd87b004700 1 -- 172.21.15.60:0/844371110 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd87405a8e0 con 0x7fd8740b24a0 2020-10-31T22:51:02.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.081+0000 7fd862ffd700 1 -- 172.21.15.60:0/844371110 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v151) v1 ==== 185+0+0 (secure 0 0 0) 0x7fd8640220e0 con 0x7fd8740b24a0 2020-10-31T22:51:02.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.085+0000 7fd87b004700 1 -- 172.21.15.60:0/844371110 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd854054f10 msgr2=0x7fd8540573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:02.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.085+0000 7fd87b004700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd854054f10 0x7fd8540573d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7fd87000d000 tx=0x7fd870009040).stop 2020-10-31T22:51:02.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.085+0000 7fd87b004700 1 -- 172.21.15.60:0/844371110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8740b24a0 msgr2=0x7fd8741402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:02.089 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.085+0000 7fd87b004700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8740b24a0 0x7fd8741402e0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 rx=0x7fd864002f30 tx=0x7fd864015000).stop 2020-10-31T22:51:02.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.085+0000 7fd87b004700 1 -- 172.21.15.60:0/844371110 shutdown_connections 2020-10-31T22:51:02.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.085+0000 7fd87b004700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fd854054f10 0x7fd8540573d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:02.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.085+0000 7fd87b004700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd874141f00 0x7fd874146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:02.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.085+0000 7fd87b004700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd8740b24a0 0x7fd8741402e0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:02.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.085+0000 7fd87b004700 1 --2- 172.21.15.60:0/844371110 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8740b5570 0x7fd874146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:02.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.085+0000 7fd87b004700 1 -- 172.21.15.60:0/844371110 >> 172.21.15.60:0/844371110 conn(0x7fd8740b8e90 msgr2=0x7fd8740b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:02.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.085+0000 7fd87b004700 1 -- 172.21.15.60:0/844371110 shutdown_connections 2020-10-31T22:51:02.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.085+0000 7fd87b004700 1 -- 172.21.15.60:0/844371110 wait complete. 2020-10-31T22:51:02.092 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:51:02.104 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-10-31T22:51:02.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.221+0000 7f2569e97700 1 Processor -- start 2020-10-31T22:51:02.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.221+0000 7f2569e97700 1 -- start start 2020-10-31T22:51:02.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2569e97700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25640b52a0 0x7f25640aca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:02.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2569e97700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f25640ac540 0x7f256413ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:02.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2569e97700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25640ae210 con 0x7f25640b0ac0 2020-10-31T22:51:02.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2569e97700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25640ae4b0 con 0x7f25640ac540 2020-10-31T22:51:02.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2569e97700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25640ae750 con 0x7f25640b52a0 2020-10-31T22:51:02.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2563fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f25640ac540 0x7f256413ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:02.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2563fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f25640ac540 0x7f256413ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49938/0 (socket says 172.21.15.60:49938) 2020-10-31T22:51:02.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2563fff700 1 -- 172.21.15.60:0/1463274533 learned_addr learned my addr 172.21.15.60:0/1463274533 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:02.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f255affd700 1 --1- 172.21.15.60:0/1463274533 >> v1:172.21.15.60:6789/0 conn(0x7f25640b0ac0 0x7f25640abe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54072/0 (socket says 172.21.15.60:54072) 2020-10-31T22:51:02.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f25637fe700 1 --2- 172.21.15.60:0/1463274533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25640b52a0 0x7f25640aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:02.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2563fff700 1 -- 172.21.15.60:0/1463274533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25640b52a0 msgr2=0x7f25640aca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:02.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2563fff700 1 --2- 172.21.15.60:0/1463274533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25640b52a0 0x7f25640aca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:02.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2563fff700 1 -- 172.21.15.60:0/1463274533 >> v1:172.21.15.60:6789/0 conn(0x7f25640b0ac0 legacy=0x7f25640abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:02.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2563fff700 1 -- 172.21.15.60:0/1463274533 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25640ae9f0 con 0x7f25640ac540 2020-10-31T22:51:02.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2562ffd700 1 -- 172.21.15.60:0/1463274533 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412885907 0 0) 0x7f25640ae210 con 0x7f25640b0ac0 2020-10-31T22:51:02.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2563fff700 1 --2- 172.21.15.60:0/1463274533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25640ac540 0x7f256413ea20 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f255c0032b0 tx=0x7f255c009270).ready entity=mon.0 client_cookie=7acddaead6894f24 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:02.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2562ffd700 1 -- 172.21.15.60:0/1463274533 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f255c009e60 con 0x7f25640ac540 2020-10-31T22:51:02.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2562ffd700 1 -- 172.21.15.60:0/1463274533 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c00bc00 con 0x7f25640ac540 2020-10-31T22:51:02.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2562ffd700 1 -- 172.21.15.60:0/1463274533 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f255c00bd70 con 0x7f25640ac540 2020-10-31T22:51:02.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2569e97700 1 -- 172.21.15.60:0/1463274533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25640ac540 msgr2=0x7f256413ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:02.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2569e97700 1 --2- 172.21.15.60:0/1463274533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25640ac540 0x7f256413ea20 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 rx=0x7f255c0032b0 tx=0x7f255c009270).stop 2020-10-31T22:51:02.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2569e97700 1 -- 172.21.15.60:0/1463274533 shutdown_connections 2020-10-31T22:51:02.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2569e97700 1 --2- 172.21.15.60:0/1463274533 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25640ac540 0x7f256413ea20 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:02.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2569e97700 1 --2- 172.21.15.60:0/1463274533 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25640b52a0 0x7f25640aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:02.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2569e97700 1 -- 172.21.15.60:0/1463274533 >> 172.21.15.60:0/1463274533 conn(0x7f2564060c50 msgr2=0x7f25640b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:02.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2569e97700 1 -- 172.21.15.60:0/1463274533 shutdown_connections 2020-10-31T22:51:02.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.225+0000 7f2569e97700 1 -- 172.21.15.60:0/1463274533 wait complete. 2020-10-31T22:51:02.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.229+0000 7f2569e97700 1 Processor -- start 2020-10-31T22:51:02.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.229+0000 7f2569e97700 1 -- start start 2020-10-31T22:51:02.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.229+0000 7f2569e97700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25640ac540 0x7f256414ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:02.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.229+0000 7f2569e97700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25640b0ac0 0x7f256405b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:02.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.229+0000 7f2569e97700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25640b52a0 0x7f2564152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:02.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.229+0000 7f2569e97700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2564152040 con 0x7f25640ac540 2020-10-31T22:51:02.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.229+0000 7f2569e97700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2564066750 con 0x7f25640b0ac0 2020-10-31T22:51:02.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.229+0000 7f2569e97700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25640669f0 con 0x7f25640b52a0 2020-10-31T22:51:02.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.229+0000 7f25637fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25640ac540 0x7f256414ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.229+0000 7f25637fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25640ac540 0x7f256414ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49940/0 (socket says 172.21.15.60:49940) 2020-10-31T22:51:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.229+0000 7f25637fe700 1 -- 172.21.15.60:0/1504174463 learned_addr learned my addr 172.21.15.60:0/1504174463 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.229+0000 7f2563fff700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25640b52a0 0x7f2564152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.229+0000 7f255affd700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25640b0ac0 0x7f256405b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.229+0000 7f2563fff700 1 -- 172.21.15.60:0/1504174463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25640b0ac0 msgr2=0x7f256405b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:02.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f2563fff700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25640b0ac0 0x7f256405b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f2563fff700 1 -- 172.21.15.60:0/1504174463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25640ac540 msgr2=0x7f256414ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f2563fff700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25640ac540 0x7f256414ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f2563fff700 1 -- 172.21.15.60:0/1504174463 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2564152270 con 0x7f25640b52a0 2020-10-31T22:51:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f25637fe700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25640ac540 0x7f256414ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f2563fff700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25640b52a0 0x7f2564152710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f255c0032b0 tx=0x7f255c016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f25617fa700 1 -- 172.21.15.60:0/1504174463 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f255c022070 con 0x7f25640b52a0 2020-10-31T22:51:02.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f25617fa700 1 -- 172.21.15.60:0/1504174463 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c01e610 con 0x7f25640b52a0 2020-10-31T22:51:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f2569e97700 1 -- 172.21.15.60:0/1504174463 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25640a0ed0 con 0x7f25640b52a0 2020-10-31T22:51:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f25617fa700 1 -- 172.21.15.60:0/1504174463 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f255c01e970 con 0x7f25640b52a0 2020-10-31T22:51:02.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f2569e97700 1 -- 172.21.15.60:0/1504174463 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2564065cc0 con 0x7f25640b52a0 2020-10-31T22:51:02.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f2569e97700 1 -- 172.21.15.60:0/1504174463 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2564057100 con 0x7f25640b52a0 2020-10-31T22:51:02.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f25617fa700 1 -- 172.21.15.60:0/1504174463 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f255c00f070 con 0x7f25640b52a0 2020-10-31T22:51:02.248 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f25617fa700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2548055020 0x7f25480574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:02.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f25617fa700 1 -- 172.21.15.60:0/1504174463 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5721+0+0 (secure 0 0 0) 0x7f255c06e8d0 con 0x7f25640b52a0 2020-10-31T22:51:02.249 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.233+0000 7f25637fe700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2548055020 0x7f25480574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:02.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.237+0000 7f25637fe700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2548055020 0x7f25480574e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f255400b000 tx=0x7f2554006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:02.250 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.245+0000 7f25617fa700 1 -- 172.21.15.60:0/1504174463 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f255c044eb0 con 0x7f25640b52a0 2020-10-31T22:51:02.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:02.393+0000 7f2569e97700 1 -- 172.21.15.60:0/1504174463 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2564066b30 con 0x7f25640b52a0 2020-10-31T22:51:03.087 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.081+0000 7f25617fa700 1 -- 172.21.15.60:0/1504174463 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v152) v1 ==== 173+0+0 (secure 0 0 0) 0x7f255c015070 con 0x7f25640b52a0 2020-10-31T22:51:03.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.085+0000 7f2569e97700 1 -- 172.21.15.60:0/1504174463 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2548055020 msgr2=0x7f25480574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:03.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.085+0000 7f2569e97700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2548055020 0x7f25480574e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f255400b000 tx=0x7f2554006dc0).stop 2020-10-31T22:51:03.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.085+0000 7f2569e97700 1 -- 172.21.15.60:0/1504174463 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25640b52a0 msgr2=0x7f2564152710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:03.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.085+0000 7f2569e97700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25640b52a0 0x7f2564152710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f255c0032b0 tx=0x7f255c016000).stop 2020-10-31T22:51:03.091 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.085+0000 7f2569e97700 1 -- 172.21.15.60:0/1504174463 shutdown_connections 2020-10-31T22:51:03.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.085+0000 7f2569e97700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25640b52a0 0x7f2564152710 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:03.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.085+0000 7f2569e97700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25640ac540 0x7f256414ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:03.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.085+0000 7f2569e97700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2548055020 0x7f25480574e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:03.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.085+0000 7f2569e97700 1 --2- 172.21.15.60:0/1504174463 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25640b0ac0 0x7f256405b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:03.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.085+0000 7f2569e97700 1 -- 172.21.15.60:0/1504174463 >> 172.21.15.60:0/1504174463 conn(0x7f2564060c50 msgr2=0x7f256413fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:03.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.089+0000 7f2569e97700 1 -- 172.21.15.60:0/1504174463 shutdown_connections 2020-10-31T22:51:03.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.089+0000 7f2569e97700 1 -- 172.21.15.60:0/1504174463 wait complete. 2020-10-31T22:51:03.094 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2020-10-31T22:51:03.106 INFO:tasks.ceph.mds.a:Restarting daemon 2020-10-31T22:51:03.106 INFO:tasks.ceph.mds.a:Stopping old one... 2020-10-31T22:51:03.107 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2020-10-31T22:51:03.107 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:51:03.107 INFO:tasks.ceph.mds.c:Restarting daemon 2020-10-31T22:51:03.107 INFO:tasks.ceph.mds.c:Stopping old one... 2020-10-31T22:51:03.108 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2020-10-31T22:51:03.108 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:51:03.108 INFO:tasks.ceph.mds.b:Restarting daemon 2020-10-31T22:51:03.108 INFO:tasks.ceph.mds.b:Stopping old one... 2020-10-31T22:51:03.109 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2020-10-31T22:51:03.109 INFO:teuthology.orchestra.run:waiting for 300 2020-10-31T22:51:03.117 INFO:tasks.ceph.mds.a:Stopped 2020-10-31T22:51:03.117 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-10-31T22:51:03.119 INFO:tasks.ceph.mds.c:Stopped 2020-10-31T22:51:03.119 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-10-31T22:51:03.123 INFO:tasks.ceph.mds.b:Stopped 2020-10-31T22:51:03.124 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-10-31T22:51:03.161 INFO:tasks.ceph.mds.a:Started 2020-10-31T22:51:03.162 DEBUG:teuthology.parallel:result is None 2020-10-31T22:51:03.163 INFO:tasks.ceph.mds.c:Started 2020-10-31T22:51:03.163 DEBUG:teuthology.parallel:result is None 2020-10-31T22:51:03.166 INFO:tasks.ceph.mds.b:Started 2020-10-31T22:51:03.167 DEBUG:teuthology.parallel:result is None 2020-10-31T22:51:03.167 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd blacklist clear 2020-10-31T22:51:03.232 INFO:tasks.ceph.mds.a.smithi060.stdout:starting mds.a at 2020-10-31T22:51:03.241 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:51:03.242 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-10-31T22:51:03.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f981dcfa700 1 Processor -- start 2020-10-31T22:51:03.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f981dcfa700 1 -- start start 2020-10-31T22:51:03.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f981dcfa700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98180ac870 0x7f98180b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:03.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f981dcfa700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98180b0e20 0x7f98180ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:03.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f981dcfa700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98180acc50 con 0x7f98180ae690 2020-10-31T22:51:03.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f981dcfa700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98180b14c0 con 0x7f98180b0e20 2020-10-31T22:51:03.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f981dcfa700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98180b5690 con 0x7f98180ac870 2020-10-31T22:51:03.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f9817fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98180b0e20 0x7f98180ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:03.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f9817fff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f98180b0e20 0x7f98180ae1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49974/0 (socket says 172.21.15.60:49974) 2020-10-31T22:51:03.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f981d4f9700 1 --1- 172.21.15.60:0/3941824809 >> v1:172.21.15.60:6789/0 conn(0x7f98180ae690 0x7f98181412e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54112/0 (socket says 172.21.15.60:54112) 2020-10-31T22:51:03.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f9817fff700 1 -- 172.21.15.60:0/3941824809 learned_addr learned my addr 172.21.15.60:0/3941824809 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:03.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f981ccf8700 1 --2- 172.21.15.60:0/3941824809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98180ac870 0x7f98180b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:03.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f9817fff700 1 -- 172.21.15.60:0/3941824809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98180ac870 msgr2=0x7f98180b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:03.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f9817fff700 1 --2- 172.21.15.60:0/3941824809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98180ac870 0x7f98180b5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:03.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f9817fff700 1 -- 172.21.15.60:0/3941824809 >> v1:172.21.15.60:6789/0 conn(0x7f98180ae690 legacy=0x7f98181412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:03.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f9817fff700 1 -- 172.21.15.60:0/3941824809 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98180afc10 con 0x7f98180b0e20 2020-10-31T22:51:03.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f98177fe700 1 -- 172.21.15.60:0/3941824809 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787483617 0 0) 0x7f98180acc50 con 0x7f98180ae690 2020-10-31T22:51:03.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f9817fff700 1 --2- 172.21.15.60:0/3941824809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98180b0e20 0x7f98180ae1a0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f9804002f30 tx=0x7f9804006e80).ready entity=mon.0 client_cookie=84155da69d1b98a8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:03.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.281+0000 7f98177fe700 1 -- 172.21.15.60:0/3941824809 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9804009880 con 0x7f98180b0e20 2020-10-31T22:51:03.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.285+0000 7f98177fe700 1 -- 172.21.15.60:0/3941824809 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98040099e0 con 0x7f98180b0e20 2020-10-31T22:51:03.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.285+0000 7f98177fe700 1 -- 172.21.15.60:0/3941824809 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9804009d40 con 0x7f98180b0e20 2020-10-31T22:51:03.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.285+0000 7f981dcfa700 1 -- 172.21.15.60:0/3941824809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98180b0e20 msgr2=0x7f98180ae1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:03.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.285+0000 7f981dcfa700 1 --2- 172.21.15.60:0/3941824809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98180b0e20 0x7f98180ae1a0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 rx=0x7f9804002f30 tx=0x7f9804006e80).stop 2020-10-31T22:51:03.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.285+0000 7f981dcfa700 1 -- 172.21.15.60:0/3941824809 shutdown_connections 2020-10-31T22:51:03.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.285+0000 7f981dcfa700 1 --2- 172.21.15.60:0/3941824809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98180ac870 0x7f98180b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:03.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.285+0000 7f981dcfa700 1 --2- 172.21.15.60:0/3941824809 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98180b0e20 0x7f98180ae1a0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:03.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.285+0000 7f981dcfa700 1 -- 172.21.15.60:0/3941824809 >> 172.21.15.60:0/3941824809 conn(0x7f981806a600 msgr2=0x7f9818060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:03.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.285+0000 7f981dcfa700 1 -- 172.21.15.60:0/3941824809 shutdown_connections 2020-10-31T22:51:03.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.285+0000 7f981dcfa700 1 -- 172.21.15.60:0/3941824809 wait complete. 2020-10-31T22:51:03.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.285+0000 7f981dcfa700 1 Processor -- start 2020-10-31T22:51:03.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.285+0000 7f981dcfa700 1 -- start start 2020-10-31T22:51:03.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981dcfa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98180ac870 0x7f9818144760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:03.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981dcfa700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98180ae690 0x7f981814d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:03.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981dcfa700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98180b0e20 0x7f9818066700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:03.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981dcfa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98180662d0 con 0x7f98180ac870 2020-10-31T22:51:03.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981dcfa700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9818064e20 con 0x7f98180b0e20 2020-10-31T22:51:03.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981dcfa700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98180650c0 con 0x7f98180ae690 2020-10-31T22:51:03.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981ccf8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98180ac870 0x7f9818144760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:03.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981ccf8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98180ac870 0x7f9818144760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49978/0 (socket says 172.21.15.60:49978) 2020-10-31T22:51:03.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981ccf8700 1 -- 172.21.15.60:0/3084249155 learned_addr learned my addr 172.21.15.60:0/3084249155 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:03.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981d4f9700 1 --2- 172.21.15.60:0/3084249155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98180b0e20 0x7f9818066700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:03.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f9817fff700 1 --2- 172.21.15.60:0/3084249155 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98180ae690 0x7f981814d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:03.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981ccf8700 1 -- 172.21.15.60:0/3084249155 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98180ae690 msgr2=0x7f981814d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:03.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981ccf8700 1 --2- 172.21.15.60:0/3084249155 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98180ae690 0x7f981814d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:03.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981ccf8700 1 -- 172.21.15.60:0/3084249155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98180b0e20 msgr2=0x7f9818066700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:03.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981ccf8700 1 --2- 172.21.15.60:0/3084249155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98180b0e20 0x7f9818066700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:03.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981ccf8700 1 -- 172.21.15.60:0/3084249155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9818065360 con 0x7f98180ac870 2020-10-31T22:51:03.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981ccf8700 1 --2- 172.21.15.60:0/3084249155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98180ac870 0x7f9818144760 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f980c00c000 tx=0x7f980c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:03.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f9815ffb700 1 -- 172.21.15.60:0/3084249155 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f980c00ca10 con 0x7f98180ac870 2020-10-31T22:51:03.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f9815ffb700 1 -- 172.21.15.60:0/3084249155 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c00cb70 con 0x7f98180ac870 2020-10-31T22:51:03.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981dcfa700 1 -- 172.21.15.60:0/3084249155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98180aa3d0 con 0x7f98180ac870 2020-10-31T22:51:03.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f9815ffb700 1 -- 172.21.15.60:0/3084249155 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f980c0123f0 con 0x7f98180ac870 2020-10-31T22:51:03.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981dcfa700 1 -- 172.21.15.60:0/3084249155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9818064ab0 con 0x7f98180ac870 2020-10-31T22:51:03.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f9815ffb700 1 -- 172.21.15.60:0/3084249155 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f980c012550 con 0x7f98180ac870 2020-10-31T22:51:03.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f981dcfa700 1 -- 172.21.15.60:0/3084249155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9818066440 con 0x7f98180ac870 2020-10-31T22:51:03.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f9815ffb700 1 --2- 172.21.15.60:0/3084249155 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9800054f30 0x7f98000573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:03.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f9815ffb700 1 -- 172.21.15.60:0/3084249155 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5339+0+0 (secure 0 0 0) 0x7f980c06d9f0 con 0x7f98180ac870 2020-10-31T22:51:03.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.289+0000 7f9817fff700 1 --2- 172.21.15.60:0/3084249155 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9800054f30 0x7f98000573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:03.300 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.293+0000 7f9817fff700 1 --2- 172.21.15.60:0/3084249155 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9800054f30 0x7f98000573f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f980401c000 tx=0x7f9804015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:03.303 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.297+0000 7f9815ffb700 1 -- 172.21.15.60:0/3084249155 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f980c06fe60 con 0x7f98180ac870 2020-10-31T22:51:03.460 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:03.453+0000 7f981dcfa700 1 -- 172.21.15.60:0/3084249155 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd blacklist clear"} v 0) v1 -- 0x7f9818057100 con 0x7f98180ac870 2020-10-31T22:51:04.307 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.301+0000 7f9815ffb700 1 -- 172.21.15.60:0/3084249155 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd blacklist clear"}]=0 removed all blacklist entries v156) v1 ==== 97+0+0 (secure 0 0 0) 0x7f980c044190 con 0x7f98180ac870 2020-10-31T22:51:04.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.305+0000 7f981dcfa700 1 -- 172.21.15.60:0/3084249155 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9800054f30 msgr2=0x7f98000573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.310 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.305+0000 7f981dcfa700 1 --2- 172.21.15.60:0/3084249155 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9800054f30 0x7f98000573f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 rx=0x7f980401c000 tx=0x7f9804015000).stop 2020-10-31T22:51:04.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.305+0000 7f981dcfa700 1 -- 172.21.15.60:0/3084249155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98180ac870 msgr2=0x7f9818144760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.305+0000 7f981dcfa700 1 --2- 172.21.15.60:0/3084249155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98180ac870 0x7f9818144760 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 rx=0x7f980c00c000 tx=0x7f980c006dc0).stop 2020-10-31T22:51:04.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.305+0000 7f981dcfa700 1 -- 172.21.15.60:0/3084249155 shutdown_connections 2020-10-31T22:51:04.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.305+0000 7f981dcfa700 1 --2- 172.21.15.60:0/3084249155 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9800054f30 0x7f98000573f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.305+0000 7f981dcfa700 1 --2- 172.21.15.60:0/3084249155 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f98180b0e20 0x7f9818066700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.311 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.305+0000 7f981dcfa700 1 --2- 172.21.15.60:0/3084249155 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f98180ac870 0x7f9818144760 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.305+0000 7f981dcfa700 1 --2- 172.21.15.60:0/3084249155 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f98180ae690 0x7f981814d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.305+0000 7f981dcfa700 1 -- 172.21.15.60:0/3084249155 >> 172.21.15.60:0/3084249155 conn(0x7f981806a600 msgr2=0x7f98180b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:04.312 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.305+0000 7f981dcfa700 1 -- 172.21.15.60:0/3084249155 shutdown_connections 2020-10-31T22:51:04.313 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.305+0000 7f981dcfa700 1 -- 172.21.15.60:0/3084249155 wait complete. 2020-10-31T22:51:04.313 INFO:teuthology.orchestra.run.smithi060.stderr: removed all blacklist entries 2020-10-31T22:51:04.327 INFO:tasks.cephfs.cephfs_test_case:['0', '1'] 2020-10-31T22:51:04.327 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early auth ls --format=json-pretty 2020-10-31T22:51:04.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1de946700 1 Processor -- start 2020-10-31T22:51:04.446 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1de946700 1 -- start start 2020-10-31T22:51:04.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1de946700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa1d80af520 0x7fa1d80ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:04.450 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1de946700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1d8066c90 0x7fa1d80670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1de946700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d80af900 con 0x7fa1d8146060 2020-10-31T22:51:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1de946700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d80afc10 con 0x7fa1d80af520 2020-10-31T22:51:04.451 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1de946700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d805bb70 con 0x7fa1d8066c90 2020-10-31T22:51:04.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1de145700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa1d8146060 0x7fa1d8149620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54130/0 (socket says 172.21.15.60:54130) 2020-10-31T22:51:04.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1de145700 1 -- 172.21.15.60:0/1990468516 learned_addr learned my addr 172.21.15.60:0/1990468516 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:04.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1dd143700 1 --2- 172.21.15.60:0/1990468516 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1d8066c90 0x7fa1d80670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:04.452 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1dd944700 1 --2- 172.21.15.60:0/1990468516 >> v2:172.21.15.66:3300/0 conn(0x7fa1d80af520 0x7fa1d80ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:04.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1dc942700 1 -- 172.21.15.60:0/1990468516 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2053897683 0 0) 0x7fa1d80af900 con 0x7fa1d8146060 2020-10-31T22:51:04.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1dc942700 1 -- 172.21.15.60:0/1990468516 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1c0003230 con 0x7fa1d8146060 2020-10-31T22:51:04.453 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1dc942700 1 -- 172.21.15.60:0/1990468516 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2308004096 0 0) 0x7fa1c0003230 con 0x7fa1d8146060 2020-10-31T22:51:04.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1dd143700 1 -- 172.21.15.60:0/1990468516 >> v2:172.21.15.66:3300/0 conn(0x7fa1d80af520 msgr2=0x7fa1d80ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:04.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1dd143700 1 --2- 172.21.15.60:0/1990468516 >> v2:172.21.15.66:3300/0 conn(0x7fa1d80af520 0x7fa1d80ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1dd143700 1 -- 172.21.15.60:0/1990468516 >> v1:172.21.15.60:6789/0 conn(0x7fa1d8146060 legacy=0x7fa1d8149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.454 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1dd143700 1 -- 172.21.15.60:0/1990468516 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d80ac130 con 0x7fa1d8066c90 2020-10-31T22:51:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1dd143700 1 --2- 172.21.15.60:0/1990468516 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1d8066c90 0x7fa1d80670f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fa1d0001bf0 tx=0x7fa1d4006dc0).ready entity=mon.2 client_cookie=674171dc56302fc0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:04.456 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1dc942700 1 -- 172.21.15.60:0/1990468516 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1d0001a50 con 0x7fa1d8066c90 2020-10-31T22:51:04.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1dc942700 1 -- 172.21.15.60:0/1990468516 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1d400d570 con 0x7fa1d8066c90 2020-10-31T22:51:04.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.441+0000 7fa1dc942700 1 -- 172.21.15.60:0/1990468516 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1d400d6e0 con 0x7fa1d8066c90 2020-10-31T22:51:04.457 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.445+0000 7fa1de946700 1 -- 172.21.15.60:0/1990468516 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1d8066c90 msgr2=0x7fa1d80670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.445+0000 7fa1de946700 1 --2- 172.21.15.60:0/1990468516 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1d8066c90 0x7fa1d80670f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fa1d0001bf0 tx=0x7fa1d4006dc0).stop 2020-10-31T22:51:04.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.445+0000 7fa1de946700 1 -- 172.21.15.60:0/1990468516 shutdown_connections 2020-10-31T22:51:04.458 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.445+0000 7fa1de946700 1 --2- 172.21.15.60:0/1990468516 >> v2:172.21.15.66:3300/0 conn(0x7fa1d80af520 0x7fa1d80ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.445+0000 7fa1de946700 1 --2- 172.21.15.60:0/1990468516 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1d8066c90 0x7fa1d80670f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.445+0000 7fa1de946700 1 -- 172.21.15.60:0/1990468516 >> 172.21.15.60:0/1990468516 conn(0x7fa1d80b3fd0 msgr2=0x7fa1d80b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:04.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.445+0000 7fa1de946700 1 -- 172.21.15.60:0/1990468516 shutdown_connections 2020-10-31T22:51:04.459 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.445+0000 7fa1de946700 1 -- 172.21.15.60:0/1990468516 wait complete. 2020-10-31T22:51:04.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.445+0000 7fa1de946700 1 Processor -- start 2020-10-31T22:51:04.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.445+0000 7fa1de946700 1 -- start start 2020-10-31T22:51:04.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1de946700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d8066c90 0x7fa1d814b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:04.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1de946700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1d80af520 0x7fa1d8149c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:04.462 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1de946700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1d8146060 0x7fa1d814a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:04.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1de946700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d8061b40 con 0x7fa1d8066c90 2020-10-31T22:51:04.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1de946700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d8148d70 con 0x7fa1d80af520 2020-10-31T22:51:04.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1de946700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d8149200 con 0x7fa1d8146060 2020-10-31T22:51:04.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1dd944700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d8066c90 0x7fa1d814b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:04.463 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1dd944700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d8066c90 0x7fa1d814b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:49996/0 (socket says 172.21.15.60:49996) 2020-10-31T22:51:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1dd944700 1 -- 172.21.15.60:0/3807005633 learned_addr learned my addr 172.21.15.60:0/3807005633 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1dd143700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1d80af520 0x7fa1d8149c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1de145700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1d8146060 0x7fa1d814a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1dd944700 1 -- 172.21.15.60:0/3807005633 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1d8146060 msgr2=0x7fa1d814a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1dd944700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1d8146060 0x7fa1d814a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1dd944700 1 -- 172.21.15.60:0/3807005633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1d80af520 msgr2=0x7fa1d8149c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.464 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1dd944700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1d80af520 0x7fa1d8149c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1dd944700 1 -- 172.21.15.60:0/3807005633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d8061600 con 0x7fa1d8066c90 2020-10-31T22:51:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1dd143700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1d80af520 0x7fa1d8149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:51:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1dd944700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d8066c90 0x7fa1d814b9c0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fa1c800c000 tx=0x7fa1c8006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1c6ffd700 1 -- 172.21.15.60:0/3807005633 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1c800ca80 con 0x7fa1d8066c90 2020-10-31T22:51:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1c6ffd700 1 -- 172.21.15.60:0/3807005633 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c800cbe0 con 0x7fa1d8066c90 2020-10-31T22:51:04.465 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1de946700 1 -- 172.21.15.60:0/3807005633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d8148f60 con 0x7fa1d8066c90 2020-10-31T22:51:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1c6ffd700 1 -- 172.21.15.60:0/3807005633 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1c80123f0 con 0x7fa1d8066c90 2020-10-31T22:51:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.449+0000 7fa1de946700 1 -- 172.21.15.60:0/3807005633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d80ad9e0 con 0x7fa1d8066c90 2020-10-31T22:51:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.453+0000 7fa1de946700 1 -- 172.21.15.60:0/3807005633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d8149980 con 0x7fa1d8066c90 2020-10-31T22:51:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.453+0000 7fa1c6ffd700 1 -- 172.21.15.60:0/3807005633 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa1c8012550 con 0x7fa1d8066c90 2020-10-31T22:51:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.453+0000 7fa1c6ffd700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa1b8054f10 0x7fa1b80573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:04.466 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.453+0000 7fa1c6ffd700 1 -- 172.21.15.60:0/3807005633 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5253+0+0 (secure 0 0 0) 0x7fa1c806db00 con 0x7fa1d8066c90 2020-10-31T22:51:04.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.453+0000 7fa1dd143700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa1b8054f10 0x7fa1b80573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:04.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.453+0000 7fa1dd143700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa1b8054f10 0x7fa1b80573d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fa1d4018000 tx=0x7fa1d4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:04.467 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.457+0000 7fa1c6ffd700 1 -- 172.21.15.60:0/3807005633 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa1d8149980 con 0x7fa1d8066c90 2020-10-31T22:51:04.659 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.653+0000 7fa1de946700 1 -- 172.21.15.60:0/3807005633 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa1d8149980 con 0x7fa1d8066c90 2020-10-31T22:51:04.660 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.653+0000 7fa1c6ffd700 1 -- 172.21.15.60:0/3807005633 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v32) v1 ==== 80+0+4255 (secure 0 0 0) 0x7fa1d8149980 con 0x7fa1d8066c90 2020-10-31T22:51:04.660 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:04.661 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:51:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: "auth_dump": [ 2020-10-31T22:51:04.661 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.662 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.a", 2020-10-31T22:51:04.662 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f7D/cFRAAHQ9NU7VSs14mi5sC/GwHng==", 2020-10-31T22:51:04.662 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.662 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:51:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:51:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:51:04.663 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:51:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.664 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.b", 2020-10-31T22:51:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551f5SPjJBAAVjFv2PdBZ7j94etJrAT0tA==", 2020-10-31T22:51:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:51:04.665 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:51:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:51:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:51:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.666 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mds.c", 2020-10-31T22:51:04.667 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKpdoHhAAhhlaYqOQoI6tTKexjRpbGA==", 2020-10-31T22:51:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:51:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:51:04.668 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:51:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:51:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.669 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.0", 2020-10-31T22:51:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDR551f7MwsMRAACZIQlAKm3BdVbDs2gQAfxg==", 2020-10-31T22:51:04.670 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:51:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:51:04.671 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:51:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.672 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.1", 2020-10-31T22:51:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDU551f07HQFxAAokMFXwsbgKGtJNpnKerdGg==", 2020-10-31T22:51:04.673 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:51:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:51:04.674 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:51:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.675 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.2", 2020-10-31T22:51:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDW551fODyjOhAAJ+j8KITJidSpltSiJaQZGw==", 2020-10-31T22:51:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:51:04.676 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:51:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:51:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.677 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.3", 2020-10-31T22:51:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDZ551fs+aCIhAAwpbmgGQjU05W3hZofTtHdg==", 2020-10-31T22:51:04.678 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:51:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:51:04.679 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:51:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.680 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.4", 2020-10-31T22:51:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDe551fI5nIMxAAwwNSHQYDPS6G2achKIpwqg==", 2020-10-31T22:51:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.681 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:51:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:51:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:51:04.682 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.683 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.5", 2020-10-31T22:51:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDh551f68p2GhAAhlGpZLPg8RqouzStqN4tFw==", 2020-10-31T22:51:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:51:04.684 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:51:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:51:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.685 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.6", 2020-10-31T22:51:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDk551fUi3kARAAsXPU7HEhqax8Go00CqgdNw==", 2020-10-31T22:51:04.686 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:51:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:51:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:51:04.687 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "osd.7", 2020-10-31T22:51:04.688 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDm551fKh4aJRAAj+whV4kueCu2Og7wZ05tNw==", 2020-10-31T22:51:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:51:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:51:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:51:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.689 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.0", 2020-10-31T22:51:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551flXvBJxAAtD4URDL2NV0zyAympufvVA==", 2020-10-31T22:51:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:51:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:51:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:51:04.690 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.1", 2020-10-31T22:51:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fQ/OGKhAA/xGrRlUW52pP6E6SWXYAGA==", 2020-10-31T22:51:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.691 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow", 2020-10-31T22:51:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow r", 2020-10-31T22:51:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow rw pool=cephfs_data" 2020-10-31T22:51:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "client.admin", 2020-10-31T22:51:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDP551fITgCMxAAQy5CQzqda1YjdUtTRxbsPQ==", 2020-10-31T22:51:04.692 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:51:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr": "allow *", 2020-10-31T22:51:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow *", 2020-10-31T22:51:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:51:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.693 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.x", 2020-10-31T22:51:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551feZUgExAAvGt2fUb5GhkkFQ0dbgP5nw==", 2020-10-31T22:51:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:51:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:51:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:51:04.694 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: "entity": "mgr.y", 2020-10-31T22:51:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: "key": "AQDQ551fKiN5EBAAhHtXXE4+yydXWOK7agZ14g==", 2020-10-31T22:51:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": { 2020-10-31T22:51:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": "allow *", 2020-10-31T22:51:04.695 INFO:teuthology.orchestra.run.smithi060.stdout: "mon": "allow profile mgr", 2020-10-31T22:51:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": "allow *" 2020-10-31T22:51:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:04.696 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:04.696 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:51:04.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.657+0000 7fa1de946700 1 -- 172.21.15.60:0/3807005633 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa1b8054f10 msgr2=0x7fa1b80573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.657+0000 7fa1de946700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa1b8054f10 0x7fa1b80573d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 rx=0x7fa1d4018000 tx=0x7fa1d4015000).stop 2020-10-31T22:51:04.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.657+0000 7fa1de946700 1 -- 172.21.15.60:0/3807005633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d8066c90 msgr2=0x7fa1d814b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.657+0000 7fa1de946700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d8066c90 0x7fa1d814b9c0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 rx=0x7fa1c800c000 tx=0x7fa1c8006dc0).stop 2020-10-31T22:51:04.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.657+0000 7fa1de946700 1 -- 172.21.15.60:0/3807005633 shutdown_connections 2020-10-31T22:51:04.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.657+0000 7fa1de946700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa1d8146060 0x7fa1d814a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.657+0000 7fa1de946700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d8066c90 0x7fa1d814b9c0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.657+0000 7fa1de946700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa1b8054f10 0x7fa1b80573d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.657+0000 7fa1de946700 1 --2- 172.21.15.60:0/3807005633 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1d80af520 0x7fa1d8149c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.657+0000 7fa1de946700 1 -- 172.21.15.60:0/3807005633 >> 172.21.15.60:0/3807005633 conn(0x7fa1d80b3fd0 msgr2=0x7fa1d80a9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:04.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.657+0000 7fa1de946700 1 -- 172.21.15.60:0/3807005633 shutdown_connections 2020-10-31T22:51:04.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.657+0000 7fa1de946700 1 -- 172.21.15.60:0/3807005633 wait complete. 2020-10-31T22:51:04.702 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:51:04.818 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.813+0000 7f28827d3700 1 Processor -- start 2020-10-31T22:51:04.819 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.813+0000 7f28827d3700 1 -- start start 2020-10-31T22:51:04.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.813+0000 7f28827d3700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f287c0b5570 0x7f287c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:04.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.813+0000 7f28827d3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c145180 con 0x7f287c0b24a0 2020-10-31T22:51:04.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.813+0000 7f28827d3700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f287c0b0670 con 0x7f287c141fe0 2020-10-31T22:51:04.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.813+0000 7f28827d3700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f287c0afae0 con 0x7f287c0b5570 2020-10-31T22:51:04.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.813+0000 7f28817d1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f287c0b5570 0x7f287c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:04.820 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.813+0000 7f2880fd0700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f287c0b24a0 0x7f287c145820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54140/0 (socket says 172.21.15.60:54140) 2020-10-31T22:51:04.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.813+0000 7f2880fd0700 1 -- 172.21.15.60:0/402326674 learned_addr learned my addr 172.21.15.60:0/402326674 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:04.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.813+0000 7f2873fff700 1 -- 172.21.15.60:0/402326674 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 567164066 0 0) 0x7f287c145180 con 0x7f287c0b24a0 2020-10-31T22:51:04.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f2873fff700 1 -- 172.21.15.60:0/402326674 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2860003230 con 0x7f287c0b24a0 2020-10-31T22:51:04.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28817d1700 1 -- 172.21.15.60:0/402326674 >> v1:172.21.15.66:6789/0 conn(0x7f287c141fe0 legacy=0x7f287c142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28817d1700 1 -- 172.21.15.60:0/402326674 >> v1:172.21.15.60:6789/0 conn(0x7f287c0b24a0 legacy=0x7f287c145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28817d1700 1 -- 172.21.15.60:0/402326674 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c0b0910 con 0x7f287c0b5570 2020-10-31T22:51:04.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28817d1700 1 --2- 172.21.15.60:0/402326674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c0b5570 0x7f287c0b5950 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f287c05f580 tx=0x7f286c006dc0).ready entity=mon.0 client_cookie=9dfaf2099467827c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:04.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f2873fff700 1 -- 172.21.15.60:0/402326674 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286c0097c0 con 0x7f287c0b5570 2020-10-31T22:51:04.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f2873fff700 1 -- 172.21.15.60:0/402326674 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c009920 con 0x7f287c0b5570 2020-10-31T22:51:04.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f2873fff700 1 -- 172.21.15.60:0/402326674 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286c009c80 con 0x7f287c0b5570 2020-10-31T22:51:04.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28827d3700 1 -- 172.21.15.60:0/402326674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c0b5570 msgr2=0x7f287c0b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28827d3700 1 --2- 172.21.15.60:0/402326674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c0b5570 0x7f287c0b5950 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 rx=0x7f287c05f580 tx=0x7f286c006dc0).stop 2020-10-31T22:51:04.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28827d3700 1 -- 172.21.15.60:0/402326674 shutdown_connections 2020-10-31T22:51:04.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28827d3700 1 --2- 172.21.15.60:0/402326674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c0b5570 0x7f287c0b5950 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28827d3700 1 -- 172.21.15.60:0/402326674 >> 172.21.15.60:0/402326674 conn(0x7f287c0b8e90 msgr2=0x7f287c0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:04.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28827d3700 1 -- 172.21.15.60:0/402326674 shutdown_connections 2020-10-31T22:51:04.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28827d3700 1 -- 172.21.15.60:0/402326674 wait complete. 2020-10-31T22:51:04.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28827d3700 1 Processor -- start 2020-10-31T22:51:04.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28827d3700 1 -- start start 2020-10-31T22:51:04.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28827d3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c0b24a0 0x7f287c148150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:04.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.817+0000 7f28827d3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f287c0b5570 0x7f287c0aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:04.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28827d3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f287c141fe0 0x7f287c0af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:04.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28827d3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c148cb0 con 0x7f287c0b24a0 2020-10-31T22:51:04.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28827d3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f287c1430c0 con 0x7f287c0b5570 2020-10-31T22:51:04.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28827d3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287c143360 con 0x7f287c141fe0 2020-10-31T22:51:04.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28817d1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c0b24a0 0x7f287c148150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:04.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28817d1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c0b24a0 0x7f287c148150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50010/0 (socket says 172.21.15.60:50010) 2020-10-31T22:51:04.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28817d1700 1 -- 172.21.15.60:0/4112078462 learned_addr learned my addr 172.21.15.60:0/4112078462 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:04.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f2881fd2700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f287c141fe0 0x7f287c0af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:04.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f2880fd0700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f287c0b5570 0x7f287c0aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:04.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28817d1700 1 -- 172.21.15.60:0/4112078462 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f287c141fe0 msgr2=0x7f287c0af030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28817d1700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f287c141fe0 0x7f287c0af030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28817d1700 1 -- 172.21.15.60:0/4112078462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f287c0b5570 msgr2=0x7f287c0aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28817d1700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f287c0b5570 0x7f287c0aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28817d1700 1 -- 172.21.15.60:0/4112078462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f287c148930 con 0x7f287c0b24a0 2020-10-31T22:51:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f2880fd0700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f287c0b5570 0x7f287c0aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:51:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28817d1700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c0b24a0 0x7f287c148150 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f287c05f580 tx=0x7f286c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:04.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28727fc700 1 -- 172.21.15.60:0/4112078462 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286c011c30 con 0x7f287c0b24a0 2020-10-31T22:51:04.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28727fc700 1 -- 172.21.15.60:0/4112078462 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c011d90 con 0x7f287c0b24a0 2020-10-31T22:51:04.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28827d3700 1 -- 172.21.15.60:0/4112078462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f287c153de0 con 0x7f287c0b24a0 2020-10-31T22:51:04.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28727fc700 1 -- 172.21.15.60:0/4112078462 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f286c01d640 con 0x7f287c0b24a0 2020-10-31T22:51:04.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28827d3700 1 -- 172.21.15.60:0/4112078462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f287c0ad500 con 0x7f287c0b24a0 2020-10-31T22:51:04.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28827d3700 1 -- 172.21.15.60:0/4112078462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f287c1491a0 con 0x7f287c0b24a0 2020-10-31T22:51:04.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.821+0000 7f28727fc700 1 -- 172.21.15.60:0/4112078462 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f286c00f070 con 0x7f287c0b24a0 2020-10-31T22:51:04.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.825+0000 7f28727fc700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2864054f10 0x7f28640573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:04.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.825+0000 7f2880fd0700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2864054f10 0x7f28640573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:04.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.825+0000 7f28727fc700 1 -- 172.21.15.60:0/4112078462 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f286c06f240 con 0x7f287c0b24a0 2020-10-31T22:51:04.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.825+0000 7f2880fd0700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2864054f10 0x7f28640573d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f287800b000 tx=0x7f2878009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:04.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.829+0000 7f28727fc700 1 -- 172.21.15.60:0/4112078462 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f286c045980 con 0x7f287c0b24a0 2020-10-31T22:51:04.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.973+0000 7f28827d3700 1 -- 172.21.15.60:0/4112078462 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f287c148ac0 con 0x7f287c0b24a0 2020-10-31T22:51:04.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.973+0000 7f28727fc700 1 -- 172.21.15.60:0/4112078462 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+13191 (secure 0 0 0) 0x7f286c048fa0 con 0x7f287c0b24a0 2020-10-31T22:51:04.980 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:04.980 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":156,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:51:04.290715+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":28,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":146,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:51:04.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.977+0000 7f28827d3700 1 -- 172.21.15.60:0/4112078462 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2864054f10 msgr2=0x7f28640573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.977+0000 7f28827d3700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2864054f10 0x7f28640573d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 rx=0x7f287800b000 tx=0x7f2878009040).stop 2020-10-31T22:51:04.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.977+0000 7f28827d3700 1 -- 172.21.15.60:0/4112078462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c0b24a0 msgr2=0x7f287c148150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:04.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.977+0000 7f28827d3700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c0b24a0 0x7f287c148150 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 rx=0x7f287c05f580 tx=0x7f286c015000).stop 2020-10-31T22:51:04.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.977+0000 7f28827d3700 1 -- 172.21.15.60:0/4112078462 shutdown_connections 2020-10-31T22:51:04.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.977+0000 7f28827d3700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f287c141fe0 0x7f287c0af030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.977+0000 7f28827d3700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f287c0b24a0 0x7f287c148150 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.977+0000 7f28827d3700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2864054f10 0x7f28640573d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.977+0000 7f28827d3700 1 --2- 172.21.15.60:0/4112078462 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f287c0b5570 0x7f287c0aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:04.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.977+0000 7f28827d3700 1 -- 172.21.15.60:0/4112078462 >> 172.21.15.60:0/4112078462 conn(0x7f287c0b8e90 msgr2=0x7f287c0661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:04.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.977+0000 7f28827d3700 1 -- 172.21.15.60:0/4112078462 shutdown_connections 2020-10-31T22:51:04.984 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:04.977+0000 7f28827d3700 1 -- 172.21.15.60:0/4112078462 wait complete. 2020-10-31T22:51:05.000 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-10-31T22:51:05.001 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:51:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0f59e700 1 Processor -- start 2020-10-31T22:51:05.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0f59e700 1 -- start start 2020-10-31T22:51:05.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0f59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b10063140 0x7f8b100afea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0f59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8b100b14d0 0x7f8b100ab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0f59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b100b0390 con 0x7f8b100ae740 2020-10-31T22:51:05.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0f59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b10063520 con 0x7f8b100b14d0 2020-10-31T22:51:05.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0f59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100a9070 con 0x7f8b10063140 2020-10-31T22:51:05.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b05d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8b100ae740 0x7f8b100aee10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54154/0 (socket says 172.21.15.60:54154) 2020-10-31T22:51:05.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b05d9b700 1 -- 172.21.15.60:0/3007461733 learned_addr learned my addr 172.21.15.60:0/3007461733 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:05.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0e59c700 1 --2- 172.21.15.60:0/3007461733 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b10063140 0x7f8b100afea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0ed9d700 1 --2- 172.21.15.60:0/3007461733 >> v2:172.21.15.66:3300/0 conn(0x7f8b100b14d0 0x7f8b100ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0dd9b700 1 -- 172.21.15.60:0/3007461733 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067283233 0 0) 0x7f8b100b0390 con 0x7f8b100ae740 2020-10-31T22:51:05.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0dd9b700 1 -- 172.21.15.60:0/3007461733 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8af0003230 con 0x7f8b100ae740 2020-10-31T22:51:05.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0e59c700 1 -- 172.21.15.60:0/3007461733 >> v2:172.21.15.66:3300/0 conn(0x7f8b100b14d0 msgr2=0x7f8b100ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:05.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0e59c700 1 --2- 172.21.15.60:0/3007461733 >> v2:172.21.15.66:3300/0 conn(0x7f8b100b14d0 0x7f8b100ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0e59c700 1 -- 172.21.15.60:0/3007461733 >> v1:172.21.15.60:6789/0 conn(0x7f8b100ae740 legacy=0x7f8b100aee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0e59c700 1 -- 172.21.15.60:0/3007461733 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100a9310 con 0x7f8b10063140 2020-10-31T22:51:05.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.117+0000 7f8b0e59c700 1 --2- 172.21.15.60:0/3007461733 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b10063140 0x7f8b100afea0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f8b00002f30 tx=0x7f8b00006dc0).ready entity=mon.2 client_cookie=f5ceef36f23e192c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:05.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.121+0000 7f8b0dd9b700 1 -- 172.21.15.60:0/3007461733 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b000096a0 con 0x7f8b10063140 2020-10-31T22:51:05.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.121+0000 7f8b0dd9b700 1 -- 172.21.15.60:0/3007461733 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b00009800 con 0x7f8b10063140 2020-10-31T22:51:05.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.121+0000 7f8b0dd9b700 1 -- 172.21.15.60:0/3007461733 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b00009b60 con 0x7f8b10063140 2020-10-31T22:51:05.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.121+0000 7f8b0f59e700 1 -- 172.21.15.60:0/3007461733 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b10063140 msgr2=0x7f8b100afea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.121+0000 7f8b0f59e700 1 --2- 172.21.15.60:0/3007461733 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b10063140 0x7f8b100afea0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f8b00002f30 tx=0x7f8b00006dc0).stop 2020-10-31T22:51:05.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.121+0000 7f8b0f59e700 1 -- 172.21.15.60:0/3007461733 shutdown_connections 2020-10-31T22:51:05.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.121+0000 7f8b0f59e700 1 --2- 172.21.15.60:0/3007461733 >> v2:172.21.15.66:3300/0 conn(0x7f8b100b14d0 0x7f8b100ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.121+0000 7f8b0f59e700 1 --2- 172.21.15.60:0/3007461733 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b10063140 0x7f8b100afea0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.121+0000 7f8b0f59e700 1 -- 172.21.15.60:0/3007461733 >> 172.21.15.60:0/3007461733 conn(0x7f8b1006a600 msgr2=0x7f8b10060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:05.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.121+0000 7f8b0f59e700 1 -- 172.21.15.60:0/3007461733 shutdown_connections 2020-10-31T22:51:05.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.121+0000 7f8b0f59e700 1 -- 172.21.15.60:0/3007461733 wait complete. 2020-10-31T22:51:05.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.121+0000 7f8b0f59e700 1 Processor -- start 2020-10-31T22:51:05.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.121+0000 7f8b0f59e700 1 -- start start 2020-10-31T22:51:05.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b0f59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b10063140 0x7f8b100acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b0f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b100ae740 0x7f8b100b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b0f59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b100b14d0 0x7f8b10142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b0f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b101412b0 con 0x7f8b100ae740 2020-10-31T22:51:05.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b0f59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b100ac6b0 con 0x7f8b100b14d0 2020-10-31T22:51:05.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b0f59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b10141010 con 0x7f8b10063140 2020-10-31T22:51:05.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b05d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b100ae740 0x7f8b100b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b05d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b100ae740 0x7f8b100b41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50026/0 (socket says 172.21.15.60:50026) 2020-10-31T22:51:05.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b05d9b700 1 -- 172.21.15.60:0/2899347136 learned_addr learned my addr 172.21.15.60:0/2899347136 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:05.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b0ed9d700 1 --2- 172.21.15.60:0/2899347136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b100b14d0 0x7f8b10142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b0e59c700 1 --2- 172.21.15.60:0/2899347136 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b10063140 0x7f8b100acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b05d9b700 1 -- 172.21.15.60:0/2899347136 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b10063140 msgr2=0x7f8b100acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b05d9b700 1 --2- 172.21.15.60:0/2899347136 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b10063140 0x7f8b100acfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b05d9b700 1 -- 172.21.15.60:0/2899347136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b100b14d0 msgr2=0x7f8b10142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b05d9b700 1 --2- 172.21.15.60:0/2899347136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b100b14d0 0x7f8b10142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b05d9b700 1 -- 172.21.15.60:0/2899347136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b100ac910 con 0x7f8b100ae740 2020-10-31T22:51:05.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b05d9b700 1 --2- 172.21.15.60:0/2899347136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b100ae740 0x7f8b100b41b0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f8af80010d0 tx=0x7f8af8007aa0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:05.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b07fff700 1 -- 172.21.15.60:0/2899347136 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8af80072e0 con 0x7f8b100ae740 2020-10-31T22:51:05.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b07fff700 1 -- 172.21.15.60:0/2899347136 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8af8007440 con 0x7f8b100ae740 2020-10-31T22:51:05.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b0f59e700 1 -- 172.21.15.60:0/2899347136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b101465d0 con 0x7f8b100ae740 2020-10-31T22:51:05.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b07fff700 1 -- 172.21.15.60:0/2899347136 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8af80057d0 con 0x7f8b100ae740 2020-10-31T22:51:05.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b0f59e700 1 -- 172.21.15.60:0/2899347136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b100ad9f0 con 0x7f8b100ae740 2020-10-31T22:51:05.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.125+0000 7f8b0f59e700 1 -- 172.21.15.60:0/2899347136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b100acde0 con 0x7f8b100ae740 2020-10-31T22:51:05.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.129+0000 7f8b07fff700 1 -- 172.21.15.60:0/2899347136 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8af8010070 con 0x7f8b100ae740 2020-10-31T22:51:05.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.129+0000 7f8b07fff700 1 --2- 172.21.15.60:0/2899347136 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8af4054fd0 0x7f8af4057490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.129+0000 7f8b07fff700 1 -- 172.21.15.60:0/2899347136 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f8af806cc90 con 0x7f8b100ae740 2020-10-31T22:51:05.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.129+0000 7f8b0e59c700 1 --2- 172.21.15.60:0/2899347136 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8af4054fd0 0x7f8af4057490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.129+0000 7f8b0e59c700 1 --2- 172.21.15.60:0/2899347136 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8af4054fd0 0x7f8af4057490 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f8b0001b000 tx=0x7f8b00015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:05.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.133+0000 7f8b07fff700 1 -- 172.21.15.60:0/2899347136 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8af80433d0 con 0x7f8b100ae740 2020-10-31T22:51:05.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.273+0000 7f8b0f59e700 1 -- 172.21.15.60:0/2899347136 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f8b100ad9f0 con 0x7f8b100ae740 2020-10-31T22:51:05.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.273+0000 7f8b07fff700 1 -- 172.21.15.60:0/2899347136 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v156) v1 ==== 110+0+10 (secure 0 0 0) 0x7f8b100ad9f0 con 0x7f8b100ae740 2020-10-31T22:51:05.277 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:51:05.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.273+0000 7f8b0f59e700 1 -- 172.21.15.60:0/2899347136 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8af4054fd0 msgr2=0x7f8af4057490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.273+0000 7f8b0f59e700 1 --2- 172.21.15.60:0/2899347136 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8af4054fd0 0x7f8af4057490 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 rx=0x7f8b0001b000 tx=0x7f8b00015000).stop 2020-10-31T22:51:05.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.273+0000 7f8b0f59e700 1 -- 172.21.15.60:0/2899347136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b100ae740 msgr2=0x7f8b100b41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.273+0000 7f8b0f59e700 1 --2- 172.21.15.60:0/2899347136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b100ae740 0x7f8b100b41b0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 rx=0x7f8af80010d0 tx=0x7f8af8007aa0).stop 2020-10-31T22:51:05.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.273+0000 7f8b0f59e700 1 -- 172.21.15.60:0/2899347136 shutdown_connections 2020-10-31T22:51:05.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.273+0000 7f8b0f59e700 1 --2- 172.21.15.60:0/2899347136 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8af4054fd0 0x7f8af4057490 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.273+0000 7f8b0f59e700 1 --2- 172.21.15.60:0/2899347136 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8b100b14d0 0x7f8b10142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.273+0000 7f8b0f59e700 1 --2- 172.21.15.60:0/2899347136 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8b10063140 0x7f8b100acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.273+0000 7f8b0f59e700 1 --2- 172.21.15.60:0/2899347136 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8b100ae740 0x7f8b100b41b0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.273+0000 7f8b0f59e700 1 -- 172.21.15.60:0/2899347136 >> 172.21.15.60:0/2899347136 conn(0x7f8b1006a600 msgr2=0x7f8b100aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:05.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.273+0000 7f8b0f59e700 1 -- 172.21.15.60:0/2899347136 shutdown_connections 2020-10-31T22:51:05.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.273+0000 7f8b0f59e700 1 -- 172.21.15.60:0/2899347136 wait complete. 2020-10-31T22:51:05.291 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:51:05.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43ab59e700 1 Processor -- start 2020-10-31T22:51:05.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43ab59e700 1 -- start start 2020-10-31T22:51:05.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43ab59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f43ac063140 0x7f43ac0add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43ab59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac0b1bd0 0x7f43ac149af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43ab59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac063520 con 0x7f43ac0b2820 2020-10-31T22:51:05.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43ab59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ac0ae260 con 0x7f43ac063140 2020-10-31T22:51:05.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43ab59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac0b23f0 con 0x7f43ac0b1bd0 2020-10-31T22:51:05.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43a9d9b700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f43ac0b2820 0x7f43ac0b0c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54172/0 (socket says 172.21.15.60:54172) 2020-10-31T22:51:05.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43a9d9b700 1 -- 172.21.15.60:0/4149020037 learned_addr learned my addr 172.21.15.60:0/4149020037 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:05.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43aa59c700 1 --2- 172.21.15.60:0/4149020037 >> v2:172.21.15.66:3300/0 conn(0x7f43ac063140 0x7f43ac0add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43aad9d700 1 --2- 172.21.15.60:0/4149020037 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac0b1bd0 0x7f43ac149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43a959a700 1 -- 172.21.15.60:0/4149020037 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3453600277 0 0) 0x7f43ac063520 con 0x7f43ac0b2820 2020-10-31T22:51:05.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43a959a700 1 -- 172.21.15.60:0/4149020037 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4390003230 con 0x7f43ac0b2820 2020-10-31T22:51:05.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43aa59c700 1 -- 172.21.15.60:0/4149020037 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac0b1bd0 msgr2=0x7f43ac149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:05.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43aa59c700 1 --2- 172.21.15.60:0/4149020037 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac0b1bd0 0x7f43ac149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43aa59c700 1 -- 172.21.15.60:0/4149020037 >> v1:172.21.15.60:6789/0 conn(0x7f43ac0b2820 legacy=0x7f43ac0b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.412 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43aa59c700 1 -- 172.21.15.60:0/4149020037 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac0b2150 con 0x7f43ac063140 2020-10-31T22:51:05.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43aad9d700 1 --2- 172.21.15.60:0/4149020037 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac0b1bd0 0x7f43ac149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:05.413 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43aa59c700 1 --2- 172.21.15.60:0/4149020037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac063140 0x7f43ac0add70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f439c002f30 tx=0x7f439c006dc0).ready entity=mon.1 client_cookie=41f3b032439bceb3 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43a959a700 1 -- 172.21.15.60:0/4149020037 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f439c009730 con 0x7f43ac063140 2020-10-31T22:51:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43a959a700 1 -- 172.21.15.60:0/4149020037 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c009890 con 0x7f43ac063140 2020-10-31T22:51:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43ab59e700 1 -- 172.21.15.60:0/4149020037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac063140 msgr2=0x7f43ac0add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43a959a700 1 -- 172.21.15.60:0/4149020037 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f439c009bf0 con 0x7f43ac063140 2020-10-31T22:51:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.405+0000 7f43ab59e700 1 --2- 172.21.15.60:0/4149020037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac063140 0x7f43ac0add70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f439c002f30 tx=0x7f439c006dc0).stop 2020-10-31T22:51:05.414 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43ab59e700 1 -- 172.21.15.60:0/4149020037 shutdown_connections 2020-10-31T22:51:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43ab59e700 1 --2- 172.21.15.60:0/4149020037 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac0b1bd0 0x7f43ac149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43ab59e700 1 --2- 172.21.15.60:0/4149020037 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac063140 0x7f43ac0add70 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43ab59e700 1 -- 172.21.15.60:0/4149020037 >> 172.21.15.60:0/4149020037 conn(0x7f43ac06a600 msgr2=0x7f43ac060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43ab59e700 1 -- 172.21.15.60:0/4149020037 shutdown_connections 2020-10-31T22:51:05.415 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43ab59e700 1 -- 172.21.15.60:0/4149020037 wait complete. 2020-10-31T22:51:05.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43ab59e700 1 Processor -- start 2020-10-31T22:51:05.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43ab59e700 1 -- start start 2020-10-31T22:51:05.416 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43ab59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac063140 0x7f43ac14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43ab59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0b1bd0 0x7f43ac145300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43ab59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac0b2820 0x7f43ac1457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43ab59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac065160 con 0x7f43ac0b1bd0 2020-10-31T22:51:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43ab59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac0a85a0 con 0x7f43ac063140 2020-10-31T22:51:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43ab59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac14d650 con 0x7f43ac0b2820 2020-10-31T22:51:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43a9d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0b1bd0 0x7f43ac145300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.417 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43a9d9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0b1bd0 0x7f43ac145300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50040/0 (socket says 172.21.15.60:50040) 2020-10-31T22:51:05.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43a9d9b700 1 -- 172.21.15.60:0/3402081644 learned_addr learned my addr 172.21.15.60:0/3402081644 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:05.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43aad9d700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac0b2820 0x7f43ac1457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.418 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.409+0000 7f43aa59c700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac063140 0x7f43ac14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f43a9d9b700 1 -- 172.21.15.60:0/3402081644 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac0b2820 msgr2=0x7f43ac1457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f43a9d9b700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac0b2820 0x7f43ac1457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f43a9d9b700 1 -- 172.21.15.60:0/3402081644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac063140 msgr2=0x7f43ac14ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f43a9d9b700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac063140 0x7f43ac14ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.419 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f43a9d9b700 1 -- 172.21.15.60:0/3402081644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac145ce0 con 0x7f43ac0b1bd0 2020-10-31T22:51:05.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f43aa59c700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac063140 0x7f43ac14ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:05.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f43a9d9b700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0b1bd0 0x7f43ac145300 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f43ac063940 tx=0x7f43a0007a10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:05.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f439b7fe700 1 -- 172.21.15.60:0/3402081644 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43a00072e0 con 0x7f43ac0b1bd0 2020-10-31T22:51:05.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f439b7fe700 1 -- 172.21.15.60:0/3402081644 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a0007440 con 0x7f43ac0b1bd0 2020-10-31T22:51:05.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f439b7fe700 1 -- 172.21.15.60:0/3402081644 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43a00057d0 con 0x7f43ac0b1bd0 2020-10-31T22:51:05.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f43ab59e700 1 -- 172.21.15.60:0/3402081644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac0a8060 con 0x7f43ac0b1bd0 2020-10-31T22:51:05.420 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f43ab59e700 1 -- 172.21.15.60:0/3402081644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac14d2d0 con 0x7f43ac0b1bd0 2020-10-31T22:51:05.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f43ab59e700 1 -- 172.21.15.60:0/3402081644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ac057100 con 0x7f43ac0b1bd0 2020-10-31T22:51:05.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f439b7fe700 1 -- 172.21.15.60:0/3402081644 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f43a0010070 con 0x7f43ac0b1bd0 2020-10-31T22:51:05.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f439b7fe700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4388054f90 0x7f4388057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.413+0000 7f439b7fe700 1 -- 172.21.15.60:0/3402081644 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f43a006ce50 con 0x7f43ac0b1bd0 2020-10-31T22:51:05.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.417+0000 7f43aa59c700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4388054f90 0x7f4388057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.417+0000 7f43aa59c700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4388054f90 0x7f4388057450 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f439c01b000 tx=0x7f439c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:05.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.421+0000 7f439b7fe700 1 -- 172.21.15.60:0/3402081644 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f43a00436a0 con 0x7f43ac0b1bd0 2020-10-31T22:51:05.566 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.561+0000 7f43ab59e700 1 -- 172.21.15.60:0/3402081644 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f43ac05ed50 con 0x7f43ac0b1bd0 2020-10-31T22:51:05.567 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.561+0000 7f439b7fe700 1 -- 172.21.15.60:0/3402081644 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v156) v1 ==== 92+0+10 (secure 0 0 0) 0x7f43a0046cc0 con 0x7f43ac0b1bd0 2020-10-31T22:51:05.567 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:51:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.565+0000 7f43ab59e700 1 -- 172.21.15.60:0/3402081644 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4388054f90 msgr2=0x7f4388057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.565+0000 7f43ab59e700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4388054f90 0x7f4388057450 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 rx=0x7f439c01b000 tx=0x7f439c015000).stop 2020-10-31T22:51:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.565+0000 7f43ab59e700 1 -- 172.21.15.60:0/3402081644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0b1bd0 msgr2=0x7f43ac145300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.565+0000 7f43ab59e700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0b1bd0 0x7f43ac145300 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 rx=0x7f43ac063940 tx=0x7f43a0007a10).stop 2020-10-31T22:51:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.565+0000 7f43ab59e700 1 -- 172.21.15.60:0/3402081644 shutdown_connections 2020-10-31T22:51:05.569 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.565+0000 7f43ab59e700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f43ac0b2820 0x7f43ac1457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.565+0000 7f43ab59e700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4388054f90 0x7f4388057450 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.565+0000 7f43ab59e700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f43ac063140 0x7f43ac14ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.565+0000 7f43ab59e700 1 --2- 172.21.15.60:0/3402081644 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43ac0b1bd0 0x7f43ac145300 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.565+0000 7f43ab59e700 1 -- 172.21.15.60:0/3402081644 >> 172.21.15.60:0/3402081644 conn(0x7f43ac06a600 msgr2=0x7f43ac0b3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:05.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.565+0000 7f43ab59e700 1 -- 172.21.15.60:0/3402081644 shutdown_connections 2020-10-31T22:51:05.570 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.565+0000 7f43ab59e700 1 -- 172.21.15.60:0/3402081644 wait complete. 2020-10-31T22:51:05.581 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-10-31T22:51:05.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b9a0e2700 1 Processor -- start 2020-10-31T22:51:05.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b9a0e2700 1 -- start start 2020-10-31T22:51:05.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b9a0e2700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7b940b1d50 0x7f7b940b0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b9a0e2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7b94141d80 0x7f7b940b0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b9a0e2700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b940b2130 con 0x7f7b9405afe0 2020-10-31T22:51:05.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b9a0e2700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b9413fab0 con 0x7f7b940b1d50 2020-10-31T22:51:05.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b9a0e2700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b940af380 con 0x7f7b94141d80 2020-10-31T22:51:05.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b990e0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7b940b1d50 0x7f7b940b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b990e0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f7b940b1d50 0x7f7b940b0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50046/0 (socket says 172.21.15.60:50046) 2020-10-31T22:51:05.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b990e0700 1 -- 172.21.15.60:0/389645098 learned_addr learned my addr 172.21.15.60:0/389645098 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:05.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b988df700 1 --2- 172.21.15.60:0/389645098 >> v2:172.21.15.66:3300/0 conn(0x7f7b94141d80 0x7f7b940b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b990e0700 1 -- 172.21.15.60:0/389645098 >> v2:172.21.15.66:3300/0 conn(0x7f7b94141d80 msgr2=0x7f7b940b0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:05.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b990e0700 1 --2- 172.21.15.60:0/389645098 >> v2:172.21.15.66:3300/0 conn(0x7f7b94141d80 0x7f7b940b0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b990e0700 1 -- 172.21.15.60:0/389645098 >> v1:172.21.15.66:6789/0 conn(0x7f7b9405afe0 legacy=0x7f7b9405bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b990e0700 1 -- 172.21.15.60:0/389645098 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940af620 con 0x7f7b940b1d50 2020-10-31T22:51:05.697 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b988df700 1 --2- 172.21.15.60:0/389645098 >> v2:172.21.15.66:3300/0 conn(0x7f7b94141d80 0x7f7b940b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:51:05.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b990e0700 1 --2- 172.21.15.60:0/389645098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b940b1d50 0x7f7b940b0000 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f7b90002f30 tx=0x7f7b90006e80).ready entity=mon.0 client_cookie=9b3d61e348d8210b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:05.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b83fff700 1 -- 172.21.15.60:0/389645098 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b900097f0 con 0x7f7b940b1d50 2020-10-31T22:51:05.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b83fff700 1 -- 172.21.15.60:0/389645098 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b90009950 con 0x7f7b940b1d50 2020-10-31T22:51:05.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b83fff700 1 -- 172.21.15.60:0/389645098 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b90009cf0 con 0x7f7b940b1d50 2020-10-31T22:51:05.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/389645098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b940b1d50 msgr2=0x7f7b940b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b9a0e2700 1 --2- 172.21.15.60:0/389645098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b940b1d50 0x7f7b940b0000 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 rx=0x7f7b90002f30 tx=0x7f7b90006e80).stop 2020-10-31T22:51:05.698 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/389645098 shutdown_connections 2020-10-31T22:51:05.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.689+0000 7f7b9a0e2700 1 --2- 172.21.15.60:0/389645098 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b940b1d50 0x7f7b940b0000 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b9a0e2700 1 --2- 172.21.15.60:0/389645098 >> v2:172.21.15.66:3300/0 conn(0x7f7b94141d80 0x7f7b940b0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/389645098 >> 172.21.15.60:0/389645098 conn(0x7f7b940b5300 msgr2=0x7f7b940b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:05.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/389645098 shutdown_connections 2020-10-31T22:51:05.699 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/389645098 wait complete. 2020-10-31T22:51:05.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b9a0e2700 1 Processor -- start 2020-10-31T22:51:05.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b9a0e2700 1 -- start start 2020-10-31T22:51:05.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b9a0e2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b9405afe0 0x7f7b9413ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.701 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b9a0e2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b940b1d50 0x7f7b9413db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b9a0e2700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b94141d80 0x7f7b94153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b9a0e2700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940add00 con 0x7f7b940b1d50 2020-10-31T22:51:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b9a0e2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940a86f0 con 0x7f7b9405afe0 2020-10-31T22:51:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b9a0e2700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b940a8990 con 0x7f7b94141d80 2020-10-31T22:51:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b988df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b940b1d50 0x7f7b9413db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b990e0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b9405afe0 0x7f7b9413ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.702 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b988df700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b940b1d50 0x7f7b9413db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50054/0 (socket says 172.21.15.60:50054) 2020-10-31T22:51:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b988df700 1 -- 172.21.15.60:0/2705726487 learned_addr learned my addr 172.21.15.60:0/2705726487 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b998e1700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b94141d80 0x7f7b94153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b988df700 1 -- 172.21.15.60:0/2705726487 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b94141d80 msgr2=0x7f7b94153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b988df700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b94141d80 0x7f7b94153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b988df700 1 -- 172.21.15.60:0/2705726487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b9405afe0 msgr2=0x7f7b9413ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.703 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b988df700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b9405afe0 0x7f7b9413ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.693+0000 7f7b988df700 1 -- 172.21.15.60:0/2705726487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940a8c30 con 0x7f7b940b1d50 2020-10-31T22:51:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.697+0000 7f7b990e0700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b9405afe0 0x7f7b9413ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.697+0000 7f7b998e1700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b94141d80 0x7f7b94153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:51:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.697+0000 7f7b988df700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b940b1d50 0x7f7b9413db90 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f7b84006910 tx=0x7f7b84008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.697+0000 7f7b827fc700 1 -- 172.21.15.60:0/2705726487 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b84009980 con 0x7f7b940b1d50 2020-10-31T22:51:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.697+0000 7f7b827fc700 1 -- 172.21.15.60:0/2705726487 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b84009ae0 con 0x7f7b940b1d50 2020-10-31T22:51:05.704 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.697+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/2705726487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b940ab580 con 0x7f7b940b1d50 2020-10-31T22:51:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.697+0000 7f7b827fc700 1 -- 172.21.15.60:0/2705726487 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b84009e40 con 0x7f7b940b1d50 2020-10-31T22:51:05.705 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.697+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/2705726487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b940a90d0 con 0x7f7b940b1d50 2020-10-31T22:51:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.697+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/2705726487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b94057100 con 0x7f7b940b1d50 2020-10-31T22:51:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.697+0000 7f7b827fc700 1 -- 172.21.15.60:0/2705726487 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f7b84013480 con 0x7f7b940b1d50 2020-10-31T22:51:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.701+0000 7f7b827fc700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7b74054f90 0x7f7b74057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.701+0000 7f7b827fc700 1 -- 172.21.15.60:0/2705726487 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f7b8406df60 con 0x7f7b940b1d50 2020-10-31T22:51:05.706 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.701+0000 7f7b990e0700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7b74054f90 0x7f7b74057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.707 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.701+0000 7f7b990e0700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7b74054f90 0x7f7b74057450 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f7b9001c000 tx=0x7f7b90015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:05.710 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.705+0000 7f7b827fc700 1 -- 172.21.15.60:0/2705726487 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f7b84044640 con 0x7f7b940b1d50 2020-10-31T22:51:05.855 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.849+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/2705726487 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f7b9405ee00 con 0x7f7b940b1d50 2020-10-31T22:51:05.856 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.849+0000 7f7b827fc700 1 -- 172.21.15.60:0/2705726487 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v156) v1 ==== 84+0+143 (secure 0 0 0) 0x7f7b8400be60 con 0x7f7b940b1d50 2020-10-31T22:51:05.856 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:05.856 INFO:teuthology.orchestra.run.smithi060.stdout:[ 2020-10-31T22:51:05.856 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:05.857 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 1, 2020-10-31T22:51:05.857 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "device_health_metrics" 2020-10-31T22:51:05.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:05.857 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:05.857 INFO:teuthology.orchestra.run.smithi060.stdout: "poolnum": 2, 2020-10-31T22:51:05.857 INFO:teuthology.orchestra.run.smithi060.stdout: "poolname": "rbd" 2020-10-31T22:51:05.858 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:05.858 INFO:teuthology.orchestra.run.smithi060.stdout:] 2020-10-31T22:51:05.858 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.853+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/2705726487 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7b74054f90 msgr2=0x7f7b74057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.853+0000 7f7b9a0e2700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7b74054f90 0x7f7b74057450 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 rx=0x7f7b9001c000 tx=0x7f7b90015000).stop 2020-10-31T22:51:05.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.853+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/2705726487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b940b1d50 msgr2=0x7f7b9413db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.853+0000 7f7b9a0e2700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b940b1d50 0x7f7b9413db90 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 rx=0x7f7b84006910 tx=0x7f7b84008040).stop 2020-10-31T22:51:05.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.853+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/2705726487 shutdown_connections 2020-10-31T22:51:05.859 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.853+0000 7f7b9a0e2700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7b94141d80 0x7f7b94153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.853+0000 7f7b9a0e2700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f7b74054f90 0x7f7b74057450 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.853+0000 7f7b9a0e2700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7b9405afe0 0x7f7b9413ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.853+0000 7f7b9a0e2700 1 --2- 172.21.15.60:0/2705726487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b940b1d50 0x7f7b9413db90 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.853+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/2705726487 >> 172.21.15.60:0/2705726487 conn(0x7f7b940b5300 msgr2=0x7f7b940b3400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:05.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.853+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/2705726487 shutdown_connections 2020-10-31T22:51:05.860 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.853+0000 7f7b9a0e2700 1 -- 172.21.15.60:0/2705726487 wait complete. 2020-10-31T22:51:05.870 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-10-31T22:51:05.871 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-10-31T22:51:05.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f129742b700 1 Processor -- start 2020-10-31T22:51:05.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f129742b700 1 -- start start 2020-10-31T22:51:05.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f129742b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f12900b5570 0x7f12900b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f129742b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1290141f00 0x7f1290142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f129742b700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12900b4440 con 0x7f12900b24a0 2020-10-31T22:51:05.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f129742b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129013f930 con 0x7f12900b5570 2020-10-31T22:51:05.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f129742b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1290146060 con 0x7f1290141f00 2020-10-31T22:51:05.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f1296429700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f12900b5570 0x7f12900b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f1296429700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f12900b5570 0x7f12900b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50060/0 (socket says 172.21.15.60:50060) 2020-10-31T22:51:05.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f1296429700 1 -- 172.21.15.60:0/3091983337 learned_addr learned my addr 172.21.15.60:0/3091983337 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:05.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f1296c2a700 1 --2- 172.21.15.60:0/3091983337 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1290141f00 0x7f1290142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:05.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f1296429700 1 -- 172.21.15.60:0/3091983337 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1290141f00 msgr2=0x7f1290142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:05.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f1296429700 1 --2- 172.21.15.60:0/3091983337 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1290141f00 0x7f1290142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f1296429700 1 -- 172.21.15.60:0/3091983337 >> v1:172.21.15.66:6789/0 conn(0x7f12900b24a0 legacy=0x7f1290145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.985+0000 7f1296429700 1 -- 172.21.15.60:0/3091983337 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12900b02f0 con 0x7f12900b5570 2020-10-31T22:51:05.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.989+0000 7f1296429700 1 --2- 172.21.15.60:0/3091983337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12900b5570 0x7f12900b5950 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f128c002f30 tx=0x7f128c006e80).ready entity=mon.0 client_cookie=131c29e46f945ece server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:05.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.989+0000 7f1295427700 1 -- 172.21.15.60:0/3091983337 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f128c0097f0 con 0x7f12900b5570 2020-10-31T22:51:05.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.989+0000 7f1295427700 1 -- 172.21.15.60:0/3091983337 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c009950 con 0x7f12900b5570 2020-10-31T22:51:05.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.989+0000 7f1295427700 1 -- 172.21.15.60:0/3091983337 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f128c009cb0 con 0x7f12900b5570 2020-10-31T22:51:05.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.989+0000 7f129742b700 1 -- 172.21.15.60:0/3091983337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12900b5570 msgr2=0x7f12900b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:05.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.989+0000 7f129742b700 1 --2- 172.21.15.60:0/3091983337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12900b5570 0x7f12900b5950 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 rx=0x7f128c002f30 tx=0x7f128c006e80).stop 2020-10-31T22:51:05.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.989+0000 7f129742b700 1 -- 172.21.15.60:0/3091983337 shutdown_connections 2020-10-31T22:51:05.997 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.989+0000 7f129742b700 1 --2- 172.21.15.60:0/3091983337 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1290141f00 0x7f1290142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.989+0000 7f129742b700 1 --2- 172.21.15.60:0/3091983337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12900b5570 0x7f12900b5950 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:05.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.989+0000 7f129742b700 1 -- 172.21.15.60:0/3091983337 >> 172.21.15.60:0/3091983337 conn(0x7f12900b8e90 msgr2=0x7f12900b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:05.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.989+0000 7f129742b700 1 -- 172.21.15.60:0/3091983337 shutdown_connections 2020-10-31T22:51:05.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.989+0000 7f129742b700 1 -- 172.21.15.60:0/3091983337 wait complete. 2020-10-31T22:51:05.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.989+0000 7f129742b700 1 Processor -- start 2020-10-31T22:51:05.998 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.989+0000 7f129742b700 1 -- start start 2020-10-31T22:51:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f129742b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12900b24a0 0x7f12900aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f129742b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12900b5570 0x7f12901431c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f129742b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1290141f00 0x7f12901584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f129742b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12900b7e70 con 0x7f12900b24a0 2020-10-31T22:51:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f129742b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12900ae730 con 0x7f1290141f00 2020-10-31T22:51:05.999 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f129742b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12900ae9d0 con 0x7f12900b5570 2020-10-31T22:51:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f1296429700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12900b24a0 0x7f12900aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f1296429700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12900b24a0 0x7f12900aee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50066/0 (socket says 172.21.15.60:50066) 2020-10-31T22:51:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f1296429700 1 -- 172.21.15.60:0/2810504272 learned_addr learned my addr 172.21.15.60:0/2810504272 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f1296c2a700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1290141f00 0x7f12901584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f1295c28700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12900b5570 0x7f12901431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f1296429700 1 -- 172.21.15.60:0/2810504272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12900b5570 msgr2=0x7f12901431c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:06.000 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f1296429700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12900b5570 0x7f12901431c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f1296429700 1 -- 172.21.15.60:0/2810504272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1290141f00 msgr2=0x7f12901584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f1296429700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1290141f00 0x7f12901584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f1296429700 1 -- 172.21.15.60:0/2810504272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12901436b0 con 0x7f12900b24a0 2020-10-31T22:51:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f1295c28700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12900b5570 0x7f12901431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-10-31T22:51:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f1296429700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12900b24a0 0x7f12900aee70 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f128c002f30 tx=0x7f128c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:06.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f12837fe700 1 -- 172.21.15.60:0/2810504272 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f128c011ca0 con 0x7f12900b24a0 2020-10-31T22:51:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f12837fe700 1 -- 172.21.15.60:0/2810504272 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c011e00 con 0x7f12900b24a0 2020-10-31T22:51:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f129742b700 1 -- 172.21.15.60:0/2810504272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1290143e50 con 0x7f12900b24a0 2020-10-31T22:51:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f12837fe700 1 -- 172.21.15.60:0/2810504272 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f128c01e650 con 0x7f12900b24a0 2020-10-31T22:51:06.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f129742b700 1 -- 172.21.15.60:0/2810504272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1290158b40 con 0x7f12900b24a0 2020-10-31T22:51:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f129742b700 1 -- 172.21.15.60:0/2810504272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1290057100 con 0x7f12900b24a0 2020-10-31T22:51:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.993+0000 7f12837fe700 1 -- 172.21.15.60:0/2810504272 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f128c025030 con 0x7f12900b24a0 2020-10-31T22:51:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.997+0000 7f12837fe700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1270055020 0x7f12700574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.997+0000 7f12837fe700 1 -- 172.21.15.60:0/2810504272 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5253+0+0 (secure 0 0 0) 0x7f128c06ed80 con 0x7f12900b24a0 2020-10-31T22:51:06.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.997+0000 7f1295c28700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1270055020 0x7f12700574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:06.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:05.997+0000 7f1295c28700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1270055020 0x7f12700574e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f1284008000 tx=0x7f1284009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:06.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:06.001+0000 7f12837fe700 1 -- 172.21.15.60:0/2810504272 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f128c0455d0 con 0x7f12900b24a0 2020-10-31T22:51:06.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:06.145+0000 7f129742b700 1 -- 172.21.15.60:0/2810504272 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f129005a8e0 con 0x7f12900b24a0 2020-10-31T22:51:07.124 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.117+0000 7f12837fe700 1 -- 172.21.15.60:0/2810504272 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v157) v1 ==== 133+0+0 (secure 0 0 0) 0x7f128c023020 con 0x7f12900b24a0 2020-10-31T22:51:07.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.121+0000 7f129742b700 1 -- 172.21.15.60:0/2810504272 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1270055020 msgr2=0x7f12700574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:07.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.121+0000 7f129742b700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1270055020 0x7f12700574e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 rx=0x7f1284008000 tx=0x7f1284009040).stop 2020-10-31T22:51:07.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.121+0000 7f129742b700 1 -- 172.21.15.60:0/2810504272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12900b24a0 msgr2=0x7f12900aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:07.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.121+0000 7f129742b700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12900b24a0 0x7f12900aee70 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 rx=0x7f128c002f30 tx=0x7f128c015000).stop 2020-10-31T22:51:07.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.121+0000 7f129742b700 1 -- 172.21.15.60:0/2810504272 shutdown_connections 2020-10-31T22:51:07.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.121+0000 7f129742b700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1270055020 0x7f12700574e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:07.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.121+0000 7f129742b700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1290141f00 0x7f12901584b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:07.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.121+0000 7f129742b700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f12900b24a0 0x7f12900aee70 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:07.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.121+0000 7f129742b700 1 --2- 172.21.15.60:0/2810504272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f12900b5570 0x7f12901431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:07.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.121+0000 7f129742b700 1 -- 172.21.15.60:0/2810504272 >> 172.21.15.60:0/2810504272 conn(0x7f12900b8e90 msgr2=0x7f1290141680 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:07.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.121+0000 7f129742b700 1 -- 172.21.15.60:0/2810504272 shutdown_connections 2020-10-31T22:51:07.133 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.121+0000 7f129742b700 1 -- 172.21.15.60:0/2810504272 wait complete. 2020-10-31T22:51:07.133 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' created 2020-10-31T22:51:07.142 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 2020-10-31T22:51:07.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.261+0000 7f59af2a5700 1 Processor -- start 2020-10-31T22:51:07.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.261+0000 7f59af2a5700 1 -- start start 2020-10-31T22:51:07.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59af2a5700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f59a80af580 0x7f59a814b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:07.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59af2a5700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a80b1120 con 0x7f59a805afe0 2020-10-31T22:51:07.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59af2a5700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59a80afa10 con 0x7f59a80b1bb0 2020-10-31T22:51:07.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59af2a5700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59a8140230 con 0x7f59a80af580 2020-10-31T22:51:07.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59aeaa4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f59a80af580 0x7f59a814b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:07.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59adaa2700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f59a805afe0 0x7f59a80ab150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54212/0 (socket says 172.21.15.60:54212) 2020-10-31T22:51:07.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59adaa2700 1 -- 172.21.15.60:0/4044782132 learned_addr learned my addr 172.21.15.60:0/4044782132 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:07.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59aeaa4700 1 -- 172.21.15.60:0/4044782132 >> v1:172.21.15.66:6789/0 conn(0x7f59a80b1bb0 legacy=0x7f59a813fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:07.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59ad2a1700 1 -- 172.21.15.60:0/4044782132 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196998732 0 0) 0x7f59a80b1120 con 0x7f59a805afe0 2020-10-31T22:51:07.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59aeaa4700 1 -- 172.21.15.60:0/4044782132 >> v1:172.21.15.60:6789/0 conn(0x7f59a805afe0 legacy=0x7f59a80ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:07.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59aeaa4700 1 -- 172.21.15.60:0/4044782132 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a80a8850 con 0x7f59a80af580 2020-10-31T22:51:07.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59aeaa4700 1 --2- 172.21.15.60:0/4044782132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59a80af580 0x7f59a814b440 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f59a00032b0 tx=0x7f59a00091a0).ready entity=mon.0 client_cookie=ebd37fb1657e81d8 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:07.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59ad2a1700 1 -- 172.21.15.60:0/4044782132 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a000ba50 con 0x7f59a80af580 2020-10-31T22:51:07.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59ad2a1700 1 -- 172.21.15.60:0/4044782132 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a000bbb0 con 0x7f59a80af580 2020-10-31T22:51:07.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59ad2a1700 1 -- 172.21.15.60:0/4044782132 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a000bd20 con 0x7f59a80af580 2020-10-31T22:51:07.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59af2a5700 1 -- 172.21.15.60:0/4044782132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59a80af580 msgr2=0x7f59a814b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:07.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59af2a5700 1 --2- 172.21.15.60:0/4044782132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59a80af580 0x7f59a814b440 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 rx=0x7f59a00032b0 tx=0x7f59a00091a0).stop 2020-10-31T22:51:07.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59af2a5700 1 -- 172.21.15.60:0/4044782132 shutdown_connections 2020-10-31T22:51:07.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59af2a5700 1 --2- 172.21.15.60:0/4044782132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59a80af580 0x7f59a814b440 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:07.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59af2a5700 1 -- 172.21.15.60:0/4044782132 >> 172.21.15.60:0/4044782132 conn(0x7f59a80b5330 msgr2=0x7f59a80b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:07.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59af2a5700 1 -- 172.21.15.60:0/4044782132 shutdown_connections 2020-10-31T22:51:07.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.265+0000 7f59af2a5700 1 -- 172.21.15.60:0/4044782132 wait complete. 2020-10-31T22:51:07.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59af2a5700 1 Processor -- start 2020-10-31T22:51:07.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59af2a5700 1 -- start start 2020-10-31T22:51:07.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59af2a5700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59a805afe0 0x7f59a80aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:07.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59af2a5700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59a80af580 0x7f59a8143640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:07.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59af2a5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59a80b1bb0 0x7f59a8141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:07.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59af2a5700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a80ad5b0 con 0x7f59a80af580 2020-10-31T22:51:07.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59af2a5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59a81547a0 con 0x7f59a80b1bb0 2020-10-31T22:51:07.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59af2a5700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59a8154c70 con 0x7f59a805afe0 2020-10-31T22:51:07.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59adaa2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59a80af580 0x7f59a8143640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:07.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59adaa2700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59a80af580 0x7f59a8143640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50084/0 (socket says 172.21.15.60:50084) 2020-10-31T22:51:07.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59aeaa4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59a80b1bb0 0x7f59a8141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:07.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59ae2a3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59a805afe0 0x7f59a80aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:07.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59adaa2700 1 -- 172.21.15.60:0/1700286182 learned_addr learned my addr 172.21.15.60:0/1700286182 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:07.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59adaa2700 1 -- 172.21.15.60:0/1700286182 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59a805afe0 msgr2=0x7f59a80aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:07.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59adaa2700 1 --2- 172.21.15.60:0/1700286182 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59a805afe0 0x7f59a80aa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:07.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59adaa2700 1 -- 172.21.15.60:0/1700286182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59a80b1bb0 msgr2=0x7f59a8141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:07.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59adaa2700 1 --2- 172.21.15.60:0/1700286182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59a80b1bb0 0x7f59a8141890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:07.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59adaa2700 1 -- 172.21.15.60:0/1700286182 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a81549d0 con 0x7f59a80af580 2020-10-31T22:51:07.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59ae2a3700 1 --2- 172.21.15.60:0/1700286182 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59a805afe0 0x7f59a80aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:07.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59aeaa4700 1 --2- 172.21.15.60:0/1700286182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59a80b1bb0 0x7f59a8141890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:07.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59adaa2700 1 --2- 172.21.15.60:0/1700286182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59a80af580 0x7f59a8143640 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f59a4000b80 tx=0x7f59a4007a30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:07.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f599b7fe700 1 -- 172.21.15.60:0/1700286182 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a40073b0 con 0x7f59a80af580 2020-10-31T22:51:07.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f599b7fe700 1 -- 172.21.15.60:0/1700286182 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a40055e0 con 0x7f59a80af580 2020-10-31T22:51:07.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f599b7fe700 1 -- 172.21.15.60:0/1700286182 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a4005940 con 0x7f59a80af580 2020-10-31T22:51:07.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59af2a5700 1 -- 172.21.15.60:0/1700286182 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a80667c0 con 0x7f59a80af580 2020-10-31T22:51:07.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.269+0000 7f59af2a5700 1 -- 172.21.15.60:0/1700286182 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59a80ab440 con 0x7f59a80af580 2020-10-31T22:51:07.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.273+0000 7f59af2a5700 1 -- 172.21.15.60:0/1700286182 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59a8057100 con 0x7f59a80af580 2020-10-31T22:51:07.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.273+0000 7f599b7fe700 1 -- 172.21.15.60:0/1700286182 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f59a4010070 con 0x7f59a80af580 2020-10-31T22:51:07.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.273+0000 7f599b7fe700 1 --2- 172.21.15.60:0/1700286182 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5988054f90 0x7f5988057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:07.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.273+0000 7f599b7fe700 1 -- 172.21.15.60:0/1700286182 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5607+0+0 (secure 0 0 0) 0x7f59a406cf90 con 0x7f59a80af580 2020-10-31T22:51:07.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.273+0000 7f59ae2a3700 1 --2- 172.21.15.60:0/1700286182 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5988054f90 0x7f5988057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:07.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.273+0000 7f59ae2a3700 1 --2- 172.21.15.60:0/1700286182 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5988054f90 0x7f5988057450 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f599c00d000 tx=0x7f599c009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:07.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.281+0000 7f599b7fe700 1 -- 172.21.15.60:0/1700286182 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f59a4043680 con 0x7f59a80af580 2020-10-31T22:51:07.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:07.425+0000 7f59af2a5700 1 -- 172.21.15.60:0/1700286182 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8} v 0) v1 -- 0x7f59a805ee00 con 0x7f59a80af580 2020-10-31T22:51:08.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.129+0000 7f599b7fe700 1 -- 172.21.15.60:0/1700286182 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8}]=0 pool 'cephfs_data' created v158) v1 ==== 125+0+0 (secure 0 0 0) 0x7f59a4046ca0 con 0x7f59a80af580 2020-10-31T22:51:08.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.133+0000 7f59af2a5700 1 -- 172.21.15.60:0/1700286182 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5988054f90 msgr2=0x7f5988057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.133+0000 7f59af2a5700 1 --2- 172.21.15.60:0/1700286182 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5988054f90 0x7f5988057450 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 rx=0x7f599c00d000 tx=0x7f599c009040).stop 2020-10-31T22:51:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.133+0000 7f59af2a5700 1 -- 172.21.15.60:0/1700286182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59a80af580 msgr2=0x7f59a8143640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.133+0000 7f59af2a5700 1 --2- 172.21.15.60:0/1700286182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59a80af580 0x7f59a8143640 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 rx=0x7f59a4000b80 tx=0x7f59a4007a30).stop 2020-10-31T22:51:08.140 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.133+0000 7f59af2a5700 1 -- 172.21.15.60:0/1700286182 shutdown_connections 2020-10-31T22:51:08.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.133+0000 7f59af2a5700 1 --2- 172.21.15.60:0/1700286182 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5988054f90 0x7f5988057450 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.133+0000 7f59af2a5700 1 --2- 172.21.15.60:0/1700286182 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59a80b1bb0 0x7f59a8141890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.133+0000 7f59af2a5700 1 --2- 172.21.15.60:0/1700286182 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59a805afe0 0x7f59a80aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.133+0000 7f59af2a5700 1 --2- 172.21.15.60:0/1700286182 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59a80af580 0x7f59a8143640 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.133+0000 7f59af2a5700 1 -- 172.21.15.60:0/1700286182 >> 172.21.15.60:0/1700286182 conn(0x7f59a80b5330 msgr2=0x7f59a805f850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:08.141 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.133+0000 7f59af2a5700 1 -- 172.21.15.60:0/1700286182 shutdown_connections 2020-10-31T22:51:08.142 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.133+0000 7f59af2a5700 1 -- 172.21.15.60:0/1700286182 wait complete. 2020-10-31T22:51:08.143 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' created 2020-10-31T22:51:08.157 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-10-31T22:51:08.269 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59b507e700 1 Processor -- start 2020-10-31T22:51:08.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59b507e700 1 -- start start 2020-10-31T22:51:08.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59b507e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f59b0063140 0x7f59b00add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59b507e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59b00b1bd0 0x7f59b0149af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.279 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59b507e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b0063520 con 0x7f59b00b2820 2020-10-31T22:51:08.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59b507e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b00ae260 con 0x7f59b0063140 2020-10-31T22:51:08.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59b507e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00b23f0 con 0x7f59b00b1bd0 2020-10-31T22:51:08.280 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59affff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f59b0063140 0x7f59b00add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59affff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f59b0063140 0x7f59b00add70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50088/0 (socket says 172.21.15.60:50088) 2020-10-31T22:51:08.281 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59affff700 1 -- 172.21.15.60:0/1192134542 learned_addr learned my addr 172.21.15.60:0/1192134542 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:08.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59b487d700 1 --2- 172.21.15.60:0/1192134542 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59b00b1bd0 0x7f59b0149af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59aeffd700 1 -- 172.21.15.60:0/1192134542 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102702302 0 0) 0x7f59b0063520 con 0x7f59b00b2820 2020-10-31T22:51:08.282 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59aeffd700 1 -- 172.21.15.60:0/1192134542 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f599c003230 con 0x7f59b00b2820 2020-10-31T22:51:08.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59affff700 1 -- 172.21.15.60:0/1192134542 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59b00b1bd0 msgr2=0x7f59b0149af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:08.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59affff700 1 --2- 172.21.15.60:0/1192134542 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59b00b1bd0 0x7f59b0149af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59affff700 1 -- 172.21.15.60:0/1192134542 >> v1:172.21.15.66:6789/0 conn(0x7f59b00b2820 legacy=0x7f59b00b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.283 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59affff700 1 -- 172.21.15.60:0/1192134542 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b00b2150 con 0x7f59b0063140 2020-10-31T22:51:08.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59affff700 1 --2- 172.21.15.60:0/1192134542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59b0063140 0x7f59b00add70 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f59a0002f30 tx=0x7f59a0006e80).ready entity=mon.0 client_cookie=d5cd69d2ea8afbca server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:08.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59aeffd700 1 -- 172.21.15.60:0/1192134542 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a00096d0 con 0x7f59b0063140 2020-10-31T22:51:08.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59aeffd700 1 -- 172.21.15.60:0/1192134542 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a0009830 con 0x7f59b0063140 2020-10-31T22:51:08.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59aeffd700 1 -- 172.21.15.60:0/1192134542 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a0009b90 con 0x7f59b0063140 2020-10-31T22:51:08.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59b507e700 1 -- 172.21.15.60:0/1192134542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59b0063140 msgr2=0x7f59b00add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.265+0000 7f59b507e700 1 --2- 172.21.15.60:0/1192134542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59b0063140 0x7f59b00add70 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 rx=0x7f59a0002f30 tx=0x7f59a0006e80).stop 2020-10-31T22:51:08.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b507e700 1 -- 172.21.15.60:0/1192134542 shutdown_connections 2020-10-31T22:51:08.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b507e700 1 --2- 172.21.15.60:0/1192134542 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59b00b1bd0 0x7f59b0149af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b507e700 1 --2- 172.21.15.60:0/1192134542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59b0063140 0x7f59b00add70 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b507e700 1 -- 172.21.15.60:0/1192134542 >> 172.21.15.60:0/1192134542 conn(0x7f59b006a600 msgr2=0x7f59b0060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:08.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b507e700 1 -- 172.21.15.60:0/1192134542 shutdown_connections 2020-10-31T22:51:08.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b507e700 1 -- 172.21.15.60:0/1192134542 wait complete. 2020-10-31T22:51:08.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b507e700 1 Processor -- start 2020-10-31T22:51:08.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b507e700 1 -- start start 2020-10-31T22:51:08.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b507e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59b0063140 0x7f59b014bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b507e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59b00b1bd0 0x7f59b0063520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.288 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b507e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59b00b2820 0x7f59b0065d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b507e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b0159110 con 0x7f59b00b1bd0 2020-10-31T22:51:08.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b507e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b0065390 con 0x7f59b00b2820 2020-10-31T22:51:08.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b507e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b0065630 con 0x7f59b0063140 2020-10-31T22:51:08.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59af7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59b00b1bd0 0x7f59b0063520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59af7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59b00b1bd0 0x7f59b0063520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50096/0 (socket says 172.21.15.60:50096) 2020-10-31T22:51:08.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59affff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59b0063140 0x7f59b014bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59af7fe700 1 -- 172.21.15.60:0/1954925150 learned_addr learned my addr 172.21.15.60:0/1954925150 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:08.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b487d700 1 --2- 172.21.15.60:0/1954925150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59b00b2820 0x7f59b0065d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59af7fe700 1 -- 172.21.15.60:0/1954925150 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59b0063140 msgr2=0x7f59b014bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59af7fe700 1 --2- 172.21.15.60:0/1954925150 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59b0063140 0x7f59b014bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59af7fe700 1 -- 172.21.15.60:0/1954925150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59b00b2820 msgr2=0x7f59b0065d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59af7fe700 1 --2- 172.21.15.60:0/1954925150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59b00b2820 0x7f59b0065d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59af7fe700 1 -- 172.21.15.60:0/1954925150 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b00658d0 con 0x7f59b00b1bd0 2020-10-31T22:51:08.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.269+0000 7f59b487d700 1 --2- 172.21.15.60:0/1954925150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59b00b2820 0x7f59b0065d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:08.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.273+0000 7f59af7fe700 1 --2- 172.21.15.60:0/1954925150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59b00b1bd0 0x7f59b0063520 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f59a40010d0 tx=0x7f59a40079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:08.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.273+0000 7f59ad7fa700 1 -- 172.21.15.60:0/1954925150 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a400f470 con 0x7f59b00b1bd0 2020-10-31T22:51:08.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.273+0000 7f59ad7fa700 1 -- 172.21.15.60:0/1954925150 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a400f5d0 con 0x7f59b00b1bd0 2020-10-31T22:51:08.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.273+0000 7f59b507e700 1 -- 172.21.15.60:0/1954925150 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b014d540 con 0x7f59b00b1bd0 2020-10-31T22:51:08.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.273+0000 7f59ad7fa700 1 -- 172.21.15.60:0/1954925150 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a400f930 con 0x7f59b00b1bd0 2020-10-31T22:51:08.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.273+0000 7f59b507e700 1 -- 172.21.15.60:0/1954925150 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b0066260 con 0x7f59b00b1bd0 2020-10-31T22:51:08.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.273+0000 7f59b507e700 1 -- 172.21.15.60:0/1954925150 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b0066a40 con 0x7f59b00b1bd0 2020-10-31T22:51:08.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.273+0000 7f59ad7fa700 1 -- 172.21.15.60:0/1954925150 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f59a4019030 con 0x7f59b00b1bd0 2020-10-31T22:51:08.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.273+0000 7f59ad7fa700 1 --2- 172.21.15.60:0/1954925150 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5990055020 0x7f59900574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.273+0000 7f59ad7fa700 1 -- 172.21.15.60:0/1954925150 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5957+0+0 (secure 0 0 0) 0x7f59a406cfa0 con 0x7f59b00b1bd0 2020-10-31T22:51:08.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.273+0000 7f59affff700 1 --2- 172.21.15.60:0/1954925150 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5990055020 0x7f59900574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.277+0000 7f59affff700 1 --2- 172.21.15.60:0/1954925150 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5990055020 0x7f59900574e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f59a001b000 tx=0x7f59a0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:08.299 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.281+0000 7f59ad7fa700 1 -- 172.21.15.60:0/1954925150 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f59a4043420 con 0x7f59b00b1bd0 2020-10-31T22:51:08.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.469+0000 7f59b507e700 1 -- 172.21.15.60:0/1954925150 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f59b0065a60 con 0x7f59b00b1bd0 2020-10-31T22:51:08.484 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.481+0000 7f59ad7fa700 1 -- 172.21.15.60:0/1954925150 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 29 and data pool 30 v80) v1 ==== 189+0+0 (secure 0 0 0) 0x7f59a4046a40 con 0x7f59b00b1bd0 2020-10-31T22:51:08.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.485+0000 7f59b507e700 1 -- 172.21.15.60:0/1954925150 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5990055020 msgr2=0x7f59900574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.485+0000 7f59b507e700 1 --2- 172.21.15.60:0/1954925150 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5990055020 0x7f59900574e0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 rx=0x7f59a001b000 tx=0x7f59a0015000).stop 2020-10-31T22:51:08.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.485+0000 7f59b507e700 1 -- 172.21.15.60:0/1954925150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59b00b1bd0 msgr2=0x7f59b0063520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.492 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.485+0000 7f59b507e700 1 --2- 172.21.15.60:0/1954925150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59b00b1bd0 0x7f59b0063520 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 rx=0x7f59a40010d0 tx=0x7f59a40079e0).stop 2020-10-31T22:51:08.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.485+0000 7f59b507e700 1 -- 172.21.15.60:0/1954925150 shutdown_connections 2020-10-31T22:51:08.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.485+0000 7f59b507e700 1 --2- 172.21.15.60:0/1954925150 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f5990055020 0x7f59900574e0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.485+0000 7f59b507e700 1 --2- 172.21.15.60:0/1954925150 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f59b00b2820 0x7f59b0065d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.485+0000 7f59b507e700 1 --2- 172.21.15.60:0/1954925150 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f59b0063140 0x7f59b014bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.485+0000 7f59b507e700 1 --2- 172.21.15.60:0/1954925150 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59b00b1bd0 0x7f59b0063520 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.485+0000 7f59b507e700 1 -- 172.21.15.60:0/1954925150 >> 172.21.15.60:0/1954925150 conn(0x7f59b006a600 msgr2=0x7f59b005c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:08.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.485+0000 7f59b507e700 1 -- 172.21.15.60:0/1954925150 shutdown_connections 2020-10-31T22:51:08.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.485+0000 7f59b507e700 1 -- 172.21.15.60:0/1954925150 wait complete. 2020-10-31T22:51:08.496 INFO:teuthology.orchestra.run.smithi060.stderr:new fs with metadata pool 29 and data pool 30 2020-10-31T22:51:08.507 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:51:08.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.601+0000 7fc2b1c4f700 1 Processor -- start 2020-10-31T22:51:08.609 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b1c4f700 1 -- start start 2020-10-31T22:51:08.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b1c4f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc2ac0b5570 0x7fc2ac0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b1c4f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2ac141fe0 0x7fc2ac142490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.610 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b1c4f700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2ac145180 con 0x7fc2ac0b24a0 2020-10-31T22:51:08.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b1c4f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2ac0afae0 con 0x7fc2ac0b5570 2020-10-31T22:51:08.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b1c4f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac141bf0 con 0x7fc2ac141fe0 2020-10-31T22:51:08.611 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b0c4d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc2ac0b5570 0x7fc2ac0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b0c4d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc2ac0b5570 0x7fc2ac0b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50110/0 (socket says 172.21.15.60:50110) 2020-10-31T22:51:08.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b0c4d700 1 -- 172.21.15.60:0/2281750551 learned_addr learned my addr 172.21.15.60:0/2281750551 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:08.612 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b144e700 1 --2- 172.21.15.60:0/2281750551 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2ac141fe0 0x7fc2ac142490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b0c4d700 1 -- 172.21.15.60:0/2281750551 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2ac141fe0 msgr2=0x7fc2ac142490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:08.615 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b0c4d700 1 --2- 172.21.15.60:0/2281750551 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2ac141fe0 0x7fc2ac142490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b0c4d700 1 -- 172.21.15.60:0/2281750551 >> v1:172.21.15.66:6789/0 conn(0x7fc2ac0b24a0 legacy=0x7fc2ac145820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.616 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2a37fe700 1 -- 172.21.15.60:0/2281750551 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232592266 0 0) 0x7fc2ac145180 con 0x7fc2ac0b24a0 2020-10-31T22:51:08.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b0c4d700 1 -- 172.21.15.60:0/2281750551 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac0b0670 con 0x7fc2ac0b5570 2020-10-31T22:51:08.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b0c4d700 1 --2- 172.21.15.60:0/2281750551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac0b5570 0x7fc2ac0b5950 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7fc2ac05f580 tx=0x7fc2a8006e80).ready entity=mon.0 client_cookie=ec98a9a102f2305d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:08.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2a37fe700 1 -- 172.21.15.60:0/2281750551 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2a80097b0 con 0x7fc2ac0b5570 2020-10-31T22:51:08.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2a37fe700 1 -- 172.21.15.60:0/2281750551 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a8009910 con 0x7fc2ac0b5570 2020-10-31T22:51:08.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2a37fe700 1 -- 172.21.15.60:0/2281750551 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2a8009c70 con 0x7fc2ac0b5570 2020-10-31T22:51:08.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2281750551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac0b5570 msgr2=0x7fc2ac0b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.618 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b1c4f700 1 --2- 172.21.15.60:0/2281750551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac0b5570 0x7fc2ac0b5950 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 rx=0x7fc2ac05f580 tx=0x7fc2a8006e80).stop 2020-10-31T22:51:08.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2281750551 shutdown_connections 2020-10-31T22:51:08.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b1c4f700 1 --2- 172.21.15.60:0/2281750551 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2ac141fe0 0x7fc2ac142490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b1c4f700 1 --2- 172.21.15.60:0/2281750551 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac0b5570 0x7fc2ac0b5950 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2281750551 >> 172.21.15.60:0/2281750551 conn(0x7fc2ac0b8e90 msgr2=0x7fc2ac0b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:08.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2281750551 shutdown_connections 2020-10-31T22:51:08.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.605+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2281750551 wait complete. 2020-10-31T22:51:08.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.609+0000 7fc2b1c4f700 1 Processor -- start 2020-10-31T22:51:08.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.609+0000 7fc2b1c4f700 1 -- start start 2020-10-31T22:51:08.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.609+0000 7fc2b1c4f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2ac0b24a0 0x7fc2ac13cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.609+0000 7fc2b1c4f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2ac0b5570 0x7fc2ac150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.609+0000 7fc2b1c4f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac141fe0 0x7fc2ac1512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.609+0000 7fc2b1c4f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac150730 con 0x7fc2ac141fe0 2020-10-31T22:51:08.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.609+0000 7fc2b1c4f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac0b7290 con 0x7fc2ac0b5570 2020-10-31T22:51:08.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.609+0000 7fc2b1c4f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ac0b7530 con 0x7fc2ac0b24a0 2020-10-31T22:51:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.609+0000 7fc2b144e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac141fe0 0x7fc2ac1512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.609+0000 7fc2b0c4d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2ac0b24a0 0x7fc2ac13cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.609+0000 7fc2b144e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac141fe0 0x7fc2ac1512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50118/0 (socket says 172.21.15.60:50118) 2020-10-31T22:51:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.609+0000 7fc2b144e700 1 -- 172.21.15.60:0/2126510540 learned_addr learned my addr 172.21.15.60:0/2126510540 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.609+0000 7fc2a3fff700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2ac0b5570 0x7fc2ac150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.626 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2b144e700 1 -- 172.21.15.60:0/2126510540 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2ac0b24a0 msgr2=0x7fc2ac13cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2b144e700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2ac0b24a0 0x7fc2ac13cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2b144e700 1 -- 172.21.15.60:0/2126510540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2ac0b5570 msgr2=0x7fc2ac150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2b144e700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2ac0b5570 0x7fc2ac150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2b144e700 1 -- 172.21.15.60:0/2126510540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ac150920 con 0x7fc2ac141fe0 2020-10-31T22:51:08.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2b0c4d700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2ac0b24a0 0x7fc2ac13cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:08.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2a3fff700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2ac0b5570 0x7fc2ac150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:08.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2b144e700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac141fe0 0x7fc2ac1512b0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7fc2a4006dd0 tx=0x7fc2a40091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:08.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2a1ffb700 1 -- 172.21.15.60:0/2126510540 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2a400c950 con 0x7fc2ac141fe0 2020-10-31T22:51:08.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2a1ffb700 1 -- 172.21.15.60:0/2126510540 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2a400cab0 con 0x7fc2ac141fe0 2020-10-31T22:51:08.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2126510540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ac141920 con 0x7fc2ac141fe0 2020-10-31T22:51:08.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2a1ffb700 1 -- 172.21.15.60:0/2126510540 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc2a400ce10 con 0x7fc2ac141fe0 2020-10-31T22:51:08.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2126510540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ac153ee0 con 0x7fc2ac141fe0 2020-10-31T22:51:08.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2126510540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2ac0b70c0 con 0x7fc2ac141fe0 2020-10-31T22:51:08.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2a1ffb700 1 -- 172.21.15.60:0/2126510540 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc2a4022070 con 0x7fc2ac141fe0 2020-10-31T22:51:08.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2a1ffb700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc28c054f90 0x7fc28c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2a1ffb700 1 -- 172.21.15.60:0/2126510540 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc2a406dff0 con 0x7fc2ac141fe0 2020-10-31T22:51:08.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.613+0000 7fc2b0c4d700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc28c054f90 0x7fc28c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.617+0000 7fc2b0c4d700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc28c054f90 0x7fc28c057450 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fc2a801c000 tx=0x7fc2a8015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:08.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.621+0000 7fc2a1ffb700 1 -- 172.21.15.60:0/2126510540 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc2a4044510 con 0x7fc2ac141fe0 2020-10-31T22:51:08.769 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.765+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2126510540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2ac150ab0 con 0x7fc2ac141fe0 2020-10-31T22:51:08.771 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.765+0000 7fc2a1ffb700 1 -- 172.21.15.60:0/2126510540 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16065 (secure 0 0 0) 0x7fc2a4016070 con 0x7fc2ac141fe0 2020-10-31T22:51:08.772 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:08.772 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":159,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:51:08.474423+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:51:06.207804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2020-10-31T22:51:07.488114+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:51:08.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.769+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2126510540 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc28c054f90 msgr2=0x7fc28c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.773 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.769+0000 7fc2b1c4f700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc28c054f90 0x7fc28c057450 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 rx=0x7fc2a801c000 tx=0x7fc2a8015000).stop 2020-10-31T22:51:08.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.769+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2126510540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac141fe0 msgr2=0x7fc2ac1512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.769+0000 7fc2b1c4f700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac141fe0 0x7fc2ac1512b0 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 rx=0x7fc2a4006dd0 tx=0x7fc2a40091a0).stop 2020-10-31T22:51:08.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.769+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2126510540 shutdown_connections 2020-10-31T22:51:08.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.769+0000 7fc2b1c4f700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2ac141fe0 0x7fc2ac1512b0 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.769+0000 7fc2b1c4f700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2ac0b24a0 0x7fc2ac13cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.774 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.769+0000 7fc2b1c4f700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc28c054f90 0x7fc28c057450 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.769+0000 7fc2b1c4f700 1 --2- 172.21.15.60:0/2126510540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2ac0b5570 0x7fc2ac150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.769+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2126510540 >> 172.21.15.60:0/2126510540 conn(0x7fc2ac0b8e90 msgr2=0x7fc2ac13dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:08.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.769+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2126510540 shutdown_connections 2020-10-31T22:51:08.775 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.769+0000 7fc2b1c4f700 1 -- 172.21.15.60:0/2126510540 wait complete. 2020-10-31T22:51:08.786 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:51:08.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262f59e700 1 Processor -- start 2020-10-31T22:51:08.897 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262f59e700 1 -- start start 2020-10-31T22:51:08.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262f59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f26300af520 0x7f26300ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262f59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2630066c90 0x7f26300670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.899 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262f59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26300af900 con 0x7f2630146060 2020-10-31T22:51:08.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262f59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26300afc10 con 0x7f2630066c90 2020-10-31T22:51:08.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262f59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263005bb70 con 0x7f26300af520 2020-10-31T22:51:08.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262dd9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f2630066c90 0x7f26300670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262ed9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f2630146060 0x7f2630149620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54262/0 (socket says 172.21.15.60:54262) 2020-10-31T22:51:08.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262ed9d700 1 -- 172.21.15.60:0/3002188927 learned_addr learned my addr 172.21.15.60:0/3002188927 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:08.900 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262e59c700 1 --2- 172.21.15.60:0/3002188927 >> v2:172.21.15.66:3300/0 conn(0x7f26300af520 0x7f26300ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262e59c700 1 -- 172.21.15.60:0/3002188927 >> v2:172.21.15.60:3300/0 conn(0x7f2630066c90 msgr2=0x7f26300670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:08.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262e59c700 1 --2- 172.21.15.60:0/3002188927 >> v2:172.21.15.60:3300/0 conn(0x7f2630066c90 0x7f26300670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262e59c700 1 -- 172.21.15.60:0/3002188927 >> v1:172.21.15.60:6789/0 conn(0x7f2630146060 legacy=0x7f2630149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262d59a700 1 -- 172.21.15.60:0/3002188927 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448073301 0 0) 0x7f26300af900 con 0x7f2630146060 2020-10-31T22:51:08.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262e59c700 1 -- 172.21.15.60:0/3002188927 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300ac130 con 0x7f26300af520 2020-10-31T22:51:08.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262dd9b700 1 --2- 172.21.15.60:0/3002188927 >> v2:172.21.15.60:3300/0 conn(0x7f2630066c90 0x7f26300670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262e59c700 1 --2- 172.21.15.60:0/3002188927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26300af520 0x7f26300ac870 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f26200032b0 tx=0x7f26200091a0).ready entity=mon.1 client_cookie=d69d8b5da7decfce server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262d59a700 1 -- 172.21.15.60:0/3002188927 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262000b9a0 con 0x7f26300af520 2020-10-31T22:51:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262d59a700 1 -- 172.21.15.60:0/3002188927 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f262000bb00 con 0x7f26300af520 2020-10-31T22:51:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262d59a700 1 -- 172.21.15.60:0/3002188927 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f262000bc70 con 0x7f26300af520 2020-10-31T22:51:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262f59e700 1 -- 172.21.15.60:0/3002188927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26300af520 msgr2=0x7f26300ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.902 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.893+0000 7f262f59e700 1 --2- 172.21.15.60:0/3002188927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26300af520 0x7f26300ac870 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f26200032b0 tx=0x7f26200091a0).stop 2020-10-31T22:51:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.897+0000 7f262f59e700 1 -- 172.21.15.60:0/3002188927 shutdown_connections 2020-10-31T22:51:08.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.897+0000 7f262f59e700 1 --2- 172.21.15.60:0/3002188927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f26300af520 0x7f26300ac870 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.897+0000 7f262f59e700 1 --2- 172.21.15.60:0/3002188927 >> v2:172.21.15.60:3300/0 conn(0x7f2630066c90 0x7f26300670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.897+0000 7f262f59e700 1 -- 172.21.15.60:0/3002188927 >> 172.21.15.60:0/3002188927 conn(0x7f26300b3fd0 msgr2=0x7f26300b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.897+0000 7f262f59e700 1 -- 172.21.15.60:0/3002188927 shutdown_connections 2020-10-31T22:51:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.897+0000 7f262f59e700 1 -- 172.21.15.60:0/3002188927 wait complete. 2020-10-31T22:51:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.897+0000 7f262f59e700 1 Processor -- start 2020-10-31T22:51:08.904 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.897+0000 7f262f59e700 1 -- start start 2020-10-31T22:51:08.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.897+0000 7f262f59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2630066c90 0x7f2630061b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.897+0000 7f262f59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26300af520 0x7f263013fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.897+0000 7f262f59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2630146060 0x7f2630140350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.897+0000 7f262f59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2630066570 con 0x7f26300af520 2020-10-31T22:51:08.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.897+0000 7f262f59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26300aab00 con 0x7f2630066c90 2020-10-31T22:51:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.897+0000 7f262f59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2630158780 con 0x7f2630146060 2020-10-31T22:51:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26300af520 0x7f263013fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262dd9b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26300af520 0x7f263013fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50130/0 (socket says 172.21.15.60:50130) 2020-10-31T22:51:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262dd9b700 1 -- 172.21.15.60:0/2500825337 learned_addr learned my addr 172.21.15.60:0/2500825337 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262e59c700 1 --2- 172.21.15.60:0/2500825337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2630066c90 0x7f2630061b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262ed9d700 1 --2- 172.21.15.60:0/2500825337 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2630146060 0x7f2630140350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262dd9b700 1 -- 172.21.15.60:0/2500825337 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2630146060 msgr2=0x7f2630140350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262dd9b700 1 --2- 172.21.15.60:0/2500825337 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2630146060 0x7f2630140350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262dd9b700 1 -- 172.21.15.60:0/2500825337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2630066c90 msgr2=0x7f2630061b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262dd9b700 1 --2- 172.21.15.60:0/2500825337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2630066c90 0x7f2630061b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262dd9b700 1 -- 172.21.15.60:0/2500825337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26301584e0 con 0x7f26300af520 2020-10-31T22:51:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262dd9b700 1 --2- 172.21.15.60:0/2500825337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26300af520 0x7f263013fe60 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f2630158910 tx=0x7f2618006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:08.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f26277fe700 1 -- 172.21.15.60:0/2500825337 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f261800cb40 con 0x7f26300af520 2020-10-31T22:51:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f26277fe700 1 -- 172.21.15.60:0/2500825337 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f261800cca0 con 0x7f26300af520 2020-10-31T22:51:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f26277fe700 1 -- 172.21.15.60:0/2500825337 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f26180123f0 con 0x7f26300af520 2020-10-31T22:51:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262f59e700 1 -- 172.21.15.60:0/2500825337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2630061600 con 0x7f26300af520 2020-10-31T22:51:08.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262f59e700 1 -- 172.21.15.60:0/2500825337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26300aad30 con 0x7f26300af520 2020-10-31T22:51:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f26277fe700 1 -- 172.21.15.60:0/2500825337 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2618012550 con 0x7f26300af520 2020-10-31T22:51:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262f59e700 1 -- 172.21.15.60:0/2500825337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2630057100 con 0x7f26300af520 2020-10-31T22:51:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f26277fe700 1 --2- 172.21.15.60:0/2500825337 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2614054f30 0x7f26140573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f26277fe700 1 -- 172.21.15.60:0/2500825337 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f261806dff0 con 0x7f26300af520 2020-10-31T22:51:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262e59c700 1 --2- 172.21.15.60:0/2500825337 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2614054f30 0x7f26140573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:08.910 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.901+0000 7f262e59c700 1 --2- 172.21.15.60:0/2500825337 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2614054f30 0x7f26140573f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f262001b000 tx=0x7f2620016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:08.913 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:08.909+0000 7f26277fe700 1 -- 172.21.15.60:0/2500825337 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2618044410 con 0x7f26300af520 2020-10-31T22:51:09.058 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.053+0000 7f262f59e700 1 -- 172.21.15.60:0/2500825337 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f26300afe20 con 0x7f26300af520 2020-10-31T22:51:09.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.057+0000 7f26277fe700 1 -- 172.21.15.60:0/2500825337 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) v1 ==== 74+0+16065 (secure 0 0 0) 0x7f2618047a30 con 0x7f26300af520 2020-10-31T22:51:09.061 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:09.061 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":159,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:51:08.474423+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:51:06.207804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2020-10-31T22:51:07.488114+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:51:09.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.057+0000 7f262f59e700 1 -- 172.21.15.60:0/2500825337 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2614054f30 msgr2=0x7f26140573f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.062 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.057+0000 7f262f59e700 1 --2- 172.21.15.60:0/2500825337 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2614054f30 0x7f26140573f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 rx=0x7f262001b000 tx=0x7f2620016000).stop 2020-10-31T22:51:09.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.057+0000 7f262f59e700 1 -- 172.21.15.60:0/2500825337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26300af520 msgr2=0x7f263013fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.057+0000 7f262f59e700 1 --2- 172.21.15.60:0/2500825337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26300af520 0x7f263013fe60 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 rx=0x7f2630158910 tx=0x7f2618006dc0).stop 2020-10-31T22:51:09.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.057+0000 7f262f59e700 1 -- 172.21.15.60:0/2500825337 shutdown_connections 2020-10-31T22:51:09.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.057+0000 7f262f59e700 1 --2- 172.21.15.60:0/2500825337 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2630146060 0x7f2630140350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.057+0000 7f262f59e700 1 --2- 172.21.15.60:0/2500825337 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2614054f30 0x7f26140573f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.063 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.057+0000 7f262f59e700 1 --2- 172.21.15.60:0/2500825337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2630066c90 0x7f2630061b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.057+0000 7f262f59e700 1 --2- 172.21.15.60:0/2500825337 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26300af520 0x7f263013fe60 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.057+0000 7f262f59e700 1 -- 172.21.15.60:0/2500825337 >> 172.21.15.60:0/2500825337 conn(0x7f26300b3fd0 msgr2=0x7f26300b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:09.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.057+0000 7f262f59e700 1 -- 172.21.15.60:0/2500825337 shutdown_connections 2020-10-31T22:51:09.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.057+0000 7f262f59e700 1 -- 172.21.15.60:0/2500825337 wait complete. 2020-10-31T22:51:09.076 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-10-31T22:51:09.194 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.189+0000 7f3464fca700 1 Processor -- start 2020-10-31T22:51:09.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.189+0000 7f3464fca700 1 -- start start 2020-10-31T22:51:09.195 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.189+0000 7f3464fca700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34600b24a0 0x7f34600b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.189+0000 7f3464fca700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3460141f00 0x7f3460142360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.189+0000 7f3464fca700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34600b4440 con 0x7f34600b5570 2020-10-31T22:51:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.189+0000 7f3464fca700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f346013f930 con 0x7f34600b24a0 2020-10-31T22:51:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.189+0000 7f3464fca700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3460146060 con 0x7f3460141f00 2020-10-31T22:51:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.189+0000 7f345f7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f34600b5570 0x7f3460145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54272/0 (socket says 172.21.15.60:54272) 2020-10-31T22:51:09.196 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.189+0000 7f345f7fe700 1 -- 172.21.15.60:0/1146056470 learned_addr learned my addr 172.21.15.60:0/1146056470 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:09.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.189+0000 7f345effd700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f34600b24a0 0x7f34600b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.197 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.189+0000 7f345ffff700 1 --2- 172.21.15.60:0/1146056470 >> v2:172.21.15.66:3300/0 conn(0x7f3460141f00 0x7f3460142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f345effd700 1 -- 172.21.15.60:0/1146056470 >> v2:172.21.15.66:3300/0 conn(0x7f3460141f00 msgr2=0x7f3460142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:09.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f345effd700 1 --2- 172.21.15.60:0/1146056470 >> v2:172.21.15.66:3300/0 conn(0x7f3460141f00 0x7f3460142360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f345effd700 1 -- 172.21.15.60:0/1146056470 >> v1:172.21.15.60:6789/0 conn(0x7f34600b5570 legacy=0x7f3460145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f345e7fc700 1 -- 172.21.15.60:0/1146056470 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205540490 0 0) 0x7f34600b4440 con 0x7f34600b5570 2020-10-31T22:51:09.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f345effd700 1 -- 172.21.15.60:0/1146056470 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34600b02f0 con 0x7f34600b24a0 2020-10-31T22:51:09.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f345effd700 1 --2- 172.21.15.60:0/1146056470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34600b24a0 0x7f34600b5950 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f3454002f30 tx=0x7f3454006dc0).ready entity=mon.0 client_cookie=3e77e7436a012763 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:09.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f345e7fc700 1 -- 172.21.15.60:0/1146056470 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f34540097b0 con 0x7f34600b24a0 2020-10-31T22:51:09.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f345e7fc700 1 -- 172.21.15.60:0/1146056470 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3454009910 con 0x7f34600b24a0 2020-10-31T22:51:09.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f345e7fc700 1 -- 172.21.15.60:0/1146056470 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3454009c70 con 0x7f34600b24a0 2020-10-31T22:51:09.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f3464fca700 1 -- 172.21.15.60:0/1146056470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34600b24a0 msgr2=0x7f34600b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f3464fca700 1 --2- 172.21.15.60:0/1146056470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34600b24a0 0x7f34600b5950 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 rx=0x7f3454002f30 tx=0x7f3454006dc0).stop 2020-10-31T22:51:09.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f3464fca700 1 -- 172.21.15.60:0/1146056470 shutdown_connections 2020-10-31T22:51:09.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f3464fca700 1 --2- 172.21.15.60:0/1146056470 >> v2:172.21.15.66:3300/0 conn(0x7f3460141f00 0x7f3460142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f3464fca700 1 --2- 172.21.15.60:0/1146056470 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34600b24a0 0x7f34600b5950 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.200 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f3464fca700 1 -- 172.21.15.60:0/1146056470 >> 172.21.15.60:0/1146056470 conn(0x7f34600b8e90 msgr2=0x7f34600b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:09.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f3464fca700 1 -- 172.21.15.60:0/1146056470 shutdown_connections 2020-10-31T22:51:09.201 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f3464fca700 1 -- 172.21.15.60:0/1146056470 wait complete. 2020-10-31T22:51:09.202 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f3464fca700 1 Processor -- start 2020-10-31T22:51:09.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.193+0000 7f3464fca700 1 -- start start 2020-10-31T22:51:09.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f3464fca700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34600b24a0 0x7f3460144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f3464fca700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34600b5570 0x7f34600b6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f3464fca700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3460141f00 0x7f346013e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f3464fca700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34600ad2e0 con 0x7f34600b5570 2020-10-31T22:51:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f3464fca700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34600ac250 con 0x7f34600b24a0 2020-10-31T22:51:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f3464fca700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34600ac4f0 con 0x7f3460141f00 2020-10-31T22:51:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34600b5570 0x7f34600b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345effd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34600b5570 0x7f34600b6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50146/0 (socket says 172.21.15.60:50146) 2020-10-31T22:51:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345effd700 1 -- 172.21.15.60:0/963648995 learned_addr learned my addr 172.21.15.60:0/963648995 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345f7fe700 1 --2- 172.21.15.60:0/963648995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34600b24a0 0x7f3460144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.204 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345ffff700 1 --2- 172.21.15.60:0/963648995 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3460141f00 0x7f346013e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345effd700 1 -- 172.21.15.60:0/963648995 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3460141f00 msgr2=0x7f346013e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345effd700 1 --2- 172.21.15.60:0/963648995 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3460141f00 0x7f346013e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345effd700 1 -- 172.21.15.60:0/963648995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34600b24a0 msgr2=0x7f3460144150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345effd700 1 --2- 172.21.15.60:0/963648995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34600b24a0 0x7f3460144150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345effd700 1 -- 172.21.15.60:0/963648995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34600ac790 con 0x7f34600b5570 2020-10-31T22:51:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345effd700 1 --2- 172.21.15.60:0/963648995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34600b5570 0x7f34600b6830 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f3454002f30 tx=0x7f3454015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345cff9700 1 -- 172.21.15.60:0/963648995 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3454011a30 con 0x7f34600b5570 2020-10-31T22:51:09.205 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345cff9700 1 -- 172.21.15.60:0/963648995 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3454011b90 con 0x7f34600b5570 2020-10-31T22:51:09.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f3464fca700 1 -- 172.21.15.60:0/963648995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34600acba0 con 0x7f34600b5570 2020-10-31T22:51:09.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345cff9700 1 -- 172.21.15.60:0/963648995 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f345401d440 con 0x7f34600b5570 2020-10-31T22:51:09.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f3464fca700 1 -- 172.21.15.60:0/963648995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34600af150 con 0x7f34600b5570 2020-10-31T22:51:09.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f3464fca700 1 -- 172.21.15.60:0/963648995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3460057100 con 0x7f34600b5570 2020-10-31T22:51:09.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.197+0000 7f345cff9700 1 -- 172.21.15.60:0/963648995 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3454017070 con 0x7f34600b5570 2020-10-31T22:51:09.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.201+0000 7f345cff9700 1 --2- 172.21.15.60:0/963648995 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3440054f90 0x7f3440057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.201+0000 7f345cff9700 1 -- 172.21.15.60:0/963648995 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f345406e680 con 0x7f34600b5570 2020-10-31T22:51:09.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.201+0000 7f345f7fe700 1 --2- 172.21.15.60:0/963648995 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3440054f90 0x7f3440057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.201+0000 7f345f7fe700 1 --2- 172.21.15.60:0/963648995 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3440054f90 0x7f3440057450 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f345000d000 tx=0x7f3450007910).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:09.215 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.209+0000 7f345cff9700 1 -- 172.21.15.60:0/963648995 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3454044b00 con 0x7f34600b5570 2020-10-31T22:51:09.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.401+0000 7f3464fca700 1 -- 172.21.15.60:0/963648995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f34600008d0 con 0x7f34600b5570 2020-10-31T22:51:09.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.477+0000 7f345cff9700 1 -- 172.21.15.60:0/963648995 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v81) v1 ==== 118+0+0 (secure 0 0 0) 0x7f34540220b0 con 0x7f34600b5570 2020-10-31T22:51:09.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.481+0000 7f3464fca700 1 -- 172.21.15.60:0/963648995 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3440054f90 msgr2=0x7f3440057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.481+0000 7f3464fca700 1 --2- 172.21.15.60:0/963648995 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3440054f90 0x7f3440057450 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 rx=0x7f345000d000 tx=0x7f3450007910).stop 2020-10-31T22:51:09.487 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.481+0000 7f3464fca700 1 -- 172.21.15.60:0/963648995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34600b5570 msgr2=0x7f34600b6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.481+0000 7f3464fca700 1 --2- 172.21.15.60:0/963648995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34600b5570 0x7f34600b6830 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 rx=0x7f3454002f30 tx=0x7f3454015000).stop 2020-10-31T22:51:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.481+0000 7f3464fca700 1 -- 172.21.15.60:0/963648995 shutdown_connections 2020-10-31T22:51:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.481+0000 7f3464fca700 1 --2- 172.21.15.60:0/963648995 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3460141f00 0x7f346013e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.481+0000 7f3464fca700 1 --2- 172.21.15.60:0/963648995 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f3440054f90 0x7f3440057450 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.488 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.481+0000 7f3464fca700 1 --2- 172.21.15.60:0/963648995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34600b24a0 0x7f3460144150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.481+0000 7f3464fca700 1 --2- 172.21.15.60:0/963648995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f34600b5570 0x7f34600b6830 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.481+0000 7f3464fca700 1 -- 172.21.15.60:0/963648995 >> 172.21.15.60:0/963648995 conn(0x7f34600b8e90 msgr2=0x7f34600b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:09.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.481+0000 7f3464fca700 1 -- 172.21.15.60:0/963648995 shutdown_connections 2020-10-31T22:51:09.489 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.481+0000 7f3464fca700 1 -- 172.21.15.60:0/963648995 wait complete. 2020-10-31T22:51:09.505 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:51:09.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.613+0000 7f340c993700 1 Processor -- start 2020-10-31T22:51:09.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.613+0000 7f340c993700 1 -- start start 2020-10-31T22:51:09.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.613+0000 7f340c993700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34080b5570 0x7f34080b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.613+0000 7f340c993700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f34080b24a0 0x7f3408145820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.613+0000 7f340c993700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3408145180 con 0x7f3408145d10 2020-10-31T22:51:09.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.613+0000 7f340c993700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34080afae0 con 0x7f34080b24a0 2020-10-31T22:51:09.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.613+0000 7f340c993700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3408141bf0 con 0x7f34080b5570 2020-10-31T22:51:09.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.613+0000 7f3406ffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f34080b24a0 0x7f3408145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.613+0000 7f34077fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34080b5570 0x7f34080b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f3407fff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f3408145d10 0x7f3408141fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:52158/0 (socket says 172.21.15.60:52158) 2020-10-31T22:51:09.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f3407fff700 1 -- 172.21.15.60:0/3955081927 learned_addr learned my addr 172.21.15.60:0/3955081927 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:09.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f3406ffd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f34080b24a0 0x7f3408145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:32854/0 (socket says 172.21.15.60:32854) 2020-10-31T22:51:09.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f3406ffd700 1 -- 172.21.15.60:0/3955081927 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34080b5570 msgr2=0x7f34080b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:09.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f3406ffd700 1 --2- 172.21.15.60:0/3955081927 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34080b5570 0x7f34080b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f3406ffd700 1 -- 172.21.15.60:0/3955081927 >> v1:172.21.15.66:6789/0 conn(0x7f3408145d10 legacy=0x7f3408141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f3406ffd700 1 -- 172.21.15.60:0/3955081927 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34080b0670 con 0x7f34080b24a0 2020-10-31T22:51:09.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f3406ffd700 1 --2- 172.21.15.60:0/3955081927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34080b24a0 0x7f3408145820 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f33f0002f30 tx=0x7f33f0006dc0).ready entity=mon.1 client_cookie=1ee12fa5a87a1950 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:09.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f34067fc700 1 -- 172.21.15.60:0/3955081927 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33f0009760 con 0x7f34080b24a0 2020-10-31T22:51:09.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f34067fc700 1 -- 172.21.15.60:0/3955081927 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f00098c0 con 0x7f34080b24a0 2020-10-31T22:51:09.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f34067fc700 1 -- 172.21.15.60:0/3955081927 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33f0009c20 con 0x7f34080b24a0 2020-10-31T22:51:09.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f340c993700 1 -- 172.21.15.60:0/3955081927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34080b24a0 msgr2=0x7f3408145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f340c993700 1 --2- 172.21.15.60:0/3955081927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34080b24a0 0x7f3408145820 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f33f0002f30 tx=0x7f33f0006dc0).stop 2020-10-31T22:51:09.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f340c993700 1 -- 172.21.15.60:0/3955081927 shutdown_connections 2020-10-31T22:51:09.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f340c993700 1 --2- 172.21.15.60:0/3955081927 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34080b5570 0x7f34080b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f340c993700 1 --2- 172.21.15.60:0/3955081927 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34080b24a0 0x7f3408145820 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f340c993700 1 -- 172.21.15.60:0/3955081927 >> 172.21.15.60:0/3955081927 conn(0x7f34080b8e90 msgr2=0x7f34080b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:09.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f340c993700 1 -- 172.21.15.60:0/3955081927 shutdown_connections 2020-10-31T22:51:09.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f340c993700 1 -- 172.21.15.60:0/3955081927 wait complete. 2020-10-31T22:51:09.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f340c993700 1 Processor -- start 2020-10-31T22:51:09.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.617+0000 7f340c993700 1 -- start start 2020-10-31T22:51:09.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f340c993700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34080b24a0 0x7f3408141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f340c993700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34080b5570 0x7f34081396e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f340c993700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3408145d10 0x7f34081408c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f340c993700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340813fd30 con 0x7f3408145d10 2020-10-31T22:51:09.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f340c993700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3408148530 con 0x7f34080b24a0 2020-10-31T22:51:09.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f340c993700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3408148790 con 0x7f34080b5570 2020-10-31T22:51:09.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3407fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3408145d10 0x7f34081408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3406ffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34080b5570 0x7f34081396e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f34077fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34080b24a0 0x7f3408141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3406ffd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34080b5570 0x7f34081396e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:35114/0 (socket says 172.21.15.60:35114) 2020-10-31T22:51:09.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3407fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3408145d10 0x7f34081408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50160/0 (socket says 172.21.15.60:50160) 2020-10-31T22:51:09.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f34077fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34080b24a0 0x7f3408141580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:32860/0 (socket says 172.21.15.60:32860) 2020-10-31T22:51:09.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3406ffd700 1 -- 172.21.15.60:0/1532756383 learned_addr learned my addr 172.21.15.60:0/1532756383 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:09.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3407fff700 1 -- 172.21.15.60:0/1532756383 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34080b5570 msgr2=0x7f34081396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3407fff700 1 --2- 172.21.15.60:0/1532756383 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34080b5570 0x7f34081396e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3407fff700 1 -- 172.21.15.60:0/1532756383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34080b24a0 msgr2=0x7f3408141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3407fff700 1 --2- 172.21.15.60:0/1532756383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34080b24a0 0x7f3408141580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3407fff700 1 -- 172.21.15.60:0/1532756383 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3408148a30 con 0x7f3408145d10 2020-10-31T22:51:09.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3406ffd700 1 --2- 172.21.15.60:0/1532756383 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34080b5570 0x7f34081396e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:09.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3407fff700 1 --2- 172.21.15.60:0/1532756383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3408145d10 0x7f34081408c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f34080610d0 tx=0x7f3400007dd0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:09.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3404ff9700 1 -- 172.21.15.60:0/1532756383 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3400005c40 con 0x7f3408145d10 2020-10-31T22:51:09.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3404ff9700 1 -- 172.21.15.60:0/1532756383 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3400005da0 con 0x7f3408145d10 2020-10-31T22:51:09.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f340c993700 1 -- 172.21.15.60:0/1532756383 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34081491e0 con 0x7f3408145d10 2020-10-31T22:51:09.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f3404ff9700 1 -- 172.21.15.60:0/1532756383 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3400007300 con 0x7f3408145d10 2020-10-31T22:51:09.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f340c993700 1 -- 172.21.15.60:0/1532756383 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340813be40 con 0x7f3408145d10 2020-10-31T22:51:09.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.621+0000 7f340c993700 1 -- 172.21.15.60:0/1532756383 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3408057100 con 0x7f3408145d10 2020-10-31T22:51:09.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.625+0000 7f3404ff9700 1 -- 172.21.15.60:0/1532756383 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f3400010030 con 0x7f3408145d10 2020-10-31T22:51:09.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.625+0000 7f3404ff9700 1 --2- 172.21.15.60:0/1532756383 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33ec054f10 0x7f33ec0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.625+0000 7f3404ff9700 1 -- 172.21.15.60:0/1532756383 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f340006d960 con 0x7f3408145d10 2020-10-31T22:51:09.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.625+0000 7f34077fe700 1 --2- 172.21.15.60:0/1532756383 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33ec054f10 0x7f33ec0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.625+0000 7f34077fe700 1 --2- 172.21.15.60:0/1532756383 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33ec054f10 0x7f33ec0573d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f33f800b000 tx=0x7f33f8006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:09.637 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.633+0000 7f3404ff9700 1 -- 172.21.15.60:0/1532756383 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f3400043d80 con 0x7f3408145d10 2020-10-31T22:51:09.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.821+0000 7f340c993700 1 -- 172.21.15.60:0/1532756383 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3408148bc0 con 0x7f3408145d10 2020-10-31T22:51:09.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.821+0000 7f3404ff9700 1 -- 172.21.15.60:0/1532756383 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f34000473a0 con 0x7f3408145d10 2020-10-31T22:51:09.828 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:09.828 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":81,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/542860877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":542860877},{"type":"v1","addr":"172.21.15.66:6833","nonce":542860877}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79},{"gid":8535,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/480001574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":480001574},{"type":"v1","addr":"172.21.15.60:6835","nonce":480001574}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:51:08.474776+0000","modified":"2020-10-31T22:51:09.477436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/364183995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":364183995},{"type":"v1","addr":"172.21.15.60:6837","nonce":364183995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-10-31T22:51:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.825+0000 7f340c993700 1 -- 172.21.15.60:0/1532756383 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33ec054f10 msgr2=0x7f33ec0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.825+0000 7f340c993700 1 --2- 172.21.15.60:0/1532756383 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33ec054f10 0x7f33ec0573d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 rx=0x7f33f800b000 tx=0x7f33f8006dc0).stop 2020-10-31T22:51:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.825+0000 7f340c993700 1 -- 172.21.15.60:0/1532756383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3408145d10 msgr2=0x7f34081408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.825+0000 7f340c993700 1 --2- 172.21.15.60:0/1532756383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3408145d10 0x7f34081408c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 rx=0x7f34080610d0 tx=0x7f3400007dd0).stop 2020-10-31T22:51:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.825+0000 7f340c993700 1 -- 172.21.15.60:0/1532756383 shutdown_connections 2020-10-31T22:51:09.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.825+0000 7f340c993700 1 --2- 172.21.15.60:0/1532756383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3408145d10 0x7f34081408c0 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.825+0000 7f340c993700 1 --2- 172.21.15.60:0/1532756383 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f33ec054f10 0x7f33ec0573d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.825+0000 7f340c993700 1 --2- 172.21.15.60:0/1532756383 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34080b24a0 0x7f3408141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.825+0000 7f340c993700 1 --2- 172.21.15.60:0/1532756383 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34080b5570 0x7f34081396e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.825+0000 7f340c993700 1 -- 172.21.15.60:0/1532756383 >> 172.21.15.60:0/1532756383 conn(0x7f34080b8e90 msgr2=0x7f340805f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.825+0000 7f340c993700 1 -- 172.21.15.60:0/1532756383 shutdown_connections 2020-10-31T22:51:09.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.825+0000 7f340c993700 1 -- 172.21.15.60:0/1532756383 wait complete. 2020-10-31T22:51:09.833 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 81 2020-10-31T22:51:09.842 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:51:09.955 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.949+0000 7f9f074aa700 1 Processor -- start 2020-10-31T22:51:09.956 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.949+0000 7f9f074aa700 1 -- start start 2020-10-31T22:51:09.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.949+0000 7f9f074aa700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9f000af520 0x7f9f000ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.949+0000 7f9f074aa700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f000670f0 0x7f9f00150980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.949+0000 7f9f074aa700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f000af900 con 0x7f9f00066c90 2020-10-31T22:51:09.958 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.949+0000 7f9f074aa700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f000afc10 con 0x7f9f000af520 2020-10-31T22:51:09.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.949+0000 7f9f074aa700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0005bb70 con 0x7f9f000670f0 2020-10-31T22:51:09.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.949+0000 7f9f06ca9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f000670f0 0x7f9f00150980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.949+0000 7f9f064a8700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9f000af520 0x7f9f000ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.949+0000 7f9f05ca7700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f9f00066c90 0x7f9f00146060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:52168/0 (socket says 172.21.15.60:52168) 2020-10-31T22:51:09.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.949+0000 7f9f06ca9700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f000670f0 0x7f9f00150980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:35120/0 (socket says 172.21.15.60:35120) 2020-10-31T22:51:09.959 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.949+0000 7f9f05ca7700 1 -- 172.21.15.60:0/859312632 learned_addr learned my addr 172.21.15.60:0/859312632 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:09.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f064a8700 1 -- 172.21.15.60:0/859312632 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f000670f0 msgr2=0x7f9f00150980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:09.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f064a8700 1 --2- 172.21.15.60:0/859312632 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f000670f0 0x7f9f00150980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f064a8700 1 -- 172.21.15.60:0/859312632 >> v1:172.21.15.66:6789/0 conn(0x7f9f00066c90 legacy=0x7f9f00146060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f054a6700 1 -- 172.21.15.60:0/859312632 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564654100 0 0) 0x7f9f000af900 con 0x7f9f00066c90 2020-10-31T22:51:09.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f064a8700 1 -- 172.21.15.60:0/859312632 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f000ac130 con 0x7f9f000af520 2020-10-31T22:51:09.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f06ca9700 1 --2- 172.21.15.60:0/859312632 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f000670f0 0x7f9f00150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:09.960 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f064a8700 1 --2- 172.21.15.60:0/859312632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f000af520 0x7f9f000ac870 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f9efc002f30 tx=0x7f9efc006dc0).ready entity=mon.1 client_cookie=3e78d0e261d10c5a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:09.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f054a6700 1 -- 172.21.15.60:0/859312632 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9efc009760 con 0x7f9f000af520 2020-10-31T22:51:09.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f054a6700 1 -- 172.21.15.60:0/859312632 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc0098c0 con 0x7f9f000af520 2020-10-31T22:51:09.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f054a6700 1 -- 172.21.15.60:0/859312632 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9efc009c20 con 0x7f9f000af520 2020-10-31T22:51:09.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f074aa700 1 -- 172.21.15.60:0/859312632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f000af520 msgr2=0x7f9f000ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.961 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f074aa700 1 --2- 172.21.15.60:0/859312632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f000af520 0x7f9f000ac870 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f9efc002f30 tx=0x7f9efc006dc0).stop 2020-10-31T22:51:09.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f074aa700 1 -- 172.21.15.60:0/859312632 shutdown_connections 2020-10-31T22:51:09.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f074aa700 1 --2- 172.21.15.60:0/859312632 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f000670f0 0x7f9f00150980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.963 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f074aa700 1 --2- 172.21.15.60:0/859312632 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f000af520 0x7f9f000ac870 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f074aa700 1 -- 172.21.15.60:0/859312632 >> 172.21.15.60:0/859312632 conn(0x7f9f000b3fd0 msgr2=0x7f9f000b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:09.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f074aa700 1 -- 172.21.15.60:0/859312632 shutdown_connections 2020-10-31T22:51:09.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f074aa700 1 -- 172.21.15.60:0/859312632 wait complete. 2020-10-31T22:51:09.964 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f074aa700 1 Processor -- start 2020-10-31T22:51:09.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.953+0000 7f9f074aa700 1 -- start start 2020-10-31T22:51:09.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f074aa700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f00066c90 0x7f9f00142ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f074aa700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f000670f0 0x7f9f00158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f074aa700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f000af520 0x7f9f00158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f074aa700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f0013f030 con 0x7f9f00066c90 2020-10-31T22:51:09.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f074aa700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f000aa710 con 0x7f9f000670f0 2020-10-31T22:51:09.965 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f074aa700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f000aa9b0 con 0x7f9f000af520 2020-10-31T22:51:09.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f064a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f00066c90 0x7f9f00142ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f064a8700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f00066c90 0x7f9f00142ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50172/0 (socket says 172.21.15.60:50172) 2020-10-31T22:51:09.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f064a8700 1 -- 172.21.15.60:0/1267332139 learned_addr learned my addr 172.21.15.60:0/1267332139 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:09.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f05ca7700 1 --2- 172.21.15.60:0/1267332139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f000670f0 0x7f9f00158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f06ca9700 1 --2- 172.21.15.60:0/1267332139 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f000af520 0x7f9f00158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f064a8700 1 -- 172.21.15.60:0/1267332139 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f000af520 msgr2=0x7f9f00158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f064a8700 1 --2- 172.21.15.60:0/1267332139 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f000af520 0x7f9f00158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f064a8700 1 -- 172.21.15.60:0/1267332139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f000670f0 msgr2=0x7f9f00158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:09.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f064a8700 1 --2- 172.21.15.60:0/1267332139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f000670f0 0x7f9f00158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:09.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f064a8700 1 -- 172.21.15.60:0/1267332139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f000a97a0 con 0x7f9f00066c90 2020-10-31T22:51:09.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f064a8700 1 --2- 172.21.15.60:0/1267332139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f00066c90 0x7f9f00142ec0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f9efc002f30 tx=0x7f9efc015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:09.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9ef37fe700 1 -- 172.21.15.60:0/1267332139 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9efc0119c0 con 0x7f9f00066c90 2020-10-31T22:51:09.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9ef37fe700 1 -- 172.21.15.60:0/1267332139 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc011b20 con 0x7f9f00066c90 2020-10-31T22:51:09.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f074aa700 1 -- 172.21.15.60:0/1267332139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f000a9a40 con 0x7f9f00066c90 2020-10-31T22:51:09.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9ef37fe700 1 -- 172.21.15.60:0/1267332139 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9efc011e80 con 0x7f9f00066c90 2020-10-31T22:51:09.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.957+0000 7f9f074aa700 1 -- 172.21.15.60:0/1267332139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f00140260 con 0x7f9f00066c90 2020-10-31T22:51:09.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.961+0000 7f9f074aa700 1 -- 172.21.15.60:0/1267332139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f000aa320 con 0x7f9f00066c90 2020-10-31T22:51:09.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.961+0000 7f9ef37fe700 1 -- 172.21.15.60:0/1267332139 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f9efc024030 con 0x7f9f00066c90 2020-10-31T22:51:09.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.961+0000 7f9ef37fe700 1 --2- 172.21.15.60:0/1267332139 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ee0054f90 0x7f9ee0057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:09.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.961+0000 7f9ef37fe700 1 -- 172.21.15.60:0/1267332139 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f9efc06e790 con 0x7f9f00066c90 2020-10-31T22:51:09.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.961+0000 7f9f05ca7700 1 --2- 172.21.15.60:0/1267332139 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ee0054f90 0x7f9ee0057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:09.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.961+0000 7f9f05ca7700 1 --2- 172.21.15.60:0/1267332139 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ee0054f90 0x7f9ee0057450 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f9ef400d000 tx=0x7f9ef40079d0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:09.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:09.965+0000 7f9ef37fe700 1 -- 172.21.15.60:0/1267332139 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f9efc044c10 con 0x7f9f00066c90 2020-10-31T22:51:10.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.109+0000 7f9f074aa700 1 -- 172.21.15.60:0/1267332139 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f00057100 con 0x7f9f00066c90 2020-10-31T22:51:10.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.109+0000 7f9ef37fe700 1 -- 172.21.15.60:0/1267332139 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f9efc022090 con 0x7f9f00066c90 2020-10-31T22:51:10.115 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:10.116 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":160,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:51:09.478155+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:51:06.207804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2020-10-31T22:51:07.488114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:51:10.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.113+0000 7f9f074aa700 1 -- 172.21.15.60:0/1267332139 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ee0054f90 msgr2=0x7f9ee0057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.113+0000 7f9f074aa700 1 --2- 172.21.15.60:0/1267332139 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ee0054f90 0x7f9ee0057450 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 rx=0x7f9ef400d000 tx=0x7f9ef40079d0).stop 2020-10-31T22:51:10.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.113+0000 7f9f074aa700 1 -- 172.21.15.60:0/1267332139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f00066c90 msgr2=0x7f9f00142ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.113+0000 7f9f074aa700 1 --2- 172.21.15.60:0/1267332139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f00066c90 0x7f9f00142ec0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 rx=0x7f9efc002f30 tx=0x7f9efc015000).stop 2020-10-31T22:51:10.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.113+0000 7f9f074aa700 1 -- 172.21.15.60:0/1267332139 shutdown_connections 2020-10-31T22:51:10.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.113+0000 7f9f074aa700 1 --2- 172.21.15.60:0/1267332139 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9f000af520 0x7f9f00158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.113+0000 7f9f074aa700 1 --2- 172.21.15.60:0/1267332139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f00066c90 0x7f9f00142ec0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.113+0000 7f9f074aa700 1 --2- 172.21.15.60:0/1267332139 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f9ee0054f90 0x7f9ee0057450 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.113+0000 7f9f074aa700 1 --2- 172.21.15.60:0/1267332139 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f000670f0 0x7f9f00158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.113+0000 7f9f074aa700 1 -- 172.21.15.60:0/1267332139 >> 172.21.15.60:0/1267332139 conn(0x7f9f000b3fd0 msgr2=0x7f9f001454a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:10.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.113+0000 7f9f074aa700 1 -- 172.21.15.60:0/1267332139 shutdown_connections 2020-10-31T22:51:10.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.113+0000 7f9f074aa700 1 -- 172.21.15.60:0/1267332139 wait complete. 2020-10-31T22:51:10.129 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:51:10.263 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49caad1700 1 Processor -- start 2020-10-31T22:51:10.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49caad1700 1 -- start start 2020-10-31T22:51:10.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49caad1700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f49c40b1570 0x7f49c4024f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49caad1700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f49c4025480 0x7f49c407fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49caad1700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c40b1950 con 0x7f49c40801c0 2020-10-31T22:51:10.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49caad1700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c4025910 con 0x7f49c4025480 2020-10-31T22:51:10.264 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49caad1700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c4062720 con 0x7f49c40b1570 2020-10-31T22:51:10.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49c9acf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f49c4025480 0x7f49c407fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49c9acf700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f49c4025480 0x7f49c407fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50180/0 (socket says 172.21.15.60:50180) 2020-10-31T22:51:10.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49c9acf700 1 -- 172.21.15.60:0/1341982569 learned_addr learned my addr 172.21.15.60:0/1341982569 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:10.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49ca2d0700 1 --2- 172.21.15.60:0/1341982569 >> v2:172.21.15.66:3300/0 conn(0x7f49c40b1570 0x7f49c4024f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49c9acf700 1 -- 172.21.15.60:0/1341982569 >> v2:172.21.15.66:3300/0 conn(0x7f49c40b1570 msgr2=0x7f49c4024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:10.265 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49c9acf700 1 --2- 172.21.15.60:0/1341982569 >> v2:172.21.15.66:3300/0 conn(0x7f49c40b1570 0x7f49c4024f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49c9acf700 1 -- 172.21.15.60:0/1341982569 >> v1:172.21.15.66:6789/0 conn(0x7f49c40801c0 legacy=0x7f49c40afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49c9acf700 1 -- 172.21.15.60:0/1341982569 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c4066cb0 con 0x7f49c4025480 2020-10-31T22:51:10.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.253+0000 7f49c9acf700 1 --2- 172.21.15.60:0/1341982569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49c4025480 0x7f49c407fcd0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f49b4002f30 tx=0x7f49b4006e80).ready entity=mon.0 client_cookie=3603f66c243f39ec server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:10.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.257+0000 7f49c92ce700 1 -- 172.21.15.60:0/1341982569 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b40097f0 con 0x7f49c4025480 2020-10-31T22:51:10.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.257+0000 7f49c92ce700 1 -- 172.21.15.60:0/1341982569 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4009950 con 0x7f49c4025480 2020-10-31T22:51:10.266 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.257+0000 7f49c92ce700 1 -- 172.21.15.60:0/1341982569 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49b4009cb0 con 0x7f49c4025480 2020-10-31T22:51:10.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.257+0000 7f49caad1700 1 -- 172.21.15.60:0/1341982569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49c4025480 msgr2=0x7f49c407fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.257+0000 7f49caad1700 1 --2- 172.21.15.60:0/1341982569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49c4025480 0x7f49c407fcd0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 rx=0x7f49b4002f30 tx=0x7f49b4006e80).stop 2020-10-31T22:51:10.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.257+0000 7f49caad1700 1 -- 172.21.15.60:0/1341982569 shutdown_connections 2020-10-31T22:51:10.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.257+0000 7f49caad1700 1 --2- 172.21.15.60:0/1341982569 >> v2:172.21.15.66:3300/0 conn(0x7f49c40b1570 0x7f49c4024f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.257+0000 7f49caad1700 1 --2- 172.21.15.60:0/1341982569 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49c4025480 0x7f49c407fcd0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.267 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.257+0000 7f49caad1700 1 -- 172.21.15.60:0/1341982569 >> 172.21.15.60:0/1341982569 conn(0x7f49c40b5440 msgr2=0x7f49c40b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:10.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.257+0000 7f49caad1700 1 -- 172.21.15.60:0/1341982569 shutdown_connections 2020-10-31T22:51:10.268 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.257+0000 7f49caad1700 1 -- 172.21.15.60:0/1341982569 wait complete. 2020-10-31T22:51:10.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.257+0000 7f49caad1700 1 Processor -- start 2020-10-31T22:51:10.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.257+0000 7f49caad1700 1 -- start start 2020-10-31T22:51:10.270 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49caad1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49c4025480 0x7f49c4065c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49caad1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49c40801c0 0x7f49c4141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49caad1700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49c40b1570 0x7f49c4141d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49caad1700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40a7ad0 con 0x7f49c4025480 2020-10-31T22:51:10.271 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49caad1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40b3c80 con 0x7f49c40801c0 2020-10-31T22:51:10.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49caad1700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c40a8cf0 con 0x7f49c40b1570 2020-10-31T22:51:10.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49ca2d0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49c4025480 0x7f49c4065c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.272 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49ca2d0700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49c4025480 0x7f49c4065c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50184/0 (socket says 172.21.15.60:50184) 2020-10-31T22:51:10.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49ca2d0700 1 -- 172.21.15.60:0/1875419361 learned_addr learned my addr 172.21.15.60:0/1875419361 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:10.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49c9acf700 1 --2- 172.21.15.60:0/1875419361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49c40801c0 0x7f49c4141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49cbd33700 1 --2- 172.21.15.60:0/1875419361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49c40b1570 0x7f49c4141d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49ca2d0700 1 -- 172.21.15.60:0/1875419361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49c40b1570 msgr2=0x7f49c4141d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49ca2d0700 1 --2- 172.21.15.60:0/1875419361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49c40b1570 0x7f49c4141d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.273 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49ca2d0700 1 -- 172.21.15.60:0/1875419361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49c40801c0 msgr2=0x7f49c4141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49ca2d0700 1 --2- 172.21.15.60:0/1875419361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49c40801c0 0x7f49c4141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49ca2d0700 1 -- 172.21.15.60:0/1875419361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c40b3eb0 con 0x7f49c4025480 2020-10-31T22:51:10.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49ca2d0700 1 --2- 172.21.15.60:0/1875419361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49c4025480 0x7f49c4065c50 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f49c40a8230 tx=0x7f49c00091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:10.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49baffd700 1 -- 172.21.15.60:0/1875419361 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49c000ca80 con 0x7f49c4025480 2020-10-31T22:51:10.274 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49baffd700 1 -- 172.21.15.60:0/1875419361 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c000cbe0 con 0x7f49c4025480 2020-10-31T22:51:10.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49caad1700 1 -- 172.21.15.60:0/1875419361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c40b4150 con 0x7f49c4025480 2020-10-31T22:51:10.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49baffd700 1 -- 172.21.15.60:0/1875419361 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f49c00123f0 con 0x7f49c4025480 2020-10-31T22:51:10.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49caad1700 1 -- 172.21.15.60:0/1875419361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c40665c0 con 0x7f49c4025480 2020-10-31T22:51:10.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49baffd700 1 -- 172.21.15.60:0/1875419361 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f49c0022070 con 0x7f49c4025480 2020-10-31T22:51:10.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.261+0000 7f49caad1700 1 -- 172.21.15.60:0/1875419361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c4057100 con 0x7f49c4025480 2020-10-31T22:51:10.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.265+0000 7f49baffd700 1 --2- 172.21.15.60:0/1875419361 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f49ac055050 0x7f49ac057510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.265+0000 7f49c9acf700 1 --2- 172.21.15.60:0/1875419361 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f49ac055050 0x7f49ac057510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.265+0000 7f49baffd700 1 -- 172.21.15.60:0/1875419361 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f49c006e170 con 0x7f49c4025480 2020-10-31T22:51:10.276 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.265+0000 7f49c9acf700 1 --2- 172.21.15.60:0/1875419361 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f49ac055050 0x7f49ac057510 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f49b401c000 tx=0x7f49b4015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:10.277 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.273+0000 7f49baffd700 1 -- 172.21.15.60:0/1875419361 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f49c0044580 con 0x7f49c4025480 2020-10-31T22:51:10.468 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.465+0000 7f49caad1700 1 -- 172.21.15.60:0/1875419361 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f49c412d4f0 con 0x7f49c4025480 2020-10-31T22:51:10.477 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.473+0000 7f49baffd700 1 -- 172.21.15.60:0/1875419361 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.0 v33) v1 ==== 184+0+0 (secure 0 0 0) 0x7f49c0047ba0 con 0x7f49c4025480 2020-10-31T22:51:10.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.473+0000 7f49caad1700 1 -- 172.21.15.60:0/1875419361 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f49ac055050 msgr2=0x7f49ac057510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.480 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.473+0000 7f49caad1700 1 --2- 172.21.15.60:0/1875419361 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f49ac055050 0x7f49ac057510 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 rx=0x7f49b401c000 tx=0x7f49b4015000).stop 2020-10-31T22:51:10.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.473+0000 7f49caad1700 1 -- 172.21.15.60:0/1875419361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49c4025480 msgr2=0x7f49c4065c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.473+0000 7f49caad1700 1 --2- 172.21.15.60:0/1875419361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49c4025480 0x7f49c4065c50 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 rx=0x7f49c40a8230 tx=0x7f49c00091a0).stop 2020-10-31T22:51:10.481 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.477+0000 7f49caad1700 1 -- 172.21.15.60:0/1875419361 shutdown_connections 2020-10-31T22:51:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.477+0000 7f49caad1700 1 --2- 172.21.15.60:0/1875419361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49c40b1570 0x7f49c4141d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.477+0000 7f49caad1700 1 --2- 172.21.15.60:0/1875419361 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49c4025480 0x7f49c4065c50 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.477+0000 7f49caad1700 1 --2- 172.21.15.60:0/1875419361 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f49ac055050 0x7f49ac057510 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.477+0000 7f49caad1700 1 --2- 172.21.15.60:0/1875419361 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f49c40801c0 0x7f49c4141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.477+0000 7f49caad1700 1 -- 172.21.15.60:0/1875419361 >> 172.21.15.60:0/1875419361 conn(0x7f49c40b5440 msgr2=0x7f49c4132dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:10.482 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.477+0000 7f49caad1700 1 -- 172.21.15.60:0/1875419361 shutdown_connections 2020-10-31T22:51:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.477+0000 7f49caad1700 1 -- 172.21.15.60:0/1875419361 wait complete. 2020-10-31T22:51:10.483 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.0 2020-10-31T22:51:10.495 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mds allow mon 'allow r' osd 'allow rw pool=cephfs_data' 2020-10-31T22:51:10.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.609+0000 7f765b0f4700 1 Processor -- start 2020-10-31T22:51:10.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.609+0000 7f765b0f4700 1 -- start start 2020-10-31T22:51:10.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765b0f4700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f76540256a0 0x7f765407fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765b0f4700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76540801c0 0x7f7654159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765b0f4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76540b1950 con 0x7f76540b1570 2020-10-31T22:51:10.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765b0f4700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7654062720 con 0x7f76540801c0 2020-10-31T22:51:10.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765b0f4700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7654066cb0 con 0x7f76540256a0 2020-10-31T22:51:10.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765c356700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f76540801c0 0x7f7654159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765a8f3700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f76540b1570 0x7f7654024f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54328/0 (socket says 172.21.15.60:54328) 2020-10-31T22:51:10.622 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765a8f3700 1 -- 172.21.15.60:0/2758733360 learned_addr learned my addr 172.21.15.60:0/2758733360 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:10.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765a0f2700 1 --2- 172.21.15.60:0/2758733360 >> v2:172.21.15.66:3300/0 conn(0x7f76540256a0 0x7f765407fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765c356700 1 -- 172.21.15.60:0/2758733360 >> v2:172.21.15.66:3300/0 conn(0x7f76540256a0 msgr2=0x7f765407fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:10.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765c356700 1 --2- 172.21.15.60:0/2758733360 >> v2:172.21.15.66:3300/0 conn(0x7f76540256a0 0x7f765407fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765c356700 1 -- 172.21.15.60:0/2758733360 >> v1:172.21.15.60:6789/0 conn(0x7f76540b1570 legacy=0x7f7654024f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765c356700 1 -- 172.21.15.60:0/2758733360 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76540aca00 con 0x7f76540801c0 2020-10-31T22:51:10.623 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f76598f1700 1 -- 172.21.15.60:0/2758733360 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517162987 0 0) 0x7f76540b1950 con 0x7f76540b1570 2020-10-31T22:51:10.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765c356700 1 --2- 172.21.15.60:0/2758733360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76540801c0 0x7f7654159210 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f764c0032b0 tx=0x7f764c0091a0).ready entity=mon.0 client_cookie=b253e80e7c0343cd server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:10.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f76598f1700 1 -- 172.21.15.60:0/2758733360 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f764c00b9a0 con 0x7f76540801c0 2020-10-31T22:51:10.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f76598f1700 1 -- 172.21.15.60:0/2758733360 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c00bb00 con 0x7f76540801c0 2020-10-31T22:51:10.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f76598f1700 1 -- 172.21.15.60:0/2758733360 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f764c00bc70 con 0x7f76540801c0 2020-10-31T22:51:10.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765b0f4700 1 -- 172.21.15.60:0/2758733360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76540801c0 msgr2=0x7f7654159210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.624 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765b0f4700 1 --2- 172.21.15.60:0/2758733360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76540801c0 0x7f7654159210 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 rx=0x7f764c0032b0 tx=0x7f764c0091a0).stop 2020-10-31T22:51:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765b0f4700 1 -- 172.21.15.60:0/2758733360 shutdown_connections 2020-10-31T22:51:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765b0f4700 1 --2- 172.21.15.60:0/2758733360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76540801c0 0x7f7654159210 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765b0f4700 1 --2- 172.21.15.60:0/2758733360 >> v2:172.21.15.66:3300/0 conn(0x7f76540256a0 0x7f765407fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765b0f4700 1 -- 172.21.15.60:0/2758733360 >> 172.21.15.60:0/2758733360 conn(0x7f76540b5440 msgr2=0x7f76540b5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765b0f4700 1 -- 172.21.15.60:0/2758733360 shutdown_connections 2020-10-31T22:51:10.625 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.613+0000 7f765b0f4700 1 -- 172.21.15.60:0/2758733360 wait complete. 2020-10-31T22:51:10.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.617+0000 7f765b0f4700 1 Processor -- start 2020-10-31T22:51:10.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.617+0000 7f765b0f4700 1 -- start start 2020-10-31T22:51:10.627 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765b0f4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76540256a0 0x7f76540b0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765b0f4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76540801c0 0x7f76540643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765b0f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76540b1570 0x7f76540648b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765b0f4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765412e770 con 0x7f76540b1570 2020-10-31T22:51:10.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765b0f4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76540a36a0 con 0x7f76540801c0 2020-10-31T22:51:10.628 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765b0f4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76540a2420 con 0x7f76540256a0 2020-10-31T22:51:10.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765c356700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76540b1570 0x7f76540648b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765c356700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76540b1570 0x7f76540648b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50202/0 (socket says 172.21.15.60:50202) 2020-10-31T22:51:10.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765c356700 1 -- 172.21.15.60:0/1764750407 learned_addr learned my addr 172.21.15.60:0/1764750407 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:10.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765a8f3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76540256a0 0x7f76540b0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765a0f2700 1 --2- 172.21.15.60:0/1764750407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76540801c0 0x7f76540643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765c356700 1 -- 172.21.15.60:0/1764750407 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76540256a0 msgr2=0x7f76540b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.629 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765c356700 1 --2- 172.21.15.60:0/1764750407 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76540256a0 0x7f76540b0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765c356700 1 -- 172.21.15.60:0/1764750407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76540801c0 msgr2=0x7f76540643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765c356700 1 --2- 172.21.15.60:0/1764750407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76540801c0 0x7f76540643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765c356700 1 -- 172.21.15.60:0/1764750407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7654130530 con 0x7f76540b1570 2020-10-31T22:51:10.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765a8f3700 1 --2- 172.21.15.60:0/1764750407 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76540256a0 0x7f76540b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:10.630 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765c356700 1 --2- 172.21.15.60:0/1764750407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76540b1570 0x7f76540648b0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f764c0032b0 tx=0x7f764c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:10.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f764b7fe700 1 -- 172.21.15.60:0/1764750407 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f764c01f3f0 con 0x7f76540b1570 2020-10-31T22:51:10.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f764b7fe700 1 -- 172.21.15.60:0/1764750407 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764c01f550 con 0x7f76540b1570 2020-10-31T22:51:10.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765b0f4700 1 -- 172.21.15.60:0/1764750407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76540b0a30 con 0x7f76540b1570 2020-10-31T22:51:10.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f764b7fe700 1 -- 172.21.15.60:0/1764750407 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f764c01f8b0 con 0x7f76540b1570 2020-10-31T22:51:10.631 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765b0f4700 1 -- 172.21.15.60:0/1764750407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76540a4230 con 0x7f76540b1570 2020-10-31T22:51:10.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.621+0000 7f765b0f4700 1 -- 172.21.15.60:0/1764750407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76540a3860 con 0x7f76540b1570 2020-10-31T22:51:10.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.625+0000 7f764b7fe700 1 -- 172.21.15.60:0/1764750407 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f764c026030 con 0x7f76540b1570 2020-10-31T22:51:10.632 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.625+0000 7f764b7fe700 1 --2- 172.21.15.60:0/1764750407 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f763c054f90 0x7f763c057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.625+0000 7f764b7fe700 1 -- 172.21.15.60:0/1764750407 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f764c06e640 con 0x7f76540b1570 2020-10-31T22:51:10.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.625+0000 7f765a8f3700 1 --2- 172.21.15.60:0/1764750407 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f763c054f90 0x7f763c057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.633 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.625+0000 7f765a8f3700 1 --2- 172.21.15.60:0/1764750407 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f763c054f90 0x7f763c057450 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f765000d000 tx=0x7f7650007930).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:10.636 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.629+0000 7f764b7fe700 1 -- 172.21.15.60:0/1764750407 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f764c044c20 con 0x7f76540b1570 2020-10-31T22:51:10.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.821+0000 7f765b0f4700 1 -- 172.21.15.60:0/1764750407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]} v 0) v1 -- 0x7f76540a25e0 con 0x7f76540b1570 2020-10-31T22:51:10.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.829+0000 7f764b7fe700 1 -- 172.21.15.60:0/1764750407 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mds", "allow", "mon", "allow r", "osd", "allow rw pool=cephfs_data"]}]=0 updated caps for client.1 v34) v1 ==== 184+0+0 (secure 0 0 0) 0x7f764c0150e0 con 0x7f76540b1570 2020-10-31T22:51:10.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.833+0000 7f765b0f4700 1 -- 172.21.15.60:0/1764750407 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f763c054f90 msgr2=0x7f763c057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.833+0000 7f765b0f4700 1 --2- 172.21.15.60:0/1764750407 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f763c054f90 0x7f763c057450 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 rx=0x7f765000d000 tx=0x7f7650007930).stop 2020-10-31T22:51:10.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.833+0000 7f765b0f4700 1 -- 172.21.15.60:0/1764750407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76540b1570 msgr2=0x7f76540648b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.833+0000 7f765b0f4700 1 --2- 172.21.15.60:0/1764750407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76540b1570 0x7f76540648b0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 rx=0x7f764c0032b0 tx=0x7f764c016000).stop 2020-10-31T22:51:10.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.833+0000 7f765b0f4700 1 -- 172.21.15.60:0/1764750407 shutdown_connections 2020-10-31T22:51:10.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.833+0000 7f765b0f4700 1 --2- 172.21.15.60:0/1764750407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f76540b1570 0x7f76540648b0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.833+0000 7f765b0f4700 1 --2- 172.21.15.60:0/1764750407 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f76540256a0 0x7f76540b0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.833+0000 7f765b0f4700 1 --2- 172.21.15.60:0/1764750407 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f763c054f90 0x7f763c057450 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.833+0000 7f765b0f4700 1 --2- 172.21.15.60:0/1764750407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f76540801c0 0x7f76540643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.833+0000 7f765b0f4700 1 -- 172.21.15.60:0/1764750407 >> 172.21.15.60:0/1764750407 conn(0x7f76540b5440 msgr2=0x7f76540acec0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.833+0000 7f765b0f4700 1 -- 172.21.15.60:0/1764750407 shutdown_connections 2020-10-31T22:51:10.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.833+0000 7f765b0f4700 1 -- 172.21.15.60:0/1764750407 wait complete. 2020-10-31T22:51:10.842 INFO:teuthology.orchestra.run.smithi060.stderr:updated caps for client.1 2020-10-31T22:51:10.851 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:51:10.966 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc8451ce700 1 Processor -- start 2020-10-31T22:51:10.967 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc8451ce700 1 -- start start 2020-10-31T22:51:10.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc8451ce700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8400a7850 0x7fc84005bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc8451ce700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc840146790 0x7fc840146c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc8451ce700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8400af200 con 0x7fc84005b960 2020-10-31T22:51:10.968 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc8451ce700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8400b0f00 con 0x7fc840146790 2020-10-31T22:51:10.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc8451ce700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400b11a0 con 0x7fc8400a7850 2020-10-31T22:51:10.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc83f59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc840146790 0x7fc840146c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc83f59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc840146790 0x7fc840146c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50210/0 (socket says 172.21.15.60:50210) 2020-10-31T22:51:10.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc83f59e700 1 -- 172.21.15.60:0/1681997429 learned_addr learned my addr 172.21.15.60:0/1681997429 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:10.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc83ed9d700 1 --1- 172.21.15.60:0/1681997429 >> v1:172.21.15.60:6789/0 conn(0x7fc84005b960 0x7fc8400aeaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54342/0 (socket says 172.21.15.60:54342) 2020-10-31T22:51:10.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc83e59c700 1 --2- 172.21.15.60:0/1681997429 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8400a7850 0x7fc84005bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.969 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc83f59e700 1 -- 172.21.15.60:0/1681997429 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8400a7850 msgr2=0x7fc84005bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc83f59e700 1 --2- 172.21.15.60:0/1681997429 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8400a7850 0x7fc84005bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc83f59e700 1 -- 172.21.15.60:0/1681997429 >> v1:172.21.15.60:6789/0 conn(0x7fc84005b960 legacy=0x7fc8400aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc83f59e700 1 -- 172.21.15.60:0/1681997429 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8400b1440 con 0x7fc840146790 2020-10-31T22:51:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc83e59c700 1 --2- 172.21.15.60:0/1681997429 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8400a7850 0x7fc84005bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:51:10.970 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.961+0000 7fc83f59e700 1 --2- 172.21.15.60:0/1681997429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc840146790 0x7fc840146c00 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fc838002f30 tx=0x7fc838006e80).ready entity=mon.0 client_cookie=fb28c00e7414d0b server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:10.971 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.965+0000 7fc83dd9b700 1 -- 172.21.15.60:0/1681997429 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8380097f0 con 0x7fc840146790 2020-10-31T22:51:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.965+0000 7fc83dd9b700 1 -- 172.21.15.60:0/1681997429 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc838009950 con 0x7fc840146790 2020-10-31T22:51:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.965+0000 7fc83dd9b700 1 -- 172.21.15.60:0/1681997429 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc838009cb0 con 0x7fc840146790 2020-10-31T22:51:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.965+0000 7fc8451ce700 1 -- 172.21.15.60:0/1681997429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc840146790 msgr2=0x7fc840146c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.965+0000 7fc8451ce700 1 --2- 172.21.15.60:0/1681997429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc840146790 0x7fc840146c00 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 rx=0x7fc838002f30 tx=0x7fc838006e80).stop 2020-10-31T22:51:10.972 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.965+0000 7fc8451ce700 1 -- 172.21.15.60:0/1681997429 shutdown_connections 2020-10-31T22:51:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.965+0000 7fc8451ce700 1 --2- 172.21.15.60:0/1681997429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc840146790 0x7fc840146c00 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.965+0000 7fc8451ce700 1 --2- 172.21.15.60:0/1681997429 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8400a7850 0x7fc84005bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.965+0000 7fc8451ce700 1 -- 172.21.15.60:0/1681997429 >> 172.21.15.60:0/1681997429 conn(0x7fc84006a260 msgr2=0x7fc840061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.965+0000 7fc8451ce700 1 -- 172.21.15.60:0/1681997429 shutdown_connections 2020-10-31T22:51:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.965+0000 7fc8451ce700 1 -- 172.21.15.60:0/1681997429 wait complete. 2020-10-31T22:51:10.973 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.965+0000 7fc8451ce700 1 Processor -- start 2020-10-31T22:51:10.974 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.965+0000 7fc8451ce700 1 -- start start 2020-10-31T22:51:10.975 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc8451ce700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc84005b960 0x7fc8400adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc8451ce700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8400a7850 0x7fc840155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc8451ce700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc840146790 0x7fc840155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc8451ce700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc840143130 con 0x7fc84005b960 2020-10-31T22:51:10.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc8451ce700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8401433d0 con 0x7fc840146790 2020-10-31T22:51:10.976 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc8451ce700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc840143670 con 0x7fc8400a7850 2020-10-31T22:51:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc83ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc84005b960 0x7fc8400adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc83ed9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc84005b960 0x7fc8400adb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50212/0 (socket says 172.21.15.60:50212) 2020-10-31T22:51:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc83ed9d700 1 -- 172.21.15.60:0/1582975894 learned_addr learned my addr 172.21.15.60:0/1582975894 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc83e59c700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8400a7850 0x7fc840155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc83f59e700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc840146790 0x7fc840155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.977 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc83ed9d700 1 -- 172.21.15.60:0/1582975894 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8400a7850 msgr2=0x7fc840155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc83ed9d700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8400a7850 0x7fc840155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc83ed9d700 1 -- 172.21.15.60:0/1582975894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc840146790 msgr2=0x7fc840155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc83ed9d700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc840146790 0x7fc840155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:10.978 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc83ed9d700 1 -- 172.21.15.60:0/1582975894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8401551d0 con 0x7fc84005b960 2020-10-31T22:51:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc83e59c700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8400a7850 0x7fc840155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:51:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc83f59e700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc840146790 0x7fc840155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:51:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc83ed9d700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc84005b960 0x7fc8400adb90 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fc840062600 tx=0x7fc834007b40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc82ffff700 1 -- 172.21.15.60:0/1582975894 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8340072e0 con 0x7fc84005b960 2020-10-31T22:51:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc82ffff700 1 -- 172.21.15.60:0/1582975894 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc834005520 con 0x7fc84005b960 2020-10-31T22:51:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc8451ce700 1 -- 172.21.15.60:0/1582975894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8400aa8d0 con 0x7fc84005b960 2020-10-31T22:51:10.979 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc82ffff700 1 -- 172.21.15.60:0/1582975894 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc834005880 con 0x7fc84005b960 2020-10-31T22:51:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc8451ce700 1 -- 172.21.15.60:0/1582975894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8400aa460 con 0x7fc84005b960 2020-10-31T22:51:10.980 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc8451ce700 1 -- 172.21.15.60:0/1582975894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc840155360 con 0x7fc84005b960 2020-10-31T22:51:10.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.969+0000 7fc82ffff700 1 -- 172.21.15.60:0/1582975894 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc834010070 con 0x7fc84005b960 2020-10-31T22:51:10.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.973+0000 7fc82ffff700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc81c055020 0x7fc81c0574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:10.981 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.973+0000 7fc82ffff700 1 -- 172.21.15.60:0/1582975894 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc83406d1b0 con 0x7fc84005b960 2020-10-31T22:51:10.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.973+0000 7fc83e59c700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc81c055020 0x7fc81c0574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:10.982 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.973+0000 7fc83e59c700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc81c055020 0x7fc81c0574e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fc83000d000 tx=0x7fc830008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:10.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:10.981+0000 7fc82ffff700 1 -- 172.21.15.60:0/1582975894 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc834043630 con 0x7fc84005b960 2020-10-31T22:51:11.172 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.165+0000 7fc8451ce700 1 -- 172.21.15.60:0/1582975894 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc840057100 con 0x7fc84005b960 2020-10-31T22:51:11.173 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.169+0000 7fc82ffff700 1 -- 172.21.15.60:0/1582975894 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+2486 (secure 0 0 0) 0x7fc834046c50 con 0x7fc84005b960 2020-10-31T22:51:11.173 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:11.173 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":81,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/542860877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":542860877},{"type":"v1","addr":"172.21.15.66:6833","nonce":542860877}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79},{"gid":8535,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/480001574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":480001574},{"type":"v1","addr":"172.21.15.60:6835","nonce":480001574}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:51:08.474776+0000","modified":"2020-10-31T22:51:09.477436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/364183995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":364183995},{"type":"v1","addr":"172.21.15.60:6837","nonce":364183995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-10-31T22:51:11.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.169+0000 7fc8451ce700 1 -- 172.21.15.60:0/1582975894 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc81c055020 msgr2=0x7fc81c0574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:11.176 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.169+0000 7fc8451ce700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc81c055020 0x7fc81c0574e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 rx=0x7fc83000d000 tx=0x7fc830008040).stop 2020-10-31T22:51:11.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.169+0000 7fc8451ce700 1 -- 172.21.15.60:0/1582975894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc84005b960 msgr2=0x7fc8400adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:11.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.169+0000 7fc8451ce700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc84005b960 0x7fc8400adb90 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 rx=0x7fc840062600 tx=0x7fc834007b40).stop 2020-10-31T22:51:11.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.169+0000 7fc8451ce700 1 -- 172.21.15.60:0/1582975894 shutdown_connections 2020-10-31T22:51:11.177 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.169+0000 7fc8451ce700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc81c055020 0x7fc81c0574e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:11.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.169+0000 7fc8451ce700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc840146790 0x7fc840155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:11.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.169+0000 7fc8451ce700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc84005b960 0x7fc8400adb90 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:11.178 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.169+0000 7fc8451ce700 1 --2- 172.21.15.60:0/1582975894 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8400a7850 0x7fc840155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:11.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.169+0000 7fc8451ce700 1 -- 172.21.15.60:0/1582975894 >> 172.21.15.60:0/1582975894 conn(0x7fc84006a260 msgr2=0x7fc840149450 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:11.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.169+0000 7fc8451ce700 1 -- 172.21.15.60:0/1582975894 shutdown_connections 2020-10-31T22:51:11.179 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.169+0000 7fc8451ce700 1 -- 172.21.15.60:0/1582975894 wait complete. 2020-10-31T22:51:11.180 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 81 2020-10-31T22:51:11.488 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:51:08.474776+0000', 'modified': '2020-10-31T22:51:09.477436+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8547}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8547': {'gid': 8547, 'name': 'c', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/364183995', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 364183995}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 364183995}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:51:11.489 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:51:11.489 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:51:11.624 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":8547,"want_state":"up:active","state":"up:active","rank_uptime":3.136172046,"mdsmap_epoch":81,"osdmap_epoch":160,"osdmap_epoch_barrier":159,"uptime":8.3712041619999997} 2020-10-31T22:51:11.625 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 8547, "mdsmap_epoch": 81, "osdmap_epoch": 160, "osdmap_epoch_barrier": 159, "rank_uptime": 3.136172046, "state": "up:active", "uptime": 8.371204162, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:51:11.626 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:51:11.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39d5407700 1 Processor -- start 2020-10-31T22:51:11.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39d5407700 1 -- start start 2020-10-31T22:51:11.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39d5407700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39d00b1bb0 0x7f39d005c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:11.741 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39d5407700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f39d013f3d0 0x7f39d00b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39d5407700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d005c800 con 0x7f39d00ae630 2020-10-31T22:51:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39d5407700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d00adc50 con 0x7f39d00b1bb0 2020-10-31T22:51:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39d5407700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d00adef0 con 0x7f39d013f3d0 2020-10-31T22:51:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39cffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f39d00b1bb0 0x7f39d005c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39cf7fe700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f39d00ae630 0x7f39d013ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54358/0 (socket says 172.21.15.60:54358) 2020-10-31T22:51:11.742 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39cf7fe700 1 -- 172.21.15.60:0/1813122379 learned_addr learned my addr 172.21.15.60:0/1813122379 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:11.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39d4c06700 1 --2- 172.21.15.60:0/1813122379 >> v2:172.21.15.66:3300/0 conn(0x7f39d013f3d0 0x7f39d00b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:11.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39ceffd700 1 -- 172.21.15.60:0/1813122379 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788189976 0 0) 0x7f39d005c800 con 0x7f39d00ae630 2020-10-31T22:51:11.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39ceffd700 1 -- 172.21.15.60:0/1813122379 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39bc003230 con 0x7f39d00ae630 2020-10-31T22:51:11.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39cffff700 1 -- 172.21.15.60:0/1813122379 >> v2:172.21.15.66:3300/0 conn(0x7f39d013f3d0 msgr2=0x7f39d00b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:11.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39cffff700 1 --2- 172.21.15.60:0/1813122379 >> v2:172.21.15.66:3300/0 conn(0x7f39d013f3d0 0x7f39d00b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:11.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39cffff700 1 -- 172.21.15.60:0/1813122379 >> v1:172.21.15.60:6789/0 conn(0x7f39d00ae630 legacy=0x7f39d013ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:11.743 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39cffff700 1 -- 172.21.15.60:0/1813122379 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d00ae190 con 0x7f39d00b1bb0 2020-10-31T22:51:11.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39cffff700 1 --2- 172.21.15.60:0/1813122379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d00b1bb0 0x7f39d005c0f0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f39c00032b0 tx=0x7f39c00091a0).ready entity=mon.0 client_cookie=efc2869dd923daa server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:11.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.733+0000 7f39ceffd700 1 -- 172.21.15.60:0/1813122379 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39c000b940 con 0x7f39d00b1bb0 2020-10-31T22:51:11.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39ceffd700 1 -- 172.21.15.60:0/1813122379 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c000baa0 con 0x7f39d00b1bb0 2020-10-31T22:51:11.744 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39ceffd700 1 -- 172.21.15.60:0/1813122379 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39c000bc10 con 0x7f39d00b1bb0 2020-10-31T22:51:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 -- 172.21.15.60:0/1813122379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d00b1bb0 msgr2=0x7f39d005c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:11.745 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 --2- 172.21.15.60:0/1813122379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d00b1bb0 0x7f39d005c0f0 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 rx=0x7f39c00032b0 tx=0x7f39c00091a0).stop 2020-10-31T22:51:11.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 -- 172.21.15.60:0/1813122379 shutdown_connections 2020-10-31T22:51:11.749 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 --2- 172.21.15.60:0/1813122379 >> v2:172.21.15.66:3300/0 conn(0x7f39d013f3d0 0x7f39d00b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:11.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 --2- 172.21.15.60:0/1813122379 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d00b1bb0 0x7f39d005c0f0 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:11.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 -- 172.21.15.60:0/1813122379 >> 172.21.15.60:0/1813122379 conn(0x7f39d00b5300 msgr2=0x7f39d00b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:11.751 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 -- 172.21.15.60:0/1813122379 shutdown_connections 2020-10-31T22:51:11.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 -- 172.21.15.60:0/1813122379 wait complete. 2020-10-31T22:51:11.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 Processor -- start 2020-10-31T22:51:11.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 -- start start 2020-10-31T22:51:11.752 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d00b1bb0 0x7f39d00aaa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:11.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39d013f3d0 0x7f39d0150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:11.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39d00654c0 0x7f39d0154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:11.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d0066d30 con 0x7f39d00b1bb0 2020-10-31T22:51:11.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d0065c40 con 0x7f39d013f3d0 2020-10-31T22:51:11.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39d5407700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d0065ee0 con 0x7f39d00654c0 2020-10-31T22:51:11.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d00b1bb0 0x7f39d00aaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:11.753 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.737+0000 7f39cffff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d00b1bb0 0x7f39d00aaa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50226/0 (socket says 172.21.15.60:50226) 2020-10-31T22:51:11.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39cffff700 1 -- 172.21.15.60:0/1685443184 learned_addr learned my addr 172.21.15.60:0/1685443184 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:11.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39d4c06700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39d00654c0 0x7f39d0154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:11.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39cf7fe700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39d013f3d0 0x7f39d0150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:11.754 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39cffff700 1 -- 172.21.15.60:0/1685443184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39d00654c0 msgr2=0x7f39d0154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:11.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39cffff700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39d00654c0 0x7f39d0154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:11.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39cffff700 1 -- 172.21.15.60:0/1685443184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39d013f3d0 msgr2=0x7f39d0150aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:11.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39cffff700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39d013f3d0 0x7f39d0150aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:11.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39cffff700 1 -- 172.21.15.60:0/1685443184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d0154010 con 0x7f39d00b1bb0 2020-10-31T22:51:11.755 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39d4c06700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39d00654c0 0x7f39d0154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:51:11.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39cffff700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d00b1bb0 0x7f39d00aaa70 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f39c00032b0 tx=0x7f39c0016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:11.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39cd7fa700 1 -- 172.21.15.60:0/1685443184 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39c000be80 con 0x7f39d00b1bb0 2020-10-31T22:51:11.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39cd7fa700 1 -- 172.21.15.60:0/1685443184 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c001f3f0 con 0x7f39d00b1bb0 2020-10-31T22:51:11.756 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39d5407700 1 -- 172.21.15.60:0/1685443184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d0065970 con 0x7f39d00b1bb0 2020-10-31T22:51:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39cd7fa700 1 -- 172.21.15.60:0/1685443184 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f39c001f750 con 0x7f39d00b1bb0 2020-10-31T22:51:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39d5407700 1 -- 172.21.15.60:0/1685443184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d0154c40 con 0x7f39d00b1bb0 2020-10-31T22:51:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39d5407700 1 -- 172.21.15.60:0/1685443184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d0057100 con 0x7f39d00b1bb0 2020-10-31T22:51:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.741+0000 7f39cd7fa700 1 -- 172.21.15.60:0/1685443184 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f39c000f070 con 0x7f39d00b1bb0 2020-10-31T22:51:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.745+0000 7f39cd7fa700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f39b0054f10 0x7f39b00573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.745+0000 7f39cd7fa700 1 -- 172.21.15.60:0/1685443184 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f39c006e520 con 0x7f39d00b1bb0 2020-10-31T22:51:11.757 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.745+0000 7f39cf7fe700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f39b0054f10 0x7f39b00573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:11.758 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.745+0000 7f39cf7fe700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f39b0054f10 0x7f39b00573d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f39c400b000 tx=0x7f39c4009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:11.759 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.749+0000 7f39cd7fa700 1 -- 172.21.15.60:0/1685443184 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f39c0044930 con 0x7f39d00b1bb0 2020-10-31T22:51:11.901 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.897+0000 7f39d5407700 1 -- 172.21.15.60:0/1685443184 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39d00b10c0 con 0x7f39d00b1bb0 2020-10-31T22:51:11.903 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.897+0000 7f39cd7fa700 1 -- 172.21.15.60:0/1685443184 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+16052 (secure 0 0 0) 0x7f39c0015090 con 0x7f39d00b1bb0 2020-10-31T22:51:11.904 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:11.904 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":160,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:51:09.478155+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:51:06.207804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2020-10-31T22:51:07.488114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:51:11.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.901+0000 7f39d5407700 1 -- 172.21.15.60:0/1685443184 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f39b0054f10 msgr2=0x7f39b00573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:11.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.901+0000 7f39d5407700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f39b0054f10 0x7f39b00573d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 rx=0x7f39c400b000 tx=0x7f39c4009040).stop 2020-10-31T22:51:11.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.901+0000 7f39d5407700 1 -- 172.21.15.60:0/1685443184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d00b1bb0 msgr2=0x7f39d00aaa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:11.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.901+0000 7f39d5407700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d00b1bb0 0x7f39d00aaa70 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 rx=0x7f39c00032b0 tx=0x7f39c0016000).stop 2020-10-31T22:51:11.906 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.901+0000 7f39d5407700 1 -- 172.21.15.60:0/1685443184 shutdown_connections 2020-10-31T22:51:11.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.901+0000 7f39d5407700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39d00654c0 0x7f39d0154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:11.907 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.901+0000 7f39d5407700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39d00b1bb0 0x7f39d00aaa70 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:11.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.901+0000 7f39d5407700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f39b0054f10 0x7f39b00573d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:11.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.901+0000 7f39d5407700 1 --2- 172.21.15.60:0/1685443184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39d013f3d0 0x7f39d0150aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:11.908 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.901+0000 7f39d5407700 1 -- 172.21.15.60:0/1685443184 >> 172.21.15.60:0/1685443184 conn(0x7f39d00b5300 msgr2=0x7f39d0142050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:11.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.901+0000 7f39d5407700 1 -- 172.21.15.60:0/1685443184 shutdown_connections 2020-10-31T22:51:11.909 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:11.901+0000 7f39d5407700 1 -- 172.21.15.60:0/1685443184 wait complete. 2020-10-31T22:51:11.924 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:51:06.207804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:51:07.488114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:51:11.925 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:51:12.051 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.041+0000 7ff082f70700 1 Processor -- start 2020-10-31T22:51:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.041+0000 7ff082f70700 1 -- start start 2020-10-31T22:51:12.052 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.041+0000 7ff082f70700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c05c660 0x7ff07c0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.041+0000 7ff082f70700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff07c065f70 0x7ff07c13f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.041+0000 7ff082f70700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07c066410 con 0x7ff07c13f880 2020-10-31T22:51:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.041+0000 7ff082f70700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07c066d60 con 0x7ff07c065f70 2020-10-31T22:51:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.041+0000 7ff082f70700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0b5e80 con 0x7ff07c05c660 2020-10-31T22:51:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.041+0000 7ff07bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff07c065f70 0x7ff07c13f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.053 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.041+0000 7ff07bfff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7ff07c065f70 0x7ff07c13f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50236/0 (socket says 172.21.15.60:50236) 2020-10-31T22:51:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.041+0000 7ff07bfff700 1 -- 172.21.15.60:0/4141788963 learned_addr learned my addr 172.21.15.60:0/4141788963 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.041+0000 7ff080d0c700 1 --2- 172.21.15.60:0/4141788963 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c05c660 0x7ff07c0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.041+0000 7ff07bfff700 1 -- 172.21.15.60:0/4141788963 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c05c660 msgr2=0x7ff07c0b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:12.054 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.041+0000 7ff07bfff700 1 --2- 172.21.15.60:0/4141788963 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c05c660 0x7ff07c0b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.041+0000 7ff07bfff700 1 -- 172.21.15.60:0/4141788963 >> v1:172.21.15.66:6789/0 conn(0x7ff07c13f880 legacy=0x7ff07c142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff07bfff700 1 -- 172.21.15.60:0/4141788963 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c0666b0 con 0x7ff07c065f70 2020-10-31T22:51:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff07bfff700 1 --2- 172.21.15.60:0/4141788963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff07c065f70 0x7ff07c13f390 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7ff07c0b5fc0 tx=0x7ff06c006e80).ready entity=mon.0 client_cookie=54119fc551db9c6c server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:12.055 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff07b7fe700 1 -- 172.21.15.60:0/4141788963 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff06c0097b0 con 0x7ff07c065f70 2020-10-31T22:51:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff07b7fe700 1 -- 172.21.15.60:0/4141788963 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c009910 con 0x7ff07c065f70 2020-10-31T22:51:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff07b7fe700 1 -- 172.21.15.60:0/4141788963 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff06c009c70 con 0x7ff07c065f70 2020-10-31T22:51:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff082f70700 1 -- 172.21.15.60:0/4141788963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff07c065f70 msgr2=0x7ff07c13f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.056 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff082f70700 1 --2- 172.21.15.60:0/4141788963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff07c065f70 0x7ff07c13f390 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 rx=0x7ff07c0b5fc0 tx=0x7ff06c006e80).stop 2020-10-31T22:51:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff082f70700 1 -- 172.21.15.60:0/4141788963 shutdown_connections 2020-10-31T22:51:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff082f70700 1 --2- 172.21.15.60:0/4141788963 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c05c660 0x7ff07c0b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff082f70700 1 --2- 172.21.15.60:0/4141788963 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff07c065f70 0x7ff07c13f390 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.057 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff082f70700 1 -- 172.21.15.60:0/4141788963 >> 172.21.15.60:0/4141788963 conn(0x7ff07c0601e0 msgr2=0x7ff07c05b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:12.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff082f70700 1 -- 172.21.15.60:0/4141788963 shutdown_connections 2020-10-31T22:51:12.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff082f70700 1 -- 172.21.15.60:0/4141788963 wait complete. 2020-10-31T22:51:12.059 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff082f70700 1 Processor -- start 2020-10-31T22:51:12.060 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff082f70700 1 -- start start 2020-10-31T22:51:12.064 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff082f70700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c05c660 0x7ff07c0ad690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.045+0000 7ff082f70700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff07c065f70 0x7ff07c151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff082f70700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c13f880 0x7ff07c145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.065 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff082f70700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0b2920 con 0x7ff07c065f70 2020-10-31T22:51:12.066 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff082f70700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0ac490 con 0x7ff07c05c660 2020-10-31T22:51:12.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff082f70700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07c0b2680 con 0x7ff07c13f880 2020-10-31T22:51:12.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff07bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff07c065f70 0x7ff07c151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff07bfff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff07c065f70 0x7ff07c151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50240/0 (socket says 172.21.15.60:50240) 2020-10-31T22:51:12.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff07bfff700 1 -- 172.21.15.60:0/1780320360 learned_addr learned my addr 172.21.15.60:0/1780320360 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:12.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff08150d700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c13f880 0x7ff07c145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff080d0c700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c05c660 0x7ff07c0ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff07bfff700 1 -- 172.21.15.60:0/1780320360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c13f880 msgr2=0x7ff07c145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.068 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff07bfff700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c13f880 0x7ff07c145780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff07bfff700 1 -- 172.21.15.60:0/1780320360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c05c660 msgr2=0x7ff07c0ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff07bfff700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c05c660 0x7ff07c0ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff07bfff700 1 -- 172.21.15.60:0/1780320360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c0ae510 con 0x7ff07c065f70 2020-10-31T22:51:12.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff08150d700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c13f880 0x7ff07c145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:51:12.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff080d0c700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c05c660 0x7ff07c0ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:51:12.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff07bfff700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff07c065f70 0x7ff07c151b60 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7ff07c0b5fc0 tx=0x7ff06c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:12.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff079ffb700 1 -- 172.21.15.60:0/1780320360 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff06c002f30 con 0x7ff07c065f70 2020-10-31T22:51:12.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff079ffb700 1 -- 172.21.15.60:0/1780320360 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c011ca0 con 0x7ff07c065f70 2020-10-31T22:51:12.072 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff082f70700 1 -- 172.21.15.60:0/1780320360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff07c0ae0c0 con 0x7ff07c065f70 2020-10-31T22:51:12.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff079ffb700 1 -- 172.21.15.60:0/1780320360 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff06c01e460 con 0x7ff07c065f70 2020-10-31T22:51:12.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff082f70700 1 -- 172.21.15.60:0/1780320360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff07c0ad2f0 con 0x7ff07c065f70 2020-10-31T22:51:12.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.049+0000 7ff082f70700 1 -- 172.21.15.60:0/1780320360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff07c0addb0 con 0x7ff07c065f70 2020-10-31T22:51:12.073 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.053+0000 7ff079ffb700 1 -- 172.21.15.60:0/1780320360 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7ff06c025030 con 0x7ff07c065f70 2020-10-31T22:51:12.074 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.053+0000 7ff079ffb700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff060054f10 0x7ff0600573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.053+0000 7ff079ffb700 1 -- 172.21.15.60:0/1780320360 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7ff06c06edb0 con 0x7ff07c065f70 2020-10-31T22:51:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.053+0000 7ff080d0c700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff060054f10 0x7ff0600573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.075 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.053+0000 7ff080d0c700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff060054f10 0x7ff0600573d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7ff06400b000 tx=0x7ff064008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:12.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.061+0000 7ff079ffb700 1 -- 172.21.15.60:0/1780320360 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7ff06c0452d0 con 0x7ff07c065f70 2020-10-31T22:51:12.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.205+0000 7ff082f70700 1 -- 172.21.15.60:0/1780320360 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7ff07c057100 con 0x7ff07c065f70 2020-10-31T22:51:12.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.205+0000 7ff079ffb700 1 -- 172.21.15.60:0/1780320360 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v160) v1 ==== 110+0+10 (secure 0 0 0) 0x7ff06c023020 con 0x7ff07c065f70 2020-10-31T22:51:12.210 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:51:12.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.205+0000 7ff082f70700 1 -- 172.21.15.60:0/1780320360 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff060054f10 msgr2=0x7ff0600573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.205+0000 7ff082f70700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff060054f10 0x7ff0600573d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 rx=0x7ff06400b000 tx=0x7ff064008040).stop 2020-10-31T22:51:12.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.205+0000 7ff082f70700 1 -- 172.21.15.60:0/1780320360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff07c065f70 msgr2=0x7ff07c151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.205+0000 7ff082f70700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff07c065f70 0x7ff07c151b60 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 rx=0x7ff07c0b5fc0 tx=0x7ff06c015000).stop 2020-10-31T22:51:12.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.205+0000 7ff082f70700 1 -- 172.21.15.60:0/1780320360 shutdown_connections 2020-10-31T22:51:12.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.205+0000 7ff082f70700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff07c13f880 0x7ff07c145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.205+0000 7ff082f70700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7ff060054f10 0x7ff0600573d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.236 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.205+0000 7ff082f70700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff07c05c660 0x7ff07c0ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.205+0000 7ff082f70700 1 --2- 172.21.15.60:0/1780320360 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff07c065f70 0x7ff07c151b60 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.205+0000 7ff082f70700 1 -- 172.21.15.60:0/1780320360 >> 172.21.15.60:0/1780320360 conn(0x7ff07c0601e0 msgr2=0x7ff07c0b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:12.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.205+0000 7ff082f70700 1 -- 172.21.15.60:0/1780320360 shutdown_connections 2020-10-31T22:51:12.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.205+0000 7ff082f70700 1 -- 172.21.15.60:0/1780320360 wait complete. 2020-10-31T22:51:12.238 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:51:12.369 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.361+0000 7fc8e5744700 1 Processor -- start 2020-10-31T22:51:12.390 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 -- start start 2020-10-31T22:51:12.400 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc8e00af520 0x7fc8e00ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc8e0066c90 0x7fc8e00670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e0146060 0x7fc8e01464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e00af900 con 0x7fc8e00af520 2020-10-31T22:51:12.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e00afc10 con 0x7fc8e0066c90 2020-10-31T22:51:12.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e005bb70 con 0x7fc8e0146060 2020-10-31T22:51:12.401 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8dffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc8e00af520 0x7fc8e00ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8dffff700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fc8e00af520 0x7fc8e00ac870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50248/0 (socket says 172.21.15.60:50248) 2020-10-31T22:51:12.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8dffff700 1 -- 172.21.15.60:0/3403176837 learned_addr learned my addr 172.21.15.60:0/3403176837 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:12.402 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e4f43700 1 --2- 172.21.15.60:0/3403176837 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e0146060 0x7fc8e01464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8d7fff700 1 --2- 172.21.15.60:0/3403176837 >> v2:172.21.15.66:3300/0 conn(0x7fc8e0066c90 0x7fc8e00670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8dffff700 1 -- 172.21.15.60:0/3403176837 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e0146060 msgr2=0x7fc8e01464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:12.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8dffff700 1 --2- 172.21.15.60:0/3403176837 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e0146060 0x7fc8e01464f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8dffff700 1 -- 172.21.15.60:0/3403176837 >> v2:172.21.15.66:3300/0 conn(0x7fc8e0066c90 msgr2=0x7fc8e00670f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:12.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8dffff700 1 --2- 172.21.15.60:0/3403176837 >> v2:172.21.15.66:3300/0 conn(0x7fc8e0066c90 0x7fc8e00670f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8dffff700 1 -- 172.21.15.60:0/3403176837 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e00ac130 con 0x7fc8e00af520 2020-10-31T22:51:12.403 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8dffff700 1 --2- 172.21.15.60:0/3403176837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8e00af520 0x7fc8e00ac870 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7fc8d0002f30 tx=0x7fc8d0006e20).ready entity=mon.0 client_cookie=10735e824ab66bc0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:12.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8df7fe700 1 -- 172.21.15.60:0/3403176837 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8d0009710 con 0x7fc8e00af520 2020-10-31T22:51:12.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8df7fe700 1 -- 172.21.15.60:0/3403176837 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d0009870 con 0x7fc8e00af520 2020-10-31T22:51:12.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8df7fe700 1 -- 172.21.15.60:0/3403176837 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8d0009bd0 con 0x7fc8e00af520 2020-10-31T22:51:12.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 -- 172.21.15.60:0/3403176837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8e00af520 msgr2=0x7fc8e00ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 --2- 172.21.15.60:0/3403176837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8e00af520 0x7fc8e00ac870 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 rx=0x7fc8d0002f30 tx=0x7fc8d0006e20).stop 2020-10-31T22:51:12.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 -- 172.21.15.60:0/3403176837 shutdown_connections 2020-10-31T22:51:12.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 --2- 172.21.15.60:0/3403176837 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e0146060 0x7fc8e01464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 --2- 172.21.15.60:0/3403176837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8e00af520 0x7fc8e00ac870 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 --2- 172.21.15.60:0/3403176837 >> v2:172.21.15.66:3300/0 conn(0x7fc8e0066c90 0x7fc8e00670f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 -- 172.21.15.60:0/3403176837 >> 172.21.15.60:0/3403176837 conn(0x7fc8e00b3fd0 msgr2=0x7fc8e00b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:12.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 -- 172.21.15.60:0/3403176837 shutdown_connections 2020-10-31T22:51:12.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.365+0000 7fc8e5744700 1 -- 172.21.15.60:0/3403176837 wait complete. 2020-10-31T22:51:12.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e5744700 1 Processor -- start 2020-10-31T22:51:12.405 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e5744700 1 -- start start 2020-10-31T22:51:12.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e5744700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e0066c90 0x7fc8e00ad080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e5744700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e00af520 0x7fc8e00a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e5744700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8e0146060 0x7fc8e00a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e5744700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e00aa4d0 con 0x7fc8e0146060 2020-10-31T22:51:12.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e5744700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e0140e60 con 0x7fc8e00af520 2020-10-31T22:51:12.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e5744700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e0141980 con 0x7fc8e0066c90 2020-10-31T22:51:12.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e4f43700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8e0146060 0x7fc8e00a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e4f43700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8e0146060 0x7fc8e00a9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50258/0 (socket says 172.21.15.60:50258) 2020-10-31T22:51:12.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e4f43700 1 -- 172.21.15.60:0/1925967353 learned_addr learned my addr 172.21.15.60:0/1925967353 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:12.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8d7fff700 1 --2- 172.21.15.60:0/1925967353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e00af520 0x7fc8e00a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.407 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8dffff700 1 --2- 172.21.15.60:0/1925967353 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e0066c90 0x7fc8e00ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e4f43700 1 -- 172.21.15.60:0/1925967353 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e0066c90 msgr2=0x7fc8e00ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.408 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e4f43700 1 --2- 172.21.15.60:0/1925967353 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e0066c90 0x7fc8e00ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e4f43700 1 -- 172.21.15.60:0/1925967353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e00af520 msgr2=0x7fc8e00a9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e4f43700 1 --2- 172.21.15.60:0/1925967353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e00af520 0x7fc8e00a9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e4f43700 1 -- 172.21.15.60:0/1925967353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e0141c20 con 0x7fc8e0146060 2020-10-31T22:51:12.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e4f43700 1 --2- 172.21.15.60:0/1925967353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8e0146060 0x7fc8e00a9fe0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7fc8d8006dd0 tx=0x7fc8d80091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:12.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8ddffb700 1 -- 172.21.15.60:0/1925967353 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8d800ca00 con 0x7fc8e0146060 2020-10-31T22:51:12.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8ddffb700 1 -- 172.21.15.60:0/1925967353 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d800cb60 con 0x7fc8e0146060 2020-10-31T22:51:12.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e5744700 1 -- 172.21.15.60:0/1925967353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e01420c0 con 0x7fc8e0146060 2020-10-31T22:51:12.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8ddffb700 1 -- 172.21.15.60:0/1925967353 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8d80123f0 con 0x7fc8e0146060 2020-10-31T22:51:12.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.369+0000 7fc8e5744700 1 -- 172.21.15.60:0/1925967353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e0142620 con 0x7fc8e0146060 2020-10-31T22:51:12.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.373+0000 7fc8e5744700 1 -- 172.21.15.60:0/1925967353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e0141db0 con 0x7fc8e0146060 2020-10-31T22:51:12.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.373+0000 7fc8ddffb700 1 -- 172.21.15.60:0/1925967353 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fc8d8022070 con 0x7fc8e0146060 2020-10-31T22:51:12.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.373+0000 7fc8ddffb700 1 --2- 172.21.15.60:0/1925967353 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc8b80550c0 0x7fc8b8057580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.373+0000 7fc8ddffb700 1 -- 172.21.15.60:0/1925967353 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fc8d806e150 con 0x7fc8e0146060 2020-10-31T22:51:12.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.373+0000 7fc8dffff700 1 --2- 172.21.15.60:0/1925967353 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc8b80550c0 0x7fc8b8057580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.373+0000 7fc8dffff700 1 --2- 172.21.15.60:0/1925967353 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc8b80550c0 0x7fc8b8057580 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fc8d001a000 tx=0x7fc8d0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:12.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.377+0000 7fc8ddffb700 1 -- 172.21.15.60:0/1925967353 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fc8d8044670 con 0x7fc8e0146060 2020-10-31T22:51:12.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.521+0000 7fc8e5744700 1 -- 172.21.15.60:0/1925967353 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc8e0057100 con 0x7fc8e0146060 2020-10-31T22:51:12.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.525+0000 7fc8ddffb700 1 -- 172.21.15.60:0/1925967353 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v160) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc8d8016020 con 0x7fc8e0146060 2020-10-31T22:51:12.530 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:51:12.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.525+0000 7fc8e5744700 1 -- 172.21.15.60:0/1925967353 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc8b80550c0 msgr2=0x7fc8b8057580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.525+0000 7fc8e5744700 1 --2- 172.21.15.60:0/1925967353 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc8b80550c0 0x7fc8b8057580 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 rx=0x7fc8d001a000 tx=0x7fc8d0015000).stop 2020-10-31T22:51:12.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.525+0000 7fc8e5744700 1 -- 172.21.15.60:0/1925967353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8e0146060 msgr2=0x7fc8e00a9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.525+0000 7fc8e5744700 1 --2- 172.21.15.60:0/1925967353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8e0146060 0x7fc8e00a9fe0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 rx=0x7fc8d8006dd0 tx=0x7fc8d80091a0).stop 2020-10-31T22:51:12.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.525+0000 7fc8e5744700 1 -- 172.21.15.60:0/1925967353 shutdown_connections 2020-10-31T22:51:12.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.525+0000 7fc8e5744700 1 --2- 172.21.15.60:0/1925967353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc8e0146060 0x7fc8e00a9fe0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.525+0000 7fc8e5744700 1 --2- 172.21.15.60:0/1925967353 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc8e0066c90 0x7fc8e00ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.525+0000 7fc8e5744700 1 --2- 172.21.15.60:0/1925967353 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fc8b80550c0 0x7fc8b8057580 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.525+0000 7fc8e5744700 1 --2- 172.21.15.60:0/1925967353 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc8e00af520 0x7fc8e00a9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.525+0000 7fc8e5744700 1 -- 172.21.15.60:0/1925967353 >> 172.21.15.60:0/1925967353 conn(0x7fc8e00b3fd0 msgr2=0x7fc8e00b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.525+0000 7fc8e5744700 1 -- 172.21.15.60:0/1925967353 shutdown_connections 2020-10-31T22:51:12.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.525+0000 7fc8e5744700 1 -- 172.21.15.60:0/1925967353 wait complete. 2020-10-31T22:51:12.543 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:51:12.671 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.665+0000 7f89a83fd700 1 Processor -- start 2020-10-31T22:51:12.672 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.665+0000 7f89a83fd700 1 -- start start 2020-10-31T22:51:12.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.665+0000 7f89a83fd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f89a005c660 0x7f89a00b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.676 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.665+0000 7f89a83fd700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a0066410 con 0x7f89a0065f70 2020-10-31T22:51:12.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.665+0000 7f89a83fd700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a00666b0 con 0x7f89a00b2e20 2020-10-31T22:51:12.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.665+0000 7f89a83fd700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89a0066d60 con 0x7f89a005c660 2020-10-31T22:51:12.677 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.665+0000 7f89a5998700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f89a0065f70 0x7f89a013f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54398/0 (socket says 172.21.15.60:54398) 2020-10-31T22:51:12.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.665+0000 7f89a5998700 1 -- 172.21.15.60:0/3394632175 learned_addr learned my addr 172.21.15.60:0/3394632175 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:12.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a6199700 1 --2- 172.21.15.60:0/3394632175 >> v2:172.21.15.66:3300/0 conn(0x7f89a005c660 0x7f89a00b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.678 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a5197700 1 -- 172.21.15.60:0/3394632175 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3102193028 0 0) 0x7f89a0066410 con 0x7f89a0065f70 2020-10-31T22:51:12.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a5197700 1 -- 172.21.15.60:0/3394632175 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8988003230 con 0x7f89a0065f70 2020-10-31T22:51:12.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a6199700 1 -- 172.21.15.60:0/3394632175 >> v1:172.21.15.66:6789/0 conn(0x7f89a00b2e20 legacy=0x7f89a0142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a6199700 1 -- 172.21.15.60:0/3394632175 >> v1:172.21.15.60:6789/0 conn(0x7f89a0065f70 legacy=0x7f89a013f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.679 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a5197700 1 -- 172.21.15.60:0/3394632175 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3896149737 0 0) 0x7f8988003230 con 0x7f89a0065f70 2020-10-31T22:51:12.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a6199700 1 -- 172.21.15.60:0/3394632175 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a0142170 con 0x7f89a005c660 2020-10-31T22:51:12.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a6199700 1 --2- 172.21.15.60:0/3394632175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89a005c660 0x7f89a00b5990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f8994001870 tx=0x7f899c006dc0).ready entity=mon.1 client_cookie=aeccd66a58f13ac7 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:12.680 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a5197700 1 -- 172.21.15.60:0/3394632175 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89940016d0 con 0x7f89a005c660 2020-10-31T22:51:12.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a5197700 1 -- 172.21.15.60:0/3394632175 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c009670 con 0x7f89a005c660 2020-10-31T22:51:12.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a5197700 1 -- 172.21.15.60:0/3394632175 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f899c0097e0 con 0x7f89a005c660 2020-10-31T22:51:12.681 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a83fd700 1 -- 172.21.15.60:0/3394632175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89a005c660 msgr2=0x7f89a00b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a83fd700 1 --2- 172.21.15.60:0/3394632175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89a005c660 0x7f89a00b5990 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f8994001870 tx=0x7f899c006dc0).stop 2020-10-31T22:51:12.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a83fd700 1 -- 172.21.15.60:0/3394632175 shutdown_connections 2020-10-31T22:51:12.682 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a83fd700 1 --2- 172.21.15.60:0/3394632175 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89a005c660 0x7f89a00b5990 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a83fd700 1 -- 172.21.15.60:0/3394632175 >> 172.21.15.60:0/3394632175 conn(0x7f89a00601e0 msgr2=0x7f89a005b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a83fd700 1 -- 172.21.15.60:0/3394632175 shutdown_connections 2020-10-31T22:51:12.683 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.669+0000 7f89a83fd700 1 -- 172.21.15.60:0/3394632175 wait complete. 2020-10-31T22:51:12.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a83fd700 1 Processor -- start 2020-10-31T22:51:12.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a83fd700 1 -- start start 2020-10-31T22:51:12.687 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a83fd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89a005c660 0x7f89a00aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a83fd700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89a0065f70 0x7f89a00addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a83fd700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89a00b2e20 0x7f89a00ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a83fd700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a0150cd0 con 0x7f89a0065f70 2020-10-31T22:51:12.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a83fd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00b2170 con 0x7f89a005c660 2020-10-31T22:51:12.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a83fd700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00b2410 con 0x7f89a00b2e20 2020-10-31T22:51:12.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a5998700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89a0065f70 0x7f89a00addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.689 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a5998700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89a0065f70 0x7f89a00addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50270/0 (socket says 172.21.15.60:50270) 2020-10-31T22:51:12.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a5998700 1 -- 172.21.15.60:0/123878574 learned_addr learned my addr 172.21.15.60:0/123878574 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:12.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a6199700 1 --2- 172.21.15.60:0/123878574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89a005c660 0x7f89a00aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a699a700 1 --2- 172.21.15.60:0/123878574 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89a00b2e20 0x7f89a00ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a5998700 1 -- 172.21.15.60:0/123878574 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89a00b2e20 msgr2=0x7f89a00ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a5998700 1 --2- 172.21.15.60:0/123878574 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89a00b2e20 0x7f89a00ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a5998700 1 -- 172.21.15.60:0/123878574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89a005c660 msgr2=0x7f89a00aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a5998700 1 --2- 172.21.15.60:0/123878574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89a005c660 0x7f89a00aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a5998700 1 -- 172.21.15.60:0/123878574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a00b26b0 con 0x7f89a0065f70 2020-10-31T22:51:12.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a5998700 1 --2- 172.21.15.60:0/123878574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89a0065f70 0x7f89a00addc0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f8994001930 tx=0x7f8994001280).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:12.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89937fe700 1 -- 172.21.15.60:0/123878574 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8994007170 con 0x7f89a0065f70 2020-10-31T22:51:12.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89937fe700 1 -- 172.21.15.60:0/123878574 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89940072d0 con 0x7f89a0065f70 2020-10-31T22:51:12.693 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a83fd700 1 -- 172.21.15.60:0/123878574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a00b1300 con 0x7f89a0065f70 2020-10-31T22:51:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89937fe700 1 -- 172.21.15.60:0/123878574 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f89940048f0 con 0x7f89a0065f70 2020-10-31T22:51:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.673+0000 7f89a83fd700 1 -- 172.21.15.60:0/123878574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a00ae7a0 con 0x7f89a0065f70 2020-10-31T22:51:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.677+0000 7f89a83fd700 1 -- 172.21.15.60:0/123878574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a0057100 con 0x7f89a0065f70 2020-10-31T22:51:12.694 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.677+0000 7f89937fe700 1 -- 172.21.15.60:0/123878574 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f899401b070 con 0x7f89a0065f70 2020-10-31T22:51:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.677+0000 7f89937fe700 1 --2- 172.21.15.60:0/123878574 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8980054f10 0x7f89800573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.677+0000 7f89a6199700 1 --2- 172.21.15.60:0/123878574 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8980054f10 0x7f89800573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.695 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.677+0000 7f89937fe700 1 -- 172.21.15.60:0/123878574 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f899406d820 con 0x7f89a0065f70 2020-10-31T22:51:12.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.677+0000 7f89a6199700 1 --2- 172.21.15.60:0/123878574 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8980054f10 0x7f89800573d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f899c019000 tx=0x7f899c015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:12.696 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.689+0000 7f89937fe700 1 -- 172.21.15.60:0/123878574 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8994042df0 con 0x7f89a0065f70 2020-10-31T22:51:12.836 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.829+0000 7f89a83fd700 1 -- 172.21.15.60:0/123878574 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f89a005aa70 con 0x7f89a0065f70 2020-10-31T22:51:12.837 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.829+0000 7f89937fe700 1 -- 172.21.15.60:0/123878574 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v160) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8994019070 con 0x7f89a0065f70 2020-10-31T22:51:12.837 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:51:12.838 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.833+0000 7f89a83fd700 1 -- 172.21.15.60:0/123878574 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8980054f10 msgr2=0x7f89800573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.833+0000 7f89a83fd700 1 --2- 172.21.15.60:0/123878574 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8980054f10 0x7f89800573d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 rx=0x7f899c019000 tx=0x7f899c015000).stop 2020-10-31T22:51:12.839 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.833+0000 7f89a83fd700 1 -- 172.21.15.60:0/123878574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89a0065f70 msgr2=0x7f89a00addc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.833+0000 7f89a83fd700 1 --2- 172.21.15.60:0/123878574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89a0065f70 0x7f89a00addc0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 rx=0x7f8994001930 tx=0x7f8994001280).stop 2020-10-31T22:51:12.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.833+0000 7f89a83fd700 1 -- 172.21.15.60:0/123878574 shutdown_connections 2020-10-31T22:51:12.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.833+0000 7f89a83fd700 1 --2- 172.21.15.60:0/123878574 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89a00b2e20 0x7f89a00ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.840 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.833+0000 7f89a83fd700 1 --2- 172.21.15.60:0/123878574 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8980054f10 0x7f89800573d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.833+0000 7f89a83fd700 1 --2- 172.21.15.60:0/123878574 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89a005c660 0x7f89a00aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.833+0000 7f89a83fd700 1 --2- 172.21.15.60:0/123878574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f89a0065f70 0x7f89a00addc0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.841 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.833+0000 7f89a83fd700 1 -- 172.21.15.60:0/123878574 >> 172.21.15.60:0/123878574 conn(0x7f89a00601e0 msgr2=0x7f89a013d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:12.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.833+0000 7f89a83fd700 1 -- 172.21.15.60:0/123878574 shutdown_connections 2020-10-31T22:51:12.842 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.833+0000 7f89a83fd700 1 -- 172.21.15.60:0/123878574 wait complete. 2020-10-31T22:51:12.854 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:51:12.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.977+0000 7f19aa0f4700 1 Processor -- start 2020-10-31T22:51:12.983 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.977+0000 7f19aa0f4700 1 -- start start 2020-10-31T22:51:12.985 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.977+0000 7f19aa0f4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19a40b2790 0x7f19a40aff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.977+0000 7f19aa0f4700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f19a413c360 0x7f19a40ae520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:12.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.977+0000 7f19aa0f4700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a40b2b70 con 0x7f19a40af660 2020-10-31T22:51:12.986 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.977+0000 7f19aa0f4700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a413c7f0 con 0x7f19a413c360 2020-10-31T22:51:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.977+0000 7f19aa0f4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a40b0410 con 0x7f19a40b2790 2020-10-31T22:51:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.977+0000 7f19a2ffd700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f19a40af660 0x7f19a413bc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54412/0 (socket says 172.21.15.60:54412) 2020-10-31T22:51:12.987 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.977+0000 7f19a2ffd700 1 -- 172.21.15.60:0/1512539807 learned_addr learned my addr 172.21.15.60:0/1512539807 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:12.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.977+0000 7f19a3fff700 1 --2- 172.21.15.60:0/1512539807 >> v2:172.21.15.66:3300/0 conn(0x7f19a413c360 0x7f19a40ae520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.977+0000 7f19a37fe700 1 --2- 172.21.15.60:0/1512539807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19a40b2790 0x7f19a40aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:12.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19a27fc700 1 -- 172.21.15.60:0/1512539807 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3330466725 0 0) 0x7f19a40b2b70 con 0x7f19a40af660 2020-10-31T22:51:12.990 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19a27fc700 1 -- 172.21.15.60:0/1512539807 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1990003230 con 0x7f19a40af660 2020-10-31T22:51:12.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19a3fff700 1 -- 172.21.15.60:0/1512539807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19a40b2790 msgr2=0x7f19a40aff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:12.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19a3fff700 1 --2- 172.21.15.60:0/1512539807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19a40b2790 0x7f19a40aff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:12.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19a3fff700 1 -- 172.21.15.60:0/1512539807 >> v1:172.21.15.60:6789/0 conn(0x7f19a40af660 legacy=0x7f19a413bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19a3fff700 1 -- 172.21.15.60:0/1512539807 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a40b0db0 con 0x7f19a413c360 2020-10-31T22:51:12.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19a3fff700 1 --2- 172.21.15.60:0/1512539807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19a413c360 0x7f19a40ae520 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f199c0032b0 tx=0x7f199c0091a0).ready entity=mon.1 client_cookie=baf1e405519d870a server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:12.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19a27fc700 1 -- 172.21.15.60:0/1512539807 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f199c00b940 con 0x7f19a413c360 2020-10-31T22:51:12.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19a27fc700 1 -- 172.21.15.60:0/1512539807 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c00baa0 con 0x7f19a413c360 2020-10-31T22:51:12.994 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19a27fc700 1 -- 172.21.15.60:0/1512539807 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f199c00bc10 con 0x7f19a413c360 2020-10-31T22:51:12.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1512539807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19a413c360 msgr2=0x7f19a40ae520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:12.995 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19aa0f4700 1 --2- 172.21.15.60:0/1512539807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19a413c360 0x7f19a40ae520 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f199c0032b0 tx=0x7f199c0091a0).stop 2020-10-31T22:51:13.001 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1512539807 shutdown_connections 2020-10-31T22:51:13.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19aa0f4700 1 --2- 172.21.15.60:0/1512539807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19a413c360 0x7f19a40ae520 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19aa0f4700 1 --2- 172.21.15.60:0/1512539807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19a40b2790 0x7f19a40aff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1512539807 >> 172.21.15.60:0/1512539807 conn(0x7f19a40b5d30 msgr2=0x7f19a40b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:13.002 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1512539807 shutdown_connections 2020-10-31T22:51:13.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1512539807 wait complete. 2020-10-31T22:51:13.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19aa0f4700 1 Processor -- start 2020-10-31T22:51:13.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.981+0000 7f19aa0f4700 1 -- start start 2020-10-31T22:51:13.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19aa0f4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19a40af660 0x7f19a413d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:13.003 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19aa0f4700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19a40b2790 0x7f19a413e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:13.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19aa0f4700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a413c360 0x7f19a413ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:13.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19aa0f4700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a413ef70 con 0x7f19a413c360 2020-10-31T22:51:13.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19aa0f4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a4142320 con 0x7f19a40af660 2020-10-31T22:51:13.004 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19aa0f4700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a4142e30 con 0x7f19a40b2790 2020-10-31T22:51:13.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19a3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a413c360 0x7f19a413ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:13.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19a3fff700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a413c360 0x7f19a413ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50286/0 (socket says 172.21.15.60:50286) 2020-10-31T22:51:13.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19a3fff700 1 -- 172.21.15.60:0/1336967203 learned_addr learned my addr 172.21.15.60:0/1336967203 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:13.005 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19a2ffd700 1 --2- 172.21.15.60:0/1336967203 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19a40b2790 0x7f19a413e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:13.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19a37fe700 1 --2- 172.21.15.60:0/1336967203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19a40af660 0x7f19a413d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:13.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19a3fff700 1 -- 172.21.15.60:0/1336967203 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19a40b2790 msgr2=0x7f19a413e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:13.006 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19a3fff700 1 --2- 172.21.15.60:0/1336967203 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19a40b2790 0x7f19a413e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19a3fff700 1 -- 172.21.15.60:0/1336967203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19a40af660 msgr2=0x7f19a413d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:13.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19a3fff700 1 --2- 172.21.15.60:0/1336967203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19a40af660 0x7f19a413d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.007 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19a3fff700 1 -- 172.21.15.60:0/1336967203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a4142080 con 0x7f19a413c360 2020-10-31T22:51:13.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19a3fff700 1 --2- 172.21.15.60:0/1336967203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a413c360 0x7f19a413ea80 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f199c0032b0 tx=0x7f199c016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:13.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19a0ff9700 1 -- 172.21.15.60:0/1336967203 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f199c020400 con 0x7f19a413c360 2020-10-31T22:51:13.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1336967203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a405c890 con 0x7f19a413c360 2020-10-31T22:51:13.008 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19a0ff9700 1 -- 172.21.15.60:0/1336967203 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c020560 con 0x7f19a413c360 2020-10-31T22:51:13.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1336967203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a413c930 con 0x7f19a413c360 2020-10-31T22:51:13.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19a0ff9700 1 -- 172.21.15.60:0/1336967203 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f199c0208c0 con 0x7f19a413c360 2020-10-31T22:51:13.009 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.985+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1336967203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a405ca20 con 0x7f19a413c360 2020-10-31T22:51:13.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.989+0000 7f19a0ff9700 1 -- 172.21.15.60:0/1336967203 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f199c027030 con 0x7f19a413c360 2020-10-31T22:51:13.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.989+0000 7f19a0ff9700 1 --2- 172.21.15.60:0/1336967203 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1984054f10 0x7f19840573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:13.010 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.989+0000 7f19a37fe700 1 --2- 172.21.15.60:0/1336967203 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1984054f10 0x7f19840573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:13.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.989+0000 7f19a0ff9700 1 -- 172.21.15.60:0/1336967203 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f199c06ea00 con 0x7f19a413c360 2020-10-31T22:51:13.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.989+0000 7f19a37fe700 1 --2- 172.21.15.60:0/1336967203 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1984054f10 0x7f19840573d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f199400b000 tx=0x7f1994006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:13.011 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:12.997+0000 7f19a0ff9700 1 -- 172.21.15.60:0/1336967203 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f199c044e80 con 0x7f19a413c360 2020-10-31T22:51:13.144 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.137+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1336967203 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19a4057100 con 0x7f19a413c360 2020-10-31T22:51:13.148 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.141+0000 7f19a0ff9700 1 -- 172.21.15.60:0/1336967203 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v160) v1 ==== 100+0+10 (secure 0 0 0) 0x7f199c0250a0 con 0x7f19a413c360 2020-10-31T22:51:13.148 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:51:13.149 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.145+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1336967203 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1984054f10 msgr2=0x7f19840573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:13.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.145+0000 7f19aa0f4700 1 --2- 172.21.15.60:0/1336967203 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1984054f10 0x7f19840573d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 rx=0x7f199400b000 tx=0x7f1994006dc0).stop 2020-10-31T22:51:13.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.145+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1336967203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a413c360 msgr2=0x7f19a413ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:13.150 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.145+0000 7f19aa0f4700 1 --2- 172.21.15.60:0/1336967203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a413c360 0x7f19a413ea80 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 rx=0x7f199c0032b0 tx=0x7f199c016000).stop 2020-10-31T22:51:13.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.145+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1336967203 shutdown_connections 2020-10-31T22:51:13.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.145+0000 7f19aa0f4700 1 --2- 172.21.15.60:0/1336967203 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19a413c360 0x7f19a413ea80 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.151 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.145+0000 7f19aa0f4700 1 --2- 172.21.15.60:0/1336967203 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f1984054f10 0x7f19840573d0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.145+0000 7f19aa0f4700 1 --2- 172.21.15.60:0/1336967203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f19a40af660 0x7f19a413d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.145+0000 7f19aa0f4700 1 --2- 172.21.15.60:0/1336967203 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f19a40b2790 0x7f19a413e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.145+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1336967203 >> 172.21.15.60:0/1336967203 conn(0x7f19a40b5d30 msgr2=0x7f19a4138e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:13.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.145+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1336967203 shutdown_connections 2020-10-31T22:51:13.152 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.145+0000 7f19aa0f4700 1 -- 172.21.15.60:0/1336967203 wait complete. 2020-10-31T22:51:13.162 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:51:13.163 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:51:13.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.277+0000 7fe99b59e700 1 Processor -- start 2020-10-31T22:51:13.284 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.277+0000 7fe99b59e700 1 -- start start 2020-10-31T22:51:13.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99b59e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe99c0af520 0x7fe99c0ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:13.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99b59e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe99c066c90 0x7fe99c0670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:13.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99b59e700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe99c0af900 con 0x7fe99c146060 2020-10-31T22:51:13.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99b59e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99c0afc10 con 0x7fe99c066c90 2020-10-31T22:51:13.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99b59e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99c05bb70 con 0x7fe99c0af520 2020-10-31T22:51:13.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe999d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fe99c066c90 0x7fe99c0670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:13.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99ad9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fe99c146060 0x7fe99c149620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54430/0 (socket says 172.21.15.60:54430) 2020-10-31T22:51:13.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99ad9d700 1 -- 172.21.15.60:0/1114170349 learned_addr learned my addr 172.21.15.60:0/1114170349 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:13.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99a59c700 1 --2- 172.21.15.60:0/1114170349 >> v2:172.21.15.66:3300/0 conn(0x7fe99c0af520 0x7fe99c0ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:13.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe999d9b700 1 -- 172.21.15.60:0/1114170349 >> v2:172.21.15.66:3300/0 conn(0x7fe99c0af520 msgr2=0x7fe99c0ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:13.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe999d9b700 1 --2- 172.21.15.60:0/1114170349 >> v2:172.21.15.66:3300/0 conn(0x7fe99c0af520 0x7fe99c0ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.287 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe999d9b700 1 -- 172.21.15.60:0/1114170349 >> v1:172.21.15.60:6789/0 conn(0x7fe99c146060 legacy=0x7fe99c149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:13.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99959a700 1 -- 172.21.15.60:0/1114170349 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484207329 0 0) 0x7fe99c0af900 con 0x7fe99c146060 2020-10-31T22:51:13.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe999d9b700 1 -- 172.21.15.60:0/1114170349 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c0ac130 con 0x7fe99c066c90 2020-10-31T22:51:13.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe999d9b700 1 --2- 172.21.15.60:0/1114170349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe99c066c90 0x7fe99c0670f0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7fe984002f30 tx=0x7fe984006dc0).ready entity=mon.0 client_cookie=17a8120f57d380e6 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:13.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99959a700 1 -- 172.21.15.60:0/1114170349 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe9840097b0 con 0x7fe99c066c90 2020-10-31T22:51:13.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99959a700 1 -- 172.21.15.60:0/1114170349 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe984009910 con 0x7fe99c066c90 2020-10-31T22:51:13.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99959a700 1 -- 172.21.15.60:0/1114170349 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe984009c70 con 0x7fe99c066c90 2020-10-31T22:51:13.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99b59e700 1 -- 172.21.15.60:0/1114170349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe99c066c90 msgr2=0x7fe99c0670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:13.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99b59e700 1 --2- 172.21.15.60:0/1114170349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe99c066c90 0x7fe99c0670f0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 rx=0x7fe984002f30 tx=0x7fe984006dc0).stop 2020-10-31T22:51:13.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99b59e700 1 -- 172.21.15.60:0/1114170349 shutdown_connections 2020-10-31T22:51:13.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99b59e700 1 --2- 172.21.15.60:0/1114170349 >> v2:172.21.15.66:3300/0 conn(0x7fe99c0af520 0x7fe99c0ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99b59e700 1 --2- 172.21.15.60:0/1114170349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe99c066c90 0x7fe99c0670f0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99b59e700 1 -- 172.21.15.60:0/1114170349 >> 172.21.15.60:0/1114170349 conn(0x7fe99c0b3fd0 msgr2=0x7fe99c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:13.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99b59e700 1 -- 172.21.15.60:0/1114170349 shutdown_connections 2020-10-31T22:51:13.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.281+0000 7fe99b59e700 1 -- 172.21.15.60:0/1114170349 wait complete. 2020-10-31T22:51:13.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99b59e700 1 Processor -- start 2020-10-31T22:51:13.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99b59e700 1 -- start start 2020-10-31T22:51:13.292 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99b59e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe99c066c90 0x7fe99c14bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99b59e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe99c0af520 0x7fe99c0aa730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99b59e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe99c146060 0x7fe99c1551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99b59e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c0a7de0 con 0x7fe99c146060 2020-10-31T22:51:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99b59e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c0a8080 con 0x7fe99c0af520 2020-10-31T22:51:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99b59e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99c0a8320 con 0x7fe99c066c90 2020-10-31T22:51:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe99c146060 0x7fe99c1551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:13.293 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99ad9d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe99c146060 0x7fe99c1551c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50300/0 (socket says 172.21.15.60:50300) 2020-10-31T22:51:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99ad9d700 1 -- 172.21.15.60:0/2973279407 learned_addr learned my addr 172.21.15.60:0/2973279407 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99a59c700 1 --2- 172.21.15.60:0/2973279407 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe99c066c90 0x7fe99c14bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:13.294 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe999d9b700 1 --2- 172.21.15.60:0/2973279407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe99c0af520 0x7fe99c0aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:13.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99ad9d700 1 -- 172.21.15.60:0/2973279407 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe99c066c90 msgr2=0x7fe99c14bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:13.295 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99ad9d700 1 --2- 172.21.15.60:0/2973279407 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe99c066c90 0x7fe99c14bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99ad9d700 1 -- 172.21.15.60:0/2973279407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe99c0af520 msgr2=0x7fe99c0aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:13.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99ad9d700 1 --2- 172.21.15.60:0/2973279407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe99c0af520 0x7fe99c0aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99ad9d700 1 -- 172.21.15.60:0/2973279407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99c0a85c0 con 0x7fe99c146060 2020-10-31T22:51:13.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99ad9d700 1 --2- 172.21.15.60:0/2973279407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe99c146060 0x7fe99c1551c0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7fe994000e90 tx=0x7fe994007990).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:13.296 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe9937fe700 1 -- 172.21.15.60:0/2973279407 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe994007320 con 0x7fe99c146060 2020-10-31T22:51:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe9937fe700 1 -- 172.21.15.60:0/2973279407 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe994007480 con 0x7fe99c146060 2020-10-31T22:51:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe9937fe700 1 -- 172.21.15.60:0/2973279407 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe994005220 con 0x7fe99c146060 2020-10-31T22:51:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99b59e700 1 -- 172.21.15.60:0/2973279407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe99c154d20 con 0x7fe99c146060 2020-10-31T22:51:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.285+0000 7fe99b59e700 1 -- 172.21.15.60:0/2973279407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99c0a9fd0 con 0x7fe99c146060 2020-10-31T22:51:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.289+0000 7fe99b59e700 1 -- 172.21.15.60:0/2973279407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe99c057100 con 0x7fe99c146060 2020-10-31T22:51:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.289+0000 7fe9937fe700 1 -- 172.21.15.60:0/2973279407 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fe9940055e0 con 0x7fe99c146060 2020-10-31T22:51:13.297 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.289+0000 7fe9937fe700 1 --2- 172.21.15.60:0/2973279407 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe980055020 0x7fe9800574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.289+0000 7fe9937fe700 1 -- 172.21.15.60:0/2973279407 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fe99406d340 con 0x7fe99c146060 2020-10-31T22:51:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.289+0000 7fe99a59c700 1 --2- 172.21.15.60:0/2973279407 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe980055020 0x7fe9800574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:13.298 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.289+0000 7fe99a59c700 1 --2- 172.21.15.60:0/2973279407 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe980055020 0x7fe9800574e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fe98c00b000 tx=0x7fe98c0091a0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:13.301 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.297+0000 7fe9937fe700 1 -- 172.21.15.60:0/2973279407 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fe994043800 con 0x7fe99c146060 2020-10-31T22:51:13.490 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.485+0000 7fe99b59e700 1 -- 172.21.15.60:0/2973279407 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe99c154eb0 con 0x7fe99c146060 2020-10-31T22:51:13.491 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.485+0000 7fe9937fe700 1 -- 172.21.15.60:0/2973279407 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+2486 (secure 0 0 0) 0x7fe994046e20 con 0x7fe99c146060 2020-10-31T22:51:13.491 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:13.492 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":81,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/542860877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":542860877},{"type":"v1","addr":"172.21.15.66:6833","nonce":542860877}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79},{"gid":8535,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/480001574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":480001574},{"type":"v1","addr":"172.21.15.60:6835","nonce":480001574}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:51:08.474776+0000","modified":"2020-10-31T22:51:09.477436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/364183995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":364183995},{"type":"v1","addr":"172.21.15.60:6837","nonce":364183995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-10-31T22:51:13.493 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.489+0000 7fe99b59e700 1 -- 172.21.15.60:0/2973279407 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe980055020 msgr2=0x7fe9800574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.489+0000 7fe99b59e700 1 --2- 172.21.15.60:0/2973279407 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe980055020 0x7fe9800574e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 rx=0x7fe98c00b000 tx=0x7fe98c0091a0).stop 2020-10-31T22:51:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.489+0000 7fe99b59e700 1 -- 172.21.15.60:0/2973279407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe99c146060 msgr2=0x7fe99c1551c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.489+0000 7fe99b59e700 1 --2- 172.21.15.60:0/2973279407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe99c146060 0x7fe99c1551c0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 rx=0x7fe994000e90 tx=0x7fe994007990).stop 2020-10-31T22:51:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.489+0000 7fe99b59e700 1 -- 172.21.15.60:0/2973279407 shutdown_connections 2020-10-31T22:51:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.489+0000 7fe99b59e700 1 --2- 172.21.15.60:0/2973279407 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe99c146060 0x7fe99c1551c0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.494 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.489+0000 7fe99b59e700 1 --2- 172.21.15.60:0/2973279407 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe99c066c90 0x7fe99c14bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.489+0000 7fe99b59e700 1 --2- 172.21.15.60:0/2973279407 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fe980055020 0x7fe9800574e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.489+0000 7fe99b59e700 1 --2- 172.21.15.60:0/2973279407 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe99c0af520 0x7fe99c0aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:13.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.489+0000 7fe99b59e700 1 -- 172.21.15.60:0/2973279407 >> 172.21.15.60:0/2973279407 conn(0x7fe99c0b3fd0 msgr2=0x7fe99c14c950 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:13.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.489+0000 7fe99b59e700 1 -- 172.21.15.60:0/2973279407 shutdown_connections 2020-10-31T22:51:13.495 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:13.489+0000 7fe99b59e700 1 -- 172.21.15.60:0/2973279407 wait complete. 2020-10-31T22:51:13.496 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 81 2020-10-31T22:51:13.808 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:51:08.474776+0000', 'modified': '2020-10-31T22:51:09.477436+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8547}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8547': {'gid': 8547, 'name': 'c', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/364183995', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 364183995}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 364183995}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:51:13.809 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:51:13.810 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:51:13.943 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":8547,"want_state":"up:active","state":"up:active","rank_uptime":5.4559729560000001,"mdsmap_epoch":81,"osdmap_epoch":160,"osdmap_epoch_barrier":159,"uptime":10.691006736} 2020-10-31T22:51:13.946 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 8547, "mdsmap_epoch": 81, "osdmap_epoch": 160, "osdmap_epoch_barrier": 159, "rank_uptime": 5.455972956, "state": "up:active", "uptime": 10.691006736, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:51:13.947 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:51:13.947 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-10-31T22:51:13.948 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi152.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-10-31T22:51:13.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:13.948 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:51:13.960 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:51:14.018 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:51:14.019 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:51:14.077 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:51:14.079 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:51:14.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:14.080 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:51:14.132 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:51:14.133 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:51:14.183 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:51:14.199 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:51:14.200 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:51:14.257 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:51:14.258 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:51:14.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:14.259 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:51:14.261 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:2020-10-31T22:51:14.258+0000 7f77e46130c0 -1 init, newargv = 0x5601bdd69430 newargc=9ceph-fuse[14299]: starting ceph client 2020-10-31T22:51:14.261 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr: 2020-10-31T22:51:14.272 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi152.stderr:ceph-fuse[14299]: starting fuse 2020-10-31T22:51:15.367 INFO:teuthology.orchestra.run.smithi152:> sudo modprobe fuse 2020-10-31T22:51:15.384 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:51:15.385 INFO:teuthology.orchestra.run.smithi152:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:51:15.442 INFO:teuthology.orchestra.run.smithi152.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:51:15.443 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:51:15.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:15.444 INFO:teuthology.orchestra.run.smithi152:> ls /sys/fs/fuse/connections 2020-10-31T22:51:15.485 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:51:15.487 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:51:15.490 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:51:15.492 INFO:teuthology.orchestra.run.smithi152.stdout:49 2020-10-31T22:51:15.492 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2020-10-31T22:51:15.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:15.493 INFO:teuthology.orchestra.run.smithi152:> sudo python3 -c ' 2020-10-31T22:51:15.493 INFO:teuthology.orchestra.run.smithi152:> import glob 2020-10-31T22:51:15.494 INFO:teuthology.orchestra.run.smithi152:> import re 2020-10-31T22:51:15.494 INFO:teuthology.orchestra.run.smithi152:> import os 2020-10-31T22:51:15.494 INFO:teuthology.orchestra.run.smithi152:> import subprocess 2020-10-31T22:51:15.495 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:51:15.495 INFO:teuthology.orchestra.run.smithi152:> def find_socket(client_name): 2020-10-31T22:51:15.495 INFO:teuthology.orchestra.run.smithi152:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-10-31T22:51:15.496 INFO:teuthology.orchestra.run.smithi152:> files = glob.glob(asok_path) 2020-10-31T22:51:15.496 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:51:15.496 INFO:teuthology.orchestra.run.smithi152:> # Given a non-glob path, it better be there 2020-10-31T22:51:15.497 INFO:teuthology.orchestra.run.smithi152:> if "*" not in asok_path: 2020-10-31T22:51:15.497 INFO:teuthology.orchestra.run.smithi152:> assert(len(files) == 1) 2020-10-31T22:51:15.497 INFO:teuthology.orchestra.run.smithi152:> return files[0] 2020-10-31T22:51:15.497 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:51:15.498 INFO:teuthology.orchestra.run.smithi152:> for f in files: 2020-10-31T22:51:15.498 INFO:teuthology.orchestra.run.smithi152:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:51:15.498 INFO:teuthology.orchestra.run.smithi152:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:51:15.499 INFO:teuthology.orchestra.run.smithi152:> return f 2020-10-31T22:51:15.499 INFO:teuthology.orchestra.run.smithi152:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:51:15.499 INFO:teuthology.orchestra.run.smithi152:> 2020-10-31T22:51:15.500 INFO:teuthology.orchestra.run.smithi152:> print(find_socket("client.0")) 2020-10-31T22:51:15.500 INFO:teuthology.orchestra.run.smithi152:> ' 2020-10-31T22:51:15.502 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:51:15.583 INFO:teuthology.orchestra.run.smithi152.stdout:/var/run/ceph/ceph-client.0.14299.asok 2020-10-31T22:51:15.588 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.14299.asok 2020-10-31T22:51:15.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:15.590 INFO:teuthology.orchestra.run.smithi152:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.14299.asok status 2020-10-31T22:51:15.733 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2020-10-31T22:51:15.733 INFO:teuthology.orchestra.run.smithi152.stdout: "metadata": { 2020-10-31T22:51:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:51:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:51:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: "entity_id": "0", 2020-10-31T22:51:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: "hostname": "smithi152", 2020-10-31T22:51:15.734 INFO:teuthology.orchestra.run.smithi152.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-10-31T22:51:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: "pid": "14299", 2020-10-31T22:51:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: "root": "/" 2020-10-31T22:51:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:51:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_count": 0, 2020-10-31T22:51:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: "dentry_pinned_count": 0, 2020-10-31T22:51:15.735 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 7409, 2020-10-31T22:51:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: "inst": { 2020-10-31T22:51:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: "name": { 2020-10-31T22:51:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "client", 2020-10-31T22:51:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: "num": 7409 2020-10-31T22:51:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:51:15.736 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:51:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:51:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:51:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2662263661 2020-10-31T22:51:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: } 2020-10-31T22:51:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:51:15.737 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": { 2020-10-31T22:51:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: "type": "v1", 2020-10-31T22:51:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: "addr": "172.21.15.152:0", 2020-10-31T22:51:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: "nonce": 2662263661 2020-10-31T22:51:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2020-10-31T22:51:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: "inst_str": "client.7409 172.21.15.152:0/2662263661", 2020-10-31T22:51:15.738 INFO:teuthology.orchestra.run.smithi152.stdout: "addr_str": "172.21.15.152:0/2662263661", 2020-10-31T22:51:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: "inode_count": 1, 2020-10-31T22:51:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: "mds_epoch": 81, 2020-10-31T22:51:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch": 160, 2020-10-31T22:51:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:51:15.739 INFO:teuthology.orchestra.run.smithi152.stdout: "blacklisted": false 2020-10-31T22:51:15.739 INFO:teuthology.orchestra.run.smithi152.stdout:} 2020-10-31T22:51:15.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:15.743 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:51:15.744 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:51:15.750 INFO:teuthology.orchestra.run.smithi152.stdout:fuseblk 2020-10-31T22:51:15.751 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-10-31T22:51:15.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:15.752 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:51:15.812 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-10-31T22:51:15.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7be17e700 1 Processor -- start 2020-10-31T22:51:15.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7be17e700 1 -- start start 2020-10-31T22:51:15.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7be17e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa7b805b320 0x7fa7b80ae970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:15.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7be17e700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7b80aa830 0x7fa7b80ac020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:15.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7be17e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b80ab410 con 0x7fa7b805c050 2020-10-31T22:51:15.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7be17e700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b80ab640 con 0x7fa7b80aa830 2020-10-31T22:51:15.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7be17e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b80ab8e0 con 0x7fa7b805b320 2020-10-31T22:51:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7bc97b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7b80aa830 0x7fa7b80ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7bc97b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa7b80aa830 0x7fa7b80ac020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50304/0 (socket says 172.21.15.60:50304) 2020-10-31T22:51:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7bc97b700 1 -- 172.21.15.60:0/466190344 learned_addr learned my addr 172.21.15.60:0/466190344 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7bd17c700 1 --2- 172.21.15.60:0/466190344 >> v2:172.21.15.66:3300/0 conn(0x7fa7b805b320 0x7fa7b80ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7bc97b700 1 -- 172.21.15.60:0/466190344 >> v2:172.21.15.66:3300/0 conn(0x7fa7b805b320 msgr2=0x7fa7b80ae970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7bc97b700 1 --2- 172.21.15.60:0/466190344 >> v2:172.21.15.66:3300/0 conn(0x7fa7b805b320 0x7fa7b80ae970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:15.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7bc97b700 1 -- 172.21.15.60:0/466190344 >> v1:172.21.15.66:6789/0 conn(0x7fa7b805c050 legacy=0x7fa7b80a71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.929+0000 7fa7bc97b700 1 -- 172.21.15.60:0/466190344 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b80abb80 con 0x7fa7b80aa830 2020-10-31T22:51:15.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.933+0000 7fa7bc97b700 1 --2- 172.21.15.60:0/466190344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b80aa830 0x7fa7b80ac020 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fa7a8002f30 tx=0x7fa7a8006f10).ready entity=mon.0 client_cookie=5b84aae257ccb172 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.933+0000 7fa7a7fff700 1 -- 172.21.15.60:0/466190344 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a800f070 con 0x7fa7b80aa830 2020-10-31T22:51:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.933+0000 7fa7a7fff700 1 -- 172.21.15.60:0/466190344 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a8008de0 con 0x7fa7b80aa830 2020-10-31T22:51:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.933+0000 7fa7a7fff700 1 -- 172.21.15.60:0/466190344 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7a800c920 con 0x7fa7b80aa830 2020-10-31T22:51:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.933+0000 7fa7be17e700 1 -- 172.21.15.60:0/466190344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b80aa830 msgr2=0x7fa7b80ac020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.933+0000 7fa7be17e700 1 --2- 172.21.15.60:0/466190344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b80aa830 0x7fa7b80ac020 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 rx=0x7fa7a8002f30 tx=0x7fa7a8006f10).stop 2020-10-31T22:51:15.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.933+0000 7fa7be17e700 1 -- 172.21.15.60:0/466190344 shutdown_connections 2020-10-31T22:51:15.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.933+0000 7fa7be17e700 1 --2- 172.21.15.60:0/466190344 >> v2:172.21.15.66:3300/0 conn(0x7fa7b805b320 0x7fa7b80ae970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:15.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.933+0000 7fa7be17e700 1 --2- 172.21.15.60:0/466190344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b80aa830 0x7fa7b80ac020 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:15.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.933+0000 7fa7be17e700 1 -- 172.21.15.60:0/466190344 >> 172.21.15.60:0/466190344 conn(0x7fa7b80b3fd0 msgr2=0x7fa7b80b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:15.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.933+0000 7fa7be17e700 1 -- 172.21.15.60:0/466190344 shutdown_connections 2020-10-31T22:51:15.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.933+0000 7fa7be17e700 1 -- 172.21.15.60:0/466190344 wait complete. 2020-10-31T22:51:15.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.933+0000 7fa7be17e700 1 Processor -- start 2020-10-31T22:51:15.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.933+0000 7fa7be17e700 1 -- start start 2020-10-31T22:51:15.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7be17e700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7b805b320 0x7fa7b80a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:15.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7be17e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b805c050 0x7fa7b81457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:15.942 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7be17e700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b80aa830 0x7fa7b8145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:15.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7be17e700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b8143db0 con 0x7fa7b80aa830 2020-10-31T22:51:15.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7be17e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b81417f0 con 0x7fa7b805c050 2020-10-31T22:51:15.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7be17e700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b81407a0 con 0x7fa7b805b320 2020-10-31T22:51:15.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7bd97d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b80aa830 0x7fa7b8145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:15.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7bd97d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b80aa830 0x7fa7b8145ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50314/0 (socket says 172.21.15.60:50314) 2020-10-31T22:51:15.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7bd97d700 1 -- 172.21.15.60:0/3469419542 learned_addr learned my addr 172.21.15.60:0/3469419542 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:15.943 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7bc97b700 1 --2- 172.21.15.60:0/3469419542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b805c050 0x7fa7b81457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:15.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7bd17c700 1 --2- 172.21.15.60:0/3469419542 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7b805b320 0x7fa7b80a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:15.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7bd97d700 1 -- 172.21.15.60:0/3469419542 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7b805b320 msgr2=0x7fa7b80a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:15.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7bd97d700 1 --2- 172.21.15.60:0/3469419542 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7b805b320 0x7fa7b80a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:15.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7bd97d700 1 -- 172.21.15.60:0/3469419542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b805c050 msgr2=0x7fa7b81457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:15.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7bd97d700 1 --2- 172.21.15.60:0/3469419542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b805c050 0x7fa7b81457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:15.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7bd97d700 1 -- 172.21.15.60:0/3469419542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b8140a00 con 0x7fa7b80aa830 2020-10-31T22:51:15.944 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7bd97d700 1 --2- 172.21.15.60:0/3469419542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b80aa830 0x7fa7b8145ce0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fa7b80ae670 tx=0x7fa7b0007e40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:15.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7a67fc700 1 -- 172.21.15.60:0/3469419542 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7b000a5a0 con 0x7fa7b80aa830 2020-10-31T22:51:15.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7a67fc700 1 -- 172.21.15.60:0/3469419542 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b000a700 con 0x7fa7b80aa830 2020-10-31T22:51:15.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7be17e700 1 -- 172.21.15.60:0/3469419542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b8140ca0 con 0x7fa7b80aa830 2020-10-31T22:51:15.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7a67fc700 1 -- 172.21.15.60:0/3469419542 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa7b000aa60 con 0x7fa7b80aa830 2020-10-31T22:51:15.945 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7be17e700 1 -- 172.21.15.60:0/3469419542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b8145060 con 0x7fa7b80aa830 2020-10-31T22:51:15.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7be17e700 1 -- 172.21.15.60:0/3469419542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b8142540 con 0x7fa7b80aa830 2020-10-31T22:51:15.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.937+0000 7fa7a67fc700 1 -- 172.21.15.60:0/3469419542 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa7b0019030 con 0x7fa7b80aa830 2020-10-31T22:51:15.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.941+0000 7fa7a67fc700 1 --2- 172.21.15.60:0/3469419542 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa798054f90 0x7fa798057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:15.946 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.941+0000 7fa7bd17c700 1 --2- 172.21.15.60:0/3469419542 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa798054f90 0x7fa798057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:15.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.941+0000 7fa7a67fc700 1 -- 172.21.15.60:0/3469419542 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa7b006d270 con 0x7fa7b80aa830 2020-10-31T22:51:15.947 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.941+0000 7fa7bd17c700 1 --2- 172.21.15.60:0/3469419542 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa798054f90 0x7fa798057450 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fa7b400c000 tx=0x7fa7b4008040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:15.954 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:15.949+0000 7fa7a67fc700 1 -- 172.21.15.60:0/3469419542 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa7b0043680 con 0x7fa7b80aa830 2020-10-31T22:51:16.092 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.085+0000 7fa7be17e700 1 -- 172.21.15.60:0/3469419542 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7b8057100 con 0x7fa7b80aa830 2020-10-31T22:51:16.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.089+0000 7fa7a67fc700 1 -- 172.21.15.60:0/3469419542 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v160) v1 ==== 74+0+16052 (secure 0 0 0) 0x7fa7b0046ca0 con 0x7fa7b80aa830 2020-10-31T22:51:16.094 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:16.094 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":160,"fsid":"226f905a-1517-4a8c-8009-08779515965c","created":"2020-10-31T22:40:51.928572+0000","modified":"2020-10-31T22:51:09.478155+0000","last_up_change":"2020-10-31T22:41:01.285949+0000","last_in_change":"2020-10-31T22:41:01.285949+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-10-31T22:40:55.846143+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-10-31T22:41:05.358501+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":29,"pool_name":"cephfs_metadata","create_time":"2020-10-31T22:51:06.207804+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"159","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":30,"pool_name":"cephfs_data","create_time":"2020-10-31T22:51:07.488114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"160","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"f8f5851d-7561-4db8-b0bf-d0ed3e815d67","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":14302},{"type":"v1","addr":"172.21.15.60:6803","nonce":14302}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":14302},{"type":"v1","addr":"172.21.15.60:6805","nonce":14302}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":14302},{"type":"v1","addr":"172.21.15.60:6809","nonce":14302}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":14302},{"type":"v1","addr":"172.21.15.60:6807","nonce":14302}]},"public_addr":"172.21.15.60:6803/14302","cluster_addr":"172.21.15.60:6805/14302","heartbeat_back_addr":"172.21.15.60:6809/14302","heartbeat_front_addr":"172.21.15.60:6807/14302","state":["exists","up"]},{"osd":1,"uuid":"2f4036a9-518b-4d0b-ae4f-489e2ae476d2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":14300},{"type":"v1","addr":"172.21.15.60:6811","nonce":14300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":14300},{"type":"v1","addr":"172.21.15.60:6813","nonce":14300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":14300},{"type":"v1","addr":"172.21.15.60:6817","nonce":14300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":14300},{"type":"v1","addr":"172.21.15.60:6815","nonce":14300}]},"public_addr":"172.21.15.60:6811/14300","cluster_addr":"172.21.15.60:6813/14300","heartbeat_back_addr":"172.21.15.60:6817/14300","heartbeat_front_addr":"172.21.15.60:6815/14300","state":["exists","up"]},{"osd":2,"uuid":"eb771e2b-981d-4ef8-b2bb-143431fea891","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":14318},{"type":"v1","addr":"172.21.15.60:6827","nonce":14318}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":14318},{"type":"v1","addr":"172.21.15.60:6829","nonce":14318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":14318},{"type":"v1","addr":"172.21.15.60:6833","nonce":14318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":14318},{"type":"v1","addr":"172.21.15.60:6831","nonce":14318}]},"public_addr":"172.21.15.60:6827/14318","cluster_addr":"172.21.15.60:6829/14318","heartbeat_back_addr":"172.21.15.60:6833/14318","heartbeat_front_addr":"172.21.15.60:6831/14318","state":["exists","up"]},{"osd":3,"uuid":"48292ed1-84ef-42a1-818f-f3541c45b2db","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":14301},{"type":"v1","addr":"172.21.15.60:6819","nonce":14301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":14301},{"type":"v1","addr":"172.21.15.60:6821","nonce":14301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":14301},{"type":"v1","addr":"172.21.15.60:6825","nonce":14301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":14301},{"type":"v1","addr":"172.21.15.60:6823","nonce":14301}]},"public_addr":"172.21.15.60:6819/14301","cluster_addr":"172.21.15.60:6821/14301","heartbeat_back_addr":"172.21.15.60:6825/14301","heartbeat_front_addr":"172.21.15.60:6823/14301","state":["exists","up"]},{"osd":4,"uuid":"019bc4f3-4ff6-4aaa-b822-2613e251a63e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":157,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":14002},{"type":"v1","addr":"172.21.15.66:6817","nonce":14002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":14002},{"type":"v1","addr":"172.21.15.66:6819","nonce":14002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":14002},{"type":"v1","addr":"172.21.15.66:6823","nonce":14002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":14002},{"type":"v1","addr":"172.21.15.66:6821","nonce":14002}]},"public_addr":"172.21.15.66:6817/14002","cluster_addr":"172.21.15.66:6819/14002","heartbeat_back_addr":"172.21.15.66:6823/14002","heartbeat_front_addr":"172.21.15.66:6821/14002","state":["exists","up"]},{"osd":5,"uuid":"79a0f0a3-769d-454a-8d26-04d8bc544575","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":14001},{"type":"v1","addr":"172.21.15.66:6801","nonce":14001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":14001},{"type":"v1","addr":"172.21.15.66:6803","nonce":14001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":14001},{"type":"v1","addr":"172.21.15.66:6807","nonce":14001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":14001},{"type":"v1","addr":"172.21.15.66:6805","nonce":14001}]},"public_addr":"172.21.15.66:6801/14001","cluster_addr":"172.21.15.66:6803/14001","heartbeat_back_addr":"172.21.15.66:6807/14001","heartbeat_front_addr":"172.21.15.66:6805/14001","state":["exists","up"]},{"osd":6,"uuid":"0fb1e61f-a193-4798-bfaa-8f4e4ad01a12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":14003},{"type":"v1","addr":"172.21.15.66:6809","nonce":14003}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":14003},{"type":"v1","addr":"172.21.15.66:6811","nonce":14003}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":14003},{"type":"v1","addr":"172.21.15.66:6815","nonce":14003}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":14003},{"type":"v1","addr":"172.21.15.66:6813","nonce":14003}]},"public_addr":"172.21.15.66:6809/14003","cluster_addr":"172.21.15.66:6811/14003","heartbeat_back_addr":"172.21.15.66:6815/14003","heartbeat_front_addr":"172.21.15.66:6813/14003","state":["exists","up"]},{"osd":7,"uuid":"1bf0b828-c2b3-4c7a-9b24-914620a369b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":158,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":14046},{"type":"v1","addr":"172.21.15.66:6825","nonce":14046}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":14046},{"type":"v1","addr":"172.21.15.66:6827","nonce":14046}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":14046},{"type":"v1","addr":"172.21.15.66:6831","nonce":14046}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":14046},{"type":"v1","addr":"172.21.15.66:6829","nonce":14046}]},"public_addr":"172.21.15.66:6825/14046","cluster_addr":"172.21.15.66:6827/14046","heartbeat_back_addr":"172.21.15.66:6831/14046","heartbeat_front_addr":"172.21.15.66:6829/14046","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.314917+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.643069+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.662572+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.664868+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551107+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.400568+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.551173+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2020-10-31T22:40:59.604302+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-10-31T22:51:16.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.089+0000 7fa7be17e700 1 -- 172.21.15.60:0/3469419542 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa798054f90 msgr2=0x7fa798057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.089+0000 7fa7be17e700 1 --2- 172.21.15.60:0/3469419542 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa798054f90 0x7fa798057450 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 rx=0x7fa7b400c000 tx=0x7fa7b4008040).stop 2020-10-31T22:51:16.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.089+0000 7fa7be17e700 1 -- 172.21.15.60:0/3469419542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b80aa830 msgr2=0x7fa7b8145ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.089+0000 7fa7be17e700 1 --2- 172.21.15.60:0/3469419542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b80aa830 0x7fa7b8145ce0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 rx=0x7fa7b80ae670 tx=0x7fa7b0007e40).stop 2020-10-31T22:51:16.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.089+0000 7fa7be17e700 1 -- 172.21.15.60:0/3469419542 shutdown_connections 2020-10-31T22:51:16.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.089+0000 7fa7be17e700 1 --2- 172.21.15.60:0/3469419542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b80aa830 0x7fa7b8145ce0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.089+0000 7fa7be17e700 1 --2- 172.21.15.60:0/3469419542 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa7b805b320 0x7fa7b80a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.089+0000 7fa7be17e700 1 --2- 172.21.15.60:0/3469419542 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa798054f90 0x7fa798057450 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.089+0000 7fa7be17e700 1 --2- 172.21.15.60:0/3469419542 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7b805c050 0x7fa7b81457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.089+0000 7fa7be17e700 1 -- 172.21.15.60:0/3469419542 >> 172.21.15.60:0/3469419542 conn(0x7fa7b80b3fd0 msgr2=0x7fa7b8065bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:16.097 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.089+0000 7fa7be17e700 1 -- 172.21.15.60:0/3469419542 shutdown_connections 2020-10-31T22:51:16.098 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.089+0000 7fa7be17e700 1 -- 172.21.15.60:0/3469419542 wait complete. 2020-10-31T22:51:16.109 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-10-31T22:40:55.846143+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-10-31T22:41:05.358501+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 29, 'pool_name': 'cephfs_metadata', 'create_time': '2020-10-31T22:51:06.207804+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '159', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 30, 'pool_name': 'cephfs_data', 'create_time': '2020-10-31T22:51:07.488114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '160', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-10-31T22:51:16.110 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get device_health_metrics pg_num 2020-10-31T22:51:16.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.221+0000 7f4964ecc700 1 Processor -- start 2020-10-31T22:51:16.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.221+0000 7f4964ecc700 1 -- start start 2020-10-31T22:51:16.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.221+0000 7f4964ecc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49600a95e0 0x7f49600a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.221+0000 7f4964ecc700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f496005b440 0x7f496005b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.221+0000 7f4964ecc700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49600a75d0 con 0x7f4960066830 2020-10-31T22:51:16.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.221+0000 7f4964ecc700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496005afe0 con 0x7f496005b440 2020-10-31T22:51:16.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.221+0000 7f4964ecc700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49600a8e00 con 0x7f49600a95e0 2020-10-31T22:51:16.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.221+0000 7f495effd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f496005b440 0x7f496005b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.221+0000 7f495f7fe700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49600a95e0 0x7f49600a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.221+0000 7f495ffff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f4960066830 0x7f4960066c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:52326/0 (socket says 172.21.15.60:52326) 2020-10-31T22:51:16.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f495effd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f496005b440 0x7f496005b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:33022/0 (socket says 172.21.15.60:33022) 2020-10-31T22:51:16.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f495ffff700 1 -- 172.21.15.60:0/1381530920 learned_addr learned my addr 172.21.15.60:0/1381530920 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:16.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f495effd700 1 -- 172.21.15.60:0/1381530920 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49600a95e0 msgr2=0x7f49600a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:16.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f495effd700 1 --2- 172.21.15.60:0/1381530920 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49600a95e0 0x7f49600a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f495effd700 1 -- 172.21.15.60:0/1381530920 >> v1:172.21.15.66:6789/0 conn(0x7f4960066830 legacy=0x7f4960066c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f495effd700 1 -- 172.21.15.60:0/1381530920 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49600aeaf0 con 0x7f496005b440 2020-10-31T22:51:16.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f495effd700 1 --2- 172.21.15.60:0/1381530920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f496005b440 0x7f496005b8a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f4948002f30 tx=0x7f4948006dc0).ready entity=mon.1 client_cookie=ec589e202a8bd9d1 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:16.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f495e7fc700 1 -- 172.21.15.60:0/1381530920 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4948009760 con 0x7f496005b440 2020-10-31T22:51:16.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f495e7fc700 1 -- 172.21.15.60:0/1381530920 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49480098c0 con 0x7f496005b440 2020-10-31T22:51:16.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f495e7fc700 1 -- 172.21.15.60:0/1381530920 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4948009c20 con 0x7f496005b440 2020-10-31T22:51:16.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f4964ecc700 1 -- 172.21.15.60:0/1381530920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f496005b440 msgr2=0x7f496005b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f4964ecc700 1 --2- 172.21.15.60:0/1381530920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f496005b440 0x7f496005b8a0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f4948002f30 tx=0x7f4948006dc0).stop 2020-10-31T22:51:16.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f4964ecc700 1 -- 172.21.15.60:0/1381530920 shutdown_connections 2020-10-31T22:51:16.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f4964ecc700 1 --2- 172.21.15.60:0/1381530920 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49600a95e0 0x7f49600a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f4964ecc700 1 --2- 172.21.15.60:0/1381530920 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f496005b440 0x7f496005b8a0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f4964ecc700 1 -- 172.21.15.60:0/1381530920 >> 172.21.15.60:0/1381530920 conn(0x7f49600b3fd0 msgr2=0x7f49600b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:16.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f4964ecc700 1 -- 172.21.15.60:0/1381530920 shutdown_connections 2020-10-31T22:51:16.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f4964ecc700 1 -- 172.21.15.60:0/1381530920 wait complete. 2020-10-31T22:51:16.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f4964ecc700 1 Processor -- start 2020-10-31T22:51:16.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.225+0000 7f4964ecc700 1 -- start start 2020-10-31T22:51:16.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f4964ecc700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496005b440 0x7f4960142540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f4964ecc700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4960066830 0x7f496014e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f4964ecc700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49600a95e0 0x7f4960145c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f4964ecc700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496013cff0 con 0x7f496005b440 2020-10-31T22:51:16.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f4964ecc700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4960146c70 con 0x7f4960066830 2020-10-31T22:51:16.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f4964ecc700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4960146ea0 con 0x7f49600a95e0 2020-10-31T22:51:16.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f495f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496005b440 0x7f4960142540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f495f7fe700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496005b440 0x7f4960142540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50324/0 (socket says 172.21.15.60:50324) 2020-10-31T22:51:16.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f495f7fe700 1 -- 172.21.15.60:0/3569514485 learned_addr learned my addr 172.21.15.60:0/3569514485 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:16.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f495effd700 1 --2- 172.21.15.60:0/3569514485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4960066830 0x7f496014e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f495ffff700 1 --2- 172.21.15.60:0/3569514485 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49600a95e0 0x7f4960145c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f495f7fe700 1 -- 172.21.15.60:0/3569514485 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49600a95e0 msgr2=0x7f4960145c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f495f7fe700 1 --2- 172.21.15.60:0/3569514485 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49600a95e0 0x7f4960145c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f495f7fe700 1 -- 172.21.15.60:0/3569514485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4960066830 msgr2=0x7f496014e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f495f7fe700 1 --2- 172.21.15.60:0/3569514485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4960066830 0x7f496014e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f495f7fe700 1 -- 172.21.15.60:0/3569514485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4960147140 con 0x7f496005b440 2020-10-31T22:51:16.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f495f7fe700 1 --2- 172.21.15.60:0/3569514485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496005b440 0x7f4960142540 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f496013d660 tx=0x7f49500091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:16.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f495cff9700 1 -- 172.21.15.60:0/3569514485 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f495000cc70 con 0x7f496005b440 2020-10-31T22:51:16.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f495cff9700 1 -- 172.21.15.60:0/3569514485 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495000cdd0 con 0x7f496005b440 2020-10-31T22:51:16.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f4964ecc700 1 -- 172.21.15.60:0/3569514485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49601457f0 con 0x7f496005b440 2020-10-31T22:51:16.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f495cff9700 1 -- 172.21.15.60:0/3569514485 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4950005c30 con 0x7f496005b440 2020-10-31T22:51:16.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.229+0000 7f4964ecc700 1 -- 172.21.15.60:0/3569514485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4960146180 con 0x7f496005b440 2020-10-31T22:51:16.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.233+0000 7f495cff9700 1 -- 172.21.15.60:0/3569514485 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4950006020 con 0x7f496005b440 2020-10-31T22:51:16.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.233+0000 7f4964ecc700 1 -- 172.21.15.60:0/3569514485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4960057100 con 0x7f496005b440 2020-10-31T22:51:16.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.233+0000 7f495cff9700 1 --2- 172.21.15.60:0/3569514485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4938054f10 0x7f49380573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.233+0000 7f495cff9700 1 -- 172.21.15.60:0/3569514485 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f495006e0c0 con 0x7f496005b440 2020-10-31T22:51:16.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.233+0000 7f495effd700 1 --2- 172.21.15.60:0/3569514485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4938054f10 0x7f49380573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.233+0000 7f495effd700 1 --2- 172.21.15.60:0/3569514485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4938054f10 0x7f49380573d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f494801a000 tx=0x7f4948015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:16.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.237+0000 7f495cff9700 1 -- 172.21.15.60:0/3569514485 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4950044580 con 0x7f496005b440 2020-10-31T22:51:16.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.381+0000 7f4964ecc700 1 -- 172.21.15.60:0/3569514485 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f49600b0850 con 0x7f496005b440 2020-10-31T22:51:16.385 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.381+0000 7f495cff9700 1 -- 172.21.15.60:0/3569514485 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v160) v1 ==== 110+0+10 (secure 0 0 0) 0x7f4950016070 con 0x7f496005b440 2020-10-31T22:51:16.386 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 1 2020-10-31T22:51:16.387 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.381+0000 7f4964ecc700 1 -- 172.21.15.60:0/3569514485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4938054f10 msgr2=0x7f49380573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.381+0000 7f4964ecc700 1 --2- 172.21.15.60:0/3569514485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4938054f10 0x7f49380573d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 rx=0x7f494801a000 tx=0x7f4948015000).stop 2020-10-31T22:51:16.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.381+0000 7f4964ecc700 1 -- 172.21.15.60:0/3569514485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496005b440 msgr2=0x7f4960142540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.381+0000 7f4964ecc700 1 --2- 172.21.15.60:0/3569514485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496005b440 0x7f4960142540 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 rx=0x7f496013d660 tx=0x7f49500091a0).stop 2020-10-31T22:51:16.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.381+0000 7f4964ecc700 1 -- 172.21.15.60:0/3569514485 shutdown_connections 2020-10-31T22:51:16.388 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.381+0000 7f4964ecc700 1 --2- 172.21.15.60:0/3569514485 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49600a95e0 0x7f4960145c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.381+0000 7f4964ecc700 1 --2- 172.21.15.60:0/3569514485 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f496005b440 0x7f4960142540 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.381+0000 7f4964ecc700 1 --2- 172.21.15.60:0/3569514485 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4938054f10 0x7f49380573d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.381+0000 7f4964ecc700 1 --2- 172.21.15.60:0/3569514485 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4960066830 0x7f496014e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.381+0000 7f4964ecc700 1 -- 172.21.15.60:0/3569514485 >> 172.21.15.60:0/3569514485 conn(0x7f49600b3fd0 msgr2=0x7f49600b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:16.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.381+0000 7f4964ecc700 1 -- 172.21.15.60:0/3569514485 shutdown_connections 2020-10-31T22:51:16.389 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.381+0000 7f4964ecc700 1 -- 172.21.15.60:0/3569514485 wait complete. 2020-10-31T22:51:16.403 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-10-31T22:51:16.525 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f2540670700 1 Processor -- start 2020-10-31T22:51:16.526 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f2540670700 1 -- start start 2020-10-31T22:51:16.527 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f2540670700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25380b5440 0x7f25380ae160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f2540670700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2538067230 0x7f25380af390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f2540670700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f25380b0290 0x7f253805afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f2540670700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2538067970 con 0x7f25380b0290 2020-10-31T22:51:16.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f2540670700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25380b5820 con 0x7f2538067230 2020-10-31T22:51:16.528 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f2540670700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25380ada60 con 0x7f25380b5440 2020-10-31T22:51:16.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f253ec0d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f25380b0290 0x7f253805afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f253ec0d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f25380b0290 0x7f253805afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50336/0 (socket says 172.21.15.60:50336) 2020-10-31T22:51:16.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f253ec0d700 1 -- 172.21.15.60:0/4226162660 learned_addr learned my addr 172.21.15.60:0/4226162660 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:16.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f253e40c700 1 --2- 172.21.15.60:0/4226162660 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25380b5440 0x7f25380ae160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f253dc0b700 1 --2- 172.21.15.60:0/4226162660 >> v2:172.21.15.66:3300/0 conn(0x7f2538067230 0x7f25380af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f253ec0d700 1 -- 172.21.15.60:0/4226162660 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25380b5440 msgr2=0x7f25380ae160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:16.529 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f253ec0d700 1 --2- 172.21.15.60:0/4226162660 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25380b5440 0x7f25380ae160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f253ec0d700 1 -- 172.21.15.60:0/4226162660 >> v2:172.21.15.66:3300/0 conn(0x7f2538067230 msgr2=0x7f25380af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:16.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f253ec0d700 1 --2- 172.21.15.60:0/4226162660 >> v2:172.21.15.66:3300/0 conn(0x7f2538067230 0x7f25380af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f253ec0d700 1 -- 172.21.15.60:0/4226162660 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25380676d0 con 0x7f25380b0290 2020-10-31T22:51:16.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f253ec0d700 1 --2- 172.21.15.60:0/4226162660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25380b0290 0x7f253805afe0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f25300032b0 tx=0x7f253000a410).ready entity=mon.0 client_cookie=4d63f9ee07cc5ec7 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:16.530 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f253d40a700 1 -- 172.21.15.60:0/4226162660 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f253000ce50 con 0x7f25380b0290 2020-10-31T22:51:16.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f253d40a700 1 -- 172.21.15.60:0/4226162660 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253000f470 con 0x7f25380b0290 2020-10-31T22:51:16.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f253d40a700 1 -- 172.21.15.60:0/4226162660 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f253000f7d0 con 0x7f25380b0290 2020-10-31T22:51:16.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f2540670700 1 -- 172.21.15.60:0/4226162660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25380b0290 msgr2=0x7f253805afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.531 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.521+0000 7f2540670700 1 --2- 172.21.15.60:0/4226162660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25380b0290 0x7f253805afe0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 rx=0x7f25300032b0 tx=0x7f253000a410).stop 2020-10-31T22:51:16.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.525+0000 7f2540670700 1 -- 172.21.15.60:0/4226162660 shutdown_connections 2020-10-31T22:51:16.532 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.525+0000 7f2540670700 1 --2- 172.21.15.60:0/4226162660 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25380b0290 0x7f253805afe0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.525+0000 7f2540670700 1 --2- 172.21.15.60:0/4226162660 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25380b5440 0x7f25380ae160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.525+0000 7f2540670700 1 --2- 172.21.15.60:0/4226162660 >> v2:172.21.15.66:3300/0 conn(0x7f2538067230 0x7f25380af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.525+0000 7f2540670700 1 -- 172.21.15.60:0/4226162660 >> 172.21.15.60:0/4226162660 conn(0x7f2538060c50 msgr2=0x7f25380b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:16.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.525+0000 7f2540670700 1 -- 172.21.15.60:0/4226162660 shutdown_connections 2020-10-31T22:51:16.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.525+0000 7f2540670700 1 -- 172.21.15.60:0/4226162660 wait complete. 2020-10-31T22:51:16.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.525+0000 7f2540670700 1 Processor -- start 2020-10-31T22:51:16.533 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.525+0000 7f2540670700 1 -- start start 2020-10-31T22:51:16.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f2540670700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2538067230 0x7f253814f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f2540670700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25380b0290 0x7f2538063770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f2540670700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25380b5440 0x7f25380a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.535 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f2540670700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2538144b20 con 0x7f25380b5440 2020-10-31T22:51:16.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f2540670700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2538064430 con 0x7f2538067230 2020-10-31T22:51:16.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f2540670700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25380646d0 con 0x7f25380b0290 2020-10-31T22:51:16.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f253ec0d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25380b5440 0x7f25380a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f253ec0d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25380b5440 0x7f25380a9a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50342/0 (socket says 172.21.15.60:50342) 2020-10-31T22:51:16.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f253ec0d700 1 -- 172.21.15.60:0/624176422 learned_addr learned my addr 172.21.15.60:0/624176422 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:16.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f253e40c700 1 --2- 172.21.15.60:0/624176422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2538067230 0x7f253814f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.536 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f253dc0b700 1 --2- 172.21.15.60:0/624176422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25380b0290 0x7f2538063770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f253ec0d700 1 -- 172.21.15.60:0/624176422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25380b0290 msgr2=0x7f2538063770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f253ec0d700 1 --2- 172.21.15.60:0/624176422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25380b0290 0x7f2538063770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f253ec0d700 1 -- 172.21.15.60:0/624176422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2538067230 msgr2=0x7f253814f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f253ec0d700 1 --2- 172.21.15.60:0/624176422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2538067230 0x7f253814f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f253ec0d700 1 -- 172.21.15.60:0/624176422 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2538064970 con 0x7f25380b5440 2020-10-31T22:51:16.537 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f253ec0d700 1 --2- 172.21.15.60:0/624176422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25380b5440 0x7f25380a9a00 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f25300032b0 tx=0x7f2530018000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:16.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f25277fe700 1 -- 172.21.15.60:0/624176422 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2530017800 con 0x7f25380b5440 2020-10-31T22:51:16.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f25277fe700 1 -- 172.21.15.60:0/624176422 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2530017960 con 0x7f25380b5440 2020-10-31T22:51:16.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f2540670700 1 -- 172.21.15.60:0/624176422 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2538064c10 con 0x7f25380b5440 2020-10-31T22:51:16.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f25277fe700 1 -- 172.21.15.60:0/624176422 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2530017cc0 con 0x7f25380b5440 2020-10-31T22:51:16.538 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f2540670700 1 -- 172.21.15.60:0/624176422 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2538065c10 con 0x7f25380b5440 2020-10-31T22:51:16.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f2540670700 1 -- 172.21.15.60:0/624176422 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2538057100 con 0x7f25380b5440 2020-10-31T22:51:16.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.529+0000 7f25277fe700 1 -- 172.21.15.60:0/624176422 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f2530028030 con 0x7f25380b5440 2020-10-31T22:51:16.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.533+0000 7f25277fe700 1 --2- 172.21.15.60:0/624176422 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2518055050 0x7f2518057510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.539 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.533+0000 7f25277fe700 1 -- 172.21.15.60:0/624176422 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f2530071000 con 0x7f25380b5440 2020-10-31T22:51:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.533+0000 7f253e40c700 1 --2- 172.21.15.60:0/624176422 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2518055050 0x7f2518057510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.540 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.533+0000 7f253e40c700 1 --2- 172.21.15.60:0/624176422 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2518055050 0x7f2518057510 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f253400b000 tx=0x7f2534006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:16.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.537+0000 7f25277fe700 1 -- 172.21.15.60:0/624176422 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f2530047520 con 0x7f25380b5440 2020-10-31T22:51:16.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.681+0000 7f2540670700 1 -- 172.21.15.60:0/624176422 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2538065c10 con 0x7f25380b5440 2020-10-31T22:51:16.688 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.685+0000 7f25277fe700 1 -- 172.21.15.60:0/624176422 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v160) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2538065c10 con 0x7f25380b5440 2020-10-31T22:51:16.689 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:51:16.690 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.685+0000 7f2540670700 1 -- 172.21.15.60:0/624176422 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2518055050 msgr2=0x7f2518057510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.685+0000 7f2540670700 1 --2- 172.21.15.60:0/624176422 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2518055050 0x7f2518057510 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 rx=0x7f253400b000 tx=0x7f2534006dc0).stop 2020-10-31T22:51:16.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.685+0000 7f2540670700 1 -- 172.21.15.60:0/624176422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25380b5440 msgr2=0x7f25380a9a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.685+0000 7f2540670700 1 --2- 172.21.15.60:0/624176422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25380b5440 0x7f25380a9a00 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 rx=0x7f25300032b0 tx=0x7f2530018000).stop 2020-10-31T22:51:16.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.685+0000 7f2540670700 1 -- 172.21.15.60:0/624176422 shutdown_connections 2020-10-31T22:51:16.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.685+0000 7f2540670700 1 --2- 172.21.15.60:0/624176422 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25380b5440 0x7f25380a9a00 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.691 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.685+0000 7f2540670700 1 --2- 172.21.15.60:0/624176422 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f2518055050 0x7f2518057510 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.685+0000 7f2540670700 1 --2- 172.21.15.60:0/624176422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2538067230 0x7f253814f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.685+0000 7f2540670700 1 --2- 172.21.15.60:0/624176422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25380b0290 0x7f2538063770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.685+0000 7f2540670700 1 -- 172.21.15.60:0/624176422 >> 172.21.15.60:0/624176422 conn(0x7f2538060c50 msgr2=0x7f2538142a50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:16.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.685+0000 7f2540670700 1 -- 172.21.15.60:0/624176422 shutdown_connections 2020-10-31T22:51:16.692 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.685+0000 7f2540670700 1 -- 172.21.15.60:0/624176422 wait complete. 2020-10-31T22:51:16.702 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-10-31T22:51:16.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b70a3700 1 Processor -- start 2020-10-31T22:51:16.821 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b70a3700 1 -- start start 2020-10-31T22:51:16.822 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b70a3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61b00b24a0 0x7f61b00b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b70a3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f61b0141f00 0x7f61b0142390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b70a3700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b00b4440 con 0x7f61b00b5570 2020-10-31T22:51:16.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b70a3700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b013f930 con 0x7f61b0141f00 2020-10-31T22:51:16.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b70a3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0146060 con 0x7f61b00b24a0 2020-10-31T22:51:16.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b60a1700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f61b00b5570 0x7f61b0145950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54482/0 (socket says 172.21.15.60:54482) 2020-10-31T22:51:16.823 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b60a1700 1 -- 172.21.15.60:0/3172201192 learned_addr learned my addr 172.21.15.60:0/3172201192 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:16.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b58a0700 1 --2- 172.21.15.60:0/3172201192 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61b00b24a0 0x7f61b00b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.824 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b68a2700 1 --2- 172.21.15.60:0/3172201192 >> v2:172.21.15.66:3300/0 conn(0x7f61b0141f00 0x7f61b0142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b509f700 1 -- 172.21.15.60:0/3172201192 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870007611 0 0) 0x7f61b00b4440 con 0x7f61b00b5570 2020-10-31T22:51:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b509f700 1 -- 172.21.15.60:0/3172201192 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6198003230 con 0x7f61b00b5570 2020-10-31T22:51:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b509f700 1 -- 172.21.15.60:0/3172201192 <== mon.0 v1:172.21.15.60:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1999418253 0 0) 0x7f6198003230 con 0x7f61b00b5570 2020-10-31T22:51:16.825 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b58a0700 1 -- 172.21.15.60:0/3172201192 >> v2:172.21.15.66:3300/0 conn(0x7f61b0141f00 msgr2=0x7f61b0142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:16.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b58a0700 1 --2- 172.21.15.60:0/3172201192 >> v2:172.21.15.66:3300/0 conn(0x7f61b0141f00 0x7f61b0142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b58a0700 1 -- 172.21.15.60:0/3172201192 >> v1:172.21.15.60:6789/0 conn(0x7f61b00b5570 legacy=0x7f61b0145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b58a0700 1 -- 172.21.15.60:0/3172201192 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b00b02f0 con 0x7f61b00b24a0 2020-10-31T22:51:16.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b68a2700 1 --2- 172.21.15.60:0/3172201192 >> v2:172.21.15.66:3300/0 conn(0x7f61b0141f00 0x7f61b0142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:16.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.817+0000 7f61b58a0700 1 --2- 172.21.15.60:0/3172201192 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61b00b24a0 0x7f61b00b5950 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f61ac001870 tx=0x7f61a0006dc0).ready entity=mon.2 client_cookie=472b89cfda1fa99 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:16.826 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.821+0000 7f61b509f700 1 -- 172.21.15.60:0/3172201192 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61ac0016d0 con 0x7f61b00b24a0 2020-10-31T22:51:16.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.821+0000 7f61b509f700 1 -- 172.21.15.60:0/3172201192 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a000d570 con 0x7f61b00b24a0 2020-10-31T22:51:16.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.821+0000 7f61b509f700 1 -- 172.21.15.60:0/3172201192 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61a000d6e0 con 0x7f61b00b24a0 2020-10-31T22:51:16.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.821+0000 7f61b70a3700 1 -- 172.21.15.60:0/3172201192 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61b00b24a0 msgr2=0x7f61b00b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.827 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.821+0000 7f61b70a3700 1 --2- 172.21.15.60:0/3172201192 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61b00b24a0 0x7f61b00b5950 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f61ac001870 tx=0x7f61a0006dc0).stop 2020-10-31T22:51:16.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.821+0000 7f61b70a3700 1 -- 172.21.15.60:0/3172201192 shutdown_connections 2020-10-31T22:51:16.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.821+0000 7f61b70a3700 1 --2- 172.21.15.60:0/3172201192 >> v2:172.21.15.66:3300/0 conn(0x7f61b0141f00 0x7f61b0142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.821+0000 7f61b70a3700 1 --2- 172.21.15.60:0/3172201192 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61b00b24a0 0x7f61b00b5950 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.821+0000 7f61b70a3700 1 -- 172.21.15.60:0/3172201192 >> 172.21.15.60:0/3172201192 conn(0x7f61b00b8e90 msgr2=0x7f61b00b4e60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:16.828 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.821+0000 7f61b70a3700 1 -- 172.21.15.60:0/3172201192 shutdown_connections 2020-10-31T22:51:16.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.821+0000 7f61b70a3700 1 -- 172.21.15.60:0/3172201192 wait complete. 2020-10-31T22:51:16.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.821+0000 7f61b70a3700 1 Processor -- start 2020-10-31T22:51:16.829 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.821+0000 7f61b70a3700 1 -- start start 2020-10-31T22:51:16.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b70a3700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b00b24a0 0x7f61b0148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b70a3700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61b00b5570 0x7f61b00ac5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.830 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b70a3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61b0141f00 0x7f61b01547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b70a3700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0144d60 con 0x7f61b00b24a0 2020-10-31T22:51:16.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b70a3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0144ac0 con 0x7f61b0141f00 2020-10-31T22:51:16.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b70a3700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b0154060 con 0x7f61b00b5570 2020-10-31T22:51:16.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b60a1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b00b24a0 0x7f61b0148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b60a1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b00b24a0 0x7f61b0148160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50352/0 (socket says 172.21.15.60:50352) 2020-10-31T22:51:16.831 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b60a1700 1 -- 172.21.15.60:0/3610702983 learned_addr learned my addr 172.21.15.60:0/3610702983 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:16.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b58a0700 1 --2- 172.21.15.60:0/3610702983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61b00b5570 0x7f61b00ac5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b68a2700 1 --2- 172.21.15.60:0/3610702983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61b0141f00 0x7f61b01547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b60a1700 1 -- 172.21.15.60:0/3610702983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61b00b5570 msgr2=0x7f61b00ac5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b60a1700 1 --2- 172.21.15.60:0/3610702983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61b00b5570 0x7f61b00ac5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b60a1700 1 -- 172.21.15.60:0/3610702983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61b0141f00 msgr2=0x7f61b01547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b60a1700 1 --2- 172.21.15.60:0/3610702983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61b0141f00 0x7f61b01547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.832 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b60a1700 1 -- 172.21.15.60:0/3610702983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b0154300 con 0x7f61b00b24a0 2020-10-31T22:51:16.833 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b60a1700 1 --2- 172.21.15.60:0/3610702983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b00b24a0 0x7f61b0148160 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f61ac001930 tx=0x7f61ac0011f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:16.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f619f7fe700 1 -- 172.21.15.60:0/3610702983 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61ac007170 con 0x7f61b00b24a0 2020-10-31T22:51:16.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f619f7fe700 1 -- 172.21.15.60:0/3610702983 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61ac0072d0 con 0x7f61b00b24a0 2020-10-31T22:51:16.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b70a3700 1 -- 172.21.15.60:0/3610702983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b0149050 con 0x7f61b00b24a0 2020-10-31T22:51:16.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f619f7fe700 1 -- 172.21.15.60:0/3610702983 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61ac0048f0 con 0x7f61b00b24a0 2020-10-31T22:51:16.834 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.825+0000 7f61b70a3700 1 -- 172.21.15.60:0/3610702983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b0154e30 con 0x7f61b00b24a0 2020-10-31T22:51:16.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.829+0000 7f619f7fe700 1 -- 172.21.15.60:0/3610702983 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f61ac01c030 con 0x7f61b00b24a0 2020-10-31T22:51:16.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.829+0000 7f61b70a3700 1 -- 172.21.15.60:0/3610702983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b0057100 con 0x7f61b00b24a0 2020-10-31T22:51:16.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.829+0000 7f619f7fe700 1 --2- 172.21.15.60:0/3610702983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6190054f10 0x7f61900573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:16.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.829+0000 7f61b58a0700 1 --2- 172.21.15.60:0/3610702983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6190054f10 0x7f61900573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:16.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.829+0000 7f619f7fe700 1 -- 172.21.15.60:0/3610702983 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f61ac06db00 con 0x7f61b00b24a0 2020-10-31T22:51:16.835 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.829+0000 7f61b58a0700 1 --2- 172.21.15.60:0/3610702983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6190054f10 0x7f61900573d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f61a0018000 tx=0x7f61a0015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:16.843 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.837+0000 7f619f7fe700 1 -- 172.21.15.60:0/3610702983 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f61ac06fe60 con 0x7f61b00b24a0 2020-10-31T22:51:16.988 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.985+0000 7f61b70a3700 1 -- 172.21.15.60:0/3610702983 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f61b0154490 con 0x7f61b00b24a0 2020-10-31T22:51:16.989 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.985+0000 7f619f7fe700 1 -- 172.21.15.60:0/3610702983 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v160) v1 ==== 104+0+10 (secure 0 0 0) 0x7f61ac043f10 con 0x7f61b00b24a0 2020-10-31T22:51:16.989 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:51:16.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.985+0000 7f61b70a3700 1 -- 172.21.15.60:0/3610702983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6190054f10 msgr2=0x7f61900573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.985+0000 7f61b70a3700 1 --2- 172.21.15.60:0/3610702983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6190054f10 0x7f61900573d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 rx=0x7f61a0018000 tx=0x7f61a0015000).stop 2020-10-31T22:51:16.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.985+0000 7f61b70a3700 1 -- 172.21.15.60:0/3610702983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b00b24a0 msgr2=0x7f61b0148160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:16.991 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.985+0000 7f61b70a3700 1 --2- 172.21.15.60:0/3610702983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b00b24a0 0x7f61b0148160 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 rx=0x7f61ac001930 tx=0x7f61ac0011f0).stop 2020-10-31T22:51:16.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.985+0000 7f61b70a3700 1 -- 172.21.15.60:0/3610702983 shutdown_connections 2020-10-31T22:51:16.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.985+0000 7f61b70a3700 1 --2- 172.21.15.60:0/3610702983 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6190054f10 0x7f61900573d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.985+0000 7f61b70a3700 1 --2- 172.21.15.60:0/3610702983 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f61b0141f00 0x7f61b01547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.985+0000 7f61b70a3700 1 --2- 172.21.15.60:0/3610702983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61b00b24a0 0x7f61b0148160 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.985+0000 7f61b70a3700 1 --2- 172.21.15.60:0/3610702983 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f61b00b5570 0x7f61b00ac5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:16.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.985+0000 7f61b70a3700 1 -- 172.21.15.60:0/3610702983 >> 172.21.15.60:0/3610702983 conn(0x7f61b00b8e90 msgr2=0x7f61b00b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:16.992 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.985+0000 7f61b70a3700 1 -- 172.21.15.60:0/3610702983 shutdown_connections 2020-10-31T22:51:16.993 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:16.985+0000 7f61b70a3700 1 -- 172.21.15.60:0/3610702983 wait complete. 2020-10-31T22:51:17.003 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-10-31T22:51:17.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb035ebb700 1 Processor -- start 2020-10-31T22:51:17.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb035ebb700 1 -- start start 2020-10-31T22:51:17.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb035ebb700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb03005b180 0x7fb0301469d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:17.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb035ebb700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb03005f900 0x7fb03005fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb035ebb700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0300b0890 con 0x7fb030060230 2020-10-31T22:51:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb035ebb700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0300b0350 con 0x7fb03005f900 2020-10-31T22:51:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb035ebb700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0300b05f0 con 0x7fb03005b180 2020-10-31T22:51:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb0356ba700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fb030060230 0x7fb03013f7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54498/0 (socket says 172.21.15.60:54498) 2020-10-31T22:51:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb0356ba700 1 -- 172.21.15.60:0/1786139984 learned_addr learned my addr 172.21.15.60:0/1786139984 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:17.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb02ffff700 1 --2- 172.21.15.60:0/1786139984 >> v2:172.21.15.66:3300/0 conn(0x7fb03005f900 0x7fb03005fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:17.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb034eb9700 1 --2- 172.21.15.60:0/1786139984 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb03005b180 0x7fb0301469d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:17.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb02f7fe700 1 -- 172.21.15.60:0/1786139984 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277195733 0 0) 0x7fb0300b0890 con 0x7fb030060230 2020-10-31T22:51:17.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb02f7fe700 1 -- 172.21.15.60:0/1786139984 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb01c003230 con 0x7fb030060230 2020-10-31T22:51:17.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb034eb9700 1 -- 172.21.15.60:0/1786139984 >> v2:172.21.15.66:3300/0 conn(0x7fb03005f900 msgr2=0x7fb03005fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:17.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb034eb9700 1 --2- 172.21.15.60:0/1786139984 >> v2:172.21.15.66:3300/0 conn(0x7fb03005f900 0x7fb03005fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb034eb9700 1 -- 172.21.15.60:0/1786139984 >> v1:172.21.15.60:6789/0 conn(0x7fb030060230 legacy=0x7fb03013f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:17.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb034eb9700 1 -- 172.21.15.60:0/1786139984 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03005f460 con 0x7fb03005b180 2020-10-31T22:51:17.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb02ffff700 1 --2- 172.21.15.60:0/1786139984 >> v2:172.21.15.66:3300/0 conn(0x7fb03005f900 0x7fb03005fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:17.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb034eb9700 1 --2- 172.21.15.60:0/1786139984 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb03005b180 0x7fb0301469d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb020002f30 tx=0x7fb020006dc0).ready entity=mon.2 client_cookie=33dc0521943a58ad server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:17.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb02f7fe700 1 -- 172.21.15.60:0/1786139984 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0200096a0 con 0x7fb03005b180 2020-10-31T22:51:17.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb02f7fe700 1 -- 172.21.15.60:0/1786139984 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb020009800 con 0x7fb03005b180 2020-10-31T22:51:17.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb02f7fe700 1 -- 172.21.15.60:0/1786139984 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb020009b60 con 0x7fb03005b180 2020-10-31T22:51:17.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb035ebb700 1 -- 172.21.15.60:0/1786139984 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb03005b180 msgr2=0x7fb0301469d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:17.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.121+0000 7fb035ebb700 1 --2- 172.21.15.60:0/1786139984 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb03005b180 0x7fb0301469d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fb020002f30 tx=0x7fb020006dc0).stop 2020-10-31T22:51:17.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb035ebb700 1 -- 172.21.15.60:0/1786139984 shutdown_connections 2020-10-31T22:51:17.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb035ebb700 1 --2- 172.21.15.60:0/1786139984 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb03005b180 0x7fb0301469d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb035ebb700 1 --2- 172.21.15.60:0/1786139984 >> v2:172.21.15.66:3300/0 conn(0x7fb03005f900 0x7fb03005fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb035ebb700 1 -- 172.21.15.60:0/1786139984 >> 172.21.15.60:0/1786139984 conn(0x7fb0300b61d0 msgr2=0x7fb0300b65b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:17.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb035ebb700 1 -- 172.21.15.60:0/1786139984 shutdown_connections 2020-10-31T22:51:17.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb035ebb700 1 -- 172.21.15.60:0/1786139984 wait complete. 2020-10-31T22:51:17.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb035ebb700 1 Processor -- start 2020-10-31T22:51:17.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb035ebb700 1 -- start start 2020-10-31T22:51:17.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb035ebb700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb03005b180 0x7fb0300b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:17.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb035ebb700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb03005f900 0x7fb0300aa8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:17.134 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb035ebb700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb030060230 0x7fb0300aad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:17.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb035ebb700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0301580c0 con 0x7fb03005b180 2020-10-31T22:51:17.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb035ebb700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb030148560 con 0x7fb030060230 2020-10-31T22:51:17.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb035ebb700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb030148800 con 0x7fb03005f900 2020-10-31T22:51:17.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.125+0000 7fb034eb9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb03005b180 0x7fb0300b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:17.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb034eb9700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb03005b180 0x7fb0300b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50366/0 (socket says 172.21.15.60:50366) 2020-10-31T22:51:17.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb034eb9700 1 -- 172.21.15.60:0/3306476875 learned_addr learned my addr 172.21.15.60:0/3306476875 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:17.135 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb02ffff700 1 --2- 172.21.15.60:0/3306476875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb03005f900 0x7fb0300aa8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:17.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb0356ba700 1 --2- 172.21.15.60:0/3306476875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb030060230 0x7fb0300aad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:17.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb034eb9700 1 -- 172.21.15.60:0/3306476875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb03005f900 msgr2=0x7fb0300aa8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:17.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb034eb9700 1 --2- 172.21.15.60:0/3306476875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb03005f900 0x7fb0300aa8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb034eb9700 1 -- 172.21.15.60:0/3306476875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb030060230 msgr2=0x7fb0300aad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:17.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb034eb9700 1 --2- 172.21.15.60:0/3306476875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb030060230 0x7fb0300aad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb034eb9700 1 -- 172.21.15.60:0/3306476875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0301474a0 con 0x7fb03005b180 2020-10-31T22:51:17.136 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb034eb9700 1 --2- 172.21.15.60:0/3306476875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb03005b180 0x7fb0300b1bd0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7fb020002f30 tx=0x7fb020015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:17.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb02dffb700 1 -- 172.21.15.60:0/3306476875 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb020011a20 con 0x7fb03005b180 2020-10-31T22:51:17.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb035ebb700 1 -- 172.21.15.60:0/3306476875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb030147740 con 0x7fb03005b180 2020-10-31T22:51:17.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb02dffb700 1 -- 172.21.15.60:0/3306476875 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb020011b80 con 0x7fb03005b180 2020-10-31T22:51:17.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb02dffb700 1 -- 172.21.15.60:0/3306476875 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb02001c3b0 con 0x7fb03005b180 2020-10-31T22:51:17.137 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb035ebb700 1 -- 172.21.15.60:0/3306476875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb030149480 con 0x7fb03005b180 2020-10-31T22:51:17.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb035ebb700 1 -- 172.21.15.60:0/3306476875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb030147be0 con 0x7fb03005b180 2020-10-31T22:51:17.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb02dffb700 1 -- 172.21.15.60:0/3306476875 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fb02000f070 con 0x7fb03005b180 2020-10-31T22:51:17.138 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb02dffb700 1 --2- 172.21.15.60:0/3306476875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb010054f10 0x7fb0100573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:17.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb02dffb700 1 -- 172.21.15.60:0/3306476875 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fb02006e5c0 con 0x7fb03005b180 2020-10-31T22:51:17.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb02ffff700 1 --2- 172.21.15.60:0/3306476875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb010054f10 0x7fb0100573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:17.139 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.129+0000 7fb02ffff700 1 --2- 172.21.15.60:0/3306476875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb010054f10 0x7fb0100573d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fb02400b000 tx=0x7fb024006dc0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:17.143 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.137+0000 7fb02dffb700 1 -- 172.21.15.60:0/3306476875 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fb030147be0 con 0x7fb03005b180 2020-10-31T22:51:17.285 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.281+0000 7fb035ebb700 1 -- 172.21.15.60:0/3306476875 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb030147be0 con 0x7fb03005b180 2020-10-31T22:51:17.286 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.281+0000 7fb02dffb700 1 -- 172.21.15.60:0/3306476875 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v160) v1 ==== 100+0+10 (secure 0 0 0) 0x7fb030147be0 con 0x7fb03005b180 2020-10-31T22:51:17.286 INFO:teuthology.orchestra.run.smithi060.stdout:pg_num: 8 2020-10-31T22:51:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.285+0000 7fb035ebb700 1 -- 172.21.15.60:0/3306476875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb010054f10 msgr2=0x7fb0100573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.285+0000 7fb035ebb700 1 --2- 172.21.15.60:0/3306476875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb010054f10 0x7fb0100573d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 rx=0x7fb02400b000 tx=0x7fb024006dc0).stop 2020-10-31T22:51:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.285+0000 7fb035ebb700 1 -- 172.21.15.60:0/3306476875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb03005b180 msgr2=0x7fb0300b1bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:17.289 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.285+0000 7fb035ebb700 1 --2- 172.21.15.60:0/3306476875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb03005b180 0x7fb0300b1bd0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 rx=0x7fb020002f30 tx=0x7fb020015000).stop 2020-10-31T22:51:17.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.285+0000 7fb035ebb700 1 -- 172.21.15.60:0/3306476875 shutdown_connections 2020-10-31T22:51:17.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.285+0000 7fb035ebb700 1 --2- 172.21.15.60:0/3306476875 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fb010054f10 0x7fb0100573d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.285+0000 7fb035ebb700 1 --2- 172.21.15.60:0/3306476875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb030060230 0x7fb0300aad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.285+0000 7fb035ebb700 1 --2- 172.21.15.60:0/3306476875 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb03005b180 0x7fb0300b1bd0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.285+0000 7fb035ebb700 1 --2- 172.21.15.60:0/3306476875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb03005f900 0x7fb0300aa8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.290 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.285+0000 7fb035ebb700 1 -- 172.21.15.60:0/3306476875 >> 172.21.15.60:0/3306476875 conn(0x7fb0300b61d0 msgr2=0x7fb030142bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.285+0000 7fb035ebb700 1 -- 172.21.15.60:0/3306476875 shutdown_connections 2020-10-31T22:51:17.291 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.285+0000 7fb035ebb700 1 -- 172.21.15.60:0/3306476875 wait complete. 2020-10-31T22:51:17.306 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-10-31T22:51:17.307 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:51:17.421 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.413+0000 7f8612d24700 1 Processor -- start 2020-10-31T22:51:17.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.413+0000 7f8612d24700 1 -- start start 2020-10-31T22:51:17.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612d24700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f860c13f3d0 0x7f860c05c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:17.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612d24700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f860c0ae630 0x7f860c0b0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:17.422 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612d24700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860c05c800 con 0x7f860c0b1bb0 2020-10-31T22:51:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612d24700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f860c0adc50 con 0x7f860c13f3d0 2020-10-31T22:51:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612d24700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c0adef0 con 0x7f860c0ae630 2020-10-31T22:51:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8611d22700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f860c0b1bb0 0x7f860c13ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54510/0 (socket says 172.21.15.60:54510) 2020-10-31T22:51:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8611d22700 1 -- 172.21.15.60:0/1389083377 learned_addr learned my addr 172.21.15.60:0/1389083377 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612523700 1 --2- 172.21.15.60:0/1389083377 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f860c0ae630 0x7f860c0b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8611521700 1 --2- 172.21.15.60:0/1389083377 >> v2:172.21.15.66:3300/0 conn(0x7f860c13f3d0 0x7f860c05c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:17.423 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8610d20700 1 -- 172.21.15.60:0/1389083377 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766554675 0 0) 0x7f860c05c800 con 0x7f860c0b1bb0 2020-10-31T22:51:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8610d20700 1 -- 172.21.15.60:0/1389083377 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85f4003230 con 0x7f860c0b1bb0 2020-10-31T22:51:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612523700 1 -- 172.21.15.60:0/1389083377 >> v2:172.21.15.66:3300/0 conn(0x7f860c13f3d0 msgr2=0x7f860c05c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612523700 1 --2- 172.21.15.60:0/1389083377 >> v2:172.21.15.66:3300/0 conn(0x7f860c13f3d0 0x7f860c05c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612523700 1 -- 172.21.15.60:0/1389083377 >> v1:172.21.15.60:6789/0 conn(0x7f860c0b1bb0 legacy=0x7f860c13ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:17.424 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612523700 1 -- 172.21.15.60:0/1389083377 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c0ae190 con 0x7f860c0ae630 2020-10-31T22:51:17.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612523700 1 --2- 172.21.15.60:0/1389083377 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f860c0ae630 0x7f860c0b0210 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f86040032b0 tx=0x7f86040091a0).ready entity=mon.2 client_cookie=3c4c49f3f7e5fdae server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:17.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8610d20700 1 -- 172.21.15.60:0/1389083377 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f860400b940 con 0x7f860c0ae630 2020-10-31T22:51:17.426 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8610d20700 1 -- 172.21.15.60:0/1389083377 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860400baa0 con 0x7f860c0ae630 2020-10-31T22:51:17.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8610d20700 1 -- 172.21.15.60:0/1389083377 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f860400bc10 con 0x7f860c0ae630 2020-10-31T22:51:17.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612d24700 1 -- 172.21.15.60:0/1389083377 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f860c0ae630 msgr2=0x7f860c0b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:17.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612d24700 1 --2- 172.21.15.60:0/1389083377 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f860c0ae630 0x7f860c0b0210 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f86040032b0 tx=0x7f86040091a0).stop 2020-10-31T22:51:17.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612d24700 1 -- 172.21.15.60:0/1389083377 shutdown_connections 2020-10-31T22:51:17.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612d24700 1 --2- 172.21.15.60:0/1389083377 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f860c0ae630 0x7f860c0b0210 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612d24700 1 --2- 172.21.15.60:0/1389083377 >> v2:172.21.15.66:3300/0 conn(0x7f860c13f3d0 0x7f860c05c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.427 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612d24700 1 -- 172.21.15.60:0/1389083377 >> 172.21.15.60:0/1389083377 conn(0x7f860c0b5300 msgr2=0x7f860c0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:17.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612d24700 1 -- 172.21.15.60:0/1389083377 shutdown_connections 2020-10-31T22:51:17.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.417+0000 7f8612d24700 1 -- 172.21.15.60:0/1389083377 wait complete. 2020-10-31T22:51:17.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8612d24700 1 Processor -- start 2020-10-31T22:51:17.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8612d24700 1 -- start start 2020-10-31T22:51:17.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8612d24700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f860c0b1bb0 0x7f860c133250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:17.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8612d24700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860c13f3d0 0x7f860c13de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:17.428 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8612d24700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f860c1428a0 0x7f860c13cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:17.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8612d24700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c133fb0 con 0x7f860c13f3d0 2020-10-31T22:51:17.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8612d24700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860c141340 con 0x7f860c1428a0 2020-10-31T22:51:17.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8612d24700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860c066a40 con 0x7f860c0b1bb0 2020-10-31T22:51:17.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8611521700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860c13f3d0 0x7f860c13de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:17.429 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8611521700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860c13f3d0 0x7f860c13de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50384/0 (socket says 172.21.15.60:50384) 2020-10-31T22:51:17.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8611521700 1 -- 172.21.15.60:0/2887533480 learned_addr learned my addr 172.21.15.60:0/2887533480 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:17.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8611d22700 1 --2- 172.21.15.60:0/2887533480 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f860c0b1bb0 0x7f860c133250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:17.430 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8612523700 1 --2- 172.21.15.60:0/2887533480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f860c1428a0 0x7f860c13cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:17.431 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8611521700 1 -- 172.21.15.60:0/2887533480 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f860c0b1bb0 msgr2=0x7f860c133250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:17.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8611521700 1 --2- 172.21.15.60:0/2887533480 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f860c0b1bb0 0x7f860c133250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8611521700 1 -- 172.21.15.60:0/2887533480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f860c1428a0 msgr2=0x7f860c13cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:17.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8611521700 1 --2- 172.21.15.60:0/2887533480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f860c1428a0 0x7f860c13cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8611521700 1 -- 172.21.15.60:0/2887533480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c066ce0 con 0x7f860c13f3d0 2020-10-31T22:51:17.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8611521700 1 --2- 172.21.15.60:0/2887533480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860c13f3d0 0x7f860c13de30 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f860000c000 tx=0x7f8600006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:17.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f85feffd700 1 -- 172.21.15.60:0/2887533480 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f860000ca10 con 0x7f860c13f3d0 2020-10-31T22:51:17.432 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f85feffd700 1 -- 172.21.15.60:0/2887533480 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860000cb70 con 0x7f860c13f3d0 2020-10-31T22:51:17.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8612d24700 1 -- 172.21.15.60:0/2887533480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860c066f80 con 0x7f860c13f3d0 2020-10-31T22:51:17.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f85feffd700 1 -- 172.21.15.60:0/2887533480 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f86000123f0 con 0x7f860c13f3d0 2020-10-31T22:51:17.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.421+0000 7f8612d24700 1 -- 172.21.15.60:0/2887533480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860c140250 con 0x7f860c13f3d0 2020-10-31T22:51:17.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.425+0000 7f8612d24700 1 -- 172.21.15.60:0/2887533480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f860c141180 con 0x7f860c13f3d0 2020-10-31T22:51:17.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.425+0000 7f85feffd700 1 -- 172.21.15.60:0/2887533480 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8600012550 con 0x7f860c13f3d0 2020-10-31T22:51:17.433 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.425+0000 7f85feffd700 1 --2- 172.21.15.60:0/2887533480 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f85ec054f90 0x7f85ec057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:17.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.425+0000 7f85feffd700 1 -- 172.21.15.60:0/2887533480 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f860006dee0 con 0x7f860c13f3d0 2020-10-31T22:51:17.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.425+0000 7f8611d22700 1 --2- 172.21.15.60:0/2887533480 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f85ec054f90 0x7f85ec057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:17.434 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.425+0000 7f8611d22700 1 --2- 172.21.15.60:0/2887533480 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f85ec054f90 0x7f85ec057450 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f860800d000 tx=0x7f8608009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:17.435 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.429+0000 7f85feffd700 1 -- 172.21.15.60:0/2887533480 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8600044290 con 0x7f860c13f3d0 2020-10-31T22:51:17.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.613+0000 7f8612d24700 1 -- 172.21.15.60:0/2887533480 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f860c057100 con 0x7f860c13f3d0 2020-10-31T22:51:17.617 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.613+0000 7f85feffd700 1 -- 172.21.15.60:0/2887533480 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f86000478b0 con 0x7f860c13f3d0 2020-10-31T22:51:17.618 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:17.618 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":81,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/542860877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":542860877},{"type":"v1","addr":"172.21.15.66:6833","nonce":542860877}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79},{"gid":8535,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/480001574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":480001574},{"type":"v1","addr":"172.21.15.60:6835","nonce":480001574}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:51:08.474776+0000","modified":"2020-10-31T22:51:09.477436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/364183995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":364183995},{"type":"v1","addr":"172.21.15.60:6837","nonce":364183995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-10-31T22:51:17.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.613+0000 7f8612d24700 1 -- 172.21.15.60:0/2887533480 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f85ec054f90 msgr2=0x7f85ec057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:17.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.613+0000 7f8612d24700 1 --2- 172.21.15.60:0/2887533480 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f85ec054f90 0x7f85ec057450 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 rx=0x7f860800d000 tx=0x7f8608009040).stop 2020-10-31T22:51:17.619 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.613+0000 7f8612d24700 1 -- 172.21.15.60:0/2887533480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860c13f3d0 msgr2=0x7f860c13de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:17.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.613+0000 7f8612d24700 1 --2- 172.21.15.60:0/2887533480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860c13f3d0 0x7f860c13de30 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 rx=0x7f860000c000 tx=0x7f8600006dc0).stop 2020-10-31T22:51:17.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.613+0000 7f8612d24700 1 -- 172.21.15.60:0/2887533480 shutdown_connections 2020-10-31T22:51:17.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.613+0000 7f8612d24700 1 --2- 172.21.15.60:0/2887533480 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f85ec054f90 0x7f85ec057450 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.613+0000 7f8612d24700 1 --2- 172.21.15.60:0/2887533480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f860c1428a0 0x7f860c13cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.613+0000 7f8612d24700 1 --2- 172.21.15.60:0/2887533480 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f860c0b1bb0 0x7f860c133250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.613+0000 7f8612d24700 1 --2- 172.21.15.60:0/2887533480 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f860c13f3d0 0x7f860c13de30 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:17.620 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.613+0000 7f8612d24700 1 -- 172.21.15.60:0/2887533480 >> 172.21.15.60:0/2887533480 conn(0x7f860c0b5300 msgr2=0x7f860c0600b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:17.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.613+0000 7f8612d24700 1 -- 172.21.15.60:0/2887533480 shutdown_connections 2020-10-31T22:51:17.621 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:17.613+0000 7f8612d24700 1 -- 172.21.15.60:0/2887533480 wait complete. 2020-10-31T22:51:17.621 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 81 2020-10-31T22:51:17.938 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-10-31T22:51:08.474776+0000', 'modified': '2020-10-31T22:51:09.477436+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8547}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8547': {'gid': 8547, 'name': 'c', 'rank': 0, 'incarnation': 80, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.60:6837/364183995', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 364183995}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 364183995}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [30], 'metadata_pool': 29, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-10-31T22:51:17.939 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-10-31T22:51:17.940 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-10-31T22:51:18.070 INFO:teuthology.orchestra.run.smithi060.stdout:{"cluster_fsid":"226f905a-1517-4a8c-8009-08779515965c","whoami":0,"id":8547,"want_state":"up:active","state":"up:active","rank_uptime":9.5825156919999994,"mdsmap_epoch":81,"osdmap_epoch":160,"osdmap_epoch_barrier":159,"uptime":14.817547891} 2020-10-31T22:51:18.071 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "226f905a-1517-4a8c-8009-08779515965c", "id": 8547, "mdsmap_epoch": 81, "osdmap_epoch": 160, "osdmap_epoch_barrier": 159, "rank_uptime": 9.582515692, "state": "up:active", "uptime": 14.817547891, "want_state": "up:active", "whoami": 0 } 2020-10-31T22:51:18.072 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-10-31T22:51:18.072 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2020-10-31T22:51:18.073 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.1 at ubuntu@smithi085.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.1... 2020-10-31T22:51:18.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:18.074 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec mkdir -m 0000 -p /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:51:18.082 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:51:18.139 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:51:18.140 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:51:18.195 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:51:18.196 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:51:18.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:18.196 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:51:18.246 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-10-31T22:51:18.247 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.1 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:51:18.290 INFO:teuthology.orchestra.run.smithi085:> sudo modprobe fuse 2020-10-31T22:51:18.306 INFO:teuthology.orchestra.run:Running command with timeout 30 2020-10-31T22:51:18.306 INFO:teuthology.orchestra.run.smithi085:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-10-31T22:51:18.363 INFO:teuthology.orchestra.run.smithi085.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2020-10-31T22:51:18.373 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-10-31T22:51:18.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:18.374 INFO:teuthology.orchestra.run.smithi085:> ls /sys/fs/fuse/connections 2020-10-31T22:51:18.375 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:2020-10-31T22:51:18.365+0000 7f28a29ee0c0 -1 init, newargv = 0x55ea0a3b65e0 newargc=9 2020-10-31T22:51:18.375 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13822]: starting ceph client 2020-10-31T22:51:18.379 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13822]: starting fuse 2020-10-31T22:51:18.384 INFO:teuthology.orchestra.run.smithi085.stdout:50 2020-10-31T22:51:18.384 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [50] 2020-10-31T22:51:18.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:18.385 INFO:teuthology.orchestra.run.smithi085:> sudo python3 -c ' 2020-10-31T22:51:18.385 INFO:teuthology.orchestra.run.smithi085:> import glob 2020-10-31T22:51:18.386 INFO:teuthology.orchestra.run.smithi085:> import re 2020-10-31T22:51:18.386 INFO:teuthology.orchestra.run.smithi085:> import os 2020-10-31T22:51:18.386 INFO:teuthology.orchestra.run.smithi085:> import subprocess 2020-10-31T22:51:18.387 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:51:18.387 INFO:teuthology.orchestra.run.smithi085:> def find_socket(client_name): 2020-10-31T22:51:18.387 INFO:teuthology.orchestra.run.smithi085:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2020-10-31T22:51:18.388 INFO:teuthology.orchestra.run.smithi085:> files = glob.glob(asok_path) 2020-10-31T22:51:18.388 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:51:18.388 INFO:teuthology.orchestra.run.smithi085:> # Given a non-glob path, it better be there 2020-10-31T22:51:18.388 INFO:teuthology.orchestra.run.smithi085:> if "*" not in asok_path: 2020-10-31T22:51:18.389 INFO:teuthology.orchestra.run.smithi085:> assert(len(files) == 1) 2020-10-31T22:51:18.389 INFO:teuthology.orchestra.run.smithi085:> return files[0] 2020-10-31T22:51:18.389 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:51:18.390 INFO:teuthology.orchestra.run.smithi085:> for f in files: 2020-10-31T22:51:18.390 INFO:teuthology.orchestra.run.smithi085:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-10-31T22:51:18.390 INFO:teuthology.orchestra.run.smithi085:> if os.path.exists("/proc/{0}".format(pid)): 2020-10-31T22:51:18.391 INFO:teuthology.orchestra.run.smithi085:> return f 2020-10-31T22:51:18.391 INFO:teuthology.orchestra.run.smithi085:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-10-31T22:51:18.391 INFO:teuthology.orchestra.run.smithi085:> 2020-10-31T22:51:18.391 INFO:teuthology.orchestra.run.smithi085:> print(find_socket("client.1")) 2020-10-31T22:51:18.392 INFO:teuthology.orchestra.run.smithi085:> ' 2020-10-31T22:51:18.474 INFO:teuthology.orchestra.run.smithi085.stdout:/var/run/ceph/ceph-client.1.13822.asok 2020-10-31T22:51:18.479 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.13822.asok 2020-10-31T22:51:18.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:18.480 INFO:teuthology.orchestra.run.smithi085:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.13822.asok status 2020-10-31T22:51:18.580 INFO:teuthology.orchestra.run.smithi085.stdout:{ 2020-10-31T22:51:18.581 INFO:teuthology.orchestra.run.smithi085.stdout: "metadata": { 2020-10-31T22:51:18.581 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_sha1": "5e705cd08d99a37f9ec3c2b451d90f6262257c7c", 2020-10-31T22:51:18.581 INFO:teuthology.orchestra.run.smithi085.stdout: "ceph_version": "ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable)", 2020-10-31T22:51:18.581 INFO:teuthology.orchestra.run.smithi085.stdout: "entity_id": "1", 2020-10-31T22:51:18.581 INFO:teuthology.orchestra.run.smithi085.stdout: "hostname": "smithi085", 2020-10-31T22:51:18.582 INFO:teuthology.orchestra.run.smithi085.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2020-10-31T22:51:18.582 INFO:teuthology.orchestra.run.smithi085.stdout: "pid": "13822", 2020-10-31T22:51:18.582 INFO:teuthology.orchestra.run.smithi085.stdout: "root": "/" 2020-10-31T22:51:18.582 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:51:18.582 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_count": 0, 2020-10-31T22:51:18.582 INFO:teuthology.orchestra.run.smithi085.stdout: "dentry_pinned_count": 0, 2020-10-31T22:51:18.583 INFO:teuthology.orchestra.run.smithi085.stdout: "id": 8491, 2020-10-31T22:51:18.583 INFO:teuthology.orchestra.run.smithi085.stdout: "inst": { 2020-10-31T22:51:18.583 INFO:teuthology.orchestra.run.smithi085.stdout: "name": { 2020-10-31T22:51:18.583 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "client", 2020-10-31T22:51:18.583 INFO:teuthology.orchestra.run.smithi085.stdout: "num": 8491 2020-10-31T22:51:18.583 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:51:18.584 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:51:18.584 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:51:18.584 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:51:18.584 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 1967216719 2020-10-31T22:51:18.584 INFO:teuthology.orchestra.run.smithi085.stdout: } 2020-10-31T22:51:18.584 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:51:18.585 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": { 2020-10-31T22:51:18.585 INFO:teuthology.orchestra.run.smithi085.stdout: "type": "v1", 2020-10-31T22:51:18.585 INFO:teuthology.orchestra.run.smithi085.stdout: "addr": "172.21.15.85:0", 2020-10-31T22:51:18.585 INFO:teuthology.orchestra.run.smithi085.stdout: "nonce": 1967216719 2020-10-31T22:51:18.585 INFO:teuthology.orchestra.run.smithi085.stdout: }, 2020-10-31T22:51:18.585 INFO:teuthology.orchestra.run.smithi085.stdout: "inst_str": "client.8491 172.21.15.85:0/1967216719", 2020-10-31T22:51:18.585 INFO:teuthology.orchestra.run.smithi085.stdout: "addr_str": "172.21.15.85:0/1967216719", 2020-10-31T22:51:18.586 INFO:teuthology.orchestra.run.smithi085.stdout: "inode_count": 1, 2020-10-31T22:51:18.586 INFO:teuthology.orchestra.run.smithi085.stdout: "mds_epoch": 81, 2020-10-31T22:51:18.586 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch": 160, 2020-10-31T22:51:18.586 INFO:teuthology.orchestra.run.smithi085.stdout: "osd_epoch_barrier": 0, 2020-10-31T22:51:18.586 INFO:teuthology.orchestra.run.smithi085.stdout: "blacklisted": false 2020-10-31T22:51:18.586 INFO:teuthology.orchestra.run.smithi085.stdout:} 2020-10-31T22:51:18.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:18.591 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:51:18.591 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:51:18.599 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:51:18.600 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:51:18.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:18.601 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo chmod 1777 /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:51:18.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:18.658 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:51:18.659 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:51:18.708 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:51:18.709 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:51:18.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:18.710 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:51:18.710 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:51:18.759 INFO:teuthology.orchestra.run.smithi085.stdout:fuseblk 2020-10-31T22:51:18.760 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2020-10-31T22:51:18.761 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi085.front.sepia.ceph.com... 2020-10-31T22:51:18.761 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-10-31T22:51:18.761 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec sudo fusermount -u /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:51:18.849 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi085.stderr:ceph-fuse[13822]: fuse finished with error 0 and tester_r 0 2020-10-31T22:51:18.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:18.851 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:51:18.851 INFO:teuthology.orchestra.run.smithi085:> ' -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:51:18.858 INFO:teuthology.orchestra.run.smithi085.stdout:ext2/ext3 2020-10-31T22:51:18.859 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse not mounted, got fs type 'ext2/ext3' 2020-10-31T22:51:18.859 INFO:teuthology.orchestra.run:waiting for 900 2020-10-31T22:51:24.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-10-31T22:51:24.962 INFO:teuthology.orchestra.run.smithi085:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2020-10-31T22:51:24.970 INFO:teuthology.orchestra.run.smithi152:> cd /home/ubuntu/cephtest/mnt.0 && sudo bash -c 'stat -f .' 2020-10-31T22:51:24.989 INFO:teuthology.orchestra.run.smithi152.stdout: File: "." 2020-10-31T22:51:24.989 INFO:teuthology.orchestra.run.smithi152.stdout: ID: 0 Namelen: 255 Type: fuseblk 2020-10-31T22:51:24.989 INFO:teuthology.orchestra.run.smithi152.stdout:Block size: 4194304 Fundamental block size: 4194304 2020-10-31T22:51:24.989 INFO:teuthology.orchestra.run.smithi152.stdout:Blocks: Total: 86526 Free: 86526 Available: 86526 2020-10-31T22:51:24.990 INFO:teuthology.orchestra.run.smithi152.stdout:Inodes: Total: 1 Free: 0 2020-10-31T22:51:24.991 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json-pretty 2020-10-31T22:51:25.113 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa120f8f700 1 Processor -- start 2020-10-31T22:51:25.114 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa120f8f700 1 -- start start 2020-10-31T22:51:25.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa120f8f700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa11c05b960 0x7fa11c05bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.116 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa120f8f700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa11c0a7850 0x7fa11c0aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa120f8f700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa11c0b0f00 con 0x7fa11c0aefe0 2020-10-31T22:51:25.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa120f8f700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11c0b11a0 con 0x7fa11c0a7850 2020-10-31T22:51:25.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa120f8f700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa11c0b1440 con 0x7fa11c05b960 2020-10-31T22:51:25.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa119d9b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa11c0a7850 0x7fa11c0aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa11ad9d700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa11c0aefe0 0x7fa11c146790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54528/0 (socket says 172.21.15.60:54528) 2020-10-31T22:51:25.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa11ad9d700 1 -- 172.21.15.60:0/1959978046 learned_addr learned my addr 172.21.15.60:0/1959978046 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:25.117 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa11a59c700 1 --2- 172.21.15.60:0/1959978046 >> v2:172.21.15.66:3300/0 conn(0x7fa11c05b960 0x7fa11c05bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa119d9b700 1 -- 172.21.15.60:0/1959978046 >> v2:172.21.15.66:3300/0 conn(0x7fa11c05b960 msgr2=0x7fa11c05bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:25.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa119d9b700 1 --2- 172.21.15.60:0/1959978046 >> v2:172.21.15.66:3300/0 conn(0x7fa11c05b960 0x7fa11c05bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa119d9b700 1 -- 172.21.15.60:0/1959978046 >> v1:172.21.15.60:6789/0 conn(0x7fa11c0aefe0 legacy=0x7fa11c146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa11959a700 1 -- 172.21.15.60:0/1959978046 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416674152 0 0) 0x7fa11c0b0f00 con 0x7fa11c0aefe0 2020-10-31T22:51:25.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa119d9b700 1 -- 172.21.15.60:0/1959978046 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c1462f0 con 0x7fa11c0a7850 2020-10-31T22:51:25.118 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa119d9b700 1 --2- 172.21.15.60:0/1959978046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa11c0a7850 0x7fa11c0aeaf0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7fa104002f30 tx=0x7fa104006dc0).ready entity=mon.0 client_cookie=7e3e58d2657b2e16 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:25.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa11959a700 1 -- 172.21.15.60:0/1959978046 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa1040097b0 con 0x7fa11c0a7850 2020-10-31T22:51:25.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa11959a700 1 -- 172.21.15.60:0/1959978046 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa104009910 con 0x7fa11c0a7850 2020-10-31T22:51:25.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa11959a700 1 -- 172.21.15.60:0/1959978046 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa104009c70 con 0x7fa11c0a7850 2020-10-31T22:51:25.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa120f8f700 1 -- 172.21.15.60:0/1959978046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa11c0a7850 msgr2=0x7fa11c0aeaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.119 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.109+0000 7fa120f8f700 1 --2- 172.21.15.60:0/1959978046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa11c0a7850 0x7fa11c0aeaf0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 rx=0x7fa104002f30 tx=0x7fa104006dc0).stop 2020-10-31T22:51:25.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.113+0000 7fa120f8f700 1 -- 172.21.15.60:0/1959978046 shutdown_connections 2020-10-31T22:51:25.120 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.113+0000 7fa120f8f700 1 --2- 172.21.15.60:0/1959978046 >> v2:172.21.15.66:3300/0 conn(0x7fa11c05b960 0x7fa11c05bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.113+0000 7fa120f8f700 1 --2- 172.21.15.60:0/1959978046 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa11c0a7850 0x7fa11c0aeaf0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.121 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.113+0000 7fa120f8f700 1 -- 172.21.15.60:0/1959978046 >> 172.21.15.60:0/1959978046 conn(0x7fa11c06a260 msgr2=0x7fa11c061a70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:25.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.113+0000 7fa120f8f700 1 -- 172.21.15.60:0/1959978046 shutdown_connections 2020-10-31T22:51:25.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.113+0000 7fa120f8f700 1 -- 172.21.15.60:0/1959978046 wait complete. 2020-10-31T22:51:25.122 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.113+0000 7fa120f8f700 1 Processor -- start 2020-10-31T22:51:25.123 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.113+0000 7fa120f8f700 1 -- start start 2020-10-31T22:51:25.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa120f8f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa11c05b960 0x7fa11c0ad670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa120f8f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa11c0a7850 0x7fa11c155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.125 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa120f8f700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa11c0b4530 0x7fa11c155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa120f8f700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c1551f0 con 0x7fa11c05b960 2020-10-31T22:51:25.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa120f8f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c0b1fa0 con 0x7fa11c0a7850 2020-10-31T22:51:25.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa120f8f700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11c0b2240 con 0x7fa11c0b4530 2020-10-31T22:51:25.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa11a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa11c05b960 0x7fa11c0ad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.126 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa11a59c700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa11c05b960 0x7fa11c0ad670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50394/0 (socket says 172.21.15.60:50394) 2020-10-31T22:51:25.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa11a59c700 1 -- 172.21.15.60:0/3215170010 learned_addr learned my addr 172.21.15.60:0/3215170010 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:25.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa11ad9d700 1 --2- 172.21.15.60:0/3215170010 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa11c0b4530 0x7fa11c155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa119d9b700 1 --2- 172.21.15.60:0/3215170010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa11c0a7850 0x7fa11c155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa11a59c700 1 -- 172.21.15.60:0/3215170010 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa11c0b4530 msgr2=0x7fa11c155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa11a59c700 1 --2- 172.21.15.60:0/3215170010 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa11c0b4530 0x7fa11c155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa11a59c700 1 -- 172.21.15.60:0/3215170010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa11c0a7850 msgr2=0x7fa11c155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.127 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa11a59c700 1 --2- 172.21.15.60:0/3215170010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa11c0a7850 0x7fa11c155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa11a59c700 1 -- 172.21.15.60:0/3215170010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa11c1553e0 con 0x7fa11c05b960 2020-10-31T22:51:25.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa11a59c700 1 --2- 172.21.15.60:0/3215170010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa11c05b960 0x7fa11c0ad670 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fa10c00c000 tx=0x7fa10c0091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:25.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa1137fe700 1 -- 172.21.15.60:0/3215170010 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa10c00cb00 con 0x7fa11c05b960 2020-10-31T22:51:25.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa1137fe700 1 -- 172.21.15.60:0/3215170010 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10c00cc60 con 0x7fa11c05b960 2020-10-31T22:51:25.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa120f8f700 1 -- 172.21.15.60:0/3215170010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11c0adb60 con 0x7fa11c05b960 2020-10-31T22:51:25.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa1137fe700 1 -- 172.21.15.60:0/3215170010 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa10c0123f0 con 0x7fa11c05b960 2020-10-31T22:51:25.128 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa120f8f700 1 -- 172.21.15.60:0/3215170010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11c149530 con 0x7fa11c05b960 2020-10-31T22:51:25.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.117+0000 7fa120f8f700 1 -- 172.21.15.60:0/3215170010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa11c0b2400 con 0x7fa11c05b960 2020-10-31T22:51:25.129 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.121+0000 7fa1137fe700 1 -- 172.21.15.60:0/3215170010 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa10c022070 con 0x7fa11c05b960 2020-10-31T22:51:25.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.121+0000 7fa1137fe700 1 --2- 172.21.15.60:0/3215170010 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa100054f10 0x7fa1000573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.121+0000 7fa1137fe700 1 -- 172.21.15.60:0/3215170010 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa10c06e580 con 0x7fa11c05b960 2020-10-31T22:51:25.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.121+0000 7fa119d9b700 1 --2- 172.21.15.60:0/3215170010 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa100054f10 0x7fa1000573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.130 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.121+0000 7fa119d9b700 1 --2- 172.21.15.60:0/3215170010 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa100054f10 0x7fa1000573d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fa10401a000 tx=0x7fa104015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:25.131 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.125+0000 7fa1137fe700 1 -- 172.21.15.60:0/3215170010 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa10c044aa0 con 0x7fa11c05b960 2020-10-31T22:51:25.275 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.269+0000 7fa120f8f700 1 -- 172.21.15.60:0/3215170010 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa11c0b2400 con 0x7fa11c05b960 2020-10-31T22:51:25.278 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.273+0000 7fa1137fe700 1 -- 172.21.15.60:0/3215170010 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v160) v1 ==== 81+0+33659 (secure 0 0 0) 0x7fa10c031390 con 0x7fa11c05b960 2020-10-31T22:51:25.279 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:25.279 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2020-10-31T22:51:25.279 INFO:teuthology.orchestra.run.smithi060.stdout: "epoch": 160, 2020-10-31T22:51:25.279 INFO:teuthology.orchestra.run.smithi060.stdout: "fsid": "226f905a-1517-4a8c-8009-08779515965c", 2020-10-31T22:51:25.280 INFO:teuthology.orchestra.run.smithi060.stdout: "created": "2020-10-31T22:40:51.928572+0000", 2020-10-31T22:51:25.280 INFO:teuthology.orchestra.run.smithi060.stdout: "modified": "2020-10-31T22:51:09.478155+0000", 2020-10-31T22:51:25.280 INFO:teuthology.orchestra.run.smithi060.stdout: "last_up_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:51:25.280 INFO:teuthology.orchestra.run.smithi060.stdout: "last_in_change": "2020-10-31T22:41:01.285949+0000", 2020-10-31T22:51:25.281 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2020-10-31T22:51:25.281 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_num": 5799936, 2020-10-31T22:51:25.281 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_set": [ 2020-10-31T22:51:25.281 INFO:teuthology.orchestra.run.smithi060.stdout: "pglog_hardlimit", 2020-10-31T22:51:25.282 INFO:teuthology.orchestra.run.smithi060.stdout: "purged_snapdirs", 2020-10-31T22:51:25.282 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_deletes", 2020-10-31T22:51:25.282 INFO:teuthology.orchestra.run.smithi060.stdout: "sortbitwise" 2020-10-31T22:51:25.282 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:51:25.283 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_version": 4, 2020-10-31T22:51:25.283 INFO:teuthology.orchestra.run.smithi060.stdout: "full_ratio": 0.94999998807907104, 2020-10-31T22:51:25.283 INFO:teuthology.orchestra.run.smithi060.stdout: "backfillfull_ratio": 0.89999997615814209, 2020-10-31T22:51:25.283 INFO:teuthology.orchestra.run.smithi060.stdout: "nearfull_ratio": 0.85000002384185791, 2020-10-31T22:51:25.284 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_snapshot": "", 2020-10-31T22:51:25.284 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_max": 30, 2020-10-31T22:51:25.284 INFO:teuthology.orchestra.run.smithi060.stdout: "max_osd": 8, 2020-10-31T22:51:25.285 INFO:teuthology.orchestra.run.smithi060.stdout: "require_min_compat_client": "jewel", 2020-10-31T22:51:25.285 INFO:teuthology.orchestra.run.smithi060.stdout: "min_compat_client": "jewel", 2020-10-31T22:51:25.285 INFO:teuthology.orchestra.run.smithi060.stdout: "require_osd_release": "octopus", 2020-10-31T22:51:25.286 INFO:teuthology.orchestra.run.smithi060.stdout: "pools": [ 2020-10-31T22:51:25.286 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.287 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 1, 2020-10-31T22:51:25.287 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "device_health_metrics", 2020-10-31T22:51:25.287 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:40:55.846143+0000", 2020-10-31T22:51:25.288 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:51:25.288 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:51:25.288 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:51:25.289 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:51:25.289 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:51:25.289 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:51:25.289 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:51:25.289 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:51:25.290 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 1, 2020-10-31T22:51:25.290 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 1, 2020-10-31T22:51:25.290 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 1, 2020-10-31T22:51:25.290 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 1, 2020-10-31T22:51:25.291 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 1, 2020-10-31T22:51:25.291 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:51:25.291 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:51:25.291 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:51:25.292 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:51:25.292 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:51:25.292 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:51:25.293 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:51:25.293 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.293 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "15", 2020-10-31T22:51:25.294 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:51:25.294 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:51:25.294 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:51:25.294 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:51:25.295 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:51:25.295 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:51:25.295 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:51:25.295 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:51:25.296 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:51:25.296 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:51:25.296 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:51:25.296 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:51:25.297 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:51:25.297 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:51:25.297 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:51:25.298 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:51:25.298 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:51:25.298 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:51:25.299 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:51:25.299 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:51:25.299 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:51:25.300 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:51:25.300 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:51:25.300 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:51:25.301 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:51:25.301 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:51:25.301 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.302 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:51:25.302 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:51:25.303 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:51:25.303 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:51:25.303 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:51:25.304 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:51:25.304 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:51:25.304 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:51:25.304 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:51:25.305 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:51:25.305 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:51:25.305 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:51:25.306 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 1 2020-10-31T22:51:25.306 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.306 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:51:25.307 INFO:teuthology.orchestra.run.smithi060.stdout: "mgr_devicehealth": {} 2020-10-31T22:51:25.307 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.307 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.308 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.308 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 2, 2020-10-31T22:51:25.308 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "rbd", 2020-10-31T22:51:25.308 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:41:05.358501+0000", 2020-10-31T22:51:25.308 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:51:25.308 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:51:25.309 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:51:25.309 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:51:25.309 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:51:25.309 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:51:25.310 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:51:25.310 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:51:25.310 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:51:25.310 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:51:25.310 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:51:25.310 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:51:25.311 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:51:25.311 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:51:25.311 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:51:25.311 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:51:25.311 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:51:25.312 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:51:25.312 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:51:25.312 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:51:25.312 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.312 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "18", 2020-10-31T22:51:25.313 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:51:25.313 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:51:25.313 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:51:25.313 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:51:25.314 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:51:25.314 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:51:25.314 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:51:25.315 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:51:25.315 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:51:25.315 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:51:25.316 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:51:25.316 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:51:25.316 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:51:25.316 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:51:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:51:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:51:25.317 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:51:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:51:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:51:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:51:25.318 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:51:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:51:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:51:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:51:25.319 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:51:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:51:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.320 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:51:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:51:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:51:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:51:25.321 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:51:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:51:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:51:25.322 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:51:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:51:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:51:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:51:25.323 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:51:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:51:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: "rbd": {} 2020-10-31T22:51:25.324 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 29, 2020-10-31T22:51:25.325 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_metadata", 2020-10-31T22:51:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:51:06.207804+0000", 2020-10-31T22:51:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:51:25.326 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:51:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:51:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:51:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:51:25.327 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:51:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:51:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:51:25.328 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:51:25.329 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:51:25.329 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:51:25.329 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:51:25.329 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:51:25.330 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:51:25.330 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:51:25.330 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:51:25.330 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:51:25.331 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:51:25.333 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:51:25.333 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:51:25.333 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.333 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "159", 2020-10-31T22:51:25.334 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:51:25.334 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:51:25.334 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:51:25.335 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:51:25.335 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:51:25.335 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:51:25.335 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:51:25.336 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:51:25.336 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:51:25.336 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:51:25.336 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:51:25.337 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:51:25.337 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:51:25.337 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:51:25.337 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:51:25.337 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:51:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:51:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:51:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:51:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:51:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:51:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:51:25.338 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:51:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:51:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:51:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:51:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:51:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:51:25.339 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:51:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:51:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:51:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:51:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:51:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:51:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:51:25.340 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:51:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:51:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "options": { 2020-10-31T22:51:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_bias": 4, 2020-10-31T22:51:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_min": 16, 2020-10-31T22:51:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_priority": 5 2020-10-31T22:51:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.341 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:51:25.342 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:51:25.342 INFO:teuthology.orchestra.run.smithi060.stdout: "metadata": "cephfs" 2020-10-31T22:51:25.342 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.343 INFO:teuthology.orchestra.run.smithi060.stdout: "pool": 30, 2020-10-31T22:51:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_name": "cephfs_data", 2020-10-31T22:51:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: "create_time": "2020-10-31T22:51:07.488114+0000", 2020-10-31T22:51:25.344 INFO:teuthology.orchestra.run.smithi060.stdout: "flags": 1, 2020-10-31T22:51:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "flags_names": "hashpspool", 2020-10-31T22:51:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "type": 1, 2020-10-31T22:51:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "size": 2, 2020-10-31T22:51:25.345 INFO:teuthology.orchestra.run.smithi060.stdout: "min_size": 1, 2020-10-31T22:51:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_rule": 0, 2020-10-31T22:51:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: "object_hash": 2, 2020-10-31T22:51:25.346 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_autoscale_mode": "off", 2020-10-31T22:51:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num": 8, 2020-10-31T22:51:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num": 8, 2020-10-31T22:51:25.347 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_placement_num_target": 8, 2020-10-31T22:51:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_target": 8, 2020-10-31T22:51:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_num_pending": 8, 2020-10-31T22:51:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "last_pg_merge_meta": { 2020-10-31T22:51:25.348 INFO:teuthology.orchestra.run.smithi060.stdout: "source_pgid": "0.0", 2020-10-31T22:51:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "ready_epoch": 0, 2020-10-31T22:51:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_started": 0, 2020-10-31T22:51:25.349 INFO:teuthology.orchestra.run.smithi060.stdout: "last_epoch_clean": 0, 2020-10-31T22:51:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: "source_version": "0'0", 2020-10-31T22:51:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: "target_version": "0'0" 2020-10-31T22:51:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.350 INFO:teuthology.orchestra.run.smithi060.stdout: "last_change": "160", 2020-10-31T22:51:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend": "0", 2020-10-31T22:51:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_prenautilus": "0", 2020-10-31T22:51:25.351 INFO:teuthology.orchestra.run.smithi060.stdout: "last_force_op_resend_preluminous": "0", 2020-10-31T22:51:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: "auid": 0, 2020-10-31T22:51:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_mode": "selfmanaged", 2020-10-31T22:51:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_seq": 0, 2020-10-31T22:51:25.352 INFO:teuthology.orchestra.run.smithi060.stdout: "snap_epoch": 0, 2020-10-31T22:51:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "pool_snaps": [], 2020-10-31T22:51:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps": "[]", 2020-10-31T22:51:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_bytes": 0, 2020-10-31T22:51:25.353 INFO:teuthology.orchestra.run.smithi060.stdout: "quota_max_objects": 0, 2020-10-31T22:51:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "tiers": [], 2020-10-31T22:51:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "tier_of": -1, 2020-10-31T22:51:25.354 INFO:teuthology.orchestra.run.smithi060.stdout: "read_tier": -1, 2020-10-31T22:51:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "write_tier": -1, 2020-10-31T22:51:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_mode": "none", 2020-10-31T22:51:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_bytes": 0, 2020-10-31T22:51:25.355 INFO:teuthology.orchestra.run.smithi060.stdout: "target_max_objects": 0, 2020-10-31T22:51:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_ratio_micro": 400000, 2020-10-31T22:51:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2020-10-31T22:51:25.356 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_target_full_ratio_micro": 800000, 2020-10-31T22:51:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_flush_age": 0, 2020-10-31T22:51:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "cache_min_evict_age": 0, 2020-10-31T22:51:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profile": "", 2020-10-31T22:51:25.357 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_params": { 2020-10-31T22:51:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "none" 2020-10-31T22:51:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.358 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_period": 0, 2020-10-31T22:51:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_count": 0, 2020-10-31T22:51:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: "use_gmt_hitset": true, 2020-10-31T22:51:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: "min_read_recency_for_promote": 0, 2020-10-31T22:51:25.359 INFO:teuthology.orchestra.run.smithi060.stdout: "min_write_recency_for_promote": 0, 2020-10-31T22:51:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_grade_decay_rate": 0, 2020-10-31T22:51:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: "hit_set_search_last_n": 0, 2020-10-31T22:51:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: "grade_table": [], 2020-10-31T22:51:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: "stripe_width": 0, 2020-10-31T22:51:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: "expected_num_objects": 0, 2020-10-31T22:51:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: "fast_read": false, 2020-10-31T22:51:25.361 INFO:teuthology.orchestra.run.smithi060.stdout: "options": {}, 2020-10-31T22:51:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: "application_metadata": { 2020-10-31T22:51:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: "cephfs": { 2020-10-31T22:51:25.362 INFO:teuthology.orchestra.run.smithi060.stdout: "data": "cephfs" 2020-10-31T22:51:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.363 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:51:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: "osds": [ 2020-10-31T22:51:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.364 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:51:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "f8f5851d-7561-4db8-b0bf-d0ed3e815d67", 2020-10-31T22:51:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:51:25.365 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:51:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:51:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:51:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:51:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:51:25.366 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:51:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 158, 2020-10-31T22:51:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:51:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:51:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:51:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.367 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6802", 2020-10-31T22:51:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:51:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.368 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6803", 2020-10-31T22:51:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:51:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.369 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:51:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.370 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6804", 2020-10-31T22:51:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:51:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.371 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6805", 2020-10-31T22:51:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:51:25.372 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:51:25.373 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6808", 2020-10-31T22:51:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:51:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.374 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6809", 2020-10-31T22:51:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:51:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.375 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:51:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6806", 2020-10-31T22:51:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:51:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.376 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6807", 2020-10-31T22:51:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14302 2020-10-31T22:51:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6803/14302", 2020-10-31T22:51:25.377 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6805/14302", 2020-10-31T22:51:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6809/14302", 2020-10-31T22:51:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6807/14302", 2020-10-31T22:51:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:51:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:51:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:51:25.378 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:51:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "2f4036a9-518b-4d0b-ae4f-489e2ae476d2", 2020-10-31T22:51:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:51:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:51:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:51:25.379 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:51:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:51:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:51:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:51:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 157, 2020-10-31T22:51:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:51:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:51:25.380 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:51:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6810", 2020-10-31T22:51:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:51:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.381 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6811", 2020-10-31T22:51:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:51:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.382 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:51:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6812", 2020-10-31T22:51:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:51:25.383 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6813", 2020-10-31T22:51:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:51:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.384 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:51:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6816", 2020-10-31T22:51:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:51:25.385 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6817", 2020-10-31T22:51:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:51:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.386 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:51:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6814", 2020-10-31T22:51:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:51:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.387 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6815", 2020-10-31T22:51:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14300 2020-10-31T22:51:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.388 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6811/14300", 2020-10-31T22:51:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6813/14300", 2020-10-31T22:51:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6817/14300", 2020-10-31T22:51:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6815/14300", 2020-10-31T22:51:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:51:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:51:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:51:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.389 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:51:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "eb771e2b-981d-4ef8-b2bb-143431fea891", 2020-10-31T22:51:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:51:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:51:25.390 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:51:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:51:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:51:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:51:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:51:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 158, 2020-10-31T22:51:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:51:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:51:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:51:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6826", 2020-10-31T22:51:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:51:25.392 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6827", 2020-10-31T22:51:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:51:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.393 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:51:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6828", 2020-10-31T22:51:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:51:25.394 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6829", 2020-10-31T22:51:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:51:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.395 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:51:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6832", 2020-10-31T22:51:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:51:25.396 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6833", 2020-10-31T22:51:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:51:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.397 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:51:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6830", 2020-10-31T22:51:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:51:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.398 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6831", 2020-10-31T22:51:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14318 2020-10-31T22:51:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.399 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6827/14318", 2020-10-31T22:51:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6829/14318", 2020-10-31T22:51:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6833/14318", 2020-10-31T22:51:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6831/14318", 2020-10-31T22:51:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:51:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:51:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:51:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.400 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:51:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "48292ed1-84ef-42a1-818f-f3541c45b2db", 2020-10-31T22:51:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:51:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:51:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:51:25.401 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:51:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:51:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:51:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:51:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 158, 2020-10-31T22:51:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:51:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:51:25.402 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:51:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6818", 2020-10-31T22:51:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:51:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.403 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6819", 2020-10-31T22:51:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:51:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:51:25.404 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6820", 2020-10-31T22:51:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:51:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.405 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6821", 2020-10-31T22:51:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:51:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:51:25.406 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6824", 2020-10-31T22:51:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:51:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.407 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6825", 2020-10-31T22:51:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:51:25.408 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.409 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:51:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.410 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6822", 2020-10-31T22:51:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:51:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.411 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.412 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.60:6823", 2020-10-31T22:51:25.412 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14301 2020-10-31T22:51:25.412 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.60:6819/14301", 2020-10-31T22:51:25.413 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.60:6821/14301", 2020-10-31T22:51:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.60:6825/14301", 2020-10-31T22:51:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.60:6823/14301", 2020-10-31T22:51:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:51:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:51:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:51:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.414 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:51:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "019bc4f3-4ff6-4aaa-b822-2613e251a63e", 2020-10-31T22:51:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:51:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:51:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:51:25.415 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:51:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:51:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:51:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:51:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 157, 2020-10-31T22:51:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:51:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:51:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:51:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6816", 2020-10-31T22:51:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:51:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.417 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6817", 2020-10-31T22:51:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:51:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:51:25.418 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.419 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.419 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6818", 2020-10-31T22:51:25.419 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:51:25.419 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.419 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.419 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.419 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6819", 2020-10-31T22:51:25.420 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:51:25.420 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.420 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.420 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.420 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:51:25.420 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.420 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.421 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6822", 2020-10-31T22:51:25.421 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:51:25.421 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.421 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.421 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.421 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6823", 2020-10-31T22:51:25.422 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:51:25.422 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.422 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.422 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.422 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:51:25.422 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.422 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.423 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6820", 2020-10-31T22:51:25.423 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:51:25.423 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.423 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.423 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.423 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6821", 2020-10-31T22:51:25.424 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14002 2020-10-31T22:51:25.424 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.424 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.424 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.424 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6817/14002", 2020-10-31T22:51:25.424 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6819/14002", 2020-10-31T22:51:25.424 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6823/14002", 2020-10-31T22:51:25.425 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6821/14002", 2020-10-31T22:51:25.425 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:51:25.425 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:51:25.425 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:51:25.425 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.425 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.425 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.425 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:51:25.426 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "79a0f0a3-769d-454a-8d26-04d8bc544575", 2020-10-31T22:51:25.426 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:51:25.426 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:51:25.426 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:51:25.426 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:51:25.426 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:51:25.426 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:51:25.427 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:51:25.427 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 158, 2020-10-31T22:51:25.427 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:51:25.427 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:51:25.427 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:51:25.427 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.427 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.428 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.428 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6800", 2020-10-31T22:51:25.428 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:51:25.428 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.428 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.428 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.428 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6801", 2020-10-31T22:51:25.428 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:51:25.429 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.429 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.429 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.429 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:51:25.429 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.429 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.429 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6802", 2020-10-31T22:51:25.430 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:51:25.430 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.430 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.430 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.430 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6803", 2020-10-31T22:51:25.430 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:51:25.430 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.431 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.431 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.431 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:51:25.431 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.431 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.431 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.431 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6806", 2020-10-31T22:51:25.432 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:51:25.432 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.432 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.432 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.432 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6807", 2020-10-31T22:51:25.432 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:51:25.432 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.433 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.433 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.433 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:51:25.433 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.433 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.433 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.433 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6804", 2020-10-31T22:51:25.433 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:51:25.434 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.434 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.434 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.434 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6805", 2020-10-31T22:51:25.434 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14001 2020-10-31T22:51:25.434 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.434 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.435 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.435 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6801/14001", 2020-10-31T22:51:25.435 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6803/14001", 2020-10-31T22:51:25.435 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6807/14001", 2020-10-31T22:51:25.435 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6805/14001", 2020-10-31T22:51:25.435 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:51:25.435 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:51:25.436 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:51:25.436 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.436 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.436 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.436 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:51:25.436 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "0fb1e61f-a193-4798-bfaa-8f4e4ad01a12", 2020-10-31T22:51:25.436 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:51:25.436 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:51:25.437 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:51:25.437 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:51:25.437 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:51:25.437 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:51:25.437 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:51:25.437 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 158, 2020-10-31T22:51:25.437 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:51:25.438 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:51:25.438 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:51:25.438 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.438 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.438 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.438 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6808", 2020-10-31T22:51:25.438 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:51:25.438 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.439 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.439 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.439 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6809", 2020-10-31T22:51:25.439 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:51:25.439 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.439 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.439 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:51:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6810", 2020-10-31T22:51:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:51:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.440 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6811", 2020-10-31T22:51:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:51:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.441 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:51:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6814", 2020-10-31T22:51:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:51:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.442 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6815", 2020-10-31T22:51:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:51:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:51:25.443 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6812", 2020-10-31T22:51:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:51:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.444 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6813", 2020-10-31T22:51:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14003 2020-10-31T22:51:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6809/14003", 2020-10-31T22:51:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6811/14003", 2020-10-31T22:51:25.445 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6815/14003", 2020-10-31T22:51:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6813/14003", 2020-10-31T22:51:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:51:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:51:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:51:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.446 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:51:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: "uuid": "1bf0b828-c2b3-4c7a-9b24-914620a369b5", 2020-10-31T22:51:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: "up": 1, 2020-10-31T22:51:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: "in": 1, 2020-10-31T22:51:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: "weight": 1, 2020-10-31T22:51:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_affinity": 1, 2020-10-31T22:51:25.447 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_begin": 0, 2020-10-31T22:51:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: "last_clean_end": 0, 2020-10-31T22:51:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: "up_from": 13, 2020-10-31T22:51:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: "up_thru": 158, 2020-10-31T22:51:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: "down_at": 0, 2020-10-31T22:51:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: "lost_at": 0, 2020-10-31T22:51:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addrs": { 2020-10-31T22:51:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.448 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6824", 2020-10-31T22:51:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:51:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.449 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6825", 2020-10-31T22:51:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:51:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addrs": { 2020-10-31T22:51:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.450 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6826", 2020-10-31T22:51:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:51:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6827", 2020-10-31T22:51:25.451 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:51:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addrs": { 2020-10-31T22:51:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.452 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.453 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6830", 2020-10-31T22:51:25.453 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:51:25.453 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.453 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.453 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.453 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6831", 2020-10-31T22:51:25.453 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:51:25.454 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.454 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.454 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.454 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addrs": { 2020-10-31T22:51:25.454 INFO:teuthology.orchestra.run.smithi060.stdout: "addrvec": [ 2020-10-31T22:51:25.454 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.454 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v2", 2020-10-31T22:51:25.455 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6828", 2020-10-31T22:51:25.455 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:51:25.455 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.455 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.455 INFO:teuthology.orchestra.run.smithi060.stdout: "type": "v1", 2020-10-31T22:51:25.455 INFO:teuthology.orchestra.run.smithi060.stdout: "addr": "172.21.15.66:6829", 2020-10-31T22:51:25.455 INFO:teuthology.orchestra.run.smithi060.stdout: "nonce": 14046 2020-10-31T22:51:25.455 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.456 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.456 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.456 INFO:teuthology.orchestra.run.smithi060.stdout: "public_addr": "172.21.15.66:6825/14046", 2020-10-31T22:51:25.456 INFO:teuthology.orchestra.run.smithi060.stdout: "cluster_addr": "172.21.15.66:6827/14046", 2020-10-31T22:51:25.456 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_back_addr": "172.21.15.66:6831/14046", 2020-10-31T22:51:25.456 INFO:teuthology.orchestra.run.smithi060.stdout: "heartbeat_front_addr": "172.21.15.66:6829/14046", 2020-10-31T22:51:25.456 INFO:teuthology.orchestra.run.smithi060.stdout: "state": [ 2020-10-31T22:51:25.457 INFO:teuthology.orchestra.run.smithi060.stdout: "exists", 2020-10-31T22:51:25.457 INFO:teuthology.orchestra.run.smithi060.stdout: "up" 2020-10-31T22:51:25.457 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2020-10-31T22:51:25.457 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.457 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:51:25.457 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_xinfo": [ 2020-10-31T22:51:25.457 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.457 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 0, 2020-10-31T22:51:25.458 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:51:25.458 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:51:25.458 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:51:25.458 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:51:25.458 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:51:25.458 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.314917+0000", 2020-10-31T22:51:25.458 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:51:25.459 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.459 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.459 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 1, 2020-10-31T22:51:25.459 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:51:25.459 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:51:25.459 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:51:25.459 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:51:25.460 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:51:25.460 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.643069+0000", 2020-10-31T22:51:25.460 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:51:25.460 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.460 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.460 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 2, 2020-10-31T22:51:25.460 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:51:25.460 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:51:25.461 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:51:25.461 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:51:25.461 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:51:25.461 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.662572+0000", 2020-10-31T22:51:25.461 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:51:25.461 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.461 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.462 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 3, 2020-10-31T22:51:25.462 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:51:25.462 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:51:25.462 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:51:25.462 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:51:25.462 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:51:25.462 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.664868+0000", 2020-10-31T22:51:25.463 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:51:25.463 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.463 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.463 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 4, 2020-10-31T22:51:25.463 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:51:25.463 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:51:25.463 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:51:25.463 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:51:25.464 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:51:25.464 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551107+0000", 2020-10-31T22:51:25.464 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:51:25.464 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.464 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.464 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 5, 2020-10-31T22:51:25.464 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:51:25.465 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:51:25.465 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:51:25.465 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:51:25.465 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:51:25.465 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.400568+0000", 2020-10-31T22:51:25.465 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:51:25.465 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.465 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.466 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 6, 2020-10-31T22:51:25.466 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:51:25.466 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:51:25.466 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:51:25.466 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:51:25.466 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:51:25.466 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.551173+0000", 2020-10-31T22:51:25.467 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:51:25.467 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.467 INFO:teuthology.orchestra.run.smithi060.stdout: { 2020-10-31T22:51:25.467 INFO:teuthology.orchestra.run.smithi060.stdout: "osd": 7, 2020-10-31T22:51:25.467 INFO:teuthology.orchestra.run.smithi060.stdout: "down_stamp": "0.000000", 2020-10-31T22:51:25.467 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_probability": 0, 2020-10-31T22:51:25.467 INFO:teuthology.orchestra.run.smithi060.stdout: "laggy_interval": 0, 2020-10-31T22:51:25.468 INFO:teuthology.orchestra.run.smithi060.stdout: "features": 4540138292840890367, 2020-10-31T22:51:25.468 INFO:teuthology.orchestra.run.smithi060.stdout: "old_weight": 0, 2020-10-31T22:51:25.468 INFO:teuthology.orchestra.run.smithi060.stdout: "last_purged_snaps_scrub": "2020-10-31T22:40:59.604302+0000", 2020-10-31T22:51:25.468 INFO:teuthology.orchestra.run.smithi060.stdout: "dead_epoch": 0 2020-10-31T22:51:25.468 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.468 INFO:teuthology.orchestra.run.smithi060.stdout: ], 2020-10-31T22:51:25.468 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap": [], 2020-10-31T22:51:25.468 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_upmap_items": [], 2020-10-31T22:51:25.469 INFO:teuthology.orchestra.run.smithi060.stdout: "pg_temp": [], 2020-10-31T22:51:25.469 INFO:teuthology.orchestra.run.smithi060.stdout: "primary_temp": [], 2020-10-31T22:51:25.469 INFO:teuthology.orchestra.run.smithi060.stdout: "blacklist": {}, 2020-10-31T22:51:25.469 INFO:teuthology.orchestra.run.smithi060.stdout: "erasure_code_profiles": { 2020-10-31T22:51:25.469 INFO:teuthology.orchestra.run.smithi060.stdout: "default": { 2020-10-31T22:51:25.469 INFO:teuthology.orchestra.run.smithi060.stdout: "crush-failure-domain": "osd", 2020-10-31T22:51:25.469 INFO:teuthology.orchestra.run.smithi060.stdout: "k": "2", 2020-10-31T22:51:25.470 INFO:teuthology.orchestra.run.smithi060.stdout: "m": "1", 2020-10-31T22:51:25.470 INFO:teuthology.orchestra.run.smithi060.stdout: "plugin": "jerasure", 2020-10-31T22:51:25.470 INFO:teuthology.orchestra.run.smithi060.stdout: "ruleset-failure-domain": "osd", 2020-10-31T22:51:25.470 INFO:teuthology.orchestra.run.smithi060.stdout: "technique": "reed_sol_van" 2020-10-31T22:51:25.470 INFO:teuthology.orchestra.run.smithi060.stdout: } 2020-10-31T22:51:25.470 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2020-10-31T22:51:25.470 INFO:teuthology.orchestra.run.smithi060.stdout: "removed_snaps_queue": [], 2020-10-31T22:51:25.470 INFO:teuthology.orchestra.run.smithi060.stdout: "new_removed_snaps": [], 2020-10-31T22:51:25.471 INFO:teuthology.orchestra.run.smithi060.stdout: "new_purged_snaps": [], 2020-10-31T22:51:25.471 INFO:teuthology.orchestra.run.smithi060.stdout: "crush_node_flags": {}, 2020-10-31T22:51:25.471 INFO:teuthology.orchestra.run.smithi060.stdout: "device_class_flags": {} 2020-10-31T22:51:25.471 INFO:teuthology.orchestra.run.smithi060.stdout:} 2020-10-31T22:51:25.472 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.273+0000 7fa120f8f700 1 -- 172.21.15.60:0/3215170010 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa100054f10 msgr2=0x7fa1000573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.273+0000 7fa120f8f700 1 --2- 172.21.15.60:0/3215170010 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa100054f10 0x7fa1000573d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 rx=0x7fa10401a000 tx=0x7fa104015000).stop 2020-10-31T22:51:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.273+0000 7fa120f8f700 1 -- 172.21.15.60:0/3215170010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa11c05b960 msgr2=0x7fa11c0ad670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.273+0000 7fa120f8f700 1 --2- 172.21.15.60:0/3215170010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa11c05b960 0x7fa11c0ad670 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 rx=0x7fa10c00c000 tx=0x7fa10c0091a0).stop 2020-10-31T22:51:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.273+0000 7fa120f8f700 1 -- 172.21.15.60:0/3215170010 shutdown_connections 2020-10-31T22:51:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.273+0000 7fa120f8f700 1 --2- 172.21.15.60:0/3215170010 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa11c0b4530 0x7fa11c155d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.473 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.273+0000 7fa120f8f700 1 --2- 172.21.15.60:0/3215170010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa11c05b960 0x7fa11c0ad670 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.273+0000 7fa120f8f700 1 --2- 172.21.15.60:0/3215170010 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa100054f10 0x7fa1000573d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.273+0000 7fa120f8f700 1 --2- 172.21.15.60:0/3215170010 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa11c0a7850 0x7fa11c155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.273+0000 7fa120f8f700 1 -- 172.21.15.60:0/3215170010 >> 172.21.15.60:0/3215170010 conn(0x7fa11c06a260 msgr2=0x7fa11c149ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:25.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.277+0000 7fa120f8f700 1 -- 172.21.15.60:0/3215170010 shutdown_connections 2020-10-31T22:51:25.474 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.277+0000 7fa120f8f700 1 -- 172.21.15.60:0/3215170010 wait complete. 2020-10-31T22:51:25.475 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:51:25.594 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.589+0000 7f4db1c27700 1 Processor -- start 2020-10-31T22:51:25.595 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.589+0000 7f4db1c27700 1 -- start start 2020-10-31T22:51:25.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.589+0000 7f4db1c27700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4dac0afdc0 0x7f4dac13be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.589+0000 7f4db1c27700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4dac13c310 0x7f4dac0aa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.596 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.589+0000 7f4db1c27700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dac1429d0 con 0x7f4dac0a7530 2020-10-31T22:51:25.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.589+0000 7f4db1c27700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac142c70 con 0x7f4dac13c310 2020-10-31T22:51:25.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.589+0000 7f4db1c27700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dac13e8e0 con 0x7f4dac0afdc0 2020-10-31T22:51:25.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1426700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4dac13c310 0x7f4dac0aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1426700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f4dac13c310 0x7f4dac0aa100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50402/0 (socket says 172.21.15.60:50402) 2020-10-31T22:51:25.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1426700 1 -- 172.21.15.60:0/994471484 learned_addr learned my addr 172.21.15.60:0/994471484 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:25.597 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db0c25700 1 --2- 172.21.15.60:0/994471484 >> v2:172.21.15.66:3300/0 conn(0x7f4dac0afdc0 0x7f4dac13be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1426700 1 -- 172.21.15.60:0/994471484 >> v2:172.21.15.66:3300/0 conn(0x7f4dac0afdc0 msgr2=0x7f4dac13be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:25.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1426700 1 --2- 172.21.15.60:0/994471484 >> v2:172.21.15.66:3300/0 conn(0x7f4dac0afdc0 0x7f4dac13be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.599 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1426700 1 -- 172.21.15.60:0/994471484 >> v1:172.21.15.66:6789/0 conn(0x7f4dac0a7530 legacy=0x7f4dac13edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1426700 1 -- 172.21.15.60:0/994471484 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac0abb30 con 0x7f4dac13c310 2020-10-31T22:51:25.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1426700 1 --2- 172.21.15.60:0/994471484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dac13c310 0x7f4dac0aa100 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f4da40032b0 tx=0x7f4da4009270).ready entity=mon.0 client_cookie=907e4f42e7149220 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:25.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4dab7fe700 1 -- 172.21.15.60:0/994471484 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da4009e60 con 0x7f4dac13c310 2020-10-31T22:51:25.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4dab7fe700 1 -- 172.21.15.60:0/994471484 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da400bc00 con 0x7f4dac13c310 2020-10-31T22:51:25.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4dab7fe700 1 -- 172.21.15.60:0/994471484 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4da400bd70 con 0x7f4dac13c310 2020-10-31T22:51:25.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1c27700 1 -- 172.21.15.60:0/994471484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dac13c310 msgr2=0x7f4dac0aa100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.600 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1c27700 1 --2- 172.21.15.60:0/994471484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dac13c310 0x7f4dac0aa100 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 rx=0x7f4da40032b0 tx=0x7f4da4009270).stop 2020-10-31T22:51:25.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1c27700 1 -- 172.21.15.60:0/994471484 shutdown_connections 2020-10-31T22:51:25.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1c27700 1 --2- 172.21.15.60:0/994471484 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dac13c310 0x7f4dac0aa100 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1c27700 1 --2- 172.21.15.60:0/994471484 >> v2:172.21.15.66:3300/0 conn(0x7f4dac0afdc0 0x7f4dac13be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1c27700 1 -- 172.21.15.60:0/994471484 >> 172.21.15.60:0/994471484 conn(0x7f4dac0b3fd0 msgr2=0x7f4dac0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:25.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1c27700 1 -- 172.21.15.60:0/994471484 shutdown_connections 2020-10-31T22:51:25.601 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.593+0000 7f4db1c27700 1 -- 172.21.15.60:0/994471484 wait complete. 2020-10-31T22:51:25.602 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db1c27700 1 Processor -- start 2020-10-31T22:51:25.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db1c27700 1 -- start start 2020-10-31T22:51:25.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db1c27700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dac0afdc0 0x7f4dac0af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db1c27700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dac13c310 0x7f4dac1507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db1c27700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4dac13dd30 0x7f4dac14c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db1c27700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac13e660 con 0x7f4dac0afdc0 2020-10-31T22:51:25.603 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db1c27700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac14fdc0 con 0x7f4dac13c310 2020-10-31T22:51:25.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db1c27700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dac150060 con 0x7f4dac13dd30 2020-10-31T22:51:25.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db0c25700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dac0afdc0 0x7f4dac0af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db0c25700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dac0afdc0 0x7f4dac0af070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50408/0 (socket says 172.21.15.60:50408) 2020-10-31T22:51:25.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db0c25700 1 -- 172.21.15.60:0/3276071365 learned_addr learned my addr 172.21.15.60:0/3276071365 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:25.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db1426700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4dac13dd30 0x7f4dac14c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.604 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4dabfff700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dac13c310 0x7f4dac1507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.605 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db0c25700 1 -- 172.21.15.60:0/3276071365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4dac13dd30 msgr2=0x7f4dac14c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db0c25700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4dac13dd30 0x7f4dac14c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db0c25700 1 -- 172.21.15.60:0/3276071365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dac13c310 msgr2=0x7f4dac1507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db0c25700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dac13c310 0x7f4dac1507a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db0c25700 1 -- 172.21.15.60:0/3276071365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac150300 con 0x7f4dac0afdc0 2020-10-31T22:51:25.606 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4dabfff700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dac13c310 0x7f4dac1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:51:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db0c25700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dac0afdc0 0x7f4dac0af070 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f4d9c00c000 tx=0x7f4d9c006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4da9ffb700 1 -- 172.21.15.60:0/3276071365 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d9c00ca10 con 0x7f4dac0afdc0 2020-10-31T22:51:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4da9ffb700 1 -- 172.21.15.60:0/3276071365 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c00cb70 con 0x7f4dac0afdc0 2020-10-31T22:51:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db1c27700 1 -- 172.21.15.60:0/3276071365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dac13e350 con 0x7f4dac0afdc0 2020-10-31T22:51:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4da9ffb700 1 -- 172.21.15.60:0/3276071365 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d9c0123f0 con 0x7f4dac0afdc0 2020-10-31T22:51:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.597+0000 7f4db1c27700 1 -- 172.21.15.60:0/3276071365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dac0af740 con 0x7f4dac0afdc0 2020-10-31T22:51:25.607 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.601+0000 7f4db1c27700 1 -- 172.21.15.60:0/3276071365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dac150490 con 0x7f4dac0afdc0 2020-10-31T22:51:25.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.601+0000 7f4da9ffb700 1 -- 172.21.15.60:0/3276071365 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f4d9c012550 con 0x7f4dac0afdc0 2020-10-31T22:51:25.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.601+0000 7f4da9ffb700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d90054f90 0x7f4d90057450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.601+0000 7f4da9ffb700 1 -- 172.21.15.60:0/3276071365 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7f4d9c06ddc0 con 0x7f4dac0afdc0 2020-10-31T22:51:25.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.601+0000 7f4dabfff700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d90054f90 0x7f4d90057450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.608 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.601+0000 7f4dabfff700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d90054f90 0x7f4d90057450 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f4d9400b000 tx=0x7f4d94009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:25.613 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.609+0000 7f4da9ffb700 1 -- 172.21.15.60:0/3276071365 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f4d9c044280 con 0x7f4dac0afdc0 2020-10-31T22:51:25.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.793+0000 7f4db1c27700 1 -- 172.21.15.60:0/3276071365 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dac057100 con 0x7f4dac0afdc0 2020-10-31T22:51:25.797 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.793+0000 7f4da9ffb700 1 -- 172.21.15.60:0/3276071365 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+2486 (secure 0 0 0) 0x7f4d9c0478a0 con 0x7f4dac0afdc0 2020-10-31T22:51:25.798 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:25.798 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":81,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/542860877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":542860877},{"type":"v1","addr":"172.21.15.66:6833","nonce":542860877}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79},{"gid":8535,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/480001574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":480001574},{"type":"v1","addr":"172.21.15.60:6835","nonce":480001574}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:51:08.474776+0000","modified":"2020-10-31T22:51:09.477436+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8547},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8547":{"gid":8547,"name":"c","rank":0,"incarnation":80,"state":"up:active","state_seq":3,"addr":"172.21.15.60:6837/364183995","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":364183995},{"type":"v1","addr":"172.21.15.60:6837","nonce":364183995}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-10-31T22:51:25.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.793+0000 7f4db1c27700 1 -- 172.21.15.60:0/3276071365 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d90054f90 msgr2=0x7f4d90057450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.799 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.793+0000 7f4db1c27700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d90054f90 0x7f4d90057450 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 rx=0x7f4d9400b000 tx=0x7f4d94009040).stop 2020-10-31T22:51:25.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.793+0000 7f4db1c27700 1 -- 172.21.15.60:0/3276071365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dac0afdc0 msgr2=0x7f4dac0af070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.793+0000 7f4db1c27700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dac0afdc0 0x7f4dac0af070 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 rx=0x7f4d9c00c000 tx=0x7f4d9c006dc0).stop 2020-10-31T22:51:25.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.793+0000 7f4db1c27700 1 -- 172.21.15.60:0/3276071365 shutdown_connections 2020-10-31T22:51:25.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.793+0000 7f4db1c27700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4dac13dd30 0x7f4dac14c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.793+0000 7f4db1c27700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4dac0afdc0 0x7f4dac0af070 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.793+0000 7f4db1c27700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f4d90054f90 0x7f4d90057450 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.800 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.793+0000 7f4db1c27700 1 --2- 172.21.15.60:0/3276071365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4dac13c310 0x7f4dac1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.793+0000 7f4db1c27700 1 -- 172.21.15.60:0/3276071365 >> 172.21.15.60:0/3276071365 conn(0x7f4dac0b3fd0 msgr2=0x7f4dac13ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:25.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.793+0000 7f4db1c27700 1 -- 172.21.15.60:0/3276071365 shutdown_connections 2020-10-31T22:51:25.801 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.793+0000 7f4db1c27700 1 -- 172.21.15.60:0/3276071365 wait complete. 2020-10-31T22:51:25.801 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 81 2020-10-31T22:51:25.811 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs fail cephfs 2020-10-31T22:51:25.925 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa232935700 1 Processor -- start 2020-10-31T22:51:25.926 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa232935700 1 -- start start 2020-10-31T22:51:25.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa232935700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa22c13ebe0 0x7fa22c142250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa232935700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa22c0af200 0x7fa22c0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.927 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa232935700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22c0abea0 con 0x7fa22c0b1a10 2020-10-31T22:51:25.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa232935700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22c141870 con 0x7fa22c13ebe0 2020-10-31T22:51:25.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa232935700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22c141b10 con 0x7fa22c0af200 2020-10-31T22:51:25.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa231933700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7fa22c0b1a10 0x7fa22c0afc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54552/0 (socket says 172.21.15.60:54552) 2020-10-31T22:51:25.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa231933700 1 -- 172.21.15.60:0/1275277585 learned_addr learned my addr 172.21.15.60:0/1275277585 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:25.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa231132700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa22c13ebe0 0x7fa22c142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa232134700 1 --2- 172.21.15.60:0/1275277585 >> v2:172.21.15.66:3300/0 conn(0x7fa22c0af200 0x7fa22c0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.928 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa230931700 1 -- 172.21.15.60:0/1275277585 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2902987732 0 0) 0x7fa22c0abea0 con 0x7fa22c0b1a10 2020-10-31T22:51:25.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa230931700 1 -- 172.21.15.60:0/1275277585 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa214003230 con 0x7fa22c0b1a10 2020-10-31T22:51:25.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa231132700 1 -- 172.21.15.60:0/1275277585 >> v2:172.21.15.66:3300/0 conn(0x7fa22c0af200 msgr2=0x7fa22c0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:25.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa231132700 1 --2- 172.21.15.60:0/1275277585 >> v2:172.21.15.66:3300/0 conn(0x7fa22c0af200 0x7fa22c0b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa231132700 1 -- 172.21.15.60:0/1275277585 >> v1:172.21.15.60:6789/0 conn(0x7fa22c0b1a10 legacy=0x7fa22c0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa231132700 1 -- 172.21.15.60:0/1275277585 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c141db0 con 0x7fa22c13ebe0 2020-10-31T22:51:25.929 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa232134700 1 --2- 172.21.15.60:0/1275277585 >> v2:172.21.15.66:3300/0 conn(0x7fa22c0af200 0x7fa22c0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:25.930 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa231132700 1 --2- 172.21.15.60:0/1275277585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c13ebe0 0x7fa22c142250 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7fa21c002f30 tx=0x7fa21c006dc0).ready entity=mon.0 client_cookie=a31426a2739bcbf server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:25.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa230931700 1 -- 172.21.15.60:0/1275277585 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa21c0096f0 con 0x7fa22c13ebe0 2020-10-31T22:51:25.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa230931700 1 -- 172.21.15.60:0/1275277585 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c009850 con 0x7fa22c13ebe0 2020-10-31T22:51:25.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa230931700 1 -- 172.21.15.60:0/1275277585 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa21c009bb0 con 0x7fa22c13ebe0 2020-10-31T22:51:25.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa232935700 1 -- 172.21.15.60:0/1275277585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c13ebe0 msgr2=0x7fa22c142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.921+0000 7fa232935700 1 --2- 172.21.15.60:0/1275277585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c13ebe0 0x7fa22c142250 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 rx=0x7fa21c002f30 tx=0x7fa21c006dc0).stop 2020-10-31T22:51:25.931 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232935700 1 -- 172.21.15.60:0/1275277585 shutdown_connections 2020-10-31T22:51:25.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232935700 1 --2- 172.21.15.60:0/1275277585 >> v2:172.21.15.66:3300/0 conn(0x7fa22c0af200 0x7fa22c0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232935700 1 --2- 172.21.15.60:0/1275277585 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c13ebe0 0x7fa22c142250 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232935700 1 -- 172.21.15.60:0/1275277585 >> 172.21.15.60:0/1275277585 conn(0x7fa22c0b5300 msgr2=0x7fa22c0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:25.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232935700 1 -- 172.21.15.60:0/1275277585 shutdown_connections 2020-10-31T22:51:25.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232935700 1 -- 172.21.15.60:0/1275277585 wait complete. 2020-10-31T22:51:25.932 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232935700 1 Processor -- start 2020-10-31T22:51:25.933 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232935700 1 -- start start 2020-10-31T22:51:25.934 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232935700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c0af200 0x7fa22c0aa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232935700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa22c0b1a10 0x7fa22c1401e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232935700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c13ebe0 0x7fa22c14e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232935700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c14d740 con 0x7fa22c13ebe0 2020-10-31T22:51:25.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232935700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c0aac70 con 0x7fa22c0b1a10 2020-10-31T22:51:25.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232935700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c066cc0 con 0x7fa22c0af200 2020-10-31T22:51:25.935 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232134700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c13ebe0 0x7fa22c14e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232134700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c13ebe0 0x7fa22c14e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50426/0 (socket says 172.21.15.60:50426) 2020-10-31T22:51:25.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa232134700 1 -- 172.21.15.60:0/4227100246 learned_addr learned my addr 172.21.15.60:0/4227100246 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:25.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa231933700 1 --2- 172.21.15.60:0/4227100246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c0af200 0x7fa22c0aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.925+0000 7fa231132700 1 --2- 172.21.15.60:0/4227100246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa22c0b1a10 0x7fa22c1401e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa232134700 1 -- 172.21.15.60:0/4227100246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c0af200 msgr2=0x7fa22c0aa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.936 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa232134700 1 --2- 172.21.15.60:0/4227100246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c0af200 0x7fa22c0aa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa232134700 1 -- 172.21.15.60:0/4227100246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa22c0b1a10 msgr2=0x7fa22c1401e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:25.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa232134700 1 --2- 172.21.15.60:0/4227100246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa22c0b1a10 0x7fa22c1401e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:25.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa232134700 1 -- 172.21.15.60:0/4227100246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c14d930 con 0x7fa22c13ebe0 2020-10-31T22:51:25.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa232134700 1 --2- 172.21.15.60:0/4227100246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c13ebe0 0x7fa22c14e070 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7fa22400c000 tx=0x7fa2240091a0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:25.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa21affd700 1 -- 172.21.15.60:0/4227100246 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa22401a470 con 0x7fa22c13ebe0 2020-10-31T22:51:25.937 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa21affd700 1 -- 172.21.15.60:0/4227100246 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22401a5d0 con 0x7fa22c13ebe0 2020-10-31T22:51:25.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa232935700 1 -- 172.21.15.60:0/4227100246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22c14dbd0 con 0x7fa22c13ebe0 2020-10-31T22:51:25.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa21affd700 1 -- 172.21.15.60:0/4227100246 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa22401a930 con 0x7fa22c13ebe0 2020-10-31T22:51:25.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa232935700 1 -- 172.21.15.60:0/4227100246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c14e560 con 0x7fa22c13ebe0 2020-10-31T22:51:25.938 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa232935700 1 -- 172.21.15.60:0/4227100246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22c066ae0 con 0x7fa22c13ebe0 2020-10-31T22:51:25.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa21affd700 1 -- 172.21.15.60:0/4227100246 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa22401aa90 con 0x7fa22c13ebe0 2020-10-31T22:51:25.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa21affd700 1 --2- 172.21.15.60:0/4227100246 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa20c054f10 0x7fa20c0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:25.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa21affd700 1 -- 172.21.15.60:0/4227100246 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 6073+0+0 (secure 0 0 0) 0x7fa224070580 con 0x7fa22c13ebe0 2020-10-31T22:51:25.939 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.929+0000 7fa231933700 1 --2- 172.21.15.60:0/4227100246 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa20c054f10 0x7fa20c0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:25.940 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.933+0000 7fa231933700 1 --2- 172.21.15.60:0/4227100246 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa20c054f10 0x7fa20c0573d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fa22800b000 tx=0x7fa228009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:25.941 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:25.937+0000 7fa21affd700 1 -- 172.21.15.60:0/4227100246 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa224046990 con 0x7fa22c13ebe0 2020-10-31T22:51:26.132 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:26.125+0000 7fa232935700 1 -- 172.21.15.60:0/4227100246 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa22c057100 con 0x7fa22c13ebe0 2020-10-31T22:51:27.048 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:51:27.045+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:51:27.067 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.061+0000 7fa21affd700 1 -- 172.21.15.60:0/4227100246 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v82) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa224049fb0 con 0x7fa22c13ebe0 2020-10-31T22:51:27.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.065+0000 7fa232935700 1 -- 172.21.15.60:0/4227100246 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa20c054f10 msgr2=0x7fa20c0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:27.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.065+0000 7fa232935700 1 --2- 172.21.15.60:0/4227100246 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa20c054f10 0x7fa20c0573d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 rx=0x7fa22800b000 tx=0x7fa228009040).stop 2020-10-31T22:51:27.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.065+0000 7fa232935700 1 -- 172.21.15.60:0/4227100246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c13ebe0 msgr2=0x7fa22c14e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:27.069 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.065+0000 7fa232935700 1 --2- 172.21.15.60:0/4227100246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c13ebe0 0x7fa22c14e070 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 rx=0x7fa22400c000 tx=0x7fa2240091a0).stop 2020-10-31T22:51:27.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.065+0000 7fa232935700 1 -- 172.21.15.60:0/4227100246 shutdown_connections 2020-10-31T22:51:27.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.065+0000 7fa232935700 1 --2- 172.21.15.60:0/4227100246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa22c13ebe0 0x7fa22c14e070 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.065+0000 7fa232935700 1 --2- 172.21.15.60:0/4227100246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa22c0af200 0x7fa22c0aa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.065+0000 7fa232935700 1 --2- 172.21.15.60:0/4227100246 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa20c054f10 0x7fa20c0573d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.065+0000 7fa232935700 1 --2- 172.21.15.60:0/4227100246 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa22c0b1a10 0x7fa22c1401e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.070 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.065+0000 7fa232935700 1 -- 172.21.15.60:0/4227100246 >> 172.21.15.60:0/4227100246 conn(0x7fa22c0b5300 msgr2=0x7fa22c05afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:27.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.065+0000 7fa232935700 1 -- 172.21.15.60:0/4227100246 shutdown_connections 2020-10-31T22:51:27.071 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.065+0000 7fa232935700 1 -- 172.21.15.60:0/4227100246 wait complete. 2020-10-31T22:51:27.071 INFO:teuthology.orchestra.run.smithi060.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2020-10-31T22:51:27.088 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-10-31T22:51:27.090 INFO:tasks.ceph.mds.c.smithi060.stdout:starting mds.c at 2020-10-31T22:51:27.198 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.193+0000 7fa09ad44700 1 Processor -- start 2020-10-31T22:51:27.199 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.193+0000 7fa09ad44700 1 -- start start 2020-10-31T22:51:27.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.193+0000 7fa09ad44700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa0940b52a0 0x7fa0940abe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:27.203 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.193+0000 7fa09ad44700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0940acab0 0x7fa0940ac320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:27.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.193+0000 7fa09ad44700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa09405c440 0x7fa09413ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:27.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.193+0000 7fa09ad44700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0940ae1e0 con 0x7fa0940b52a0 2020-10-31T22:51:27.206 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.193+0000 7fa09ad44700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0940ae480 con 0x7fa09405c440 2020-10-31T22:51:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.193+0000 7fa09ad44700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0940ae720 con 0x7fa0940acab0 2020-10-31T22:51:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.193+0000 7fa098ae0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa0940b52a0 0x7fa0940abe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.193+0000 7fa098ae0700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7fa0940b52a0 0x7fa0940abe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50442/0 (socket says 172.21.15.60:50442) 2020-10-31T22:51:27.207 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.193+0000 7fa098ae0700 1 -- 172.21.15.60:0/2220198466 learned_addr learned my addr 172.21.15.60:0/2220198466 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa093fff700 1 --2- 172.21.15.60:0/2220198466 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0940acab0 0x7fa0940ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa0992e1700 1 --2- 172.21.15.60:0/2220198466 >> v2:172.21.15.66:3300/0 conn(0x7fa09405c440 0x7fa09413ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:27.208 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa098ae0700 1 -- 172.21.15.60:0/2220198466 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0940acab0 msgr2=0x7fa0940ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa098ae0700 1 --2- 172.21.15.60:0/2220198466 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0940acab0 0x7fa0940ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa098ae0700 1 -- 172.21.15.60:0/2220198466 >> v2:172.21.15.66:3300/0 conn(0x7fa09405c440 msgr2=0x7fa09413ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa098ae0700 1 --2- 172.21.15.60:0/2220198466 >> v2:172.21.15.66:3300/0 conn(0x7fa09405c440 0x7fa09413ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.209 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa098ae0700 1 -- 172.21.15.60:0/2220198466 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0940ae9c0 con 0x7fa0940b52a0 2020-10-31T22:51:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa0992e1700 1 --2- 172.21.15.60:0/2220198466 >> v2:172.21.15.66:3300/0 conn(0x7fa09405c440 0x7fa09413ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:51:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa098ae0700 1 --2- 172.21.15.60:0/2220198466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0940b52a0 0x7fa0940abe30 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7fa0840032b0 tx=0x7fa084009270).ready entity=mon.0 client_cookie=8d5ad74ed8720660 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:27.210 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa0937fe700 1 -- 172.21.15.60:0/2220198466 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa084009e60 con 0x7fa0940b52a0 2020-10-31T22:51:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa0937fe700 1 -- 172.21.15.60:0/2220198466 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08400bc00 con 0x7fa0940b52a0 2020-10-31T22:51:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa0937fe700 1 -- 172.21.15.60:0/2220198466 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08400bd70 con 0x7fa0940b52a0 2020-10-31T22:51:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa09ad44700 1 -- 172.21.15.60:0/2220198466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0940b52a0 msgr2=0x7fa0940abe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:27.211 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa09ad44700 1 --2- 172.21.15.60:0/2220198466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0940b52a0 0x7fa0940abe30 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 rx=0x7fa0840032b0 tx=0x7fa084009270).stop 2020-10-31T22:51:27.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa09ad44700 1 -- 172.21.15.60:0/2220198466 shutdown_connections 2020-10-31T22:51:27.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa09ad44700 1 --2- 172.21.15.60:0/2220198466 >> v2:172.21.15.66:3300/0 conn(0x7fa09405c440 0x7fa09413ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.212 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa09ad44700 1 --2- 172.21.15.60:0/2220198466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0940b52a0 0x7fa0940abe30 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa09ad44700 1 --2- 172.21.15.60:0/2220198466 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0940acab0 0x7fa0940ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa09ad44700 1 -- 172.21.15.60:0/2220198466 >> 172.21.15.60:0/2220198466 conn(0x7fa094060c10 msgr2=0x7fa0940b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:27.213 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa09ad44700 1 -- 172.21.15.60:0/2220198466 shutdown_connections 2020-10-31T22:51:27.214 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.197+0000 7fa09ad44700 1 -- 172.21.15.60:0/2220198466 wait complete. 2020-10-31T22:51:27.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa09ad44700 1 Processor -- start 2020-10-31T22:51:27.218 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa09ad44700 1 -- start start 2020-10-31T22:51:27.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa09ad44700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa09405c440 0x7fa094066af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:27.219 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa09ad44700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0940acab0 0x7fa09414dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:27.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa09ad44700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0940b52a0 0x7fa09414e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:27.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa09ad44700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0940642c0 con 0x7fa0940b52a0 2020-10-31T22:51:27.220 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa09ad44700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa09405c0f0 con 0x7fa09405c440 2020-10-31T22:51:27.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa09ad44700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0940aa570 con 0x7fa0940acab0 2020-10-31T22:51:27.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa0992e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0940b52a0 0x7fa09414e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:27.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa0992e1700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0940b52a0 0x7fa09414e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50452/0 (socket says 172.21.15.60:50452) 2020-10-31T22:51:27.221 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa0992e1700 1 -- 172.21.15.60:0/3613775400 learned_addr learned my addr 172.21.15.60:0/3613775400 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:27.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa098ae0700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa09405c440 0x7fa094066af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:27.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa093fff700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0940acab0 0x7fa09414dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:27.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa0992e1700 1 -- 172.21.15.60:0/3613775400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0940acab0 msgr2=0x7fa09414dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:27.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa0992e1700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0940acab0 0x7fa09414dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa0992e1700 1 -- 172.21.15.60:0/3613775400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa09405c440 msgr2=0x7fa094066af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:27.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa0992e1700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa09405c440 0x7fa094066af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa0992e1700 1 -- 172.21.15.60:0/3613775400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa094063340 con 0x7fa0940b52a0 2020-10-31T22:51:27.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa093fff700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0940acab0 0x7fa09414dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-10-31T22:51:27.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.201+0000 7fa0992e1700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0940b52a0 0x7fa09414e1a0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7fa08c006910 tx=0x7fa08c008040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:27.224 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.205+0000 7fa091ffb700 1 -- 172.21.15.60:0/3613775400 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08c011780 con 0x7fa0940b52a0 2020-10-31T22:51:27.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.205+0000 7fa091ffb700 1 -- 172.21.15.60:0/3613775400 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08c0118e0 con 0x7fa0940b52a0 2020-10-31T22:51:27.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.205+0000 7fa09ad44700 1 -- 172.21.15.60:0/3613775400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0940635e0 con 0x7fa0940b52a0 2020-10-31T22:51:27.225 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.205+0000 7fa091ffb700 1 -- 172.21.15.60:0/3613775400 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa08c011c40 con 0x7fa0940b52a0 2020-10-31T22:51:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.205+0000 7fa09ad44700 1 -- 172.21.15.60:0/3613775400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0940ab2b0 con 0x7fa0940b52a0 2020-10-31T22:51:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.205+0000 7fa09ad44700 1 -- 172.21.15.60:0/3613775400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0940ab470 con 0x7fa0940b52a0 2020-10-31T22:51:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.205+0000 7fa091ffb700 1 -- 172.21.15.60:0/3613775400 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fa08c01c460 con 0x7fa0940b52a0 2020-10-31T22:51:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.205+0000 7fa091ffb700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa078057230 0x7fa0780596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:27.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.205+0000 7fa091ffb700 1 -- 172.21.15.60:0/3613775400 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6159+0+0 (secure 0 0 0) 0x7fa08c06deb0 con 0x7fa0940b52a0 2020-10-31T22:51:27.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.205+0000 7fa098ae0700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa078057230 0x7fa0780596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:27.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.205+0000 7fa098ae0700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa078057230 0x7fa0780596f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fa08401b000 tx=0x7fa084016000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:27.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.213+0000 7fa091ffb700 1 -- 172.21.15.60:0/3613775400 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fa08c044280 con 0x7fa0940b52a0 2020-10-31T22:51:27.404 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.401+0000 7fa09ad44700 1 -- 172.21.15.60:0/3613775400 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa094057100 con 0x7fa0940b52a0 2020-10-31T22:51:27.406 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.401+0000 7fa091ffb700 1 -- 172.21.15.60:0/3613775400 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) v1 ==== 94+0+2129 (secure 0 0 0) 0x7fa08c0478a0 con 0x7fa0940b52a0 2020-10-31T22:51:27.406 INFO:teuthology.orchestra.run.smithi060.stdout: 2020-10-31T22:51:27.406 INFO:teuthology.orchestra.run.smithi060.stdout:{"epoch":82,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":7298,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/542860877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":542860877},{"type":"v1","addr":"172.21.15.66:6833","nonce":542860877}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79},{"gid":8535,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/480001574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":480001574},{"type":"v1","addr":"172.21.15.60:6835","nonce":480001574}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":79}],"filesystems":[{"mdsmap":{"epoch":82,"flags":19,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-10-31T22:51:08.474776+0000","modified":"2020-10-31T22:51:27.048354+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":161,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[30],"metadata_pool":29,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2020-10-31T22:51:27.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.405+0000 7fa09ad44700 1 -- 172.21.15.60:0/3613775400 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa078057230 msgr2=0x7fa0780596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:27.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.405+0000 7fa09ad44700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa078057230 0x7fa0780596f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 rx=0x7fa08401b000 tx=0x7fa084016000).stop 2020-10-31T22:51:27.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.405+0000 7fa09ad44700 1 -- 172.21.15.60:0/3613775400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0940b52a0 msgr2=0x7fa09414e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:27.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.405+0000 7fa09ad44700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0940b52a0 0x7fa09414e1a0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 rx=0x7fa08c006910 tx=0x7fa08c008040).stop 2020-10-31T22:51:27.409 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.405+0000 7fa09ad44700 1 -- 172.21.15.60:0/3613775400 shutdown_connections 2020-10-31T22:51:27.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.405+0000 7fa09ad44700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0940b52a0 0x7fa09414e1a0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.405+0000 7fa09ad44700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7fa078057230 0x7fa0780596f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.405+0000 7fa09ad44700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa09405c440 0x7fa094066af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.405+0000 7fa09ad44700 1 --2- 172.21.15.60:0/3613775400 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa0940acab0 0x7fa09414dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.405+0000 7fa09ad44700 1 -- 172.21.15.60:0/3613775400 >> 172.21.15.60:0/3613775400 conn(0x7fa094060c10 msgr2=0x7fa0940b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:27.410 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.405+0000 7fa09ad44700 1 -- 172.21.15.60:0/3613775400 shutdown_connections 2020-10-31T22:51:27.411 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.405+0000 7fa09ad44700 1 -- 172.21.15.60:0/3613775400 wait complete. 2020-10-31T22:51:27.411 INFO:teuthology.orchestra.run.smithi060.stderr:dumped fsmap epoch 82 2020-10-31T22:51:27.425 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs rm cephfs --yes-i-really-mean-it 2020-10-31T22:51:27.543 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.537+0000 7f626160b700 1 Processor -- start 2020-10-31T22:51:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.537+0000 7f626160b700 1 -- start start 2020-10-31T22:51:27.544 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f625c0a7580 0x7f625c1423b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:27.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f625c0ae970 0x7f625c1428a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:27.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625c0ac3f0 con 0x7f625c0ac010 2020-10-31T22:51:27.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c145e50 con 0x7f625c0a7580 2020-10-31T22:51:27.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c065e50 con 0x7f625c0ae970 2020-10-31T22:51:27.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f625b7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f625c0a7580 0x7f625c1423b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:27.545 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f625b7fe700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f625c0a7580 0x7f625c1423b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50460/0 (socket says 172.21.15.60:50460) 2020-10-31T22:51:27.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f625b7fe700 1 -- 172.21.15.60:0/1372952345 learned_addr learned my addr 172.21.15.60:0/1372952345 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:27.546 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f6260e0a700 1 --2- 172.21.15.60:0/1372952345 >> v2:172.21.15.66:3300/0 conn(0x7f625c0ae970 0x7f625c1428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:27.547 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f625b7fe700 1 -- 172.21.15.60:0/1372952345 >> v2:172.21.15.66:3300/0 conn(0x7f625c0ae970 msgr2=0x7f625c1428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:27.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f625b7fe700 1 --2- 172.21.15.60:0/1372952345 >> v2:172.21.15.66:3300/0 conn(0x7f625c0ae970 0x7f625c1428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f625b7fe700 1 -- 172.21.15.60:0/1372952345 >> v1:172.21.15.66:6789/0 conn(0x7f625c0ac010 legacy=0x7f625c0662f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:27.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f625b7fe700 1 -- 172.21.15.60:0/1372952345 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c145b50 con 0x7f625c0a7580 2020-10-31T22:51:27.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f625b7fe700 1 --2- 172.21.15.60:0/1372952345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f625c0a7580 0x7f625c1423b0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f625c0ae670 tx=0x7f624c009270).ready entity=mon.0 client_cookie=87734750a4d32540 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:27.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f625affd700 1 -- 172.21.15.60:0/1372952345 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f624c009e60 con 0x7f625c0a7580 2020-10-31T22:51:27.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f625affd700 1 -- 172.21.15.60:0/1372952345 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c00bbc0 con 0x7f625c0a7580 2020-10-31T22:51:27.548 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f625affd700 1 -- 172.21.15.60:0/1372952345 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f624c00bd30 con 0x7f625c0a7580 2020-10-31T22:51:27.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 -- 172.21.15.60:0/1372952345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f625c0a7580 msgr2=0x7f625c1423b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:27.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 --2- 172.21.15.60:0/1372952345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f625c0a7580 0x7f625c1423b0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 rx=0x7f625c0ae670 tx=0x7f624c009270).stop 2020-10-31T22:51:27.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 -- 172.21.15.60:0/1372952345 shutdown_connections 2020-10-31T22:51:27.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 --2- 172.21.15.60:0/1372952345 >> v2:172.21.15.66:3300/0 conn(0x7f625c0ae970 0x7f625c1428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 --2- 172.21.15.60:0/1372952345 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f625c0a7580 0x7f625c1423b0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 -- 172.21.15.60:0/1372952345 >> 172.21.15.60:0/1372952345 conn(0x7f625c0b3fd0 msgr2=0x7f625c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:27.549 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 -- 172.21.15.60:0/1372952345 shutdown_connections 2020-10-31T22:51:27.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 -- 172.21.15.60:0/1372952345 wait complete. 2020-10-31T22:51:27.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 Processor -- start 2020-10-31T22:51:27.550 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.541+0000 7f626160b700 1 -- start start 2020-10-31T22:51:27.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f626160b700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f625c0a7580 0x7f625c0aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:27.551 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f626160b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f625c0ac010 0x7f625c0acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:27.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f626160b700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f625c0ae970 0x7f625c0a7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:27.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f626160b700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c151560 con 0x7f625c0ae970 2020-10-31T22:51:27.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f626160b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c151800 con 0x7f625c0ac010 2020-10-31T22:51:27.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f626160b700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c0aa1b0 con 0x7f625c0a7580 2020-10-31T22:51:27.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f6260e0a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f625c0ae970 0x7f625c0a7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:27.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f6260e0a700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f625c0ae970 0x7f625c0a7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50466/0 (socket says 172.21.15.60:50466) 2020-10-31T22:51:27.552 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f6260e0a700 1 -- 172.21.15.60:0/3726604509 learned_addr learned my addr 172.21.15.60:0/3726604509 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:27.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f625bfff700 1 --2- 172.21.15.60:0/3726604509 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f625c0a7580 0x7f625c0aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:27.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f625b7fe700 1 --2- 172.21.15.60:0/3726604509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f625c0ac010 0x7f625c0acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:27.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f6260e0a700 1 -- 172.21.15.60:0/3726604509 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f625c0a7580 msgr2=0x7f625c0aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:27.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f6260e0a700 1 --2- 172.21.15.60:0/3726604509 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f625c0a7580 0x7f625c0aa8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f6260e0a700 1 -- 172.21.15.60:0/3726604509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f625c0ac010 msgr2=0x7f625c0acf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:27.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f6260e0a700 1 --2- 172.21.15.60:0/3726604509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f625c0ac010 0x7f625c0acf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:27.553 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f6260e0a700 1 -- 172.21.15.60:0/3726604509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c0aa450 con 0x7f625c0ae970 2020-10-31T22:51:27.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f6260e0a700 1 --2- 172.21.15.60:0/3726604509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f625c0ae970 0x7f625c0a7de0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f625400c000 tx=0x7f6254006dc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:27.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f62597fa700 1 -- 172.21.15.60:0/3726604509 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f625400ca10 con 0x7f625c0ae970 2020-10-31T22:51:27.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f626160b700 1 -- 172.21.15.60:0/3726604509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625c13d270 con 0x7f625c0ae970 2020-10-31T22:51:27.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f62597fa700 1 -- 172.21.15.60:0/3726604509 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625400cb70 con 0x7f625c0ae970 2020-10-31T22:51:27.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f62597fa700 1 -- 172.21.15.60:0/3726604509 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62540123f0 con 0x7f625c0ae970 2020-10-31T22:51:27.554 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f626160b700 1 -- 172.21.15.60:0/3726604509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625c0ad410 con 0x7f625c0ae970 2020-10-31T22:51:27.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.545+0000 7f626160b700 1 -- 172.21.15.60:0/3726604509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c13d400 con 0x7f625c0ae970 2020-10-31T22:51:27.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.549+0000 7f62597fa700 1 -- 172.21.15.60:0/3726604509 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f6254012550 con 0x7f625c0ae970 2020-10-31T22:51:27.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.549+0000 7f62597fa700 1 --2- 172.21.15.60:0/3726604509 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6240055020 0x7f62400574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:27.555 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.549+0000 7f62597fa700 1 -- 172.21.15.60:0/3726604509 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f625406df90 con 0x7f625c0ae970 2020-10-31T22:51:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.549+0000 7f625bfff700 1 --2- 172.21.15.60:0/3726604509 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6240055020 0x7f62400574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:27.556 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.549+0000 7f625bfff700 1 --2- 172.21.15.60:0/3726604509 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6240055020 0x7f62400574e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f624400d000 tx=0x7f6244009040).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:27.561 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.557+0000 7f62597fa700 1 -- 172.21.15.60:0/3726604509 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f6254044360 con 0x7f625c0ae970 2020-10-31T22:51:27.747 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:27.741+0000 7f626160b700 1 -- 172.21.15.60:0/3726604509 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f625c057100 con 0x7f625c0ae970 2020-10-31T22:51:28.076 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.069+0000 7f62597fa700 1 -- 172.21.15.60:0/3726604509 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v83) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6254047980 con 0x7f625c0ae970 2020-10-31T22:51:28.082 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.073+0000 7f626160b700 1 -- 172.21.15.60:0/3726604509 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6240055020 msgr2=0x7f62400574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.073+0000 7f626160b700 1 --2- 172.21.15.60:0/3726604509 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6240055020 0x7f62400574e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 rx=0x7f624400d000 tx=0x7f6244009040).stop 2020-10-31T22:51:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.073+0000 7f626160b700 1 -- 172.21.15.60:0/3726604509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f625c0ae970 msgr2=0x7f625c0a7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.073+0000 7f626160b700 1 --2- 172.21.15.60:0/3726604509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f625c0ae970 0x7f625c0a7de0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 rx=0x7f625400c000 tx=0x7f6254006dc0).stop 2020-10-31T22:51:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.073+0000 7f626160b700 1 -- 172.21.15.60:0/3726604509 shutdown_connections 2020-10-31T22:51:28.083 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.073+0000 7f626160b700 1 --2- 172.21.15.60:0/3726604509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f625c0ae970 0x7f625c0a7de0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:28.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.073+0000 7f626160b700 1 --2- 172.21.15.60:0/3726604509 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f625c0a7580 0x7f625c0aa8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:28.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.073+0000 7f626160b700 1 --2- 172.21.15.60:0/3726604509 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f6240055020 0x7f62400574e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:28.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.073+0000 7f626160b700 1 --2- 172.21.15.60:0/3726604509 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f625c0ac010 0x7f625c0acf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:28.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.073+0000 7f626160b700 1 -- 172.21.15.60:0/3726604509 >> 172.21.15.60:0/3726604509 conn(0x7f625c0b3fd0 msgr2=0x7f625c0b43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:28.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.073+0000 7f626160b700 1 -- 172.21.15.60:0/3726604509 shutdown_connections 2020-10-31T22:51:28.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.073+0000 7f626160b700 1 -- 172.21.15.60:0/3726604509 wait complete. 2020-10-31T22:51:28.095 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2020-10-31T22:51:28.222 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a2c06d700 1 Processor -- start 2020-10-31T22:51:28.223 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a2c06d700 1 -- start start 2020-10-31T22:51:28.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a2c06d700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8a24065f70 0x7f8a240b5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:28.226 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a2c06d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8a240b2e20 0x7f8a24142610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:28.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a2c06d700 1 -- --> v1:172.21.15.60:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a24066410 con 0x7f8a2405c660 2020-10-31T22:51:28.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a2c06d700 1 -- --> v2:172.21.15.60:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a24066d60 con 0x7f8a24065f70 2020-10-31T22:51:28.227 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a2c06d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a240b5e80 con 0x7f8a240b2e20 2020-10-31T22:51:28.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a29608700 1 --2- >> v2:172.21.15.60:3300/0 conn(0x7f8a24065f70 0x7f8a240b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:28.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a29e09700 1 --1- >> v1:172.21.15.60:6789/0 conn(0x7f8a2405c660 0x7f8a2413f390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.60:6789/0 says I am v1:172.21.15.60:54606/0 (socket says 172.21.15.60:54606) 2020-10-31T22:51:28.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a29e09700 1 -- 172.21.15.60:0/499620119 learned_addr learned my addr 172.21.15.60:0/499620119 (peer_addr_for_me v1:172.21.15.60:0/0) 2020-10-31T22:51:28.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a2a60a700 1 --2- 172.21.15.60:0/499620119 >> v2:172.21.15.66:3300/0 conn(0x7f8a240b2e20 0x7f8a24142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a28e07700 1 -- 172.21.15.60:0/499620119 <== mon.0 v1:172.21.15.60:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 102326222 0 0) 0x7f8a24066410 con 0x7f8a2405c660 2020-10-31T22:51:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a28e07700 1 -- 172.21.15.60:0/499620119 --> v1:172.21.15.60:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a0c003230 con 0x7f8a2405c660 2020-10-31T22:51:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a29608700 1 -- 172.21.15.60:0/499620119 >> v2:172.21.15.66:3300/0 conn(0x7f8a240b2e20 msgr2=0x7f8a24142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:28.229 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a29608700 1 --2- 172.21.15.60:0/499620119 >> v2:172.21.15.66:3300/0 conn(0x7f8a240b2e20 0x7f8a24142610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a29608700 1 -- 172.21.15.60:0/499620119 >> v1:172.21.15.60:6789/0 conn(0x7f8a2405c660 legacy=0x7f8a2413f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a29608700 1 -- 172.21.15.60:0/499620119 --> v2:172.21.15.60:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a240666b0 con 0x7f8a24065f70 2020-10-31T22:51:28.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.217+0000 7f8a29608700 1 --2- 172.21.15.60:0/499620119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a24065f70 0x7f8a240b5990 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f8a14002f30 tx=0x7f8a14006dc0).ready entity=mon.0 client_cookie=595d44a00f151883 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.221+0000 7f8a28e07700 1 -- 172.21.15.60:0/499620119 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a140096f0 con 0x7f8a24065f70 2020-10-31T22:51:28.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.221+0000 7f8a28e07700 1 -- 172.21.15.60:0/499620119 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a14009850 con 0x7f8a24065f70 2020-10-31T22:51:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.221+0000 7f8a28e07700 1 -- 172.21.15.60:0/499620119 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a14009bb0 con 0x7f8a24065f70 2020-10-31T22:51:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.221+0000 7f8a2c06d700 1 -- 172.21.15.60:0/499620119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a24065f70 msgr2=0x7f8a240b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:28.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.221+0000 7f8a2c06d700 1 --2- 172.21.15.60:0/499620119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a24065f70 0x7f8a240b5990 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 rx=0x7f8a14002f30 tx=0x7f8a14006dc0).stop 2020-10-31T22:51:28.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.221+0000 7f8a2c06d700 1 -- 172.21.15.60:0/499620119 shutdown_connections 2020-10-31T22:51:28.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.221+0000 7f8a2c06d700 1 --2- 172.21.15.60:0/499620119 >> v2:172.21.15.66:3300/0 conn(0x7f8a240b2e20 0x7f8a24142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:28.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.221+0000 7f8a2c06d700 1 --2- 172.21.15.60:0/499620119 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a24065f70 0x7f8a240b5990 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:28.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.221+0000 7f8a2c06d700 1 -- 172.21.15.60:0/499620119 >> 172.21.15.60:0/499620119 conn(0x7f8a240601e0 msgr2=0x7f8a2405b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:28.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.221+0000 7f8a2c06d700 1 -- 172.21.15.60:0/499620119 shutdown_connections 2020-10-31T22:51:28.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.221+0000 7f8a2c06d700 1 -- 172.21.15.60:0/499620119 wait complete. 2020-10-31T22:51:28.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.221+0000 7f8a2c06d700 1 Processor -- start 2020-10-31T22:51:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.221+0000 7f8a2c06d700 1 -- start start 2020-10-31T22:51:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a2c06d700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2405c660 0x7f8a240aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:28.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a2c06d700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a24065f70 0x7f8a240aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a2c06d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a240b2e20 0x7f8a240acf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a2c06d700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a240a9c70 con 0x7f8a24065f70 2020-10-31T22:51:28.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a2c06d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a24151990 con 0x7f8a240b2e20 2020-10-31T22:51:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a2c06d700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a240a97d0 con 0x7f8a2405c660 2020-10-31T22:51:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a29608700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a24065f70 0x7f8a240aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:28.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a29e09700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2405c660 0x7f8a240aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:28.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a29608700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a24065f70 0x7f8a240aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50478/0 (socket says 172.21.15.60:50478) 2020-10-31T22:51:28.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a29608700 1 -- 172.21.15.60:0/1554517120 learned_addr learned my addr 172.21.15.60:0/1554517120 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:28.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a2a60a700 1 --2- 172.21.15.60:0/1554517120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a240b2e20 0x7f8a240acf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a29e09700 1 -- 172.21.15.60:0/1554517120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a240b2e20 msgr2=0x7f8a240acf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:28.242 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a29e09700 1 --2- 172.21.15.60:0/1554517120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a240b2e20 0x7f8a240acf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a29e09700 1 -- 172.21.15.60:0/1554517120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a24065f70 msgr2=0x7f8a240aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a29e09700 1 --2- 172.21.15.60:0/1554517120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a24065f70 0x7f8a240aef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:28.243 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a29e09700 1 -- 172.21.15.60:0/1554517120 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a24148700 con 0x7f8a2405c660 2020-10-31T22:51:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a29e09700 1 --2- 172.21.15.60:0/1554517120 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2405c660 0x7f8a240aea70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f8a200010d0 tx=0x7f8a20007970).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a12ffd700 1 -- 172.21.15.60:0/1554517120 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a200072e0 con 0x7f8a2405c660 2020-10-31T22:51:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a12ffd700 1 -- 172.21.15.60:0/1554517120 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a20007440 con 0x7f8a2405c660 2020-10-31T22:51:28.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a2c06d700 1 -- 172.21.15.60:0/1554517120 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a241515e0 con 0x7f8a2405c660 2020-10-31T22:51:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a12ffd700 1 -- 172.21.15.60:0/1554517120 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8a200057d0 con 0x7f8a2405c660 2020-10-31T22:51:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.225+0000 7f8a2c06d700 1 -- 172.21.15.60:0/1554517120 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a240a9060 con 0x7f8a2405c660 2020-10-31T22:51:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.229+0000 7f8a2c06d700 1 -- 172.21.15.60:0/1554517120 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a240a99d0 con 0x7f8a2405c660 2020-10-31T22:51:28.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.229+0000 7f8a12ffd700 1 -- 172.21.15.60:0/1554517120 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7f8a2001a060 con 0x7f8a2405c660 2020-10-31T22:51:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.229+0000 7f8a12ffd700 1 --2- 172.21.15.60:0/1554517120 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8a04054f10 0x7f8a040573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.229+0000 7f8a12ffd700 1 -- 172.21.15.60:0/1554517120 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 6159+0+0 (secure 0 0 0) 0x7f8a2006cda0 con 0x7f8a2405c660 2020-10-31T22:51:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.229+0000 7f8a29608700 1 --2- 172.21.15.60:0/1554517120 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8a04054f10 0x7f8a040573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:28.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.229+0000 7f8a29608700 1 --2- 172.21.15.60:0/1554517120 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8a04054f10 0x7f8a040573d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f8a1401b000 tx=0x7f8a14015000).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:28.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.245+0000 7f8a12ffd700 1 -- 172.21.15.60:0/1554517120 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7f8a240a99d0 con 0x7f8a2405c660 2020-10-31T22:51:28.391 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:28.385+0000 7f8a2c06d700 1 -- 172.21.15.60:0/1554517120 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8a240a99d0 con 0x7f8a2405c660 2020-10-31T22:51:29.079 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.073+0000 7f8a12ffd700 1 -- 172.21.15.60:0/1554517120 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v162) v1 ==== 185+0+0 (secure 0 0 0) 0x7f8a240a99d0 con 0x7f8a2405c660 2020-10-31T22:51:29.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.077+0000 7f8a2c06d700 1 -- 172.21.15.60:0/1554517120 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8a04054f10 msgr2=0x7f8a040573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:29.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.077+0000 7f8a2c06d700 1 --2- 172.21.15.60:0/1554517120 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8a04054f10 0x7f8a040573d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 rx=0x7f8a1401b000 tx=0x7f8a14015000).stop 2020-10-31T22:51:29.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.077+0000 7f8a2c06d700 1 -- 172.21.15.60:0/1554517120 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2405c660 msgr2=0x7f8a240aea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:29.084 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.077+0000 7f8a2c06d700 1 --2- 172.21.15.60:0/1554517120 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2405c660 0x7f8a240aea70 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f8a200010d0 tx=0x7f8a20007970).stop 2020-10-31T22:51:29.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.077+0000 7f8a2c06d700 1 -- 172.21.15.60:0/1554517120 shutdown_connections 2020-10-31T22:51:29.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.077+0000 7f8a2c06d700 1 --2- 172.21.15.60:0/1554517120 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7f8a04054f10 0x7f8a040573d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:29.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.077+0000 7f8a2c06d700 1 --2- 172.21.15.60:0/1554517120 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a240b2e20 0x7f8a240acf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:29.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.077+0000 7f8a2c06d700 1 --2- 172.21.15.60:0/1554517120 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2405c660 0x7f8a240aea70 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:29.085 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.077+0000 7f8a2c06d700 1 --2- 172.21.15.60:0/1554517120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a24065f70 0x7f8a240aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:29.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.077+0000 7f8a2c06d700 1 -- 172.21.15.60:0/1554517120 >> 172.21.15.60:0/1554517120 conn(0x7f8a240601e0 msgr2=0x7f8a240b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:29.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.077+0000 7f8a2c06d700 1 -- 172.21.15.60:0/1554517120 shutdown_connections 2020-10-31T22:51:29.086 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.077+0000 7f8a2c06d700 1 -- 172.21.15.60:0/1554517120 wait complete. 2020-10-31T22:51:29.086 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_metadata' removed 2020-10-31T22:51:29.102 INFO:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool delete cephfs_data cephfs_data --yes-i-really-really-mean-it 2020-10-31T22:51:29.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.221+0000 7fad1e402700 1 Processor -- start 2020-10-31T22:51:29.228 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.221+0000 7fad1e402700 1 -- start start 2020-10-31T22:51:29.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad1e402700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad180ac540 0x7fad180aca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:29.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad1e402700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fad180b0ac0 0x7fad1813ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:29.230 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad1e402700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad180ae210 con 0x7fad180b52a0 2020-10-31T22:51:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad1e402700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad180ae4b0 con 0x7fad180b0ac0 2020-10-31T22:51:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad1e402700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad180ae750 con 0x7fad180ac540 2020-10-31T22:51:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad1c99f700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fad180b0ac0 0x7fad1813ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:29.231 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad0ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad180ac540 0x7fad180aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad1c99f700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fad180b0ac0 0x7fad1813ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.60:33192/0 (socket says 172.21.15.60:33192) 2020-10-31T22:51:29.232 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad0ffff700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad180ac540 0x7fad180aca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.60:35442/0 (socket says 172.21.15.60:35442) 2020-10-31T22:51:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad1c99f700 1 -- 172.21.15.60:0/717993927 learned_addr learned my addr 172.21.15.60:0/717993927 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad17fff700 1 --1- 172.21.15.60:0/717993927 >> v1:172.21.15.66:6789/0 conn(0x7fad180b52a0 0x7fad180abe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.60:52488/0 (socket says 172.21.15.60:52488) 2020-10-31T22:51:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad177fe700 1 -- 172.21.15.60:0/717993927 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646067808 0 0) 0x7fad180ae210 con 0x7fad180b52a0 2020-10-31T22:51:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad177fe700 1 -- 172.21.15.60:0/717993927 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf8003230 con 0x7fad180b52a0 2020-10-31T22:51:29.233 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad0ffff700 1 -- 172.21.15.60:0/717993927 >> v2:172.21.15.66:3300/0 conn(0x7fad180b0ac0 msgr2=0x7fad1813ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-10-31T22:51:29.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad0ffff700 1 --2- 172.21.15.60:0/717993927 >> v2:172.21.15.66:3300/0 conn(0x7fad180b0ac0 0x7fad1813ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:29.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad0ffff700 1 -- 172.21.15.60:0/717993927 >> v1:172.21.15.66:6789/0 conn(0x7fad180b52a0 legacy=0x7fad180abe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:29.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad0ffff700 1 -- 172.21.15.60:0/717993927 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad180ae9f0 con 0x7fad180ac540 2020-10-31T22:51:29.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad1c99f700 1 --2- 172.21.15.60:0/717993927 >> v2:172.21.15.66:3300/0 conn(0x7fad180b0ac0 0x7fad1813ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-10-31T22:51:29.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad0ffff700 1 --2- 172.21.15.60:0/717993927 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad180ac540 0x7fad180aca90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fad00002f30 tx=0x7fad00006dc0).ready entity=mon.2 client_cookie=7deb442049e01c4d server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:29.234 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad177fe700 1 -- 172.21.15.60:0/717993927 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad000096a0 con 0x7fad180ac540 2020-10-31T22:51:29.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad177fe700 1 -- 172.21.15.60:0/717993927 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad00009800 con 0x7fad180ac540 2020-10-31T22:51:29.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.225+0000 7fad177fe700 1 -- 172.21.15.60:0/717993927 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad00009b60 con 0x7fad180ac540 2020-10-31T22:51:29.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.229+0000 7fad1e402700 1 -- 172.21.15.60:0/717993927 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad180ac540 msgr2=0x7fad180aca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:29.235 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.229+0000 7fad1e402700 1 --2- 172.21.15.60:0/717993927 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad180ac540 0x7fad180aca90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fad00002f30 tx=0x7fad00006dc0).stop 2020-10-31T22:51:29.237 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.229+0000 7fad1e402700 1 -- 172.21.15.60:0/717993927 shutdown_connections 2020-10-31T22:51:29.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.229+0000 7fad1e402700 1 --2- 172.21.15.60:0/717993927 >> v2:172.21.15.66:3300/0 conn(0x7fad180b0ac0 0x7fad1813ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:29.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.229+0000 7fad1e402700 1 --2- 172.21.15.60:0/717993927 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad180ac540 0x7fad180aca90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:29.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.229+0000 7fad1e402700 1 -- 172.21.15.60:0/717993927 >> 172.21.15.60:0/717993927 conn(0x7fad18060c50 msgr2=0x7fad180b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:29.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.229+0000 7fad1e402700 1 -- 172.21.15.60:0/717993927 shutdown_connections 2020-10-31T22:51:29.238 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.229+0000 7fad1e402700 1 -- 172.21.15.60:0/717993927 wait complete. 2020-10-31T22:51:29.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.229+0000 7fad1e402700 1 Processor -- start 2020-10-31T22:51:29.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.229+0000 7fad1e402700 1 -- start start 2020-10-31T22:51:29.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1e402700 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad180ac540 0x7fad1813df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:29.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1e402700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad180b0ac0 0x7fad180a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:29.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1e402700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad180b52a0 0x7fad1814d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:29.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1e402700 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad180663d0 con 0x7fad180b52a0 2020-10-31T22:51:29.239 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1e402700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1809de90 con 0x7fad180b0ac0 2020-10-31T22:51:29.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1e402700 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1809e130 con 0x7fad180ac540 2020-10-31T22:51:29.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1c99f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad180b52a0 0x7fad1814d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:29.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1c99f700 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad180b52a0 0x7fad1814d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50492/0 (socket says 172.21.15.60:50492) 2020-10-31T22:51:29.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1c99f700 1 -- 172.21.15.60:0/4222892713 learned_addr learned my addr 172.21.15.60:0/4222892713 (peer_addr_for_me v2:172.21.15.60:0/0) 2020-10-31T22:51:29.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad17fff700 1 --2- 172.21.15.60:0/4222892713 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad180ac540 0x7fad1813df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:29.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad0ffff700 1 --2- 172.21.15.60:0/4222892713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad180b0ac0 0x7fad180a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:29.240 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1c99f700 1 -- 172.21.15.60:0/4222892713 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad180ac540 msgr2=0x7fad1813df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:29.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1c99f700 1 --2- 172.21.15.60:0/4222892713 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad180ac540 0x7fad1813df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:29.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1c99f700 1 -- 172.21.15.60:0/4222892713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad180b0ac0 msgr2=0x7fad180a01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:29.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1c99f700 1 --2- 172.21.15.60:0/4222892713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad180b0ac0 0x7fad180a01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:29.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1c99f700 1 -- 172.21.15.60:0/4222892713 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1809e3d0 con 0x7fad180b52a0 2020-10-31T22:51:29.241 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1c99f700 1 --2- 172.21.15.60:0/4222892713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad180b52a0 0x7fad1814d780 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7fad1809f1c0 tx=0x7fad10009270).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:29.244 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad15ffb700 1 -- 172.21.15.60:0/4222892713 <== mon.0 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad1000cb70 con 0x7fad180b52a0 2020-10-31T22:51:29.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad15ffb700 1 -- 172.21.15.60:0/4222892713 <== mon.0 v2:172.21.15.60:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad1000ccd0 con 0x7fad180b52a0 2020-10-31T22:51:29.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1e402700 1 -- 172.21.15.60:0/4222892713 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad1809e670 con 0x7fad180b52a0 2020-10-31T22:51:29.245 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad15ffb700 1 -- 172.21.15.60:0/4222892713 <== mon.0 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad100125e0 con 0x7fad180b52a0 2020-10-31T22:51:29.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1e402700 1 -- 172.21.15.60:0/4222892713 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad18065eb0 con 0x7fad180b52a0 2020-10-31T22:51:29.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad1e402700 1 -- 172.21.15.60:0/4222892713 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad18066190 con 0x7fad180b52a0 2020-10-31T22:51:29.246 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.233+0000 7fad15ffb700 1 -- 172.21.15.60:0/4222892713 <== mon.0 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 4) v1 ==== 66616+0+0 (secure 0 0 0) 0x7fad10022070 con 0x7fad180b52a0 2020-10-31T22:51:29.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.237+0000 7fad15ffb700 1 --2- 172.21.15.60:0/4222892713 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7facfc054f10 0x7facfc0573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-10-31T22:51:29.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.237+0000 7fad15ffb700 1 -- 172.21.15.60:0/4222892713 <== mon.0 v2:172.21.15.60:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5721+0+0 (secure 0 0 0) 0x7fad1006e050 con 0x7fad180b52a0 2020-10-31T22:51:29.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.237+0000 7fad17fff700 1 --2- 172.21.15.60:0/4222892713 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7facfc054f10 0x7facfc0573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-10-31T22:51:29.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.237+0000 7fad17fff700 1 --2- 172.21.15.60:0/4222892713 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7facfc054f10 0x7facfc0573d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fad0800d000 tx=0x7fad08007950).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-10-31T22:51:29.247 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.241+0000 7fad15ffb700 1 -- 172.21.15.60:0/4222892713 <== mon.0 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+134611 (secure 0 0 0) 0x7fad100446d0 con 0x7fad180b52a0 2020-10-31T22:51:29.392 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:29.385+0000 7fad1e402700 1 -- 172.21.15.60:0/4222892713 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fad1809e800 con 0x7fad180b52a0 2020-10-31T22:51:30.090 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:30.085+0000 7fad15ffb700 1 -- 172.21.15.60:0/4222892713 <== mon.0 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v163) v1 ==== 173+0+0 (secure 0 0 0) 0x7fad10016070 con 0x7fad180b52a0 2020-10-31T22:51:30.093 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:30.089+0000 7fad1e402700 1 -- 172.21.15.60:0/4222892713 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7facfc054f10 msgr2=0x7facfc0573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:30.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:30.089+0000 7fad1e402700 1 --2- 172.21.15.60:0/4222892713 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7facfc054f10 0x7facfc0573d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 rx=0x7fad0800d000 tx=0x7fad08007950).stop 2020-10-31T22:51:30.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:30.089+0000 7fad1e402700 1 -- 172.21.15.60:0/4222892713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad180b52a0 msgr2=0x7fad1814d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-10-31T22:51:30.094 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:30.089+0000 7fad1e402700 1 --2- 172.21.15.60:0/4222892713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad180b52a0 0x7fad1814d780 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 rx=0x7fad1809f1c0 tx=0x7fad10009270).stop 2020-10-31T22:51:30.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:30.089+0000 7fad1e402700 1 -- 172.21.15.60:0/4222892713 shutdown_connections 2020-10-31T22:51:30.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:30.089+0000 7fad1e402700 1 --2- 172.21.15.60:0/4222892713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fad180b52a0 0x7fad1814d780 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:30.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:30.089+0000 7fad1e402700 1 --2- 172.21.15.60:0/4222892713 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad180ac540 0x7fad1813df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:30.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:30.089+0000 7fad1e402700 1 --2- 172.21.15.60:0/4222892713 >> [v2:172.21.15.60:6800/14112,v1:172.21.15.60:6801/14112] conn(0x7facfc054f10 0x7facfc0573d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:30.095 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:30.089+0000 7fad1e402700 1 --2- 172.21.15.60:0/4222892713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad180b0ac0 0x7fad180a01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-10-31T22:51:30.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:30.089+0000 7fad1e402700 1 -- 172.21.15.60:0/4222892713 >> 172.21.15.60:0/4222892713 conn(0x7fad18060c50 msgr2=0x7fad18142140 unknown :-1 s=STATE_NONE l=0).mark_down 2020-10-31T22:51:30.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:30.089+0000 7fad1e402700 1 -- 172.21.15.60:0/4222892713 shutdown_connections 2020-10-31T22:51:30.096 INFO:teuthology.orchestra.run.smithi060.stderr:2020-10-31T22:51:30.089+0000 7fad1e402700 1 -- 172.21.15.60:0/4222892713 wait complete. 2020-10-31T22:51:30.096 INFO:teuthology.orchestra.run.smithi060.stderr:pool 'cephfs_data' removed 2020-10-31T22:51:30.108 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2020-10-31T22:51:30.109 INFO:teuthology.orchestra.run.smithi060:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:51:30.124 INFO:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:51:30.139 INFO:teuthology.orchestra.run.smithi085:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:51:30.155 INFO:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2020-10-31T22:51:30.172 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2020-10-31T22:51:30.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:51:30.173 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:51:30.174 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:51:30.225 INFO:tasks.ceph.mon.c.smithi066.stderr:*** Caught signal (Segmentation fault) ** 2020-10-31T22:51:30.225 INFO:tasks.ceph.mon.c.smithi066.stderr: in thread 7f8b2103a700 thread_name:ms_dispatch 2020-10-31T22:51:30.233 INFO:tasks.ceph.mon.c.smithi066.stderr: ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable) 2020-10-31T22:51:30.233 INFO:tasks.ceph.mon.c.smithi066.stderr: 1: (()+0x128a0) [0x7f8b2c66d8a0] 2020-10-31T22:51:30.234 INFO:tasks.ceph.mon.c.smithi066.stderr: 2: (PGMapDigest::get_pool_free_space(OSDMap const&, long) const+0x160) [0x7f8b2db76a90] 2020-10-31T22:51:30.234 INFO:tasks.ceph.mon.c.smithi066.stderr: 3: (PGMapDigest::get_statfs(OSDMap&, boost::optional) const+0xd8) [0x7f8b2db76c08] 2020-10-31T22:51:30.234 INFO:tasks.ceph.mon.c.smithi066.stderr: 4: (MgrStatMonitor::preprocess_statfs(boost::intrusive_ptr)+0x2d3) [0x55c84cf859d3] 2020-10-31T22:51:30.234 INFO:tasks.ceph.mon.c.smithi066.stderr: 5: (MgrStatMonitor::preprocess_query(boost::intrusive_ptr)+0x183) [0x55c84cf85f73] 2020-10-31T22:51:30.234 INFO:tasks.ceph.mon.c.smithi066.stderr: 6: (PaxosService::dispatch(boost::intrusive_ptr)+0x55b) [0x55c84ce7afdb] 2020-10-31T22:51:30.234 INFO:tasks.ceph.mon.c.smithi066.stderr: 7: (Monitor::dispatch_op(boost::intrusive_ptr)+0x8b9) [0x55c84cd80649] 2020-10-31T22:51:30.235 INFO:tasks.ceph.mon.c.smithi066.stderr: 8: (Monitor::_ms_dispatch(Message*)+0x29a) [0x55c84cd817ca] 2020-10-31T22:51:30.235 INFO:tasks.ceph.mon.c.smithi066.stderr: 9: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x55c84cdafe38] 2020-10-31T22:51:30.235 INFO:tasks.ceph.mon.c.smithi066.stderr: 10: (DispatchQueue::entry()+0x11ea) [0x7f8b2d9f260a] 2020-10-31T22:51:30.235 INFO:tasks.ceph.mon.c.smithi066.stderr: 11: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f8b2da9200d] 2020-10-31T22:51:30.235 INFO:tasks.ceph.mon.c.smithi066.stderr: 12: (()+0x76db) [0x7f8b2c6626db] 2020-10-31T22:51:30.235 INFO:tasks.ceph.mon.c.smithi066.stderr: 13: (clone()+0x3f) [0x7f8b2b848a3f] 2020-10-31T22:51:30.235 INFO:tasks.ceph.mon.c.smithi066.stderr:2020-10-31T22:51:30.233+0000 7f8b2103a700 -1 *** Caught signal (Segmentation fault) ** 2020-10-31T22:51:30.236 INFO:tasks.ceph.mon.c.smithi066.stderr: in thread 7f8b2103a700 thread_name:ms_dispatch 2020-10-31T22:51:30.236 INFO:tasks.ceph.mon.c.smithi066.stderr: 2020-10-31T22:51:30.236 INFO:tasks.ceph.mon.c.smithi066.stderr: ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable) 2020-10-31T22:51:30.236 INFO:tasks.ceph.mon.c.smithi066.stderr: 1: (()+0x128a0) [0x7f8b2c66d8a0] 2020-10-31T22:51:30.236 INFO:tasks.ceph.mon.c.smithi066.stderr: 2: (PGMapDigest::get_pool_free_space(OSDMap const&, long) const+0x160) [0x7f8b2db76a90] 2020-10-31T22:51:30.236 INFO:tasks.ceph.mon.c.smithi066.stderr: 3: (PGMapDigest::get_statfs(OSDMap&, boost::optional) const+0xd8) [0x7f8b2db76c08] 2020-10-31T22:51:30.236 INFO:tasks.ceph.mon.c.smithi066.stderr: 4: (MgrStatMonitor::preprocess_statfs(boost::intrusive_ptr)+0x2d3) [0x55c84cf859d3] 2020-10-31T22:51:30.237 INFO:tasks.ceph.mon.c.smithi066.stderr: 5: (MgrStatMonitor::preprocess_query(boost::intrusive_ptr)+0x183) [0x55c84cf85f73] 2020-10-31T22:51:30.237 INFO:tasks.ceph.mon.c.smithi066.stderr: 6: (PaxosService::dispatch(boost::intrusive_ptr)+0x55b) [0x55c84ce7afdb] 2020-10-31T22:51:30.237 INFO:tasks.ceph.mon.c.smithi066.stderr: 7: (Monitor::dispatch_op(boost::intrusive_ptr)+0x8b9) [0x55c84cd80649] 2020-10-31T22:51:30.237 INFO:tasks.ceph.mon.c.smithi066.stderr: 8: (Monitor::_ms_dispatch(Message*)+0x29a) [0x55c84cd817ca] 2020-10-31T22:51:30.237 INFO:tasks.ceph.mon.c.smithi066.stderr: 9: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x55c84cdafe38] 2020-10-31T22:51:30.237 INFO:tasks.ceph.mon.c.smithi066.stderr: 10: (DispatchQueue::entry()+0x11ea) [0x7f8b2d9f260a] 2020-10-31T22:51:30.237 INFO:tasks.ceph.mon.c.smithi066.stderr: 11: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f8b2da9200d] 2020-10-31T22:51:30.238 INFO:tasks.ceph.mon.c.smithi066.stderr: 12: (()+0x76db) [0x7f8b2c6626db] 2020-10-31T22:51:30.238 INFO:tasks.ceph.mon.c.smithi066.stderr: 13: (clone()+0x3f) [0x7f8b2b848a3f] 2020-10-31T22:51:30.238 INFO:tasks.ceph.mon.c.smithi066.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-10-31T22:51:30.238 INFO:tasks.ceph.mon.c.smithi066.stderr: 2020-10-31T22:51:30.247 INFO:tasks.ceph.mon.c.smithi066.stderr: 0> 2020-10-31T22:51:30.233+0000 7f8b2103a700 -1 *** Caught signal (Segmentation fault) ** 2020-10-31T22:51:30.247 INFO:tasks.ceph.mon.c.smithi066.stderr: in thread 7f8b2103a700 thread_name:ms_dispatch 2020-10-31T22:51:30.247 INFO:tasks.ceph.mon.c.smithi066.stderr: 2020-10-31T22:51:30.248 INFO:tasks.ceph.mon.c.smithi066.stderr: ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable) 2020-10-31T22:51:30.248 INFO:tasks.ceph.mon.c.smithi066.stderr: 1: (()+0x128a0) [0x7f8b2c66d8a0] 2020-10-31T22:51:30.248 INFO:tasks.ceph.mon.c.smithi066.stderr: 2: (PGMapDigest::get_pool_free_space(OSDMap const&, long) const+0x160) [0x7f8b2db76a90] 2020-10-31T22:51:30.248 INFO:tasks.ceph.mon.c.smithi066.stderr: 3: (PGMapDigest::get_statfs(OSDMap&, boost::optional) const+0xd8) [0x7f8b2db76c08] 2020-10-31T22:51:30.248 INFO:tasks.ceph.mon.c.smithi066.stderr: 4: (MgrStatMonitor::preprocess_statfs(boost::intrusive_ptr)+0x2d3) [0x55c84cf859d3] 2020-10-31T22:51:30.248 INFO:tasks.ceph.mon.c.smithi066.stderr: 5: (MgrStatMonitor::preprocess_query(boost::intrusive_ptr)+0x183) [0x55c84cf85f73] 2020-10-31T22:51:30.248 INFO:tasks.ceph.mon.c.smithi066.stderr: 6: (PaxosService::dispatch(boost::intrusive_ptr)+0x55b) [0x55c84ce7afdb] 2020-10-31T22:51:30.249 INFO:tasks.ceph.mon.c.smithi066.stderr: 7: (Monitor::dispatch_op(boost::intrusive_ptr)+0x8b9) [0x55c84cd80649] 2020-10-31T22:51:30.249 INFO:tasks.ceph.mon.c.smithi066.stderr: 8: (Monitor::_ms_dispatch(Message*)+0x29a) [0x55c84cd817ca] 2020-10-31T22:51:30.249 INFO:tasks.ceph.mon.c.smithi066.stderr: 9: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x55c84cdafe38] 2020-10-31T22:51:30.249 INFO:tasks.ceph.mon.c.smithi066.stderr: 10: (DispatchQueue::entry()+0x11ea) [0x7f8b2d9f260a] 2020-10-31T22:51:30.249 INFO:tasks.ceph.mon.c.smithi066.stderr: 11: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f8b2da9200d] 2020-10-31T22:51:30.249 INFO:tasks.ceph.mon.c.smithi066.stderr: 12: (()+0x76db) [0x7f8b2c6626db] 2020-10-31T22:51:30.249 INFO:tasks.ceph.mon.c.smithi066.stderr: 13: (clone()+0x3f) [0x7f8b2b848a3f] 2020-10-31T22:51:30.250 INFO:tasks.ceph.mon.c.smithi066.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-10-31T22:51:30.250 INFO:tasks.ceph.mon.c.smithi066.stderr: 2020-10-31T22:51:30.259 INFO:tasks.ceph.mon.c.smithi066.stderr: 0> 2020-10-31T22:51:30.233+0000 7f8b2103a700 -1 *** Caught signal (Segmentation fault) ** 2020-10-31T22:51:30.260 INFO:tasks.ceph.mon.c.smithi066.stderr: in thread 7f8b2103a700 thread_name:ms_dispatch 2020-10-31T22:51:30.260 INFO:tasks.ceph.mon.c.smithi066.stderr: 2020-10-31T22:51:30.260 INFO:tasks.ceph.mon.c.smithi066.stderr: ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable) 2020-10-31T22:51:30.260 INFO:tasks.ceph.mon.c.smithi066.stderr: 1: (()+0x128a0) [0x7f8b2c66d8a0] 2020-10-31T22:51:30.260 INFO:tasks.ceph.mon.c.smithi066.stderr: 2: (PGMapDigest::get_pool_free_space(OSDMap const&, long) const+0x160) [0x7f8b2db76a90] 2020-10-31T22:51:30.261 INFO:tasks.ceph.mon.c.smithi066.stderr: 3: (PGMapDigest::get_statfs(OSDMap&, boost::optional) const+0xd8) [0x7f8b2db76c08] 2020-10-31T22:51:30.261 INFO:tasks.ceph.mon.c.smithi066.stderr: 4: (MgrStatMonitor::preprocess_statfs(boost::intrusive_ptr)+0x2d3) [0x55c84cf859d3] 2020-10-31T22:51:30.261 INFO:tasks.ceph.mon.c.smithi066.stderr: 5: (MgrStatMonitor::preprocess_query(boost::intrusive_ptr)+0x183) [0x55c84cf85f73] 2020-10-31T22:51:30.261 INFO:tasks.ceph.mon.c.smithi066.stderr: 6: (PaxosService::dispatch(boost::intrusive_ptr)+0x55b) [0x55c84ce7afdb] 2020-10-31T22:51:30.261 INFO:tasks.ceph.mon.c.smithi066.stderr: 7: (Monitor::dispatch_op(boost::intrusive_ptr)+0x8b9) [0x55c84cd80649] 2020-10-31T22:51:30.261 INFO:tasks.ceph.mon.c.smithi066.stderr: 8: (Monitor::_ms_dispatch(Message*)+0x29a) [0x55c84cd817ca] 2020-10-31T22:51:30.262 INFO:tasks.ceph.mon.c.smithi066.stderr: 9: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x55c84cdafe38] 2020-10-31T22:51:30.262 INFO:tasks.ceph.mon.c.smithi066.stderr: 10: (DispatchQueue::entry()+0x11ea) [0x7f8b2d9f260a] 2020-10-31T22:51:30.262 INFO:tasks.ceph.mon.c.smithi066.stderr: 11: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f8b2da9200d] 2020-10-31T22:51:30.262 INFO:tasks.ceph.mon.c.smithi066.stderr: 12: (()+0x76db) [0x7f8b2c6626db] 2020-10-31T22:51:30.262 INFO:tasks.ceph.mon.c.smithi066.stderr: 13: (clone()+0x3f) [0x7f8b2b848a3f] 2020-10-31T22:51:30.262 INFO:tasks.ceph.mon.c.smithi066.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-10-31T22:51:30.262 INFO:tasks.ceph.mon.c.smithi066.stderr: 2020-10-31T22:51:30.308 INFO:tasks.ceph.mon.a.smithi060.stderr:*** Caught signal (Segmentation fault) ** 2020-10-31T22:51:30.308 INFO:tasks.ceph.mon.a.smithi060.stderr: in thread 7f16c922b700 thread_name:ms_dispatch 2020-10-31T22:51:30.316 INFO:tasks.ceph.mon.a.smithi060.stderr: ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable) 2020-10-31T22:51:30.316 INFO:tasks.ceph.mon.a.smithi060.stderr: 1: (()+0x128a0) [0x7f16d485e8a0] 2020-10-31T22:51:30.317 INFO:tasks.ceph.mon.a.smithi060.stderr: 2: (PGMapDigest::get_pool_free_space(OSDMap const&, long) const+0x160) [0x7f16d5d67a90] 2020-10-31T22:51:30.317 INFO:tasks.ceph.mon.a.smithi060.stderr: 3: (PGMapDigest::get_statfs(OSDMap&, boost::optional) const+0xd8) [0x7f16d5d67c08] 2020-10-31T22:51:30.317 INFO:tasks.ceph.mon.a.smithi060.stderr: 4: (MgrStatMonitor::preprocess_statfs(boost::intrusive_ptr)+0x2d3) [0x5630c2cd19d3] 2020-10-31T22:51:30.317 INFO:tasks.ceph.mon.a.smithi060.stderr: 5: (MgrStatMonitor::preprocess_query(boost::intrusive_ptr)+0x183) [0x5630c2cd1f73] 2020-10-31T22:51:30.317 INFO:tasks.ceph.mon.a.smithi060.stderr: 6: (PaxosService::dispatch(boost::intrusive_ptr)+0x55b) [0x5630c2bc6fdb] 2020-10-31T22:51:30.317 INFO:tasks.ceph.mon.a.smithi060.stderr: 7: (Monitor::dispatch_op(boost::intrusive_ptr)+0x8b9) [0x5630c2acc649] 2020-10-31T22:51:30.318 INFO:tasks.ceph.mon.a.smithi060.stderr: 8: (Monitor::_ms_dispatch(Message*)+0x29a) [0x5630c2acd7ca] 2020-10-31T22:51:30.318 INFO:tasks.ceph.mon.a.smithi060.stderr: 9: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x5630c2afbe38] 2020-10-31T22:51:30.318 INFO:tasks.ceph.mon.a.smithi060.stderr: 10: (DispatchQueue::entry()+0x11ea) [0x7f16d5be360a] 2020-10-31T22:51:30.318 INFO:tasks.ceph.mon.a.smithi060.stderr: 11: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f16d5c8300d] 2020-10-31T22:51:30.318 INFO:tasks.ceph.mon.a.smithi060.stderr: 12: (()+0x76db) [0x7f16d48536db] 2020-10-31T22:51:30.318 INFO:tasks.ceph.mon.a.smithi060.stderr: 13: (clone()+0x3f) [0x7f16d3a39a3f] 2020-10-31T22:51:30.319 INFO:tasks.ceph.mon.a.smithi060.stderr:2020-10-31T22:51:30.317+0000 7f16c922b700 -1 *** Caught signal (Segmentation fault) ** 2020-10-31T22:51:30.319 INFO:tasks.ceph.mon.a.smithi060.stderr: in thread 7f16c922b700 thread_name:ms_dispatch 2020-10-31T22:51:30.319 INFO:tasks.ceph.mon.a.smithi060.stderr: 2020-10-31T22:51:30.319 INFO:tasks.ceph.mon.a.smithi060.stderr: ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable) 2020-10-31T22:51:30.320 INFO:tasks.ceph.mon.a.smithi060.stderr: 1: (()+0x128a0) [0x7f16d485e8a0] 2020-10-31T22:51:30.320 INFO:tasks.ceph.mon.a.smithi060.stderr: 2: (PGMapDigest::get_pool_free_space(OSDMap const&, long) const+0x160) [0x7f16d5d67a90] 2020-10-31T22:51:30.320 INFO:tasks.ceph.mon.a.smithi060.stderr: 3: (PGMapDigest::get_statfs(OSDMap&, boost::optional) const+0xd8) [0x7f16d5d67c08] 2020-10-31T22:51:30.320 INFO:tasks.ceph.mon.a.smithi060.stderr: 4: (MgrStatMonitor::preprocess_statfs(boost::intrusive_ptr)+0x2d3) [0x5630c2cd19d3] 2020-10-31T22:51:30.320 INFO:tasks.ceph.mon.a.smithi060.stderr: 5: (MgrStatMonitor::preprocess_query(boost::intrusive_ptr)+0x183) [0x5630c2cd1f73] 2020-10-31T22:51:30.320 INFO:tasks.ceph.mon.a.smithi060.stderr: 6: (PaxosService::dispatch(boost::intrusive_ptr)+0x55b) [0x5630c2bc6fdb] 2020-10-31T22:51:30.320 INFO:tasks.ceph.mon.a.smithi060.stderr: 7: (Monitor::dispatch_op(boost::intrusive_ptr)+0x8b9) [0x5630c2acc649] 2020-10-31T22:51:30.321 INFO:tasks.ceph.mon.a.smithi060.stderr: 8: (Monitor::_ms_dispatch(Message*)+0x29a) [0x5630c2acd7ca] 2020-10-31T22:51:30.321 INFO:tasks.ceph.mon.a.smithi060.stderr: 9: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x5630c2afbe38] 2020-10-31T22:51:30.321 INFO:tasks.ceph.mon.a.smithi060.stderr: 10: (DispatchQueue::entry()+0x11ea) [0x7f16d5be360a] 2020-10-31T22:51:30.321 INFO:tasks.ceph.mon.a.smithi060.stderr: 11: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f16d5c8300d] 2020-10-31T22:51:30.321 INFO:tasks.ceph.mon.a.smithi060.stderr: 12: (()+0x76db) [0x7f16d48536db] 2020-10-31T22:51:30.321 INFO:tasks.ceph.mon.a.smithi060.stderr: 13: (clone()+0x3f) [0x7f16d3a39a3f] 2020-10-31T22:51:30.322 INFO:tasks.ceph.mon.a.smithi060.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-10-31T22:51:30.322 INFO:tasks.ceph.mon.a.smithi060.stderr: 2020-10-31T22:51:30.332 INFO:tasks.ceph.mon.a.smithi060.stderr: -2794> 2020-10-31T22:51:27.045+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:51:30.334 INFO:tasks.ceph.mon.a.smithi060.stderr: 0> 2020-10-31T22:51:30.317+0000 7f16c922b700 -1 *** Caught signal (Segmentation fault) ** 2020-10-31T22:51:30.334 INFO:tasks.ceph.mon.a.smithi060.stderr: in thread 7f16c922b700 thread_name:ms_dispatch 2020-10-31T22:51:30.335 INFO:tasks.ceph.mon.a.smithi060.stderr: 2020-10-31T22:51:30.335 INFO:tasks.ceph.mon.a.smithi060.stderr: ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable) 2020-10-31T22:51:30.335 INFO:tasks.ceph.mon.a.smithi060.stderr: 1: (()+0x128a0) [0x7f16d485e8a0] 2020-10-31T22:51:30.335 INFO:tasks.ceph.mon.a.smithi060.stderr: 2: (PGMapDigest::get_pool_free_space(OSDMap const&, long) const+0x160) [0x7f16d5d67a90] 2020-10-31T22:51:30.335 INFO:tasks.ceph.mon.a.smithi060.stderr: 3: (PGMapDigest::get_statfs(OSDMap&, boost::optional) const+0xd8) [0x7f16d5d67c08] 2020-10-31T22:51:30.335 INFO:tasks.ceph.mon.a.smithi060.stderr: 4: (MgrStatMonitor::preprocess_statfs(boost::intrusive_ptr)+0x2d3) [0x5630c2cd19d3] 2020-10-31T22:51:30.335 INFO:tasks.ceph.mon.a.smithi060.stderr: 5: (MgrStatMonitor::preprocess_query(boost::intrusive_ptr)+0x183) [0x5630c2cd1f73] 2020-10-31T22:51:30.336 INFO:tasks.ceph.mon.a.smithi060.stderr: 6: (PaxosService::dispatch(boost::intrusive_ptr)+0x55b) [0x5630c2bc6fdb] 2020-10-31T22:51:30.336 INFO:tasks.ceph.mon.a.smithi060.stderr: 7: (Monitor::dispatch_op(boost::intrusive_ptr)+0x8b9) [0x5630c2acc649] 2020-10-31T22:51:30.336 INFO:tasks.ceph.mon.a.smithi060.stderr: 8: (Monitor::_ms_dispatch(Message*)+0x29a) [0x5630c2acd7ca] 2020-10-31T22:51:30.336 INFO:tasks.ceph.mon.a.smithi060.stderr: 9: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x5630c2afbe38] 2020-10-31T22:51:30.336 INFO:tasks.ceph.mon.a.smithi060.stderr: 10: (DispatchQueue::entry()+0x11ea) [0x7f16d5be360a] 2020-10-31T22:51:30.336 INFO:tasks.ceph.mon.a.smithi060.stderr: 11: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f16d5c8300d] 2020-10-31T22:51:30.336 INFO:tasks.ceph.mon.a.smithi060.stderr: 12: (()+0x76db) [0x7f16d48536db] 2020-10-31T22:51:30.337 INFO:tasks.ceph.mon.a.smithi060.stderr: 13: (clone()+0x3f) [0x7f16d3a39a3f] 2020-10-31T22:51:30.337 INFO:tasks.ceph.mon.a.smithi060.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-10-31T22:51:30.337 INFO:tasks.ceph.mon.a.smithi060.stderr: 2020-10-31T22:51:30.344 INFO:tasks.ceph.mon.a.smithi060.stderr: -2794> 2020-10-31T22:51:27.045+0000 7f16cba30700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-10-31T22:51:30.347 INFO:tasks.ceph.mon.a.smithi060.stderr: 0> 2020-10-31T22:51:30.317+0000 7f16c922b700 -1 *** Caught signal (Segmentation fault) ** 2020-10-31T22:51:30.347 INFO:tasks.ceph.mon.a.smithi060.stderr: in thread 7f16c922b700 thread_name:ms_dispatch 2020-10-31T22:51:30.347 INFO:tasks.ceph.mon.a.smithi060.stderr: 2020-10-31T22:51:30.347 INFO:tasks.ceph.mon.a.smithi060.stderr: ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable) 2020-10-31T22:51:30.347 INFO:tasks.ceph.mon.a.smithi060.stderr: 1: (()+0x128a0) [0x7f16d485e8a0] 2020-10-31T22:51:30.348 INFO:tasks.ceph.mon.a.smithi060.stderr: 2: (PGMapDigest::get_pool_free_space(OSDMap const&, long) const+0x160) [0x7f16d5d67a90] 2020-10-31T22:51:30.348 INFO:tasks.ceph.mon.a.smithi060.stderr: 3: (PGMapDigest::get_statfs(OSDMap&, boost::optional) const+0xd8) [0x7f16d5d67c08] 2020-10-31T22:51:30.348 INFO:tasks.ceph.mon.a.smithi060.stderr: 4: (MgrStatMonitor::preprocess_statfs(boost::intrusive_ptr)+0x2d3) [0x5630c2cd19d3] 2020-10-31T22:51:30.348 INFO:tasks.ceph.mon.a.smithi060.stderr: 5: (MgrStatMonitor::preprocess_query(boost::intrusive_ptr)+0x183) [0x5630c2cd1f73] 2020-10-31T22:51:30.348 INFO:tasks.ceph.mon.a.smithi060.stderr: 6: (PaxosService::dispatch(boost::intrusive_ptr)+0x55b) [0x5630c2bc6fdb] 2020-10-31T22:51:30.348 INFO:tasks.ceph.mon.a.smithi060.stderr: 7: (Monitor::dispatch_op(boost::intrusive_ptr)+0x8b9) [0x5630c2acc649] 2020-10-31T22:51:30.349 INFO:tasks.ceph.mon.a.smithi060.stderr: 8: (Monitor::_ms_dispatch(Message*)+0x29a) [0x5630c2acd7ca] 2020-10-31T22:51:30.349 INFO:tasks.ceph.mon.a.smithi060.stderr: 9: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x5630c2afbe38] 2020-10-31T22:51:30.349 INFO:tasks.ceph.mon.a.smithi060.stderr: 10: (DispatchQueue::entry()+0x11ea) [0x7f16d5be360a] 2020-10-31T22:51:30.349 INFO:tasks.ceph.mon.a.smithi060.stderr: 11: (DispatchQueue::DispatchThread::entry()+0xd) [0x7f16d5c8300d] 2020-10-31T22:51:30.349 INFO:tasks.ceph.mon.a.smithi060.stderr: 12: (()+0x76db) [0x7f16d48536db] 2020-10-31T22:51:30.349 INFO:tasks.ceph.mon.a.smithi060.stderr: 13: (clone()+0x3f) [0x7f16d3a39a3f] 2020-10-31T22:51:30.349 INFO:tasks.ceph.mon.a.smithi060.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-10-31T22:51:30.352 INFO:tasks.ceph.mon.a.smithi060.stderr: 2020-10-31T22:51:30.405 INFO:tasks.ceph.mon.c.smithi066.stderr:daemon-helper: command crashed with signal 11 2020-10-31T22:51:30.407 INFO:tasks.ceph.mon.b.smithi066.stderr:*** Caught signal (Segmentation fault) ** 2020-10-31T22:51:30.407 INFO:tasks.ceph.mon.b.smithi066.stderr: in thread 7fcad2a21700 thread_name:ms_dispatch 2020-10-31T22:51:30.415 INFO:tasks.ceph.mon.b.smithi066.stderr: ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable) 2020-10-31T22:51:30.415 INFO:tasks.ceph.mon.b.smithi066.stderr: 1: (()+0x128a0) [0x7fcade0548a0] 2020-10-31T22:51:30.415 INFO:tasks.ceph.mon.b.smithi066.stderr: 2: (PGMapDigest::get_pool_free_space(OSDMap const&, long) const+0x160) [0x7fcadf55da90] 2020-10-31T22:51:30.416 INFO:tasks.ceph.mon.b.smithi066.stderr: 3: (PGMapDigest::get_statfs(OSDMap&, boost::optional) const+0xd8) [0x7fcadf55dc08] 2020-10-31T22:51:30.416 INFO:tasks.ceph.mon.b.smithi066.stderr: 4: (MgrStatMonitor::preprocess_statfs(boost::intrusive_ptr)+0x2d3) [0x5640c85ac9d3] 2020-10-31T22:51:30.416 INFO:tasks.ceph.mon.b.smithi066.stderr: 5: (MgrStatMonitor::preprocess_query(boost::intrusive_ptr)+0x183) [0x5640c85acf73] 2020-10-31T22:51:30.416 INFO:tasks.ceph.mon.b.smithi066.stderr: 6: (PaxosService::dispatch(boost::intrusive_ptr)+0x55b) [0x5640c84a1fdb] 2020-10-31T22:51:30.416 INFO:tasks.ceph.mon.b.smithi066.stderr: 7: (Monitor::dispatch_op(boost::intrusive_ptr)+0x8b9) [0x5640c83a7649] 2020-10-31T22:51:30.417 INFO:tasks.ceph.mon.b.smithi066.stderr: 8: (Monitor::_ms_dispatch(Message*)+0x29a) [0x5640c83a87ca] 2020-10-31T22:51:30.417 INFO:tasks.ceph.mon.b.smithi066.stderr: 9: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x5640c83d6e38] 2020-10-31T22:51:30.417 INFO:tasks.ceph.mon.b.smithi066.stderr: 10: (DispatchQueue::entry()+0x11ea) [0x7fcadf3d960a] 2020-10-31T22:51:30.417 INFO:tasks.ceph.mon.b.smithi066.stderr: 11: (DispatchQueue::DispatchThread::entry()+0xd) [0x7fcadf47900d] 2020-10-31T22:51:30.418 INFO:tasks.ceph.mon.b.smithi066.stderr: 12: (()+0x76db) [0x7fcade0496db] 2020-10-31T22:51:30.418 INFO:tasks.ceph.mon.b.smithi066.stderr: 13: (clone()+0x3f) [0x7fcadd22fa3f] 2020-10-31T22:51:30.419 INFO:tasks.ceph.mon.b.smithi066.stderr:2020-10-31T22:51:30.413+0000 7fcad2a21700 -1 *** Caught signal (Segmentation fault) ** 2020-10-31T22:51:30.419 INFO:tasks.ceph.mon.b.smithi066.stderr: in thread 7fcad2a21700 thread_name:ms_dispatch 2020-10-31T22:51:30.420 INFO:tasks.ceph.mon.b.smithi066.stderr: 2020-10-31T22:51:30.420 INFO:tasks.ceph.mon.b.smithi066.stderr: ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable) 2020-10-31T22:51:30.420 INFO:tasks.ceph.mon.b.smithi066.stderr: 1: (()+0x128a0) [0x7fcade0548a0] 2020-10-31T22:51:30.421 INFO:tasks.ceph.mon.b.smithi066.stderr: 2: (PGMapDigest::get_pool_free_space(OSDMap const&, long) const+0x160) [0x7fcadf55da90] 2020-10-31T22:51:30.421 INFO:tasks.ceph.mon.b.smithi066.stderr: 3: (PGMapDigest::get_statfs(OSDMap&, boost::optional) const+0xd8) [0x7fcadf55dc08] 2020-10-31T22:51:30.421 INFO:tasks.ceph.mon.b.smithi066.stderr: 4: (MgrStatMonitor::preprocess_statfs(boost::intrusive_ptr)+0x2d3) [0x5640c85ac9d3] 2020-10-31T22:51:30.421 INFO:tasks.ceph.mon.b.smithi066.stderr: 5: (MgrStatMonitor::preprocess_query(boost::intrusive_ptr)+0x183) [0x5640c85acf73] 2020-10-31T22:51:30.422 INFO:tasks.ceph.mon.b.smithi066.stderr: 6: (PaxosService::dispatch(boost::intrusive_ptr)+0x55b) [0x5640c84a1fdb] 2020-10-31T22:51:30.422 INFO:tasks.ceph.mon.b.smithi066.stderr: 7: (Monitor::dispatch_op(boost::intrusive_ptr)+0x8b9) [0x5640c83a7649] 2020-10-31T22:51:30.422 INFO:tasks.ceph.mon.b.smithi066.stderr: 8: (Monitor::_ms_dispatch(Message*)+0x29a) [0x5640c83a87ca] 2020-10-31T22:51:30.422 INFO:tasks.ceph.mon.b.smithi066.stderr: 9: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x5640c83d6e38] 2020-10-31T22:51:30.422 INFO:tasks.ceph.mon.b.smithi066.stderr: 10: (DispatchQueue::entry()+0x11ea) [0x7fcadf3d960a] 2020-10-31T22:51:30.423 INFO:tasks.ceph.mon.b.smithi066.stderr: 11: (DispatchQueue::DispatchThread::entry()+0xd) [0x7fcadf47900d] 2020-10-31T22:51:30.423 INFO:tasks.ceph.mon.b.smithi066.stderr: 12: (()+0x76db) [0x7fcade0496db] 2020-10-31T22:51:30.423 INFO:tasks.ceph.mon.b.smithi066.stderr: 13: (clone()+0x3f) [0x7fcadd22fa3f] 2020-10-31T22:51:30.423 INFO:tasks.ceph.mon.b.smithi066.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-10-31T22:51:30.423 INFO:tasks.ceph.mon.b.smithi066.stderr: 2020-10-31T22:51:30.431 INFO:tasks.ceph.mon.b.smithi066.stderr: 0> 2020-10-31T22:51:30.413+0000 7fcad2a21700 -1 *** Caught signal (Segmentation fault) ** 2020-10-31T22:51:30.431 INFO:tasks.ceph.mon.b.smithi066.stderr: in thread 7fcad2a21700 thread_name:ms_dispatch 2020-10-31T22:51:30.432 INFO:tasks.ceph.mon.b.smithi066.stderr: 2020-10-31T22:51:30.432 INFO:tasks.ceph.mon.b.smithi066.stderr: ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable) 2020-10-31T22:51:30.432 INFO:tasks.ceph.mon.b.smithi066.stderr: 1: (()+0x128a0) [0x7fcade0548a0] 2020-10-31T22:51:30.432 INFO:tasks.ceph.mon.b.smithi066.stderr: 2: (PGMapDigest::get_pool_free_space(OSDMap const&, long) const+0x160) [0x7fcadf55da90] 2020-10-31T22:51:30.432 INFO:tasks.ceph.mon.b.smithi066.stderr: 3: (PGMapDigest::get_statfs(OSDMap&, boost::optional) const+0xd8) [0x7fcadf55dc08] 2020-10-31T22:51:30.432 INFO:tasks.ceph.mon.b.smithi066.stderr: 4: (MgrStatMonitor::preprocess_statfs(boost::intrusive_ptr)+0x2d3) [0x5640c85ac9d3] 2020-10-31T22:51:30.432 INFO:tasks.ceph.mon.b.smithi066.stderr: 5: (MgrStatMonitor::preprocess_query(boost::intrusive_ptr)+0x183) [0x5640c85acf73] 2020-10-31T22:51:30.433 INFO:tasks.ceph.mon.b.smithi066.stderr: 6: (PaxosService::dispatch(boost::intrusive_ptr)+0x55b) [0x5640c84a1fdb] 2020-10-31T22:51:30.433 INFO:tasks.ceph.mon.b.smithi066.stderr: 7: (Monitor::dispatch_op(boost::intrusive_ptr)+0x8b9) [0x5640c83a7649] 2020-10-31T22:51:30.433 INFO:tasks.ceph.mon.b.smithi066.stderr: 8: (Monitor::_ms_dispatch(Message*)+0x29a) [0x5640c83a87ca] 2020-10-31T22:51:30.433 INFO:tasks.ceph.mon.b.smithi066.stderr: 9: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x5640c83d6e38] 2020-10-31T22:51:30.433 INFO:tasks.ceph.mon.b.smithi066.stderr: 10: (DispatchQueue::entry()+0x11ea) [0x7fcadf3d960a] 2020-10-31T22:51:30.433 INFO:tasks.ceph.mon.b.smithi066.stderr: 11: (DispatchQueue::DispatchThread::entry()+0xd) [0x7fcadf47900d] 2020-10-31T22:51:30.433 INFO:tasks.ceph.mon.b.smithi066.stderr: 12: (()+0x76db) [0x7fcade0496db] 2020-10-31T22:51:30.434 INFO:tasks.ceph.mon.b.smithi066.stderr: 13: (clone()+0x3f) [0x7fcadd22fa3f] 2020-10-31T22:51:30.434 INFO:tasks.ceph.mon.b.smithi066.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-10-31T22:51:30.434 INFO:tasks.ceph.mon.b.smithi066.stderr: 2020-10-31T22:51:30.443 INFO:tasks.ceph.mon.b.smithi066.stderr: 0> 2020-10-31T22:51:30.413+0000 7fcad2a21700 -1 *** Caught signal (Segmentation fault) ** 2020-10-31T22:51:30.443 INFO:tasks.ceph.mon.b.smithi066.stderr: in thread 7fcad2a21700 thread_name:ms_dispatch 2020-10-31T22:51:30.443 INFO:tasks.ceph.mon.b.smithi066.stderr: 2020-10-31T22:51:30.444 INFO:tasks.ceph.mon.b.smithi066.stderr: ceph version 15.2.5-488-g5e705cd0 (5e705cd08d99a37f9ec3c2b451d90f6262257c7c) octopus (stable) 2020-10-31T22:51:30.444 INFO:tasks.ceph.mon.b.smithi066.stderr: 1: (()+0x128a0) [0x7fcade0548a0] 2020-10-31T22:51:30.444 INFO:tasks.ceph.mon.b.smithi066.stderr: 2: (PGMapDigest::get_pool_free_space(OSDMap const&, long) const+0x160) [0x7fcadf55da90] 2020-10-31T22:51:30.444 INFO:tasks.ceph.mon.b.smithi066.stderr: 3: (PGMapDigest::get_statfs(OSDMap&, boost::optional) const+0xd8) [0x7fcadf55dc08] 2020-10-31T22:51:30.444 INFO:tasks.ceph.mon.b.smithi066.stderr: 4: (MgrStatMonitor::preprocess_statfs(boost::intrusive_ptr)+0x2d3) [0x5640c85ac9d3] 2020-10-31T22:51:30.444 INFO:tasks.ceph.mon.b.smithi066.stderr: 5: (MgrStatMonitor::preprocess_query(boost::intrusive_ptr)+0x183) [0x5640c85acf73] 2020-10-31T22:51:30.444 INFO:tasks.ceph.mon.b.smithi066.stderr: 6: (PaxosService::dispatch(boost::intrusive_ptr)+0x55b) [0x5640c84a1fdb] 2020-10-31T22:51:30.445 INFO:tasks.ceph.mon.b.smithi066.stderr: 7: (Monitor::dispatch_op(boost::intrusive_ptr)+0x8b9) [0x5640c83a7649] 2020-10-31T22:51:30.445 INFO:tasks.ceph.mon.b.smithi066.stderr: 8: (Monitor::_ms_dispatch(Message*)+0x29a) [0x5640c83a87ca] 2020-10-31T22:51:30.445 INFO:tasks.ceph.mon.b.smithi066.stderr: 9: (Dispatcher::ms_dispatch2(boost::intrusive_ptr const&)+0x58) [0x5640c83d6e38] 2020-10-31T22:51:30.445 INFO:tasks.ceph.mon.b.smithi066.stderr: 10: (DispatchQueue::entry()+0x11ea) [0x7fcadf3d960a] 2020-10-31T22:51:30.445 INFO:tasks.ceph.mon.b.smithi066.stderr: 11: (DispatchQueue::DispatchThread::entry()+0xd) [0x7fcadf47900d] 2020-10-31T22:51:30.445 INFO:tasks.ceph.mon.b.smithi066.stderr: 12: (()+0x76db) [0x7fcade0496db] 2020-10-31T22:51:30.445 INFO:tasks.ceph.mon.b.smithi066.stderr: 13: (clone()+0x3f) [0x7fcadd22fa3f] 2020-10-31T22:51:30.446 INFO:tasks.ceph.mon.b.smithi066.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-10-31T22:51:30.446 INFO:tasks.ceph.mon.b.smithi066.stderr: 2020-10-31T22:51:30.527 INFO:tasks.ceph.mon.a.smithi060.stderr:daemon-helper: command crashed with signal 11 2020-10-31T22:51:30.588 INFO:tasks.ceph.mon.b.smithi066.stderr:daemon-helper: command crashed with signal 11 2020-10-31T22:51:35.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2020-10-31T22:51:35.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2020-10-31T22:51:35.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2020-10-31T22:51:41.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~6s 2020-10-31T22:51:41.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~6s 2020-10-31T22:51:41.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~6s 2020-10-31T22:51:45.574 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:51:45.577 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:51:45.579 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:51:45.581 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:51:48.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~13s 2020-10-31T22:51:48.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~13s 2020-10-31T22:51:48.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~13s 2020-10-31T22:51:54.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~19s 2020-10-31T22:51:54.383 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~19s 2020-10-31T22:51:54.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~19s 2020-10-31T22:52:00.707 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~25s 2020-10-31T22:52:00.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~25s 2020-10-31T22:52:00.709 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~25s 2020-10-31T22:52:07.019 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~32s 2020-10-31T22:52:07.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~32s 2020-10-31T22:52:07.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~32s 2020-10-31T22:52:13.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~38s 2020-10-31T22:52:13.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~38s 2020-10-31T22:52:13.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~38s 2020-10-31T22:52:15.634 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:52:15.637 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:52:15.640 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:52:15.644 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:52:19.639 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~44s 2020-10-31T22:52:19.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~44s 2020-10-31T22:52:19.640 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~44s 2020-10-31T22:52:25.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~50s 2020-10-31T22:52:25.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~50s 2020-10-31T22:52:25.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~50s 2020-10-31T22:52:32.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~57s 2020-10-31T22:52:32.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~57s 2020-10-31T22:52:32.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~57s 2020-10-31T22:52:38.571 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~63s 2020-10-31T22:52:38.587 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~63s 2020-10-31T22:52:38.588 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~63s 2020-10-31T22:52:44.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~69s 2020-10-31T22:52:44.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~69s 2020-10-31T22:52:44.896 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~69s 2020-10-31T22:52:45.711 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:52:45.715 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:52:45.718 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:52:45.721 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:52:51.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~76s 2020-10-31T22:52:51.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~76s 2020-10-31T22:52:51.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~76s 2020-10-31T22:52:57.518 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~82s 2020-10-31T22:52:57.518 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~82s 2020-10-31T22:52:57.518 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~82s 2020-10-31T22:53:03.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~88s 2020-10-31T22:53:03.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~88s 2020-10-31T22:53:03.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~88s 2020-10-31T22:53:10.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~95s 2020-10-31T22:53:10.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~95s 2020-10-31T22:53:10.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~95s 2020-10-31T22:53:15.765 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:53:15.769 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:53:15.772 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:53:15.778 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:53:16.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~101s 2020-10-31T22:53:16.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~101s 2020-10-31T22:53:16.451 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~101s 2020-10-31T22:53:22.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~107s 2020-10-31T22:53:22.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~107s 2020-10-31T22:53:22.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~107s 2020-10-31T22:53:29.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~114s 2020-10-31T22:53:29.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~114s 2020-10-31T22:53:29.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~114s 2020-10-31T22:53:35.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~120s 2020-10-31T22:53:35.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~120s 2020-10-31T22:53:35.381 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~120s 2020-10-31T22:53:41.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~126s 2020-10-31T22:53:41.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~126s 2020-10-31T22:53:41.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~126s 2020-10-31T22:53:45.835 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:53:45.838 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:53:45.841 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:53:45.844 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:53:48.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~133s 2020-10-31T22:53:48.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~133s 2020-10-31T22:53:48.011 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~133s 2020-10-31T22:53:54.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~139s 2020-10-31T22:53:54.320 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~139s 2020-10-31T22:53:54.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~139s 2020-10-31T22:54:00.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~145s 2020-10-31T22:54:00.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~145s 2020-10-31T22:54:00.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~145s 2020-10-31T22:54:06.942 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~151s 2020-10-31T22:54:06.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~151s 2020-10-31T22:54:06.943 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~151s 2020-10-31T22:54:13.252 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~158s 2020-10-31T22:54:13.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~158s 2020-10-31T22:54:13.253 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~158s 2020-10-31T22:54:15.903 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:54:15.907 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:54:15.911 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:54:15.914 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:54:19.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~164s 2020-10-31T22:54:19.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~164s 2020-10-31T22:54:19.564 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~164s 2020-10-31T22:54:25.873 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~170s 2020-10-31T22:54:25.874 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~170s 2020-10-31T22:54:25.874 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~170s 2020-10-31T22:54:32.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~177s 2020-10-31T22:54:32.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~177s 2020-10-31T22:54:32.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~177s 2020-10-31T22:54:38.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~183s 2020-10-31T22:54:38.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~183s 2020-10-31T22:54:38.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~183s 2020-10-31T22:54:44.814 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~189s 2020-10-31T22:54:44.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~189s 2020-10-31T22:54:44.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~189s 2020-10-31T22:54:45.952 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:54:45.956 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:54:45.958 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:54:45.961 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:54:51.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~196s 2020-10-31T22:54:51.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~196s 2020-10-31T22:54:51.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~196s 2020-10-31T22:54:57.442 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~202s 2020-10-31T22:54:57.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~202s 2020-10-31T22:54:57.443 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~202s 2020-10-31T22:55:03.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~208s 2020-10-31T22:55:03.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~208s 2020-10-31T22:55:03.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~208s 2020-10-31T22:55:10.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~215s 2020-10-31T22:55:10.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~215s 2020-10-31T22:55:10.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~215s 2020-10-31T22:55:16.025 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:55:16.028 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:55:16.032 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:55:16.036 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:55:16.378 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~221s 2020-10-31T22:55:16.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~221s 2020-10-31T22:55:16.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~221s 2020-10-31T22:55:22.689 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~227s 2020-10-31T22:55:22.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~227s 2020-10-31T22:55:22.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~227s 2020-10-31T22:55:29.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~234s 2020-10-31T22:55:29.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~234s 2020-10-31T22:55:29.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~234s 2020-10-31T22:55:35.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~240s 2020-10-31T22:55:35.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~240s 2020-10-31T22:55:35.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~240s 2020-10-31T22:55:41.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~246s 2020-10-31T22:55:41.623 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~246s 2020-10-31T22:55:41.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~246s 2020-10-31T22:55:46.079 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:55:46.082 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:55:46.085 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:55:46.088 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:55:47.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~252s 2020-10-31T22:55:47.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~252s 2020-10-31T22:55:47.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~252s 2020-10-31T22:55:54.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~259s 2020-10-31T22:55:54.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~259s 2020-10-31T22:55:54.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~259s 2020-10-31T22:56:00.555 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~265s 2020-10-31T22:56:00.556 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~265s 2020-10-31T22:56:00.556 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~265s 2020-10-31T22:56:06.867 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~271s 2020-10-31T22:56:06.867 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~271s 2020-10-31T22:56:06.868 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~271s 2020-10-31T22:56:13.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~278s 2020-10-31T22:56:13.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~278s 2020-10-31T22:56:13.178 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~278s 2020-10-31T22:56:16.143 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:56:16.147 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:56:16.149 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:56:16.151 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:56:19.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~284s 2020-10-31T22:56:19.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~284s 2020-10-31T22:56:19.487 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~284s 2020-10-31T22:56:25.798 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~290s 2020-10-31T22:56:25.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~290s 2020-10-31T22:56:25.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~290s 2020-10-31T22:56:32.107 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~297s 2020-10-31T22:56:32.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~297s 2020-10-31T22:56:32.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~297s 2020-10-31T22:56:38.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~303s 2020-10-31T22:56:38.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~303s 2020-10-31T22:56:38.416 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~303s 2020-10-31T22:56:38.416 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2020-10-31T22:56:38.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-10-31T22:56:38.417 INFO:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec stat --file-system '--printf=%T 2020-10-31T22:56:38.417 INFO:teuthology.orchestra.run.smithi152:> ' -- /home/ubuntu/cephtest/mnt.0) 2020-10-31T22:56:46.199 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:56:46.202 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:56:46.204 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:56:46.207 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:57:16.250 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:57:16.256 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:57:16.264 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:57:16.280 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:57:46.340 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:57:46.343 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:57:46.346 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:57:46.351 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:58:16.393 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:58:16.396 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:58:16.399 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:58:16.401 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:58:46.453 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:58:46.456 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:58:46.459 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:58:46.461 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:59:16.519 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:59:16.521 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:59:16.524 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:59:16.526 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:59:46.654 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:59:46.694 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:59:46.697 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T22:59:46.700 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:00:16.829 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:00:16.833 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:00:16.835 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:00:16.838 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:00:46.883 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:00:46.887 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:00:46.889 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:00:46.891 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:01:16.937 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:01:16.951 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:01:16.957 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:01:16.973 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:01:47.035 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:01:47.039 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:01:47.041 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:01:47.043 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:02:17.201 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:02:17.239 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:02:17.242 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:02:17.245 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:02:47.300 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:02:47.318 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:02:47.330 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:02:47.336 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:03:17.388 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:03:17.392 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:03:17.397 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:03:17.400 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:03:47.472 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:03:47.475 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:03:47.478 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:03:47.482 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:04:17.540 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:04:17.544 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:04:17.547 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:04:17.550 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:04:47.597 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:04:47.601 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:04:47.603 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:04:47.606 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:05:17.667 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:05:17.690 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:05:17.694 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:05:17.696 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:05:47.738 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:05:47.741 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:05:47.744 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:05:47.746 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:06:17.784 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:06:17.787 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:06:17.790 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:06:17.792 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:06:30.224 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 316, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 273, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2020-10-31T23:06:30.229 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 316, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 273, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2020-10-31T23:06:47.831 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:06:47.834 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:06:47.837 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:06:47.839 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:07:17.878 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:07:17.881 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:07:17.885 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:07:17.888 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:07:47.933 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:07:47.936 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:07:47.939 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:07:47.941 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:08:17.986 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:08:17.991 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:08:17.995 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:08:17.997 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:08:48.141 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:08:48.145 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:08:48.148 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:08:48.151 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:09:18.213 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:09:18.216 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:09:18.219 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:09:18.221 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:09:48.262 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:09:48.268 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:09:48.278 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:09:48.288 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:10:18.347 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:10:18.351 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:10:18.354 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:10:18.356 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:10:48.394 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:10:48.397 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:10:48.400 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:10:48.404 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:11:18.486 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:11:18.489 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:11:18.491 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:11:18.494 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:11:38.428 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 316, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 273, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2020-10-31T23:11:38.429 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 316, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 273, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2020-10-31T23:11:48.540 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:11:48.543 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:11:48.546 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:11:48.548 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:12:18.604 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:12:18.607 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:12:18.610 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:12:18.612 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:12:48.681 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:12:48.684 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:12:48.686 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:12:48.688 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:13:18.742 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:13:18.745 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:13:18.748 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:13:18.750 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:13:48.822 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:13:48.825 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:13:48.828 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:13:48.831 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:14:18.895 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:14:18.900 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:14:18.922 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:14:18.929 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:14:49.010 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:14:49.013 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:14:49.015 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:14:49.018 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:15:19.074 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:15:19.077 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:15:19.079 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:15:19.081 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:15:49.182 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:15:49.185 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:15:49.188 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:15:49.190 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:16:19.280 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:16:19.282 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:16:19.285 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:16:19.288 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:16:49.409 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:16:49.412 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:16:49.414 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:16:49.416 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:17:19.456 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:17:19.458 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:17:19.460 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:17:19.463 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:17:49.502 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:17:49.508 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:17:49.510 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:17:49.513 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:18:19.623 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:18:19.626 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:18:19.628 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:18:19.630 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:18:49.753 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:18:49.756 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:18:49.758 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:18:49.760 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:19:19.871 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:19:19.874 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:19:19.876 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:19:19.878 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:19:49.987 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:19:49.989 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:19:49.992 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:19:49.994 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:20:20.117 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:20:20.120 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:20:20.122 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:20:20.124 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:20:50.162 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:20:50.164 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:20:50.167 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:20:50.169 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:21:20.292 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:21:20.295 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:21:20.297 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:21:20.300 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:21:50.404 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:21:50.407 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:21:50.409 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:21:50.411 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:22:20.551 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:22:20.554 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:22:20.557 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:22:20.559 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:22:50.688 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:22:50.691 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:22:50.694 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:22:50.696 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:23:20.822 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:23:20.825 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:23:20.828 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:23:20.831 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:23:50.939 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:23:50.942 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:23:50.945 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:23:50.947 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:24:21.010 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:24:21.013 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:24:21.016 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:24:21.018 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:24:51.123 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:24:51.127 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:24:51.130 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:24:51.134 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:25:21.244 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:25:21.247 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:25:21.250 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:25:21.254 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:25:51.357 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:25:51.360 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:25:51.362 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:25:51.365 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:26:21.495 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:26:21.498 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:26:21.500 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:26:21.503 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:26:51.543 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:26:51.546 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:26:51.548 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:26:51.550 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:27:21.654 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:27:21.657 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:27:21.660 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:27:21.662 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:27:51.766 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:27:51.770 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:27:51.773 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:27:51.775 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:28:21.880 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:28:21.883 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:28:21.885 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:28:21.887 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:28:51.983 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:28:51.986 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:28:51.988 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:28:51.990 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:29:22.046 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:29:22.049 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:29:22.051 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:29:22.053 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:29:52.106 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:29:52.110 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:29:52.112 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:29:52.114 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:30:22.213 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:30:22.216 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:30:22.218 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:30:22.220 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:30:52.326 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:30:52.329 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:30:52.331 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:30:52.333 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:31:22.430 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:31:22.433 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:31:22.435 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:31:22.437 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:31:52.553 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:31:52.557 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:31:52.560 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:31:52.563 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:32:22.664 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:32:22.667 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:32:22.669 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:32:22.671 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:32:52.786 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:32:52.789 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:32:52.791 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:32:52.793 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:33:22.835 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:33:22.839 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:33:22.841 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:33:22.844 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:33:52.936 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:33:52.940 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:33:52.943 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:33:52.946 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:34:22.999 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:34:23.002 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:34:23.005 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:34:23.007 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:34:53.120 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:34:53.123 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:34:53.125 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:34:53.127 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:35:23.225 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:35:23.228 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:35:23.230 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:35:23.232 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:35:53.354 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:35:53.358 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:35:53.360 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:35:53.362 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:36:23.476 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:36:23.479 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:36:23.481 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:36:23.483 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:36:53.621 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:36:53.624 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:36:53.626 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:36:53.629 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:37:23.675 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:37:23.678 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:37:23.681 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:37:23.684 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:37:53.728 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:37:53.731 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:37:53.733 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:37:53.735 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:38:23.855 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:38:23.858 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:38:23.861 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:38:23.863 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:38:53.981 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:38:53.984 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:38:53.987 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:38:53.989 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:39:24.044 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:39:24.048 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:39:24.050 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:39:24.053 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:39:54.156 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:39:54.159 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:39:54.162 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:39:54.164 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:40:24.278 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:40:24.281 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:40:24.283 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:40:24.287 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:40:54.408 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:40:54.411 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:40:54.413 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:40:54.416 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:41:24.559 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:41:24.562 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:41:24.564 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:41:24.566 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:41:54.658 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:41:54.661 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:41:54.664 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:41:54.666 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:42:24.780 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:42:24.782 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:42:24.785 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:42:24.788 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:42:54.884 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:42:54.887 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:42:54.889 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:42:54.893 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:43:24.995 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:43:24.998 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:43:25.002 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:43:25.004 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:43:55.118 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:43:55.123 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:43:55.125 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:43:55.127 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:44:25.195 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:44:25.199 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:44:25.203 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:44:25.206 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:44:55.327 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:44:55.330 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:44:55.333 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:44:55.337 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:45:25.439 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:45:25.442 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:45:25.444 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:45:25.446 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:45:55.552 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:45:55.554 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:45:55.557 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:45:55.559 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:46:25.664 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:46:25.667 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:46:25.669 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:46:25.672 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:46:55.787 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:46:55.789 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:46:55.792 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:46:55.794 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:47:25.899 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:47:25.902 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:47:25.904 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:47:25.907 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:47:56.020 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:47:56.023 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:47:56.025 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:47:56.028 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:48:26.132 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:48:26.135 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:48:26.138 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:48:26.140 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:48:56.254 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:48:56.257 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:48:56.259 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:48:56.261 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:49:26.308 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:49:26.311 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:49:26.314 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:49:26.316 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:49:56.357 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:49:56.360 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:49:56.362 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:49:56.365 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:50:26.484 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:50:26.487 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:50:26.490 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:50:26.492 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:50:56.651 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:50:56.654 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:50:56.658 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:50:56.661 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:51:26.768 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:51:26.771 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:51:26.773 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:51:26.775 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:51:56.873 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:51:56.876 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:51:56.878 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:51:56.880 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:52:27.219 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:52:27.222 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:52:27.224 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:52:27.227 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:52:57.331 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:52:57.334 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:52:57.337 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:52:57.340 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:53:27.444 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:53:27.447 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:53:27.450 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:53:27.452 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:53:57.565 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:53:57.568 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:53:57.570 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:53:57.572 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:54:27.619 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:54:27.622 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:54:27.624 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:54:27.626 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:54:57.670 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:54:57.673 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:54:57.675 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:54:57.677 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:55:27.779 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:55:27.782 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:55:27.784 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:55:27.787 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:55:57.891 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:55:57.894 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:55:57.897 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:55:57.899 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:56:28.020 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:56:28.023 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:56:28.025 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:56:28.028 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:56:58.173 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:56:58.176 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:56:58.179 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:56:58.181 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:57:28.342 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:57:28.345 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:57:28.348 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:57:28.350 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:57:58.451 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:57:58.454 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:57:58.456 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:57:58.458 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:58:28.632 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:58:28.635 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:58:28.638 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:58:28.641 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:58:58.735 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:58:58.738 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:58:58.740 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:58:58.742 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:59:28.789 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:59:28.792 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:59:28.794 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:59:28.796 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:59:58.902 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:59:58.905 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:59:58.907 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-10-31T23:59:58.910 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:00:29.039 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:00:29.049 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:00:29.559 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:00:29.562 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:00:59.702 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:00:59.705 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:00:59.708 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:00:59.710 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:01:29.815 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:01:29.818 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:01:29.821 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:01:29.823 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:01:59.937 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:01:59.940 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:01:59.942 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:01:59.945 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:02:30.041 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:02:30.043 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:02:30.046 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:02:30.048 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:03:00.162 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:03:00.164 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:03:00.167 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:03:00.169 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:03:30.275 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:03:30.278 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:03:30.280 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:03:30.282 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:04:00.333 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:04:00.336 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:04:00.338 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:04:00.340 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:04:30.434 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:04:30.437 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:04:30.440 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:04:30.442 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:05:00.572 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:05:00.575 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:05:00.577 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:05:00.580 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:05:30.693 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:05:30.697 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:05:30.699 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:05:30.701 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:06:00.823 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:06:00.826 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:06:00.828 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:06:00.830 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:06:30.877 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:06:30.881 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:06:30.883 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:06:30.887 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:07:00.990 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:07:00.993 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:07:00.997 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:07:01.000 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:07:31.119 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:07:31.123 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:07:31.125 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:07:31.128 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:08:01.183 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:08:01.186 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:08:01.189 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:08:01.191 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:08:31.303 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:08:31.306 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:08:31.308 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:08:31.311 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:09:01.400 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:09:01.404 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:09:01.407 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:09:01.409 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:09:31.484 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:09:31.487 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:09:31.489 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:09:31.491 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:10:01.608 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:10:01.612 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:10:01.614 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:10:01.616 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:10:31.729 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:10:31.920 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:10:31.922 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:10:31.924 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:11:02.033 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:11:02.036 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:11:02.038 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:11:02.040 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:11:32.162 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:11:32.165 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:11:32.168 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:11:32.170 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:12:02.259 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:12:02.262 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:12:02.264 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:12:02.267 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:12:32.363 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:12:32.366 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:12:32.369 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:12:32.371 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:13:02.475 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:13:02.478 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:13:02.480 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:13:02.482 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:13:32.597 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:13:32.600 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:13:32.602 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:13:32.604 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:14:02.685 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:14:02.688 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:14:02.690 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:14:02.692 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:14:32.746 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:14:32.754 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:14:32.757 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:14:32.760 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:15:02.869 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:15:02.872 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:15:02.874 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:15:02.876 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:15:32.973 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:15:32.976 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:15:32.978 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:15:32.980 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:16:03.060 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:16:03.063 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:16:03.065 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:16:03.068 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:16:33.182 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:16:33.185 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:16:33.187 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:16:33.189 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:17:03.319 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:17:03.322 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:17:03.325 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:17:03.327 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:17:33.440 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:17:33.444 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:17:33.446 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:17:33.448 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:18:03.561 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:18:03.564 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:18:03.567 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:18:03.569 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:18:33.682 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:18:33.686 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:18:33.690 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:18:33.693 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:19:03.812 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:19:03.815 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:19:03.817 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:19:03.820 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:19:33.874 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:19:33.877 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:19:33.880 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:19:33.882 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:20:03.996 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:20:03.998 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:20:04.001 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:20:04.003 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:20:34.064 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:20:34.067 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:20:34.069 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:20:34.071 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:21:04.188 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:21:04.191 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:21:04.194 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:21:04.196 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:21:34.292 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:21:34.295 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:21:34.297 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:21:34.299 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:22:04.388 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:22:04.391 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:22:04.393 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:22:04.396 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:22:34.501 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:22:34.504 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:22:34.507 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:22:34.509 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:23:04.638 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:23:04.641 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:23:04.643 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:23:04.645 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:23:34.734 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:23:34.737 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:23:34.739 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:23:34.741 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:24:04.799 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:24:04.802 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:24:04.805 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:24:04.807 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:24:34.860 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:24:34.863 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:24:34.866 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:24:34.868 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:25:04.916 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:25:04.919 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:25:04.921 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:25:04.923 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:25:35.045 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:25:35.048 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:25:35.050 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:25:35.052 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:26:05.148 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:26:05.151 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:26:05.153 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:26:05.155 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:26:35.278 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:26:35.280 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:26:35.282 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:26:35.284 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:27:05.407 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:27:05.410 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:27:05.412 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:27:05.414 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:27:35.503 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:27:35.506 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:27:35.509 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:27:35.512 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:28:05.616 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:28:05.619 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:28:05.621 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:28:05.624 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:28:35.704 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:28:35.707 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:28:35.710 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:28:35.712 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:29:05.825 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:29:05.828 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:29:05.830 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:29:05.834 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:29:36.017 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:29:36.024 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:29:36.033 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:29:36.049 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:30:06.237 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:30:06.240 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:30:06.243 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:30:06.245 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:30:36.362 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:30:36.365 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:30:36.367 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:30:36.369 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:31:06.532 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:31:06.535 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:31:06.537 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:31:06.539 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:31:36.655 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:31:36.658 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:31:36.661 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:31:36.663 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:32:06.792 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:32:06.795 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:32:06.797 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:32:06.800 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:32:37.010 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:32:37.013 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:32:37.017 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:32:37.019 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:33:07.126 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:33:07.129 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:33:07.131 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:33:07.133 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:33:37.277 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:33:37.280 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:33:37.282 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:33:37.284 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:34:07.366 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:34:07.370 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:34:07.373 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:34:07.375 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:34:37.495 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:34:37.498 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:34:37.500 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:34:37.503 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:35:07.602 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:35:07.605 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:35:07.607 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:35:07.609 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:35:37.762 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:35:37.765 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:35:37.767 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:35:37.770 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:36:07.877 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:36:07.880 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:36:07.883 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:36:07.885 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:36:38.155 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:36:38.158 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:36:38.161 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:36:38.163 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:37:08.387 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:37:08.390 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:37:08.392 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:37:08.394 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:37:38.498 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:37:38.526 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:37:38.529 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:37:38.532 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:38:08.628 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:38:08.631 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:38:08.640 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:38:08.649 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:38:38.790 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:38:38.793 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:38:38.795 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:38:38.797 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:39:08.919 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:39:08.922 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:39:08.924 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:39:08.926 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:39:39.200 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:39:39.203 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:39:39.206 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:39:39.208 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:40:09.305 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:40:09.307 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:40:09.310 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:40:09.312 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:40:39.453 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:40:39.456 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:40:39.458 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:40:39.460 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:41:09.573 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:41:09.576 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:41:09.578 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:41:09.581 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:41:39.702 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:41:39.705 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:41:39.707 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:41:39.710 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:42:09.838 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:42:09.842 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:42:09.844 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:42:09.846 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:42:39.968 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:42:39.971 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:42:39.973 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:42:39.976 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:43:10.080 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:43:10.083 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:43:10.085 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:43:10.087 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:43:40.210 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:43:40.213 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:43:40.215 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:43:40.217 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:44:10.380 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:44:10.383 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:44:10.385 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:44:10.387 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:44:40.727 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:44:40.730 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:44:40.733 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:44:40.735 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:45:10.851 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:45:10.856 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:45:10.858 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:45:10.861 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:45:41.056 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:45:41.059 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:45:41.061 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:45:41.063 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:46:11.361 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:46:11.364 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:46:11.366 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:46:11.369 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:46:41.469 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:46:41.472 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:46:41.474 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:46:41.476 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:47:11.591 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:47:11.593 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:47:11.595 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:47:11.597 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:47:41.690 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:47:41.694 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:47:41.696 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:47:41.699 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:48:11.820 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:48:11.823 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:48:11.825 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:48:11.827 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:48:41.941 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:48:41.945 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:48:41.947 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:48:41.949 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:49:12.054 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:49:12.057 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:49:12.059 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:49:12.061 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:49:42.196 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:49:42.199 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:49:42.201 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:49:42.203 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:50:12.325 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:50:12.328 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:50:12.331 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:50:12.333 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:50:42.476 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:50:42.480 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:50:42.482 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:50:42.484 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:51:12.584 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:51:12.589 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:51:12.591 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:51:12.593 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:51:42.755 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:51:42.758 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:51:42.760 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:51:42.763 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:52:12.860 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:52:12.863 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:52:12.865 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:52:12.867 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:52:42.956 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:52:42.959 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:52:42.961 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:52:42.963 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:53:13.068 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:53:13.070 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:53:13.073 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:53:13.075 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:53:43.181 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:53:43.184 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:53:43.186 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:53:43.188 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:54:13.451 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:54:13.454 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:54:13.456 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:54:13.459 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:54:43.587 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:54:43.590 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:54:43.592 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:54:43.595 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:55:13.710 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:55:13.714 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:55:13.717 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:55:13.719 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:55:43.890 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:55:43.896 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:55:43.913 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:55:43.941 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:56:14.045 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:56:14.050 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:56:14.052 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:56:14.055 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:56:44.158 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:56:44.162 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:56:44.164 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:56:44.167 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:57:14.295 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:57:14.297 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:57:14.300 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:57:14.302 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:57:44.540 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:57:44.572 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:57:44.575 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:57:44.577 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:58:14.695 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:58:14.698 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:58:14.700 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:58:14.703 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:58:44.825 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:58:44.828 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:58:44.830 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:58:44.833 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:59:14.945 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:59:14.949 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:59:14.951 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:59:14.953 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:59:45.117 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:59:45.120 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:59:45.122 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T00:59:45.124 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:00:15.297 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:00:15.300 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:00:15.302 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:00:15.305 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:00:45.444 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:00:45.462 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:00:45.464 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:00:45.468 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:01:15.588 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:01:15.592 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:01:15.595 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:01:15.598 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:01:45.727 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:01:45.730 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:01:45.733 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:01:45.735 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:02:15.881 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:02:15.887 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:02:15.893 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:02:15.895 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:02:46.003 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:02:46.006 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:02:46.008 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:02:46.011 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:03:16.132 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:03:16.135 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:03:16.137 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:03:16.140 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:03:46.253 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:03:46.256 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:03:46.258 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:03:46.261 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:04:16.423 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:04:16.426 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:04:16.429 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:04:16.432 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:04:46.720 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:04:46.723 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:04:46.725 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:04:46.727 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:05:16.894 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:05:16.898 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:05:16.901 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:05:16.904 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:05:47.044 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:05:47.048 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:05:47.050 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:05:47.054 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:06:17.267 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:06:17.270 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:06:17.273 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:06:17.275 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:06:47.398 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:06:47.406 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:06:47.409 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:06:47.412 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:07:17.544 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:07:17.547 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:07:17.550 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:07:17.552 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:07:47.723 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:07:47.725 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:07:47.728 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:07:47.730 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:08:17.844 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:08:17.847 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:08:17.849 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:08:17.852 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:08:47.965 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:08:47.969 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:08:47.971 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:08:47.973 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:09:18.078 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:09:18.081 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:09:18.084 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:09:18.086 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:09:48.243 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:09:48.247 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:09:48.250 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:09:48.253 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:10:18.362 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:10:18.365 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:10:18.368 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:10:18.370 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:10:48.508 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:10:48.535 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:10:48.539 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:10:48.542 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:11:18.661 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:11:18.674 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:11:18.676 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:11:18.679 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:11:48.806 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:11:48.811 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:11:48.814 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:11:48.817 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:12:18.939 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:12:18.942 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:12:18.944 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:12:18.946 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:12:49.057 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:12:49.060 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:12:49.062 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:12:49.064 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:13:19.178 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:13:19.181 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:13:19.183 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:13:19.186 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:13:49.308 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:13:49.311 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:13:49.313 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:13:49.315 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:14:19.429 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:14:19.432 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:14:19.434 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:14:19.437 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:14:49.608 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:14:49.611 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:14:49.614 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:14:49.616 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:15:19.729 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:15:19.732 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:15:19.734 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:15:19.737 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:15:49.834 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:15:49.837 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:15:49.840 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:15:49.842 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:16:19.939 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:16:19.943 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:16:19.946 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:16:19.949 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:16:50.051 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:16:50.054 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:16:50.056 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:16:50.059 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:17:20.173 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:17:20.176 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:17:20.178 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:17:20.181 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:17:50.293 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:17:50.296 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:17:50.299 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:17:50.301 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:18:20.405 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:18:20.408 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:18:20.411 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:18:20.413 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:18:50.548 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:18:50.551 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:18:50.553 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:18:50.555 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:19:20.703 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:19:20.706 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:19:20.708 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:19:20.710 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:19:50.769 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:19:50.772 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:19:50.774 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:19:50.777 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:20:20.882 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:20:20.885 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:20:20.888 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:20:20.891 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:20:50.995 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:20:50.998 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:20:51.000 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:20:51.002 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:21:21.124 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:21:21.128 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:21:21.130 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:21:21.132 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:21:51.421 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:21:51.424 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:21:51.426 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:21:51.428 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:22:21.525 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:22:21.528 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:22:21.530 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:22:21.532 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:22:51.638 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:22:51.641 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:22:51.644 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:22:51.646 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:23:21.750 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:23:21.753 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:23:21.756 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:23:21.758 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:23:51.889 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:23:51.892 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:23:51.894 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:23:51.897 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:24:22.001 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:24:22.003 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:24:22.006 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:24:22.008 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:24:52.331 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:24:52.334 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:24:52.336 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:24:52.338 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:25:22.443 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:25:22.445 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:25:22.448 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:25:22.450 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:25:52.548 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:25:52.551 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:25:52.553 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:25:52.556 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:26:22.677 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:26:22.680 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:26:22.682 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:26:22.684 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:26:53.079 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:26:53.081 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:26:53.084 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:26:53.086 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:27:23.402 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:27:23.405 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:27:23.407 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:27:23.409 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:27:53.792 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:27:53.795 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:27:53.797 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:27:53.799 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:28:23.919 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:28:23.922 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:28:23.924 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:28:23.926 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:28:54.042 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:28:54.045 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:28:54.048 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:28:54.050 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:29:24.171 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:29:24.174 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:29:24.176 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:29:24.178 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:29:54.301 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:29:54.305 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:29:54.307 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:29:54.309 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:30:24.431 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:30:24.434 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:30:24.437 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:30:24.439 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:30:54.559 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:30:54.562 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:30:54.564 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:30:54.567 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:31:24.672 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:31:24.675 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:31:24.677 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:31:24.680 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:31:54.801 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:31:54.804 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:31:54.811 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:31:54.815 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:32:24.915 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:32:24.918 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:32:24.920 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:32:24.922 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:32:55.076 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:32:55.079 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:32:55.082 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:32:55.084 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:33:25.198 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:33:25.202 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:33:25.212 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:33:25.518 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:33:55.778 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:33:55.781 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:33:55.783 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:33:55.785 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:34:25.882 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:34:25.885 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:34:25.887 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:34:25.889 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:34:56.018 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:34:56.021 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:34:56.023 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:34:56.025 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:35:26.140 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:35:26.142 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:35:26.145 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:35:26.147 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:35:56.292 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:35:56.295 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:35:56.297 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:35:56.299 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:36:26.407 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:36:26.416 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:36:26.424 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:36:26.440 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:36:56.545 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:36:56.549 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:36:56.551 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:36:56.553 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:37:26.826 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:37:26.829 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:37:26.831 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:37:26.834 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:37:56.959 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:37:56.962 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:37:56.964 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:37:56.966 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:38:27.095 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:38:27.098 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:38:27.101 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:38:27.103 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:38:57.223 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:38:57.226 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:38:57.228 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:38:57.230 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:39:27.350 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:39:27.353 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:39:27.356 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:39:27.358 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:39:57.588 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:39:57.591 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:39:57.593 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:39:57.596 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:40:27.710 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:40:27.713 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:40:27.715 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:40:27.717 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:40:57.821 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:40:57.824 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:40:57.827 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:40:57.829 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:41:27.960 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:41:27.963 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:41:27.966 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:41:27.968 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:41:58.276 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:41:58.279 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:41:58.281 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:41:58.283 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:42:28.484 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:42:28.487 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:42:28.489 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:42:28.491 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:42:58.610 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:42:58.613 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:42:58.615 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:42:58.617 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:43:28.718 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:43:28.721 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:43:28.723 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:43:28.725 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:43:58.848 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:43:58.851 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:43:58.853 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:43:58.855 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:44:28.985 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:44:28.988 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:44:28.990 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:44:28.993 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:44:59.047 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:44:59.050 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:44:59.052 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:44:59.054 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:45:29.107 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:45:29.110 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:45:29.112 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:45:29.114 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:45:59.231 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:45:59.234 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:45:59.236 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:45:59.238 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:46:29.366 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:46:29.369 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:46:29.371 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:46:29.373 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:46:59.473 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:46:59.476 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:46:59.478 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:46:59.480 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:47:29.586 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:47:29.589 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:47:29.591 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:47:29.593 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:47:59.889 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:47:59.892 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:47:59.894 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:47:59.896 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:48:30.019 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:48:30.023 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:48:30.034 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:48:30.038 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:49:00.180 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:49:00.187 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:49:00.198 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:49:00.208 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:49:30.320 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:49:30.323 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:49:30.325 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:49:30.327 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:50:00.583 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:50:00.586 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:50:00.589 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:50:00.591 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:50:30.940 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:50:30.943 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:50:30.945 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:50:30.948 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:51:01.082 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:51:01.085 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:51:01.088 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:51:01.091 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:51:31.204 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:51:31.217 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:51:31.228 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:51:31.234 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:52:01.343 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:52:01.352 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:52:01.359 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:52:01.364 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:52:31.463 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:52:31.466 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:52:31.475 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:52:31.479 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:53:01.593 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:53:01.596 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:53:01.598 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:53:01.600 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:53:31.922 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:53:31.925 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:53:31.928 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:53:31.930 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:54:02.059 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:54:02.062 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:54:02.065 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:54:02.067 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:54:32.171 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:54:32.174 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:54:32.176 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:54:32.178 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:55:02.300 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:55:02.303 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:55:02.305 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:55:02.307 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:55:32.405 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:55:32.409 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:55:32.419 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:55:32.424 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:56:02.628 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:56:02.631 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:56:02.634 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:56:02.636 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:56:32.752 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:56:32.756 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:56:32.759 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:56:32.761 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:57:02.868 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:57:02.871 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:57:02.873 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:57:02.875 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:57:32.981 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:57:32.984 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:57:32.987 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:57:32.989 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:58:03.118 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:58:03.121 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:58:03.124 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:58:03.126 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:58:33.249 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:58:33.251 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:58:33.254 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:58:33.256 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:59:03.361 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:59:03.364 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:59:03.366 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:59:03.369 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:59:33.490 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:59:33.493 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:59:33.496 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T01:59:33.498 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:00:03.594 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:00:03.597 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:00:03.601 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:00:03.603 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:00:33.885 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:00:33.888 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:00:33.891 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:00:33.893 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:01:04.024 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:01:04.027 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:01:04.029 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:01:04.031 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:01:34.145 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:01:34.148 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:01:34.150 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:01:34.152 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:02:04.261 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:02:04.264 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:02:04.266 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:02:04.269 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:02:34.379 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:02:34.382 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:02:34.385 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:02:34.387 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:03:04.634 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:03:04.637 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:03:04.639 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:03:04.641 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:03:34.749 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:03:34.752 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:03:34.754 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:03:34.756 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:04:04.851 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:04:04.854 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:04:04.856 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:04:04.858 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:04:34.914 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:04:34.917 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:04:34.919 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:04:34.921 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:05:05.155 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:05:05.158 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:05:05.160 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:05:05.162 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:05:35.251 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:05:35.254 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:05:35.256 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:05:35.258 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:06:05.477 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:06:05.480 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:06:05.483 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:06:05.485 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:06:35.592 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:06:35.595 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:06:35.598 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:06:35.600 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:07:05.714 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:07:05.717 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:07:05.719 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:07:05.721 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:07:35.818 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:07:35.821 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:07:35.823 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:07:35.825 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:08:06.021 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:08:06.024 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:08:06.026 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:08:06.028 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:08:36.126 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:08:36.129 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:08:36.132 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:08:36.134 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:09:06.238 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:09:06.241 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:09:06.244 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:09:06.246 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:09:36.368 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:09:36.371 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:09:36.375 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:09:36.377 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:10:06.573 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:10:06.576 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:10:06.578 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:10:06.580 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:10:36.702 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:10:36.705 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:10:36.707 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:10:36.710 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:11:06.832 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:11:06.835 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:11:06.837 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:11:06.839 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:11:36.936 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:11:36.939 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:11:36.945 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:11:36.947 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:12:07.073 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:12:07.081 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:12:07.093 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:12:07.103 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:12:37.202 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:12:37.205 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:12:37.207 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:12:37.209 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:13:07.299 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:13:07.304 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:13:07.307 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:13:07.310 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:13:37.411 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:13:37.415 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:13:37.417 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:13:37.419 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:14:07.533 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:14:07.549 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:14:07.560 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:14:07.569 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:14:37.670 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:14:37.673 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:14:37.675 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:14:37.677 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:15:07.741 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:15:07.744 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:15:07.746 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:15:07.748 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:15:37.786 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:15:37.789 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:15:37.791 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:15:37.794 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:16:07.916 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:16:07.919 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:16:07.921 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:16:07.923 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:16:38.013 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:16:38.016 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:16:38.018 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:16:38.020 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:17:08.141 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:17:08.144 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:17:08.146 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:17:08.148 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:17:38.371 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:17:38.374 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:17:38.377 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:17:38.379 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:18:08.509 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:18:08.512 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:18:08.514 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:18:08.516 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:18:38.638 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:18:38.641 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:18:38.643 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:18:38.646 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:19:08.759 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:19:08.762 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:19:08.764 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:19:08.767 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:19:38.863 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:19:38.866 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:19:38.868 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:19:38.870 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:20:08.942 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:20:08.945 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:20:08.947 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:20:08.949 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:20:39.046 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:20:39.050 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:20:39.052 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:20:39.054 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:21:09.143 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:21:09.146 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:21:09.149 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:21:09.151 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:21:39.278 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:21:39.281 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:21:39.283 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:21:39.285 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:22:09.416 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:22:09.419 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:22:09.421 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:22:09.423 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:22:39.545 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:22:39.548 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:22:39.551 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:22:39.553 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:23:09.658 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:23:09.661 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:23:09.664 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:23:09.667 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:23:39.763 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:23:39.766 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:23:39.769 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:23:39.771 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:24:09.902 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:24:09.905 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:24:09.907 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:24:09.909 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:24:40.014 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:24:40.017 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:24:40.019 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:24:40.021 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:25:10.118 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:25:10.121 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:25:10.123 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:25:10.125 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:25:40.248 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:25:40.259 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:25:40.265 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:25:40.271 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:26:10.327 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:26:10.330 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:26:10.332 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:26:10.335 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:26:40.499 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:26:40.502 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:26:40.506 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:26:40.509 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:27:10.612 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:27:10.615 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:27:10.617 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:27:10.619 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:27:40.707 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:27:40.710 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:27:40.712 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:27:40.714 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:28:10.803 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:28:10.806 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:28:10.808 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:28:10.810 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:28:41.075 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:28:41.078 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:28:41.080 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:28:41.082 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:29:11.346 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:29:11.349 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:29:11.351 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:29:11.353 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:29:41.457 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:29:41.460 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:29:41.463 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:29:41.465 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:30:11.678 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:30:11.682 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:30:11.684 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:30:11.686 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:30:41.726 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:30:41.729 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:30:41.731 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:30:41.734 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:31:11.963 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:31:11.966 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:31:11.968 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:31:11.970 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:31:42.161 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:31:42.164 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:31:42.167 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:31:42.169 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:32:12.298 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:32:12.302 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:32:12.304 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:32:12.306 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:32:42.425 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:32:42.428 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:32:42.430 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:32:42.432 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:33:12.566 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:33:12.569 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:33:12.572 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:33:12.574 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:33:42.713 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:33:42.716 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:33:42.718 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:33:42.721 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:34:12.822 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:34:12.825 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:34:12.829 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:34:12.831 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:34:43.059 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:34:43.062 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:34:43.066 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:34:43.069 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:35:13.192 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:35:13.196 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:35:13.198 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:35:13.201 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:35:43.342 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:35:43.346 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:35:43.348 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:35:43.350 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:36:13.477 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:36:13.480 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:36:13.482 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:36:13.484 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:36:43.618 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:36:43.621 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:36:43.623 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:36:43.625 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:37:13.756 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:37:13.759 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:37:13.761 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:37:13.763 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:37:43.876 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:37:43.880 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:37:43.882 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:37:43.884 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:38:13.997 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:38:14.001 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:38:14.003 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:38:14.005 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:38:44.119 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:38:44.122 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:38:44.125 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:38:44.127 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:39:14.164 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:39:14.168 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:39:14.170 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:39:14.172 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:39:44.220 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:39:44.223 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:39:44.225 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:39:44.227 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:40:14.338 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:40:14.341 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:40:14.343 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:40:14.346 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:40:44.474 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:40:44.478 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:40:44.481 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:40:44.483 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:41:14.607 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:41:14.610 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:41:14.612 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:41:14.615 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:41:44.711 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:41:44.714 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:41:44.716 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:41:44.718 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:42:14.840 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:42:14.843 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:42:14.845 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:42:14.848 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:42:44.945 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:42:44.948 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:42:44.952 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:42:44.954 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:43:15.067 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:43:15.070 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:43:15.072 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:43:15.074 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:43:45.171 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:43:45.174 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:43:45.177 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:43:45.178 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:44:15.307 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:44:15.310 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:44:15.312 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:44:15.315 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:44:45.430 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:44:45.433 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:44:45.435 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:44:45.437 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:45:15.535 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:45:15.538 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:45:15.540 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:45:15.542 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:45:45.671 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:45:45.674 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:45:45.676 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:45:45.678 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:46:15.978 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:46:15.981 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:46:15.983 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:46:15.985 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:46:46.079 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:46:46.089 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:46:46.091 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:46:46.093 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:47:16.161 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:47:16.164 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:47:16.166 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:47:16.169 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:47:46.438 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:47:46.441 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:47:46.444 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:47:46.446 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:48:16.571 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:48:16.574 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:48:16.577 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:48:16.578 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:48:46.763 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:48:46.767 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:48:46.769 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:48:46.771 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:49:16.879 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:49:16.882 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:49:16.885 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:49:16.887 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:49:47.005 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:49:47.010 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:49:47.012 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:49:47.014 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:50:17.218 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:50:17.221 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:50:17.223 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:50:17.225 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:50:47.347 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:50:47.350 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:50:47.352 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:50:47.354 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:51:17.459 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:51:17.462 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:51:17.464 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:51:17.466 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:51:47.561 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:51:47.565 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:51:47.568 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:51:47.570 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:52:17.732 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:52:17.736 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:52:17.747 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:52:17.757 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:52:47.881 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:52:47.885 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:52:47.887 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:52:47.889 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:53:18.061 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:53:18.064 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:53:18.066 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:53:18.068 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:53:48.174 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:53:48.177 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:53:48.180 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:53:48.182 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:54:18.285 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:54:18.333 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:54:18.335 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:54:18.338 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:54:48.448 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:54:48.451 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:54:48.454 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:54:48.456 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:55:18.703 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:55:18.716 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:55:18.722 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:55:18.726 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:55:48.843 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:55:48.846 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:55:48.848 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:55:48.850 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:56:18.963 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:56:18.966 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:56:18.969 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:56:18.972 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:56:49.166 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:56:49.169 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:56:49.171 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:56:49.173 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:57:19.330 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:57:19.333 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:57:19.335 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:57:19.336 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:57:49.450 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:57:49.452 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:57:49.454 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:57:49.457 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:58:19.580 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:58:19.583 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:58:19.585 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:58:19.588 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:58:49.718 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:58:49.721 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:58:49.724 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:58:49.726 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:59:19.846 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:59:19.849 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:59:19.851 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:59:19.853 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:59:49.967 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:59:49.970 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:59:49.973 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T02:59:49.975 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:00:20.170 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:00:20.173 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:00:20.175 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:00:20.177 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:00:50.367 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:00:50.370 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:00:50.372 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:00:50.374 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:01:20.530 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:01:20.533 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:01:20.535 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:01:20.537 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:01:50.655 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:01:50.658 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:01:50.661 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:01:50.663 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:02:20.776 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:02:20.778 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:02:20.780 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:02:20.783 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:02:50.889 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:02:50.894 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:02:50.898 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:02:50.902 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:03:21.022 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:03:21.025 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:03:21.027 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:03:21.030 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:03:51.134 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:03:51.137 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:03:51.140 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:03:51.142 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:04:21.247 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:04:21.275 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:04:21.277 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:04:21.279 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:04:51.506 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:04:51.509 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:04:51.511 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:04:51.513 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:05:21.681 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:05:21.684 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:05:21.686 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:05:21.689 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:05:51.935 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:05:51.938 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:05:51.941 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:05:51.945 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:06:22.048 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:06:22.053 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:06:22.057 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:06:22.060 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:06:52.161 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:06:52.164 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:06:52.166 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:06:52.169 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:07:22.282 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:07:22.285 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:07:22.287 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:07:22.289 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:07:52.411 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:07:52.414 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:07:52.416 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:07:52.418 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:08:22.523 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:08:22.547 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:08:22.549 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:08:22.551 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:08:52.653 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:08:52.656 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:08:52.658 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:08:52.660 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:09:22.882 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:09:22.887 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:09:22.893 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:09:22.896 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:09:53.004 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:09:53.006 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:09:53.009 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:09:53.011 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:10:23.174 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:10:23.177 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:10:23.179 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:10:23.182 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:10:53.437 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:10:53.440 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:10:53.442 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:10:53.445 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:11:23.591 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:11:23.595 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:11:23.600 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:11:23.609 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:11:53.729 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:11:53.732 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:11:53.734 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:11:53.737 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:12:23.859 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:12:23.862 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:12:23.864 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:12:23.867 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:12:53.970 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:12:53.974 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:12:53.976 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:12:53.978 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:13:24.083 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:13:24.086 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:13:24.089 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:13:24.091 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:13:54.196 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:13:54.199 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:13:54.201 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:13:54.203 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:14:24.308 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:14:24.311 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:14:24.314 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:14:24.316 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:14:54.589 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:14:54.592 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:14:54.594 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:14:54.596 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:15:24.694 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:15:24.698 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:15:24.700 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:15:24.702 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:15:54.799 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:15:54.825 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:15:54.828 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:15:54.831 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:16:24.962 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:16:24.965 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:16:24.968 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:16:24.970 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:16:55.092 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:16:55.095 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:16:55.097 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:16:55.100 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:17:25.203 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:17:25.214 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:17:25.220 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:17:25.231 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:17:55.346 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:17:55.355 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:17:55.358 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:17:55.367 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:18:25.589 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:18:25.592 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:18:25.594 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:18:25.597 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:18:55.716 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:18:55.719 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:18:55.722 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:18:55.725 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:19:25.827 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:19:25.834 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:19:25.845 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:19:25.851 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:19:55.957 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:19:55.960 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:19:55.963 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:19:55.965 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:20:26.074 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:20:26.077 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:20:26.079 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:20:26.081 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:20:56.133 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:20:56.158 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:20:56.160 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:20:56.162 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:21:26.474 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:21:26.477 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:21:26.479 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:21:26.482 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:21:56.608 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:21:56.611 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:21:56.613 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:21:56.615 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:22:26.742 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:22:26.745 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:22:26.747 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:22:26.751 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:22:56.852 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:22:56.866 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:22:56.872 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:22:56.878 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:23:26.979 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:23:27.007 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:23:27.010 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:23:27.017 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:23:57.125 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:23:57.128 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:23:57.131 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:23:57.133 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:24:27.252 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:24:27.254 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:24:27.258 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:24:27.260 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:24:57.531 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:24:57.534 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:24:57.537 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:24:57.539 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:25:27.696 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:25:27.699 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:25:27.702 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:25:27.704 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:25:57.827 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:25:57.830 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:25:57.832 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:25:57.834 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:26:28.001 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:26:28.004 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:26:28.006 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:26:28.008 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:26:58.126 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:26:58.130 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:26:58.132 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:26:58.134 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:27:28.355 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:27:28.358 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:27:28.360 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:27:28.362 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:27:58.468 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:27:58.471 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:27:58.474 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:27:58.476 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:28:28.598 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:28:28.601 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:28:28.603 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:28:28.605 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:28:58.726 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:28:58.729 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:28:58.732 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:28:58.734 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:29:28.856 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:29:28.858 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:29:28.861 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:29:28.863 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:29:58.952 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:29:58.955 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:29:58.957 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:29:58.959 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:30:29.123 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:30:29.130 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:30:29.136 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:30:29.140 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:30:59.270 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:30:59.273 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:30:59.275 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:30:59.278 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:31:29.397 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:31:29.418 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:31:29.421 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:31:29.423 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:31:59.678 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:31:59.685 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:31:59.689 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:31:59.691 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:32:29.782 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:32:29.785 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:32:29.788 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:32:29.790 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:32:59.919 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:32:59.925 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:32:59.929 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:32:59.936 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:33:30.042 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:33:30.046 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:33:30.048 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:33:30.056 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:34:00.217 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:34:00.222 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:34:00.229 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:34:00.237 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:34:30.351 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:34:30.355 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:34:30.357 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:34:30.359 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:35:00.606 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:35:00.610 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:35:00.613 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:35:00.616 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:35:30.765 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:35:30.796 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:35:30.800 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:35:30.802 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:36:00.904 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:36:00.908 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:36:00.911 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:36:00.915 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:36:31.044 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:36:31.047 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:36:31.050 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:36:31.052 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:37:01.146 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:37:01.149 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:37:01.151 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:37:01.154 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:37:31.262 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:37:31.265 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:37:31.267 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:37:31.270 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:38:01.592 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:38:01.595 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:38:01.598 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:38:01.601 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:38:31.704 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:38:31.707 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:38:31.709 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:38:31.711 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:39:01.831 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:39:01.834 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:39:01.836 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:39:01.838 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:39:31.933 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:39:31.936 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:39:31.939 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:39:31.941 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:40:02.038 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:40:02.041 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:40:02.043 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:40:02.045 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:40:32.350 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:40:32.353 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:40:32.355 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:40:32.357 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:41:02.560 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:41:02.563 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:41:02.566 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:41:02.568 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:41:32.676 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:41:32.680 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:41:32.682 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:41:32.685 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:42:02.788 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:42:02.791 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:42:02.794 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:42:02.796 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:42:32.918 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:42:32.922 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:42:32.924 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:42:32.933 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:43:03.030 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:43:03.033 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:43:03.035 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:43:03.037 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:43:33.144 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:43:33.147 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:43:33.150 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:43:33.152 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:44:03.295 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:44:03.298 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:44:03.300 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:44:03.302 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:44:33.417 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:44:33.459 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:44:33.463 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:44:33.467 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:45:03.580 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:45:03.583 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:45:03.585 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:45:03.587 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:45:33.760 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:45:33.763 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:45:33.768 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:45:33.771 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:46:03.880 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:46:03.884 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:46:03.886 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:46:03.889 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:46:34.002 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:46:34.010 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:46:34.019 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:46:34.025 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:47:04.148 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:47:04.151 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:47:04.154 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:47:04.156 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:47:34.297 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:47:34.301 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:47:34.304 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:47:34.307 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:48:04.423 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:48:04.426 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:48:04.428 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:48:04.431 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:48:34.562 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:48:34.577 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:48:34.584 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:48:34.591 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:49:04.690 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:49:04.725 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:49:04.728 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:49:04.730 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:49:34.836 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:49:34.839 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:49:34.845 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:49:34.849 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:50:04.965 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:50:04.968 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:50:04.970 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:50:04.972 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:50:35.078 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:50:35.082 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:50:35.084 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:50:35.087 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:51:05.134 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:51:05.137 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:51:05.139 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:51:05.141 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:51:35.463 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:51:35.467 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:51:35.469 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:51:35.472 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:52:05.726 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:52:05.729 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:52:05.731 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:52:05.733 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:52:35.828 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:52:35.830 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:52:35.833 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:52:35.835 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:53:05.932 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:53:05.935 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:53:05.937 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:53:05.939 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:53:36.052 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:53:36.324 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:53:36.327 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:53:36.329 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:54:06.449 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:54:06.453 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:54:06.457 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:54:06.461 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:54:36.585 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:54:36.588 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:54:36.590 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:54:36.592 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:55:06.716 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:55:06.719 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:55:06.721 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:55:06.723 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:55:36.870 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:55:36.873 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:55:36.876 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:55:36.879 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:56:06.949 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:56:06.952 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:56:06.955 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:56:06.957 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:56:37.087 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:56:37.093 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:56:37.098 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:56:37.109 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:57:07.200 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:57:07.203 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:57:07.206 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:57:07.208 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:57:37.321 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:57:37.324 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:57:37.327 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:57:37.329 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:58:07.425 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:58:07.428 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:58:07.431 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:58:07.434 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:58:37.563 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:58:37.566 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:58:37.568 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:58:37.570 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:59:07.676 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:59:07.679 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:59:07.682 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:59:07.684 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:59:37.791 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:59:37.794 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:59:37.798 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T03:59:37.801 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:00:07.909 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:00:07.912 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:00:07.914 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:00:07.916 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:00:37.972 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:00:37.978 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:00:37.982 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:00:37.985 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:01:08.093 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:01:08.096 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:01:08.098 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:01:08.100 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:01:38.205 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:01:38.208 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:01:38.211 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:01:38.213 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:02:08.317 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:02:08.328 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:02:08.330 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:02:08.332 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:02:38.431 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:02:38.443 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:02:38.447 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:02:38.459 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:03:08.592 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:03:08.597 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:03:08.600 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:03:08.604 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:03:38.713 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:03:38.717 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:03:38.733 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:03:38.739 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:04:08.851 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:04:08.854 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:04:08.856 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:04:08.858 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:04:38.914 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:04:38.917 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:04:38.920 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:04:38.922 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:05:09.068 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:05:09.071 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:05:09.073 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:05:09.075 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:05:39.140 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:05:39.143 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:05:39.145 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:05:39.147 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:06:09.269 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:06:09.272 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:06:09.274 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:06:09.276 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:06:39.389 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:06:39.393 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:06:39.396 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:06:39.398 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:07:09.502 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:07:09.505 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:07:09.507 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:07:09.509 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:07:39.606 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:07:39.609 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:07:39.612 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:07:39.614 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:08:09.774 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:08:09.777 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:08:09.779 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:08:09.781 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:08:39.913 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:08:39.916 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:08:39.918 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:08:39.921 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:09:10.036 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:09:10.039 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:09:10.042 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:09:10.044 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:09:40.148 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:09:40.151 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:09:40.153 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:09:40.155 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:10:10.258 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:10:10.261 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:10:10.263 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:10:10.267 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:10:40.582 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:10:40.585 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:10:40.587 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:10:40.589 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:11:10.683 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:11:10.687 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:11:10.689 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:11:10.692 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:11:40.989 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:11:40.992 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:11:40.995 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:11:40.997 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:12:11.103 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:12:11.106 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:12:11.108 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:12:11.110 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:12:41.198 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:12:41.204 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:12:41.212 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:12:41.218 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:13:11.312 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:13:11.315 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:13:11.317 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:13:11.319 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:13:41.365 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:13:41.368 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:13:41.370 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:13:41.372 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:14:11.486 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:14:11.489 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:14:11.492 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:14:11.495 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:14:41.608 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:14:41.610 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:14:41.613 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:14:41.615 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:15:11.862 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:15:11.866 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:15:11.868 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:15:11.870 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:15:41.975 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:15:41.978 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:15:41.980 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:15:41.982 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:16:12.096 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:16:12.140 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:16:12.142 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:16:12.144 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:16:42.343 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:16:42.346 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:16:42.348 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:16:42.351 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:17:12.471 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:17:12.474 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:17:12.477 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:17:12.479 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:17:42.602 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:17:42.605 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:17:42.607 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:17:42.610 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:18:12.731 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:18:12.746 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:18:12.756 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:18:12.764 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:18:42.895 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:18:42.900 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:18:42.903 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:18:42.905 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:19:13.005 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:19:13.009 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:19:13.012 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:19:13.015 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:19:43.135 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:19:43.140 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:19:43.143 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:19:43.146 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:20:13.255 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:20:13.258 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:20:13.260 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:20:13.262 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:20:43.594 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:20:43.598 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:20:43.600 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:20:43.603 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:21:13.910 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:21:13.913 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:21:13.915 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:21:13.917 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:21:44.063 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:21:44.066 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:21:44.069 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:21:44.071 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:22:14.181 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:22:14.184 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:22:14.190 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:22:14.198 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:22:44.239 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:22:44.242 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:22:44.244 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:22:44.246 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:23:14.347 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:23:14.351 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:23:14.353 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:23:14.355 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:23:44.486 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:23:44.489 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:23:44.491 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:23:44.493 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:24:14.611 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:24:14.615 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:24:14.618 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:24:14.621 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:24:44.941 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:24:44.944 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:24:44.947 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:24:44.949 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:25:15.073 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:25:15.076 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:25:15.078 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:25:15.081 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:25:45.186 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:25:45.189 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:25:45.191 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:25:45.193 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:26:15.315 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:26:15.318 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:26:15.320 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:26:15.322 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:26:45.637 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:26:45.640 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:26:45.642 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:26:45.644 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:27:15.767 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:27:15.782 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:27:15.790 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:27:15.794 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:27:45.929 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:27:45.932 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:27:45.934 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:27:45.936 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:28:16.035 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:28:16.050 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:28:16.066 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:28:16.080 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:28:46.189 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:28:46.193 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:28:46.195 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:28:46.197 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:29:16.298 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:29:16.303 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:29:16.314 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:29:16.327 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:29:46.439 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:29:46.442 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:29:46.444 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:29:46.447 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:30:16.558 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:30:17.081 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:30:17.087 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:30:17.090 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:30:47.221 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:30:47.226 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:30:47.228 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:30:47.232 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:31:17.351 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:31:17.363 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:31:17.379 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:31:17.386 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:31:47.556 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:31:47.559 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:31:47.562 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:31:47.564 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:32:17.668 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:32:17.671 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:32:17.674 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:32:17.676 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:32:47.788 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:32:47.792 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:32:47.794 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:32:47.797 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:33:17.875 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:33:17.878 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:33:17.880 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:33:17.882 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:33:47.996 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:33:48.025 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:33:48.028 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:33:48.030 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:34:18.159 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:34:18.162 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:34:18.164 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:34:18.166 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:34:48.280 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:34:48.284 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:34:48.286 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:34:48.288 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:35:18.410 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:35:18.413 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:35:18.416 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:35:18.419 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:35:48.525 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:35:48.528 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:35:48.531 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:35:48.534 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:36:18.580 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:36:18.583 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:36:18.586 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:36:18.588 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:36:48.701 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:36:48.704 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:36:48.706 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:36:48.708 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:37:18.828 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:37:18.831 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:37:18.833 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:37:18.836 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:37:48.932 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:37:48.935 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:37:48.937 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:37:48.939 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:38:19.053 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:38:19.056 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:38:19.059 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:38:19.061 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:38:49.190 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:38:49.193 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:38:49.195 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:38:49.197 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:39:19.312 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:39:19.334 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:39:19.348 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:39:19.353 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:39:49.441 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:39:49.448 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:39:49.467 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:39:49.474 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:40:19.561 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:40:19.565 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:40:19.567 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:40:19.569 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:40:49.688 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:40:49.719 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:40:49.723 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:40:49.725 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:41:20.043 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:41:20.046 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:41:20.048 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:41:20.051 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:41:50.313 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:41:50.317 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:41:50.319 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:41:50.321 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:42:20.429 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:42:20.432 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:42:20.434 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:42:20.436 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:42:50.533 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:42:50.539 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:42:50.549 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:42:50.557 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:43:20.677 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:43:20.680 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:43:20.682 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:43:20.685 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:43:50.998 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:43:51.002 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:43:51.004 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:43:51.007 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:44:21.096 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:44:21.127 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:44:21.130 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:44:21.132 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:44:51.450 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:44:51.453 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:44:51.455 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:44:51.458 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:45:21.780 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:45:21.784 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:45:21.787 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:45:21.789 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:45:51.943 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:45:51.946 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:45:51.948 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:45:51.950 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:46:22.054 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:46:22.057 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:46:22.060 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:46:22.062 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:46:52.200 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:46:52.203 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:46:52.205 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:46:52.207 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:47:22.331 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:47:22.334 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:47:22.336 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:47:22.338 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:47:52.435 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:47:52.438 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:47:52.440 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:47:52.442 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:48:22.565 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:48:22.568 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:48:22.570 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:48:22.572 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:48:52.794 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:48:52.797 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:48:52.800 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:48:52.802 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:49:23.123 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:49:23.126 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:49:23.128 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:49:23.131 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:49:53.235 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:49:53.238 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:49:53.240 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:49:53.242 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:50:23.365 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:50:23.368 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:50:23.370 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:50:23.372 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:50:53.511 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:50:53.514 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:50:53.516 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:50:53.518 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:51:23.648 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:51:23.651 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:51:23.653 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:51:23.655 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:51:53.797 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:51:53.800 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:51:53.802 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:51:53.804 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:52:24.101 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:52:24.104 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:52:24.107 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:52:24.109 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:52:54.212 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:52:54.215 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:52:54.217 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:52:54.219 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:53:24.324 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:53:24.327 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:53:24.329 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:53:24.331 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:53:54.429 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:53:54.432 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:53:54.434 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:53:54.436 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:54:24.532 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:54:24.538 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:54:24.542 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:54:24.558 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:54:54.691 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:54:54.694 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:54:54.697 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:54:54.699 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:55:24.811 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:55:24.813 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:55:24.816 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:55:24.818 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:55:55.165 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:55:55.168 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:55:55.170 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:55:55.173 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:56:25.296 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:56:25.299 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:56:25.301 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:56:25.303 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:56:55.434 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:56:55.437 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:56:55.440 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:56:55.442 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:57:25.563 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:57:25.566 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:57:25.568 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:57:25.570 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:57:55.692 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:57:55.695 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:57:55.697 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:57:55.699 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:58:25.811 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:58:25.841 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:58:25.845 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:58:25.848 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:58:55.967 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:58:55.970 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:58:55.972 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:58:55.974 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:59:26.096 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:59:26.099 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:59:26.101 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:59:26.103 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:59:56.207 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:59:56.210 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:59:56.212 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T04:59:56.214 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:00:26.332 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:00:26.335 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:00:26.337 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:00:26.340 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:00:56.454 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:00:56.457 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:00:56.459 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:00:56.461 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:01:26.588 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:01:26.591 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:01:26.593 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:01:26.595 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:01:56.692 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:01:56.695 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:01:56.697 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:01:56.700 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:02:26.813 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:02:26.816 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:02:26.819 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:02:26.821 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:02:56.925 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:02:56.928 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:02:56.930 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:02:56.932 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:03:27.248 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:03:27.251 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:03:27.254 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:03:27.256 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:03:57.383 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:03:57.386 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:03:57.388 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:03:57.390 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:04:27.514 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:04:27.517 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:04:27.519 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:04:27.521 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:04:57.626 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:04:57.629 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:04:57.632 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:04:57.634 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:05:27.747 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:05:27.750 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:05:27.752 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:05:27.754 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:05:57.818 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:05:57.821 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:05:57.823 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:05:57.826 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:06:27.864 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:06:27.867 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:06:27.869 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:06:27.871 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:06:57.977 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:06:57.980 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:06:57.982 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:06:57.984 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:07:28.090 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:07:28.093 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:07:28.095 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:07:28.097 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:07:58.220 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:07:58.223 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:07:58.225 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:07:58.228 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:08:28.340 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:08:28.343 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:08:28.346 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:08:28.348 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:08:58.453 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:08:58.456 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:08:58.459 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:08:58.461 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:09:28.591 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:09:28.594 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:09:28.596 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:09:28.599 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:09:58.720 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:09:58.723 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:09:58.725 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:09:58.728 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:10:28.858 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:10:28.861 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:10:28.863 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:10:28.865 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:10:58.971 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:10:58.974 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:10:58.977 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:10:58.979 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:11:29.109 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:11:29.112 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:11:29.114 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:11:29.117 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:11:59.405 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:11:59.409 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:11:59.417 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:11:59.419 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:12:29.534 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:12:29.538 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:12:29.540 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:12:29.543 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:12:59.639 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:12:59.642 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:12:59.644 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:12:59.646 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:13:29.758 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:13:29.761 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:13:29.763 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:13:29.765 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:13:59.863 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:13:59.866 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:13:59.868 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:13:59.871 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:14:29.975 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:14:29.978 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:14:29.980 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:14:29.983 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:15:00.258 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:15:00.261 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:15:00.263 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:15:00.265 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:15:30.392 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:15:30.395 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:15:30.397 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:15:30.399 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:16:00.681 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:16:00.684 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:16:00.687 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:16:00.689 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:16:30.796 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:16:30.827 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:16:30.830 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:16:30.832 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:17:00.992 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:17:01.000 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:17:01.007 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:17:01.018 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:17:31.271 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:17:31.274 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:17:31.277 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:17:31.279 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:18:01.393 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:18:01.396 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:18:01.399 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:18:01.401 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:18:31.513 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:18:31.517 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:18:31.519 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:18:31.521 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:19:01.635 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:19:01.638 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:19:01.640 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:19:01.642 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:19:31.745 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:19:31.748 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:19:31.751 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:19:31.754 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:20:01.864 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:20:01.867 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:20:01.870 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:20:01.873 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:20:31.986 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:20:31.989 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:20:31.991 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:20:31.993 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:21:02.177 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:21:02.182 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:21:02.185 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:21:02.188 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:21:32.228 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:21:32.231 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:21:32.233 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:21:32.235 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:22:02.349 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:22:02.353 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:22:02.355 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:22:02.357 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:22:32.462 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:22:32.465 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:22:32.467 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:22:32.469 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:23:02.575 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:23:02.578 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:23:02.580 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:23:02.582 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:23:32.680 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:23:32.683 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:23:32.685 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:23:32.687 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:24:02.791 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:24:02.794 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:24:02.797 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:24:02.800 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:24:32.896 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:24:32.899 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:24:32.901 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:24:32.903 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:25:03.001 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:25:03.004 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:25:03.006 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:25:03.008 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:25:33.105 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:25:33.108 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:25:33.110 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:25:33.112 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:26:03.176 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:26:03.179 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:26:03.181 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:26:03.183 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:26:33.297 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:26:33.300 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:26:33.303 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:26:33.305 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:27:03.418 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:27:03.421 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:27:03.424 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:27:03.427 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:27:33.548 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:27:33.550 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:27:33.553 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:27:33.555 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:28:03.660 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:28:03.663 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:28:03.665 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:28:03.668 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:28:33.815 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:28:33.819 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:28:33.822 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:28:33.824 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:29:03.928 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:29:03.931 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:29:03.934 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:29:03.936 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:29:34.048 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:29:34.051 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:29:34.053 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:29:34.055 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:30:04.161 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:30:04.164 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:30:04.166 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:30:04.168 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:30:34.273 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:30:34.276 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:30:34.279 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:30:34.281 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:31:04.345 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:31:04.348 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:31:04.350 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:31:04.352 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:31:34.465 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:31:34.468 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:31:34.470 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:31:34.473 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:32:04.578 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:32:04.581 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:32:04.584 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:32:04.587 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:32:34.691 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:32:34.694 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:32:34.696 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:32:34.698 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:33:04.805 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:33:04.808 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:33:04.811 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:33:04.813 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:33:34.916 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:33:34.919 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:33:34.921 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:33:34.923 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:34:05.029 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:34:05.032 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:34:05.034 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:34:05.037 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:34:35.077 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:34:35.080 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:34:35.083 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:34:35.085 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:35:05.412 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:35:05.415 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:35:05.417 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:35:05.419 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:35:35.541 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:35:35.544 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:35:35.547 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:35:35.549 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:36:05.680 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:36:05.683 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:36:05.685 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:36:05.687 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:36:35.802 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:36:35.805 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:36:35.807 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:36:35.809 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:37:05.930 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:37:05.933 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:37:05.935 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:37:05.938 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:37:36.051 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:37:36.055 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:37:36.057 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:37:36.064 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:38:06.178 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:38:06.181 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:38:06.183 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:38:06.185 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:38:36.310 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:38:36.314 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:38:36.316 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:38:36.324 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:39:06.439 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:39:06.442 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:39:06.445 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:39:06.447 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:39:36.560 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:39:36.563 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:39:36.566 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:39:36.568 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:40:06.681 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:40:06.685 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:40:06.687 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:40:06.689 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:40:36.810 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:40:36.813 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:40:36.815 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:40:36.818 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:41:07.140 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:41:07.143 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:41:07.145 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:41:07.147 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:41:37.261 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:41:37.264 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:41:37.267 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:41:37.269 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:42:07.601 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:42:07.604 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:42:07.606 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:42:07.608 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:42:37.711 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:42:37.714 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:42:37.717 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:42:37.719 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:43:07.841 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:43:07.845 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:43:07.847 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:43:07.849 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:43:37.961 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:43:37.964 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:43:37.966 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:43:37.969 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:44:08.091 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:44:08.094 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:44:08.096 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:44:08.099 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:44:38.212 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:44:38.215 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:44:38.217 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:44:38.219 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:45:08.493 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:45:08.496 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:45:08.498 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:45:08.501 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:45:38.615 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:45:38.618 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:45:38.620 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:45:38.622 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:46:08.735 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:46:09.151 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:46:09.156 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:46:09.161 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:46:39.272 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:46:39.275 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:46:39.278 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:46:39.280 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:47:09.403 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:47:09.406 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:47:09.408 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:47:09.410 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:47:39.538 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:47:39.541 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:47:39.544 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:47:39.546 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:48:09.667 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:48:09.669 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:48:09.672 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:48:09.674 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:48:39.796 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:48:39.799 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:48:39.801 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:48:39.803 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:49:09.913 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:49:09.916 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:49:09.918 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:49:09.920 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:49:40.043 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:49:40.046 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:49:40.048 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:49:40.050 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:50:10.180 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:50:10.183 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:50:10.185 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:50:10.187 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:50:40.292 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:50:40.295 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:50:40.297 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:50:40.299 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:51:10.426 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:51:10.429 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:51:10.431 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:51:10.433 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:51:40.667 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:51:40.671 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:51:40.673 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:51:40.676 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:52:10.965 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:52:10.967 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:52:10.970 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:52:10.972 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:52:41.020 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:52:41.029 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:52:41.031 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:52:41.033 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:53:11.127 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:53:11.130 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:53:11.132 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:53:11.134 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:53:41.231 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:53:41.259 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:53:41.261 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:53:41.263 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:54:11.566 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:54:11.568 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:54:11.571 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:54:11.573 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:54:41.690 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:54:41.693 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:54:41.696 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:54:41.699 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:55:11.811 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:55:11.829 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:55:11.837 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:55:11.853 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:55:41.988 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:55:41.990 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:55:41.993 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:55:41.995 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:56:12.128 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:56:12.140 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:56:12.143 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:56:12.156 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:56:42.280 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:56:42.283 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:56:42.285 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:56:42.287 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:57:12.426 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:57:12.430 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:57:12.432 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:57:12.434 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:57:42.556 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:57:42.559 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:57:42.561 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:57:42.563 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:58:12.662 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:58:12.664 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:58:12.667 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:58:12.669 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:58:42.782 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:58:42.786 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:58:42.789 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:58:42.791 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:59:12.904 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:59:12.907 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:59:12.909 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:59:12.911 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:59:43.024 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:59:43.028 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:59:43.031 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T05:59:43.034 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:00:13.146 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:00:13.149 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:00:13.151 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:00:13.153 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:00:43.348 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:00:43.359 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:00:43.366 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:00:43.396 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:01:13.664 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:01:13.672 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:01:13.681 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:01:13.686 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:01:43.784 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:01:43.787 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:01:43.789 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:01:43.792 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:02:13.980 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:02:13.984 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:02:13.986 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:02:13.990 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:02:44.084 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:02:44.087 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:02:44.090 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:02:44.093 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:03:14.205 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:03:14.208 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:03:14.210 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:03:14.213 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:03:44.319 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:03:44.322 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:03:44.324 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:03:44.326 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:04:14.623 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:04:14.625 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:04:14.628 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:04:14.630 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:04:44.735 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:04:44.738 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:04:44.740 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:04:44.743 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:05:14.864 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:05:14.867 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:05:14.871 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:05:14.873 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:05:44.977 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:05:44.980 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:05:44.983 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:05:44.985 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:06:15.123 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:06:15.126 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:06:15.129 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:06:15.131 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:06:45.253 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:06:45.287 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:06:45.290 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:06:45.292 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:07:15.424 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:07:15.427 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:07:15.431 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:07:15.433 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:07:45.545 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:07:45.548 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:07:45.550 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:07:45.552 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:08:15.676 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:08:15.679 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:08:15.681 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:08:15.683 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:08:45.779 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:08:45.784 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:08:45.792 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:08:45.798 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:09:15.924 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:09:15.927 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:09:15.930 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:09:15.933 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:09:46.055 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:09:46.058 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:09:46.060 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:09:46.062 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:10:16.167 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:10:16.202 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:10:16.205 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:10:16.208 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:10:46.305 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:10:46.309 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:10:46.311 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:10:46.313 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:11:16.418 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:11:16.421 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:11:16.423 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:11:16.425 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:11:46.546 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:11:46.549 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:11:46.551 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:11:46.553 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:12:16.602 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:12:16.606 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:12:16.608 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:12:16.610 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:12:46.715 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:12:46.718 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:12:46.721 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:12:46.723 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:13:16.845 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:13:16.847 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:13:16.850 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:13:16.852 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:13:47.191 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:13:47.194 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:13:47.196 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:13:47.198 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:14:17.415 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:14:17.419 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:14:17.421 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:14:17.423 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:14:47.457 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:14:47.460 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:14:47.462 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:14:47.464 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:15:17.663 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:15:17.665 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:15:17.668 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:15:17.670 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:15:47.948 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:15:47.951 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:15:47.953 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:15:47.955 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:16:18.077 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:16:18.080 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:16:18.082 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:16:18.084 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:16:48.193 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:16:48.198 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:16:48.202 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:16:48.214 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:17:18.340 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:17:18.343 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:17:18.345 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:17:18.348 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:17:48.478 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:17:48.481 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:17:48.483 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:17:48.486 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:18:18.595 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:18:18.599 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:18:18.601 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:18:18.603 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:18:48.777 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:18:48.779 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:18:48.782 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:18:48.784 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:19:18.895 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:19:18.899 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:19:18.902 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:19:18.904 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:19:49.033 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:19:49.036 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:19:49.038 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:19:49.040 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:20:19.145 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:20:19.148 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:20:19.150 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:20:19.153 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:20:49.258 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:20:49.261 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:20:49.264 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:20:49.266 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:21:19.613 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:21:19.616 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:21:19.619 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:21:19.622 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:21:49.747 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:21:49.749 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:21:49.752 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:21:49.754 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:22:19.910 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:22:19.913 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:22:19.916 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:22:19.921 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:22:50.026 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:22:50.035 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:22:50.046 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:22:50.050 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:23:20.138 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:23:20.141 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:23:20.144 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:23:20.146 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:23:50.267 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:23:50.271 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:23:50.274 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:23:50.277 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:24:20.380 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:24:20.383 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:24:20.385 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:24:20.387 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:24:50.526 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:24:50.529 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:24:50.532 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:24:50.534 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:25:01.598 INFO:tasks.ceph.mgr.x.smithi066.stderr:2020-11-01T06:25:01.593+0000 7f93005c1700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 21911) UID: 0 2020-11-01T06:25:01.599 INFO:tasks.ceph.osd.4.smithi066.stderr:2020-11-01T06:25:01.593+0000 7efc9b400700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 21911) UID: 0 2020-11-01T06:25:01.599 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-11-01T06:25:01.593+0000 7f979eba0700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 21911) UID: 0 2020-11-01T06:25:01.599 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-11-01T06:25:01.593+0000 7f89fdfcf700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 21911) UID: 0 2020-11-01T06:25:01.599 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-11-01T06:25:01.593+0000 7f3b83123700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 21911) UID: 0 2020-11-01T06:25:01.600 INFO:tasks.ceph.mds.b.smithi066.stderr:2020-11-01T06:25:01.597+0000 7f0ee553d700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 21911) UID: 0 2020-11-01T06:25:01.610 INFO:tasks.ceph.mgr.x.smithi066.stderr:2020-11-01T06:25:01.605+0000 7f93005c1700 -1 received signal: Hangup from (PID: 21912) UID: 0 2020-11-01T06:25:01.610 INFO:tasks.ceph.osd.4.smithi066.stderr:2020-11-01T06:25:01.605+0000 7efc9b400700 -1 received signal: Hangup from (PID: 21912) UID: 0 2020-11-01T06:25:01.611 INFO:tasks.ceph.osd.6.smithi066.stderr:2020-11-01T06:25:01.605+0000 7f89fdfcf700 -1 received signal: Hangup from (PID: 21912) UID: 0 2020-11-01T06:25:01.611 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-11-01T06:25:01.605+0000 7f979eba0700 -1 received signal: Hangup from (PID: 21912) UID: 0 2020-11-01T06:25:01.611 INFO:tasks.ceph.mds.b.smithi066.stderr:2020-11-01T06:25:01.605+0000 7f0ee553d700 -1 received signal: Hangup from (PID: 21912) UID: 0 2020-11-01T06:25:01.611 INFO:tasks.ceph.osd.5.smithi066.stderr:2020-11-01T06:25:01.605+0000 7f3b83123700 -1 received signal: Hangup from (PID: 21912) UID: 0 2020-11-01T06:25:01.705 INFO:tasks.ceph.mgr.y.smithi060.stderr:2020-11-01T06:25:01.699+0000 7fa5e54d0700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 39091) UID: 0 2020-11-01T06:25:01.706 INFO:tasks.ceph.osd.1.smithi060.stderr:2020-11-01T06:25:01.699+0000 7fb717bf5700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 39091) UID: 0 2020-11-01T06:25:01.706 INFO:tasks.ceph.osd.3.smithi060.stderr:2020-11-01T06:25:01.699+0000 7f41dbbaf700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 39091) UID: 0 2020-11-01T06:25:01.706 INFO:tasks.ceph.osd.0.smithi060.stderr:2020-11-01T06:25:01.699+0000 7fd25e158700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 39091) UID: 0 2020-11-01T06:25:01.707 INFO:tasks.ceph.osd.2.smithi060.stderr:2020-11-01T06:25:01.699+0000 7feaa9b71700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 39091) UID: 0 2020-11-01T06:25:01.707 INFO:tasks.ceph.mds.a.smithi060.stderr:2020-11-01T06:25:01.699+0000 7f7776fdc700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 39091) UID: 0 2020-11-01T06:25:01.708 INFO:tasks.ceph.mds.c.smithi060.stderr:2020-11-01T06:25:01.699+0000 7f14af160700 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror (PID: 39091) UID: 0 2020-11-01T06:25:01.715 INFO:tasks.ceph.osd.3.smithi060.stderr:2020-11-01T06:25:01.711+0000 7f41dbbaf700 -1 received signal: Hangup from (PID: 39092) UID: 0 2020-11-01T06:25:01.716 INFO:tasks.ceph.mds.c.smithi060.stderr:2020-11-01T06:25:01.711+0000 7f14af160700 -1 received signal: Hangup from (PID: 39092) UID: 0 2020-11-01T06:25:01.716 INFO:tasks.ceph.osd.2.smithi060.stderr:2020-11-01T06:25:01.711+0000 7feaa9b71700 -1 received signal: Hangup from (PID: 39092) UID: 0 2020-11-01T06:25:01.717 INFO:tasks.ceph.mgr.y.smithi060.stderr:2020-11-01T06:25:01.711+0000 7fa5e54d0700 -1 received signal: Hangup from (PID: 39092) UID: 0 2020-11-01T06:25:01.717 INFO:tasks.ceph.osd.1.smithi060.stderr:2020-11-01T06:25:01.711+0000 7fb717bf5700 -1 received signal: Hangup from (PID: 39092) UID: 0 2020-11-01T06:25:01.717 INFO:tasks.ceph.mds.a.smithi060.stderr:2020-11-01T06:25:01.711+0000 7f7776fdc700 -1 received signal: Hangup from (PID: 39092) UID: 0 2020-11-01T06:25:01.717 INFO:tasks.ceph.osd.0.smithi060.stderr:2020-11-01T06:25:01.711+0000 7fd25e158700 -1 received signal: Hangup from (PID: 39092) UID: 0 2020-11-01T06:25:20.745 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:25:20.748 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:25:20.750 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:25:20.752 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:25:50.879 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:25:50.882 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:25:50.884 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:25:50.887 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:26:21.017 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:26:21.021 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:26:21.023 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:26:21.025 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:26:51.164 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:26:51.168 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:26:51.171 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:26:51.174 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:27:21.293 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:27:21.297 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:27:21.300 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:27:21.302 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:27:51.428 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:27:51.431 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:27:51.436 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:27:51.439 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:28:21.645 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:28:21.651 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:28:21.662 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:28:21.676 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:28:51.787 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:28:51.791 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:28:51.794 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:28:51.797 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:29:21.902 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:29:21.905 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:29:21.908 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:29:21.911 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:29:52.021 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:29:52.024 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:29:52.026 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:29:52.029 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:30:22.136 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:30:22.139 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:30:22.141 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:30:22.143 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:30:52.231 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:30:52.234 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:30:52.237 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:30:52.240 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:31:22.594 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:31:22.598 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:31:22.600 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:31:22.602 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:31:52.756 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:31:52.759 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:31:52.761 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:31:52.763 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:32:22.886 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:32:22.889 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:32:22.892 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:32:22.894 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:32:52.999 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:32:53.002 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:32:53.004 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:32:53.007 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:33:23.137 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:33:23.140 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:33:23.142 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:33:23.145 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:33:53.258 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:33:53.261 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:33:53.263 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:33:53.265 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:34:23.388 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:34:23.390 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:34:23.393 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:34:23.396 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:34:53.509 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:34:53.523 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:34:53.538 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:34:53.550 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:35:23.663 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:35:23.666 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:35:23.668 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:35:23.670 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:35:53.784 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:35:53.817 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:35:53.820 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:35:53.823 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:36:23.954 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:36:23.957 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:36:23.960 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:36:23.962 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:36:54.076 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:36:54.079 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:36:54.081 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:36:54.083 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:37:24.404 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:37:24.408 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:37:24.410 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:37:24.412 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:37:54.534 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:37:54.537 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:37:54.539 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:37:54.541 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:38:24.814 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:38:24.821 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:38:24.824 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:38:24.827 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:38:54.961 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:38:54.964 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:38:54.968 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:38:54.970 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:39:25.064 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:39:25.067 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:39:25.070 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:39:25.072 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:39:55.202 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:39:55.206 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:39:55.209 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:39:55.211 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:40:25.323 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:40:25.326 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:40:25.328 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:40:25.331 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:40:55.427 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:40:55.431 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:40:55.433 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:40:55.436 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:41:25.565 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:41:25.573 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:41:25.588 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:41:25.593 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:41:55.736 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:41:55.739 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:41:55.742 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:41:55.744 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:42:25.865 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:42:25.869 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:42:25.872 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:42:25.874 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:42:55.928 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:42:55.932 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:42:55.934 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:42:55.936 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:43:26.049 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:43:26.062 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:43:26.068 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:43:26.072 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:43:56.204 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:43:56.210 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:43:56.216 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:43:56.221 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:44:26.324 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:44:26.411 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:44:26.414 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:44:26.421 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:44:56.529 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:44:56.532 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:44:56.534 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:44:56.537 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:45:26.642 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:45:26.645 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:45:26.648 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:45:26.650 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:45:56.770 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:45:56.774 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:45:56.776 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:45:56.779 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:46:27.133 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:46:27.172 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:46:27.175 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:46:27.178 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:46:57.229 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:46:57.235 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:46:57.242 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:46:57.244 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:47:27.359 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:47:27.366 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:47:27.372 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:47:27.375 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:47:57.440 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:47:57.443 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:47:57.447 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:47:57.449 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:48:27.558 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:48:27.562 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:48:27.564 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:48:27.566 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:48:57.670 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:48:57.673 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:48:57.676 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:48:57.678 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:49:27.999 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:49:28.002 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:49:28.006 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:49:28.008 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:49:58.112 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:49:58.120 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:49:58.124 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:49:58.128 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:50:28.218 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:50:28.221 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:50:28.223 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:50:28.225 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:50:58.550 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:50:58.553 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:50:58.555 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:50:58.558 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:51:28.675 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:51:28.684 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:51:28.686 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:51:28.690 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:51:58.799 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:51:58.806 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:51:58.813 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:51:58.823 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:52:28.956 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:52:28.965 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:52:28.968 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:52:28.971 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:52:59.104 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:52:59.108 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:52:59.110 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:52:59.113 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:53:29.210 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:53:29.259 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:53:29.261 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:53:29.263 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:53:59.381 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:53:59.383 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:53:59.386 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:53:59.388 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:54:29.502 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:54:29.505 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:54:29.507 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:54:29.509 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:54:59.613 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:54:59.616 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:54:59.619 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:54:59.621 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:55:29.726 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:55:29.739 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:55:29.741 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:55:29.743 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:55:59.856 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:55:59.860 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:55:59.864 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:55:59.866 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:56:29.929 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:56:29.942 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:56:29.953 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:56:29.966 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:57:00.012 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:57:00.027 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:57:00.031 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:57:00.037 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:57:30.137 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:57:30.140 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:57:30.142 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:57:30.145 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:58:00.264 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:58:00.296 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:58:00.301 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:58:00.304 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:58:30.428 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:58:30.430 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:58:30.433 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:58:30.436 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:59:00.543 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:59:00.546 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:59:00.549 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:59:00.551 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:59:30.653 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:59:30.656 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:59:30.658 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T06:59:30.660 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:00:00.773 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:00:00.813 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:00:00.816 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:00:00.818 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:00:30.920 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:00:30.926 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:00:30.937 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:00:30.962 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:01:01.070 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:01:01.073 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:01:01.076 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:01:01.078 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:01:31.137 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:01:31.140 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:01:31.142 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:01:31.146 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:02:01.258 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:02:01.289 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:02:01.291 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:02:01.294 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:02:31.378 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:02:31.384 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:02:31.386 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:02:31.389 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:03:01.483 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:03:01.486 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:03:01.488 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:03:01.492 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:03:31.621 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:03:31.662 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:03:31.669 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:03:31.672 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:04:01.775 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:04:01.778 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:04:01.781 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:04:01.783 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:04:31.847 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:04:31.850 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:04:31.853 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:04:31.855 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:05:01.942 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:05:01.946 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:05:01.951 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:05:01.953 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:05:32.054 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:05:32.058 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:05:32.061 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:05:32.075 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:06:02.162 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:06:02.168 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:06:02.170 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:06:02.172 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:06:32.230 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:06:32.655 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:06:32.664 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:06:32.683 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:07:02.964 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:07:02.969 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:07:02.973 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:07:02.976 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:07:33.339 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:07:33.342 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:07:33.346 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:07:33.350 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:08:03.458 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:08:04.057 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:08:04.060 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:08:04.062 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:08:34.163 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:08:34.166 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:08:34.169 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:08:34.173 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:09:04.352 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:09:04.361 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:09:04.372 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:09:04.380 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:09:34.490 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:09:34.496 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:09:34.499 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:09:34.503 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:10:04.659 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:10:04.663 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:10:04.666 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:10:04.668 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:10:34.790 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:10:34.792 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:10:34.795 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:10:34.797 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:11:04.848 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:11:04.851 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:11:04.854 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:11:04.856 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:11:34.997 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:11:35.000 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:11:35.002 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:11:35.004 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:12:05.110 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:12:05.113 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:12:05.116 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:12:05.118 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:12:35.247 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:12:35.250 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:12:35.252 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:12:35.255 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:13:05.368 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:13:05.371 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:13:05.373 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:13:05.375 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:13:35.499 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:13:35.502 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:13:35.505 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:13:35.508 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:14:05.610 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:14:05.613 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:14:05.615 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:14:05.617 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:14:35.725 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:14:35.728 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:14:35.736 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:14:35.739 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:15:05.844 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:15:05.848 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:15:05.851 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:15:05.853 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:15:35.948 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:15:35.978 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:15:35.980 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:15:35.983 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:16:06.094 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:16:06.098 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:16:06.100 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:16:06.102 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:16:36.179 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:16:36.182 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:16:36.184 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:16:36.186 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:17:06.229 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:17:06.232 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:17:06.235 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:17:06.238 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:17:36.348 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:17:36.394 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:17:36.396 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:17:36.398 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:18:06.520 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:18:06.523 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:18:06.526 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:18:06.528 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:18:36.641 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:18:36.643 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:18:36.646 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:18:36.648 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:19:06.754 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:19:06.757 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:19:06.760 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:19:06.763 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:19:36.891 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:19:36.894 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:19:36.896 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:19:36.898 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:20:07.004 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:20:07.011 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:20:07.047 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:20:07.052 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:20:37.150 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:20:37.153 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:20:37.156 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:20:37.158 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:21:07.262 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:21:07.265 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:21:07.267 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:21:07.270 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:21:37.344 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:21:37.347 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:21:37.350 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:21:37.352 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:22:07.471 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:22:07.474 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:22:07.477 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:22:07.479 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:22:37.599 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:22:37.602 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:22:37.604 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:22:37.607 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:23:07.721 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:23:07.723 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:23:07.726 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:23:07.728 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:23:37.833 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:23:37.844 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:23:37.856 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:23:37.873 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:24:07.990 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:24:07.993 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:24:07.996 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:24:07.999 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:24:38.108 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:24:38.111 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:24:38.113 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:24:38.116 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:25:08.238 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:25:08.241 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:25:08.244 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:25:08.246 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:25:38.351 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:25:38.353 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:25:38.356 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:25:38.358 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:26:08.455 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:26:08.459 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:26:08.462 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:26:08.468 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:26:38.526 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:26:38.532 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:26:38.554 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:26:38.579 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:27:08.680 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:27:08.691 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:27:08.702 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:27:08.712 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:27:38.827 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:27:38.854 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:27:38.867 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:27:38.876 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:28:08.987 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:28:08.999 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:28:09.002 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:28:09.005 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:28:39.110 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:28:39.114 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:28:39.118 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:28:39.121 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:29:09.169 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:29:09.172 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:29:09.174 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:29:09.179 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:29:39.284 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:29:39.288 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:29:39.291 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:29:39.294 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:30:09.405 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:30:09.476 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:30:09.479 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:30:09.482 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:30:39.617 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:30:39.620 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:30:39.623 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:30:39.626 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:31:09.748 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:31:09.751 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:31:09.753 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:31:09.756 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:31:40.076 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:31:40.079 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:31:40.082 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:31:40.084 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:32:10.198 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:32:10.200 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:32:10.202 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:32:10.204 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:32:40.310 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:32:40.363 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:32:40.366 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:32:40.368 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:33:10.457 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:33:10.460 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:33:10.463 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:33:10.466 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:33:40.529 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:33:40.532 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:33:40.534 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:33:40.536 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:34:10.657 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:34:10.661 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:34:10.663 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:34:10.665 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:34:40.788 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:34:40.791 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:34:40.793 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:34:40.795 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:35:10.899 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:35:10.902 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:35:10.905 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:35:10.908 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:35:41.020 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:35:41.023 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:35:41.025 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:35:41.030 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:36:11.134 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:36:11.193 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:36:11.195 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:36:11.198 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:36:41.488 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:36:41.492 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:36:41.495 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:36:41.497 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:37:11.617 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:37:11.620 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:37:11.622 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:37:11.624 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:37:41.685 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:37:41.688 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:37:41.691 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:37:41.693 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:38:11.791 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:38:11.796 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:38:11.801 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:38:11.807 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:38:41.921 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:38:41.924 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:38:41.926 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:38:41.929 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:39:12.051 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:39:12.054 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:39:12.057 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:39:12.059 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:39:42.146 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:39:42.185 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:39:42.187 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:39:42.189 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:40:12.292 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:40:12.295 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:40:12.298 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:40:12.300 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:40:42.413 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:40:42.416 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:40:42.418 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:40:42.421 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:41:12.518 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:41:12.522 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:41:12.524 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:41:12.526 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:41:42.580 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:41:42.583 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:41:42.586 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:41:42.588 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:42:12.710 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:42:12.715 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:42:12.718 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:42:12.721 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:42:42.817 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:42:42.820 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:42:42.825 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:42:42.827 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:43:12.952 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:43:12.957 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:43:12.961 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:43:12.964 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:43:43.056 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:43:43.059 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:43:43.062 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:43:43.065 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:44:13.268 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:44:13.272 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:44:13.283 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:44:13.286 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:44:43.407 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:44:43.410 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:44:43.413 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:44:43.415 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:45:13.519 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:45:13.522 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:45:13.525 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:45:13.527 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:45:43.624 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:45:43.627 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:45:43.629 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:45:43.631 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:46:13.745 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:46:13.751 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:46:13.768 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:46:13.779 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:46:43.841 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:46:43.843 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:46:43.846 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:46:43.849 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:47:13.978 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:47:13.981 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:47:13.983 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:47:13.985 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:47:44.108 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:47:44.111 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:47:44.113 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:47:44.115 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:48:14.220 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:48:14.255 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:48:14.259 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:48:14.261 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:48:44.388 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:48:44.401 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:48:44.419 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:48:44.430 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:49:14.546 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:49:14.549 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:49:14.552 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:49:14.554 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:49:44.666 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:49:44.670 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:49:44.672 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:49:44.675 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:50:14.796 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:50:14.821 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:50:14.826 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:50:14.829 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:50:44.881 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:50:44.885 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:50:44.888 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:50:44.891 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:51:14.996 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:51:14.999 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:51:15.001 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:51:15.003 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:51:45.325 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:51:45.328 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:51:45.331 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:51:45.333 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:52:15.446 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:52:15.452 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:52:15.458 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:52:15.465 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:52:45.583 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:52:45.586 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:52:45.589 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:52:45.591 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:53:15.722 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:53:15.751 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:53:15.753 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:53:15.756 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:53:45.859 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:53:45.862 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:53:45.865 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:53:45.867 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:54:15.946 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:54:15.949 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:54:15.952 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:54:15.954 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:54:46.020 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:54:46.024 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:54:46.028 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:54:46.031 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:55:16.130 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:55:16.135 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:55:16.138 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:55:16.140 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:55:46.244 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:55:46.249 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:55:46.252 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:55:46.256 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:56:16.370 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:56:16.393 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:56:16.400 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:56:16.415 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:56:46.735 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:56:46.739 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:56:46.741 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:56:46.744 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:57:16.842 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:57:16.845 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:57:16.847 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:57:16.849 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:57:47.071 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:57:48.486 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:57:48.489 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:57:48.491 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:58:18.605 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:58:18.609 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:58:18.611 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:58:18.616 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:58:48.745 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:58:48.748 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:58:48.750 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:58:48.753 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:59:18.856 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:59:18.859 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:59:18.862 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:59:18.864 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:59:48.986 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:59:48.988 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:59:48.991 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T07:59:48.993 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:00:19.098 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:00:19.102 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:00:19.105 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:00:19.107 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:00:49.221 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:00:49.224 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:00:49.228 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:00:49.231 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:01:19.408 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:01:19.412 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:01:19.414 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:01:19.417 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:01:49.621 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:01:49.625 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:01:49.627 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:01:49.631 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:02:19.749 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:02:19.781 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:02:19.784 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:02:19.786 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:02:49.886 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:02:49.889 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:02:49.891 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:02:49.893 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:03:20.016 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:03:20.018 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:03:20.020 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:03:20.023 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:03:50.119 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:03:50.122 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:03:50.124 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:03:50.127 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:04:20.309 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:04:20.350 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:04:20.352 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:04:20.354 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:04:50.513 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:04:50.516 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:04:50.518 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:04:50.520 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:05:20.643 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:05:20.646 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:05:20.648 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:05:20.651 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:05:50.762 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:05:50.766 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:05:50.768 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:05:50.770 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:06:20.902 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:06:20.905 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:06:20.907 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:06:20.909 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:06:51.180 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:06:51.184 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:06:51.187 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:06:51.190 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:07:21.291 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:07:21.301 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:07:21.303 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:07:21.305 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:07:51.605 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:07:51.608 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:07:51.611 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:07:51.613 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:08:21.701 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:08:21.704 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:08:21.706 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:08:21.708 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:08:51.830 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:08:51.833 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:08:51.835 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:08:51.838 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:09:21.944 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:09:21.952 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:09:21.955 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:09:21.957 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:09:52.082 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:09:52.085 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:09:52.087 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:09:52.089 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:10:22.212 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:10:22.216 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:10:22.220 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:10:22.222 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:10:52.346 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:10:52.348 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:10:52.351 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:10:52.353 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:11:22.452 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:11:22.455 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:11:22.457 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:11:22.459 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:11:52.658 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:11:52.661 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:11:52.663 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:11:52.666 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:12:22.770 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:12:22.773 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:12:22.775 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:12:22.777 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:12:52.950 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:12:52.953 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:12:52.955 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:12:52.957 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:13:23.079 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:13:23.082 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:13:23.085 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:13:23.087 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:13:53.215 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:13:53.218 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:13:53.220 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:13:53.222 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:14:23.493 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:14:23.497 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:14:23.499 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:14:23.501 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:14:53.591 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:14:53.594 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:14:53.597 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:14:53.599 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:15:23.720 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:15:23.724 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:15:23.729 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:15:23.731 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:15:53.832 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:15:53.851 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:15:53.859 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:15:53.862 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:16:23.973 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:16:23.978 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:16:23.981 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:16:23.984 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:16:54.068 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:16:54.100 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:16:54.102 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:16:54.105 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:17:24.231 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:17:24.234 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:17:24.236 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:17:24.239 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:17:54.351 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:17:54.354 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:17:54.356 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:17:54.358 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:18:24.464 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:18:24.468 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:18:24.470 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:18:24.472 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:18:54.593 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:18:54.596 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:18:54.599 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:18:54.601 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:19:24.722 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:19:24.725 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:19:24.727 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:19:24.729 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:19:54.851 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:19:54.854 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:19:54.857 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:19:54.859 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:20:24.956 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:20:24.959 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:20:24.961 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:20:24.963 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:20:55.078 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:20:55.081 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:20:55.083 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:20:55.085 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:21:25.206 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:21:25.209 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:21:25.211 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:21:25.213 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:21:55.553 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:21:55.557 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:21:55.559 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:21:55.561 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:22:25.690 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:22:25.693 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:22:25.695 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:22:25.697 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:22:55.835 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:22:55.839 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:22:55.842 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:22:55.844 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:23:25.958 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:23:25.960 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:23:25.963 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:23:25.965 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:23:56.069 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:23:56.072 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:23:56.075 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:23:56.077 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:24:26.174 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:24:26.177 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:24:26.180 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:24:26.182 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:24:56.286 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:24:56.290 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:24:56.292 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:24:56.295 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:25:26.607 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:25:26.610 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:25:26.612 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:25:26.615 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:25:56.737 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:25:56.740 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:25:56.743 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:25:56.745 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:26:26.851 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:26:26.887 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:26:26.890 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:26:26.897 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:26:56.987 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:26:56.990 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:26:56.992 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:26:56.995 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:27:27.126 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:27:27.129 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:27:27.131 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:27:27.133 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:27:57.272 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:27:57.275 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:27:57.277 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:27:57.279 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:28:27.510 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:28:27.513 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:28:27.515 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:28:27.518 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:28:57.780 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:28:57.783 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:28:57.786 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:28:57.788 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:29:27.884 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:29:27.887 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:29:27.889 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:29:27.891 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:29:57.998 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:29:58.001 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:29:58.003 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:29:58.005 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:30:28.092 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:30:28.095 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:30:28.097 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:30:28.099 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:30:58.206 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:30:58.209 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:30:58.212 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:30:58.215 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:31:28.317 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:31:28.320 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:31:28.323 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:31:28.325 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:31:58.605 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:31:58.608 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:31:58.612 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:31:58.614 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:32:28.727 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:32:28.729 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:32:28.732 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:32:28.735 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:32:58.822 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:32:58.825 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:32:58.828 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:32:58.830 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:33:28.917 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:33:28.920 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:33:28.923 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:33:28.925 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:33:59.047 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:33:59.050 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:33:59.053 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:33:59.056 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:34:29.160 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:34:29.163 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:34:29.166 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:34:29.170 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:34:59.255 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:34:59.259 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:34:59.262 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:34:59.271 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:35:29.386 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:35:29.389 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:35:29.391 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:35:29.393 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:35:59.515 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:35:59.519 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:35:59.522 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:35:59.525 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:36:29.643 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:36:29.646 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:36:29.648 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:36:29.651 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:36:59.939 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:36:59.945 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:36:59.949 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:36:59.957 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:37:30.146 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:37:30.151 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:37:30.168 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:37:30.173 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:38:00.534 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:38:00.537 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:38:00.540 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:38:00.542 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:38:30.661 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:38:30.665 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:38:30.668 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:38:30.670 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:39:00.776 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:39:00.779 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:39:00.781 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:39:00.783 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:39:30.869 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:39:30.879 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:39:30.898 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:39:30.903 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:40:00.959 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:40:00.961 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:40:00.963 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:40:00.966 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:40:31.070 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:40:31.074 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:40:31.077 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:40:31.079 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:41:01.174 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:41:01.178 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:41:01.181 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:41:01.183 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:41:31.312 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:41:31.314 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:41:31.317 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:41:31.319 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:42:01.466 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:42:01.469 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:42:01.472 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:42:01.474 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:42:31.696 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:42:31.699 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:42:31.701 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:42:31.703 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:43:01.807 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:43:01.810 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:43:01.812 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:43:01.814 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:43:31.944 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:43:31.947 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:43:31.950 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:43:31.952 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:44:02.049 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:44:02.052 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:44:02.054 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:44:02.056 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:44:32.161 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:44:32.164 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:44:32.166 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:44:32.168 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:45:02.265 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:45:02.271 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:45:02.279 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:45:02.283 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:45:32.412 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:45:32.415 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:45:32.418 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:45:32.420 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:46:02.533 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:46:02.536 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:46:02.538 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:46:02.540 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:46:32.646 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:46:32.649 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:46:32.651 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:46:32.653 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:47:02.858 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:47:02.862 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:47:02.865 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:47:02.868 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:47:32.979 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:47:32.982 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:47:32.984 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:47:32.987 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:48:03.318 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:48:03.387 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:48:03.389 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:48:03.392 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:48:33.731 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:48:33.734 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:48:33.736 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:48:33.738 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:49:03.850 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:49:03.860 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:49:03.866 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:49:03.877 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:49:33.998 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:49:34.001 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:49:34.003 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:49:34.006 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:50:04.111 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:50:04.115 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:50:04.117 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:50:04.120 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:50:34.224 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:50:34.226 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:50:34.229 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:50:34.231 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:51:04.404 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:51:04.407 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:51:04.409 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:51:04.411 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:51:34.590 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:51:34.593 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:51:34.596 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:51:34.598 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:52:04.651 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:52:04.655 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:52:04.657 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:52:04.660 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:52:34.708 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:52:34.711 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:52:34.714 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:52:34.716 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:53:04.843 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:53:04.906 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:53:04.909 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:53:04.912 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:53:35.030 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:53:35.034 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:53:35.037 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:53:35.039 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:54:05.134 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:54:05.137 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:54:05.140 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:54:05.142 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:54:35.239 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:54:35.242 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:54:35.245 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:54:35.247 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:55:05.368 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:55:05.371 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:55:05.374 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:55:05.378 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:55:35.489 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:55:35.491 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:55:35.494 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:55:35.496 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:56:05.602 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:56:05.605 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:56:05.607 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:56:05.610 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:56:35.792 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:56:35.795 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:56:35.798 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:56:35.800 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:57:05.976 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:57:05.979 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:57:05.981 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:57:05.983 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:57:36.281 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:57:36.285 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:57:36.287 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:57:36.289 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:58:06.430 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:58:06.432 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:58:06.435 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:58:06.437 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:58:36.539 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:58:36.542 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:58:36.544 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:58:36.546 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:59:06.780 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:59:06.783 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:59:06.786 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:59:06.788 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:59:36.923 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:59:36.926 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:59:36.928 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T08:59:36.930 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:00:07.035 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:00:07.038 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:00:07.041 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:00:07.043 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:00:37.314 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:00:37.317 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:00:37.319 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:00:37.321 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:01:07.427 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:01:07.430 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:01:07.432 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:01:07.435 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:01:37.559 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:01:37.562 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:01:37.564 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:01:37.566 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:02:07.831 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:02:07.834 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:02:07.837 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:02:07.840 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:02:37.932 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:02:37.935 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:02:37.937 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:02:37.939 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:03:08.064 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:03:08.068 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:03:08.070 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:03:08.072 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:03:38.174 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:03:38.188 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:03:38.191 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:03:38.200 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:04:08.303 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:04:08.307 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:04:08.310 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:04:08.312 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:04:38.424 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:04:38.428 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:04:38.430 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:04:38.432 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:05:08.553 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:05:08.555 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:05:08.557 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:05:08.560 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:05:38.682 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:05:38.685 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:05:38.687 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:05:38.689 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:06:08.820 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:06:08.823 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:06:08.825 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:06:08.828 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:06:38.915 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:06:38.919 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:06:38.921 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:06:38.924 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:07:09.104 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:07:09.106 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:07:09.109 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:07:09.111 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:07:39.216 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:07:39.219 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:07:39.222 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:07:39.225 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:08:09.457 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:08:09.489 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:08:09.492 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:08:09.494 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:08:39.583 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:08:39.588 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:08:39.590 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:08:39.592 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:09:09.849 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:09:09.852 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:09:09.856 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:09:09.859 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:09:39.966 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:09:39.969 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:09:39.971 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:09:39.973 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:10:10.082 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:10:10.085 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:10:10.088 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:10:10.090 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:10:40.227 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:10:40.229 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:10:40.231 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:10:40.234 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:11:10.354 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:11:10.357 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:11:10.360 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:11:10.362 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:11:40.476 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:11:40.479 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:11:40.481 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:11:40.483 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:12:10.612 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:12:10.615 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:12:10.617 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:12:10.619 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:12:40.872 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:12:40.898 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:12:40.901 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:12:40.903 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:13:11.051 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:13:11.055 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:13:11.058 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:13:11.060 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:13:41.185 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:13:41.187 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:13:41.190 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:13:41.192 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:14:11.322 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:14:11.325 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:14:11.329 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:14:11.331 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:14:41.451 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:14:41.453 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:14:41.456 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:14:41.458 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:15:11.582 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:15:11.615 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:15:11.618 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:15:11.620 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:15:41.923 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:15:41.926 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:15:41.929 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:15:41.931 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:16:12.040 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:16:12.043 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:16:12.048 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:16:12.051 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:16:42.161 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:16:42.177 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:16:42.181 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:16:42.188 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:17:12.307 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:17:12.343 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:17:12.346 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:17:12.349 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:17:42.452 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:17:42.455 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:17:42.457 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:17:42.459 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:18:12.595 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:18:12.598 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:18:12.601 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:18:12.603 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:18:42.945 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:18:42.949 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:18:42.951 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:18:42.953 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:19:13.082 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:19:13.105 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:19:13.108 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:19:13.112 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:19:43.237 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:19:43.241 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:19:43.243 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:19:43.245 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:20:13.350 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:20:13.355 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:20:13.359 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:20:13.361 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:20:43.463 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:20:43.466 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:20:43.469 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:20:43.471 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:21:13.595 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:21:13.598 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:21:13.602 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:21:13.606 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:21:43.724 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:21:43.729 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:21:43.733 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:21:43.736 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:22:13.943 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:22:13.945 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:22:13.948 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:22:13.950 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:22:44.054 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:22:44.060 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:22:44.076 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:22:44.088 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:23:14.222 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:23:14.225 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:23:14.228 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:23:14.231 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:23:44.288 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:23:44.320 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:23:44.322 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:23:44.325 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:24:14.476 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:24:14.480 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:24:14.483 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:24:14.486 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:24:44.588 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:24:44.591 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:24:44.594 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:24:44.596 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:25:14.684 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:25:14.689 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:25:14.692 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:25:14.695 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:25:44.976 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:25:44.979 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:25:44.984 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:25:44.987 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:26:15.084 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:26:15.087 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:26:15.091 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:26:15.093 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:26:45.188 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:26:45.191 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:26:45.194 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:26:45.196 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:27:15.334 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:27:15.347 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:27:15.358 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:27:15.366 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:27:45.420 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:27:45.423 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:27:45.425 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:27:45.428 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:28:15.559 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:28:15.562 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:28:15.565 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:28:15.567 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:28:45.727 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:28:45.755 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:28:45.759 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:28:45.761 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:29:16.007 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:29:16.010 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:29:16.013 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:29:16.015 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:29:46.136 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:29:46.139 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:29:46.141 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:29:46.144 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:30:16.261 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:30:16.266 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:30:16.269 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:30:16.271 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:30:46.384 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:30:46.411 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:30:46.414 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:30:46.416 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:31:16.541 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:31:16.545 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:31:16.547 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:31:16.550 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:31:46.661 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:31:46.672 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:31:46.680 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:31:46.682 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:32:16.953 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:32:16.957 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:32:16.961 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:32:16.965 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:32:47.009 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:32:47.035 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:32:47.038 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:32:47.041 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:33:17.207 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:33:17.210 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:33:17.213 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:33:17.215 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:33:47.324 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:33:47.327 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:33:47.330 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:33:47.333 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:34:17.437 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:34:17.452 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:34:17.466 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:34:17.479 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:34:47.574 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:34:47.595 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:34:47.598 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:34:47.601 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:35:17.727 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:35:17.730 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:35:17.733 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:35:17.735 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:35:47.848 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:35:47.851 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:35:47.854 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:35:47.856 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:36:17.971 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:36:17.974 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:36:17.976 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:36:17.979 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:36:48.091 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:36:48.094 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:36:48.096 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:36:48.098 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:37:18.295 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:37:18.299 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:37:18.301 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:37:18.303 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:37:48.454 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:37:48.461 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:37:48.466 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:37:48.478 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:38:18.579 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:38:18.582 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:38:18.585 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:38:18.587 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:38:48.691 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:38:48.731 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:38:48.734 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:38:48.736 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:39:18.838 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:39:18.861 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:39:18.884 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:39:18.891 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:39:49.001 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:39:49.004 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:39:49.006 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:39:49.008 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:40:19.115 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:40:19.119 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:40:19.124 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:40:19.126 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:40:49.359 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:40:49.363 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:40:49.365 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:40:49.367 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:41:19.480 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:41:19.483 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:41:19.486 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:41:19.488 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:41:49.538 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:41:50.752 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:41:50.754 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:41:50.756 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:42:20.814 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:42:20.831 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:42:20.844 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:42:20.860 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:42:50.987 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:42:50.990 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:42:50.992 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:42:50.994 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:43:21.130 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:43:21.133 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:43:21.136 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:43:21.138 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:43:51.243 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:43:51.246 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:43:51.249 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:43:51.251 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:44:21.347 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:44:21.402 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:44:21.404 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:44:21.406 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:44:51.526 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:44:51.529 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:44:51.532 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:44:51.534 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:45:21.647 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:45:21.651 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:45:21.653 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:45:21.656 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:45:51.771 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:45:51.774 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:45:51.777 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:45:51.779 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:46:21.889 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:46:21.901 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:46:21.905 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:46:21.917 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:46:52.029 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:46:52.032 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:46:52.035 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:46:52.037 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:47:22.341 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:47:22.344 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:47:22.346 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:47:22.348 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:47:52.462 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:47:52.465 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:47:52.467 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:47:52.469 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:48:22.599 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:48:22.602 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:48:22.604 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:48:22.606 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:48:52.729 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:48:52.734 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:48:52.740 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:48:52.753 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:49:22.849 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:49:22.852 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:49:22.854 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:49:22.857 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:49:53.162 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:49:53.168 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:49:53.172 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:49:53.175 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:50:23.299 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:50:23.306 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:50:23.315 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:50:23.332 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:50:53.437 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:50:53.440 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:50:53.443 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:50:53.445 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:51:23.542 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:51:23.545 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:51:23.547 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:51:23.550 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:51:53.647 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:51:53.684 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:51:53.686 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:51:53.688 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:52:23.817 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:52:23.820 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:52:23.822 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:52:23.824 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:52:53.946 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:52:53.949 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:52:53.951 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:52:53.953 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:53:24.082 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:53:24.086 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:53:24.089 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:53:24.093 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:53:54.204 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:53:54.208 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:53:54.210 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:53:54.212 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:54:24.349 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:54:24.352 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:54:24.355 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:54:24.357 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:54:54.471 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:54:54.474 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:54:54.476 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:54:54.478 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:55:24.593 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:55:24.596 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:55:24.599 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:55:24.602 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:55:54.730 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:55:54.734 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:55:54.736 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:55:54.741 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:56:24.852 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:56:24.855 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:56:24.857 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:56:24.860 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:56:54.980 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:56:54.983 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:56:54.985 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:56:54.987 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:57:25.343 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:57:25.346 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:57:25.348 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:57:25.350 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:57:55.464 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:57:55.467 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:57:55.470 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:57:55.472 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:58:25.593 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:58:25.596 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:58:25.598 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:58:25.601 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:58:55.725 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:58:55.728 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:58:55.731 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:58:55.734 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:59:25.843 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:59:25.846 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:59:25.848 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:59:25.850 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:59:55.964 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:59:55.967 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:59:55.970 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T09:59:55.972 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:00:26.077 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:00:26.081 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:00:26.083 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:00:26.085 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:00:56.181 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:00:56.184 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:00:56.187 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:00:56.189 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:01:26.278 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:01:26.280 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:01:26.283 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:01:26.285 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:01:56.391 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:01:56.393 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:01:56.396 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:01:56.398 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:02:26.578 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:02:26.582 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:02:26.585 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:02:26.588 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:02:56.682 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:02:56.685 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:02:56.688 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:02:56.690 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:03:26.811 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:03:26.813 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:03:26.816 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:03:26.820 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:03:56.933 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:03:56.947 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:03:56.957 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:03:56.970 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:04:27.079 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:04:27.082 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:04:27.084 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:04:27.087 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:04:57.226 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:04:57.239 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:04:57.247 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:04:57.259 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:05:27.371 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:05:27.374 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:05:27.376 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:05:27.379 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:05:57.518 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:05:57.526 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:05:57.529 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:05:57.532 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:06:27.622 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:06:27.625 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:06:27.627 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:06:27.629 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:06:57.750 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:06:57.752 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:06:57.755 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:06:57.758 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:07:28.022 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:07:28.025 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:07:28.028 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:07:28.030 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:07:58.127 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:07:58.129 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:07:58.132 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:07:58.134 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:08:28.238 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:08:28.241 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:08:28.243 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:08:28.246 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:08:58.351 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:08:58.354 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:08:58.358 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:08:58.360 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:09:28.489 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:09:28.498 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:09:28.529 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:09:28.537 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:09:58.642 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:09:58.645 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:09:58.648 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:09:58.650 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:10:28.763 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:10:28.766 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:10:28.768 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:10:28.770 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:10:58.877 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:10:58.880 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:10:58.882 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:10:58.884 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:11:28.981 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:11:28.984 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:11:28.986 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:11:28.988 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:11:59.118 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:11:59.122 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:11:59.125 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:11:59.127 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:12:29.316 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:12:29.321 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:12:29.325 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:12:29.331 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:12:59.461 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:12:59.464 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:12:59.467 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:12:59.471 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:13:29.573 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:13:29.576 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:13:29.578 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:13:29.580 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:13:59.686 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:13:59.707 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:13:59.713 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:13:59.733 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:14:29.848 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:14:29.853 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:14:29.857 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:14:29.862 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:14:59.961 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:14:59.977 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:14:59.989 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:14:59.998 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:15:30.098 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:15:30.102 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:15:30.105 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:15:30.107 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:16:00.203 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:16:00.206 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:16:00.208 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:16:00.210 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:16:30.332 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:16:30.336 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:16:30.341 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:16:30.344 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:17:00.436 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:17:00.439 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:17:00.442 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:17:00.444 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:17:30.555 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:17:30.558 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:17:30.560 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:17:30.562 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:18:00.713 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:18:00.716 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:18:00.718 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:18:00.721 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:18:30.815 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:18:30.818 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:18:30.820 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:18:30.822 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:19:00.911 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:19:00.915 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:19:00.918 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:19:00.920 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:19:31.032 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:19:31.036 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:19:31.038 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:19:31.041 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:20:01.153 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:20:01.156 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:20:01.159 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:20:01.161 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:20:31.249 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:20:31.252 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:20:31.254 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:20:31.256 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:21:01.379 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:21:01.388 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:21:01.391 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:21:01.393 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:21:31.501 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:21:31.504 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:21:31.507 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:21:31.509 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:22:01.630 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:22:01.633 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:22:01.636 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:22:01.638 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:22:31.693 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:22:31.696 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:22:31.698 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:22:31.701 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:23:01.831 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:23:01.834 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:23:01.836 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:23:01.838 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:23:31.958 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:23:31.961 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:23:31.963 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:23:31.966 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:24:02.072 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:24:02.075 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:24:02.085 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:24:02.089 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:24:32.395 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:24:32.398 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:24:32.401 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:24:32.403 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:25:02.515 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:25:02.518 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:25:02.521 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:25:02.523 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:25:32.636 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:25:32.640 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:25:32.642 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:25:32.645 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:26:02.702 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:26:02.705 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:26:02.707 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:26:02.710 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:26:32.810 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:26:32.813 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:26:32.815 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:26:32.817 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:27:02.923 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:27:02.926 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:27:02.929 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:27:02.931 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:27:32.994 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:27:32.997 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:27:32.999 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:27:33.001 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:28:03.124 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:28:03.127 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:28:03.129 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:28:03.131 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:28:33.446 INFO:teuthology.orchestra.run.smithi060:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:28:33.449 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:28:33.451 INFO:teuthology.orchestra.run.smithi085:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:28:33.454 INFO:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-01T10:28:59.549 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-11-01T10:28:59.550 DEBUG:teuthology.task.console_log:Killing console logger for smithi060 2020-11-01T10:28:59.551 DEBUG:teuthology.task.console_log:Killing console logger for smithi066 2020-11-01T10:28:59.551 DEBUG:teuthology.task.console_log:Killing console logger for smithi152 2020-11-01T10:28:59.552 DEBUG:teuthology.task.console_log:Killing console logger for smithi085 2020-11-01T10:28:59.552 DEBUG:teuthology.task.console_log:Killing console logger for smithi060 2020-11-01T10:28:59.552 DEBUG:teuthology.task.console_log:Killing console logger for smithi066 2020-11-01T10:28:59.552 DEBUG:teuthology.task.console_log:Killing console logger for smithi152 2020-11-01T10:28:59.553 DEBUG:teuthology.task.console_log:Killing console logger for smithi085 2020-11-01T10:28:59.553 DEBUG:teuthology.exit:Finished running handlers